-- Logs begin at Tue 2022-08-09 13:44:12 UTC, end at Tue 2022-08-09 16:11:16 UTC. -- Aug 09 14:20:06.331530 n-d-844626-8 systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 14:20:06.340487 n-d-844626-8 devstack@n-api.service[103912]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 14:20:06.342479 n-d-844626-8 devstack@n-api.service[103912]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 14:20:06 2022] *** Aug 09 14:20:06.342479 n-d-844626-8 devstack@n-api.service[103912]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 14:20:06.342479 n-d-844626-8 devstack@n-api.service[103912]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 14:20:06.342479 n-d-844626-8 devstack@n-api.service[103912]: nodename: n-d-844626-8 Aug 09 14:20:06.342479 n-d-844626-8 devstack@n-api.service[103912]: machine: x86_64 Aug 09 14:20:06.342479 n-d-844626-8 devstack@n-api.service[103912]: clock source: unix Aug 09 14:20:06.342479 n-d-844626-8 devstack@n-api.service[103912]: pcre jit disabled Aug 09 14:20:06.342479 n-d-844626-8 devstack@n-api.service[103912]: detected number of CPU cores: 4 Aug 09 14:20:06.342479 n-d-844626-8 devstack@n-api.service[103912]: current working directory: / Aug 09 14:20:06.342479 n-d-844626-8 devstack@n-api.service[103912]: detected binary path: /usr/bin/uwsgi-core Aug 09 14:20:06.343286 n-d-844626-8 devstack@n-api.service[103912]: your processes number limit is 47680 Aug 09 14:20:06.343286 n-d-844626-8 devstack@n-api.service[103912]: your memory page size is 4096 bytes Aug 09 14:20:06.343286 n-d-844626-8 devstack@n-api.service[103912]: detected max file descriptor number: 2048 Aug 09 14:20:06.343286 n-d-844626-8 devstack@n-api.service[103912]: lock engine: pthread robust mutexes Aug 09 14:20:06.343286 n-d-844626-8 devstack@n-api.service[103912]: thunder lock: enabled Aug 09 14:20:06.343286 n-d-844626-8 devstack@n-api.service[103912]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 14:20:06.343286 n-d-844626-8 devstack@n-api.service[103912]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 14:20:06.381203 n-d-844626-8 devstack@n-api.service[103912]: Python main interpreter initialized at 0x5587371b89c0 Aug 09 14:20:06.381203 n-d-844626-8 devstack@n-api.service[103912]: python threads support enabled Aug 09 14:20:06.381203 n-d-844626-8 devstack@n-api.service[103912]: your server socket listen backlog is limited to 100 connections Aug 09 14:20:06.381203 n-d-844626-8 devstack@n-api.service[103912]: your mercy for graceful operations on workers is 90 seconds Aug 09 14:20:06.381556 n-d-844626-8 devstack@n-api.service[103912]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 14:20:06.381556 n-d-844626-8 devstack@n-api.service[103912]: *** Operational MODE: preforking *** Aug 09 14:20:06.381853 n-d-844626-8 devstack@n-api.service[103912]: *** uWSGI is running in multiple interpreter mode *** Aug 09 14:20:06.381853 n-d-844626-8 devstack@n-api.service[103912]: spawned uWSGI master process (pid: 103912) Aug 09 14:20:06.382049 n-d-844626-8 systemd[1]: Started Devstack devstack@n-api.service. Aug 09 14:20:06.382976 n-d-844626-8 devstack@n-api.service[103912]: spawned uWSGI worker 1 (pid: 103913, cores: 1) Aug 09 14:20:06.382976 n-d-844626-8 devstack@n-api.service[103912]: spawned uWSGI worker 2 (pid: 103914, cores: 1) Aug 09 14:20:06.382976 n-d-844626-8 devstack@n-api.service[103912]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 14:20:07.026231 n-d-844626-8 devstack@n-api.service[103914]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 14:20:07.031687 n-d-844626-8 devstack@n-api.service[103913]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 14:20:08.097149 n-d-844626-8 devstack@n-api.service[103914]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 14:20:08.097149 n-d-844626-8 devstack@n-api.service[103914]: from cryptography.utils import int_from_bytes Aug 09 14:20:08.097758 n-d-844626-8 devstack@n-api.service[103913]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 14:20:08.097758 n-d-844626-8 devstack@n-api.service[103913]: from cryptography.utils import int_from_bytes Aug 09 14:20:08.098146 n-d-844626-8 devstack@n-api.service[103914]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 14:20:08.098146 n-d-844626-8 devstack@n-api.service[103914]: from cryptography.utils import int_from_bytes Aug 09 14:20:08.098307 n-d-844626-8 devstack@n-api.service[103913]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 14:20:08.098307 n-d-844626-8 devstack@n-api.service[103913]: from cryptography.utils import int_from_bytes Aug 09 14:20:10.531352 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 14:20:10.531917 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 14:20:10.532091 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 14:20:10.532452 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 14:20:10.532701 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 14:20:10.532833 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 14:20:10.533208 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.533300 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 14:20:10.533386 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.533573 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 14:20:10.533717 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.533935 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 14:20:10.534079 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.534168 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 14:20:10.534264 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.534565 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.534709 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.534877 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.535019 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.535218 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.535369 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.535525 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.535684 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.535818 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.535949 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.536093 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.536224 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.536352 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-844626-8 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.536480 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.536678 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.536870 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.537016 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.537153 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.537277 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.537397 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.537518 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.537654 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.537808 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.537946 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-844626-8 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.538147 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.538327 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.538478 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.538632 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.538770 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.538898 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.539365 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.539485 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.539589 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.539709 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.539823 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.539939 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.540188 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.540411 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.540652 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.540788 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.540933 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.541058 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.541194 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.541323 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.541454 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.541666 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.541846 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.541978 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.542104 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.542271 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.542410 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-844626-8 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.542610 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.542799 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.542944 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.543071 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.543232 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.543355 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.543539 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.543675 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.543841 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.543977 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.544241 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.544375 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-844626-8 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.544560 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.544776 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.544916 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.545038 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.545173 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.545302 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.545437 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.545566 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.545759 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.545896 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.546063 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.546200 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.546385 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.546513 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.546646 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.546778 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.546965 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.547129 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.547298 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.547438 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.547613 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.547750 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.547904 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.548039 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.548199 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.548328 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.548456 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.548587 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.548709 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.548894 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.549035 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.549158 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.549336 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.549483 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.549636 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.549769 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.549898 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.550022 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.550142 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.550273 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.550395 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.550518 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.550716 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.550860 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.550982 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.551152 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.551320 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.551480 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.551611 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.551741 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.551919 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.552060 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.552195 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.552318 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.552505 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.552644 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.552769 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.552897 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.553084 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.553243 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.553378 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.553500 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.553673 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.553810 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.553997 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.554126 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.554286 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.554423 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.554604 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.554732 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.554949 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.555137 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.555276 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.555400 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.555598 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.555729 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.555921 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.556050 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.556219 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.556355 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.556546 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.556673 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.556854 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.556992 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.557157 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.557286 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.557466 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.557603 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.557756 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.557895 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.558055 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.558184 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.558372 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.558501 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.558691 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.558836 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.558969 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.559200 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.559325 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.559446 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.559579 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.559712 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.559834 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.559962 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.560083 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.560211 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.560372 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.560508 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.560681 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.560809 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.560969 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.561106 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.561236 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.561359 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.561553 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.561682 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.561854 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.561982 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.562143 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.562271 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.562451 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.562589 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.562712 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.562832 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.563021 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.563183 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.563316 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.563447 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.563623 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.563751 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.563911 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.564048 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.564227 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.564356 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.564533 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.564670 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.564824 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.564955 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.565115 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.565257 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.565410 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.565550 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.565681 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.565804 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.566011 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.566139 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.566291 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.566428 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.566600 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.566736 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.566912 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.567038 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.567207 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.567345 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.567522 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.567669 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.567799 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.567920 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.568114 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.568251 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.568405 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.568534 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.568719 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.568848 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.568982 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.569112 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.569293 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.569436 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.569589 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.569718 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.569899 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.570106 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.570230 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.570357 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.570798 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.570929 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.571110 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.571252 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.571433 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.571562 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.571730 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.571866 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.571999 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.572121 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.572307 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.572435 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.572586 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.572714 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.572899 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.573033 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.573205 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.573333 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.573491 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.573618 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.573783 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.573923 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.574083 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.574217 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.574392 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.574519 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.574706 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.574842 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.575028 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.575191 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.575346 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.575486 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.575671 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.575799 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.575950 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.576086 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.576281 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:20:10.576418 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.576608 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.576735 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.576913 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.577042 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.577222 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.577359 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.577538 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.577677 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.577831 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.577959 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.578150 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.578280 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.578457 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.578586 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.578767 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.578905 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.579065 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.579250 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.579427 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.579555 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.579737 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.579878 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.580045 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.580201 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.580336 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.580458 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.580657 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.580785 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.580971 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.581108 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.581288 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.581417 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.581604 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.581737 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.581902 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.582030 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.582229 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.582355 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.582541 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.582670 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.582859 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.582990 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.583195 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.583322 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.583513 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.583655 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.583808 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.583937 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.584122 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.584250 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.584446 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.584582 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.584717 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.584839 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.585047 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.585186 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.585356 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.585495 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.585667 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.585796 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.585976 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.586104 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.586292 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.586426 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.586618 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.586755 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.586889 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.587011 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.587228 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.587360 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.587566 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.587704 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.587881 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.588020 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.588151 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.588275 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.588469 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.588606 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.588778 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.588908 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.589071 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.589218 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.589373 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.589513 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.589686 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.589814 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.589963 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.590096 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.590257 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.590399 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.590551 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.590680 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.590863 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.590999 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.591170 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.591300 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.591502 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.591637 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.591770 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.591891 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.592079 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.592204 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.592383 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.592588 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.592723 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.592843 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.592966 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.593101 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.593269 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.593403 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.593572 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.593698 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.593870 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.593995 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.594175 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.594309 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.594479 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.594619 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.594779 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.594916 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.595106 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.595234 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.595415 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.595538 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.595714 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.595839 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.596026 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.596160 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.596322 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.596445 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.596619 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.596745 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.596924 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.597059 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.597231 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.597356 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.597535 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.597660 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.597834 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.597959 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.598139 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.598272 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.598440 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.598573 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.598747 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.598871 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.599055 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.599201 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.599392 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.599527 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.599703 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.599843 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.600009 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.600133 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.600325 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.600460 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.600636 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.600763 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.600944 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.601078 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.601243 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.601377 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.601552 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.601678 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.601877 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.602013 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.602175 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.602302 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.602476 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.602610 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.602781 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.602908 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.603124 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.603255 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.603403 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.603529 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.603703 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.603829 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.604002 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.604133 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.604298 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.604424 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.604614 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.604739 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.604917 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.605054 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.605217 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.605350 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.605514 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.605650 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.605815 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.605948 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.606118 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.606244 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.606435 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.606573 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.606743 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.606867 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.607049 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.607196 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.607379 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.607516 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.607682 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.607808 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.607998 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.608122 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.608305 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.608445 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.608609 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.608734 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.608915 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.609040 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.609220 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.609347 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.609524 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.609650 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.609834 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.609959 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.610138 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.610265 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.610449 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.610574 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.610750 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.610875 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.611061 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.611239 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.611392 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.611518 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.611702 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.611819 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.611998 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.612124 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.612309 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.612434 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.612615 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.612739 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.612936 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.613062 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.613246 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.613372 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.613557 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.613696 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.613859 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.613983 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.614163 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.614295 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.614468 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.614608 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.614771 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.614903 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.615072 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.615220 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.615397 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.615542 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.615707 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.615834 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.616010 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.616135 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.616319 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.616462 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.616621 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.616747 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.616934 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.617068 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.617236 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.617391 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.617604 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.617729 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.617911 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.618035 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.618217 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.618343 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.618523 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.618648 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.618845 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.618970 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.619166 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.619290 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.619462 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.619599 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.619768 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.619900 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.620068 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.620193 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.620371 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.620504 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.620675 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.620879 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.621004 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.621134 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.621255 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.621367 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.621551 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.621690 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.621857 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.621995 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.622158 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.622291 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.622457 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.622597 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.622754 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.622880 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.623060 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.623207 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.623391 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.623527 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.623704 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.623830 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.624016 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.624142 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.624316 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.624441 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.624617 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.624741 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.624916 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.625040 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.625221 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.625346 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.625524 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.625649 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.625817 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.625942 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.626112 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.626239 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.626423 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.626549 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.626723 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.626851 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.627019 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.627207 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.627331 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.627452 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.627625 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.627757 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.627938 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.628065 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.628244 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.628376 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.628541 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.628676 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.628842 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.628967 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.629143 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.629278 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.629444 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.629578 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.629750 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.629875 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.630050 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.630186 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.630352 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.630487 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.630663 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.630788 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.630966 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.631111 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.631292 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.631432 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.631602 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.631734 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.631903 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.632020 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.632205 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.632392 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.632516 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.632637 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.632807 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.632933 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.633132 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.633258 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.633436 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.633570 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.633742 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.633865 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.634037 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.634161 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.634337 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.634463 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.634646 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.634772 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.634954 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.635232 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.635361 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.635556 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.635681 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.635864 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.635990 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.636171 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.636295 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.636478 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.636602 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.636789 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.637045 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.637171 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.637381 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.637506 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.637699 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.637837 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.638016 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.638149 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.638319 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.638453 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.638615 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.638749 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.638912 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.639045 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.639242 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.639369 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.639540 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.639666 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.639838 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.639977 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.640138 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.640262 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.640441 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.640565 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.640738 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.640872 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.641036 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.641170 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.641336 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.641462 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.641633 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.641768 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.641937 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.642062 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.642235 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.642359 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.642537 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.642669 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.642832 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.642965 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.643139 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.643275 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.643448 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.643574 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.643745 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.643869 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.644042 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.644175 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.644370 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.644495 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.644641 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.644764 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.644948 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.645072 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.645259 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.645392 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.645568 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.645693 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.645873 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.646007 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.646177 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.646302 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.646474 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.646598 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.646790 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.646924 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.647103 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.647231 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.647405 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.647530 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.647700 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.647843 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.648001 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.648126 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.648303 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.648428 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.648617 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.648768 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.648980 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.649115 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.649284 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.649422 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.649588 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.649714 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.649889 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.650014 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.650186 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.650312 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.650488 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.650623 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.650784 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.650910 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.651107 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.651246 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.651418 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.651545 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.651712 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.651836 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.652008 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.652144 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.652311 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.652437 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.652611 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.652735 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.652907 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.653040 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.653210 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.653377 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.653503 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.653623 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.653795 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.653930 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.654092 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.654216 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.654388 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.654513 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.654683 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.654823 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.654986 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.655146 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.655308 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.655433 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.655606 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.655736 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.655909 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.656031 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.656208 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.656340 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.656505 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.656633 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.656803 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.656927 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.657103 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.657228 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.657401 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.657529 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.657696 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.657830 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.657996 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.658121 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.658302 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.658426 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.658604 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.658737 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.658898 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.659029 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.659221 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.659344 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.659513 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.659638 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.659809 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.659941 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.660106 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.660231 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.660406 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.660543 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.660700 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.660834 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.660996 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.661122 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.661293 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.661419 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.661597 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.661730 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.661891 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.662014 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.662196 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.662312 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.662495 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.662620 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.662793 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.662919 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.663101 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.663226 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.663409 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.663535 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.663708 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.663833 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.664029 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.664152 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.664360 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.664494 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.664664 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.664802 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.664965 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.665097 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.665265 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.665391 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.665572 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.665696 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.665883 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.666008 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.666189 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.666314 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.666488 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.666612 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.666796 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.666929 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.667114 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.667243 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.667422 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.667547 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.667719 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.667854 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.668015 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.668140 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.668327 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.668452 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.668631 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.668768 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.668934 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.669060 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.669243 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.669373 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.669544 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.669678 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.669847 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.669973 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.670140 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.670263 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.670441 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.670567 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.670740 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.670865 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.671039 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.671179 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.671380 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.671515 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.671681 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.671809 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.671984 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.672108 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.672305 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.672419 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.672580 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.672715 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.672878 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.673002 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.673179 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.673306 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.673478 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.673604 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.673779 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.673912 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.674080 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.674215 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.674377 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.674503 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.674685 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.674816 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.674984 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.675167 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.675295 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.675416 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.675594 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.675728 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.675890 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.676015 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.676192 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.676318 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.676489 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.676623 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.676805 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.676928 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.677108 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.677240 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.677415 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.677541 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.677720 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.677844 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.678031 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.678156 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.678336 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.678462 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.678641 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.678772 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.678945 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.679070 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.679264 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.679402 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.679662 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.679785 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.680017 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.680145 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.680328 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.680453 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.680629 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.680752 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.680927 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.681061 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.681222 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.681347 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.681531 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.681657 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.681846 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.682030 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.682156 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.682277 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.682413 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.682526 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.682707 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.682842 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.683022 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.683215 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.683349 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.683484 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.683642 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.683780 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.684014 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.684138 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.684316 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.684449 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.684632 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.684759 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.684920 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.685055 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.685224 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.685349 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.685539 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.685669 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.685894 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.686017 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.686207 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.686333 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.686524 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.686650 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.686821 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.686948 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.687147 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.687289 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.687451 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.687578 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.687768 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.687919 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.688082 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.688209 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.688383 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.688517 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.688688 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.688815 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.688985 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.689112 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.689298 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.689434 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.689613 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.689739 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.689918 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.690045 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.690229 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.690364 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.690545 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.690677 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.690853 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.690980 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.691197 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.691338 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.691522 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.691647 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.691834 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.691960 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.692146 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.692279 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.692445 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.692578 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.692746 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.692882 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.693043 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.693179 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.693341 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.693479 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.693655 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.693782 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.693952 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.694078 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.694258 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.694395 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.694559 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.694686 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.694858 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.694984 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.695176 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.695317 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.695820 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.695950 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.696138 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.696266 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.696435 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.696560 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.696747 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.696882 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.697051 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.697177 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.697363 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.697490 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.697669 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.697808 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.697965 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.698090 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.698277 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.698402 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.698574 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.698708 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.698871 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.698997 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.699189 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.699329 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.699487 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.699622 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.699818 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.699947 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.700115 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.700253 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.700428 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.700565 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.700733 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.700864 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.701038 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.701171 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.701344 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.701472 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.701664 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.701789 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.701978 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.702110 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.702287 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.702412 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.702600 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.702718 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.702919 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.703046 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.703250 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.703376 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.703547 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.703673 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.703848 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.703983 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.704146 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.704280 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.704442 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.704568 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.704738 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.704872 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.705039 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.705166 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.705337 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.705466 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.705632 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.705773 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.705930 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.706056 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.706244 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.706370 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.706539 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.706674 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.706853 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.706980 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.707176 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.707302 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.707476 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.707602 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.707772 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.707905 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.708069 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.708196 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.708386 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.708510 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.708685 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.708809 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.709000 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.709124 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.709300 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.709425 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.709601 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.709725 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.709904 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.710030 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.710211 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.710336 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.710515 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.710644 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.710821 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.710994 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.711160 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.711311 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.711491 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.711630 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.711798 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.711932 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.712099 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.712224 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.712405 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.712531 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.712708 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.712835 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.713019 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.713154 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.713336 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.713527 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.713661 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.713849 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.713976 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.714158 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.714284 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.714463 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.714598 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.714767 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.714894 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.715073 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.715378 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.715504 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.715689 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.715815 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.715996 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.716122 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.716298 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.716425 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.716599 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.716726 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.716913 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.717037 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.717226 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.717361 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.717538 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.717664 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.717849 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.717975 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.718158 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.718368 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.718494 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.718615 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.718759 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.718885 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.719063 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.719227 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.719425 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.719592 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.719720 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.719840 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.720022 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.720157 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.720329 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.720457 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.720635 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.720762 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.720944 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.721071 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.721247 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.721374 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.721555 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.721689 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.721862 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.721989 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.722165 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.722291 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.722468 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.722604 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.722773 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.722892 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.723077 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.723251 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.723404 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.723544 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.723714 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.723839 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.724026 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.724152 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.724335 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.724462 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.724640 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.724764 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.724948 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.725081 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.725284 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.725400 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.725569 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.725757 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.725883 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.726074 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.726210 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.726403 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.726537 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.726723 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.726868 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.727060 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.727209 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.727394 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.727673 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.727798 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.727988 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.728126 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.728304 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.728431 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.728602 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.728730 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.728905 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.729040 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.729209 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.729335 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.729508 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.729633 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.729820 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.729955 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.730125 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.730251 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.730422 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.730547 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.730726 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.730852 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.731026 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.731205 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.731341 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.731581 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.731722 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.731919 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.732053 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.732228 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.732354 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.732547 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.732685 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.732852 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.732977 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.733160 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.733388 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.733525 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.733736 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.733862 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.734045 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.734170 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.734344 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.734479 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.734653 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.734780 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.734958 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.735105 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.735280 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.735420 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.735578 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.735704 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.735882 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.736019 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.736185 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.736320 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.736574 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.736703 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.736825 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.736946 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.737103 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.737239 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.737363 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.737484 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.737648 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.737775 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.737945 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.738072 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.738241 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.738360 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.738546 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.738677 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.738841 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.738968 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.739160 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.739290 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.739459 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.739590 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.739757 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.739884 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.740057 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.740182 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.740351 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.740476 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.740653 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.740780 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.740951 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.741076 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.741251 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.741390 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.741547 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.741671 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.741847 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.741972 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.742142 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.742276 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.742494 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.742621 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.742800 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.742933 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.743135 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.743279 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.743440 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.743567 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.743748 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.743875 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.744049 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.744184 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.744360 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.744485 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.744661 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.744785 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.744993 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.745119 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.745303 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.745429 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.745611 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.745829 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.745969 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.746156 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.746290 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.746470 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.746604 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.746794 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.746930 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.747142 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.747271 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.747447 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.747720 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.747847 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.748029 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.748155 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.748349 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.748475 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.748658 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.748794 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.748960 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.749086 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.749266 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.749391 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.749569 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.749706 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.749875 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.750001 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.750176 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.750302 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.750481 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.750615 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.750782 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.750910 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.751112 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.751243 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.751412 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.751549 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.751715 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.751843 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.752019 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.752152 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.752321 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.752448 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.752625 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.752751 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.752930 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.753062 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.753240 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.753402 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.753535 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.753658 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.753846 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.754057 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.754192 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.754315 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.754437 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.754558 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.754747 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.754880 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.755051 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.755228 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.755384 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.755524 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.755687 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.755828 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.755996 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.756123 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.756316 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.756437 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.756623 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.756748 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.756920 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.757046 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.757226 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.757350 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.757536 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.757663 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.757849 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.758001 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.758199 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.758327 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.758514 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.758640 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.758817 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.758949 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.759175 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.759317 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.759484 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.759625 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.759801 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.759927 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.760106 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.760247 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.760434 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.760560 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.760765 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.760899 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.761087 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.761225 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.761398 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.761524 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.761698 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.761832 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.761996 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.762132 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.762296 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.762426 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.762598 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.762733 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.762914 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.763049 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.763242 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.763372 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.763542 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.763682 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.763838 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.763965 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.764141 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.764268 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.764441 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.764580 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.764740 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.764867 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.765036 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.765170 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.765333 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.765469 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.765636 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.765762 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.765934 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.766067 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.766230 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.766364 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.766526 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.766652 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.766821 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.766954 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.767134 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.767276 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.767432 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.767561 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.767733 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.767859 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.768029 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.768166 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.768325 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.768451 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.768619 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.768744 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.768914 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.769041 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.769207 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.769333 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.769513 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.769646 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.769818 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.769944 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.770121 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.770246 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.770422 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.770548 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.770721 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.770854 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.771018 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.771174 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.771354 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.771490 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.771667 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.771796 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.771979 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.772113 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.772286 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.772420 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.772587 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.772712 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.772903 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.773041 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.773204 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.773337 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.773509 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.773681 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.773875 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.773999 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.774186 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.774322 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.774488 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.774614 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.774791 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.774919 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.775133 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.775277 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.775450 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.775582 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.775752 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.775876 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.776063 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.776189 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.776372 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.776506 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.776681 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.776807 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.776989 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.777122 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.777296 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.777422 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.777610 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.777736 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.777914 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.778041 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.778217 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.778343 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.778519 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.778654 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.778822 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.778948 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.779141 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.779270 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.779454 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.779593 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.779757 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.779883 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.780062 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.780188 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.780372 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.780504 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.780678 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.780804 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.780986 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.781118 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.781301 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.781471 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.781604 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.781727 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.781905 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.782030 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.782226 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.782351 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.782519 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.782645 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.782836 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.782961 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.783180 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.783308 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.783491 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.783627 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.783803 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.783939 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.784109 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.784236 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.784409 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.784535 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.784658 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103914) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 14:20:10.784792 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.785082 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.785410 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.785722 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.786036 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.786340 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:20:10.786581 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103913) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 14:20:10.937501 n-d-844626-8 devstack@n-api.service[103914]: INFO dbcounter [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Registered counter for database nova_api Aug 09 14:20:10.939147 n-d-844626-8 devstack@n-api.service[103913]: INFO dbcounter [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Registered counter for database nova_api Aug 09 14:20:10.960811 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_db.sqlalchemy.engines [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:20:10.962346 n-d-844626-8 devstack@n-api.service[103914]: DEBUG oslo_db.sqlalchemy.engines [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:20:10.968012 n-d-844626-8 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writer thread running {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:20:10.969198 n-d-844626-8 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writer thread running {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:20:11.023229 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.context [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) {{(pid=103914) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 14:20:11.023523 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.context [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) {{(pid=103913) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 14:20:11.027073 n-d-844626-8 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:20:11.027331 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:20:11.027516 n-d-844626-8 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:20:11.027770 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:20:11.029118 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:20:11.029266 n-d-844626-8 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:20:11.029843 n-d-844626-8 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:20:11.029978 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:20:11.030280 n-d-844626-8 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:20:11.030416 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:20:11.032356 n-d-844626-8 devstack@n-api.service[103914]: DEBUG oslo_concurrency.lockutils [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103914) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:20:11.032487 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:20:11.034283 n-d-844626-8 devstack@n-api.service[103914]: INFO dbcounter [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Registered counter for database nova_cell0 Aug 09 14:20:11.034419 n-d-844626-8 devstack@n-api.service[103913]: INFO dbcounter [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Registered counter for database nova_cell0 Aug 09 14:20:11.040012 n-d-844626-8 devstack@n-api.service[103913]: INFO dbcounter [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Registered counter for database nova_cell1 Aug 09 14:20:11.040185 n-d-844626-8 devstack@n-api.service[103914]: INFO dbcounter [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Registered counter for database nova_cell1 Aug 09 14:20:11.047184 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_db.sqlalchemy.engines [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:20:11.050130 n-d-844626-8 devstack@n-api.service[103914]: DEBUG oslo_db.sqlalchemy.engines [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:20:11.050884 n-d-844626-8 devstack@n-api.service[103914]: DEBUG oslo_db.sqlalchemy.engines [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:20:11.052587 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_db.sqlalchemy.engines [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:20:11.054739 n-d-844626-8 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writer thread running {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:20:11.056289 n-d-844626-8 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writer thread running {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:20:11.189845 n-d-844626-8 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writer thread running {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:20:11.191604 n-d-844626-8 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writer thread running {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:20:11.199447 n-d-844626-8 devstack@n-api.service[103914]: INFO dbcounter [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Registered counter for database nova_cell0 Aug 09 14:20:11.201207 n-d-844626-8 devstack@n-api.service[103913]: INFO dbcounter [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Registered counter for database nova_cell0 Aug 09 14:20:11.210687 n-d-844626-8 devstack@n-api.service[103914]: DEBUG oslo_db.sqlalchemy.engines [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103914) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:20:11.214582 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_db.sqlalchemy.engines [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103913) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:20:11.215112 n-d-844626-8 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writer thread running {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:20:11.219901 n-d-844626-8 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writer thread running {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:20:11.540851 n-d-844626-8 devstack@n-api.service[103914]: WARNING keystonemiddleware.auth_token [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 14:20:11.542636 n-d-844626-8 devstack@n-api.service[103913]: WARNING keystonemiddleware.auth_token [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 14:20:11.548119 n-d-844626-8 devstack@n-api.service[103914]: WARNING keystonemiddleware.auth_token [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 14:20:11.549814 n-d-844626-8 devstack@n-api.service[103913]: WARNING keystonemiddleware.auth_token [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 14:20:11.882258 n-d-844626-8 devstack@n-api.service[103914]: WARNING keystonemiddleware.auth_token [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 14:20:11.885570 n-d-844626-8 devstack@n-api.service[103913]: WARNING keystonemiddleware.auth_token [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 14:20:11.888219 n-d-844626-8 devstack@n-api.service[103914]: WARNING keystonemiddleware.auth_token [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 14:20:11.891545 n-d-844626-8 devstack@n-api.service[103913]: WARNING keystonemiddleware.auth_token [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 14:20:11.893446 n-d-844626-8 devstack@n-api.service[103914]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5587371b89c0 pid: 103914 (default app) Aug 09 14:20:11.895518 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:20:11.896697 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-ff479756-4f27-4168-97cb-9711401aae3c None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Aug 09 14:20:11.896825 n-d-844626-8 devstack@n-api.service[103913]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5587371b89c0 pid: 103913 (default app) Aug 09 14:20:11.897069 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Tue Aug 9 14:20:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:26.804103 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:26.805419 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Aug 09 14:21:26.805899 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:21:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:26.817544 n-d-844626-8 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_api:SELECT=3 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:21:26.818563 n-d-844626-8 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_cell1:SELECT=3 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:21:26.820452 n-d-844626-8 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_cell0:SELECT=3 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:21:26.821460 n-d-844626-8 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:21:27.656249 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-e11e0c1f-7143-47cc-822f-3d75653df006 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:27.688333 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-e11e0c1f-7143-47cc-822f-3d75653df006 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.876119 Aug 09 14:21:27.692705 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 2/3] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 9 14:21:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:21:29.866136 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:29.867265 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-5343acc6-171c-4a8c-a8c3-93f3127ce0c7 None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 09 14:21:29.869161 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 2/4] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:21:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:30.311335 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-f3b9ba8e-9cbd-49a5-b003-b9d621082022 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "id": "c1", "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:30.331658 n-d-844626-8 devstack@n-api.service[103914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:21:30.331658 n-d-844626-8 devstack@n-api.service[103914]: warnings.warn(msg) Aug 09 14:21:30.362873 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-f3b9ba8e-9cbd-49a5-b003-b9d621082022 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488321 Aug 09 14:21:30.363630 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 3/5] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 9 14:21:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:21:30.377484 n-d-844626-8 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_api:SELECT=3 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:21:30.378635 n-d-844626-8 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_cell1:SELECT=3 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:21:30.379651 n-d-844626-8 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_cell0:SELECT=3 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:21:30.380397 n-d-844626-8 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:21:30.583876 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-225b2ecc-6e51-476e-be75-bfc6feeb0365 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:30.588222 n-d-844626-8 devstack@n-api.service[103913]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:21:30.588222 n-d-844626-8 devstack@n-api.service[103913]: warnings.warn(msg) Aug 09 14:21:30.663197 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-225b2ecc-6e51-476e-be75-bfc6feeb0365 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290845 Aug 09 14:21:30.671237 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 3/6] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 9 14:21:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:21:32.893201 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-f3b9ba8e-9cbd-49a5-b003-b9d621082022 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:32.894156 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-f3b9ba8e-9cbd-49a5-b003-b9d621082022 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 09 14:21:32.894687 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 4/7] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:21:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:33.614871 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-aa47f7ed-4527-427b-8c5a-10a069f58f3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:33.634873 n-d-844626-8 devstack@n-api.service[103913]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:21:33.634873 n-d-844626-8 devstack@n-api.service[103913]: warnings.warn(msg) Aug 09 14:21:33.669632 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-aa47f7ed-4527-427b-8c5a-10a069f58f3f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.768870 Aug 09 14:21:33.670692 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 4/8] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 9 14:21:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 14:21:33.682889 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-aa5e48dd-aec0-4e87-a0c5-bd6167c85e09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:33.686039 n-d-844626-8 devstack@n-api.service[103914]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:21:33.686039 n-d-844626-8 devstack@n-api.service[103914]: warnings.warn(msg) Aug 09 14:21:33.753160 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-aa5e48dd-aec0-4e87-a0c5-bd6167c85e09 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074065 Aug 09 14:21:33.754005 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 5/9] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 9 14:21:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:21:36.234430 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-aa47f7ed-4527-427b-8c5a-10a069f58f3f admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:36.247542 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-aa47f7ed-4527-427b-8c5a-10a069f58f3f admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 09 14:21:36.248253 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:21:36 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:36.875248 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-df3a0450-19d3-4c3b-aa28-98a97f022b86 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:36.898795 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-df3a0450-19d3-4c3b-aa28-98a97f022b86 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.644506 Aug 09 14:21:36.912575 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-f1aa3ca4-2d08-46a6-a480-ff41af1ede80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:36.917663 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 6/11] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 9 14:21:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:21:36.941088 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-f1aa3ca4-2d08-46a6-a480-ff41af1ede80 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032431 Aug 09 14:21:36.947451 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 6/12] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 9 14:21:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:21:39.317483 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-df3a0450-19d3-4c3b-aa28-98a97f022b86 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:39.319247 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-df3a0450-19d3-4c3b-aa28-98a97f022b86 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002106 Aug 09 14:21:39.319856 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 7/13] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:21:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:39.764105 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-f043d84a-7109-4ad1-9da4-9ccc339d77a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "name": "ds2G", "id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "rxtx_factor": 1.0}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:39.785361 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-f043d84a-7109-4ad1-9da4-9ccc339d77a6 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459307 Aug 09 14:21:39.791780 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 7/14] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 9 14:21:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 14:21:39.798251 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-e86d77f8-4e11-4b26-a8e3-548529e9bf8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:39.827631 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-e86d77f8-4e11-4b26-a8e3-548529e9bf8e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032755 Aug 09 14:21:39.828110 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 8/15] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 9 14:21:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:21:42.035897 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-f043d84a-7109-4ad1-9da4-9ccc339d77a6 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:42.037057 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-f043d84a-7109-4ad1-9da4-9ccc339d77a6 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001725 Aug 09 14:21:42.037556 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 8/16] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:21:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:42.497378 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-e4dbb36d-7e98-4a81-967b-3b9144b33fa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:42.526428 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-e4dbb36d-7e98-4a81-967b-3b9144b33fa7 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482631 Aug 09 14:21:42.526987 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 9/17] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 9 14:21:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:21:42.543396 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-dff54d7d-e157-4180-be4e-cecd178079f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:42.571254 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-dff54d7d-e157-4180-be4e-cecd178079f2 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032157 Aug 09 14:21:42.575539 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 9/18] 10.222.0.50 () {64 vars in 1336 bytes} [Tue Aug 9 14:21:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:21:44.805401 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-e4dbb36d-7e98-4a81-967b-3b9144b33fa7 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:44.806584 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-e4dbb36d-7e98-4a81-967b-3b9144b33fa7 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Aug 09 14:21:44.807413 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 10/19] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:21:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:45.290429 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-aa463a78-67da-4da0-a0a1-09247e2dbbe1 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:45.314794 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-aa463a78-67da-4da0-a0a1-09247e2dbbe1 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.499869 Aug 09 14:21:45.315374 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 10/20] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 9 14:21:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:21:47.540964 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-e4dbb36d-7e98-4a81-967b-3b9144b33fa7 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:47.542019 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-e4dbb36d-7e98-4a81-967b-3b9144b33fa7 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 09 14:21:47.542389 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 11/21] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:21:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:48.011568 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-836f6938-25a6-4200-b968-592a732d4584 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "ram": 512, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:48.034405 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-836f6938-25a6-4200-b968-592a732d4584 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.485619 Aug 09 14:21:48.034993 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 11/22] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 9 14:21:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:21:48.047806 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-8e3a1aeb-aa23-4f75-b6a1-b59436ec5d49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:48.074393 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-8e3a1aeb-aa23-4f75-b6a1-b59436ec5d49 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030508 Aug 09 14:21:48.075025 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 12/23] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 9 14:21:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:21:50.264813 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-836f6938-25a6-4200-b968-592a732d4584 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:50.265702 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-836f6938-25a6-4200-b968-592a732d4584 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Aug 09 14:21:50.266096 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 12/24] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:21:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:50.732716 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-aa7cba32-7efa-405a-9fb6-9ae46f0b96fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "swap": 0, "id": "2", "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:50.753726 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-aa7cba32-7efa-405a-9fb6-9ae46f0b96fb admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.481237 Aug 09 14:21:50.754297 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 13/25] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 9 14:21:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:21:50.767078 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-ba84a654-9a83-442b-9806-7683048ef46e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:50.796258 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-ba84a654-9a83-442b-9806-7683048ef46e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032933 Aug 09 14:21:50.796869 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 13/26] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 9 14:21:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:21:53.018684 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-aa7cba32-7efa-405a-9fb6-9ae46f0b96fb admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:53.019722 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-aa7cba32-7efa-405a-9fb6-9ae46f0b96fb admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 09 14:21:53.020145 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 14/27] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:21:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:53.417152 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-ea550bd4-90dd-4489-8a9d-b05dc7c80ec2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "vcpus": 2}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:53.436502 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-ea550bd4-90dd-4489-8a9d-b05dc7c80ec2 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.410188 Aug 09 14:21:53.437122 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 14/28] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 9 14:21:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 14:21:53.449782 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-482088c2-6e17-4193-b192-815fb583618e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:53.473971 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-482088c2-6e17-4193-b192-815fb583618e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027971 Aug 09 14:21:53.474583 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 15/29] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 9 14:21:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:21:55.663057 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-ea550bd4-90dd-4489-8a9d-b05dc7c80ec2 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:55.664115 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-ea550bd4-90dd-4489-8a9d-b05dc7c80ec2 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 09 14:21:55.664543 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 15/30] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:21:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:56.083997 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-5c3da0c9-3b68-46f2-bf75-435f30b378f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:56.104617 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-5c3da0c9-3b68-46f2-bf75-435f30b378f1 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.433800 Aug 09 14:21:56.105176 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 16/31] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 9 14:21:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 14:21:56.117212 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-463fe794-77d4-4c4f-8724-a526dcabb3fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:56.143165 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-463fe794-77d4-4c4f-8724-a526dcabb3fa admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029540 Aug 09 14:21:56.143812 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 16/32] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 9 14:21:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:21:58.410956 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-5c3da0c9-3b68-46f2-bf75-435f30b378f1 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:21:58.412081 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-5c3da0c9-3b68-46f2-bf75-435f30b378f1 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Aug 09 14:21:58.412484 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 17/33] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:21:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:21:58.837766 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-63fcc7de-c6fe-49b6-a6eb-163635a7d89e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "swap": 0}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:58.857729 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-63fcc7de-c6fe-49b6-a6eb-163635a7d89e admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.439128 Aug 09 14:21:58.858281 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 17/34] 10.222.0.50 () {64 vars in 1283 bytes} [Tue Aug 9 14:21:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:21:58.870522 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-ca90cefc-a810-4bf3-9758-8b4d7c061c3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:21:58.875597 n-d-844626-8 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:21:58.899014 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-ca90cefc-a810-4bf3-9758-8b4d7c061c3a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032258 Aug 09 14:21:58.899914 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 18/35] 10.222.0.50 () {64 vars in 1333 bytes} [Tue Aug 9 14:21:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:22:22.813110 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-63fcc7de-c6fe-49b6-a6eb-163635a7d89e admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:22.814164 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-63fcc7de-c6fe-49b6-a6eb-163635a7d89e admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 09 14:22:22.814561 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 18/36] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:22:22.825895 n-d-844626-8 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:22:23.227037 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-d8a864f0-084e-4581-95b5-6ba6c016c1e2 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:23.245397 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-d8a864f0-084e-4581-95b5-6ba6c016c1e2 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.423913 Aug 09 14:22:23.245856 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 19/37] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 9 14:22:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:22:24.462601 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-63fcc7de-c6fe-49b6-a6eb-163635a7d89e admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:24.464209 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-63fcc7de-c6fe-49b6-a6eb-163635a7d89e admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002228 Aug 09 14:22:24.464851 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 19/38] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 9 14:22:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:22:25.019944 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-6d89ba4d-d8b8-4858-80a7-55325ecc4088 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:25.026148 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.wsgi [None req-6d89ba4d-d8b8-4858-80a7-55325ecc4088 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-6d89ba4d-d8b8-4858-80a7-55325ecc4088 admin admin] Request method failure captured: Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: Accept: application/json Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: Accept-Encoding: gzip, deflate Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: Connection: keep-alive Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: Content-Length: 0 Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: Host: 10.222.0.50 Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: Openstack-Api-Version: compute 2.90 Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: Openstack-System-Scope: None Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: User-Agent: python-novaclient Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: X-Auth-Token: gAAAAABi8m2gzq9yYc67VZvvBNJqFYZKnf9ShCUcVkPvwBNnLc26XanniiKfSNVx9EoTD_CC-cev2gbL6C9AJH7bGUVvrQE6EtNzDerQ1tkj2YHZv2FiEUWEoaMGfstMNDKPJVwTimf6_oAHBKdq4tlwxy7zmckIHn088H1VWt_jyJhoD0O07rg Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: X-Domain-Id: None Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: X-Domain-Name: None Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: X-Identity-Status: Confirmed Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: X-Is-Admin-Project: True Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: X-Project-Domain-Id: default Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: X-Project-Domain-Name: Default Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: X-Project-Id: d05dc1ade58a4c1382c483f0b65c467a Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: X-Project-Name: admin Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: X-Role: member,reader,admin Aug 09 14:22:25.029446 n-d-844626-8 devstack@n-api.service[103914]: X-Roles: member,reader,admin Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d05dc1ade58a4c1382c483f0b65c467a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: X-Tenant: admin Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: X-Tenant-Id: d05dc1ade58a4c1382c483f0b65c467a Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: X-Tenant-Name: admin Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: X-User: admin Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: X-User-Domain-Id: default Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: X-User-Domain-Name: Default Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: X-User-Id: cb803693b657417b91696d4d12d0ac59 Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: X-User-Name: admin Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: method: > Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: exception: Flavor 42 could not be found. Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: action_args: {'id': '42'} Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:22:25.031064 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:22:25.032020 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:25.033174 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-6d89ba4d-d8b8-4858-80a7-55325ecc4088 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:22:25.034467 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-6d89ba4d-d8b8-4858-80a7-55325ecc4088 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.415631 Aug 09 14:22:25.034467 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 20/39] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 9 14:22:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:22:25.042527 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-b1e37a02-dbe9-445c-9ecb-adc18a8db8c3 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:25.046804 n-d-844626-8 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:22:25.065592 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-b1e37a02-dbe9-445c-9ecb-adc18a8db8c3 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027133 Aug 09 14:22:25.066092 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 20/40] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 9 14:22:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:22:25.084116 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-dbc864d2-efe6-47d4-8bfc-6492a15d57b3 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:25.108509 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-dbc864d2-efe6-47d4-8bfc-6492a15d57b3 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027967 Aug 09 14:22:25.109075 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 21/41] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 9 14:22:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:22:25.118786 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-eb312741-9768-4f2e-9586-d8c64a6125eb admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:25.124951 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.wsgi [None req-eb312741-9768-4f2e-9586-d8c64a6125eb admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-eb312741-9768-4f2e-9586-d8c64a6125eb admin admin] Request method failure captured: Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: Accept: application/json Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: Accept-Encoding: gzip, deflate Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: Connection: keep-alive Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: Content-Length: 0 Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: Host: 10.222.0.50 Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: Openstack-Api-Version: compute 2.90 Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: Openstack-System-Scope: None Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: User-Agent: python-novaclient Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: X-Auth-Token: gAAAAABi8m2gzq9yYc67VZvvBNJqFYZKnf9ShCUcVkPvwBNnLc26XanniiKfSNVx9EoTD_CC-cev2gbL6C9AJH7bGUVvrQE6EtNzDerQ1tkj2YHZv2FiEUWEoaMGfstMNDKPJVwTimf6_oAHBKdq4tlwxy7zmckIHn088H1VWt_jyJhoD0O07rg Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: X-Domain-Id: None Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: X-Domain-Name: None Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: X-Identity-Status: Confirmed Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: X-Is-Admin-Project: True Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: X-Project-Domain-Id: default Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: X-Project-Domain-Name: Default Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: X-Project-Id: d05dc1ade58a4c1382c483f0b65c467a Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: X-Project-Name: admin Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: X-Role: member,reader,admin Aug 09 14:22:25.128211 n-d-844626-8 devstack@n-api.service[103913]: X-Roles: member,reader,admin Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d05dc1ade58a4c1382c483f0b65c467a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: X-Tenant: admin Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: X-Tenant-Id: d05dc1ade58a4c1382c483f0b65c467a Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: X-Tenant-Name: admin Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: X-User: admin Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: X-User-Domain-Id: default Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: X-User-Domain-Name: Default Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: X-User-Id: cb803693b657417b91696d4d12d0ac59 Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: X-User-Name: admin Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: method: > Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: exception: Flavor 42 could not be found. Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: action_args: {'id': '42'} Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:22:25.129718 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:22:25.130723 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:25.132363 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-eb312741-9768-4f2e-9586-d8c64a6125eb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:22:25.133663 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-eb312741-9768-4f2e-9586-d8c64a6125eb admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014525 Aug 09 14:22:25.133663 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 21/42] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 9 14:22:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 09 14:22:26.101627 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-dbc864d2-efe6-47d4-8bfc-6492a15d57b3 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:26.102626 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-dbc864d2-efe6-47d4-8bfc-6492a15d57b3 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001999 Aug 09 14:22:26.103023 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 22/43] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 9 14:22:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:22:26.636405 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-362850b7-4863-472f-a8fc-d1f06ca9c84d admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:26.642383 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.wsgi [None req-362850b7-4863-472f-a8fc-d1f06ca9c84d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-362850b7-4863-472f-a8fc-d1f06ca9c84d admin admin] Request method failure captured: Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: Accept: application/json Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: Accept-Encoding: gzip, deflate Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: Connection: keep-alive Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: Content-Length: 0 Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: Host: 10.222.0.50 Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: Openstack-Api-Version: compute 2.90 Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: Openstack-System-Scope: None Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: User-Agent: python-novaclient Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: X-Auth-Token: gAAAAABi8m2h3XxxjszU2ANTqpW_ZdTCmdMkGxDKkAKCxfrM_FyNKzKHPuDhvcbXW69TaVqxtDCI6y6QmAWjDFKjr8ywHckzwWGvtUOcaBUmg-oacjALhRwfZ9yS5fFJB1iXTopzpiuaXblbbsndDg67NNNAlBeezyb31kVqHktySNZ6BY6iWg0 Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: X-Domain-Id: None Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: X-Domain-Name: None Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: X-Identity-Status: Confirmed Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: X-Is-Admin-Project: True Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: X-Project-Domain-Id: default Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: X-Project-Domain-Name: Default Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: X-Project-Id: d05dc1ade58a4c1382c483f0b65c467a Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: X-Project-Name: admin Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: X-Role: member,reader,admin Aug 09 14:22:26.643950 n-d-844626-8 devstack@n-api.service[103913]: X-Roles: member,reader,admin Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d05dc1ade58a4c1382c483f0b65c467a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: X-Tenant: admin Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: X-Tenant-Id: d05dc1ade58a4c1382c483f0b65c467a Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: X-Tenant-Name: admin Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: X-User: admin Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: X-User-Domain-Id: default Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: X-User-Domain-Name: Default Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: X-User-Id: cb803693b657417b91696d4d12d0ac59 Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: X-User-Name: admin Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: method: > Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: exception: Flavor 84 could not be found. Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: action_args: {'id': '84'} Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:22:26.645498 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:22:26.646488 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:26.647843 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-362850b7-4863-472f-a8fc-d1f06ca9c84d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:22:26.649137 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-362850b7-4863-472f-a8fc-d1f06ca9c84d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.406204 Aug 09 14:22:26.649137 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 22/44] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 9 14:22:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 407 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:22:26.655445 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-909ff75d-1890-4cde-83a2-9e0cc9d74e29 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:26.670467 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-909ff75d-1890-4cde-83a2-9e0cc9d74e29 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018780 Aug 09 14:22:26.670986 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 23/45] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 9 14:22:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:22:26.682699 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-f30b0932-ae3a-407c-9170-0b97807c5045 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:26.701782 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-f30b0932-ae3a-407c-9170-0b97807c5045 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024721 Aug 09 14:22:26.702300 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 23/46] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 9 14:22:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:22:26.712371 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-426a3449-a82d-4a60-a8f4-258d8d4dee07 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:26.717842 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.wsgi [None req-426a3449-a82d-4a60-a8f4-258d8d4dee07 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-426a3449-a82d-4a60-a8f4-258d8d4dee07 admin admin] Request method failure captured: Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: Accept: application/json Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: Accept-Encoding: gzip, deflate Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: Connection: keep-alive Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: Content-Length: 0 Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: Host: 10.222.0.50 Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: Openstack-Api-Version: compute 2.90 Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: Openstack-System-Scope: None Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: User-Agent: python-novaclient Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: X-Auth-Token: gAAAAABi8m2h3XxxjszU2ANTqpW_ZdTCmdMkGxDKkAKCxfrM_FyNKzKHPuDhvcbXW69TaVqxtDCI6y6QmAWjDFKjr8ywHckzwWGvtUOcaBUmg-oacjALhRwfZ9yS5fFJB1iXTopzpiuaXblbbsndDg67NNNAlBeezyb31kVqHktySNZ6BY6iWg0 Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: X-Domain-Id: None Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: X-Domain-Name: None Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: X-Identity-Status: Confirmed Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: X-Is-Admin-Project: True Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: X-Project-Domain-Id: default Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: X-Project-Domain-Name: Default Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: X-Project-Id: d05dc1ade58a4c1382c483f0b65c467a Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: X-Project-Name: admin Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: X-Role: member,reader,admin Aug 09 14:22:26.719467 n-d-844626-8 devstack@n-api.service[103914]: X-Roles: member,reader,admin Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d05dc1ade58a4c1382c483f0b65c467a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: X-Tenant: admin Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: X-Tenant-Id: d05dc1ade58a4c1382c483f0b65c467a Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: X-Tenant-Name: admin Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: X-User: admin Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: X-User-Domain-Id: default Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: X-User-Domain-Name: Default Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: X-User-Id: cb803693b657417b91696d4d12d0ac59 Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: X-User-Name: admin Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: method: > Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: exception: Flavor 84 could not be found. Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: action_args: {'id': '84'} Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:22:26.720968 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:22:26.722048 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:26.723547 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-426a3449-a82d-4a60-a8f4-258d8d4dee07 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:22:26.724763 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-426a3449-a82d-4a60-a8f4-258d8d4dee07 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012551 Aug 09 14:22:26.724763 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 24/47] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 9 14:22:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:22:27.688212 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-f30b0932-ae3a-407c-9170-0b97807c5045 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:27.689247 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-f30b0932-ae3a-407c-9170-0b97807c5045 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 09 14:22:27.689641 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 24/48] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 9 14:22:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:22:28.241553 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-64d8ddf2-de72-49ad-a12a-f1e6b1fd8ec8 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:28.247459 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.wsgi [None req-64d8ddf2-de72-49ad-a12a-f1e6b1fd8ec8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-64d8ddf2-de72-49ad-a12a-f1e6b1fd8ec8 admin admin] Request method failure captured: Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: Accept: application/json Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: Accept-Encoding: gzip, deflate Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: Connection: keep-alive Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: Content-Length: 0 Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: Host: 10.222.0.50 Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: Openstack-Api-Version: compute 2.90 Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: Openstack-System-Scope: None Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: User-Agent: python-novaclient Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: X-Auth-Token: gAAAAABi8m2jD7BzuZTmvdZyXf4uFj2B9hBE517-KjrDO4bHzrflNt2U0Ia0ugiA2l8nUI_nfQmbK6M34vWJIt9oiLT2lIRQDOFgNmcdLRcmeLyRWMVoef1JHU3HFr27Ldsr_Q7SheDiBhKEfQfOrzbDI2T_4m3vEN0v70uF82Adtd18OC9ascM Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: X-Domain-Id: None Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: X-Domain-Name: None Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: X-Identity-Status: Confirmed Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: X-Is-Admin-Project: True Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: X-Project-Domain-Id: default Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: X-Project-Domain-Name: Default Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: X-Project-Id: d05dc1ade58a4c1382c483f0b65c467a Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: X-Project-Name: admin Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: X-Role: member,reader,admin Aug 09 14:22:28.248941 n-d-844626-8 devstack@n-api.service[103914]: X-Roles: member,reader,admin Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d05dc1ade58a4c1382c483f0b65c467a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: X-Tenant: admin Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: X-Tenant-Id: d05dc1ade58a4c1382c483f0b65c467a Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: X-Tenant-Name: admin Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: X-User: admin Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: X-User-Domain-Id: default Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: X-User-Domain-Name: Default Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: X-User-Id: cb803693b657417b91696d4d12d0ac59 Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: X-User-Name: admin Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: method: > Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: exception: Flavor 451 could not be found. Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: action_args: {'id': '451'} Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:22:28.250278 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:22:28.251390 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: ERROR nova.api.openstack.wsgi Aug 09 14:22:28.252581 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-64d8ddf2-de72-49ad-a12a-f1e6b1fd8ec8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103914) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:22:28.253757 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-64d8ddf2-de72-49ad-a12a-f1e6b1fd8ec8 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.423205 Aug 09 14:22:28.253757 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 25/49] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 9 14:22:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:22:28.260377 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-873177a1-c733-4821-aac8-e296959c8e6c admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:28.275538 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-873177a1-c733-4821-aac8-e296959c8e6c admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018848 Aug 09 14:22:28.276032 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 25/50] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 9 14:22:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:22:28.285442 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:28.300541 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018627 Aug 09 14:22:28.301088 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 26/51] 10.222.0.50 () {60 vars in 1210 bytes} [Tue Aug 9 14:22:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:22:28.310355 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-263e8c88-ed51-4300-a953-e4e656429bec admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:28.315877 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.wsgi [None req-263e8c88-ed51-4300-a953-e4e656429bec admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-263e8c88-ed51-4300-a953-e4e656429bec admin admin] Request method failure captured: Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: Accept: application/json Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: Accept-Encoding: gzip, deflate Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: Connection: keep-alive Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: Content-Length: 0 Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: Host: 10.222.0.50 Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: Openstack-Api-Version: compute 2.90 Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: Openstack-System-Scope: None Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: User-Agent: python-novaclient Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: X-Auth-Token: gAAAAABi8m2jD7BzuZTmvdZyXf4uFj2B9hBE517-KjrDO4bHzrflNt2U0Ia0ugiA2l8nUI_nfQmbK6M34vWJIt9oiLT2lIRQDOFgNmcdLRcmeLyRWMVoef1JHU3HFr27Ldsr_Q7SheDiBhKEfQfOrzbDI2T_4m3vEN0v70uF82Adtd18OC9ascM Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: X-Domain-Id: None Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: X-Domain-Name: None Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: X-Identity-Status: Confirmed Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: X-Is-Admin-Project: True Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: X-Project-Domain-Id: default Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: X-Project-Domain-Name: Default Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: X-Project-Id: d05dc1ade58a4c1382c483f0b65c467a Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: X-Project-Name: admin Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: X-Role: member,reader,admin Aug 09 14:22:28.317686 n-d-844626-8 devstack@n-api.service[103913]: X-Roles: member,reader,admin Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d05dc1ade58a4c1382c483f0b65c467a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d05dc1ade58a4c1382c483f0b65c467a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: X-Tenant: admin Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: X-Tenant-Id: d05dc1ade58a4c1382c483f0b65c467a Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: X-Tenant-Name: admin Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: X-User: admin Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: X-User-Domain-Id: default Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: X-User-Domain-Name: Default Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: X-User-Id: cb803693b657417b91696d4d12d0ac59 Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: X-User-Name: admin Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: method: > Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: exception: Flavor 451 could not be found. Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: action_args: {'id': '451'} Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:22:28.319325 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:22:28.320377 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: ERROR nova.api.openstack.wsgi Aug 09 14:22:28.321514 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-263e8c88-ed51-4300-a953-e4e656429bec admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103913) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:22:28.322535 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-263e8c88-ed51-4300-a953-e4e656429bec admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012231 Aug 09 14:22:28.322535 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 26/52] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 9 14:22:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:22:29.276300 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:29.277627 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001956 Aug 09 14:22:29.278183 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 27/53] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 9 14:22:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:22:29.824300 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-fd625577-e4ae-47d3-99e8-ed6a4e46d304 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:22:29.846793 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-fd625577-e4ae-47d3-99e8-ed6a4e46d304 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.432614 Aug 09 14:22:29.847356 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 27/54] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Aug 9 14:22:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:22:30.801816 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:30.802809 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 09 14:22:30.803230 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 28/55] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 9 14:22:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:22:31.351233 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-a8bfc8b8-8d97-4b64-a44e-b15a89669147 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:22:31.372689 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-a8bfc8b8-8d97-4b64-a44e-b15a89669147 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.434136 Aug 09 14:22:31.373237 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 28/56] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Aug 9 14:22:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:22:32.370694 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:32.371732 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 09 14:22:32.372145 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 29/57] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 9 14:22:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:22:32.920985 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-c01d9e9f-9eab-4c6b-b699-da945a8006d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:22:32.941923 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-c01d9e9f-9eab-4c6b-b699-da945a8006d8 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.432857 Aug 09 14:22:32.942767 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 29/58] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Aug 9 14:22:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:22:33.922869 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:33.923909 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 09 14:22:33.924300 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 30/59] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 9 14:22:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:22:34.470443 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-14926dff-0f12-4b16-8ae6-72351b416f6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:22:34.492308 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-14926dff-0f12-4b16-8ae6-72351b416f6a admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.430018 Aug 09 14:22:34.492937 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 30/60] 10.222.0.50 () {64 vars in 1235 bytes} [Tue Aug 9 14:22:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:22:35.480516 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:35.481544 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 09 14:22:35.481942 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 31/61] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 9 14:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:22:36.098285 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-218e2c55-f3f2-4e42-8940-3104de062849 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:22:36.124669 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-218e2c55-f3f2-4e42-8940-3104de062849 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.501612 Aug 09 14:22:36.125216 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 31/62] 10.222.0.50 () {60 vars in 1202 bytes} [Tue Aug 9 14:22:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:23:27.802937 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:23:27.804006 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-55ba2ab7-29f3-44d9-b2fd-3f09fbf60637 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 09 14:23:27.804371 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 32/63] 10.222.0.50 () {54 vars in 931 bytes} [Tue Aug 9 14:23:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:23:27.818623 n-d-844626-8 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:23:28.261878 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-5c7da8d9-111b-44eb-823b-ee353fc92d50 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:23:28.282062 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-5c7da8d9-111b-44eb-823b-ee353fc92d50 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.470903 Aug 09 14:23:28.282577 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 32/64] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 9 14:23:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:23:28.303375 n-d-844626-8 devstack@n-api.service[103914]: DEBUG dbcounter [-] [103914] Writing DB stats nova_api:SELECT=14 {{(pid=103914) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:23:28.307501 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-92bd7ee4-94f0-4d41-9286-af7971c1af7f admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:23:28.315479 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-92bd7ee4-94f0-4d41-9286-af7971c1af7f admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013505 Aug 09 14:23:28.315996 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 33/65] 10.222.0.50 () {60 vars in 1283 bytes} [Tue Aug 9 14:23:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:23:28.328246 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-53bacd57-505c-4e60-bf09-953f2645f60b admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:23:28.336160 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-53bacd57-505c-4e60-bf09-953f2645f60b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011517 Aug 09 14:23:28.336682 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 33/66] 10.222.0.50 () {60 vars in 1286 bytes} [Tue Aug 9 14:23:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:23:28.348476 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-23ede468-b79c-4e66-9037-82e23326af60 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:23:28.356477 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-23ede468-b79c-4e66-9037-82e23326af60 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011611 Aug 09 14:23:28.357025 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 34/67] 10.222.0.50 () {60 vars in 1286 bytes} [Tue Aug 9 14:23:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:23:28.368366 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-a1ab2ac7-3437-41ca-b8cf-194a539269bc admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:23:28.376333 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-a1ab2ac7-3437-41ca-b8cf-194a539269bc admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011567 Aug 09 14:23:28.376857 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 34/68] 10.222.0.50 () {60 vars in 1283 bytes} [Tue Aug 9 14:23:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:28:50.989503 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-23ede468-b79c-4e66-9037-82e23326af60 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:28:50.990503 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-23ede468-b79c-4e66-9037-82e23326af60 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 09 14:28:50.990895 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 35/69] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 9 14:28:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:28:51.130378 n-d-844626-8 devstack@n-api.service[103913]: DEBUG dbcounter [-] [103913] Writing DB stats nova_api:SELECT=6 {{(pid=103913) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:28:51.292926 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-266a89ab-4d70-41b0-b6fd-6b71571f06ff admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:28:51.295292 n-d-844626-8 devstack@n-api.service[103913]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:28:51.295292 n-d-844626-8 devstack@n-api.service[103913]: warnings.warn(msg) Aug 09 14:28:51.296420 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-266a89ab-4d70-41b0-b6fd-6b71571f06ff admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:28:51.296889 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-266a89ab-4d70-41b0-b6fd-6b71571f06ff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:28:51.297315 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-266a89ab-4d70-41b0-b6fd-6b71571f06ff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:28:51.298025 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-266a89ab-4d70-41b0-b6fd-6b71571f06ff admin admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:28:51.298461 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-266a89ab-4d70-41b0-b6fd-6b71571f06ff admin admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:28:51.298875 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-266a89ab-4d70-41b0-b6fd-6b71571f06ff admin admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:28:51.339789 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-266a89ab-4d70-41b0-b6fd-6b71571f06ff admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.211042 Aug 09 14:28:51.340335 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 35/70] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 9 14:28:51 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:28:52.166579 n-d-844626-8 devstack@n-api.service[103914]: DEBUG nova.api.openstack.wsgi [None req-23ede468-b79c-4e66-9037-82e23326af60 admin admin] Calling method '>' {{(pid=103914) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:28:52.167604 n-d-844626-8 devstack@n-api.service[103914]: INFO nova.api.openstack.requestlog [None req-23ede468-b79c-4e66-9037-82e23326af60 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 09 14:28:52.167962 n-d-844626-8 devstack@n-api.service[103914]: [pid: 103914|app: 0|req: 36/71] 10.222.0.50 () {56 vars in 1074 bytes} [Tue Aug 9 14:28:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:28:52.368191 n-d-844626-8 devstack@n-api.service[103913]: DEBUG nova.api.openstack.wsgi [None req-8f9405dd-23f3-43dc-99f2-a8eb0d882b85 admin admin] Calling method '>' {{(pid=103913) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:28:52.370582 n-d-844626-8 devstack@n-api.service[103913]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:28:52.370582 n-d-844626-8 devstack@n-api.service[103913]: warnings.warn(msg) Aug 09 14:28:52.371709 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-8f9405dd-23f3-43dc-99f2-a8eb0d882b85 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:28:52.372689 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-8f9405dd-23f3-43dc-99f2-a8eb0d882b85 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:28:52.373118 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-8f9405dd-23f3-43dc-99f2-a8eb0d882b85 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:28:52.374008 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-8f9405dd-23f3-43dc-99f2-a8eb0d882b85 admin admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:28:52.374453 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-8f9405dd-23f3-43dc-99f2-a8eb0d882b85 admin admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:28:52.374865 n-d-844626-8 devstack@n-api.service[103913]: DEBUG oslo_concurrency.lockutils [None req-8f9405dd-23f3-43dc-99f2-a8eb0d882b85 admin admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103913) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:28:52.396799 n-d-844626-8 devstack@n-api.service[103913]: INFO nova.api.openstack.requestlog [None req-8f9405dd-23f3-43dc-99f2-a8eb0d882b85 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.092354 Aug 09 14:28:52.397335 n-d-844626-8 devstack@n-api.service[103913]: [pid: 103913|app: 0|req: 36/72] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 9 14:28:52 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:29:40.833670 n-d-844626-8 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 09 14:29:40.834452 n-d-844626-8 devstack@n-api.service[103912]: Tue Aug 9 14:29:40 2022 - graceful shutdown triggered... Aug 09 14:29:40.835124 n-d-844626-8 devstack@n-api.service[103913]: Gracefully killing worker 1 (pid: 103913)... Aug 09 14:29:40.835748 n-d-844626-8 devstack@n-api.service[103914]: Gracefully killing worker 2 (pid: 103914)... Aug 09 14:29:41.835698 n-d-844626-8 devstack@n-api.service[103912]: worker 1 buried after 1 seconds Aug 09 14:29:41.835698 n-d-844626-8 devstack@n-api.service[103912]: worker 2 buried after 1 seconds Aug 09 14:29:41.835698 n-d-844626-8 devstack@n-api.service[103912]: goodbye to uWSGI. Aug 09 14:29:41.838147 n-d-844626-8 systemd[1]: devstack@n-api.service: Succeeded. Aug 09 14:29:41.839070 n-d-844626-8 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 09 14:29:41.843357 n-d-844626-8 systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 14:29:41.865349 n-d-844626-8 devstack@n-api.service[119397]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 14:29:41 2022] *** Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: nodename: n-d-844626-8 Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: machine: x86_64 Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: clock source: unix Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: pcre jit disabled Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: detected number of CPU cores: 4 Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: current working directory: / Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: detected binary path: /usr/bin/uwsgi-core Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: your processes number limit is 47680 Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: your memory page size is 4096 bytes Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: detected max file descriptor number: 2048 Aug 09 14:29:41.886162 n-d-844626-8 devstack@n-api.service[119397]: lock engine: pthread robust mutexes Aug 09 14:29:41.887225 n-d-844626-8 devstack@n-api.service[119397]: thunder lock: enabled Aug 09 14:29:41.887225 n-d-844626-8 devstack@n-api.service[119397]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 14:29:41.887225 n-d-844626-8 devstack@n-api.service[119397]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 14:29:41.928662 n-d-844626-8 devstack@n-api.service[119397]: Python main interpreter initialized at 0x55589cf1b9c0 Aug 09 14:29:41.928662 n-d-844626-8 devstack@n-api.service[119397]: python threads support enabled Aug 09 14:29:41.928662 n-d-844626-8 devstack@n-api.service[119397]: your server socket listen backlog is limited to 100 connections Aug 09 14:29:41.928662 n-d-844626-8 devstack@n-api.service[119397]: your mercy for graceful operations on workers is 90 seconds Aug 09 14:29:41.929137 n-d-844626-8 devstack@n-api.service[119397]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 14:29:41.929137 n-d-844626-8 devstack@n-api.service[119397]: *** Operational MODE: preforking *** Aug 09 14:29:41.929366 n-d-844626-8 devstack@n-api.service[119397]: *** uWSGI is running in multiple interpreter mode *** Aug 09 14:29:41.929366 n-d-844626-8 devstack@n-api.service[119397]: spawned uWSGI master process (pid: 119397) Aug 09 14:29:41.929552 n-d-844626-8 systemd[1]: Started Devstack devstack@n-api.service. Aug 09 14:29:41.930213 n-d-844626-8 devstack@n-api.service[119397]: spawned uWSGI worker 1 (pid: 119406, cores: 1) Aug 09 14:29:41.930554 n-d-844626-8 devstack@n-api.service[119397]: spawned uWSGI worker 2 (pid: 119407, cores: 1) Aug 09 14:29:41.930887 n-d-844626-8 devstack@n-api.service[119397]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 14:29:42.580543 n-d-844626-8 devstack@n-api.service[119407]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 14:29:42.590548 n-d-844626-8 devstack@n-api.service[119406]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 14:29:43.748724 n-d-844626-8 devstack@n-api.service[119407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 14:29:43.748724 n-d-844626-8 devstack@n-api.service[119407]: from cryptography.utils import int_from_bytes Aug 09 14:29:43.749412 n-d-844626-8 devstack@n-api.service[119407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 14:29:43.749412 n-d-844626-8 devstack@n-api.service[119407]: from cryptography.utils import int_from_bytes Aug 09 14:29:43.752376 n-d-844626-8 devstack@n-api.service[119406]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 14:29:43.752376 n-d-844626-8 devstack@n-api.service[119406]: from cryptography.utils import int_from_bytes Aug 09 14:29:43.752865 n-d-844626-8 devstack@n-api.service[119406]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 14:29:43.752865 n-d-844626-8 devstack@n-api.service[119406]: from cryptography.utils import int_from_bytes Aug 09 14:29:46.043180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 14:29:46.043691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 14:29:46.043691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 14:29:46.044137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 14:29:46.044137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 14:29:46.044305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 14:29:46.044305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 14:29:46.044467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 14:29:46.044561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 14:29:46.044653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 14:29:46.044883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.045037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.045203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.045300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.045521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.045636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.045832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.045955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.046155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.046265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.046460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.046566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.046776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.046867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.047121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.047233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.047445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.047605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.047709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.047798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.047996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.048122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.048314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-844626-8 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.048424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-844626-8 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.048630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.048737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.048931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.049038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.049240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.049362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.049545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.049637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.049843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.049934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.050157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.050264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.050458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.050554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.050940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.051046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.051395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.051492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.051698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.051789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.051998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.052107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.052331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.052434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.052636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.052734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.052945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.053099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.053259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.053363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.053561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.053658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.053872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.053978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.054173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.054265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.054563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-844626-8 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.054664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-844626-8 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.054871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.054961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.055205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.055311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.055514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.055607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.055915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.056047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.056302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.056425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.056612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.056770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.056927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.057056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.057250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.057847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.057966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.058199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.058325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.058517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.058631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.058829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.058944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.059168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.059337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.059484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.059641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.059781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.059954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.060103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.060251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.060391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.060534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.060698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.060844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.060991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.061142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.061288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.061434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.061434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.061749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.061850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.061935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.062017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.062105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.062324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.062429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.062593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.062697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.062843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.062947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.063105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.063254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.063429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.063521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.063744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.063843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.064050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.064149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.064351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.064450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.064650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.064748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.064946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.065034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.065243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.065332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.065541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.065632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.065839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.065930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.066139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.066229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.066450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.066551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.066757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.066846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.067060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.067197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.067380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.067480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.067693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.067796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.068012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.068120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.068317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.068459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.068603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.068731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.068930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.069073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.069238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.069337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.069536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.069626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.069845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.069945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.070149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.070237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.070447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.070535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.070744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.070843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.071043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.071206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.071378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.071469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.071690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.071780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.071968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.072067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.072241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.072344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.072536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.072657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.072831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.072927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.073138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.073284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.073436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.073533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.073732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.073829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.074028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.074116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.074320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.074417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.074619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.074708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.074916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.075020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.075245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.075342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.075583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.075749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.075867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.075965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.076115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.076215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.076441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.076586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.076748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.076908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.077015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.077190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.077346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.077439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.077621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.077775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.077920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.078070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.078225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.078444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.078683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.078831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.078974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.079138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.079282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.079443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.079443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.079718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.079869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.080007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.080144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.080290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.080444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.080581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.080716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.080851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.080987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.081131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.081287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.081426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.081426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.081694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.081694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.081958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.082103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.082238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.082381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.082518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.082687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.082808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.082968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.083122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.083255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.083396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.083484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.083577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.083720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.083817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.084017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.084113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.084315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.084420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.084607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.084707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.084901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.084989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.085190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.085293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.085501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.085639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.085814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.085965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.086111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.086211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.086393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.086491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.086692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.086803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.087000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 14:29:46.087149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.087356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.087449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.087751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.087863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.088065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.088163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.088383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.088489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.088714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.088818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.089027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.089124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.089337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.089435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.089640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.089738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.089951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.090092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.090256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.090390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.090558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.090694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.090861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.090951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.091193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.091303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.091505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.091755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.091862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.092073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.092174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.092395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.092492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.092706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.092805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.093014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.093119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.093324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.093468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.093629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.093732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.093945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.094046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.094252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.094349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.094565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.094664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.094871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.094963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.095230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.095323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.095560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.095659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.095866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.095963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.096182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.096280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.096490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.096587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.096796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.096952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.097098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.097213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.097403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.097502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.097718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.097816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.098033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.098130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.098336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.098425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.098640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.098753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.098943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.099058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.099271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.099373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.099574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.099671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.099876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.099975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.100180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.100314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.100504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.100602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.100808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.100947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.101117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.101217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.101421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.101511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.101727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.101825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.102028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.102125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.102329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.102419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.102631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.102734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.102928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.103041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.103277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.103379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.103580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.103720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.103885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.103975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.104184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.104275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.104498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.104588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.104817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.104908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.105116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.105215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.105423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.105513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.105724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.105816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.106025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.106116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.106326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.106422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.106626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.106722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.106926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.107071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.107249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.107372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.107553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.107643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.107849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.107947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.108157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.108246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.108456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.108554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.108754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.108861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.109061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.109161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.109355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.109453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.109651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.109760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.109957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.110046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.110259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.110349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.110559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.110650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.110862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.110953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.111190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.111298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.111500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.111598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.111802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.111900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.112105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.112195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.112429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.112534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.112750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.112838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.113043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.113142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.113359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.113449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.113660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.113785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.113969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.114080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.114263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.114354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.114563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.114659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.114857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.114956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.115178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.115284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.115476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.115566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.115777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.115882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.116073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.116163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.116371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.116468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.116666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.116764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.116962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.117116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.117258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.117348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.117565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.117696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.117863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.117952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.118156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.118254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.118450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.118549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.118820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.118911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.119184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.119308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.119486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.119594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.119821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.119921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.120144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.120266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.120455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.120563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.120766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.120873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.121072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.121198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.121379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.121483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.121679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.121780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.121984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.122088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.122284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.122372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.122585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.122674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.122896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.122995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.123223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.123331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.123539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.123630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.123850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.123980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.124165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.124267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.124469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.124572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.124779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.124887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.125074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.125182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.125382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.125490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.125712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.125820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.126040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.126141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.126345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.126458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.126654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.126758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.126956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.127046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.127285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.127376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.127584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.127682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.127884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.127981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.128186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.128286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.128490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.128590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.128808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.128955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.129101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.129223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.129413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.129526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.129712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.129814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.130023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.130121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.130322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.130410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.130630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.130719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.130922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.131019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.131251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.131344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.131571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.131674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.131889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.132055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.132188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.132277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.132505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.132753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.132858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.133074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.133211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.133379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.133478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.133680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.133814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.134021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.134152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.134294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.134388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.134595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.134699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.134895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.134994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.135219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.135311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.135518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.135619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.135818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.135908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.136113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.136204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.136410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.136500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.136710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.136851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.137007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.137097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.137303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.137428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.137603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.137704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.137917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.138041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.138217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.138331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.138519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.138620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.138831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.138919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.139156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.139261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.139453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.139589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.139756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.139879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.140056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.140168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.140353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.140462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.140649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.140765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.140946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.141060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.141281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.141387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.141611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.141718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.141882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.141990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.142190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.142282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.142500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.142605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.142800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.142898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.143124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.143240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.143432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.143545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.143734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.143834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.144050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.144145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.144359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.144469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.144661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.144754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.144965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.145058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.145269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.145362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.145572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.145665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.145875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.145967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.146181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.146271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.146482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.146643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.146787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.146949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.147127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.147263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.147401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.147682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.147815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.147990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.148132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.148308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.148553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.148688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.148879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.149022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.149187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.149289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.149499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.149737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.149850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.150001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.150193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.150292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.150516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.150620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.150836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.150933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.151164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.151260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.151471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.151575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.151780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.151914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.152082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.152194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.152378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.152479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.152682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.152797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.152978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.153077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.153276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.153375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.153597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.153793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.153885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.153978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.154148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.154246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.154439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.154554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.154741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.154834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.155041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.155165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.155375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.155541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.155684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.155836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.155987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.156131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.156286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.156439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.156578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.156725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.156866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.157021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.157171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.157320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.157462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.157713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.157856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.158016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.158123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.158353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.158446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.158657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.158758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.158988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.159114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.159336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.159432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.159637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.159767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.159941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.160034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.160242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.160340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.160549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.160638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.160843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.160933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.161139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.161230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.161434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.161539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.161736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.161825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.162058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.162167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.162315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.162416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.162619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.162709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.162922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.163023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.163244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.163346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.163546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.163637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.163846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.163947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.164145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.164248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.164425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.164560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.164733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.164832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.165037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.165140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.165328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.165419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.165649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.165748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.165948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.166048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.166247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.166345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.166542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.166632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.166841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.166938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.167155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.167250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.167465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.167556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.167759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.167850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.168054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.168148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.168350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.168449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.168651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.168792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.168950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.169048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.169245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.169391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.169551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.169649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.169849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.169949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.170145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.170250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.170439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.170530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.170738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.170836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.171031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.171148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.171350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.171441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.171649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.171738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.171960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.172085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.172262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.172386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.172554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.172659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.172853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.172955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.173150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.173251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.173445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.173548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.173762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.173859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.174041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.174149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.174339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.174447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.174638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.174756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.174933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.175025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.175251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.175357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.175547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.175647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.175852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.175942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.176151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.176249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.176448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.176541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.176745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.176836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.177039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.177144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.177374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.177516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.177674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.177801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.178076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.178301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.178405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.178606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.178696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.178904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.178994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.179237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.179330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.179543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.179638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.179847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.179981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.180147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.180238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.180442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.180540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.180750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.180857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.181053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.181172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.181415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.181507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.181723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.181896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.182026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.182124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.182345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.182465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.183009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.183137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.183336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.183441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.183644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.183736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.183947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.184052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.184252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.184361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.184549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.184640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.184853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.184958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.185157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.185249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.185456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.185548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.185759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.185863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.186061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.186154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.186362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.186453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.186667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.186762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.186969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.187069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.187297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.187404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.187597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.187708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.187893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.187986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.188194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.188297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.188497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.188590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.188795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.188906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.189104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.189211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.189402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.189518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.189702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.189829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.190024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.190145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.190292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.190441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.190594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.190745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.190891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.191054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.191339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.191434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.191644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.191750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.191948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.192040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.192244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.192335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.192550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.192736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.192892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.193048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.193196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.193342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.193491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.193638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.193790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.193938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.194146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.194290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.194429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.194571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.194717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.194936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.195105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.195211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.195305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.195400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.195571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.195670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.195873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.195965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.196187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.196293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.196483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.196582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.196800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.196941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.197213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.197321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.197525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.197623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.197823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.197936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.198137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.198229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.198541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.198665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.198844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.198936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.199169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.199275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.199498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.199587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.199802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.199907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.200138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.200248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.200422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.200517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.200759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.200863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.201074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.201167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.201374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.201472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.201679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.201779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.201981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.202072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.202294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.202434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.202590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.202801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.202894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.202988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.203212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.203320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.203510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.203641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.203830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.203964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.204148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.204286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.204455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.204562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.204766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.204895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.205167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.205276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.205482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.205574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.205785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.205877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.206085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.206184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.206387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.206478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.206690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.206787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.206987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.207096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.207314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.207404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.207611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.207702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.207907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.208013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.208209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.208299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.208506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.208604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.208807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.208932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.209106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.209239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.209418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.209509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.209685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.209819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.209979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.210073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.210294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.210406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.210638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.210737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.210898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.211003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.211223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.211334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.211525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.211618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.211827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.211919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.212118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.212217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.212513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.212622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.212824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.212946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.213118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.213240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.213416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.213528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.213732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.213841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.214047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.214161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.214346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.214446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.214659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.214760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.214982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.215108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.215413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.215523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.215608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.215681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.216254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.216367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.216446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.216528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.216604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.216675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.216873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.216976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.217131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.217230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.217395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.217529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.217699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.217803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.217999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.218095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.218298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.218407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.218599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.218708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.218920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.219011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.219242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.219358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.219540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.219670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.219839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.219931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.220138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.220247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.220442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.220742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.221082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.221384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.221708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.221986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.222098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.222316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.222418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.222632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.222740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.222943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.223039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.223277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.223389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.223586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.223699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.223898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.224208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.224402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.224502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.224753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.224863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.225063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.225172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.226023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.226187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.226348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.226491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.226630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.226793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.226934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.227108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.227284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.227438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.227582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.227722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.227722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.227896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.228096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.228908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.229121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.229271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.229447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.229598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.229750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.229885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.230062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.230222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.230390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.230625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.230730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.230865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.231007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.231177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.231370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.231632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.231726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.231986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.232298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.232609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.232972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.233288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.233583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.233893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.234205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.235031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.235285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.235285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.235979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.236117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.236211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.236682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.236870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.236985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.237071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.237155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.237250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.237336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.237429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.237515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.237599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.237683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.237765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.237859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.237953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.238051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.238320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.238428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.238523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.238620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.238706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.238790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.238886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.238973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.239064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.239293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.239395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.239590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.239746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.239898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.240067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.240224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.240335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.240547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.240763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.240855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.240957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.241144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.241238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.241452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.241579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.241756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.241882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.242088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.242186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.242360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.242454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.242664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.242766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.242966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.243068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.243308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.243618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.243985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.244286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.244566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.244696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.244869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.245119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.245234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.245472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.245563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.245792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.245894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.246121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.246446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.246690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.246792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.247024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.247186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.247363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.247455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.247677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.247769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.247979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.248077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.248293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.248508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.248601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.248823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.248923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.249154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.249255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.249471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.249576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.249787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.249989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.250156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.250385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.250685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.251007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.251331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.251632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.251878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.251980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.252215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.252306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.252517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.252623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.252816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.252908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.253116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.253216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.253415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.253517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.253725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.253826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.254031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.254197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.254336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.254448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.254635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.254745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.254938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.255050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.255258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.255565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.255865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.256191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.257865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.257865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.258075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.258181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.258281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.258386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.259168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.259348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.259457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.259553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.259553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.259717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.259717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.259986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.259986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.260163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.260163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.260332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.260432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.260521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.260608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.260730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.260846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.261195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.261324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.261452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.261580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.261708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.261872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.262047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.262168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.262349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.262522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.262672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.262792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.262909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.263023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.263202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.263332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.263332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.263560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.263676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.263800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.263937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.264065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.264189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.292619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.293943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.294161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.294433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.294690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.294969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.295417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.295685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.295837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.295984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.296133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.296289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.296411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.296534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.296646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.296758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.296861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.296987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.297196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.297338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.297467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.297587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.297720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.297984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.298158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.298309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.298458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.298593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.298593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.298856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.299012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.299183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.299311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.299446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.299568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.299688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.299808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.299934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.300029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.300131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.300244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.300474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.300585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.300753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.300842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.300913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.300981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.301082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.301175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.301264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.301361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.301454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.301545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.301634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.301737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.301874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.302252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.302754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.303494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.303678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.303964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.304724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.304838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.304932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.305023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.305166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.305264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.305372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.305372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.305573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.305690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.305898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.306010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.306128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.306289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.306436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.306569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.306708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.306851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.306985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.307182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.307320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.307845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.308133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.308417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.308627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.308853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.308969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.309077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.309169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.309316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.309447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.309564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.309672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.309765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.309840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.309928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.309995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.310968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.311103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.311229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.311337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.311444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.311551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.311622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.311706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.311706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.311895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.311895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.312021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.312021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.312153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.312153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.312259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.312259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.312388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.312458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.312458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.313913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.314977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.315982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.316966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.317851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 14:29:46.318666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.318666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.319775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.320348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.320726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.321115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.321504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.322000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.322399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.322778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.323201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.323585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.323976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.324360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.324749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.325141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.325517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.325913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.326353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.326655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.327029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.327433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.327811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.328185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.328565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.328943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.329339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.329731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.330104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.330507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.330900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.331340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.331718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.332127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.332517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.332895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.333274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.333990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 14:29:46.334300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119406) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 14:29:46.457946 n-d-844626-8 devstack@n-api.service[119407]: INFO dbcounter [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Registered counter for database nova_api Aug 09 14:29:46.479693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_db.sqlalchemy.engines [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:29:46.487633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writer thread running {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:29:46.488572 n-d-844626-8 devstack@n-api.service[119406]: INFO dbcounter [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Registered counter for database nova_api Aug 09 14:29:46.508951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_db.sqlalchemy.engines [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:29:46.516018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writer thread running {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:29:46.545055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.context [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) {{(pid=119407) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 14:29:46.549397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:29:46.550035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:29:46.551772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:29:46.552643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:29:46.553237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:29:46.555997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:29:46.558615 n-d-844626-8 devstack@n-api.service[119407]: INFO dbcounter [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Registered counter for database nova_cell0 Aug 09 14:29:46.562968 n-d-844626-8 devstack@n-api.service[119407]: INFO dbcounter [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Registered counter for database nova_cell1 Aug 09 14:29:46.570355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_db.sqlalchemy.engines [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:29:46.573272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.context [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) {{(pid=119406) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 14:29:46.574725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_db.sqlalchemy.engines [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:29:46.576978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writer thread running {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:29:46.577379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:29:46.577850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:29:46.579471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:29:46.580372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:29:46.581040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:29:46.583110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:29:46.585163 n-d-844626-8 devstack@n-api.service[119406]: INFO dbcounter [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Registered counter for database nova_cell0 Aug 09 14:29:46.589262 n-d-844626-8 devstack@n-api.service[119406]: INFO dbcounter [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Registered counter for database nova_cell1 Aug 09 14:29:46.596589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_db.sqlalchemy.engines [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:29:46.601650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writer thread running {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:29:46.602306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_db.sqlalchemy.engines [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:29:46.721985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writer thread running {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:29:46.731420 n-d-844626-8 devstack@n-api.service[119407]: INFO dbcounter [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Registered counter for database nova_cell0 Aug 09 14:29:46.738719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_db.sqlalchemy.engines [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:29:46.742964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writer thread running {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:29:46.744590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writer thread running {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:29:46.752001 n-d-844626-8 devstack@n-api.service[119406]: INFO dbcounter [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Registered counter for database nova_cell0 Aug 09 14:29:46.758837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_db.sqlalchemy.engines [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119406) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 14:29:46.763367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writer thread running {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 14:29:47.060395 n-d-844626-8 devstack@n-api.service[119407]: WARNING keystonemiddleware.auth_token [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 14:29:47.067836 n-d-844626-8 devstack@n-api.service[119407]: WARNING keystonemiddleware.auth_token [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 14:29:47.074659 n-d-844626-8 devstack@n-api.service[119406]: WARNING keystonemiddleware.auth_token [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 14:29:47.081995 n-d-844626-8 devstack@n-api.service[119406]: WARNING keystonemiddleware.auth_token [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 14:29:47.409180 n-d-844626-8 devstack@n-api.service[119407]: WARNING keystonemiddleware.auth_token [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 14:29:47.415163 n-d-844626-8 devstack@n-api.service[119407]: WARNING keystonemiddleware.auth_token [None req-07906da8-9aa5-4831-9822-5c3b3eb3d78e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 14:29:47.421546 n-d-844626-8 devstack@n-api.service[119407]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55589cf1b9c0 pid: 119407 (default app) Aug 09 14:29:47.423300 n-d-844626-8 devstack@n-api.service[119406]: WARNING keystonemiddleware.auth_token [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 14:29:47.429520 n-d-844626-8 devstack@n-api.service[119406]: WARNING keystonemiddleware.auth_token [None req-5baf2508-f18e-4978-a2ec-e1cc6ed2bd4d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 14:29:47.436155 n-d-844626-8 devstack@n-api.service[119406]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55589cf1b9c0 pid: 119406 (default app) Aug 09 14:30:25.673973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:25.688117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:25.689235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:25.690617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:27.121825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-803b24aa-3639-4e2c-8ebe-31cdabaa0d12 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '.version_select at 0x7f41e4e7edc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:27.123926 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:27.123926 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:27.131527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-803b24aa-3639-4e2c-8ebe-31cdabaa0d12 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) {{(pid=119407) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 09 14:30:27.132698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-803b24aa-3639-4e2c-8ebe-31cdabaa0d12 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:27.133346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-803b24aa-3639-4e2c-8ebe-31cdabaa0d12 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:27.133900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-803b24aa-3639-4e2c-8ebe-31cdabaa0d12 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:27.162245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-803b24aa-3639-4e2c-8ebe-31cdabaa0d12 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:27.163610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-803b24aa-3639-4e2c-8ebe-31cdabaa0d12 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:27.164032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-803b24aa-3639-4e2c-8ebe-31cdabaa0d12 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:27.178388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-803b24aa-3639-4e2c-8ebe-31cdabaa0d12 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:27.179283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-803b24aa-3639-4e2c-8ebe-31cdabaa0d12 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:27.179859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-803b24aa-3639-4e2c-8ebe-31cdabaa0d12 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:27.186834 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-803b24aa-3639-4e2c-8ebe-31cdabaa0d12 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.520015 Aug 09 14:30:27.187741 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1/1] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 9 14:30:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:27.463801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f853d554-8ccf-4ae2-b506-7e6e774d6c4c tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-475699290", "name": "tempest-test_aggregate-73300397"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:27.507929 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:27.507929 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:27.509220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-f853d554-8ccf-4ae2-b506-7e6e774d6c4c tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Generated uuid 46e1f99b-848e-4360-bc15-6661ad51860c for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:30:27.518551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:27.519587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:27.520415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:27.521429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:27.598405 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f853d554-8ccf-4ae2-b506-7e6e774d6c4c tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.395129 Aug 09 14:30:27.599276 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1/2] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Aug 9 14:30:27 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:27.610806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2380f6f-8481-4fe8-9aae-11380f7b6ce5 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:27.612219 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:27.612219 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:27.626610 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2380f6f-8481-4fe8-9aae-11380f7b6ce5 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 299 microversion: 2.1 time: 0.020004 Aug 09 14:30:27.627545 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:30:27 2022] GET /compute/v2.1/os-aggregates => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:30:27.639305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-86f3a81e-b6a1-427f-89ff-01863d1a0617 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:27.642021 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:27.642021 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:27.660238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86f3a81e-b6a1-427f-89ff-01863d1a0617 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:27.660714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86f3a81e-b6a1-427f-89ff-01863d1a0617 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:27.661140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86f3a81e-b6a1-427f-89ff-01863d1a0617 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:27.994002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-83bb8a55-a66f-4c1a-86a3-14684efc55dc tempest-AZAdminNegativeTestJSON-1651683152 tempest-AZAdminNegativeTestJSON-1651683152-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:27.995287 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:27.995287 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:27.996779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-83bb8a55-a66f-4c1a-86a3-14684efc55dc tempest-AZAdminNegativeTestJSON-1651683152 tempest-AZAdminNegativeTestJSON-1651683152-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'e9a3475e8b8640a996f294c017ccac49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6c371406fe488eaafc55fca1d7d0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-83bb8a55-a66f-4c1a-86a3-14684efc55dc tempest-AZAdminNegativeTestJSON-1651683152 tempest-AZAdminNegativeTestJSON-1651683152-project] Request method failure captured: Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-Bq95_7cSBNuoNH448bB-REQyMi29_zWyW3Q3RPIGMpHpRqY2ZjRMnE5R8VlN95F7CK5Tg-CV1wh0GzLtk8SJ_PqkvEY4puZJOXgOgd3dkxdLy7mJ1Ht1oGsZCjQ6S1NH5qmexKpsg8uwd6Xx1e-KbmzNZEtJsvvehL6vrPumTzFY Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 4f6c371406fe488eaafc55fca1d7d0b2 Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1651683152 Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:30:28.000357 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:30:28.001523 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4f6c371406fe488eaafc55fca1d7d0b2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4f6c371406fe488eaafc55fca1d7d0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4f6c371406fe488eaafc55fca1d7d0b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4f6c371406fe488eaafc55fca1d7d0b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:28.001523 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AZAdminNegativeTestJSON-1651683152 Aug 09 14:30:28.001523 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 4f6c371406fe488eaafc55fca1d7d0b2 Aug 09 14:30:28.001523 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1651683152 Aug 09 14:30:28.001523 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AZAdminNegativeTestJSON-1651683152-project Aug 09 14:30:28.001523 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:28.001523 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:28.001523 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e9a3475e8b8640a996f294c017ccac49 Aug 09 14:30:28.001523 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AZAdminNegativeTestJSON-1651683152-project Aug 09 14:30:28.001523 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:30:28.001523 n-d-844626-8 devstack@n-api.service[119407]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 09 14:30:28.001523 n-d-844626-8 devstack@n-api.service[119407]: action_args: {} Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:28.002236 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:28.003172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-83bb8a55-a66f-4c1a-86a3-14684efc55dc tempest-AZAdminNegativeTestJSON-1651683152 tempest-AZAdminNegativeTestJSON-1651683152-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:28.003998 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-83bb8a55-a66f-4c1a-86a3-14684efc55dc tempest-AZAdminNegativeTestJSON-1651683152 tempest-AZAdminNegativeTestJSON-1651683152-project] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.499377 Aug 09 14:30:28.003998 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 9 14:30:27 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 500 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:30:28.960620 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-86f3a81e-b6a1-427f-89ff-01863d1a0617 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 311 microversion: 2.1 time: 1.325449 Aug 09 14:30:28.962030 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3/5] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 9 14:30:27 2022] POST /compute/v2.1/os-aggregates/1/action => generated 311 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:29.012904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0f84f598-5841-4700-b1d8-98c5b86a40dc tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Calling method '.version_select at 0x7f41e4cf1a60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:29.017274 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:29.017274 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:29.020503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f84f598-5841-4700-b1d8-98c5b86a40dc tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:29.020503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f84f598-5841-4700-b1d8-98c5b86a40dc tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:29.023262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f84f598-5841-4700-b1d8-98c5b86a40dc tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:29.026198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f84f598-5841-4700-b1d8-98c5b86a40dc tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:29.026775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f84f598-5841-4700-b1d8-98c5b86a40dc tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:29.027240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f84f598-5841-4700-b1d8-98c5b86a40dc tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:29.086629 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0f84f598-5841-4700-b1d8-98c5b86a40dc tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.507594 Aug 09 14:30:29.095973 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3/6] 10.222.0.50 () {58 vars in 1128 bytes} [Tue Aug 9 14:30:28 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:30:29.494568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b96a0d99-bd6c-4d5e-8b4d-7843668fe2ef tempest-FlavorsV255TestJSON-502350270 tempest-FlavorsV255TestJSON-502350270-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1223224861", "id": 521053961, "os-flavor-access:is_public": "True"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:29.515228 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:29.515228 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:29.548643 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b96a0d99-bd6c-4d5e-8b4d-7843668fe2ef tempest-FlavorsV255TestJSON-502350270 tempest-FlavorsV255TestJSON-502350270-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.451640 Aug 09 14:30:29.558308 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 4/7] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:30:29 2022] POST /compute/v2.1/flavors => generated 446 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:30:29.566383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a928b5b-1d42-409b-b25e-fc78f4da1795 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Calling method '.version_select at 0x7f41e44374c0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:29.571774 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:29.571774 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:29.582641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a928b5b-1d42-409b-b25e-fc78f4da1795 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) {{(pid=119406) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 09 14:30:29.583829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a928b5b-1d42-409b-b25e-fc78f4da1795 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:29.584473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a928b5b-1d42-409b-b25e-fc78f4da1795 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:29.584978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a928b5b-1d42-409b-b25e-fc78f4da1795 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:29.608114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a928b5b-1d42-409b-b25e-fc78f4da1795 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:29.608929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a928b5b-1d42-409b-b25e-fc78f4da1795 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:29.609420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a928b5b-1d42-409b-b25e-fc78f4da1795 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:29.622614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a928b5b-1d42-409b-b25e-fc78f4da1795 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:29.623230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a928b5b-1d42-409b-b25e-fc78f4da1795 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:29.623709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a928b5b-1d42-409b-b25e-fc78f4da1795 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:29.629979 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a928b5b-1d42-409b-b25e-fc78f4da1795 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.666526 Aug 09 14:30:29.630636 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 4/8] 10.222.0.50 () {60 vars in 1208 bytes} [Tue Aug 9 14:30:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:30:29.706511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d85f4fb7-1198-476d-b74b-e5a0f2e27cc0 tempest-FlavorMetadataValidation-1779339047 tempest-FlavorMetadataValidation-1779339047-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-568096162", "id": 978446820, "os-flavor-access:is_public": "True"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:29.727427 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d85f4fb7-1198-476d-b74b-e5a0f2e27cc0 tempest-FlavorMetadataValidation-1779339047 tempest-FlavorMetadataValidation-1779339047-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.167962 Aug 09 14:30:29.728096 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 5/9] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:30:29 2022] POST /compute/v2.1/flavors => generated 467 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:30:29.954377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43e9643c-118c-41f1-8e82-a7ae47d3758f tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Calling method '.version_select at 0x7f41e4437820>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:29.956977 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:29.956977 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:29.958750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-43e9643c-118c-41f1-8e82-a7ae47d3758f tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '820ddadd1b88413aa189806f578ce5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507a1fddd8f1462abcf58c1db837afe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43e9643c-118c-41f1-8e82-a7ae47d3758f tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Request method failure captured: Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-BuzRC1EdXyRqRo1HLk7bIA_04tDfAlZKcKxNe0eLm6xy-2Tj-u4I6qVhKq4ojvSry7H6UsedMx7lf3Bye4ulNMwOtKbrKEyvc6LlHK6mpyesGE6U0LEznUKGVQs0gtNO-iaTPOToFVLeRp0N1pH7wXXO8VxsGONDPd1nJQUUVECU Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 507a1fddd8f1462abcf58c1db837afe0 Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:30:29.962668 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_507a1fddd8f1462abcf58c1db837afe0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 507a1fddd8f1462abcf58c1db837afe0 Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HostsAdminNegativeTestJSON-2081181060-project Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 820ddadd1b88413aa189806f578ce5c7 Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2081181060-project Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: action_args: {} Aug 09 14:30:29.964303 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:29.964945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 09 14:30:29.965816 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:29.968423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43e9643c-118c-41f1-8e82-a7ae47d3758f tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:29.969618 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-43e9643c-118c-41f1-8e82-a7ae47d3758f tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.337879 Aug 09 14:30:29.970786 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 5/10] 10.222.0.50 () {58 vars in 1128 bytes} [Tue Aug 9 14:30:29 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 339 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:30:30.112247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1525730201", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "availability_zone": "tempest-test_az-475699290"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:30.142170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:30.142694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:30.143071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:30.143838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:30.144336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:30.144653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:30.316220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-74d168ab-dde1-4e78-8e12-e8ae068915ff tempest-FlavorsV255TestJSON-1565963862 tempest-FlavorsV255TestJSON-1565963862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:30.340154 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-74d168ab-dde1-4e78-8e12-e8ae068915ff tempest-FlavorsV255TestJSON-1565963862 tempest-FlavorsV255TestJSON-1565963862-project] 10.222.0.50 "GET /compute/v2.1/flavors/521053961" status: 200 len: 446 microversion: 2.55 time: 0.367884 Aug 09 14:30:30.343650 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 6/11] 10.222.0.50 () {60 vars in 1196 bytes} [Tue Aug 9 14:30:29 2022] GET /compute/v2.1/flavors/521053961 => generated 446 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:30:30.345837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-759d486f-801d-425f-8d55-5480a6db3406 tempest-FlavorMetadataValidation-1779339047 tempest-FlavorMetadataValidation-1779339047-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:30.348671 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:30.348671 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:30.544278 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-759d486f-801d-425f-8d55-5480a6db3406 tempest-FlavorMetadataValidation-1779339047 tempest-FlavorMetadataValidation-1779339047-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/978446820/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.202255 Aug 09 14:30:30.544869 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 7/12] 10.222.0.50 () {62 vars in 1262 bytes} [Tue Aug 9 14:30:30 2022] POST /compute/v2.1/flavors/978446820/os-extra_specs => generated 62 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:30.550163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b5a34d5b-c0c4-45f2-8ebd-fcb89720ae20 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Calling method '.version_select at 0x7f41e4386790>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:30.550939 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:30.550939 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:30.552044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b5a34d5b-c0c4-45f2-8ebd-fcb89720ae20 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '820ddadd1b88413aa189806f578ce5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507a1fddd8f1462abcf58c1db837afe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b5a34d5b-c0c4-45f2-8ebd-fcb89720ae20 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Request method failure captured: Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hosts/n-d-844626-8/reboot HTTP/1.1 Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-BuzRC1EdXyRqRo1HLk7bIA_04tDfAlZKcKxNe0eLm6xy-2Tj-u4I6qVhKq4ojvSry7H6UsedMx7lf3Bye4ulNMwOtKbrKEyvc6LlHK6mpyesGE6U0LEznUKGVQs0gtNO-iaTPOToFVLeRp0N1pH7wXXO8VxsGONDPd1nJQUUVECU Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 507a1fddd8f1462abcf58c1db837afe0 Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:30:30.553587 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_507a1fddd8f1462abcf58c1db837afe0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 507a1fddd8f1462abcf58c1db837afe0 Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HostsAdminNegativeTestJSON-2081181060-project Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 820ddadd1b88413aa189806f578ce5c7 Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2081181060-project Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'n-d-844626-8'} Aug 09 14:30:30.555115 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:30.555902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 09 14:30:30.557252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:30.558475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b5a34d5b-c0c4-45f2-8ebd-fcb89720ae20 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:30.558475 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b5a34d5b-c0c4-45f2-8ebd-fcb89720ae20 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-844626-8/reboot" status: 403 len: 111 microversion: 2.1 time: 0.008983 Aug 09 14:30:30.558475 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 8/13] 10.222.0.50 () {58 vars in 1188 bytes} [Tue Aug 9 14:30:30 2022] GET /compute/v2.1/os-hosts/n-d-844626-8/reboot => generated 111 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:30:30.697911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67e7c978-bb47-4da9-a5c1-1492bb58d24e tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-77261379", "id": 234519072, "os-flavor-access:is_public": "False"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:30.700705 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:30.700705 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:30.721433 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-67e7c978-bb47-4da9-a5c1-1492bb58d24e tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.164621 Aug 09 14:30:30.722024 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 9/14] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:30:30 2022] POST /compute/v2.1/flavors => generated 434 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:30.737158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-663ab224-700a-49a6-9809-0e267f87b33e tempest-FlavorsV255TestJSON-502350270 tempest-FlavorsV255TestJSON-502350270-project-admin] Action: 'update', calling method: .version_select at 0x7f41e5241b80>, body: {"flavor": {"description": "new"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:30.748718 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:30.748718 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:30.776990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:30:30.781579 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-663ab224-700a-49a6-9809-0e267f87b33e tempest-FlavorsV255TestJSON-502350270 tempest-FlavorsV255TestJSON-502350270-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/521053961" status: 200 len: 447 microversion: 2.55 time: 0.048221 Aug 09 14:30:30.782304 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 10/15] 10.222.0.50 () {62 vars in 1216 bytes} [Tue Aug 9 14:30:30 2022] PUT /compute/v2.1/flavors/521053961 => generated 447 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:30:30.787115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87740998-696b-41e4-9e3c-f5014e9846e0 tempest-FlavorMetadataValidation-1779339047 tempest-FlavorMetadataValidation-1779339047-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:30.788179 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:30.788179 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:30.827706 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87740998-696b-41e4-9e3c-f5014e9846e0 tempest-FlavorMetadataValidation-1779339047 tempest-FlavorMetadataValidation-1779339047-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/978446820" status: 202 len: 0 microversion: 2.86 time: 0.043897 Aug 09 14:30:30.832416 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 11/16] 10.222.0.50 () {60 vars in 1199 bytes} [Tue Aug 9 14:30:30 2022] DELETE /compute/v2.1/flavors/978446820 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:30:30.837686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eecfbc40-85ea-4035-b7e3-6441b836ebae tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Calling method '.version_select at 0x7f41e4325d30>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:30.853100 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-eecfbc40-85ea-4035-b7e3-6441b836ebae tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eecfbc40-85ea-4035-b7e3-6441b836ebae tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Request method failure captured: Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-Er-iGm4Hf7GQ4aJ-_RGv86h2AwjN3pZcaVvVwICXun0OhFlJ6kCwCqSPKi1xiqkn3biFIcrVDmyuEdmqixgYl5rtB7RgLjXfs5pGs0pxR5sfOja4--BlmDpiNAiki3yKNNu2nRdi1YFg29KdkhGcOvgu28eukG5uhdXHRco0mQrU Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:30:30.867654 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_838f8080c3a540268e66e8830714e64f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/838f8080c3a540268e66e8830714e64f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 98cec5c8834943d2bbad6fa835282d16 Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'nonexistent_hostname'} Aug 09 14:30:30.868676 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:30:30.869326 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 09 14:30:30.870217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eecfbc40-85ea-4035-b7e3-6441b836ebae tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eecfbc40-85ea-4035-b7e3-6441b836ebae tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.032180 Aug 09 14:30:30.873700 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 12/17] 10.222.0.50 () {58 vars in 1212 bytes} [Tue Aug 9 14:30:30 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:30:30.879742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9eb665a6-65e1-4c03-8afa-8dc32cddb3bc tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a1dc2ef2cf8f42ba9f00fb4e54b6a757"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:30.888567 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:30.888567 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:31.036810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:30:31.037941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:30:31.039303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:30:31.039827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:30:31.040547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:30:31.056964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:31.057442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:31.058094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:31.059213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:31.059824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:31.060390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:31.095075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Getting quotas for project 36c69ad6412d4e4581eee19d03c6baef. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:30:31.102153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Getting quotas for user 2a4383fb5b774f569258d463e090a89a and project 36c69ad6412d4e4581eee19d03c6baef. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:30:31.113723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:30:31.116523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:30:31.197860 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-925b8b9a-ce1d-467e-a540-59b7161bac9f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.467423 Aug 09 14:30:31.199843 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 6/18] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:30:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:30:31.207129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ec504627-031a-41cc-b9f9-2d1e4c2d6728 tempest-FlavorsV255TestJSON-1565963862 tempest-FlavorsV255TestJSON-1565963862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:31.245864 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ec504627-031a-41cc-b9f9-2d1e4c2d6728 tempest-FlavorsV255TestJSON-1565963862 tempest-FlavorsV255TestJSON-1565963862-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.044257 Aug 09 14:30:31.246949 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 7/19] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 9 14:30:31 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:30:31.253375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e87bc1ab-b64e-4d76-8e96-77cc47cc9e17 tempest-FlavorMetadataValidation-1779339047 tempest-FlavorMetadataValidation-1779339047-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:31.284943 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9eb665a6-65e1-4c03-8afa-8dc32cddb3bc tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/234519072/action" status: 200 len: 96 microversion: 2.1 time: 0.416086 Aug 09 14:30:31.285987 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 13/20] 10.222.0.50 () {60 vars in 1197 bytes} [Tue Aug 9 14:30:30 2022] POST /compute/v2.1/flavors/234519072/action => generated 96 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:30:31.291239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be611544-db43-48cd-b360-1b59d91a758f tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Calling method '.version_select at 0x7f41e4225790>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:31.292192 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:31.292192 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:31.294071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-be611544-db43-48cd-b360-1b59d91a758f tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '820ddadd1b88413aa189806f578ce5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507a1fddd8f1462abcf58c1db837afe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be611544-db43-48cd-b360-1b59d91a758f tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Request method failure captured: Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hosts/n-d-844626-8 HTTP/1.1 Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-BuzRC1EdXyRqRo1HLk7bIA_04tDfAlZKcKxNe0eLm6xy-2Tj-u4I6qVhKq4ojvSry7H6UsedMx7lf3Bye4ulNMwOtKbrKEyvc6LlHK6mpyesGE6U0LEznUKGVQs0gtNO-iaTPOToFVLeRp0N1pH7wXXO8VxsGONDPd1nJQUUVECU Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 507a1fddd8f1462abcf58c1db837afe0 Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:30:31.296183 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_507a1fddd8f1462abcf58c1db837afe0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 507a1fddd8f1462abcf58c1db837afe0 Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HostsAdminNegativeTestJSON-2081181060-project Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 820ddadd1b88413aa189806f578ce5c7 Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2081181060-project Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'n-d-844626-8'} Aug 09 14:30:31.297445 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:31.298232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 09 14:30:31.299412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:31.301123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be611544-db43-48cd-b360-1b59d91a758f tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:31.302861 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be611544-db43-48cd-b360-1b59d91a758f tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-844626-8" status: 403 len: 109 microversion: 2.1 time: 0.015175 Aug 09 14:30:31.303589 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 14/21] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 9 14:30:31 2022] GET /compute/v2.1/os-hosts/n-d-844626-8 => generated 109 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:30:31.309412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dd0ace15-4b70-4dbe-8394-e1441a6d00b8 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:31.310549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dd0ace15-4b70-4dbe-8394-e1441a6d00b8 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:31.328581 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e87bc1ab-b64e-4d76-8e96-77cc47cc9e17 tempest-FlavorMetadataValidation-1779339047 tempest-FlavorMetadataValidation-1779339047-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6232 microversion: 2.86 time: 0.080006 Aug 09 14:30:31.343571 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 8/22] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 9 14:30:31 2022] GET /compute/v2.1/flavors/detail => generated 6232 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:30:31.349005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2e1376c-c9a8-4601-9acd-b7e3074d5e95 tempest-FlavorsV255TestJSON-1565963862 tempest-FlavorsV255TestJSON-1565963862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:31.374606 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2e1376c-c9a8-4601-9acd-b7e3074d5e95 tempest-FlavorsV255TestJSON-1565963862 tempest-FlavorsV255TestJSON-1565963862-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.029711 Aug 09 14:30:31.375508 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 9/23] 10.222.0.50 () {60 vars in 1166 bytes} [Tue Aug 9 14:30:31 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:30:31.380123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc88193c-1ce0-425f-8f48-7026de95ec07 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a1dc2ef2cf8f42ba9f00fb4e54b6a757"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:31.382645 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:31.382645 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:31.922124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd0ace15-4b70-4dbe-8394-e1441a6d00b8 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:31.936590 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dd0ace15-4b70-4dbe-8394-e1441a6d00b8 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1242 microversion: 2.1 time: 0.631764 Aug 09 14:30:31.937251 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 15/24] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:31 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1242 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:31.942177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e46a6bf-f4df-4349-846a-813c20a3302a tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Calling method '.version_select at 0x7f41e42254c0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:31.943037 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:31.943037 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:31.948849 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-2e46a6bf-f4df-4349-846a-813c20a3302a tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e46a6bf-f4df-4349-846a-813c20a3302a tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Request method failure captured: Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-Er-iGm4Hf7GQ4aJ-_RGv86h2AwjN3pZcaVvVwICXun0OhFlJ6kCwCqSPKi1xiqkn3biFIcrVDmyuEdmqixgYl5rtB7RgLjXfs5pGs0pxR5sfOja4--BlmDpiNAiki3yKNNu2nRdi1YFg29KdkhGcOvgu28eukG5uhdXHRco0mQrU Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:30:31.950801 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_838f8080c3a540268e66e8830714e64f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/838f8080c3a540268e66e8830714e64f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 98cec5c8834943d2bbad6fa835282d16 Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'nonexistent_hostname'} Aug 09 14:30:31.952080 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:31.952875 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:31.953973 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:31.955651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e46a6bf-f4df-4349-846a-813c20a3302a tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:31.956624 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2e46a6bf-f4df-4349-846a-813c20a3302a tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.017934 Aug 09 14:30:31.957470 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 16/25] 10.222.0.50 () {58 vars in 1191 bytes} [Tue Aug 9 14:30:31 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:30:31.964076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13ad16c5-102f-480d-b72e-b5e23a9c0fca tempest-FlavorsV255TestJSON-502350270 tempest-FlavorsV255TestJSON-502350270-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:31.965023 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:31.965023 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:31.983034 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-13ad16c5-102f-480d-b72e-b5e23a9c0fca tempest-FlavorsV255TestJSON-502350270 tempest-FlavorsV255TestJSON-502350270-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/521053961" status: 202 len: 0 microversion: 2.55 time: 0.024115 Aug 09 14:30:31.983930 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 17/26] 10.222.0.50 () {60 vars in 1199 bytes} [Tue Aug 9 14:30:31 2022] DELETE /compute/v2.1/flavors/521053961 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:30:31.988777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5aba9946-1f68-4d65-b1e4-719fc774a6c6 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Calling method '.version_select at 0x7f41e42254c0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:31.989567 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:31.989567 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:31.990981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5aba9946-1f68-4d65-b1e4-719fc774a6c6 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '820ddadd1b88413aa189806f578ce5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507a1fddd8f1462abcf58c1db837afe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5aba9946-1f68-4d65-b1e4-719fc774a6c6 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Request method failure captured: Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hosts/n-d-844626-8/shutdown HTTP/1.1 Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-BuzRC1EdXyRqRo1HLk7bIA_04tDfAlZKcKxNe0eLm6xy-2Tj-u4I6qVhKq4ojvSry7H6UsedMx7lf3Bye4ulNMwOtKbrKEyvc6LlHK6mpyesGE6U0LEznUKGVQs0gtNO-iaTPOToFVLeRp0N1pH7wXXO8VxsGONDPd1nJQUUVECU Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 507a1fddd8f1462abcf58c1db837afe0 Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:30:31.992662 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_507a1fddd8f1462abcf58c1db837afe0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 507a1fddd8f1462abcf58c1db837afe0 Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HostsAdminNegativeTestJSON-2081181060-project Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 820ddadd1b88413aa189806f578ce5c7 Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2081181060-project Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'n-d-844626-8'} Aug 09 14:30:31.993817 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:31.994446 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 09 14:30:31.995357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:31.996203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5aba9946-1f68-4d65-b1e4-719fc774a6c6 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:31.997106 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5aba9946-1f68-4d65-b1e4-719fc774a6c6 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-844626-8/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.012070 Aug 09 14:30:31.999303 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 18/27] 10.222.0.50 () {58 vars in 1194 bytes} [Tue Aug 9 14:30:31 2022] GET /compute/v2.1/os-hosts/n-d-844626-8/shutdown => generated 113 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:30:32.006422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12ee14c8-f2ba-4c8a-a44e-4a25e341ae33 tempest-FlavorsV255TestJSON-502350270 tempest-FlavorsV255TestJSON-502350270-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:32.038512 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-12ee14c8-f2ba-4c8a-a44e-4a25e341ae33 tempest-FlavorsV255TestJSON-502350270 tempest-FlavorsV255TestJSON-502350270-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.038134 Aug 09 14:30:32.039283 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 19/28] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 9 14:30:31 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:30:32.044989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4db7a480-2206-4704-a415-44cf783d5f79 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Calling method '.version_select at 0x7f41e41e4ee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:32.054463 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4db7a480-2206-4704-a415-44cf783d5f79 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4db7a480-2206-4704-a415-44cf783d5f79 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Request method failure captured: Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-Er-iGm4Hf7GQ4aJ-_RGv86h2AwjN3pZcaVvVwICXun0OhFlJ6kCwCqSPKi1xiqkn3biFIcrVDmyuEdmqixgYl5rtB7RgLjXfs5pGs0pxR5sfOja4--BlmDpiNAiki3yKNNu2nRdi1YFg29KdkhGcOvgu28eukG5uhdXHRco0mQrU Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:30:32.056264 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_838f8080c3a540268e66e8830714e64f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/838f8080c3a540268e66e8830714e64f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 98cec5c8834943d2bbad6fa835282d16 Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'nonexistent_hostname'} Aug 09 14:30:32.057622 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:30:32.058304 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 09 14:30:32.059230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4db7a480-2206-4704-a415-44cf783d5f79 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4db7a480-2206-4704-a415-44cf783d5f79 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.017632 Aug 09 14:30:32.060318 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 20/29] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 9 14:30:32 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:30:32.068577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c86476b-f5ca-46a3-8c49-ff3f82277874 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Calling method '.version_select at 0x7f41e4225e50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:32.069664 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:32.069664 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:32.071480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2c86476b-f5ca-46a3-8c49-ff3f82277874 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '820ddadd1b88413aa189806f578ce5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507a1fddd8f1462abcf58c1db837afe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c86476b-f5ca-46a3-8c49-ff3f82277874 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Request method failure captured: Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hosts/n-d-844626-8/startup HTTP/1.1 Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-BuzRC1EdXyRqRo1HLk7bIA_04tDfAlZKcKxNe0eLm6xy-2Tj-u4I6qVhKq4ojvSry7H6UsedMx7lf3Bye4ulNMwOtKbrKEyvc6LlHK6mpyesGE6U0LEznUKGVQs0gtNO-iaTPOToFVLeRp0N1pH7wXXO8VxsGONDPd1nJQUUVECU Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 507a1fddd8f1462abcf58c1db837afe0 Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:30:32.073327 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_507a1fddd8f1462abcf58c1db837afe0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 507a1fddd8f1462abcf58c1db837afe0 Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HostsAdminNegativeTestJSON-2081181060-project Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 820ddadd1b88413aa189806f578ce5c7 Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2081181060-project Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'n-d-844626-8'} Aug 09 14:30:32.074372 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:32.075119 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 09 14:30:32.076059 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.077086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c86476b-f5ca-46a3-8c49-ff3f82277874 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:32.077086 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2c86476b-f5ca-46a3-8c49-ff3f82277874 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-d-844626-8/startup" status: 403 len: 110 microversion: 2.1 time: 0.010630 Aug 09 14:30:32.077086 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 21/30] 10.222.0.50 () {58 vars in 1191 bytes} [Tue Aug 9 14:30:32 2022] GET /compute/v2.1/os-hosts/n-d-844626-8/startup => generated 110 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:30:32.088073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06fb7514-5f98-4e0e-b1a4-c0f601fb0cc2 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Calling method '.version_select at 0x7f41e43465e0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:32.098524 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-06fb7514-5f98-4e0e-b1a4-c0f601fb0cc2 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06fb7514-5f98-4e0e-b1a4-c0f601fb0cc2 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Request method failure captured: Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-Er-iGm4Hf7GQ4aJ-_RGv86h2AwjN3pZcaVvVwICXun0OhFlJ6kCwCqSPKi1xiqkn3biFIcrVDmyuEdmqixgYl5rtB7RgLjXfs5pGs0pxR5sfOja4--BlmDpiNAiki3yKNNu2nRdi1YFg29KdkhGcOvgu28eukG5uhdXHRco0mQrU Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:30:32.101171 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_838f8080c3a540268e66e8830714e64f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/838f8080c3a540268e66e8830714e64f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 98cec5c8834943d2bbad6fa835282d16 Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'nonexistent_hostname'} Aug 09 14:30:32.102347 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:30:32.103018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 09 14:30:32.104968 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06fb7514-5f98-4e0e-b1a4-c0f601fb0cc2 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-06fb7514-5f98-4e0e-b1a4-c0f601fb0cc2 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.019785 Aug 09 14:30:32.105924 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 22/31] 10.222.0.50 () {58 vars in 1215 bytes} [Tue Aug 9 14:30:32 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:30:32.106596 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-fc88193c-1ce0-425f-8f48-7026de95ec07 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project a1dc2ef2cf8f42ba9f00fb4e54b6a757 combination. Aug 09 14:30:32.112352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-783bb4c9-6f6d-4ab2-9f36-1d25e87a01f5 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Action: 'update', calling method: .version_select at 0x7f41e41e48b0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-783bb4c9-6f6d-4ab2-9f36-1d25e87a01f5 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Request method failure captured: Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: request: PUT /compute/v2.1/os-hosts/n-d-844626-8 HTTP/1.1 Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 51 Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-Er-iGm4Hf7GQ4aJ-_RGv86h2AwjN3pZcaVvVwICXun0OhFlJ6kCwCqSPKi1xiqkn3biFIcrVDmyuEdmqixgYl5rtB7RgLjXfs5pGs0pxR5sfOja4--BlmDpiNAiki3yKNNu2nRdi1YFg29KdkhGcOvgu28eukG5uhdXHRco0mQrU Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:30:32.117036 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_838f8080c3a540268e66e8830714e64f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/838f8080c3a540268e66e8830714e64f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 98cec5c8834943d2bbad6fa835282d16 Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: {"status": "enable", "maintenance_mode": "invalid"} Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:30:32.118565 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'n-d-844626-8', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'disable', Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'Enable', Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'Disable', Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance: Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'invalid' Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.119378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.120978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.122103 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.122103 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:30:32.122103 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:30:32.122103 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 14:30:32.122103 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.122103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-783bb4c9-6f6d-4ab2-9f36-1d25e87a01f5 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:32.122103 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-783bb4c9-6f6d-4ab2-9f36-1d25e87a01f5 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-844626-8" status: 400 len: 199 microversion: 2.1 time: 0.009877 Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc88193c-1ce0-425f-8f48-7026de95ec07 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Request method failure captured: Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/flavors/234519072/action HTTP/1.1 Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 67 Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-E3XHdqVPbdoJE0DF1mZlSBnwnYdGBt2Z_iMm621sXvO7Xtn_v0cdLxJol49as-8cBc0jNQOqKl89Mq3jqERvZJMQoADO_T-Zs-BdOi_N56s4RX_191V8VBPOlsPDZ9-jAwbP50t1TGGtnjl92oM259XWSuTVnZ4Nd47ite1KX6sk Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: acc18ad46beb4ae5b5b933b886ca4348 Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-234420831 Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:30:32.122569 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:30:32.124293 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_acc18ad46beb4ae5b5b933b886ca4348", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/acc18ad46beb4ae5b5b933b886ca4348"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/acc18ad46beb4ae5b5b933b886ca4348"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/acc18ad46beb4ae5b5b933b886ca4348"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:32.124293 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-234420831 Aug 09 14:30:32.124293 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: acc18ad46beb4ae5b5b933b886ca4348 Aug 09 14:30:32.124293 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-234420831 Aug 09 14:30:32.124293 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin Aug 09 14:30:32.124293 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:32.124293 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:32.124293 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 8f29985332a144d7a81526e3ff27912e Aug 09 14:30:32.124293 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin Aug 09 14:30:32.124293 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:30:32.124293 n-d-844626-8 devstack@n-api.service[119407]: {"addTenantAccess": {"tenant": "a1dc2ef2cf8f42ba9f00fb4e54b6a757"}} Aug 09 14:30:32.124293 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: exception: Flavor access already exists for flavor 17 and project a1dc2ef2cf8f42ba9f00fb4e54b6a757 combination. Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '234519072', 'body': {'addTenantAccess': {'tenant': 'a1dc2ef2cf8f42ba9f00fb4e54b6a757'}}} Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result.read() Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 14:30:32.126039 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-a1dc2ef2cf8f42ba9f00fb4e54b6a757' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi session.flush() Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 14:30:32.126969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 14:30:32.128194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 14:30:32.129276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result.read() Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-a1dc2ef2cf8f42ba9f00fb4e54b6a757' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 9, 14, 30, 32, 97507), 'updated_at': None, 'flavor_id': 17, 'project_id': 'a1dc2ef2cf8f42ba9f00fb4e54b6a757'}] Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.130340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project a1dc2ef2cf8f42ba9f00fb4e54b6a757 combination. Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.131542 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project a1dc2ef2cf8f42ba9f00fb4e54b6a757 combination. Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:30:32.133791 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:30:32.136754 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project a1dc2ef2cf8f42ba9f00fb4e54b6a757 combination. Aug 09 14:30:32.136754 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.137012 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 23/32] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 9 14:30:32 2022] PUT /compute/v2.1/os-hosts/n-d-844626-8 => generated 199 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:30:32.137150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc88193c-1ce0-425f-8f48-7026de95ec07 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project a1dc2ef2cf8f42ba9f00fb4e54b6a757 combination. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:32.137150 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc88193c-1ce0-425f-8f48-7026de95ec07 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/234519072/action" status: 409 len: 152 microversion: 2.1 time: 0.744102 Aug 09 14:30:32.137150 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 10/33] 10.222.0.50 () {60 vars in 1197 bytes} [Tue Aug 9 14:30:31 2022] POST /compute/v2.1/flavors/234519072/action => generated 152 bytes in 745 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:30:32.138720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bcb54981-36b1-4ad8-9e3b-6e220355a0b9 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a1dc2ef2cf8f42ba9f00fb4e54b6a757"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:32.141870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-796add68-bdd0-4592-8f9d-f22b90cb6036 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Action: 'update', calling method: .version_select at 0x7f41e411a700>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:32.143575 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:32.143575 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-796add68-bdd0-4592-8f9d-f22b90cb6036 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Request method failure captured: Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/os-hosts/n-d-844626-8 HTTP/1.1 Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 51 Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-Er-iGm4Hf7GQ4aJ-_RGv86h2AwjN3pZcaVvVwICXun0OhFlJ6kCwCqSPKi1xiqkn3biFIcrVDmyuEdmqixgYl5rtB7RgLjXfs5pGs0pxR5sfOja4--BlmDpiNAiki3yKNNu2nRdi1YFg29KdkhGcOvgu28eukG5uhdXHRco0mQrU Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:30:32.145592 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_838f8080c3a540268e66e8830714e64f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/838f8080c3a540268e66e8830714e64f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 98cec5c8834943d2bbad6fa835282d16 Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: {"status": "invalid", "maintenance_mode": "enable"} Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:30:32.146723 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'n-d-844626-8', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'disable', Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'Enable', Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'Disable', Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance: Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'invalid' Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.147825 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.149151 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.150159 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.150159 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:30:32.150159 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:30:32.150159 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 09 14:30:32.150159 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.150159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-796add68-bdd0-4592-8f9d-f22b90cb6036 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:32.150159 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-796add68-bdd0-4592-8f9d-f22b90cb6036 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-844626-8" status: 400 len: 189 microversion: 2.1 time: 0.016925 Aug 09 14:30:32.150159 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 11/34] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 9 14:30:32 2022] PUT /compute/v2.1/os-hosts/n-d-844626-8 => generated 189 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:30:32.156780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-779fbcce-5fde-49bc-8202-588512fc82d6 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Action: 'update', calling method: .version_select at 0x7f41e413d4c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:32.159311 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:32.159311 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:32.160455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-779fbcce-5fde-49bc-8202-588512fc82d6 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '820ddadd1b88413aa189806f578ce5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '507a1fddd8f1462abcf58c1db837afe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-779fbcce-5fde-49bc-8202-588512fc82d6 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Request method failure captured: Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/os-hosts/n-d-844626-8 HTTP/1.1 Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 50 Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-BuzRC1EdXyRqRo1HLk7bIA_04tDfAlZKcKxNe0eLm6xy-2Tj-u4I6qVhKq4ojvSry7H6UsedMx7lf3Bye4ulNMwOtKbrKEyvc6LlHK6mpyesGE6U0LEznUKGVQs0gtNO-iaTPOToFVLeRp0N1pH7wXXO8VxsGONDPd1nJQUUVECU Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 507a1fddd8f1462abcf58c1db837afe0 Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:30:32.162306 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_507a1fddd8f1462abcf58c1db837afe0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/507a1fddd8f1462abcf58c1db837afe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 507a1fddd8f1462abcf58c1db837afe0 Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2081181060 Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-HostsAdminNegativeTestJSON-2081181060-project Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 820ddadd1b88413aa189806f578ce5c7 Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2081181060-project Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: {"status": "enable", "maintenance_mode": "enable"} Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 09 14:30:32.163540 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'n-d-844626-8', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:32.164369 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 09 14:30:32.165823 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.167256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-779fbcce-5fde-49bc-8202-588512fc82d6 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:32.167256 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-779fbcce-5fde-49bc-8202-588512fc82d6 tempest-HostsAdminNegativeTestJSON-2081181060 tempest-HostsAdminNegativeTestJSON-2081181060-project] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-844626-8" status: 403 len: 111 microversion: 2.1 time: 0.010936 Aug 09 14:30:32.167256 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 12/35] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 9 14:30:32 2022] PUT /compute/v2.1/os-hosts/n-d-844626-8 => generated 111 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:30:32.177827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f629b62c-021a-4751-94b3-28d6737ee8d4 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Action: 'update', calling method: .version_select at 0x7f41e413fc10>, body: {"status": null, "maintenance_mode": null} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f629b62c-021a-4751-94b3-28d6737ee8d4 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Request method failure captured: Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/os-hosts/n-d-844626-8 HTTP/1.1 Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 42 Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-Er-iGm4Hf7GQ4aJ-_RGv86h2AwjN3pZcaVvVwICXun0OhFlJ6kCwCqSPKi1xiqkn3biFIcrVDmyuEdmqixgYl5rtB7RgLjXfs5pGs0pxR5sfOja4--BlmDpiNAiki3yKNNu2nRdi1YFg29KdkhGcOvgu28eukG5uhdXHRco0mQrU Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:30:32.182741 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_838f8080c3a540268e66e8830714e64f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/838f8080c3a540268e66e8830714e64f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 98cec5c8834943d2bbad6fa835282d16 Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: {"status": null, "maintenance_mode": null} Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 09 14:30:32.184104 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'n-d-844626-8', 'body': {'status': None, 'maintenance_mode': None}} Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'disable', Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'Enable', Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'Disable', Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance: Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi None Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.184954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.187253 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.189203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:30:32.189203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:30:32.189203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 09 14:30:32.189203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.189203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f629b62c-021a-4751-94b3-28d6737ee8d4 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:32.189203 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f629b62c-021a-4751-94b3-28d6737ee8d4 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/n-d-844626-8" status: 400 len: 127 microversion: 2.1 time: 0.010449 Aug 09 14:30:32.189203 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 13/36] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 9 14:30:32 2022] PUT /compute/v2.1/os-hosts/n-d-844626-8 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:30:32.196773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9349aeb6-16a4-41ba-90f3-475c79714122 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Action: 'update', calling method: .version_select at 0x7f41e413dee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:32.200798 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.hosts [None req-9349aeb6-16a4-41ba-90f3-475c79714122 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Enabling host nonexistent_hostname. Aug 09 14:30:32.229564 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-9349aeb6-16a4-41ba-90f3-475c79714122 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9349aeb6-16a4-41ba-90f3-475c79714122 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Request method failure captured: Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 50 Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-Er-iGm4Hf7GQ4aJ-_RGv86h2AwjN3pZcaVvVwICXun0OhFlJ6kCwCqSPKi1xiqkn3biFIcrVDmyuEdmqixgYl5rtB7RgLjXfs5pGs0pxR5sfOja4--BlmDpiNAiki3yKNNu2nRdi1YFg29KdkhGcOvgu28eukG5uhdXHRco0mQrU Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:30:32.235930 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_838f8080c3a540268e66e8830714e64f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/838f8080c3a540268e66e8830714e64f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/838f8080c3a540268e66e8830714e64f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 838f8080c3a540268e66e8830714e64f Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1138675113 Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 98cec5c8834943d2bbad6fa835282d16 Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1138675113-project-admin Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: {"status": "enable", "maintenance_mode": "enable"} Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.237013 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 14:30:32.237705 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:30:32.238579 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 09 14:30:32.240680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:32.244199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9349aeb6-16a4-41ba-90f3-475c79714122 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:32.245297 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9349aeb6-16a4-41ba-90f3-475c79714122 tempest-HostsAdminNegativeTestJSON-1138675113 tempest-HostsAdminNegativeTestJSON-1138675113-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.053038 Aug 09 14:30:32.250030 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 14/37] 10.222.0.50 () {60 vars in 1211 bytes} [Tue Aug 9 14:30:32 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 09 14:30:32.811350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1708979093", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:32.881090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:30:32.896311 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bcb54981-36b1-4ad8-9e3b-6e220355a0b9 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/234519072/action" status: 200 len: 21 microversion: 2.1 time: 0.770306 Aug 09 14:30:32.902712 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 24/38] 10.222.0.50 () {60 vars in 1197 bytes} [Tue Aug 9 14:30:32 2022] POST /compute/v2.1/flavors/234519072/action => generated 21 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 14:30:32.907933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1435275c-471a-4207-9970-3fd4a757e319 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:32.929095 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1435275c-471a-4207-9970-3fd4a757e319 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/234519072" status: 202 len: 0 microversion: 2.1 time: 0.025145 Aug 09 14:30:32.929811 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 25/39] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:30:32 2022] DELETE /compute/v2.1/flavors/234519072 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:30:32.939330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9f6bec2-0851-4e42-b5ec-b229147f3ff0 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:32.964137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1,nova_api:DELETE=10 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:32.983771 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9f6bec2-0851-4e42-b5ec-b229147f3ff0 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048586 Aug 09 14:30:32.988332 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 26/40] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:30:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:33.007589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f14fc335-f2ec-4377-9fa7-a48573534ae4 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:33.008275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f14fc335-f2ec-4377-9fa7-a48573534ae4 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:33.075431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f14fc335-f2ec-4377-9fa7-a48573534ae4 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:33.086998 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f14fc335-f2ec-4377-9fa7-a48573534ae4 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1242 microversion: 2.1 time: 0.083665 Aug 09 14:30:33.088789 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 27/41] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:32 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1242 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:33.094662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36107a9c-7bf7-4661-a4a0-424e1325bfb6 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-208881375", "id": 1064188295, "os-flavor-access:is_public": "True"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:33.121004 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:33.121004 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:33.146917 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36107a9c-7bf7-4661-a4a0-424e1325bfb6 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.056486 Aug 09 14:30:33.147629 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 28/42] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:30:33 2022] POST /compute/v2.1/flavors => generated 437 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:33.163338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b07eef17-f0a6-4ad8-ad82-5d97fe4041ba tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:33.164247 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:33.164247 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:33.171655 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b07eef17-f0a6-4ad8-ad82-5d97fe4041ba tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b07eef17-f0a6-4ad8-ad82-5d97fe4041ba tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Request method failure captured: Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/flavors/1064188295/os-flavor-access HTTP/1.1 Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-E3XHdqVPbdoJE0DF1mZlSBnwnYdGBt2Z_iMm621sXvO7Xtn_v0cdLxJol49as-8cBc0jNQOqKl89Mq3jqERvZJMQoADO_T-Zs-BdOi_N56s4RX_191V8VBPOlsPDZ9-jAwbP50t1TGGtnjl92oM259XWSuTVnZ4Nd47ite1KX6sk Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: acc18ad46beb4ae5b5b933b886ca4348 Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-234420831 Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:30:33.175459 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:30:33.176900 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_acc18ad46beb4ae5b5b933b886ca4348", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/acc18ad46beb4ae5b5b933b886ca4348"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/acc18ad46beb4ae5b5b933b886ca4348"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/acc18ad46beb4ae5b5b933b886ca4348"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:33.176900 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-234420831 Aug 09 14:30:33.176900 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: acc18ad46beb4ae5b5b933b886ca4348 Aug 09 14:30:33.176900 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-234420831 Aug 09 14:30:33.176900 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin Aug 09 14:30:33.176900 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:33.176900 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:33.176900 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 8f29985332a144d7a81526e3ff27912e Aug 09 14:30:33.176900 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin Aug 09 14:30:33.176900 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:30:33.176900 n-d-844626-8 devstack@n-api.service[119406]: exception: Access list not available for public flavors. Aug 09 14:30:33.176900 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'flavor_id': '1064188295'} Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 09 14:30:33.177638 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:33.178652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b07eef17-f0a6-4ad8-ad82-5d97fe4041ba tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:33.178652 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b07eef17-f0a6-4ad8-ad82-5d97fe4041ba tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1064188295/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.017724 Aug 09 14:30:33.178652 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 29/43] 10.222.0.50 () {58 vars in 1209 bytes} [Tue Aug 9 14:30:33 2022] GET /compute/v2.1/flavors/1064188295/os-flavor-access => generated 91 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:30:33.186663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-24f2e8c5-a5d9-42c5-a352-473a839f487f tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:33.187439 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:33.187439 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:33.217109 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-24f2e8c5-a5d9-42c5-a352-473a839f487f tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1064188295" status: 202 len: 0 microversion: 2.1 time: 0.033733 Aug 09 14:30:33.217958 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 30/44] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:30:33 2022] DELETE /compute/v2.1/flavors/1064188295 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:30:33.220075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:30:33.220565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:30:33.220992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:30:33.221368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:30:33.221774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:30:33.229040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1632c720-86b1-40ba-99c2-c6234c3c664a tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:33.240798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:33.241287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:33.241720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:33.244010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:33.244512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:33.246373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:33.269339 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1632c720-86b1-40ba-99c2-c6234c3c664a tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045372 Aug 09 14:30:33.271848 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 31/45] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:30:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:33.295982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Getting quotas for project fb69ef1d43a24edcbbc99882cbf52f5b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:30:33.297901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e5e97e1f-aa50-4582-8bb4-880badf1b83a tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1379241127", "id": 1180028535, "os-flavor-access:is_public": "False"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:33.301060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Getting quotas for user 3e3b1bc0133f4e848eeccd53e141f6d2 and project fb69ef1d43a24edcbbc99882cbf52f5b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:30:33.322828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:30:33.326771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:30:33.349089 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e5e97e1f-aa50-4582-8bb4-880badf1b83a tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.060077 Aug 09 14:30:33.349818 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 32/46] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:30:33 2022] POST /compute/v2.1/flavors => generated 439 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:33.398972 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c1cecc74-4a16-4081-8082-3065005856d2 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.986316 Aug 09 14:30:33.399920 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 15/47] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:30:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:30:33.426998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8fab4151-6992-4e4c-936c-d570b9d8baac tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:33.427675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8fab4151-6992-4e4c-936c-d570b9d8baac tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:33.506679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8fab4151-6992-4e4c-936c-d570b9d8baac tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:33.544392 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8fab4151-6992-4e4c-936c-d570b9d8baac tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1220 microversion: 2.1 time: 0.132425 Aug 09 14:30:33.546318 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 16/48] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:33 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:33.637374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-890e1c29-3c52-4cc5-8427-4cd9cfa95d06 tempest-FlavorsAccessNegativeTestJSON-1157731588 tempest-FlavorsAccessNegativeTestJSON-1157731588-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a1dc2ef2cf8f42ba9f00fb4e54b6a757"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:33.640014 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:33.640014 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:33.640897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-890e1c29-3c52-4cc5-8427-4cd9cfa95d06 tempest-FlavorsAccessNegativeTestJSON-1157731588 tempest-FlavorsAccessNegativeTestJSON-1157731588-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'b68b6cfe787946188df6e0237db66eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1dc2ef2cf8f42ba9f00fb4e54b6a757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-890e1c29-3c52-4cc5-8427-4cd9cfa95d06 tempest-FlavorsAccessNegativeTestJSON-1157731588 tempest-FlavorsAccessNegativeTestJSON-1157731588-project] Request method failure captured: Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/flavors/1180028535/action HTTP/1.1 Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 67 Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-CtdrGWkBUyZ6-cHjfEjWY21E5EdWZQPTGWELAcryXcDkQQJ8UMbXW0FGUqYTLDXkNXP4RPwu_j_BEgHOuVLf9MgbTDkCJVaGofsrh1NsPnKmWbKwfzCYjPdeuXfk8koDJrDwdf-SFtqoqt7fXdCzyIRXEkbB5Z3xqCV9pa0hp7cM Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a1dc2ef2cf8f42ba9f00fb4e54b6a757 Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1157731588 Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:30:33.642764 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:30:33.644195 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a1dc2ef2cf8f42ba9f00fb4e54b6a757", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a1dc2ef2cf8f42ba9f00fb4e54b6a757"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1dc2ef2cf8f42ba9f00fb4e54b6a757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1dc2ef2cf8f42ba9f00fb4e54b6a757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:33.644195 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1157731588 Aug 09 14:30:33.644195 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a1dc2ef2cf8f42ba9f00fb4e54b6a757 Aug 09 14:30:33.644195 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1157731588 Aug 09 14:30:33.644195 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FlavorsAccessNegativeTestJSON-1157731588-project Aug 09 14:30:33.644195 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:33.644195 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:33.644195 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: b68b6cfe787946188df6e0237db66eb3 Aug 09 14:30:33.644195 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1157731588-project Aug 09 14:30:33.644195 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:30:33.644195 n-d-844626-8 devstack@n-api.service[119406]: {"addTenantAccess": {"tenant": "a1dc2ef2cf8f42ba9f00fb4e54b6a757"}} Aug 09 14:30:33.644195 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '1180028535', 'body': {'addTenantAccess': {'tenant': 'a1dc2ef2cf8f42ba9f00fb4e54b6a757'}}} Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:33.644944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 09 14:30:33.646192 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:33.647430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-890e1c29-3c52-4cc5-8427-4cd9cfa95d06 tempest-FlavorsAccessNegativeTestJSON-1157731588 tempest-FlavorsAccessNegativeTestJSON-1157731588-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:33.647430 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-890e1c29-3c52-4cc5-8427-4cd9cfa95d06 tempest-FlavorsAccessNegativeTestJSON-1157731588 tempest-FlavorsAccessNegativeTestJSON-1157731588-project] 10.222.0.50 "POST /compute/v2.1/flavors/1180028535/action" status: 403 len: 130 microversion: 2.1 time: 0.285482 Aug 09 14:30:33.647430 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 33/49] 10.222.0.50 () {60 vars in 1200 bytes} [Tue Aug 9 14:30:33 2022] POST /compute/v2.1/flavors/1180028535/action => generated 130 bytes in 287 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:30:33.657054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af85cd40-25fa-4d29-a2ae-f6de50f06af1 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:33.657830 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:33.657830 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:33.778308 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af85cd40-25fa-4d29-a2ae-f6de50f06af1 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1180028535" status: 202 len: 0 microversion: 2.1 time: 0.125145 Aug 09 14:30:33.778932 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 17/50] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:30:33 2022] DELETE /compute/v2.1/flavors/1180028535 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:30:33.787906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0647ebbe-f1dc-4554-ba2f-60409f0a8b5c tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:33.822865 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0647ebbe-f1dc-4554-ba2f-60409f0a8b5c tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039661 Aug 09 14:30:33.824153 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 34/51] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:30:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:33.842297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75d48850-6819-4472-b487-d843b217e54b tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1995145539", "id": 1123155079, "os-flavor-access:is_public": "False"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:33.845322 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:33.845322 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:33.873960 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75d48850-6819-4472-b487-d843b217e54b tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.035634 Aug 09 14:30:33.874463 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 18/52] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:30:33 2022] POST /compute/v2.1/flavors => generated 439 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:33.886424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cc46598a-1ae6-49c0-96ef-4eac28e24999 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "a1dc2ef2cf8f42ba9f00fb4e54b6a757"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:34.170165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-80b9e93e-ba76-464f-812f-ba48030db65e tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Calling method '.version_select at 0x7f41e411a430>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:34.171246 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:34.171246 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:34.173192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80b9e93e-ba76-464f-812f-ba48030db65e tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.173823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80b9e93e-ba76-464f-812f-ba48030db65e tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.174418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80b9e93e-ba76-464f-812f-ba48030db65e tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:34.205347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80b9e93e-ba76-464f-812f-ba48030db65e tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.206572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80b9e93e-ba76-464f-812f-ba48030db65e tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.207411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80b9e93e-ba76-464f-812f-ba48030db65e tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:34.264370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80b9e93e-ba76-464f-812f-ba48030db65e tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.266328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80b9e93e-ba76-464f-812f-ba48030db65e tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.267839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80b9e93e-ba76-464f-812f-ba48030db65e tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:34.287136 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-80b9e93e-ba76-464f-812f-ba48030db65e tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.364781 Aug 09 14:30:34.287998 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 19/53] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:30:33 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:34.296279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d35d1189-3670-40c2-95c7-6f7727905ae1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:34.301926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d35d1189-3670-40c2-95c7-6f7727905ae1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:34.320183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d35d1189-3670-40c2-95c7-6f7727905ae1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.321901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d35d1189-3670-40c2-95c7-6f7727905ae1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.322951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d35d1189-3670-40c2-95c7-6f7727905ae1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:34.325199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d35d1189-3670-40c2-95c7-6f7727905ae1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.327430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d35d1189-3670-40c2-95c7-6f7727905ae1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.328418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d35d1189-3670-40c2-95c7-6f7727905ae1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:34.331396 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cc46598a-1ae6-49c0-96ef-4eac28e24999 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1123155079/action" status: 200 len: 97 microversion: 2.1 time: 0.448950 Aug 09 14:30:34.333941 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 35/54] 10.222.0.50 () {60 vars in 1200 bytes} [Tue Aug 9 14:30:33 2022] POST /compute/v2.1/flavors/1123155079/action => generated 97 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:30:34.345190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9c8817f-ac9c-486c-89b6-50e6b3b66b71 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Calling method '.version_select at 0x7f41e41c9700>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:34.347470 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:34.347470 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:34.348683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9c8817f-ac9c-486c-89b6-50e6b3b66b71 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.350651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9c8817f-ac9c-486c-89b6-50e6b3b66b71 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.352404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9c8817f-ac9c-486c-89b6-50e6b3b66b71 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:34.420149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9c8817f-ac9c-486c-89b6-50e6b3b66b71 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.421181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9c8817f-ac9c-486c-89b6-50e6b3b66b71 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.422251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9c8817f-ac9c-486c-89b6-50e6b3b66b71 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:34.437876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9c8817f-ac9c-486c-89b6-50e6b3b66b71 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.439390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9c8817f-ac9c-486c-89b6-50e6b3b66b71 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.439979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9c8817f-ac9c-486c-89b6-50e6b3b66b71 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:34.450208 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c9c8817f-ac9c-486c-89b6-50e6b3b66b71 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.114368 Aug 09 14:30:34.451568 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 36/55] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 9 14:30:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:34.474520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3769283-22d0-458b-8e00-c09a1c546fed tempest-FlavorsAccessNegativeTestJSON-1157731588 tempest-FlavorsAccessNegativeTestJSON-1157731588-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a1dc2ef2cf8f42ba9f00fb4e54b6a757"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:34.486569 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:34.486569 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:34.489168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b3769283-22d0-458b-8e00-c09a1c546fed tempest-FlavorsAccessNegativeTestJSON-1157731588 tempest-FlavorsAccessNegativeTestJSON-1157731588-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'b68b6cfe787946188df6e0237db66eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1dc2ef2cf8f42ba9f00fb4e54b6a757', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3769283-22d0-458b-8e00-c09a1c546fed tempest-FlavorsAccessNegativeTestJSON-1157731588 tempest-FlavorsAccessNegativeTestJSON-1157731588-project] Request method failure captured: Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/flavors/1123155079/action HTTP/1.1 Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 70 Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-CtdrGWkBUyZ6-cHjfEjWY21E5EdWZQPTGWELAcryXcDkQQJ8UMbXW0FGUqYTLDXkNXP4RPwu_j_BEgHOuVLf9MgbTDkCJVaGofsrh1NsPnKmWbKwfzCYjPdeuXfk8koDJrDwdf-SFtqoqt7fXdCzyIRXEkbB5Z3xqCV9pa0hp7cM Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a1dc2ef2cf8f42ba9f00fb4e54b6a757 Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1157731588 Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:30:34.491209 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:30:34.492523 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a1dc2ef2cf8f42ba9f00fb4e54b6a757", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a1dc2ef2cf8f42ba9f00fb4e54b6a757"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1dc2ef2cf8f42ba9f00fb4e54b6a757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1dc2ef2cf8f42ba9f00fb4e54b6a757"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:34.492523 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1157731588 Aug 09 14:30:34.492523 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a1dc2ef2cf8f42ba9f00fb4e54b6a757 Aug 09 14:30:34.492523 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1157731588 Aug 09 14:30:34.492523 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FlavorsAccessNegativeTestJSON-1157731588-project Aug 09 14:30:34.492523 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:34.492523 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:34.492523 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: b68b6cfe787946188df6e0237db66eb3 Aug 09 14:30:34.492523 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1157731588-project Aug 09 14:30:34.492523 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:30:34.492523 n-d-844626-8 devstack@n-api.service[119406]: {"removeTenantAccess": {"tenant": "a1dc2ef2cf8f42ba9f00fb4e54b6a757"}} Aug 09 14:30:34.492523 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '1123155079', 'body': {'removeTenantAccess': {'tenant': 'a1dc2ef2cf8f42ba9f00fb4e54b6a757'}}} Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can( Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:34.493286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 09 14:30:34.494360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:34.499379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3769283-22d0-458b-8e00-c09a1c546fed tempest-FlavorsAccessNegativeTestJSON-1157731588 tempest-FlavorsAccessNegativeTestJSON-1157731588-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:34.500576 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3769283-22d0-458b-8e00-c09a1c546fed tempest-FlavorsAccessNegativeTestJSON-1157731588 tempest-FlavorsAccessNegativeTestJSON-1157731588-project] 10.222.0.50 "POST /compute/v2.1/flavors/1123155079/action" status: 403 len: 133 microversion: 2.1 time: 0.047778 Aug 09 14:30:34.501587 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 37/56] 10.222.0.50 () {60 vars in 1200 bytes} [Tue Aug 9 14:30:34 2022] POST /compute/v2.1/flavors/1123155079/action => generated 133 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:30:34.520969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7fef29aa-42fa-4b43-a98b-649fec18111c tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Calling method '.version_select at 0x7f41e41c9310>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:34.523053 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:34.523053 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:34.524525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fef29aa-42fa-4b43-a98b-649fec18111c tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.525360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fef29aa-42fa-4b43-a98b-649fec18111c tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.526109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fef29aa-42fa-4b43-a98b-649fec18111c tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:34.544194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fef29aa-42fa-4b43-a98b-649fec18111c tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.544847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fef29aa-42fa-4b43-a98b-649fec18111c tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.545279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fef29aa-42fa-4b43-a98b-649fec18111c tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:34.562806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fef29aa-42fa-4b43-a98b-649fec18111c tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.563430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fef29aa-42fa-4b43-a98b-649fec18111c tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.563971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fef29aa-42fa-4b43-a98b-649fec18111c tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:34.576067 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7fef29aa-42fa-4b43-a98b-649fec18111c tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.073268 Aug 09 14:30:34.579131 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 38/57] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:30:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:34.584612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ea734bf7-c40c-46e6-91d3-377cfcea646e tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "a1dc2ef2cf8f42ba9f00fb4e54b6a757"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:34.591418 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:34.591418 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:34.895405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d35d1189-3670-40c2-95c7-6f7727905ae1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:34.919230 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d35d1189-3670-40c2-95c7-6f7727905ae1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1296 microversion: 2.1 time: 0.629680 Aug 09 14:30:34.940501 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 20/58] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:34 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1296 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:34.950722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4c153882-95ce-493a-9d1d-a21bed509698 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:34.955210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4c153882-95ce-493a-9d1d-a21bed509698 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:34.973971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c153882-95ce-493a-9d1d-a21bed509698 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.974475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c153882-95ce-493a-9d1d-a21bed509698 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.975330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c153882-95ce-493a-9d1d-a21bed509698 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:34.976218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c153882-95ce-493a-9d1d-a21bed509698 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:34.977808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c153882-95ce-493a-9d1d-a21bed509698 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:34.979260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c153882-95ce-493a-9d1d-a21bed509698 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.143223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4c153882-95ce-493a-9d1d-a21bed509698 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:35.153843 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4c153882-95ce-493a-9d1d-a21bed509698 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1216 microversion: 2.1 time: 0.211552 Aug 09 14:30:35.155525 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 21/59] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:34 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1216 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:35.166876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-04f33d5c-0f60-4adc-9dae-4ca5270dd269 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Calling method '.version_select at 0x7f41def40dc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:35.167785 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:35.167785 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:35.171063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04f33d5c-0f60-4adc-9dae-4ca5270dd269 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.172914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04f33d5c-0f60-4adc-9dae-4ca5270dd269 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.186953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04f33d5c-0f60-4adc-9dae-4ca5270dd269 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.242200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04f33d5c-0f60-4adc-9dae-4ca5270dd269 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.244567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04f33d5c-0f60-4adc-9dae-4ca5270dd269 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.245686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04f33d5c-0f60-4adc-9dae-4ca5270dd269 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.256728 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-04f33d5c-0f60-4adc-9dae-4ca5270dd269 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.100138 Aug 09 14:30:35.258491 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 22/60] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:30:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:35.275994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bea0e830-4129-4871-bb07-bc496d4bafba tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Calling method '.version_select at 0x7f41def40e50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:35.277328 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:35.277328 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:35.278384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bea0e830-4129-4871-bb07-bc496d4bafba tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.278875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bea0e830-4129-4871-bb07-bc496d4bafba tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.279827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bea0e830-4129-4871-bb07-bc496d4bafba tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.303385 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bea0e830-4129-4871-bb07-bc496d4bafba tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.031119 Aug 09 14:30:35.309266 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 23/61] 10.222.0.50 () {58 vars in 1179 bytes} [Tue Aug 9 14:30:35 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:35.321126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4196c60f-d40f-4986-abaf-151f0a806b10 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Calling method '.version_select at 0x7f41def40ca0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:35.322076 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:35.322076 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:35.324259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4196c60f-d40f-4986-abaf-151f0a806b10 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.328071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4196c60f-d40f-4986-abaf-151f0a806b10 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.328631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4196c60f-d40f-4986-abaf-151f0a806b10 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.357065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4196c60f-d40f-4986-abaf-151f0a806b10 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.358800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4196c60f-d40f-4986-abaf-151f0a806b10 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.362054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4196c60f-d40f-4986-abaf-151f0a806b10 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.395984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4196c60f-d40f-4986-abaf-151f0a806b10 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.396471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4196c60f-d40f-4986-abaf-151f0a806b10 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.396914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4196c60f-d40f-4986-abaf-151f0a806b10 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.401577 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ea734bf7-c40c-46e6-91d3-377cfcea646e tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1123155079/action" status: 200 len: 21 microversion: 2.1 time: 0.821467 Aug 09 14:30:35.403646 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 39/62] 10.222.0.50 () {60 vars in 1200 bytes} [Tue Aug 9 14:30:34 2022] POST /compute/v2.1/flavors/1123155079/action => generated 21 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:30:35.407495 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4196c60f-d40f-4986-abaf-151f0a806b10 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.093060 Aug 09 14:30:35.413304 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 24/63] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:30:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:35.418197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8828338-e9c3-421c-a063-63cd19479195 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Calling method '.version_select at 0x7f41def62940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:35.418992 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:35.418992 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:35.424856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42058804-51f8-4fec-b1d3-3b6ed1335286 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:35.426894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8828338-e9c3-421c-a063-63cd19479195 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.427837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8828338-e9c3-421c-a063-63cd19479195 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.428402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8828338-e9c3-421c-a063-63cd19479195 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.429586 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:35.429586 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:35.465572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8828338-e9c3-421c-a063-63cd19479195 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.466499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8828338-e9c3-421c-a063-63cd19479195 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.467864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8828338-e9c3-421c-a063-63cd19479195 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.491902 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8828338-e9c3-421c-a063-63cd19479195 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.077111 Aug 09 14:30:35.494893 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 25/64] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:30:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:30:35.498616 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42058804-51f8-4fec-b1d3-3b6ed1335286 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1123155079" status: 202 len: 0 microversion: 2.1 time: 0.082191 Aug 09 14:30:35.499301 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 40/65] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:30:35 2022] DELETE /compute/v2.1/flavors/1123155079 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:30:35.508134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec975593-cc9e-47ec-8757-f357dcfaec36 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Calling method '.version_select at 0x7f41e41ab790>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:35.508681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d80d7bcc-7183-48ca-b12e-653758bcc26e tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:35.508936 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:35.508936 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:35.511523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec975593-cc9e-47ec-8757-f357dcfaec36 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.512528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec975593-cc9e-47ec-8757-f357dcfaec36 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.512972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec975593-cc9e-47ec-8757-f357dcfaec36 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.540438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec975593-cc9e-47ec-8757-f357dcfaec36 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.540953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec975593-cc9e-47ec-8757-f357dcfaec36 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.541399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec975593-cc9e-47ec-8757-f357dcfaec36 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.551928 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d80d7bcc-7183-48ca-b12e-653758bcc26e tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047020 Aug 09 14:30:35.569582 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 26/66] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:30:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:35.570150 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec975593-cc9e-47ec-8757-f357dcfaec36 tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.051480 Aug 09 14:30:35.570150 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 41/67] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:30:35 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:35.583850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dbe51add-539b-4d23-a012-554a52e987aa tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Calling method '.version_select at 0x7f41def40ee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:35.584589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-956b073e-54e1-4c48-ae4c-4b054377f1ec tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-210285217", "id": 1237811024, "os-flavor-access:is_public": "False"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:35.585755 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:35.585755 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:35.589946 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:35.589946 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:35.590716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbe51add-539b-4d23-a012-554a52e987aa tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.591455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbe51add-539b-4d23-a012-554a52e987aa tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.591961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbe51add-539b-4d23-a012-554a52e987aa tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.608245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:35.619387 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-956b073e-54e1-4c48-ae4c-4b054377f1ec tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.042270 Aug 09 14:30:35.621682 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 42/68] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:30:35 2022] POST /compute/v2.1/flavors => generated 438 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:35.623778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbe51add-539b-4d23-a012-554a52e987aa tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.624597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbe51add-539b-4d23-a012-554a52e987aa tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.625273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbe51add-539b-4d23-a012-554a52e987aa tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.633434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a79bc8f0-d8ab-41ac-9747-6ae6afeaeb11 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "67c52b5b94054f98b10d718311fcb738"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:35.639198 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:35.639198 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:35.645087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbe51add-539b-4d23-a012-554a52e987aa tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.646874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbe51add-539b-4d23-a012-554a52e987aa tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.647613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbe51add-539b-4d23-a012-554a52e987aa tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.654685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbe51add-539b-4d23-a012-554a52e987aa tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:30:35.655427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbe51add-539b-4d23-a012-554a52e987aa tempest-HypervisorAdminTestJSON-151416351 tempest-HypervisorAdminTestJSON-151416351-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:30:35.656746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a171d2-7d8e-4eb0-ad4f-f2abdcc1c33e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.657404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a171d2-7d8e-4eb0-ad4f-f2abdcc1c33e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.658025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a171d2-7d8e-4eb0-ad4f-f2abdcc1c33e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.658962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a171d2-7d8e-4eb0-ad4f-f2abdcc1c33e None None] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.659644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a171d2-7d8e-4eb0-ad4f-f2abdcc1c33e None None] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.660288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a171d2-7d8e-4eb0-ad4f-f2abdcc1c33e None None] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.672014 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.compute.rpcapi [None req-50a171d2-7d8e-4eb0-ad4f-f2abdcc1c33e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 14:30:35.673587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a171d2-7d8e-4eb0-ad4f-f2abdcc1c33e None None] Releasing lock "compute-rpcapi-router" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:30:35.734540 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50a171d2-7d8e-4eb0-ad4f-f2abdcc1c33e None None] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.164413 Aug 09 14:30:35.738177 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 27/69] 10.222.0.50 () {58 vars in 1173 bytes} [Tue Aug 9 14:30:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:35.942276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1e269fef-b273-431c-b1a5-edfeabf2e6a7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:35.943166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1e269fef-b273-431c-b1a5-edfeabf2e6a7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:35.951132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e269fef-b273-431c-b1a5-edfeabf2e6a7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.951755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e269fef-b273-431c-b1a5-edfeabf2e6a7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.952293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e269fef-b273-431c-b1a5-edfeabf2e6a7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:35.953896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e269fef-b273-431c-b1a5-edfeabf2e6a7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:35.954300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e269fef-b273-431c-b1a5-edfeabf2e6a7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:35.955014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e269fef-b273-431c-b1a5-edfeabf2e6a7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:36.143693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e269fef-b273-431c-b1a5-edfeabf2e6a7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:36.155640 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1e269fef-b273-431c-b1a5-edfeabf2e6a7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1296 microversion: 2.1 time: 0.217661 Aug 09 14:30:36.158941 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 28/70] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:35 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1296 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:30:36.177072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-720d6a14-c11a-4748-b131-2a5860d2af85 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:36.177841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-720d6a14-c11a-4748-b131-2a5860d2af85 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:36.189935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720d6a14-c11a-4748-b131-2a5860d2af85 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:36.190421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720d6a14-c11a-4748-b131-2a5860d2af85 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:36.190852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720d6a14-c11a-4748-b131-2a5860d2af85 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:36.191589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720d6a14-c11a-4748-b131-2a5860d2af85 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:36.192034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720d6a14-c11a-4748-b131-2a5860d2af85 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:36.192452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720d6a14-c11a-4748-b131-2a5860d2af85 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:36.374776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-720d6a14-c11a-4748-b131-2a5860d2af85 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:36.388735 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-720d6a14-c11a-4748-b131-2a5860d2af85 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1278 microversion: 2.1 time: 0.216023 Aug 09 14:30:36.389823 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 29/71] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:36 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1278 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:36.979346 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-a79bc8f0-d8ab-41ac-9747-6ae6afeaeb11 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] HTTP exception thrown: Flavor access not found for 21 / 67c52b5b94054f98b10d718311fcb738 combination. Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a79bc8f0-d8ab-41ac-9747-6ae6afeaeb11 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Request method failure captured: Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/flavors/1237811024/action HTTP/1.1 Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 70 Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-E3XHdqVPbdoJE0DF1mZlSBnwnYdGBt2Z_iMm621sXvO7Xtn_v0cdLxJol49as-8cBc0jNQOqKl89Mq3jqERvZJMQoADO_T-Zs-BdOi_N56s4RX_191V8VBPOlsPDZ9-jAwbP50t1TGGtnjl92oM259XWSuTVnZ4Nd47ite1KX6sk Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: acc18ad46beb4ae5b5b933b886ca4348 Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-234420831 Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:30:36.981438 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:30:36.982610 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_acc18ad46beb4ae5b5b933b886ca4348", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/acc18ad46beb4ae5b5b933b886ca4348"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/acc18ad46beb4ae5b5b933b886ca4348"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/acc18ad46beb4ae5b5b933b886ca4348"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:36.982610 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-234420831 Aug 09 14:30:36.982610 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: acc18ad46beb4ae5b5b933b886ca4348 Aug 09 14:30:36.982610 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-234420831 Aug 09 14:30:36.982610 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin Aug 09 14:30:36.982610 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:36.982610 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:36.982610 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 8f29985332a144d7a81526e3ff27912e Aug 09 14:30:36.982610 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin Aug 09 14:30:36.982610 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:30:36.982610 n-d-844626-8 devstack@n-api.service[119406]: {"removeTenantAccess": {"tenant": "67c52b5b94054f98b10d718311fcb738"}} Aug 09 14:30:36.982610 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: exception: Flavor access not found for 21 / 67c52b5b94054f98b10d718311fcb738 combination. Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '1237811024', 'body': {'removeTenantAccess': {'tenant': '67c52b5b94054f98b10d718311fcb738'}}} Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 09 14:30:36.983257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / 67c52b5b94054f98b10d718311fcb738 combination. Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / 67c52b5b94054f98b10d718311fcb738 combination. Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:36.984255 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:36.985361 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:36.985361 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:36.985361 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:30:36.985361 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:30:36.985361 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / 67c52b5b94054f98b10d718311fcb738 combination. Aug 09 14:30:36.985361 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:36.985361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a79bc8f0-d8ab-41ac-9747-6ae6afeaeb11 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Returning 404 to user: Flavor access not found for 21 / 67c52b5b94054f98b10d718311fcb738 combination. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:36.985361 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a79bc8f0-d8ab-41ac-9747-6ae6afeaeb11 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1237811024/action" status: 404 len: 124 microversion: 2.1 time: 1.353730 Aug 09 14:30:36.991921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af557abb-d80e-48a3-a9b0-3084f77e43d9 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:36.992851 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:36.992851 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:36.997349 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 43/72] 10.222.0.50 () {60 vars in 1200 bytes} [Tue Aug 9 14:30:35 2022] POST /compute/v2.1/flavors/1237811024/action => generated 124 bytes in 1368 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:30:37.026960 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af557abb-d80e-48a3-a9b0-3084f77e43d9 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1237811024" status: 202 len: 0 microversion: 2.1 time: 0.038857 Aug 09 14:30:37.027588 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 30/73] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:30:36 2022] DELETE /compute/v2.1/flavors/1237811024 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 14:30:37.041528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eea5ec72-1602-4af0-bcf3-63ac9b5b6009 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:37.112588 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eea5ec72-1602-4af0-bcf3-63ac9b5b6009 tempest-FlavorsAccessNegativeTestJSON-234420831 tempest-FlavorsAccessNegativeTestJSON-234420831-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068773 Aug 09 14:30:37.114616 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 44/74] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:30:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:37.185504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79f2bb12-d62b-451a-a6e1-10d7e31e6a42 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:37.185504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79f2bb12-d62b-451a-a6e1-10d7e31e6a42 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:37.202867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79f2bb12-d62b-451a-a6e1-10d7e31e6a42 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:37.203318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79f2bb12-d62b-451a-a6e1-10d7e31e6a42 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:37.203753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79f2bb12-d62b-451a-a6e1-10d7e31e6a42 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:37.204463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79f2bb12-d62b-451a-a6e1-10d7e31e6a42 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:37.204914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79f2bb12-d62b-451a-a6e1-10d7e31e6a42 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:37.205347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79f2bb12-d62b-451a-a6e1-10d7e31e6a42 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:37.415665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb08c393-2474-4541-ab42-7b2b554618b3 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:37.416581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bb08c393-2474-4541-ab42-7b2b554618b3 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:37.438452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb08c393-2474-4541-ab42-7b2b554618b3 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:37.449983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb08c393-2474-4541-ab42-7b2b554618b3 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:37.452075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb08c393-2474-4541-ab42-7b2b554618b3 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:37.457877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb08c393-2474-4541-ab42-7b2b554618b3 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:37.463585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb08c393-2474-4541-ab42-7b2b554618b3 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:37.464071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb08c393-2474-4541-ab42-7b2b554618b3 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:37.515120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-79f2bb12-d62b-451a-a6e1-10d7e31e6a42 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:37.529138 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79f2bb12-d62b-451a-a6e1-10d7e31e6a42 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.352966 Aug 09 14:30:37.530812 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 31/75] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:37 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:37.877148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bb08c393-2474-4541-ab42-7b2b554618b3 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:37.905983 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb08c393-2474-4541-ab42-7b2b554618b3 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1278 microversion: 2.1 time: 0.495774 Aug 09 14:30:37.922651 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 45/76] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:37 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1278 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:38.557592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-128b4453-f2e5-4c0e-a7de-ce5079c0381c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:38.558900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-128b4453-f2e5-4c0e-a7de-ce5079c0381c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:38.577982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-128b4453-f2e5-4c0e-a7de-ce5079c0381c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:38.578959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-128b4453-f2e5-4c0e-a7de-ce5079c0381c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:38.580509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-128b4453-f2e5-4c0e-a7de-ce5079c0381c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:38.581394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-128b4453-f2e5-4c0e-a7de-ce5079c0381c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:38.581986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-128b4453-f2e5-4c0e-a7de-ce5079c0381c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:38.582626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-128b4453-f2e5-4c0e-a7de-ce5079c0381c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:38.930446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8dada1bc-4b73-45c3-b8c4-21e7ee241d87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:38.932025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8dada1bc-4b73-45c3-b8c4-21e7ee241d87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:38.951108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dada1bc-4b73-45c3-b8c4-21e7ee241d87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:38.951877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dada1bc-4b73-45c3-b8c4-21e7ee241d87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:38.952464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dada1bc-4b73-45c3-b8c4-21e7ee241d87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:38.955285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dada1bc-4b73-45c3-b8c4-21e7ee241d87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:38.957915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dada1bc-4b73-45c3-b8c4-21e7ee241d87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:38.958629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dada1bc-4b73-45c3-b8c4-21e7ee241d87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:40.101589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-128b4453-f2e5-4c0e-a7de-ce5079c0381c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:40.124356 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-128b4453-f2e5-4c0e-a7de-ce5079c0381c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 1.575571 Aug 09 14:30:40.127955 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 32/77] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:38 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:40.506056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8dada1bc-4b73-45c3-b8c4-21e7ee241d87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:40.529249 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8dada1bc-4b73-45c3-b8c4-21e7ee241d87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 1.595491 Aug 09 14:30:40.530968 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 46/78] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:38 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:30:41.156185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cd0c18b8-117d-40ed-a4b4-a4ce3db61c87 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:41.158303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cd0c18b8-117d-40ed-a4b4-a4ce3db61c87 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:41.185124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd0c18b8-117d-40ed-a4b4-a4ce3db61c87 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:41.186136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd0c18b8-117d-40ed-a4b4-a4ce3db61c87 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:41.186722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd0c18b8-117d-40ed-a4b4-a4ce3db61c87 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:41.189096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd0c18b8-117d-40ed-a4b4-a4ce3db61c87 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:41.192343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd0c18b8-117d-40ed-a4b4-a4ce3db61c87 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:41.192986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd0c18b8-117d-40ed-a4b4-a4ce3db61c87 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:41.884319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cd0c18b8-117d-40ed-a4b4-a4ce3db61c87 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:41.911828 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cd0c18b8-117d-40ed-a4b4-a4ce3db61c87 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.764160 Aug 09 14:30:41.913242 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 33/79] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:41 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:41.923772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2562de22-2978-4a67-a50a-38094ddbc56d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:41.930780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2562de22-2978-4a67-a50a-38094ddbc56d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:41.941223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d7e46f4f-6112-4f8f-9457-773a75881d48 req-9aa76644-d756-43fc-91e3-e728833143fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f8ce37a-525d-4ad6-b09a-505ed3e418ce", "tag": "db7c3e7e-c5dc-4613-bc9f-4fb4332d9cbb"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:41.961313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2562de22-2978-4a67-a50a-38094ddbc56d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:41.964772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2562de22-2978-4a67-a50a-38094ddbc56d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:41.966410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2562de22-2978-4a67-a50a-38094ddbc56d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:41.971346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2562de22-2978-4a67-a50a-38094ddbc56d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:41.973934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2562de22-2978-4a67-a50a-38094ddbc56d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:41.975505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2562de22-2978-4a67-a50a-38094ddbc56d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:41.988350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d7e46f4f-6112-4f8f-9457-773a75881d48 req-9aa76644-d756-43fc-91e3-e728833143fb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:41.989413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d7e46f4f-6112-4f8f-9457-773a75881d48 req-9aa76644-d756-43fc-91e3-e728833143fb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:41.990062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d7e46f4f-6112-4f8f-9457-773a75881d48 req-9aa76644-d756-43fc-91e3-e728833143fb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:42.083348 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d7e46f4f-6112-4f8f-9457-773a75881d48 req-9aa76644-d756-43fc-91e3-e728833143fb service nova] Creating event network-changed:db7c3e7e-c5dc-4613-bc9f-4fb4332d9cbb for instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce on n-h1-844626-8 Aug 09 14:30:42.089585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d7e46f4f-6112-4f8f-9457-773a75881d48 req-9aa76644-d756-43fc-91e3-e728833143fb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:30:42.090265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d7e46f4f-6112-4f8f-9457-773a75881d48 req-9aa76644-d756-43fc-91e3-e728833143fb service nova] Acquired lock "compute-rpcapi-router" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:30:42.091709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30cc8fd5-e51f-4fed-8d3f-82b000c22e36 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:42.097804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30cc8fd5-e51f-4fed-8d3f-82b000c22e36 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:42.098584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30cc8fd5-e51f-4fed-8d3f-82b000c22e36 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:42.101011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30cc8fd5-e51f-4fed-8d3f-82b000c22e36 None None] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:42.101767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30cc8fd5-e51f-4fed-8d3f-82b000c22e36 None None] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:42.102658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30cc8fd5-e51f-4fed-8d3f-82b000c22e36 None None] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:42.152486 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.compute.rpcapi [None req-30cc8fd5-e51f-4fed-8d3f-82b000c22e36 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 14:30:42.154023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30cc8fd5-e51f-4fed-8d3f-82b000c22e36 None None] Releasing lock "compute-rpcapi-router" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:30:42.215881 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-30cc8fd5-e51f-4fed-8d3f-82b000c22e36 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.002947 Aug 09 14:30:42.216689 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 47/80] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:42.915268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2562de22-2978-4a67-a50a-38094ddbc56d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:42.929168 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2562de22-2978-4a67-a50a-38094ddbc56d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 1.010208 Aug 09 14:30:42.929858 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 34/81] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:41 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:42.959521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23bed8b0-6686-45f7-9609-eb77b4a6d0b9 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:42.963127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-23bed8b0-6686-45f7-9609-eb77b4a6d0b9 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:43.000052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23bed8b0-6686-45f7-9609-eb77b4a6d0b9 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:43.003420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23bed8b0-6686-45f7-9609-eb77b4a6d0b9 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:43.004117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23bed8b0-6686-45f7-9609-eb77b4a6d0b9 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:43.009264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23bed8b0-6686-45f7-9609-eb77b4a6d0b9 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:43.010385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23bed8b0-6686-45f7-9609-eb77b4a6d0b9 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:43.012683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23bed8b0-6686-45f7-9609-eb77b4a6d0b9 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:43.081840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:43.543926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=14 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:43.632304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07aab5b4-2079-4453-b1ba-1b82564ddad1 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1074421182", "ram": 512, "vcpus": 1, "disk": 10, "id": 193583441, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:43.642226 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:43.642226 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:43.720200 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07aab5b4-2079-4453-b1ba-1b82564ddad1 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 1.498175 Aug 09 14:30:43.729648 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 48/82] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:30:42 2022] POST /compute/v2.1/flavors => generated 413 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:43.807450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-23bed8b0-6686-45f7-9609-eb77b4a6d0b9 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:43.821226 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23bed8b0-6686-45f7-9609-eb77b4a6d0b9 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.875439 Aug 09 14:30:43.827322 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 35/83] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:42 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:44.537606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-50ddb1b6-d23f-43a5-bbfe-a33227994d4d req-b438e5f6-e20c-4b02-8ad3-342663ddb3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af232722-6385-4af0-b196-3f72b6bbc5f7", "tag": "e142dbbe-2cf4-4d97-b019-f6e13971b3f8"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:44.587809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-50ddb1b6-d23f-43a5-bbfe-a33227994d4d req-b438e5f6-e20c-4b02-8ad3-342663ddb3c9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:44.589158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-50ddb1b6-d23f-43a5-bbfe-a33227994d4d req-b438e5f6-e20c-4b02-8ad3-342663ddb3c9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:44.596665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-50ddb1b6-d23f-43a5-bbfe-a33227994d4d req-b438e5f6-e20c-4b02-8ad3-342663ddb3c9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:44.660832 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-50ddb1b6-d23f-43a5-bbfe-a33227994d4d req-b438e5f6-e20c-4b02-8ad3-342663ddb3c9 service nova] Creating event network-changed:e142dbbe-2cf4-4d97-b019-f6e13971b3f8 for instance af232722-6385-4af0-b196-3f72b6bbc5f7 on n-h2-844626-8 Aug 09 14:30:44.672103 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-50ddb1b6-d23f-43a5-bbfe-a33227994d4d req-b438e5f6-e20c-4b02-8ad3-342663ddb3c9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.940917 Aug 09 14:30:44.674109 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 49/84] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:44.707412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a99b6af7-c702-4c39-99eb-c5fb3df5af87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:44.708689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a99b6af7-c702-4c39-99eb-c5fb3df5af87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:44.721738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a99b6af7-c702-4c39-99eb-c5fb3df5af87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:44.722923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a99b6af7-c702-4c39-99eb-c5fb3df5af87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:44.723731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a99b6af7-c702-4c39-99eb-c5fb3df5af87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:44.726633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a99b6af7-c702-4c39-99eb-c5fb3df5af87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:44.727649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a99b6af7-c702-4c39-99eb-c5fb3df5af87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:44.728648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a99b6af7-c702-4c39-99eb-c5fb3df5af87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:44.981513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f372d948-935f-42ba-af36-3c5969172b4d tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:45.063231 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-f372d948-935f-42ba-af36-3c5969172b4d tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] HTTP exception thrown: Flavor 193583441 has no extra specs with key hw:cpu_thread_policy. Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f372d948-935f-42ba-af36-3c5969172b4d tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Request method failure captured: Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/flavors/193583441/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-OSyXIOwFKaBV_PXglC9R2nHf3O-IMDEa7Dh5MzBg1XsITmVDuMeBOh2YppxEFAsNqIkPLWxwUhYeDndReoGc9T1TDVVZPLqaxt-PM7XBlxBv5jfsDETk1YLS5AHZFiQyTwVDNCCZ_Ygo8hMJMNh_6alJIDdITDWjQVFAwTTfOT1Y Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: a3e0eb09083f403e822d179538c6d261 Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:30:45.083871 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:30:45.085411 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a3e0eb09083f403e822d179538c6d261", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a3e0eb09083f403e822d179538c6d261"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3e0eb09083f403e822d179538c6d261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3e0eb09083f403e822d179538c6d261"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:45.085411 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 Aug 09 14:30:45.085411 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: a3e0eb09083f403e822d179538c6d261 Aug 09 14:30:45.085411 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 Aug 09 14:30:45.085411 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project Aug 09 14:30:45.085411 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:45.085411 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:45.085411 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: afcba602889a4cc4ae100a802af83535 Aug 09 14:30:45.085411 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project Aug 09 14:30:45.085411 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:30:45.085411 n-d-844626-8 devstack@n-api.service[119407]: exception: Flavor 193583441 has no extra specs with key hw:cpu_thread_policy. Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'flavor_id': '193583441', 'id': 'hw:cpu_thread_policy'} Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 193583441 has no extra specs with key hw:cpu_thread_policy. Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:45.086207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.087682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.087682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.087682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.087682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:30:45.087682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:30:45.087682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 193583441 has no extra specs with key hw:cpu_thread_policy. Aug 09 14:30:45.087682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.095029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f372d948-935f-42ba-af36-3c5969172b4d tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Returning 404 to user: Flavor 193583441 has no extra specs with key hw:cpu_thread_policy. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:45.098299 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f372d948-935f-42ba-af36-3c5969172b4d tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] 10.222.0.50 "GET /compute/v2.1/flavors/193583441/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 1.268438 Aug 09 14:30:45.100188 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 36/85] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:30:43 2022] GET /compute/v2.1/flavors/193583441/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 1272 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:30:45.116555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-24ade0ca-0429-48dc-81ad-424cb2a37937 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:45.117788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-24ade0ca-0429-48dc-81ad-424cb2a37937 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:45.149353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24ade0ca-0429-48dc-81ad-424cb2a37937 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:45.151790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24ade0ca-0429-48dc-81ad-424cb2a37937 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:45.155411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24ade0ca-0429-48dc-81ad-424cb2a37937 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:45.157327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24ade0ca-0429-48dc-81ad-424cb2a37937 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:45.160080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24ade0ca-0429-48dc-81ad-424cb2a37937 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:45.165375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24ade0ca-0429-48dc-81ad-424cb2a37937 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:45.189035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:45.290265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a99b6af7-c702-4c39-99eb-c5fb3df5af87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:45.300504 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a99b6af7-c702-4c39-99eb-c5fb3df5af87 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.624863 Aug 09 14:30:45.301094 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 50/86] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:44 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:45.345832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-902efa8d-4bff-42fa-8306-9c91bdbf15c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:45.361662 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:45.361662 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:45.362717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-902efa8d-4bff-42fa-8306-9c91bdbf15c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'afcba602889a4cc4ae100a802af83535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e0eb09083f403e822d179538c6d261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-902efa8d-4bff-42fa-8306-9c91bdbf15c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Request method failure captured: Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/flavors/193583441/os-extra_specs HTTP/1.1 Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 66 Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-OSyXIOwFKaBV_PXglC9R2nHf3O-IMDEa7Dh5MzBg1XsITmVDuMeBOh2YppxEFAsNqIkPLWxwUhYeDndReoGc9T1TDVVZPLqaxt-PM7XBlxBv5jfsDETk1YLS5AHZFiQyTwVDNCCZ_Ygo8hMJMNh_6alJIDdITDWjQVFAwTTfOT1Y Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a3e0eb09083f403e822d179538c6d261 Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:30:45.394338 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:30:45.395568 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a3e0eb09083f403e822d179538c6d261", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a3e0eb09083f403e822d179538c6d261"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3e0eb09083f403e822d179538c6d261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3e0eb09083f403e822d179538c6d261"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:45.395568 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 Aug 09 14:30:45.395568 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a3e0eb09083f403e822d179538c6d261 Aug 09 14:30:45.395568 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 Aug 09 14:30:45.395568 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project Aug 09 14:30:45.395568 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:45.395568 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:45.395568 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: afcba602889a4cc4ae100a802af83535 Aug 09 14:30:45.395568 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project Aug 09 14:30:45.395568 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:30:45.395568 n-d-844626-8 devstack@n-api.service[119406]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 09 14:30:45.395568 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'flavor_id': '193583441', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:45.396206 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 09 14:30:45.398898 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.405582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-902efa8d-4bff-42fa-8306-9c91bdbf15c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:45.408029 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-902efa8d-4bff-42fa-8306-9c91bdbf15c9 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] 10.222.0.50 "POST /compute/v2.1/flavors/193583441/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.104757 Aug 09 14:30:45.411481 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 51/87] 10.222.0.50 () {60 vars in 1221 bytes} [Tue Aug 9 14:30:45 2022] POST /compute/v2.1/flavors/193583441/os-extra_specs => generated 124 bytes in 109 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:30:45.427869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-46f3e225-fb06-4c73-ab67-27084f366461 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:45.515744 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-46f3e225-fb06-4c73-ab67-27084f366461 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/193583441/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.095732 Aug 09 14:30:45.519638 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 52/88] 10.222.0.50 () {60 vars in 1221 bytes} [Tue Aug 9 14:30:45 2022] POST /compute/v2.1/flavors/193583441/os-extra_specs => generated 66 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 14:30:45.531823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aafeb5b3-3cc2-4322-9ea3-bd3b9cff0f42 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:45.532586 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:45.532586 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:45.534317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aafeb5b3-3cc2-4322-9ea3-bd3b9cff0f42 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'afcba602889a4cc4ae100a802af83535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e0eb09083f403e822d179538c6d261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aafeb5b3-3cc2-4322-9ea3-bd3b9cff0f42 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Request method failure captured: Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/flavors/193583441/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-OSyXIOwFKaBV_PXglC9R2nHf3O-IMDEa7Dh5MzBg1XsITmVDuMeBOh2YppxEFAsNqIkPLWxwUhYeDndReoGc9T1TDVVZPLqaxt-PM7XBlxBv5jfsDETk1YLS5AHZFiQyTwVDNCCZ_Ygo8hMJMNh_6alJIDdITDWjQVFAwTTfOT1Y Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a3e0eb09083f403e822d179538c6d261 Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:30:45.537457 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:30:45.539454 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a3e0eb09083f403e822d179538c6d261", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a3e0eb09083f403e822d179538c6d261"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3e0eb09083f403e822d179538c6d261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3e0eb09083f403e822d179538c6d261"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:45.539454 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 Aug 09 14:30:45.539454 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a3e0eb09083f403e822d179538c6d261 Aug 09 14:30:45.539454 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 Aug 09 14:30:45.539454 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project Aug 09 14:30:45.539454 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:30:45.539454 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:30:45.539454 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: afcba602889a4cc4ae100a802af83535 Aug 09 14:30:45.539454 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project Aug 09 14:30:45.539454 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:30:45.539454 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'flavor_id': '193583441', 'id': 'hw:numa_nodes'} Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:45.540161 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 09 14:30:45.541404 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.545426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aafeb5b3-3cc2-4322-9ea3-bd3b9cff0f42 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:45.547649 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aafeb5b3-3cc2-4322-9ea3-bd3b9cff0f42 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] 10.222.0.50 "DELETE /compute/v2.1/flavors/193583441/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.022034 Aug 09 14:30:45.553709 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 53/89] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:30:45 2022] DELETE /compute/v2.1/flavors/193583441/os-extra_specs/hw:numa_nodes => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:30:45.581813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2c17d77-c380-4c4a-b513-0aa8283c1907 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:45.669337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=10 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:45.686622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=7,nova_api:DELETE=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:45.693151 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f2c17d77-c380-4c4a-b513-0aa8283c1907 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/193583441/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.133412 Aug 09 14:30:45.694013 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 54/90] 10.222.0.50 () {60 vars in 1221 bytes} [Tue Aug 9 14:30:45 2022] POST /compute/v2.1/flavors/193583441/os-extra_specs => generated 66 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 14:30:45.700158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-24ade0ca-0429-48dc-81ad-424cb2a37937 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:45.712877 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-24ade0ca-0429-48dc-81ad-424cb2a37937 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.609565 Aug 09 14:30:45.719726 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 37/91] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:45 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:45.745118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef651f8b-da08-4c2d-8be7-30edec8ef90f tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:45.758030 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:45.758030 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:45.760349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ef651f8b-da08-4c2d-8be7-30edec8ef90f tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'afcba602889a4cc4ae100a802af83535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3e0eb09083f403e822d179538c6d261', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef651f8b-da08-4c2d-8be7-30edec8ef90f tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Request method failure captured: Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/flavors/193583441/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 22 Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-OSyXIOwFKaBV_PXglC9R2nHf3O-IMDEa7Dh5MzBg1XsITmVDuMeBOh2YppxEFAsNqIkPLWxwUhYeDndReoGc9T1TDVVZPLqaxt-PM7XBlxBv5jfsDETk1YLS5AHZFiQyTwVDNCCZ_Ygo8hMJMNh_6alJIDdITDWjQVFAwTTfOT1Y Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: a3e0eb09083f403e822d179538c6d261 Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:30:45.765064 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a3e0eb09083f403e822d179538c6d261", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a3e0eb09083f403e822d179538c6d261"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3e0eb09083f403e822d179538c6d261"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a3e0eb09083f403e822d179538c6d261"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: a3e0eb09083f403e822d179538c6d261 Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: afcba602889a4cc4ae100a802af83535 Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: {"hw:numa_nodes": "1"} Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:30:45.766479 n-d-844626-8 devstack@n-api.service[119407]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'flavor_id': '193583441', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:45.767519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 09 14:30:45.768650 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.772555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef651f8b-da08-4c2d-8be7-30edec8ef90f tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:45.773970 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ef651f8b-da08-4c2d-8be7-30edec8ef90f tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353 tempest-FlavorsExtraSpecsNegativeTestJSON-1362246353-project] 10.222.0.50 "PUT /compute/v2.1/flavors/193583441/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.049567 Aug 09 14:30:45.786949 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 38/92] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:30:45 2022] PUT /compute/v2.1/flavors/193583441/os-extra_specs/hw:numa_nodes => generated 124 bytes in 66 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:30:45.797106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-69a628e0-e0e6-481b-93f4-d23362962511 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:45.798328 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:45.798328 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:45.824618 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-69a628e0-e0e6-481b-93f4-d23362962511 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] HTTP exception thrown: Flavor 193583441 has no extra specs with key hw:cpu_thread_policy. Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-69a628e0-e0e6-481b-93f4-d23362962511 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Request method failure captured: Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/flavors/193583441/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-RAC4ZIxDp8pSZhkEdiKNLs-LakV_2kCorlFYIxyjX-te19dGgzOa3MlvJnWNT5ok8dCFX9vbxN0kSzEV95g0Agurgs9tRMacfWTLFUqdHY1c6uOcxnDNtrXvrbRUKb4uz_HVWXrPE5tqrF5kIBVhgp9ur4wHnlQDdUrMShFZ6A_c Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: a46b16f5c95c4319a03f7340171ff91e Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:30:45.826464 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:30:45.827621 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a46b16f5c95c4319a03f7340171ff91e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a46b16f5c95c4319a03f7340171ff91e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a46b16f5c95c4319a03f7340171ff91e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a46b16f5c95c4319a03f7340171ff91e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:45.827621 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 Aug 09 14:30:45.827621 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: a46b16f5c95c4319a03f7340171ff91e Aug 09 14:30:45.827621 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 Aug 09 14:30:45.827621 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin Aug 09 14:30:45.827621 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:45.827621 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:45.827621 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 41d3a64f250545359e9adeddb4c86b90 Aug 09 14:30:45.827621 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin Aug 09 14:30:45.827621 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:30:45.827621 n-d-844626-8 devstack@n-api.service[119407]: exception: Flavor 193583441 has no extra specs with key hw:cpu_thread_policy. Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'flavor_id': '193583441', 'id': 'hw:cpu_thread_policy'} Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 193583441 has no extra specs with key hw:cpu_thread_policy. Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:45.828232 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.829301 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.829301 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.829301 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.829301 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:30:45.829301 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:30:45.829301 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 193583441 has no extra specs with key hw:cpu_thread_policy. Aug 09 14:30:45.829301 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.831959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-69a628e0-e0e6-481b-93f4-d23362962511 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Returning 404 to user: Flavor 193583441 has no extra specs with key hw:cpu_thread_policy. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:45.833298 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-69a628e0-e0e6-481b-93f4-d23362962511 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/193583441/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.044945 Aug 09 14:30:45.839220 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 39/93] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 14:30:45 2022] DELETE /compute/v2.1/flavors/193583441/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:30:45.848478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49e000ed-868c-4171-811e-60e63fe28899 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:45.859535 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-49e000ed-868c-4171-811e-60e63fe28899 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49e000ed-868c-4171-811e-60e63fe28899 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Request method failure captured: Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/flavors/193583441/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 27 Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-RAC4ZIxDp8pSZhkEdiKNLs-LakV_2kCorlFYIxyjX-te19dGgzOa3MlvJnWNT5ok8dCFX9vbxN0kSzEV95g0Agurgs9tRMacfWTLFUqdHY1c6uOcxnDNtrXvrbRUKb4uz_HVWXrPE5tqrF5kIBVhgp9ur4wHnlQDdUrMShFZ6A_c Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: a46b16f5c95c4319a03f7340171ff91e Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:30:45.861384 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a46b16f5c95c4319a03f7340171ff91e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a46b16f5c95c4319a03f7340171ff91e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a46b16f5c95c4319a03f7340171ff91e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a46b16f5c95c4319a03f7340171ff91e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: a46b16f5c95c4319a03f7340171ff91e Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 41d3a64f250545359e9adeddb4c86b90 Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: {"hw:cpu_policy": "shared"} Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:30:45.862527 n-d-844626-8 devstack@n-api.service[119407]: exception: Request body and URI mismatch Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'flavor_id': '193583441', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.864297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.865314 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:30:45.865314 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:30:45.865314 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 09 14:30:45.865314 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.867935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49e000ed-868c-4171-811e-60e63fe28899 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:45.870999 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49e000ed-868c-4171-811e-60e63fe28899 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/193583441/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.030436 Aug 09 14:30:45.877481 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 40/94] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:30:45 2022] PUT /compute/v2.1/flavors/193583441/os-extra_specs/hw:numa_nodes => generated 73 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:30:45.890378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2f3e643-8ee7-4ac7-96e3-b5385c76abfb tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2f3e643-8ee7-4ac7-96e3-b5385c76abfb tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Request method failure captured: Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/flavors/193583441/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 49 Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-RAC4ZIxDp8pSZhkEdiKNLs-LakV_2kCorlFYIxyjX-te19dGgzOa3MlvJnWNT5ok8dCFX9vbxN0kSzEV95g0Agurgs9tRMacfWTLFUqdHY1c6uOcxnDNtrXvrbRUKb4uz_HVWXrPE5tqrF5kIBVhgp9ur4wHnlQDdUrMShFZ6A_c Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: a46b16f5c95c4319a03f7340171ff91e Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:30:45.900013 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:30:45.901244 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a46b16f5c95c4319a03f7340171ff91e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a46b16f5c95c4319a03f7340171ff91e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a46b16f5c95c4319a03f7340171ff91e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a46b16f5c95c4319a03f7340171ff91e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:45.901244 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 Aug 09 14:30:45.901244 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: a46b16f5c95c4319a03f7340171ff91e Aug 09 14:30:45.901244 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 Aug 09 14:30:45.901244 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin Aug 09 14:30:45.901244 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:45.901244 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:45.901244 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 41d3a64f250545359e9adeddb4c86b90 Aug 09 14:30:45.901244 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin Aug 09 14:30:45.901244 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:30:45.901244 n-d-844626-8 devstack@n-api.service[119407]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 09 14:30:45.901244 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'flavor_id': '193583441', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance: Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 09 14:30:45.901871 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.903030 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:45.907466 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:45.907466 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:45.907466 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:30:45.907466 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:30:45.907466 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 09 14:30:45.907466 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:45.907466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2f3e643-8ee7-4ac7-96e3-b5385c76abfb tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:45.907466 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d2f3e643-8ee7-4ac7-96e3-b5385c76abfb tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/193583441/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.025469 Aug 09 14:30:45.907466 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 41/95] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:30:45 2022] PUT /compute/v2.1/flavors/193583441/os-extra_specs/hw:numa_nodes => generated 117 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:30:45.918749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe326ba7-b9b9-4b1d-9f9c-3698fe30a30c tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:45.928111 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:45.928111 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:45.996785 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe326ba7-b9b9-4b1d-9f9c-3698fe30a30c tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/193583441" status: 202 len: 0 microversion: 2.1 time: 0.079012 Aug 09 14:30:46.001043 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 42/96] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:30:45 2022] DELETE /compute/v2.1/flavors/193583441 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:30:46.055944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eab73c33-953b-4466-bbef-99692dfabed0 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:46.104490 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eab73c33-953b-4466-bbef-99692dfabed0 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644 tempest-FlavorsExtraSpecsNegativeTestJSON-2051781644-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.098872 Aug 09 14:30:46.106695 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 43/97] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:30:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:46.646206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ca7e00d-0d87-49b1-9e95-5dce1eb3bc48 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Calling method '.version_select at 0x7f41e405bf70>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:46.647769 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:46.647769 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:46.649325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca7e00d-0d87-49b1-9e95-5dce1eb3bc48 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:46.652273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca7e00d-0d87-49b1-9e95-5dce1eb3bc48 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:46.653548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca7e00d-0d87-49b1-9e95-5dce1eb3bc48 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:46.725645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca7e00d-0d87-49b1-9e95-5dce1eb3bc48 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:46.727285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca7e00d-0d87-49b1-9e95-5dce1eb3bc48 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:46.729810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca7e00d-0d87-49b1-9e95-5dce1eb3bc48 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:46.786412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca7e00d-0d87-49b1-9e95-5dce1eb3bc48 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:46.791461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca7e00d-0d87-49b1-9e95-5dce1eb3bc48 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:46.792330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4c44fcbc-da04-48c6-a3c6-97674578f35a tempest-FlavorsV261TestJSON-159303771 tempest-FlavorsV261TestJSON-159303771-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1732077644", "id": 1159835400, "os-flavor-access:is_public": "True"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:46.795334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca7e00d-0d87-49b1-9e95-5dce1eb3bc48 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:46.810494 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:46.810494 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:46.818427 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ca7e00d-0d87-49b1-9e95-5dce1eb3bc48 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.122991 Aug 09 14:30:46.825959 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 55/98] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:30:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:46.841285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e65b2ed5-7155-4a76-bbd4-864f3e83b96e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:46.849874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e65b2ed5-7155-4a76-bbd4-864f3e83b96e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:46.876021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e65b2ed5-7155-4a76-bbd4-864f3e83b96e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:46.876997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e65b2ed5-7155-4a76-bbd4-864f3e83b96e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:46.882352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e65b2ed5-7155-4a76-bbd4-864f3e83b96e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:46.887745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e65b2ed5-7155-4a76-bbd4-864f3e83b96e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:46.888784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e65b2ed5-7155-4a76-bbd4-864f3e83b96e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:46.892029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e65b2ed5-7155-4a76-bbd4-864f3e83b96e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:46.900389 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4c44fcbc-da04-48c6-a3c6-97674578f35a tempest-FlavorsV261TestJSON-159303771 tempest-FlavorsV261TestJSON-159303771-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.633510 Aug 09 14:30:46.901803 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 44/99] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:30:46 2022] POST /compute/v2.1/flavors => generated 468 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:30:46.908031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60a5b88f-f7f0-434d-ac64-d9fa15955876 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:46.909005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-60a5b88f-f7f0-434d-ac64-d9fa15955876 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:46.974567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60a5b88f-f7f0-434d-ac64-d9fa15955876 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:46.975036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60a5b88f-f7f0-434d-ac64-d9fa15955876 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:46.989448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60a5b88f-f7f0-434d-ac64-d9fa15955876 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:46.991621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60a5b88f-f7f0-434d-ac64-d9fa15955876 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:46.994132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60a5b88f-f7f0-434d-ac64-d9fa15955876 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:46.995851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60a5b88f-f7f0-434d-ac64-d9fa15955876 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:47.635874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e65b2ed5-7155-4a76-bbd4-864f3e83b96e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:47.666952 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e65b2ed5-7155-4a76-bbd4-864f3e83b96e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.835669 Aug 09 14:30:47.690470 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 56/100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:46 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:47.707073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a1d1ce4-7963-4b6f-ae73-5066e508614d tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Calling method '.version_select at 0x7f41e40c7670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:47.716338 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:47.716338 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:47.717894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1d1ce4-7963-4b6f-ae73-5066e508614d tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:47.721156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1d1ce4-7963-4b6f-ae73-5066e508614d tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:47.721962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1d1ce4-7963-4b6f-ae73-5066e508614d tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:47.816769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1d1ce4-7963-4b6f-ae73-5066e508614d tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:47.818044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1d1ce4-7963-4b6f-ae73-5066e508614d tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:47.819752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1d1ce4-7963-4b6f-ae73-5066e508614d tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:47.933913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60a5b88f-f7f0-434d-ac64-d9fa15955876 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:47.947711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1d1ce4-7963-4b6f-ae73-5066e508614d tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:47.948966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1d1ce4-7963-4b6f-ae73-5066e508614d tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:47.950859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1d1ce4-7963-4b6f-ae73-5066e508614d tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:47.961857 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60a5b88f-f7f0-434d-ac64-d9fa15955876 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 1.050826 Aug 09 14:30:47.962953 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 45/101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:46 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:47.985855 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a1d1ce4-7963-4b6f-ae73-5066e508614d tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h1-844626-8/servers" status: 200 len: 196 microversion: 2.1 time: 0.293977 Aug 09 14:30:47.987505 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 57/102] 10.222.0.50 () {58 vars in 1212 bytes} [Tue Aug 9 14:30:47 2022] GET /compute/v2.1/os-hypervisors/n-h1-844626-8/servers => generated 196 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:48.003173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-14b1c852-a556-4c55-8b27-16067a252611 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Calling method '.version_select at 0x7f41e40c7790>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:48.004541 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:48.004541 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:48.006221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14b1c852-a556-4c55-8b27-16067a252611 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:48.006955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14b1c852-a556-4c55-8b27-16067a252611 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:48.007693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14b1c852-a556-4c55-8b27-16067a252611 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:48.060598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14b1c852-a556-4c55-8b27-16067a252611 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:48.062724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14b1c852-a556-4c55-8b27-16067a252611 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:48.067771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14b1c852-a556-4c55-8b27-16067a252611 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:48.092033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14b1c852-a556-4c55-8b27-16067a252611 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:48.094577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14b1c852-a556-4c55-8b27-16067a252611 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:48.095973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14b1c852-a556-4c55-8b27-16067a252611 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:48.116794 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-14b1c852-a556-4c55-8b27-16067a252611 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.119538 Aug 09 14:30:48.121169 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 58/103] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:30:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:48.138354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fb624f2-af6e-416d-baac-39b088d10960 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Calling method '.version_select at 0x7f41e405ba60>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:48.140747 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:48.140747 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:48.144166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fb624f2-af6e-416d-baac-39b088d10960 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:48.146541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fb624f2-af6e-416d-baac-39b088d10960 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:48.147358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fb624f2-af6e-416d-baac-39b088d10960 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:48.174153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fb624f2-af6e-416d-baac-39b088d10960 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:48.174998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fb624f2-af6e-416d-baac-39b088d10960 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:48.176001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fb624f2-af6e-416d-baac-39b088d10960 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:48.184400 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fb624f2-af6e-416d-baac-39b088d10960 tempest-HypervisorAdminUnderV252Test-1036307600 tempest-HypervisorAdminUnderV252Test-1036307600-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h1-844626-8/search" status: 200 len: 104 microversion: 2.1 time: 0.058101 Aug 09 14:30:48.186034 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 59/104] 10.222.0.50 () {58 vars in 1209 bytes} [Tue Aug 9 14:30:48 2022] GET /compute/v2.1/os-hypervisors/n-h1-844626-8/search => generated 104 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:48.384725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cd531b2f-8fb2-4f7f-97e7-112e2ab2767d tempest-FlavorsV261TestJSON-1147589405 tempest-FlavorsV261TestJSON-1147589405-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:48.424959 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cd531b2f-8fb2-4f7f-97e7-112e2ab2767d tempest-FlavorsV261TestJSON-1147589405 tempest-FlavorsV261TestJSON-1147589405-project] 10.222.0.50 "GET /compute/v2.1/flavors/1159835400" status: 200 len: 468 microversion: 2.61 time: 0.451856 Aug 09 14:30:48.425942 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 46/105] 10.222.0.50 () {60 vars in 1199 bytes} [Tue Aug 9 14:30:47 2022] GET /compute/v2.1/flavors/1159835400 => generated 468 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:30:48.441337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d88b1935-25cf-45e7-a383-175f3766c6ac tempest-FlavorsV261TestJSON-159303771 tempest-FlavorsV261TestJSON-159303771-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:48.444426 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:48.444426 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:30:48.502898 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d88b1935-25cf-45e7-a383-175f3766c6ac tempest-FlavorsV261TestJSON-159303771 tempest-FlavorsV261TestJSON-159303771-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/1159835400" status: 200 len: 469 microversion: 2.61 time: 0.066034 Aug 09 14:30:48.516344 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 60/106] 10.222.0.50 () {62 vars in 1219 bytes} [Tue Aug 9 14:30:48 2022] PUT /compute/v2.1/flavors/1159835400 => generated 469 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:30:48.532317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-43e0632e-d64f-41e3-97f4-28df00443138 tempest-FlavorsV261TestJSON-1147589405 tempest-FlavorsV261TestJSON-1147589405-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:48.588023 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-43e0632e-d64f-41e3-97f4-28df00443138 tempest-FlavorsV261TestJSON-1147589405 tempest-FlavorsV261TestJSON-1147589405-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.059442 Aug 09 14:30:48.588899 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 47/107] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 9 14:30:48 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:30:48.614942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0ec3230-b729-4fa7-9088-cc74f899c5a1 tempest-FlavorsV261TestJSON-1147589405 tempest-FlavorsV261TestJSON-1147589405-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:48.671305 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0ec3230-b729-4fa7-9088-cc74f899c5a1 tempest-FlavorsV261TestJSON-1147589405 tempest-FlavorsV261TestJSON-1147589405-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.061211 Aug 09 14:30:48.672150 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 61/108] 10.222.0.50 () {60 vars in 1166 bytes} [Tue Aug 9 14:30:48 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:30:48.699571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-15705a17-7bbc-4add-9873-33af5ea429ff tempest-FlavorsV261TestJSON-159303771 tempest-FlavorsV261TestJSON-159303771-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:48.700917 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:48.700917 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:48.718682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4518f28f-6de2-4119-8a1c-a3e17df79506 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:48.728462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4518f28f-6de2-4119-8a1c-a3e17df79506 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:48.753122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4518f28f-6de2-4119-8a1c-a3e17df79506 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:48.753985 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-15705a17-7bbc-4add-9873-33af5ea429ff tempest-FlavorsV261TestJSON-159303771 tempest-FlavorsV261TestJSON-159303771-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1159835400" status: 202 len: 0 microversion: 2.61 time: 0.065831 Aug 09 14:30:48.758509 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 48/109] 10.222.0.50 () {60 vars in 1202 bytes} [Tue Aug 9 14:30:48 2022] DELETE /compute/v2.1/flavors/1159835400 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:30:48.759069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4518f28f-6de2-4119-8a1c-a3e17df79506 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:48.759722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4518f28f-6de2-4119-8a1c-a3e17df79506 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:48.760823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4518f28f-6de2-4119-8a1c-a3e17df79506 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:48.772053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4518f28f-6de2-4119-8a1c-a3e17df79506 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:48.774598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4518f28f-6de2-4119-8a1c-a3e17df79506 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:48.777658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e2b51776-cf1f-421a-ac05-7014e17fc978 tempest-FlavorsV261TestJSON-159303771 tempest-FlavorsV261TestJSON-159303771-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:48.863686 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e2b51776-cf1f-421a-ac05-7014e17fc978 tempest-FlavorsV261TestJSON-159303771 tempest-FlavorsV261TestJSON-159303771-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.100910 Aug 09 14:30:48.869521 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 49/110] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 9 14:30:48 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:30:48.996228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0b755f8-d9c4-443b-8683-d6fb990962f3 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:48.998187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0b755f8-d9c4-443b-8683-d6fb990962f3 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:49.012971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0b755f8-d9c4-443b-8683-d6fb990962f3 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:49.013904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0b755f8-d9c4-443b-8683-d6fb990962f3 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:49.014539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0b755f8-d9c4-443b-8683-d6fb990962f3 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:49.015631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0b755f8-d9c4-443b-8683-d6fb990962f3 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:49.017364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0b755f8-d9c4-443b-8683-d6fb990962f3 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:49.018274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0b755f8-d9c4-443b-8683-d6fb990962f3 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:49.068842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4518f28f-6de2-4119-8a1c-a3e17df79506 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:49.083670 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4518f28f-6de2-4119-8a1c-a3e17df79506 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.374126 Aug 09 14:30:49.097191 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 62/111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:48 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:49.415733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a0b755f8-d9c4-443b-8683-d6fb990962f3 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:49.428511 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0b755f8-d9c4-443b-8683-d6fb990962f3 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.446040 Aug 09 14:30:49.436899 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 50/112] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:48 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:50.109094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a513c259-4710-42e6-9a4e-af0e48b5f00c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:50.109753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a513c259-4710-42e6-9a4e-af0e48b5f00c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:50.139134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a513c259-4710-42e6-9a4e-af0e48b5f00c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:50.139677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a513c259-4710-42e6-9a4e-af0e48b5f00c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:50.140113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a513c259-4710-42e6-9a4e-af0e48b5f00c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:50.158971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a513c259-4710-42e6-9a4e-af0e48b5f00c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:50.159555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a513c259-4710-42e6-9a4e-af0e48b5f00c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:50.160005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a513c259-4710-42e6-9a4e-af0e48b5f00c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:50.449998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a8c54c1-87fa-4488-b4db-f165545299c0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:50.450664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0a8c54c1-87fa-4488-b4db-f165545299c0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:50.475571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a8c54c1-87fa-4488-b4db-f165545299c0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:50.476288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a8c54c1-87fa-4488-b4db-f165545299c0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:50.476887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a8c54c1-87fa-4488-b4db-f165545299c0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:50.477634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a8c54c1-87fa-4488-b4db-f165545299c0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:50.478094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a8c54c1-87fa-4488-b4db-f165545299c0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:50.478519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a8c54c1-87fa-4488-b4db-f165545299c0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:50.808953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a513c259-4710-42e6-9a4e-af0e48b5f00c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:50.832013 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a513c259-4710-42e6-9a4e-af0e48b5f00c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.729496 Aug 09 14:30:50.832722 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 63/113] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:50 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:51.074888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0a8c54c1-87fa-4488-b4db-f165545299c0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:51.083592 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0a8c54c1-87fa-4488-b4db-f165545299c0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.637463 Aug 09 14:30:51.097315 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 51/114] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:50 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:51.863562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a35844aa-90bf-4408-89d4-af8290a2cd81 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:51.864206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a35844aa-90bf-4408-89d4-af8290a2cd81 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:51.877079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a35844aa-90bf-4408-89d4-af8290a2cd81 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:51.877579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a35844aa-90bf-4408-89d4-af8290a2cd81 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:51.878014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a35844aa-90bf-4408-89d4-af8290a2cd81 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:51.878763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a35844aa-90bf-4408-89d4-af8290a2cd81 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:51.886344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a35844aa-90bf-4408-89d4-af8290a2cd81 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:51.886970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a35844aa-90bf-4408-89d4-af8290a2cd81 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:52.104811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fec7f977-479c-4dce-aecf-8cb6b5a931ca tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:52.106199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fec7f977-479c-4dce-aecf-8cb6b5a931ca tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:52.122078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec7f977-479c-4dce-aecf-8cb6b5a931ca tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:52.123880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec7f977-479c-4dce-aecf-8cb6b5a931ca tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:52.127461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec7f977-479c-4dce-aecf-8cb6b5a931ca tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:52.135250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec7f977-479c-4dce-aecf-8cb6b5a931ca tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:52.140437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec7f977-479c-4dce-aecf-8cb6b5a931ca tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:52.141687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec7f977-479c-4dce-aecf-8cb6b5a931ca tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:52.145267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:52.468499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a35844aa-90bf-4408-89d4-af8290a2cd81 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:52.479613 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a35844aa-90bf-4408-89d4-af8290a2cd81 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.622049 Aug 09 14:30:52.481438 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 64/115] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:51 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:52.495747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fec7f977-479c-4dce-aecf-8cb6b5a931ca tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:52.505362 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fec7f977-479c-4dce-aecf-8cb6b5a931ca tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.404582 Aug 09 14:30:52.507448 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 52/116] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:52 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:30:53.501393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ad7f599-6e1b-4703-b00d-1244b03fe211 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:53.502393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9ad7f599-6e1b-4703-b00d-1244b03fe211 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:53.511634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ad7f599-6e1b-4703-b00d-1244b03fe211 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:53.512552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ad7f599-6e1b-4703-b00d-1244b03fe211 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:53.513179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ad7f599-6e1b-4703-b00d-1244b03fe211 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:53.514015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ad7f599-6e1b-4703-b00d-1244b03fe211 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:53.514609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ad7f599-6e1b-4703-b00d-1244b03fe211 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:53.515191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ad7f599-6e1b-4703-b00d-1244b03fe211 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:53.744388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1433342884", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:30:53.896586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9ad7f599-6e1b-4703-b00d-1244b03fe211 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:53.913752 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ad7f599-6e1b-4703-b00d-1244b03fe211 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.415020 Aug 09 14:30:53.917072 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 53/117] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:53 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:53.928005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e9cebf6-1f11-4e33-8453-f510bc803d39 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:53.930740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e9cebf6-1f11-4e33-8453-f510bc803d39 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:53.946669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e9cebf6-1f11-4e33-8453-f510bc803d39 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:53.947770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e9cebf6-1f11-4e33-8453-f510bc803d39 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:53.950157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e9cebf6-1f11-4e33-8453-f510bc803d39 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:53.952571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e9cebf6-1f11-4e33-8453-f510bc803d39 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:53.954332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e9cebf6-1f11-4e33-8453-f510bc803d39 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:53.955325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e9cebf6-1f11-4e33-8453-f510bc803d39 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:54.379503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e9cebf6-1f11-4e33-8453-f510bc803d39 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:54.408288 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e9cebf6-1f11-4e33-8453-f510bc803d39 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.484457 Aug 09 14:30:54.410504 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 54/118] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:53 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:54.744887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:30:54.944768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc10f47e-3760-46ef-96c0-f9bea54f734b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:54.946606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fc10f47e-3760-46ef-96c0-f9bea54f734b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:55.002770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc10f47e-3760-46ef-96c0-f9bea54f734b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:55.003886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc10f47e-3760-46ef-96c0-f9bea54f734b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:55.004323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc10f47e-3760-46ef-96c0-f9bea54f734b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:55.005042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc10f47e-3760-46ef-96c0-f9bea54f734b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:55.005543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc10f47e-3760-46ef-96c0-f9bea54f734b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:55.006310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc10f47e-3760-46ef-96c0-f9bea54f734b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:55.256313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc10f47e-3760-46ef-96c0-f9bea54f734b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:55.265686 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc10f47e-3760-46ef-96c0-f9bea54f734b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.325205 Aug 09 14:30:55.269491 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 55/119] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:54 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:55.272273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:30:55.272880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:30:55.273545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:30:55.274112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:30:55.274655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:30:55.289603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:55.290327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:55.290882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:55.291649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:55.292086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:55.292659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:55.311311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:30:55.336208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Getting quotas for project 445967d49e9e4267b0a741861f3ea634. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:30:55.343618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Getting quotas for user 7dac1d91c48541e194c85de174ad3011 and project 445967d49e9e4267b0a741861f3ea634. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:30:55.359803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:30:55.363300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:30:55.434327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2c433b9-c59a-407f-a71f-0108131e5ed6 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:55.435254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2c433b9-c59a-407f-a71f-0108131e5ed6 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:55.444428 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dca65018-4525-45c9-980b-e24f971f39c2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.480957 Aug 09 14:30:55.445426 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 65/120] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:30:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:30:55.459541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5817a1c2-7c1b-45ca-82e9-e77d6b3f9ede tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:55.460165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5817a1c2-7c1b-45ca-82e9-e77d6b3f9ede tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:55.465670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c433b9-c59a-407f-a71f-0108131e5ed6 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:55.469336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c433b9-c59a-407f-a71f-0108131e5ed6 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:55.470999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c433b9-c59a-407f-a71f-0108131e5ed6 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:55.471766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c433b9-c59a-407f-a71f-0108131e5ed6 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:55.472220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c433b9-c59a-407f-a71f-0108131e5ed6 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:55.474934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2c433b9-c59a-407f-a71f-0108131e5ed6 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:55.594962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5817a1c2-7c1b-45ca-82e9-e77d6b3f9ede tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:55.609199 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5817a1c2-7c1b-45ca-82e9-e77d6b3f9ede tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1223 microversion: 2.1 time: 0.156415 Aug 09 14:30:55.609792 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 66/121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:55 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1223 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:55.812715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2c433b9-c59a-407f-a71f-0108131e5ed6 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:55.823423 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2c433b9-c59a-407f-a71f-0108131e5ed6 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.395617 Aug 09 14:30:55.824650 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 56/122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:55 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:30:56.291068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03a84c48-39b7-4c19-9ada-8c3a3f28c421 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:56.291788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03a84c48-39b7-4c19-9ada-8c3a3f28c421 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:56.303592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03a84c48-39b7-4c19-9ada-8c3a3f28c421 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:56.304082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03a84c48-39b7-4c19-9ada-8c3a3f28c421 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:56.307358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03a84c48-39b7-4c19-9ada-8c3a3f28c421 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:56.309234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03a84c48-39b7-4c19-9ada-8c3a3f28c421 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:56.311764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03a84c48-39b7-4c19-9ada-8c3a3f28c421 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:56.312414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03a84c48-39b7-4c19-9ada-8c3a3f28c421 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:56.591746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-03a84c48-39b7-4c19-9ada-8c3a3f28c421 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:56.605095 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03a84c48-39b7-4c19-9ada-8c3a3f28c421 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.322994 Aug 09 14:30:56.622622 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 67/123] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:56 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:56.633297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c099876-10a7-47e6-8d3f-546e1128758a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:56.633994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6c099876-10a7-47e6-8d3f-546e1128758a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:56.646239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c099876-10a7-47e6-8d3f-546e1128758a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:56.646818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c099876-10a7-47e6-8d3f-546e1128758a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:56.647336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c099876-10a7-47e6-8d3f-546e1128758a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:56.648124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c099876-10a7-47e6-8d3f-546e1128758a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:56.648652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c099876-10a7-47e6-8d3f-546e1128758a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:56.649135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c099876-10a7-47e6-8d3f-546e1128758a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:56.800953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6c099876-10a7-47e6-8d3f-546e1128758a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:56.811234 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6c099876-10a7-47e6-8d3f-546e1128758a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1227 microversion: 2.1 time: 0.182329 Aug 09 14:30:56.815130 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 57/124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:56 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1227 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:56.850381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5770228-0085-4088-bf4f-1aa71f38100a tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:56.851263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c5770228-0085-4088-bf4f-1aa71f38100a tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:56.864009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5770228-0085-4088-bf4f-1aa71f38100a tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:56.864763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5770228-0085-4088-bf4f-1aa71f38100a tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:56.866167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5770228-0085-4088-bf4f-1aa71f38100a tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:56.872136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5770228-0085-4088-bf4f-1aa71f38100a tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:56.873634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5770228-0085-4088-bf4f-1aa71f38100a tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:56.877887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5770228-0085-4088-bf4f-1aa71f38100a tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:57.133514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5770228-0085-4088-bf4f-1aa71f38100a tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:57.164474 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c5770228-0085-4088-bf4f-1aa71f38100a tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.320724 Aug 09 14:30:57.167751 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 68/125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:56 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:57.628971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f140121-a2d1-4a1c-bfdb-a067d30b463c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:57.629983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f140121-a2d1-4a1c-bfdb-a067d30b463c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:57.640735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f140121-a2d1-4a1c-bfdb-a067d30b463c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:57.641164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f140121-a2d1-4a1c-bfdb-a067d30b463c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:57.641602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f140121-a2d1-4a1c-bfdb-a067d30b463c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:57.643738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f140121-a2d1-4a1c-bfdb-a067d30b463c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:57.645030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f140121-a2d1-4a1c-bfdb-a067d30b463c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:57.645464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f140121-a2d1-4a1c-bfdb-a067d30b463c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:57.721854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44c18d1f-5895-454c-b1e3-cf08767b6337 tempest-InstanceUsageAuditLogTestJSON-1791100528 tempest-InstanceUsageAuditLogTestJSON-1791100528-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:57.723754 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:57.723754 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:57.792728 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44c18d1f-5895-454c-b1e3-cf08767b6337 tempest-InstanceUsageAuditLogTestJSON-1791100528 tempest-InstanceUsageAuditLogTestJSON-1791100528-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-09 14:30:57" status: 200 len: 318 microversion: 2.1 time: 0.412257 Aug 09 14:30:57.795103 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 58/126] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:30:57 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-09%2014%3A30%3A57 => generated 318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:57.915544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b1563c3-69ef-4e88-a053-55ccad693403 tempest-InstanceUsageAuditLogNegativeTestJSON-738105928 tempest-InstanceUsageAuditLogNegativeTestJSON-738105928-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:57.916738 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:57.916738 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:57.918287 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-5b1563c3-69ef-4e88-a053-55ccad693403 tempest-InstanceUsageAuditLogNegativeTestJSON-738105928 tempest-InstanceUsageAuditLogNegativeTestJSON-738105928-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 09 14:30:57.920043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f140121-a2d1-4a1c-bfdb-a067d30b463c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b1563c3-69ef-4e88-a053-55ccad693403 tempest-InstanceUsageAuditLogNegativeTestJSON-738105928 tempest-InstanceUsageAuditLogNegativeTestJSON-738105928-project-admin] Request method failure captured: Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-hzhQQ6wVYhwvTAn5H0ukgCuf0R9T240uvBCrgYZQRXiHrhtHGsFaiAU5EkEFRV2KtAX8lJE_q8hLbtyYOi7RniPzv1vuzlUlAqwZjoA6dVSFhkFG7epZIJUJuRikgP4Fo24vt8Ig81uFlalm6xY3Kvx9H6KhqqtYmsD53UOTI5nY Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: c011398249614e12987bfd3c0537ca24 Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-738105928 Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:30:57.929282 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:30:57.931146 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c011398249614e12987bfd3c0537ca24", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c011398249614e12987bfd3c0537ca24"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c011398249614e12987bfd3c0537ca24"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c011398249614e12987bfd3c0537ca24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:57.931146 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-738105928 Aug 09 14:30:57.931146 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: c011398249614e12987bfd3c0537ca24 Aug 09 14:30:57.931146 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-738105928 Aug 09 14:30:57.931146 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-738105928-project-admin Aug 09 14:30:57.931146 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:57.931146 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:57.931146 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e15d2e022c1948f4996593b7fa2f2626 Aug 09 14:30:57.931146 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-738105928-project-admin Aug 09 14:30:57.931146 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:30:57.931146 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid timestamp for date invalid_time Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'invalid_time'} Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:57.931913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 09 14:30:57.933289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:57.934103 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f140121-a2d1-4a1c-bfdb-a067d30b463c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.307858 Aug 09 14:30:57.935139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b1563c3-69ef-4e88-a053-55ccad693403 tempest-InstanceUsageAuditLogNegativeTestJSON-738105928 tempest-InstanceUsageAuditLogNegativeTestJSON-738105928-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:57.936574 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5b1563c3-69ef-4e88-a053-55ccad693403 tempest-InstanceUsageAuditLogNegativeTestJSON-738105928 tempest-InstanceUsageAuditLogNegativeTestJSON-738105928-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.139940 Aug 09 14:30:57.942441 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 59/127] 10.222.0.50 () {58 vars in 1224 bytes} [Tue Aug 9 14:30:57 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:30:57.946701 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 69/128] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:57 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:30:57.951468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d3f00f73-a26c-4d7b-96e8-9572ca1c9581 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:57.952078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3f00f73-a26c-4d7b-96e8-9572ca1c9581 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:57.952440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b02ed612-1d6f-4515-9514-4dfcc013540d tempest-InstanceUsageAuditLogTestJSON-1791100528 tempest-InstanceUsageAuditLogTestJSON-1791100528-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:57.953401 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:57.953401 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:57.959631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f00f73-a26c-4d7b-96e8-9572ca1c9581 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:57.960868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f00f73-a26c-4d7b-96e8-9572ca1c9581 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:57.961582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f00f73-a26c-4d7b-96e8-9572ca1c9581 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:57.962304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f00f73-a26c-4d7b-96e8-9572ca1c9581 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:57.962759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f00f73-a26c-4d7b-96e8-9572ca1c9581 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:57.963207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f00f73-a26c-4d7b-96e8-9572ca1c9581 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:58.001206 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b02ed612-1d6f-4515-9514-4dfcc013540d tempest-InstanceUsageAuditLogTestJSON-1791100528 tempest-InstanceUsageAuditLogTestJSON-1791100528-project-admin] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.057119 Aug 09 14:30:58.002297 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 60/129] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 9 14:30:57 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:58.073087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d3f00f73-a26c-4d7b-96e8-9572ca1c9581 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:58.082658 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d3f00f73-a26c-4d7b-96e8-9572ca1c9581 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1293 microversion: 2.1 time: 0.134666 Aug 09 14:30:58.083646 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 70/130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:57 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1293 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:58.189628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca04204e-ff49-49bf-911e-d0748fd57d70 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:58.190310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca04204e-ff49-49bf-911e-d0748fd57d70 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:58.196723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca04204e-ff49-49bf-911e-d0748fd57d70 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:58.197204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca04204e-ff49-49bf-911e-d0748fd57d70 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:58.197630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca04204e-ff49-49bf-911e-d0748fd57d70 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:58.198323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca04204e-ff49-49bf-911e-d0748fd57d70 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:58.198830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca04204e-ff49-49bf-911e-d0748fd57d70 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:58.199276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca04204e-ff49-49bf-911e-d0748fd57d70 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:58.269199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0b44ac9-c5b5-4086-8c2d-e936917e1d60 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:58.269953 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:58.269953 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:58.271054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a0b44ac9-c5b5-4086-8c2d-e936917e1d60 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'ec3ab6a73e374d5784da2b6a72546102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efe9f3f009d4f62aee97929c6d0167b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0b44ac9-c5b5-4086-8c2d-e936917e1d60 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project] Request method failure captured: Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-fFUDQ96A_UdHvmGHiM9wjOBJFeC09M8aFL7qcTteXq44inidKAq0Hc2xClPL_vYCooxZY34w2-WbAL-9fnXA_j3acXoXZmevBwUw7YBVetHXnWxbxBVulfwT2CDsbft7PZiIdMm44V2tf966vuQOAo59kiCIsIUd1JQKmxNYViOM Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 1efe9f3f009d4f62aee97929c6d0167b Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:30:58.272608 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:30:58.274027 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1efe9f3f009d4f62aee97929c6d0167b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1efe9f3f009d4f62aee97929c6d0167b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1efe9f3f009d4f62aee97929c6d0167b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1efe9f3f009d4f62aee97929c6d0167b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:58.274027 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 Aug 09 14:30:58.274027 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 1efe9f3f009d4f62aee97929c6d0167b Aug 09 14:30:58.274027 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 Aug 09 14:30:58.274027 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project Aug 09 14:30:58.274027 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:58.274027 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:58.274027 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: ec3ab6a73e374d5784da2b6a72546102 Aug 09 14:30:58.274027 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project Aug 09 14:30:58.274027 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: action_args: {} Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:58.274689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 09 14:30:58.276070 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:58.277188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0b44ac9-c5b5-4086-8c2d-e936917e1d60 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:58.277188 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0b44ac9-c5b5-4086-8c2d-e936917e1d60 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.270566 Aug 09 14:30:58.277188 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 61/131] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 9 14:30:58 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 272 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:30:58.295218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c13f3d84-a3cb-4a6f-92f7-e383c2255e83 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:58.296214 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:58.296214 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:58.300503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c13f3d84-a3cb-4a6f-92f7-e383c2255e83 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'ec3ab6a73e374d5784da2b6a72546102', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1efe9f3f009d4f62aee97929c6d0167b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c13f3d84-a3cb-4a6f-92f7-e383c2255e83 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project] Request method failure captured: Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-09%2014:30:58 HTTP/1.1 Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-fFUDQ96A_UdHvmGHiM9wjOBJFeC09M8aFL7qcTteXq44inidKAq0Hc2xClPL_vYCooxZY34w2-WbAL-9fnXA_j3acXoXZmevBwUw7YBVetHXnWxbxBVulfwT2CDsbft7PZiIdMm44V2tf966vuQOAo59kiCIsIUd1JQKmxNYViOM Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 1efe9f3f009d4f62aee97929c6d0167b Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:30:58.320284 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:30:58.322046 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1efe9f3f009d4f62aee97929c6d0167b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1efe9f3f009d4f62aee97929c6d0167b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1efe9f3f009d4f62aee97929c6d0167b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1efe9f3f009d4f62aee97929c6d0167b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:30:58.322046 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 Aug 09 14:30:58.322046 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 1efe9f3f009d4f62aee97929c6d0167b Aug 09 14:30:58.322046 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 Aug 09 14:30:58.322046 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project Aug 09 14:30:58.322046 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:30:58.322046 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:30:58.322046 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: ec3ab6a73e374d5784da2b6a72546102 Aug 09 14:30:58.322046 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project Aug 09 14:30:58.322046 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '2022-08-09 14:30:58'} Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:30:58.323215 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 09 14:30:58.324677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:30:58.327527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c13f3d84-a3cb-4a6f-92f7-e383c2255e83 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:30:58.332095 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c13f3d84-a3cb-4a6f-92f7-e383c2255e83 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543 tempest-InstanceUsageAuditLogNegativeTestJSON-2129215543-project] 10.222.0.50 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-09 14:30:58" status: 403 len: 128 microversion: 2.1 time: 0.053096 Aug 09 14:30:58.333748 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 62/132] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:30:58 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-09%2014%3A30%3A58 => generated 128 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:30:58.394920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca04204e-ff49-49bf-911e-d0748fd57d70 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:58.408156 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca04204e-ff49-49bf-911e-d0748fd57d70 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.223264 Aug 09 14:30:58.421622 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 71/133] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:58 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:58.954485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2918d2c-6f9e-45ea-a9b5-e03eaf9709bc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:58.955776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b2918d2c-6f9e-45ea-a9b5-e03eaf9709bc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:58.968174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2918d2c-6f9e-45ea-a9b5-e03eaf9709bc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:58.969108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2918d2c-6f9e-45ea-a9b5-e03eaf9709bc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:58.969719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2918d2c-6f9e-45ea-a9b5-e03eaf9709bc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:58.970904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2918d2c-6f9e-45ea-a9b5-e03eaf9709bc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:58.971566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2918d2c-6f9e-45ea-a9b5-e03eaf9709bc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:58.973396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2918d2c-6f9e-45ea-a9b5-e03eaf9709bc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:59.010287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-71da8680-6ce6-4abf-bbe7-9253d885c11c tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Calling method '.version_select at 0x7f41def2b430>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:59.014846 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:59.014846 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:59.019628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71da8680-6ce6-4abf-bbe7-9253d885c11c tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:59.020436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71da8680-6ce6-4abf-bbe7-9253d885c11c tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:59.021059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71da8680-6ce6-4abf-bbe7-9253d885c11c tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:59.022558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71da8680-6ce6-4abf-bbe7-9253d885c11c tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:59.024360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71da8680-6ce6-4abf-bbe7-9253d885c11c tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:59.024992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71da8680-6ce6-4abf-bbe7-9253d885c11c tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:59.062297 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-71da8680-6ce6-4abf-bbe7-9253d885c11c tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.484152 Aug 09 14:30:59.064683 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 63/134] 10.222.0.50 () {58 vars in 1128 bytes} [Tue Aug 9 14:30:58 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:59.077434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a49ff481-8b51-4c15-80d5-7cfa9074777d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Calling method '.version_select at 0x7f41e4045790>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:59.080845 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:59.080845 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:59.082358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a49ff481-8b51-4c15-80d5-7cfa9074777d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:59.083032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a49ff481-8b51-4c15-80d5-7cfa9074777d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:59.083712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a49ff481-8b51-4c15-80d5-7cfa9074777d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:59.084612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a49ff481-8b51-4c15-80d5-7cfa9074777d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:59.085254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a49ff481-8b51-4c15-80d5-7cfa9074777d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:59.085886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a49ff481-8b51-4c15-80d5-7cfa9074777d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:59.124947 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a49ff481-8b51-4c15-80d5-7cfa9074777d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.051289 Aug 09 14:30:59.126247 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 64/135] 10.222.0.50 () {58 vars in 1139 bytes} [Tue Aug 9 14:30:59 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:30:59.136812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6b6ee1a9-1faf-4e7d-9f24-bcb83eef631a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:59.137714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6b6ee1a9-1faf-4e7d-9f24-bcb83eef631a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:59.145074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b6ee1a9-1faf-4e7d-9f24-bcb83eef631a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:59.145827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b6ee1a9-1faf-4e7d-9f24-bcb83eef631a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:59.147325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b6ee1a9-1faf-4e7d-9f24-bcb83eef631a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:59.148364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b6ee1a9-1faf-4e7d-9f24-bcb83eef631a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:59.149014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b6ee1a9-1faf-4e7d-9f24-bcb83eef631a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:59.149929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b6ee1a9-1faf-4e7d-9f24-bcb83eef631a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:59.410378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6b6ee1a9-1faf-4e7d-9f24-bcb83eef631a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:59.427883 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6b6ee1a9-1faf-4e7d-9f24-bcb83eef631a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1281 microversion: 2.1 time: 0.293505 Aug 09 14:30:59.428703 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 65/136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:59 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1281 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:30:59.434753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a33c4bf3-9bd1-423f-aff6-9f1250045408 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Calling method '.version_select at 0x7f41def375e0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:59.440230 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:30:59.440230 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:30:59.448063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a33c4bf3-9bd1-423f-aff6-9f1250045408 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:59.448913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a33c4bf3-9bd1-423f-aff6-9f1250045408 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:59.450363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a33c4bf3-9bd1-423f-aff6-9f1250045408 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:59.452549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a33c4bf3-9bd1-423f-aff6-9f1250045408 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:59.453109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a33c4bf3-9bd1-423f-aff6-9f1250045408 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:59.453544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a33c4bf3-9bd1-423f-aff6-9f1250045408 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:59.493342 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a33c4bf3-9bd1-423f-aff6-9f1250045408 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.063183 Aug 09 14:30:59.494721 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 66/137] 10.222.0.50 () {58 vars in 1145 bytes} [Tue Aug 9 14:30:59 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:30:59.505786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63974208-eb86-47e8-a7d1-a7466c8f09bd tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:30:59.506805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-63974208-eb86-47e8-a7d1-a7466c8f09bd tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:30:59.516069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63974208-eb86-47e8-a7d1-a7466c8f09bd tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:59.517212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63974208-eb86-47e8-a7d1-a7466c8f09bd tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:59.517849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63974208-eb86-47e8-a7d1-a7466c8f09bd tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:59.518866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63974208-eb86-47e8-a7d1-a7466c8f09bd tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:30:59.519516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63974208-eb86-47e8-a7d1-a7466c8f09bd tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:30:59.520577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63974208-eb86-47e8-a7d1-a7466c8f09bd tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:30:59.593912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b2918d2c-6f9e-45ea-a9b5-e03eaf9709bc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:30:59.604947 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b2918d2c-6f9e-45ea-a9b5-e03eaf9709bc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.655851 Aug 09 14:30:59.605825 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 72/138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:58 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:31:00.069391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-63974208-eb86-47e8-a7d1-a7466c8f09bd tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:00.078523 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63974208-eb86-47e8-a7d1-a7466c8f09bd tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.582561 Aug 09 14:31:00.083704 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 67/139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:30:59 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:00.452216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-86ec831c-489d-4271-ae12-1950e6b0bba3 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:00.455823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-86ec831c-489d-4271-ae12-1950e6b0bba3 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:00.468870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86ec831c-489d-4271-ae12-1950e6b0bba3 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:00.471937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86ec831c-489d-4271-ae12-1950e6b0bba3 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:00.473866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86ec831c-489d-4271-ae12-1950e6b0bba3 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:00.477725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86ec831c-489d-4271-ae12-1950e6b0bba3 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:00.478471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86ec831c-489d-4271-ae12-1950e6b0bba3 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:00.481398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86ec831c-489d-4271-ae12-1950e6b0bba3 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:00.628761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93ec842d-98da-477a-931e-52c17b7251f0 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:00.629571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93ec842d-98da-477a-931e-52c17b7251f0 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:00.641895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ec842d-98da-477a-931e-52c17b7251f0 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:00.642486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ec842d-98da-477a-931e-52c17b7251f0 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:00.643019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ec842d-98da-477a-931e-52c17b7251f0 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:00.643852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ec842d-98da-477a-931e-52c17b7251f0 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:00.645684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ec842d-98da-477a-931e-52c17b7251f0 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:00.646343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ec842d-98da-477a-931e-52c17b7251f0 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:01.303368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-86ec831c-489d-4271-ae12-1950e6b0bba3 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:01.314079 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-86ec831c-489d-4271-ae12-1950e6b0bba3 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1323 microversion: 2.1 time: 0.867654 Aug 09 14:31:01.316654 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 73/140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:00 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1323 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:01.335284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-538eebde-768a-4e0e-808d-5a28136734a6 req-de2ed5ec-6020-4f5e-8adf-ea002081adc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc68a48f-2a87-414d-97c1-48fcf18e53cd", "tag": "0f355a3a-b917-40d9-9e88-ffb0aa86375d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:01.367458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-538eebde-768a-4e0e-808d-5a28136734a6 req-de2ed5ec-6020-4f5e-8adf-ea002081adc3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:01.368279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-538eebde-768a-4e0e-808d-5a28136734a6 req-de2ed5ec-6020-4f5e-8adf-ea002081adc3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:01.369032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-538eebde-768a-4e0e-808d-5a28136734a6 req-de2ed5ec-6020-4f5e-8adf-ea002081adc3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:01.386432 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-538eebde-768a-4e0e-808d-5a28136734a6 req-de2ed5ec-6020-4f5e-8adf-ea002081adc3 service nova] Creating event network-changed:0f355a3a-b917-40d9-9e88-ffb0aa86375d for instance cc68a48f-2a87-414d-97c1-48fcf18e53cd on n-h2-844626-8 Aug 09 14:31:01.389669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-93ec842d-98da-477a-931e-52c17b7251f0 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:01.401029 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-538eebde-768a-4e0e-808d-5a28136734a6 req-de2ed5ec-6020-4f5e-8adf-ea002081adc3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082940 Aug 09 14:31:01.401635 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 74/141] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:01.408332 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93ec842d-98da-477a-931e-52c17b7251f0 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.783865 Aug 09 14:31:01.408510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cc829c6d-a60b-4bcb-9145-e4c5b07dc08f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:01.409208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cc829c6d-a60b-4bcb-9145-e4c5b07dc08f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:01.412697 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 68/142] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:00 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:01.458339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc829c6d-a60b-4bcb-9145-e4c5b07dc08f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:01.458882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc829c6d-a60b-4bcb-9145-e4c5b07dc08f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:01.459301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc829c6d-a60b-4bcb-9145-e4c5b07dc08f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:01.460023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc829c6d-a60b-4bcb-9145-e4c5b07dc08f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:01.460492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc829c6d-a60b-4bcb-9145-e4c5b07dc08f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:01.460980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc829c6d-a60b-4bcb-9145-e4c5b07dc08f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:01.575851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-7ac5890d-f991-4ca3-9194-5fa4c02d854d req-fd24b9c1-f132-4c02-8edc-39d499fff896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af232722-6385-4af0-b196-3f72b6bbc5f7", "name": "network-vif-plugged", "status": "completed", "tag": "e142dbbe-2cf4-4d97-b019-f6e13971b3f8"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:01.602664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7ac5890d-f991-4ca3-9194-5fa4c02d854d req-fd24b9c1-f132-4c02-8edc-39d499fff896 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:01.609719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7ac5890d-f991-4ca3-9194-5fa4c02d854d req-fd24b9c1-f132-4c02-8edc-39d499fff896 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:01.610251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7ac5890d-f991-4ca3-9194-5fa4c02d854d req-fd24b9c1-f132-4c02-8edc-39d499fff896 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:01.664006 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-7ac5890d-f991-4ca3-9194-5fa4c02d854d req-fd24b9c1-f132-4c02-8edc-39d499fff896 service nova] Creating event network-vif-plugged:e142dbbe-2cf4-4d97-b019-f6e13971b3f8 for instance af232722-6385-4af0-b196-3f72b6bbc5f7 on n-h2-844626-8 Aug 09 14:31:01.687197 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-7ac5890d-f991-4ca3-9194-5fa4c02d854d req-fd24b9c1-f132-4c02-8edc-39d499fff896 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259316 Aug 09 14:31:01.688417 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 69/143] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:01.974138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cc829c6d-a60b-4bcb-9145-e4c5b07dc08f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:01.995877 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cc829c6d-a60b-4bcb-9145-e4c5b07dc08f tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.592746 Aug 09 14:31:02.011066 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 75/144] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:01 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:02.338396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09b2a030-7960-4075-962f-a9393b7e99b2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:02.339364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-09b2a030-7960-4075-962f-a9393b7e99b2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:02.345750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09b2a030-7960-4075-962f-a9393b7e99b2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:02.346494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09b2a030-7960-4075-962f-a9393b7e99b2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:02.347139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09b2a030-7960-4075-962f-a9393b7e99b2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:02.347833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09b2a030-7960-4075-962f-a9393b7e99b2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:02.348280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09b2a030-7960-4075-962f-a9393b7e99b2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:02.348693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09b2a030-7960-4075-962f-a9393b7e99b2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:02.431027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-863ee454-0a67-4a70-81ab-67d3ad84575c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:02.431681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-863ee454-0a67-4a70-81ab-67d3ad84575c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:02.443930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-863ee454-0a67-4a70-81ab-67d3ad84575c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:02.444650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-863ee454-0a67-4a70-81ab-67d3ad84575c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:02.445292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-863ee454-0a67-4a70-81ab-67d3ad84575c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:02.446221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-863ee454-0a67-4a70-81ab-67d3ad84575c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:02.446878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-863ee454-0a67-4a70-81ab-67d3ad84575c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:02.447881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-863ee454-0a67-4a70-81ab-67d3ad84575c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:02.715765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-09b2a030-7960-4075-962f-a9393b7e99b2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:02.726807 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09b2a030-7960-4075-962f-a9393b7e99b2 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1323 microversion: 2.1 time: 0.392515 Aug 09 14:31:02.727476 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 70/145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:02 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1323 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:02.766872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-863ee454-0a67-4a70-81ab-67d3ad84575c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:02.777519 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-863ee454-0a67-4a70-81ab-67d3ad84575c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.351194 Aug 09 14:31:02.780931 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 76/146] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:02 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:03.017101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e617810-46b0-4049-862d-653c67177da7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:03.018029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e617810-46b0-4049-862d-653c67177da7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:03.028164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e617810-46b0-4049-862d-653c67177da7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:03.028657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e617810-46b0-4049-862d-653c67177da7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:03.033839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e617810-46b0-4049-862d-653c67177da7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:03.034686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e617810-46b0-4049-862d-653c67177da7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:03.035181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e617810-46b0-4049-862d-653c67177da7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:03.035769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e617810-46b0-4049-862d-653c67177da7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:03.232255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5e617810-46b0-4049-862d-653c67177da7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:03.243424 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e617810-46b0-4049-862d-653c67177da7 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.230106 Aug 09 14:31:03.244484 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 71/147] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:03 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:03.730987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ed7b0ced-a86b-418e-a222-39490966a95e req-996a8c5e-c168-4ccd-a4ae-1c50b79d63a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8ce37a-525d-4ad6-b09a-505ed3e418ce", "name": "network-vif-plugged", "status": "completed", "tag": "db7c3e7e-c5dc-4613-bc9f-4fb4332d9cbb"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:03.750183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-08e2cfa0-a398-41d9-b8cf-93a715eeb5c9 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:03.750878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-08e2cfa0-a398-41d9-b8cf-93a715eeb5c9 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:03.763986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=9,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:03.764550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ed7b0ced-a86b-418e-a222-39490966a95e req-996a8c5e-c168-4ccd-a4ae-1c50b79d63a8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:03.767190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ed7b0ced-a86b-418e-a222-39490966a95e req-996a8c5e-c168-4ccd-a4ae-1c50b79d63a8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:03.768962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08e2cfa0-a398-41d9-b8cf-93a715eeb5c9 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:03.769869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ed7b0ced-a86b-418e-a222-39490966a95e req-996a8c5e-c168-4ccd-a4ae-1c50b79d63a8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:03.772959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08e2cfa0-a398-41d9-b8cf-93a715eeb5c9 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:03.773798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08e2cfa0-a398-41d9-b8cf-93a715eeb5c9 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:03.777120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08e2cfa0-a398-41d9-b8cf-93a715eeb5c9 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:03.777605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08e2cfa0-a398-41d9-b8cf-93a715eeb5c9 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:03.780294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08e2cfa0-a398-41d9-b8cf-93a715eeb5c9 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:03.814189 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ed7b0ced-a86b-418e-a222-39490966a95e req-996a8c5e-c168-4ccd-a4ae-1c50b79d63a8 service nova] Creating event network-vif-plugged:db7c3e7e-c5dc-4613-bc9f-4fb4332d9cbb for instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce on n-h1-844626-8 Aug 09 14:31:03.817279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:03.827236 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ed7b0ced-a86b-418e-a222-39490966a95e req-996a8c5e-c168-4ccd-a4ae-1c50b79d63a8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100987 Aug 09 14:31:03.832615 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 77/148] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:03.843352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57f21d24-a314-43b9-913a-7b8c30d1f9cb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:03.845724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57f21d24-a314-43b9-913a-7b8c30d1f9cb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:03.863935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57f21d24-a314-43b9-913a-7b8c30d1f9cb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:03.864576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57f21d24-a314-43b9-913a-7b8c30d1f9cb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:03.868273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57f21d24-a314-43b9-913a-7b8c30d1f9cb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:03.883068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57f21d24-a314-43b9-913a-7b8c30d1f9cb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:03.883890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57f21d24-a314-43b9-913a-7b8c30d1f9cb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:03.884529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57f21d24-a314-43b9-913a-7b8c30d1f9cb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:04.246912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-08e2cfa0-a398-41d9-b8cf-93a715eeb5c9 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:04.255797 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-08e2cfa0-a398-41d9-b8cf-93a715eeb5c9 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1323 microversion: 2.1 time: 0.510413 Aug 09 14:31:04.256390 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 72/149] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:03 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1323 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:31:04.273180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-faf8ee6c-1332-499d-832b-0514ce8d084c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:04.273960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-faf8ee6c-1332-499d-832b-0514ce8d084c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:04.295305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faf8ee6c-1332-499d-832b-0514ce8d084c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:04.295799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faf8ee6c-1332-499d-832b-0514ce8d084c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:04.296225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faf8ee6c-1332-499d-832b-0514ce8d084c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:04.297130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faf8ee6c-1332-499d-832b-0514ce8d084c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:04.297777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faf8ee6c-1332-499d-832b-0514ce8d084c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:04.298429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faf8ee6c-1332-499d-832b-0514ce8d084c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:04.357027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-57f21d24-a314-43b9-913a-7b8c30d1f9cb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:04.369249 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57f21d24-a314-43b9-913a-7b8c30d1f9cb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1320 microversion: 2.1 time: 0.534494 Aug 09 14:31:04.370369 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 78/150] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:03 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1320 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:04.522226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-790bbedd-1ec6-43c2-81f8-dd68d716dbb1 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Action: 'create', calling method: .version_select at 0x7f41e40c7e50>, body: {"keypair": {"name": "tempest-keypair-1702025812", "type": "ssh", "user_id": "d00736480e164796b877acc967b0cc4f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvXP4DWjJOcKLAH1eevzAluVEyWm/bCbSvHbcnGkdZuYTI4l4QbtkiAfmg0y99PETzrT52t9gANvRVhT3O7o3uaZaiA2uNNzjsv6Mx4pYcDXdvQ6f1opE53Cp/Oa2NPWQ=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:04.549675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-790bbedd-1ec6-43c2-81f8-dd68d716dbb1 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Getting quotas for project 433e99095b04427895bc4cbb4312f8a5. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:31:04.554541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-790bbedd-1ec6-43c2-81f8-dd68d716dbb1 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Getting quotas for user 6cbe8b8ec09f4f57ad778f3aa4b195d3 and project 433e99095b04427895bc4cbb4312f8a5. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:31:04.571420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-faf8ee6c-1332-499d-832b-0514ce8d084c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:04.587592 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-faf8ee6c-1332-499d-832b-0514ce8d084c tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.316345 Aug 09 14:31:04.589268 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 73/151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:04 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:04.603932 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-790bbedd-1ec6-43c2-81f8-dd68d716dbb1 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.232083 Aug 09 14:31:04.605406 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 79/152] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 9 14:31:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 234 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 14:31:04.621159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ad60a31-afba-4a8a-b686-9fd5eda8b145 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Action: 'create', calling method: .version_select at 0x7f41def37af0>, body: {"keypair": {"name": "tempest-keypair-600415644", "type": "ssh", "user_id": "d00736480e164796b877acc967b0cc4f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1lGFk/5L8ZwwLfw5XeiJtoIKERQtFCBiRF7Vmcg9AQy1Urv/Wh/ILC97HbVjXMqyQAfp2BXfkxkGQ97A7lnnED9c1fx56XmMMt1iWNudlhjkiYZ52f1VhsqIr1/nEfTw=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:04.670878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-5ad60a31-afba-4a8a-b686-9fd5eda8b145 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Getting quotas for project 433e99095b04427895bc4cbb4312f8a5. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:31:04.676688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-5ad60a31-afba-4a8a-b686-9fd5eda8b145 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Getting quotas for user 6cbe8b8ec09f4f57ad778f3aa4b195d3 and project 433e99095b04427895bc4cbb4312f8a5. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:31:04.724907 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5ad60a31-afba-4a8a-b686-9fd5eda8b145 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.108564 Aug 09 14:31:04.726271 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 74/153] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 9 14:31:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 14:31:04.738268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de374ec1-4d88-4126-9a9f-5635b70b705e tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Calling method '.version_select at 0x7f41def5d430>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:04.752186 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-de374ec1-4d88-4126-9a9f-5635b70b705e tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-1702025812?user_id=d00736480e164796b877acc967b0cc4f" status: 200 len: 512 microversion: 2.10 time: 0.019002 Aug 09 14:31:04.763924 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 80/154] 10.222.0.50 () {60 vars in 1340 bytes} [Tue Aug 9 14:31:04 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1702025812?user_id=d00736480e164796b877acc967b0cc4f => generated 512 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:31:04.772279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44fbf0f8-d2f1-4f69-b664-ca84f0b87a57 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Action: 'create', calling method: .version_select at 0x7f41e407b160>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-473592524", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZzjEAulU4OrbXv+I7Q1jf5Jvi6vhBwfl+pIxWZvyr641b3TX+L8GKh3GkUWqECpZVgOvUCBsvmms4ov8bceN7GGMY3A3bYgksbVNHzkPuWFmcQsHfvFHLrvkYk0P/rwA=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:04.809815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-44fbf0f8-d2f1-4f69-b664-ca84f0b87a57 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Getting quotas for project 433e99095b04427895bc4cbb4312f8a5. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:31:04.824265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-44fbf0f8-d2f1-4f69-b664-ca84f0b87a57 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Getting quotas for user 6cbe8b8ec09f4f57ad778f3aa4b195d3 and project 433e99095b04427895bc4cbb4312f8a5. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:31:04.861235 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44fbf0f8-d2f1-4f69-b664-ca84f0b87a57 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.097099 Aug 09 14:31:04.871394 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 75/155] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 9 14:31:04 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 108 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 09 14:31:04.872604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cff36aa6-885f-4acb-a37b-aa2aff23e33f tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Calling method '.version_select at 0x7f41def5d670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:04.876574 n-d-844626-8 devstack@n-api.service[119406]: WARNING oslo_db.sqlalchemy.utils [None req-cff36aa6-885f-4acb-a37b-aa2aff23e33f tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 09 14:31:04.889876 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cff36aa6-885f-4acb-a37b-aa2aff23e33f tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] 10.222.0.50 "GET /compute/v2.1/os-keypairs?user_id=d00736480e164796b877acc967b0cc4f" status: 200 len: 725 microversion: 2.10 time: 0.020771 Aug 09 14:31:04.891548 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 81/156] 10.222.0.50 () {60 vars in 1259 bytes} [Tue Aug 9 14:31:04 2022] GET /compute/v2.1/os-keypairs?user_id=d00736480e164796b877acc967b0cc4f => generated 725 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:31:04.901981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a8fe9e6-2ad8-41af-a494-c5d3a8e06b1f tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Calling method '.version_select at 0x7f41de5c4820>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:04.927518 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a8fe9e6-2ad8-41af-a494-c5d3a8e06b1f tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-473592524" status: 204 len: 0 microversion: 2.10 time: 0.028122 Aug 09 14:31:04.933283 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 76/157] 10.222.0.50 () {60 vars in 1322 bytes} [Tue Aug 9 14:31:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-473592524 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:31:04.938366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f3b27925-0434-499f-892f-a86c589e3b12 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Calling method '.version_select at 0x7f41def14670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:04.961132 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f3b27925-0434-499f-892f-a86c589e3b12 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-600415644?user_id=d00736480e164796b877acc967b0cc4f" status: 204 len: 0 microversion: 2.10 time: 0.026036 Aug 09 14:31:04.963078 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 82/158] 10.222.0.50 () {60 vars in 1340 bytes} [Tue Aug 9 14:31:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-600415644?user_id=d00736480e164796b877acc967b0cc4f => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:31:04.971442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-013e0bb0-1c2d-4937-91d8-72b746f34a48 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] Calling method '.version_select at 0x7f41de5e3790>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:04.999349 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-013e0bb0-1c2d-4937-91d8-72b746f34a48 tempest-KeyPairsV210TestJSON-1987504739 tempest-KeyPairsV210TestJSON-1987504739-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702025812?user_id=d00736480e164796b877acc967b0cc4f" status: 204 len: 0 microversion: 2.10 time: 0.031854 Aug 09 14:31:05.005667 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 77/159] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:31:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1702025812?user_id=d00736480e164796b877acc967b0cc4f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:31:05.279033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c887a2e-e1fb-4e07-a583-85e0c3d4a01d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:05.280245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c887a2e-e1fb-4e07-a583-85e0c3d4a01d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:05.293755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c887a2e-e1fb-4e07-a583-85e0c3d4a01d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:05.294534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c887a2e-e1fb-4e07-a583-85e0c3d4a01d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:05.295988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c887a2e-e1fb-4e07-a583-85e0c3d4a01d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:05.297350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c887a2e-e1fb-4e07-a583-85e0c3d4a01d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:05.299478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c887a2e-e1fb-4e07-a583-85e0c3d4a01d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:05.309152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c887a2e-e1fb-4e07-a583-85e0c3d4a01d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:05.317409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:05.391942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48995d66-847a-43e1-8dd2-3ce9a6774676 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:05.393519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48995d66-847a-43e1-8dd2-3ce9a6774676 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:05.405242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48995d66-847a-43e1-8dd2-3ce9a6774676 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:05.406140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48995d66-847a-43e1-8dd2-3ce9a6774676 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:05.406794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48995d66-847a-43e1-8dd2-3ce9a6774676 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:05.410225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48995d66-847a-43e1-8dd2-3ce9a6774676 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:05.410958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48995d66-847a-43e1-8dd2-3ce9a6774676 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:05.411542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48995d66-847a-43e1-8dd2-3ce9a6774676 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:05.951164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48995d66-847a-43e1-8dd2-3ce9a6774676 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:05.971141 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48995d66-847a-43e1-8dd2-3ce9a6774676 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1470 microversion: 2.1 time: 0.583524 Aug 09 14:31:05.973982 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 78/160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:05 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1470 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:05.995651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-715b3227-def6-479c-9791-542cfad6aca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:05.997945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-715b3227-def6-479c-9791-542cfad6aca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:06.016207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-715b3227-def6-479c-9791-542cfad6aca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:06.017215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-715b3227-def6-479c-9791-542cfad6aca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:06.018825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-715b3227-def6-479c-9791-542cfad6aca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:06.022792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-715b3227-def6-479c-9791-542cfad6aca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:06.024428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-715b3227-def6-479c-9791-542cfad6aca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:06.025432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-715b3227-def6-479c-9791-542cfad6aca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:06.252307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c887a2e-e1fb-4e07-a583-85e0c3d4a01d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:06.261970 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c887a2e-e1fb-4e07-a583-85e0c3d4a01d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1323 microversion: 2.1 time: 0.988129 Aug 09 14:31:06.263166 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 83/161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:05 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1323 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:06.682246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5424e37f-138d-418a-9e9c-75f69c8617e9 tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:06.683642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5424e37f-138d-418a-9e9c-75f69c8617e9 tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:06.686832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:06.691313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5424e37f-138d-418a-9e9c-75f69c8617e9 tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:06.696691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-715b3227-def6-479c-9791-542cfad6aca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:06.697766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5424e37f-138d-418a-9e9c-75f69c8617e9 tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:06.698522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5424e37f-138d-418a-9e9c-75f69c8617e9 tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:06.699564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5424e37f-138d-418a-9e9c-75f69c8617e9 tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:06.700839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5424e37f-138d-418a-9e9c-75f69c8617e9 tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:06.701503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5424e37f-138d-418a-9e9c-75f69c8617e9 tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:06.705286 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-715b3227-def6-479c-9791-542cfad6aca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1338 microversion: 2.1 time: 0.729906 Aug 09 14:31:06.705882 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 79/162] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:05 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1338 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:06.907993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5424e37f-138d-418a-9e9c-75f69c8617e9 tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:31:07.171225 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5424e37f-138d-418a-9e9c-75f69c8617e9 tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 204 len: 0 microversion: 2.1 time: 0.906070 Aug 09 14:31:07.172529 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 84/163] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:31:06 2022] DELETE /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 0 bytes in 908 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:31:07.181265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f5b0cff-5fdb-4ff7-af72-c4f329338d6e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:07.181918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f5b0cff-5fdb-4ff7-af72-c4f329338d6e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:07.189102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f5b0cff-5fdb-4ff7-af72-c4f329338d6e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:07.189896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f5b0cff-5fdb-4ff7-af72-c4f329338d6e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:07.190469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f5b0cff-5fdb-4ff7-af72-c4f329338d6e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:07.191415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f5b0cff-5fdb-4ff7-af72-c4f329338d6e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:07.192001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f5b0cff-5fdb-4ff7-af72-c4f329338d6e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:07.192554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f5b0cff-5fdb-4ff7-af72-c4f329338d6e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:07.271329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d69eecdb-aa71-4543-a32c-4df79b4ab1c0 req-ce81c7cd-daac-4c57-9a82-315199043905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc68a48f-2a87-414d-97c1-48fcf18e53cd", "name": "network-vif-plugged", "status": "completed", "tag": "0f355a3a-b917-40d9-9e88-ffb0aa86375d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:07.580632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d69eecdb-aa71-4543-a32c-4df79b4ab1c0 req-ce81c7cd-daac-4c57-9a82-315199043905 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:07.581112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d69eecdb-aa71-4543-a32c-4df79b4ab1c0 req-ce81c7cd-daac-4c57-9a82-315199043905 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:07.583443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d69eecdb-aa71-4543-a32c-4df79b4ab1c0 req-ce81c7cd-daac-4c57-9a82-315199043905 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:07.597813 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d69eecdb-aa71-4543-a32c-4df79b4ab1c0 req-ce81c7cd-daac-4c57-9a82-315199043905 service nova] Creating event network-vif-plugged:0f355a3a-b917-40d9-9e88-ffb0aa86375d for instance cc68a48f-2a87-414d-97c1-48fcf18e53cd on n-h2-844626-8 Aug 09 14:31:07.605769 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d69eecdb-aa71-4543-a32c-4df79b4ab1c0 req-ce81c7cd-daac-4c57-9a82-315199043905 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340209 Aug 09 14:31:07.607480 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 85/164] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:07.612840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71a3932a-4bf0-4d74-b807-356b3df2ed8f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:07.616167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-71a3932a-4bf0-4d74-b807-356b3df2ed8f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:07.636409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71a3932a-4bf0-4d74-b807-356b3df2ed8f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:07.637724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71a3932a-4bf0-4d74-b807-356b3df2ed8f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:07.637724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71a3932a-4bf0-4d74-b807-356b3df2ed8f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:07.641337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2f5b0cff-5fdb-4ff7-af72-c4f329338d6e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:07.645760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71a3932a-4bf0-4d74-b807-356b3df2ed8f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:07.647454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71a3932a-4bf0-4d74-b807-356b3df2ed8f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:07.648988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71a3932a-4bf0-4d74-b807-356b3df2ed8f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:07.661231 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f5b0cff-5fdb-4ff7-af72-c4f329338d6e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1476 microversion: 2.1 time: 0.484225 Aug 09 14:31:07.663156 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 80/165] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:07 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1476 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:07.727402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-123186a3-a75c-4f3c-ae0a-eb98a8db2ca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:07.728668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-123186a3-a75c-4f3c-ae0a-eb98a8db2ca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:07.747721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-123186a3-a75c-4f3c-ae0a-eb98a8db2ca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:07.748349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-123186a3-a75c-4f3c-ae0a-eb98a8db2ca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:07.748778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-123186a3-a75c-4f3c-ae0a-eb98a8db2ca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:07.749979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-123186a3-a75c-4f3c-ae0a-eb98a8db2ca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:07.750613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-123186a3-a75c-4f3c-ae0a-eb98a8db2ca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:07.751245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-123186a3-a75c-4f3c-ae0a-eb98a8db2ca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:08.339485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-123186a3-a75c-4f3c-ae0a-eb98a8db2ca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:08.354257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-71a3932a-4bf0-4d74-b807-356b3df2ed8f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:08.362104 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-71a3932a-4bf0-4d74-b807-356b3df2ed8f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1323 microversion: 2.1 time: 0.753298 Aug 09 14:31:08.383111 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 86/166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:07 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1323 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:08.397045 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-123186a3-a75c-4f3c-ae0a-eb98a8db2ca1 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1488 microversion: 2.1 time: 0.674743 Aug 09 14:31:08.429400 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 81/167] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:07 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1488 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:08.434757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-061cb662-c598-46e4-a047-7b9f0964587f tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:08.435557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-061cb662-c598-46e4-a047-7b9f0964587f tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:08.450057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-061cb662-c598-46e4-a047-7b9f0964587f tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:08.457456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-061cb662-c598-46e4-a047-7b9f0964587f tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:08.458890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-061cb662-c598-46e4-a047-7b9f0964587f tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:08.461348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-061cb662-c598-46e4-a047-7b9f0964587f tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:08.461905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-061cb662-c598-46e4-a047-7b9f0964587f tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:08.462438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-061cb662-c598-46e4-a047-7b9f0964587f tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:08.684468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c7873dd9-b327-47ef-8f7c-0223f9ed12eb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:08.685427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c7873dd9-b327-47ef-8f7c-0223f9ed12eb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:08.694459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7873dd9-b327-47ef-8f7c-0223f9ed12eb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:08.703162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7873dd9-b327-47ef-8f7c-0223f9ed12eb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:08.705184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7873dd9-b327-47ef-8f7c-0223f9ed12eb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:08.706164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7873dd9-b327-47ef-8f7c-0223f9ed12eb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:08.707488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7873dd9-b327-47ef-8f7c-0223f9ed12eb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:08.708987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7873dd9-b327-47ef-8f7c-0223f9ed12eb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:09.125766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c7873dd9-b327-47ef-8f7c-0223f9ed12eb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:09.140185 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c7873dd9-b327-47ef-8f7c-0223f9ed12eb tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1476 microversion: 2.1 time: 0.460196 Aug 09 14:31:09.141289 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 82/168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:08 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1476 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:31:09.393564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7bfe17af-ded8-470c-87ed-b9eee80b9853 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:09.398040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7bfe17af-ded8-470c-87ed-b9eee80b9853 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:09.417360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bfe17af-ded8-470c-87ed-b9eee80b9853 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:09.419060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bfe17af-ded8-470c-87ed-b9eee80b9853 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:09.422694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bfe17af-ded8-470c-87ed-b9eee80b9853 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:09.427189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bfe17af-ded8-470c-87ed-b9eee80b9853 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:09.429305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bfe17af-ded8-470c-87ed-b9eee80b9853 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:09.429931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bfe17af-ded8-470c-87ed-b9eee80b9853 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:09.482697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:09.765438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:09.775875 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-061cb662-c598-46e4-a047-7b9f0964587f tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1639 microversion: 2.1 time: 1.344764 Aug 09 14:31:09.777137 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 87/169] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:08 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1639 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:09.806178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b05c0b52-2489-4b62-9d5b-7fb39f8367de tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:09.808320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b05c0b52-2489-4b62-9d5b-7fb39f8367de tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:09.841051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05c0b52-2489-4b62-9d5b-7fb39f8367de tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:09.842900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05c0b52-2489-4b62-9d5b-7fb39f8367de tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:09.845214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05c0b52-2489-4b62-9d5b-7fb39f8367de tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:09.846219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05c0b52-2489-4b62-9d5b-7fb39f8367de tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:09.846883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05c0b52-2489-4b62-9d5b-7fb39f8367de tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:09.848316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05c0b52-2489-4b62-9d5b-7fb39f8367de tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:09.935898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b05c0b52-2489-4b62-9d5b-7fb39f8367de tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:31:10.065643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7bfe17af-ded8-470c-87ed-b9eee80b9853 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:10.076364 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7bfe17af-ded8-470c-87ed-b9eee80b9853 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1323 microversion: 2.1 time: 0.686452 Aug 09 14:31:10.077655 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 83/170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:09 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1323 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:10.172742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58a3b301-892e-415d-802b-9f825e4323cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:10.176528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58a3b301-892e-415d-802b-9f825e4323cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:10.194481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a3b301-892e-415d-802b-9f825e4323cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:10.196639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a3b301-892e-415d-802b-9f825e4323cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:10.197388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a3b301-892e-415d-802b-9f825e4323cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:10.201085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a3b301-892e-415d-802b-9f825e4323cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:10.205357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a3b301-892e-415d-802b-9f825e4323cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:10.206188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a3b301-892e-415d-802b-9f825e4323cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:10.286974 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b05c0b52-2489-4b62-9d5b-7fb39f8367de tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 204 len: 0 microversion: 2.1 time: 0.481784 Aug 09 14:31:10.293164 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 88/171] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:31:09 2022] DELETE /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:31:10.303029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2fb5827d-268e-4925-a91b-4025de0bae12 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:10.303772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2fb5827d-268e-4925-a91b-4025de0bae12 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:10.328818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb5827d-268e-4925-a91b-4025de0bae12 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:10.329326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb5827d-268e-4925-a91b-4025de0bae12 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:10.329774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb5827d-268e-4925-a91b-4025de0bae12 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:10.330665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb5827d-268e-4925-a91b-4025de0bae12 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:10.331293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb5827d-268e-4925-a91b-4025de0bae12 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:10.333136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb5827d-268e-4925-a91b-4025de0bae12 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:10.442645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-58a3b301-892e-415d-802b-9f825e4323cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:10.484284 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58a3b301-892e-415d-802b-9f825e4323cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 200 len: 1434 microversion: 2.1 time: 0.322976 Aug 09 14:31:10.487826 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 84/172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:10 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 1434 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:10.590437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-59d3b753-83a2-477c-a588-3d1c623e8a12 req-f8cfd6d7-2907-4742-86f8-f477fa01cc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af232722-6385-4af0-b196-3f72b6bbc5f7", "name": "network-vif-deleted", "tag": "e142dbbe-2cf4-4d97-b019-f6e13971b3f8"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:10.622300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-59d3b753-83a2-477c-a588-3d1c623e8a12 req-f8cfd6d7-2907-4742-86f8-f477fa01cc3a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:10.623945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-59d3b753-83a2-477c-a588-3d1c623e8a12 req-f8cfd6d7-2907-4742-86f8-f477fa01cc3a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:10.626545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-59d3b753-83a2-477c-a588-3d1c623e8a12 req-f8cfd6d7-2907-4742-86f8-f477fa01cc3a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:10.666473 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-59d3b753-83a2-477c-a588-3d1c623e8a12 req-f8cfd6d7-2907-4742-86f8-f477fa01cc3a service nova] Creating event network-vif-deleted:e142dbbe-2cf4-4d97-b019-f6e13971b3f8 for instance af232722-6385-4af0-b196-3f72b6bbc5f7 on n-h2-844626-8 Aug 09 14:31:10.701895 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-59d3b753-83a2-477c-a588-3d1c623e8a12 req-f8cfd6d7-2907-4742-86f8-f477fa01cc3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148127 Aug 09 14:31:10.707259 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 85/173] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:31:10.840601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2fb5827d-268e-4925-a91b-4025de0bae12 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:10.850086 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2fb5827d-268e-4925-a91b-4025de0bae12 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1494 microversion: 2.1 time: 0.555334 Aug 09 14:31:10.856672 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 89/174] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:10 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1494 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:11.098968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49d89d7a-52d4-464d-863e-0f00eba64358 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:11.099729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49d89d7a-52d4-464d-863e-0f00eba64358 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:11.114874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49d89d7a-52d4-464d-863e-0f00eba64358 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:11.115383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49d89d7a-52d4-464d-863e-0f00eba64358 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:11.115811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49d89d7a-52d4-464d-863e-0f00eba64358 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:11.116567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49d89d7a-52d4-464d-863e-0f00eba64358 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:11.117018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49d89d7a-52d4-464d-863e-0f00eba64358 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:11.117433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49d89d7a-52d4-464d-863e-0f00eba64358 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:11.446576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-49d89d7a-52d4-464d-863e-0f00eba64358 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:11.455391 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49d89d7a-52d4-464d-863e-0f00eba64358 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1473 microversion: 2.1 time: 0.360941 Aug 09 14:31:11.462396 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 86/175] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:11 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1473 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:11.482122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-056252e2-5f05-4f99-9ad7-0e1389b2db0f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:11.482616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-056252e2-5f05-4f99-9ad7-0e1389b2db0f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:11.498807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-056252e2-5f05-4f99-9ad7-0e1389b2db0f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:11.499326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-056252e2-5f05-4f99-9ad7-0e1389b2db0f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:11.499765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-056252e2-5f05-4f99-9ad7-0e1389b2db0f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:11.500703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-056252e2-5f05-4f99-9ad7-0e1389b2db0f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:11.501175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-056252e2-5f05-4f99-9ad7-0e1389b2db0f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:11.501868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-056252e2-5f05-4f99-9ad7-0e1389b2db0f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:11.506862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-233ea13e-3445-474d-999b-4fc7caabd232 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:11.507907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-233ea13e-3445-474d-999b-4fc7caabd232 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:11.516886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-233ea13e-3445-474d-999b-4fc7caabd232 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:11.517604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-233ea13e-3445-474d-999b-4fc7caabd232 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:11.521036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-233ea13e-3445-474d-999b-4fc7caabd232 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:11.522059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-233ea13e-3445-474d-999b-4fc7caabd232 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:11.523726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-233ea13e-3445-474d-999b-4fc7caabd232 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:11.531790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-233ea13e-3445-474d-999b-4fc7caabd232 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:11.555203 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-233ea13e-3445-474d-999b-4fc7caabd232 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] HTTP exception thrown: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:11.563102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-056252e2-5f05-4f99-9ad7-0e1389b2db0f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-233ea13e-3445-474d-999b-4fc7caabd232 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Request method failure captured: Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 HTTP/1.1 Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-GXnsaOUjMizHPiuKEVzMmLDm1p4-Erfruo3yxwmAViTRH150_T4qmkSCJe9EVL8QMsuZhgW1XtoPKOthLUk0M9W-oESTz8t622U4c4YkjNyXa34DiFHYxSUFRw8Z5RErTEij5SvhdhAF8N1ocQLXLR2-zhtq95TG5h2_lk_2B9TY Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: fb69ef1d43a24edcbbc99882cbf52f5b Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:31:11.566505 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:31:11.567786 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fb69ef1d43a24edcbbc99882cbf52f5b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:11.567786 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:11.567786 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: fb69ef1d43a24edcbbc99882cbf52f5b Aug 09 14:31:11.567786 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:11.567786 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersAdminTestJSON-1992007047-project Aug 09 14:31:11.567786 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:11.567786 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:11.567786 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 3e3b1bc0133f4e848eeccd53e141f6d2 Aug 09 14:31:11.567786 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersAdminTestJSON-1992007047-project Aug 09 14:31:11.567786 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:11.567786 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:11.567786 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'af232722-6385-4af0-b196-3f72b6bbc5f7'} Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:11.568463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:11.569514 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:11.572459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-233ea13e-3445-474d-999b-4fc7caabd232 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Returning 404 to user: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-056252e2-5f05-4f99-9ad7-0e1389b2db0f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Request method failure captured: Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd/diagnostics HTTP/1.1 Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-YQQyd21uTrb9-a2QjbHYQdwIZ-mRC5FpwUMXWAFHXQSIIyabwn14YWe2TDUebnkfmrggEBxM4l6XAi0REfNM0H8xQIIfqK5IHUhbkde2lcIGxbYW19rPuWdkfrfeE-6b4XkHZS3dK0w53K0xyl5HDnMVCY0qeaE0qwSrQ-E9ap1k Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 445967d49e9e4267b0a741861f3ea634 Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-487107141 Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:11.574861 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:11.576229 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_445967d49e9e4267b0a741861f3ea634", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/445967d49e9e4267b0a741861f3ea634"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/445967d49e9e4267b0a741861f3ea634"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/445967d49e9e4267b0a741861f3ea634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:11.576229 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-487107141 Aug 09 14:31:11.576229 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 445967d49e9e4267b0a741861f3ea634 Aug 09 14:31:11.576229 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-487107141 Aug 09 14:31:11.576229 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerDiagnosticsNegativeTest-487107141-project Aug 09 14:31:11.576229 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:11.576229 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:11.576229 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 7dac1d91c48541e194c85de174ad3011 Aug 09 14:31:11.576229 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-487107141-project Aug 09 14:31:11.576229 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:11.576229 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'server_id': 'cc68a48f-2a87-414d-97c1-48fcf18e53cd'} Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:11.576832 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 09 14:31:11.578003 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:11.580759 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-233ea13e-3445-474d-999b-4fc7caabd232 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 404 len: 111 microversion: 2.1 time: 0.077577 Aug 09 14:31:11.582408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-056252e2-5f05-4f99-9ad7-0e1389b2db0f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:11.582856 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 87/176] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:11 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:11.584031 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-056252e2-5f05-4f99-9ad7-0e1389b2db0f tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.105854 Aug 09 14:31:11.585055 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 90/177] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:31:11 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd/diagnostics => generated 117 bytes in 107 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:11.605955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d572b4a4-bf32-486b-9a92-579b31c5d183 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:11.606479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d572b4a4-bf32-486b-9a92-579b31c5d183 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:11.624140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d572b4a4-bf32-486b-9a92-579b31c5d183 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:11.625242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d572b4a4-bf32-486b-9a92-579b31c5d183 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:11.629295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d572b4a4-bf32-486b-9a92-579b31c5d183 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:11.630402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d572b4a4-bf32-486b-9a92-579b31c5d183 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:11.631039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d572b4a4-bf32-486b-9a92-579b31c5d183 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:11.633212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d572b4a4-bf32-486b-9a92-579b31c5d183 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:11.762743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-665189221", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:11.797179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d572b4a4-bf32-486b-9a92-579b31c5d183 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:31:11.883494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:31:12.031622 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d572b4a4-bf32-486b-9a92-579b31c5d183 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "DELETE /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 204 len: 0 microversion: 2.1 time: 0.437126 Aug 09 14:31:12.044605 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 88/178] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:31:11 2022] DELETE /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:31:12.062467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3dc04f61-7dba-407a-8363-98a15f69ecd2 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:12.063474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3dc04f61-7dba-407a-8363-98a15f69ecd2 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:12.072684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dc04f61-7dba-407a-8363-98a15f69ecd2 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:12.073400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dc04f61-7dba-407a-8363-98a15f69ecd2 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:12.073975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dc04f61-7dba-407a-8363-98a15f69ecd2 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:12.079398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dc04f61-7dba-407a-8363-98a15f69ecd2 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:12.080136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dc04f61-7dba-407a-8363-98a15f69ecd2 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:12.080865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dc04f61-7dba-407a-8363-98a15f69ecd2 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:12.411352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3dc04f61-7dba-407a-8363-98a15f69ecd2 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:12.425298 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3dc04f61-7dba-407a-8363-98a15f69ecd2 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1494 microversion: 2.1 time: 0.373641 Aug 09 14:31:12.426645 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 89/179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:12 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1494 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:12.438507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ae8b58f-10b2-406f-9f3c-1ed95dffb732 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:12.439205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ae8b58f-10b2-406f-9f3c-1ed95dffb732 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:12.453459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ae8b58f-10b2-406f-9f3c-1ed95dffb732 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:12.454110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ae8b58f-10b2-406f-9f3c-1ed95dffb732 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:12.454392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ae8b58f-10b2-406f-9f3c-1ed95dffb732 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:12.455139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ae8b58f-10b2-406f-9f3c-1ed95dffb732 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:12.455603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ae8b58f-10b2-406f-9f3c-1ed95dffb732 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:12.456019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ae8b58f-10b2-406f-9f3c-1ed95dffb732 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:12.765043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:31:12.766031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:31:12.766711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:31:12.767846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:31:12.768447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:31:12.788133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:12.788952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:12.789830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:12.790774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:12.791456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:12.792056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:12.822400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Getting quotas for project fb69ef1d43a24edcbbc99882cbf52f5b. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:31:12.828635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Getting quotas for user 3e3b1bc0133f4e848eeccd53e141f6d2 and project fb69ef1d43a24edcbbc99882cbf52f5b. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:31:12.845440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:31:12.851255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:31:13.027874 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3763a34a-92b3-4080-af02-4f567d5f1266 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.269251 Aug 09 14:31:13.038143 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 91/180] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:31:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:31:13.056393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d8255ba-994e-489d-bba6-9adc57646737 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:13.078908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ae8b58f-10b2-406f-9f3c-1ed95dffb732 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:13.089495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d8255ba-994e-489d-bba6-9adc57646737 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:13.098431 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ae8b58f-10b2-406f-9f3c-1ed95dffb732 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1479 microversion: 2.1 time: 0.670380 Aug 09 14:31:13.103418 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 90/181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:12 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1479 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:13.246000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0d8255ba-994e-489d-bba6-9adc57646737 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:13.278245 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d8255ba-994e-489d-bba6-9adc57646737 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1219 microversion: 2.1 time: 0.232043 Aug 09 14:31:13.284769 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 92/182] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:13 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1219 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:13.453728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0409b745-eaf7-4b52-a2bf-7cdaef5fef06 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:13.456712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0409b745-eaf7-4b52-a2bf-7cdaef5fef06 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:13.477770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0409b745-eaf7-4b52-a2bf-7cdaef5fef06 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:13.484807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0409b745-eaf7-4b52-a2bf-7cdaef5fef06 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:13.486977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0409b745-eaf7-4b52-a2bf-7cdaef5fef06 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:13.488719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0409b745-eaf7-4b52-a2bf-7cdaef5fef06 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:13.491632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0409b745-eaf7-4b52-a2bf-7cdaef5fef06 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:13.493242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0409b745-eaf7-4b52-a2bf-7cdaef5fef06 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:13.868543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0409b745-eaf7-4b52-a2bf-7cdaef5fef06 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4383fb5b774f569258d463e090a89a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36c69ad6412d4e4581eee19d03c6baef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:13.890371 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0409b745-eaf7-4b52-a2bf-7cdaef5fef06 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 200 len: 1452 microversion: 2.1 time: 0.442526 Aug 09 14:31:13.895417 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 91/183] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:13 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 1452 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:13.911663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3c39334f-4a70-45b2-adf1-85614e011d5c req-e0a0860c-85d2-47b5-b808-a4274ccc6a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f8ce37a-525d-4ad6-b09a-505ed3e418ce", "name": "network-vif-deleted", "tag": "db7c3e7e-c5dc-4613-bc9f-4fb4332d9cbb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:13.959504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3c39334f-4a70-45b2-adf1-85614e011d5c req-e0a0860c-85d2-47b5-b808-a4274ccc6a7b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:13.965005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3c39334f-4a70-45b2-adf1-85614e011d5c req-e0a0860c-85d2-47b5-b808-a4274ccc6a7b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:13.965600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3c39334f-4a70-45b2-adf1-85614e011d5c req-e0a0860c-85d2-47b5-b808-a4274ccc6a7b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:14.033601 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3c39334f-4a70-45b2-adf1-85614e011d5c req-e0a0860c-85d2-47b5-b808-a4274ccc6a7b service nova] Creating event network-vif-deleted:db7c3e7e-c5dc-4613-bc9f-4fb4332d9cbb for instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce on n-h1-844626-8 Aug 09 14:31:14.048013 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3c39334f-4a70-45b2-adf1-85614e011d5c req-e0a0860c-85d2-47b5-b808-a4274ccc6a7b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143023 Aug 09 14:31:14.050238 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 92/184] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:14.073062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1216879825", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "9b1e0849-062e-48c7-aa5b-09f3ae58e299"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:14.125972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b3a3951a-051b-4858-ba55-bddabcdbc23a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:14.127268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b3a3951a-051b-4858-ba55-bddabcdbc23a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:14.141285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3a3951a-051b-4858-ba55-bddabcdbc23a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:14.141893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3a3951a-051b-4858-ba55-bddabcdbc23a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:14.143651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3a3951a-051b-4858-ba55-bddabcdbc23a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:14.145117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3a3951a-051b-4858-ba55-bddabcdbc23a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:14.147009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3a3951a-051b-4858-ba55-bddabcdbc23a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:14.149812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3a3951a-051b-4858-ba55-bddabcdbc23a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:14.182814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] validate_networks() for [('9b1e0849-062e-48c7-aa5b-09f3ae58e299', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:31:14.201814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:14.834944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=16 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:14.858193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b3a3951a-051b-4858-ba55-bddabcdbc23a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:14.869071 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b3a3951a-051b-4858-ba55-bddabcdbc23a tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1479 microversion: 2.1 time: 0.748822 Aug 09 14:31:14.869691 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 93/185] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:14 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1479 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:31:14.888163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85871ce0-9bae-4f2b-b5e0-320c85cc351d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:14.889270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85871ce0-9bae-4f2b-b5e0-320c85cc351d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:14.898825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85871ce0-9bae-4f2b-b5e0-320c85cc351d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:14.900116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85871ce0-9bae-4f2b-b5e0-320c85cc351d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:14.900727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85871ce0-9bae-4f2b-b5e0-320c85cc351d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:14.901626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85871ce0-9bae-4f2b-b5e0-320c85cc351d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:14.902564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85871ce0-9bae-4f2b-b5e0-320c85cc351d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:14.904055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85871ce0-9bae-4f2b-b5e0-320c85cc351d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:15.067219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-85871ce0-9bae-4f2b-b5e0-320c85cc351d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:15.089178 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85871ce0-9bae-4f2b-b5e0-320c85cc351d tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1271 microversion: 2.1 time: 0.217813 Aug 09 14:31:15.090156 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 94/186] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:14 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:15.132510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-582167ec-c258-43c2-ad6a-abaa1bbccae5 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:15.137493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-582167ec-c258-43c2-ad6a-abaa1bbccae5 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:15.148510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-582167ec-c258-43c2-ad6a-abaa1bbccae5 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:15.150245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-582167ec-c258-43c2-ad6a-abaa1bbccae5 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:15.151271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-582167ec-c258-43c2-ad6a-abaa1bbccae5 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:15.154552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-582167ec-c258-43c2-ad6a-abaa1bbccae5 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:15.155068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-582167ec-c258-43c2-ad6a-abaa1bbccae5 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:15.156738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-582167ec-c258-43c2-ad6a-abaa1bbccae5 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:15.229703 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-582167ec-c258-43c2-ad6a-abaa1bbccae5 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] HTTP exception thrown: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-582167ec-c258-43c2-ad6a-abaa1bbccae5 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Request method failure captured: Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce HTTP/1.1 Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m9_3NQqCBgAf_-8CH-ZESf4nnCmq5nO_dfxYp3hEob9wDEgccEEbf7C8dv-mEWc-u9hiLsSCxWGF9-ltus4OWA5rkxhAcfnwZQt85OizAl7cQ6WOVImhwOq0ZohQrfJSkjDQVdRMvmO5eaDSCbdYP31dzH1QTs_CQMj4Z1nRELUBkE Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 36c69ad6412d4e4581eee19d03c6baef Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AggregatesAdminTestJSON-1732197079 Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:31:15.239820 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:31:15.241349 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_36c69ad6412d4e4581eee19d03c6baef", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/36c69ad6412d4e4581eee19d03c6baef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36c69ad6412d4e4581eee19d03c6baef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36c69ad6412d4e4581eee19d03c6baef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:15.241349 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AggregatesAdminTestJSON-1732197079 Aug 09 14:31:15.241349 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 36c69ad6412d4e4581eee19d03c6baef Aug 09 14:31:15.241349 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1732197079 Aug 09 14:31:15.241349 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AggregatesAdminTestJSON-1732197079-project Aug 09 14:31:15.241349 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:15.241349 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:15.241349 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 2a4383fb5b774f569258d463e090a89a Aug 09 14:31:15.241349 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AggregatesAdminTestJSON-1732197079-project Aug 09 14:31:15.241349 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:15.241349 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:15.241349 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '4f8ce37a-525d-4ad6-b09a-505ed3e418ce'} Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:15.242112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:15.243316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:15.244416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-582167ec-c258-43c2-ad6a-abaa1bbccae5 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Returning 404 to user: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:15.248451 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-582167ec-c258-43c2-ad6a-abaa1bbccae5 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 404 len: 111 microversion: 2.1 time: 0.152800 Aug 09 14:31:15.254855 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 95/187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:15 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:15.260690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bb49925c-9479-4bbd-b2f6-32ba81b6a2ab tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-844626-8"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:15.282582 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:15.282582 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:15.325478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb49925c-9479-4bbd-b2f6-32ba81b6a2ab tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:15.334554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb49925c-9479-4bbd-b2f6-32ba81b6a2ab tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:15.335039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb49925c-9479-4bbd-b2f6-32ba81b6a2ab tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:15.950357 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bb49925c-9479-4bbd-b2f6-32ba81b6a2ab tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 296 microversion: 2.1 time: 0.693783 Aug 09 14:31:15.951644 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 96/188] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 9 14:31:15 2022] POST /compute/v2.1/os-aggregates/1/action => generated 296 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:15.971260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e54b4be-bc95-4450-bcbe-bb1cf84c8910 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:15.972681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9e54b4be-bc95-4450-bcbe-bb1cf84c8910 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:15.985464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e54b4be-bc95-4450-bcbe-bb1cf84c8910 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:15.985951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e54b4be-bc95-4450-bcbe-bb1cf84c8910 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:15.986382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e54b4be-bc95-4450-bcbe-bb1cf84c8910 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:15.987076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e54b4be-bc95-4450-bcbe-bb1cf84c8910 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:15.987539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e54b4be-bc95-4450-bcbe-bb1cf84c8910 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:15.987946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e54b4be-bc95-4450-bcbe-bb1cf84c8910 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:16.171163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9e54b4be-bc95-4450-bcbe-bb1cf84c8910 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:16.182274 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e54b4be-bc95-4450-bcbe-bb1cf84c8910 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1437 microversion: 2.1 time: 0.228835 Aug 09 14:31:16.183430 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 97/189] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:15 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1437 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:16.198726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82b48498-a7a3-40f8-8301-8e9607710738 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:16.203988 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:16.203988 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:16.254954 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82b48498-a7a3-40f8-8301-8e9607710738 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.067585 Aug 09 14:31:16.256129 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 98/190] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:16 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:16.272227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ce40b01-9d31-430a-9dcc-5c843fab56b9 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:16.285785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:31:16.286595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ce40b01-9d31-430a-9dcc-5c843fab56b9 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:16.287710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:31:16.288691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:31:16.289368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:31:16.290186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:31:16.303699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:16.304649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ce40b01-9d31-430a-9dcc-5c843fab56b9 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:16.304948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:16.306523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ce40b01-9d31-430a-9dcc-5c843fab56b9 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:16.307723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:16.308921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:16.309803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:16.309959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ce40b01-9d31-430a-9dcc-5c843fab56b9 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:16.310683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:16.311599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ce40b01-9d31-430a-9dcc-5c843fab56b9 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:16.313044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ce40b01-9d31-430a-9dcc-5c843fab56b9 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:16.315067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ce40b01-9d31-430a-9dcc-5c843fab56b9 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:16.377280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Getting quotas for project a1bf318922fb4676a19a51a39580948a. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:31:16.388441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Getting quotas for user 56df13a960424540b4540a50696dfd2d and project a1bf318922fb4676a19a51a39580948a. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:31:16.446970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:31:16.450404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:31:16.579198 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-261adf62-812f-4d23-a269-a8e9dd9fb7b8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.822793 Aug 09 14:31:16.580470 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 93/191] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:31:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:31:16.603302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f847fb7b-fc69-447a-8a82-4f145027d430 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1843663798"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:16.608768 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:16.608768 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:16.615847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-f847fb7b-fc69-447a-8a82-4f145027d430 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Generated uuid 1c113680-2120-4494-a093-1c2cca4eba79 for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:16.719240 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f847fb7b-fc69-447a-8a82-4f145027d430 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.137275 Aug 09 14:31:16.725384 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 94/192] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:16.759504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-954e7670-225f-449f-9e8b-94e4ac7d743c req-ddbee982-40ce-4ecf-9d5c-95e3c661a7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc68a48f-2a87-414d-97c1-48fcf18e53cd", "name": "network-vif-deleted", "tag": "0f355a3a-b917-40d9-9e88-ffb0aa86375d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:16.783432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-954e7670-225f-449f-9e8b-94e4ac7d743c req-ddbee982-40ce-4ecf-9d5c-95e3c661a7f3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:16.790273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-954e7670-225f-449f-9e8b-94e4ac7d743c req-ddbee982-40ce-4ecf-9d5c-95e3c661a7f3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:16.790953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-954e7670-225f-449f-9e8b-94e4ac7d743c req-ddbee982-40ce-4ecf-9d5c-95e3c661a7f3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:16.818216 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-954e7670-225f-449f-9e8b-94e4ac7d743c req-ddbee982-40ce-4ecf-9d5c-95e3c661a7f3 service nova] Creating event network-vif-deleted:0f355a3a-b917-40d9-9e88-ffb0aa86375d for instance cc68a48f-2a87-414d-97c1-48fcf18e53cd on n-h2-844626-8 Aug 09 14:31:16.835030 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-954e7670-225f-449f-9e8b-94e4ac7d743c req-ddbee982-40ce-4ecf-9d5c-95e3c661a7f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104818 Aug 09 14:31:16.838277 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 95/193] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:16.839713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ce40b01-9d31-430a-9dcc-5c843fab56b9 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:16.845955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b019c477-4b03-4985-80c2-1b21b4231f92 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:16.851750 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ce40b01-9d31-430a-9dcc-5c843fab56b9 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1277 microversion: 2.1 time: 0.593563 Aug 09 14:31:16.858113 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:16.858113 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:16.868440 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 99/194] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:16 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1277 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:16.874041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b019c477-4b03-4985-80c2-1b21b4231f92 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:16.874519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b019c477-4b03-4985-80c2-1b21b4231f92 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:16.874946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b019c477-4b03-4985-80c2-1b21b4231f92 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:16.888973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-97393457", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "9b1e0849-062e-48c7-aa5b-09f3ae58e299"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:16.976321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] validate_networks() for [('9b1e0849-062e-48c7-aa5b-09f3ae58e299', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:31:17.201966 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b019c477-4b03-4985-80c2-1b21b4231f92 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.359838 Aug 09 14:31:17.205238 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 96/195] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 9 14:31:16 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:17.223133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:17.225447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:17.252007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:17.258017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:17.258552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:17.263562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:17.266421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:17.267506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:17.373797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:17.374963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:17.378060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:17.378737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lazy-loading 'fault' on Instance uuid cc68a48f-2a87-414d-97c1-48fcf18e53cd {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:31:17.573519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dac1d91c48541e194c85de174ad3011', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445967d49e9e4267b0a741861f3ea634', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:17.581349 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b29bc399-12ce-4eca-8116-42b211ad38e6 tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 200 len: 1313 microversion: 2.1 time: 0.374536 Aug 09 14:31:17.583621 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 97/196] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:17 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:17.609106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-922e6be0-4f6b-4c97-9b57-d91bff1a4f32 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:17.610269 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:17.610269 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:17.624385 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-922e6be0-4f6b-4c97-9b57-d91bff1a4f32 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.039559 Aug 09 14:31:17.627633 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 98/197] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 9 14:31:17 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:17.639632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b8d64ab-1817-49ed-91f9-2855c1f77060 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:17.649003 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:17.649003 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:17.685421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b8d64ab-1817-49ed-91f9-2855c1f77060 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:17.687619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b8d64ab-1817-49ed-91f9-2855c1f77060 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:17.705222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b8d64ab-1817-49ed-91f9-2855c1f77060 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:17.918204 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b8d64ab-1817-49ed-91f9-2855c1f77060 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.283335 Aug 09 14:31:17.920360 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 99/198] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 9 14:31:17 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:31:17.926474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31cce236-d650-4515-8458-7b5a15ac8b9a tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:17.928325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31cce236-d650-4515-8458-7b5a15ac8b9a tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:17.936430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31cce236-d650-4515-8458-7b5a15ac8b9a tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:17.937053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31cce236-d650-4515-8458-7b5a15ac8b9a tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:17.937581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31cce236-d650-4515-8458-7b5a15ac8b9a tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:17.938385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31cce236-d650-4515-8458-7b5a15ac8b9a tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:17.938948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31cce236-d650-4515-8458-7b5a15ac8b9a tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:17.939639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31cce236-d650-4515-8458-7b5a15ac8b9a tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:18.235433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-31cce236-d650-4515-8458-7b5a15ac8b9a tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:18.244458 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31cce236-d650-4515-8458-7b5a15ac8b9a tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1277 microversion: 2.1 time: 0.322681 Aug 09 14:31:18.267006 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 100/199] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:17 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1277 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:18.280405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d349c7bd-2e89-48b0-babb-fbc8b6a89c63 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:18.282820 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:18.282820 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:18.357225 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d349c7bd-2e89-48b0-babb-fbc8b6a89c63 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.087578 Aug 09 14:31:18.357858 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 101/200] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:18 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:18.368347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4df3735-7f0f-48bb-a310-23497eb76268 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1608495858"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:18.374563 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:18.374563 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:18.376206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-a4df3735-7f0f-48bb-a310-23497eb76268 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Generated uuid 6899c4c0-a8f9-4603-9164-d146cdb7c92e for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:18.400465 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4df3735-7f0f-48bb-a310-23497eb76268 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.035693 Aug 09 14:31:18.401653 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 102/201] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:18.427265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0898e3ff-c3a1-451b-ae03-693f8cad16c2 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:18.443589 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:18.443589 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:18.460885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:18.471216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0898e3ff-c3a1-451b-ae03-693f8cad16c2 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:18.471874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0898e3ff-c3a1-451b-ae03-693f8cad16c2 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:18.472460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0898e3ff-c3a1-451b-ae03-693f8cad16c2 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:18.816718 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0898e3ff-c3a1-451b-ae03-693f8cad16c2 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.392542 Aug 09 14:31:18.817981 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 103/202] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 9 14:31:18 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:18.831235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8dc65014-0992-4a6e-932a-810b7a2f1a7d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:18.832103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8dc65014-0992-4a6e-932a-810b7a2f1a7d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] [instance: cc68a48f-2a87-414d-97c1-48fcf18e53cd] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:18.840298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dc65014-0992-4a6e-932a-810b7a2f1a7d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:18.841041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dc65014-0992-4a6e-932a-810b7a2f1a7d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:18.841661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dc65014-0992-4a6e-932a-810b7a2f1a7d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:18.842736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dc65014-0992-4a6e-932a-810b7a2f1a7d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:18.843923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dc65014-0992-4a6e-932a-810b7a2f1a7d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:18.844656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dc65014-0992-4a6e-932a-810b7a2f1a7d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:18.881687 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-8dc65014-0992-4a6e-932a-810b7a2f1a7d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] HTTP exception thrown: Instance cc68a48f-2a87-414d-97c1-48fcf18e53cd could not be found. Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8dc65014-0992-4a6e-932a-810b7a2f1a7d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Request method failure captured: Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd HTTP/1.1 Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-YQQyd21uTrb9-a2QjbHYQdwIZ-mRC5FpwUMXWAFHXQSIIyabwn14YWe2TDUebnkfmrggEBxM4l6XAi0REfNM0H8xQIIfqK5IHUhbkde2lcIGxbYW19rPuWdkfrfeE-6b4XkHZS3dK0w53K0xyl5HDnMVCY0qeaE0qwSrQ-E9ap1k Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 445967d49e9e4267b0a741861f3ea634 Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-487107141 Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:18.888478 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:18.890054 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_445967d49e9e4267b0a741861f3ea634", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/445967d49e9e4267b0a741861f3ea634"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/445967d49e9e4267b0a741861f3ea634"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/445967d49e9e4267b0a741861f3ea634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:18.890054 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-487107141 Aug 09 14:31:18.890054 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 445967d49e9e4267b0a741861f3ea634 Aug 09 14:31:18.890054 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-487107141 Aug 09 14:31:18.890054 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerDiagnosticsNegativeTest-487107141-project Aug 09 14:31:18.890054 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:18.890054 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:18.890054 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 7dac1d91c48541e194c85de174ad3011 Aug 09 14:31:18.890054 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-487107141-project Aug 09 14:31:18.890054 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:18.890054 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance cc68a48f-2a87-414d-97c1-48fcf18e53cd could not be found. Aug 09 14:31:18.890054 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'cc68a48f-2a87-414d-97c1-48fcf18e53cd'} Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc68a48f-2a87-414d-97c1-48fcf18e53cd could not be found. Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:18.890915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc68a48f-2a87-414d-97c1-48fcf18e53cd could not be found. Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc68a48f-2a87-414d-97c1-48fcf18e53cd could not be found. Aug 09 14:31:18.892471 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:18.895246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8dc65014-0992-4a6e-932a-810b7a2f1a7d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] Returning 404 to user: Instance cc68a48f-2a87-414d-97c1-48fcf18e53cd could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:18.896322 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8dc65014-0992-4a6e-932a-810b7a2f1a7d tempest-ServerDiagnosticsNegativeTest-487107141 tempest-ServerDiagnosticsNegativeTest-487107141-project] 10.222.0.50 "GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd" status: 404 len: 111 microversion: 2.1 time: 0.077175 Aug 09 14:31:18.897337 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 104/203] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:18 2022] GET /compute/v2.1/servers/cc68a48f-2a87-414d-97c1-48fcf18e53cd => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:18.928960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a985fbab-e4a1-45fc-868e-36a985fcfdf3 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:18.930831 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:18.930831 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:18.974349 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a985fbab-e4a1-45fc-868e-36a985fcfdf3 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.053922 Aug 09 14:31:18.975682 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 105/204] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:31:18 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:18.991272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2d6b9a0-4fe5-42c7-a8af-421b7f753314 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:19.000218 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:19.000218 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:19.014328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2d6b9a0-4fe5-42c7-a8af-421b7f753314 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:19.015340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2d6b9a0-4fe5-42c7-a8af-421b7f753314 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:19.016197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2d6b9a0-4fe5-42c7-a8af-421b7f753314 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:19.067339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:31:19.067929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:31:19.068221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:31:19.068702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:31:19.069248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:31:19.086791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:19.087561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:19.087998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:19.092332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:19.095199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:19.096370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:19.200777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:19.244623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Getting quotas for project a1bf318922fb4676a19a51a39580948a. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:31:19.261756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Getting quotas for user 56df13a960424540b4540a50696dfd2d and project a1bf318922fb4676a19a51a39580948a. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:31:19.298500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:31:19.310759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 9124e955-056d-4c19-baa2-dbbfdcad5058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:31:19.331892 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b2d6b9a0-4fe5-42c7-a8af-421b7f753314 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.348269 Aug 09 14:31:19.332539 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 106/205] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 9 14:31:18 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:19.341348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-64656713-e175-43f6-820d-3f5b46c7dcbf tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:19.341996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-64656713-e175-43f6-820d-3f5b46c7dcbf tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:19.371598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64656713-e175-43f6-820d-3f5b46c7dcbf tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:19.372121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64656713-e175-43f6-820d-3f5b46c7dcbf tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:19.372568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64656713-e175-43f6-820d-3f5b46c7dcbf tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:19.373411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64656713-e175-43f6-820d-3f5b46c7dcbf tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:19.373766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64656713-e175-43f6-820d-3f5b46c7dcbf tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:19.374185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64656713-e175-43f6-820d-3f5b46c7dcbf tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:19.439946 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-01add0c9-ac95-4979-b837-70840d6073a0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.546427 Aug 09 14:31:19.441343 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 100/206] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:31:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:31:19.466450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b459df8-2589-492b-86bc-dfbeb852d160 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:19.469519 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:19.469519 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:19.521633 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5b459df8-2589-492b-86bc-dfbeb852d160 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.077370 Aug 09 14:31:19.524478 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 101/207] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:19 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:19.537772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-238d64db-cea5-4d45-af27-18aa1ff79da5 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-140120303"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:19.547146 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:19.547146 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:19.549992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.aggregate [None req-238d64db-cea5-4d45-af27-18aa1ff79da5 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Generated uuid ec455ff9-883b-47e4-876b-4c581ceb1064 for aggregate {{(pid=119407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:19.611654 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-238d64db-cea5-4d45-af27-18aa1ff79da5 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.080337 Aug 09 14:31:19.612273 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 102/208] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:19 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:19.629758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-313851d6-b31d-4f21-920f-c2dabeebe4be tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-844626-8"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:19.636859 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:19.636859 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:19.656563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-313851d6-b31d-4f21-920f-c2dabeebe4be tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:19.658340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-313851d6-b31d-4f21-920f-c2dabeebe4be tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:19.661766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-313851d6-b31d-4f21-920f-c2dabeebe4be tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:20.011997 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-313851d6-b31d-4f21-920f-c2dabeebe4be tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.391719 Aug 09 14:31:20.021644 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 103/209] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 9 14:31:19 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:31:20.030433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2111107160", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "451", "networks": [{"uuid": "9b1e0849-062e-48c7-aa5b-09f3ae58e299"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:20.198430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] validate_networks() for [('9b1e0849-062e-48c7-aa5b-09f3ae58e299', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:31:20.445320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-64656713-e175-43f6-820d-3f5b46c7dcbf tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:20.453704 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-64656713-e175-43f6-820d-3f5b46c7dcbf tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1319 microversion: 2.1 time: 1.120048 Aug 09 14:31:20.458978 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 107/210] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:19 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1319 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:20.471970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-635370f9-07ec-40c7-9e45-603aadb18fb4 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:20.485504 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:20.485504 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:20.503913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-635370f9-07ec-40c7-9e45-603aadb18fb4 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:20.505455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-635370f9-07ec-40c7-9e45-603aadb18fb4 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:20.506199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-635370f9-07ec-40c7-9e45-603aadb18fb4 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:20.695831 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-635370f9-07ec-40c7-9e45-603aadb18fb4 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.233471 Aug 09 14:31:20.704704 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 108/211] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 9 14:31:20 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:20.956581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-758780772", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "3fec08e6-958d-4908-98b5-60037a88730d"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:21.046852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] validate_networks() for [('3fec08e6-958d-4908-98b5-60037a88730d', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:31:22.661815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:31:22.662575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:31:22.663753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:31:22.664178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:31:22.664599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:31:22.681557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:22.682501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:22.684459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:22.685434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:22.688739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:22.689181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:22.719697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Getting quotas for project a1bf318922fb4676a19a51a39580948a. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:31:22.725399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Getting quotas for user 56df13a960424540b4540a50696dfd2d and project a1bf318922fb4676a19a51a39580948a. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:31:22.750011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:31:22.755837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:31:22.856046 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-43c5b353-96c8-431f-aa6b-4e690fbfa3fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.832831 Aug 09 14:31:22.857076 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 104/212] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:31:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:31:22.866561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a599e4d7-1d6e-4622-8b0f-1c12b92a8850 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:22.867412 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:22.867412 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:22.911756 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a599e4d7-1d6e-4622-8b0f-1c12b92a8850 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.053527 Aug 09 14:31:22.918312 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 105/213] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:22 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:22.927547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-fd7720c3-33c5-41e2-b499-417f0919d437 req-01a3c9ee-cda6-4662-bbd8-269847be3d74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c4fd60-05f3-4849-9278-267334ae8ce4", "tag": "e139787c-315b-43e9-8513-11c3d196300f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:22.949468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fd7720c3-33c5-41e2-b499-417f0919d437 req-01a3c9ee-cda6-4662-bbd8-269847be3d74 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:22.953180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fd7720c3-33c5-41e2-b499-417f0919d437 req-01a3c9ee-cda6-4662-bbd8-269847be3d74 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:22.953633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fd7720c3-33c5-41e2-b499-417f0919d437 req-01a3c9ee-cda6-4662-bbd8-269847be3d74 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:22.982237 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-fd7720c3-33c5-41e2-b499-417f0919d437 req-01a3c9ee-cda6-4662-bbd8-269847be3d74 service nova] Creating event network-changed:e139787c-315b-43e9-8513-11c3d196300f for instance e3c4fd60-05f3-4849-9278-267334ae8ce4 on n-h2-844626-8 Aug 09 14:31:22.995479 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-fd7720c3-33c5-41e2-b499-417f0919d437 req-01a3c9ee-cda6-4662-bbd8-269847be3d74 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080022 Aug 09 14:31:22.996139 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 106/214] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:23.005939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea00c160-f909-4de5-be0e-0d7b4e9e6fa5 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:23.008512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea00c160-f909-4de5-be0e-0d7b4e9e6fa5 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:23.028746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea00c160-f909-4de5-be0e-0d7b4e9e6fa5 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:23.029251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea00c160-f909-4de5-be0e-0d7b4e9e6fa5 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:23.029816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea00c160-f909-4de5-be0e-0d7b4e9e6fa5 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:23.030746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea00c160-f909-4de5-be0e-0d7b4e9e6fa5 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:23.037840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea00c160-f909-4de5-be0e-0d7b4e9e6fa5 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:23.039329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea00c160-f909-4de5-be0e-0d7b4e9e6fa5 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:23.296955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:31:23.297566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:31:23.298208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:31:23.298772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:31:23.299368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:31:23.324174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=27 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:23.335437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:23.336429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:23.339276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:23.341751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:23.343470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:23.347483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:23.370150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Getting quotas for project d512f92fc41c45edbd209ab51922e5d7. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:31:23.376469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Getting quotas for user 247d1747ce074adb8b1e56a459e8cd51 and project d512f92fc41c45edbd209ab51922e5d7. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:31:23.392188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:31:23.396571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:31:23.501340 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-41a3db9e-130c-4542-a89c-1d901e7b7f22 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.794998 Aug 09 14:31:23.507052 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 109/215] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:31:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2801 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 14:31:23.512816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c985319-2e54-46af-bb41-6970f8e907aa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:23.522458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c985319-2e54-46af-bb41-6970f8e907aa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:23.588642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ea00c160-f909-4de5-be0e-0d7b4e9e6fa5 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:23.613689 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea00c160-f909-4de5-be0e-0d7b4e9e6fa5 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1319 microversion: 2.1 time: 0.612539 Aug 09 14:31:23.617385 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 107/216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:22 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1319 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:23.638313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14e7e2ed-1be2-4346-85e4-a178415c9980 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1313514553"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:23.650799 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:23.650799 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:23.655230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.aggregate [None req-14e7e2ed-1be2-4346-85e4-a178415c9980 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Generated uuid 07bccc6f-43d0-485b-acd1-92079aea1a0b for aggregate {{(pid=119407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:23.716609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c985319-2e54-46af-bb41-6970f8e907aa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:23.726820 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c985319-2e54-46af-bb41-6970f8e907aa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1221 microversion: 2.1 time: 0.217820 Aug 09 14:31:23.730763 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 110/217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:23 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1221 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:23.748650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ca9d9bd-3441-4b4b-86ab-93b1b892060b tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-583395988"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:23.753283 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:23.753283 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:23.754498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-2ca9d9bd-3441-4b4b-86ab-93b1b892060b tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Generated uuid 03ebeeda-b7c0-45ee-b753-cd65a0b38fad for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:23.757125 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14e7e2ed-1be2-4346-85e4-a178415c9980 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.136869 Aug 09 14:31:23.761722 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 108/218] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:23.789256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a76f48be-1342-40fd-8142-726dbef256b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:23.794278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a76f48be-1342-40fd-8142-726dbef256b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:23.823843 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ca9d9bd-3441-4b4b-86ab-93b1b892060b tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.076271 Aug 09 14:31:23.826797 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 111/219] 10.222.0.50 () {62 vars in 1205 bytes} [Tue Aug 9 14:31:23 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:31:23.846079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1192ded8-01d4-40bf-ba04-7e0c35e77de4 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:23.847692 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:23.847692 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:23.885569 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1192ded8-01d4-40bf-ba04-7e0c35e77de4 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.044628 Aug 09 14:31:23.886523 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 112/220] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:23 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:23.892755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0efd9f1e-fd9c-4086-a9df-a55a8f301234 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1441150770"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:24.034684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a76f48be-1342-40fd-8142-726dbef256b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:24.047755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a76f48be-1342-40fd-8142-726dbef256b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:24.052759 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:24.052759 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:24.058602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a76f48be-1342-40fd-8142-726dbef256b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:24.063474 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a76f48be-1342-40fd-8142-726dbef256b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1261 microversion: 2.25 time: 0.300410 Aug 09 14:31:24.064257 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 109/221] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:23 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1261 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:24.068926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bfcbe196-70d9-4132-a7b7-5b5085757110 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:24.069709 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:24.069709 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:24.106702 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-bfcbe196-70d9-4132-a7b7-5b5085757110 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bfcbe196-70d9-4132-a7b7-5b5085757110 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Request method failure captured: Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-BRxPlfxJ1yjyCwtSjTJB5dfoC3CqKYYzaAaQXfX3N3Igf7lxuaSdxTf8Yx6P0lpCweXRQh9Q0VqhkQEFIyVAj7WYIJiBAtN7WxbkD3cEvQkPRcaQhyS2rd8nCwRjvTD75rloFh1s8Jlupx2s4FoDu3QFsnUqE5_eMx3AEcInRUr8 Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 52b1d60533844e2bb6e52e3f3671e668 Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AggregatesAdminTestJSON-630394532 Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:31:24.112696 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_52b1d60533844e2bb6e52e3f3671e668", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/52b1d60533844e2bb6e52e3f3671e668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/52b1d60533844e2bb6e52e3f3671e668"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/52b1d60533844e2bb6e52e3f3671e668"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AggregatesAdminTestJSON-630394532 Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 52b1d60533844e2bb6e52e3f3671e668 Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-630394532 Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AggregatesAdminTestJSON-630394532-project-admin Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 503e0e62e672443fa3275b14d4a745fa Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AggregatesAdminTestJSON-630394532-project-admin Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: exception: Aggregate 5 could not be found. Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '5'} Aug 09 14:31:24.114107 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6430, in get_aggregate Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:24.114932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.116182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bfcbe196-70d9-4132-a7b7-5b5085757110 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:24.117304 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bfcbe196-70d9-4132-a7b7-5b5085757110 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.048667 Aug 09 14:31:24.117304 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 110/222] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 9 14:31:24 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:31:24.128521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72439ff0-1816-4640-8a60-222b80236a82 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:24.141716 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:24.141716 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:24.161485 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0efd9f1e-fd9c-4086-a9df-a55a8f301234 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.269452 Aug 09 14:31:24.164588 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 113/223] 10.222.0.50 () {62 vars in 1210 bytes} [Tue Aug 9 14:31:23 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:31:24.172634 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-72439ff0-1816-4640-8a60-222b80236a82 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72439ff0-1816-4640-8a60-222b80236a82 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Request method failure captured: Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-BRxPlfxJ1yjyCwtSjTJB5dfoC3CqKYYzaAaQXfX3N3Igf7lxuaSdxTf8Yx6P0lpCweXRQh9Q0VqhkQEFIyVAj7WYIJiBAtN7WxbkD3cEvQkPRcaQhyS2rd8nCwRjvTD75rloFh1s8Jlupx2s4FoDu3QFsnUqE5_eMx3AEcInRUr8 Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 52b1d60533844e2bb6e52e3f3671e668 Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AggregatesAdminTestJSON-630394532 Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:31:24.174315 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_52b1d60533844e2bb6e52e3f3671e668", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/52b1d60533844e2bb6e52e3f3671e668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/52b1d60533844e2bb6e52e3f3671e668"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/52b1d60533844e2bb6e52e3f3671e668"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AggregatesAdminTestJSON-630394532 Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 52b1d60533844e2bb6e52e3f3671e668 Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-630394532 Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AggregatesAdminTestJSON-630394532-project-admin Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 503e0e62e672443fa3275b14d4a745fa Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AggregatesAdminTestJSON-630394532-project-admin Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: exception: Aggregate 5 could not be found. Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '5'} Aug 09 14:31:24.175656 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6483, in delete_aggregate Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:31:24.176385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:24.177486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:24.181285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:24.181285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:24.181285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:24.181285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 09 14:31:24.181285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.181285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72439ff0-1816-4640-8a60-222b80236a82 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:24.181285 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72439ff0-1816-4640-8a60-222b80236a82 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.052796 Aug 09 14:31:24.181706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9728b330-495c-42f4-9813-3810b298b2ce tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:24.181782 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 111/224] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:24 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:31:24.181848 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:24.181848 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:24.185777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2940ea6f-2c0a-4b61-8a19-ace614307afd tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1155010244", "name": "tempest-test_aggregate-1691800194"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:24.198038 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9728b330-495c-42f4-9813-3810b298b2ce tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.026308 Aug 09 14:31:24.213053 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 114/225] 10.222.0.50 () {60 vars in 1190 bytes} [Tue Aug 9 14:31:24 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:31:24.218549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f011f2c0-8949-4eda-9b01-cd02f70d8a01 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:24.221557 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:24.221557 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:24.222734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.aggregate [None req-2940ea6f-2c0a-4b61-8a19-ace614307afd tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Generated uuid 0367457d-36fb-4d70-ac2e-12e3b341c858 for aggregate {{(pid=119407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:24.227876 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:24.227876 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:24.242609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f011f2c0-8949-4eda-9b01-cd02f70d8a01 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:24.252039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f011f2c0-8949-4eda-9b01-cd02f70d8a01 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:24.252629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f011f2c0-8949-4eda-9b01-cd02f70d8a01 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:24.296968 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2940ea6f-2c0a-4b61-8a19-ace614307afd tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.114656 Aug 09 14:31:24.298361 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 112/226] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Aug 9 14:31:24 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:24.340030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6fa194e7-23aa-4e46-991c-52d391305264 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:24.341407 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:24.341407 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:24.406250 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6fa194e7-23aa-4e46-991c-52d391305264 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.100527 Aug 09 14:31:24.410716 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 113/227] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:24 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:24.425721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ac34053-f186-43f7-b54f-8053b8668848 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:24.431388 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:24.431388 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:24.444805 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-2ac34053-f186-43f7-b54f-8053b8668848 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ac34053-f186-43f7-b54f-8053b8668848 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Request method failure captured: Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-BRxPlfxJ1yjyCwtSjTJB5dfoC3CqKYYzaAaQXfX3N3Igf7lxuaSdxTf8Yx6P0lpCweXRQh9Q0VqhkQEFIyVAj7WYIJiBAtN7WxbkD3cEvQkPRcaQhyS2rd8nCwRjvTD75rloFh1s8Jlupx2s4FoDu3QFsnUqE5_eMx3AEcInRUr8 Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 52b1d60533844e2bb6e52e3f3671e668 Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AggregatesAdminTestJSON-630394532 Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:31:24.448696 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_52b1d60533844e2bb6e52e3f3671e668", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/52b1d60533844e2bb6e52e3f3671e668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/52b1d60533844e2bb6e52e3f3671e668"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/52b1d60533844e2bb6e52e3f3671e668"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AggregatesAdminTestJSON-630394532 Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 52b1d60533844e2bb6e52e3f3671e668 Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-630394532 Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AggregatesAdminTestJSON-630394532-project-admin Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 503e0e62e672443fa3275b14d4a745fa Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AggregatesAdminTestJSON-630394532-project-admin Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: exception: Aggregate 7 could not be found. Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '7'} Aug 09 14:31:24.449900 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6430, in get_aggregate Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:24.450776 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 09 14:31:24.453289 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.462129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ac34053-f186-43f7-b54f-8053b8668848 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:24.463004 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ac34053-f186-43f7-b54f-8053b8668848 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.050972 Aug 09 14:31:24.471999 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 114/228] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 9 14:31:24 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:31:24.488573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efae2b79-8bef-4841-b647-fe0183881fb3 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:24.490135 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:24.490135 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:24.554321 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-efae2b79-8bef-4841-b647-fe0183881fb3 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efae2b79-8bef-4841-b647-fe0183881fb3 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Request method failure captured: Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-BRxPlfxJ1yjyCwtSjTJB5dfoC3CqKYYzaAaQXfX3N3Igf7lxuaSdxTf8Yx6P0lpCweXRQh9Q0VqhkQEFIyVAj7WYIJiBAtN7WxbkD3cEvQkPRcaQhyS2rd8nCwRjvTD75rloFh1s8Jlupx2s4FoDu3QFsnUqE5_eMx3AEcInRUr8 Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 52b1d60533844e2bb6e52e3f3671e668 Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AggregatesAdminTestJSON-630394532 Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:31:24.574330 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_52b1d60533844e2bb6e52e3f3671e668", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/52b1d60533844e2bb6e52e3f3671e668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/52b1d60533844e2bb6e52e3f3671e668"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/52b1d60533844e2bb6e52e3f3671e668"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AggregatesAdminTestJSON-630394532 Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 52b1d60533844e2bb6e52e3f3671e668 Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-630394532 Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AggregatesAdminTestJSON-630394532-project-admin Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 503e0e62e672443fa3275b14d4a745fa Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AggregatesAdminTestJSON-630394532-project-admin Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: exception: Aggregate 7 could not be found. Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '7'} Aug 09 14:31:24.575859 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6483, in delete_aggregate Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:31:24.576590 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:24.577771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:24.579137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:24.579137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:24.579137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:24.579137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 09 14:31:24.579137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:24.579490 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f011f2c0-8949-4eda-9b01-cd02f70d8a01 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.361314 Aug 09 14:31:24.579490 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 115/229] 10.222.0.50 () {62 vars in 1232 bytes} [Tue Aug 9 14:31:24 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 14:31:24.582704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efae2b79-8bef-4841-b647-fe0183881fb3 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:24.585013 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-efae2b79-8bef-4841-b647-fe0183881fb3 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.107650 Aug 09 14:31:24.587554 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 115/230] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:24 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:31:24.590356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0877dfa4-7b2c-4845-823a-4abb20607445 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:24.593720 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:24.593720 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:24.604360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0877dfa4-7b2c-4845-823a-4abb20607445 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:24.604963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0877dfa4-7b2c-4845-823a-4abb20607445 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:24.605581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0877dfa4-7b2c-4845-823a-4abb20607445 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:24.621831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23a6aff6-4c10-4e7a-8d5e-99368b7e62b3 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1314517798"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:24.626493 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:24.626493 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:24.628677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.aggregate [None req-23a6aff6-4c10-4e7a-8d5e-99368b7e62b3 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Generated uuid 8fc7a6bd-6e46-410f-b44b-f465d98647bf for aggregate {{(pid=119407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:24.704766 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23a6aff6-4c10-4e7a-8d5e-99368b7e62b3 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.107574 Aug 09 14:31:24.708953 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 116/231] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:24.720111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b00da332-d810-4568-bd33-957321155855 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:24.724063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b00da332-d810-4568-bd33-957321155855 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:24.740072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b00da332-d810-4568-bd33-957321155855 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:24.741716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b00da332-d810-4568-bd33-957321155855 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:24.742479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b00da332-d810-4568-bd33-957321155855 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:24.749155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b00da332-d810-4568-bd33-957321155855 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:24.751947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b00da332-d810-4568-bd33-957321155855 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:24.754171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b00da332-d810-4568-bd33-957321155855 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:24.909161 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0877dfa4-7b2c-4845-823a-4abb20607445 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.322663 Aug 09 14:31:24.918739 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 116/232] 10.222.0.50 () {62 vars in 1232 bytes} [Tue Aug 9 14:31:24 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 14:31:24.940078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c8d92d7f-2a69-4a5d-8281-001f319a408d tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:24.940882 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:24.940882 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:24.961179 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c8d92d7f-2a69-4a5d-8281-001f319a408d tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.040826 Aug 09 14:31:24.967127 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 117/233] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 9 14:31:24 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:24.977562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8f53609-db21-434e-abbc-a4a425bfce15 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:24.978449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b8f53609-db21-434e-abbc-a4a425bfce15 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:24.994330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8f53609-db21-434e-abbc-a4a425bfce15 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:24.997193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8f53609-db21-434e-abbc-a4a425bfce15 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:24.997861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8f53609-db21-434e-abbc-a4a425bfce15 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:24.999965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8f53609-db21-434e-abbc-a4a425bfce15 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:25.001810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8f53609-db21-434e-abbc-a4a425bfce15 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:25.003756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8f53609-db21-434e-abbc-a4a425bfce15 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:25.308943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8f53609-db21-434e-abbc-a4a425bfce15 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:25.320017 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8f53609-db21-434e-abbc-a4a425bfce15 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1291 microversion: 2.1 time: 0.349655 Aug 09 14:31:25.321367 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 118/234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:24 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1291 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:25.327117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f94814e-e634-4b3c-9503-908a73a21f35 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:25.329523 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:25.329523 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:25.416782 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f94814e-e634-4b3c-9503-908a73a21f35 tempest-AggregatesAdminTestV241-1623300761 tempest-AggregatesAdminTestV241-1623300761-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.092063 Aug 09 14:31:25.419361 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 119/235] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 9 14:31:25 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:25.462075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-214e83c2-37f2-42fc-bac1-3113e4db94d0 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:25.469396 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:25.469396 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:25.476506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b00da332-d810-4568-bd33-957321155855 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:25.486584 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b00da332-d810-4568-bd33-957321155855 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1319 microversion: 2.1 time: 0.775594 Aug 09 14:31:25.498619 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 117/236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:24 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1319 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:25.512059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7535e8f9-1cd6-423b-b39e-4f21501b735c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:25.513029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7535e8f9-1cd6-423b-b39e-4f21501b735c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:25.530318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7535e8f9-1cd6-423b-b39e-4f21501b735c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:25.531195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7535e8f9-1cd6-423b-b39e-4f21501b735c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:25.531862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7535e8f9-1cd6-423b-b39e-4f21501b735c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:25.532794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7535e8f9-1cd6-423b-b39e-4f21501b735c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:25.533440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7535e8f9-1cd6-423b-b39e-4f21501b735c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:25.534102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7535e8f9-1cd6-423b-b39e-4f21501b735c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:25.595994 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-214e83c2-37f2-42fc-bac1-3113e4db94d0 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.172903 Aug 09 14:31:25.597759 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 120/237] 10.222.0.50 () {60 vars in 1191 bytes} [Tue Aug 9 14:31:25 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:25.624091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f44fc020-5f2c-4cce-8fb6-6e898edadc2d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Calling method '.version_select at 0x7f41e534d670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:25.628775 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:25.628775 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:25.630643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f44fc020-5f2c-4cce-8fb6-6e898edadc2d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:25.631498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f44fc020-5f2c-4cce-8fb6-6e898edadc2d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:25.632133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f44fc020-5f2c-4cce-8fb6-6e898edadc2d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:25.633602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f44fc020-5f2c-4cce-8fb6-6e898edadc2d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:25.634394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f44fc020-5f2c-4cce-8fb6-6e898edadc2d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:25.636215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f44fc020-5f2c-4cce-8fb6-6e898edadc2d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:25.713587 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f44fc020-5f2c-4cce-8fb6-6e898edadc2d tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.102069 Aug 09 14:31:25.714356 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 121/238] 10.222.0.50 () {58 vars in 1128 bytes} [Tue Aug 9 14:31:25 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:25.728027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3cad824e-6622-48f3-86a5-abe7a20391dc tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:25.729180 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:25.729180 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:25.749242 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3cad824e-6622-48f3-86a5-abe7a20391dc tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.032455 Aug 09 14:31:25.749842 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 122/239] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 9 14:31:25 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:25.765301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a93c270-6edd-4606-a481-fc833f80e134 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Calling method '.version_select at 0x7f41deec4c10>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:25.774034 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:25.774034 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:25.776122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a93c270-6edd-4606-a481-fc833f80e134 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:25.777012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a93c270-6edd-4606-a481-fc833f80e134 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:25.777750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a93c270-6edd-4606-a481-fc833f80e134 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:25.779750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a93c270-6edd-4606-a481-fc833f80e134 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:25.780515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a93c270-6edd-4606-a481-fc833f80e134 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:25.781135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a93c270-6edd-4606-a481-fc833f80e134 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:25.807055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7535e8f9-1cd6-423b-b39e-4f21501b735c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:25.809192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:25.827914 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5a93c270-6edd-4606-a481-fc833f80e134 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.067654 Aug 09 14:31:25.829211 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 123/240] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:31:25 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:25.834777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a16944d2-9693-4d90-b99f-1c0c1369b0c5 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:25.835832 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:25.835832 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:25.837105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7535e8f9-1cd6-423b-b39e-4f21501b735c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:25.843318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7535e8f9-1cd6-423b-b39e-4f21501b735c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:25.859266 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7535e8f9-1cd6-423b-b39e-4f21501b735c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1321 microversion: 2.25 time: 0.351205 Aug 09 14:31:25.861035 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 118/241] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:25 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:25.865794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-462fc0b8-5a7a-4bdf-a6eb-68cfe83bec9e tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Calling method '.version_select at 0x7f41deebb160>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:25.868671 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a16944d2-9693-4d90-b99f-1c0c1369b0c5 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.037708 Aug 09 14:31:25.869473 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 124/242] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:25 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:25.880176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9c01f43d-3a10-491f-92a7-71019cdae46c tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-640964782", "availability_zone": "tempest-test_az-673845129"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:25.886608 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:25.886608 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:25.889125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-462fc0b8-5a7a-4bdf-a6eb-68cfe83bec9e tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:25.889829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-462fc0b8-5a7a-4bdf-a6eb-68cfe83bec9e tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:25.890565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-462fc0b8-5a7a-4bdf-a6eb-68cfe83bec9e tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:25.892308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-462fc0b8-5a7a-4bdf-a6eb-68cfe83bec9e tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:25.893125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-462fc0b8-5a7a-4bdf-a6eb-68cfe83bec9e tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:25.893847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-462fc0b8-5a7a-4bdf-a6eb-68cfe83bec9e tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:25.940311 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:25.940311 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:25.941394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-9c01f43d-3a10-491f-92a7-71019cdae46c tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Generated uuid 9f46dcf4-4efd-4e8a-8686-348e3c20c8a5 for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:25.944568 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-462fc0b8-5a7a-4bdf-a6eb-68cfe83bec9e tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.080206 Aug 09 14:31:25.946309 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 119/243] 10.222.0.50 () {58 vars in 1128 bytes} [Tue Aug 9 14:31:25 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:25.957139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-43adbad1-b16b-4362-8548-ccc4e63ef663 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Calling method '.version_select at 0x7f41dee90d30>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:25.958362 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:25.958362 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:25.967236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43adbad1-b16b-4362-8548-ccc4e63ef663 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:25.969059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43adbad1-b16b-4362-8548-ccc4e63ef663 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:25.969778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43adbad1-b16b-4362-8548-ccc4e63ef663 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:25.995759 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9c01f43d-3a10-491f-92a7-71019cdae46c tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.118896 Aug 09 14:31:25.998921 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 125/244] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Aug 9 14:31:25 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:26.031334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c782bf5-6c4c-4a87-8ffa-8d1a1d8188ee tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-640964782_new", "availability_zone": "tempest-test_az-673845129_new"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:26.035418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43adbad1-b16b-4362-8548-ccc4e63ef663 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.036100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43adbad1-b16b-4362-8548-ccc4e63ef663 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.036670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43adbad1-b16b-4362-8548-ccc4e63ef663 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.040041 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:26.040041 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:26.129248 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-43adbad1-b16b-4362-8548-ccc4e63ef663 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-h1-844626-8" status: 200 len: 598 microversion: 2.1 time: 0.177326 Aug 09 14:31:26.130506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c782bf5-6c4c-4a87-8ffa-8d1a1d8188ee tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.130993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c782bf5-6c4c-4a87-8ffa-8d1a1d8188ee tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.131453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c782bf5-6c4c-4a87-8ffa-8d1a1d8188ee tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.133089 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 120/245] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 9 14:31:25 2022] GET /compute/v2.1/os-hosts/n-h1-844626-8 => generated 598 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:31:26.150101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16cdb900-9760-4a63-8329-c744400ebfd5 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Calling method '.version_select at 0x7f41e405ee50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:26.159453 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:26.159453 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:26.174121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=12,nova_api:DELETE=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:26.184879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16cdb900-9760-4a63-8329-c744400ebfd5 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.187269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16cdb900-9760-4a63-8329-c744400ebfd5 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.188923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16cdb900-9760-4a63-8329-c744400ebfd5 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.212766 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c782bf5-6c4c-4a87-8ffa-8d1a1d8188ee tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 333 microversion: 2.1 time: 0.202196 Aug 09 14:31:26.222492 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 126/246] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 9 14:31:26 2022] PUT /compute/v2.1/os-aggregates/9 => generated 333 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:26.232428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4b64581-4689-411d-a00a-7ce70b2b427f tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:26.234449 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:26.234449 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:26.255744 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4b64581-4689-411d-a00a-7ce70b2b427f tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.030198 Aug 09 14:31:26.258328 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 127/247] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:31:26 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:26.269658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5da913db-893d-4901-8d96-8aac92c352db tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:26.270426 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:26.270426 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:26.280838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16cdb900-9760-4a63-8329-c744400ebfd5 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.281376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16cdb900-9760-4a63-8329-c744400ebfd5 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.281811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16cdb900-9760-4a63-8329-c744400ebfd5 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.316316 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5da913db-893d-4901-8d96-8aac92c352db tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.050009 Aug 09 14:31:26.321637 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 128/248] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:26 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:26.327489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01f99fe5-e289-4694-849a-fe02b8de57b6 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-595056227"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:26.331360 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:26.331360 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:26.332692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-01f99fe5-e289-4694-849a-fe02b8de57b6 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Generated uuid b7c7574f-7a82-4b0f-8614-1517fb648462 for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:26.361098 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01f99fe5-e289-4694-849a-fe02b8de57b6 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037867 Aug 09 14:31:26.369679 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 129/249] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:26.375444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cc949d7d-e491-43da-92b0-356c942236d2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:26.377899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cc949d7d-e491-43da-92b0-356c942236d2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:26.385633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc949d7d-e491-43da-92b0-356c942236d2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.386408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc949d7d-e491-43da-92b0-356c942236d2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.387422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc949d7d-e491-43da-92b0-356c942236d2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.388337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc949d7d-e491-43da-92b0-356c942236d2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.390516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc949d7d-e491-43da-92b0-356c942236d2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.391190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc949d7d-e491-43da-92b0-356c942236d2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.402340 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16cdb900-9760-4a63-8329-c744400ebfd5 tempest-HostsAdminTestJSON-1386987960 tempest-HostsAdminTestJSON-1386987960-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hosts/n-h2-844626-8" status: 200 len: 598 microversion: 2.1 time: 0.261316 Aug 09 14:31:26.407440 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 121/250] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 9 14:31:26 2022] GET /compute/v2.1/os-hosts/n-h2-844626-8 => generated 598 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:26.415958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-524e45e8-f2e3-45fe-b8fc-be9875c94249 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:26.417532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:26.422725 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:26.422725 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:26.448905 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-524e45e8-f2e3-45fe-b8fc-be9875c94249 tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.040071 Aug 09 14:31:26.460782 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 122/251] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:31:26 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:26.467253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dde8e418-e714-4871-b2c0-1e642db98a7b tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:26.469459 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:26.469459 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:26.505199 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dde8e418-e714-4871-b2c0-1e642db98a7b tempest-AggregatesAdminTestJSON-630394532 tempest-AggregatesAdminTestJSON-630394532-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.041880 Aug 09 14:31:26.512302 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 123/252] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:31:26 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:26.529263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40d87375-4c6e-4749-8506-62b38397fda0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:26.529798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40d87375-4c6e-4749-8506-62b38397fda0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:26.556356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40d87375-4c6e-4749-8506-62b38397fda0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.556931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40d87375-4c6e-4749-8506-62b38397fda0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.558116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40d87375-4c6e-4749-8506-62b38397fda0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.560338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40d87375-4c6e-4749-8506-62b38397fda0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.560803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40d87375-4c6e-4749-8506-62b38397fda0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.565955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40d87375-4c6e-4749-8506-62b38397fda0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.599955 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-40d87375-4c6e-4749-8506-62b38397fda0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] HTTP exception thrown: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40d87375-4c6e-4749-8506-62b38397fda0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Request method failure captured: Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce HTTP/1.1 Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m9_3NQqCBgAf_-8CH-ZESf4nnCmq5nO_dfxYp3hEob9wDEgccEEbf7C8dv-mEWc-u9hiLsSCxWGF9-ltus4OWA5rkxhAcfnwZQt85OizAl7cQ6WOVImhwOq0ZohQrfJSkjDQVdRMvmO5eaDSCbdYP31dzH1QTs_CQMj4Z1nRELUBkE Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 36c69ad6412d4e4581eee19d03c6baef Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AggregatesAdminTestJSON-1732197079 Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:31:26.606209 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:31:26.607644 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_36c69ad6412d4e4581eee19d03c6baef", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/36c69ad6412d4e4581eee19d03c6baef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36c69ad6412d4e4581eee19d03c6baef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36c69ad6412d4e4581eee19d03c6baef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:26.607644 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AggregatesAdminTestJSON-1732197079 Aug 09 14:31:26.607644 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 36c69ad6412d4e4581eee19d03c6baef Aug 09 14:31:26.607644 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1732197079 Aug 09 14:31:26.607644 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AggregatesAdminTestJSON-1732197079-project Aug 09 14:31:26.607644 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:26.607644 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:26.607644 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 2a4383fb5b774f569258d463e090a89a Aug 09 14:31:26.607644 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AggregatesAdminTestJSON-1732197079-project Aug 09 14:31:26.607644 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:26.607644 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:26.607644 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '4f8ce37a-525d-4ad6-b09a-505ed3e418ce'} Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:26.608432 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:26.609698 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:26.611023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40d87375-4c6e-4749-8506-62b38397fda0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Returning 404 to user: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:26.611023 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40d87375-4c6e-4749-8506-62b38397fda0 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 404 len: 111 microversion: 2.1 time: 0.094230 Aug 09 14:31:26.617942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cc949d7d-e491-43da-92b0-356c942236d2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:26.629422 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 124/253] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:31:26 2022] DELETE /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:26.637959 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cc949d7d-e491-43da-92b0-356c942236d2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1279 microversion: 2.1 time: 0.265227 Aug 09 14:31:26.640495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-962f9a00-018d-405b-9db3-037a496a85cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:26.641517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-962f9a00-018d-405b-9db3-037a496a85cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:26.659476 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 130/254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:26 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1279 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:26.662516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-962f9a00-018d-405b-9db3-037a496a85cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.664660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-962f9a00-018d-405b-9db3-037a496a85cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.667206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-962f9a00-018d-405b-9db3-037a496a85cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.668152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-962f9a00-018d-405b-9db3-037a496a85cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.669605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-962f9a00-018d-405b-9db3-037a496a85cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.670202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-962f9a00-018d-405b-9db3-037a496a85cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.678996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6df5e14a-2130-4147-bd1e-c62475924098 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:26.682073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6df5e14a-2130-4147-bd1e-c62475924098 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] [instance: 4f8ce37a-525d-4ad6-b09a-505ed3e418ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:26.703222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6df5e14a-2130-4147-bd1e-c62475924098 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.704917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6df5e14a-2130-4147-bd1e-c62475924098 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.706596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6df5e14a-2130-4147-bd1e-c62475924098 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.708569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6df5e14a-2130-4147-bd1e-c62475924098 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.709682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6df5e14a-2130-4147-bd1e-c62475924098 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.712143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6df5e14a-2130-4147-bd1e-c62475924098 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.750493 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6df5e14a-2130-4147-bd1e-c62475924098 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] HTTP exception thrown: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6df5e14a-2130-4147-bd1e-c62475924098 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Request method failure captured: Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce HTTP/1.1 Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m9_3NQqCBgAf_-8CH-ZESf4nnCmq5nO_dfxYp3hEob9wDEgccEEbf7C8dv-mEWc-u9hiLsSCxWGF9-ltus4OWA5rkxhAcfnwZQt85OizAl7cQ6WOVImhwOq0ZohQrfJSkjDQVdRMvmO5eaDSCbdYP31dzH1QTs_CQMj4Z1nRELUBkE Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 36c69ad6412d4e4581eee19d03c6baef Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AggregatesAdminTestJSON-1732197079 Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:26.757013 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:26.758421 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_36c69ad6412d4e4581eee19d03c6baef", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/36c69ad6412d4e4581eee19d03c6baef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36c69ad6412d4e4581eee19d03c6baef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/36c69ad6412d4e4581eee19d03c6baef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:26.758421 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AggregatesAdminTestJSON-1732197079 Aug 09 14:31:26.758421 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 36c69ad6412d4e4581eee19d03c6baef Aug 09 14:31:26.758421 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1732197079 Aug 09 14:31:26.758421 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AggregatesAdminTestJSON-1732197079-project Aug 09 14:31:26.758421 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:26.758421 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:26.758421 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 2a4383fb5b774f569258d463e090a89a Aug 09 14:31:26.758421 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AggregatesAdminTestJSON-1732197079-project Aug 09 14:31:26.758421 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:26.758421 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:26.758421 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '4f8ce37a-525d-4ad6-b09a-505ed3e418ce'} Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:26.759137 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. Aug 09 14:31:26.760217 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:26.769539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6df5e14a-2130-4147-bd1e-c62475924098 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] Returning 404 to user: Instance 4f8ce37a-525d-4ad6-b09a-505ed3e418ce could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:26.774360 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6df5e14a-2130-4147-bd1e-c62475924098 tempest-AggregatesAdminTestJSON-1732197079 tempest-AggregatesAdminTestJSON-1732197079-project] 10.222.0.50 "GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce" status: 404 len: 111 microversion: 2.1 time: 0.110656 Aug 09 14:31:26.778276 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 131/255] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:26 2022] GET /compute/v2.1/servers/4f8ce37a-525d-4ad6-b09a-505ed3e418ce => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:26.845737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0e5b0cb6-03b8-4051-bef4-c1d6ac5d802f req-08fb93ad-66f5-4370-a919-5370476892aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce", "tag": "ada039c2-0eea-454b-9ce1-6f801863f373"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:26.870210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0e5b0cb6-03b8-4051-bef4-c1d6ac5d802f req-08fb93ad-66f5-4370-a919-5370476892aa service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.874828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0e5b0cb6-03b8-4051-bef4-c1d6ac5d802f req-08fb93ad-66f5-4370-a919-5370476892aa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.876091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0e5b0cb6-03b8-4051-bef4-c1d6ac5d802f req-08fb93ad-66f5-4370-a919-5370476892aa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.908175 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0e5b0cb6-03b8-4051-bef4-c1d6ac5d802f req-08fb93ad-66f5-4370-a919-5370476892aa service nova] Creating event network-changed:ada039c2-0eea-454b-9ce1-6f801863f373 for instance 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce on n-h1-844626-8 Aug 09 14:31:26.917166 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0e5b0cb6-03b8-4051-bef4-c1d6ac5d802f req-08fb93ad-66f5-4370-a919-5370476892aa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074821 Aug 09 14:31:26.919037 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 132/256] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:26.932057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c4e3308-f08d-4ab1-8c0e-ec1d73c492f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:26.932748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c4e3308-f08d-4ab1-8c0e-ec1d73c492f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:26.949211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c4e3308-f08d-4ab1-8c0e-ec1d73c492f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.953476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c4e3308-f08d-4ab1-8c0e-ec1d73c492f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.953935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c4e3308-f08d-4ab1-8c0e-ec1d73c492f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:26.954664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c4e3308-f08d-4ab1-8c0e-ec1d73c492f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:26.955653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c4e3308-f08d-4ab1-8c0e-ec1d73c492f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:26.955653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c4e3308-f08d-4ab1-8c0e-ec1d73c492f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:27.340698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1c4e3308-f08d-4ab1-8c0e-ec1d73c492f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:27.350837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1c4e3308-f08d-4ab1-8c0e-ec1d73c492f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:27.352803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1c4e3308-f08d-4ab1-8c0e-ec1d73c492f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:27.360340 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c4e3308-f08d-4ab1-8c0e-ec1d73c492f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1319 microversion: 2.25 time: 0.439755 Aug 09 14:31:27.360933 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 133/257] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:26 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:27.666174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e07c5974-2165-481b-9986-7373832a1adf tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:27.668083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e07c5974-2165-481b-9986-7373832a1adf tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:27.675275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e07c5974-2165-481b-9986-7373832a1adf tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:27.676130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e07c5974-2165-481b-9986-7373832a1adf tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:27.676705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e07c5974-2165-481b-9986-7373832a1adf tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:27.677756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e07c5974-2165-481b-9986-7373832a1adf tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:27.678386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e07c5974-2165-481b-9986-7373832a1adf tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:27.679075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e07c5974-2165-481b-9986-7373832a1adf tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:27.852493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-962f9a00-018d-405b-9db3-037a496a85cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:27.865913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e07c5974-2165-481b-9986-7373832a1adf tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:27.870716 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-962f9a00-018d-405b-9db3-037a496a85cc tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1319 microversion: 2.1 time: 1.240119 Aug 09 14:31:27.875375 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e07c5974-2165-481b-9986-7373832a1adf tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1279 microversion: 2.1 time: 0.213607 Aug 09 14:31:27.892885 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 125/258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:26 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1319 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:27.903073 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 134/259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:27 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1279 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:31:28.390358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a1f7a104-30e6-44f2-9a12-0c82376d769c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:28.391633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a1f7a104-30e6-44f2-9a12-0c82376d769c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:28.400032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1f7a104-30e6-44f2-9a12-0c82376d769c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:28.401078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1f7a104-30e6-44f2-9a12-0c82376d769c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:28.401729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1f7a104-30e6-44f2-9a12-0c82376d769c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:28.403217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1f7a104-30e6-44f2-9a12-0c82376d769c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:28.403822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1f7a104-30e6-44f2-9a12-0c82376d769c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:28.404429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1f7a104-30e6-44f2-9a12-0c82376d769c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:28.569705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a1f7a104-30e6-44f2-9a12-0c82376d769c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:28.593446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a1f7a104-30e6-44f2-9a12-0c82376d769c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:28.597318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a1f7a104-30e6-44f2-9a12-0c82376d769c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:28.603162 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a1f7a104-30e6-44f2-9a12-0c82376d769c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1319 microversion: 2.25 time: 0.218853 Aug 09 14:31:28.605438 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 126/260] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:28 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:28.844342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-3f0cbbde-5d79-41c0-9778-5b69a963d33c req-6684bedd-f776-4364-b53f-5c45dde750f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c4fd60-05f3-4849-9278-267334ae8ce4", "name": "network-vif-plugged", "status": "completed", "tag": "e139787c-315b-43e9-8513-11c3d196300f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:28.865289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3f0cbbde-5d79-41c0-9778-5b69a963d33c req-6684bedd-f776-4364-b53f-5c45dde750f3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:28.867398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3f0cbbde-5d79-41c0-9778-5b69a963d33c req-6684bedd-f776-4364-b53f-5c45dde750f3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:28.869305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3f0cbbde-5d79-41c0-9778-5b69a963d33c req-6684bedd-f776-4364-b53f-5c45dde750f3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:28.901749 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3f0cbbde-5d79-41c0-9778-5b69a963d33c req-6684bedd-f776-4364-b53f-5c45dde750f3 service nova] Creating event network-vif-plugged:e139787c-315b-43e9-8513-11c3d196300f for instance e3c4fd60-05f3-4849-9278-267334ae8ce4 on n-h2-844626-8 Aug 09 14:31:28.901983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eea63f3f-5ba6-4b9e-a52e-2dca00d2a0cd tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:28.903945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eea63f3f-5ba6-4b9e-a52e-2dca00d2a0cd tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:28.914661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea63f3f-5ba6-4b9e-a52e-2dca00d2a0cd tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:28.916043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea63f3f-5ba6-4b9e-a52e-2dca00d2a0cd tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:28.916696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea63f3f-5ba6-4b9e-a52e-2dca00d2a0cd tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:28.916855 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-3f0cbbde-5d79-41c0-9778-5b69a963d33c req-6684bedd-f776-4364-b53f-5c45dde750f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077082 Aug 09 14:31:28.917726 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 135/261] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:28.918056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea63f3f-5ba6-4b9e-a52e-2dca00d2a0cd tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:28.918889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea63f3f-5ba6-4b9e-a52e-2dca00d2a0cd tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:28.920382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea63f3f-5ba6-4b9e-a52e-2dca00d2a0cd tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:28.950909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb5febcd-a23f-43bc-8d7d-70e706c4ac81 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:28.953832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eb5febcd-a23f-43bc-8d7d-70e706c4ac81 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:28.963956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb5febcd-a23f-43bc-8d7d-70e706c4ac81 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:28.964759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb5febcd-a23f-43bc-8d7d-70e706c4ac81 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:28.965327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb5febcd-a23f-43bc-8d7d-70e706c4ac81 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:28.966475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb5febcd-a23f-43bc-8d7d-70e706c4ac81 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:28.968369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb5febcd-a23f-43bc-8d7d-70e706c4ac81 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:28.969404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb5febcd-a23f-43bc-8d7d-70e706c4ac81 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:29.206322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb5febcd-a23f-43bc-8d7d-70e706c4ac81 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:29.221324 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb5febcd-a23f-43bc-8d7d-70e706c4ac81 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1279 microversion: 2.1 time: 0.298000 Aug 09 14:31:29.222696 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 136/262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:28 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1279 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:29.261341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-088779e6-f1d2-495c-ab49-045a7225746d req-f4578777-210e-47e5-b221-ac29a7e621a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9124e955-056d-4c19-baa2-dbbfdcad5058", "tag": "f0f8dcb7-df02-4e0c-a16f-f9b2f9e6fe00"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:29.308204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-088779e6-f1d2-495c-ab49-045a7225746d req-f4578777-210e-47e5-b221-ac29a7e621a6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:29.308691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-088779e6-f1d2-495c-ab49-045a7225746d req-f4578777-210e-47e5-b221-ac29a7e621a6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:29.309113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-088779e6-f1d2-495c-ab49-045a7225746d req-f4578777-210e-47e5-b221-ac29a7e621a6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:29.354582 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-088779e6-f1d2-495c-ab49-045a7225746d req-f4578777-210e-47e5-b221-ac29a7e621a6 service nova] Creating event network-changed:f0f8dcb7-df02-4e0c-a16f-f9b2f9e6fe00 for instance 9124e955-056d-4c19-baa2-dbbfdcad5058 on n-h2-844626-8 Aug 09 14:31:29.368920 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-088779e6-f1d2-495c-ab49-045a7225746d req-f4578777-210e-47e5-b221-ac29a7e621a6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144195 Aug 09 14:31:29.369375 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 137/263] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:29.503912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eea63f3f-5ba6-4b9e-a52e-2dca00d2a0cd tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:29.515322 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eea63f3f-5ba6-4b9e-a52e-2dca00d2a0cd tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1319 microversion: 2.1 time: 0.621054 Aug 09 14:31:29.539281 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 127/264] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:28 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1319 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:31:29.627751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-65317310-c1e4-4ba5-ad99-17255e476808 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:29.628445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-65317310-c1e4-4ba5-ad99-17255e476808 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:29.639401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65317310-c1e4-4ba5-ad99-17255e476808 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:29.640503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65317310-c1e4-4ba5-ad99-17255e476808 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:29.644570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65317310-c1e4-4ba5-ad99-17255e476808 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:29.646776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65317310-c1e4-4ba5-ad99-17255e476808 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:29.648269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65317310-c1e4-4ba5-ad99-17255e476808 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:29.648915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65317310-c1e4-4ba5-ad99-17255e476808 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:30.245095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fce70ffd-6c25-4948-8f29-f7e1b74b522f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:30.246395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fce70ffd-6c25-4948-8f29-f7e1b74b522f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:30.256425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fce70ffd-6c25-4948-8f29-f7e1b74b522f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:30.257057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fce70ffd-6c25-4948-8f29-f7e1b74b522f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:30.258082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fce70ffd-6c25-4948-8f29-f7e1b74b522f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:30.258807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fce70ffd-6c25-4948-8f29-f7e1b74b522f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:30.259315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fce70ffd-6c25-4948-8f29-f7e1b74b522f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:30.260796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fce70ffd-6c25-4948-8f29-f7e1b74b522f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:30.334072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-65317310-c1e4-4ba5-ad99-17255e476808 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:30.354790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-65317310-c1e4-4ba5-ad99-17255e476808 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:30.359306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-65317310-c1e4-4ba5-ad99-17255e476808 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:30.360823 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-65317310-c1e4-4ba5-ad99-17255e476808 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1361 microversion: 2.25 time: 0.737663 Aug 09 14:31:30.362684 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 138/265] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:29 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1361 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:30.544572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-196835e7-7fac-4f12-b5ca-d170a137b745 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:30.546408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-196835e7-7fac-4f12-b5ca-d170a137b745 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:30.556846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-196835e7-7fac-4f12-b5ca-d170a137b745 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:30.557668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-196835e7-7fac-4f12-b5ca-d170a137b745 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:30.558318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-196835e7-7fac-4f12-b5ca-d170a137b745 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:30.559848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-196835e7-7fac-4f12-b5ca-d170a137b745 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:30.560506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-196835e7-7fac-4f12-b5ca-d170a137b745 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:30.562827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-196835e7-7fac-4f12-b5ca-d170a137b745 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:30.888683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fce70ffd-6c25-4948-8f29-f7e1b74b522f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:30.896575 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fce70ffd-6c25-4948-8f29-f7e1b74b522f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1321 microversion: 2.1 time: 0.656842 Aug 09 14:31:30.897132 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 128/266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:30 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1321 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:31.032467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-196835e7-7fac-4f12-b5ca-d170a137b745 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:31.040322 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-196835e7-7fac-4f12-b5ca-d170a137b745 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1319 microversion: 2.1 time: 0.500257 Aug 09 14:31:31.056521 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 139/267] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:30 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:31:31.386195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67cda94c-cf44-4c80-b069-d159948aa745 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:31.386844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-67cda94c-cf44-4c80-b069-d159948aa745 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:31.407600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cda94c-cf44-4c80-b069-d159948aa745 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:31.409755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cda94c-cf44-4c80-b069-d159948aa745 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:31.410206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cda94c-cf44-4c80-b069-d159948aa745 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:31.416527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cda94c-cf44-4c80-b069-d159948aa745 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:31.417016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cda94c-cf44-4c80-b069-d159948aa745 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:31.418775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cda94c-cf44-4c80-b069-d159948aa745 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:31.787314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-67cda94c-cf44-4c80-b069-d159948aa745 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:31.790966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:31.796531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-67cda94c-cf44-4c80-b069-d159948aa745 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:31.798107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-67cda94c-cf44-4c80-b069-d159948aa745 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:31.802356 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67cda94c-cf44-4c80-b069-d159948aa745 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1361 microversion: 2.25 time: 0.417923 Aug 09 14:31:31.804780 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 129/268] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:31 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1361 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:31.919535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7d19541d-d99c-4462-bb1a-ebac501ad579 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:31.920186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7d19541d-d99c-4462-bb1a-ebac501ad579 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:31.929510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d19541d-d99c-4462-bb1a-ebac501ad579 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:31.929966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d19541d-d99c-4462-bb1a-ebac501ad579 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:31.930955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d19541d-d99c-4462-bb1a-ebac501ad579 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:31.931925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d19541d-d99c-4462-bb1a-ebac501ad579 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:31.932511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d19541d-d99c-4462-bb1a-ebac501ad579 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:31.933109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d19541d-d99c-4462-bb1a-ebac501ad579 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:32.068308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3139e130-4d0d-45af-ba2d-6764c3a74f46 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:32.068916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3139e130-4d0d-45af-ba2d-6764c3a74f46 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:32.078496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3139e130-4d0d-45af-ba2d-6764c3a74f46 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:32.079732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3139e130-4d0d-45af-ba2d-6764c3a74f46 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:32.080354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3139e130-4d0d-45af-ba2d-6764c3a74f46 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:32.082609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3139e130-4d0d-45af-ba2d-6764c3a74f46 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:32.083432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3139e130-4d0d-45af-ba2d-6764c3a74f46 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:32.084263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3139e130-4d0d-45af-ba2d-6764c3a74f46 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:33.091479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3139e130-4d0d-45af-ba2d-6764c3a74f46 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:33.103388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7d19541d-d99c-4462-bb1a-ebac501ad579 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:33.111213 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7d19541d-d99c-4462-bb1a-ebac501ad579 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1321 microversion: 2.1 time: 1.197821 Aug 09 14:31:33.112086 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3139e130-4d0d-45af-ba2d-6764c3a74f46 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1469 microversion: 2.1 time: 1.050448 Aug 09 14:31:33.124589 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 130/269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:32 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1469 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:33.130384 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 140/270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:31 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1321 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:33.139424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88ca1558-51b0-489b-b2e1-b8e4ba1b4d14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:33.140802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-88ca1558-51b0-489b-b2e1-b8e4ba1b4d14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:33.147071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-1d13d3cd-385c-4f17-8ad8-ea973daf6ef7 req-ef438af0-fe35-420d-a621-8d126c95ae80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50063b74-64e4-46e0-a842-cfd6735d25ac", "tag": "fc3132c5-cc58-4ae3-a9ab-ada9e2c1a56d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:33.158417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88ca1558-51b0-489b-b2e1-b8e4ba1b4d14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:33.158919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88ca1558-51b0-489b-b2e1-b8e4ba1b4d14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:33.166686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88ca1558-51b0-489b-b2e1-b8e4ba1b4d14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:33.167547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88ca1558-51b0-489b-b2e1-b8e4ba1b4d14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:33.168031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88ca1558-51b0-489b-b2e1-b8e4ba1b4d14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:33.168448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88ca1558-51b0-489b-b2e1-b8e4ba1b4d14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:33.171838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1d13d3cd-385c-4f17-8ad8-ea973daf6ef7 req-ef438af0-fe35-420d-a621-8d126c95ae80 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:33.181069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1d13d3cd-385c-4f17-8ad8-ea973daf6ef7 req-ef438af0-fe35-420d-a621-8d126c95ae80 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:33.182136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1d13d3cd-385c-4f17-8ad8-ea973daf6ef7 req-ef438af0-fe35-420d-a621-8d126c95ae80 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:33.215906 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1d13d3cd-385c-4f17-8ad8-ea973daf6ef7 req-ef438af0-fe35-420d-a621-8d126c95ae80 service nova] Creating event network-changed:fc3132c5-cc58-4ae3-a9ab-ada9e2c1a56d for instance 50063b74-64e4-46e0-a842-cfd6735d25ac on n-h1-844626-8 Aug 09 14:31:33.222627 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-1d13d3cd-385c-4f17-8ad8-ea973daf6ef7 req-ef438af0-fe35-420d-a621-8d126c95ae80 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096452 Aug 09 14:31:33.223753 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 131/271] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:33.251776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-150ee9a7-8e75-418f-8f7e-a6a809385bed tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:33.254518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-150ee9a7-8e75-418f-8f7e-a6a809385bed tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:33.267810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-150ee9a7-8e75-418f-8f7e-a6a809385bed tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:33.269788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-150ee9a7-8e75-418f-8f7e-a6a809385bed tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:33.270234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-150ee9a7-8e75-418f-8f7e-a6a809385bed tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:33.273197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-150ee9a7-8e75-418f-8f7e-a6a809385bed tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:33.274075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-150ee9a7-8e75-418f-8f7e-a6a809385bed tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:33.274320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-150ee9a7-8e75-418f-8f7e-a6a809385bed tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:33.624225 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-150ee9a7-8e75-418f-8f7e-a6a809385bed tempest-DeleteServersAdminTestJSON-1213896395 tempest-DeleteServersAdminTestJSON-1213896395-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4/action" status: 202 len: 0 microversion: 2.1 time: 0.396105 Aug 09 14:31:33.626981 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 132/272] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:31:33 2022] POST /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:31:33.655377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:33.657292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:33.684850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:33.687785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:33.689919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:33.692526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:33.693838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:33.694627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:33.721188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-88ca1558-51b0-489b-b2e1-b8e4ba1b4d14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:33.741574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=7 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:33.746444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-88ca1558-51b0-489b-b2e1-b8e4ba1b4d14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:33.748015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-88ca1558-51b0-489b-b2e1-b8e4ba1b4d14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:33.749192 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88ca1558-51b0-489b-b2e1-b8e4ba1b4d14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1361 microversion: 2.25 time: 0.617521 Aug 09 14:31:33.763529 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 141/273] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:33 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1361 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:33.798731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:33.800298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:33.800875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:33.802711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lazy-loading 'fault' on Instance uuid e3c4fd60-05f3-4849-9278-267334ae8ce4 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:31:34.039367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=14 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:34.133900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8bf87c0-46a2-4d39-9352-51885717c061 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:34.134503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8bf87c0-46a2-4d39-9352-51885717c061 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:34.147450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8bf87c0-46a2-4d39-9352-51885717c061 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:34.147944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8bf87c0-46a2-4d39-9352-51885717c061 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:34.148373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8bf87c0-46a2-4d39-9352-51885717c061 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:34.149074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8bf87c0-46a2-4d39-9352-51885717c061 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:34.149526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8bf87c0-46a2-4d39-9352-51885717c061 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:34.149936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8bf87c0-46a2-4d39-9352-51885717c061 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:34.712610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:34.720372 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-476ff20c-3648-4618-97b5-bdba680bd202 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1452 microversion: 2.1 time: 1.087262 Aug 09 14:31:34.720951 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 133/274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:33 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1452 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:34.739161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-00bbf54e-0db6-46d5-a5c4-68acc9bc705f req-4e8fcdee-fc7f-4567-9094-d48df2d724b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce", "name": "network-vif-plugged", "status": "completed", "tag": "ada039c2-0eea-454b-9ce1-6f801863f373"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:34.759704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-00bbf54e-0db6-46d5-a5c4-68acc9bc705f req-4e8fcdee-fc7f-4567-9094-d48df2d724b3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:34.765613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-00bbf54e-0db6-46d5-a5c4-68acc9bc705f req-4e8fcdee-fc7f-4567-9094-d48df2d724b3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:34.766077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-00bbf54e-0db6-46d5-a5c4-68acc9bc705f req-4e8fcdee-fc7f-4567-9094-d48df2d724b3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:34.789803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8bf87c0-46a2-4d39-9352-51885717c061 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:34.805527 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e8bf87c0-46a2-4d39-9352-51885717c061 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1321 microversion: 2.1 time: 0.674794 Aug 09 14:31:34.806145 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 142/275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:34 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1321 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:31:34.818331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-206ce2d7-b7c6-4b16-a864-dcd28647049c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:34.820176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-206ce2d7-b7c6-4b16-a864-dcd28647049c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:34.821329 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-00bbf54e-0db6-46d5-a5c4-68acc9bc705f req-4e8fcdee-fc7f-4567-9094-d48df2d724b3 service nova] Creating event network-vif-plugged:ada039c2-0eea-454b-9ce1-6f801863f373 for instance 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce on n-h1-844626-8 Aug 09 14:31:34.839013 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-00bbf54e-0db6-46d5-a5c4-68acc9bc705f req-4e8fcdee-fc7f-4567-9094-d48df2d724b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116856 Aug 09 14:31:34.839994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-206ce2d7-b7c6-4b16-a864-dcd28647049c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:34.840499 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 134/276] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:34.840610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-206ce2d7-b7c6-4b16-a864-dcd28647049c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:34.840970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-206ce2d7-b7c6-4b16-a864-dcd28647049c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:34.841694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-206ce2d7-b7c6-4b16-a864-dcd28647049c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:34.842138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-206ce2d7-b7c6-4b16-a864-dcd28647049c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:34.848576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-206ce2d7-b7c6-4b16-a864-dcd28647049c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:34.871312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6b47e15b-d2a7-4f84-a4c9-4a41d50599df tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:34.875609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6b47e15b-d2a7-4f84-a4c9-4a41d50599df tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:34.892011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b47e15b-d2a7-4f84-a4c9-4a41d50599df tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:34.893730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b47e15b-d2a7-4f84-a4c9-4a41d50599df tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:34.896564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b47e15b-d2a7-4f84-a4c9-4a41d50599df tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:34.900552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b47e15b-d2a7-4f84-a4c9-4a41d50599df tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:34.902119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b47e15b-d2a7-4f84-a4c9-4a41d50599df tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:34.902710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b47e15b-d2a7-4f84-a4c9-4a41d50599df tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:34.930717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-206ce2d7-b7c6-4b16-a864-dcd28647049c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:31:35.187192 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-206ce2d7-b7c6-4b16-a864-dcd28647049c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 204 len: 0 microversion: 2.1 time: 0.378578 Aug 09 14:31:35.189023 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 143/277] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:31:34 2022] DELETE /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:31:35.384828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6b47e15b-d2a7-4f84-a4c9-4a41d50599df tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:35.397577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6b47e15b-d2a7-4f84-a4c9-4a41d50599df tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:35.402124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6b47e15b-d2a7-4f84-a4c9-4a41d50599df tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:35.405779 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6b47e15b-d2a7-4f84-a4c9-4a41d50599df tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1361 microversion: 2.25 time: 0.562305 Aug 09 14:31:35.420123 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 135/278] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:34 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1361 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:35.661538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-035d11ac-c319-4ea9-adc7-350abcf5741d tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Calling method '.version_select at 0x7f41e41e7700>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:35.662798 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:35.662798 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:35.664584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-035d11ac-c319-4ea9-adc7-350abcf5741d tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:35.665813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-035d11ac-c319-4ea9-adc7-350abcf5741d tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:35.667040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-035d11ac-c319-4ea9-adc7-350abcf5741d tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:35.710394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-035d11ac-c319-4ea9-adc7-350abcf5741d tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:35.713453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-035d11ac-c319-4ea9-adc7-350abcf5741d tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:35.730199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-035d11ac-c319-4ea9-adc7-350abcf5741d tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:35.751232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-035d11ac-c319-4ea9-adc7-350abcf5741d tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:35.751718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-035d11ac-c319-4ea9-adc7-350abcf5741d tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:35.752155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-035d11ac-c319-4ea9-adc7-350abcf5741d tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:35.773044 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-035d11ac-c319-4ea9-adc7-350abcf5741d tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.582478 Aug 09 14:31:35.777142 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 144/279] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 9 14:31:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:31:35.789550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:35.791386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:35.796963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=10 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:35.807731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:35.808465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:35.809120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:35.809965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:35.810578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:35.811167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:35.850852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:35.851666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:35.853664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:35.854607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lazy-loading 'fault' on Instance uuid e3c4fd60-05f3-4849-9278-267334ae8ce4 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:31:35.909411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:36.005175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7ebe1bf3-d36a-4e09-9305-9717837f0460 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:36.008254 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:36.008254 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:36.009597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ebe1bf3-d36a-4e09-9305-9717837f0460 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:36.010205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ebe1bf3-d36a-4e09-9305-9717837f0460 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:36.010706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ebe1bf3-d36a-4e09-9305-9717837f0460 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:36.011535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ebe1bf3-d36a-4e09-9305-9717837f0460 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:36.012050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ebe1bf3-d36a-4e09-9305-9717837f0460 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:36.012538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ebe1bf3-d36a-4e09-9305-9717837f0460 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:36.041794 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7ebe1bf3-d36a-4e09-9305-9717837f0460 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.620282 Aug 09 14:31:36.042754 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 136/280] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 9 14:31:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:36.047579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-28eff703-848c-4824-9e67-8df77208896b req-2a548039-4b64-4d69-9fbc-176b2bbe9fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "826994ac-b33d-487a-ad40-a26199875e31", "tag": "3f98b6bb-8a91-4cae-ae5a-187ccef422fd"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:36.058064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-28eff703-848c-4824-9e67-8df77208896b req-2a548039-4b64-4d69-9fbc-176b2bbe9fd8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:36.058813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-28eff703-848c-4824-9e67-8df77208896b req-2a548039-4b64-4d69-9fbc-176b2bbe9fd8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:36.059915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-28eff703-848c-4824-9e67-8df77208896b req-2a548039-4b64-4d69-9fbc-176b2bbe9fd8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:36.072287 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-28eff703-848c-4824-9e67-8df77208896b req-2a548039-4b64-4d69-9fbc-176b2bbe9fd8 service nova] Creating event network-changed:3f98b6bb-8a91-4cae-ae5a-187ccef422fd for instance 826994ac-b33d-487a-ad40-a26199875e31 on n-h1-844626-8 Aug 09 14:31:36.088156 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-28eff703-848c-4824-9e67-8df77208896b req-2a548039-4b64-4d69-9fbc-176b2bbe9fd8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043931 Aug 09 14:31:36.090227 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 137/281] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:36.095200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40bae4c1-3c24-4dea-b046-eb8845af10f0 tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Calling method '.version_select at 0x7f41de3d74c0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:36.096067 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:36.096067 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:36.097156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40bae4c1-3c24-4dea-b046-eb8845af10f0 tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:36.097703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40bae4c1-3c24-4dea-b046-eb8845af10f0 tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:36.098137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40bae4c1-3c24-4dea-b046-eb8845af10f0 tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:36.112971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40bae4c1-3c24-4dea-b046-eb8845af10f0 tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:36.113449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40bae4c1-3c24-4dea-b046-eb8845af10f0 tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:36.113876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40bae4c1-3c24-4dea-b046-eb8845af10f0 tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:36.119871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:36.120679 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40bae4c1-3c24-4dea-b046-eb8845af10f0 tempest-HypervisorAdminV228Test-541493312 tempest-HypervisorAdminV228Test-541493312-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.029451 Aug 09 14:31:36.121456 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 138/282] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 9 14:31:36 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:31:36.126034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c04ec240-21da-4835-9ab8-3d00478e8642 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:36.126973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c04ec240-21da-4835-9ab8-3d00478e8642 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:36.132396 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c1c3a57a-89c3-444e-9483-5162f7008273 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1458 microversion: 2.1 time: 0.351610 Aug 09 14:31:36.134332 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 145/283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:35 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1458 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:36.141653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b425e16-cb7a-494d-9a36-87cf17f1f65a tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1315327255"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:36.147542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c04ec240-21da-4835-9ab8-3d00478e8642 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:36.149107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c04ec240-21da-4835-9ab8-3d00478e8642 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:36.150063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c04ec240-21da-4835-9ab8-3d00478e8642 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:36.151365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c04ec240-21da-4835-9ab8-3d00478e8642 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:36.151727 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:36.151727 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:36.154022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-9b425e16-cb7a-494d-9a36-87cf17f1f65a tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Generated uuid ade96026-3949-4bf9-833f-a7ab1e6e8af1 for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:36.154756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c04ec240-21da-4835-9ab8-3d00478e8642 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:36.156146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c04ec240-21da-4835-9ab8-3d00478e8642 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:36.203000 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b425e16-cb7a-494d-9a36-87cf17f1f65a tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.067547 Aug 09 14:31:36.205110 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 146/284] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:36 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:36.216060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a3ab2939-e896-4f95-9c6b-7681c6924659 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:36.219790 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:36.219790 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:36.238722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3ab2939-e896-4f95-9c6b-7681c6924659 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:36.245420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3ab2939-e896-4f95-9c6b-7681c6924659 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:36.246112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3ab2939-e896-4f95-9c6b-7681c6924659 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:36.650075 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a3ab2939-e896-4f95-9c6b-7681c6924659 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.437742 Aug 09 14:31:36.651215 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 147/285] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:31:36 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:36.675540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0589dcf2-2025-4d23-9ee4-3ed56dfa19fd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:36.676460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0589dcf2-2025-4d23-9ee4-3ed56dfa19fd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:36.706636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0589dcf2-2025-4d23-9ee4-3ed56dfa19fd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:36.707996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0589dcf2-2025-4d23-9ee4-3ed56dfa19fd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:36.709767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0589dcf2-2025-4d23-9ee4-3ed56dfa19fd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:36.713824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0589dcf2-2025-4d23-9ee4-3ed56dfa19fd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:36.714545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0589dcf2-2025-4d23-9ee4-3ed56dfa19fd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:36.715307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0589dcf2-2025-4d23-9ee4-3ed56dfa19fd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:37.083730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c04ec240-21da-4835-9ab8-3d00478e8642 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:37.125993 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c04ec240-21da-4835-9ab8-3d00478e8642 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1321 microversion: 2.1 time: 1.002507 Aug 09 14:31:37.127992 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 139/286] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:36 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1321 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:37.212561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0589dcf2-2025-4d23-9ee4-3ed56dfa19fd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:37.231924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0589dcf2-2025-4d23-9ee4-3ed56dfa19fd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:37.235709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0589dcf2-2025-4d23-9ee4-3ed56dfa19fd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:37.238341 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0589dcf2-2025-4d23-9ee4-3ed56dfa19fd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1361 microversion: 2.25 time: 0.585032 Aug 09 14:31:37.241146 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 148/287] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:36 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1361 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:37.248446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d53e1488-fabf-45d4-a9e4-0567ca365c02 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:37.254983 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:37.254983 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:37.273022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d53e1488-fabf-45d4-a9e4-0567ca365c02 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:37.276902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d53e1488-fabf-45d4-a9e4-0567ca365c02 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:37.277790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d53e1488-fabf-45d4-a9e4-0567ca365c02 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:37.288218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:37.326220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=4,nova_api:INSERT=5,nova_api:UPDATE=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:37.337169 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-d53e1488-fabf-45d4-a9e4-0567ca365c02 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-844626-8. Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d53e1488-fabf-45d4-a9e4-0567ca365c02 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Request method failure captured: Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 39 Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_GYk1LBZlQHgaDwuoCTQ7ZmpjhaEJ8SPpUoh7as3d6e3zj0tdthh3IcZdOL5nzWeubaOsNYJV4cslMdCl_RpXzx3aX7-YC-BJVXrUnBQ_9Ymjoe1xyE3a_k_HqwQ7iX20DdytRv_MJEIYVBfjXNgNQ9ib0ZPx329jp_FAeObcvm-4 Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:31:37.362968 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a931190b3f6546c5a9ffd0c436771208", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 65f6c3962ac5488cbb90967fb42138a2 Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: {"add_host": {"host": "n-h1-844626-8"}} Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:37.364286 n-d-844626-8 devstack@n-api.service[119406]: exception: Aggregate 11 already has host n-h1-844626-8. Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-844626-8'}}} Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result.read() Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 14:31:37.365024 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-844626-8-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi session.flush() Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 14:31:37.366145 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 14:31:37.367299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 14:31:37.370877 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result.read() Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-844626-8-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 9, 14, 31, 37, 322478), 'updated_at': None, 'host': 'n-h1-844626-8', 'aggregate_id': 11}] Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:37.373260 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6607, in add_host_to_aggregate Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-844626-8. Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:37.375844 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-844626-8. Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:37.380294 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:37.385095 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-844626-8. Aug 09 14:31:37.385095 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:37.385095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d53e1488-fabf-45d4-a9e4-0567ca365c02 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-844626-8. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:37.385095 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d53e1488-fabf-45d4-a9e4-0567ca365c02 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.121834 Aug 09 14:31:37.385095 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 149/288] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:31:37 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 09 14:31:37.385095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:37.385095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:37.396700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:37.398131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:37.398896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:37.401551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:37.403184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:37.403754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:37.483809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:37.487015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:37.487652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:37.488242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lazy-loading 'fault' on Instance uuid e3c4fd60-05f3-4849-9278-267334ae8ce4 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:31:37.516921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-be0490f8-a7b4-4a05-9af2-247f42d87773 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:37.523883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be0490f8-a7b4-4a05-9af2-247f42d87773 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:37.524668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be0490f8-a7b4-4a05-9af2-247f42d87773 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:37.525411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be0490f8-a7b4-4a05-9af2-247f42d87773 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:37.526353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be0490f8-a7b4-4a05-9af2-247f42d87773 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:37.527459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be0490f8-a7b4-4a05-9af2-247f42d87773 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:37.529502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be0490f8-a7b4-4a05-9af2-247f42d87773 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:37.655756 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-be0490f8-a7b4-4a05-9af2-247f42d87773 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.525907 Aug 09 14:31:37.657510 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 140/289] 10.222.0.50 () {58 vars in 1164 bytes} [Tue Aug 9 14:31:37 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:31:37.676417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c90a4e64-47c2-491b-af55-dfde44042623 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-844626-8"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:37.680690 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:37.680690 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:37.706197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c90a4e64-47c2-491b-af55-dfde44042623 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:37.707042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c90a4e64-47c2-491b-af55-dfde44042623 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:37.718760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c90a4e64-47c2-491b-af55-dfde44042623 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:37.858029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e3b1bc0133f4e848eeccd53e141f6d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb69ef1d43a24edcbbc99882cbf52f5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:37.868862 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be5518e0-22a3-4c45-902f-2d10c243074c tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 200 len: 1458 microversion: 2.1 time: 0.496059 Aug 09 14:31:37.870801 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 150/290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:37 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 1458 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:37.889845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36e5e84c-81d6-4ca9-822f-6b2c840c9bb0 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:37.891804 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:37.891804 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:37.894275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36e5e84c-81d6-4ca9-822f-6b2c840c9bb0 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:37.896223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36e5e84c-81d6-4ca9-822f-6b2c840c9bb0 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:37.896931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36e5e84c-81d6-4ca9-822f-6b2c840c9bb0 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:37.899263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36e5e84c-81d6-4ca9-822f-6b2c840c9bb0 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:37.899952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36e5e84c-81d6-4ca9-822f-6b2c840c9bb0 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:37.902054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36e5e84c-81d6-4ca9-822f-6b2c840c9bb0 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:37.999420 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c90a4e64-47c2-491b-af55-dfde44042623 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.338671 Aug 09 14:31:38.005923 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 141/291] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:31:37 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:38.011642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e6f97192-c475-4379-80bb-2083f9ebcba4 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:38.012280 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36e5e84c-81d6-4ca9-822f-6b2c840c9bb0 tempest-AZAdminV2TestJSON-894183949 tempest-AZAdminV2TestJSON-894183949-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.137714 Aug 09 14:31:38.012994 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:38.012994 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:38.028946 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 151/292] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 9 14:31:37 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:38.083955 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e6f97192-c475-4379-80bb-2083f9ebcba4 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.076617 Aug 09 14:31:38.094824 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 142/293] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:31:38 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 09 14:31:38.100873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-daf34a86-1044-420f-b2d9-fb539e4e659e tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-990963777"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:38.116740 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:38.116740 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:38.119856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-daf34a86-1044-420f-b2d9-fb539e4e659e tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Generated uuid 891ee70d-2d86-4c60-88f4-d71da9694661 for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:38.152413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33bf51e2-8349-4475-ba7e-8db019ae9a77 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:38.154092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-33bf51e2-8349-4475-ba7e-8db019ae9a77 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:38.172291 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-daf34a86-1044-420f-b2d9-fb539e4e659e tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.073844 Aug 09 14:31:38.173513 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 152/294] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:38.190130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33bf51e2-8349-4475-ba7e-8db019ae9a77 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:38.190691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33bf51e2-8349-4475-ba7e-8db019ae9a77 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:38.191145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33bf51e2-8349-4475-ba7e-8db019ae9a77 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:38.191867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33bf51e2-8349-4475-ba7e-8db019ae9a77 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:38.192307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33bf51e2-8349-4475-ba7e-8db019ae9a77 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:38.192717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33bf51e2-8349-4475-ba7e-8db019ae9a77 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:38.486054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-310bcfa1-decb-41fb-a204-9f0cccb726d1 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:38.488888 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:38.488888 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:38.489923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-310bcfa1-decb-41fb-a204-9f0cccb726d1 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '9ce0dcabe3d5429b8015f660a6558dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81d07a48001448da49463444ac209da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-310bcfa1-decb-41fb-a204-9f0cccb726d1 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Request method failure captured: Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 39 Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_FoDyO5Z5Ra8ezUNPa6tUHiRQOhbuTBRemuTzD-Ge7iFstQsXC0FIoov8Wb-tVwmeFWpyvfBJG1OzNr3A74cbVDTZLJgf_lxUCy3srCYHCI4TI2YNulrJMZgEj1_XL_zkDYF8CUu-GTbko8uJkklXjSpfWcokzhXI1jsDW7oUFQuc Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: b81d07a48001448da49463444ac209da Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:38.498988 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b81d07a48001448da49463444ac209da", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b81d07a48001448da49463444ac209da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b81d07a48001448da49463444ac209da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b81d07a48001448da49463444ac209da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: b81d07a48001448da49463444ac209da Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AggregatesAdminNegativeTestJSON-426262599-project Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 9ce0dcabe3d5429b8015f660a6558dc4 Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-426262599-project Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: {"add_host": {"host": "n-h1-844626-8"}} Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:38.500608 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-844626-8'}}} Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:38.501568 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 09 14:31:38.503076 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:38.508475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-310bcfa1-decb-41fb-a204-9f0cccb726d1 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:38.510794 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-310bcfa1-decb-41fb-a204-9f0cccb726d1 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.328418 Aug 09 14:31:38.511532 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 153/295] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:31:38 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 331 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:31:38.534153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b252a05f-f959-4ca7-b779-7a0149661f9f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:38.537178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b252a05f-f959-4ca7-b779-7a0149661f9f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:38.555784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b252a05f-f959-4ca7-b779-7a0149661f9f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:38.565200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b252a05f-f959-4ca7-b779-7a0149661f9f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:38.568843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b252a05f-f959-4ca7-b779-7a0149661f9f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:38.570904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b252a05f-f959-4ca7-b779-7a0149661f9f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:38.573175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b252a05f-f959-4ca7-b779-7a0149661f9f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:38.574259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b252a05f-f959-4ca7-b779-7a0149661f9f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:38.871643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-33bf51e2-8349-4475-ba7e-8db019ae9a77 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:38.890813 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-33bf51e2-8349-4475-ba7e-8db019ae9a77 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1321 microversion: 2.1 time: 0.742326 Aug 09 14:31:38.894178 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 143/296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:38 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1321 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:38.909348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-608a8431-ff54-46cf-96c6-705b689cc833 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:38.915844 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:38.915844 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:38.994857 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-608a8431-ff54-46cf-96c6-705b689cc833 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.094760 Aug 09 14:31:38.996290 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 144/297] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:31:38 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:38.997315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b252a05f-f959-4ca7-b779-7a0149661f9f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:39.010781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-dd5d0004-5668-4560-ad93-9260db06fd48 req-6bb5b8d9-c89c-4948-a7f5-dc359117dd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c4fd60-05f3-4849-9278-267334ae8ce4", "name": "network-vif-deleted", "tag": "e139787c-315b-43e9-8513-11c3d196300f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:39.011883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b252a05f-f959-4ca7-b779-7a0149661f9f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:39.013767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b252a05f-f959-4ca7-b779-7a0149661f9f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:39.020944 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b252a05f-f959-4ca7-b779-7a0149661f9f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1361 microversion: 2.25 time: 0.506866 Aug 09 14:31:39.035007 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 154/298] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:38 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1361 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:39.046857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce9f35f4-246d-4ff2-8c0e-b6bb391b276e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:39.051956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ce9f35f4-246d-4ff2-8c0e-b6bb391b276e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:39.065203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce9f35f4-246d-4ff2-8c0e-b6bb391b276e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.066931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dd5d0004-5668-4560-ad93-9260db06fd48 req-6bb5b8d9-c89c-4948-a7f5-dc359117dd20 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.067487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dd5d0004-5668-4560-ad93-9260db06fd48 req-6bb5b8d9-c89c-4948-a7f5-dc359117dd20 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.067864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce9f35f4-246d-4ff2-8c0e-b6bb391b276e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.067990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dd5d0004-5668-4560-ad93-9260db06fd48 req-6bb5b8d9-c89c-4948-a7f5-dc359117dd20 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.068549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce9f35f4-246d-4ff2-8c0e-b6bb391b276e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.069537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce9f35f4-246d-4ff2-8c0e-b6bb391b276e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.075788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce9f35f4-246d-4ff2-8c0e-b6bb391b276e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.076506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce9f35f4-246d-4ff2-8c0e-b6bb391b276e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.104967 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ce9f35f4-246d-4ff2-8c0e-b6bb391b276e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] HTTP exception thrown: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce9f35f4-246d-4ff2-8c0e-b6bb391b276e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Request method failure captured: Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 HTTP/1.1 Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-GXnsaOUjMizHPiuKEVzMmLDm1p4-Erfruo3yxwmAViTRH150_T4qmkSCJe9EVL8QMsuZhgW1XtoPKOthLUk0M9W-oESTz8t622U4c4YkjNyXa34DiFHYxSUFRw8Z5RErTEij5SvhdhAF8N1ocQLXLR2-zhtq95TG5h2_lk_2B9TY Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: fb69ef1d43a24edcbbc99882cbf52f5b Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:39.106683 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:39.108149 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fb69ef1d43a24edcbbc99882cbf52f5b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:39.108149 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.108149 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: fb69ef1d43a24edcbbc99882cbf52f5b Aug 09 14:31:39.108149 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.108149 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersAdminTestJSON-1992007047-project Aug 09 14:31:39.108149 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:39.108149 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:39.108149 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3e3b1bc0133f4e848eeccd53e141f6d2 Aug 09 14:31:39.108149 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersAdminTestJSON-1992007047-project Aug 09 14:31:39.108149 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:39.108149 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.108149 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'e3c4fd60-05f3-4849-9278-267334ae8ce4'} Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:39.108908 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.110045 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.111650 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-dd5d0004-5668-4560-ad93-9260db06fd48 req-6bb5b8d9-c89c-4948-a7f5-dc359117dd20 service nova] Creating event network-vif-deleted:e139787c-315b-43e9-8513-11c3d196300f for instance e3c4fd60-05f3-4849-9278-267334ae8ce4 on n-h2-844626-8 Aug 09 14:31:39.114730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce9f35f4-246d-4ff2-8c0e-b6bb391b276e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Returning 404 to user: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:39.118902 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ce9f35f4-246d-4ff2-8c0e-b6bb391b276e tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 404 len: 111 microversion: 2.1 time: 0.082569 Aug 09 14:31:39.119731 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 155/299] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:39 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:39.120059 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-dd5d0004-5668-4560-ad93-9260db06fd48 req-6bb5b8d9-c89c-4948-a7f5-dc359117dd20 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117744 Aug 09 14:31:39.121068 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 145/300] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:39.134758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db050b24-bd48-4a27-a23a-9ecfeb7e325b tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1968556594"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:39.138084 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:39.138084 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:39.139267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-db050b24-bd48-4a27-a23a-9ecfeb7e325b tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Generated uuid ed83a7d7-962c-4ac7-b8f0-6b60cb4c2389 for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:39.139608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82e892e4-b83a-455d-bd6a-e7cb9a62f096 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:39.140185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82e892e4-b83a-455d-bd6a-e7cb9a62f096 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:39.151399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82e892e4-b83a-455d-bd6a-e7cb9a62f096 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.151839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82e892e4-b83a-455d-bd6a-e7cb9a62f096 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.152262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82e892e4-b83a-455d-bd6a-e7cb9a62f096 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.152956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82e892e4-b83a-455d-bd6a-e7cb9a62f096 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.153435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82e892e4-b83a-455d-bd6a-e7cb9a62f096 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.153846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82e892e4-b83a-455d-bd6a-e7cb9a62f096 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.186553 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db050b24-bd48-4a27-a23a-9ecfeb7e325b tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.065453 Aug 09 14:31:39.187767 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 156/301] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:39.198367 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-82e892e4-b83a-455d-bd6a-e7cb9a62f096 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] HTTP exception thrown: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.199888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c94c3b1a-617a-45a2-bdd5-3fcdb40d7210 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1881241152"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:39.202683 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:39.202683 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82e892e4-b83a-455d-bd6a-e7cb9a62f096 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Request method failure captured: Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 HTTP/1.1 Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-GXnsaOUjMizHPiuKEVzMmLDm1p4-Erfruo3yxwmAViTRH150_T4qmkSCJe9EVL8QMsuZhgW1XtoPKOthLUk0M9W-oESTz8t622U4c4YkjNyXa34DiFHYxSUFRw8Z5RErTEij5SvhdhAF8N1ocQLXLR2-zhtq95TG5h2_lk_2B9TY Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: fb69ef1d43a24edcbbc99882cbf52f5b Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:31:39.205684 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:31:39.207099 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fb69ef1d43a24edcbbc99882cbf52f5b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:39.207099 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.207099 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: fb69ef1d43a24edcbbc99882cbf52f5b Aug 09 14:31:39.207099 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.207099 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersAdminTestJSON-1992007047-project Aug 09 14:31:39.207099 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:39.207099 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:39.207099 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 3e3b1bc0133f4e848eeccd53e141f6d2 Aug 09 14:31:39.207099 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersAdminTestJSON-1992007047-project Aug 09 14:31:39.207099 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:39.207099 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.207099 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'e3c4fd60-05f3-4849-9278-267334ae8ce4'} Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:39.207932 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.209251 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.210613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82e892e4-b83a-455d-bd6a-e7cb9a62f096 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Returning 404 to user: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:39.210613 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82e892e4-b83a-455d-bd6a-e7cb9a62f096 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 404 len: 111 microversion: 2.1 time: 0.072781 Aug 09 14:31:39.210613 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 146/302] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:31:39 2022] DELETE /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:39.221511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e34dd3e-d4e5-428f-9e84-c0795ce76c6b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:39.222123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8e34dd3e-d4e5-428f-9e84-c0795ce76c6b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: e3c4fd60-05f3-4849-9278-267334ae8ce4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:39.241099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c94c3b1a-617a-45a2-bdd5-3fcdb40d7210 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.241700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e34dd3e-d4e5-428f-9e84-c0795ce76c6b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.241949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c94c3b1a-617a-45a2-bdd5-3fcdb40d7210 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.242236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e34dd3e-d4e5-428f-9e84-c0795ce76c6b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.242665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e34dd3e-d4e5-428f-9e84-c0795ce76c6b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.243597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e34dd3e-d4e5-428f-9e84-c0795ce76c6b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.244154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e34dd3e-d4e5-428f-9e84-c0795ce76c6b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.244569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e34dd3e-d4e5-428f-9e84-c0795ce76c6b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.251308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c94c3b1a-617a-45a2-bdd5-3fcdb40d7210 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.276557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c94c3b1a-617a-45a2-bdd5-3fcdb40d7210 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.277299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c94c3b1a-617a-45a2-bdd5-3fcdb40d7210 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.277925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c94c3b1a-617a-45a2-bdd5-3fcdb40d7210 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.292372 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-8e34dd3e-d4e5-428f-9e84-c0795ce76c6b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] HTTP exception thrown: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e34dd3e-d4e5-428f-9e84-c0795ce76c6b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Request method failure captured: Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 HTTP/1.1 Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-GXnsaOUjMizHPiuKEVzMmLDm1p4-Erfruo3yxwmAViTRH150_T4qmkSCJe9EVL8QMsuZhgW1XtoPKOthLUk0M9W-oESTz8t622U4c4YkjNyXa34DiFHYxSUFRw8Z5RErTEij5SvhdhAF8N1ocQLXLR2-zhtq95TG5h2_lk_2B9TY Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: fb69ef1d43a24edcbbc99882cbf52f5b Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:31:39.295534 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:31:39.296733 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fb69ef1d43a24edcbbc99882cbf52f5b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:39.296733 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.296733 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: fb69ef1d43a24edcbbc99882cbf52f5b Aug 09 14:31:39.296733 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.296733 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersAdminTestJSON-1992007047-project Aug 09 14:31:39.296733 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:39.296733 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:39.296733 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 3e3b1bc0133f4e848eeccd53e141f6d2 Aug 09 14:31:39.296733 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersAdminTestJSON-1992007047-project Aug 09 14:31:39.296733 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:39.296733 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.296733 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'e3c4fd60-05f3-4849-9278-267334ae8ce4'} Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:39.297395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. Aug 09 14:31:39.300775 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.302190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e34dd3e-d4e5-428f-9e84-c0795ce76c6b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Returning 404 to user: Instance e3c4fd60-05f3-4849-9278-267334ae8ce4 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:39.302190 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8e34dd3e-d4e5-428f-9e84-c0795ce76c6b tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4" status: 404 len: 111 microversion: 2.1 time: 0.084293 Aug 09 14:31:39.302190 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 147/303] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:39 2022] GET /compute/v2.1/servers/e3c4fd60-05f3-4849-9278-267334ae8ce4 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:39.307561 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-c94c3b1a-617a-45a2-bdd5-3fcdb40d7210 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1881241152 could not be found. Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c94c3b1a-617a-45a2-bdd5-3fcdb40d7210 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Request method failure captured: Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 58 Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_GYk1LBZlQHgaDwuoCTQ7ZmpjhaEJ8SPpUoh7as3d6e3zj0tdthh3IcZdOL5nzWeubaOsNYJV4cslMdCl_RpXzx3aX7-YC-BJVXrUnBQ_9Ymjoe1xyE3a_k_HqwQ7iX20DdytRv_MJEIYVBfjXNgNQ9ib0ZPx329jp_FAeObcvm-4 Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:31:39.310682 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a931190b3f6546c5a9ffd0c436771208", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 65f6c3962ac5488cbb90967fb42138a2 Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: {"add_host": {"host": "tempest-nonexist_host-1881241152"}} Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:39.312031 n-d-844626-8 devstack@n-api.service[119406]: exception: Compute host tempest-nonexist_host-1881241152 could not be found. Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1881241152'}}} Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5962, in _get_service_in_cell_by_host Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1881241152' is not mapped to any cell Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.312738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5968, in _get_service_in_cell_by_host Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6587, in add_host_to_aggregate Aug 09 14:31:39.313855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5970, in _get_service_in_cell_by_host Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1881241152 could not be found. Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1881241152 could not be found. Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.314945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.316073 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.316073 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.316073 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.316073 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:39.316073 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:39.316073 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1881241152 could not be found. Aug 09 14:31:39.316073 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.316555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3e267116-ea92-40c0-8dc3-40741ca1f828 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:39.316555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3e267116-ea92-40c0-8dc3-40741ca1f828 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:39.321773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c94c3b1a-617a-45a2-bdd5-3fcdb40d7210 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1881241152 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:39.323707 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c94c3b1a-617a-45a2-bdd5-3fcdb40d7210 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.128668 Aug 09 14:31:39.325173 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 157/304] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:31:39 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:39.337691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e267116-ea92-40c0-8dc3-40741ca1f828 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.339244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e267116-ea92-40c0-8dc3-40741ca1f828 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.340534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e267116-ea92-40c0-8dc3-40741ca1f828 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.341407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e267116-ea92-40c0-8dc3-40741ca1f828 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.345088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e267116-ea92-40c0-8dc3-40741ca1f828 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.345527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e267116-ea92-40c0-8dc3-40741ca1f828 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.347234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7148742f-bd4d-498d-abb6-7519801c1029 req-d3ce1a0e-4c9b-421d-aa34-933bf0aa9c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9124e955-056d-4c19-baa2-dbbfdcad5058", "name": "network-vif-plugged", "status": "completed", "tag": "f0f8dcb7-df02-4e0c-a16f-f9b2f9e6fe00"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:39.360699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7148742f-bd4d-498d-abb6-7519801c1029 req-d3ce1a0e-4c9b-421d-aa34-933bf0aa9c6b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.361627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7148742f-bd4d-498d-abb6-7519801c1029 req-d3ce1a0e-4c9b-421d-aa34-933bf0aa9c6b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.362334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7148742f-bd4d-498d-abb6-7519801c1029 req-d3ce1a0e-4c9b-421d-aa34-933bf0aa9c6b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.375273 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7148742f-bd4d-498d-abb6-7519801c1029 req-d3ce1a0e-4c9b-421d-aa34-933bf0aa9c6b service nova] Creating event network-vif-plugged:f0f8dcb7-df02-4e0c-a16f-f9b2f9e6fe00 for instance 9124e955-056d-4c19-baa2-dbbfdcad5058 on n-h2-844626-8 Aug 09 14:31:39.380366 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-3e267116-ea92-40c0-8dc3-40741ca1f828 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] HTTP exception thrown: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3e267116-ea92-40c0-8dc3-40741ca1f828 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Request method failure captured: Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 HTTP/1.1 Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-GXnsaOUjMizHPiuKEVzMmLDm1p4-Erfruo3yxwmAViTRH150_T4qmkSCJe9EVL8QMsuZhgW1XtoPKOthLUk0M9W-oESTz8t622U4c4YkjNyXa34DiFHYxSUFRw8Z5RErTEij5SvhdhAF8N1ocQLXLR2-zhtq95TG5h2_lk_2B9TY Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: fb69ef1d43a24edcbbc99882cbf52f5b Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:31:39.384032 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:31:39.385415 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fb69ef1d43a24edcbbc99882cbf52f5b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:39.385415 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.385415 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: fb69ef1d43a24edcbbc99882cbf52f5b Aug 09 14:31:39.385415 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.385415 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersAdminTestJSON-1992007047-project Aug 09 14:31:39.385415 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:39.385415 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:39.385415 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 3e3b1bc0133f4e848eeccd53e141f6d2 Aug 09 14:31:39.385415 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersAdminTestJSON-1992007047-project Aug 09 14:31:39.385415 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:39.385415 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:39.385415 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'af232722-6385-4af0-b196-3f72b6bbc5f7'} Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:39.386183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:39.387470 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.391441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3e267116-ea92-40c0-8dc3-40741ca1f828 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Returning 404 to user: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:39.393407 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3e267116-ea92-40c0-8dc3-40741ca1f828 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "DELETE /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 404 len: 111 microversion: 2.1 time: 0.091440 Aug 09 14:31:39.399685 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 148/305] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:31:39 2022] DELETE /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:39.405933 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7148742f-bd4d-498d-abb6-7519801c1029 req-d3ce1a0e-4c9b-421d-aa34-933bf0aa9c6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079098 Aug 09 14:31:39.407411 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 158/306] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:39.416473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf007bf0-a6a1-414e-ab78-6cd4bed314d2 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:39.418049 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:39.418049 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:39.419808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a2321598-0194-4873-8d1e-46d3a355a136 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:39.421627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a2321598-0194-4873-8d1e-46d3a355a136 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] [instance: af232722-6385-4af0-b196-3f72b6bbc5f7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:39.430160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2321598-0194-4873-8d1e-46d3a355a136 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.431001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2321598-0194-4873-8d1e-46d3a355a136 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.431855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2321598-0194-4873-8d1e-46d3a355a136 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.433042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2321598-0194-4873-8d1e-46d3a355a136 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.435398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2321598-0194-4873-8d1e-46d3a355a136 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.436374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2321598-0194-4873-8d1e-46d3a355a136 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.466289 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-a2321598-0194-4873-8d1e-46d3a355a136 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] HTTP exception thrown: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a2321598-0194-4873-8d1e-46d3a355a136 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Request method failure captured: Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 HTTP/1.1 Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-GXnsaOUjMizHPiuKEVzMmLDm1p4-Erfruo3yxwmAViTRH150_T4qmkSCJe9EVL8QMsuZhgW1XtoPKOthLUk0M9W-oESTz8t622U4c4YkjNyXa34DiFHYxSUFRw8Z5RErTEij5SvhdhAF8N1ocQLXLR2-zhtq95TG5h2_lk_2B9TY Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: fb69ef1d43a24edcbbc99882cbf52f5b Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:39.469126 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:39.470347 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fb69ef1d43a24edcbbc99882cbf52f5b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb69ef1d43a24edcbbc99882cbf52f5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:39.470347 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.470347 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: fb69ef1d43a24edcbbc99882cbf52f5b Aug 09 14:31:39.470347 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1992007047 Aug 09 14:31:39.470347 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersAdminTestJSON-1992007047-project Aug 09 14:31:39.470347 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:39.470347 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:39.470347 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3e3b1bc0133f4e848eeccd53e141f6d2 Aug 09 14:31:39.470347 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersAdminTestJSON-1992007047-project Aug 09 14:31:39.470347 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:39.470347 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:39.470347 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'af232722-6385-4af0-b196-3f72b6bbc5f7'} Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:39.471046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. Aug 09 14:31:39.472839 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.478150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a2321598-0194-4873-8d1e-46d3a355a136 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] Returning 404 to user: Instance af232722-6385-4af0-b196-3f72b6bbc5f7 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:39.479968 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a2321598-0194-4873-8d1e-46d3a355a136 tempest-DeleteServersAdminTestJSON-1992007047 tempest-DeleteServersAdminTestJSON-1992007047-project] 10.222.0.50 "GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7" status: 404 len: 111 microversion: 2.1 time: 0.065213 Aug 09 14:31:39.484623 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf007bf0-a6a1-414e-ab78-6cd4bed314d2 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.077549 Aug 09 14:31:39.490103 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 159/307] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:39 2022] GET /compute/v2.1/servers/af232722-6385-4af0-b196-3f72b6bbc5f7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:39.490684 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 149/308] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:31:39 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:39.499601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ff897c0-9df1-45cf-bd8b-8730e8144919 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ff897c0-9df1-45cf-bd8b-8730e8144919 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Request method failure captured: Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 283 Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_GYk1LBZlQHgaDwuoCTQ7ZmpjhaEJ8SPpUoh7as3d6e3zj0tdthh3IcZdOL5nzWeubaOsNYJV4cslMdCl_RpXzx3aX7-YC-BJVXrUnBQ_9Ymjoe1xyE3a_k_HqwQ7iX20DdytRv_MJEIYVBfjXNgNQ9ib0ZPx329jp_FAeObcvm-4 Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:31:39.507073 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:31:39.508315 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a931190b3f6546c5a9ffd0c436771208", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:39.508315 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:39.508315 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:39.508315 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:39.508315 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:39.508315 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:39.508315 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:39.508315 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 65f6c3962ac5488cbb90967fb42138a2 Aug 09 14:31:39.508315 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:39.508315 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:31:39.508947 n-d-844626-8 devstack@n-api.service[119407]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 09 14:31:39.508947 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:39.508947 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 14:31:39.508947 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 09 14:31:39.508947 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:39.508947 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.508947 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:31:39.508947 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:31:39.508947 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:31:39.508947 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:39.509554 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.517015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.518581 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:31:39.518581 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:31:39.518581 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 14:31:39.518581 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.518581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ff897c0-9df1-45cf-bd8b-8730e8144919 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:39.519994 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ff897c0-9df1-45cf-bd8b-8730e8144919 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.018883 Aug 09 14:31:39.519994 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 150/309] 10.222.0.50 () {60 vars in 1165 bytes} [Tue Aug 9 14:31:39 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:31:39.530633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94c59ff0-3324-49c0-83db-eb9f0516c255 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94c59ff0-3324-49c0-83db-eb9f0516c255 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Request method failure captured: Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 27 Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_GYk1LBZlQHgaDwuoCTQ7ZmpjhaEJ8SPpUoh7as3d6e3zj0tdthh3IcZdOL5nzWeubaOsNYJV4cslMdCl_RpXzx3aX7-YC-BJVXrUnBQ_9Ymjoe1xyE3a_k_HqwQ7iX20DdytRv_MJEIYVBfjXNgNQ9ib0ZPx329jp_FAeObcvm-4 Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:31:39.558941 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a931190b3f6546c5a9ffd0c436771208", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 65f6c3962ac5488cbb90967fb42138a2 Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: {"aggregate": {"name": ""}} Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:39.560221 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi '' Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:39.560932 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 09 14:31:39.563545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.566317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94c59ff0-3324-49c0-83db-eb9f0516c255 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:39.566317 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-94c59ff0-3324-49c0-83db-eb9f0516c255 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.043700 Aug 09 14:31:39.571015 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 160/310] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:39 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:31:39.579316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3789b962-740c-494c-b4e2-ebae15b8daeb tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1016769473"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:39.582235 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:39.582235 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:39.584644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3789b962-740c-494c-b4e2-ebae15b8daeb tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '9ce0dcabe3d5429b8015f660a6558dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81d07a48001448da49463444ac209da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3789b962-740c-494c-b4e2-ebae15b8daeb tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Request method failure captured: Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 60 Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_FoDyO5Z5Ra8ezUNPa6tUHiRQOhbuTBRemuTzD-Ge7iFstQsXC0FIoov8Wb-tVwmeFWpyvfBJG1OzNr3A74cbVDTZLJgf_lxUCy3srCYHCI4TI2YNulrJMZgEj1_XL_zkDYF8CUu-GTbko8uJkklXjSpfWcokzhXI1jsDW7oUFQuc Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: b81d07a48001448da49463444ac209da Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:31:39.589226 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b81d07a48001448da49463444ac209da", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b81d07a48001448da49463444ac209da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b81d07a48001448da49463444ac209da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b81d07a48001448da49463444ac209da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: b81d07a48001448da49463444ac209da Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AggregatesAdminNegativeTestJSON-426262599-project Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 9ce0dcabe3d5429b8015f660a6558dc4 Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-426262599-project Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: {"aggregate": {"name": "tempest-test_aggregate-1016769473"}} Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:39.590451 n-d-844626-8 devstack@n-api.service[119407]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1016769473'}}} Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:31:39.591187 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:31:39.592280 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 09 14:31:39.593305 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.596873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3789b962-740c-494c-b4e2-ebae15b8daeb tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:39.604361 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3789b962-740c-494c-b4e2-ebae15b8daeb tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.025330 Aug 09 14:31:39.611304 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 151/311] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:39 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:39.615769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1772dfdc-1783-422d-9bf1-5536a7a6228e tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1089795847"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:39.618512 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:39.618512 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:39.620156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-1772dfdc-1783-422d-9bf1-5536a7a6228e tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Generated uuid 2f861635-2b3a-41d2-a78e-ee4ae1f2a09b for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:39.702740 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1772dfdc-1783-422d-9bf1-5536a7a6228e tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.087668 Aug 09 14:31:39.703791 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 161/312] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:31:39.724104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7bf3d580-43a1-4c45-8cdf-2bb529be685a tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1089795847"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:39.729031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.aggregate [None req-7bf3d580-43a1-4c45-8cdf-2bb529be685a tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Generated uuid b1d06d10-b9a5-406c-9132-73558048e95c for aggregate {{(pid=119407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:39.767437 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-7bf3d580-43a1-4c45-8cdf-2bb529be685a tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1089795847 already exists. Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7bf3d580-43a1-4c45-8cdf-2bb529be685a tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Request method failure captured: Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 60 Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_GYk1LBZlQHgaDwuoCTQ7ZmpjhaEJ8SPpUoh7as3d6e3zj0tdthh3IcZdOL5nzWeubaOsNYJV4cslMdCl_RpXzx3aX7-YC-BJVXrUnBQ_9Ymjoe1xyE3a_k_HqwQ7iX20DdytRv_MJEIYVBfjXNgNQ9ib0ZPx329jp_FAeObcvm-4 Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:31:39.788883 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a931190b3f6546c5a9ffd0c436771208", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 65f6c3962ac5488cbb90967fb42138a2 Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: {"aggregate": {"name": "tempest-test_aggregate-1089795847"}} Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:39.790329 n-d-844626-8 devstack@n-api.service[119407]: exception: Aggregate tempest-test_aggregate-1089795847 already exists. Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1089795847'}}} Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6424, in create_aggregate Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 09 14:31:39.791222 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1089795847 already exists. Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:31:39.793321 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1089795847 already exists. Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1089795847 already exists. Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7bf3d580-43a1-4c45-8cdf-2bb529be685a tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1089795847 already exists. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:39.794611 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7bf3d580-43a1-4c45-8cdf-2bb529be685a tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.077021 Aug 09 14:31:39.795739 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 152/313] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:39 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:31:39.821405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23921789-855d-4285-9e45-1c71393238b8 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:39.823341 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:39.823341 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:39.871937 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-23921789-855d-4285-9e45-1c71393238b8 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.065396 Aug 09 14:31:39.896771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b6199249-721c-41d3-b3f9-ec552abd837a tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1166426209"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:39.898499 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 162/314] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:31:39 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:39.900526 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:39.900526 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:39.901789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.aggregate [None req-b6199249-721c-41d3-b3f9-ec552abd837a tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Generated uuid 263dca9d-e608-431b-b1c0-0829d1a8f2c6 for aggregate {{(pid=119407) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:39.925583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5319d74c-364e-4838-ac68-fcdec7787981 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:39.926932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5319d74c-364e-4838-ac68-fcdec7787981 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:39.937824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5319d74c-364e-4838-ac68-fcdec7787981 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.938586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5319d74c-364e-4838-ac68-fcdec7787981 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.939144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5319d74c-364e-4838-ac68-fcdec7787981 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.940439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5319d74c-364e-4838-ac68-fcdec7787981 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:39.941859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5319d74c-364e-4838-ac68-fcdec7787981 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:39.942574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5319d74c-364e-4838-ac68-fcdec7787981 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:39.967551 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b6199249-721c-41d3-b3f9-ec552abd837a tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.074250 Aug 09 14:31:39.972935 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 153/315] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:31:39.994386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a200b7ee-c1d6-49f7-9cd0-eccc67efa3c4 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:39.997232 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:39.997232 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:40.001746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a200b7ee-c1d6-49f7-9cd0-eccc67efa3c4 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '9ce0dcabe3d5429b8015f660a6558dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81d07a48001448da49463444ac209da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a200b7ee-c1d6-49f7-9cd0-eccc67efa3c4 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Request method failure captured: Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_FoDyO5Z5Ra8ezUNPa6tUHiRQOhbuTBRemuTzD-Ge7iFstQsXC0FIoov8Wb-tVwmeFWpyvfBJG1OzNr3A74cbVDTZLJgf_lxUCy3srCYHCI4TI2YNulrJMZgEj1_XL_zkDYF8CUu-GTbko8uJkklXjSpfWcokzhXI1jsDW7oUFQuc Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: b81d07a48001448da49463444ac209da Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:31:40.005542 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:31:40.006951 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b81d07a48001448da49463444ac209da", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b81d07a48001448da49463444ac209da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b81d07a48001448da49463444ac209da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b81d07a48001448da49463444ac209da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:40.006951 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:40.006951 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: b81d07a48001448da49463444ac209da Aug 09 14:31:40.006951 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:40.006951 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AggregatesAdminNegativeTestJSON-426262599-project Aug 09 14:31:40.006951 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:40.006951 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:40.006951 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 9ce0dcabe3d5429b8015f660a6558dc4 Aug 09 14:31:40.006951 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-426262599-project Aug 09 14:31:40.006951 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:40.006951 n-d-844626-8 devstack@n-api.service[119407]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 09 14:31:40.006951 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '15'} Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:40.007917 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 09 14:31:40.009103 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:40.011658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a200b7ee-c1d6-49f7-9cd0-eccc67efa3c4 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:40.015584 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a200b7ee-c1d6-49f7-9cd0-eccc67efa3c4 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.033479 Aug 09 14:31:40.016799 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 154/316] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:31:39 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:40.028276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b95d650f-ea76-4d86-a6c7-1564cdb313b2 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:40.101025 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b95d650f-ea76-4d86-a6c7-1564cdb313b2 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.078289 Aug 09 14:31:40.104353 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 155/317] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:31:40 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:40.116753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05cff4bd-493e-42a2-8847-55dbbccb708d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:40.117403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05cff4bd-493e-42a2-8847-55dbbccb708d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:40.136515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05cff4bd-493e-42a2-8847-55dbbccb708d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:40.138565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05cff4bd-493e-42a2-8847-55dbbccb708d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:40.139000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05cff4bd-493e-42a2-8847-55dbbccb708d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:40.140818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05cff4bd-493e-42a2-8847-55dbbccb708d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:40.141482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05cff4bd-493e-42a2-8847-55dbbccb708d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:40.142829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05cff4bd-493e-42a2-8847-55dbbccb708d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:40.740343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5319d74c-364e-4838-ac68-fcdec7787981 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:40.752162 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5319d74c-364e-4838-ac68-fcdec7787981 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1321 microversion: 2.1 time: 0.840663 Aug 09 14:31:40.752774 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 163/318] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:39 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1321 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:40.772054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ba973dfa-969f-44a9-9bab-5d48737279c3 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:40.772988 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:40.772988 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:40.798252 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ba973dfa-969f-44a9-9bab-5d48737279c3 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ba973dfa-969f-44a9-9bab-5d48737279c3 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Request method failure captured: Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_GYk1LBZlQHgaDwuoCTQ7ZmpjhaEJ8SPpUoh7as3d6e3zj0tdthh3IcZdOL5nzWeubaOsNYJV4cslMdCl_RpXzx3aX7-YC-BJVXrUnBQ_9Ymjoe1xyE3a_k_HqwQ7iX20DdytRv_MJEIYVBfjXNgNQ9ib0ZPx329jp_FAeObcvm-4 Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:31:40.801937 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:31:40.803223 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a931190b3f6546c5a9ffd0c436771208", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:40.803223 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:40.803223 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:40.803223 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:40.803223 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:40.803223 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:40.803223 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:40.803223 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 65f6c3962ac5488cbb90967fb42138a2 Aug 09 14:31:40.803223 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:40.803223 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:40.803223 n-d-844626-8 devstack@n-api.service[119406]: exception: Aggregate -1 could not be found. Aug 09 14:31:40.803223 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '-1'} Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6483, in delete_aggregate Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 09 14:31:40.804080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:40.805410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:40.806571 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:40.806571 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:40.806571 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:40.806571 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:40.806571 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 09 14:31:40.806571 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:40.806571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ba973dfa-969f-44a9-9bab-5d48737279c3 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:40.806571 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ba973dfa-969f-44a9-9bab-5d48737279c3 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.049712 Aug 09 14:31:40.807795 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 164/319] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:31:40 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:31:40.827875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-345aaeed-40a4-462c-9f80-f0877b6525f1 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1618873787"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:40.834039 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:40.834039 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:40.837973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-345aaeed-40a4-462c-9f80-f0877b6525f1 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Generated uuid 4027c6c2-72fd-46c6-8975-876dd871dd08 for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:40.895456 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-345aaeed-40a4-462c-9f80-f0877b6525f1 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.082760 Aug 09 14:31:40.896272 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 165/320] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:40 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:40.911028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ebaae19-8869-4b78-b96b-3c29dd2c5129 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:40.912098 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:40.912098 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:40.914093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ebaae19-8869-4b78-b96b-3c29dd2c5129 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '9ce0dcabe3d5429b8015f660a6558dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81d07a48001448da49463444ac209da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ebaae19-8869-4b78-b96b-3c29dd2c5129 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Request method failure captured: Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_FoDyO5Z5Ra8ezUNPa6tUHiRQOhbuTBRemuTzD-Ge7iFstQsXC0FIoov8Wb-tVwmeFWpyvfBJG1OzNr3A74cbVDTZLJgf_lxUCy3srCYHCI4TI2YNulrJMZgEj1_XL_zkDYF8CUu-GTbko8uJkklXjSpfWcokzhXI1jsDW7oUFQuc Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: b81d07a48001448da49463444ac209da Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:40.916162 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:40.918462 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b81d07a48001448da49463444ac209da", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b81d07a48001448da49463444ac209da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b81d07a48001448da49463444ac209da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b81d07a48001448da49463444ac209da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:40.918462 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:40.918462 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: b81d07a48001448da49463444ac209da Aug 09 14:31:40.918462 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:40.918462 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AggregatesAdminNegativeTestJSON-426262599-project Aug 09 14:31:40.918462 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:40.918462 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:40.918462 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 9ce0dcabe3d5429b8015f660a6558dc4 Aug 09 14:31:40.918462 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-426262599-project Aug 09 14:31:40.918462 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:40.918462 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 09 14:31:40.918462 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '16'} Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:40.919458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:40.920815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ebaae19-8869-4b78-b96b-3c29dd2c5129 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:40.922621 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ebaae19-8869-4b78-b96b-3c29dd2c5129 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] 10.222.0.50 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.014476 Aug 09 14:31:40.927025 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 166/321] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:40 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:31:40.959145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a22e38a-f313-4e30-84c9-b3f285be89ff tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:40.968369 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:40.968369 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:41.038976 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5a22e38a-f313-4e30-84c9-b3f285be89ff tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.099633 Aug 09 14:31:41.041518 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 167/322] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:31:40 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:41.062163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9890722e-a6ce-467f-acaf-e172bc152896 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:41.063402 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:41.063402 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:41.073191 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-9890722e-a6ce-467f-acaf-e172bc152896 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9890722e-a6ce-467f-acaf-e172bc152896 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Request method failure captured: Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_GYk1LBZlQHgaDwuoCTQ7ZmpjhaEJ8SPpUoh7as3d6e3zj0tdthh3IcZdOL5nzWeubaOsNYJV4cslMdCl_RpXzx3aX7-YC-BJVXrUnBQ_9Ymjoe1xyE3a_k_HqwQ7iX20DdytRv_MJEIYVBfjXNgNQ9ib0ZPx329jp_FAeObcvm-4 Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:31:41.077161 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:31:41.078464 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a931190b3f6546c5a9ffd0c436771208", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:41.078464 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:41.078464 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:41.078464 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:41.078464 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:41.078464 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:41.078464 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:41.078464 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 65f6c3962ac5488cbb90967fb42138a2 Aug 09 14:31:41.078464 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:41.078464 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:41.078464 n-d-844626-8 devstack@n-api.service[119406]: exception: Aggregate -1 could not be found. Aug 09 14:31:41.078464 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '-1'} Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6430, in get_aggregate Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:41.079181 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 09 14:31:41.080539 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:41.084605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9890722e-a6ce-467f-acaf-e172bc152896 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:41.084605 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9890722e-a6ce-467f-acaf-e172bc152896 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.032025 Aug 09 14:31:41.084605 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 168/323] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:41 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:31:41.095336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ffedbd53-2b2c-4876-8997-031aa7870369 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:41.096415 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:41.096415 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:41.097337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ffedbd53-2b2c-4876-8997-031aa7870369 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '9ce0dcabe3d5429b8015f660a6558dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81d07a48001448da49463444ac209da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ffedbd53-2b2c-4876-8997-031aa7870369 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Request method failure captured: Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_FoDyO5Z5Ra8ezUNPa6tUHiRQOhbuTBRemuTzD-Ge7iFstQsXC0FIoov8Wb-tVwmeFWpyvfBJG1OzNr3A74cbVDTZLJgf_lxUCy3srCYHCI4TI2YNulrJMZgEj1_XL_zkDYF8CUu-GTbko8uJkklXjSpfWcokzhXI1jsDW7oUFQuc Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: b81d07a48001448da49463444ac209da Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:41.102171 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:41.103676 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b81d07a48001448da49463444ac209da", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b81d07a48001448da49463444ac209da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b81d07a48001448da49463444ac209da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b81d07a48001448da49463444ac209da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:41.103676 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:41.103676 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: b81d07a48001448da49463444ac209da Aug 09 14:31:41.103676 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:41.103676 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AggregatesAdminNegativeTestJSON-426262599-project Aug 09 14:31:41.103676 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:41.103676 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:41.103676 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 9ce0dcabe3d5429b8015f660a6558dc4 Aug 09 14:31:41.103676 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-426262599-project Aug 09 14:31:41.103676 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:41.103676 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 09 14:31:41.103676 n-d-844626-8 devstack@n-api.service[119406]: action_args: {} Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:41.104468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 09 14:31:41.105662 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:41.110589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ffedbd53-2b2c-4876-8997-031aa7870369 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:41.111729 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ffedbd53-2b2c-4876-8997-031aa7870369 tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.023877 Aug 09 14:31:41.114823 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 169/324] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:31:41 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:41.128387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-90b0ca20-a005-40a4-80da-3663a480904e tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-858899251"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:41.131705 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:41.131705 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:41.133997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-90b0ca20-a005-40a4-80da-3663a480904e tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Generated uuid 1c883336-06d7-4625-95d2-aeb21a32d9d7 for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:41.177510 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-90b0ca20-a005-40a4-80da-3663a480904e tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.057752 Aug 09 14:31:41.179366 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 170/325] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:41 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:31:41.190337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e2046281-4f14-49fd-853d-c7aace4196fe tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:41.194639 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:41.194639 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:41.200360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05cff4bd-493e-42a2-8847-55dbbccb708d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:41.219707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05cff4bd-493e-42a2-8847-55dbbccb708d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:41.219871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2046281-4f14-49fd-853d-c7aace4196fe tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:41.223237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2046281-4f14-49fd-853d-c7aace4196fe tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:41.223862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2046281-4f14-49fd-853d-c7aace4196fe tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:41.226722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05cff4bd-493e-42a2-8847-55dbbccb708d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:41.232392 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05cff4bd-493e-42a2-8847-55dbbccb708d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1361 microversion: 2.25 time: 1.124503 Aug 09 14:31:41.234975 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 156/326] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:40 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1361 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:41.456274 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e2046281-4f14-49fd-853d-c7aace4196fe tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.270118 Aug 09 14:31:41.457141 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 171/327] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:31:41 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:31:41.475911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d6b14c9e-0d79-49c5-a161-a3b198a901ca tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-844626-8"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:41.478644 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:41.478644 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:41.485870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d6b14c9e-0d79-49c5-a161-a3b198a901ca tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '9ce0dcabe3d5429b8015f660a6558dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b81d07a48001448da49463444ac209da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d6b14c9e-0d79-49c5-a161-a3b198a901ca tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Request method failure captured: Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 42 Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_FoDyO5Z5Ra8ezUNPa6tUHiRQOhbuTBRemuTzD-Ge7iFstQsXC0FIoov8Wb-tVwmeFWpyvfBJG1OzNr3A74cbVDTZLJgf_lxUCy3srCYHCI4TI2YNulrJMZgEj1_XL_zkDYF8CUu-GTbko8uJkklXjSpfWcokzhXI1jsDW7oUFQuc Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: b81d07a48001448da49463444ac209da Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:31:41.487590 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b81d07a48001448da49463444ac209da", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b81d07a48001448da49463444ac209da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b81d07a48001448da49463444ac209da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b81d07a48001448da49463444ac209da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: b81d07a48001448da49463444ac209da Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-426262599 Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AggregatesAdminNegativeTestJSON-426262599-project Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 9ce0dcabe3d5429b8015f660a6558dc4 Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-426262599-project Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: {"remove_host": {"host": "n-h1-844626-8"}} Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:31:41.488810 n-d-844626-8 devstack@n-api.service[119407]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-844626-8'}}} Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:41.489601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 09 14:31:41.490620 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:31:41.491961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d6b14c9e-0d79-49c5-a161-a3b198a901ca tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:41.491961 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d6b14c9e-0d79-49c5-a161-a3b198a901ca tempest-AggregatesAdminNegativeTestJSON-426262599 tempest-AggregatesAdminNegativeTestJSON-426262599-project] 10.222.0.50 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.021221 Aug 09 14:31:41.491961 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 157/328] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:31:41 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:41.499006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c38e3fdb-d682-47e6-9797-4aeef79236c1 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:41.501820 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:41.501820 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:41.529533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c38e3fdb-d682-47e6-9797-4aeef79236c1 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:41.530780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c38e3fdb-d682-47e6-9797-4aeef79236c1 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:41.532827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c38e3fdb-d682-47e6-9797-4aeef79236c1 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:41.790666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-804573b2-bb9a-47f9-afaa-1f50e11b116a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:41.795293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-804573b2-bb9a-47f9-afaa-1f50e11b116a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:41.827437 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c38e3fdb-d682-47e6-9797-4aeef79236c1 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.333251 Aug 09 14:31:41.831920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-804573b2-bb9a-47f9-afaa-1f50e11b116a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:41.832386 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 172/329] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:31:41 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:41.833040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-804573b2-bb9a-47f9-afaa-1f50e11b116a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:41.834595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-804573b2-bb9a-47f9-afaa-1f50e11b116a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:41.843677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-804573b2-bb9a-47f9-afaa-1f50e11b116a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:41.844748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-804573b2-bb9a-47f9-afaa-1f50e11b116a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:41.845471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-804573b2-bb9a-47f9-afaa-1f50e11b116a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:41.848700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6bf1343a-09ad-48b9-9fd8-0a3bfeba9e86 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:41.850622 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:41.850622 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:41.933532 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6bf1343a-09ad-48b9-9fd8-0a3bfeba9e86 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.093167 Aug 09 14:31:41.935634 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 173/330] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:31:41 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:41.952839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0172e6be-9497-468a-8b3a-fc7dc152549b tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1752359442"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:41.960134 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:41.960134 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:41.969046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-0172e6be-9497-468a-8b3a-fc7dc152549b tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Generated uuid 510c85f6-72a0-431f-b875-a4095cbd4ea1 for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:31:42.077752 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0172e6be-9497-468a-8b3a-fc7dc152549b tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.125723 Aug 09 14:31:42.079571 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 174/331] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:31:41 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:42.093540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a79aa16-882d-4808-aa4f-0005a27cf027 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:42.096765 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:42.096765 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:42.140893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a79aa16-882d-4808-aa4f-0005a27cf027 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:42.142429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a79aa16-882d-4808-aa4f-0005a27cf027 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:42.144285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a79aa16-882d-4808-aa4f-0005a27cf027 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:42.158669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a79aa16-882d-4808-aa4f-0005a27cf027 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:42.159221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a79aa16-882d-4808-aa4f-0005a27cf027 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:42.159648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a79aa16-882d-4808-aa4f-0005a27cf027 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:42.195579 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.compute.aggregates [None req-9a79aa16-882d-4808-aa4f-0005a27cf027 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 09 14:31:42.196157 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-9a79aa16-882d-4808-aa4f-0005a27cf027 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a79aa16-882d-4808-aa4f-0005a27cf027 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Request method failure captured: Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 42 Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_GYk1LBZlQHgaDwuoCTQ7ZmpjhaEJ8SPpUoh7as3d6e3zj0tdthh3IcZdOL5nzWeubaOsNYJV4cslMdCl_RpXzx3aX7-YC-BJVXrUnBQ_9Ymjoe1xyE3a_k_HqwQ7iX20DdytRv_MJEIYVBfjXNgNQ9ib0ZPx329jp_FAeObcvm-4 Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:31:42.203645 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a931190b3f6546c5a9ffd0c436771208", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a931190b3f6546c5a9ffd0c436771208"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a931190b3f6546c5a9ffd0c436771208 Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-696050761 Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 65f6c3962ac5488cbb90967fb42138a2 Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: {"remove_host": {"host": "nonexist_host"}} Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:31:42.205204 n-d-844626-8 devstack@n-api.service[119406]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5962, in _get_service_in_cell_by_host Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5968, in _get_service_in_cell_by_host Aug 09 14:31:42.206098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6649, in remove_host_from_aggregate Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 09 14:31:42.207412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5970, in _get_service_in_cell_by_host Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:42.209055 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:42.210398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:42.210398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:42.210398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:42.210398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:42.210398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 09 14:31:42.210398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:42.216306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a79aa16-882d-4808-aa4f-0005a27cf027 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:42.217487 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a79aa16-882d-4808-aa4f-0005a27cf027 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.130894 Aug 09 14:31:42.218276 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 175/332] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:31:42 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 09 14:31:42.231874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e3fa35a9-23be-4ca1-bf71-018703697cd7 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:42.234052 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:42.234052 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:42.301866 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e3fa35a9-23be-4ca1-bf71-018703697cd7 tempest-AggregatesAdminNegativeTestJSON-696050761 tempest-AggregatesAdminNegativeTestJSON-696050761-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.078652 Aug 09 14:31:42.302809 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 176/333] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:31:42 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:31:42.319458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a700520e-5403-4999-832d-d06d8ae734b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:42.320494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a700520e-5403-4999-832d-d06d8ae734b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:42.338399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a700520e-5403-4999-832d-d06d8ae734b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:42.345909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a700520e-5403-4999-832d-d06d8ae734b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:42.346491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a700520e-5403-4999-832d-d06d8ae734b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:42.347296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a700520e-5403-4999-832d-d06d8ae734b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:42.347762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a700520e-5403-4999-832d-d06d8ae734b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:42.348179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a700520e-5403-4999-832d-d06d8ae734b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:42.547236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-804573b2-bb9a-47f9-afaa-1f50e11b116a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:42.560826 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-804573b2-bb9a-47f9-afaa-1f50e11b116a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1321 microversion: 2.1 time: 0.783545 Aug 09 14:31:42.562229 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 158/334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:41 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1321 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:42.862668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a700520e-5403-4999-832d-d06d8ae734b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:42.885670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a700520e-5403-4999-832d-d06d8ae734b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:42.892118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a700520e-5403-4999-832d-d06d8ae734b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:42.893291 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a700520e-5403-4999-832d-d06d8ae734b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1361 microversion: 2.25 time: 0.588406 Aug 09 14:31:42.911309 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 177/335] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:42 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1361 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:43.582079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-346da007-d03a-4a50-bb53-6932266f897e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:43.583458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-346da007-d03a-4a50-bb53-6932266f897e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:43.594831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=11,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:43.598552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-346da007-d03a-4a50-bb53-6932266f897e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:43.603305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-346da007-d03a-4a50-bb53-6932266f897e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:43.603305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-346da007-d03a-4a50-bb53-6932266f897e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:43.605308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-346da007-d03a-4a50-bb53-6932266f897e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:43.607383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-346da007-d03a-4a50-bb53-6932266f897e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:43.608004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-346da007-d03a-4a50-bb53-6932266f897e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:43.758933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-58eb3cf9-f03b-47de-8dfe-83a65f19edcc req-1eab0da8-1b16-4daf-9282-463051112a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50063b74-64e4-46e0-a842-cfd6735d25ac", "name": "network-vif-plugged", "status": "completed", "tag": "fc3132c5-cc58-4ae3-a9ab-ada9e2c1a56d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:43.774996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-58eb3cf9-f03b-47de-8dfe-83a65f19edcc req-1eab0da8-1b16-4daf-9282-463051112a69 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:43.775953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-58eb3cf9-f03b-47de-8dfe-83a65f19edcc req-1eab0da8-1b16-4daf-9282-463051112a69 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:43.777664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-58eb3cf9-f03b-47de-8dfe-83a65f19edcc req-1eab0da8-1b16-4daf-9282-463051112a69 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:43.806791 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-58eb3cf9-f03b-47de-8dfe-83a65f19edcc req-1eab0da8-1b16-4daf-9282-463051112a69 service nova] Creating event network-vif-plugged:fc3132c5-cc58-4ae3-a9ab-ada9e2c1a56d for instance 50063b74-64e4-46e0-a842-cfd6735d25ac on n-h1-844626-8 Aug 09 14:31:43.814193 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-58eb3cf9-f03b-47de-8dfe-83a65f19edcc req-1eab0da8-1b16-4daf-9282-463051112a69 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059160 Aug 09 14:31:43.815204 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 178/336] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:31:43.923415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5eaf5e5-497d-4206-af97-f4af12497bb0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:43.924176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c5eaf5e5-497d-4206-af97-f4af12497bb0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:43.952966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5eaf5e5-497d-4206-af97-f4af12497bb0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:43.955636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5eaf5e5-497d-4206-af97-f4af12497bb0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:43.956076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5eaf5e5-497d-4206-af97-f4af12497bb0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:43.959134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5eaf5e5-497d-4206-af97-f4af12497bb0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:43.959844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5eaf5e5-497d-4206-af97-f4af12497bb0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:43.960467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5eaf5e5-497d-4206-af97-f4af12497bb0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:44.199348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-346da007-d03a-4a50-bb53-6932266f897e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:44.206849 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-346da007-d03a-4a50-bb53-6932266f897e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1321 microversion: 2.1 time: 0.628802 Aug 09 14:31:44.219456 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 159/337] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:43 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1321 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:44.576908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5eaf5e5-497d-4206-af97-f4af12497bb0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:44.596624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5eaf5e5-497d-4206-af97-f4af12497bb0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:44.598408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5eaf5e5-497d-4206-af97-f4af12497bb0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:44.599716 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c5eaf5e5-497d-4206-af97-f4af12497bb0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1361 microversion: 2.25 time: 0.683925 Aug 09 14:31:44.614655 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 179/338] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:43 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1361 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:31:44.943619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-657553871", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:45.020446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:31:45.230914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f6c183d5-8f2b-4416-9f38-f26d5bef7989 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:45.232321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f6c183d5-8f2b-4416-9f38-f26d5bef7989 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:45.245094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6c183d5-8f2b-4416-9f38-f26d5bef7989 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:45.245605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6c183d5-8f2b-4416-9f38-f26d5bef7989 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:45.248754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6c183d5-8f2b-4416-9f38-f26d5bef7989 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:45.250598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6c183d5-8f2b-4416-9f38-f26d5bef7989 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:45.254280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6c183d5-8f2b-4416-9f38-f26d5bef7989 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:45.255140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6c183d5-8f2b-4416-9f38-f26d5bef7989 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:45.697906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:31:45.698969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:31:45.699473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:31:45.699875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:31:45.700454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:31:45.720893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:45.731113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:45.734558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:45.735544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:45.736019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:45.736445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:45.797385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Getting quotas for project 21a086b8d4904e118283cea8eb12b678. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:31:45.814862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Getting quotas for user c45d9a126a0841d5938ee21e8e87b293 and project 21a086b8d4904e118283cea8eb12b678. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:31:45.821965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f6c183d5-8f2b-4416-9f38-f26d5bef7989 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:45.831450 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f6c183d5-8f2b-4416-9f38-f26d5bef7989 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1321 microversion: 2.1 time: 0.604142 Aug 09 14:31:45.833574 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 180/339] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:45 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1321 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:31:45.866225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:31:45.874173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:31:45.979929 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9cc655f8-fb59-49c7-a6a8-ec38b9a87243 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.287524 Aug 09 14:31:45.980641 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 160/340] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:31:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1289 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:31:45.985731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9586987-c190-42fe-89d1-35c0dd5f9a95 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:45.991190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a9586987-c190-42fe-89d1-35c0dd5f9a95 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:46.013957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9586987-c190-42fe-89d1-35c0dd5f9a95 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:46.014756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9586987-c190-42fe-89d1-35c0dd5f9a95 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:46.015519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9586987-c190-42fe-89d1-35c0dd5f9a95 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:46.016732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9586987-c190-42fe-89d1-35c0dd5f9a95 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:46.017380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9586987-c190-42fe-89d1-35c0dd5f9a95 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:46.017998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9586987-c190-42fe-89d1-35c0dd5f9a95 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:46.327688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-624034443", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "505d781d-685d-4f4d-90ea-300cf638095b"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:46.350450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=83,nova_api:DELETE=9 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:46.467604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] validate_networks() for [('505d781d-685d-4f4d-90ea-300cf638095b', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:31:46.854370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a9586987-c190-42fe-89d1-35c0dd5f9a95 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:46.865143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a9586987-c190-42fe-89d1-35c0dd5f9a95 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:46.866711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a9586987-c190-42fe-89d1-35c0dd5f9a95 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:46.875309 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a9586987-c190-42fe-89d1-35c0dd5f9a95 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1558 microversion: 2.25 time: 0.893342 Aug 09 14:31:46.875906 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 161/341] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:45 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1558 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:46.880639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afd9a2b7-4230-4008-89fd-b77ed9942ec5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:46.896525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-afd9a2b7-4230-4008-89fd-b77ed9942ec5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:47.089115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-afd9a2b7-4230-4008-89fd-b77ed9942ec5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:47.100784 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afd9a2b7-4230-4008-89fd-b77ed9942ec5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1212 microversion: 2.1 time: 0.221971 Aug 09 14:31:47.101970 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 162/342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:46 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1212 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:47.112255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2ed195df-2069-40be-8658-5ed8901de0f5 req-521c8991-6492-4d83-a1f1-7a7e3955827b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826994ac-b33d-487a-ad40-a26199875e31", "name": "network-vif-plugged", "status": "completed", "tag": "3f98b6bb-8a91-4cae-ae5a-187ccef422fd"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:47.139367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2ed195df-2069-40be-8658-5ed8901de0f5 req-521c8991-6492-4d83-a1f1-7a7e3955827b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:47.140575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2ed195df-2069-40be-8658-5ed8901de0f5 req-521c8991-6492-4d83-a1f1-7a7e3955827b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:47.141234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2ed195df-2069-40be-8658-5ed8901de0f5 req-521c8991-6492-4d83-a1f1-7a7e3955827b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:47.163536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:47.173538 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2ed195df-2069-40be-8658-5ed8901de0f5 req-521c8991-6492-4d83-a1f1-7a7e3955827b service nova] Creating event network-vif-plugged:3f98b6bb-8a91-4cae-ae5a-187ccef422fd for instance 826994ac-b33d-487a-ad40-a26199875e31 on n-h1-844626-8 Aug 09 14:31:47.214961 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2ed195df-2069-40be-8658-5ed8901de0f5 req-521c8991-6492-4d83-a1f1-7a7e3955827b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105749 Aug 09 14:31:47.217002 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 163/343] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:47.226484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a727ade3-2a3f-4f87-a0fd-533efea1475f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:47.228167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a727ade3-2a3f-4f87-a0fd-533efea1475f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:47.264303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a727ade3-2a3f-4f87-a0fd-533efea1475f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:47.270443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a727ade3-2a3f-4f87-a0fd-533efea1475f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:47.270992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a727ade3-2a3f-4f87-a0fd-533efea1475f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:47.271766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a727ade3-2a3f-4f87-a0fd-533efea1475f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:47.273683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a727ade3-2a3f-4f87-a0fd-533efea1475f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:47.274337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a727ade3-2a3f-4f87-a0fd-533efea1475f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:47.789800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a727ade3-2a3f-4f87-a0fd-533efea1475f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:47.806138 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a727ade3-2a3f-4f87-a0fd-533efea1475f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1321 microversion: 2.1 time: 0.586969 Aug 09 14:31:47.810194 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 164/344] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:47 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1321 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:48.075257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:31:48.076431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:31:48.096472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:31:48.097169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:31:48.097614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:31:48.123650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:48.124133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:48.126119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:48.127266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:48.131815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:48.134541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:48.195053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Getting quotas for project 2ed4c364ec984dd2911b76dc78702f88. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:31:48.203566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Getting quotas for user aaf9b49d50cb4967ab7dc88adc939769 and project 2ed4c364ec984dd2911b76dc78702f88. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:31:48.229626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:31:48.233681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:31:48.319790 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3017a18a-fa51-4b8c-b1e0-a96963e7d74c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.484538 Aug 09 14:31:48.320463 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 181/345] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:31:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:31:48.338469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e2737ae6-ec70-4f8f-a2c9-bab1e92d22d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:48.339193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e2737ae6-ec70-4f8f-a2c9-bab1e92d22d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:48.346828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2737ae6-ec70-4f8f-a2c9-bab1e92d22d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:48.353093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2737ae6-ec70-4f8f-a2c9-bab1e92d22d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:48.353676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2737ae6-ec70-4f8f-a2c9-bab1e92d22d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:48.356783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2737ae6-ec70-4f8f-a2c9-bab1e92d22d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:48.357260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2737ae6-ec70-4f8f-a2c9-bab1e92d22d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:48.357682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2737ae6-ec70-4f8f-a2c9-bab1e92d22d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:48.365339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-acc64113-ef1c-43fd-a947-900c729ebfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:48.369494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-acc64113-ef1c-43fd-a947-900c729ebfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:48.392795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acc64113-ef1c-43fd-a947-900c729ebfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:48.393614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acc64113-ef1c-43fd-a947-900c729ebfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:48.394665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acc64113-ef1c-43fd-a947-900c729ebfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:48.401066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acc64113-ef1c-43fd-a947-900c729ebfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:48.402005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acc64113-ef1c-43fd-a947-900c729ebfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:48.404905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acc64113-ef1c-43fd-a947-900c729ebfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:48.442307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e2737ae6-ec70-4f8f-a2c9-bab1e92d22d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:48.460616 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e2737ae6-ec70-4f8f-a2c9-bab1e92d22d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1270 microversion: 2.1 time: 0.126091 Aug 09 14:31:48.461579 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 182/346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:48 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1270 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:48.480553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-441738fa-e936-49c8-b845-f532efa29b91 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:48.481595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-441738fa-e936-49c8-b845-f532efa29b91 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:48.621316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-441738fa-e936-49c8-b845-f532efa29b91 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:48.630223 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-441738fa-e936-49c8-b845-f532efa29b91 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1231 microversion: 2.1 time: 0.167511 Aug 09 14:31:48.632207 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 183/347] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:48 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1231 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:48.633327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-441738fa-e936-49c8-b845-f532efa29b91 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:48.635577 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-441738fa-e936-49c8-b845-f532efa29b91 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002428 Aug 09 14:31:48.636134 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 184/348] 10.222.0.50 () {56 vars in 886 bytes} [Tue Aug 9 14:31:48 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 09 14:31:48.830073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94bd942d-eea4-40d1-85b9-5daa2c85d46d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:48.832237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-94bd942d-eea4-40d1-85b9-5daa2c85d46d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:48.851475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94bd942d-eea4-40d1-85b9-5daa2c85d46d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:48.853921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94bd942d-eea4-40d1-85b9-5daa2c85d46d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:48.854554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94bd942d-eea4-40d1-85b9-5daa2c85d46d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:48.859597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94bd942d-eea4-40d1-85b9-5daa2c85d46d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:48.860512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94bd942d-eea4-40d1-85b9-5daa2c85d46d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:48.863627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94bd942d-eea4-40d1-85b9-5daa2c85d46d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:48.953552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-acc64113-ef1c-43fd-a947-900c729ebfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 50063b74-64e4-46e0-a842-cfd6735d25ac {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:31:49.126046 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-acc64113-ef1c-43fd-a947-900c729ebfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 2050 microversion: 2.25 time: 1.312554 Aug 09 14:31:49.128977 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 165/349] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:47 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 2050 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:49.154514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4422cc56-1be2-454d-9fbc-a31adb382bf6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:49.155528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4422cc56-1be2-454d-9fbc-a31adb382bf6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:49.173051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4422cc56-1be2-454d-9fbc-a31adb382bf6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:49.173806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4422cc56-1be2-454d-9fbc-a31adb382bf6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:49.174517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4422cc56-1be2-454d-9fbc-a31adb382bf6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:49.181627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4422cc56-1be2-454d-9fbc-a31adb382bf6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:49.186406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4422cc56-1be2-454d-9fbc-a31adb382bf6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:49.187158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4422cc56-1be2-454d-9fbc-a31adb382bf6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:49.379246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-94bd942d-eea4-40d1-85b9-5daa2c85d46d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:49.394340 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-94bd942d-eea4-40d1-85b9-5daa2c85d46d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1321 microversion: 2.1 time: 0.568249 Aug 09 14:31:49.395234 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 185/350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:48 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:49.481459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0a59e58-cbd6-4418-83d4-417efaa9c17a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:49.482288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0a59e58-cbd6-4418-83d4-417efaa9c17a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:49.493031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a59e58-cbd6-4418-83d4-417efaa9c17a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:49.496622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a59e58-cbd6-4418-83d4-417efaa9c17a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:49.497336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a59e58-cbd6-4418-83d4-417efaa9c17a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:49.498333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a59e58-cbd6-4418-83d4-417efaa9c17a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:49.500773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a59e58-cbd6-4418-83d4-417efaa9c17a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:49.501445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a59e58-cbd6-4418-83d4-417efaa9c17a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:49.676592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0a59e58-cbd6-4418-83d4-417efaa9c17a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:49.689298 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0a59e58-cbd6-4418-83d4-417efaa9c17a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1270 microversion: 2.1 time: 0.211939 Aug 09 14:31:49.689875 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 186/351] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:49 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:49.737995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-4422cc56-1be2-454d-9fbc-a31adb382bf6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 50063b74-64e4-46e0-a842-cfd6735d25ac {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:31:49.805133 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4422cc56-1be2-454d-9fbc-a31adb382bf6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 2050 microversion: 2.25 time: 0.649643 Aug 09 14:31:49.820050 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 166/352] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:49 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 2050 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:49.833159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc1ede40-ebbc-4daf-b156-a80ce31ff684 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:49.834127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bc1ede40-ebbc-4daf-b156-a80ce31ff684 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:49.848352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc1ede40-ebbc-4daf-b156-a80ce31ff684 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:49.851680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc1ede40-ebbc-4daf-b156-a80ce31ff684 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:49.853202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc1ede40-ebbc-4daf-b156-a80ce31ff684 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:49.856409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc1ede40-ebbc-4daf-b156-a80ce31ff684 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:49.859557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc1ede40-ebbc-4daf-b156-a80ce31ff684 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:49.860892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc1ede40-ebbc-4daf-b156-a80ce31ff684 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:49.959047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bc1ede40-ebbc-4daf-b156-a80ce31ff684 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:49.974001 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc1ede40-ebbc-4daf-b156-a80ce31ff684 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1283 microversion: 2.1 time: 0.151696 Aug 09 14:31:49.988166 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 167/353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:49 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:49.995909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6b822ba5-12b9-48f6-b9d3-5166c0ebe235 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:50.000999 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:50.000999 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:50.003397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b822ba5-12b9-48f6-b9d3-5166c0ebe235 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:50.004206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b822ba5-12b9-48f6-b9d3-5166c0ebe235 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:50.005059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b822ba5-12b9-48f6-b9d3-5166c0ebe235 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:50.006885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b822ba5-12b9-48f6-b9d3-5166c0ebe235 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:50.007783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b822ba5-12b9-48f6-b9d3-5166c0ebe235 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:50.012795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b822ba5-12b9-48f6-b9d3-5166c0ebe235 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:50.043036 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6b822ba5-12b9-48f6-b9d3-5166c0ebe235 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.052964 Aug 09 14:31:50.052163 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 168/354] 10.222.0.50 () {60 vars in 1217 bytes} [Tue Aug 9 14:31:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:31:50.063705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-01150b5a-84be-49da-8353-a548d99e8949 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844626-8", "block_migration": "auto"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:50.067506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01150b5a-84be-49da-8353-a548d99e8949 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:50.080148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01150b5a-84be-49da-8353-a548d99e8949 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:50.081097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01150b5a-84be-49da-8353-a548d99e8949 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:50.081758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01150b5a-84be-49da-8353-a548d99e8949 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:50.083049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01150b5a-84be-49da-8353-a548d99e8949 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:50.083776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01150b5a-84be-49da-8353-a548d99e8949 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:50.085258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01150b5a-84be-49da-8353-a548d99e8949 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:50.104693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-330f1ea3-dfd0-4d71-8d4f-00d9853d8048 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Calling method '.version_select at 0x7f41deb2db80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:50.106979 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:50.106979 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:50.108752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-330f1ea3-dfd0-4d71-8d4f-00d9853d8048 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'e4bc9980746c46c0932480b598e57ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1922d6bb87c44b4980381d16b7ffcf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-330f1ea3-dfd0-4d71-8d4f-00d9853d8048 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Request method failure captured: Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_ThuYhRSyKVV4VWIXJOJ5XQn3mNOcstBQGRk1X_-t_iubeCPeXpDV7ml1sHHBj2vbGmRheS6dZ8ef6iKMSZa6LiHnSkttuLau6r0rrMpg2MFckwx-egvp6nrEz8dFmETqjY5iZENyqoIt8hqQLs6qcwlH_jQW7i0Uqex3-ElUmghs Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a1922d6bb87c44b4980381d16b7ffcf5 Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:50.111976 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a1922d6bb87c44b4980381d16b7ffcf5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a1922d6bb87c44b4980381d16b7ffcf5 Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HypervisorAdminNegativeTestJSON-1433284761-project Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e4bc9980746c46c0932480b598e57ab3 Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761-project Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: action_args: {} Aug 09 14:31:50.113508 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:50.114413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 09 14:31:50.115831 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:50.118654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-330f1ea3-dfd0-4d71-8d4f-00d9853d8048 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:50.119734 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-330f1ea3-dfd0-4d71-8d4f-00d9853d8048 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.428750 Aug 09 14:31:50.120728 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 187/355] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 9 14:31:49 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 430 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:50.151228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ca0762f-0725-4786-8ecc-f39a6413efba tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Calling method '.version_select at 0x7f41deb1db80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:50.152695 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:50.152695 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:50.155027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ca0762f-0725-4786-8ecc-f39a6413efba tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'e4bc9980746c46c0932480b598e57ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1922d6bb87c44b4980381d16b7ffcf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ca0762f-0725-4786-8ecc-f39a6413efba tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Request method failure captured: Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_ThuYhRSyKVV4VWIXJOJ5XQn3mNOcstBQGRk1X_-t_iubeCPeXpDV7ml1sHHBj2vbGmRheS6dZ8ef6iKMSZa6LiHnSkttuLau6r0rrMpg2MFckwx-egvp6nrEz8dFmETqjY5iZENyqoIt8hqQLs6qcwlH_jQW7i0Uqex3-ElUmghs Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a1922d6bb87c44b4980381d16b7ffcf5 Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:50.157386 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a1922d6bb87c44b4980381d16b7ffcf5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a1922d6bb87c44b4980381d16b7ffcf5 Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HypervisorAdminNegativeTestJSON-1433284761-project Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e4bc9980746c46c0932480b598e57ab3 Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761-project Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: action_args: {} Aug 09 14:31:50.158719 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:50.159608 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 09 14:31:50.160918 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:50.165208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ca0762f-0725-4786-8ecc-f39a6413efba tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:50.166383 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ca0762f-0725-4786-8ecc-f39a6413efba tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.021364 Aug 09 14:31:50.167400 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 188/356] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:31:50 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:50.206397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a7805bf-3e33-427b-9011-8932aa0c4859 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Calling method '.version_select at 0x7f41deb1dc10>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:50.213260 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:50.213260 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:50.219007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5a7805bf-3e33-427b-9011-8932aa0c4859 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'e4bc9980746c46c0932480b598e57ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1922d6bb87c44b4980381d16b7ffcf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a7805bf-3e33-427b-9011-8932aa0c4859 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Request method failure captured: Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_ThuYhRSyKVV4VWIXJOJ5XQn3mNOcstBQGRk1X_-t_iubeCPeXpDV7ml1sHHBj2vbGmRheS6dZ8ef6iKMSZa6LiHnSkttuLau6r0rrMpg2MFckwx-egvp6nrEz8dFmETqjY5iZENyqoIt8hqQLs6qcwlH_jQW7i0Uqex3-ElUmghs Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a1922d6bb87c44b4980381d16b7ffcf5 Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:50.220735 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a1922d6bb87c44b4980381d16b7ffcf5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a1922d6bb87c44b4980381d16b7ffcf5 Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HypervisorAdminNegativeTestJSON-1433284761-project Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e4bc9980746c46c0932480b598e57ab3 Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761-project Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: action_args: {} Aug 09 14:31:50.222161 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:50.223002 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 09 14:31:50.224380 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:50.225665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a7805bf-3e33-427b-9011-8932aa0c4859 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:50.227440 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5a7805bf-3e33-427b-9011-8932aa0c4859 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.051384 Aug 09 14:31:50.234669 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 189/357] 10.222.0.50 () {58 vars in 1179 bytes} [Tue Aug 9 14:31:50 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:50.296234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-01150b5a-84be-49da-8353-a548d99e8949 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'flavor' on Instance uuid 50063b74-64e4-46e0-a842-cfd6735d25ac {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:31:50.409036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01150b5a-84be-49da-8353-a548d99e8949 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Going to try to live migrate instance to n-h2-844626-8 {{(pid=119407) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 14:31:50.498265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0da9f4d9-7878-47c9-825c-4b4fb97f02a4 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Calling method '.version_select at 0x7f41deb2d160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:50.501001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da9f4d9-7878-47c9-825c-4b4fb97f02a4 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:50.502513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da9f4d9-7878-47c9-825c-4b4fb97f02a4 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:50.503703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da9f4d9-7878-47c9-825c-4b4fb97f02a4 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:50.563583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da9f4d9-7878-47c9-825c-4b4fb97f02a4 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:50.564651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da9f4d9-7878-47c9-825c-4b4fb97f02a4 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:50.565266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da9f4d9-7878-47c9-825c-4b4fb97f02a4 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:50.595865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da9f4d9-7878-47c9-825c-4b4fb97f02a4 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:50.598033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da9f4d9-7878-47c9-825c-4b4fb97f02a4 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:50.600574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0da9f4d9-7878-47c9-825c-4b4fb97f02a4 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:50.618561 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0da9f4d9-7878-47c9-825c-4b4fb97f02a4 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.381668 Aug 09 14:31:50.623324 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 190/358] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:31:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:50.641120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-af2f9c00-77b5-4c1b-a778-28613ecb6e9c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:50.652882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-af2f9c00-77b5-4c1b-a778-28613ecb6e9c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:50.676971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af2f9c00-77b5-4c1b-a778-28613ecb6e9c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:50.678848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af2f9c00-77b5-4c1b-a778-28613ecb6e9c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:50.683074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af2f9c00-77b5-4c1b-a778-28613ecb6e9c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:50.684396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af2f9c00-77b5-4c1b-a778-28613ecb6e9c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:50.686258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af2f9c00-77b5-4c1b-a778-28613ecb6e9c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:50.686962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af2f9c00-77b5-4c1b-a778-28613ecb6e9c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:50.933870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-af2f9c00-77b5-4c1b-a778-28613ecb6e9c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:50.944789 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-af2f9c00-77b5-4c1b-a778-28613ecb6e9c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1513 microversion: 2.1 time: 0.318952 Aug 09 14:31:50.959795 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 191/359] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:50 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1513 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:50.966614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8d3e162e-e47f-41a1-9ab7-f89cb6fecd5c tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Calling method '.version_select at 0x7f41deac4550>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:50.968426 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:50.968426 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:50.970221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8d3e162e-e47f-41a1-9ab7-f89cb6fecd5c tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'e4bc9980746c46c0932480b598e57ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1922d6bb87c44b4980381d16b7ffcf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8d3e162e-e47f-41a1-9ab7-f89cb6fecd5c tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Request method failure captured: Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_ThuYhRSyKVV4VWIXJOJ5XQn3mNOcstBQGRk1X_-t_iubeCPeXpDV7ml1sHHBj2vbGmRheS6dZ8ef6iKMSZa6LiHnSkttuLau6r0rrMpg2MFckwx-egvp6nrEz8dFmETqjY5iZENyqoIt8hqQLs6qcwlH_jQW7i0Uqex3-ElUmghs Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a1922d6bb87c44b4980381d16b7ffcf5 Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:50.971940 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a1922d6bb87c44b4980381d16b7ffcf5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a1922d6bb87c44b4980381d16b7ffcf5 Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HypervisorAdminNegativeTestJSON-1433284761-project Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e4bc9980746c46c0932480b598e57ab3 Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761-project Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '1'} Aug 09 14:31:50.973248 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:50.973985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 09 14:31:50.975126 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:50.977425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8d3e162e-e47f-41a1-9ab7-f89cb6fecd5c tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:50.978509 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8d3e162e-e47f-41a1-9ab7-f89cb6fecd5c tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.017610 Aug 09 14:31:50.983897 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 192/360] 10.222.0.50 () {58 vars in 1173 bytes} [Tue Aug 9 14:31:50 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:50.989315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bbe1f22-813c-4e89-92c3-59e513858e21 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:50.990193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8bbe1f22-813c-4e89-92c3-59e513858e21 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:50.997815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bbe1f22-813c-4e89-92c3-59e513858e21 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:50.998436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bbe1f22-813c-4e89-92c3-59e513858e21 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:50.999174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bbe1f22-813c-4e89-92c3-59e513858e21 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:51.000311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bbe1f22-813c-4e89-92c3-59e513858e21 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:51.001007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bbe1f22-813c-4e89-92c3-59e513858e21 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:51.001678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bbe1f22-813c-4e89-92c3-59e513858e21 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:51.213210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8bbe1f22-813c-4e89-92c3-59e513858e21 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:51.222002 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8bbe1f22-813c-4e89-92c3-59e513858e21 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1312 microversion: 2.1 time: 0.236531 Aug 09 14:31:51.223207 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 193/361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:50 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1312 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:51.237545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-51a9227a-b321-4b48-b554-3b02ff6d3e62 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:51.240555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-51a9227a-b321-4b48-b554-3b02ff6d3e62 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:51.248212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51a9227a-b321-4b48-b554-3b02ff6d3e62 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:51.249027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51a9227a-b321-4b48-b554-3b02ff6d3e62 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:51.249860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51a9227a-b321-4b48-b554-3b02ff6d3e62 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:51.250797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51a9227a-b321-4b48-b554-3b02ff6d3e62 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:51.251494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51a9227a-b321-4b48-b554-3b02ff6d3e62 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:51.252093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51a9227a-b321-4b48-b554-3b02ff6d3e62 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:51.263900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:51.442580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-51a9227a-b321-4b48-b554-3b02ff6d3e62 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:51.452916 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-51a9227a-b321-4b48-b554-3b02ff6d3e62 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1512 microversion: 2.1 time: 0.227983 Aug 09 14:31:51.453735 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 194/362] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:51 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:51.460459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a209d39-93ab-4993-8bd7-e1b9e61ae4a5 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Calling method '.version_select at 0x7f41deb1dc10>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:51.462309 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:51.462309 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:51.463418 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-9a209d39-93ab-4993-8bd7-e1b9e61ae4a5 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] HTTP exception thrown: Hypervisor with ID '443d1934-e073-4f9a-9bf8-0ede9fa30878' could not be found. Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a209d39-93ab-4993-8bd7-e1b9e61ae4a5 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Request method failure captured: Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hypervisors/443d1934-e073-4f9a-9bf8-0ede9fa30878/uptime HTTP/1.1 Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_VwzJ2GDXHfJ8ce9swFsgzzuH2XKP_G0Hf58hCMgb4ZUHHbbCrA2WxpaP8Dp1LD5PNuLHgm0Q7G5-DfF0sbtjt8gdcR6lcQRrgF2mo2X4ad9VKRV5z6K4WWWMHxCOGq3YS1gw2Hm_rmyCz7aa158rmGv5-r5TnzC6IaoGrCEbMfqI Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 93fbc65afcf649559c799173b0c38ed3 Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-777372797 Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:31:51.474964 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:31:51.476565 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_93fbc65afcf649559c799173b0c38ed3", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/93fbc65afcf649559c799173b0c38ed3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/93fbc65afcf649559c799173b0c38ed3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/93fbc65afcf649559c799173b0c38ed3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:51.476565 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-777372797 Aug 09 14:31:51.476565 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 93fbc65afcf649559c799173b0c38ed3 Aug 09 14:31:51.476565 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-777372797 Aug 09 14:31:51.476565 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin Aug 09 14:31:51.476565 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:51.476565 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:51.476565 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 12eff05cf6524bf6af91b63a26a4c749 Aug 09 14:31:51.476565 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin Aug 09 14:31:51.476565 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:31:51.476565 n-d-844626-8 devstack@n-api.service[119406]: exception: Hypervisor with ID '443d1934-e073-4f9a-9bf8-0ede9fa30878' could not be found. Aug 09 14:31:51.476565 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '443d1934-e073-4f9a-9bf8-0ede9fa30878'} Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '443d1934-e073-4f9a-9bf8-0ede9fa30878' Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 09 14:31:51.477464 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '443d1934-e073-4f9a-9bf8-0ede9fa30878' could not be found. Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:51.478909 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:51.480148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:51.480148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:51.480148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:51.480148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:51.480148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:51.480148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '443d1934-e073-4f9a-9bf8-0ede9fa30878' could not be found. Aug 09 14:31:51.480148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:51.483157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a209d39-93ab-4993-8bd7-e1b9e61ae4a5 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Returning 404 to user: Hypervisor with ID '443d1934-e073-4f9a-9bf8-0ede9fa30878' could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:51.484017 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a209d39-93ab-4993-8bd7-e1b9e61ae4a5 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/443d1934-e073-4f9a-9bf8-0ede9fa30878/uptime" status: 404 len: 123 microversion: 2.1 time: 0.028952 Aug 09 14:31:51.484580 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 195/363] 10.222.0.50 () {58 vars in 1278 bytes} [Tue Aug 9 14:31:51 2022] GET /compute/v2.1/os-hypervisors/443d1934-e073-4f9a-9bf8-0ede9fa30878/uptime => generated 123 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:51.489853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b5270f64-ed87-4bae-8303-f5efa7f7e68b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:51.490801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b5270f64-ed87-4bae-8303-f5efa7f7e68b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:51.497889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5270f64-ed87-4bae-8303-f5efa7f7e68b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:51.498763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5270f64-ed87-4bae-8303-f5efa7f7e68b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:51.499923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5270f64-ed87-4bae-8303-f5efa7f7e68b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:51.500976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5270f64-ed87-4bae-8303-f5efa7f7e68b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:51.501662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5270f64-ed87-4bae-8303-f5efa7f7e68b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:51.502328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5270f64-ed87-4bae-8303-f5efa7f7e68b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:51.592896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b5270f64-ed87-4bae-8303-f5efa7f7e68b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:51.601406 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b5270f64-ed87-4bae-8303-f5efa7f7e68b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1289 microversion: 2.1 time: 0.115483 Aug 09 14:31:51.602360 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 196/364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:51 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1289 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:51.620330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17956cfe-9a01-4424-a830-287dbac4d9e9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:51.621230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17956cfe-9a01-4424-a830-287dbac4d9e9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 9124e955-056d-4c19-baa2-dbbfdcad5058] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:51.628370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17956cfe-9a01-4424-a830-287dbac4d9e9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:51.629081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17956cfe-9a01-4424-a830-287dbac4d9e9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:51.629713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17956cfe-9a01-4424-a830-287dbac4d9e9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:51.630845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17956cfe-9a01-4424-a830-287dbac4d9e9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:51.631618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17956cfe-9a01-4424-a830-287dbac4d9e9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:51.632338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17956cfe-9a01-4424-a830-287dbac4d9e9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:51.986124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-17956cfe-9a01-4424-a830-287dbac4d9e9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:52.001211 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17956cfe-9a01-4424-a830-287dbac4d9e9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058" status: 200 len: 1510 microversion: 2.1 time: 0.395541 Aug 09 14:31:52.001211 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 197/365] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:51 2022] GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058 => generated 1510 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:52.038969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-51c96e75-814f-41e0-b9b3-db9a2b016f98 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Calling method '.version_select at 0x7f41deb2ddc0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:52.039986 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:52.039986 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:52.041156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51c96e75-814f-41e0-b9b3-db9a2b016f98 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:52.041710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51c96e75-814f-41e0-b9b3-db9a2b016f98 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:52.042223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51c96e75-814f-41e0-b9b3-db9a2b016f98 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:52.061165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51c96e75-814f-41e0-b9b3-db9a2b016f98 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:52.062047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51c96e75-814f-41e0-b9b3-db9a2b016f98 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:52.062686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51c96e75-814f-41e0-b9b3-db9a2b016f98 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:52.075276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51c96e75-814f-41e0-b9b3-db9a2b016f98 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:52.076188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51c96e75-814f-41e0-b9b3-db9a2b016f98 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:52.076794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51c96e75-814f-41e0-b9b3-db9a2b016f98 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:52.083652 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-51c96e75-814f-41e0-b9b3-db9a2b016f98 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.049359 Aug 09 14:31:52.085131 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 198/366] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:31:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:52.091886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:52.098124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:52.099969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:31:52.113422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:52.114258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:52.115252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:52.116235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:52.116955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:52.117724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:52.275698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:31:52.414082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:52.422033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:52.422820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:52.423769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:52.706101 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-768ef5fb-8108-4be8-86d1-b3939dcd5828 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.619336 Aug 09 14:31:52.706973 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 199/367] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 9 14:31:52 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:52.726696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b4444c6-3dc9-4912-9916-8a2bc187cad6 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Calling method '.version_select at 0x7f41deb1da60>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:52.727714 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:52.727714 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:52.728663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2b4444c6-3dc9-4912-9916-8a2bc187cad6 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'e4bc9980746c46c0932480b598e57ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1922d6bb87c44b4980381d16b7ffcf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b4444c6-3dc9-4912-9916-8a2bc187cad6 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Request method failure captured: Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_ThuYhRSyKVV4VWIXJOJ5XQn3mNOcstBQGRk1X_-t_iubeCPeXpDV7ml1sHHBj2vbGmRheS6dZ8ef6iKMSZa6LiHnSkttuLau6r0rrMpg2MFckwx-egvp6nrEz8dFmETqjY5iZENyqoIt8hqQLs6qcwlH_jQW7i0Uqex3-ElUmghs Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a1922d6bb87c44b4980381d16b7ffcf5 Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:31:52.730631 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a1922d6bb87c44b4980381d16b7ffcf5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1922d6bb87c44b4980381d16b7ffcf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a1922d6bb87c44b4980381d16b7ffcf5 Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761 Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HypervisorAdminNegativeTestJSON-1433284761-project Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e4bc9980746c46c0932480b598e57ab3 Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1433284761-project Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '1'} Aug 09 14:31:52.731874 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:31:52.732732 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 09 14:31:52.733771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:52.736545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b4444c6-3dc9-4912-9916-8a2bc187cad6 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:52.736545 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b4444c6-3dc9-4912-9916-8a2bc187cad6 tempest-HypervisorAdminNegativeTestJSON-1433284761 tempest-HypervisorAdminNegativeTestJSON-1433284761-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.024055 Aug 09 14:31:52.737026 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 200/368] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:52 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:52.748627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-922cba57-5d0f-4b3e-a0a6-8948eaeac120 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:52.756005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-922cba57-5d0f-4b3e-a0a6-8948eaeac120 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:52.770931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922cba57-5d0f-4b3e-a0a6-8948eaeac120 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:52.772280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922cba57-5d0f-4b3e-a0a6-8948eaeac120 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:52.773460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922cba57-5d0f-4b3e-a0a6-8948eaeac120 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:52.774235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922cba57-5d0f-4b3e-a0a6-8948eaeac120 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:52.775296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922cba57-5d0f-4b3e-a0a6-8948eaeac120 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:52.776059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922cba57-5d0f-4b3e-a0a6-8948eaeac120 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:53.325543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-922cba57-5d0f-4b3e-a0a6-8948eaeac120 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:53.337377 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-922cba57-5d0f-4b3e-a0a6-8948eaeac120 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1312 microversion: 2.1 time: 0.595999 Aug 09 14:31:53.338236 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 201/369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:52 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1312 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:53.346777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-012012a5-dd80-44cf-98b8-dad4e01d79e0 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:53.351926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-012012a5-dd80-44cf-98b8-dad4e01d79e0 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:53.360805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-012012a5-dd80-44cf-98b8-dad4e01d79e0 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:53.361304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-012012a5-dd80-44cf-98b8-dad4e01d79e0 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:53.361768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-012012a5-dd80-44cf-98b8-dad4e01d79e0 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:53.362418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-012012a5-dd80-44cf-98b8-dad4e01d79e0 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:53.368931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-012012a5-dd80-44cf-98b8-dad4e01d79e0 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:53.369591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-012012a5-dd80-44cf-98b8-dad4e01d79e0 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:53.633353 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-01150b5a-84be-49da-8353-a548d99e8949 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac/action" status: 202 len: 0 microversion: 2.25 time: 3.579846 Aug 09 14:31:53.634023 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 169/370] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:31:50 2022] POST /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac/action => generated 0 bytes in 3581 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:31:53.640251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:53.655498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:53.662239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1216879825', 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:31:53.691021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:53.694363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:53.695608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:53.697605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:53.699696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:53.700371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:53.746795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-012012a5-dd80-44cf-98b8-dad4e01d79e0 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:53.768867 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-012012a5-dd80-44cf-98b8-dad4e01d79e0 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1331 microversion: 2.1 time: 0.429205 Aug 09 14:31:53.785692 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 202/371] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:53 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1331 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:53.802840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f96372d4-5783-4b3a-bf86-9b4d9ea7df27 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Calling method '.version_select at 0x7f41deb2d040>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:53.818530 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:53.818530 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:53.821725 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-f96372d4-5783-4b3a-bf86-9b4d9ea7df27 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] HTTP exception thrown: Hypervisor with ID 'fa67b782-4f17-4136-b149-ed924f2fd5ad' could not be found. Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f96372d4-5783-4b3a-bf86-9b4d9ea7df27 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Request method failure captured: Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hypervisors/fa67b782-4f17-4136-b149-ed924f2fd5ad HTTP/1.1 Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_VwzJ2GDXHfJ8ce9swFsgzzuH2XKP_G0Hf58hCMgb4ZUHHbbCrA2WxpaP8Dp1LD5PNuLHgm0Q7G5-DfF0sbtjt8gdcR6lcQRrgF2mo2X4ad9VKRV5z6K4WWWMHxCOGq3YS1gw2Hm_rmyCz7aa158rmGv5-r5TnzC6IaoGrCEbMfqI Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 93fbc65afcf649559c799173b0c38ed3 Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-777372797 Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:31:53.823486 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:31:53.824752 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_93fbc65afcf649559c799173b0c38ed3", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/93fbc65afcf649559c799173b0c38ed3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/93fbc65afcf649559c799173b0c38ed3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/93fbc65afcf649559c799173b0c38ed3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:31:53.824752 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-777372797 Aug 09 14:31:53.824752 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 93fbc65afcf649559c799173b0c38ed3 Aug 09 14:31:53.824752 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-777372797 Aug 09 14:31:53.824752 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin Aug 09 14:31:53.824752 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:31:53.824752 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:31:53.824752 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 12eff05cf6524bf6af91b63a26a4c749 Aug 09 14:31:53.824752 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin Aug 09 14:31:53.824752 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:31:53.824752 n-d-844626-8 devstack@n-api.service[119406]: exception: Hypervisor with ID 'fa67b782-4f17-4136-b149-ed924f2fd5ad' could not be found. Aug 09 14:31:53.824752 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'fa67b782-4f17-4136-b149-ed924f2fd5ad'} Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'fa67b782-4f17-4136-b149-ed924f2fd5ad' Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 09 14:31:53.825454 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 14:31:53.826759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'fa67b782-4f17-4136-b149-ed924f2fd5ad' could not be found. Aug 09 14:31:53.829884 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:53.829884 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:31:53.829884 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:53.829884 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:31:53.829884 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:31:53.829884 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:31:53.829884 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:31:53.829884 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:31:53.829884 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'fa67b782-4f17-4136-b149-ed924f2fd5ad' could not be found. Aug 09 14:31:53.829884 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:31:53.829884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f96372d4-5783-4b3a-bf86-9b4d9ea7df27 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] Returning 404 to user: Hypervisor with ID 'fa67b782-4f17-4136-b149-ed924f2fd5ad' could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:31:53.829884 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f96372d4-5783-4b3a-bf86-9b4d9ea7df27 tempest-HypervisorAdminNegativeTestJSON-777372797 tempest-HypervisorAdminNegativeTestJSON-777372797-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/fa67b782-4f17-4136-b149-ed924f2fd5ad" status: 404 len: 123 microversion: 2.1 time: 0.038082 Aug 09 14:31:53.838906 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 203/372] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 9 14:31:53 2022] GET /compute/v2.1/os-hypervisors/fa67b782-4f17-4136-b149-ed924f2fd5ad => generated 123 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:31:53.854434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06db8945-9720-4d6b-ae2f-719f568757b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:53.855348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-06db8945-9720-4d6b-ae2f-719f568757b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:53.861818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06db8945-9720-4d6b-ae2f-719f568757b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:53.862746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06db8945-9720-4d6b-ae2f-719f568757b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:53.863462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06db8945-9720-4d6b-ae2f-719f568757b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:53.864331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06db8945-9720-4d6b-ae2f-719f568757b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:53.864938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06db8945-9720-4d6b-ae2f-719f568757b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:53.867401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06db8945-9720-4d6b-ae2f-719f568757b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:54.056951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:31:54.336547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:54.337733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-06db8945-9720-4d6b-ae2f-719f568757b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:54.350326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:54.351046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:54.351654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:54.359307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-06db8945-9720-4d6b-ae2f-719f568757b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:54.366766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-06db8945-9720-4d6b-ae2f-719f568757b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:54.370865 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-06db8945-9720-4d6b-ae2f-719f568757b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1568 microversion: 2.25 time: 0.530681 Aug 09 14:31:54.373846 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 204/373] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:53 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1568 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:54.379253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-265cc0c0-4f3c-4efd-ae89-55317be335a7 req-d2c26112-b5b0-43bb-b0b8-3b9ce9c7bc97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4125ae9-163d-4e42-b277-f309f031f352", "tag": "3ce4965e-717b-4943-b658-c4cc8884f87e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:54.405650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-265cc0c0-4f3c-4efd-ae89-55317be335a7 req-d2c26112-b5b0-43bb-b0b8-3b9ce9c7bc97 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:54.409018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-265cc0c0-4f3c-4efd-ae89-55317be335a7 req-d2c26112-b5b0-43bb-b0b8-3b9ce9c7bc97 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:54.409586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-265cc0c0-4f3c-4efd-ae89-55317be335a7 req-d2c26112-b5b0-43bb-b0b8-3b9ce9c7bc97 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:54.450012 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-265cc0c0-4f3c-4efd-ae89-55317be335a7 req-d2c26112-b5b0-43bb-b0b8-3b9ce9c7bc97 service nova] Creating event network-changed:3ce4965e-717b-4943-b658-c4cc8884f87e for instance c4125ae9-163d-4e42-b277-f309f031f352 on n-h2-844626-8 Aug 09 14:31:54.462010 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-265cc0c0-4f3c-4efd-ae89-55317be335a7 req-d2c26112-b5b0-43bb-b0b8-3b9ce9c7bc97 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083867 Aug 09 14:31:54.464860 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 205/374] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:54.480382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c54cd21-079c-4751-8497-1f306ca9db53 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:54.481684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2c54cd21-079c-4751-8497-1f306ca9db53 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:54.496813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c54cd21-079c-4751-8497-1f306ca9db53 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:54.497292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c54cd21-079c-4751-8497-1f306ca9db53 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:54.497710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c54cd21-079c-4751-8497-1f306ca9db53 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:54.498423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c54cd21-079c-4751-8497-1f306ca9db53 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:54.498860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c54cd21-079c-4751-8497-1f306ca9db53 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:54.499276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c54cd21-079c-4751-8497-1f306ca9db53 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:54.910803 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37744597-3e68-473f-a882-4e435ae572f5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1216879825" status: 200 len: 1515 microversion: 2.1 time: 1.275407 Aug 09 14:31:54.911510 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 170/375] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:31:53 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1216879825 => generated 1515 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:54.916396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9dfaef40-a088-420e-a9e2-71a4fe717347 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:54.917197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9dfaef40-a088-420e-a9e2-71a4fe717347 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:54.931580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dfaef40-a088-420e-a9e2-71a4fe717347 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:54.935489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dfaef40-a088-420e-a9e2-71a4fe717347 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:54.936020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dfaef40-a088-420e-a9e2-71a4fe717347 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:54.936817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dfaef40-a088-420e-a9e2-71a4fe717347 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:54.937259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dfaef40-a088-420e-a9e2-71a4fe717347 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:54.937672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dfaef40-a088-420e-a9e2-71a4fe717347 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:55.074219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2c54cd21-079c-4751-8497-1f306ca9db53 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:55.091440 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2c54cd21-079c-4751-8497-1f306ca9db53 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1312 microversion: 2.1 time: 0.622391 Aug 09 14:31:55.093337 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 206/376] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:54 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1312 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:55.254461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Calling method '.version_select at 0x7f41deb2d160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:55.259419 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:55.259419 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:55.262101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:55.262881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:55.264126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:55.266708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9dfaef40-a088-420e-a9e2-71a4fe717347 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:55.280445 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9dfaef40-a088-420e-a9e2-71a4fe717347 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1331 microversion: 2.1 time: 0.367099 Aug 09 14:31:55.282986 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 171/377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:54 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1331 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:55.284563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:55.285264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:55.286300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:55.298628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:55.308323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:55.311230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:31:55.319111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:55.320419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:55.321245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:55.330012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:55.332644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:55.333234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:55.337828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:55.339779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:55.341790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:55.344407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:55.345306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:55.347240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:55.432099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:55.433954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:55.435281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:55.455729 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6daab076-4854-4b0c-91d4-c157ec08c8f4 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2073 microversion: 2.53 time: 0.360307 Aug 09 14:31:55.456508 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 207/378] 10.222.0.50 () {60 vars in 1243 bytes} [Tue Aug 9 14:31:55 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2073 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:55.472042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a09e7e84-deb8-4583-859f-eaf2fed269f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:55.477539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a09e7e84-deb8-4583-859f-eaf2fed269f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:55.485929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a09e7e84-deb8-4583-859f-eaf2fed269f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:55.486792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a09e7e84-deb8-4583-859f-eaf2fed269f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:55.487348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a09e7e84-deb8-4583-859f-eaf2fed269f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:55.488219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a09e7e84-deb8-4583-859f-eaf2fed269f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:55.488837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a09e7e84-deb8-4583-859f-eaf2fed269f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:55.489362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a09e7e84-deb8-4583-859f-eaf2fed269f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:55.577870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:31:55.664210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:55.673505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:55.673988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:55.674416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:55.963793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a09e7e84-deb8-4583-859f-eaf2fed269f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:55.974178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a09e7e84-deb8-4583-859f-eaf2fed269f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:55.976107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a09e7e84-deb8-4583-859f-eaf2fed269f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:55.977736 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a09e7e84-deb8-4583-859f-eaf2fed269f3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1568 microversion: 2.25 time: 0.519973 Aug 09 14:31:55.995119 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 208/379] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:55 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1568 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:55.995119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Calling method '.version_select at 0x7f41deae0ee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:55.995119 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:55.995119 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:31:55.996126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:55.996837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:55.997513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.034318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.034878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.035701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.077961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.079299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.080094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.087536 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c2d4bc8-19d3-4e12-865b-295dc403b2bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.803395 Aug 09 14:31:56.088922 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 172/380] 10.222.0.50 () {58 vars in 1173 bytes} [Tue Aug 9 14:31:55 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:56.098097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.098697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.099257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.113834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7dc6bd32-5f5b-43d3-97a1-c438696fa53c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:56.114688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7dc6bd32-5f5b-43d3-97a1-c438696fa53c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:56.125582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7dc6bd32-5f5b-43d3-97a1-c438696fa53c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.129004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7dc6bd32-5f5b-43d3-97a1-c438696fa53c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.129644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7dc6bd32-5f5b-43d3-97a1-c438696fa53c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.130840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7dc6bd32-5f5b-43d3-97a1-c438696fa53c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.132577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.133170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7dc6bd32-5f5b-43d3-97a1-c438696fa53c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.133539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.133671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7dc6bd32-5f5b-43d3-97a1-c438696fa53c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.134496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.142631 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1600ffef-b7c7-4358-a79e-2479c7779499 tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 765 microversion: 2.53 time: 0.159615 Aug 09 14:31:56.150741 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 209/381] 10.222.0.50 () {60 vars in 1222 bytes} [Tue Aug 9 14:31:55 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 765 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:31:56.163374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:56.169416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:56.170245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.compute.servers [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Removing options 'limit' from query {{(pid=119406) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 09 14:31:56.171146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:31:56.177520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.177994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.178614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.179894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.180338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.180757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.290603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:56.297700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.298553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.299216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.538458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7dc6bd32-5f5b-43d3-97a1-c438696fa53c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:56.556755 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7dc6bd32-5f5b-43d3-97a1-c438696fa53c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1312 microversion: 2.1 time: 0.447172 Aug 09 14:31:56.557694 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 173/382] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:56 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1312 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:56.571974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-461d87e2-35bd-433d-9078-92e530ce18ba tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Calling method '.version_select at 0x7f41de26e790>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:56.574709 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:31:56.574709 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:31:56.582346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-461d87e2-35bd-433d-9078-92e530ce18ba tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.583154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-461d87e2-35bd-433d-9078-92e530ce18ba tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.584296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-461d87e2-35bd-433d-9078-92e530ce18ba tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.584435 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-204d1a58-9a68-401a-947d-394f8a0cbdb6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.430757 Aug 09 14:31:56.584955 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 210/383] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:31:56 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:56.591313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b7e1cfeb-93a0-41a3-83c8-fa1fe254c099 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:56.592162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b7e1cfeb-93a0-41a3-83c8-fa1fe254c099 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:56.605592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7e1cfeb-93a0-41a3-83c8-fa1fe254c099 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.606025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7e1cfeb-93a0-41a3-83c8-fa1fe254c099 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.609788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7e1cfeb-93a0-41a3-83c8-fa1fe254c099 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.612195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7e1cfeb-93a0-41a3-83c8-fa1fe254c099 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.612669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7e1cfeb-93a0-41a3-83c8-fa1fe254c099 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.614665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7e1cfeb-93a0-41a3-83c8-fa1fe254c099 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.623664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-461d87e2-35bd-433d-9078-92e530ce18ba tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.624390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-461d87e2-35bd-433d-9078-92e530ce18ba tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.624984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-461d87e2-35bd-433d-9078-92e530ce18ba tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.638246 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-461d87e2-35bd-433d-9078-92e530ce18ba tempest-HypervisorAdminV253TestBase-110934182 tempest-HypervisorAdminV253TestBase-110934182-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/8ac0cf5c-b163-4b69-b1ca-04208e128e50" status: 200 len: 792 microversion: 2.53 time: 0.079370 Aug 09 14:31:56.638890 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 174/384] 10.222.0.50 () {60 vars in 1298 bytes} [Tue Aug 9 14:31:56 2022] GET /compute/v2.1/os-hypervisors/8ac0cf5c-b163-4b69-b1ca-04208e128e50 => generated 792 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:31:56.646073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-31101ce2-dbb0-406b-bf97-a446189346a7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:56.653335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-31101ce2-dbb0-406b-bf97-a446189346a7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:56.654065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-31101ce2-dbb0-406b-bf97-a446189346a7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:31:56.661197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31101ce2-dbb0-406b-bf97-a446189346a7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.665161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31101ce2-dbb0-406b-bf97-a446189346a7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.665884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31101ce2-dbb0-406b-bf97-a446189346a7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.666921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31101ce2-dbb0-406b-bf97-a446189346a7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.667554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31101ce2-dbb0-406b-bf97-a446189346a7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.668134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31101ce2-dbb0-406b-bf97-a446189346a7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.669539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:56.796878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-31101ce2-dbb0-406b-bf97-a446189346a7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:31:56.904410 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-31101ce2-dbb0-406b-bf97-a446189346a7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.263116 Aug 09 14:31:56.914297 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 175/385] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:31:56 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:56.915329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-36b6b7b0-acd7-483e-a6cd-fe05b89a920f req-ef43d7ff-cf1c-479c-b01e-055070b49cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59150e12-26f8-4d76-8919-498784537442", "tag": "8919a34a-05ad-4b2e-b6c8-02b8aee7335b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:56.937379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-36b6b7b0-acd7-483e-a6cd-fe05b89a920f req-ef43d7ff-cf1c-479c-b01e-055070b49cc3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:56.939498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-36b6b7b0-acd7-483e-a6cd-fe05b89a920f req-ef43d7ff-cf1c-479c-b01e-055070b49cc3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:56.940000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-36b6b7b0-acd7-483e-a6cd-fe05b89a920f req-ef43d7ff-cf1c-479c-b01e-055070b49cc3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:56.949675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b7e1cfeb-93a0-41a3-83c8-fa1fe254c099 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:56.960175 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b7e1cfeb-93a0-41a3-83c8-fa1fe254c099 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1331 microversion: 2.1 time: 0.372762 Aug 09 14:31:56.973488 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 211/386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:56 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1331 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:56.979448 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-36b6b7b0-acd7-483e-a6cd-fe05b89a920f req-ef43d7ff-cf1c-479c-b01e-055070b49cc3 service nova] Creating event network-changed:8919a34a-05ad-4b2e-b6c8-02b8aee7335b for instance 59150e12-26f8-4d76-8919-498784537442 on n-h2-844626-8 Aug 09 14:31:56.983053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-30fafd24-4eea-4bc5-a3af-1ba871dabfb4 req-96d58ecd-daf2-44ac-a57f-fb6dcbea8778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50063b74-64e4-46e0-a842-cfd6735d25ac", "name": "network-vif-unplugged", "status": "completed", "tag": "fc3132c5-cc58-4ae3-a9ab-ada9e2c1a56d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:56.991018 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-36b6b7b0-acd7-483e-a6cd-fe05b89a920f req-ef43d7ff-cf1c-479c-b01e-055070b49cc3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079240 Aug 09 14:31:56.992047 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 176/387] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:57.001510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79cc8fad-846a-4224-802f-583afb60e6a8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:57.009537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-30fafd24-4eea-4bc5-a3af-1ba871dabfb4 req-96d58ecd-daf2-44ac-a57f-fb6dcbea8778 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:57.010122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-30fafd24-4eea-4bc5-a3af-1ba871dabfb4 req-96d58ecd-daf2-44ac-a57f-fb6dcbea8778 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:57.010805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-30fafd24-4eea-4bc5-a3af-1ba871dabfb4 req-96d58ecd-daf2-44ac-a57f-fb6dcbea8778 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:57.026686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-79cc8fad-846a-4224-802f-583afb60e6a8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:57.035351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.compute.servers [None req-79cc8fad-846a-4224-802f-583afb60e6a8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Removing options 'limit' from query {{(pid=119407) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 09 14:31:57.036643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79cc8fad-846a-4224-802f-583afb60e6a8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:31:57.051787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79cc8fad-846a-4224-802f-583afb60e6a8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:57.053826 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-30fafd24-4eea-4bc5-a3af-1ba871dabfb4 req-96d58ecd-daf2-44ac-a57f-fb6dcbea8778 service nova] Creating event network-vif-unplugged:fc3132c5-cc58-4ae3-a9ab-ada9e2c1a56d for instance 50063b74-64e4-46e0-a842-cfd6735d25ac on n-h1-844626-8 Aug 09 14:31:57.060612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79cc8fad-846a-4224-802f-583afb60e6a8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:57.061059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79cc8fad-846a-4224-802f-583afb60e6a8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:57.061859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79cc8fad-846a-4224-802f-583afb60e6a8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:57.062304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79cc8fad-846a-4224-802f-583afb60e6a8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:57.062710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79cc8fad-846a-4224-802f-583afb60e6a8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:57.071785 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-30fafd24-4eea-4bc5-a3af-1ba871dabfb4 req-96d58ecd-daf2-44ac-a57f-fb6dcbea8778 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099360 Aug 09 14:31:57.073005 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 212/388] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:57.094600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-487668ea-5ff0-483e-ad27-bdd8c747c4cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:57.098973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-487668ea-5ff0-483e-ad27-bdd8c747c4cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:57.127895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-487668ea-5ff0-483e-ad27-bdd8c747c4cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:57.131569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-487668ea-5ff0-483e-ad27-bdd8c747c4cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:57.132346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-487668ea-5ff0-483e-ad27-bdd8c747c4cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:57.133213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-487668ea-5ff0-483e-ad27-bdd8c747c4cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:57.135479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-487668ea-5ff0-483e-ad27-bdd8c747c4cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:57.136406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-487668ea-5ff0-483e-ad27-bdd8c747c4cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:57.423338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-79cc8fad-846a-4224-802f-583afb60e6a8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:31:57.526574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:31:57.529250 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79cc8fad-846a-4224-802f-583afb60e6a8 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.533501 Aug 09 14:31:57.532743 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 177/389] 10.222.0.50 () {58 vars in 1150 bytes} [Tue Aug 9 14:31:56 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:57.552707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c9ecd0a-665c-45a3-b89f-1adb40acc8d7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:57.559627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c9ecd0a-665c-45a3-b89f-1adb40acc8d7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:57.564795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2c9ecd0a-665c-45a3-b89f-1adb40acc8d7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:31:57.577604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c9ecd0a-665c-45a3-b89f-1adb40acc8d7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:57.579435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c9ecd0a-665c-45a3-b89f-1adb40acc8d7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:57.581652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c9ecd0a-665c-45a3-b89f-1adb40acc8d7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:57.582603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c9ecd0a-665c-45a3-b89f-1adb40acc8d7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:57.583724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c9ecd0a-665c-45a3-b89f-1adb40acc8d7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:57.584392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c9ecd0a-665c-45a3-b89f-1adb40acc8d7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:57.616861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-2c9ecd0a-665c-45a3-b89f-1adb40acc8d7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:31:57.649057 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2c9ecd0a-665c-45a3-b89f-1adb40acc8d7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.100124 Aug 09 14:31:57.650228 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 178/390] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 14:31:57 2022] GET /compute/v2.1/servers => generated 1010 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:31:57.655635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58816f44-5df8-4886-b4a5-3bd5e55e1484 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:57.656670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58816f44-5df8-4886-b4a5-3bd5e55e1484 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:57.663381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58816f44-5df8-4886-b4a5-3bd5e55e1484 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:57.664347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58816f44-5df8-4886-b4a5-3bd5e55e1484 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:57.664962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58816f44-5df8-4886-b4a5-3bd5e55e1484 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:57.665808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58816f44-5df8-4886-b4a5-3bd5e55e1484 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:57.666455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58816f44-5df8-4886-b4a5-3bd5e55e1484 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:57.667010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58816f44-5df8-4886-b4a5-3bd5e55e1484 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:57.962802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-487668ea-5ff0-483e-ad27-bdd8c747c4cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:57.972637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-487668ea-5ff0-483e-ad27-bdd8c747c4cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:57.981263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-487668ea-5ff0-483e-ad27-bdd8c747c4cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:57.987145 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-487668ea-5ff0-483e-ad27-bdd8c747c4cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1568 microversion: 2.25 time: 0.912758 Aug 09 14:31:57.988230 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 213/391] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:57 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1568 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:31:58.008047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4ac0bb4-e9e7-4f92-a4fd-fbb44ef331b1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:58.013419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b4ac0bb4-e9e7-4f92-a4fd-fbb44ef331b1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:58.024780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b4ac0bb4-e9e7-4f92-a4fd-fbb44ef331b1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:31:58.047461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4ac0bb4-e9e7-4f92-a4fd-fbb44ef331b1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:58.048167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4ac0bb4-e9e7-4f92-a4fd-fbb44ef331b1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:58.048424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4ac0bb4-e9e7-4f92-a4fd-fbb44ef331b1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:58.049137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4ac0bb4-e9e7-4f92-a4fd-fbb44ef331b1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:58.049652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4ac0bb4-e9e7-4f92-a4fd-fbb44ef331b1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:58.050073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4ac0bb4-e9e7-4f92-a4fd-fbb44ef331b1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:58.098463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-58816f44-5df8-4886-b4a5-3bd5e55e1484 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:58.113666 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58816f44-5df8-4886-b4a5-3bd5e55e1484 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1312 microversion: 2.1 time: 0.462085 Aug 09 14:31:58.114805 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 179/392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:57 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1312 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:58.119697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40539a5a-e020-425f-b5cb-e130aa3a9ae3 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:58.140275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40539a5a-e020-425f-b5cb-e130aa3a9ae3 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:58.153741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40539a5a-e020-425f-b5cb-e130aa3a9ae3 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:58.168870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40539a5a-e020-425f-b5cb-e130aa3a9ae3 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:58.169742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40539a5a-e020-425f-b5cb-e130aa3a9ae3 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:58.172251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40539a5a-e020-425f-b5cb-e130aa3a9ae3 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:58.172870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40539a5a-e020-425f-b5cb-e130aa3a9ae3 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:58.175284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40539a5a-e020-425f-b5cb-e130aa3a9ae3 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:58.182352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-b4ac0bb4-e9e7-4f92-a4fd-fbb44ef331b1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:31:58.257409 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b4ac0bb4-e9e7-4f92-a4fd-fbb44ef331b1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.267749 Aug 09 14:31:58.258894 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 214/393] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:31:57 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:58.274794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-305306c0-8939-4604-9dbb-cfcaadb0c0b4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:58.281435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-305306c0-8939-4604-9dbb-cfcaadb0c0b4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:58.281999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.compute.servers [None req-305306c0-8939-4604-9dbb-cfcaadb0c0b4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Removing options 'limit' from query {{(pid=119406) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 09 14:31:58.282790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-305306c0-8939-4604-9dbb-cfcaadb0c0b4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:31:58.288874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-305306c0-8939-4604-9dbb-cfcaadb0c0b4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:58.289440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-305306c0-8939-4604-9dbb-cfcaadb0c0b4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:58.289976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-305306c0-8939-4604-9dbb-cfcaadb0c0b4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:58.291066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-305306c0-8939-4604-9dbb-cfcaadb0c0b4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:58.291796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-305306c0-8939-4604-9dbb-cfcaadb0c0b4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:58.292149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-305306c0-8939-4604-9dbb-cfcaadb0c0b4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:58.414180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40539a5a-e020-425f-b5cb-e130aa3a9ae3 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:58.425801 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40539a5a-e020-425f-b5cb-e130aa3a9ae3 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1331 microversion: 2.1 time: 0.309421 Aug 09 14:31:58.426567 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 180/394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:58 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1331 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:58.433354 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-305306c0-8939-4604-9dbb-cfcaadb0c0b4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.162505 Aug 09 14:31:58.441329 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 215/395] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Aug 9 14:31:58 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:58.449414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-088bf4c0-59e1-4e88-b2d2-1a31ea0c7c39 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:58.458715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-088bf4c0-59e1-4e88-b2d2-1a31ea0c7c39 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:58.459533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-088bf4c0-59e1-4e88-b2d2-1a31ea0c7c39 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1216879825', 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:31:58.476466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-088bf4c0-59e1-4e88-b2d2-1a31ea0c7c39 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:58.476942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-088bf4c0-59e1-4e88-b2d2-1a31ea0c7c39 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:58.477365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-088bf4c0-59e1-4e88-b2d2-1a31ea0c7c39 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:58.478080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-088bf4c0-59e1-4e88-b2d2-1a31ea0c7c39 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:58.478524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-088bf4c0-59e1-4e88-b2d2-1a31ea0c7c39 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:58.479051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-088bf4c0-59e1-4e88-b2d2-1a31ea0c7c39 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:58.615121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-088bf4c0-59e1-4e88-b2d2-1a31ea0c7c39 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:31:58.691271 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-088bf4c0-59e1-4e88-b2d2-1a31ea0c7c39 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1216879825" status: 200 len: 346 microversion: 2.1 time: 0.245971 Aug 09 14:31:58.695292 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 181/396] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 9 14:31:58 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1216879825 => generated 346 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:58.707374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f824382c-ae89-4f4e-b7ec-5eb8e3207e1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:58.718155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f824382c-ae89-4f4e-b7ec-5eb8e3207e1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:58.718901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f824382c-ae89-4f4e-b7ec-5eb8e3207e1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:58.719791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f824382c-ae89-4f4e-b7ec-5eb8e3207e1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:58.801543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f824382c-ae89-4f4e-b7ec-5eb8e3207e1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Going to try to stop instance {{(pid=119406) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 14:31:58.859136 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f824382c-ae89-4f4e-b7ec-5eb8e3207e1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "POST /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce/action" status: 202 len: 0 microversion: 2.1 time: 0.157221 Aug 09 14:31:58.864058 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 216/397] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:31:58 2022] POST /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:31:58.876375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b79b9730-6031-43a6-a316-bd21feb2e63e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:58.876989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b79b9730-6031-43a6-a316-bd21feb2e63e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:58.885931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b79b9730-6031-43a6-a316-bd21feb2e63e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:58.886736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b79b9730-6031-43a6-a316-bd21feb2e63e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:58.887450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b79b9730-6031-43a6-a316-bd21feb2e63e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:58.888375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b79b9730-6031-43a6-a316-bd21feb2e63e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:58.888997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b79b9730-6031-43a6-a316-bd21feb2e63e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:58.889564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b79b9730-6031-43a6-a316-bd21feb2e63e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:59.012025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ca8cc82-5895-4ad6-8ce0-8c85a6ed28bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:59.013228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ca8cc82-5895-4ad6-8ce0-8c85a6ed28bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:59.026562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca8cc82-5895-4ad6-8ce0-8c85a6ed28bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:59.027779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca8cc82-5895-4ad6-8ce0-8c85a6ed28bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:59.028474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca8cc82-5895-4ad6-8ce0-8c85a6ed28bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:59.032318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca8cc82-5895-4ad6-8ce0-8c85a6ed28bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:59.034357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca8cc82-5895-4ad6-8ce0-8c85a6ed28bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:59.035779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ca8cc82-5895-4ad6-8ce0-8c85a6ed28bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:59.176723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b79b9730-6031-43a6-a316-bd21feb2e63e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:59.185415 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b79b9730-6031-43a6-a316-bd21feb2e63e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1522 microversion: 2.1 time: 0.312638 Aug 09 14:31:59.188815 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 182/398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:58 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:31:59.199603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2e047868-68fb-46b3-9781-ee0b4732ea64 req-69f6ac2a-d78a-44b4-a194-039b110348e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50063b74-64e4-46e0-a842-cfd6735d25ac", "tag": "fc3132c5-cc58-4ae3-a9ab-ada9e2c1a56d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:31:59.222171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2e047868-68fb-46b3-9781-ee0b4732ea64 req-69f6ac2a-d78a-44b4-a194-039b110348e0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:59.222652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2e047868-68fb-46b3-9781-ee0b4732ea64 req-69f6ac2a-d78a-44b4-a194-039b110348e0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:59.225469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2e047868-68fb-46b3-9781-ee0b4732ea64 req-69f6ac2a-d78a-44b4-a194-039b110348e0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:59.261257 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2e047868-68fb-46b3-9781-ee0b4732ea64 req-69f6ac2a-d78a-44b4-a194-039b110348e0 service nova] Creating event network-changed:fc3132c5-cc58-4ae3-a9ab-ada9e2c1a56d for instance 50063b74-64e4-46e0-a842-cfd6735d25ac on n-h1-844626-8 Aug 09 14:31:59.267177 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2e047868-68fb-46b3-9781-ee0b4732ea64 req-69f6ac2a-d78a-44b4-a194-039b110348e0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075161 Aug 09 14:31:59.268620 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 183/399] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:31:59.275374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d961930e-579f-4385-903c-5c863b3ad0db tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:59.276581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d961930e-579f-4385-903c-5c863b3ad0db tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:59.285415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d961930e-579f-4385-903c-5c863b3ad0db tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:59.286383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d961930e-579f-4385-903c-5c863b3ad0db tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:59.287383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d961930e-579f-4385-903c-5c863b3ad0db tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:59.288547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d961930e-579f-4385-903c-5c863b3ad0db tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:59.289277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d961930e-579f-4385-903c-5c863b3ad0db tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:59.289866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d961930e-579f-4385-903c-5c863b3ad0db tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:59.648273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ca8cc82-5895-4ad6-8ce0-8c85a6ed28bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:59.678531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ca8cc82-5895-4ad6-8ce0-8c85a6ed28bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:59.683974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ca8cc82-5895-4ad6-8ce0-8c85a6ed28bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:59.685790 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ca8cc82-5895-4ad6-8ce0-8c85a6ed28bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1568 microversion: 2.25 time: 0.679302 Aug 09 14:31:59.690185 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 217/400] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:31:59 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1568 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:31:59.696498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4c0e941d-145f-4dd7-9054-2763fc7dd72e tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:31:59.701671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4c0e941d-145f-4dd7-9054-2763fc7dd72e tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:31:59.728569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c0e941d-145f-4dd7-9054-2763fc7dd72e tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:59.729929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c0e941d-145f-4dd7-9054-2763fc7dd72e tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:59.732076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c0e941d-145f-4dd7-9054-2763fc7dd72e tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:59.733157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c0e941d-145f-4dd7-9054-2763fc7dd72e tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:31:59.735117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c0e941d-145f-4dd7-9054-2763fc7dd72e tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:31:59.737105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c0e941d-145f-4dd7-9054-2763fc7dd72e tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:31:59.809022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d961930e-579f-4385-903c-5c863b3ad0db tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:31:59.822356 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d961930e-579f-4385-903c-5c863b3ad0db tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1312 microversion: 2.1 time: 0.552181 Aug 09 14:31:59.827982 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 184/401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:59 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1312 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:00.167374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4c0e941d-145f-4dd7-9054-2763fc7dd72e tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:00.177301 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4c0e941d-145f-4dd7-9054-2763fc7dd72e tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1331 microversion: 2.1 time: 0.485778 Aug 09 14:32:00.188565 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 218/402] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:31:59 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1331 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:00.216976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3e15d90d-704c-4002-a76c-8ace6f8e61e1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:00.217709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3e15d90d-704c-4002-a76c-8ace6f8e61e1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:00.227250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:00.233455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e15d90d-704c-4002-a76c-8ace6f8e61e1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:00.236520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e15d90d-704c-4002-a76c-8ace6f8e61e1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:00.240741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e15d90d-704c-4002-a76c-8ace6f8e61e1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:00.242407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e15d90d-704c-4002-a76c-8ace6f8e61e1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:00.244017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e15d90d-704c-4002-a76c-8ace6f8e61e1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:00.244836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e15d90d-704c-4002-a76c-8ace6f8e61e1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:00.382948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-977509722", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:00.459912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:32:00.559812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3e15d90d-704c-4002-a76c-8ace6f8e61e1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:00.569187 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3e15d90d-704c-4002-a76c-8ace6f8e61e1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1522 microversion: 2.1 time: 0.362613 Aug 09 14:32:00.573399 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 219/403] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:00 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:00.714587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7a9a0396-ae28-40f7-a468-63a1b8b6a30b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:00.715154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7a9a0396-ae28-40f7-a468-63a1b8b6a30b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:00.721561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a9a0396-ae28-40f7-a468-63a1b8b6a30b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:00.722068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a9a0396-ae28-40f7-a468-63a1b8b6a30b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:00.722497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a9a0396-ae28-40f7-a468-63a1b8b6a30b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:00.723209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a9a0396-ae28-40f7-a468-63a1b8b6a30b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:00.723920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a9a0396-ae28-40f7-a468-63a1b8b6a30b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:00.724577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a9a0396-ae28-40f7-a468-63a1b8b6a30b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:01.045030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7a9a0396-ae28-40f7-a468-63a1b8b6a30b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:01.057163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7a9a0396-ae28-40f7-a468-63a1b8b6a30b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:01.061964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7a9a0396-ae28-40f7-a468-63a1b8b6a30b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:01.064716 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7a9a0396-ae28-40f7-a468-63a1b8b6a30b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1568 microversion: 2.25 time: 0.353213 Aug 09 14:32:01.065329 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 220/404] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:00 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1568 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:32:01.078476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88dad29c-d0d1-4a4f-96c9-39ba9b498dd7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:01.079075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-88dad29c-d0d1-4a4f-96c9-39ba9b498dd7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:01.104669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88dad29c-d0d1-4a4f-96c9-39ba9b498dd7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:01.105243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88dad29c-d0d1-4a4f-96c9-39ba9b498dd7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:01.105633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88dad29c-d0d1-4a4f-96c9-39ba9b498dd7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:01.106335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88dad29c-d0d1-4a4f-96c9-39ba9b498dd7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:01.106769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88dad29c-d0d1-4a4f-96c9-39ba9b498dd7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:01.107204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88dad29c-d0d1-4a4f-96c9-39ba9b498dd7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:01.226169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:32:01.227155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:32:01.227621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:32:01.228174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:32:01.228571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:32:01.237877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:01.238626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:01.239335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:01.240229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:01.240892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:01.241440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:01.260344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Getting quotas for project 5965d64145c14bf4bb3c9c56ffa8dcab. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:32:01.265733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Getting quotas for user 36032592e1ea4a4e996689515d713ab3 and project 5965d64145c14bf4bb3c9c56ffa8dcab. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:32:01.282070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:32:01.285856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:32:01.356191 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d5fa534d-055b-4c7a-839b-543a8bf40f0a tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.224864 Aug 09 14:32:01.357429 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 185/405] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:32:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:32:01.362717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f35bef93-9f02-40d1-ba28-503e1193c080 req-dfa72f81-1f2f-4ad2-8975-684a39953677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4125ae9-163d-4e42-b277-f309f031f352", "name": "network-vif-plugged", "status": "completed", "tag": "3ce4965e-717b-4943-b658-c4cc8884f87e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:01.377843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f35bef93-9f02-40d1-ba28-503e1193c080 req-dfa72f81-1f2f-4ad2-8975-684a39953677 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:01.378483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f35bef93-9f02-40d1-ba28-503e1193c080 req-dfa72f81-1f2f-4ad2-8975-684a39953677 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:01.379050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f35bef93-9f02-40d1-ba28-503e1193c080 req-dfa72f81-1f2f-4ad2-8975-684a39953677 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:01.403134 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f35bef93-9f02-40d1-ba28-503e1193c080 req-dfa72f81-1f2f-4ad2-8975-684a39953677 service nova] Creating event network-vif-plugged:3ce4965e-717b-4943-b658-c4cc8884f87e for instance c4125ae9-163d-4e42-b277-f309f031f352 on n-h2-844626-8 Aug 09 14:32:01.413931 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f35bef93-9f02-40d1-ba28-503e1193c080 req-dfa72f81-1f2f-4ad2-8975-684a39953677 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055083 Aug 09 14:32:01.416606 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 186/406] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:01.428545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c55258c-adf3-43a5-b56f-977da9cf7135 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:01.429299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5c55258c-adf3-43a5-b56f-977da9cf7135 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:01.453917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c55258c-adf3-43a5-b56f-977da9cf7135 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:01.455562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c55258c-adf3-43a5-b56f-977da9cf7135 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:01.456619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c55258c-adf3-43a5-b56f-977da9cf7135 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:01.460249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c55258c-adf3-43a5-b56f-977da9cf7135 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:01.460930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c55258c-adf3-43a5-b56f-977da9cf7135 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:01.461431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c55258c-adf3-43a5-b56f-977da9cf7135 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:01.693231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-88dad29c-d0d1-4a4f-96c9-39ba9b498dd7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:01.702073 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88dad29c-d0d1-4a4f-96c9-39ba9b498dd7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1312 microversion: 2.1 time: 0.633261 Aug 09 14:32:01.710614 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 221/407] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:01 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1312 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:01.715441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-447350db-3dec-4409-ac29-35139b35fdd6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:01.716675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-447350db-3dec-4409-ac29-35139b35fdd6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:01.901280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-447350db-3dec-4409-ac29-35139b35fdd6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:01.910165 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-447350db-3dec-4409-ac29-35139b35fdd6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1218 microversion: 2.1 time: 0.198170 Aug 09 14:32:01.914843 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 222/408] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:01 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:01.927298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c55258c-adf3-43a5-b56f-977da9cf7135 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:01.928171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b9b3e97b-cfea-4c55-b251-981293e646f2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:01.928702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b9b3e97b-cfea-4c55-b251-981293e646f2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:01.938335 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c55258c-adf3-43a5-b56f-977da9cf7135 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1331 microversion: 2.1 time: 0.514609 Aug 09 14:32:01.940328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9b3e97b-cfea-4c55-b251-981293e646f2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:01.940967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9b3e97b-cfea-4c55-b251-981293e646f2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:01.941696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9b3e97b-cfea-4c55-b251-981293e646f2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:01.942749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9b3e97b-cfea-4c55-b251-981293e646f2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:01.943241 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 187/409] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:01 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1331 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:01.943913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9b3e97b-cfea-4c55-b251-981293e646f2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:01.945791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9b3e97b-cfea-4c55-b251-981293e646f2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:02.089171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a01b9e3d-8e44-4d7c-b2bb-8b0e9ae87765 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:02.090220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a01b9e3d-8e44-4d7c-b2bb-8b0e9ae87765 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:02.103163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a01b9e3d-8e44-4d7c-b2bb-8b0e9ae87765 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:02.106007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a01b9e3d-8e44-4d7c-b2bb-8b0e9ae87765 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:02.106953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a01b9e3d-8e44-4d7c-b2bb-8b0e9ae87765 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:02.108247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a01b9e3d-8e44-4d7c-b2bb-8b0e9ae87765 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:02.110958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a01b9e3d-8e44-4d7c-b2bb-8b0e9ae87765 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:02.111623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a01b9e3d-8e44-4d7c-b2bb-8b0e9ae87765 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:02.276190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b9b3e97b-cfea-4c55-b251-981293e646f2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:02.291928 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b9b3e97b-cfea-4c55-b251-981293e646f2 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1522 microversion: 2.1 time: 0.375869 Aug 09 14:32:02.311501 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 223/410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:01 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:02.512130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a01b9e3d-8e44-4d7c-b2bb-8b0e9ae87765 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:02.521663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a01b9e3d-8e44-4d7c-b2bb-8b0e9ae87765 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:02.529417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a01b9e3d-8e44-4d7c-b2bb-8b0e9ae87765 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:02.531590 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a01b9e3d-8e44-4d7c-b2bb-8b0e9ae87765 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1568 microversion: 2.25 time: 0.447037 Aug 09 14:32:02.537212 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 188/411] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:02 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1568 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:32:02.729759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2b12339-227e-42ef-85aa-bfce9e77ba71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:02.730958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c2b12339-227e-42ef-85aa-bfce9e77ba71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:02.743454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2b12339-227e-42ef-85aa-bfce9e77ba71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:02.744174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2b12339-227e-42ef-85aa-bfce9e77ba71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:02.744605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2b12339-227e-42ef-85aa-bfce9e77ba71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:02.745299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2b12339-227e-42ef-85aa-bfce9e77ba71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:02.745938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2b12339-227e-42ef-85aa-bfce9e77ba71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:02.746739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2b12339-227e-42ef-85aa-bfce9e77ba71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:02.932424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e3b95c42-26f8-46d2-ac79-2a60baa9ddf2 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:02.933342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e3b95c42-26f8-46d2-ac79-2a60baa9ddf2 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:02.949823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3b95c42-26f8-46d2-ac79-2a60baa9ddf2 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:02.955757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3b95c42-26f8-46d2-ac79-2a60baa9ddf2 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:02.956387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3b95c42-26f8-46d2-ac79-2a60baa9ddf2 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:02.958924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3b95c42-26f8-46d2-ac79-2a60baa9ddf2 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:02.960549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3b95c42-26f8-46d2-ac79-2a60baa9ddf2 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:02.962176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3b95c42-26f8-46d2-ac79-2a60baa9ddf2 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:02.987981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c2b12339-227e-42ef-85aa-bfce9e77ba71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:02.999900 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2b12339-227e-42ef-85aa-bfce9e77ba71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1312 microversion: 2.1 time: 0.273963 Aug 09 14:32:03.005515 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 224/412] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:02 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1312 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:03.015458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d3f82cb-61d5-44a5-977d-1aa6da96a13b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:03.018059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d3f82cb-61d5-44a5-977d-1aa6da96a13b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:03.045446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d3f82cb-61d5-44a5-977d-1aa6da96a13b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:03.050950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d3f82cb-61d5-44a5-977d-1aa6da96a13b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:03.052521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d3f82cb-61d5-44a5-977d-1aa6da96a13b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:03.054651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d3f82cb-61d5-44a5-977d-1aa6da96a13b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:03.060723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d3f82cb-61d5-44a5-977d-1aa6da96a13b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:03.062839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d3f82cb-61d5-44a5-977d-1aa6da96a13b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:03.279967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e3b95c42-26f8-46d2-ac79-2a60baa9ddf2 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:03.288922 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e3b95c42-26f8-46d2-ac79-2a60baa9ddf2 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1270 microversion: 2.1 time: 0.361269 Aug 09 14:32:03.293003 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 189/413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:02 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1270 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:03.323891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0bda54c-aa88-4d5f-a096-898d4b30407f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:03.324867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0bda54c-aa88-4d5f-a096-898d4b30407f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:03.328409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:03.332310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0bda54c-aa88-4d5f-a096-898d4b30407f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:03.342128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0bda54c-aa88-4d5f-a096-898d4b30407f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:03.342956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0bda54c-aa88-4d5f-a096-898d4b30407f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:03.343814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0bda54c-aa88-4d5f-a096-898d4b30407f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:03.344324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0bda54c-aa88-4d5f-a096-898d4b30407f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:03.345041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0bda54c-aa88-4d5f-a096-898d4b30407f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:03.523343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d3f82cb-61d5-44a5-977d-1aa6da96a13b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:03.532592 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d3f82cb-61d5-44a5-977d-1aa6da96a13b tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1331 microversion: 2.1 time: 0.523163 Aug 09 14:32:03.533221 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 225/414] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:03 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1331 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:03.558683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c7a866d-bf5e-4bfc-bfe6-09e0ebf2a468 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:03.559568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c7a866d-bf5e-4bfc-bfe6-09e0ebf2a468 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:03.566794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c7a866d-bf5e-4bfc-bfe6-09e0ebf2a468 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:03.571186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c7a866d-bf5e-4bfc-bfe6-09e0ebf2a468 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:03.572204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c7a866d-bf5e-4bfc-bfe6-09e0ebf2a468 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:03.573189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c7a866d-bf5e-4bfc-bfe6-09e0ebf2a468 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:03.574206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c7a866d-bf5e-4bfc-bfe6-09e0ebf2a468 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:03.574801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c7a866d-bf5e-4bfc-bfe6-09e0ebf2a468 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:03.657170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a0bda54c-aa88-4d5f-a096-898d4b30407f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:03.666480 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0bda54c-aa88-4d5f-a096-898d4b30407f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1522 microversion: 2.1 time: 0.346457 Aug 09 14:32:03.679832 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 190/415] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:03 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:32:03.892333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c7a866d-bf5e-4bfc-bfe6-09e0ebf2a468 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:03.906599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c7a866d-bf5e-4bfc-bfe6-09e0ebf2a468 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:03.912746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c7a866d-bf5e-4bfc-bfe6-09e0ebf2a468 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:03.916371 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c7a866d-bf5e-4bfc-bfe6-09e0ebf2a468 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1568 microversion: 2.25 time: 0.361964 Aug 09 14:32:03.920324 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 226/416] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:03 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1568 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:04.027004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6db35079-2665-4e8f-98c9-1ba555c6c047 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:04.028240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6db35079-2665-4e8f-98c9-1ba555c6c047 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:04.044744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6db35079-2665-4e8f-98c9-1ba555c6c047 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:04.049281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6db35079-2665-4e8f-98c9-1ba555c6c047 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:04.049795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6db35079-2665-4e8f-98c9-1ba555c6c047 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:04.052858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6db35079-2665-4e8f-98c9-1ba555c6c047 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:04.054221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6db35079-2665-4e8f-98c9-1ba555c6c047 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:04.055871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6db35079-2665-4e8f-98c9-1ba555c6c047 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:04.317910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fb59eaea-df8f-4b5e-b188-2f83377f17fb tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:04.318665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fb59eaea-df8f-4b5e-b188-2f83377f17fb tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:04.321085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6db35079-2665-4e8f-98c9-1ba555c6c047 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:04.334543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb59eaea-df8f-4b5e-b188-2f83377f17fb tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:04.340737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb59eaea-df8f-4b5e-b188-2f83377f17fb tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:04.343564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb59eaea-df8f-4b5e-b188-2f83377f17fb tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:04.344573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb59eaea-df8f-4b5e-b188-2f83377f17fb tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:04.345232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb59eaea-df8f-4b5e-b188-2f83377f17fb tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:04.352029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb59eaea-df8f-4b5e-b188-2f83377f17fb tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:04.362051 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6db35079-2665-4e8f-98c9-1ba555c6c047 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1462 microversion: 2.1 time: 0.335521 Aug 09 14:32:04.363319 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 191/417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:04 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1462 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:04.677343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fb59eaea-df8f-4b5e-b188-2f83377f17fb tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:04.692597 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fb59eaea-df8f-4b5e-b188-2f83377f17fb tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1276 microversion: 2.1 time: 0.374811 Aug 09 14:32:04.707274 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 227/418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:04 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1276 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:04.714313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a6d0ba35-8447-4c6e-995f-ce70e22a1aef tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:04.721996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a6d0ba35-8447-4c6e-995f-ce70e22a1aef tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:04.742367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6d0ba35-8447-4c6e-995f-ce70e22a1aef tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:04.744880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6d0ba35-8447-4c6e-995f-ce70e22a1aef tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:04.745537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6d0ba35-8447-4c6e-995f-ce70e22a1aef tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:04.747389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6d0ba35-8447-4c6e-995f-ce70e22a1aef tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:04.748014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6d0ba35-8447-4c6e-995f-ce70e22a1aef tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:04.749675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6d0ba35-8447-4c6e-995f-ce70e22a1aef tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:04.875730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7042a1ea-8ad6-4735-b266-dd99fa170b26 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:04.876342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7042a1ea-8ad6-4735-b266-dd99fa170b26 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:04.886676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7042a1ea-8ad6-4735-b266-dd99fa170b26 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:04.887199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7042a1ea-8ad6-4735-b266-dd99fa170b26 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:04.887637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7042a1ea-8ad6-4735-b266-dd99fa170b26 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:04.888348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7042a1ea-8ad6-4735-b266-dd99fa170b26 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:04.888797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7042a1ea-8ad6-4735-b266-dd99fa170b26 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:04.889206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7042a1ea-8ad6-4735-b266-dd99fa170b26 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:05.157812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a6d0ba35-8447-4c6e-995f-ce70e22a1aef tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:05.178459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:05.213813 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a6d0ba35-8447-4c6e-995f-ce70e22a1aef tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1331 microversion: 2.1 time: 0.509564 Aug 09 14:32:05.214738 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 228/419] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:04 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1331 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:05.234753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d889fe7-c6d4-41ca-bb0b-c4328860406e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:05.236361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3d889fe7-c6d4-41ca-bb0b-c4328860406e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:05.256465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d889fe7-c6d4-41ca-bb0b-c4328860406e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:05.257253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d889fe7-c6d4-41ca-bb0b-c4328860406e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:05.257900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d889fe7-c6d4-41ca-bb0b-c4328860406e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:05.260956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d889fe7-c6d4-41ca-bb0b-c4328860406e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:05.261665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d889fe7-c6d4-41ca-bb0b-c4328860406e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:05.267059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d889fe7-c6d4-41ca-bb0b-c4328860406e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:05.693433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d889fe7-c6d4-41ca-bb0b-c4328860406e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:05.701881 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d889fe7-c6d4-41ca-bb0b-c4328860406e tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1522 microversion: 2.1 time: 0.484371 Aug 09 14:32:05.719640 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 229/420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:05 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:05.731636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bda8fa76-d2dd-4120-985f-f3dc05d89f4d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:05.732565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bda8fa76-d2dd-4120-985f-f3dc05d89f4d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:05.748148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bda8fa76-d2dd-4120-985f-f3dc05d89f4d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:05.748941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bda8fa76-d2dd-4120-985f-f3dc05d89f4d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:05.749548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bda8fa76-d2dd-4120-985f-f3dc05d89f4d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:05.750480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bda8fa76-d2dd-4120-985f-f3dc05d89f4d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:05.766530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bda8fa76-d2dd-4120-985f-f3dc05d89f4d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:05.767339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bda8fa76-d2dd-4120-985f-f3dc05d89f4d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:05.774127 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7042a1ea-8ad6-4735-b266-dd99fa170b26 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1613 microversion: 2.1 time: 1.390523 Aug 09 14:32:05.785026 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 192/421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:04 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1613 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:05.808378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f095b005-3f46-4470-9ceb-79f5817881c1 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:05.813805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f095b005-3f46-4470-9ceb-79f5817881c1 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:05.847460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f095b005-3f46-4470-9ceb-79f5817881c1 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:05.849029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f095b005-3f46-4470-9ceb-79f5817881c1 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:05.851230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f095b005-3f46-4470-9ceb-79f5817881c1 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:05.852076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f095b005-3f46-4470-9ceb-79f5817881c1 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:05.853654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f095b005-3f46-4470-9ceb-79f5817881c1 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:05.854313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f095b005-3f46-4470-9ceb-79f5817881c1 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:06.024225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f095b005-3f46-4470-9ceb-79f5817881c1 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:06.037989 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f095b005-3f46-4470-9ceb-79f5817881c1 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1276 microversion: 2.1 time: 0.244445 Aug 09 14:32:06.038668 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 193/422] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:05 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:06.054016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5159bdb5-5444-46b8-882e-56e493d63c71 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:06.054016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5159bdb5-5444-46b8-882e-56e493d63c71 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:06.065576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5159bdb5-5444-46b8-882e-56e493d63c71 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:06.066118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5159bdb5-5444-46b8-882e-56e493d63c71 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:06.066581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5159bdb5-5444-46b8-882e-56e493d63c71 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:06.067396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5159bdb5-5444-46b8-882e-56e493d63c71 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:06.067859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5159bdb5-5444-46b8-882e-56e493d63c71 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:06.068378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5159bdb5-5444-46b8-882e-56e493d63c71 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:06.167569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5159bdb5-5444-46b8-882e-56e493d63c71 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4b6bcc9d7723487a9655932727c72c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade9d9f6a2064be4b4c0d9bb65c10afe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:06.168202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5159bdb5-5444-46b8-882e-56e493d63c71 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] [instance: c4125ae9-163d-4e42-b277-f309f031f352] flavor_id is None. Assuming migration. {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 09 14:32:06.168616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5159bdb5-5444-46b8-882e-56e493d63c71 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 14:32:06.270414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bda8fa76-d2dd-4120-985f-f3dc05d89f4d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:06.294851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bda8fa76-d2dd-4120-985f-f3dc05d89f4d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:06.300844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bda8fa76-d2dd-4120-985f-f3dc05d89f4d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:06.306442 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bda8fa76-d2dd-4120-985f-f3dc05d89f4d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1568 microversion: 2.25 time: 0.585130 Aug 09 14:32:06.308761 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 230/423] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:05 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1568 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:06.324234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d60de97d-6b10-40c3-9b74-31a4d5b284d8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:06.328330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d60de97d-6b10-40c3-9b74-31a4d5b284d8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:06.345220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60de97d-6b10-40c3-9b74-31a4d5b284d8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:06.346100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60de97d-6b10-40c3-9b74-31a4d5b284d8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:06.348606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60de97d-6b10-40c3-9b74-31a4d5b284d8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:06.349710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60de97d-6b10-40c3-9b74-31a4d5b284d8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:06.352145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60de97d-6b10-40c3-9b74-31a4d5b284d8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:06.354360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60de97d-6b10-40c3-9b74-31a4d5b284d8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:07.338828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:07.480087 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5159bdb5-5444-46b8-882e-56e493d63c71 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352/action" status: 202 len: 0 microversion: 2.1 time: 1.439444 Aug 09 14:32:07.481163 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 194/424] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:32:06 2022] POST /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352/action => generated 0 bytes in 1442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:32:07.484844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d60de97d-6b10-40c3-9b74-31a4d5b284d8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:07.488434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a7084426-6e0a-4389-b0f2-607d16fc0c55 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:07.491316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a7084426-6e0a-4389-b0f2-607d16fc0c55 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:07.495201 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d60de97d-6b10-40c3-9b74-31a4d5b284d8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1331 microversion: 2.1 time: 1.184105 Aug 09 14:32:07.497813 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 231/425] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:06 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1331 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:07.515506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7084426-6e0a-4389-b0f2-607d16fc0c55 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:07.516237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7084426-6e0a-4389-b0f2-607d16fc0c55 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:07.516868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7084426-6e0a-4389-b0f2-607d16fc0c55 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:07.517776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7084426-6e0a-4389-b0f2-607d16fc0c55 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:07.518409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7084426-6e0a-4389-b0f2-607d16fc0c55 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:07.519192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7084426-6e0a-4389-b0f2-607d16fc0c55 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:07.524344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0044ad6e-d363-439c-b28b-a32649356c26 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:07.525029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0044ad6e-d363-439c-b28b-a32649356c26 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:07.540660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0044ad6e-d363-439c-b28b-a32649356c26 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:07.543816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0044ad6e-d363-439c-b28b-a32649356c26 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:07.544556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0044ad6e-d363-439c-b28b-a32649356c26 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:07.545565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0044ad6e-d363-439c-b28b-a32649356c26 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:07.546204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0044ad6e-d363-439c-b28b-a32649356c26 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:07.546909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0044ad6e-d363-439c-b28b-a32649356c26 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:08.085298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a7084426-6e0a-4389-b0f2-607d16fc0c55 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:08.106447 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a7084426-6e0a-4389-b0f2-607d16fc0c55 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1522 microversion: 2.1 time: 0.619470 Aug 09 14:32:08.108644 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 195/426] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:07 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1522 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:08.135773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1574992a-9b82-4ee9-932c-229d19474cd8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:08.136656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1574992a-9b82-4ee9-932c-229d19474cd8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:08.146211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1574992a-9b82-4ee9-932c-229d19474cd8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:08.150044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1574992a-9b82-4ee9-932c-229d19474cd8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:08.150044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1574992a-9b82-4ee9-932c-229d19474cd8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:08.150044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1574992a-9b82-4ee9-932c-229d19474cd8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:08.150950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1574992a-9b82-4ee9-932c-229d19474cd8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:08.151805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1574992a-9b82-4ee9-932c-229d19474cd8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:08.240372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0044ad6e-d363-439c-b28b-a32649356c26 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:08.263888 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0044ad6e-d363-439c-b28b-a32649356c26 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1318 microversion: 2.1 time: 0.764941 Aug 09 14:32:08.279692 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 232/427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:07 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1318 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:08.356700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=16 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:08.696512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01ee4a03-4331-43e5-ab81-ece0d9afb049 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Action: 'update', calling method: .version_select at 0x7f41de9b7160>, body: {"quota_set": {"ram": "5120"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:08.826785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01ee4a03-4331-43e5-ab81-ece0d9afb049 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:08.828532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01ee4a03-4331-43e5-ab81-ece0d9afb049 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:08.831526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01ee4a03-4331-43e5-ab81-ece0d9afb049 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:08.832556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01ee4a03-4331-43e5-ab81-ece0d9afb049 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:08.834999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01ee4a03-4331-43e5-ab81-ece0d9afb049 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:08.837459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01ee4a03-4331-43e5-ab81-ece0d9afb049 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:08.956986 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01ee4a03-4331-43e5-ab81-ece0d9afb049 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/1204ab1d657d47c8a9a71dc2fd5d5ee3" status: 200 len: 240 microversion: 2.36 time: 0.675229 Aug 09 14:32:08.957761 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 233/428] 10.222.0.50 () {62 vars in 1303 bytes} [Tue Aug 9 14:32:08 2022] PUT /compute/v2.1/os-quota-sets/1204ab1d657d47c8a9a71dc2fd5d5ee3 => generated 240 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:32:08.970963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1574992a-9b82-4ee9-932c-229d19474cd8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:08.972501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ec30cd1-38de-4399-8ef8-dd0693eaf15c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:08.973411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ec30cd1-38de-4399-8ef8-dd0693eaf15c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:08.980918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec30cd1-38de-4399-8ef8-dd0693eaf15c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:08.981105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1574992a-9b82-4ee9-932c-229d19474cd8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:08.981877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec30cd1-38de-4399-8ef8-dd0693eaf15c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:08.982516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1574992a-9b82-4ee9-932c-229d19474cd8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:08.982765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec30cd1-38de-4399-8ef8-dd0693eaf15c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:08.983688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec30cd1-38de-4399-8ef8-dd0693eaf15c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:08.983796 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1574992a-9b82-4ee9-932c-229d19474cd8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1568 microversion: 2.25 time: 0.857752 Aug 09 14:32:08.984278 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 196/429] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:08 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1568 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:08.984972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec30cd1-38de-4399-8ef8-dd0693eaf15c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:08.985817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec30cd1-38de-4399-8ef8-dd0693eaf15c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:09.014647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-bc67255c-a12d-451f-b181-b1dc0d0a9a91 req-c39344f2-9d21-4675-be03-8904d1632748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59150e12-26f8-4d76-8919-498784537442", "name": "network-vif-plugged", "status": "completed", "tag": "8919a34a-05ad-4b2e-b6c8-02b8aee7335b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:09.044069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bc67255c-a12d-451f-b181-b1dc0d0a9a91 req-c39344f2-9d21-4675-be03-8904d1632748 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:09.047560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bc67255c-a12d-451f-b181-b1dc0d0a9a91 req-c39344f2-9d21-4675-be03-8904d1632748 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:09.048124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bc67255c-a12d-451f-b181-b1dc0d0a9a91 req-c39344f2-9d21-4675-be03-8904d1632748 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:09.067856 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-bc67255c-a12d-451f-b181-b1dc0d0a9a91 req-c39344f2-9d21-4675-be03-8904d1632748 service nova] Creating event network-vif-plugged:8919a34a-05ad-4b2e-b6c8-02b8aee7335b for instance 59150e12-26f8-4d76-8919-498784537442 on n-h2-844626-8 Aug 09 14:32:09.077835 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-bc67255c-a12d-451f-b181-b1dc0d0a9a91 req-c39344f2-9d21-4675-be03-8904d1632748 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078158 Aug 09 14:32:09.080399 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 197/430] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:09.087328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b96516e1-9584-4cb2-a752-77f32b0cb185 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:09.088474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b96516e1-9584-4cb2-a752-77f32b0cb185 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:09.095916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b96516e1-9584-4cb2-a752-77f32b0cb185 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:09.096886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b96516e1-9584-4cb2-a752-77f32b0cb185 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:09.097529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b96516e1-9584-4cb2-a752-77f32b0cb185 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:09.098466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b96516e1-9584-4cb2-a752-77f32b0cb185 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:09.099152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b96516e1-9584-4cb2-a752-77f32b0cb185 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:09.100117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b96516e1-9584-4cb2-a752-77f32b0cb185 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:09.556243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ec30cd1-38de-4399-8ef8-dd0693eaf15c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:09.564631 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ec30cd1-38de-4399-8ef8-dd0693eaf15c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1471 microversion: 2.1 time: 0.597811 Aug 09 14:32:09.571662 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 234/431] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:08 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1471 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:09.584004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-39bc3ec0-7cd9-4194-88e9-b2309dfa4a53 req-e7af4701-3c1a-475d-9b9c-6ff0373bf5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f816689-a92c-4d67-9f00-fea73d865d5a", "tag": "23f1b837-21e2-411c-947f-32576c25ec04"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:09.607877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-39bc3ec0-7cd9-4194-88e9-b2309dfa4a53 req-e7af4701-3c1a-475d-9b9c-6ff0373bf5d6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:09.623217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-39bc3ec0-7cd9-4194-88e9-b2309dfa4a53 req-e7af4701-3c1a-475d-9b9c-6ff0373bf5d6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:09.624197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-39bc3ec0-7cd9-4194-88e9-b2309dfa4a53 req-e7af4701-3c1a-475d-9b9c-6ff0373bf5d6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:09.647975 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-39bc3ec0-7cd9-4194-88e9-b2309dfa4a53 req-e7af4701-3c1a-475d-9b9c-6ff0373bf5d6 service nova] Creating event network-changed:23f1b837-21e2-411c-947f-32576c25ec04 for instance 0f816689-a92c-4d67-9f00-fea73d865d5a on n-h1-844626-8 Aug 09 14:32:09.663983 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-39bc3ec0-7cd9-4194-88e9-b2309dfa4a53 req-e7af4701-3c1a-475d-9b9c-6ff0373bf5d6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090820 Aug 09 14:32:09.668702 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 235/432] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:09.676058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-96dc0a59-592c-45d3-8ee0-9b519ae24476 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Calling method '.version_select at 0x7f41de997f70>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:09.789928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96dc0a59-592c-45d3-8ee0-9b519ae24476 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:09.792723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96dc0a59-592c-45d3-8ee0-9b519ae24476 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:09.794477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96dc0a59-592c-45d3-8ee0-9b519ae24476 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:09.795585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96dc0a59-592c-45d3-8ee0-9b519ae24476 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:09.796233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96dc0a59-592c-45d3-8ee0-9b519ae24476 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:09.796924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96dc0a59-592c-45d3-8ee0-9b519ae24476 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:09.811455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b96516e1-9584-4cb2-a752-77f32b0cb185 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:09.821403 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-96dc0a59-592c-45d3-8ee0-9b519ae24476 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/1204ab1d657d47c8a9a71dc2fd5d5ee3/detail" status: 200 len: 672 microversion: 2.36 time: 0.151205 Aug 09 14:32:09.822179 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 236/433] 10.222.0.50 () {60 vars in 1304 bytes} [Tue Aug 9 14:32:09 2022] GET /compute/v2.1/os-quota-sets/1204ab1d657d47c8a9a71dc2fd5d5ee3/detail => generated 672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:32:09.823427 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b96516e1-9584-4cb2-a752-77f32b0cb185 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1331 microversion: 2.1 time: 0.739358 Aug 09 14:32:09.824044 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 198/434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:09 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1331 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:09.829289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e687d5d-2957-4753-8d07-7c5ddd711ea4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:09.830299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e687d5d-2957-4753-8d07-7c5ddd711ea4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:09.830558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3de9ccad-43c4-4d07-87f4-c160c45b5084 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:09.835594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3de9ccad-43c4-4d07-87f4-c160c45b5084 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:09.851832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3de9ccad-43c4-4d07-87f4-c160c45b5084 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:09.852125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e687d5d-2957-4753-8d07-7c5ddd711ea4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:09.852250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3de9ccad-43c4-4d07-87f4-c160c45b5084 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:09.852722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3de9ccad-43c4-4d07-87f4-c160c45b5084 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:09.852879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e687d5d-2957-4753-8d07-7c5ddd711ea4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:09.853410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e687d5d-2957-4753-8d07-7c5ddd711ea4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:09.853748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3de9ccad-43c4-4d07-87f4-c160c45b5084 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:09.854588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e687d5d-2957-4753-8d07-7c5ddd711ea4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:09.855297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e687d5d-2957-4753-8d07-7c5ddd711ea4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:09.855971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e687d5d-2957-4753-8d07-7c5ddd711ea4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:09.859375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3de9ccad-43c4-4d07-87f4-c160c45b5084 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:09.860134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3de9ccad-43c4-4d07-87f4-c160c45b5084 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:10.187896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3de9ccad-43c4-4d07-87f4-c160c45b5084 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:10.195507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e687d5d-2957-4753-8d07-7c5ddd711ea4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:10.202332 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3de9ccad-43c4-4d07-87f4-c160c45b5084 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1318 microversion: 2.1 time: 0.376535 Aug 09 14:32:10.204549 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 199/435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:09 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:10.215864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1e434ef-c08a-4000-a0b3-d271d88cec5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:10.218313 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e687d5d-2957-4753-8d07-7c5ddd711ea4 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1499 microversion: 2.1 time: 0.380156 Aug 09 14:32:10.219270 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 237/436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:09 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1499 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:10.224240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Action: 'update', calling method: .version_select at 0x7f41de778c10>, body: {"quota_set": {"ram": "2048"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:10.234451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1e434ef-c08a-4000-a0b3-d271d88cec5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:10.253909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1e434ef-c08a-4000-a0b3-d271d88cec5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:10.254403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1e434ef-c08a-4000-a0b3-d271d88cec5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:10.254833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1e434ef-c08a-4000-a0b3-d271d88cec5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:10.259757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1e434ef-c08a-4000-a0b3-d271d88cec5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:10.260306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1e434ef-c08a-4000-a0b3-d271d88cec5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:10.264336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1e434ef-c08a-4000-a0b3-d271d88cec5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:10.298738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:10.299622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:10.300383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:10.301281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:10.301901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:10.302489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:10.384261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:10.386322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:10.390192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:10.391127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:10.391668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:10.393758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:10.482342 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b98245b4-c9b3-4560-a817-b99d0a5490bb tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/1204ab1d657d47c8a9a71dc2fd5d5ee3?user_id=be7e25a7f115456291f53e32b6d6a7b5" status: 200 len: 240 microversion: 2.36 time: 0.261576 Aug 09 14:32:10.484085 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 238/437] 10.222.0.50 () {62 vars in 1384 bytes} [Tue Aug 9 14:32:10 2022] PUT /compute/v2.1/os-quota-sets/1204ab1d657d47c8a9a71dc2fd5d5ee3?user_id=be7e25a7f115456291f53e32b6d6a7b5 => generated 240 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:32:10.489679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-02423d2d-42dd-4e7a-9900-a1fe7dcc646c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:10.496646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-02423d2d-42dd-4e7a-9900-a1fe7dcc646c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:10.497998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-02423d2d-42dd-4e7a-9900-a1fe7dcc646c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:32:10.507656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02423d2d-42dd-4e7a-9900-a1fe7dcc646c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:10.508506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02423d2d-42dd-4e7a-9900-a1fe7dcc646c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:10.509334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02423d2d-42dd-4e7a-9900-a1fe7dcc646c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:10.510316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02423d2d-42dd-4e7a-9900-a1fe7dcc646c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:10.511014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02423d2d-42dd-4e7a-9900-a1fe7dcc646c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:10.511645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02423d2d-42dd-4e7a-9900-a1fe7dcc646c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:10.572116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1e434ef-c08a-4000-a0b3-d271d88cec5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:10.586918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1e434ef-c08a-4000-a0b3-d271d88cec5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:10.588643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1e434ef-c08a-4000-a0b3-d271d88cec5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:10.590073 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1e434ef-c08a-4000-a0b3-d271d88cec5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1568 microversion: 2.25 time: 0.382391 Aug 09 14:32:10.590792 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 200/438] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:10 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1568 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:10.595788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85870e75-fc4d-4c83-8da1-130268d64830 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] Calling method '.version_select at 0x7f41def37f70>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:10.648006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-02423d2d-42dd-4e7a-9900-a1fe7dcc646c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:32:10.711453 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85870e75-fc4d-4c83-8da1-130268d64830 tempest-QuotasAdminTestV236-1953832024 tempest-QuotasAdminTestV236-1953832024-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/1204ab1d657d47c8a9a71dc2fd5d5ee3?user_id=be7e25a7f115456291f53e32b6d6a7b5" status: 200 len: 282 microversion: 2.36 time: 0.119140 Aug 09 14:32:10.712769 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 201/439] 10.222.0.50 () {60 vars in 1364 bytes} [Tue Aug 9 14:32:10 2022] GET /compute/v2.1/os-quota-sets/1204ab1d657d47c8a9a71dc2fd5d5ee3?user_id=be7e25a7f115456291f53e32b6d6a7b5 => generated 282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:32:10.728451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5266aaf-531a-4c86-b532-bd460267d686 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:10.729265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c5266aaf-531a-4c86-b532-bd460267d686 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:10.744556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5266aaf-531a-4c86-b532-bd460267d686 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:10.747275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5266aaf-531a-4c86-b532-bd460267d686 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:10.749720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5266aaf-531a-4c86-b532-bd460267d686 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:10.752142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5266aaf-531a-4c86-b532-bd460267d686 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:10.752653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5266aaf-531a-4c86-b532-bd460267d686 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:10.753081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5266aaf-531a-4c86-b532-bd460267d686 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:10.758795 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-02423d2d-42dd-4e7a-9900-a1fe7dcc646c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.273162 Aug 09 14:32:10.768795 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 239/440] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Aug 9 14:32:10 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:10.785620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5aff8a32-f29a-499c-a946-9799a78f8510 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:10.804709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5aff8a32-f29a-499c-a946-9799a78f8510 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:10.805355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5aff8a32-f29a-499c-a946-9799a78f8510 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:10.805573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5aff8a32-f29a-499c-a946-9799a78f8510 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:10.886624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5aff8a32-f29a-499c-a946-9799a78f8510 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Going to try to start instance {{(pid=119406) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 14:32:10.997453 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5aff8a32-f29a-499c-a946-9799a78f8510 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "POST /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce/action" status: 202 len: 0 microversion: 2.1 time: 0.224301 Aug 09 14:32:10.998101 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 240/441] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:32:10 2022] POST /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:32:11.027616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-20862ea7-8cf9-4427-9443-d83bb53fe504 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:11.028397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-20862ea7-8cf9-4427-9443-d83bb53fe504 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:11.045119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20862ea7-8cf9-4427-9443-d83bb53fe504 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:11.047902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20862ea7-8cf9-4427-9443-d83bb53fe504 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:11.050101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20862ea7-8cf9-4427-9443-d83bb53fe504 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:11.051324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20862ea7-8cf9-4427-9443-d83bb53fe504 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:11.051939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20862ea7-8cf9-4427-9443-d83bb53fe504 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:11.053845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20862ea7-8cf9-4427-9443-d83bb53fe504 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:11.098407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c5266aaf-531a-4c86-b532-bd460267d686 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:11.106649 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c5266aaf-531a-4c86-b532-bd460267d686 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1471 microversion: 2.1 time: 0.391655 Aug 09 14:32:11.120060 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 202/442] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:10 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1471 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:11.128684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-76f54bbe-606d-4762-805e-6bddb5a8ceeb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:11.130050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-76f54bbe-606d-4762-805e-6bddb5a8ceeb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:11.137350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f54bbe-606d-4762-805e-6bddb5a8ceeb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:11.138013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f54bbe-606d-4762-805e-6bddb5a8ceeb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:11.138584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f54bbe-606d-4762-805e-6bddb5a8ceeb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:11.139561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f54bbe-606d-4762-805e-6bddb5a8ceeb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:11.140724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f54bbe-606d-4762-805e-6bddb5a8ceeb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:11.141303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f54bbe-606d-4762-805e-6bddb5a8ceeb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:11.252176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=22 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:11.592043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-76f54bbe-606d-4762-805e-6bddb5a8ceeb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:11.598747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-20862ea7-8cf9-4427-9443-d83bb53fe504 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:11.601780 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-76f54bbe-606d-4762-805e-6bddb5a8ceeb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1508 microversion: 2.1 time: 0.480546 Aug 09 14:32:11.603339 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 203/443] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:11 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:11.610944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6643e4a6-0220-49a9-abb3-44eb8cfb3678 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:11.611675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6643e4a6-0220-49a9-abb3-44eb8cfb3678 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:11.629742 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-20862ea7-8cf9-4427-9443-d83bb53fe504 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1331 microversion: 2.1 time: 0.617467 Aug 09 14:32:11.632253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6643e4a6-0220-49a9-abb3-44eb8cfb3678 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:11.634298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6643e4a6-0220-49a9-abb3-44eb8cfb3678 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:11.640039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6643e4a6-0220-49a9-abb3-44eb8cfb3678 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:11.643698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6643e4a6-0220-49a9-abb3-44eb8cfb3678 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:11.643852 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 241/444] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:11 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1331 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:11.645043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6643e4a6-0220-49a9-abb3-44eb8cfb3678 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:11.648383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6643e4a6-0220-49a9-abb3-44eb8cfb3678 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:11.655825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84ef5f8f-8f83-4192-a4cf-7ddaf82efed7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:11.656262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84ef5f8f-8f83-4192-a4cf-7ddaf82efed7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:11.669953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84ef5f8f-8f83-4192-a4cf-7ddaf82efed7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:11.674970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84ef5f8f-8f83-4192-a4cf-7ddaf82efed7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:11.676378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84ef5f8f-8f83-4192-a4cf-7ddaf82efed7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:11.680924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84ef5f8f-8f83-4192-a4cf-7ddaf82efed7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:11.684123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84ef5f8f-8f83-4192-a4cf-7ddaf82efed7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:11.684744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84ef5f8f-8f83-4192-a4cf-7ddaf82efed7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:12.071775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-84ef5f8f-8f83-4192-a4cf-7ddaf82efed7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:12.092823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-84ef5f8f-8f83-4192-a4cf-7ddaf82efed7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:12.096669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-84ef5f8f-8f83-4192-a4cf-7ddaf82efed7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:12.102970 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84ef5f8f-8f83-4192-a4cf-7ddaf82efed7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1558 microversion: 2.25 time: 0.458025 Aug 09 14:32:12.106457 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 242/445] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:11 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1558 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:12.138847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e77b7b3e-11f9-40f7-91f7-8d6a598a289b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:12.140065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e77b7b3e-11f9-40f7-91f7-8d6a598a289b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:12.152509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e77b7b3e-11f9-40f7-91f7-8d6a598a289b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:12.153220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e77b7b3e-11f9-40f7-91f7-8d6a598a289b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:12.153817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e77b7b3e-11f9-40f7-91f7-8d6a598a289b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:12.155468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e77b7b3e-11f9-40f7-91f7-8d6a598a289b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:12.156735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e77b7b3e-11f9-40f7-91f7-8d6a598a289b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:12.157478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e77b7b3e-11f9-40f7-91f7-8d6a598a289b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:12.164520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6643e4a6-0220-49a9-abb3-44eb8cfb3678 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:12.176939 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6643e4a6-0220-49a9-abb3-44eb8cfb3678 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1318 microversion: 2.1 time: 0.570149 Aug 09 14:32:12.192938 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 204/446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:11 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:12.200074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1f703515-636d-4d9e-89bb-717b2c9d4bb4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '.version_select at 0x7f41deebbee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:12.204328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f703515-636d-4d9e-89bb-717b2c9d4bb4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:12.204813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f703515-636d-4d9e-89bb-717b2c9d4bb4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:12.205373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f703515-636d-4d9e-89bb-717b2c9d4bb4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:12.252931 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1f703515-636d-4d9e-89bb-717b2c9d4bb4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1108 microversion: 2.25 time: 0.055664 Aug 09 14:32:12.255176 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 205/447] 10.222.0.50 () {60 vars in 1184 bytes} [Tue Aug 9 14:32:12 2022] GET /compute/v2.1/os-migrations => generated 1108 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:12.270562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-be79d5ef-48e9-4197-baa3-0f1b75a2eb41 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:12.271840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-be79d5ef-48e9-4197-baa3-0f1b75a2eb41 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:12.300046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be79d5ef-48e9-4197-baa3-0f1b75a2eb41 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:12.301770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be79d5ef-48e9-4197-baa3-0f1b75a2eb41 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:12.302445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be79d5ef-48e9-4197-baa3-0f1b75a2eb41 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:12.305360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be79d5ef-48e9-4197-baa3-0f1b75a2eb41 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:12.307395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be79d5ef-48e9-4197-baa3-0f1b75a2eb41 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:12.308168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be79d5ef-48e9-4197-baa3-0f1b75a2eb41 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:12.471389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e77b7b3e-11f9-40f7-91f7-8d6a598a289b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:12.486812 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e77b7b3e-11f9-40f7-91f7-8d6a598a289b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1471 microversion: 2.1 time: 0.354693 Aug 09 14:32:12.489853 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 243/448] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:12 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1471 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:12.627540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8b34767-b139-4402-9053-99f30ed867af tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:12.628465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8b34767-b139-4402-9053-99f30ed867af tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:12.642647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8b34767-b139-4402-9053-99f30ed867af tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:12.643220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-be79d5ef-48e9-4197-baa3-0f1b75a2eb41 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 50063b74-64e4-46e0-a842-cfd6735d25ac {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:12.646970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8b34767-b139-4402-9053-99f30ed867af tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:12.647807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8b34767-b139-4402-9053-99f30ed867af tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:12.648887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8b34767-b139-4402-9053-99f30ed867af tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:12.650529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8b34767-b139-4402-9053-99f30ed867af tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:12.652764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8b34767-b139-4402-9053-99f30ed867af tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:12.682982 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-be79d5ef-48e9-4197-baa3-0f1b75a2eb41 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 2050 microversion: 2.25 time: 0.417588 Aug 09 14:32:12.684232 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 206/449] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:12 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 2050 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:12.710971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3378d851-e983-489d-b7d0-ebf2f67a6380 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:12.710971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3378d851-e983-489d-b7d0-ebf2f67a6380 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:12.731633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3378d851-e983-489d-b7d0-ebf2f67a6380 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:12.731768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3378d851-e983-489d-b7d0-ebf2f67a6380 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:12.737390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3378d851-e983-489d-b7d0-ebf2f67a6380 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:12.738547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3378d851-e983-489d-b7d0-ebf2f67a6380 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:12.746658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3378d851-e983-489d-b7d0-ebf2f67a6380 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:12.753766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3378d851-e983-489d-b7d0-ebf2f67a6380 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:13.542649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3378d851-e983-489d-b7d0-ebf2f67a6380 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:13.560034 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3378d851-e983-489d-b7d0-ebf2f67a6380 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1534 microversion: 2.1 time: 0.873331 Aug 09 14:32:13.561108 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 207/450] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:12 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1534 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:13.570931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8b34767-b139-4402-9053-99f30ed867af tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:13.579368 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e8b34767-b139-4402-9053-99f30ed867af tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1508 microversion: 2.1 time: 0.957924 Aug 09 14:32:13.580511 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 244/451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:12 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1508 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:32:13.585330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42ab3d05-d4cf-42ee-8fa5-417f4357bf65 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:13.591971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42ab3d05-d4cf-42ee-8fa5-417f4357bf65 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:13.594813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-523061060", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "3fec08e6-958d-4908-98b5-60037a88730d"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:13.605964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ab3d05-d4cf-42ee-8fa5-417f4357bf65 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:13.617457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ab3d05-d4cf-42ee-8fa5-417f4357bf65 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:13.617906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ab3d05-d4cf-42ee-8fa5-417f4357bf65 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:13.618641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ab3d05-d4cf-42ee-8fa5-417f4357bf65 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:13.619104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ab3d05-d4cf-42ee-8fa5-417f4357bf65 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:13.619524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ab3d05-d4cf-42ee-8fa5-417f4357bf65 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:13.692392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] validate_networks() for [('3fec08e6-958d-4908-98b5-60037a88730d', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:32:14.084497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42ab3d05-d4cf-42ee-8fa5-417f4357bf65 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:14.093862 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42ab3d05-d4cf-42ee-8fa5-417f4357bf65 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1318 microversion: 2.1 time: 0.512148 Aug 09 14:32:14.094579 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 245/452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:13 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:14.101783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91ae573a-87d7-4849-800f-fe46b31a1a8a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:14.103636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91ae573a-87d7-4849-800f-fe46b31a1a8a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:14.110658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91ae573a-87d7-4849-800f-fe46b31a1a8a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:14.111603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91ae573a-87d7-4849-800f-fe46b31a1a8a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:14.112433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91ae573a-87d7-4849-800f-fe46b31a1a8a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:14.113987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91ae573a-87d7-4849-800f-fe46b31a1a8a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:14.114642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91ae573a-87d7-4849-800f-fe46b31a1a8a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:14.115354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91ae573a-87d7-4849-800f-fe46b31a1a8a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:14.138542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:14.395907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91ae573a-87d7-4849-800f-fe46b31a1a8a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:14.409019 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91ae573a-87d7-4849-800f-fe46b31a1a8a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1471 microversion: 2.1 time: 0.311500 Aug 09 14:32:14.409959 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 246/453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:14 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1471 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:14.417344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-398c3d89-aaab-4722-8ab1-fafdd70b3031 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Action: 'create', calling method: .version_select at 0x7f41de7171f0>, body: {"pool": "29ae9fc7-b9a1-496b-a8e8-bbaf101db756"} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:14.708286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:32:14.711674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:32:14.713132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:32:14.716399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:32:14.725132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:32:14.782195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=23 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:14.808326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:14.809860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:14.814985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:14.819252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:14.819737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:14.839783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:14.917970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Getting quotas for project d512f92fc41c45edbd209ab51922e5d7. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:32:14.924429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Getting quotas for user 247d1747ce074adb8b1e56a459e8cd51 and project d512f92fc41c45edbd209ab51922e5d7. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:32:14.962426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:32:14.967532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:32:15.085955 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d7e13a68-0c33-45e2-84df-9a7948e75e15 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.519703 Aug 09 14:32:15.088811 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 208/454] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:32:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 14:32:15.100978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c89b7182-6634-420e-a0c0-b38a2dd8d28c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:15.102383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c89b7182-6634-420e-a0c0-b38a2dd8d28c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:15.116961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c89b7182-6634-420e-a0c0-b38a2dd8d28c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:15.166888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c89b7182-6634-420e-a0c0-b38a2dd8d28c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:15.166888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c89b7182-6634-420e-a0c0-b38a2dd8d28c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:15.166888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c89b7182-6634-420e-a0c0-b38a2dd8d28c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:15.166888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c89b7182-6634-420e-a0c0-b38a2dd8d28c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:15.167641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c89b7182-6634-420e-a0c0-b38a2dd8d28c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:15.498342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c89b7182-6634-420e-a0c0-b38a2dd8d28c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:15.507775 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c89b7182-6634-420e-a0c0-b38a2dd8d28c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1508 microversion: 2.1 time: 0.417297 Aug 09 14:32:15.512239 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 209/455] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:15 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1508 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:15.522816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-7851093c-851e-4069-9474-5b5b04af2e5b req-5a7b23b6-e1c7-434b-ae94-2f5daa87967d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f816689-a92c-4d67-9f00-fea73d865d5a", "name": "network-vif-plugged", "status": "completed", "tag": "23f1b837-21e2-411c-947f-32576c25ec04"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:15.543285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7851093c-851e-4069-9474-5b5b04af2e5b req-5a7b23b6-e1c7-434b-ae94-2f5daa87967d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:15.546003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7851093c-851e-4069-9474-5b5b04af2e5b req-5a7b23b6-e1c7-434b-ae94-2f5daa87967d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:15.546728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7851093c-851e-4069-9474-5b5b04af2e5b req-5a7b23b6-e1c7-434b-ae94-2f5daa87967d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:15.578710 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-7851093c-851e-4069-9474-5b5b04af2e5b req-5a7b23b6-e1c7-434b-ae94-2f5daa87967d service nova] Creating event network-vif-plugged:23f1b837-21e2-411c-947f-32576c25ec04 for instance 0f816689-a92c-4d67-9f00-fea73d865d5a on n-h1-844626-8 Aug 09 14:32:15.586808 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-7851093c-851e-4069-9474-5b5b04af2e5b req-5a7b23b6-e1c7-434b-ae94-2f5daa87967d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067566 Aug 09 14:32:15.587510 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 210/456] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:15.612830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22782096-7dfd-4595-85d6-391c4f934fd7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:15.627877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22782096-7dfd-4595-85d6-391c4f934fd7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:15.751439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22782096-7dfd-4595-85d6-391c4f934fd7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:15.761708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22782096-7dfd-4595-85d6-391c4f934fd7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:15.763511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22782096-7dfd-4595-85d6-391c4f934fd7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:15.768055 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22782096-7dfd-4595-85d6-391c4f934fd7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1261 microversion: 2.25 time: 0.178085 Aug 09 14:32:15.769159 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 211/457] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:15 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:15.777349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9dc38b6a-6c8a-45aa-9056-b8ecbcb60afa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:15.777988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9dc38b6a-6c8a-45aa-9056-b8ecbcb60afa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:15.791287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dc38b6a-6c8a-45aa-9056-b8ecbcb60afa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:15.791782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dc38b6a-6c8a-45aa-9056-b8ecbcb60afa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:15.792216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dc38b6a-6c8a-45aa-9056-b8ecbcb60afa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:15.792921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dc38b6a-6c8a-45aa-9056-b8ecbcb60afa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:15.793366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dc38b6a-6c8a-45aa-9056-b8ecbcb60afa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:15.793784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dc38b6a-6c8a-45aa-9056-b8ecbcb60afa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:16.066415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9dc38b6a-6c8a-45aa-9056-b8ecbcb60afa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:16.074759 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9dc38b6a-6c8a-45aa-9056-b8ecbcb60afa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1318 microversion: 2.1 time: 0.304353 Aug 09 14:32:16.089620 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 212/458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:15 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:16.095059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a36581e0-4c23-4474-ad3b-5bd9f6caaa0d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:16.096028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a36581e0-4c23-4474-ad3b-5bd9f6caaa0d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:16.103496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a36581e0-4c23-4474-ad3b-5bd9f6caaa0d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:16.104316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a36581e0-4c23-4474-ad3b-5bd9f6caaa0d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:16.104743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a36581e0-4c23-4474-ad3b-5bd9f6caaa0d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:16.105459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a36581e0-4c23-4474-ad3b-5bd9f6caaa0d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:16.106068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a36581e0-4c23-4474-ad3b-5bd9f6caaa0d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:16.106642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a36581e0-4c23-4474-ad3b-5bd9f6caaa0d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:16.364990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a36581e0-4c23-4474-ad3b-5bd9f6caaa0d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:16.373546 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a36581e0-4c23-4474-ad3b-5bd9f6caaa0d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1471 microversion: 2.1 time: 0.282356 Aug 09 14:32:16.374762 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 213/459] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:16 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:16.535891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63c386ae-b715-45f6-8434-2c34c52583bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:16.536793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-63c386ae-b715-45f6-8434-2c34c52583bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:16.545405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63c386ae-b715-45f6-8434-2c34c52583bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:16.546068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63c386ae-b715-45f6-8434-2c34c52583bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:16.546613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63c386ae-b715-45f6-8434-2c34c52583bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:16.547450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63c386ae-b715-45f6-8434-2c34c52583bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:16.548002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63c386ae-b715-45f6-8434-2c34c52583bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:16.548522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63c386ae-b715-45f6-8434-2c34c52583bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:16.956066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-63c386ae-b715-45f6-8434-2c34c52583bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:16.973861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:16.981068 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63c386ae-b715-45f6-8434-2c34c52583bb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1508 microversion: 2.1 time: 0.451273 Aug 09 14:32:16.998451 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 214/460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:16 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1508 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:32:17.008452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40885fdf-f96a-426f-9de6-442eb6fbf581 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:17.009704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40885fdf-f96a-426f-9de6-442eb6fbf581 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:17.019129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40885fdf-f96a-426f-9de6-442eb6fbf581 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:17.020098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40885fdf-f96a-426f-9de6-442eb6fbf581 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:17.020774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40885fdf-f96a-426f-9de6-442eb6fbf581 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:17.022910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40885fdf-f96a-426f-9de6-442eb6fbf581 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:17.023723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40885fdf-f96a-426f-9de6-442eb6fbf581 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:17.024374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40885fdf-f96a-426f-9de6-442eb6fbf581 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:17.077286 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-398c3d89-aaab-4722-8ab1-fafdd70b3031 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.665953 Aug 09 14:32:17.079338 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 247/461] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 9 14:32:14 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:17.100785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Action: 'action', calling method: .version_select at 0x7f41e501a160>, body: {"addFloatingIp": {"address": "172.25.5.229"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:17.110635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:17.149167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:17.151821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:17.152664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:17.154607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:17.155267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:17.156487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:17.182368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40885fdf-f96a-426f-9de6-442eb6fbf581 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:17.197760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40885fdf-f96a-426f-9de6-442eb6fbf581 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:17.208338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40885fdf-f96a-426f-9de6-442eb6fbf581 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:17.210411 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40885fdf-f96a-426f-9de6-442eb6fbf581 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1321 microversion: 2.25 time: 0.209750 Aug 09 14:32:17.211939 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 215/462] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:16 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:17.232933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c8ea0e7-6b5d-4444-aa46-6cbc8bfa3e75 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:17.233544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5c8ea0e7-6b5d-4444-aa46-6cbc8bfa3e75 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:17.254982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "refresh_cache-59150e12-26f8-4d76-8919-498784537442" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:32:17.255547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquired lock "refresh_cache-59150e12-26f8-4d76-8919-498784537442" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:32:17.257283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8ea0e7-6b5d-4444-aa46-6cbc8bfa3e75 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:17.258206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8ea0e7-6b5d-4444-aa46-6cbc8bfa3e75 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:17.259173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8ea0e7-6b5d-4444-aa46-6cbc8bfa3e75 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:17.262032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8ea0e7-6b5d-4444-aa46-6cbc8bfa3e75 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:17.262539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8ea0e7-6b5d-4444-aa46-6cbc8bfa3e75 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:17.263306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8ea0e7-6b5d-4444-aa46-6cbc8bfa3e75 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:17.597375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c8ea0e7-6b5d-4444-aa46-6cbc8bfa3e75 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:17.606027 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c8ea0e7-6b5d-4444-aa46-6cbc8bfa3e75 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1318 microversion: 2.1 time: 0.392756 Aug 09 14:32:17.631484 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 216/463] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:17 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:17.636871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ad9c9d9-beac-4254-b02e-84901129a79a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:17.637683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ad9c9d9-beac-4254-b02e-84901129a79a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:17.652502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ad9c9d9-beac-4254-b02e-84901129a79a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:17.653173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ad9c9d9-beac-4254-b02e-84901129a79a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:17.653740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ad9c9d9-beac-4254-b02e-84901129a79a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:17.654609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ad9c9d9-beac-4254-b02e-84901129a79a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:17.655246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ad9c9d9-beac-4254-b02e-84901129a79a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:17.655832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ad9c9d9-beac-4254-b02e-84901129a79a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:18.454984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ad9c9d9-beac-4254-b02e-84901129a79a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:18.464525 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ad9c9d9-beac-4254-b02e-84901129a79a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1476 microversion: 2.1 time: 0.831667 Aug 09 14:32:18.476104 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 217/464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:17 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1476 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:18.486957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23cb09e2-f38e-4e4e-9552-84af8c74e1b0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:18.487809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-23cb09e2-f38e-4e4e-9552-84af8c74e1b0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:18.494761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23cb09e2-f38e-4e4e-9552-84af8c74e1b0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:18.495735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23cb09e2-f38e-4e4e-9552-84af8c74e1b0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:18.496725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23cb09e2-f38e-4e4e-9552-84af8c74e1b0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:18.497698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23cb09e2-f38e-4e4e-9552-84af8c74e1b0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:18.498352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23cb09e2-f38e-4e4e-9552-84af8c74e1b0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:18.499065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23cb09e2-f38e-4e4e-9552-84af8c74e1b0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:19.098330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-23cb09e2-f38e-4e4e-9552-84af8c74e1b0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:19.109271 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23cb09e2-f38e-4e4e-9552-84af8c74e1b0 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1512 microversion: 2.1 time: 0.631637 Aug 09 14:32:19.123109 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 218/465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:18 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1512 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:19.123109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c63707de-9622-46f7-9ebc-8c7e118c2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:19.125929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c63707de-9622-46f7-9ebc-8c7e118c2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:19.133306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c63707de-9622-46f7-9ebc-8c7e118c2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:19.134017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c63707de-9622-46f7-9ebc-8c7e118c2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:19.134642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c63707de-9622-46f7-9ebc-8c7e118c2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:19.135540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c63707de-9622-46f7-9ebc-8c7e118c2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:19.136134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c63707de-9622-46f7-9ebc-8c7e118c2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:19.137016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c63707de-9622-46f7-9ebc-8c7e118c2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:19.443802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c63707de-9622-46f7-9ebc-8c7e118c2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:19.457335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c63707de-9622-46f7-9ebc-8c7e118c2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:19.461476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c63707de-9622-46f7-9ebc-8c7e118c2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:19.465034 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c63707de-9622-46f7-9ebc-8c7e118c2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1319 microversion: 2.25 time: 0.351106 Aug 09 14:32:19.467633 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 219/466] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:19 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:19.479625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c093b90a-1d2a-4318-a365-4a637462dcb5 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:19.483132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c093b90a-1d2a-4318-a365-4a637462dcb5 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:19.498968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c093b90a-1d2a-4318-a365-4a637462dcb5 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:19.499735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c093b90a-1d2a-4318-a365-4a637462dcb5 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:19.500445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c093b90a-1d2a-4318-a365-4a637462dcb5 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:19.501473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c093b90a-1d2a-4318-a365-4a637462dcb5 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:19.502125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c093b90a-1d2a-4318-a365-4a637462dcb5 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:19.502780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c093b90a-1d2a-4318-a365-4a637462dcb5 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:19.970266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c093b90a-1d2a-4318-a365-4a637462dcb5 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:19.979757 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c093b90a-1d2a-4318-a365-4a637462dcb5 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1468 microversion: 2.1 time: 0.510775 Aug 09 14:32:19.982898 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 220/467] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:19 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1468 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:19.995920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Building network info cache for instance {{(pid=119406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 14:32:19.998345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60caafff-3ce1-46df-a6ef-058ba721ce8b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:20.009086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60caafff-3ce1-46df-a6ef-058ba721ce8b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:20.009946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.compute.servers [None req-60caafff-3ce1-46df-a6ef-058ba721ce8b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Removing options 'limit' from query {{(pid=119407) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 09 14:32:20.010927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-60caafff-3ce1-46df-a6ef-058ba721ce8b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:32:20.015299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60caafff-3ce1-46df-a6ef-058ba721ce8b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:20.016202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60caafff-3ce1-46df-a6ef-058ba721ce8b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:20.017002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60caafff-3ce1-46df-a6ef-058ba721ce8b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:20.018337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60caafff-3ce1-46df-a6ef-058ba721ce8b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:20.019686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60caafff-3ce1-46df-a6ef-058ba721ce8b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:20.020290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60caafff-3ce1-46df-a6ef-058ba721ce8b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:20.021996 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60caafff-3ce1-46df-a6ef-058ba721ce8b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.038087 Aug 09 14:32:20.023107 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 221/468] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Aug 9 14:32:19 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:32:20.382748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9da573da-f8f1-48dd-9495-bf41c254b28d tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Calling method '.version_select at 0x7f41de5f1dc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:20.475785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=36 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:20.574274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=11 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:20.642351 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9da573da-f8f1-48dd-9495-bf41c254b28d tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe" status: 200 len: 371 microversion: 2.1 time: 0.617903 Aug 09 14:32:20.657080 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 222/469] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 9 14:32:20 2022] GET /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe => generated 371 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:20.673399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0d3c5f15-4d83-49e5-90b6-2fdd62d86919 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:20.674028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0d3c5f15-4d83-49e5-90b6-2fdd62d86919 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:20.685484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d3c5f15-4d83-49e5-90b6-2fdd62d86919 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:20.686525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d3c5f15-4d83-49e5-90b6-2fdd62d86919 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:20.687150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d3c5f15-4d83-49e5-90b6-2fdd62d86919 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:20.688204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d3c5f15-4d83-49e5-90b6-2fdd62d86919 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:20.688937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d3c5f15-4d83-49e5-90b6-2fdd62d86919 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:20.690331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d3c5f15-4d83-49e5-90b6-2fdd62d86919 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:21.171205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0d3c5f15-4d83-49e5-90b6-2fdd62d86919 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:21.181456 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0d3c5f15-4d83-49e5-90b6-2fdd62d86919 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1476 microversion: 2.1 time: 0.523029 Aug 09 14:32:21.182062 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 223/470] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:20 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1476 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:21.625319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-702892697", "block_migration": true, "disk_over_commit": false}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:21.628205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:21.641421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:21.641915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:21.642346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:21.643140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:21.643706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:21.644056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:21.688565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lazy-loading 'flavor' on Instance uuid 0f816689-a92c-4d67-9f00-fea73d865d5a {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:21.706580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Going to try to live migrate instance to tempest-host-702892697 {{(pid=119407) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 14:32:21.707285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Updating instance_info_cache with network_info: [{"id": "8919a34a-05ad-4b2e-b6c8-02b8aee7335b", "address": "fa:16:3e:62:7a:eb", "network": {"id": "505d781d-685d-4f4d-90ea-300cf638095b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-173237240-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2ed4c364ec984dd2911b76dc78702f88", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8919a34a-05", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 14:32:21.726249 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] HTTP exception thrown: Compute host tempest-host-702892697 could not be found. Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Request method failure captured: Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a/action HTTP/1.1 Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 106 Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_fApmm3gpA3TyhkHo3CRc5sZeBsz1ihUNE-UElrH-cd56iOVlfTtoaCVieOeyLHSDitbEulMCAtjwWhFEiTQJ90yQUT6vMXZ4bT_8W6UNAWe9Gh0aP8SGjcjBOG_-dp3MshAjZNxpn_esmUEvHtslhp4xPcZetidFcUlqzjKQXRTE Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: c71515c4f7aa4924b570873b7f45951b Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-LiveMigrationNegativeTest-519146900 Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:32:21.732659 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:32:21.734259 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c71515c4f7aa4924b570873b7f45951b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c71515c4f7aa4924b570873b7f45951b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c71515c4f7aa4924b570873b7f45951b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c71515c4f7aa4924b570873b7f45951b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:21.734259 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-LiveMigrationNegativeTest-519146900 Aug 09 14:32:21.734259 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: c71515c4f7aa4924b570873b7f45951b Aug 09 14:32:21.734259 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-519146900 Aug 09 14:32:21.734259 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-LiveMigrationNegativeTest-519146900-project-admin Aug 09 14:32:21.734259 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:32:21.734259 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:32:21.734259 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 0070af346315409daf5c6ae2b8b2f7e2 Aug 09 14:32:21.734259 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-LiveMigrationNegativeTest-519146900-project-admin Aug 09 14:32:21.734259 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:32:21.734259 n-d-844626-8 devstack@n-api.service[119407]: {"os-migrateLive": {"host": "tempest-host-702892697", "block_migration": true, "disk_over_commit": false}} Aug 09 14:32:21.734259 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: exception: Compute host tempest-host-702892697 could not be found. Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '0f816689-a92c-4d67-9f00-fea73d865d5a', 'body': {'os-migrateLive': {'host': 'tempest-host-702892697', 'block_migration': True, 'disk_over_commit': False}}} Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 14:32:21.737657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5449, in live_migrate Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-702892697 could not be found. Aug 09 14:32:21.739504 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-702892697 could not be found. Aug 09 14:32:21.741035 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:21.742532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:21.742532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:21.742532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:21.742532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:21.742532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:21.742532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:21.742532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:21.742532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-702892697 could not be found. Aug 09 14:32:21.742532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:21.742532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Returning 400 to user: Compute host tempest-host-702892697 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:21.742532 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-746070c2-7fa5-4b69-a176-e9cd32b395fa tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a/action" status: 400 len: 99 microversion: 2.1 time: 0.544171 Aug 09 14:32:21.743333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Releasing lock "refresh_cache-59150e12-26f8-4d76-8919-498784537442" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:32:21.743445 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 224/471] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Aug 9 14:32:21 2022] POST /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a/action => generated 99 bytes in 551 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:32:21.743533 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-619264cb-6677-4687-b43e-70af0ebc508d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action" status: 202 len: 0 microversion: 2.1 time: 4.655493 Aug 09 14:32:21.743870 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 248/472] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:32:17 2022] POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action => generated 0 bytes in 4657 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 14:32:21.750084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-16f79ab9-8c9c-48f8-9d55-e0abc0f2a02c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:21.751156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-16f79ab9-8c9c-48f8-9d55-e0abc0f2a02c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:21.755114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-00ff1508-38c5-4824-a627-ea4b612c4b2b req-6af13199-aac6-4aaf-9c35-ab271c294c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59150e12-26f8-4d76-8919-498784537442", "tag": "8919a34a-05ad-4b2e-b6c8-02b8aee7335b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:21.772676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16f79ab9-8c9c-48f8-9d55-e0abc0f2a02c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:21.773164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16f79ab9-8c9c-48f8-9d55-e0abc0f2a02c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:21.774719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-00ff1508-38c5-4824-a627-ea4b612c4b2b req-6af13199-aac6-4aaf-9c35-ab271c294c82 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:21.775344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16f79ab9-8c9c-48f8-9d55-e0abc0f2a02c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:21.775711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-00ff1508-38c5-4824-a627-ea4b612c4b2b req-6af13199-aac6-4aaf-9c35-ab271c294c82 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:21.776372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-00ff1508-38c5-4824-a627-ea4b612c4b2b req-6af13199-aac6-4aaf-9c35-ab271c294c82 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:21.777550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16f79ab9-8c9c-48f8-9d55-e0abc0f2a02c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:21.778015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16f79ab9-8c9c-48f8-9d55-e0abc0f2a02c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:21.780402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16f79ab9-8c9c-48f8-9d55-e0abc0f2a02c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:21.793246 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-00ff1508-38c5-4824-a627-ea4b612c4b2b req-6af13199-aac6-4aaf-9c35-ab271c294c82 service nova] Creating event network-changed:8919a34a-05ad-4b2e-b6c8-02b8aee7335b for instance 59150e12-26f8-4d76-8919-498784537442 on n-h2-844626-8 Aug 09 14:32:21.807590 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-00ff1508-38c5-4824-a627-ea4b612c4b2b req-6af13199-aac6-4aaf-9c35-ab271c294c82 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060088 Aug 09 14:32:21.812125 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 225/473] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:21.817974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bb462536-afd9-4803-ac09-921c79d23cfe tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:21.824216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bb462536-afd9-4803-ac09-921c79d23cfe tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:21.840695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb462536-afd9-4803-ac09-921c79d23cfe tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:21.841219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb462536-afd9-4803-ac09-921c79d23cfe tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:21.841947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb462536-afd9-4803-ac09-921c79d23cfe tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:21.842853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb462536-afd9-4803-ac09-921c79d23cfe tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:21.843500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb462536-afd9-4803-ac09-921c79d23cfe tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:21.844083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb462536-afd9-4803-ac09-921c79d23cfe tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:22.218808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-16f79ab9-8c9c-48f8-9d55-e0abc0f2a02c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:22.231803 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-16f79ab9-8c9c-48f8-9d55-e0abc0f2a02c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1512 microversion: 2.1 time: 0.486198 Aug 09 14:32:22.234470 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 249/474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:21 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1512 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:22.239341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23f1a516-af93-4498-948e-d59f65fb26e4 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Action: 'update', calling method: .version_select at 0x7f41de692940>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:22.259899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bb462536-afd9-4803-ac09-921c79d23cfe tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:22.275978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bb462536-afd9-4803-ac09-921c79d23cfe tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:22.277704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bb462536-afd9-4803-ac09-921c79d23cfe tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:22.279453 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bb462536-afd9-4803-ac09-921c79d23cfe tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1361 microversion: 2.25 time: 0.465817 Aug 09 14:32:22.295586 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 226/475] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:21 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1361 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:22.303603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3bf0abca-1b5e-484a-af3f-f6b525797884 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:22.305448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3bf0abca-1b5e-484a-af3f-f6b525797884 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:22.315639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bf0abca-1b5e-484a-af3f-f6b525797884 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:22.317418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bf0abca-1b5e-484a-af3f-f6b525797884 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:22.318174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bf0abca-1b5e-484a-af3f-f6b525797884 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:22.319472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bf0abca-1b5e-484a-af3f-f6b525797884 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:22.320765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bf0abca-1b5e-484a-af3f-f6b525797884 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:22.321623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bf0abca-1b5e-484a-af3f-f6b525797884 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:22.328858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:22.335786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23f1a516-af93-4498-948e-d59f65fb26e4 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:22.336528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23f1a516-af93-4498-948e-d59f65fb26e4 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:22.337274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23f1a516-af93-4498-948e-d59f65fb26e4 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:22.338215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23f1a516-af93-4498-948e-d59f65fb26e4 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:22.340204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23f1a516-af93-4498-948e-d59f65fb26e4 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:22.340806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23f1a516-af93-4498-948e-d59f65fb26e4 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:22.439128 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-23f1a516-af93-4498-948e-d59f65fb26e4 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe" status: 200 len: 328 microversion: 2.1 time: 0.203146 Aug 09 14:32:22.441125 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 250/476] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:32:22 2022] PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe => generated 328 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:22.472298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-faa2ba3d-bc49-42e5-bd04-033e74e8016c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Action: 'create', calling method: .version_select at 0x7f41de60d280>, body: {"pool": "29ae9fc7-b9a1-496b-a8e8-bbaf101db756"} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:22.910224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3bf0abca-1b5e-484a-af3f-f6b525797884 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:22.920614 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3bf0abca-1b5e-484a-af3f-f6b525797884 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1468 microversion: 2.1 time: 0.622627 Aug 09 14:32:22.944355 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 227/477] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:22 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1468 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:22.949343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3fce7fbc-3196-4a21-abb0-e277c44f4c71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:22.950292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fce7fbc-3196-4a21-abb0-e277c44f4c71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:22.973433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fce7fbc-3196-4a21-abb0-e277c44f4c71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:22.973924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fce7fbc-3196-4a21-abb0-e277c44f4c71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:22.974499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fce7fbc-3196-4a21-abb0-e277c44f4c71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:22.988085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fce7fbc-3196-4a21-abb0-e277c44f4c71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:22.988575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fce7fbc-3196-4a21-abb0-e277c44f4c71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:22.989541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fce7fbc-3196-4a21-abb0-e277c44f4c71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:23.418878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3fce7fbc-3196-4a21-abb0-e277c44f4c71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:23.426946 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3fce7fbc-3196-4a21-abb0-e277c44f4c71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1476 microversion: 2.1 time: 0.481374 Aug 09 14:32:23.439732 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 228/478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:22 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1476 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:23.446242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2d747f5-0b15-496a-aaf9-5d2cf97101d1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:23.447700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2d747f5-0b15-496a-aaf9-5d2cf97101d1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 9124e955-056d-4c19-baa2-dbbfdcad5058] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:23.455800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d747f5-0b15-496a-aaf9-5d2cf97101d1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:23.456494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d747f5-0b15-496a-aaf9-5d2cf97101d1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:23.457106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d747f5-0b15-496a-aaf9-5d2cf97101d1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:23.457990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d747f5-0b15-496a-aaf9-5d2cf97101d1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:23.458647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d747f5-0b15-496a-aaf9-5d2cf97101d1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:23.459288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d747f5-0b15-496a-aaf9-5d2cf97101d1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:24.150925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2d747f5-0b15-496a-aaf9-5d2cf97101d1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:24.164211 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2d747f5-0b15-496a-aaf9-5d2cf97101d1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058" status: 200 len: 1510 microversion: 2.1 time: 0.718307 Aug 09 14:32:24.165548 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 229/479] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:23 2022] GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058 => generated 1510 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:24.306904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1222842700", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:24.342853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:24.436965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:32:24.894434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:25.240425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:32:25.241737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:32:25.242581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:32:25.243982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:32:25.245182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:32:25.263711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:25.264312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:25.264738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:25.265622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:25.266067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:25.269417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:25.296778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Getting quotas for project 649cdd2449f0499e91043797f54cbbbe. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:32:25.302615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Getting quotas for user af125c08bffd401584ff1db3ebae3328 and project 649cdd2449f0499e91043797f54cbbbe. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:32:25.324089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.utils [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] cores quota exceeded for 649cdd2449f0499e91043797f54cbbbe, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119407) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 09 14:32:25.325230 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Request method failure captured: Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 145 Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_yuFCyRYAWgNooWjZdDPC3TMQafL05Fz3Nt19fRkPx2rWmAaBVLMBqLlS4B6A43-eGcVcF3SBVBxHubX2SvtRpBqHLLrkE5ENh00epPbXPlo_4364Mcv1Vftnq3KnpVDKv0XZcy97B4lDxpHflv_9kpBUo_CfzZf94Vkx-evh5S1o Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 649cdd2449f0499e91043797f54cbbbe Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-QuotasAdminNegativeTest-1987220401 Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:32:25.330377 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:32:25.331949 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_649cdd2449f0499e91043797f54cbbbe", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/649cdd2449f0499e91043797f54cbbbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/649cdd2449f0499e91043797f54cbbbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/649cdd2449f0499e91043797f54cbbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:25.331949 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-QuotasAdminNegativeTest-1987220401 Aug 09 14:32:25.331949 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 649cdd2449f0499e91043797f54cbbbe Aug 09 14:32:25.331949 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1987220401 Aug 09 14:32:25.331949 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-QuotasAdminNegativeTest-1987220401-project Aug 09 14:32:25.331949 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:32:25.331949 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:32:25.331949 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: af125c08bffd401584ff1db3ebae3328 Aug 09 14:32:25.331949 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-QuotasAdminNegativeTest-1987220401-project Aug 09 14:32:25.331949 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:32:25.331949 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1222842700", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} Aug 09 14:32:25.331949 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1222842700', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452'}}} Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 09 14:32:25.332793 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:25.334067 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:25.335477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:25.336894 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:25.336894 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:25.336894 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:25.336894 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:25.336894 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 09 14:32:25.336894 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:25.338357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:25.339426 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6102a525-f046-439f-8e8b-9341342660db tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.172650 Aug 09 14:32:25.340351 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 230/480] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:32:24 2022] POST /compute/v2.1/servers => generated 111 bytes in 1174 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:32:25.345849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-348666227", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:25.427333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:32:26.051973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:32:26.052620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:32:26.053237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:32:26.054365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:32:26.054993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:32:26.071662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:26.072129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:26.072536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:26.078081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:26.078081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:26.078081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:26.109285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Getting quotas for project 5965d64145c14bf4bb3c9c56ffa8dcab. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:32:26.116634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Getting quotas for user 36032592e1ea4a4e996689515d713ab3 and project 5965d64145c14bf4bb3c9c56ffa8dcab. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:32:26.140960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:32:26.143297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:32:26.196593 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3100ac66-55df-4d2e-ac87-626e951da26e tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.854924 Aug 09 14:32:26.197571 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 231/481] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:32:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:32:26.202522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-338e5e48-6b59-4622-b4b5-7ca7ca3944c9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:26.204048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-338e5e48-6b59-4622-b4b5-7ca7ca3944c9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:26.212639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-338e5e48-6b59-4622-b4b5-7ca7ca3944c9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:26.213404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-338e5e48-6b59-4622-b4b5-7ca7ca3944c9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:26.214049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-338e5e48-6b59-4622-b4b5-7ca7ca3944c9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:26.214747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-338e5e48-6b59-4622-b4b5-7ca7ca3944c9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:26.215231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-338e5e48-6b59-4622-b4b5-7ca7ca3944c9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:26.215662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-338e5e48-6b59-4622-b4b5-7ca7ca3944c9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:26.551580 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-faa2ba3d-bc49-42e5-bd04-033e74e8016c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.109015 Aug 09 14:32:26.560380 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 251/482] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 9 14:32:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:26.570814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ffef5778-ff09-4cb2-803a-f81be2714983 req-5e961faf-84f9-43e5-92e2-aff62529d64f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f49c755-de1e-44c2-98de-f6654c0a94a5", "tag": "73ab8dbc-ce85-43aa-8083-f3979fc042ef"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:26.582207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ffef5778-ff09-4cb2-803a-f81be2714983 req-5e961faf-84f9-43e5-92e2-aff62529d64f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:26.583141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ffef5778-ff09-4cb2-803a-f81be2714983 req-5e961faf-84f9-43e5-92e2-aff62529d64f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:26.584298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ffef5778-ff09-4cb2-803a-f81be2714983 req-5e961faf-84f9-43e5-92e2-aff62529d64f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:26.599361 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ffef5778-ff09-4cb2-803a-f81be2714983 req-5e961faf-84f9-43e5-92e2-aff62529d64f service nova] Creating event network-changed:73ab8dbc-ce85-43aa-8083-f3979fc042ef for instance 0f49c755-de1e-44c2-98de-f6654c0a94a5 on n-h1-844626-8 Aug 09 14:32:26.607350 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ffef5778-ff09-4cb2-803a-f81be2714983 req-5e961faf-84f9-43e5-92e2-aff62529d64f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044888 Aug 09 14:32:26.608538 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 252/483] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:26.615576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2072237-c6b7-497c-901c-6c86e6b8bc1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:26.616465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f2072237-c6b7-497c-901c-6c86e6b8bc1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:26.623373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2072237-c6b7-497c-901c-6c86e6b8bc1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:26.624127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2072237-c6b7-497c-901c-6c86e6b8bc1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:26.624865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2072237-c6b7-497c-901c-6c86e6b8bc1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:26.625949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2072237-c6b7-497c-901c-6c86e6b8bc1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:26.626553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2072237-c6b7-497c-901c-6c86e6b8bc1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:26.627123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2072237-c6b7-497c-901c-6c86e6b8bc1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:26.767426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-338e5e48-6b59-4622-b4b5-7ca7ca3944c9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:26.783955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-338e5e48-6b59-4622-b4b5-7ca7ca3944c9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:26.787322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-338e5e48-6b59-4622-b4b5-7ca7ca3944c9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:26.792682 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-338e5e48-6b59-4622-b4b5-7ca7ca3944c9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1361 microversion: 2.25 time: 0.593194 Aug 09 14:32:26.794190 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 232/484] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:26 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1361 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:26.803395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d61ebd30-9053-4261-b53e-e7e002261f2e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:26.805255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d61ebd30-9053-4261-b53e-e7e002261f2e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:26.826875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d61ebd30-9053-4261-b53e-e7e002261f2e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:26.827872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d61ebd30-9053-4261-b53e-e7e002261f2e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:26.828520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d61ebd30-9053-4261-b53e-e7e002261f2e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:26.829531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d61ebd30-9053-4261-b53e-e7e002261f2e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:26.830643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d61ebd30-9053-4261-b53e-e7e002261f2e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:26.835412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d61ebd30-9053-4261-b53e-e7e002261f2e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:26.903239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f2072237-c6b7-497c-901c-6c86e6b8bc1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:26.913819 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f2072237-c6b7-497c-901c-6c86e6b8bc1d tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1513 microversion: 2.1 time: 0.303880 Aug 09 14:32:26.914428 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 253/485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:26 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1513 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:27.125690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85bcf2b2-21ac-45b2-b974-94430d4df8a0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:27.151437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d61ebd30-9053-4261-b53e-e7e002261f2e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:27.155339 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-85bcf2b2-21ac-45b2-b974-94430d4df8a0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.235430 Aug 09 14:32:27.160547 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d61ebd30-9053-4261-b53e-e7e002261f2e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1476 microversion: 2.1 time: 0.365066 Aug 09 14:32:27.167557 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 254/486] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:32:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:27.172552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fdcf0012-f234-45ab-a6b8-c896424b7646 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Action: 'update', calling method: .version_select at 0x7f41de7b6940>, body: {"quota_set": {"cores": 20}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:27.175607 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 233/487] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:26 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:27.196128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ee6e7c2-b787-4efd-9ddf-568088c3fcc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:27.200006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ee6e7c2-b787-4efd-9ddf-568088c3fcc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:27.222287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ee6e7c2-b787-4efd-9ddf-568088c3fcc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:27.223780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ee6e7c2-b787-4efd-9ddf-568088c3fcc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:27.229004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ee6e7c2-b787-4efd-9ddf-568088c3fcc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:27.231670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ee6e7c2-b787-4efd-9ddf-568088c3fcc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:27.232245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ee6e7c2-b787-4efd-9ddf-568088c3fcc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:27.234383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ee6e7c2-b787-4efd-9ddf-568088c3fcc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:27.359559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ee6e7c2-b787-4efd-9ddf-568088c3fcc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:27.374916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdcf0012-f234-45ab-a6b8-c896424b7646 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:27.375460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdcf0012-f234-45ab-a6b8-c896424b7646 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:27.377532 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ee6e7c2-b787-4efd-9ddf-568088c3fcc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1214 microversion: 2.1 time: 0.200687 Aug 09 14:32:27.378138 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 234/488] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:27 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1214 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:27.385144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdcf0012-f234-45ab-a6b8-c896424b7646 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:27.386111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdcf0012-f234-45ab-a6b8-c896424b7646 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:27.389780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdcf0012-f234-45ab-a6b8-c896424b7646 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:27.390312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdcf0012-f234-45ab-a6b8-c896424b7646 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:27.402157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Action: 'action', calling method: .version_select at 0x7f41e50bdd30>, body: {"addFloatingIp": {"address": "172.25.5.141"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:27.404979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:27.434323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:27.434817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:27.435275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:27.435980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:27.436430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:27.436845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:27.488390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:27.545090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "refresh_cache-59150e12-26f8-4d76-8919-498784537442" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:32:27.545485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquired lock "refresh_cache-59150e12-26f8-4d76-8919-498784537442" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:32:27.555314 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fdcf0012-f234-45ab-a6b8-c896424b7646 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe" status: 200 len: 329 microversion: 2.1 time: 0.386243 Aug 09 14:32:27.557964 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 255/489] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:32:27 2022] PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe => generated 329 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:27.566189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e3018017-2ffa-4f16-b464-281930c589df tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:27.573556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e3018017-2ffa-4f16-b464-281930c589df tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:27.574630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e3018017-2ffa-4f16-b464-281930c589df tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:32:27.887392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3018017-2ffa-4f16-b464-281930c589df tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:27.888979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3018017-2ffa-4f16-b464-281930c589df tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:27.889911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3018017-2ffa-4f16-b464-281930c589df tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:27.891027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3018017-2ffa-4f16-b464-281930c589df tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:27.891802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3018017-2ffa-4f16-b464-281930c589df tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:27.892623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3018017-2ffa-4f16-b464-281930c589df tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:28.088471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-e3018017-2ffa-4f16-b464-281930c589df tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:32:28.170544 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e3018017-2ffa-4f16-b464-281930c589df tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.611198 Aug 09 14:32:28.171879 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 256/490] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Aug 9 14:32:27 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:28.271695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d144a003-c55c-4beb-850b-117f0db613e0 tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-740687928", "id": 1478225061, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:28.275626 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:28.275626 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:32:28.403772 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d144a003-c55c-4beb-850b-117f0db613e0 tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.229000 Aug 09 14:32:28.404767 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 257/491] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:32:28 2022] POST /compute/v2.1/flavors => generated 424 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:28.418362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-76467c6f-6cc3-48e6-a3a7-44cb1b99705f tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Calling method '.version_select at 0x7f41de60dee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:28.437656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG neutronclient.v2_0.client [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.141 (531779c7-2e5d-4ad3-b76b-7b6a66e0d97e) with port 8919a34a-05ad-4b2e-b6c8-02b8aee7335b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 29ae9fc7-b9a1-496b-a8e8-bbaf101db756.", "detail": ""}} {{(pid=119407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:32:28.438224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Releasing lock "refresh_cache-59150e12-26f8-4d76-8919-498784537442" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:32:28.438968 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.141 (531779c7-2e5d-4ad3-b76b-7b6a66e0d97e) with port 8919a34a-05ad-4b2e-b6c8-02b8aee7335b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 29ae9fc7-b9a1-496b-a8e8-bbaf101db756. Aug 09 14:32:28.438968 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-4eda5ed9-0e8e-476d-8612-3f4cb59c9fef'] Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Request method failure captured: Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action HTTP/1.1 Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 46 Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_QpQa--ISt8vO-hCXmkQq00faWfBKtM8eFrpgsJjBwaN3i8i14kaZpwo03I6pGJCCaqJ13gmuQdHXWD4ZOgVS2yB0HZLblnFvpKhYF0qhHTQvitlQzLb-tgdmCSvNn8-h6VFwQd7887ADPBoM9Nw-QLeg5R-76NwEwpp1t_MFPcHA Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 2ed4c364ec984dd2911b76dc78702f88 Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:32:28.448674 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:32:28.450270 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ed4c364ec984dd2911b76dc78702f88", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:28.450270 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:28.450270 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 2ed4c364ec984dd2911b76dc78702f88 Aug 09 14:32:28.450270 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:28.450270 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project Aug 09 14:32:28.450270 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:32:28.450270 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:32:28.450270 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: aaf9b49d50cb4967ab7dc88adc939769 Aug 09 14:32:28.450270 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project Aug 09 14:32:28.450270 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:32:28.450270 n-d-844626-8 devstack@n-api.service[119407]: {"addFloatingIp": {"address": "172.25.5.141"}} Aug 09 14:32:28.450270 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: exception: Cannot associate floating IP 172.25.5.141 (531779c7-2e5d-4ad3-b76b-7b6a66e0d97e) with port 8919a34a-05ad-4b2e-b6c8-02b8aee7335b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 29ae9fc7-b9a1-496b-a8e8-bbaf101db756. Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-4eda5ed9-0e8e-476d-8612-3f4cb59c9fef'] Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '59150e12-26f8-4d76-8919-498784537442', 'body': {'addFloatingIp': {'address': '172.25.5.141'}}} Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:32:28.451179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:32:28.453018 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.5.141 (531779c7-2e5d-4ad3-b76b-7b6a66e0d97e) with port 8919a34a-05ad-4b2e-b6c8-02b8aee7335b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 29ae9fc7-b9a1-496b-a8e8-bbaf101db756. Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eda5ed9-0e8e-476d-8612-3f4cb59c9fef'] Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.5.141 (531779c7-2e5d-4ad3-b76b-7b6a66e0d97e) with port 8919a34a-05ad-4b2e-b6c8-02b8aee7335b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 29ae9fc7-b9a1-496b-a8e8-bbaf101db756. Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eda5ed9-0e8e-476d-8612-3f4cb59c9fef'] Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:28.454785 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.5.141 (531779c7-2e5d-4ad3-b76b-7b6a66e0d97e) with port 8919a34a-05ad-4b2e-b6c8-02b8aee7335b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 29ae9fc7-b9a1-496b-a8e8-bbaf101db756. Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eda5ed9-0e8e-476d-8612-3f4cb59c9fef'] Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:28.460036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:28.464973 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:28.464973 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:28.464973 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:28.464973 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:28.464973 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:28.464973 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:28.464973 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.5.141 (531779c7-2e5d-4ad3-b76b-7b6a66e0d97e) with port 8919a34a-05ad-4b2e-b6c8-02b8aee7335b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 29ae9fc7-b9a1-496b-a8e8-bbaf101db756. Aug 09 14:32:28.464973 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4eda5ed9-0e8e-476d-8612-3f4cb59c9fef'] Aug 09 14:32:28.464973 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:28.464973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Returning 400 to user: Cannot associate floating IP 172.25.5.141 (531779c7-2e5d-4ad3-b76b-7b6a66e0d97e) with port 8919a34a-05ad-4b2e-b6c8-02b8aee7335b using fixed IP 172.20.0.8, as that fixed IP already has a floating IP on external network 29ae9fc7-b9a1-496b-a8e8-bbaf101db756. Aug 09 14:32:28.464973 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-4eda5ed9-0e8e-476d-8612-3f4cb59c9fef'] {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:28.466941 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-25b93b12-8ae3-43e3-8b9f-f61665980fdf tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action" status: 400 len: 381 microversion: 2.1 time: 1.069607 Aug 09 14:32:28.466941 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 235/492] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:32:27 2022] POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action => generated 381 bytes in 1084 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:32:28.472291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-be36d815-e8f8-435a-be79-b0b89b07859c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:28.473443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-be36d815-e8f8-435a-be79-b0b89b07859c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:28.483124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be36d815-e8f8-435a-be79-b0b89b07859c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:28.486529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be36d815-e8f8-435a-be79-b0b89b07859c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:28.488135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be36d815-e8f8-435a-be79-b0b89b07859c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:28.490605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be36d815-e8f8-435a-be79-b0b89b07859c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:28.492257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be36d815-e8f8-435a-be79-b0b89b07859c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:28.495433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be36d815-e8f8-435a-be79-b0b89b07859c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:28.514105 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-76467c6f-6cc3-48e6-a3a7-44cb1b99705f tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe" status: 200 len: 371 microversion: 2.1 time: 0.102882 Aug 09 14:32:28.515013 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 258/493] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 9 14:32:28 2022] GET /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:28.526930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fb148bfe-67f5-4a0a-a85d-437beb943fe7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:28.527561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fb148bfe-67f5-4a0a-a85d-437beb943fe7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:28.542775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb148bfe-67f5-4a0a-a85d-437beb943fe7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:28.543310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb148bfe-67f5-4a0a-a85d-437beb943fe7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:28.543747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb148bfe-67f5-4a0a-a85d-437beb943fe7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:28.544449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb148bfe-67f5-4a0a-a85d-437beb943fe7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:28.544899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb148bfe-67f5-4a0a-a85d-437beb943fe7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:28.545320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb148bfe-67f5-4a0a-a85d-437beb943fe7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:28.812717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-be36d815-e8f8-435a-be79-b0b89b07859c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:28.821248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-be36d815-e8f8-435a-be79-b0b89b07859c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:28.822802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-be36d815-e8f8-435a-be79-b0b89b07859c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:28.830453 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-be36d815-e8f8-435a-be79-b0b89b07859c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1361 microversion: 2.25 time: 0.361955 Aug 09 14:32:28.833969 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 236/494] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:28 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:28.853338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a6d1d21-6fc9-40ef-a21d-70a8b64230c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:28.853956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a6d1d21-6fc9-40ef-a21d-70a8b64230c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:28.865737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a6d1d21-6fc9-40ef-a21d-70a8b64230c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:28.866233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a6d1d21-6fc9-40ef-a21d-70a8b64230c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:28.866667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a6d1d21-6fc9-40ef-a21d-70a8b64230c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:28.867411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a6d1d21-6fc9-40ef-a21d-70a8b64230c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:28.876987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a6d1d21-6fc9-40ef-a21d-70a8b64230c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:28.877483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a6d1d21-6fc9-40ef-a21d-70a8b64230c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:29.058513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fb148bfe-67f5-4a0a-a85d-437beb943fe7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:29.071890 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fb148bfe-67f5-4a0a-a85d-437beb943fe7 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1512 microversion: 2.1 time: 0.553709 Aug 09 14:32:29.075468 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 259/495] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:28 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1512 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:29.090468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-532346ae-8fbd-4674-ad4f-2d49dd0d9c3f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:29.091902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-532346ae-8fbd-4674-ad4f-2d49dd0d9c3f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:29.119160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-532346ae-8fbd-4674-ad4f-2d49dd0d9c3f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:29.119663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-532346ae-8fbd-4674-ad4f-2d49dd0d9c3f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:29.120093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-532346ae-8fbd-4674-ad4f-2d49dd0d9c3f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:29.123593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-532346ae-8fbd-4674-ad4f-2d49dd0d9c3f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:29.124097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-532346ae-8fbd-4674-ad4f-2d49dd0d9c3f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:29.124525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-532346ae-8fbd-4674-ad4f-2d49dd0d9c3f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:29.386204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a6d1d21-6fc9-40ef-a21d-70a8b64230c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:29.396103 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a6d1d21-6fc9-40ef-a21d-70a8b64230c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1476 microversion: 2.1 time: 0.560718 Aug 09 14:32:29.399653 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 237/496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:28 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1476 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:29.411521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a6043aba-8839-4187-b1fe-7efc8c4f5365 tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:29.415119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-532346ae-8fbd-4674-ad4f-2d49dd0d9c3f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:29.421920 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a6043aba-8839-4187-b1fe-7efc8c4f5365 tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015640 Aug 09 14:32:29.423369 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 238/497] 10.222.0.50 () {58 vars in 1182 bytes} [Tue Aug 9 14:32:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:32:29.424783 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-532346ae-8fbd-4674-ad4f-2d49dd0d9c3f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1318 microversion: 2.1 time: 0.348011 Aug 09 14:32:29.438470 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 260/498] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:29 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:29.438470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5ab98ea-5e80-4de2-bc3f-ca66b08bf20a tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Action: 'update', calling method: .version_select at 0x7f41de692f70>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:29.447928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a6bc5163-b3d7-4a3e-a6c3-97a55e2c22b0 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '.version_select at 0x7f41dde51e50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:29.531855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5ab98ea-5e80-4de2-bc3f-ca66b08bf20a tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:29.532617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5ab98ea-5e80-4de2-bc3f-ca66b08bf20a tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:29.533304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5ab98ea-5e80-4de2-bc3f-ca66b08bf20a tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:29.534269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5ab98ea-5e80-4de2-bc3f-ca66b08bf20a tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:29.534905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5ab98ea-5e80-4de2-bc3f-ca66b08bf20a tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:29.535497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5ab98ea-5e80-4de2-bc3f-ca66b08bf20a tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:29.606468 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5ab98ea-5e80-4de2-bc3f-ca66b08bf20a tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe" status: 200 len: 328 microversion: 2.1 time: 0.179549 Aug 09 14:32:29.620698 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 261/499] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:32:29 2022] PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe => generated 328 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:29.628013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a805902-f552-488f-aa8f-1bba2f551eb9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:29.628687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a805902-f552-488f-aa8f-1bba2f551eb9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 9124e955-056d-4c19-baa2-dbbfdcad5058] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:29.638890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a805902-f552-488f-aa8f-1bba2f551eb9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:29.643459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a805902-f552-488f-aa8f-1bba2f551eb9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:29.644074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a805902-f552-488f-aa8f-1bba2f551eb9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:29.644820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a805902-f552-488f-aa8f-1bba2f551eb9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:29.645283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a805902-f552-488f-aa8f-1bba2f551eb9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:29.650782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a805902-f552-488f-aa8f-1bba2f551eb9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:30.185638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a805902-f552-488f-aa8f-1bba2f551eb9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:30.193569 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a805902-f552-488f-aa8f-1bba2f551eb9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058" status: 200 len: 1510 microversion: 2.1 time: 0.571100 Aug 09 14:32:30.208122 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 262/500] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:29 2022] GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058 => generated 1510 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:30.215160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-084ca14a-ebfa-4dd2-9f0d-ba156258077a tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-580511506", "id": 1980919458, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:30.218462 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:30.218462 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:32:30.241452 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-084ca14a-ebfa-4dd2-9f0d-ba156258077a tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.031468 Aug 09 14:32:30.242228 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 263/501] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:32:30 2022] POST /compute/v2.1/flavors => generated 424 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:30.248346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1486618825", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:30.309394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:32:30.902244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:32:30.903439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:32:30.903927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:32:30.904512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:32:30.904936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:32:30.915110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:30.915938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:30.916469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:30.917483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:30.918248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:30.919256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:30.941407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Getting quotas for project 649cdd2449f0499e91043797f54cbbbe. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:32:30.945687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Getting quotas for user af125c08bffd401584ff1db3ebae3328 and project 649cdd2449f0499e91043797f54cbbbe. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:32:30.956648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.utils [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] instances quota exceeded for 649cdd2449f0499e91043797f54cbbbe, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119406) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 09 14:32:30.957462 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Request method failure captured: Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 145 Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_yuFCyRYAWgNooWjZdDPC3TMQafL05Fz3Nt19fRkPx2rWmAaBVLMBqLlS4B6A43-eGcVcF3SBVBxHubX2SvtRpBqHLLrkE5ENh00epPbXPlo_4364Mcv1Vftnq3KnpVDKv0XZcy97B4lDxpHflv_9kpBUo_CfzZf94Vkx-evh5S1o Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 649cdd2449f0499e91043797f54cbbbe Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-QuotasAdminNegativeTest-1987220401 Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:32:30.961198 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:32:30.962488 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_649cdd2449f0499e91043797f54cbbbe", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/649cdd2449f0499e91043797f54cbbbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/649cdd2449f0499e91043797f54cbbbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/649cdd2449f0499e91043797f54cbbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:30.962488 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-QuotasAdminNegativeTest-1987220401 Aug 09 14:32:30.962488 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 649cdd2449f0499e91043797f54cbbbe Aug 09 14:32:30.962488 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1987220401 Aug 09 14:32:30.962488 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-QuotasAdminNegativeTest-1987220401-project Aug 09 14:32:30.962488 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:32:30.962488 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:32:30.962488 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: af125c08bffd401584ff1db3ebae3328 Aug 09 14:32:30.962488 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-QuotasAdminNegativeTest-1987220401-project Aug 09 14:32:30.962488 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:32:30.962488 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1486618825", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} Aug 09 14:32:30.962488 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1486618825', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452'}}} Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 09 14:32:30.963238 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:30.964328 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:30.965688 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:30.967049 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:30.967049 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:30.967049 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:30.967049 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:30.967049 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 09 14:32:30.967049 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:30.967049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:30.967049 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-43ac8b5a-32ed-426a-9881-8e8f927e3762 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.719154 Aug 09 14:32:30.967049 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 264/502] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:32:30 2022] POST /compute/v2.1/servers => generated 119 bytes in 720 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:32:30.967813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be3ae289-28e6-4ec6-8b58-0fea622279da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:30.968620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be3ae289-28e6-4ec6-8b58-0fea622279da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:30.975436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be3ae289-28e6-4ec6-8b58-0fea622279da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:30.975916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be3ae289-28e6-4ec6-8b58-0fea622279da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:30.976348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be3ae289-28e6-4ec6-8b58-0fea622279da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:30.977027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be3ae289-28e6-4ec6-8b58-0fea622279da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:30.977468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be3ae289-28e6-4ec6-8b58-0fea622279da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:30.977881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be3ae289-28e6-4ec6-8b58-0fea622279da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:31.255548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-be3ae289-28e6-4ec6-8b58-0fea622279da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:31.264992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-be3ae289-28e6-4ec6-8b58-0fea622279da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:31.266692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-be3ae289-28e6-4ec6-8b58-0fea622279da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:31.268487 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be3ae289-28e6-4ec6-8b58-0fea622279da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1361 microversion: 2.25 time: 0.304408 Aug 09 14:32:31.269217 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 265/503] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:30 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:31.273920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-fb8ee8bb-e5b4-4f61-b57a-6d5b5431e26c req-9c712789-7d63-4c77-827a-9d657d08d27c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49bf1b81-8cce-44a6-97ca-87ab6af16b85", "tag": "a49672bf-47a1-4880-9dbf-84e2874f2277"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:31.286004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-fb8ee8bb-e5b4-4f61-b57a-6d5b5431e26c req-9c712789-7d63-4c77-827a-9d657d08d27c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:31.286586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-fb8ee8bb-e5b4-4f61-b57a-6d5b5431e26c req-9c712789-7d63-4c77-827a-9d657d08d27c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:31.286959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-fb8ee8bb-e5b4-4f61-b57a-6d5b5431e26c req-9c712789-7d63-4c77-827a-9d657d08d27c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:31.300756 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-fb8ee8bb-e5b4-4f61-b57a-6d5b5431e26c req-9c712789-7d63-4c77-827a-9d657d08d27c service nova] Creating event network-changed:a49672bf-47a1-4880-9dbf-84e2874f2277 for instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 on n-h2-844626-8 Aug 09 14:32:31.306347 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-fb8ee8bb-e5b4-4f61-b57a-6d5b5431e26c req-9c712789-7d63-4c77-827a-9d657d08d27c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035902 Aug 09 14:32:31.307121 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 266/504] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:31.314564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9afe0b83-cab4-4e1c-acca-4d3521b5d02a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:31.316272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9afe0b83-cab4-4e1c-acca-4d3521b5d02a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:31.325012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9afe0b83-cab4-4e1c-acca-4d3521b5d02a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:31.325650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9afe0b83-cab4-4e1c-acca-4d3521b5d02a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:31.326270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9afe0b83-cab4-4e1c-acca-4d3521b5d02a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:31.327136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9afe0b83-cab4-4e1c-acca-4d3521b5d02a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:31.327720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9afe0b83-cab4-4e1c-acca-4d3521b5d02a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:31.328274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9afe0b83-cab4-4e1c-acca-4d3521b5d02a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:31.533682 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a6bc5163-b3d7-4a3e-a6c3-97a55e2c22b0 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/531779c7-2e5d-4ad3-b76b-7b6a66e0d97e" status: 202 len: 0 microversion: 2.1 time: 2.108935 Aug 09 14:32:31.534868 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 239/505] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:32:29 2022] DELETE /compute/v2.1/os-floating-ips/531779c7-2e5d-4ad3-b76b-7b6a66e0d97e => generated 0 bytes in 2111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:32:31.541490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d08fa1d7-23b6-4ec4-8efe-0bfbcc0bd836 tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:31.550642 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d08fa1d7-23b6-4ec4-8efe-0bfbcc0bd836 tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014089 Aug 09 14:32:31.551305 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 240/506] 10.222.0.50 () {58 vars in 1182 bytes} [Tue Aug 9 14:32:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:32:31.564384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aef71c8f-e2b7-44bd-a2fd-b3ab28e033ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:31.565358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aef71c8f-e2b7-44bd-a2fd-b3ab28e033ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:31.574056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aef71c8f-e2b7-44bd-a2fd-b3ab28e033ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:31.574681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aef71c8f-e2b7-44bd-a2fd-b3ab28e033ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:31.575273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aef71c8f-e2b7-44bd-a2fd-b3ab28e033ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:31.576471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aef71c8f-e2b7-44bd-a2fd-b3ab28e033ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:31.577447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aef71c8f-e2b7-44bd-a2fd-b3ab28e033ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:31.578207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aef71c8f-e2b7-44bd-a2fd-b3ab28e033ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:31.589964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9afe0b83-cab4-4e1c-acca-4d3521b5d02a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:31.605715 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9afe0b83-cab4-4e1c-acca-4d3521b5d02a tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1513 microversion: 2.1 time: 0.296926 Aug 09 14:32:31.606306 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 267/507] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:31 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:31.623110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d38c2b4e-1287-4e04-b5dd-f799350e1f62 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:31.623770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d38c2b4e-1287-4e04-b5dd-f799350e1f62 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:31.639328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d38c2b4e-1287-4e04-b5dd-f799350e1f62 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:31.641533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d38c2b4e-1287-4e04-b5dd-f799350e1f62 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:31.642320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d38c2b4e-1287-4e04-b5dd-f799350e1f62 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:31.643261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d38c2b4e-1287-4e04-b5dd-f799350e1f62 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:31.643892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d38c2b4e-1287-4e04-b5dd-f799350e1f62 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:31.644518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d38c2b4e-1287-4e04-b5dd-f799350e1f62 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:31.884817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aef71c8f-e2b7-44bd-a2fd-b3ab28e033ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:31.897510 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aef71c8f-e2b7-44bd-a2fd-b3ab28e033ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1476 microversion: 2.1 time: 0.342613 Aug 09 14:32:31.898110 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 241/508] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:31 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1476 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:31.904796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-efa9d979-2d15-468c-a59e-55516fcd4a48 req-8df84fa3-ff45-409b-8491-9f2d6f078443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f49c755-de1e-44c2-98de-f6654c0a94a5", "name": "network-vif-plugged", "status": "completed", "tag": "73ab8dbc-ce85-43aa-8083-f3979fc042ef"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:31.916967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-efa9d979-2d15-468c-a59e-55516fcd4a48 req-8df84fa3-ff45-409b-8491-9f2d6f078443 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:31.917443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-efa9d979-2d15-468c-a59e-55516fcd4a48 req-8df84fa3-ff45-409b-8491-9f2d6f078443 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:31.917873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-efa9d979-2d15-468c-a59e-55516fcd4a48 req-8df84fa3-ff45-409b-8491-9f2d6f078443 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:31.936653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d38c2b4e-1287-4e04-b5dd-f799350e1f62 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:31.946471 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d38c2b4e-1287-4e04-b5dd-f799350e1f62 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1318 microversion: 2.1 time: 0.338881 Aug 09 14:32:31.956174 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-efa9d979-2d15-468c-a59e-55516fcd4a48 req-8df84fa3-ff45-409b-8491-9f2d6f078443 service nova] Creating event network-vif-plugged:73ab8dbc-ce85-43aa-8083-f3979fc042ef for instance 0f49c755-de1e-44c2-98de-f6654c0a94a5 on n-h1-844626-8 Aug 09 14:32:31.962453 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 268/509] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:31 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:31.967995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d1f6e69-c16d-47c5-afd2-1a9ebee639c8 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Action: 'update', calling method: .version_select at 0x7f41de5d9040>, body: {"quota_set": {"instances": 10}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:31.979595 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-efa9d979-2d15-468c-a59e-55516fcd4a48 req-8df84fa3-ff45-409b-8491-9f2d6f078443 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079899 Aug 09 14:32:31.981103 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 242/510] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:31.995855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Action: 'action', calling method: .version_select at 0x7f41e5244700>, body: {"removeFloatingIp": {"address": "172.25.5.229"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:32.070013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d1f6e69-c16d-47c5-afd2-1a9ebee639c8 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:32.071006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d1f6e69-c16d-47c5-afd2-1a9ebee639c8 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:32.071469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d1f6e69-c16d-47c5-afd2-1a9ebee639c8 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:32.072203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d1f6e69-c16d-47c5-afd2-1a9ebee639c8 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:32.072797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d1f6e69-c16d-47c5-afd2-1a9ebee639c8 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:32.073214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d1f6e69-c16d-47c5-afd2-1a9ebee639c8 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:32.126773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:32.139620 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d1f6e69-c16d-47c5-afd2-1a9ebee639c8 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe" status: 200 len: 329 microversion: 2.1 time: 0.175667 Aug 09 14:32:32.140603 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 269/511] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:32:31 2022] PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe => generated 329 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:32.145907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f18a6ac-5b75-4de7-b2f7-7e2d6f49206d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Action: 'create', calling method: .version_select at 0x7f41e538b430>, body: {"keypair": {"name": "tempest-keypair-1853064886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB60PSMWw7szWQQIAyevuIh1PNRTiTBHS7be4kt0kcxBKB0PZMUYFzodRMQ9+f4vqpiYYPw1TiIrhGT7m5fdtCNIE/u09GN3olOtseOfsdfqZTfPM8u0SkHB/+lxRDtykg=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:32.164149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9f18a6ac-5b75-4de7-b2f7-7e2d6f49206d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Getting quotas for project ea5a1dc39fe54b69b5473a9f86dcd34b. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:32:32.168967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9f18a6ac-5b75-4de7-b2f7-7e2d6f49206d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Getting quotas for user d11ef713c75d461291b2a6937db4a4b1 and project ea5a1dc39fe54b69b5473a9f86dcd34b. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:32:32.203608 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f18a6ac-5b75-4de7-b2f7-7e2d6f49206d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061141 Aug 09 14:32:32.210079 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 270/512] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:32:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:32.211485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:32.217155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:32.218027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:32:32.224964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:32.225445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:32.225883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:32.226586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:32.227032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:32.227473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:32.258930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:32:32.262978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:32.270084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:32.270567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:32.271149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:32.272217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:32.273004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:32.273626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:32.357808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:32.369178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:32.370089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:32.370708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:32.878292 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9cb1c089-7f25-44e3-9de4-c7dfc2a94afe tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.672632 Aug 09 14:32:32.891110 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 271/513] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:32:32 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:32.891110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e60e433b-8222-415b-97a8-cada87199ac9 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Calling method '.version_select at 0x7f41de4d6b80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:32.895649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "refresh_cache-59150e12-26f8-4d76-8919-498784537442" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:32:32.895649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquired lock "refresh_cache-59150e12-26f8-4d76-8919-498784537442" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:32:32.959508 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e60e433b-8222-415b-97a8-cada87199ac9 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe" status: 200 len: 371 microversion: 2.1 time: 0.079009 Aug 09 14:32:32.969187 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 272/514] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 9 14:32:32 2022] GET /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:32.975190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63c32c58-e852-4cff-b267-a5e7bf6299a6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:32.975854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63c32c58-e852-4cff-b267-a5e7bf6299a6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:32.982982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63c32c58-e852-4cff-b267-a5e7bf6299a6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:32.983552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63c32c58-e852-4cff-b267-a5e7bf6299a6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:32.983995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63c32c58-e852-4cff-b267-a5e7bf6299a6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:32.984721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63c32c58-e852-4cff-b267-a5e7bf6299a6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:32.985196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63c32c58-e852-4cff-b267-a5e7bf6299a6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:32.985736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63c32c58-e852-4cff-b267-a5e7bf6299a6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:33.255409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63c32c58-e852-4cff-b267-a5e7bf6299a6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:33.259141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:33.266869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63c32c58-e852-4cff-b267-a5e7bf6299a6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:33.270791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63c32c58-e852-4cff-b267-a5e7bf6299a6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:33.276846 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63c32c58-e852-4cff-b267-a5e7bf6299a6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1361 microversion: 2.25 time: 0.306096 Aug 09 14:32:33.277435 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 273/515] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:32 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1361 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:33.375996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-124587289", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "4e9e66ac-24f5-49b8-8427-02f1b1cd91af"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:33.639670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] validate_networks() for [('4e9e66ac-24f5-49b8-8427-02f1b1cd91af', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:32:34.000101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Building network info cache for instance {{(pid=119407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 14:32:34.369289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:32:34.369855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:32:34.370164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:32:34.370732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:32:34.371323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:32:34.386588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:34.387729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:34.388336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:34.389485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:34.390128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:34.390775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:34.436221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Getting quotas for project beac39aa567247818bf13c604a1ed8ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:32:34.442374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Getting quotas for user ca408ac0b6df4c3797409e40335f61aa and project beac39aa567247818bf13c604a1ed8ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:32:34.462164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:32:34.465497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:32:34.532010 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6cce21e1-2a92-4fde-aa40-7f6e71b7439b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.251534 Aug 09 14:32:34.533203 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 274/516] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:32:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:32:34.538229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a95f6c7a-f8eb-44a5-bd30-bc1d20594784 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:34.543830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a95f6c7a-f8eb-44a5-bd30-bc1d20594784 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:34.544496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a95f6c7a-f8eb-44a5-bd30-bc1d20594784 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:32:34.615200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a95f6c7a-f8eb-44a5-bd30-bc1d20594784 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:34.615679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a95f6c7a-f8eb-44a5-bd30-bc1d20594784 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:34.616103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a95f6c7a-f8eb-44a5-bd30-bc1d20594784 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:34.618067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a95f6c7a-f8eb-44a5-bd30-bc1d20594784 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:34.618551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a95f6c7a-f8eb-44a5-bd30-bc1d20594784 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:34.618982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a95f6c7a-f8eb-44a5-bd30-bc1d20594784 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:34.680412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-a95f6c7a-f8eb-44a5-bd30-bc1d20594784 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:32:34.741662 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a95f6c7a-f8eb-44a5-bd30-bc1d20594784 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.207209 Aug 09 14:32:34.742265 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 275/517] 10.222.0.50 () {58 vars in 1150 bytes} [Tue Aug 9 14:32:34 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:34.757792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04dcfc24-6b34-422a-af6a-dd16eff0bb52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:34.759798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-04dcfc24-6b34-422a-af6a-dd16eff0bb52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:34.770214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04dcfc24-6b34-422a-af6a-dd16eff0bb52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:34.771314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04dcfc24-6b34-422a-af6a-dd16eff0bb52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:34.771777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04dcfc24-6b34-422a-af6a-dd16eff0bb52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:34.772492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04dcfc24-6b34-422a-af6a-dd16eff0bb52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:34.772946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04dcfc24-6b34-422a-af6a-dd16eff0bb52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:34.773368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04dcfc24-6b34-422a-af6a-dd16eff0bb52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:34.892353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Updating instance_info_cache with network_info: [{"id": "8919a34a-05ad-4b2e-b6c8-02b8aee7335b", "address": "fa:16:3e:62:7a:eb", "network": {"id": "505d781d-685d-4f4d-90ea-300cf638095b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-173237240-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2ed4c364ec984dd2911b76dc78702f88", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8919a34a-05", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 14:32:34.908256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Releasing lock "refresh_cache-59150e12-26f8-4d76-8919-498784537442" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:32:34.909338 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-71758111-02a4-4305-823b-2efa1b54da3f tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action" status: 202 len: 0 microversion: 2.1 time: 2.927454 Aug 09 14:32:34.910035 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 243/518] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:32:31 2022] POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action => generated 0 bytes in 2929 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 14:32:34.915916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3ebb0040-2f39-4850-8f20-527c3e604e48 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Action: 'update', calling method: .version_select at 0x7f41de268ca0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:35.002709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ebb0040-2f39-4850-8f20-527c3e604e48 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:35.003321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-04dcfc24-6b34-422a-af6a-dd16eff0bb52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:35.003455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ebb0040-2f39-4850-8f20-527c3e604e48 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:35.007560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ebb0040-2f39-4850-8f20-527c3e604e48 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:35.008473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ebb0040-2f39-4850-8f20-527c3e604e48 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:35.008948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ebb0040-2f39-4850-8f20-527c3e604e48 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:35.009391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ebb0040-2f39-4850-8f20-527c3e604e48 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:35.013382 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-04dcfc24-6b34-422a-af6a-dd16eff0bb52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1476 microversion: 2.1 time: 0.264598 Aug 09 14:32:35.027769 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 276/519] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:34 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1476 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:35.036550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8736fd4b-461c-4aaa-9cb3-2e5f975dec59 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:35.037783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8736fd4b-461c-4aaa-9cb3-2e5f975dec59 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:35.045941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8736fd4b-461c-4aaa-9cb3-2e5f975dec59 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:35.046663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8736fd4b-461c-4aaa-9cb3-2e5f975dec59 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:35.047355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8736fd4b-461c-4aaa-9cb3-2e5f975dec59 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:35.048501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8736fd4b-461c-4aaa-9cb3-2e5f975dec59 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:35.049132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8736fd4b-461c-4aaa-9cb3-2e5f975dec59 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:35.049687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8736fd4b-461c-4aaa-9cb3-2e5f975dec59 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:35.103882 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3ebb0040-2f39-4850-8f20-527c3e604e48 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe" status: 200 len: 325 microversion: 2.1 time: 0.192466 Aug 09 14:32:35.117699 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 244/520] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:32:34 2022] PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe => generated 325 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:35.125300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-314914901", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "1980919458", "adminPass": "***", "networks": [{"uuid": "6df883f8-2d60-4d64-8837-2c2d82e3a648"}], "security_groups": [{"name": "tempest-securitygroup--2050609474"}], "key_name": "tempest-keypair-1853064886", "user_data": "}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:35.326465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8736fd4b-461c-4aaa-9cb3-2e5f975dec59 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:35.328866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] validate_networks() for [('6df883f8-2d60-4d64-8837-2c2d82e3a648', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:32:35.338438 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8736fd4b-461c-4aaa-9cb3-2e5f975dec59 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1318 microversion: 2.1 time: 0.309185 Aug 09 14:32:35.352023 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 277/521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:35 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:35.358675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8431ce1c-9620-42a1-81e5-5b8149c603d7 req-c0bd5c73-cd6e-4c4f-8bc7-4c1cd5c78185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59150e12-26f8-4d76-8919-498784537442", "tag": "8919a34a-05ad-4b2e-b6c8-02b8aee7335b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:35.372337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8431ce1c-9620-42a1-81e5-5b8149c603d7 req-c0bd5c73-cd6e-4c4f-8bc7-4c1cd5c78185 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:35.373594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8431ce1c-9620-42a1-81e5-5b8149c603d7 req-c0bd5c73-cd6e-4c4f-8bc7-4c1cd5c78185 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:35.374183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8431ce1c-9620-42a1-81e5-5b8149c603d7 req-c0bd5c73-cd6e-4c4f-8bc7-4c1cd5c78185 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:35.386224 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8431ce1c-9620-42a1-81e5-5b8149c603d7 req-c0bd5c73-cd6e-4c4f-8bc7-4c1cd5c78185 service nova] Creating event network-changed:8919a34a-05ad-4b2e-b6c8-02b8aee7335b for instance 59150e12-26f8-4d76-8919-498784537442 on n-h2-844626-8 Aug 09 14:32:35.391840 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8431ce1c-9620-42a1-81e5-5b8149c603d7 req-c0bd5c73-cd6e-4c4f-8bc7-4c1cd5c78185 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038356 Aug 09 14:32:35.393107 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 278/522] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:35.398739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f3a49c48-f082-4c8a-b99b-ac0b010f2d3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:35.399810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f3a49c48-f082-4c8a-b99b-ac0b010f2d3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:35.418820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3a49c48-f082-4c8a-b99b-ac0b010f2d3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:35.421018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3a49c48-f082-4c8a-b99b-ac0b010f2d3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:35.421909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3a49c48-f082-4c8a-b99b-ac0b010f2d3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:35.423034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3a49c48-f082-4c8a-b99b-ac0b010f2d3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:35.423930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3a49c48-f082-4c8a-b99b-ac0b010f2d3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:35.424592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3a49c48-f082-4c8a-b99b-ac0b010f2d3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:35.639473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f3a49c48-f082-4c8a-b99b-ac0b010f2d3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:35.650024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f3a49c48-f082-4c8a-b99b-ac0b010f2d3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:35.651699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f3a49c48-f082-4c8a-b99b-ac0b010f2d3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:35.653127 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f3a49c48-f082-4c8a-b99b-ac0b010f2d3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1558 microversion: 2.25 time: 0.258787 Aug 09 14:32:35.663166 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 279/523] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:35 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1558 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:35.663166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-18c2b03e-86f0-4476-963a-b48e4364a5df tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:35.663166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-18c2b03e-86f0-4476-963a-b48e4364a5df tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:35.671815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18c2b03e-86f0-4476-963a-b48e4364a5df tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:35.671815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18c2b03e-86f0-4476-963a-b48e4364a5df tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:35.671815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18c2b03e-86f0-4476-963a-b48e4364a5df tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:35.671815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18c2b03e-86f0-4476-963a-b48e4364a5df tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:35.672228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18c2b03e-86f0-4476-963a-b48e4364a5df tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:35.672228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18c2b03e-86f0-4476-963a-b48e4364a5df tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:35.786401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-18c2b03e-86f0-4476-963a-b48e4364a5df tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:35.839995 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-18c2b03e-86f0-4476-963a-b48e4364a5df tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1262 microversion: 2.1 time: 0.184016 Aug 09 14:32:35.856615 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 280/524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:35 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1262 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:35.864611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f005fa36-d8cb-4be5-92c2-c4a0ee973809 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:35.878377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f005fa36-d8cb-4be5-92c2-c4a0ee973809 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:35.880612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f005fa36-d8cb-4be5-92c2-c4a0ee973809 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:32:35.893942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f005fa36-d8cb-4be5-92c2-c4a0ee973809 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:35.896774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f005fa36-d8cb-4be5-92c2-c4a0ee973809 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:35.897405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f005fa36-d8cb-4be5-92c2-c4a0ee973809 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:35.898812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f005fa36-d8cb-4be5-92c2-c4a0ee973809 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:35.904201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f005fa36-d8cb-4be5-92c2-c4a0ee973809 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:35.905055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f005fa36-d8cb-4be5-92c2-c4a0ee973809 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:36.033857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:32:36.034319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:32:36.034735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:32:36.035165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:32:36.035573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:32:36.050380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:36.050866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:36.054117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:36.055273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:36.055961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:36.056572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:36.094835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Getting quotas for project ea5a1dc39fe54b69b5473a9f86dcd34b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:32:36.103411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Getting quotas for user d11ef713c75d461291b2a6937db4a4b1 and project ea5a1dc39fe54b69b5473a9f86dcd34b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:32:36.113983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-f005fa36-d8cb-4be5-92c2-c4a0ee973809 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:32:36.134461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:32:36.140792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:32:36.208758 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f005fa36-d8cb-4be5-92c2-c4a0ee973809 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.350808 Aug 09 14:32:36.211026 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 281/525] 10.222.0.50 () {58 vars in 1212 bytes} [Tue Aug 9 14:32:35 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:36.220004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f51737c-04fb-478a-9d5f-174dd8b3601e tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '.version_select at 0x7f41de5d98b0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:36.226303 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8514f6c5-b891-4008-a302-6571c28c452c tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.107059 Aug 09 14:32:36.226622 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 245/526] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:32:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:32:36.243663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1984739326", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:36.323133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:32:36.665609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:32:36.666028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:32:36.666903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:32:36.669711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:32:36.670162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:32:36.682176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:36.682473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:36.682906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:36.683670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:36.684535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:36.684785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:36.708753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Getting quotas for project 649cdd2449f0499e91043797f54cbbbe. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:32:36.712932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Getting quotas for user af125c08bffd401584ff1db3ebae3328 and project 649cdd2449f0499e91043797f54cbbbe. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:32:36.726969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.utils [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] ram quota exceeded for 649cdd2449f0499e91043797f54cbbbe, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=119407) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 09 14:32:36.727754 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Request method failure captured: Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 145 Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_yuFCyRYAWgNooWjZdDPC3TMQafL05Fz3Nt19fRkPx2rWmAaBVLMBqLlS4B6A43-eGcVcF3SBVBxHubX2SvtRpBqHLLrkE5ENh00epPbXPlo_4364Mcv1Vftnq3KnpVDKv0XZcy97B4lDxpHflv_9kpBUo_CfzZf94Vkx-evh5S1o Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 649cdd2449f0499e91043797f54cbbbe Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-QuotasAdminNegativeTest-1987220401 Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:32:36.731424 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:32:36.732739 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_649cdd2449f0499e91043797f54cbbbe", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/649cdd2449f0499e91043797f54cbbbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/649cdd2449f0499e91043797f54cbbbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/649cdd2449f0499e91043797f54cbbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:36.732739 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-QuotasAdminNegativeTest-1987220401 Aug 09 14:32:36.732739 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 649cdd2449f0499e91043797f54cbbbe Aug 09 14:32:36.732739 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1987220401 Aug 09 14:32:36.732739 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-QuotasAdminNegativeTest-1987220401-project Aug 09 14:32:36.732739 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:32:36.732739 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:32:36.732739 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: af125c08bffd401584ff1db3ebae3328 Aug 09 14:32:36.732739 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-QuotasAdminNegativeTest-1987220401-project Aug 09 14:32:36.732739 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:32:36.732739 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1984739326", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} Aug 09 14:32:36.732739 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1984739326', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452'}}} Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 09 14:32:36.733462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:36.734510 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:36.738812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:36.742609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:36.742609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:36.742609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:36.742609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:36.742609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 09 14:32:36.742609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:36.742609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:36.742609 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8323453-1b3f-41a0-8f38-e5981789e874 tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.502702 Aug 09 14:32:36.742609 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 246/527] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:32:36 2022] POST /compute/v2.1/servers => generated 110 bytes in 505 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:32:36.742609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c3b8f6f-47c2-4f6a-bb08-db63e131ca11 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:36.744475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3c3b8f6f-47c2-4f6a-bb08-db63e131ca11 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:36.749196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c3b8f6f-47c2-4f6a-bb08-db63e131ca11 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:36.750441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c3b8f6f-47c2-4f6a-bb08-db63e131ca11 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:36.750947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c3b8f6f-47c2-4f6a-bb08-db63e131ca11 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:36.751705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c3b8f6f-47c2-4f6a-bb08-db63e131ca11 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:36.752341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c3b8f6f-47c2-4f6a-bb08-db63e131ca11 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:36.752990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c3b8f6f-47c2-4f6a-bb08-db63e131ca11 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.070905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-3c3b8f6f-47c2-4f6a-bb08-db63e131ca11 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 0f49c755-de1e-44c2-98de-f6654c0a94a5 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:37.092377 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3c3b8f6f-47c2-4f6a-bb08-db63e131ca11 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 2050 microversion: 2.25 time: 0.357036 Aug 09 14:32:37.102941 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 247/528] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:36 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 2050 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:37.111600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b43e613b-fc09-4c94-93f6-c1f5b31b336f req-4cd0adad-a0a9-4f9b-8044-0cd28475a93f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49bf1b81-8cce-44a6-97ca-87ab6af16b85", "name": "network-vif-plugged", "status": "completed", "tag": "a49672bf-47a1-4880-9dbf-84e2874f2277"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:37.125645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b43e613b-fc09-4c94-93f6-c1f5b31b336f req-4cd0adad-a0a9-4f9b-8044-0cd28475a93f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.126347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b43e613b-fc09-4c94-93f6-c1f5b31b336f req-4cd0adad-a0a9-4f9b-8044-0cd28475a93f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.127151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b43e613b-fc09-4c94-93f6-c1f5b31b336f req-4cd0adad-a0a9-4f9b-8044-0cd28475a93f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.147825 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b43e613b-fc09-4c94-93f6-c1f5b31b336f req-4cd0adad-a0a9-4f9b-8044-0cd28475a93f service nova] Creating event network-vif-plugged:a49672bf-47a1-4880-9dbf-84e2874f2277 for instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 on n-h2-844626-8 Aug 09 14:32:37.155957 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b43e613b-fc09-4c94-93f6-c1f5b31b336f req-4cd0adad-a0a9-4f9b-8044-0cd28475a93f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051375 Aug 09 14:32:37.156915 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 248/529] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:37.163295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1d967fc-a0f6-4059-b40c-1b41b3369250 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:37.164108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1d967fc-a0f6-4059-b40c-1b41b3369250 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:37.171583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1d967fc-a0f6-4059-b40c-1b41b3369250 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.172122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1d967fc-a0f6-4059-b40c-1b41b3369250 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.172652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1d967fc-a0f6-4059-b40c-1b41b3369250 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.173684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1d967fc-a0f6-4059-b40c-1b41b3369250 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.174228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1d967fc-a0f6-4059-b40c-1b41b3369250 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.174732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1d967fc-a0f6-4059-b40c-1b41b3369250 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.497449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1d967fc-a0f6-4059-b40c-1b41b3369250 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:37.508625 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1d967fc-a0f6-4059-b40c-1b41b3369250 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1476 microversion: 2.1 time: 0.347825 Aug 09 14:32:37.511063 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 249/530] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:37 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1476 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:37.529022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67667d19-7d81-446d-b22a-49e029083d6c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:37.538306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-67667d19-7d81-446d-b22a-49e029083d6c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:37.539128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-67667d19-7d81-446d-b22a-49e029083d6c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:32:37.542116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:37.551183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67667d19-7d81-446d-b22a-49e029083d6c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.551672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67667d19-7d81-446d-b22a-49e029083d6c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.552176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67667d19-7d81-446d-b22a-49e029083d6c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.552897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67667d19-7d81-446d-b22a-49e029083d6c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.553342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67667d19-7d81-446d-b22a-49e029083d6c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.554065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67667d19-7d81-446d-b22a-49e029083d6c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.660663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-67667d19-7d81-446d-b22a-49e029083d6c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:32:37.734848 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f51737c-04fb-478a-9d5f-174dd8b3601e tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/f89d7bb2-ae88-4509-a7d3-bdbbb7383d30" status: 202 len: 0 microversion: 2.1 time: 1.523913 Aug 09 14:32:37.736867 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 282/531] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:32:36 2022] DELETE /compute/v2.1/os-floating-ips/f89d7bb2-ae88-4509-a7d3-bdbbb7383d30 => generated 0 bytes in 1526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:32:37.744208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-106dfdc8-9634-47b5-b9fb-40dd281d85fd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:37.745130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-106dfdc8-9634-47b5-b9fb-40dd281d85fd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:37.751473 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67667d19-7d81-446d-b22a-49e029083d6c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.238152 Aug 09 14:32:37.758710 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 250/532] 10.222.0.50 () {58 vars in 1196 bytes} [Tue Aug 9 14:32:37 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:37.758710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81aae364-05dd-45da-9d5e-70f8cebae668 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:37.758710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-81aae364-05dd-45da-9d5e-70f8cebae668 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:37.765491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81aae364-05dd-45da-9d5e-70f8cebae668 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.766082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81aae364-05dd-45da-9d5e-70f8cebae668 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.766573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81aae364-05dd-45da-9d5e-70f8cebae668 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.767307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81aae364-05dd-45da-9d5e-70f8cebae668 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.767752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81aae364-05dd-45da-9d5e-70f8cebae668 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.768336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81aae364-05dd-45da-9d5e-70f8cebae668 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.768586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-106dfdc8-9634-47b5-b9fb-40dd281d85fd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.769089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-106dfdc8-9634-47b5-b9fb-40dd281d85fd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.769526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-106dfdc8-9634-47b5-b9fb-40dd281d85fd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.770438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-106dfdc8-9634-47b5-b9fb-40dd281d85fd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.770946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-106dfdc8-9634-47b5-b9fb-40dd281d85fd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.771588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-106dfdc8-9634-47b5-b9fb-40dd281d85fd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.844502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-106dfdc8-9634-47b5-b9fb-40dd281d85fd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:37.853582 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-106dfdc8-9634-47b5-b9fb-40dd281d85fd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1316 microversion: 2.1 time: 0.115405 Aug 09 14:32:37.863726 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 283/533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:37 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1316 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:37.863726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bab039a0-5452-443b-aac0-a05148444d94 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Action: 'update', calling method: .version_select at 0x7f41e405be50>, body: {"quota_set": {"ram": 51200}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:37.929669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bab039a0-5452-443b-aac0-a05148444d94 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.930156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bab039a0-5452-443b-aac0-a05148444d94 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.930579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bab039a0-5452-443b-aac0-a05148444d94 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.931370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bab039a0-5452-443b-aac0-a05148444d94 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.931811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bab039a0-5452-443b-aac0-a05148444d94 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.932398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bab039a0-5452-443b-aac0-a05148444d94 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.940030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-81aae364-05dd-45da-9d5e-70f8cebae668 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:37.949746 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81aae364-05dd-45da-9d5e-70f8cebae668 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1318 microversion: 2.1 time: 0.196311 Aug 09 14:32:37.950748 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 251/534] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:37 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:37.955353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-635f9962-34ca-49b4-b1a6-12e2d14d8ca2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:37.956665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-635f9962-34ca-49b4-b1a6-12e2d14d8ca2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:37.964493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-635f9962-34ca-49b4-b1a6-12e2d14d8ca2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.965059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-635f9962-34ca-49b4-b1a6-12e2d14d8ca2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.965571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-635f9962-34ca-49b4-b1a6-12e2d14d8ca2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.966471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-635f9962-34ca-49b4-b1a6-12e2d14d8ca2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:37.967124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-635f9962-34ca-49b4-b1a6-12e2d14d8ca2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:37.967917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-635f9962-34ca-49b4-b1a6-12e2d14d8ca2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:37.990771 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bab039a0-5452-443b-aac0-a05148444d94 tempest-QuotasAdminNegativeTest-685046804 tempest-QuotasAdminNegativeTest-685046804-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe" status: 200 len: 329 microversion: 2.1 time: 0.134608 Aug 09 14:32:37.999968 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 284/535] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:32:37 2022] PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe => generated 329 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:38.000851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8005f131-6242-4642-8f78-55f860903ca4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:38.001563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8005f131-6242-4642-8f78-55f860903ca4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:38.013340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8005f131-6242-4642-8f78-55f860903ca4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.013849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8005f131-6242-4642-8f78-55f860903ca4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.014289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8005f131-6242-4642-8f78-55f860903ca4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.014995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8005f131-6242-4642-8f78-55f860903ca4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.015473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8005f131-6242-4642-8f78-55f860903ca4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.015902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8005f131-6242-4642-8f78-55f860903ca4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.172610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-635f9962-34ca-49b4-b1a6-12e2d14d8ca2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:38.184249 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-635f9962-34ca-49b4-b1a6-12e2d14d8ca2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1310 microversion: 2.1 time: 0.232539 Aug 09 14:32:38.184824 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 252/536] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:37 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1310 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:38.191919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-65a060c3-4dda-49c9-955f-306d092801f8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-65a060c3-4dda-49c9-955f-306d092801f8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Request method failure captured: Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action HTTP/1.1 Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 34 Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_QpQa--ISt8vO-hCXmkQq00faWfBKtM8eFrpgsJjBwaN3i8i14kaZpwo03I6pGJCCaqJ13gmuQdHXWD4ZOgVS2yB0HZLblnFvpKhYF0qhHTQvitlQzLb-tgdmCSvNn8-h6VFwQd7887ADPBoM9Nw-QLeg5R-76NwEwpp1t_MFPcHA Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 2ed4c364ec984dd2911b76dc78702f88 Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:32:38.198248 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ed4c364ec984dd2911b76dc78702f88", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 2ed4c364ec984dd2911b76dc78702f88 Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: aaf9b49d50cb4967ab7dc88adc939769 Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: {"addFloatingIp": {"address": ""}} Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:32:38.199896 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '59150e12-26f8-4d76-8919-498784537442', 'body': {'addFloatingIp': {'address': ''}}} Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi '' Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:38.200867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:32:38.202365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:32:38.203732 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 09 14:32:38.203732 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.203732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-65a060c3-4dda-49c9-955f-306d092801f8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:38.204808 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-65a060c3-4dda-49c9-955f-306d092801f8 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action" status: 400 len: 142 microversion: 2.1 time: 0.018672 Aug 09 14:32:38.205658 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 253/537] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:32:38 2022] POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action => generated 142 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:32:38.210974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8955a849-dd93-479d-82ef-58b18ee5e2fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:38.216106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8955a849-dd93-479d-82ef-58b18ee5e2fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:38.216918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8955a849-dd93-479d-82ef-58b18ee5e2fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'name': '1216879825', 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:32:38.223292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-8005f131-6242-4642-8f78-55f860903ca4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 0f49c755-de1e-44c2-98de-f6654c0a94a5 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:38.225899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8955a849-dd93-479d-82ef-58b18ee5e2fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.226449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8955a849-dd93-479d-82ef-58b18ee5e2fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.226982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8955a849-dd93-479d-82ef-58b18ee5e2fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.228000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8955a849-dd93-479d-82ef-58b18ee5e2fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.228517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8955a849-dd93-479d-82ef-58b18ee5e2fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.229004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8955a849-dd93-479d-82ef-58b18ee5e2fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.281331 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8005f131-6242-4642-8f78-55f860903ca4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 2050 microversion: 2.25 time: 0.287838 Aug 09 14:32:38.281938 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 285/538] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:37 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 2050 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:38.291259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a81ff4a-855c-4ab2-b0a1-f6fc0fde466f tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Action: 'update', calling method: .version_select at 0x7f41de444940>, body: {"quota_set": {"ram": 0}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:38.296372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2a81ff4a-855c-4ab2-b0a1-f6fc0fde466f tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'af125c08bffd401584ff1db3ebae3328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '649cdd2449f0499e91043797f54cbbbe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a81ff4a-855c-4ab2-b0a1-f6fc0fde466f tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Request method failure captured: Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: request: PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe HTTP/1.1 Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 25 Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_yuFCyRYAWgNooWjZdDPC3TMQafL05Fz3Nt19fRkPx2rWmAaBVLMBqLlS4B6A43-eGcVcF3SBVBxHubX2SvtRpBqHLLrkE5ENh00epPbXPlo_4364Mcv1Vftnq3KnpVDKv0XZcy97B4lDxpHflv_9kpBUo_CfzZf94Vkx-evh5S1o Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 649cdd2449f0499e91043797f54cbbbe Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-QuotasAdminNegativeTest-1987220401 Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:32:38.298698 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_649cdd2449f0499e91043797f54cbbbe", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/649cdd2449f0499e91043797f54cbbbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/649cdd2449f0499e91043797f54cbbbe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/649cdd2449f0499e91043797f54cbbbe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-QuotasAdminNegativeTest-1987220401 Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 649cdd2449f0499e91043797f54cbbbe Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1987220401 Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-QuotasAdminNegativeTest-1987220401-project Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: af125c08bffd401584ff1db3ebae3328 Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-QuotasAdminNegativeTest-1987220401-project Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: {"quota_set": {"ram": 0}} Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 09 14:32:38.300138 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '649cdd2449f0499e91043797f54cbbbe', 'body': {'quota_set': {'ram': 0}}} Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:38.300991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.302340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:38.303915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:38.303915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:38.303915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:32:38.303915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:32:38.303915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 09 14:32:38.303915 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.304263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a81ff4a-855c-4ab2-b0a1-f6fc0fde466f tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:38.305047 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2a81ff4a-855c-4ab2-b0a1-f6fc0fde466f tempest-QuotasAdminNegativeTest-1987220401 tempest-QuotasAdminNegativeTest-1987220401-project] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe" status: 403 len: 116 microversion: 2.1 time: 0.017689 Aug 09 14:32:38.305750 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 286/539] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:32:38 2022] PUT /compute/v2.1/os-quota-sets/649cdd2449f0499e91043797f54cbbbe => generated 116 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:32:38.314871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7d2cc8b5-27ec-4dbf-a882-b87ae672e8b4 req-ef324b8e-d894-43dc-873d-a816e18eb6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca42dbb-ca4a-4f81-ac33-6d850cd01322", "tag": "9a9dcfd1-2560-4f1f-9b95-a81d267cb98d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:38.318763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-8955a849-dd93-479d-82ef-58b18ee5e2fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:32:38.326052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7d2cc8b5-27ec-4dbf-a882-b87ae672e8b4 req-ef324b8e-d894-43dc-873d-a816e18eb6e3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.326547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7d2cc8b5-27ec-4dbf-a882-b87ae672e8b4 req-ef324b8e-d894-43dc-873d-a816e18eb6e3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.326971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7d2cc8b5-27ec-4dbf-a882-b87ae672e8b4 req-ef324b8e-d894-43dc-873d-a816e18eb6e3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.340893 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7d2cc8b5-27ec-4dbf-a882-b87ae672e8b4 req-ef324b8e-d894-43dc-873d-a816e18eb6e3 service nova] Creating event network-changed:9a9dcfd1-2560-4f1f-9b95-a81d267cb98d for instance 4ca42dbb-ca4a-4f81-ac33-6d850cd01322 on n-h1-844626-8 Aug 09 14:32:38.346248 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7d2cc8b5-27ec-4dbf-a882-b87ae672e8b4 req-ef324b8e-d894-43dc-873d-a816e18eb6e3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039425 Aug 09 14:32:38.347276 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 287/540] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:38.352737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:38.355578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:38.362275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.362967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.363704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.364705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.365666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.366262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.394734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "refresh_cache-59150e12-26f8-4d76-8919-498784537442" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:32:38.395583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquired lock "refresh_cache-59150e12-26f8-4d76-8919-498784537442" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:32:38.408390 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8955a849-dd93-479d-82ef-58b18ee5e2fb tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?name=1216879825" status: 200 len: 346 microversion: 2.1 time: 0.201741 Aug 09 14:32:38.408968 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 254/541] 10.222.0.50 () {58 vars in 1156 bytes} [Tue Aug 9 14:32:38 2022] GET /compute/v2.1/servers?name=1216879825 => generated 346 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:38.425343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-865bfcf0-b0f3-4102-af0d-7eb7c70e1adb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:38.428072 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:38.428072 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:32:38.431881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-865bfcf0-b0f3-4102-af0d-7eb7c70e1adb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.433300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-865bfcf0-b0f3-4102-af0d-7eb7c70e1adb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.433928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-865bfcf0-b0f3-4102-af0d-7eb7c70e1adb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.435107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-865bfcf0-b0f3-4102-af0d-7eb7c70e1adb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.435779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-865bfcf0-b0f3-4102-af0d-7eb7c70e1adb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.436425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-865bfcf0-b0f3-4102-af0d-7eb7c70e1adb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.460849 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-865bfcf0-b0f3-4102-af0d-7eb7c70e1adb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043885 Aug 09 14:32:38.468350 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 255/542] 10.222.0.50 () {60 vars in 1217 bytes} [Tue Aug 9 14:32:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:32:38.468350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40618853-5e4b-4245-8774-a576cf7b8189 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:38.472455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40618853-5e4b-4245-8774-a576cf7b8189 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:38.473313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40618853-5e4b-4245-8774-a576cf7b8189 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:32:38.478957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40618853-5e4b-4245-8774-a576cf7b8189 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.479464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40618853-5e4b-4245-8774-a576cf7b8189 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.479892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40618853-5e4b-4245-8774-a576cf7b8189 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.480619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40618853-5e4b-4245-8774-a576cf7b8189 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.481174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40618853-5e4b-4245-8774-a576cf7b8189 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.481545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40618853-5e4b-4245-8774-a576cf7b8189 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.580151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-40618853-5e4b-4245-8774-a576cf7b8189 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:32:38.651292 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40618853-5e4b-4245-8774-a576cf7b8189 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.188207 Aug 09 14:32:38.652048 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 256/543] 10.222.0.50 () {58 vars in 1154 bytes} [Tue Aug 9 14:32:38 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:38.659284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf41c747-87a0-4be1-b3c8-35d9226e7e2d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:38.659284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cf41c747-87a0-4be1-b3c8-35d9226e7e2d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:38.666420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf41c747-87a0-4be1-b3c8-35d9226e7e2d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.666669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf41c747-87a0-4be1-b3c8-35d9226e7e2d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.666964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf41c747-87a0-4be1-b3c8-35d9226e7e2d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.667982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf41c747-87a0-4be1-b3c8-35d9226e7e2d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.668475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf41c747-87a0-4be1-b3c8-35d9226e7e2d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.669334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf41c747-87a0-4be1-b3c8-35d9226e7e2d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.703556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:38.764658 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf41c747-87a0-4be1-b3c8-35d9226e7e2d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5/action" status: 202 len: 0 microversion: 2.25 time: 0.111055 Aug 09 14:32:38.765458 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 257/544] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:32:38 2022] POST /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:32:38.781299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3681e88e-ef85-49cf-9a5f-1da07685ae52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:38.782015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3681e88e-ef85-49cf-9a5f-1da07685ae52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:38.790402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3681e88e-ef85-49cf-9a5f-1da07685ae52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.790991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3681e88e-ef85-49cf-9a5f-1da07685ae52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.791599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3681e88e-ef85-49cf-9a5f-1da07685ae52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.792402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3681e88e-ef85-49cf-9a5f-1da07685ae52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.793327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3681e88e-ef85-49cf-9a5f-1da07685ae52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.793821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3681e88e-ef85-49cf-9a5f-1da07685ae52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.832928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Releasing lock "refresh_cache-59150e12-26f8-4d76-8919-498784537442" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:32:38.833989 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] HTTP exception thrown: floating IP not found Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Request method failure captured: Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action HTTP/1.1 Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 41 Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_QpQa--ISt8vO-hCXmkQq00faWfBKtM8eFrpgsJjBwaN3i8i14kaZpwo03I6pGJCCaqJ13gmuQdHXWD4ZOgVS2yB0HZLblnFvpKhYF0qhHTQvitlQzLb-tgdmCSvNn8-h6VFwQd7887ADPBoM9Nw-QLeg5R-76NwEwpp1t_MFPcHA Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 2ed4c364ec984dd2911b76dc78702f88 Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:32:38.837404 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ed4c364ec984dd2911b76dc78702f88", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 2ed4c364ec984dd2911b76dc78702f88 Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: aaf9b49d50cb4967ab7dc88adc939769 Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:32:38.838886 n-d-844626-8 devstack@n-api.service[119406]: exception: floating IP not found Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '59150e12-26f8-4d76-8919-498784537442', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:38.839723 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 09 14:32:38.840879 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:38.843653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Returning 404 to user: floating IP not found {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:38.844594 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5e31a03a-c590-4223-85b2-913d8a86b2de tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action" status: 404 len: 67 microversion: 2.1 time: 0.496205 Aug 09 14:32:38.845195 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 288/545] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:32:38 2022] POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action => generated 67 bytes in 497 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:32:38.851951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17b03d27-4de6-48ae-a5c5-0dc8585f358b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:38.856985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-17b03d27-4de6-48ae-a5c5-0dc8585f358b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:38.857784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17b03d27-4de6-48ae-a5c5-0dc8585f358b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-121687982', 'deleted': False, 'project_id': 'a1bf318922fb4676a19a51a39580948a'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:32:38.863664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17b03d27-4de6-48ae-a5c5-0dc8585f358b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.864162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17b03d27-4de6-48ae-a5c5-0dc8585f358b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.864606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17b03d27-4de6-48ae-a5c5-0dc8585f358b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.865337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17b03d27-4de6-48ae-a5c5-0dc8585f358b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.865798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17b03d27-4de6-48ae-a5c5-0dc8585f358b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.866214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17b03d27-4de6-48ae-a5c5-0dc8585f358b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.941767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3681e88e-ef85-49cf-9a5f-1da07685ae52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:38.950244 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3681e88e-ef85-49cf-9a5f-1da07685ae52 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1476 microversion: 2.1 time: 0.174192 Aug 09 14:32:38.955639 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 258/546] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:38 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1476 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:38.955639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60bcf542-10b0-4519-b499-bbe01dce61c9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:38.956349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-60bcf542-10b0-4519-b499-bbe01dce61c9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:38.964701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60bcf542-10b0-4519-b499-bbe01dce61c9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.965579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60bcf542-10b0-4519-b499-bbe01dce61c9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.966053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60bcf542-10b0-4519-b499-bbe01dce61c9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:38.966212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-17b03d27-4de6-48ae-a5c5-0dc8585f358b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:32:38.966878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60bcf542-10b0-4519-b499-bbe01dce61c9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:38.967405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60bcf542-10b0-4519-b499-bbe01dce61c9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:38.967772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60bcf542-10b0-4519-b499-bbe01dce61c9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.037084 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17b03d27-4de6-48ae-a5c5-0dc8585f358b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-121687982" status: 200 len: 346 microversion: 2.1 time: 0.190804 Aug 09 14:32:39.037677 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 289/547] 10.222.0.50 () {58 vars in 1228 bytes} [Tue Aug 9 14:32:38 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-121687982 => generated 346 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:39.042803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ed690bf7-3173-4ac7-a345-334ccfa7421c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Action: 'action', calling method: .version_select at 0x7f41e501a1f0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:39.101111 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ed690bf7-3173-4ac7-a345-334ccfa7421c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ed690bf7-3173-4ac7-a345-334ccfa7421c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Request method failure captured: Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action HTTP/1.1 Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 44 Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_QpQa--ISt8vO-hCXmkQq00faWfBKtM8eFrpgsJjBwaN3i8i14kaZpwo03I6pGJCCaqJ13gmuQdHXWD4ZOgVS2yB0HZLblnFvpKhYF0qhHTQvitlQzLb-tgdmCSvNn8-h6VFwQd7887ADPBoM9Nw-QLeg5R-76NwEwpp1t_MFPcHA Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 2ed4c364ec984dd2911b76dc78702f88 Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:32:39.102708 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ed4c364ec984dd2911b76dc78702f88", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 2ed4c364ec984dd2911b76dc78702f88 Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: aaf9b49d50cb4967ab7dc88adc939769 Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:32:39.104005 n-d-844626-8 devstack@n-api.service[119406]: exception: Floating IP not found for address 0.0.0.0. Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '59150e12-26f8-4d76-8919-498784537442', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:39.104778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 09 14:32:39.105887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:39.107135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ed690bf7-3173-4ac7-a345-334ccfa7421c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:39.107135 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ed690bf7-3173-4ac7-a345-334ccfa7421c tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action" status: 404 len: 88 microversion: 2.1 time: 0.065151 Aug 09 14:32:39.107135 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 290/548] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:32:39 2022] POST /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442/action => generated 88 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:32:39.109111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db405ffe-ab0a-40a0-bc35-14a83f812993 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:39.109709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db405ffe-ab0a-40a0-bc35-14a83f812993 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:39.120741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db405ffe-ab0a-40a0-bc35-14a83f812993 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.121464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db405ffe-ab0a-40a0-bc35-14a83f812993 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.121893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db405ffe-ab0a-40a0-bc35-14a83f812993 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.123388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db405ffe-ab0a-40a0-bc35-14a83f812993 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.124096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db405ffe-ab0a-40a0-bc35-14a83f812993 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.124740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db405ffe-ab0a-40a0-bc35-14a83f812993 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.187845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-60bcf542-10b0-4519-b499-bbe01dce61c9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 0f49c755-de1e-44c2-98de-f6654c0a94a5 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:39.198514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-db405ffe-ab0a-40a0-bc35-14a83f812993 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:39.204178 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60bcf542-10b0-4519-b499-bbe01dce61c9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 2055 microversion: 2.25 time: 0.252317 Aug 09 14:32:39.205275 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 259/549] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:38 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 2055 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:39.210497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e212d9e-b9e6-4d68-9411-702da33ab26b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:39.211689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8e212d9e-b9e6-4d68-9411-702da33ab26b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:39.214247 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db405ffe-ab0a-40a0-bc35-14a83f812993 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1316 microversion: 2.1 time: 0.108552 Aug 09 14:32:39.218157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e212d9e-b9e6-4d68-9411-702da33ab26b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.218793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e212d9e-b9e6-4d68-9411-702da33ab26b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.219434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e212d9e-b9e6-4d68-9411-702da33ab26b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.221037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e212d9e-b9e6-4d68-9411-702da33ab26b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.221485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e212d9e-b9e6-4d68-9411-702da33ab26b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.221900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e212d9e-b9e6-4d68-9411-702da33ab26b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.223979 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 291/550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:39 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1316 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:39.230306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-321d4001-3460-4d53-93ec-c16ec0a26198 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:39.230808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-321d4001-3460-4d53-93ec-c16ec0a26198 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:39.240274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-321d4001-3460-4d53-93ec-c16ec0a26198 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.240771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-321d4001-3460-4d53-93ec-c16ec0a26198 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.241252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-321d4001-3460-4d53-93ec-c16ec0a26198 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.241961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-321d4001-3460-4d53-93ec-c16ec0a26198 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.242708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-321d4001-3460-4d53-93ec-c16ec0a26198 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.243458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-321d4001-3460-4d53-93ec-c16ec0a26198 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.288028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-321d4001-3460-4d53-93ec-c16ec0a26198 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:32:39.402204 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-321d4001-3460-4d53-93ec-c16ec0a26198 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "DELETE /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 204 len: 0 microversion: 2.1 time: 0.176667 Aug 09 14:32:39.403290 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 292/551] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:32:39 2022] DELETE /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:32:39.409556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b32c60d-67f4-4fd6-8c6d-4b97c9349fe2 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:39.410126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b32c60d-67f4-4fd6-8c6d-4b97c9349fe2 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:39.416824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8e212d9e-b9e6-4d68-9411-702da33ab26b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:39.417731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b32c60d-67f4-4fd6-8c6d-4b97c9349fe2 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.418221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b32c60d-67f4-4fd6-8c6d-4b97c9349fe2 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.418655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b32c60d-67f4-4fd6-8c6d-4b97c9349fe2 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.419395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b32c60d-67f4-4fd6-8c6d-4b97c9349fe2 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.419840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b32c60d-67f4-4fd6-8c6d-4b97c9349fe2 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.420471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b32c60d-67f4-4fd6-8c6d-4b97c9349fe2 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.428748 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8e212d9e-b9e6-4d68-9411-702da33ab26b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1318 microversion: 2.1 time: 0.221812 Aug 09 14:32:39.429645 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 260/552] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:39 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:39.439030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2c5d868-22a3-46c0-bc50-899297ebe6d1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:39.439970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d2c5d868-22a3-46c0-bc50-899297ebe6d1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:39.440762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:39.448347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2c5d868-22a3-46c0-bc50-899297ebe6d1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.449257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2c5d868-22a3-46c0-bc50-899297ebe6d1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.449855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2c5d868-22a3-46c0-bc50-899297ebe6d1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.450432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b32c60d-67f4-4fd6-8c6d-4b97c9349fe2 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:32:39.450549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2c5d868-22a3-46c0-bc50-899297ebe6d1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.450976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2c5d868-22a3-46c0-bc50-899297ebe6d1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.451445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2c5d868-22a3-46c0-bc50-899297ebe6d1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.544179 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b32c60d-67f4-4fd6-8c6d-4b97c9349fe2 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "DELETE /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 204 len: 0 microversion: 2.1 time: 0.139218 Aug 09 14:32:39.544996 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 293/553] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:32:39 2022] DELETE /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:32:39.549888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d5651a9b-c39a-441e-b905-10d0177af27c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:39.550578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d5651a9b-c39a-441e-b905-10d0177af27c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:39.557169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5651a9b-c39a-441e-b905-10d0177af27c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.557654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5651a9b-c39a-441e-b905-10d0177af27c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.558082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5651a9b-c39a-441e-b905-10d0177af27c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.559038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5651a9b-c39a-441e-b905-10d0177af27c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.559323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5651a9b-c39a-441e-b905-10d0177af27c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.559678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5651a9b-c39a-441e-b905-10d0177af27c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.590343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d2c5d868-22a3-46c0-bc50-899297ebe6d1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:39.598063 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d2c5d868-22a3-46c0-bc50-899297ebe6d1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1310 microversion: 2.1 time: 0.166676 Aug 09 14:32:39.598991 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 261/554] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:39 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1310 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:39.603734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf921fc2-1d4c-4f9d-b7ff-2422d743476d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:39.604329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf921fc2-1d4c-4f9d-b7ff-2422d743476d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:39.612677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf921fc2-1d4c-4f9d-b7ff-2422d743476d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.613249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf921fc2-1d4c-4f9d-b7ff-2422d743476d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.613714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf921fc2-1d4c-4f9d-b7ff-2422d743476d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.614686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf921fc2-1d4c-4f9d-b7ff-2422d743476d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.615057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf921fc2-1d4c-4f9d-b7ff-2422d743476d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.615653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf921fc2-1d4c-4f9d-b7ff-2422d743476d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.797082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d5651a9b-c39a-441e-b905-10d0177af27c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:39.806625 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d5651a9b-c39a-441e-b905-10d0177af27c tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1519 microversion: 2.1 time: 0.260632 Aug 09 14:32:39.807326 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 294/555] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:39 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:39.837665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bf921fc2-1d4c-4f9d-b7ff-2422d743476d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:39.848616 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf921fc2-1d4c-4f9d-b7ff-2422d743476d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1540 microversion: 2.1 time: 0.248490 Aug 09 14:32:39.852710 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 262/556] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:39 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1540 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:39.970757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1cec40cd-3ebf-443d-8f31-652ab4c92862 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:39.971436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1cec40cd-3ebf-443d-8f31-652ab4c92862 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:39.974401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:39.978247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cec40cd-3ebf-443d-8f31-652ab4c92862 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.978712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cec40cd-3ebf-443d-8f31-652ab4c92862 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.979174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cec40cd-3ebf-443d-8f31-652ab4c92862 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:39.979855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cec40cd-3ebf-443d-8f31-652ab4c92862 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:39.980296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cec40cd-3ebf-443d-8f31-652ab4c92862 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:39.980719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cec40cd-3ebf-443d-8f31-652ab4c92862 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:40.118037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1cec40cd-3ebf-443d-8f31-652ab4c92862 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:40.125709 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1cec40cd-3ebf-443d-8f31-652ab4c92862 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1476 microversion: 2.1 time: 0.158772 Aug 09 14:32:40.126295 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 295/557] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:39 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1476 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:40.228018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f79494c-dccd-4be0-b4eb-afeab9c8bfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:40.228592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7f79494c-dccd-4be0-b4eb-afeab9c8bfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:40.235148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f79494c-dccd-4be0-b4eb-afeab9c8bfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:40.235820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f79494c-dccd-4be0-b4eb-afeab9c8bfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:40.236408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f79494c-dccd-4be0-b4eb-afeab9c8bfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:40.237255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f79494c-dccd-4be0-b4eb-afeab9c8bfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:40.237862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f79494c-dccd-4be0-b4eb-afeab9c8bfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:40.238433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f79494c-dccd-4be0-b4eb-afeab9c8bfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:40.238635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f617bdfc-9e67-4b68-b010-b33017d03f6f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:40.239309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f617bdfc-9e67-4b68-b010-b33017d03f6f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:40.245543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f617bdfc-9e67-4b68-b010-b33017d03f6f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:40.246034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f617bdfc-9e67-4b68-b010-b33017d03f6f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:40.246478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f617bdfc-9e67-4b68-b010-b33017d03f6f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:40.247291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f617bdfc-9e67-4b68-b010-b33017d03f6f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:40.247647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f617bdfc-9e67-4b68-b010-b33017d03f6f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:40.248061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f617bdfc-9e67-4b68-b010-b33017d03f6f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:40.336198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f617bdfc-9e67-4b68-b010-b33017d03f6f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:40.345301 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f617bdfc-9e67-4b68-b010-b33017d03f6f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1324 microversion: 2.1 time: 0.110617 Aug 09 14:32:40.346097 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 296/558] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:40 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1324 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:40.395856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-7f79494c-dccd-4be0-b4eb-afeab9c8bfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 0f49c755-de1e-44c2-98de-f6654c0a94a5 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:40.409546 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7f79494c-dccd-4be0-b4eb-afeab9c8bfd9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 2055 microversion: 2.25 time: 0.185294 Aug 09 14:32:40.410134 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 263/559] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:40 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 2055 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:40.449810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae429f5d-3d7b-48d0-821d-b499999fd1aa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:40.450448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae429f5d-3d7b-48d0-821d-b499999fd1aa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:40.456633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae429f5d-3d7b-48d0-821d-b499999fd1aa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:40.457099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae429f5d-3d7b-48d0-821d-b499999fd1aa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:40.457605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae429f5d-3d7b-48d0-821d-b499999fd1aa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:40.458232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae429f5d-3d7b-48d0-821d-b499999fd1aa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:40.458781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae429f5d-3d7b-48d0-821d-b499999fd1aa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:40.459254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae429f5d-3d7b-48d0-821d-b499999fd1aa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:40.591763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ae429f5d-3d7b-48d0-821d-b499999fd1aa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:40.599355 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae429f5d-3d7b-48d0-821d-b499999fd1aa tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1318 microversion: 2.1 time: 0.153451 Aug 09 14:32:40.599931 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 297/560] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:40 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:40.617974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4142f00-a624-4abd-a4ce-5a427701b149 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:40.618585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4142f00-a624-4abd-a4ce-5a427701b149 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:40.624560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4142f00-a624-4abd-a4ce-5a427701b149 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:40.625038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4142f00-a624-4abd-a4ce-5a427701b149 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:40.625464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4142f00-a624-4abd-a4ce-5a427701b149 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:40.626294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4142f00-a624-4abd-a4ce-5a427701b149 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:40.626777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4142f00-a624-4abd-a4ce-5a427701b149 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:40.627323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4142f00-a624-4abd-a4ce-5a427701b149 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:40.763891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d4142f00-a624-4abd-a4ce-5a427701b149 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:40.771728 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4142f00-a624-4abd-a4ce-5a427701b149 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1310 microversion: 2.1 time: 0.157775 Aug 09 14:32:40.772394 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 264/561] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:40 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1310 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:40.827536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-016e33ff-9a19-48d4-bc1a-35b2ac803503 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:40.828059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-016e33ff-9a19-48d4-bc1a-35b2ac803503 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:40.834331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-016e33ff-9a19-48d4-bc1a-35b2ac803503 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:40.834807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-016e33ff-9a19-48d4-bc1a-35b2ac803503 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:40.835258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-016e33ff-9a19-48d4-bc1a-35b2ac803503 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:40.835939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-016e33ff-9a19-48d4-bc1a-35b2ac803503 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:40.836382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-016e33ff-9a19-48d4-bc1a-35b2ac803503 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:40.836805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-016e33ff-9a19-48d4-bc1a-35b2ac803503 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:40.874027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3081da49-d9f0-4928-82ff-0bf53f098d6d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:40.874650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3081da49-d9f0-4928-82ff-0bf53f098d6d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:40.881838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3081da49-d9f0-4928-82ff-0bf53f098d6d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:40.882310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3081da49-d9f0-4928-82ff-0bf53f098d6d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:40.882743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3081da49-d9f0-4928-82ff-0bf53f098d6d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:40.883577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3081da49-d9f0-4928-82ff-0bf53f098d6d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:40.884040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3081da49-d9f0-4928-82ff-0bf53f098d6d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:40.884481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3081da49-d9f0-4928-82ff-0bf53f098d6d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.060091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-016e33ff-9a19-48d4-bc1a-35b2ac803503 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:41.074787 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-016e33ff-9a19-48d4-bc1a-35b2ac803503 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1519 microversion: 2.1 time: 0.250252 Aug 09 14:32:41.076642 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 298/562] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:40 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:41.093984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3081da49-d9f0-4928-82ff-0bf53f098d6d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:41.102209 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3081da49-d9f0-4928-82ff-0bf53f098d6d tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1540 microversion: 2.1 time: 0.232271 Aug 09 14:32:41.103114 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 265/563] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:40 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1540 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:32:41.145516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fc40f257-5f1c-446c-a3b0-ae6b5e00db91 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:41.146125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fc40f257-5f1c-446c-a3b0-ae6b5e00db91 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:41.152085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc40f257-5f1c-446c-a3b0-ae6b5e00db91 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.152564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc40f257-5f1c-446c-a3b0-ae6b5e00db91 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.152991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc40f257-5f1c-446c-a3b0-ae6b5e00db91 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.153684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc40f257-5f1c-446c-a3b0-ae6b5e00db91 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.154127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc40f257-5f1c-446c-a3b0-ae6b5e00db91 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.155342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc40f257-5f1c-446c-a3b0-ae6b5e00db91 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.327950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fc40f257-5f1c-446c-a3b0-ae6b5e00db91 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:41.345123 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fc40f257-5f1c-446c-a3b0-ae6b5e00db91 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1475 microversion: 2.1 time: 0.202316 Aug 09 14:32:41.346221 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 299/564] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:41 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1475 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:41.366161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9ad8da60-8fc5-4169-b041-46cde2496389 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:41.366853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9ad8da60-8fc5-4169-b041-46cde2496389 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:41.375445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ad8da60-8fc5-4169-b041-46cde2496389 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.376137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ad8da60-8fc5-4169-b041-46cde2496389 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.376626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ad8da60-8fc5-4169-b041-46cde2496389 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.377379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ad8da60-8fc5-4169-b041-46cde2496389 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.377885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ad8da60-8fc5-4169-b041-46cde2496389 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.378483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ad8da60-8fc5-4169-b041-46cde2496389 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.469250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9ad8da60-8fc5-4169-b041-46cde2496389 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:41.478535 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9ad8da60-8fc5-4169-b041-46cde2496389 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1322 microversion: 2.1 time: 0.116589 Aug 09 14:32:41.479538 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 300/565] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:41 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1322 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:32:41.485190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a684c043-8429-4402-97f7-6252a84026fb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:41.485800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a684c043-8429-4402-97f7-6252a84026fb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:41.492387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a684c043-8429-4402-97f7-6252a84026fb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.492968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a684c043-8429-4402-97f7-6252a84026fb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.493517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a684c043-8429-4402-97f7-6252a84026fb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.494429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a684c043-8429-4402-97f7-6252a84026fb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.495130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a684c043-8429-4402-97f7-6252a84026fb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.495647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a684c043-8429-4402-97f7-6252a84026fb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.504917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5612e058-07ae-4e26-bc16-a03edfcfc195 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Action: 'update', calling method: .version_select at 0x7f41dd854e50>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:41.507774 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:41.507774 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:32:41.508932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5612e058-07ae-4e26-bc16-a03edfcfc195 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.509653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5612e058-07ae-4e26-bc16-a03edfcfc195 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.510140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5612e058-07ae-4e26-bc16-a03edfcfc195 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.518071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5612e058-07ae-4e26-bc16-a03edfcfc195 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.518725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5612e058-07ae-4e26-bc16-a03edfcfc195 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.519426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5612e058-07ae-4e26-bc16-a03edfcfc195 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.527779 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-5612e058-07ae-4e26-bc16-a03edfcfc195 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] HTTP exception thrown: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5612e058-07ae-4e26-bc16-a03edfcfc195 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Request method failure captured: Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/os-services/3a5ca606-ba60-485d-b8bf-2d5bc2f66934 HTTP/1.1 Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 56 Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nAJ2tOX9XOsf_5-0ns_3ApjaE7r9ygn5Rmr4TzP78aQRiaBwtpjalNnEftZ536rLRmlTS1Vv7VBkyTKZX7V2qNPaIfJFzWW-6gfBB64czyo_n24wdoA5jDcf-qqRybHbyT76IuSkVa4nr32L2zqR3iksA9a5x5Jb4jJaZKNK7baXy4 Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.53 Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 6ef5767e8422474193525a1209347006 Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-576878593 Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:32:41.529826 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6ef5767e8422474193525a1209347006", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6ef5767e8422474193525a1209347006"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ef5767e8422474193525a1209347006"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ef5767e8422474193525a1209347006"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-576878593 Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 6ef5767e8422474193525a1209347006 Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-576878593 Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f27f28c717764ab99a6570d7bc71059b Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:32:41.532570 n-d-844626-8 devstack@n-api.service[119407]: exception: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3a5ca606-ba60-485d-b8bf-2d5bc2f66934', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6170, in service_get_by_id Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6172, in service_get_by_id Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.533374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:41.534654 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:41.535893 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:41.535893 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.535893 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.535893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5612e058-07ae-4e26-bc16-a03edfcfc195 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Returning 404 to user: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:41.535893 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5612e058-07ae-4e26-bc16-a03edfcfc195 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/3a5ca606-ba60-485d-b8bf-2d5bc2f66934" status: 404 len: 110 microversion: 2.53 time: 0.210572 Aug 09 14:32:41.537697 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 266/566] 10.222.0.50 () {62 vars in 1309 bytes} [Tue Aug 9 14:32:41 2022] PUT /compute/v2.1/os-services/3a5ca606-ba60-485d-b8bf-2d5bc2f66934 => generated 110 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:32:41.542736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21ac1123-3db9-4ac8-bafa-0a8c19393bd4 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Action: 'update', calling method: .version_select at 0x7f41dd804f70>, body: {"status": "disabled"} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:41.547288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21ac1123-3db9-4ac8-bafa-0a8c19393bd4 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.547911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21ac1123-3db9-4ac8-bafa-0a8c19393bd4 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.548616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21ac1123-3db9-4ac8-bafa-0a8c19393bd4 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.555481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21ac1123-3db9-4ac8-bafa-0a8c19393bd4 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.556324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21ac1123-3db9-4ac8-bafa-0a8c19393bd4 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.556967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21ac1123-3db9-4ac8-bafa-0a8c19393bd4 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.562298 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-21ac1123-3db9-4ac8-bafa-0a8c19393bd4 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] HTTP exception thrown: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21ac1123-3db9-4ac8-bafa-0a8c19393bd4 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Request method failure captured: Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/os-services/3a5ca606-ba60-485d-b8bf-2d5bc2f66934 HTTP/1.1 Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 22 Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nAJ2tOX9XOsf_5-0ns_3ApjaE7r9ygn5Rmr4TzP78aQRiaBwtpjalNnEftZ536rLRmlTS1Vv7VBkyTKZX7V2qNPaIfJFzWW-6gfBB64czyo_n24wdoA5jDcf-qqRybHbyT76IuSkVa4nr32L2zqR3iksA9a5x5Jb4jJaZKNK7baXy4 Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.53 Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 6ef5767e8422474193525a1209347006 Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-576878593 Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:32:41.564174 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6ef5767e8422474193525a1209347006", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6ef5767e8422474193525a1209347006"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ef5767e8422474193525a1209347006"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ef5767e8422474193525a1209347006"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-576878593 Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 6ef5767e8422474193525a1209347006 Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-576878593 Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f27f28c717764ab99a6570d7bc71059b Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: {"status": "disabled"} Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: exception: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.565499 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3a5ca606-ba60-485d-b8bf-2d5bc2f66934', 'body': {'status': 'disabled'}} Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6170, in service_get_by_id Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6172, in service_get_by_id Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:41.566334 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:41.567636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:41.568787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.568787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.570541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21ac1123-3db9-4ac8-bafa-0a8c19393bd4 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Returning 404 to user: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:41.571629 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-21ac1123-3db9-4ac8-bafa-0a8c19393bd4 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/3a5ca606-ba60-485d-b8bf-2d5bc2f66934" status: 404 len: 110 microversion: 2.53 time: 0.032769 Aug 09 14:32:41.572421 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 267/567] 10.222.0.50 () {62 vars in 1309 bytes} [Tue Aug 9 14:32:41 2022] PUT /compute/v2.1/os-services/3a5ca606-ba60-485d-b8bf-2d5bc2f66934 => generated 110 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:32:41.581777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0651e73-1499-46d5-99e5-550e371b4a21 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Action: 'update', calling method: .version_select at 0x7f41dd874670>, body: {"status": "enabled"} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:41.587183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0651e73-1499-46d5-99e5-550e371b4a21 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.587913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0651e73-1499-46d5-99e5-550e371b4a21 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.588476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0651e73-1499-46d5-99e5-550e371b4a21 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.595357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0651e73-1499-46d5-99e5-550e371b4a21 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.596296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0651e73-1499-46d5-99e5-550e371b4a21 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.597253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0651e73-1499-46d5-99e5-550e371b4a21 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.603933 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-f0651e73-1499-46d5-99e5-550e371b4a21 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] HTTP exception thrown: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0651e73-1499-46d5-99e5-550e371b4a21 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Request method failure captured: Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/os-services/3a5ca606-ba60-485d-b8bf-2d5bc2f66934 HTTP/1.1 Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 21 Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nAJ2tOX9XOsf_5-0ns_3ApjaE7r9ygn5Rmr4TzP78aQRiaBwtpjalNnEftZ536rLRmlTS1Vv7VBkyTKZX7V2qNPaIfJFzWW-6gfBB64czyo_n24wdoA5jDcf-qqRybHbyT76IuSkVa4nr32L2zqR3iksA9a5x5Jb4jJaZKNK7baXy4 Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.53 Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 6ef5767e8422474193525a1209347006 Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-576878593 Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:32:41.605910 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6ef5767e8422474193525a1209347006", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6ef5767e8422474193525a1209347006"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ef5767e8422474193525a1209347006"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6ef5767e8422474193525a1209347006"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-576878593 Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 6ef5767e8422474193525a1209347006 Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-576878593 Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f27f28c717764ab99a6570d7bc71059b Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: {"status": "enabled"} Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: exception: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.607280 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3a5ca606-ba60-485d-b8bf-2d5bc2f66934', 'body': {'status': 'enabled'}} Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6170, in service_get_by_id Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6172, in service_get_by_id Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:41.608365 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:41.609568 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:41.610696 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. Aug 09 14:32:41.610696 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:41.613296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0651e73-1499-46d5-99e5-550e371b4a21 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Returning 404 to user: Service 3a5ca606-ba60-485d-b8bf-2d5bc2f66934 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:41.614954 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0651e73-1499-46d5-99e5-550e371b4a21 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-services/3a5ca606-ba60-485d-b8bf-2d5bc2f66934" status: 404 len: 110 microversion: 2.53 time: 0.036897 Aug 09 14:32:41.616014 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 268/568] 10.222.0.50 () {62 vars in 1309 bytes} [Tue Aug 9 14:32:41 2022] PUT /compute/v2.1/os-services/3a5ca606-ba60-485d-b8bf-2d5bc2f66934 => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:32:41.625409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8df4593d-a2a0-4140-8069-88686f027923 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:41.626543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8df4593d-a2a0-4140-8069-88686f027923 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:41.635037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8df4593d-a2a0-4140-8069-88686f027923 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.635871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8df4593d-a2a0-4140-8069-88686f027923 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.636737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8df4593d-a2a0-4140-8069-88686f027923 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.637751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8df4593d-a2a0-4140-8069-88686f027923 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.638406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8df4593d-a2a0-4140-8069-88686f027923 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.639026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8df4593d-a2a0-4140-8069-88686f027923 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.757008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-a684c043-8429-4402-97f7-6252a84026fb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 0f49c755-de1e-44c2-98de-f6654c0a94a5 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:41.773817 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a684c043-8429-4402-97f7-6252a84026fb tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 2055 microversion: 2.25 time: 0.293056 Aug 09 14:32:41.791309 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 301/569] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:41 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 2055 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:41.796492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-123bb566-8203-4fb1-a138-c6d7448b4203 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:41.799674 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:41.799674 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:32:41.801071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-123bb566-8203-4fb1-a138-c6d7448b4203 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.801561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-123bb566-8203-4fb1-a138-c6d7448b4203 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.802131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-123bb566-8203-4fb1-a138-c6d7448b4203 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.803009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-123bb566-8203-4fb1-a138-c6d7448b4203 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.803912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-123bb566-8203-4fb1-a138-c6d7448b4203 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.804278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-123bb566-8203-4fb1-a138-c6d7448b4203 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.838352 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-123bb566-8203-4fb1-a138-c6d7448b4203 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.045758 Aug 09 14:32:41.845294 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 302/570] 10.222.0.50 () {60 vars in 1178 bytes} [Tue Aug 9 14:32:41 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:41.845294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40ac0750-ec42-4914-b396-a0be2d1f17f1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:41.845294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40ac0750-ec42-4914-b396-a0be2d1f17f1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:41.852373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40ac0750-ec42-4914-b396-a0be2d1f17f1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.852858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40ac0750-ec42-4914-b396-a0be2d1f17f1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.853856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40ac0750-ec42-4914-b396-a0be2d1f17f1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.854558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40ac0750-ec42-4914-b396-a0be2d1f17f1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:41.855001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40ac0750-ec42-4914-b396-a0be2d1f17f1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:41.855518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40ac0750-ec42-4914-b396-a0be2d1f17f1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:41.979477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8df4593d-a2a0-4140-8069-88686f027923 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:41.989142 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8df4593d-a2a0-4140-8069-88686f027923 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1467 microversion: 2.1 time: 0.371593 Aug 09 14:32:41.999841 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 269/571] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:41 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1467 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:42.006975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0e9e07fe-74d2-457e-8f93-c56ed256b228 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:42.010047 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:42.010047 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:32:42.011564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e9e07fe-74d2-457e-8f93-c56ed256b228 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.012140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e9e07fe-74d2-457e-8f93-c56ed256b228 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.013459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e9e07fe-74d2-457e-8f93-c56ed256b228 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.014596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e9e07fe-74d2-457e-8f93-c56ed256b228 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.015560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e9e07fe-74d2-457e-8f93-c56ed256b228 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.016213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e9e07fe-74d2-457e-8f93-c56ed256b228 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.051522 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0e9e07fe-74d2-457e-8f93-c56ed256b228 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.049948 Aug 09 14:32:42.052445 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 270/572] 10.222.0.50 () {60 vars in 1211 bytes} [Tue Aug 9 14:32:42 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:42.058003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-88536d63-f553-462e-ae2b-97d74ae77500 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:42.058778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-88536d63-f553-462e-ae2b-97d74ae77500 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:42.066214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88536d63-f553-462e-ae2b-97d74ae77500 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.066690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88536d63-f553-462e-ae2b-97d74ae77500 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.067394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88536d63-f553-462e-ae2b-97d74ae77500 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.068117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88536d63-f553-462e-ae2b-97d74ae77500 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.068845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88536d63-f553-462e-ae2b-97d74ae77500 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.069267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88536d63-f553-462e-ae2b-97d74ae77500 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.093082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-88536d63-f553-462e-ae2b-97d74ae77500 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lazy-loading 'flavor' on Instance uuid 49bf1b81-8cce-44a6-97ca-87ab6af16b85 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:42.100006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-40ac0750-ec42-4914-b396-a0be2d1f17f1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:42.110108 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40ac0750-ec42-4914-b396-a0be2d1f17f1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1310 microversion: 2.1 time: 0.270054 Aug 09 14:32:42.111119 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 303/573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:41 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1310 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:42.119794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-efc25448-cac9-415c-aa59-1b07853fafd2 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:42.124240 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:42.124240 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:32:42.126921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efc25448-cac9-415c-aa59-1b07853fafd2 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.127785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efc25448-cac9-415c-aa59-1b07853fafd2 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.128849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efc25448-cac9-415c-aa59-1b07853fafd2 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.130982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efc25448-cac9-415c-aa59-1b07853fafd2 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.132272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efc25448-cac9-415c-aa59-1b07853fafd2 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.132906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efc25448-cac9-415c-aa59-1b07853fafd2 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.172048 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-efc25448-cac9-415c-aa59-1b07853fafd2 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.056751 Aug 09 14:32:42.182253 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 304/574] 10.222.0.50 () {60 vars in 1178 bytes} [Tue Aug 9 14:32:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:42.184752 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-88536d63-f553-462e-ae2b-97d74ae77500 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85/action" status: 202 len: 0 microversion: 2.1 time: 0.129872 Aug 09 14:32:42.187142 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 271/575] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:32:42 2022] POST /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:32:42.192850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-409e1e09-f2f1-4645-a14b-742f33931a1b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:42.194035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-409e1e09-f2f1-4645-a14b-742f33931a1b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:42.203288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409e1e09-f2f1-4645-a14b-742f33931a1b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.204095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409e1e09-f2f1-4645-a14b-742f33931a1b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.204904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409e1e09-f2f1-4645-a14b-742f33931a1b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.206019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409e1e09-f2f1-4645-a14b-742f33931a1b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.206751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409e1e09-f2f1-4645-a14b-742f33931a1b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.207549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409e1e09-f2f1-4645-a14b-742f33931a1b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.208461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-974d8456-0d86-491e-8cbe-a62c2110787a tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:42.209282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-974d8456-0d86-491e-8cbe-a62c2110787a tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:42.216760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-974d8456-0d86-491e-8cbe-a62c2110787a tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.217624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-974d8456-0d86-491e-8cbe-a62c2110787a tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.218394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-974d8456-0d86-491e-8cbe-a62c2110787a tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.219857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-974d8456-0d86-491e-8cbe-a62c2110787a tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.220481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-974d8456-0d86-491e-8cbe-a62c2110787a tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.221379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-974d8456-0d86-491e-8cbe-a62c2110787a tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.373454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-409e1e09-f2f1-4645-a14b-742f33931a1b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:42.387247 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-409e1e09-f2f1-4645-a14b-742f33931a1b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 200 len: 1477 microversion: 2.1 time: 0.203384 Aug 09 14:32:42.388156 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 305/576] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:42 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 1477 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:42.403529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9405d092-2755-4965-a35d-bf351080036b tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:42.413884 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:42.413884 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:32:42.417265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9405d092-2755-4965-a35d-bf351080036b tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.417999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9405d092-2755-4965-a35d-bf351080036b tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.418784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9405d092-2755-4965-a35d-bf351080036b tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.419818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9405d092-2755-4965-a35d-bf351080036b tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.420487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9405d092-2755-4965-a35d-bf351080036b tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.421124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9405d092-2755-4965-a35d-bf351080036b tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.459820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-974d8456-0d86-491e-8cbe-a62c2110787a tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:42.470364 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-974d8456-0d86-491e-8cbe-a62c2110787a tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1540 microversion: 2.1 time: 0.283759 Aug 09 14:32:42.470955 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 272/577] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:42 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1540 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:42.482793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ffb63810-d4ae-43cb-bd23-a947441887e0 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:42.483636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffb63810-d4ae-43cb-bd23-a947441887e0 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:42.490926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb63810-d4ae-43cb-bd23-a947441887e0 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.491683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb63810-d4ae-43cb-bd23-a947441887e0 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.492309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb63810-d4ae-43cb-bd23-a947441887e0 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.494622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb63810-d4ae-43cb-bd23-a947441887e0 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.494622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb63810-d4ae-43cb-bd23-a947441887e0 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.494622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb63810-d4ae-43cb-bd23-a947441887e0 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.524229 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9405d092-2755-4965-a35d-bf351080036b tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-844626-8&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.134296 Aug 09 14:32:42.533777 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 306/578] 10.222.0.50 () {60 vars in 1235 bytes} [Tue Aug 9 14:32:42 2022] GET /compute/v2.1/os-services?host=n-d-844626-8&binary=xxx => generated 16 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:42.539459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7801313e-3c44-4a32-beff-86aa70557f72 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:42.547959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7801313e-3c44-4a32-beff-86aa70557f72 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:42.554622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7801313e-3c44-4a32-beff-86aa70557f72 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.555571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7801313e-3c44-4a32-beff-86aa70557f72 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.563494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7801313e-3c44-4a32-beff-86aa70557f72 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.564405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7801313e-3c44-4a32-beff-86aa70557f72 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.564950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7801313e-3c44-4a32-beff-86aa70557f72 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.565472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7801313e-3c44-4a32-beff-86aa70557f72 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.703989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffb63810-d4ae-43cb-bd23-a947441887e0 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:42.708643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:42.719032 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ffb63810-d4ae-43cb-bd23-a947441887e0 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1475 microversion: 2.1 time: 0.245900 Aug 09 14:32:42.720275 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 273/579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:42 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1475 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:42.731995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-602d3551-d131-4bdc-9f7a-8435f407af14 req-bf1295b1-f1ee-4fa5-a245-d15c9ae2f4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "826994ac-b33d-487a-ad40-a26199875e31", "name": "network-vif-deleted", "tag": "3f98b6bb-8a91-4cae-ae5a-187ccef422fd"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:42.769411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-602d3551-d131-4bdc-9f7a-8435f407af14 req-bf1295b1-f1ee-4fa5-a245-d15c9ae2f4a2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.771660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-602d3551-d131-4bdc-9f7a-8435f407af14 req-bf1295b1-f1ee-4fa5-a245-d15c9ae2f4a2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.772841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-602d3551-d131-4bdc-9f7a-8435f407af14 req-bf1295b1-f1ee-4fa5-a245-d15c9ae2f4a2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.809227 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-602d3551-d131-4bdc-9f7a-8435f407af14 req-bf1295b1-f1ee-4fa5-a245-d15c9ae2f4a2 service nova] Creating event network-vif-deleted:3f98b6bb-8a91-4cae-ae5a-187ccef422fd for instance 826994ac-b33d-487a-ad40-a26199875e31 on n-h1-844626-8 Aug 09 14:32:42.820417 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-602d3551-d131-4bdc-9f7a-8435f407af14 req-bf1295b1-f1ee-4fa5-a245-d15c9ae2f4a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098804 Aug 09 14:32:42.821108 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 274/580] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:42.836702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-57715386-b1eb-45c5-a879-a6670bc42c67 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:42.838545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-57715386-b1eb-45c5-a879-a6670bc42c67 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:42.856087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57715386-b1eb-45c5-a879-a6670bc42c67 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.856626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57715386-b1eb-45c5-a879-a6670bc42c67 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.857019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57715386-b1eb-45c5-a879-a6670bc42c67 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.858716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57715386-b1eb-45c5-a879-a6670bc42c67 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.865077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7801313e-3c44-4a32-beff-86aa70557f72 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:42.874027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57715386-b1eb-45c5-a879-a6670bc42c67 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.874510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57715386-b1eb-45c5-a879-a6670bc42c67 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.876153 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7801313e-3c44-4a32-beff-86aa70557f72 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1475 microversion: 2.1 time: 0.342929 Aug 09 14:32:42.876759 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 307/581] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:42 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1475 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:42.886303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1df7e96a-03a9-43d6-bfbd-b1139629cfb7 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:42.891121 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:42.891121 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:32:42.897291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1df7e96a-03a9-43d6-bfbd-b1139629cfb7 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.897778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1df7e96a-03a9-43d6-bfbd-b1139629cfb7 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.898206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1df7e96a-03a9-43d6-bfbd-b1139629cfb7 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.902448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1df7e96a-03a9-43d6-bfbd-b1139629cfb7 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:42.902941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1df7e96a-03a9-43d6-bfbd-b1139629cfb7 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:42.903405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1df7e96a-03a9-43d6-bfbd-b1139629cfb7 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:42.964143 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1df7e96a-03a9-43d6-bfbd-b1139629cfb7 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.086122 Aug 09 14:32:42.976178 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 308/582] 10.222.0.50 () {60 vars in 1178 bytes} [Tue Aug 9 14:32:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:42.992101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-48bc6b6b-702c-4780-9870-18f7eb16c11d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:42.992789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-48bc6b6b-702c-4780-9870-18f7eb16c11d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:43.005819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48bc6b6b-702c-4780-9870-18f7eb16c11d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.005986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-57715386-b1eb-45c5-a879-a6670bc42c67 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:43.006312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48bc6b6b-702c-4780-9870-18f7eb16c11d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.006739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48bc6b6b-702c-4780-9870-18f7eb16c11d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.008317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48bc6b6b-702c-4780-9870-18f7eb16c11d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.008317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48bc6b6b-702c-4780-9870-18f7eb16c11d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.009727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48bc6b6b-702c-4780-9870-18f7eb16c11d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.023567 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-57715386-b1eb-45c5-a879-a6670bc42c67 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1322 microversion: 2.1 time: 0.196153 Aug 09 14:32:43.037858 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 275/583] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:42 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:43.043153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0e44db40-43b1-48d1-9066-5d4ca7a61382 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:43.046060 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:43.046060 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:32:43.047423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e44db40-43b1-48d1-9066-5d4ca7a61382 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.048584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e44db40-43b1-48d1-9066-5d4ca7a61382 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.049106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e44db40-43b1-48d1-9066-5d4ca7a61382 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.049865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e44db40-43b1-48d1-9066-5d4ca7a61382 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.050309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e44db40-43b1-48d1-9066-5d4ca7a61382 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.050723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e44db40-43b1-48d1-9066-5d4ca7a61382 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.077039 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0e44db40-43b1-48d1-9066-5d4ca7a61382 tempest-ServicesAdminNegativeV253TestJSON-576878593 tempest-ServicesAdminNegativeV253TestJSON-576878593-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.037873 Aug 09 14:32:43.077952 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 276/584] 10.222.0.50 () {60 vars in 1239 bytes} [Tue Aug 9 14:32:43 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:43.236192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-48bc6b6b-702c-4780-9870-18f7eb16c11d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 0f49c755-de1e-44c2-98de-f6654c0a94a5 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:43.258450 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-48bc6b6b-702c-4780-9870-18f7eb16c11d tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 2035 microversion: 2.25 time: 0.280322 Aug 09 14:32:43.260260 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 309/585] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:42 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 2035 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:43.267405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0cd0539d-6855-47e4-b2ac-a8e27f614b61 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:43.268297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0cd0539d-6855-47e4-b2ac-a8e27f614b61 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:43.275603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cd0539d-6855-47e4-b2ac-a8e27f614b61 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.276300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cd0539d-6855-47e4-b2ac-a8e27f614b61 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.277222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cd0539d-6855-47e4-b2ac-a8e27f614b61 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.278188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cd0539d-6855-47e4-b2ac-a8e27f614b61 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.278820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cd0539d-6855-47e4-b2ac-a8e27f614b61 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.279599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cd0539d-6855-47e4-b2ac-a8e27f614b61 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.307398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d38684d7-aaa4-4d6d-a63d-9ae16ef4ebe3 tempest-ServicesAdminNegativeV253TestJSON-806640306 tempest-ServicesAdminNegativeV253TestJSON-806640306-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:43.310368 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:43.310368 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:32:43.312132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d38684d7-aaa4-4d6d-a63d-9ae16ef4ebe3 tempest-ServicesAdminNegativeV253TestJSON-806640306 tempest-ServicesAdminNegativeV253TestJSON-806640306-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '37241ae7b31045e2b4693db3ff3f30c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1fd0ea52c95492d87b49750abd7856c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:43.314963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d38684d7-aaa4-4d6d-a63d-9ae16ef4ebe3 tempest-ServicesAdminNegativeV253TestJSON-806640306 tempest-ServicesAdminNegativeV253TestJSON-806640306-project] Request method failure captured: Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nAINrrqnGWq3JuwYkkbtKFKQl_VsC7zMQVWYa0mkuQ6alatZgo_-6-VyLfgw6by6mcQeYXnxEcH1OBo0NvW7TPNkd2wmjzx2gNILCRzUkyneeR7S9Gf8awOI67sNThmjj4yVbcJNm_ENoHvm9BhYhYKaVSW4SL_ZZUTIW0nO4D-afw Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.53 Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: d1fd0ea52c95492d87b49750abd7856c Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-806640306 Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:32:43.315833 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:32:43.317251 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d1fd0ea52c95492d87b49750abd7856c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d1fd0ea52c95492d87b49750abd7856c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d1fd0ea52c95492d87b49750abd7856c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d1fd0ea52c95492d87b49750abd7856c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:43.317251 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-806640306 Aug 09 14:32:43.317251 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: d1fd0ea52c95492d87b49750abd7856c Aug 09 14:32:43.317251 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-806640306 Aug 09 14:32:43.317251 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServicesAdminNegativeV253TestJSON-806640306-project Aug 09 14:32:43.317251 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:32:43.317251 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:32:43.317251 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 37241ae7b31045e2b4693db3ff3f30c5 Aug 09 14:32:43.317251 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-806640306-project Aug 09 14:32:43.317251 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:32:43.317251 n-d-844626-8 devstack@n-api.service[119407]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 09 14:32:43.317251 n-d-844626-8 devstack@n-api.service[119407]: action_args: {} Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:32:43.318068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 09 14:32:43.320676 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:43.322292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d38684d7-aaa4-4d6d-a63d-9ae16ef4ebe3 tempest-ServicesAdminNegativeV253TestJSON-806640306 tempest-ServicesAdminNegativeV253TestJSON-806640306-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:43.324237 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d38684d7-aaa4-4d6d-a63d-9ae16ef4ebe3 tempest-ServicesAdminNegativeV253TestJSON-806640306 tempest-ServicesAdminNegativeV253TestJSON-806640306-project] 10.222.0.50 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.238429 Aug 09 14:32:43.325668 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 277/586] 10.222.0.50 () {60 vars in 1178 bytes} [Tue Aug 9 14:32:43 2022] GET /compute/v2.1/os-services => generated 112 bytes in 240 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:32:43.336160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f7cd155-0ec4-4b8c-ad70-8c84700730c4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844626-8", "block_migration": "auto"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:43.355733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f7cd155-0ec4-4b8c-ad70-8c84700730c4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:43.370439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f7cd155-0ec4-4b8c-ad70-8c84700730c4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.375336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f7cd155-0ec4-4b8c-ad70-8c84700730c4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.376953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f7cd155-0ec4-4b8c-ad70-8c84700730c4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.379736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f7cd155-0ec4-4b8c-ad70-8c84700730c4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.381862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f7cd155-0ec4-4b8c-ad70-8c84700730c4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.382753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f7cd155-0ec4-4b8c-ad70-8c84700730c4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.437335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-9f7cd155-0ec4-4b8c-ad70-8c84700730c4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'flavor' on Instance uuid 0f49c755-de1e-44c2-98de-f6654c0a94a5 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:43.452504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f7cd155-0ec4-4b8c-ad70-8c84700730c4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Going to try to live migrate instance to n-h2-844626-8 {{(pid=119407) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 14:32:43.560269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0cd0539d-6855-47e4-b2ac-a8e27f614b61 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:43.588262 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0cd0539d-6855-47e4-b2ac-a8e27f614b61 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1310 microversion: 2.1 time: 0.308940 Aug 09 14:32:43.602148 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 310/587] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:43 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1310 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:43.603696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88942879-9d25-44cd-b459-0a4efa269ac5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:43.604724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-88942879-9d25-44cd-b459-0a4efa269ac5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 826994ac-b33d-487a-ad40-a26199875e31] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:43.623076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88942879-9d25-44cd-b459-0a4efa269ac5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.624248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88942879-9d25-44cd-b459-0a4efa269ac5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.625957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88942879-9d25-44cd-b459-0a4efa269ac5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.628933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88942879-9d25-44cd-b459-0a4efa269ac5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.631493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88942879-9d25-44cd-b459-0a4efa269ac5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.633989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88942879-9d25-44cd-b459-0a4efa269ac5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.682247 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-88942879-9d25-44cd-b459-0a4efa269ac5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] HTTP exception thrown: Instance 826994ac-b33d-487a-ad40-a26199875e31 could not be found. Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88942879-9d25-44cd-b459-0a4efa269ac5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Request method failure captured: Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 HTTP/1.1 Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-xMW1p22yQgXVnAOILTSyK6kzD0spd3R9vmFXpnSwsI9NrLffJKtAzkoOcEzUjwR55uouxgrRrbZ8wEjEnpY2nzDPcjOL4AsUJoxJPeJLYbesnlquUqps_AyjHaGrTqXu5kpTp0xeso4IU_ykwVBVuO6iVy0ETsd9clb-oyaRIpTw Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a1bf318922fb4676a19a51a39580948a Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ListServerFiltersTestJSON-2110151572 Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:32:43.683947 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:32:43.685447 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a1bf318922fb4676a19a51a39580948a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a1bf318922fb4676a19a51a39580948a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1bf318922fb4676a19a51a39580948a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1bf318922fb4676a19a51a39580948a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:43.685447 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ListServerFiltersTestJSON-2110151572 Aug 09 14:32:43.685447 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a1bf318922fb4676a19a51a39580948a Aug 09 14:32:43.685447 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2110151572 Aug 09 14:32:43.685447 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ListServerFiltersTestJSON-2110151572-project Aug 09 14:32:43.685447 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:32:43.685447 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:32:43.685447 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 56df13a960424540b4540a50696dfd2d Aug 09 14:32:43.685447 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ListServerFiltersTestJSON-2110151572-project Aug 09 14:32:43.685447 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:32:43.685447 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 826994ac-b33d-487a-ad40-a26199875e31 could not be found. Aug 09 14:32:43.685447 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '826994ac-b33d-487a-ad40-a26199875e31'} Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 826994ac-b33d-487a-ad40-a26199875e31 could not be found. Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:43.686183 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 826994ac-b33d-487a-ad40-a26199875e31 could not be found. Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 826994ac-b33d-487a-ad40-a26199875e31 could not be found. Aug 09 14:32:43.687509 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:43.688589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88942879-9d25-44cd-b459-0a4efa269ac5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Returning 404 to user: Instance 826994ac-b33d-487a-ad40-a26199875e31 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:43.690258 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88942879-9d25-44cd-b459-0a4efa269ac5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31" status: 404 len: 111 microversion: 2.1 time: 0.096353 Aug 09 14:32:43.692710 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 311/588] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:43 2022] GET /compute/v2.1/servers/826994ac-b33d-487a-ad40-a26199875e31 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:32:43.705537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b6080c5f-78b1-41de-9e8d-e65deb08d157 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:43.707975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6080c5f-78b1-41de-9e8d-e65deb08d157 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:43.720678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6080c5f-78b1-41de-9e8d-e65deb08d157 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.723335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6080c5f-78b1-41de-9e8d-e65deb08d157 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.723955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6080c5f-78b1-41de-9e8d-e65deb08d157 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.724683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6080c5f-78b1-41de-9e8d-e65deb08d157 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.725133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6080c5f-78b1-41de-9e8d-e65deb08d157 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.725550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6080c5f-78b1-41de-9e8d-e65deb08d157 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.830087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b6080c5f-78b1-41de-9e8d-e65deb08d157 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:43.841553 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b6080c5f-78b1-41de-9e8d-e65deb08d157 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1498 microversion: 2.1 time: 0.144550 Aug 09 14:32:43.842351 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 312/589] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:43 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:43.872873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-431ad126-37b7-4908-a457-8ef2d6b63632 req-12e315d1-c23a-4a5d-bb97-f8646317193c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4125ae9-163d-4e42-b277-f309f031f352", "name": "network-vif-unplugged", "status": "completed", "tag": "3ce4965e-717b-4943-b658-c4cc8884f87e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:43.883895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-431ad126-37b7-4908-a457-8ef2d6b63632 req-12e315d1-c23a-4a5d-bb97-f8646317193c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.885240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-431ad126-37b7-4908-a457-8ef2d6b63632 req-12e315d1-c23a-4a5d-bb97-f8646317193c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.885240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-431ad126-37b7-4908-a457-8ef2d6b63632 req-12e315d1-c23a-4a5d-bb97-f8646317193c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.899071 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-431ad126-37b7-4908-a457-8ef2d6b63632 req-12e315d1-c23a-4a5d-bb97-f8646317193c service nova] Creating event network-vif-unplugged:3ce4965e-717b-4943-b658-c4cc8884f87e for instance c4125ae9-163d-4e42-b277-f309f031f352 on n-h1-844626-8 Aug 09 14:32:43.916586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-431ad126-37b7-4908-a457-8ef2d6b63632 req-12e315d1-c23a-4a5d-bb97-f8646317193c service nova] Instance c4125ae9-163d-4e42-b277-f309f031f352 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 14:32:43.934083 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-431ad126-37b7-4908-a457-8ef2d6b63632 req-12e315d1-c23a-4a5d-bb97-f8646317193c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072865 Aug 09 14:32:43.935037 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 313/590] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:43.940410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44c07bbf-4c8e-4a97-8eb5-60ccebff43a5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:43.940987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44c07bbf-4c8e-4a97-8eb5-60ccebff43a5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 9124e955-056d-4c19-baa2-dbbfdcad5058] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:43.948673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44c07bbf-4c8e-4a97-8eb5-60ccebff43a5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.949602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44c07bbf-4c8e-4a97-8eb5-60ccebff43a5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.950055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44c07bbf-4c8e-4a97-8eb5-60ccebff43a5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.950770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44c07bbf-4c8e-4a97-8eb5-60ccebff43a5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:43.951264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44c07bbf-4c8e-4a97-8eb5-60ccebff43a5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:43.951691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44c07bbf-4c8e-4a97-8eb5-60ccebff43a5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:43.981567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44c07bbf-4c8e-4a97-8eb5-60ccebff43a5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 9124e955-056d-4c19-baa2-dbbfdcad5058] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:32:44.143895 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44c07bbf-4c8e-4a97-8eb5-60ccebff43a5 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058" status: 204 len: 0 microversion: 2.1 time: 0.206938 Aug 09 14:32:44.146375 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 314/591] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:32:43 2022] DELETE /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:32:44.152535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-601e7bb9-a982-459a-9ac1-19fb69253e1d tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:44.153234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-601e7bb9-a982-459a-9ac1-19fb69253e1d tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:44.172527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-601e7bb9-a982-459a-9ac1-19fb69253e1d tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:44.173290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-601e7bb9-a982-459a-9ac1-19fb69253e1d tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:44.174181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-601e7bb9-a982-459a-9ac1-19fb69253e1d tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:44.175121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-601e7bb9-a982-459a-9ac1-19fb69253e1d tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:44.175561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-601e7bb9-a982-459a-9ac1-19fb69253e1d tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:44.176007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-601e7bb9-a982-459a-9ac1-19fb69253e1d tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:44.431611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-601e7bb9-a982-459a-9ac1-19fb69253e1d tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:44.440715 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-601e7bb9-a982-459a-9ac1-19fb69253e1d tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1458 microversion: 2.1 time: 0.293021 Aug 09 14:32:44.446088 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 315/592] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:44 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1458 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:44.456149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-58397b9c-93dd-4b0d-bc87-7e9ac7ee5197 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:44.460119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-58397b9c-93dd-4b0d-bc87-7e9ac7ee5197 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:44.473381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58397b9c-93dd-4b0d-bc87-7e9ac7ee5197 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:44.474552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58397b9c-93dd-4b0d-bc87-7e9ac7ee5197 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:44.477290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58397b9c-93dd-4b0d-bc87-7e9ac7ee5197 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:44.478252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58397b9c-93dd-4b0d-bc87-7e9ac7ee5197 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:44.482011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58397b9c-93dd-4b0d-bc87-7e9ac7ee5197 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:44.482650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58397b9c-93dd-4b0d-bc87-7e9ac7ee5197 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:44.792391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-58397b9c-93dd-4b0d-bc87-7e9ac7ee5197 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:44.800977 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-58397b9c-93dd-4b0d-bc87-7e9ac7ee5197 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1475 microversion: 2.1 time: 0.353426 Aug 09 14:32:44.809409 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 316/593] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:44 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1475 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:44.814599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3a508f2-5248-45b0-8169-0b8cbb579091 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:44.818493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3a508f2-5248-45b0-8169-0b8cbb579091 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:44.829151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3a508f2-5248-45b0-8169-0b8cbb579091 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:44.832633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3a508f2-5248-45b0-8169-0b8cbb579091 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:44.833340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3a508f2-5248-45b0-8169-0b8cbb579091 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:44.835903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3a508f2-5248-45b0-8169-0b8cbb579091 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:44.836554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3a508f2-5248-45b0-8169-0b8cbb579091 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:44.843068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3a508f2-5248-45b0-8169-0b8cbb579091 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.044585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b3a508f2-5248-45b0-8169-0b8cbb579091 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:45.053071 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3a508f2-5248-45b0-8169-0b8cbb579091 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1390 microversion: 2.1 time: 0.242124 Aug 09 14:32:45.053976 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 317/594] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:44 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1390 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:45.063911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8240d64-8c7b-4654-a8d1-db6b239c8b7f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:45.068001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8240d64-8c7b-4654-a8d1-db6b239c8b7f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 9124e955-056d-4c19-baa2-dbbfdcad5058] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:45.074351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8240d64-8c7b-4654-a8d1-db6b239c8b7f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.074780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8240d64-8c7b-4654-a8d1-db6b239c8b7f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.075414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8240d64-8c7b-4654-a8d1-db6b239c8b7f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.076359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8240d64-8c7b-4654-a8d1-db6b239c8b7f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.077434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8240d64-8c7b-4654-a8d1-db6b239c8b7f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.078025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8240d64-8c7b-4654-a8d1-db6b239c8b7f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.229045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f8240d64-8c7b-4654-a8d1-db6b239c8b7f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:45.239014 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8240d64-8c7b-4654-a8d1-db6b239c8b7f tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058" status: 200 len: 1516 microversion: 2.1 time: 0.178702 Aug 09 14:32:45.239992 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 318/595] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:45 2022] GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058 => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:45.244823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8912cbfe-cf00-4d00-aa77-6718b48d5cbc tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:45.246097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8912cbfe-cf00-4d00-aa77-6718b48d5cbc tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:45.252392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8912cbfe-cf00-4d00-aa77-6718b48d5cbc tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.252883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8912cbfe-cf00-4d00-aa77-6718b48d5cbc tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.253316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8912cbfe-cf00-4d00-aa77-6718b48d5cbc tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.254026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8912cbfe-cf00-4d00-aa77-6718b48d5cbc tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.254474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8912cbfe-cf00-4d00-aa77-6718b48d5cbc tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.255002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8912cbfe-cf00-4d00-aa77-6718b48d5cbc tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.544547 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8912cbfe-cf00-4d00-aa77-6718b48d5cbc tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1609 microversion: 2.1 time: 0.303420 Aug 09 14:32:45.550316 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 319/596] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:45 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1609 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:45.557707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5cec4f97-6dbf-4f42-8c18-426676c682dc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:45.558999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5cec4f97-6dbf-4f42-8c18-426676c682dc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:45.566406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cec4f97-6dbf-4f42-8c18-426676c682dc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.567332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cec4f97-6dbf-4f42-8c18-426676c682dc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.567945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cec4f97-6dbf-4f42-8c18-426676c682dc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.568648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cec4f97-6dbf-4f42-8c18-426676c682dc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.569249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cec4f97-6dbf-4f42-8c18-426676c682dc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.569804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cec4f97-6dbf-4f42-8c18-426676c682dc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.726789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cec4f97-6dbf-4f42-8c18-426676c682dc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:45.741421 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5cec4f97-6dbf-4f42-8c18-426676c682dc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1310 microversion: 2.1 time: 0.188968 Aug 09 14:32:45.742365 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 320/597] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:45 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1310 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:45.754618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:45.755493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:45.761668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.762137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.762562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.763268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.763879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.764293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.808464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.808938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.809363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.809801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lazy-loading 'fault' on Instance uuid 59150e12-26f8-4d76-8919-498784537442 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:45.856396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf9b49d50cb4967ab7dc88adc939769', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed4c364ec984dd2911b76dc78702f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:45.864437 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f67b028-bd4f-4338-af53-9c12cfc2f041 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 200 len: 1321 microversion: 2.1 time: 0.120724 Aug 09 14:32:45.865018 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 321/598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:45 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 1321 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:45.869429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0e7ce3ec-45a3-4c65-b1de-dc5e5507779a req-9149128e-8616-4f82-9091-1d4d3c63cd27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca42dbb-ca4a-4f81-ac33-6d850cd01322", "name": "network-vif-plugged", "status": "completed", "tag": "9a9dcfd1-2560-4f1f-9b95-a81d267cb98d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:45.880129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0e7ce3ec-45a3-4c65-b1de-dc5e5507779a req-9149128e-8616-4f82-9091-1d4d3c63cd27 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.880862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0e7ce3ec-45a3-4c65-b1de-dc5e5507779a req-9149128e-8616-4f82-9091-1d4d3c63cd27 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.881042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0e7ce3ec-45a3-4c65-b1de-dc5e5507779a req-9149128e-8616-4f82-9091-1d4d3c63cd27 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.892521 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0e7ce3ec-45a3-4c65-b1de-dc5e5507779a req-9149128e-8616-4f82-9091-1d4d3c63cd27 service nova] Creating event network-vif-plugged:9a9dcfd1-2560-4f1f-9b95-a81d267cb98d for instance 4ca42dbb-ca4a-4f81-ac33-6d850cd01322 on n-h1-844626-8 Aug 09 14:32:45.897801 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0e7ce3ec-45a3-4c65-b1de-dc5e5507779a req-9149128e-8616-4f82-9091-1d4d3c63cd27 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031643 Aug 09 14:32:45.898422 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 322/599] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:45.906181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4623bb3a-98c6-4d51-8a2b-3a56b577e5e5 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:45.908879 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:45.908879 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:32:45.910015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4623bb3a-98c6-4d51-8a2b-3a56b577e5e5 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.910493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4623bb3a-98c6-4d51-8a2b-3a56b577e5e5 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.910940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4623bb3a-98c6-4d51-8a2b-3a56b577e5e5 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.913373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4623bb3a-98c6-4d51-8a2b-3a56b577e5e5 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.913832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4623bb3a-98c6-4d51-8a2b-3a56b577e5e5 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.914266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4623bb3a-98c6-4d51-8a2b-3a56b577e5e5 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.937809 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4623bb3a-98c6-4d51-8a2b-3a56b577e5e5 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035518 Aug 09 14:32:45.938566 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 323/600] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 9 14:32:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:45.943282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-553fa40e-41a0-4a5b-8c2f-97cff2078840 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:45.943977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-553fa40e-41a0-4a5b-8c2f-97cff2078840 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:45.949953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-553fa40e-41a0-4a5b-8c2f-97cff2078840 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.950429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-553fa40e-41a0-4a5b-8c2f-97cff2078840 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.950857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-553fa40e-41a0-4a5b-8c2f-97cff2078840 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:45.951646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-553fa40e-41a0-4a5b-8c2f-97cff2078840 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:45.952086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-553fa40e-41a0-4a5b-8c2f-97cff2078840 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:45.952499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-553fa40e-41a0-4a5b-8c2f-97cff2078840 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:46.087070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-553fa40e-41a0-4a5b-8c2f-97cff2078840 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:46.096058 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-553fa40e-41a0-4a5b-8c2f-97cff2078840 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1473 microversion: 2.1 time: 0.156657 Aug 09 14:32:46.096660 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 324/601] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:45 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1473 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:46.113403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844626-8", "block_migration": true, "disk_over_commit": false}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:46.116070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:46.122369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:46.122858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:46.123323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:46.124018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:46.124467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:46.124886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:46.202398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Lazy-loading 'flavor' on Instance uuid 49bf1b81-8cce-44a6-97ca-87ab6af16b85 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:46.254757 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 while it is in vm_state suspended Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Request method failure captured: Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85/action HTTP/1.1 Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 97 Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_fApmm3gpA3TyhkHo3CRc5sZeBsz1ihUNE-UElrH-cd56iOVlfTtoaCVieOeyLHSDitbEulMCAtjwWhFEiTQJ90yQUT6vMXZ4bT_8W6UNAWe9Gh0aP8SGjcjBOG_-dp3MshAjZNxpn_esmUEvHtslhp4xPcZetidFcUlqzjKQXRTE Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: c71515c4f7aa4924b570873b7f45951b Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-LiveMigrationNegativeTest-519146900 Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:32:46.257091 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:32:46.258659 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c71515c4f7aa4924b570873b7f45951b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c71515c4f7aa4924b570873b7f45951b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c71515c4f7aa4924b570873b7f45951b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c71515c4f7aa4924b570873b7f45951b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:46.258659 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-LiveMigrationNegativeTest-519146900 Aug 09 14:32:46.258659 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: c71515c4f7aa4924b570873b7f45951b Aug 09 14:32:46.258659 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-519146900 Aug 09 14:32:46.258659 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-LiveMigrationNegativeTest-519146900-project-admin Aug 09 14:32:46.258659 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:32:46.258659 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:32:46.258659 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 0070af346315409daf5c6ae2b8b2f7e2 Aug 09 14:32:46.258659 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-LiveMigrationNegativeTest-519146900-project-admin Aug 09 14:32:46.258659 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:32:46.258659 n-d-844626-8 devstack@n-api.service[119406]: {"os-migrateLive": {"host": "n-h1-844626-8", "block_migration": true, "disk_over_commit": false}} Aug 09 14:32:46.258659 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: exception: Cannot 'os-migrateLive' instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 while it is in vm_state suspended Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '49bf1b81-8cce-44a6-97ca-87ab6af16b85', 'body': {'os-migrateLive': {'host': 'n-h1-844626-8', 'block_migration': True, 'disk_over_commit': False}}} Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 09 14:32:46.259655 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:46.260912 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 while it is in vm_state suspended Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 while it is in vm_state suspended Aug 09 14:32:46.262859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:46.264591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 while it is in vm_state suspended {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:46.264591 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-89bd08eb-929d-48d5-ba56-ed58797d4787 tempest-LiveMigrationNegativeTest-519146900 tempest-LiveMigrationNegativeTest-519146900-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85/action" status: 409 len: 155 microversion: 2.1 time: 0.162682 Aug 09 14:32:46.264591 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 325/602] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:32:46 2022] POST /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85/action => generated 155 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:32:46.272945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8635fa82-af36-4410-8499-840c77f42249 req-cb20892e-c65d-4f50-a98e-aabfb4119f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59150e12-26f8-4d76-8919-498784537442", "name": "network-vif-deleted", "tag": "8919a34a-05ad-4b2e-b6c8-02b8aee7335b"}, {"name": "network-changed", "server_uuid": "c4125ae9-163d-4e42-b277-f309f031f352", "tag": "3ce4965e-717b-4943-b658-c4cc8884f87e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:46.284347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8635fa82-af36-4410-8499-840c77f42249 req-cb20892e-c65d-4f50-a98e-aabfb4119f97 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:46.284916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8635fa82-af36-4410-8499-840c77f42249 req-cb20892e-c65d-4f50-a98e-aabfb4119f97 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:46.285557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8635fa82-af36-4410-8499-840c77f42249 req-cb20892e-c65d-4f50-a98e-aabfb4119f97 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:46.299782 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8635fa82-af36-4410-8499-840c77f42249 req-cb20892e-c65d-4f50-a98e-aabfb4119f97 service nova] Creating event network-vif-deleted:8919a34a-05ad-4b2e-b6c8-02b8aee7335b for instance 59150e12-26f8-4d76-8919-498784537442 on n-h2-844626-8 Aug 09 14:32:46.300186 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8635fa82-af36-4410-8499-840c77f42249 req-cb20892e-c65d-4f50-a98e-aabfb4119f97 service nova] Creating event network-changed:3ce4965e-717b-4943-b658-c4cc8884f87e for instance c4125ae9-163d-4e42-b277-f309f031f352 on n-h1-844626-8 Aug 09 14:32:46.308367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-8635fa82-af36-4410-8499-840c77f42249 req-cb20892e-c65d-4f50-a98e-aabfb4119f97 service nova] Instance c4125ae9-163d-4e42-b277-f309f031f352 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 14:32:46.324413 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8635fa82-af36-4410-8499-840c77f42249 req-cb20892e-c65d-4f50-a98e-aabfb4119f97 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058870 Aug 09 14:32:46.325570 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 326/603] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:46.331529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e2fe846-c160-4c98-b222-a829c583c376 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:46.332385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e2fe846-c160-4c98-b222-a829c583c376 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:46.348978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e2fe846-c160-4c98-b222-a829c583c376 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:46.349545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e2fe846-c160-4c98-b222-a829c583c376 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:46.349970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e2fe846-c160-4c98-b222-a829c583c376 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:46.350813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e2fe846-c160-4c98-b222-a829c583c376 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:46.351108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e2fe846-c160-4c98-b222-a829c583c376 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:46.351721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e2fe846-c160-4c98-b222-a829c583c376 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:46.666110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e2fe846-c160-4c98-b222-a829c583c376 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:46.677090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:46.691950 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e2fe846-c160-4c98-b222-a829c583c376 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1390 microversion: 2.1 time: 0.364954 Aug 09 14:32:46.708793 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 327/604] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:46 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1390 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:46.714377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31a58580-9c56-43f7-a261-98d31cdb7b22 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:46.715206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31a58580-9c56-43f7-a261-98d31cdb7b22 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 9124e955-056d-4c19-baa2-dbbfdcad5058] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:46.720883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=41 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:46.723492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31a58580-9c56-43f7-a261-98d31cdb7b22 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:46.724748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31a58580-9c56-43f7-a261-98d31cdb7b22 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:46.725349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31a58580-9c56-43f7-a261-98d31cdb7b22 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:46.726214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31a58580-9c56-43f7-a261-98d31cdb7b22 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:46.726818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31a58580-9c56-43f7-a261-98d31cdb7b22 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:46.727450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31a58580-9c56-43f7-a261-98d31cdb7b22 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:46.851237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-31a58580-9c56-43f7-a261-98d31cdb7b22 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:46.860472 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31a58580-9c56-43f7-a261-98d31cdb7b22 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058" status: 200 len: 1474 microversion: 2.1 time: 0.150291 Aug 09 14:32:46.877311 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 328/605] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:46 2022] GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058 => generated 1474 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:46.878535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a2af158-7019-41c3-ac7e-8722f9747749 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:46.879034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a2af158-7019-41c3-ac7e-8722f9747749 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:46.903672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a2af158-7019-41c3-ac7e-8722f9747749 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:46.904296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a2af158-7019-41c3-ac7e-8722f9747749 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:46.904738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a2af158-7019-41c3-ac7e-8722f9747749 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:46.907366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a2af158-7019-41c3-ac7e-8722f9747749 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:46.909780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a2af158-7019-41c3-ac7e-8722f9747749 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:46.912065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a2af158-7019-41c3-ac7e-8722f9747749 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:46.977536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a2af158-7019-41c3-ac7e-8722f9747749 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:32:47.188612 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a2af158-7019-41c3-ac7e-8722f9747749 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "DELETE /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 204 len: 0 microversion: 2.1 time: 0.321816 Aug 09 14:32:47.190614 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 329/606] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:32:46 2022] DELETE /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:32:47.205916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40c96541-9b38-41ad-8359-9cc460771e5c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:47.208264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40c96541-9b38-41ad-8359-9cc460771e5c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:47.224782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40c96541-9b38-41ad-8359-9cc460771e5c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:47.226707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40c96541-9b38-41ad-8359-9cc460771e5c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:47.227334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40c96541-9b38-41ad-8359-9cc460771e5c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:47.229180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40c96541-9b38-41ad-8359-9cc460771e5c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:47.230839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40c96541-9b38-41ad-8359-9cc460771e5c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:47.234548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40c96541-9b38-41ad-8359-9cc460771e5c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:47.504413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-40c96541-9b38-41ad-8359-9cc460771e5c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:47.514838 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40c96541-9b38-41ad-8359-9cc460771e5c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1310 microversion: 2.1 time: 0.321426 Aug 09 14:32:47.515517 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 330/607] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:47 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1310 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:47.521869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4675f7c7-3eac-4bb0-8b1c-a42309b50085 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:47.523535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4675f7c7-3eac-4bb0-8b1c-a42309b50085 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] [instance: 59150e12-26f8-4d76-8919-498784537442] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:47.534388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4675f7c7-3eac-4bb0-8b1c-a42309b50085 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:47.534941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4675f7c7-3eac-4bb0-8b1c-a42309b50085 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:47.535572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4675f7c7-3eac-4bb0-8b1c-a42309b50085 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:47.536518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4675f7c7-3eac-4bb0-8b1c-a42309b50085 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:47.536973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4675f7c7-3eac-4bb0-8b1c-a42309b50085 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:47.537392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4675f7c7-3eac-4bb0-8b1c-a42309b50085 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:47.551653 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4675f7c7-3eac-4bb0-8b1c-a42309b50085 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] HTTP exception thrown: Instance 59150e12-26f8-4d76-8919-498784537442 could not be found. Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4675f7c7-3eac-4bb0-8b1c-a42309b50085 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Request method failure captured: Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 HTTP/1.1 Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_QpQa--ISt8vO-hCXmkQq00faWfBKtM8eFrpgsJjBwaN3i8i14kaZpwo03I6pGJCCaqJ13gmuQdHXWD4ZOgVS2yB0HZLblnFvpKhYF0qhHTQvitlQzLb-tgdmCSvNn8-h6VFwQd7887ADPBoM9Nw-QLeg5R-76NwEwpp1t_MFPcHA Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 2ed4c364ec984dd2911b76dc78702f88 Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:32:47.553609 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:32:47.555192 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2ed4c364ec984dd2911b76dc78702f88", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2ed4c364ec984dd2911b76dc78702f88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:47.555192 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:47.555192 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 2ed4c364ec984dd2911b76dc78702f88 Aug 09 14:32:47.555192 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263 Aug 09 14:32:47.555192 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project Aug 09 14:32:47.555192 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:32:47.555192 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:32:47.555192 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: aaf9b49d50cb4967ab7dc88adc939769 Aug 09 14:32:47.555192 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project Aug 09 14:32:47.555192 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:32:47.555192 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 59150e12-26f8-4d76-8919-498784537442 could not be found. Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '59150e12-26f8-4d76-8919-498784537442'} Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59150e12-26f8-4d76-8919-498784537442 could not be found. Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:47.555991 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59150e12-26f8-4d76-8919-498784537442 could not be found. Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59150e12-26f8-4d76-8919-498784537442 could not be found. Aug 09 14:32:47.557390 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:47.561398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4675f7c7-3eac-4bb0-8b1c-a42309b50085 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] Returning 404 to user: Instance 59150e12-26f8-4d76-8919-498784537442 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:47.562455 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4675f7c7-3eac-4bb0-8b1c-a42309b50085 tempest-FloatingIPsAssociationNegativeTestJSON-439624263 tempest-FloatingIPsAssociationNegativeTestJSON-439624263-project] 10.222.0.50 "GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442" status: 404 len: 111 microversion: 2.1 time: 0.045164 Aug 09 14:32:47.563536 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 331/608] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:47 2022] GET /compute/v2.1/servers/59150e12-26f8-4d76-8919-498784537442 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:32:47.568637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e6f3e57-c536-4afe-807e-c899c18916cf tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:47.569428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6e6f3e57-c536-4afe-807e-c899c18916cf tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:47.575830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e6f3e57-c536-4afe-807e-c899c18916cf tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:47.576686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e6f3e57-c536-4afe-807e-c899c18916cf tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:47.577272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e6f3e57-c536-4afe-807e-c899c18916cf tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:47.578111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e6f3e57-c536-4afe-807e-c899c18916cf tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:47.578721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e6f3e57-c536-4afe-807e-c899c18916cf tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:47.579320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e6f3e57-c536-4afe-807e-c899c18916cf tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:47.904354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6e6f3e57-c536-4afe-807e-c899c18916cf tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:47.912207 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6e6f3e57-c536-4afe-807e-c899c18916cf tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1470 microversion: 2.1 time: 0.347488 Aug 09 14:32:47.912847 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 332/609] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:47 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1470 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:47.930643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f3d7bcf-36a7-4365-a4a9-c35e5576bb92 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:47.931461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2f3d7bcf-36a7-4365-a4a9-c35e5576bb92 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:47.934555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:47.938897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d7bcf-36a7-4365-a4a9-c35e5576bb92 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:47.939442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d7bcf-36a7-4365-a4a9-c35e5576bb92 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:47.939937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d7bcf-36a7-4365-a4a9-c35e5576bb92 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:47.940687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d7bcf-36a7-4365-a4a9-c35e5576bb92 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:47.941333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d7bcf-36a7-4365-a4a9-c35e5576bb92 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:47.941741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d7bcf-36a7-4365-a4a9-c35e5576bb92 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:47.985994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=62 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:48.341815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2f3d7bcf-36a7-4365-a4a9-c35e5576bb92 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:48.350039 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2f3d7bcf-36a7-4365-a4a9-c35e5576bb92 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1464 microversion: 2.1 time: 0.436171 Aug 09 14:32:48.350702 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 333/610] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:47 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1464 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:48.355544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-45b1b413-41fc-47bd-b249-c029b7eebbbf tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:48.356265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-45b1b413-41fc-47bd-b249-c029b7eebbbf tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:48.362777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45b1b413-41fc-47bd-b249-c029b7eebbbf tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:48.363455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45b1b413-41fc-47bd-b249-c029b7eebbbf tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:48.364165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45b1b413-41fc-47bd-b249-c029b7eebbbf tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:48.364965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45b1b413-41fc-47bd-b249-c029b7eebbbf tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:48.365475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45b1b413-41fc-47bd-b249-c029b7eebbbf tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:48.366102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45b1b413-41fc-47bd-b249-c029b7eebbbf tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.004190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45b1b413-41fc-47bd-b249-c029b7eebbbf tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:49.025164 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-45b1b413-41fc-47bd-b249-c029b7eebbbf tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1390 microversion: 2.1 time: 0.673049 Aug 09 14:32:49.029686 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 334/611] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:48 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1390 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:49.040694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:49.041343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 9124e955-056d-4c19-baa2-dbbfdcad5058] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:49.054212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.056781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.057588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.058476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.059132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.059703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.124107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.125296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.126887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.129093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lazy-loading 'fault' on Instance uuid 9124e955-056d-4c19-baa2-dbbfdcad5058 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:49.190121 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9f7cd155-0ec4-4b8c-ad70-8c84700730c4 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5/action" status: 202 len: 0 microversion: 2.25 time: 5.862713 Aug 09 14:32:49.190745 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 278/612] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:32:43 2022] POST /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5/action => generated 0 bytes in 5864 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:32:49.197810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afd3800d-40b2-4c03-938d-fed46cf0da4c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:49.198714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-afd3800d-40b2-4c03-938d-fed46cf0da4c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:49.217465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afd3800d-40b2-4c03-938d-fed46cf0da4c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.218997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afd3800d-40b2-4c03-938d-fed46cf0da4c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.219977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afd3800d-40b2-4c03-938d-fed46cf0da4c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.221362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afd3800d-40b2-4c03-938d-fed46cf0da4c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.222317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afd3800d-40b2-4c03-938d-fed46cf0da4c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.227657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afd3800d-40b2-4c03-938d-fed46cf0da4c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.280946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:49.290915 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9c688ee7-b2f0-4602-b498-7f6551cd04d6 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058" status: 200 len: 1309 microversion: 2.1 time: 0.259156 Aug 09 14:32:49.296673 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 335/613] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:49 2022] GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058 => generated 1309 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:49.313989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1b761a08-4b57-42ea-b280-fecaf66f8670 req-af20850a-2293-49c5-836a-7aa34cda7fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d784e6b-2704-47cb-9cb5-225e4cace576", "tag": "b17957b8-8774-4495-a6d4-74b4c7b3ef18"}, {"server_uuid": "9124e955-056d-4c19-baa2-dbbfdcad5058", "name": "network-vif-deleted", "tag": "f0f8dcb7-df02-4e0c-a16f-f9b2f9e6fe00"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:49.341477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1b761a08-4b57-42ea-b280-fecaf66f8670 req-af20850a-2293-49c5-836a-7aa34cda7fd9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.342842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1b761a08-4b57-42ea-b280-fecaf66f8670 req-af20850a-2293-49c5-836a-7aa34cda7fd9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.344162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1b761a08-4b57-42ea-b280-fecaf66f8670 req-af20850a-2293-49c5-836a-7aa34cda7fd9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.359700 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afd3800d-40b2-4c03-938d-fed46cf0da4c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "POST /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352/action" status: 204 len: 0 microversion: 2.1 time: 0.165250 Aug 09 14:32:49.360884 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 279/614] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:32:49 2022] POST /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352/action => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:32:49.374416 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1b761a08-4b57-42ea-b280-fecaf66f8670 req-af20850a-2293-49c5-836a-7aa34cda7fd9 service nova] Creating event network-changed:b17957b8-8774-4495-a6d4-74b4c7b3ef18 for instance 3d784e6b-2704-47cb-9cb5-225e4cace576 on n-h2-844626-8 Aug 09 14:32:49.379007 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1b761a08-4b57-42ea-b280-fecaf66f8670 req-af20850a-2293-49c5-836a-7aa34cda7fd9 service nova] Creating event network-vif-deleted:f0f8dcb7-df02-4e0c-a16f-f9b2f9e6fe00 for instance 9124e955-056d-4c19-baa2-dbbfdcad5058 on n-h2-844626-8 Aug 09 14:32:49.393953 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1b761a08-4b57-42ea-b280-fecaf66f8670 req-af20850a-2293-49c5-836a-7aa34cda7fd9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.095156 Aug 09 14:32:49.397452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0eb9ad9f-5e04-47cb-8539-a86393e75543 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:49.398708 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 336/615] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:49.402915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0eb9ad9f-5e04-47cb-8539-a86393e75543 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:49.410305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44840cf4-a94c-44e7-b3d0-0f760cf19ee7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:49.415811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44840cf4-a94c-44e7-b3d0-0f760cf19ee7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:49.419612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eb9ad9f-5e04-47cb-8539-a86393e75543 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.420450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eb9ad9f-5e04-47cb-8539-a86393e75543 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.421336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eb9ad9f-5e04-47cb-8539-a86393e75543 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.422484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eb9ad9f-5e04-47cb-8539-a86393e75543 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.423171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eb9ad9f-5e04-47cb-8539-a86393e75543 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.423845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eb9ad9f-5e04-47cb-8539-a86393e75543 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.431326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44840cf4-a94c-44e7-b3d0-0f760cf19ee7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.431326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44840cf4-a94c-44e7-b3d0-0f760cf19ee7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.431528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44840cf4-a94c-44e7-b3d0-0f760cf19ee7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.432206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44840cf4-a94c-44e7-b3d0-0f760cf19ee7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.437297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44840cf4-a94c-44e7-b3d0-0f760cf19ee7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.437870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44840cf4-a94c-44e7-b3d0-0f760cf19ee7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.894668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0eb9ad9f-5e04-47cb-8539-a86393e75543 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:49.912558 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0eb9ad9f-5e04-47cb-8539-a86393e75543 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1492 microversion: 2.1 time: 0.549837 Aug 09 14:32:49.916602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-44840cf4-a94c-44e7-b3d0-0f760cf19ee7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:49.925571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-44840cf4-a94c-44e7-b3d0-0f760cf19ee7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:49.927538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-44840cf4-a94c-44e7-b3d0-0f760cf19ee7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:49.929258 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44840cf4-a94c-44e7-b3d0-0f760cf19ee7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1568 microversion: 2.25 time: 0.529245 Aug 09 14:32:49.930113 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 337/617] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:49 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1568 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:49.931942 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 280/617] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:49 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1492 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:49.944337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8839516d-fbe3-4e4b-bd4e-9d42e29df0f6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:49.944993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8839516d-fbe3-4e4b-bd4e-9d42e29df0f6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:49.946320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-baf987d9-1e92-4276-8dfc-bdde81e0f31a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:49.948560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-baf987d9-1e92-4276-8dfc-bdde81e0f31a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:49.958518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8839516d-fbe3-4e4b-bd4e-9d42e29df0f6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.960755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8839516d-fbe3-4e4b-bd4e-9d42e29df0f6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.964573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-baf987d9-1e92-4276-8dfc-bdde81e0f31a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.965662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8839516d-fbe3-4e4b-bd4e-9d42e29df0f6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.966906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8839516d-fbe3-4e4b-bd4e-9d42e29df0f6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.967567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8839516d-fbe3-4e4b-bd4e-9d42e29df0f6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.968229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8839516d-fbe3-4e4b-bd4e-9d42e29df0f6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.974172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-baf987d9-1e92-4276-8dfc-bdde81e0f31a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.974838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-baf987d9-1e92-4276-8dfc-bdde81e0f31a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:49.976223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-baf987d9-1e92-4276-8dfc-bdde81e0f31a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:49.976859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-baf987d9-1e92-4276-8dfc-bdde81e0f31a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:49.977444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-baf987d9-1e92-4276-8dfc-bdde81e0f31a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:50.416057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8839516d-fbe3-4e4b-bd4e-9d42e29df0f6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:50.419895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-baf987d9-1e92-4276-8dfc-bdde81e0f31a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:50.427614 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8839516d-fbe3-4e4b-bd4e-9d42e29df0f6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 200 len: 1464 microversion: 2.1 time: 0.494428 Aug 09 14:32:50.427712 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-baf987d9-1e92-4276-8dfc-bdde81e0f31a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1470 microversion: 2.1 time: 0.496188 Aug 09 14:32:50.440703 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 338/618] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:49 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1470 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:50.443788 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 281/619] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:49 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 1464 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:50.464927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1ee9433-e166-4ba9-bae2-e1ac9faa889a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:50.465846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1ee9433-e166-4ba9-bae2-e1ac9faa889a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:50.477343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1ee9433-e166-4ba9-bae2-e1ac9faa889a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:50.478144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1ee9433-e166-4ba9-bae2-e1ac9faa889a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:50.478835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1ee9433-e166-4ba9-bae2-e1ac9faa889a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:50.480342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1ee9433-e166-4ba9-bae2-e1ac9faa889a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:50.481043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1ee9433-e166-4ba9-bae2-e1ac9faa889a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:50.482133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1ee9433-e166-4ba9-bae2-e1ac9faa889a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:50.668557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e02858fd-375d-4cbc-aa2a-0aa98cadae7f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:50.669411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e02858fd-375d-4cbc-aa2a-0aa98cadae7f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:50.679490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e02858fd-375d-4cbc-aa2a-0aa98cadae7f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:50.680023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e02858fd-375d-4cbc-aa2a-0aa98cadae7f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:50.683962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e02858fd-375d-4cbc-aa2a-0aa98cadae7f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:50.697141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e02858fd-375d-4cbc-aa2a-0aa98cadae7f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:50.698849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e02858fd-375d-4cbc-aa2a-0aa98cadae7f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:50.699504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e02858fd-375d-4cbc-aa2a-0aa98cadae7f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:51.395469 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e02858fd-375d-4cbc-aa2a-0aa98cadae7f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1643 microversion: 2.1 time: 0.953231 Aug 09 14:32:51.400681 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 339/620] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:50 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1643 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:51.408178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a6af040f-6011-4ae3-96cc-74f921a3b6ae tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:51.408777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a6af040f-6011-4ae3-96cc-74f921a3b6ae tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 9124e955-056d-4c19-baa2-dbbfdcad5058] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:51.423467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1ee9433-e166-4ba9-bae2-e1ac9faa889a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:51.437292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6af040f-6011-4ae3-96cc-74f921a3b6ae tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:51.440504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6af040f-6011-4ae3-96cc-74f921a3b6ae tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:51.443766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6af040f-6011-4ae3-96cc-74f921a3b6ae tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:51.444751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6af040f-6011-4ae3-96cc-74f921a3b6ae tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:51.446170 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1ee9433-e166-4ba9-bae2-e1ac9faa889a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1390 microversion: 2.1 time: 0.999494 Aug 09 14:32:51.446811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6af040f-6011-4ae3-96cc-74f921a3b6ae tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:51.448113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6af040f-6011-4ae3-96cc-74f921a3b6ae tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:51.449522 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 282/621] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:50 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1390 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:51.462493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-423587c0-ab66-460c-9db8-a6713c929d48 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:51.463884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-423587c0-ab66-460c-9db8-a6713c929d48 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:51.478066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-423587c0-ab66-460c-9db8-a6713c929d48 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:51.478867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-423587c0-ab66-460c-9db8-a6713c929d48 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:51.479528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-423587c0-ab66-460c-9db8-a6713c929d48 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:51.480475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-423587c0-ab66-460c-9db8-a6713c929d48 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:51.480952 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-a6af040f-6011-4ae3-96cc-74f921a3b6ae tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] HTTP exception thrown: Instance 9124e955-056d-4c19-baa2-dbbfdcad5058 could not be found. Aug 09 14:32:51.481292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-423587c0-ab66-460c-9db8-a6713c929d48 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:51.481878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-423587c0-ab66-460c-9db8-a6713c929d48 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a6af040f-6011-4ae3-96cc-74f921a3b6ae tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Request method failure captured: Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058 HTTP/1.1 Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-xMW1p22yQgXVnAOILTSyK6kzD0spd3R9vmFXpnSwsI9NrLffJKtAzkoOcEzUjwR55uouxgrRrbZ8wEjEnpY2nzDPcjOL4AsUJoxJPeJLYbesnlquUqps_AyjHaGrTqXu5kpTp0xeso4IU_ykwVBVuO6iVy0ETsd9clb-oyaRIpTw Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a1bf318922fb4676a19a51a39580948a Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ListServerFiltersTestJSON-2110151572 Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:32:51.483504 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:32:51.485060 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a1bf318922fb4676a19a51a39580948a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a1bf318922fb4676a19a51a39580948a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1bf318922fb4676a19a51a39580948a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1bf318922fb4676a19a51a39580948a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:51.485060 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ListServerFiltersTestJSON-2110151572 Aug 09 14:32:51.485060 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a1bf318922fb4676a19a51a39580948a Aug 09 14:32:51.485060 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2110151572 Aug 09 14:32:51.485060 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ListServerFiltersTestJSON-2110151572-project Aug 09 14:32:51.485060 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:32:51.485060 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:32:51.485060 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 56df13a960424540b4540a50696dfd2d Aug 09 14:32:51.485060 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ListServerFiltersTestJSON-2110151572-project Aug 09 14:32:51.485060 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:32:51.485060 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 9124e955-056d-4c19-baa2-dbbfdcad5058 could not be found. Aug 09 14:32:51.485060 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '9124e955-056d-4c19-baa2-dbbfdcad5058'} Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9124e955-056d-4c19-baa2-dbbfdcad5058 could not be found. Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:51.486016 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9124e955-056d-4c19-baa2-dbbfdcad5058 could not be found. Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9124e955-056d-4c19-baa2-dbbfdcad5058 could not be found. Aug 09 14:32:51.487466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:51.488752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a6af040f-6011-4ae3-96cc-74f921a3b6ae tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Returning 404 to user: Instance 9124e955-056d-4c19-baa2-dbbfdcad5058 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:51.488752 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a6af040f-6011-4ae3-96cc-74f921a3b6ae tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058" status: 404 len: 111 microversion: 2.1 time: 0.084948 Aug 09 14:32:51.489295 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 340/622] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:51 2022] GET /compute/v2.1/servers/9124e955-056d-4c19-baa2-dbbfdcad5058 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:32:51.495959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-fa9b8d39-280b-469e-87f8-454a9da08094 req-d9c34cf6-0d18-4800-ad4c-eb836b807fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49bf1b81-8cce-44a6-97ca-87ab6af16b85", "name": "network-vif-deleted", "tag": "a49672bf-47a1-4880-9dbf-84e2874f2277"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:51.532490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-fa9b8d39-280b-469e-87f8-454a9da08094 req-d9c34cf6-0d18-4800-ad4c-eb836b807fc0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:51.534333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-fa9b8d39-280b-469e-87f8-454a9da08094 req-d9c34cf6-0d18-4800-ad4c-eb836b807fc0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:51.535756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-fa9b8d39-280b-469e-87f8-454a9da08094 req-d9c34cf6-0d18-4800-ad4c-eb836b807fc0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:51.569570 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-fa9b8d39-280b-469e-87f8-454a9da08094 req-d9c34cf6-0d18-4800-ad4c-eb836b807fc0 service nova] Creating event network-vif-deleted:a49672bf-47a1-4880-9dbf-84e2874f2277 for instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 on n-h2-844626-8 Aug 09 14:32:51.580870 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-fa9b8d39-280b-469e-87f8-454a9da08094 req-d9c34cf6-0d18-4800-ad4c-eb836b807fc0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090039 Aug 09 14:32:51.582377 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 341/623] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:51.593720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ef5ded8b-501e-42d3-a9fa-5d690efda3bf req-355dc429-4cd4-42d4-b85e-44e13ca850d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4125ae9-163d-4e42-b277-f309f031f352", "name": "network-vif-plugged", "status": "completed", "tag": "3ce4965e-717b-4943-b658-c4cc8884f87e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:51.610332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ef5ded8b-501e-42d3-a9fa-5d690efda3bf req-355dc429-4cd4-42d4-b85e-44e13ca850d0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:51.611057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ef5ded8b-501e-42d3-a9fa-5d690efda3bf req-355dc429-4cd4-42d4-b85e-44e13ca850d0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:51.611748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ef5ded8b-501e-42d3-a9fa-5d690efda3bf req-355dc429-4cd4-42d4-b85e-44e13ca850d0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:51.637601 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ef5ded8b-501e-42d3-a9fa-5d690efda3bf req-355dc429-4cd4-42d4-b85e-44e13ca850d0 service nova] Creating event network-vif-plugged:3ce4965e-717b-4943-b658-c4cc8884f87e for instance c4125ae9-163d-4e42-b277-f309f031f352 on n-h1-844626-8 Aug 09 14:32:51.645505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-ef5ded8b-501e-42d3-a9fa-5d690efda3bf req-355dc429-4cd4-42d4-b85e-44e13ca850d0 service nova] Instance c4125ae9-163d-4e42-b277-f309f031f352 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 14:32:51.658827 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ef5ded8b-501e-42d3-a9fa-5d690efda3bf req-355dc429-4cd4-42d4-b85e-44e13ca850d0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074347 Aug 09 14:32:51.663913 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 342/624] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:51.674048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3cae34b7-2f45-4342-9cb9-182af81d6939 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:51.675396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3cae34b7-2f45-4342-9cb9-182af81d6939 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:51.685420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cae34b7-2f45-4342-9cb9-182af81d6939 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:51.686336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cae34b7-2f45-4342-9cb9-182af81d6939 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:51.687714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cae34b7-2f45-4342-9cb9-182af81d6939 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:51.688682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cae34b7-2f45-4342-9cb9-182af81d6939 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:51.689785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cae34b7-2f45-4342-9cb9-182af81d6939 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:51.690378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cae34b7-2f45-4342-9cb9-182af81d6939 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.300331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-423587c0-ab66-460c-9db8-a6713c929d48 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:52.320605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-423587c0-ab66-460c-9db8-a6713c929d48 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:52.326931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-423587c0-ab66-460c-9db8-a6713c929d48 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:52.329643 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-423587c0-ab66-460c-9db8-a6713c929d48 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1568 microversion: 2.25 time: 0.876726 Aug 09 14:32:52.332435 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 283/625] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:51 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1568 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:52.339972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d9945e2-a5d4-4699-9f2a-ac8c8fd8922b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:52.340895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6d9945e2-a5d4-4699-9f2a-ac8c8fd8922b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 49bf1b81-8cce-44a6-97ca-87ab6af16b85] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:52.349113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d9945e2-a5d4-4699-9f2a-ac8c8fd8922b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.349891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d9945e2-a5d4-4699-9f2a-ac8c8fd8922b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.350521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d9945e2-a5d4-4699-9f2a-ac8c8fd8922b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.351902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d9945e2-a5d4-4699-9f2a-ac8c8fd8922b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.352943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d9945e2-a5d4-4699-9f2a-ac8c8fd8922b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.353569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d9945e2-a5d4-4699-9f2a-ac8c8fd8922b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.384686 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3cae34b7-2f45-4342-9cb9-182af81d6939 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1643 microversion: 2.1 time: 0.716991 Aug 09 14:32:52.385526 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 343/626] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:51 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1643 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:52.395334 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-6d9945e2-a5d4-4699-9f2a-ac8c8fd8922b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] HTTP exception thrown: Instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 could not be found. Aug 09 14:32:52.397927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4ff6a6d2-a68e-4c3f-b240-0c83fa4f3c3d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:52.400701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4ff6a6d2-a68e-4c3f-b240-0c83fa4f3c3d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d9945e2-a5d4-4699-9f2a-ac8c8fd8922b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Request method failure captured: Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 HTTP/1.1 Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_e-T_pcqUfNb5DDrmHuOxBYEITM5r-mdxIqwZJgyf0XXU-24cBtKv3OQh11-Fjil7BpXc2_HJhzmLPS7C3PJ2PNjIDDa3oLeCfDm511SHjEJ3F2fcjrW3alF3C9qDp5i4z6MYbl4FIWUANPgPRDiJN_U53aIHpfykIteeuEpkNeA4 Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 5965d64145c14bf4bb3c9c56ffa8dcab Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-LiveMigrationNegativeTest-1850754955 Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:32:52.401592 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:32:52.403073 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5965d64145c14bf4bb3c9c56ffa8dcab", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5965d64145c14bf4bb3c9c56ffa8dcab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5965d64145c14bf4bb3c9c56ffa8dcab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5965d64145c14bf4bb3c9c56ffa8dcab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:52.403073 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-LiveMigrationNegativeTest-1850754955 Aug 09 14:32:52.403073 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 5965d64145c14bf4bb3c9c56ffa8dcab Aug 09 14:32:52.403073 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1850754955 Aug 09 14:32:52.403073 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-LiveMigrationNegativeTest-1850754955-project Aug 09 14:32:52.403073 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:32:52.403073 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:32:52.403073 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 36032592e1ea4a4e996689515d713ab3 Aug 09 14:32:52.403073 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-LiveMigrationNegativeTest-1850754955-project Aug 09 14:32:52.403073 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:32:52.403073 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 could not be found. Aug 09 14:32:52.403073 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '49bf1b81-8cce-44a6-97ca-87ab6af16b85'} Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 could not be found. Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:52.404043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 could not be found. Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 could not be found. Aug 09 14:32:52.405416 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:32:52.406857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ff6a6d2-a68e-4c3f-b240-0c83fa4f3c3d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.407380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ff6a6d2-a68e-4c3f-b240-0c83fa4f3c3d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.407816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ff6a6d2-a68e-4c3f-b240-0c83fa4f3c3d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.407928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d9945e2-a5d4-4699-9f2a-ac8c8fd8922b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Returning 404 to user: Instance 49bf1b81-8cce-44a6-97ca-87ab6af16b85 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:52.408513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ff6a6d2-a68e-4c3f-b240-0c83fa4f3c3d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.408991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ff6a6d2-a68e-4c3f-b240-0c83fa4f3c3d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.409265 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6d9945e2-a5d4-4699-9f2a-ac8c8fd8922b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85" status: 404 len: 111 microversion: 2.1 time: 0.075552 Aug 09 14:32:52.409763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ff6a6d2-a68e-4c3f-b240-0c83fa4f3c3d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.410405 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 284/627] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:52 2022] GET /compute/v2.1/servers/49bf1b81-8cce-44a6-97ca-87ab6af16b85 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:32:52.417559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-937079c4-009a-48b8-a3eb-9fb4c889fddc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:52.418063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-937079c4-009a-48b8-a3eb-9fb4c889fddc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:52.425379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-937079c4-009a-48b8-a3eb-9fb4c889fddc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.426610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-937079c4-009a-48b8-a3eb-9fb4c889fddc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.428925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-937079c4-009a-48b8-a3eb-9fb4c889fddc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.431236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-937079c4-009a-48b8-a3eb-9fb4c889fddc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.431992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-937079c4-009a-48b8-a3eb-9fb4c889fddc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.432595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-937079c4-009a-48b8-a3eb-9fb4c889fddc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.465310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-937079c4-009a-48b8-a3eb-9fb4c889fddc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:32:52.571314 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-937079c4-009a-48b8-a3eb-9fb4c889fddc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 204 len: 0 microversion: 2.1 time: 0.159341 Aug 09 14:32:52.574845 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 285/628] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:32:52 2022] DELETE /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:32:52.578944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40305518-fd57-403b-9f2d-a210bf70a9b4 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:52.582545 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:32:52.582545 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:32:52.584203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40305518-fd57-403b-9f2d-a210bf70a9b4 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.584856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40305518-fd57-403b-9f2d-a210bf70a9b4 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.585430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40305518-fd57-403b-9f2d-a210bf70a9b4 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.586368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40305518-fd57-403b-9f2d-a210bf70a9b4 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.586962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40305518-fd57-403b-9f2d-a210bf70a9b4 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.587569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40305518-fd57-403b-9f2d-a210bf70a9b4 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.612886 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40305518-fd57-403b-9f2d-a210bf70a9b4 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039139 Aug 09 14:32:52.620641 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 286/629] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 9 14:32:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:52.627182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-104636ab-8d7b-4565-948b-084050fd83d9 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:52.628285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-104636ab-8d7b-4565-948b-084050fd83d9 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:52.640439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-104636ab-8d7b-4565-948b-084050fd83d9 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.641273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-104636ab-8d7b-4565-948b-084050fd83d9 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.642451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-104636ab-8d7b-4565-948b-084050fd83d9 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.643617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-104636ab-8d7b-4565-948b-084050fd83d9 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.644289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-104636ab-8d7b-4565-948b-084050fd83d9 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.644902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-104636ab-8d7b-4565-948b-084050fd83d9 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.696018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4ff6a6d2-a68e-4c3f-b240-0c83fa4f3c3d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:52.698467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-104636ab-8d7b-4565-948b-084050fd83d9 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:32:52.707443 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4ff6a6d2-a68e-4c3f-b240-0c83fa4f3c3d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1470 microversion: 2.1 time: 0.319827 Aug 09 14:32:52.708402 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 344/630] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:52 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1470 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:52.713610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4fed2cf-f1c7-4d41-be84-b99821b7eed5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:52.714206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b4fed2cf-f1c7-4d41-be84-b99821b7eed5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:52.724816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4fed2cf-f1c7-4d41-be84-b99821b7eed5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.725950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4fed2cf-f1c7-4d41-be84-b99821b7eed5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.726738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4fed2cf-f1c7-4d41-be84-b99821b7eed5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.727681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4fed2cf-f1c7-4d41-be84-b99821b7eed5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.729935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4fed2cf-f1c7-4d41-be84-b99821b7eed5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.730564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4fed2cf-f1c7-4d41-be84-b99821b7eed5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.758964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:52.791787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:52.798299 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-104636ab-8d7b-4565-948b-084050fd83d9 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 204 len: 0 microversion: 2.1 time: 0.176305 Aug 09 14:32:52.799556 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 287/631] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:32:52 2022] DELETE /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:32:52.808952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eea3575c-6f72-4e4b-a768-1a93eaf217c9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:52.809723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eea3575c-6f72-4e4b-a768-1a93eaf217c9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:52.818675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea3575c-6f72-4e4b-a768-1a93eaf217c9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.819565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea3575c-6f72-4e4b-a768-1a93eaf217c9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.820864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea3575c-6f72-4e4b-a768-1a93eaf217c9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:52.821658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea3575c-6f72-4e4b-a768-1a93eaf217c9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:52.822296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea3575c-6f72-4e4b-a768-1a93eaf217c9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:52.822699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea3575c-6f72-4e4b-a768-1a93eaf217c9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:53.099893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b4fed2cf-f1c7-4d41-be84-b99821b7eed5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:53.112816 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b4fed2cf-f1c7-4d41-be84-b99821b7eed5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1390 microversion: 2.1 time: 0.402748 Aug 09 14:32:53.114587 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 345/632] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:52 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1390 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:53.131000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eea3575c-6f72-4e4b-a768-1a93eaf217c9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:53.140109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4153e004-2b86-486e-aace-ddc6981be37f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844626-8", "block_migration": true, "disk_over_commit": false}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:53.148171 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eea3575c-6f72-4e4b-a768-1a93eaf217c9 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1518 microversion: 2.1 time: 0.346970 Aug 09 14:32:53.152754 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 288/633] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:52 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1518 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:53.164509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4153e004-2b86-486e-aace-ddc6981be37f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:53.166899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37bbff29-3c31-4837-8526-ab57c6c82bc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:53.168442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37bbff29-3c31-4837-8526-ab57c6c82bc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:53.175307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4153e004-2b86-486e-aace-ddc6981be37f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:53.175967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4153e004-2b86-486e-aace-ddc6981be37f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:53.176604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4153e004-2b86-486e-aace-ddc6981be37f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:53.177465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4153e004-2b86-486e-aace-ddc6981be37f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:53.178064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4153e004-2b86-486e-aace-ddc6981be37f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:53.178946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4153e004-2b86-486e-aace-ddc6981be37f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:53.180941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37bbff29-3c31-4837-8526-ab57c6c82bc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:53.181452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37bbff29-3c31-4837-8526-ab57c6c82bc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:53.181892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37bbff29-3c31-4837-8526-ab57c6c82bc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:53.182598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37bbff29-3c31-4837-8526-ab57c6c82bc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:53.183073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37bbff29-3c31-4837-8526-ab57c6c82bc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:53.183513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37bbff29-3c31-4837-8526-ab57c6c82bc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:53.209599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-4153e004-2b86-486e-aace-ddc6981be37f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lazy-loading 'flavor' on Instance uuid 4ca42dbb-ca4a-4f81-ac33-6d850cd01322 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:53.223912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4153e004-2b86-486e-aace-ddc6981be37f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Going to try to live migrate instance to n-h2-844626-8 {{(pid=119406) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 14:32:53.469458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-37bbff29-3c31-4837-8526-ab57c6c82bc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:53.479066 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37bbff29-3c31-4837-8526-ab57c6c82bc3 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1474 microversion: 2.1 time: 0.325167 Aug 09 14:32:53.480707 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 289/634] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:53 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1474 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:53.489570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3f9ae9ca-905b-49b6-a851-940da0bf540e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:53.490471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3f9ae9ca-905b-49b6-a851-940da0bf540e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:53.499916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f9ae9ca-905b-49b6-a851-940da0bf540e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:53.504570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f9ae9ca-905b-49b6-a851-940da0bf540e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:53.505327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f9ae9ca-905b-49b6-a851-940da0bf540e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:53.506214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f9ae9ca-905b-49b6-a851-940da0bf540e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:53.508753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f9ae9ca-905b-49b6-a851-940da0bf540e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:53.509354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f9ae9ca-905b-49b6-a851-940da0bf540e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:53.880649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3f9ae9ca-905b-49b6-a851-940da0bf540e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:53.890198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3f9ae9ca-905b-49b6-a851-940da0bf540e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:53.894090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3f9ae9ca-905b-49b6-a851-940da0bf540e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:53.895347 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3f9ae9ca-905b-49b6-a851-940da0bf540e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1568 microversion: 2.25 time: 0.413629 Aug 09 14:32:53.915418 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 290/635] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:53 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1568 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:53.920366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f144660f-710e-4554-b8bf-b91aecf459bf req-f4a964db-d2c7-4911-932d-fb29014ff24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f49c755-de1e-44c2-98de-f6654c0a94a5", "name": "network-vif-unplugged", "status": "completed", "tag": "73ab8dbc-ce85-43aa-8083-f3979fc042ef"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:53.946663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f144660f-710e-4554-b8bf-b91aecf459bf req-f4a964db-d2c7-4911-932d-fb29014ff24f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:53.947257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f144660f-710e-4554-b8bf-b91aecf459bf req-f4a964db-d2c7-4911-932d-fb29014ff24f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:53.947778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f144660f-710e-4554-b8bf-b91aecf459bf req-f4a964db-d2c7-4911-932d-fb29014ff24f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:53.975489 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f144660f-710e-4554-b8bf-b91aecf459bf req-f4a964db-d2c7-4911-932d-fb29014ff24f service nova] Creating event network-vif-unplugged:73ab8dbc-ce85-43aa-8083-f3979fc042ef for instance 0f49c755-de1e-44c2-98de-f6654c0a94a5 on n-h1-844626-8 Aug 09 14:32:53.988319 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f144660f-710e-4554-b8bf-b91aecf459bf req-f4a964db-d2c7-4911-932d-fb29014ff24f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071324 Aug 09 14:32:53.990525 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 291/636] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:54.002267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b255b1ca-903f-474e-97bc-46c16312934c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:54.002987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b255b1ca-903f-474e-97bc-46c16312934c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:54.028080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b255b1ca-903f-474e-97bc-46c16312934c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:54.028455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b255b1ca-903f-474e-97bc-46c16312934c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:54.028904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b255b1ca-903f-474e-97bc-46c16312934c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:54.043951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b255b1ca-903f-474e-97bc-46c16312934c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:54.046265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b255b1ca-903f-474e-97bc-46c16312934c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:54.047754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b255b1ca-903f-474e-97bc-46c16312934c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:54.338645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b255b1ca-903f-474e-97bc-46c16312934c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:54.351379 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b255b1ca-903f-474e-97bc-46c16312934c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1462 microversion: 2.1 time: 0.359411 Aug 09 14:32:54.353016 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 292/637] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:53 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1462 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:54.358770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-596efa02-1626-4943-b235-21404988e4c8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:54.359449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-596efa02-1626-4943-b235-21404988e4c8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:54.370105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-596efa02-1626-4943-b235-21404988e4c8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:54.373050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-596efa02-1626-4943-b235-21404988e4c8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:54.373683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-596efa02-1626-4943-b235-21404988e4c8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:54.374556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-596efa02-1626-4943-b235-21404988e4c8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:54.375185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-596efa02-1626-4943-b235-21404988e4c8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:54.375903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-596efa02-1626-4943-b235-21404988e4c8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:54.525229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-596efa02-1626-4943-b235-21404988e4c8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:54.535297 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-596efa02-1626-4943-b235-21404988e4c8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1390 microversion: 2.1 time: 0.180959 Aug 09 14:32:54.535992 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 293/638] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:54 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1390 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:54.541954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b84bd65a-6921-4c83-9c97-3ba2022f46fa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:54.542739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b84bd65a-6921-4c83-9c97-3ba2022f46fa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:54.546734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:54.552557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b84bd65a-6921-4c83-9c97-3ba2022f46fa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:54.553564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b84bd65a-6921-4c83-9c97-3ba2022f46fa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:54.554128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b84bd65a-6921-4c83-9c97-3ba2022f46fa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:54.555006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b84bd65a-6921-4c83-9c97-3ba2022f46fa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:54.556374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b84bd65a-6921-4c83-9c97-3ba2022f46fa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:54.556944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b84bd65a-6921-4c83-9c97-3ba2022f46fa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:54.713723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b84bd65a-6921-4c83-9c97-3ba2022f46fa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:54.721935 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b84bd65a-6921-4c83-9c97-3ba2022f46fa tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1518 microversion: 2.1 time: 0.184682 Aug 09 14:32:54.722766 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 294/639] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:54 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:54.727619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-355b6f15-1561-440f-b860-10bc357b6e82 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:54.728228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-355b6f15-1561-440f-b860-10bc357b6e82 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:54.736184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-355b6f15-1561-440f-b860-10bc357b6e82 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:54.738982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-355b6f15-1561-440f-b860-10bc357b6e82 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:54.739586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-355b6f15-1561-440f-b860-10bc357b6e82 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:54.741036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-355b6f15-1561-440f-b860-10bc357b6e82 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:54.741502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-355b6f15-1561-440f-b860-10bc357b6e82 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:54.741923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-355b6f15-1561-440f-b860-10bc357b6e82 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:54.886104 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-355b6f15-1561-440f-b860-10bc357b6e82 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1613 microversion: 2.1 time: 0.162253 Aug 09 14:32:54.891606 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 295/640] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:54 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1613 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:54.895933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36621a65-d0b9-415f-b073-71cd31c98f4b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:54.896725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36621a65-d0b9-415f-b073-71cd31c98f4b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:54.907078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36621a65-d0b9-415f-b073-71cd31c98f4b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:54.907972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36621a65-d0b9-415f-b073-71cd31c98f4b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:54.918107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36621a65-d0b9-415f-b073-71cd31c98f4b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:54.919176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36621a65-d0b9-415f-b073-71cd31c98f4b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:54.920796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36621a65-d0b9-415f-b073-71cd31c98f4b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:54.921375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36621a65-d0b9-415f-b073-71cd31c98f4b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:55.141582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-36621a65-d0b9-415f-b073-71cd31c98f4b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:55.152584 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36621a65-d0b9-415f-b073-71cd31c98f4b tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1474 microversion: 2.1 time: 0.264629 Aug 09 14:32:55.168021 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 296/641] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:54 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1474 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:55.175194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-428e466f-191d-4389-9133-de328be1639b tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Calling method '.version_select at 0x7f41dd7fc310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:55.180414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-428e466f-191d-4389-9133-de328be1639b tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:55.181112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-428e466f-191d-4389-9133-de328be1639b tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:55.182139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-428e466f-191d-4389-9133-de328be1639b tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:55.224495 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-428e466f-191d-4389-9133-de328be1639b tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1514 microversion: 2.1 time: 0.046160 Aug 09 14:32:55.240686 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 297/642] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:32:55 2022] GET /compute/v2.1/os-migrations => generated 1514 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:55.245899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a15ed69e-5f3c-4119-abd9-6e6d98496693 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:55.247154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a15ed69e-5f3c-4119-abd9-6e6d98496693 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:55.253944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a15ed69e-5f3c-4119-abd9-6e6d98496693 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:55.255000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a15ed69e-5f3c-4119-abd9-6e6d98496693 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:55.256496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a15ed69e-5f3c-4119-abd9-6e6d98496693 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:55.257406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a15ed69e-5f3c-4119-abd9-6e6d98496693 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:55.257997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a15ed69e-5f3c-4119-abd9-6e6d98496693 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:55.258554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a15ed69e-5f3c-4119-abd9-6e6d98496693 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:55.451572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a15ed69e-5f3c-4119-abd9-6e6d98496693 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:55.461715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a15ed69e-5f3c-4119-abd9-6e6d98496693 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:55.463316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a15ed69e-5f3c-4119-abd9-6e6d98496693 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:55.464512 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a15ed69e-5f3c-4119-abd9-6e6d98496693 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1568 microversion: 2.25 time: 0.222910 Aug 09 14:32:55.480224 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 298/643] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:55 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1568 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:55.487040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1838621316", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:55.579370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:32:55.919647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=34 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:56.214902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:32:56.215288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:32:56.215766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:32:56.216175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:32:56.216589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:32:56.232279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:56.233444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:56.234104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:56.235170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:56.236436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:56.237111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:56.247976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=31 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:32:56.265100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Getting quotas for project 21a086b8d4904e118283cea8eb12b678. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:32:56.270152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Getting quotas for user c45d9a126a0841d5938ee21e8e87b293 and project 21a086b8d4904e118283cea8eb12b678. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:32:56.295485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:32:56.304792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:32:56.406746 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4f3ec50-c817-45e6-9775-88b7b758bff5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925207 Aug 09 14:32:56.414822 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 299/644] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:32:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:32:56.435465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1cc4c276-bd36-481e-be3c-69046ad1b84a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:56.436241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1cc4c276-bd36-481e-be3c-69046ad1b84a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:56.458574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cc4c276-bd36-481e-be3c-69046ad1b84a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:56.463662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cc4c276-bd36-481e-be3c-69046ad1b84a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:56.464206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cc4c276-bd36-481e-be3c-69046ad1b84a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:56.465017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cc4c276-bd36-481e-be3c-69046ad1b84a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:56.469405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cc4c276-bd36-481e-be3c-69046ad1b84a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:56.474907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cc4c276-bd36-481e-be3c-69046ad1b84a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:56.711677 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4153e004-2b86-486e-aace-ddc6981be37f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322/action" status: 202 len: 0 microversion: 2.1 time: 3.581521 Aug 09 14:32:56.722205 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 346/645] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:32:53 2022] POST /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322/action => generated 0 bytes in 3601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:32:56.731308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-049fa4a8-f5a0-4d25-9870-49cc3b2005fc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:56.736506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-049fa4a8-f5a0-4d25-9870-49cc3b2005fc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:56.754319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-049fa4a8-f5a0-4d25-9870-49cc3b2005fc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:56.755337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-049fa4a8-f5a0-4d25-9870-49cc3b2005fc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:56.755998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-049fa4a8-f5a0-4d25-9870-49cc3b2005fc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:56.756910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-049fa4a8-f5a0-4d25-9870-49cc3b2005fc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:56.757579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-049fa4a8-f5a0-4d25-9870-49cc3b2005fc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:56.758791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-049fa4a8-f5a0-4d25-9870-49cc3b2005fc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:56.902009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1cc4c276-bd36-481e-be3c-69046ad1b84a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:56.912450 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1cc4c276-bd36-481e-be3c-69046ad1b84a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1390 microversion: 2.1 time: 0.496189 Aug 09 14:32:56.913038 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 300/646] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:56 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1390 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:56.939438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-c808ec6b-8f73-435c-866f-3a4534324dd6 req-f5947e20-6bf4-491d-a6b4-a6d2dc85638b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f49c755-de1e-44c2-98de-f6654c0a94a5", "tag": "73ab8dbc-ce85-43aa-8083-f3979fc042ef"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:56.958186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c808ec6b-8f73-435c-866f-3a4534324dd6 req-f5947e20-6bf4-491d-a6b4-a6d2dc85638b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:56.958880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c808ec6b-8f73-435c-866f-3a4534324dd6 req-f5947e20-6bf4-491d-a6b4-a6d2dc85638b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:56.965820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c808ec6b-8f73-435c-866f-3a4534324dd6 req-f5947e20-6bf4-491d-a6b4-a6d2dc85638b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:56.990816 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-c808ec6b-8f73-435c-866f-3a4534324dd6 req-f5947e20-6bf4-491d-a6b4-a6d2dc85638b service nova] Creating event network-changed:73ab8dbc-ce85-43aa-8083-f3979fc042ef for instance 0f49c755-de1e-44c2-98de-f6654c0a94a5 on n-h1-844626-8 Aug 09 14:32:57.002636 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-c808ec6b-8f73-435c-866f-3a4534324dd6 req-f5947e20-6bf4-491d-a6b4-a6d2dc85638b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072569 Aug 09 14:32:57.003379 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 301/647] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:57.015306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-20063171-b005-4722-bc90-c31e1f3ab9d6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:57.019529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-20063171-b005-4722-bc90-c31e1f3ab9d6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:57.034502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20063171-b005-4722-bc90-c31e1f3ab9d6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:57.035000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20063171-b005-4722-bc90-c31e1f3ab9d6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:57.035496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20063171-b005-4722-bc90-c31e1f3ab9d6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:57.036225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20063171-b005-4722-bc90-c31e1f3ab9d6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:57.036678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20063171-b005-4722-bc90-c31e1f3ab9d6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:57.037097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20063171-b005-4722-bc90-c31e1f3ab9d6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:57.121281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-049fa4a8-f5a0-4d25-9870-49cc3b2005fc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:57.131491 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-049fa4a8-f5a0-4d25-9870-49cc3b2005fc tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1518 microversion: 2.1 time: 0.406345 Aug 09 14:32:57.133737 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 347/648] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:56 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1518 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:57.142778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-183c7047-c79d-477e-9fd3-d3e3fa111988 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:57.145935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-183c7047-c79d-477e-9fd3-d3e3fa111988 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:57.159006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-183c7047-c79d-477e-9fd3-d3e3fa111988 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:57.159634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-183c7047-c79d-477e-9fd3-d3e3fa111988 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:57.160169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-183c7047-c79d-477e-9fd3-d3e3fa111988 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:57.161079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-183c7047-c79d-477e-9fd3-d3e3fa111988 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:57.166009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-183c7047-c79d-477e-9fd3-d3e3fa111988 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:57.166615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-183c7047-c79d-477e-9fd3-d3e3fa111988 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:57.433588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-183c7047-c79d-477e-9fd3-d3e3fa111988 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:57.489214 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-183c7047-c79d-477e-9fd3-d3e3fa111988 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1209 microversion: 2.1 time: 0.354219 Aug 09 14:32:57.490747 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 348/649] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:57 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1209 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:57.517838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec11f067-4d3b-4e85-808f-55bb8682f9fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:57.518003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-20063171-b005-4722-bc90-c31e1f3ab9d6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:57.518785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ec11f067-4d3b-4e85-808f-55bb8682f9fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:57.532433 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-20063171-b005-4722-bc90-c31e1f3ab9d6 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1474 microversion: 2.1 time: 0.526577 Aug 09 14:32:57.533082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec11f067-4d3b-4e85-808f-55bb8682f9fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:57.539113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec11f067-4d3b-4e85-808f-55bb8682f9fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:57.539305 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 302/650] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:57 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1474 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:57.543420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-147f4872-61c1-4dc8-bff7-b41a116e5966 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:57.544210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-147f4872-61c1-4dc8-bff7-b41a116e5966 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:57.558482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec11f067-4d3b-4e85-808f-55bb8682f9fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:57.559280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec11f067-4d3b-4e85-808f-55bb8682f9fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:57.559994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec11f067-4d3b-4e85-808f-55bb8682f9fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:57.560140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec11f067-4d3b-4e85-808f-55bb8682f9fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:57.562240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-147f4872-61c1-4dc8-bff7-b41a116e5966 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:57.563047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-147f4872-61c1-4dc8-bff7-b41a116e5966 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:57.564312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-147f4872-61c1-4dc8-bff7-b41a116e5966 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:57.566002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-147f4872-61c1-4dc8-bff7-b41a116e5966 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:57.569047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-147f4872-61c1-4dc8-bff7-b41a116e5966 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:57.569654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-147f4872-61c1-4dc8-bff7-b41a116e5966 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:58.142292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-147f4872-61c1-4dc8-bff7-b41a116e5966 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:58.157006 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-147f4872-61c1-4dc8-bff7-b41a116e5966 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 0.621346 Aug 09 14:32:58.157427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ec11f067-4d3b-4e85-808f-55bb8682f9fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:58.159155 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 303/651] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:57 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:58.167620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed58da29-e946-4dde-9de8-aa6c6cbab3ba tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:58.168776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed58da29-e946-4dde-9de8-aa6c6cbab3ba tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:58.169366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ec11f067-4d3b-4e85-808f-55bb8682f9fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:58.170870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ec11f067-4d3b-4e85-808f-55bb8682f9fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:58.172078 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec11f067-4d3b-4e85-808f-55bb8682f9fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1568 microversion: 2.25 time: 0.680156 Aug 09 14:32:58.181039 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 349/652] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:57 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1568 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:32:58.186251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1cfd56be-62b5-4782-b063-a0f2e65c16a7 req-9b647171-e1fd-4b9c-ac6b-c328fcf459fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d784e6b-2704-47cb-9cb5-225e4cace576", "name": "network-vif-plugged", "status": "completed", "tag": "b17957b8-8774-4495-a6d4-74b4c7b3ef18"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:58.200290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed58da29-e946-4dde-9de8-aa6c6cbab3ba tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:58.200689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed58da29-e946-4dde-9de8-aa6c6cbab3ba tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:58.203445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed58da29-e946-4dde-9de8-aa6c6cbab3ba tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:58.204184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed58da29-e946-4dde-9de8-aa6c6cbab3ba tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:58.204636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed58da29-e946-4dde-9de8-aa6c6cbab3ba tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:58.206480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1cfd56be-62b5-4782-b063-a0f2e65c16a7 req-9b647171-e1fd-4b9c-ac6b-c328fcf459fe service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:58.206950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1cfd56be-62b5-4782-b063-a0f2e65c16a7 req-9b647171-e1fd-4b9c-ac6b-c328fcf459fe service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:58.207396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1cfd56be-62b5-4782-b063-a0f2e65c16a7 req-9b647171-e1fd-4b9c-ac6b-c328fcf459fe service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:58.207791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed58da29-e946-4dde-9de8-aa6c6cbab3ba tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:58.232878 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1cfd56be-62b5-4782-b063-a0f2e65c16a7 req-9b647171-e1fd-4b9c-ac6b-c328fcf459fe service nova] Creating event network-vif-plugged:b17957b8-8774-4495-a6d4-74b4c7b3ef18 for instance 3d784e6b-2704-47cb-9cb5-225e4cace576 on n-h2-844626-8 Aug 09 14:32:58.245844 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1cfd56be-62b5-4782-b063-a0f2e65c16a7 req-9b647171-e1fd-4b9c-ac6b-c328fcf459fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063743 Aug 09 14:32:58.246821 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 350/653] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:58.251882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c5cb36ee-90c8-468d-b9cc-5918a5fc89e6 req-56d8e244-23dc-440d-a381-7d1355a51e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f816689-a92c-4d67-9f00-fea73d865d5a", "name": "network-vif-deleted", "tag": "23f1b837-21e2-411c-947f-32576c25ec04"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:32:58.279509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c5cb36ee-90c8-468d-b9cc-5918a5fc89e6 req-56d8e244-23dc-440d-a381-7d1355a51e61 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:58.279958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c5cb36ee-90c8-468d-b9cc-5918a5fc89e6 req-56d8e244-23dc-440d-a381-7d1355a51e61 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:58.280327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c5cb36ee-90c8-468d-b9cc-5918a5fc89e6 req-56d8e244-23dc-440d-a381-7d1355a51e61 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:58.320539 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-c5cb36ee-90c8-468d-b9cc-5918a5fc89e6 req-56d8e244-23dc-440d-a381-7d1355a51e61 service nova] Creating event network-vif-deleted:23f1b837-21e2-411c-947f-32576c25ec04 for instance 0f816689-a92c-4d67-9f00-fea73d865d5a on n-h1-844626-8 Aug 09 14:32:58.352081 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c5cb36ee-90c8-468d-b9cc-5918a5fc89e6 req-56d8e244-23dc-440d-a381-7d1355a51e61 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102389 Aug 09 14:32:58.352752 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 351/654] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:32:58.385218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-895fb6b1-da73-454e-a131-0c4fdc1d2da1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:58.391598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-895fb6b1-da73-454e-a131-0c4fdc1d2da1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:58.410418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-895fb6b1-da73-454e-a131-0c4fdc1d2da1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:58.411019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-895fb6b1-da73-454e-a131-0c4fdc1d2da1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:58.413538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-895fb6b1-da73-454e-a131-0c4fdc1d2da1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:58.420818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-895fb6b1-da73-454e-a131-0c4fdc1d2da1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:58.421604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-895fb6b1-da73-454e-a131-0c4fdc1d2da1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:58.431838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-895fb6b1-da73-454e-a131-0c4fdc1d2da1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:58.752098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-895fb6b1-da73-454e-a131-0c4fdc1d2da1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56df13a960424540b4540a50696dfd2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1bf318922fb4676a19a51a39580948a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:58.775380 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-895fb6b1-da73-454e-a131-0c4fdc1d2da1 tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 200 len: 1306 microversion: 2.1 time: 0.413051 Aug 09 14:32:58.776324 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 352/655] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:58 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 1306 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:58.781779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b11db750-46b7-4bc9-bb69-36e162fb550f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:58.782702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b11db750-46b7-4bc9-bb69-36e162fb550f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:58.800167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b11db750-46b7-4bc9-bb69-36e162fb550f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:58.800589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b11db750-46b7-4bc9-bb69-36e162fb550f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:58.801199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b11db750-46b7-4bc9-bb69-36e162fb550f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:58.802161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b11db750-46b7-4bc9-bb69-36e162fb550f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:58.806407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b11db750-46b7-4bc9-bb69-36e162fb550f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:58.807005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b11db750-46b7-4bc9-bb69-36e162fb550f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:58.881226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed58da29-e946-4dde-9de8-aa6c6cbab3ba tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:58.890830 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed58da29-e946-4dde-9de8-aa6c6cbab3ba tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1390 microversion: 2.1 time: 0.730067 Aug 09 14:32:58.898703 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 304/656] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:58 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1390 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:58.904231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:58.907229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:58.922671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:58.923403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:58.924055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:58.925349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:58.925995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:58.932158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:58.982351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b11db750-46b7-4bc9-bb69-36e162fb550f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:59.002347 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b11db750-46b7-4bc9-bb69-36e162fb550f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1271 microversion: 2.1 time: 0.224891 Aug 09 14:32:59.002980 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 353/657] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:58 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1271 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:59.006265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:59.007388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:59.008154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:59.009532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lazy-loading 'fault' on Instance uuid 0f816689-a92c-4d67-9f00-fea73d865d5a {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:32:59.440335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-852724ce-413b-411f-b85f-ad6f155d7979 tempest-FloatingIPDetailsNegativeTestJSON-645703840 tempest-FloatingIPDetailsNegativeTestJSON-645703840-project] Calling method '.version_select at 0x7f41de1a4dc0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:59.553901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36032592e1ea4a4e996689515d713ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5965d64145c14bf4bb3c9c56ffa8dcab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:32:59.571890 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ff1956e8-b540-4777-b7bd-40e7653c3b9f tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 200 len: 1308 microversion: 2.1 time: 0.671668 Aug 09 14:32:59.586695 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 305/658] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:58 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 1308 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:32:59.589545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc104118-4415-4fb5-a999-aaee3e09ff68 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:59.589545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fc104118-4415-4fb5-a999-aaee3e09ff68 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:59.597137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc104118-4415-4fb5-a999-aaee3e09ff68 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:59.597886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc104118-4415-4fb5-a999-aaee3e09ff68 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:59.598588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc104118-4415-4fb5-a999-aaee3e09ff68 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:59.599448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc104118-4415-4fb5-a999-aaee3e09ff68 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:59.610105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc104118-4415-4fb5-a999-aaee3e09ff68 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:59.610750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc104118-4415-4fb5-a999-aaee3e09ff68 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:59.624754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-852724ce-413b-411f-b85f-ad6f155d7979 tempest-FloatingIPDetailsNegativeTestJSON-645703840 tempest-FloatingIPDetailsNegativeTestJSON-645703840-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5920990a-4017-473c-837e-b5df947c85bf could not be found", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:32:59.625612 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-852724ce-413b-411f-b85f-ad6f155d7979 tempest-FloatingIPDetailsNegativeTestJSON-645703840 tempest-FloatingIPDetailsNegativeTestJSON-645703840-project] HTTP exception thrown: Floating IP not found for ID 5920990a-4017-473c-837e-b5df947c85bf Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-852724ce-413b-411f-b85f-ad6f155d7979 tempest-FloatingIPDetailsNegativeTestJSON-645703840 tempest-FloatingIPDetailsNegativeTestJSON-645703840-project] Request method failure captured: Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-floating-ips/5920990a-4017-473c-837e-b5df947c85bf HTTP/1.1 Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nAacFVAzjUrCVJtjSqWyGgI4ueIjhxHKIETXroc48cHDpUCtKqeqXe81ygDMOxyCAEHyZ_nHN1OiFpo1QNtD5ycCouFOESWv2JzCyoB2eTaMvgnn_FT2FQDzCQV9_19YKESAkvDB8L7ySl6jam3-kIFTB6srYdBC0fEDu11QBm0ZCs Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f9813aed09c94a54bdb89be86fbb9c31 Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-645703840 Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:32:59.628631 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:32:59.630268 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f9813aed09c94a54bdb89be86fbb9c31", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f9813aed09c94a54bdb89be86fbb9c31"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9813aed09c94a54bdb89be86fbb9c31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9813aed09c94a54bdb89be86fbb9c31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:32:59.630268 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-645703840 Aug 09 14:32:59.630268 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f9813aed09c94a54bdb89be86fbb9c31 Aug 09 14:32:59.630268 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-645703840 Aug 09 14:32:59.630268 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-645703840-project Aug 09 14:32:59.630268 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:32:59.630268 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:32:59.630268 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 217eabbf2f19489dbefef6a362b45b6a Aug 09 14:32:59.630268 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-645703840-project Aug 09 14:32:59.630268 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:32:59.630268 n-d-844626-8 devstack@n-api.service[119406]: exception: Floating IP not found for ID 5920990a-4017-473c-837e-b5df947c85bf Aug 09 14:32:59.630268 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '5920990a-4017-473c-837e-b5df947c85bf'} Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:32:59.631154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5920990a-4017-473c-837e-b5df947c85bf could not be found Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55cf2d35-7b23-442b-91f3-279a5805c1d7'] Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5920990a-4017-473c-837e-b5df947c85bf. Aug 09 14:32:59.632484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5920990a-4017-473c-837e-b5df947c85bf Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:32:59.633770 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:32:59.635190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:32:59.635190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5920990a-4017-473c-837e-b5df947c85bf Aug 09 14:32:59.635190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:32:59.636122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-852724ce-413b-411f-b85f-ad6f155d7979 tempest-FloatingIPDetailsNegativeTestJSON-645703840 tempest-FloatingIPDetailsNegativeTestJSON-645703840-project] Returning 404 to user: Floating IP not found for ID 5920990a-4017-473c-837e-b5df947c85bf {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:32:59.637124 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-852724ce-413b-411f-b85f-ad6f155d7979 tempest-FloatingIPDetailsNegativeTestJSON-645703840 tempest-FloatingIPDetailsNegativeTestJSON-645703840-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/5920990a-4017-473c-837e-b5df947c85bf" status: 404 len: 111 microversion: 2.1 time: 0.608963 Aug 09 14:32:59.638133 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 354/659] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 9 14:32:59 2022] GET /compute/v2.1/os-floating-ips/5920990a-4017-473c-837e-b5df947c85bf => generated 111 bytes in 610 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:32:59.648381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34c11cb9-aa65-4853-9ac4-72c8a14a9cf0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:32:59.649142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34c11cb9-aa65-4853-9ac4-72c8a14a9cf0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:32:59.662463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34c11cb9-aa65-4853-9ac4-72c8a14a9cf0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:59.675891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34c11cb9-aa65-4853-9ac4-72c8a14a9cf0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:59.676871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34c11cb9-aa65-4853-9ac4-72c8a14a9cf0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:32:59.677793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34c11cb9-aa65-4853-9ac4-72c8a14a9cf0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:32:59.678718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34c11cb9-aa65-4853-9ac4-72c8a14a9cf0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:32:59.679318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34c11cb9-aa65-4853-9ac4-72c8a14a9cf0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:00.059537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34c11cb9-aa65-4853-9ac4-72c8a14a9cf0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:00.077387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34c11cb9-aa65-4853-9ac4-72c8a14a9cf0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:00.078989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34c11cb9-aa65-4853-9ac4-72c8a14a9cf0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:00.082241 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34c11cb9-aa65-4853-9ac4-72c8a14a9cf0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1568 microversion: 2.25 time: 0.441131 Aug 09 14:33:00.085952 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 355/660] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:32:59 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1568 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:00.090735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bd793e8c-e70f-40ae-8558-9ad29738a00b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:00.091361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bd793e8c-e70f-40ae-8558-9ad29738a00b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] [instance: 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:00.104197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd793e8c-e70f-40ae-8558-9ad29738a00b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:00.104679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd793e8c-e70f-40ae-8558-9ad29738a00b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:00.105122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd793e8c-e70f-40ae-8558-9ad29738a00b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:00.106493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd793e8c-e70f-40ae-8558-9ad29738a00b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:00.107153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd793e8c-e70f-40ae-8558-9ad29738a00b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:00.107584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd793e8c-e70f-40ae-8558-9ad29738a00b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:00.146575 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-bd793e8c-e70f-40ae-8558-9ad29738a00b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] HTTP exception thrown: Instance 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce could not be found. Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bd793e8c-e70f-40ae-8558-9ad29738a00b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Request method failure captured: Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce HTTP/1.1 Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-xMW1p22yQgXVnAOILTSyK6kzD0spd3R9vmFXpnSwsI9NrLffJKtAzkoOcEzUjwR55uouxgrRrbZ8wEjEnpY2nzDPcjOL4AsUJoxJPeJLYbesnlquUqps_AyjHaGrTqXu5kpTp0xeso4IU_ykwVBVuO6iVy0ETsd9clb-oyaRIpTw Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a1bf318922fb4676a19a51a39580948a Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ListServerFiltersTestJSON-2110151572 Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:33:00.149547 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:33:00.150880 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a1bf318922fb4676a19a51a39580948a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a1bf318922fb4676a19a51a39580948a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1bf318922fb4676a19a51a39580948a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a1bf318922fb4676a19a51a39580948a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:00.150880 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ListServerFiltersTestJSON-2110151572 Aug 09 14:33:00.150880 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a1bf318922fb4676a19a51a39580948a Aug 09 14:33:00.150880 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2110151572 Aug 09 14:33:00.150880 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ListServerFiltersTestJSON-2110151572-project Aug 09 14:33:00.150880 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:33:00.150880 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:33:00.150880 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 56df13a960424540b4540a50696dfd2d Aug 09 14:33:00.150880 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ListServerFiltersTestJSON-2110151572-project Aug 09 14:33:00.150880 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:33:00.150880 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce could not be found. Aug 09 14:33:00.150880 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce'} Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce could not be found. Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:00.151697 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce could not be found. Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce could not be found. Aug 09 14:33:00.152855 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:00.154000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bd793e8c-e70f-40ae-8558-9ad29738a00b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] Returning 404 to user: Instance 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:00.154000 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bd793e8c-e70f-40ae-8558-9ad29738a00b tempest-ListServerFiltersTestJSON-2110151572 tempest-ListServerFiltersTestJSON-2110151572-project] 10.222.0.50 "GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce" status: 404 len: 111 microversion: 2.1 time: 0.066591 Aug 09 14:33:00.159594 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 356/661] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:00 2022] GET /compute/v2.1/servers/8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:33:00.163235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc104118-4415-4fb5-a999-aaee3e09ff68 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:00.165826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:00.185422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-daa7534a-4683-459a-a12e-08ec809677e9 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:00.186032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-daa7534a-4683-459a-a12e-08ec809677e9 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:00.187810 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc104118-4415-4fb5-a999-aaee3e09ff68 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 0.600746 Aug 09 14:33:00.189694 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 306/662] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:32:59 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:00.214375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f68b3987-8155-47a3-976b-9c9827473d55 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:00.215607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f68b3987-8155-47a3-976b-9c9827473d55 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:00.224089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daa7534a-4683-459a-a12e-08ec809677e9 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:00.229073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daa7534a-4683-459a-a12e-08ec809677e9 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:00.230962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daa7534a-4683-459a-a12e-08ec809677e9 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:00.232982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daa7534a-4683-459a-a12e-08ec809677e9 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:00.236398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daa7534a-4683-459a-a12e-08ec809677e9 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:00.237043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-daa7534a-4683-459a-a12e-08ec809677e9 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:00.249833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f68b3987-8155-47a3-976b-9c9827473d55 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:00.251441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f68b3987-8155-47a3-976b-9c9827473d55 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:00.254152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f68b3987-8155-47a3-976b-9c9827473d55 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:00.257195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f68b3987-8155-47a3-976b-9c9827473d55 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:00.263241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f68b3987-8155-47a3-976b-9c9827473d55 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:00.264261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f68b3987-8155-47a3-976b-9c9827473d55 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:00.483295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f68b3987-8155-47a3-976b-9c9827473d55 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:00.497343 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f68b3987-8155-47a3-976b-9c9827473d55 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1271 microversion: 2.1 time: 0.306182 Aug 09 14:33:00.511783 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 307/663] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:00 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:00.513602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-4646f377-7b56-4627-8ba8-a739b0505eff req-e676ccfa-a7d8-4be0-a118-c17ae43dd5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce", "name": "network-vif-deleted", "tag": "ada039c2-0eea-454b-9ce1-6f801863f373"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:00.523376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4646f377-7b56-4627-8ba8-a739b0505eff req-e676ccfa-a7d8-4be0-a118-c17ae43dd5b2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:00.523859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4646f377-7b56-4627-8ba8-a739b0505eff req-e676ccfa-a7d8-4be0-a118-c17ae43dd5b2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:00.524285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4646f377-7b56-4627-8ba8-a739b0505eff req-e676ccfa-a7d8-4be0-a118-c17ae43dd5b2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:00.536915 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-4646f377-7b56-4627-8ba8-a739b0505eff req-e676ccfa-a7d8-4be0-a118-c17ae43dd5b2 service nova] Creating event network-vif-deleted:ada039c2-0eea-454b-9ce1-6f801863f373 for instance 8ff6910f-dbe7-4aea-ba56-9a889f4ad3ce on n-h1-844626-8 Aug 09 14:33:00.542102 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-4646f377-7b56-4627-8ba8-a739b0505eff req-e676ccfa-a7d8-4be0-a118-c17ae43dd5b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033468 Aug 09 14:33:00.543023 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 308/664] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:00.607495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e67da505-9c89-4a86-ab07-ba76e12a0f95 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:00.609611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e67da505-9c89-4a86-ab07-ba76e12a0f95 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] [instance: 0f816689-a92c-4d67-9f00-fea73d865d5a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:00.625819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67da505-9c89-4a86-ab07-ba76e12a0f95 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:00.626656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67da505-9c89-4a86-ab07-ba76e12a0f95 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:00.628754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67da505-9c89-4a86-ab07-ba76e12a0f95 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:00.629942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67da505-9c89-4a86-ab07-ba76e12a0f95 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:00.630845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67da505-9c89-4a86-ab07-ba76e12a0f95 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:00.631873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67da505-9c89-4a86-ab07-ba76e12a0f95 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:00.647516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-daa7534a-4683-459a-a12e-08ec809677e9 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:00.655687 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-daa7534a-4683-459a-a12e-08ec809677e9 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1590 microversion: 2.1 time: 0.480310 Aug 09 14:33:00.656979 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e67da505-9c89-4a86-ab07-ba76e12a0f95 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] HTTP exception thrown: Instance 0f816689-a92c-4d67-9f00-fea73d865d5a could not be found. Aug 09 14:33:00.658750 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 357/665] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:00 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1590 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e67da505-9c89-4a86-ab07-ba76e12a0f95 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Request method failure captured: Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a HTTP/1.1 Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_e-T_pcqUfNb5DDrmHuOxBYEITM5r-mdxIqwZJgyf0XXU-24cBtKv3OQh11-Fjil7BpXc2_HJhzmLPS7C3PJ2PNjIDDa3oLeCfDm511SHjEJ3F2fcjrW3alF3C9qDp5i4z6MYbl4FIWUANPgPRDiJN_U53aIHpfykIteeuEpkNeA4 Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 5965d64145c14bf4bb3c9c56ffa8dcab Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-LiveMigrationNegativeTest-1850754955 Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:33:00.661512 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:33:00.662866 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5965d64145c14bf4bb3c9c56ffa8dcab", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5965d64145c14bf4bb3c9c56ffa8dcab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5965d64145c14bf4bb3c9c56ffa8dcab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5965d64145c14bf4bb3c9c56ffa8dcab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:00.662866 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-LiveMigrationNegativeTest-1850754955 Aug 09 14:33:00.662866 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 5965d64145c14bf4bb3c9c56ffa8dcab Aug 09 14:33:00.662866 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1850754955 Aug 09 14:33:00.662866 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-LiveMigrationNegativeTest-1850754955-project Aug 09 14:33:00.662866 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:33:00.662866 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:33:00.662866 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 36032592e1ea4a4e996689515d713ab3 Aug 09 14:33:00.662866 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-LiveMigrationNegativeTest-1850754955-project Aug 09 14:33:00.662866 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:33:00.662866 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 0f816689-a92c-4d67-9f00-fea73d865d5a could not be found. Aug 09 14:33:00.662866 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '0f816689-a92c-4d67-9f00-fea73d865d5a'} Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f816689-a92c-4d67-9f00-fea73d865d5a could not be found. Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:00.663615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f816689-a92c-4d67-9f00-fea73d865d5a could not be found. Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f816689-a92c-4d67-9f00-fea73d865d5a could not be found. Aug 09 14:33:00.664789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:00.665829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e67da505-9c89-4a86-ab07-ba76e12a0f95 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] Returning 404 to user: Instance 0f816689-a92c-4d67-9f00-fea73d865d5a could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:00.665829 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e67da505-9c89-4a86-ab07-ba76e12a0f95 tempest-LiveMigrationNegativeTest-1850754955 tempest-LiveMigrationNegativeTest-1850754955-project] 10.222.0.50 "GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a" status: 404 len: 111 microversion: 2.1 time: 0.071249 Aug 09 14:33:00.665829 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 309/666] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:00 2022] GET /compute/v2.1/servers/0f816689-a92c-4d67-9f00-fea73d865d5a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:33:00.684671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ea260904-28e2-4709-94e6-e8cffd302f75 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:00.685163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ea260904-28e2-4709-94e6-e8cffd302f75 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:00.692989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea260904-28e2-4709-94e6-e8cffd302f75 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:00.694621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea260904-28e2-4709-94e6-e8cffd302f75 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:00.695065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea260904-28e2-4709-94e6-e8cffd302f75 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:00.695811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea260904-28e2-4709-94e6-e8cffd302f75 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:00.699044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea260904-28e2-4709-94e6-e8cffd302f75 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:00.699817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea260904-28e2-4709-94e6-e8cffd302f75 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:00.922717 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ea260904-28e2-4709-94e6-e8cffd302f75 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.241954 Aug 09 14:33:00.924354 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 358/667] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:33:00 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576/os-interface => generated 285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:01.105360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8fcbcee5-a5ce-4d94-882d-f9cb2a3d671a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:01.105981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8fcbcee5-a5ce-4d94-882d-f9cb2a3d671a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:01.112214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fcbcee5-a5ce-4d94-882d-f9cb2a3d671a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:01.117974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fcbcee5-a5ce-4d94-882d-f9cb2a3d671a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:01.122678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fcbcee5-a5ce-4d94-882d-f9cb2a3d671a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:01.124147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fcbcee5-a5ce-4d94-882d-f9cb2a3d671a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:01.124961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fcbcee5-a5ce-4d94-882d-f9cb2a3d671a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:01.125387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fcbcee5-a5ce-4d94-882d-f9cb2a3d671a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:01.216157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-723d5da7-c3dd-4942-ae77-bc60cfead4ac tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:01.219592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-723d5da7-c3dd-4942-ae77-bc60cfead4ac tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:01.228183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-723d5da7-c3dd-4942-ae77-bc60cfead4ac tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:01.230656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-723d5da7-c3dd-4942-ae77-bc60cfead4ac tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:01.231486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-723d5da7-c3dd-4942-ae77-bc60cfead4ac tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:01.232407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-723d5da7-c3dd-4942-ae77-bc60cfead4ac tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:01.233049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-723d5da7-c3dd-4942-ae77-bc60cfead4ac tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:01.233691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-723d5da7-c3dd-4942-ae77-bc60cfead4ac tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:01.882043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8fcbcee5-a5ce-4d94-882d-f9cb2a3d671a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:01.893262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8fcbcee5-a5ce-4d94-882d-f9cb2a3d671a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:01.896759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8fcbcee5-a5ce-4d94-882d-f9cb2a3d671a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:01.899518 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8fcbcee5-a5ce-4d94-882d-f9cb2a3d671a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1568 microversion: 2.25 time: 0.797314 Aug 09 14:33:01.901790 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 310/668] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:01 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1568 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:01.909217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9350ff7-a6d0-4abb-8a09-4f03c3bf19f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:01.909978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9350ff7-a6d0-4abb-8a09-4f03c3bf19f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:01.921545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9350ff7-a6d0-4abb-8a09-4f03c3bf19f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:01.922941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9350ff7-a6d0-4abb-8a09-4f03c3bf19f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:01.924056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9350ff7-a6d0-4abb-8a09-4f03c3bf19f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:01.925246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9350ff7-a6d0-4abb-8a09-4f03c3bf19f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:01.928878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9350ff7-a6d0-4abb-8a09-4f03c3bf19f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:01.929622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9350ff7-a6d0-4abb-8a09-4f03c3bf19f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:02.011460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-723d5da7-c3dd-4942-ae77-bc60cfead4ac tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:02.026606 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-723d5da7-c3dd-4942-ae77-bc60cfead4ac tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 0.816348 Aug 09 14:33:02.042373 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 359/669] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:01 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:02.759795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9350ff7-a6d0-4abb-8a09-4f03c3bf19f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:02.774405 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9350ff7-a6d0-4abb-8a09-4f03c3bf19f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1313 microversion: 2.1 time: 0.871309 Aug 09 14:33:02.777740 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 311/670] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:01 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1313 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:02.930644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c998eba3-2047-4cf0-be35-6b11716ec1fb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:02.931785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c998eba3-2047-4cf0-be35-6b11716ec1fb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:02.943789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c998eba3-2047-4cf0-be35-6b11716ec1fb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:02.946629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c998eba3-2047-4cf0-be35-6b11716ec1fb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:02.948700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c998eba3-2047-4cf0-be35-6b11716ec1fb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:02.949822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c998eba3-2047-4cf0-be35-6b11716ec1fb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:02.951633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c998eba3-2047-4cf0-be35-6b11716ec1fb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:02.952730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c998eba3-2047-4cf0-be35-6b11716ec1fb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:03.059352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e22f5d41-7dd8-4b0f-86f4-aa3c63f9c16d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:03.065284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e22f5d41-7dd8-4b0f-86f4-aa3c63f9c16d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:03.089351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e22f5d41-7dd8-4b0f-86f4-aa3c63f9c16d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:03.089960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e22f5d41-7dd8-4b0f-86f4-aa3c63f9c16d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:03.090581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e22f5d41-7dd8-4b0f-86f4-aa3c63f9c16d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:03.093832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e22f5d41-7dd8-4b0f-86f4-aa3c63f9c16d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:03.094696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e22f5d41-7dd8-4b0f-86f4-aa3c63f9c16d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:03.095613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e22f5d41-7dd8-4b0f-86f4-aa3c63f9c16d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:03.897074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c998eba3-2047-4cf0-be35-6b11716ec1fb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:03.910326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c998eba3-2047-4cf0-be35-6b11716ec1fb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:03.912366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c998eba3-2047-4cf0-be35-6b11716ec1fb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:03.914376 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c998eba3-2047-4cf0-be35-6b11716ec1fb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1568 microversion: 2.25 time: 0.989186 Aug 09 14:33:03.915475 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 360/671] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:02 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1568 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:03.920701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0925b0ab-0f00-4db7-b42e-b6b199a6cf71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:03.921587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0925b0ab-0f00-4db7-b42e-b6b199a6cf71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:03.930713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0925b0ab-0f00-4db7-b42e-b6b199a6cf71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:03.931599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0925b0ab-0f00-4db7-b42e-b6b199a6cf71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:03.932321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0925b0ab-0f00-4db7-b42e-b6b199a6cf71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:03.933436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0925b0ab-0f00-4db7-b42e-b6b199a6cf71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:03.934056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0925b0ab-0f00-4db7-b42e-b6b199a6cf71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:03.935759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0925b0ab-0f00-4db7-b42e-b6b199a6cf71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:04.157130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e22f5d41-7dd8-4b0f-86f4-aa3c63f9c16d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:04.167374 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e22f5d41-7dd8-4b0f-86f4-aa3c63f9c16d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 1.119751 Aug 09 14:33:04.179522 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 312/672] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:03 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:04.434449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0925b0ab-0f00-4db7-b42e-b6b199a6cf71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:04.450546 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0925b0ab-0f00-4db7-b42e-b6b199a6cf71 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1313 microversion: 2.1 time: 0.533783 Aug 09 14:33:04.464209 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 361/673] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:03 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:04.604480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f46a3280-ceaf-4955-854f-328b72e4dfb0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:04.605081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f46a3280-ceaf-4955-854f-328b72e4dfb0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:04.613383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f46a3280-ceaf-4955-854f-328b72e4dfb0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:04.616952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f46a3280-ceaf-4955-854f-328b72e4dfb0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:04.617392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f46a3280-ceaf-4955-854f-328b72e4dfb0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:04.618114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f46a3280-ceaf-4955-854f-328b72e4dfb0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:04.618559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f46a3280-ceaf-4955-854f-328b72e4dfb0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:04.618972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f46a3280-ceaf-4955-854f-328b72e4dfb0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:04.634601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f41baa5b-d892-4b5f-a80c-8e770680816d req-d75026d6-6600-4782-bc6e-057cb68ad942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d784e6b-2704-47cb-9cb5-225e4cace576", "tag": "b17957b8-8774-4495-a6d4-74b4c7b3ef18"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:04.650937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f41baa5b-d892-4b5f-a80c-8e770680816d req-d75026d6-6600-4782-bc6e-057cb68ad942 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:04.659827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f41baa5b-d892-4b5f-a80c-8e770680816d req-d75026d6-6600-4782-bc6e-057cb68ad942 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:04.664352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f41baa5b-d892-4b5f-a80c-8e770680816d req-d75026d6-6600-4782-bc6e-057cb68ad942 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:04.702405 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f41baa5b-d892-4b5f-a80c-8e770680816d req-d75026d6-6600-4782-bc6e-057cb68ad942 service nova] Creating event network-changed:b17957b8-8774-4495-a6d4-74b4c7b3ef18 for instance 3d784e6b-2704-47cb-9cb5-225e4cace576 on n-h2-844626-8 Aug 09 14:33:04.724315 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f41baa5b-d892-4b5f-a80c-8e770680816d req-d75026d6-6600-4782-bc6e-057cb68ad942 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093039 Aug 09 14:33:04.728317 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 362/674] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:04.938629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-26b4538e-99e8-4eb3-aa74-fd7d47b76122 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:04.939532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-26b4538e-99e8-4eb3-aa74-fd7d47b76122 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:04.957588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26b4538e-99e8-4eb3-aa74-fd7d47b76122 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:04.960765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26b4538e-99e8-4eb3-aa74-fd7d47b76122 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:04.961464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26b4538e-99e8-4eb3-aa74-fd7d47b76122 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:04.962362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26b4538e-99e8-4eb3-aa74-fd7d47b76122 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:04.962986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26b4538e-99e8-4eb3-aa74-fd7d47b76122 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:04.966209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26b4538e-99e8-4eb3-aa74-fd7d47b76122 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:05.808241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f46a3280-ceaf-4955-854f-328b72e4dfb0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:05.821129 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f46a3280-ceaf-4955-854f-328b72e4dfb0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 200 len: 1590 microversion: 2.1 time: 1.220431 Aug 09 14:33:05.826911 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 313/675] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:04 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 1590 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:05.841963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2fca223-f461-471d-b04d-223e0420ae57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:05.843157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b2fca223-f461-471d-b04d-223e0420ae57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:05.864693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2fca223-f461-471d-b04d-223e0420ae57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:05.866482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2fca223-f461-471d-b04d-223e0420ae57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:05.868222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2fca223-f461-471d-b04d-223e0420ae57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:05.869634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2fca223-f461-471d-b04d-223e0420ae57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:05.870524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2fca223-f461-471d-b04d-223e0420ae57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:05.871321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2fca223-f461-471d-b04d-223e0420ae57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:06.145424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-26b4538e-99e8-4eb3-aa74-fd7d47b76122 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:06.167459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-26b4538e-99e8-4eb3-aa74-fd7d47b76122 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:06.171886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-26b4538e-99e8-4eb3-aa74-fd7d47b76122 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:06.174741 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-26b4538e-99e8-4eb3-aa74-fd7d47b76122 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1543 microversion: 2.25 time: 1.239212 Aug 09 14:33:06.187118 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 363/676] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:04 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1543 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:33:06.198632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5fbaaed9-aae0-400a-a20c-d6c6fccd5d5c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:06.198632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5fbaaed9-aae0-400a-a20c-d6c6fccd5d5c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:06.227026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fbaaed9-aae0-400a-a20c-d6c6fccd5d5c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:06.231297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fbaaed9-aae0-400a-a20c-d6c6fccd5d5c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:06.233040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fbaaed9-aae0-400a-a20c-d6c6fccd5d5c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:06.233798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fbaaed9-aae0-400a-a20c-d6c6fccd5d5c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:06.234259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fbaaed9-aae0-400a-a20c-d6c6fccd5d5c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:06.234716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fbaaed9-aae0-400a-a20c-d6c6fccd5d5c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:06.259514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:06.281275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:06.317099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:06.478276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2fca223-f461-471d-b04d-223e0420ae57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:06.486602 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2fca223-f461-471d-b04d-223e0420ae57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 0.657531 Aug 09 14:33:06.492094 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 314/677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:05 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:06.562572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5fbaaed9-aae0-400a-a20c-d6c6fccd5d5c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:06.571838 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5fbaaed9-aae0-400a-a20c-d6c6fccd5d5c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1313 microversion: 2.1 time: 0.391208 Aug 09 14:33:06.575800 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 364/678] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:06 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:06.596379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a77a4ea5-7815-406a-9912-c8c5bf52ba60 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '.version_select at 0x7f41de1a4700>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:06.602262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a77a4ea5-7815-406a-9912-c8c5bf52ba60 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:06.606392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a77a4ea5-7815-406a-9912-c8c5bf52ba60 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:06.606908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a77a4ea5-7815-406a-9912-c8c5bf52ba60 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:06.663982 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a77a4ea5-7815-406a-9912-c8c5bf52ba60 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1946 microversion: 2.25 time: 0.085927 Aug 09 14:33:06.667193 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 365/679] 10.222.0.50 () {60 vars in 1184 bytes} [Tue Aug 9 14:33:06 2022] GET /compute/v2.1/os-migrations => generated 1946 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:06.690510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9112e8e-88f3-4289-bf4a-09b8f31cb4c6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:06.692533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c9112e8e-88f3-4289-bf4a-09b8f31cb4c6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:06.711723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9112e8e-88f3-4289-bf4a-09b8f31cb4c6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:06.715442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9112e8e-88f3-4289-bf4a-09b8f31cb4c6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:06.720825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9112e8e-88f3-4289-bf4a-09b8f31cb4c6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:06.721873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9112e8e-88f3-4289-bf4a-09b8f31cb4c6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:06.723971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9112e8e-88f3-4289-bf4a-09b8f31cb4c6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:06.724787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9112e8e-88f3-4289-bf4a-09b8f31cb4c6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:06.996418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1910283818", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": "none"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:07.092896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:33:07.093386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:33:07.093859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:33:07.094261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:33:07.094666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:33:07.112642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:07.113674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:07.113674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:07.114330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:07.114780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:07.115225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:07.136974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-c9112e8e-88f3-4289-bf4a-09b8f31cb4c6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 0f49c755-de1e-44c2-98de-f6654c0a94a5 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:33:07.169042 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c9112e8e-88f3-4289-bf4a-09b8f31cb4c6 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 2035 microversion: 2.25 time: 0.489064 Aug 09 14:33:07.187167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Getting quotas for project c1effd2bed3d4d92ab6867ee57cc43db. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:07.187456 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 366/680] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:06 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 2035 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:07.187456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-05f3165f-bc18-479a-a2c1-402c2f483b0a req-fe59a56b-1666-443e-86b9-d438c33cad25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "319985c3-0dee-4da4-aeab-bf1d653a147f", "tag": "6313404f-b7f3-4c22-9a42-627cf07b300b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:07.187629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Getting quotas for user e28d3f302d604c86b09224da9e935603 and project c1effd2bed3d4d92ab6867ee57cc43db. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:07.219735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-05f3165f-bc18-479a-a2c1-402c2f483b0a req-fe59a56b-1666-443e-86b9-d438c33cad25 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:07.220318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-05f3165f-bc18-479a-a2c1-402c2f483b0a req-fe59a56b-1666-443e-86b9-d438c33cad25 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:07.220761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-05f3165f-bc18-479a-a2c1-402c2f483b0a req-fe59a56b-1666-443e-86b9-d438c33cad25 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:07.229113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:33:07.232593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:33:07.255992 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-05f3165f-bc18-479a-a2c1-402c2f483b0a req-fe59a56b-1666-443e-86b9-d438c33cad25 service nova] Creating event network-changed:6313404f-b7f3-4c22-9a42-627cf07b300b for instance 319985c3-0dee-4da4-aeab-bf1d653a147f on n-h2-844626-8 Aug 09 14:33:07.272129 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-05f3165f-bc18-479a-a2c1-402c2f483b0a req-fe59a56b-1666-443e-86b9-d438c33cad25 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097953 Aug 09 14:33:07.272780 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 367/681] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:07.291566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ff7a755-4aed-4f37-86e7-5334725b32ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Action: 'create', calling method: .version_select at 0x7f41de0d4e50>, body: {"keypair": {"name": "tempest-keypair-610303194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCYNEC9GQOeuVGADF4i46+xQqLWuI6g6pdbPY16wb1OVuUDqif0PMYYINkv7HU0KXhdEbzoqsMeJxJ0MkLsQQmip9eXj7cXJFQmm4cokWj0j/N65ueJXYgkJshKgLYnOaA=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:07.308453 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7946e959-ceab-4dd3-a91e-e1b284f70b17 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.812124 Aug 09 14:33:07.309636 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 315/682] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:33:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 14:33:07.336335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-1ff7a755-4aed-4f37-86e7-5334725b32ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Getting quotas for project d512f92fc41c45edbd209ab51922e5d7. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:07.336552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7e361bc9-1a7f-4b52-a4c5-b79924e650c7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:07.337286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7e361bc9-1a7f-4b52-a4c5-b79924e650c7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:07.344544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-1ff7a755-4aed-4f37-86e7-5334725b32ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Getting quotas for user 247d1747ce074adb8b1e56a459e8cd51 and project d512f92fc41c45edbd209ab51922e5d7. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:07.403012 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1ff7a755-4aed-4f37-86e7-5334725b32ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.124049 Aug 09 14:33:07.403937 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 368/683] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 9 14:33:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 14:33:07.417868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7e361bc9-1a7f-4b52-a4c5-b79924e650c7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:07.429014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7e361bc9-1a7f-4b52-a4c5-b79924e650c7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:07.433234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7e361bc9-1a7f-4b52-a4c5-b79924e650c7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:07.436353 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7e361bc9-1a7f-4b52-a4c5-b79924e650c7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299" status: 200 len: 1281 microversion: 2.47 time: 0.114133 Aug 09 14:33:07.437516 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 316/684] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:07 2022] GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299 => generated 1281 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:07.517629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eea427f9-c83a-48e5-a644-8980786f2254 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:07.518645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eea427f9-c83a-48e5-a644-8980786f2254 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:07.537479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea427f9-c83a-48e5-a644-8980786f2254 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:07.540148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea427f9-c83a-48e5-a644-8980786f2254 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:07.540594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea427f9-c83a-48e5-a644-8980786f2254 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:07.541322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea427f9-c83a-48e5-a644-8980786f2254 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:07.541778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea427f9-c83a-48e5-a644-8980786f2254 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:07.543635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eea427f9-c83a-48e5-a644-8980786f2254 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:07.714470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a93763e-7c65-4fba-ad55-bdc501d12eab tempest-NetworksTest-1757058377 tempest-NetworksTest-1757058377-project-admin] Calling method '.version_select at 0x7f41de16c430>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:07.896146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eea427f9-c83a-48e5-a644-8980786f2254 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:07.911029 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eea427f9-c83a-48e5-a644-8980786f2254 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 0.398777 Aug 09 14:33:07.912035 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 317/685] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:07 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:07.925991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1987fbca-064b-48df-a5f7-d3fb28437e76 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:07.926846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1987fbca-064b-48df-a5f7-d3fb28437e76 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:07.937873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1987fbca-064b-48df-a5f7-d3fb28437e76 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:07.941819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1987fbca-064b-48df-a5f7-d3fb28437e76 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:07.942659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1987fbca-064b-48df-a5f7-d3fb28437e76 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:07.947529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1987fbca-064b-48df-a5f7-d3fb28437e76 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:07.947529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1987fbca-064b-48df-a5f7-d3fb28437e76 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:07.947529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1987fbca-064b-48df-a5f7-d3fb28437e76 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:08.041916 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a93763e-7c65-4fba-ad55-bdc501d12eab tempest-NetworksTest-1757058377 tempest-NetworksTest-1757058377-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks" status: 200 len: 7447 microversion: 2.1 time: 0.609002 Aug 09 14:33:08.046375 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 369/686] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:33:07 2022] GET /compute/v2.1/os-networks => generated 7447 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:08.050970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-debf08dc-3b9c-44b1-bb4d-3a6a097bd9cc tempest-NetworksTest-1757058377 tempest-NetworksTest-1757058377-project-admin] Calling method '.version_select at 0x7f41de113280>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:08.414385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1987fbca-064b-48df-a5f7-d3fb28437e76 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:08.422720 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1987fbca-064b-48df-a5f7-d3fb28437e76 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1313 microversion: 2.1 time: 0.509437 Aug 09 14:33:08.428175 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 318/687] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:07 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1313 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:08.435352 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-debf08dc-3b9c-44b1-bb4d-3a6a097bd9cc tempest-NetworksTest-1757058377 tempest-NetworksTest-1757058377-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks/29ae9fc7-b9a1-496b-a8e8-bbaf101db756" status: 200 len: 652 microversion: 2.1 time: 0.387852 Aug 09 14:33:08.436524 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 370/688] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:33:08 2022] GET /compute/v2.1/os-networks/29ae9fc7-b9a1-496b-a8e8-bbaf101db756 => generated 652 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:33:08.445511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eaeb27c2-f19d-494d-85f8-e27753a59ca3 tempest-NetworksTest-1757058377 tempest-NetworksTest-1757058377-project-admin] Calling method '.version_select at 0x7f41de3c79d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:08.468027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-636a1b68-3683-4f39-9d1c-9d82264f4b94 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:08.469275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-636a1b68-3683-4f39-9d1c-9d82264f4b94 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:08.489456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-636a1b68-3683-4f39-9d1c-9d82264f4b94 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:08.490249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-636a1b68-3683-4f39-9d1c-9d82264f4b94 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:08.492343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-636a1b68-3683-4f39-9d1c-9d82264f4b94 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:08.494867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-636a1b68-3683-4f39-9d1c-9d82264f4b94 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:08.496272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-636a1b68-3683-4f39-9d1c-9d82264f4b94 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:08.497605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-636a1b68-3683-4f39-9d1c-9d82264f4b94 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:08.774691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-636a1b68-3683-4f39-9d1c-9d82264f4b94 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:08.782718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-636a1b68-3683-4f39-9d1c-9d82264f4b94 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:08.785816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-636a1b68-3683-4f39-9d1c-9d82264f4b94 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:08.785816 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-636a1b68-3683-4f39-9d1c-9d82264f4b94 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299" status: 200 len: 1333 microversion: 2.47 time: 0.325728 Aug 09 14:33:08.787035 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 371/689] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:08 2022] GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299 => generated 1333 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:08.846229 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eaeb27c2-f19d-494d-85f8-e27753a59ca3 tempest-NetworksTest-1757058377 tempest-NetworksTest-1757058377-project-admin] 10.222.0.50 "GET /compute/v2.1/os-networks" status: 200 len: 7447 microversion: 2.1 time: 0.404327 Aug 09 14:33:08.848408 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 319/690] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:33:08 2022] GET /compute/v2.1/os-networks => generated 7447 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:08.941881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7caeb8fb-5e05-4f89-abb9-dd0a7b63d303 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:08.942570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7caeb8fb-5e05-4f89-abb9-dd0a7b63d303 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:08.958408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7caeb8fb-5e05-4f89-abb9-dd0a7b63d303 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:08.964257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7caeb8fb-5e05-4f89-abb9-dd0a7b63d303 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:08.964716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7caeb8fb-5e05-4f89-abb9-dd0a7b63d303 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:08.967027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7caeb8fb-5e05-4f89-abb9-dd0a7b63d303 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:08.969134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7caeb8fb-5e05-4f89-abb9-dd0a7b63d303 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:08.969601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7caeb8fb-5e05-4f89-abb9-dd0a7b63d303 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:09.217600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-dcfd3f13-17d5-464a-8980-c5ff76dea2fb req-a9be25f8-fa25-4f2b-8ba2-4fa83f02c5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca42dbb-ca4a-4f81-ac33-6d850cd01322", "name": "network-vif-unplugged", "status": "completed", "tag": "9a9dcfd1-2560-4f1f-9b95-a81d267cb98d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:09.244490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dcfd3f13-17d5-464a-8980-c5ff76dea2fb req-a9be25f8-fa25-4f2b-8ba2-4fa83f02c5f0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:09.245229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dcfd3f13-17d5-464a-8980-c5ff76dea2fb req-a9be25f8-fa25-4f2b-8ba2-4fa83f02c5f0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:09.245829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dcfd3f13-17d5-464a-8980-c5ff76dea2fb req-a9be25f8-fa25-4f2b-8ba2-4fa83f02c5f0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:09.273382 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-dcfd3f13-17d5-464a-8980-c5ff76dea2fb req-a9be25f8-fa25-4f2b-8ba2-4fa83f02c5f0 service nova] Creating event network-vif-unplugged:9a9dcfd1-2560-4f1f-9b95-a81d267cb98d for instance 4ca42dbb-ca4a-4f81-ac33-6d850cd01322 on n-h1-844626-8 Aug 09 14:33:09.282244 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-dcfd3f13-17d5-464a-8980-c5ff76dea2fb req-a9be25f8-fa25-4f2b-8ba2-4fa83f02c5f0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071868 Aug 09 14:33:09.283150 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 320/691] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:33:09.449818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c51a899-62eb-4a72-9afd-bd9cf9c51ea5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:09.450659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c51a899-62eb-4a72-9afd-bd9cf9c51ea5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:09.465541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c51a899-62eb-4a72-9afd-bd9cf9c51ea5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:09.466176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c51a899-62eb-4a72-9afd-bd9cf9c51ea5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:09.466619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c51a899-62eb-4a72-9afd-bd9cf9c51ea5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:09.467496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c51a899-62eb-4a72-9afd-bd9cf9c51ea5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:09.467946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c51a899-62eb-4a72-9afd-bd9cf9c51ea5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:09.468367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c51a899-62eb-4a72-9afd-bd9cf9c51ea5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:09.730691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7caeb8fb-5e05-4f89-abb9-dd0a7b63d303 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:09.742097 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7caeb8fb-5e05-4f89-abb9-dd0a7b63d303 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 0.811211 Aug 09 14:33:09.742432 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 372/692] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:08 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:09.811303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cd856513-31d5-4f83-87c5-77b871a2c2a2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:09.812333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cd856513-31d5-4f83-87c5-77b871a2c2a2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:09.819577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd856513-31d5-4f83-87c5-77b871a2c2a2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:09.820358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd856513-31d5-4f83-87c5-77b871a2c2a2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:09.820939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd856513-31d5-4f83-87c5-77b871a2c2a2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:09.821821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd856513-31d5-4f83-87c5-77b871a2c2a2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:09.822420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd856513-31d5-4f83-87c5-77b871a2c2a2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:09.823008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd856513-31d5-4f83-87c5-77b871a2c2a2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:10.150170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cd856513-31d5-4f83-87c5-77b871a2c2a2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:10.168773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cd856513-31d5-4f83-87c5-77b871a2c2a2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:10.179273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cd856513-31d5-4f83-87c5-77b871a2c2a2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:10.184651 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cd856513-31d5-4f83-87c5-77b871a2c2a2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299" status: 200 len: 1339 microversion: 2.47 time: 0.377563 Aug 09 14:33:10.188934 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 373/693] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:09 2022] GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299 => generated 1339 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:33:10.276854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c51a899-62eb-4a72-9afd-bd9cf9c51ea5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:10.284352 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c51a899-62eb-4a72-9afd-bd9cf9c51ea5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1313 microversion: 2.1 time: 0.840065 Aug 09 14:33:10.295066 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 321/694] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:09 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1313 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:10.762737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef5f9c79-a5d8-4a4c-8d62-dc465466018d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:10.765309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef5f9c79-a5d8-4a4c-8d62-dc465466018d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:10.772905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef5f9c79-a5d8-4a4c-8d62-dc465466018d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:10.773663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef5f9c79-a5d8-4a4c-8d62-dc465466018d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:10.786198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef5f9c79-a5d8-4a4c-8d62-dc465466018d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:10.792958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef5f9c79-a5d8-4a4c-8d62-dc465466018d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:10.799100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef5f9c79-a5d8-4a4c-8d62-dc465466018d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:10.800777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef5f9c79-a5d8-4a4c-8d62-dc465466018d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:11.153868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef5f9c79-a5d8-4a4c-8d62-dc465466018d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:11.174243 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef5f9c79-a5d8-4a4c-8d62-dc465466018d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 0.413591 Aug 09 14:33:11.177198 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 374/695] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:10 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:11.213840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-686f7a96-5959-42bc-b77a-82e1dc26e1cc tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:11.214990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-686f7a96-5959-42bc-b77a-82e1dc26e1cc tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:11.229632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686f7a96-5959-42bc-b77a-82e1dc26e1cc tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:11.231510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686f7a96-5959-42bc-b77a-82e1dc26e1cc tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:11.232930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686f7a96-5959-42bc-b77a-82e1dc26e1cc tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:11.235387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686f7a96-5959-42bc-b77a-82e1dc26e1cc tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:11.236041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686f7a96-5959-42bc-b77a-82e1dc26e1cc tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:11.237381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686f7a96-5959-42bc-b77a-82e1dc26e1cc tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:11.314070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b765c65-c1bd-4829-8a7d-a2a626431463 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:11.314867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b765c65-c1bd-4829-8a7d-a2a626431463 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:11.326483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b765c65-c1bd-4829-8a7d-a2a626431463 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:11.328517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b765c65-c1bd-4829-8a7d-a2a626431463 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:11.329303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b765c65-c1bd-4829-8a7d-a2a626431463 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:11.330517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b765c65-c1bd-4829-8a7d-a2a626431463 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:11.333600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b765c65-c1bd-4829-8a7d-a2a626431463 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:11.334161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b765c65-c1bd-4829-8a7d-a2a626431463 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:11.553825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-686f7a96-5959-42bc-b77a-82e1dc26e1cc tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:11.576373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-686f7a96-5959-42bc-b77a-82e1dc26e1cc tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:11.577981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-686f7a96-5959-42bc-b77a-82e1dc26e1cc tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:11.579393 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-686f7a96-5959-42bc-b77a-82e1dc26e1cc tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299" status: 200 len: 1339 microversion: 2.47 time: 0.369490 Aug 09 14:33:11.580067 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 322/696] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:11 2022] GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299 => generated 1339 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:11.584610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-61839d5b-4d31-4b13-9e54-58ba37b2089a req-dd66859a-3722-4dd6-bf32-98ccf1dd95b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca42dbb-ca4a-4f81-ac33-6d850cd01322", "tag": "9a9dcfd1-2560-4f1f-9b95-a81d267cb98d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:11.601141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-61839d5b-4d31-4b13-9e54-58ba37b2089a req-dd66859a-3722-4dd6-bf32-98ccf1dd95b1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:11.601606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-61839d5b-4d31-4b13-9e54-58ba37b2089a req-dd66859a-3722-4dd6-bf32-98ccf1dd95b1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:11.609659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-61839d5b-4d31-4b13-9e54-58ba37b2089a req-dd66859a-3722-4dd6-bf32-98ccf1dd95b1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:11.631431 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-61839d5b-4d31-4b13-9e54-58ba37b2089a req-dd66859a-3722-4dd6-bf32-98ccf1dd95b1 service nova] Creating event network-changed:9a9dcfd1-2560-4f1f-9b95-a81d267cb98d for instance 4ca42dbb-ca4a-4f81-ac33-6d850cd01322 on n-h1-844626-8 Aug 09 14:33:11.637310 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-61839d5b-4d31-4b13-9e54-58ba37b2089a req-dd66859a-3722-4dd6-bf32-98ccf1dd95b1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056138 Aug 09 14:33:11.638844 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 323/697] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:11.811324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2b765c65-c1bd-4829-8a7d-a2a626431463 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:11.821841 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b765c65-c1bd-4829-8a7d-a2a626431463 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1313 microversion: 2.1 time: 0.518680 Aug 09 14:33:11.822845 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 375/698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:11 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1313 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:12.202756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eb016326-7f0a-4d26-a984-93c4ebd5a941 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:12.204187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eb016326-7f0a-4d26-a984-93c4ebd5a941 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:12.218896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb016326-7f0a-4d26-a984-93c4ebd5a941 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:12.223321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb016326-7f0a-4d26-a984-93c4ebd5a941 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:12.224396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb016326-7f0a-4d26-a984-93c4ebd5a941 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:12.239792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb016326-7f0a-4d26-a984-93c4ebd5a941 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:12.240791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb016326-7f0a-4d26-a984-93c4ebd5a941 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:12.244012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb016326-7f0a-4d26-a984-93c4ebd5a941 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:12.255713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1160696403", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "3fec08e6-958d-4908-98b5-60037a88730d"}], "security_groups": [{"name": "tempest-securitygroup--616667161"}], "key_name": "tempest-keypair-610303194", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:12.617937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] validate_networks() for [('3fec08e6-958d-4908-98b5-60037a88730d', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:33:12.728678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eb016326-7f0a-4d26-a984-93c4ebd5a941 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:12.760326 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eb016326-7f0a-4d26-a984-93c4ebd5a941 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 0.563069 Aug 09 14:33:12.777851 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 324/699] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:12 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:12.803927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30cb0616-a2f3-4881-8ed6-9f5af28cf452 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:12.815904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30cb0616-a2f3-4881-8ed6-9f5af28cf452 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:12.840996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30cb0616-a2f3-4881-8ed6-9f5af28cf452 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:12.842808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30cb0616-a2f3-4881-8ed6-9f5af28cf452 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:12.844660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30cb0616-a2f3-4881-8ed6-9f5af28cf452 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:12.848037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30cb0616-a2f3-4881-8ed6-9f5af28cf452 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:12.848765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30cb0616-a2f3-4881-8ed6-9f5af28cf452 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:12.850735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30cb0616-a2f3-4881-8ed6-9f5af28cf452 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:13.051408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30cb0616-a2f3-4881-8ed6-9f5af28cf452 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:13.069092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30cb0616-a2f3-4881-8ed6-9f5af28cf452 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:13.070740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30cb0616-a2f3-4881-8ed6-9f5af28cf452 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:13.074255 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30cb0616-a2f3-4881-8ed6-9f5af28cf452 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299" status: 200 len: 1360 microversion: 2.47 time: 0.294969 Aug 09 14:33:13.075393 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 325/700] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:12 2022] GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299 => generated 1360 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:13.081022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d980b07b-5b20-4fa8-ad41-a3068730331e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:13.081853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d980b07b-5b20-4fa8-ad41-a3068730331e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:13.088767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d980b07b-5b20-4fa8-ad41-a3068730331e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:13.089530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d980b07b-5b20-4fa8-ad41-a3068730331e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:13.090161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d980b07b-5b20-4fa8-ad41-a3068730331e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:13.091107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d980b07b-5b20-4fa8-ad41-a3068730331e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:13.091752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d980b07b-5b20-4fa8-ad41-a3068730331e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:13.092504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d980b07b-5b20-4fa8-ad41-a3068730331e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:13.464277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d980b07b-5b20-4fa8-ad41-a3068730331e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:13.481110 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d980b07b-5b20-4fa8-ad41-a3068730331e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1313 microversion: 2.1 time: 0.403888 Aug 09 14:33:13.482195 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 326/701] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:13 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:13.488076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a5c2c4d8-201b-4f30-8a07-a0bff6b8e1c2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1990935603"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:13.492884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a5c2c4d8-201b-4f30-8a07-a0bff6b8e1c2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:13.503571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5c2c4d8-201b-4f30-8a07-a0bff6b8e1c2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:13.504995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5c2c4d8-201b-4f30-8a07-a0bff6b8e1c2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:13.506242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5c2c4d8-201b-4f30-8a07-a0bff6b8e1c2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:13.507936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5c2c4d8-201b-4f30-8a07-a0bff6b8e1c2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:13.509366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5c2c4d8-201b-4f30-8a07-a0bff6b8e1c2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:13.510622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5c2c4d8-201b-4f30-8a07-a0bff6b8e1c2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:13.544629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:33:13.545097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:33:13.545615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:33:13.546107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:33:13.546605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:33:13.568008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:13.568500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:13.569512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:13.569921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:13.570502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:13.571000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:13.608822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Getting quotas for project d512f92fc41c45edbd209ab51922e5d7. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:13.632306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:13.638126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Getting quotas for user 247d1747ce074adb8b1e56a459e8cd51 and project d512f92fc41c45edbd209ab51922e5d7. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:13.674366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:33:13.677622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:33:13.761501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:13.779224 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8afcfa2a-1356-4a99-8980-aac7cca163b5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.530382 Aug 09 14:33:13.792721 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 376/702] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:33:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 09 14:33:13.801523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c72c15e2-b84a-4f1a-8cdc-e3e4e29a4731 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:13.804671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c72c15e2-b84a-4f1a-8cdc-e3e4e29a4731 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:13.813451 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a5c2c4d8-201b-4f30-8a07-a0bff6b8e1c2 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "POST /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299/action" status: 202 len: 52 microversion: 2.47 time: 0.329714 Aug 09 14:33:13.817577 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 327/703] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:33:13 2022] POST /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299/action => generated 52 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 09 14:33:13.818641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c72c15e2-b84a-4f1a-8cdc-e3e4e29a4731 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:13.819800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c72c15e2-b84a-4f1a-8cdc-e3e4e29a4731 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:13.820437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c72c15e2-b84a-4f1a-8cdc-e3e4e29a4731 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:13.821342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c72c15e2-b84a-4f1a-8cdc-e3e4e29a4731 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:13.822004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c72c15e2-b84a-4f1a-8cdc-e3e4e29a4731 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:13.822920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c72c15e2-b84a-4f1a-8cdc-e3e4e29a4731 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:13.829103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28c6aaa4-2204-4ae3-8244-89f8002e6565 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:13.829814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28c6aaa4-2204-4ae3-8244-89f8002e6565 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:13.969461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-28c6aaa4-2204-4ae3-8244-89f8002e6565 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:13.980377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-28c6aaa4-2204-4ae3-8244-89f8002e6565 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:13.981955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-28c6aaa4-2204-4ae3-8244-89f8002e6565 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:13.983027 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28c6aaa4-2204-4ae3-8244-89f8002e6565 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1285 microversion: 2.25 time: 0.164463 Aug 09 14:33:13.990743 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 328/704] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:13 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:14.012066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df732231-4583-45ec-8d08-7f4e0a9763c1 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:14.012575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df732231-4583-45ec-8d08-7f4e0a9763c1 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:14.053469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:14.055606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df732231-4583-45ec-8d08-7f4e0a9763c1 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:14.055606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df732231-4583-45ec-8d08-7f4e0a9763c1 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:14.065156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df732231-4583-45ec-8d08-7f4e0a9763c1 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:14.066725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df732231-4583-45ec-8d08-7f4e0a9763c1 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:14.066725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df732231-4583-45ec-8d08-7f4e0a9763c1 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:14.067132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df732231-4583-45ec-8d08-7f4e0a9763c1 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:14.216996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df732231-4583-45ec-8d08-7f4e0a9763c1 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:33:14.363510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c72c15e2-b84a-4f1a-8cdc-e3e4e29a4731 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:14.378477 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c72c15e2-b84a-4f1a-8cdc-e3e4e29a4731 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 0.583987 Aug 09 14:33:14.380801 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 377/705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:13 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:14.469358 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df732231-4583-45ec-8d08-7f4e0a9763c1 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "DELETE /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299" status: 204 len: 0 microversion: 2.47 time: 0.476500 Aug 09 14:33:14.469970 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 329/706] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:33:13 2022] DELETE /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:33:14.485554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0e7d77d6-f140-4692-a465-f8b73e657750 req-7baf19d1-4fa0-4bfa-a6fa-c396662f28d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319985c3-0dee-4da4-aeab-bf1d653a147f", "name": "network-vif-plugged", "status": "completed", "tag": "6313404f-b7f3-4c22-9a42-627cf07b300b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:14.516211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0e7d77d6-f140-4692-a465-f8b73e657750 req-7baf19d1-4fa0-4bfa-a6fa-c396662f28d1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:14.517893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0e7d77d6-f140-4692-a465-f8b73e657750 req-7baf19d1-4fa0-4bfa-a6fa-c396662f28d1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:14.521007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0e7d77d6-f140-4692-a465-f8b73e657750 req-7baf19d1-4fa0-4bfa-a6fa-c396662f28d1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:14.549249 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0e7d77d6-f140-4692-a465-f8b73e657750 req-7baf19d1-4fa0-4bfa-a6fa-c396662f28d1 service nova] Creating event network-vif-plugged:6313404f-b7f3-4c22-9a42-627cf07b300b for instance 319985c3-0dee-4da4-aeab-bf1d653a147f on n-h2-844626-8 Aug 09 14:33:14.563040 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0e7d77d6-f140-4692-a465-f8b73e657750 req-7baf19d1-4fa0-4bfa-a6fa-c396662f28d1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091120 Aug 09 14:33:14.571630 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 330/707] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:14.578264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6213155e-91ee-468e-93e0-b4a9f29d1b5d tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:14.578966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6213155e-91ee-468e-93e0-b4a9f29d1b5d tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:14.598490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6213155e-91ee-468e-93e0-b4a9f29d1b5d tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:14.598931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6213155e-91ee-468e-93e0-b4a9f29d1b5d tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:14.599442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6213155e-91ee-468e-93e0-b4a9f29d1b5d tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:14.602918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6213155e-91ee-468e-93e0-b4a9f29d1b5d tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:14.603463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6213155e-91ee-468e-93e0-b4a9f29d1b5d tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:14.603903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6213155e-91ee-468e-93e0-b4a9f29d1b5d tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:14.750508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6213155e-91ee-468e-93e0-b4a9f29d1b5d tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:14.766538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6213155e-91ee-468e-93e0-b4a9f29d1b5d tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:14.771002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6213155e-91ee-468e-93e0-b4a9f29d1b5d tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:14.773526 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6213155e-91ee-468e-93e0-b4a9f29d1b5d tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299" status: 200 len: 1366 microversion: 2.47 time: 0.200652 Aug 09 14:33:14.805238 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 331/708] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:14 2022] GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:14.816010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f87aeb3a-5287-4168-bc47-78cc4a988bf7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:14.817117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f87aeb3a-5287-4168-bc47-78cc4a988bf7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:14.828474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f87aeb3a-5287-4168-bc47-78cc4a988bf7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:14.831179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f87aeb3a-5287-4168-bc47-78cc4a988bf7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:14.831788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f87aeb3a-5287-4168-bc47-78cc4a988bf7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:14.832848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f87aeb3a-5287-4168-bc47-78cc4a988bf7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:14.833527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f87aeb3a-5287-4168-bc47-78cc4a988bf7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:14.834096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f87aeb3a-5287-4168-bc47-78cc4a988bf7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:15.040596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f87aeb3a-5287-4168-bc47-78cc4a988bf7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:15.051166 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f87aeb3a-5287-4168-bc47-78cc4a988bf7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1313 microversion: 2.1 time: 0.243360 Aug 09 14:33:15.063180 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 332/709] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:14 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:15.063180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14587a18-0dcf-404b-badd-bf91b27c2df6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:15.063180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14587a18-0dcf-404b-badd-bf91b27c2df6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:15.072884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14587a18-0dcf-404b-badd-bf91b27c2df6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:15.075124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14587a18-0dcf-404b-badd-bf91b27c2df6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:15.077312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14587a18-0dcf-404b-badd-bf91b27c2df6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:15.079051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14587a18-0dcf-404b-badd-bf91b27c2df6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:15.079542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14587a18-0dcf-404b-badd-bf91b27c2df6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:15.079973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14587a18-0dcf-404b-badd-bf91b27c2df6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:15.130811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-652071045", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "0ea1a37f-cd51-4aeb-addf-5c6fbaf11c17"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:15.200699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14587a18-0dcf-404b-badd-bf91b27c2df6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:15.213066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] validate_networks() for [('0ea1a37f-cd51-4aeb-addf-5c6fbaf11c17', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:33:15.213198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14587a18-0dcf-404b-badd-bf91b27c2df6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:15.217037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14587a18-0dcf-404b-badd-bf91b27c2df6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:15.237777 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14587a18-0dcf-404b-badd-bf91b27c2df6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1281 microversion: 2.25 time: 0.165197 Aug 09 14:33:15.238535 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 333/710] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:15 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1281 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:15.402669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-90113ccb-6c3f-4074-8cb8-16a876203744 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:15.403526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-90113ccb-6c3f-4074-8cb8-16a876203744 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:15.412075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90113ccb-6c3f-4074-8cb8-16a876203744 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:15.413060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90113ccb-6c3f-4074-8cb8-16a876203744 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:15.413643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90113ccb-6c3f-4074-8cb8-16a876203744 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:15.414673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90113ccb-6c3f-4074-8cb8-16a876203744 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:15.415302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90113ccb-6c3f-4074-8cb8-16a876203744 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:15.416306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90113ccb-6c3f-4074-8cb8-16a876203744 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:15.670236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-90113ccb-6c3f-4074-8cb8-16a876203744 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:15.696380 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-90113ccb-6c3f-4074-8cb8-16a876203744 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 0.298661 Aug 09 14:33:15.696960 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 334/711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:15 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:15.719565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:33:15.720255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:33:15.722659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:33:15.723502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:33:15.724655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:33:15.738656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:15.739348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:15.739925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:15.740635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:15.741075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:15.741764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:15.760678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Getting quotas for project ad30eb2eb9e94c2a8b7490f1e46a93d6. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:15.765194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Getting quotas for user 538f392147114c069a8a5d1175f8c46e and project ad30eb2eb9e94c2a8b7490f1e46a93d6. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:15.779582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:33:15.782318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:33:15.842076 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c6984cd3-b015-4722-a04b-7333fd2ec1fe tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.457753 Aug 09 14:33:15.843264 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 378/712] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:33:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:33:15.848274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0328d7cc-6fa9-465c-a56c-38d8607e49f7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:15.849076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0328d7cc-6fa9-465c-a56c-38d8607e49f7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:15.855717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0328d7cc-6fa9-465c-a56c-38d8607e49f7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:15.856452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0328d7cc-6fa9-465c-a56c-38d8607e49f7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:15.857211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0328d7cc-6fa9-465c-a56c-38d8607e49f7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:15.858344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0328d7cc-6fa9-465c-a56c-38d8607e49f7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:15.858970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0328d7cc-6fa9-465c-a56c-38d8607e49f7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:15.859586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0328d7cc-6fa9-465c-a56c-38d8607e49f7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:15.878701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8246f527-a63a-4286-b588-29418add28ec tempest-QuotaClassesAdmin257Test-846295272 tempest-QuotaClassesAdmin257Test-846295272-project-admin] Calling method '.version_select at 0x7f41dd72f940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:15.879725 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:33:15.879725 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:33:15.905593 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8246f527-a63a-4286-b588-29418add28ec tempest-QuotaClassesAdmin257Test-846295272 tempest-QuotaClassesAdmin257Test-846295272-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.207390 Aug 09 14:33:15.907132 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 335/713] 10.222.0.50 () {60 vars in 1226 bytes} [Tue Aug 9 14:33:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:33:15.919190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37460edc-a69b-44c2-9102-a109ca71a0fd tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:15.919869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37460edc-a69b-44c2-9102-a109ca71a0fd tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:15.947407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0328d7cc-6fa9-465c-a56c-38d8607e49f7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:15.958982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0328d7cc-6fa9-465c-a56c-38d8607e49f7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:15.961788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0328d7cc-6fa9-465c-a56c-38d8607e49f7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:15.963161 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0328d7cc-6fa9-465c-a56c-38d8607e49f7 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299" status: 200 len: 1366 microversion: 2.47 time: 0.118954 Aug 09 14:33:15.964280 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 379/714] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:15 2022] GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299 => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:15.970459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7cdf721c-32f0-43bb-856d-750fd96921de tempest-QuotaClassesAdmin257Test-846295272 tempest-QuotaClassesAdmin257Test-846295272-project-admin] Action: 'update', calling method: .version_select at 0x7f41de17d670>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:15.974067 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:33:15.974067 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:33:16.006115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-37460edc-a69b-44c2-9102-a109ca71a0fd tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:16.013466 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37460edc-a69b-44c2-9102-a109ca71a0fd tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1215 microversion: 2.1 time: 0.102164 Aug 09 14:33:16.016239 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 336/715] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:15 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1215 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:16.076850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8f269b67-e94f-4695-9875-872b3129f76f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:16.077813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8f269b67-e94f-4695-9875-872b3129f76f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:16.086470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f269b67-e94f-4695-9875-872b3129f76f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:16.086958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f269b67-e94f-4695-9875-872b3129f76f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:16.087454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f269b67-e94f-4695-9875-872b3129f76f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:16.088258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f269b67-e94f-4695-9875-872b3129f76f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:16.088624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f269b67-e94f-4695-9875-872b3129f76f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:16.089350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f269b67-e94f-4695-9875-872b3129f76f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:16.290092 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7cdf721c-32f0-43bb-856d-750fd96921de tempest-QuotaClassesAdmin257Test-846295272 tempest-QuotaClassesAdmin257Test-846295272-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.324643 Aug 09 14:33:16.291738 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 380/716] 10.222.0.50 () {62 vars in 1247 bytes} [Tue Aug 9 14:33:15 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:33:16.298040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0e938ad-bd6d-4165-a38b-3f8ebc1665fa tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:16.299185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0e938ad-bd6d-4165-a38b-3f8ebc1665fa tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:16.403185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0e938ad-bd6d-4165-a38b-3f8ebc1665fa tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:16.406251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0e938ad-bd6d-4165-a38b-3f8ebc1665fa tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:16.411048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0e938ad-bd6d-4165-a38b-3f8ebc1665fa tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:16.413048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0e938ad-bd6d-4165-a38b-3f8ebc1665fa tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:16.415881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0e938ad-bd6d-4165-a38b-3f8ebc1665fa tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:16.416428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0e938ad-bd6d-4165-a38b-3f8ebc1665fa tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:16.420788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8f269b67-e94f-4695-9875-872b3129f76f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:16.435694 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8f269b67-e94f-4695-9875-872b3129f76f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1313 microversion: 2.1 time: 0.363362 Aug 09 14:33:16.436285 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 337/717] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:16 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:16.474459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d651b743-c4f9-47de-8e14-5d5f7cc14c9a tempest-QuotaClassesAdmin257Test-846295272 tempest-QuotaClassesAdmin257Test-846295272-project-admin] Calling method '.version_select at 0x7f41dd8124c0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:16.477185 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:33:16.477185 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:33:16.509173 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d651b743-c4f9-47de-8e14-5d5f7cc14c9a tempest-QuotaClassesAdmin257Test-846295272 tempest-QuotaClassesAdmin257Test-846295272-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.044574 Aug 09 14:33:16.513007 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 338/718] 10.222.0.50 () {60 vars in 1226 bytes} [Tue Aug 9 14:33:16 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:33:16.548666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc6eb097-5cc1-48c2-994d-fdac54f818bb tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd73b430>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:16.589890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0e938ad-bd6d-4165-a38b-3f8ebc1665fa tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:16.600303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0e938ad-bd6d-4165-a38b-3f8ebc1665fa tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:16.605341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0e938ad-bd6d-4165-a38b-3f8ebc1665fa tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:16.609168 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0e938ad-bd6d-4165-a38b-3f8ebc1665fa tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1337 microversion: 2.25 time: 0.314408 Aug 09 14:33:16.609911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 381/719] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:16 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1337 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:16.621302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57d5b378-7001-4a4a-97dd-84b5a5711517 tempest-QuotaClassesAdmin257Test-846295272 tempest-QuotaClassesAdmin257Test-846295272-project-admin] Action: 'update', calling method: .version_select at 0x7f41de301700>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:16.627765 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:33:16.627765 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:33:16.628764 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc6eb097-5cc1-48c2-994d-fdac54f818bb tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/cca40997-f9ac-4862-a31f-1d532fef0d9e" status: 200 len: 662 microversion: 2.1 time: 0.106736 Aug 09 14:33:16.630771 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 339/720] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:16 2022] GET /compute/v2.1/images/cca40997-f9ac-4862-a31f-1d532fef0d9e => generated 662 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:16.648662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06958f04-457f-447b-87b8-4aff6f551fab tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd7fce50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:16.716743 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06958f04-457f-447b-87b8-4aff6f551fab tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/cca40997-f9ac-4862-a31f-1d532fef0d9e" status: 200 len: 662 microversion: 2.1 time: 0.076479 Aug 09 14:33:16.718205 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 340/721] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:16 2022] GET /compute/v2.1/images/cca40997-f9ac-4862-a31f-1d532fef0d9e => generated 662 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:16.724031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d13eabf8-2ec0-46fe-8697-dfce5a1f48b2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:16.724671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d13eabf8-2ec0-46fe-8697-dfce5a1f48b2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:16.731774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d13eabf8-2ec0-46fe-8697-dfce5a1f48b2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:16.732307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d13eabf8-2ec0-46fe-8697-dfce5a1f48b2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:16.732754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d13eabf8-2ec0-46fe-8697-dfce5a1f48b2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:16.733501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d13eabf8-2ec0-46fe-8697-dfce5a1f48b2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:16.733950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d13eabf8-2ec0-46fe-8697-dfce5a1f48b2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:16.734375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d13eabf8-2ec0-46fe-8697-dfce5a1f48b2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:16.749533 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57d5b378-7001-4a4a-97dd-84b5a5711517 tempest-QuotaClassesAdmin257Test-846295272 tempest-QuotaClassesAdmin257Test-846295272-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.137948 Aug 09 14:33:16.750727 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 382/722] 10.222.0.50 () {62 vars in 1247 bytes} [Tue Aug 9 14:33:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:33:16.986502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9104cbbc-77f8-4ab4-ab55-05834fcd7ed8 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:16.987155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9104cbbc-77f8-4ab4-ab55-05834fcd7ed8 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:16.997466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9104cbbc-77f8-4ab4-ab55-05834fcd7ed8 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:16.997873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9104cbbc-77f8-4ab4-ab55-05834fcd7ed8 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:16.998316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9104cbbc-77f8-4ab4-ab55-05834fcd7ed8 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:16.999018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9104cbbc-77f8-4ab4-ab55-05834fcd7ed8 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:17.011820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9104cbbc-77f8-4ab4-ab55-05834fcd7ed8 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:17.012283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9104cbbc-77f8-4ab4-ab55-05834fcd7ed8 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:17.148918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:17.551732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9104cbbc-77f8-4ab4-ab55-05834fcd7ed8 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:17.588484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9104cbbc-77f8-4ab4-ab55-05834fcd7ed8 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:17.595692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9104cbbc-77f8-4ab4-ab55-05834fcd7ed8 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:17.596914 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9104cbbc-77f8-4ab4-ab55-05834fcd7ed8 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299" status: 200 len: 1366 microversion: 2.47 time: 0.614478 Aug 09 14:33:17.602707 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 383/723] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:16 2022] GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299 => generated 1366 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:17.618567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d13eabf8-2ec0-46fe-8697-dfce5a1f48b2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:17.620283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6941e228-b452-41fd-bde9-174278c063e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:17.621126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6941e228-b452-41fd-bde9-174278c063e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:17.629181 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d13eabf8-2ec0-46fe-8697-dfce5a1f48b2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 0.909781 Aug 09 14:33:17.630614 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 341/724] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:16 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:17.633455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6941e228-b452-41fd-bde9-174278c063e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:17.635694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6941e228-b452-41fd-bde9-174278c063e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:17.636153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6941e228-b452-41fd-bde9-174278c063e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:17.638264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7275db36-9e3b-4449-a761-41498d37bb90 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:17.638474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6941e228-b452-41fd-bde9-174278c063e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:17.639121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6941e228-b452-41fd-bde9-174278c063e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:17.639327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7275db36-9e3b-4449-a761-41498d37bb90 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:17.639894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6941e228-b452-41fd-bde9-174278c063e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:17.646114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7275db36-9e3b-4449-a761-41498d37bb90 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:17.646932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7275db36-9e3b-4449-a761-41498d37bb90 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:17.647790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7275db36-9e3b-4449-a761-41498d37bb90 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:17.648713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7275db36-9e3b-4449-a761-41498d37bb90 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:17.649579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7275db36-9e3b-4449-a761-41498d37bb90 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:17.650246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7275db36-9e3b-4449-a761-41498d37bb90 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:17.809976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6941e228-b452-41fd-bde9-174278c063e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:17.823904 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6941e228-b452-41fd-bde9-174278c063e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1267 microversion: 2.1 time: 0.217163 Aug 09 14:33:17.824718 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 384/725] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:17 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:17.845431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32c39618-819c-46aa-8e1c-93cf988389a2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:17.847873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-32c39618-819c-46aa-8e1c-93cf988389a2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:17.861674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32c39618-819c-46aa-8e1c-93cf988389a2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:17.865521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32c39618-819c-46aa-8e1c-93cf988389a2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:17.866095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32c39618-819c-46aa-8e1c-93cf988389a2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:17.867994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32c39618-819c-46aa-8e1c-93cf988389a2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:17.868537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32c39618-819c-46aa-8e1c-93cf988389a2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:17.873267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32c39618-819c-46aa-8e1c-93cf988389a2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:18.288822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-32c39618-819c-46aa-8e1c-93cf988389a2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:18.302379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-32c39618-819c-46aa-8e1c-93cf988389a2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:18.304226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-32c39618-819c-46aa-8e1c-93cf988389a2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:18.311120 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32c39618-819c-46aa-8e1c-93cf988389a2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1343 microversion: 2.25 time: 0.485086 Aug 09 14:33:18.312700 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 385/726] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:17 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1343 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:18.374750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7275db36-9e3b-4449-a761-41498d37bb90 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:18.400038 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7275db36-9e3b-4449-a761-41498d37bb90 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1462 microversion: 2.1 time: 0.766355 Aug 09 14:33:18.424874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:18.428599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:18.437443 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 342/727] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:17 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1462 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:18.440726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:18.445459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:18.447974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:18.450050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:18.451498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:18.453348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:18.630464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:18.632192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:18.647344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:18.647841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:18.650607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:18.651366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:18.651823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:18.652241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:18.692690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:18.717967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Old instance type m1.heat2, new instance type m1.heat {{(pid=119406) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 14:33:18.720097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:18.720586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:18.721017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:18.721466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lazy-loading 'fault' on Instance uuid 71ecaec2-a2ed-4c8f-9cae-b20fc6183299 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:33:18.738006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:33:18.746242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:33:18.747834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:33:18.750766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:33:18.752185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:33:18.995791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:18.996594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:19.011059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:19.017928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e28d3f302d604c86b09224da9e935603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1effd2bed3d4d92ab6867ee57cc43db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:19.023391 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87a8c28c-e6fe-4b9a-96e4-04438a47f3a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "POST /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f/action" status: 202 len: 0 microversion: 2.1 time: 0.603988 Aug 09 14:33:19.024685 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 386/728] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:33:18 2022] POST /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:33:19.031644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8395eeff-3812-4e18-8179-2c6111116ffc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:19.033235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8395eeff-3812-4e18-8179-2c6111116ffc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:19.034335 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf6ffe4b-e602-4e90-a96f-e319d5f00114 tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299" status: 200 len: 1371 microversion: 2.47 time: 0.408943 Aug 09 14:33:19.040285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8395eeff-3812-4e18-8179-2c6111116ffc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:19.040777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8395eeff-3812-4e18-8179-2c6111116ffc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:19.041213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8395eeff-3812-4e18-8179-2c6111116ffc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:19.041900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8395eeff-3812-4e18-8179-2c6111116ffc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:19.042338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8395eeff-3812-4e18-8179-2c6111116ffc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:19.042993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8395eeff-3812-4e18-8179-2c6111116ffc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:19.043923 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 343/729] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:18 2022] GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299 => generated 1371 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:33:19.062065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a7ea457-f3c3-452a-88be-6c316049fd16 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:19.063028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0a7ea457-f3c3-452a-88be-6c316049fd16 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:19.095616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a7ea457-f3c3-452a-88be-6c316049fd16 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:19.097276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a7ea457-f3c3-452a-88be-6c316049fd16 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:19.098573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a7ea457-f3c3-452a-88be-6c316049fd16 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:19.101969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a7ea457-f3c3-452a-88be-6c316049fd16 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:19.102453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a7ea457-f3c3-452a-88be-6c316049fd16 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:19.103065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a7ea457-f3c3-452a-88be-6c316049fd16 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:19.638496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8395eeff-3812-4e18-8179-2c6111116ffc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:19.652797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0a7ea457-f3c3-452a-88be-6c316049fd16 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:19.655900 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8395eeff-3812-4e18-8179-2c6111116ffc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1502 microversion: 2.1 time: 0.629857 Aug 09 14:33:19.669710 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 387/730] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:19 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1502 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:19.669888 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0a7ea457-f3c3-452a-88be-6c316049fd16 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1315 microversion: 2.1 time: 0.618096 Aug 09 14:33:19.669888 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 344/731] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:19 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:19.669888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1b3dfc2a-b3a2-45d1-8001-d3ec571a9a44 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:19.669888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1b3dfc2a-b3a2-45d1-8001-d3ec571a9a44 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:19.673956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4307800c-44d4-4a26-9159-efcb1f56c26c tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41de0bb820>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:19.676245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b3dfc2a-b3a2-45d1-8001-d3ec571a9a44 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:19.677373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b3dfc2a-b3a2-45d1-8001-d3ec571a9a44 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:19.678475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b3dfc2a-b3a2-45d1-8001-d3ec571a9a44 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:19.679405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b3dfc2a-b3a2-45d1-8001-d3ec571a9a44 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:19.680502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b3dfc2a-b3a2-45d1-8001-d3ec571a9a44 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:19.681162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b3dfc2a-b3a2-45d1-8001-d3ec571a9a44 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:19.752455 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4307800c-44d4-4a26-9159-efcb1f56c26c tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/cff39c94-ccdd-4b3e-9538-9f47a01755c2" status: 200 len: 662 microversion: 2.1 time: 0.094599 Aug 09 14:33:19.761611 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 388/732] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:19 2022] GET /compute/v2.1/images/cff39c94-ccdd-4b3e-9538-9f47a01755c2 => generated 662 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:19.765786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7908cc07-9e41-41e8-880f-99cdd57eadf8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:19.766402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7908cc07-9e41-41e8-880f-99cdd57eadf8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:19.774634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7908cc07-9e41-41e8-880f-99cdd57eadf8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:19.775228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7908cc07-9e41-41e8-880f-99cdd57eadf8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:19.775657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7908cc07-9e41-41e8-880f-99cdd57eadf8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:19.776533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7908cc07-9e41-41e8-880f-99cdd57eadf8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:19.777156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7908cc07-9e41-41e8-880f-99cdd57eadf8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:19.777573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7908cc07-9e41-41e8-880f-99cdd57eadf8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:19.904495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7908cc07-9e41-41e8-880f-99cdd57eadf8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:19.917084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7908cc07-9e41-41e8-880f-99cdd57eadf8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:19.919191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7908cc07-9e41-41e8-880f-99cdd57eadf8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:19.929227 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7908cc07-9e41-41e8-880f-99cdd57eadf8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1343 microversion: 2.25 time: 0.171529 Aug 09 14:33:19.930594 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 389/733] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:19 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1343 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:19.949702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-54a1c39d-73e4-43a7-8bef-a19176764d80 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41de0513a0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:20.048154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1b3dfc2a-b3a2-45d1-8001-d3ec571a9a44 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:20.065943 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-54a1c39d-73e4-43a7-8bef-a19176764d80 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/cff39c94-ccdd-4b3e-9538-9f47a01755c2" status: 200 len: 662 microversion: 2.1 time: 0.133850 Aug 09 14:33:20.068486 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1b3dfc2a-b3a2-45d1-8001-d3ec571a9a44 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1471 microversion: 2.1 time: 0.401698 Aug 09 14:33:20.082393 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 345/734] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:19 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1471 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:20.086679 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 390/735] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:19 2022] GET /compute/v2.1/images/cff39c94-ccdd-4b3e-9538-9f47a01755c2 => generated 662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:20.105978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96089adf-2ede-44bc-9830-a113be6abd0f tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:20.106682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-96089adf-2ede-44bc-9830-a113be6abd0f tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] [instance: 71ecaec2-a2ed-4c8f-9cae-b20fc6183299] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:20.124654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96089adf-2ede-44bc-9830-a113be6abd0f tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:20.125162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96089adf-2ede-44bc-9830-a113be6abd0f tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:20.125590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96089adf-2ede-44bc-9830-a113be6abd0f tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:20.126289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96089adf-2ede-44bc-9830-a113be6abd0f tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:20.129000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96089adf-2ede-44bc-9830-a113be6abd0f tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:20.129626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96089adf-2ede-44bc-9830-a113be6abd0f tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:20.161377 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-96089adf-2ede-44bc-9830-a113be6abd0f tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] HTTP exception thrown: Instance 71ecaec2-a2ed-4c8f-9cae-b20fc6183299 could not be found. Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96089adf-2ede-44bc-9830-a113be6abd0f tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Request method failure captured: Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299 HTTP/1.1 Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nAhvmBl4kfFT3bN4y5dq562IDLfsar4EIO-Xx5i38RpJtS9Gtpqmjk_LRG3tgRNwReZbFnkd9akh1HKsPIkhCB0SYCux2-uR4Q836QdPGwzHTbD7BMdl-6RGn-Kp6FNilifapGHjITlEi9T5lYwMeLkd2xZS7-FL4a_Wpk5kv8Hbno Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.47 Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: c1effd2bed3d4d92ab6867ee57cc43db Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersAaction247Test-982255216 Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:33:20.163050 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:33:20.164849 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c1effd2bed3d4d92ab6867ee57cc43db", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c1effd2bed3d4d92ab6867ee57cc43db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1effd2bed3d4d92ab6867ee57cc43db"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1effd2bed3d4d92ab6867ee57cc43db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:20.164849 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersAaction247Test-982255216 Aug 09 14:33:20.164849 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: c1effd2bed3d4d92ab6867ee57cc43db Aug 09 14:33:20.164849 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersAaction247Test-982255216 Aug 09 14:33:20.164849 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersAaction247Test-982255216-project Aug 09 14:33:20.164849 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:33:20.164849 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:33:20.164849 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e28d3f302d604c86b09224da9e935603 Aug 09 14:33:20.164849 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersAaction247Test-982255216-project Aug 09 14:33:20.164849 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:33:20.164849 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 71ecaec2-a2ed-4c8f-9cae-b20fc6183299 could not be found. Aug 09 14:33:20.164849 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '71ecaec2-a2ed-4c8f-9cae-b20fc6183299'} Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ecaec2-a2ed-4c8f-9cae-b20fc6183299 could not be found. Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:20.165630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ecaec2-a2ed-4c8f-9cae-b20fc6183299 could not be found. Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ecaec2-a2ed-4c8f-9cae-b20fc6183299 could not be found. Aug 09 14:33:20.166915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:20.171005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96089adf-2ede-44bc-9830-a113be6abd0f tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] Returning 404 to user: Instance 71ecaec2-a2ed-4c8f-9cae-b20fc6183299 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:20.171005 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-96089adf-2ede-44bc-9830-a113be6abd0f tempest-ServersAaction247Test-982255216 tempest-ServersAaction247Test-982255216-project] 10.222.0.50 "GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299" status: 404 len: 111 microversion: 2.47 time: 0.064352 Aug 09 14:33:20.171005 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 346/736] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:20 2022] GET /compute/v2.1/servers/71ecaec2-a2ed-4c8f-9cae-b20fc6183299 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:33:20.677825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fa12f7b8-181a-4593-9845-43eb277de4a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:20.678506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fa12f7b8-181a-4593-9845-43eb277de4a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:20.684079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=13,nova_api:UPDATE=14 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:20.685385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3fbf379e-3bc7-467c-b876-091f041d67a2 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:20.686626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fbf379e-3bc7-467c-b876-091f041d67a2 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:20.696351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa12f7b8-181a-4593-9845-43eb277de4a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:20.696770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa12f7b8-181a-4593-9845-43eb277de4a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:20.697526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa12f7b8-181a-4593-9845-43eb277de4a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:20.698247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa12f7b8-181a-4593-9845-43eb277de4a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:20.698696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa12f7b8-181a-4593-9845-43eb277de4a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:20.699128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa12f7b8-181a-4593-9845-43eb277de4a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:20.699986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fbf379e-3bc7-467c-b876-091f041d67a2 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:20.700479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fbf379e-3bc7-467c-b876-091f041d67a2 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:20.700912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fbf379e-3bc7-467c-b876-091f041d67a2 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:20.703878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fbf379e-3bc7-467c-b876-091f041d67a2 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:20.704364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fbf379e-3bc7-467c-b876-091f041d67a2 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:20.704796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fbf379e-3bc7-467c-b876-091f041d67a2 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:21.123375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fa12f7b8-181a-4593-9845-43eb277de4a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:21.139974 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fa12f7b8-181a-4593-9845-43eb277de4a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1492 microversion: 2.1 time: 0.465846 Aug 09 14:33:21.142069 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 391/737] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:20 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1492 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:21.151289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31b63568-fdbd-41eb-9efe-765096f8af57 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:21.152148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31b63568-fdbd-41eb-9efe-765096f8af57 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:21.163969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b63568-fdbd-41eb-9efe-765096f8af57 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:21.164821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b63568-fdbd-41eb-9efe-765096f8af57 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:21.167241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b63568-fdbd-41eb-9efe-765096f8af57 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:21.170293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b63568-fdbd-41eb-9efe-765096f8af57 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:21.172071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b63568-fdbd-41eb-9efe-765096f8af57 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:21.175940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b63568-fdbd-41eb-9efe-765096f8af57 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:21.208471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3fbf379e-3bc7-467c-b876-091f041d67a2 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:21.217725 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3fbf379e-3bc7-467c-b876-091f041d67a2 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1315 microversion: 2.1 time: 0.537577 Aug 09 14:33:21.220695 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 347/738] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:20 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:21.229799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0d66debb-a4b3-4488-aace-8369c2534e64 req-c1fbc08b-d469-4f7c-8c7a-2201da8ace41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "093134a3-712a-416c-acbe-15ea40bcfe79", "tag": "c9cee52a-c76d-4ebe-b6f5-9aa50144777b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:21.259673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0d66debb-a4b3-4488-aace-8369c2534e64 req-c1fbc08b-d469-4f7c-8c7a-2201da8ace41 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:21.260167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0d66debb-a4b3-4488-aace-8369c2534e64 req-c1fbc08b-d469-4f7c-8c7a-2201da8ace41 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:21.260579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0d66debb-a4b3-4488-aace-8369c2534e64 req-c1fbc08b-d469-4f7c-8c7a-2201da8ace41 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:21.306102 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0d66debb-a4b3-4488-aace-8369c2534e64 req-c1fbc08b-d469-4f7c-8c7a-2201da8ace41 service nova] Creating event network-changed:c9cee52a-c76d-4ebe-b6f5-9aa50144777b for instance 093134a3-712a-416c-acbe-15ea40bcfe79 on n-h1-844626-8 Aug 09 14:33:21.313855 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0d66debb-a4b3-4488-aace-8369c2534e64 req-c1fbc08b-d469-4f7c-8c7a-2201da8ace41 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091426 Aug 09 14:33:21.321739 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 348/739] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:21.333728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b91abc1e-5c88-4eab-85e9-21b3c7ad1b50 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:21.334428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b91abc1e-5c88-4eab-85e9-21b3c7ad1b50 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:21.351395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b91abc1e-5c88-4eab-85e9-21b3c7ad1b50 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:21.353061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b91abc1e-5c88-4eab-85e9-21b3c7ad1b50 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:21.353515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b91abc1e-5c88-4eab-85e9-21b3c7ad1b50 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:21.354237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b91abc1e-5c88-4eab-85e9-21b3c7ad1b50 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:21.354677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b91abc1e-5c88-4eab-85e9-21b3c7ad1b50 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:21.355211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b91abc1e-5c88-4eab-85e9-21b3c7ad1b50 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:21.694607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-31b63568-fdbd-41eb-9efe-765096f8af57 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:21.707977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-31b63568-fdbd-41eb-9efe-765096f8af57 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:21.711305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-31b63568-fdbd-41eb-9efe-765096f8af57 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:21.712712 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31b63568-fdbd-41eb-9efe-765096f8af57 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1410 microversion: 2.25 time: 0.569459 Aug 09 14:33:21.715879 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 392/740] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:21 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1410 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:21.724666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac9ae0ec-ecf7-4cef-8cb5-aed009fa2b97 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '.version_select at 0x7f41ddf3f160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:21.740779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac9ae0ec-ecf7-4cef-8cb5-aed009fa2b97 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:21.741547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac9ae0ec-ecf7-4cef-8cb5-aed009fa2b97 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:21.742146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac9ae0ec-ecf7-4cef-8cb5-aed009fa2b97 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:21.751743 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ac9ae0ec-ecf7-4cef-8cb5-aed009fa2b97 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1901 microversion: 2.1 time: 0.034396 Aug 09 14:33:21.769979 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 393/741] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:33:21 2022] GET /compute/v2.1/os-migrations => generated 1901 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:21.774656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-177668ef-123f-487d-975c-cdd9f4114d0f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:21.775296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-177668ef-123f-487d-975c-cdd9f4114d0f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:21.786579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-177668ef-123f-487d-975c-cdd9f4114d0f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:21.787068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-177668ef-123f-487d-975c-cdd9f4114d0f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:21.787531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-177668ef-123f-487d-975c-cdd9f4114d0f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:21.788226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-177668ef-123f-487d-975c-cdd9f4114d0f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:21.788826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-177668ef-123f-487d-975c-cdd9f4114d0f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:21.789394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-177668ef-123f-487d-975c-cdd9f4114d0f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:21.827903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b91abc1e-5c88-4eab-85e9-21b3c7ad1b50 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:21.838055 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b91abc1e-5c88-4eab-85e9-21b3c7ad1b50 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1471 microversion: 2.1 time: 0.512226 Aug 09 14:33:21.852087 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 349/742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:21 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1471 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:22.076801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-d7b5984f-158e-4c2c-90a4-8c30cd1e1007 req-7331211a-839f-4880-923f-148fd32d6d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd6f697-9f2e-4825-998a-796902617f44", "tag": "ee2a1cef-a2ec-4b5c-a13d-9c50e9639eb0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:22.105834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d7b5984f-158e-4c2c-90a4-8c30cd1e1007 req-7331211a-839f-4880-923f-148fd32d6d8f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:22.106663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d7b5984f-158e-4c2c-90a4-8c30cd1e1007 req-7331211a-839f-4880-923f-148fd32d6d8f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:22.108693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d7b5984f-158e-4c2c-90a4-8c30cd1e1007 req-7331211a-839f-4880-923f-148fd32d6d8f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:22.139882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:22.147199 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-177668ef-123f-487d-975c-cdd9f4114d0f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1643 microversion: 2.1 time: 0.375390 Aug 09 14:33:22.148911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 394/743] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:21 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1643 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:22.165640 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d7b5984f-158e-4c2c-90a4-8c30cd1e1007 req-7331211a-839f-4880-923f-148fd32d6d8f service nova] Creating event network-changed:ee2a1cef-a2ec-4b5c-a13d-9c50e9639eb0 for instance acd6f697-9f2e-4825-998a-796902617f44 on n-h1-844626-8 Aug 09 14:33:22.201968 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-d7b5984f-158e-4c2c-90a4-8c30cd1e1007 req-7331211a-839f-4880-923f-148fd32d6d8f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134188 Aug 09 14:33:22.207055 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 350/744] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:22.243705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2614ebc0-df09-4abb-9643-37645c948d12 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:22.245417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2614ebc0-df09-4abb-9643-37645c948d12 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:22.250247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0d4e0498-d2dd-4f96-b4ab-702f2b0b908e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd7055e0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:22.255589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2614ebc0-df09-4abb-9643-37645c948d12 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:22.256219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2614ebc0-df09-4abb-9643-37645c948d12 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:22.257572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2614ebc0-df09-4abb-9643-37645c948d12 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:22.259200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2614ebc0-df09-4abb-9643-37645c948d12 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:22.260709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2614ebc0-df09-4abb-9643-37645c948d12 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:22.264075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2614ebc0-df09-4abb-9643-37645c948d12 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:22.315639 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0d4e0498-d2dd-4f96-b4ab-702f2b0b908e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/37b93773-84ef-4e24-b8cb-16017e8918d7" status: 200 len: 660 microversion: 2.1 time: 0.070459 Aug 09 14:33:22.316217 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 351/745] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:22 2022] GET /compute/v2.1/images/37b93773-84ef-4e24-b8cb-16017e8918d7 => generated 660 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:22.339257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4ab5440-1430-447a-9958-844b512da318 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd73b8b0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:22.403544 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4ab5440-1430-447a-9958-844b512da318 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/37b93773-84ef-4e24-b8cb-16017e8918d7" status: 200 len: 660 microversion: 2.1 time: 0.073754 Aug 09 14:33:22.404122 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 352/746] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:22 2022] GET /compute/v2.1/images/37b93773-84ef-4e24-b8cb-16017e8918d7 => generated 660 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:22.514158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-65394785", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "4e9e66ac-24f5-49b8-8427-02f1b1cd91af"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:22.551249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2614ebc0-df09-4abb-9643-37645c948d12 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:22.567640 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2614ebc0-df09-4abb-9643-37645c948d12 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1315 microversion: 2.1 time: 0.325634 Aug 09 14:33:22.568750 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 395/747] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:22 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:22.616235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] validate_networks() for [('4e9e66ac-24f5-49b8-8427-02f1b1cd91af', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:33:22.648557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1624548946", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:22.729310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:33:23.074992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:33:23.075508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:33:23.076151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:33:23.076629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:33:23.077105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:33:23.092288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:23.092991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:23.093559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:23.094859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:23.095354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:23.095933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:23.125933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Getting quotas for project a9197a5676004ed888ef46000067e150. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:23.132276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Getting quotas for user 8b1fd7b4e40e49828ab24bfced256417 and project a9197a5676004ed888ef46000067e150. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:23.162575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:33:23.172705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:33:23.204072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:33:23.204553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:33:23.204951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:33:23.205574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:33:23.206186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:33:23.218300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:23.219117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:23.221225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:23.222942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:23.223723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:23.224593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:23.230438 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-25edc1e9-38b3-4b90-892c-167e3ac60866 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586123 Aug 09 14:33:23.231118 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 396/748] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:33:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:33:23.257970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b9735db-5a45-4a89-bf39-0c839ea144ba tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:23.258587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b9735db-5a45-4a89-bf39-0c839ea144ba tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:23.264979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b9735db-5a45-4a89-bf39-0c839ea144ba tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:23.265707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b9735db-5a45-4a89-bf39-0c839ea144ba tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:23.266326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b9735db-5a45-4a89-bf39-0c839ea144ba tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:23.267317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b9735db-5a45-4a89-bf39-0c839ea144ba tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:23.267914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b9735db-5a45-4a89-bf39-0c839ea144ba tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:23.268568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b9735db-5a45-4a89-bf39-0c839ea144ba tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:23.296335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Getting quotas for project beac39aa567247818bf13c604a1ed8ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:23.311895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Getting quotas for user ca408ac0b6df4c3797409e40335f61aa and project beac39aa567247818bf13c604a1ed8ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:23.340386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:33:23.343182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:33:23.417558 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-666d56a4-4339-40cf-bb93-4a67e7aae330 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908787 Aug 09 14:33:23.423887 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 353/749] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:33:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:33:23.432638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-149e1f25-686c-47af-8785-feb08fbdb2b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:23.434271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-149e1f25-686c-47af-8785-feb08fbdb2b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:23.442813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-149e1f25-686c-47af-8785-feb08fbdb2b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:23.443538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-149e1f25-686c-47af-8785-feb08fbdb2b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:23.444131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-149e1f25-686c-47af-8785-feb08fbdb2b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:23.445143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-149e1f25-686c-47af-8785-feb08fbdb2b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:23.445734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-149e1f25-686c-47af-8785-feb08fbdb2b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:23.446296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-149e1f25-686c-47af-8785-feb08fbdb2b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:24.025446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6b9735db-5a45-4a89-bf39-0c839ea144ba tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:24.041502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6b9735db-5a45-4a89-bf39-0c839ea144ba tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:24.044812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6b9735db-5a45-4a89-bf39-0c839ea144ba tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:24.046364 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b9735db-5a45-4a89-bf39-0c839ea144ba tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1410 microversion: 2.25 time: 0.797026 Aug 09 14:33:24.048277 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 397/750] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:23 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1410 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:24.076702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-149e1f25-686c-47af-8785-feb08fbdb2b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:24.086653 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-149e1f25-686c-47af-8785-feb08fbdb2b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1471 microversion: 2.1 time: 0.661292 Aug 09 14:33:24.087424 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 354/751] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:23 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1471 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:24.248647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c742b47-d1d2-4c05-862d-11dd3621333d tempest-ExtensionsTest-55399258 tempest-ExtensionsTest-55399258-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:24.250559 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2c742b47-d1d2-4c05-862d-11dd3621333d tempest-ExtensionsTest-55399258 tempest-ExtensionsTest-55399258-project] 10.222.0.50 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.161931 Aug 09 14:33:24.255240 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 355/752] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 9 14:33:24 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:24.262924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-284244427", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:24.297404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-454167676", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:24.329981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:33:24.350894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:33:24.731620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:33:24.732072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:33:24.732568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:33:24.732966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:33:24.733394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:33:24.743061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:24.743632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:24.743996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:24.744716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:24.745162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:24.745583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:24.751812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:33:24.752332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:33:24.752878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:33:24.753477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:33:24.753943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:33:24.762332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Getting quotas for project a9197a5676004ed888ef46000067e150. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:24.762746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:24.763405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:24.763895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:24.764668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:24.765176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:24.765671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:24.766896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Getting quotas for user 8b1fd7b4e40e49828ab24bfced256417 and project a9197a5676004ed888ef46000067e150. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:24.778629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:33:24.780794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:33:24.782247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:24.786669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:24.799965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:33:24.802307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:33:24.833446 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f4f9d66-063c-4602-a4e7-b3795e2e1198 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576954 Aug 09 14:33:24.840358 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 356/753] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:33:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:33:24.845736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b9978954-9b6f-4e93-bb47-f874e030be87 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:24.846534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b9978954-9b6f-4e93-bb47-f874e030be87 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:24.854268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9978954-9b6f-4e93-bb47-f874e030be87 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:24.855032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9978954-9b6f-4e93-bb47-f874e030be87 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:24.855741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9978954-9b6f-4e93-bb47-f874e030be87 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:24.856608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9978954-9b6f-4e93-bb47-f874e030be87 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:24.857309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9978954-9b6f-4e93-bb47-f874e030be87 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:24.857883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9978954-9b6f-4e93-bb47-f874e030be87 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:24.887559 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d3a01389-6cc3-466c-a2c6-2e139252e1e8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837106 Aug 09 14:33:24.902748 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 398/754] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:33:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:33:24.913158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-af76427a-e8dd-4f34-a3cc-c9638c86f5c0 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:24.913777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-af76427a-e8dd-4f34-a3cc-c9638c86f5c0 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:24.927868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af76427a-e8dd-4f34-a3cc-c9638c86f5c0 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:24.928366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af76427a-e8dd-4f34-a3cc-c9638c86f5c0 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:24.928810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af76427a-e8dd-4f34-a3cc-c9638c86f5c0 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:24.929516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af76427a-e8dd-4f34-a3cc-c9638c86f5c0 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:24.929969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af76427a-e8dd-4f34-a3cc-c9638c86f5c0 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:24.930394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af76427a-e8dd-4f34-a3cc-c9638c86f5c0 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:25.077604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b9978954-9b6f-4e93-bb47-f874e030be87 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:25.091932 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b9978954-9b6f-4e93-bb47-f874e030be87 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1261 microversion: 2.1 time: 0.250221 Aug 09 14:33:25.108827 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 357/755] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:24 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1261 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:25.117700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a75697a7-2ee5-4f96-b4d3-6676c4c0a4d4 tempest-ExtensionsTest-55399258 tempest-ExtensionsTest-55399258-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:25.119792 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a75697a7-2ee5-4f96-b4d3-6676c4c0a4d4 tempest-ExtensionsTest-55399258 tempest-ExtensionsTest-55399258-project] 10.222.0.50 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.008638 Aug 09 14:33:25.120352 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 358/756] 10.222.0.50 () {58 vars in 1134 bytes} [Tue Aug 9 14:33:25 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:33:25.159927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4c6eae3-5b4c-4928-9b5d-c92bf4fd161c tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:25.160771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4c6eae3-5b4c-4928-9b5d-c92bf4fd161c tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:25.413685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b4c6eae3-5b4c-4928-9b5d-c92bf4fd161c tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:25.427710 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4c6eae3-5b4c-4928-9b5d-c92bf4fd161c tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1217 microversion: 2.1 time: 0.304443 Aug 09 14:33:25.441673 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 359/757] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:25 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1217 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:25.458012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6219ec42-1543-4de0-9b5d-c34a384196c5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:25.459920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6219ec42-1543-4de0-9b5d-c34a384196c5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:25.494013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-af76427a-e8dd-4f34-a3cc-c9638c86f5c0 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:25.504293 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-af76427a-e8dd-4f34-a3cc-c9638c86f5c0 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1315 microversion: 2.1 time: 0.598576 Aug 09 14:33:25.519453 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 399/758] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:24 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:25.519925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-da17514e-f419-4e17-8946-0e3a5fd3bfcc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:25.520612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-da17514e-f419-4e17-8946-0e3a5fd3bfcc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:25.539428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da17514e-f419-4e17-8946-0e3a5fd3bfcc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:25.540805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da17514e-f419-4e17-8946-0e3a5fd3bfcc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:25.541457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da17514e-f419-4e17-8946-0e3a5fd3bfcc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:25.543659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da17514e-f419-4e17-8946-0e3a5fd3bfcc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:25.545086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da17514e-f419-4e17-8946-0e3a5fd3bfcc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:25.546298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da17514e-f419-4e17-8946-0e3a5fd3bfcc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:25.645602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6219ec42-1543-4de0-9b5d-c34a384196c5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:25.655177 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6219ec42-1543-4de0-9b5d-c34a384196c5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1216 microversion: 2.1 time: 0.220407 Aug 09 14:33:25.664444 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 360/759] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:25 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1216 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:25.682406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-45a50f8d-2032-4306-9d0d-f4909c7977b6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:25.683035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-45a50f8d-2032-4306-9d0d-f4909c7977b6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:25.690343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45a50f8d-2032-4306-9d0d-f4909c7977b6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:25.691212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45a50f8d-2032-4306-9d0d-f4909c7977b6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:25.691948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45a50f8d-2032-4306-9d0d-f4909c7977b6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:25.692924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45a50f8d-2032-4306-9d0d-f4909c7977b6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:25.693755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45a50f8d-2032-4306-9d0d-f4909c7977b6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:25.694308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45a50f8d-2032-4306-9d0d-f4909c7977b6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:26.005026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da17514e-f419-4e17-8946-0e3a5fd3bfcc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:26.024593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da17514e-f419-4e17-8946-0e3a5fd3bfcc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:26.030608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da17514e-f419-4e17-8946-0e3a5fd3bfcc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:26.032534 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-da17514e-f419-4e17-8946-0e3a5fd3bfcc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1410 microversion: 2.25 time: 0.522069 Aug 09 14:33:26.038507 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 400/760] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:25 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1410 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:26.069446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-45a50f8d-2032-4306-9d0d-f4909c7977b6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:26.078455 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-45a50f8d-2032-4306-9d0d-f4909c7977b6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.399718 Aug 09 14:33:26.079813 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 361/761] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:25 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:26.113075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7a7c3969-9d38-425c-a495-1e4ead5e6cf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:26.114050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7a7c3969-9d38-425c-a495-1e4ead5e6cf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:26.121104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a7c3969-9d38-425c-a495-1e4ead5e6cf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:26.121629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a7c3969-9d38-425c-a495-1e4ead5e6cf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:26.122082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a7c3969-9d38-425c-a495-1e4ead5e6cf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:26.122840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a7c3969-9d38-425c-a495-1e4ead5e6cf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:26.123578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a7c3969-9d38-425c-a495-1e4ead5e6cf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:26.124029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a7c3969-9d38-425c-a495-1e4ead5e6cf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:26.213234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7a7c3969-9d38-425c-a495-1e4ead5e6cf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:26.223782 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7a7c3969-9d38-425c-a495-1e4ead5e6cf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1267 microversion: 2.1 time: 0.114652 Aug 09 14:33:26.224871 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 401/762] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:26 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:26.449915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f71560f8-56e3-4567-aaf7-11db549fdbbf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:26.450592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f71560f8-56e3-4567-aaf7-11db549fdbbf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:26.458764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f71560f8-56e3-4567-aaf7-11db549fdbbf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:26.459567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f71560f8-56e3-4567-aaf7-11db549fdbbf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:26.460154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f71560f8-56e3-4567-aaf7-11db549fdbbf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:26.461238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f71560f8-56e3-4567-aaf7-11db549fdbbf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:26.461841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f71560f8-56e3-4567-aaf7-11db549fdbbf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:26.463594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f71560f8-56e3-4567-aaf7-11db549fdbbf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:26.529266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aba65f9f-3c02-4012-87ca-0eefd1362ce5 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:26.530053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aba65f9f-3c02-4012-87ca-0eefd1362ce5 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:26.537183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aba65f9f-3c02-4012-87ca-0eefd1362ce5 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:26.537804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aba65f9f-3c02-4012-87ca-0eefd1362ce5 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:26.538325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aba65f9f-3c02-4012-87ca-0eefd1362ce5 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:26.539375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aba65f9f-3c02-4012-87ca-0eefd1362ce5 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:26.539876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aba65f9f-3c02-4012-87ca-0eefd1362ce5 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:26.540353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aba65f9f-3c02-4012-87ca-0eefd1362ce5 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:26.575642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f71560f8-56e3-4567-aaf7-11db549fdbbf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:26.584678 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f71560f8-56e3-4567-aaf7-11db549fdbbf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1287 microversion: 2.1 time: 0.139178 Aug 09 14:33:26.585433 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 362/763] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:26 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1287 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:26.685023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f242c14-219b-49a9-bb27-8dce056e323b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:26.685717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f242c14-219b-49a9-bb27-8dce056e323b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:26.693943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f242c14-219b-49a9-bb27-8dce056e323b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:26.694727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f242c14-219b-49a9-bb27-8dce056e323b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:26.695355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f242c14-219b-49a9-bb27-8dce056e323b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:26.696263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f242c14-219b-49a9-bb27-8dce056e323b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:26.696924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f242c14-219b-49a9-bb27-8dce056e323b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:26.697879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f242c14-219b-49a9-bb27-8dce056e323b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:26.896648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6f242c14-219b-49a9-bb27-8dce056e323b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:26.905768 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f242c14-219b-49a9-bb27-8dce056e323b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1268 microversion: 2.1 time: 0.224715 Aug 09 14:33:26.920345 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 363/764] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:26 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1268 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:26.994950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aba65f9f-3c02-4012-87ca-0eefd1362ce5 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:27.011645 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aba65f9f-3c02-4012-87ca-0eefd1362ce5 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1315 microversion: 2.1 time: 0.486892 Aug 09 14:33:27.013370 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 402/765] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:26 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:27.061350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c265d559-8763-46ad-a2a4-40a6c5df71cb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:27.062235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c265d559-8763-46ad-a2a4-40a6c5df71cb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:27.065423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:27.078174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c265d559-8763-46ad-a2a4-40a6c5df71cb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:27.078896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c265d559-8763-46ad-a2a4-40a6c5df71cb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:27.079515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c265d559-8763-46ad-a2a4-40a6c5df71cb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:27.080397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c265d559-8763-46ad-a2a4-40a6c5df71cb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:27.080997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c265d559-8763-46ad-a2a4-40a6c5df71cb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:27.081583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c265d559-8763-46ad-a2a4-40a6c5df71cb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:27.101427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-95991ca8-8c44-48c1-9fe5-5451a605ed11 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:27.102505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-95991ca8-8c44-48c1-9fe5-5451a605ed11 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:27.113472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95991ca8-8c44-48c1-9fe5-5451a605ed11 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:27.114301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95991ca8-8c44-48c1-9fe5-5451a605ed11 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:27.116077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95991ca8-8c44-48c1-9fe5-5451a605ed11 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:27.117220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95991ca8-8c44-48c1-9fe5-5451a605ed11 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:27.118557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95991ca8-8c44-48c1-9fe5-5451a605ed11 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:27.120216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95991ca8-8c44-48c1-9fe5-5451a605ed11 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:27.507632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c265d559-8763-46ad-a2a4-40a6c5df71cb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:27.523370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c265d559-8763-46ad-a2a4-40a6c5df71cb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:27.525309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c265d559-8763-46ad-a2a4-40a6c5df71cb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:27.527869 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c265d559-8763-46ad-a2a4-40a6c5df71cb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1410 microversion: 2.25 time: 0.469925 Aug 09 14:33:27.528655 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 364/766] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:27 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1410 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:33:27.535442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4c3b68d4-3899-47e5-8fd4-c93c2b7a64ee tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:27.536669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4c3b68d4-3899-47e5-8fd4-c93c2b7a64ee tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:27.545870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c3b68d4-3899-47e5-8fd4-c93c2b7a64ee tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:27.546462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c3b68d4-3899-47e5-8fd4-c93c2b7a64ee tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:27.547000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c3b68d4-3899-47e5-8fd4-c93c2b7a64ee tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:27.547656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-95991ca8-8c44-48c1-9fe5-5451a605ed11 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:27.552286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c3b68d4-3899-47e5-8fd4-c93c2b7a64ee tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:27.554240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c3b68d4-3899-47e5-8fd4-c93c2b7a64ee tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:27.554780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c3b68d4-3899-47e5-8fd4-c93c2b7a64ee tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:27.557634 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-95991ca8-8c44-48c1-9fe5-5451a605ed11 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.460921 Aug 09 14:33:27.558270 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 403/767] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:27 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:27.608474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c7ea2f7-3bd0-40da-afb2-d213d85ecfe7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:27.609136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c7ea2f7-3bd0-40da-afb2-d213d85ecfe7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:27.616231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c7ea2f7-3bd0-40da-afb2-d213d85ecfe7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:27.617481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c7ea2f7-3bd0-40da-afb2-d213d85ecfe7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:27.617481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c7ea2f7-3bd0-40da-afb2-d213d85ecfe7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:27.617956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c7ea2f7-3bd0-40da-afb2-d213d85ecfe7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:27.624795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c7ea2f7-3bd0-40da-afb2-d213d85ecfe7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:27.625240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c7ea2f7-3bd0-40da-afb2-d213d85ecfe7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:27.786095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c7ea2f7-3bd0-40da-afb2-d213d85ecfe7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:27.795530 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c7ea2f7-3bd0-40da-afb2-d213d85ecfe7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1275 microversion: 2.1 time: 0.191092 Aug 09 14:33:27.796825 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 404/768] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:27 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:27.930134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-24df4faa-028e-4cb4-9965-e70d13a7ab8b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:27.931405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-24df4faa-028e-4cb4-9965-e70d13a7ab8b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:27.937986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4c3b68d4-3899-47e5-8fd4-c93c2b7a64ee tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:27.941640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24df4faa-028e-4cb4-9965-e70d13a7ab8b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:27.943028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24df4faa-028e-4cb4-9965-e70d13a7ab8b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:27.943707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24df4faa-028e-4cb4-9965-e70d13a7ab8b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:27.944839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24df4faa-028e-4cb4-9965-e70d13a7ab8b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:27.945382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24df4faa-028e-4cb4-9965-e70d13a7ab8b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:27.945893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24df4faa-028e-4cb4-9965-e70d13a7ab8b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:27.948592 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4c3b68d4-3899-47e5-8fd4-c93c2b7a64ee tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1309 microversion: 2.1 time: 0.418331 Aug 09 14:33:27.949387 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 365/769] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:27 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1309 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:28.037400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94defee5-ec10-49aa-988e-36e134fb2128 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:28.038013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94defee5-ec10-49aa-988e-36e134fb2128 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:28.056668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94defee5-ec10-49aa-988e-36e134fb2128 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:28.057341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94defee5-ec10-49aa-988e-36e134fb2128 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:28.057983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94defee5-ec10-49aa-988e-36e134fb2128 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:28.058841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94defee5-ec10-49aa-988e-36e134fb2128 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:28.061870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94defee5-ec10-49aa-988e-36e134fb2128 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:28.062259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94defee5-ec10-49aa-988e-36e134fb2128 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:28.102861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-24df4faa-028e-4cb4-9965-e70d13a7ab8b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:28.110635 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-24df4faa-028e-4cb4-9965-e70d13a7ab8b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1274 microversion: 2.1 time: 0.185529 Aug 09 14:33:28.111245 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 405/770] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:27 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:28.228588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-94defee5-ec10-49aa-988e-36e134fb2128 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:28.239521 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94defee5-ec10-49aa-988e-36e134fb2128 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1315 microversion: 2.1 time: 0.208372 Aug 09 14:33:28.240995 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 366/771] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:28 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:28.556081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-799dcd5b-7ec7-469d-9fa0-8d978b4393eb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:28.557419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-799dcd5b-7ec7-469d-9fa0-8d978b4393eb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:28.564937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-799dcd5b-7ec7-469d-9fa0-8d978b4393eb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:28.566422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-799dcd5b-7ec7-469d-9fa0-8d978b4393eb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:28.567217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-799dcd5b-7ec7-469d-9fa0-8d978b4393eb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:28.568225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-799dcd5b-7ec7-469d-9fa0-8d978b4393eb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:28.569054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-799dcd5b-7ec7-469d-9fa0-8d978b4393eb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:28.569710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-799dcd5b-7ec7-469d-9fa0-8d978b4393eb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:28.579063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6b13625d-d6f8-4030-b63b-990da55f70bc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:28.579808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6b13625d-d6f8-4030-b63b-990da55f70bc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:28.596189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b13625d-d6f8-4030-b63b-990da55f70bc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:28.598030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b13625d-d6f8-4030-b63b-990da55f70bc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:28.600396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b13625d-d6f8-4030-b63b-990da55f70bc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:28.601293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b13625d-d6f8-4030-b63b-990da55f70bc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:28.604192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b13625d-d6f8-4030-b63b-990da55f70bc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:28.604825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b13625d-d6f8-4030-b63b-990da55f70bc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:29.239535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6b13625d-d6f8-4030-b63b-990da55f70bc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:29.246356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-799dcd5b-7ec7-469d-9fa0-8d978b4393eb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:29.258165 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6b13625d-d6f8-4030-b63b-990da55f70bc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.683992 Aug 09 14:33:29.271334 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 367/772] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:28 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:29.271334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-886ebdfe-4b71-461d-9040-e606dd81439b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:29.271334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-886ebdfe-4b71-461d-9040-e606dd81439b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:29.271678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-799dcd5b-7ec7-469d-9fa0-8d978b4393eb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:29.278665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-799dcd5b-7ec7-469d-9fa0-8d978b4393eb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:29.280134 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-799dcd5b-7ec7-469d-9fa0-8d978b4393eb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1410 microversion: 2.25 time: 0.728563 Aug 09 14:33:29.283358 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 406/773] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:28 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1410 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:29.290374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-886ebdfe-4b71-461d-9040-e606dd81439b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:29.290866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-886ebdfe-4b71-461d-9040-e606dd81439b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:29.291324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-886ebdfe-4b71-461d-9040-e606dd81439b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:29.295288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-886ebdfe-4b71-461d-9040-e606dd81439b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:29.295982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-886ebdfe-4b71-461d-9040-e606dd81439b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:29.296609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-886ebdfe-4b71-461d-9040-e606dd81439b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:29.311632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c2ca66d-62ef-40cf-bfde-e6d680784352 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:29.311632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c2ca66d-62ef-40cf-bfde-e6d680784352 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:29.325204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c2ca66d-62ef-40cf-bfde-e6d680784352 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:29.325701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c2ca66d-62ef-40cf-bfde-e6d680784352 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:29.326139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c2ca66d-62ef-40cf-bfde-e6d680784352 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:29.326898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c2ca66d-62ef-40cf-bfde-e6d680784352 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:29.329078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c2ca66d-62ef-40cf-bfde-e6d680784352 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:29.331153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c2ca66d-62ef-40cf-bfde-e6d680784352 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:29.392833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:29.737722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c2ca66d-62ef-40cf-bfde-e6d680784352 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:29.744131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-886ebdfe-4b71-461d-9040-e606dd81439b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:29.747224 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c2ca66d-62ef-40cf-bfde-e6d680784352 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1309 microversion: 2.1 time: 0.461220 Aug 09 14:33:29.748395 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 407/774] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:29 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1309 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:29.754419 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-886ebdfe-4b71-461d-9040-e606dd81439b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1317 microversion: 2.1 time: 0.489671 Aug 09 14:33:29.765557 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 368/775] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:29 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:29.766030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e3f2154a-a79a-46e3-9944-963f8efd6ce3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:29.766805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e3f2154a-a79a-46e3-9944-963f8efd6ce3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:29.770698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-557e2749-722d-4d8d-ad26-76392787ba3e req-822057ce-7fd8-436d-8f91-e04904e226d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd6f697-9f2e-4825-998a-796902617f44", "name": "network-vif-plugged", "status": "completed", "tag": "ee2a1cef-a2ec-4b5c-a13d-9c50e9639eb0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:29.778911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3f2154a-a79a-46e3-9944-963f8efd6ce3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:29.779534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3f2154a-a79a-46e3-9944-963f8efd6ce3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:29.779957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3f2154a-a79a-46e3-9944-963f8efd6ce3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:29.780682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3f2154a-a79a-46e3-9944-963f8efd6ce3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:29.781132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3f2154a-a79a-46e3-9944-963f8efd6ce3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:29.781958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3f2154a-a79a-46e3-9944-963f8efd6ce3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:29.789897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-557e2749-722d-4d8d-ad26-76392787ba3e req-822057ce-7fd8-436d-8f91-e04904e226d1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:29.790388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-557e2749-722d-4d8d-ad26-76392787ba3e req-822057ce-7fd8-436d-8f91-e04904e226d1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:29.790815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-557e2749-722d-4d8d-ad26-76392787ba3e req-822057ce-7fd8-436d-8f91-e04904e226d1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:29.803968 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-557e2749-722d-4d8d-ad26-76392787ba3e req-822057ce-7fd8-436d-8f91-e04904e226d1 service nova] Creating event network-vif-plugged:ee2a1cef-a2ec-4b5c-a13d-9c50e9639eb0 for instance acd6f697-9f2e-4825-998a-796902617f44 on n-h1-844626-8 Aug 09 14:33:29.810016 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-557e2749-722d-4d8d-ad26-76392787ba3e req-822057ce-7fd8-436d-8f91-e04904e226d1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042627 Aug 09 14:33:29.810655 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 369/776] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:29.818083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-03e250bc-62e1-4a78-8ddd-959715fe6b79 req-7b3938ea-8504-45e9-b401-a9d2a3594aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd9360b9-5620-4fa1-819c-90485da8e233", "tag": "5bd1019d-0599-4147-9f78-e7a7f2989303"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:29.830831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-03e250bc-62e1-4a78-8ddd-959715fe6b79 req-7b3938ea-8504-45e9-b401-a9d2a3594aec service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:29.831663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-03e250bc-62e1-4a78-8ddd-959715fe6b79 req-7b3938ea-8504-45e9-b401-a9d2a3594aec service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:29.832301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-03e250bc-62e1-4a78-8ddd-959715fe6b79 req-7b3938ea-8504-45e9-b401-a9d2a3594aec service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:29.845778 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-03e250bc-62e1-4a78-8ddd-959715fe6b79 req-7b3938ea-8504-45e9-b401-a9d2a3594aec service nova] Creating event network-changed:5bd1019d-0599-4147-9f78-e7a7f2989303 for instance bd9360b9-5620-4fa1-819c-90485da8e233 on n-h2-844626-8 Aug 09 14:33:29.861802 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-03e250bc-62e1-4a78-8ddd-959715fe6b79 req-7b3938ea-8504-45e9-b401-a9d2a3594aec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042514 Aug 09 14:33:29.863496 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 370/777] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:29.870132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bcc54fe6-4cae-4637-8262-409447dddd84 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:29.871197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bcc54fe6-4cae-4637-8262-409447dddd84 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:29.877671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcc54fe6-4cae-4637-8262-409447dddd84 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:29.878158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcc54fe6-4cae-4637-8262-409447dddd84 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:29.878848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcc54fe6-4cae-4637-8262-409447dddd84 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:29.879590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcc54fe6-4cae-4637-8262-409447dddd84 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:29.880767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcc54fe6-4cae-4637-8262-409447dddd84 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:29.880767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcc54fe6-4cae-4637-8262-409447dddd84 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:30.201656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e3f2154a-a79a-46e3-9944-963f8efd6ce3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:30.216088 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e3f2154a-a79a-46e3-9944-963f8efd6ce3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1316 microversion: 2.1 time: 0.456049 Aug 09 14:33:30.217810 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 408/778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:29 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:30.248863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-64cd8d6e-b039-4133-bb62-2358e03e1c02 req-abc35a54-addb-4a18-a886-a08b42376312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ba6d964-167a-4b1e-94f0-fb74f63c03f1", "tag": "e4f9d82e-39ab-4f23-91b4-e30a41b072c4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:30.271014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-64cd8d6e-b039-4133-bb62-2358e03e1c02 req-abc35a54-addb-4a18-a886-a08b42376312 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:30.271642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-64cd8d6e-b039-4133-bb62-2358e03e1c02 req-abc35a54-addb-4a18-a886-a08b42376312 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:30.272144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-64cd8d6e-b039-4133-bb62-2358e03e1c02 req-abc35a54-addb-4a18-a886-a08b42376312 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:30.317646 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-64cd8d6e-b039-4133-bb62-2358e03e1c02 req-abc35a54-addb-4a18-a886-a08b42376312 service nova] Creating event network-changed:e4f9d82e-39ab-4f23-91b4-e30a41b072c4 for instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 on n-h2-844626-8 Aug 09 14:33:30.332457 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-64cd8d6e-b039-4133-bb62-2358e03e1c02 req-abc35a54-addb-4a18-a886-a08b42376312 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091923 Aug 09 14:33:30.335138 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 409/779] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:30.347609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5bdcbb3-b4bb-4e90-915a-21f0bed87446 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:30.348996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5bdcbb3-b4bb-4e90-915a-21f0bed87446 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:30.359810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5bdcbb3-b4bb-4e90-915a-21f0bed87446 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:30.360662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5bdcbb3-b4bb-4e90-915a-21f0bed87446 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:30.361764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5bdcbb3-b4bb-4e90-915a-21f0bed87446 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:30.364438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5bdcbb3-b4bb-4e90-915a-21f0bed87446 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:30.365106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5bdcbb3-b4bb-4e90-915a-21f0bed87446 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:30.366863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5bdcbb3-b4bb-4e90-915a-21f0bed87446 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:30.403533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bcc54fe6-4cae-4637-8262-409447dddd84 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:30.416731 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bcc54fe6-4cae-4637-8262-409447dddd84 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1315 microversion: 2.1 time: 0.551321 Aug 09 14:33:30.417579 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 371/780] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:29 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:30.427861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0e1c62a-ae25-45a5-bb50-683b3f4a845a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:30.429289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0e1c62a-ae25-45a5-bb50-683b3f4a845a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:30.437888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e1c62a-ae25-45a5-bb50-683b3f4a845a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:30.439045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e1c62a-ae25-45a5-bb50-683b3f4a845a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:30.439789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e1c62a-ae25-45a5-bb50-683b3f4a845a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:30.440932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e1c62a-ae25-45a5-bb50-683b3f4a845a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:30.442189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e1c62a-ae25-45a5-bb50-683b3f4a845a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:30.443150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e1c62a-ae25-45a5-bb50-683b3f4a845a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:30.560268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f5bdcbb3-b4bb-4e90-915a-21f0bed87446 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:30.568755 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5bdcbb3-b4bb-4e90-915a-21f0bed87446 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.231803 Aug 09 14:33:30.569322 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 410/781] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:30 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:30.632436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0e1c62a-ae25-45a5-bb50-683b3f4a845a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:30.641146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0e1c62a-ae25-45a5-bb50-683b3f4a845a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:30.643006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0e1c62a-ae25-45a5-bb50-683b3f4a845a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:30.644187 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0e1c62a-ae25-45a5-bb50-683b3f4a845a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1410 microversion: 2.25 time: 0.225206 Aug 09 14:33:30.644779 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 372/782] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:30 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1410 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:33:30.707274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6acc7e84-abee-450e-a175-434be733532f tempest-ComputeTenantNetworksTest-583944986 tempest-ComputeTenantNetworksTest-583944986-project] Calling method '.version_select at 0x7f41de02aee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:30.770958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-635f9dca-cc5e-42f3-8ba0-41e5541b470e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:30.772288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-635f9dca-cc5e-42f3-8ba0-41e5541b470e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:30.778855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-635f9dca-cc5e-42f3-8ba0-41e5541b470e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:30.779316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-635f9dca-cc5e-42f3-8ba0-41e5541b470e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:30.779923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-635f9dca-cc5e-42f3-8ba0-41e5541b470e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:30.780970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-635f9dca-cc5e-42f3-8ba0-41e5541b470e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:30.781610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-635f9dca-cc5e-42f3-8ba0-41e5541b470e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:30.782012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-635f9dca-cc5e-42f3-8ba0-41e5541b470e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:30.964225 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6acc7e84-abee-450e-a175-434be733532f tempest-ComputeTenantNetworksTest-583944986 tempest-ComputeTenantNetworksTest-583944986-project] 10.222.0.50 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.386808 Aug 09 14:33:30.965692 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 411/783] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:33:30 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:30.970773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63901db2-a838-4ec8-8f5d-e15a9895c8e8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:30.971434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63901db2-a838-4ec8-8f5d-e15a9895c8e8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:30.980641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63901db2-a838-4ec8-8f5d-e15a9895c8e8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:30.981325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63901db2-a838-4ec8-8f5d-e15a9895c8e8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:30.981762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63901db2-a838-4ec8-8f5d-e15a9895c8e8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:30.982483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63901db2-a838-4ec8-8f5d-e15a9895c8e8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:30.982941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63901db2-a838-4ec8-8f5d-e15a9895c8e8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:30.983406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63901db2-a838-4ec8-8f5d-e15a9895c8e8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:31.014232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-635f9dca-cc5e-42f3-8ba0-41e5541b470e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:31.022981 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-635f9dca-cc5e-42f3-8ba0-41e5541b470e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1309 microversion: 2.1 time: 0.256997 Aug 09 14:33:31.023860 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 373/784] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:30 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1309 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:31.039398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0cf5db1a-e42b-4ecc-a333-64ab06bd957d tempest-ComputeTenantNetworksTest-583944986 tempest-ComputeTenantNetworksTest-583944986-project] Calling method '.version_select at 0x7f41dd770ee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:31.180682 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0cf5db1a-e42b-4ecc-a333-64ab06bd957d tempest-ComputeTenantNetworksTest-583944986 tempest-ComputeTenantNetworksTest-583944986-project] 10.222.0.50 "GET /compute/v2.1/os-tenant-networks/d4348a53-dcd1-4cf3-8623-ba2cf9cb8a7b" status: 200 len: 139 microversion: 2.1 time: 0.155491 Aug 09 14:33:31.187639 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 374/785] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:33:31 2022] GET /compute/v2.1/os-tenant-networks/d4348a53-dcd1-4cf3-8623-ba2cf9cb8a7b => generated 139 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:31.211075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63901db2-a838-4ec8-8f5d-e15a9895c8e8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:31.218616 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63901db2-a838-4ec8-8f5d-e15a9895c8e8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1317 microversion: 2.1 time: 0.251612 Aug 09 14:33:31.219199 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 412/786] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:30 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:31.246006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b9eb6e81-84c7-4b93-bda4-224f419d5432 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:31.246618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b9eb6e81-84c7-4b93-bda4-224f419d5432 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:31.253151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9eb6e81-84c7-4b93-bda4-224f419d5432 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:31.253673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9eb6e81-84c7-4b93-bda4-224f419d5432 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:31.254222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9eb6e81-84c7-4b93-bda4-224f419d5432 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:31.254966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9eb6e81-84c7-4b93-bda4-224f419d5432 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:31.255429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9eb6e81-84c7-4b93-bda4-224f419d5432 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:31.255867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9eb6e81-84c7-4b93-bda4-224f419d5432 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:31.392697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b9eb6e81-84c7-4b93-bda4-224f419d5432 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:31.403837 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b9eb6e81-84c7-4b93-bda4-224f419d5432 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1316 microversion: 2.1 time: 0.161763 Aug 09 14:33:31.415635 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 375/787] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:31 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:31.442346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a796a190-7f64-4864-8be2-79a9bc13ad45 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:31.443448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a796a190-7f64-4864-8be2-79a9bc13ad45 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:31.450177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a796a190-7f64-4864-8be2-79a9bc13ad45 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:31.450722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a796a190-7f64-4864-8be2-79a9bc13ad45 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:31.451431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a796a190-7f64-4864-8be2-79a9bc13ad45 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:31.452401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a796a190-7f64-4864-8be2-79a9bc13ad45 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:31.452859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a796a190-7f64-4864-8be2-79a9bc13ad45 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:31.453471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a796a190-7f64-4864-8be2-79a9bc13ad45 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:31.592226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1b86cae1-91ff-4780-9d1e-271cf5f16676 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:31.593121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1b86cae1-91ff-4780-9d1e-271cf5f16676 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:31.605024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a796a190-7f64-4864-8be2-79a9bc13ad45 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:31.610385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b86cae1-91ff-4780-9d1e-271cf5f16676 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:31.610886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b86cae1-91ff-4780-9d1e-271cf5f16676 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:31.612306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b86cae1-91ff-4780-9d1e-271cf5f16676 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:31.613132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b86cae1-91ff-4780-9d1e-271cf5f16676 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:31.613580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b86cae1-91ff-4780-9d1e-271cf5f16676 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:31.613989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b86cae1-91ff-4780-9d1e-271cf5f16676 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:31.614362 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a796a190-7f64-4864-8be2-79a9bc13ad45 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1315 microversion: 2.1 time: 0.176098 Aug 09 14:33:31.615330 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 413/788] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:31 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:31.667898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fea84265-6931-4c4b-b872-f97f4ddc751e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:31.668810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fea84265-6931-4c4b-b872-f97f4ddc751e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:31.675711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fea84265-6931-4c4b-b872-f97f4ddc751e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:31.676380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fea84265-6931-4c4b-b872-f97f4ddc751e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:31.677000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fea84265-6931-4c4b-b872-f97f4ddc751e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:31.678271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fea84265-6931-4c4b-b872-f97f4ddc751e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:31.678860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fea84265-6931-4c4b-b872-f97f4ddc751e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:31.679448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fea84265-6931-4c4b-b872-f97f4ddc751e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:31.789795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1b86cae1-91ff-4780-9d1e-271cf5f16676 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:31.798717 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1b86cae1-91ff-4780-9d1e-271cf5f16676 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.212293 Aug 09 14:33:31.799531 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 376/789] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:31 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:31.850084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fea84265-6931-4c4b-b872-f97f4ddc751e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:31.859953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fea84265-6931-4c4b-b872-f97f4ddc751e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:31.861687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fea84265-6931-4c4b-b872-f97f4ddc751e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:31.862898 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fea84265-6931-4c4b-b872-f97f4ddc751e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1607 microversion: 2.25 time: 0.200152 Aug 09 14:33:31.875218 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 414/790] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:33:31 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1607 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:33:31.888260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c3e91dea-5423-4163-9571-b61769f9a1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:31.888852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c3e91dea-5423-4163-9571-b61769f9a1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:31.897669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-36e22c65-8983-4f0d-a516-1ab563b0567c req-6bfe17a6-625f-4d48-811e-cba006e94c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "261b33cd-d9c1-42bc-bb0e-3836fae12d34", "tag": "deab8750-c5ac-4d07-a63f-ee59f7fa7a73"}, {"name": "network-changed", "server_uuid": "5c29a36e-08bc-48f8-ae8c-029a5dbf060f", "tag": "2137f1f1-d9de-48cb-9103-f3fd05beec4f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:31.898226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e91dea-5423-4163-9571-b61769f9a1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:31.898953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e91dea-5423-4163-9571-b61769f9a1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:31.899759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e91dea-5423-4163-9571-b61769f9a1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:31.900756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e91dea-5423-4163-9571-b61769f9a1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:31.901500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e91dea-5423-4163-9571-b61769f9a1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:31.902525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e91dea-5423-4163-9571-b61769f9a1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:31.910070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-36e22c65-8983-4f0d-a516-1ab563b0567c req-6bfe17a6-625f-4d48-811e-cba006e94c74 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:31.910958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-36e22c65-8983-4f0d-a516-1ab563b0567c req-6bfe17a6-625f-4d48-811e-cba006e94c74 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:31.911611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-36e22c65-8983-4f0d-a516-1ab563b0567c req-6bfe17a6-625f-4d48-811e-cba006e94c74 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:31.925135 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-36e22c65-8983-4f0d-a516-1ab563b0567c req-6bfe17a6-625f-4d48-811e-cba006e94c74 service nova] Creating event network-changed:deab8750-c5ac-4d07-a63f-ee59f7fa7a73 for instance 261b33cd-d9c1-42bc-bb0e-3836fae12d34 on n-h1-844626-8 Aug 09 14:33:31.926049 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-36e22c65-8983-4f0d-a516-1ab563b0567c req-6bfe17a6-625f-4d48-811e-cba006e94c74 service nova] Creating event network-changed:2137f1f1-d9de-48cb-9103-f3fd05beec4f for instance 5c29a36e-08bc-48f8-ae8c-029a5dbf060f on n-h1-844626-8 Aug 09 14:33:31.937030 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-36e22c65-8983-4f0d-a516-1ab563b0567c req-6bfe17a6-625f-4d48-811e-cba006e94c74 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.043427 Aug 09 14:33:31.938791 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 415/791] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:31.940221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:31.998280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-3c235655-12d0-4684-9f78-161ef6faeb83 req-c51d4798-619d-4957-89e0-fe68f40cf61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "093134a3-712a-416c-acbe-15ea40bcfe79", "name": "network-vif-plugged", "status": "completed", "tag": "c9cee52a-c76d-4ebe-b6f5-9aa50144777b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:32.011910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3c235655-12d0-4684-9f78-161ef6faeb83 req-c51d4798-619d-4957-89e0-fe68f40cf61b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:32.012486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3c235655-12d0-4684-9f78-161ef6faeb83 req-c51d4798-619d-4957-89e0-fe68f40cf61b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:32.013178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3c235655-12d0-4684-9f78-161ef6faeb83 req-c51d4798-619d-4957-89e0-fe68f40cf61b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:32.025378 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c3e91dea-5423-4163-9571-b61769f9a1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.140859 Aug 09 14:33:32.025378 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 377/792] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 9 14:33:31 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:33:32.041889 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3c235655-12d0-4684-9f78-161ef6faeb83 req-c51d4798-619d-4957-89e0-fe68f40cf61b service nova] Creating event network-vif-plugged:c9cee52a-c76d-4ebe-b6f5-9aa50144777b for instance 093134a3-712a-416c-acbe-15ea40bcfe79 on n-h1-844626-8 Aug 09 14:33:32.046799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d58947c6-fda9-45b7-9b22-6857bd0bba33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:32.048824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d58947c6-fda9-45b7-9b22-6857bd0bba33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:32.050341 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-3c235655-12d0-4684-9f78-161ef6faeb83 req-c51d4798-619d-4957-89e0-fe68f40cf61b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058511 Aug 09 14:33:32.051190 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 416/793] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:32.060906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d58947c6-fda9-45b7-9b22-6857bd0bba33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:32.061404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d58947c6-fda9-45b7-9b22-6857bd0bba33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:32.062251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d58947c6-fda9-45b7-9b22-6857bd0bba33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:32.063869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d58947c6-fda9-45b7-9b22-6857bd0bba33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:32.064651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d58947c6-fda9-45b7-9b22-6857bd0bba33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:32.065474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d58947c6-fda9-45b7-9b22-6857bd0bba33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:32.241809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8cadf16-976d-4916-bb6f-05717fd310c0 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:32.243362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8cadf16-976d-4916-bb6f-05717fd310c0 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:32.252048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8cadf16-976d-4916-bb6f-05717fd310c0 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:32.253508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8cadf16-976d-4916-bb6f-05717fd310c0 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:32.254097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8cadf16-976d-4916-bb6f-05717fd310c0 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:32.255494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8cadf16-976d-4916-bb6f-05717fd310c0 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:32.256096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8cadf16-976d-4916-bb6f-05717fd310c0 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:32.256788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8cadf16-976d-4916-bb6f-05717fd310c0 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:32.282610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d58947c6-fda9-45b7-9b22-6857bd0bba33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:32.291387 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d58947c6-fda9-45b7-9b22-6857bd0bba33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1309 microversion: 2.1 time: 0.249389 Aug 09 14:33:32.304983 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 378/794] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:32 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1309 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:32.426342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-201d20e8-3f98-478c-bf99-cd44892b3371 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:32.427072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-201d20e8-3f98-478c-bf99-cd44892b3371 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:32.433826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201d20e8-3f98-478c-bf99-cd44892b3371 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:32.434505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201d20e8-3f98-478c-bf99-cd44892b3371 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:32.435117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201d20e8-3f98-478c-bf99-cd44892b3371 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:32.435835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201d20e8-3f98-478c-bf99-cd44892b3371 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:32.436265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201d20e8-3f98-478c-bf99-cd44892b3371 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:32.436692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201d20e8-3f98-478c-bf99-cd44892b3371 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:32.452157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8cadf16-976d-4916-bb6f-05717fd310c0 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:32.465963 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e8cadf16-976d-4916-bb6f-05717fd310c0 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1317 microversion: 2.1 time: 0.229900 Aug 09 14:33:32.467121 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 417/795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:32 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:32.623648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-201d20e8-3f98-478c-bf99-cd44892b3371 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:32.632380 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-201d20e8-3f98-478c-bf99-cd44892b3371 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1316 microversion: 2.1 time: 0.210484 Aug 09 14:33:32.633648 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 379/796] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:32 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:32.639968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f45bb02f-9f15-46d8-825f-0724074c38d9 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:32.641250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f45bb02f-9f15-46d8-825f-0724074c38d9 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:32.650936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f45bb02f-9f15-46d8-825f-0724074c38d9 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:32.651487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f45bb02f-9f15-46d8-825f-0724074c38d9 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:32.651910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f45bb02f-9f15-46d8-825f-0724074c38d9 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:32.652647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f45bb02f-9f15-46d8-825f-0724074c38d9 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:32.653128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f45bb02f-9f15-46d8-825f-0724074c38d9 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:32.653547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f45bb02f-9f15-46d8-825f-0724074c38d9 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:32.820321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f8a8fbeb-512c-405c-9944-4393594d0b5d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:32.820864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8a8fbeb-512c-405c-9944-4393594d0b5d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:32.834884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a8fbeb-512c-405c-9944-4393594d0b5d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:32.836970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a8fbeb-512c-405c-9944-4393594d0b5d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:32.838333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a8fbeb-512c-405c-9944-4393594d0b5d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:32.839847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a8fbeb-512c-405c-9944-4393594d0b5d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:32.840686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a8fbeb-512c-405c-9944-4393594d0b5d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:32.841313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a8fbeb-512c-405c-9944-4393594d0b5d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:32.843980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f45bb02f-9f15-46d8-825f-0724074c38d9 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:32.854721 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f45bb02f-9f15-46d8-825f-0724074c38d9 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1315 microversion: 2.1 time: 0.222303 Aug 09 14:33:32.855653 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 418/797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:32 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:33.095377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8a8fbeb-512c-405c-9944-4393594d0b5d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:33.110253 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f8a8fbeb-512c-405c-9944-4393594d0b5d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.292965 Aug 09 14:33:33.112795 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 380/798] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:32 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:33.313348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-53895837-7aba-4510-860f-bb9230b5c038 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:33.313948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53895837-7aba-4510-860f-bb9230b5c038 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:33.320636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53895837-7aba-4510-860f-bb9230b5c038 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:33.321460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53895837-7aba-4510-860f-bb9230b5c038 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:33.322125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53895837-7aba-4510-860f-bb9230b5c038 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:33.322923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53895837-7aba-4510-860f-bb9230b5c038 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:33.323679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53895837-7aba-4510-860f-bb9230b5c038 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:33.324083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53895837-7aba-4510-860f-bb9230b5c038 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:33.491071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a6ddc164-9369-4a03-835a-6bcae7e38d20 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:33.492463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a6ddc164-9369-4a03-835a-6bcae7e38d20 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:33.507656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ddc164-9369-4a03-835a-6bcae7e38d20 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:33.509122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ddc164-9369-4a03-835a-6bcae7e38d20 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:33.510498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ddc164-9369-4a03-835a-6bcae7e38d20 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:33.512348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ddc164-9369-4a03-835a-6bcae7e38d20 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:33.513038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ddc164-9369-4a03-835a-6bcae7e38d20 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:33.514983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ddc164-9369-4a03-835a-6bcae7e38d20 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:33.701270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-53895837-7aba-4510-860f-bb9230b5c038 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:33.712018 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-53895837-7aba-4510-860f-bb9230b5c038 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1309 microversion: 2.1 time: 0.401764 Aug 09 14:33:33.714356 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 419/799] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:33 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1309 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:33.719990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd916218-f935-4651-ac3e-f69ebc3ba28e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:33.720755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd916218-f935-4651-ac3e-f69ebc3ba28e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:33.727664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd916218-f935-4651-ac3e-f69ebc3ba28e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:33.728572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd916218-f935-4651-ac3e-f69ebc3ba28e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:33.729213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd916218-f935-4651-ac3e-f69ebc3ba28e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:33.730259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd916218-f935-4651-ac3e-f69ebc3ba28e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:33.730709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd916218-f935-4651-ac3e-f69ebc3ba28e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:33.731316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd916218-f935-4651-ac3e-f69ebc3ba28e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:33.770261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a6ddc164-9369-4a03-835a-6bcae7e38d20 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:33.779618 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a6ddc164-9369-4a03-835a-6bcae7e38d20 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1317 microversion: 2.1 time: 0.295305 Aug 09 14:33:33.782537 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 381/800] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:33 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:33.876533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ac392433-7025-40e1-9c2c-bcbf9458040c tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:33.877240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ac392433-7025-40e1-9c2c-bcbf9458040c tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:33.887959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac392433-7025-40e1-9c2c-bcbf9458040c tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:33.888710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac392433-7025-40e1-9c2c-bcbf9458040c tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:33.889256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac392433-7025-40e1-9c2c-bcbf9458040c tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:33.890055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac392433-7025-40e1-9c2c-bcbf9458040c tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:33.890603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac392433-7025-40e1-9c2c-bcbf9458040c tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:33.891142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac392433-7025-40e1-9c2c-bcbf9458040c tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:33.950229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fd916218-f935-4651-ac3e-f69ebc3ba28e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:33.958526 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd916218-f935-4651-ac3e-f69ebc3ba28e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1316 microversion: 2.1 time: 0.242676 Aug 09 14:33:33.971717 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 420/801] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:33 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:34.057004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac392433-7025-40e1-9c2c-bcbf9458040c tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:34.067155 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ac392433-7025-40e1-9c2c-bcbf9458040c tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1315 microversion: 2.1 time: 0.195058 Aug 09 14:33:34.080833 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 382/802] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:33 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:34.133255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-68eea052-3da0-4155-a735-4aa0ea69b0b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:34.134067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-68eea052-3da0-4155-a735-4aa0ea69b0b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:34.149015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68eea052-3da0-4155-a735-4aa0ea69b0b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:34.149573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68eea052-3da0-4155-a735-4aa0ea69b0b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:34.150004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68eea052-3da0-4155-a735-4aa0ea69b0b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:34.150813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68eea052-3da0-4155-a735-4aa0ea69b0b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:34.151276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68eea052-3da0-4155-a735-4aa0ea69b0b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:34.151686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68eea052-3da0-4155-a735-4aa0ea69b0b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:34.285254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-68eea052-3da0-4155-a735-4aa0ea69b0b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:34.293243 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-68eea052-3da0-4155-a735-4aa0ea69b0b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.164413 Aug 09 14:33:34.293823 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 421/803] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:34 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:34.413448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-27fa3539-2ed0-4376-a25a-a58f0dc48a34 req-35424543-c5e6-4579-b7f0-c5481bdbb74a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd6f697-9f2e-4825-998a-796902617f44", "tag": "ee2a1cef-a2ec-4b5c-a13d-9c50e9639eb0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:34.424459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-27fa3539-2ed0-4376-a25a-a58f0dc48a34 req-35424543-c5e6-4579-b7f0-c5481bdbb74a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:34.424951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-27fa3539-2ed0-4376-a25a-a58f0dc48a34 req-35424543-c5e6-4579-b7f0-c5481bdbb74a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:34.425362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-27fa3539-2ed0-4376-a25a-a58f0dc48a34 req-35424543-c5e6-4579-b7f0-c5481bdbb74a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:34.456486 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-27fa3539-2ed0-4376-a25a-a58f0dc48a34 req-35424543-c5e6-4579-b7f0-c5481bdbb74a service nova] Creating event network-changed:ee2a1cef-a2ec-4b5c-a13d-9c50e9639eb0 for instance acd6f697-9f2e-4825-998a-796902617f44 on n-h1-844626-8 Aug 09 14:33:34.462592 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-27fa3539-2ed0-4376-a25a-a58f0dc48a34 req-35424543-c5e6-4579-b7f0-c5481bdbb74a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052835 Aug 09 14:33:34.463648 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 383/804] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:34.734613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c69374de-d084-4ad2-af42-42090cdcbbea tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:34.735343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c69374de-d084-4ad2-af42-42090cdcbbea tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:34.745267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c69374de-d084-4ad2-af42-42090cdcbbea tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:34.745897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c69374de-d084-4ad2-af42-42090cdcbbea tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:34.746856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c69374de-d084-4ad2-af42-42090cdcbbea tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:34.747668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c69374de-d084-4ad2-af42-42090cdcbbea tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:34.748852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c69374de-d084-4ad2-af42-42090cdcbbea tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:34.749341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c69374de-d084-4ad2-af42-42090cdcbbea tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:34.774734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:34.794214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=53,nova_cell0:UPDATE=7 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:34.800839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:34.810356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c51521f-1ea5-49e5-ab8f-aab3af816069 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:34.811178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2c51521f-1ea5-49e5-ab8f-aab3af816069 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:34.825539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c51521f-1ea5-49e5-ab8f-aab3af816069 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:34.828393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c51521f-1ea5-49e5-ab8f-aab3af816069 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:34.829058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c51521f-1ea5-49e5-ab8f-aab3af816069 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:34.829938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c51521f-1ea5-49e5-ab8f-aab3af816069 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:34.832471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c51521f-1ea5-49e5-ab8f-aab3af816069 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:34.833037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c51521f-1ea5-49e5-ab8f-aab3af816069 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:35.549372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c69374de-d084-4ad2-af42-42090cdcbbea tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:35.559464 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c69374de-d084-4ad2-af42-42090cdcbbea tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1309 microversion: 2.1 time: 0.829323 Aug 09 14:33:35.560602 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 422/805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:34 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1309 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:35.576171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-158cee74-0a32-4e5e-832c-792ebfcdf97f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:35.576794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-158cee74-0a32-4e5e-832c-792ebfcdf97f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:35.585233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-158cee74-0a32-4e5e-832c-792ebfcdf97f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:35.586040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-158cee74-0a32-4e5e-832c-792ebfcdf97f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:35.586816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-158cee74-0a32-4e5e-832c-792ebfcdf97f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:35.587819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-158cee74-0a32-4e5e-832c-792ebfcdf97f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:35.588702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-158cee74-0a32-4e5e-832c-792ebfcdf97f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:35.589277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-158cee74-0a32-4e5e-832c-792ebfcdf97f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:35.651409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=32 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:35.819240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c51521f-1ea5-49e5-ab8f-aab3af816069 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:35.827865 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2c51521f-1ea5-49e5-ab8f-aab3af816069 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1317 microversion: 2.1 time: 1.028149 Aug 09 14:33:35.829217 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 384/806] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:34 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1317 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:35.834995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bd83d61d-5d10-4111-9eea-3f3d87e52176 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:35.836063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bd83d61d-5d10-4111-9eea-3f3d87e52176 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:35.844314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd83d61d-5d10-4111-9eea-3f3d87e52176 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:35.845027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd83d61d-5d10-4111-9eea-3f3d87e52176 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:35.845974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd83d61d-5d10-4111-9eea-3f3d87e52176 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:35.846922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd83d61d-5d10-4111-9eea-3f3d87e52176 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:35.847805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd83d61d-5d10-4111-9eea-3f3d87e52176 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:35.848422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd83d61d-5d10-4111-9eea-3f3d87e52176 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:35.915472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-158cee74-0a32-4e5e-832c-792ebfcdf97f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:35.924162 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-158cee74-0a32-4e5e-832c-792ebfcdf97f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1316 microversion: 2.1 time: 0.362394 Aug 09 14:33:35.924881 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 423/807] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:35 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1316 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:35.930372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-64cfd469-9ff6-47b1-ba2e-393bfa9b5d9b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:35.931415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-64cfd469-9ff6-47b1-ba2e-393bfa9b5d9b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:35.940545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64cfd469-9ff6-47b1-ba2e-393bfa9b5d9b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:35.941635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64cfd469-9ff6-47b1-ba2e-393bfa9b5d9b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:35.942125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64cfd469-9ff6-47b1-ba2e-393bfa9b5d9b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:35.943048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64cfd469-9ff6-47b1-ba2e-393bfa9b5d9b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:35.943693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64cfd469-9ff6-47b1-ba2e-393bfa9b5d9b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:35.944236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64cfd469-9ff6-47b1-ba2e-393bfa9b5d9b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:36.260182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bd83d61d-5d10-4111-9eea-3f3d87e52176 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:36.275252 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bd83d61d-5d10-4111-9eea-3f3d87e52176 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1504 microversion: 2.1 time: 0.444541 Aug 09 14:33:36.275929 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 385/808] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:35 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1504 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:36.299583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5dbdaa10-fd6f-42bb-b792-9f42b1d94590 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:36.300084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5dbdaa10-fd6f-42bb-b792-9f42b1d94590 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:36.309197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dbdaa10-fd6f-42bb-b792-9f42b1d94590 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:36.309949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dbdaa10-fd6f-42bb-b792-9f42b1d94590 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:36.310504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dbdaa10-fd6f-42bb-b792-9f42b1d94590 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:36.311230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dbdaa10-fd6f-42bb-b792-9f42b1d94590 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:36.311841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dbdaa10-fd6f-42bb-b792-9f42b1d94590 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:36.312263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dbdaa10-fd6f-42bb-b792-9f42b1d94590 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:36.324486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-64cfd469-9ff6-47b1-ba2e-393bfa9b5d9b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:36.347906 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-64cfd469-9ff6-47b1-ba2e-393bfa9b5d9b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.421634 Aug 09 14:33:36.361945 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 424/809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:35 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:36.370550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5dbdaa10-fd6f-42bb-b792-9f42b1d94590 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:33:36.458092 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5dbdaa10-fd6f-42bb-b792-9f42b1d94590 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "DELETE /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 204 len: 0 microversion: 2.1 time: 0.163437 Aug 09 14:33:36.460020 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 386/810] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:33:36 2022] DELETE /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:33:36.468277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5f6792ca-74d0-4a40-9ba4-07d4563f2521 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:36.468903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5f6792ca-74d0-4a40-9ba4-07d4563f2521 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:36.476101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f6792ca-74d0-4a40-9ba4-07d4563f2521 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:36.476581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f6792ca-74d0-4a40-9ba4-07d4563f2521 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:36.477002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f6792ca-74d0-4a40-9ba4-07d4563f2521 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:36.477855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f6792ca-74d0-4a40-9ba4-07d4563f2521 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:36.478295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f6792ca-74d0-4a40-9ba4-07d4563f2521 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:36.478846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f6792ca-74d0-4a40-9ba4-07d4563f2521 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:36.584202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91f28f4a-668c-4004-b582-097dc90424a3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:36.585588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-91f28f4a-668c-4004-b582-097dc90424a3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:36.593422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91f28f4a-668c-4004-b582-097dc90424a3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:36.594359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91f28f4a-668c-4004-b582-097dc90424a3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:36.595448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91f28f4a-668c-4004-b582-097dc90424a3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:36.599945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91f28f4a-668c-4004-b582-097dc90424a3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:36.600858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91f28f4a-668c-4004-b582-097dc90424a3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:36.601385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91f28f4a-668c-4004-b582-097dc90424a3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:36.826183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f6792ca-74d0-4a40-9ba4-07d4563f2521 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:36.834171 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5f6792ca-74d0-4a40-9ba4-07d4563f2521 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1510 microversion: 2.1 time: 0.369820 Aug 09 14:33:36.834756 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 425/811] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:36 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1510 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:36.844053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-43dbff2b-4115-4189-9d93-9b1920afd9a4 req-8507b790-3995-4a3f-b429-121e110952c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba6d964-167a-4b1e-94f0-fb74f63c03f1", "name": "network-vif-plugged", "status": "completed", "tag": "e4f9d82e-39ab-4f23-91b4-e30a41b072c4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:36.855933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-43dbff2b-4115-4189-9d93-9b1920afd9a4 req-8507b790-3995-4a3f-b429-121e110952c6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:36.856521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-43dbff2b-4115-4189-9d93-9b1920afd9a4 req-8507b790-3995-4a3f-b429-121e110952c6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:36.857110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-43dbff2b-4115-4189-9d93-9b1920afd9a4 req-8507b790-3995-4a3f-b429-121e110952c6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:36.873076 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-43dbff2b-4115-4189-9d93-9b1920afd9a4 req-8507b790-3995-4a3f-b429-121e110952c6 service nova] Creating event network-vif-plugged:e4f9d82e-39ab-4f23-91b4-e30a41b072c4 for instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 on n-h2-844626-8 Aug 09 14:33:36.884632 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-43dbff2b-4115-4189-9d93-9b1920afd9a4 req-8507b790-3995-4a3f-b429-121e110952c6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048099 Aug 09 14:33:36.885786 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 426/812] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:36.891976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-49f15a66-d34d-46cd-97cf-db77ab0d0613 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:36.895265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-49f15a66-d34d-46cd-97cf-db77ab0d0613 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:36.902585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-91f28f4a-668c-4004-b582-097dc90424a3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:36.910357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49f15a66-d34d-46cd-97cf-db77ab0d0613 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:36.910882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49f15a66-d34d-46cd-97cf-db77ab0d0613 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:36.911717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49f15a66-d34d-46cd-97cf-db77ab0d0613 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:36.912587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49f15a66-d34d-46cd-97cf-db77ab0d0613 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:36.913172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49f15a66-d34d-46cd-97cf-db77ab0d0613 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:36.914016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49f15a66-d34d-46cd-97cf-db77ab0d0613 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:36.930437 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91f28f4a-668c-4004-b582-097dc90424a3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1309 microversion: 2.1 time: 0.352264 Aug 09 14:33:36.935835 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 387/813] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:36 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1309 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:36.954744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16874de7-53c5-412c-98c6-166b9dac1969 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:36.958757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-16874de7-53c5-412c-98c6-166b9dac1969 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:36.970485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16874de7-53c5-412c-98c6-166b9dac1969 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:36.970982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16874de7-53c5-412c-98c6-166b9dac1969 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:36.971442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16874de7-53c5-412c-98c6-166b9dac1969 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:36.972169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16874de7-53c5-412c-98c6-166b9dac1969 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:36.972642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16874de7-53c5-412c-98c6-166b9dac1969 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:36.973048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16874de7-53c5-412c-98c6-166b9dac1969 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:37.288344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-49f15a66-d34d-46cd-97cf-db77ab0d0613 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:37.293532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:37.300660 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-49f15a66-d34d-46cd-97cf-db77ab0d0613 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1317 microversion: 2.1 time: 0.413321 Aug 09 14:33:37.301576 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 427/814] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:36 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:37.307351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-16874de7-53c5-412c-98c6-166b9dac1969 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:37.316365 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16874de7-53c5-412c-98c6-166b9dac1969 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1316 microversion: 2.1 time: 0.372091 Aug 09 14:33:37.317235 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 388/815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:36 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:37.369838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17fddb93-3f54-4df0-bc11-31d6442ddbc8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:37.372370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17fddb93-3f54-4df0-bc11-31d6442ddbc8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:37.381193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17fddb93-3f54-4df0-bc11-31d6442ddbc8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:37.381927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17fddb93-3f54-4df0-bc11-31d6442ddbc8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:37.382530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17fddb93-3f54-4df0-bc11-31d6442ddbc8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:37.383608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17fddb93-3f54-4df0-bc11-31d6442ddbc8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:37.384207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17fddb93-3f54-4df0-bc11-31d6442ddbc8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:37.384774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17fddb93-3f54-4df0-bc11-31d6442ddbc8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:37.672099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-17fddb93-3f54-4df0-bc11-31d6442ddbc8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:37.681453 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17fddb93-3f54-4df0-bc11-31d6442ddbc8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.316860 Aug 09 14:33:37.682212 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 428/816] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:37 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:37.856624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d32505cf-aef6-4ada-97b5-0faa491fc397 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:37.857519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d32505cf-aef6-4ada-97b5-0faa491fc397 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:37.864369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d32505cf-aef6-4ada-97b5-0faa491fc397 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:37.865293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d32505cf-aef6-4ada-97b5-0faa491fc397 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:37.866049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d32505cf-aef6-4ada-97b5-0faa491fc397 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:37.866727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d32505cf-aef6-4ada-97b5-0faa491fc397 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:37.867372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d32505cf-aef6-4ada-97b5-0faa491fc397 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:37.867982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d32505cf-aef6-4ada-97b5-0faa491fc397 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:37.953494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f195798-970b-4354-8b7b-6a60d4d2337a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:37.954094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3f195798-970b-4354-8b7b-6a60d4d2337a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:37.956763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:37.968023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f195798-970b-4354-8b7b-6a60d4d2337a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:37.968617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f195798-970b-4354-8b7b-6a60d4d2337a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:37.969571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f195798-970b-4354-8b7b-6a60d4d2337a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:37.970367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f195798-970b-4354-8b7b-6a60d4d2337a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:37.970951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f195798-970b-4354-8b7b-6a60d4d2337a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:37.972734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f195798-970b-4354-8b7b-6a60d4d2337a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:38.365342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d32505cf-aef6-4ada-97b5-0faa491fc397 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:38.382271 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d32505cf-aef6-4ada-97b5-0faa491fc397 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1510 microversion: 2.1 time: 0.528478 Aug 09 14:33:38.385085 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 389/817] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:37 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1510 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:38.395987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1c26259f-67ed-4136-8176-a0afe4520cb8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:38.397289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1c26259f-67ed-4136-8176-a0afe4520cb8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:38.413479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c26259f-67ed-4136-8176-a0afe4520cb8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:38.414613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c26259f-67ed-4136-8176-a0afe4520cb8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:38.416249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c26259f-67ed-4136-8176-a0afe4520cb8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:38.417550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c26259f-67ed-4136-8176-a0afe4520cb8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:38.418332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c26259f-67ed-4136-8176-a0afe4520cb8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:38.419062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c26259f-67ed-4136-8176-a0afe4520cb8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:38.437955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3f195798-970b-4354-8b7b-6a60d4d2337a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:38.450396 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3f195798-970b-4354-8b7b-6a60d4d2337a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1309 microversion: 2.1 time: 0.500692 Aug 09 14:33:38.460668 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 429/818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:37 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1309 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:38.480509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55c27d16-7ad4-49a0-aa12-97868fdc8187 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:38.481116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55c27d16-7ad4-49a0-aa12-97868fdc8187 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:38.497315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55c27d16-7ad4-49a0-aa12-97868fdc8187 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:38.497808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55c27d16-7ad4-49a0-aa12-97868fdc8187 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:38.498748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55c27d16-7ad4-49a0-aa12-97868fdc8187 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:38.499493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55c27d16-7ad4-49a0-aa12-97868fdc8187 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:38.499942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55c27d16-7ad4-49a0-aa12-97868fdc8187 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:38.500361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55c27d16-7ad4-49a0-aa12-97868fdc8187 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:39.102334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1c26259f-67ed-4136-8176-a0afe4520cb8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:39.110827 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1c26259f-67ed-4136-8176-a0afe4520cb8 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1317 microversion: 2.1 time: 0.724420 Aug 09 14:33:39.120156 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 390/819] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:38 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:39.127890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14944845-be91-4fe9-9fec-48a1dba425d3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:39.128769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14944845-be91-4fe9-9fec-48a1dba425d3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:39.135446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14944845-be91-4fe9-9fec-48a1dba425d3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:39.136225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14944845-be91-4fe9-9fec-48a1dba425d3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:39.136823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14944845-be91-4fe9-9fec-48a1dba425d3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:39.137697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14944845-be91-4fe9-9fec-48a1dba425d3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:39.138446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14944845-be91-4fe9-9fec-48a1dba425d3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:39.139388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14944845-be91-4fe9-9fec-48a1dba425d3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:39.157384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-55c27d16-7ad4-49a0-aa12-97868fdc8187 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:39.168909 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-55c27d16-7ad4-49a0-aa12-97868fdc8187 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1316 microversion: 2.1 time: 0.706944 Aug 09 14:33:39.171567 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 430/820] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:38 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1316 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:39.179598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ad8be6e7-725c-4fde-9185-e64d9fb6d4b6 req-75f2b8eb-6cf4-47f6-8013-a10bf54d460b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261b33cd-d9c1-42bc-bb0e-3836fae12d34", "name": "network-vif-plugged", "status": "completed", "tag": "deab8750-c5ac-4d07-a63f-ee59f7fa7a73"}, {"server_uuid": "bd9360b9-5620-4fa1-819c-90485da8e233", "name": "network-vif-plugged", "status": "completed", "tag": "5bd1019d-0599-4147-9f78-e7a7f2989303"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:39.210189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ad8be6e7-725c-4fde-9185-e64d9fb6d4b6 req-75f2b8eb-6cf4-47f6-8013-a10bf54d460b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:39.213333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ad8be6e7-725c-4fde-9185-e64d9fb6d4b6 req-75f2b8eb-6cf4-47f6-8013-a10bf54d460b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:39.220350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ad8be6e7-725c-4fde-9185-e64d9fb6d4b6 req-75f2b8eb-6cf4-47f6-8013-a10bf54d460b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:39.254850 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ad8be6e7-725c-4fde-9185-e64d9fb6d4b6 req-75f2b8eb-6cf4-47f6-8013-a10bf54d460b service nova] Creating event network-vif-plugged:deab8750-c5ac-4d07-a63f-ee59f7fa7a73 for instance 261b33cd-d9c1-42bc-bb0e-3836fae12d34 on n-h1-844626-8 Aug 09 14:33:39.257650 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ad8be6e7-725c-4fde-9185-e64d9fb6d4b6 req-75f2b8eb-6cf4-47f6-8013-a10bf54d460b service nova] Creating event network-vif-plugged:5bd1019d-0599-4147-9f78-e7a7f2989303 for instance bd9360b9-5620-4fa1-819c-90485da8e233 on n-h2-844626-8 Aug 09 14:33:39.274956 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ad8be6e7-725c-4fde-9185-e64d9fb6d4b6 req-75f2b8eb-6cf4-47f6-8013-a10bf54d460b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.101935 Aug 09 14:33:39.278020 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 431/821] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:39.289612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f82f86f5-abe2-47bb-9a6c-1a6400e06577 req-bd7b0809-d6ab-457d-af5b-ab4700fa0c66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "093134a3-712a-416c-acbe-15ea40bcfe79", "name": "network-vif-deleted", "tag": "c9cee52a-c76d-4ebe-b6f5-9aa50144777b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:39.311441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f82f86f5-abe2-47bb-9a6c-1a6400e06577 req-bd7b0809-d6ab-457d-af5b-ab4700fa0c66 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:39.315148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f82f86f5-abe2-47bb-9a6c-1a6400e06577 req-bd7b0809-d6ab-457d-af5b-ab4700fa0c66 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:39.317438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f82f86f5-abe2-47bb-9a6c-1a6400e06577 req-bd7b0809-d6ab-457d-af5b-ab4700fa0c66 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:39.347710 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f82f86f5-abe2-47bb-9a6c-1a6400e06577 req-bd7b0809-d6ab-457d-af5b-ab4700fa0c66 service nova] Creating event network-vif-deleted:c9cee52a-c76d-4ebe-b6f5-9aa50144777b for instance 093134a3-712a-416c-acbe-15ea40bcfe79 on n-h1-844626-8 Aug 09 14:33:39.361662 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f82f86f5-abe2-47bb-9a6c-1a6400e06577 req-bd7b0809-d6ab-457d-af5b-ab4700fa0c66 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079630 Aug 09 14:33:39.364576 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 432/822] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:39.383277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14944845-be91-4fe9-9fec-48a1dba425d3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:39.407453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:39.408336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:39.409847 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14944845-be91-4fe9-9fec-48a1dba425d3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.288397 Aug 09 14:33:39.417082 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 391/823] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:39 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:39.428669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:39.429176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:39.429619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:39.430338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:39.430787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:39.435031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:39.473442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-392e5f8a-0213-4680-b162-f2173a247650 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:39.474725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-392e5f8a-0213-4680-b162-f2173a247650 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:39.487313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-392e5f8a-0213-4680-b162-f2173a247650 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:39.489366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-392e5f8a-0213-4680-b162-f2173a247650 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:39.491372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-392e5f8a-0213-4680-b162-f2173a247650 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:39.492564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-392e5f8a-0213-4680-b162-f2173a247650 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:39.495502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-392e5f8a-0213-4680-b162-f2173a247650 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:39.498513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-392e5f8a-0213-4680-b162-f2173a247650 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:39.510756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:39.511339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:39.511682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:39.512292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lazy-loading 'fault' on Instance uuid 093134a3-712a-416c-acbe-15ea40bcfe79 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:33:39.617923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '538f392147114c069a8a5d1175f8c46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad30eb2eb9e94c2a8b7490f1e46a93d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:39.632382 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2f3d110b-43bd-4021-a732-7240d4d9cf2b tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 200 len: 1305 microversion: 2.1 time: 0.230134 Aug 09 14:33:39.632927 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 433/824] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:39 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 1305 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:39.732641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-392e5f8a-0213-4680-b162-f2173a247650 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:39.740439 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-392e5f8a-0213-4680-b162-f2173a247650 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1309 microversion: 2.1 time: 0.270967 Aug 09 14:33:39.751937 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 392/825] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:39 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1309 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:40.131658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ed7f39d-91fb-416d-8c47-c21a08c08cff tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:40.132634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ed7f39d-91fb-416d-8c47-c21a08c08cff tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:40.139863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ed7f39d-91fb-416d-8c47-c21a08c08cff tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.140589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ed7f39d-91fb-416d-8c47-c21a08c08cff tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.141274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ed7f39d-91fb-416d-8c47-c21a08c08cff tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.142330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ed7f39d-91fb-416d-8c47-c21a08c08cff tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.142935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ed7f39d-91fb-416d-8c47-c21a08c08cff tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.143723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ed7f39d-91fb-416d-8c47-c21a08c08cff tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.278277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-404a51fc-84c4-4b3d-ba42-ca2f6572105b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:40.279318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-404a51fc-84c4-4b3d-ba42-ca2f6572105b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:40.287124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-404a51fc-84c4-4b3d-ba42-ca2f6572105b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.288009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-404a51fc-84c4-4b3d-ba42-ca2f6572105b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.288836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-404a51fc-84c4-4b3d-ba42-ca2f6572105b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.289974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-404a51fc-84c4-4b3d-ba42-ca2f6572105b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.290661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-404a51fc-84c4-4b3d-ba42-ca2f6572105b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.291355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-404a51fc-84c4-4b3d-ba42-ca2f6572105b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.297903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:40.308899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ed7f39d-91fb-416d-8c47-c21a08c08cff tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:40.318397 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ed7f39d-91fb-416d-8c47-c21a08c08cff tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1317 microversion: 2.1 time: 0.190572 Aug 09 14:33:40.340622 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 434/826] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:40 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:40.432874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d930d00f-b6de-4fc3-9f6f-20804e9b1721 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:40.433494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d930d00f-b6de-4fc3-9f6f-20804e9b1721 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:40.445962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d930d00f-b6de-4fc3-9f6f-20804e9b1721 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.447067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d930d00f-b6de-4fc3-9f6f-20804e9b1721 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.447529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d930d00f-b6de-4fc3-9f6f-20804e9b1721 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.448246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d930d00f-b6de-4fc3-9f6f-20804e9b1721 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.448694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d930d00f-b6de-4fc3-9f6f-20804e9b1721 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.449113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d930d00f-b6de-4fc3-9f6f-20804e9b1721 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.470566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-404a51fc-84c4-4b3d-ba42-ca2f6572105b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:40.483038 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-404a51fc-84c4-4b3d-ba42-ca2f6572105b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1316 microversion: 2.1 time: 0.208839 Aug 09 14:33:40.485050 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 393/827] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:40 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:40.640406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d930d00f-b6de-4fc3-9f6f-20804e9b1721 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:40.650477 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d930d00f-b6de-4fc3-9f6f-20804e9b1721 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.221604 Aug 09 14:33:40.652088 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 435/828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:40 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:40.669239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-54f7e0b8-ef64-4a96-996d-77ec29b4d1a6 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:40.669940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-54f7e0b8-ef64-4a96-996d-77ec29b4d1a6 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:40.688204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54f7e0b8-ef64-4a96-996d-77ec29b4d1a6 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.690358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54f7e0b8-ef64-4a96-996d-77ec29b4d1a6 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.690902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54f7e0b8-ef64-4a96-996d-77ec29b4d1a6 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.692279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54f7e0b8-ef64-4a96-996d-77ec29b4d1a6 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.692895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54f7e0b8-ef64-4a96-996d-77ec29b4d1a6 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.693315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54f7e0b8-ef64-4a96-996d-77ec29b4d1a6 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.707619 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-54f7e0b8-ef64-4a96-996d-77ec29b4d1a6 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] HTTP exception thrown: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-54f7e0b8-ef64-4a96-996d-77ec29b4d1a6 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Request method failure captured: Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 HTTP/1.1 Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nApdFBbzu0AyUISXn2Vr7jgIMnWyUb8xMOss-lW440WO6OVUZ9WXCp4G2kW73OPnER_O9bFrYdpfaUbOand9T38IrPORDcFl3IYLd1gSrxcDTCTNlBNcm60LBX37Q9tqIzZiOA4Np6cjHei3AEPTdNdBo-nftJ4-yTRY4SdrU-e2cw Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:33:40.709539 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:33:40.710935 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ad30eb2eb9e94c2a8b7490f1e46a93d6", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:40.710935 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.710935 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.710935 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.710935 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.710935 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:33:40.710935 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:33:40.710935 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 538f392147114c069a8a5d1175f8c46e Aug 09 14:33:40.710935 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.710935 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:33:40.710935 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.710935 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '093134a3-712a-416c-acbe-15ea40bcfe79'} Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:40.712036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.713902 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.716077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-54f7e0b8-ef64-4a96-996d-77ec29b4d1a6 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Returning 404 to user: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:40.716077 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-54f7e0b8-ef64-4a96-996d-77ec29b4d1a6 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 404 len: 111 microversion: 2.1 time: 0.061783 Aug 09 14:33:40.716077 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 394/829] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:40 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:33:40.720428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d61b503-1070-4f64-b51f-c8cdc52c9a3e tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1473185097", "metadata": {"image_type": "test"}}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:40.724397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d61b503-1070-4f64-b51f-c8cdc52c9a3e tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:40.733718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d61b503-1070-4f64-b51f-c8cdc52c9a3e tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.734213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d61b503-1070-4f64-b51f-c8cdc52c9a3e tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.734642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d61b503-1070-4f64-b51f-c8cdc52c9a3e tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.735430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d61b503-1070-4f64-b51f-c8cdc52c9a3e tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.736014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d61b503-1070-4f64-b51f-c8cdc52c9a3e tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.736433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d61b503-1070-4f64-b51f-c8cdc52c9a3e tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.751036 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6d61b503-1070-4f64-b51f-c8cdc52c9a3e tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] HTTP exception thrown: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d61b503-1070-4f64-b51f-c8cdc52c9a3e tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Request method failure captured: Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79/action HTTP/1.1 Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 112 Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nApdFBbzu0AyUISXn2Vr7jgIMnWyUb8xMOss-lW440WO6OVUZ9WXCp4G2kW73OPnER_O9bFrYdpfaUbOand9T38IrPORDcFl3IYLd1gSrxcDTCTNlBNcm60LBX37Q9tqIzZiOA4Np6cjHei3AEPTdNdBo-nftJ4-yTRY4SdrU-e2cw Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:33:40.752816 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:33:40.754389 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ad30eb2eb9e94c2a8b7490f1e46a93d6", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:40.754389 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.754389 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.754389 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.754389 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.754389 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:33:40.754389 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:33:40.754389 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 538f392147114c069a8a5d1175f8c46e Aug 09 14:33:40.754389 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.754389 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:33:40.754389 n-d-844626-8 devstack@n-api.service[119406]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1473185097", "metadata": {"image_type": "test"}}} Aug 09 14:33:40.754389 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '093134a3-712a-416c-acbe-15ea40bcfe79', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1473185097', 'metadata': {'image_type': 'test'}}}} Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.756902 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.758300 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.759699 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.759699 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:40.759699 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:40.759699 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.759699 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.759699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d61b503-1070-4f64-b51f-c8cdc52c9a3e tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Returning 404 to user: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:40.759699 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d61b503-1070-4f64-b51f-c8cdc52c9a3e tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "POST /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79/action" status: 404 len: 111 microversion: 2.1 time: 0.037930 Aug 09 14:33:40.759699 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 436/830] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Aug 9 14:33:40 2022] POST /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:33:40.765973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58688b78-cf79-4378-a28a-dfe66d726ba2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:40.766164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eee2eb6d-5400-45a2-8ae8-90919f7be986 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-442648212", "metadata": {"image_type": "test"}}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:40.768794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eee2eb6d-5400-45a2-8ae8-90919f7be986 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Failed to fetch instance by id tempest-invalid-134335698 {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 14:33:40.769640 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-eee2eb6d-5400-45a2-8ae8-90919f7be986 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] HTTP exception thrown: Instance tempest-invalid-134335698 could not be found. Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eee2eb6d-5400-45a2-8ae8-90919f7be986 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Request method failure captured: Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/tempest-invalid-134335698/action HTTP/1.1 Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 111 Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nApdFBbzu0AyUISXn2Vr7jgIMnWyUb8xMOss-lW440WO6OVUZ9WXCp4G2kW73OPnER_O9bFrYdpfaUbOand9T38IrPORDcFl3IYLd1gSrxcDTCTNlBNcm60LBX37Q9tqIzZiOA4Np6cjHei3AEPTdNdBo-nftJ4-yTRY4SdrU-e2cw Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:33:40.771759 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:33:40.773281 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ad30eb2eb9e94c2a8b7490f1e46a93d6", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:40.773281 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.773281 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.773281 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.773281 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.773281 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:33:40.773281 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:33:40.773281 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 538f392147114c069a8a5d1175f8c46e Aug 09 14:33:40.773281 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.773281 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:33:40.773281 n-d-844626-8 devstack@n-api.service[119406]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-442648212", "metadata": {"image_type": "test"}}} Aug 09 14:33:40.773281 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance tempest-invalid-134335698 could not be found. Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'tempest-invalid-134335698', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-442648212', 'metadata': {'image_type': 'test'}}}} Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-134335698 could not be found. Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:40.774131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-134335698 could not be found. Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-134335698 could not be found. Aug 09 14:33:40.775591 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.777111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eee2eb6d-5400-45a2-8ae8-90919f7be986 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Returning 404 to user: Instance tempest-invalid-134335698 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:40.777208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58688b78-cf79-4378-a28a-dfe66d726ba2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:40.777306 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eee2eb6d-5400-45a2-8ae8-90919f7be986 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "POST /compute/v2.1/servers/tempest-invalid-134335698/action" status: 404 len: 100 microversion: 2.1 time: 0.013427 Aug 09 14:33:40.777701 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 437/831] 10.222.0.50 () {60 vars in 1246 bytes} [Tue Aug 9 14:33:40 2022] POST /compute/v2.1/servers/tempest-invalid-134335698/action => generated 100 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:33:40.789148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-411a3d9b-c9b0-4b6e-bfda-9d17a649ceeb tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1654359536"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:40.791669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-411a3d9b-c9b0-4b6e-bfda-9d17a649ceeb tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 14:33:40.792874 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-411a3d9b-c9b0-4b6e-bfda-9d17a649ceeb tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 14:33:40.795599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58688b78-cf79-4378-a28a-dfe66d726ba2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-411a3d9b-c9b0-4b6e-bfda-9d17a649ceeb tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Request method failure captured: Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 57 Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nApdFBbzu0AyUISXn2Vr7jgIMnWyUb8xMOss-lW440WO6OVUZ9WXCp4G2kW73OPnER_O9bFrYdpfaUbOand9T38IrPORDcFl3IYLd1gSrxcDTCTNlBNcm60LBX37Q9tqIzZiOA4Np6cjHei3AEPTdNdBo-nftJ4-yTRY4SdrU-e2cw Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:33:40.795757 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ad30eb2eb9e94c2a8b7490f1e46a93d6", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 538f392147114c069a8a5d1175f8c46e Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: {"createImage": {"name": "tempest-test-snap-1654359536"}} Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:33:40.797301 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1654359536'}}} Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:40.798226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 14:33:40.799526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.800687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58688b78-cf79-4378-a28a-dfe66d726ba2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.800811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-411a3d9b-c9b0-4b6e-bfda-9d17a649ceeb tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:40.800895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58688b78-cf79-4378-a28a-dfe66d726ba2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.800986 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-411a3d9b-c9b0-4b6e-bfda-9d17a649ceeb tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.015265 Aug 09 14:33:40.801066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58688b78-cf79-4378-a28a-dfe66d726ba2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.801141 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 438/832] 10.222.0.50 () {60 vars in 1275 bytes} [Tue Aug 9 14:33:40 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:33:40.801213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58688b78-cf79-4378-a28a-dfe66d726ba2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.801213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58688b78-cf79-4378-a28a-dfe66d726ba2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.826351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73cb73b9-90a0-45ad-802c-6b66170230e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1894753388"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:40.831885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-73cb73b9-90a0-45ad-802c-6b66170230e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 14:33:40.832421 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-73cb73b9-90a0-45ad-802c-6b66170230e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73cb73b9-90a0-45ad-802c-6b66170230e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Request method failure captured: Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 57 Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nApdFBbzu0AyUISXn2Vr7jgIMnWyUb8xMOss-lW440WO6OVUZ9WXCp4G2kW73OPnER_O9bFrYdpfaUbOand9T38IrPORDcFl3IYLd1gSrxcDTCTNlBNcm60LBX37Q9tqIzZiOA4Np6cjHei3AEPTdNdBo-nftJ4-yTRY4SdrU-e2cw Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:33:40.834013 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ad30eb2eb9e94c2a8b7490f1e46a93d6", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 538f392147114c069a8a5d1175f8c46e Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: {"createImage": {"name": "tempest-test-snap-1894753388"}} Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:33:40.835550 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1894753388'}}} Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:40.836381 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 09 14:33:40.837714 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.838836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73cb73b9-90a0-45ad-802c-6b66170230e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:40.838836 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-73cb73b9-90a0-45ad-802c-6b66170230e8 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.029603 Aug 09 14:33:40.841237 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 439/833] 10.222.0.50 () {60 vars in 1281 bytes} [Tue Aug 9 14:33:40 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:33:40.846258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b681769-56aa-4d6d-af75-dda9c6153dda tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:40.846761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b681769-56aa-4d6d-af75-dda9c6153dda tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:40.853515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b681769-56aa-4d6d-af75-dda9c6153dda tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.854266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b681769-56aa-4d6d-af75-dda9c6153dda tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.854895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b681769-56aa-4d6d-af75-dda9c6153dda tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.855946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b681769-56aa-4d6d-af75-dda9c6153dda tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.856775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b681769-56aa-4d6d-af75-dda9c6153dda tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.858686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b681769-56aa-4d6d-af75-dda9c6153dda tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.898235 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-9b681769-56aa-4d6d-af75-dda9c6153dda tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] HTTP exception thrown: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b681769-56aa-4d6d-af75-dda9c6153dda tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Request method failure captured: Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 HTTP/1.1 Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nApdFBbzu0AyUISXn2Vr7jgIMnWyUb8xMOss-lW440WO6OVUZ9WXCp4G2kW73OPnER_O9bFrYdpfaUbOand9T38IrPORDcFl3IYLd1gSrxcDTCTNlBNcm60LBX37Q9tqIzZiOA4Np6cjHei3AEPTdNdBo-nftJ4-yTRY4SdrU-e2cw Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:33:40.900558 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:33:40.901823 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ad30eb2eb9e94c2a8b7490f1e46a93d6", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:40.901823 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.901823 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.901823 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.901823 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.901823 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:33:40.901823 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:33:40.901823 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 538f392147114c069a8a5d1175f8c46e Aug 09 14:33:40.901823 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.901823 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:33:40.901823 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.901823 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '093134a3-712a-416c-acbe-15ea40bcfe79'} Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:40.902520 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.903783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.906623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b681769-56aa-4d6d-af75-dda9c6153dda tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Returning 404 to user: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:40.908338 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b681769-56aa-4d6d-af75-dda9c6153dda tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "DELETE /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 404 len: 111 microversion: 2.1 time: 0.066097 Aug 09 14:33:40.912659 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 440/834] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:33:40 2022] DELETE /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:33:40.925579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82f5df7b-4cb8-4eba-ba20-54d790db2d74 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:40.926346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-82f5df7b-4cb8-4eba-ba20-54d790db2d74 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] [instance: 093134a3-712a-416c-acbe-15ea40bcfe79] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:40.934547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82f5df7b-4cb8-4eba-ba20-54d790db2d74 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.935565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82f5df7b-4cb8-4eba-ba20-54d790db2d74 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.936298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82f5df7b-4cb8-4eba-ba20-54d790db2d74 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.937235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82f5df7b-4cb8-4eba-ba20-54d790db2d74 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:40.939899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82f5df7b-4cb8-4eba-ba20-54d790db2d74 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:40.943355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82f5df7b-4cb8-4eba-ba20-54d790db2d74 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:40.963856 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-82f5df7b-4cb8-4eba-ba20-54d790db2d74 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] HTTP exception thrown: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82f5df7b-4cb8-4eba-ba20-54d790db2d74 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Request method failure captured: Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 HTTP/1.1 Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nApdFBbzu0AyUISXn2Vr7jgIMnWyUb8xMOss-lW440WO6OVUZ9WXCp4G2kW73OPnER_O9bFrYdpfaUbOand9T38IrPORDcFl3IYLd1gSrxcDTCTNlBNcm60LBX37Q9tqIzZiOA4Np6cjHei3AEPTdNdBo-nftJ4-yTRY4SdrU-e2cw Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:33:40.968900 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:33:40.971313 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ad30eb2eb9e94c2a8b7490f1e46a93d6", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad30eb2eb9e94c2a8b7490f1e46a93d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:40.971313 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.971313 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ad30eb2eb9e94c2a8b7490f1e46a93d6 Aug 09 14:33:40.971313 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1570241027 Aug 09 14:33:40.971313 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.971313 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:33:40.971313 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:33:40.971313 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 538f392147114c069a8a5d1175f8c46e Aug 09 14:33:40.971313 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesNegativeTestJSON-1570241027-project Aug 09 14:33:40.971313 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:33:40.971313 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.971313 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '093134a3-712a-416c-acbe-15ea40bcfe79'} Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:40.972080 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. Aug 09 14:33:40.973403 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:40.975310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82f5df7b-4cb8-4eba-ba20-54d790db2d74 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] Returning 404 to user: Instance 093134a3-712a-416c-acbe-15ea40bcfe79 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:40.978533 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-82f5df7b-4cb8-4eba-ba20-54d790db2d74 tempest-ImagesNegativeTestJSON-1570241027 tempest-ImagesNegativeTestJSON-1570241027-project] 10.222.0.50 "GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79" status: 404 len: 111 microversion: 2.1 time: 0.064214 Aug 09 14:33:40.979796 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 441/835] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:40 2022] GET /compute/v2.1/servers/093134a3-712a-416c-acbe-15ea40bcfe79 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:33:41.157688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-58688b78-cf79-4378-a28a-dfe66d726ba2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:41.172934 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58688b78-cf79-4378-a28a-dfe66d726ba2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1309 microversion: 2.1 time: 0.407819 Aug 09 14:33:41.173634 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 395/836] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:40 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1309 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:41.283833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32e0391c-1bef-4d41-abf5-b6a07c2398bc tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:41.284331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-32e0391c-1bef-4d41-abf5-b6a07c2398bc tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:41.301189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32e0391c-1bef-4d41-abf5-b6a07c2398bc tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:41.301669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32e0391c-1bef-4d41-abf5-b6a07c2398bc tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:41.302611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32e0391c-1bef-4d41-abf5-b6a07c2398bc tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:41.303504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32e0391c-1bef-4d41-abf5-b6a07c2398bc tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:41.304118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32e0391c-1bef-4d41-abf5-b6a07c2398bc tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:41.304684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32e0391c-1bef-4d41-abf5-b6a07c2398bc tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:41.338220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-68e2a044-7a38-4235-963c-16b4d71b8e45 req-71185f02-1057-4b05-91be-f9d51205ca06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c29a36e-08bc-48f8-ae8c-029a5dbf060f", "name": "network-vif-plugged", "status": "completed", "tag": "2137f1f1-d9de-48cb-9103-f3fd05beec4f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:41.341173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-32e0391c-1bef-4d41-abf5-b6a07c2398bc tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:33:41.358330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-68e2a044-7a38-4235-963c-16b4d71b8e45 req-71185f02-1057-4b05-91be-f9d51205ca06 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:41.360499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-68e2a044-7a38-4235-963c-16b4d71b8e45 req-71185f02-1057-4b05-91be-f9d51205ca06 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:41.361131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-68e2a044-7a38-4235-963c-16b4d71b8e45 req-71185f02-1057-4b05-91be-f9d51205ca06 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:41.383676 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-68e2a044-7a38-4235-963c-16b4d71b8e45 req-71185f02-1057-4b05-91be-f9d51205ca06 service nova] Creating event network-vif-plugged:2137f1f1-d9de-48cb-9103-f3fd05beec4f for instance 5c29a36e-08bc-48f8-ae8c-029a5dbf060f on n-h1-844626-8 Aug 09 14:33:41.403601 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-68e2a044-7a38-4235-963c-16b4d71b8e45 req-71185f02-1057-4b05-91be-f9d51205ca06 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070296 Aug 09 14:33:41.404854 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 396/837] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:41.425509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-50d8e924-1aad-4cc9-bcce-d2dfbba6a0b7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:41.428009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-50d8e924-1aad-4cc9-bcce-d2dfbba6a0b7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:41.441912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50d8e924-1aad-4cc9-bcce-d2dfbba6a0b7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:41.442566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50d8e924-1aad-4cc9-bcce-d2dfbba6a0b7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:41.443216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50d8e924-1aad-4cc9-bcce-d2dfbba6a0b7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:41.444167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50d8e924-1aad-4cc9-bcce-d2dfbba6a0b7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:41.444718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50d8e924-1aad-4cc9-bcce-d2dfbba6a0b7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:41.445237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50d8e924-1aad-4cc9-bcce-d2dfbba6a0b7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:41.525020 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32e0391c-1bef-4d41-abf5-b6a07c2398bc tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 204 len: 0 microversion: 2.1 time: 0.244271 Aug 09 14:33:41.533737 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 442/838] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:33:41 2022] DELETE /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:33:41.545938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d7ae7b2-8473-44ea-a982-4192d4ad48b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:41.546636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d7ae7b2-8473-44ea-a982-4192d4ad48b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:41.564301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d7ae7b2-8473-44ea-a982-4192d4ad48b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:41.564802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d7ae7b2-8473-44ea-a982-4192d4ad48b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:41.566357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d7ae7b2-8473-44ea-a982-4192d4ad48b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:41.568510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d7ae7b2-8473-44ea-a982-4192d4ad48b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:41.569025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d7ae7b2-8473-44ea-a982-4192d4ad48b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:41.571490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d7ae7b2-8473-44ea-a982-4192d4ad48b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:41.866848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-50d8e924-1aad-4cc9-bcce-d2dfbba6a0b7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:41.874723 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50d8e924-1aad-4cc9-bcce-d2dfbba6a0b7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1466 microversion: 2.1 time: 0.468523 Aug 09 14:33:41.875339 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 397/839] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:41 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1466 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:41.905364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0d7ae7b2-8473-44ea-a982-4192d4ad48b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:41.913267 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d7ae7b2-8473-44ea-a982-4192d4ad48b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1316 microversion: 2.1 time: 0.386065 Aug 09 14:33:41.913843 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 443/840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:41 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:41.921538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-510185828", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "1478225061", "adminPass": "***", "networks": [{"uuid": "6df883f8-2d60-4d64-8837-2c2d82e3a648"}], "security_groups": [{"name": "tempest-securitygroup--2050609474"}], "key_name": "tempest-keypair-1853064886", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:42.055528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-437062a4-fcfc-4406-99a4-d256da3daf75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: .version_select at 0x7f41dd697e50>, body: {"keypair": {"name": "tempest-keypair-907006119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQg/Vo6vz7Nj9MvJr6D4aqRrZ7Zmk5tETk533YzKKg2T+tyu2BOpX1pjrru0/6nerjmITFiI+FBqj4hD7YHReAYoU3zeREkaKPjH2WNi/axFJISHHjutm6CxM5yACDLJg=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:42.071285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-437062a4-fcfc-4406-99a4-d256da3daf75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:42.075962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-437062a4-fcfc-4406-99a4-d256da3daf75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for user 788fc5ec92a2482db1b27657c4f6b426 and project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:42.099420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] validate_networks() for [('6df883f8-2d60-4d64-8837-2c2d82e3a648', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:33:42.108343 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-437062a4-fcfc-4406-99a4-d256da3daf75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.231806 Aug 09 14:33:42.109244 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 398/841] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:33:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:42.119064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ce6caf76-5eb4-428c-8768-8d5dd50c24be tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:42.119859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ce6caf76-5eb4-428c-8768-8d5dd50c24be tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:42.126433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce6caf76-5eb4-428c-8768-8d5dd50c24be tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:42.127178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce6caf76-5eb4-428c-8768-8d5dd50c24be tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:42.127804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce6caf76-5eb4-428c-8768-8d5dd50c24be tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:42.128707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce6caf76-5eb4-428c-8768-8d5dd50c24be tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:42.129342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce6caf76-5eb4-428c-8768-8d5dd50c24be tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:42.129940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce6caf76-5eb4-428c-8768-8d5dd50c24be tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:42.415932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce6caf76-5eb4-428c-8768-8d5dd50c24be tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:42.424717 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ce6caf76-5eb4-428c-8768-8d5dd50c24be tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.309947 Aug 09 14:33:42.425635 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 399/842] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:42 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:42.431534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-583c619e-22a8-42fe-9633-f66d7476c99a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:42.432965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-583c619e-22a8-42fe-9633-f66d7476c99a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:42.447071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-583c619e-22a8-42fe-9633-f66d7476c99a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:42.447615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-583c619e-22a8-42fe-9633-f66d7476c99a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:42.448042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-583c619e-22a8-42fe-9633-f66d7476c99a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:42.448742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-583c619e-22a8-42fe-9633-f66d7476c99a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:42.449184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-583c619e-22a8-42fe-9633-f66d7476c99a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:42.449743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-583c619e-22a8-42fe-9633-f66d7476c99a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:42.750951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-583c619e-22a8-42fe-9633-f66d7476c99a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:42.759571 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-583c619e-22a8-42fe-9633-f66d7476c99a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1" status: 200 len: 1468 microversion: 2.1 time: 0.332153 Aug 09 14:33:42.762660 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 400/843] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:42 2022] GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1 => generated 1468 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:42.783304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70f6598e-3f10-4c54-aa36-a6b5e946cc77 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:42.784191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-70f6598e-3f10-4c54-aa36-a6b5e946cc77 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:42.792299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70f6598e-3f10-4c54-aa36-a6b5e946cc77 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:42.792802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70f6598e-3f10-4c54-aa36-a6b5e946cc77 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:42.793429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70f6598e-3f10-4c54-aa36-a6b5e946cc77 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:42.794194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70f6598e-3f10-4c54-aa36-a6b5e946cc77 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:42.795201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70f6598e-3f10-4c54-aa36-a6b5e946cc77 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:42.796115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70f6598e-3f10-4c54-aa36-a6b5e946cc77 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:42.978665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:33:42.979295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:33:42.979566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:33:42.979970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:33:42.980373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:33:42.990288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:42.991118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:42.991861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:42.992773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:42.993372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:42.993950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:43.014949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Getting quotas for project ea5a1dc39fe54b69b5473a9f86dcd34b. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:43.020970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Getting quotas for user d11ef713c75d461291b2a6937db4a4b1 and project ea5a1dc39fe54b69b5473a9f86dcd34b. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:43.038188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:33:43.042274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:33:43.113363 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-89c69f01-603b-4801-98c2-c829ce1adf63 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.198155 Aug 09 14:33:43.114499 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 444/844] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:33:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:33:43.132077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dbe8005c-3bc4-41c1-917b-3a0f306b9b75 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1279004756"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:43.137315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dbe8005c-3bc4-41c1-917b-3a0f306b9b75 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:43.151405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-70f6598e-3f10-4c54-aa36-a6b5e946cc77 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:43.162924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbe8005c-3bc4-41c1-917b-3a0f306b9b75 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:43.163563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbe8005c-3bc4-41c1-917b-3a0f306b9b75 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:43.164091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbe8005c-3bc4-41c1-917b-3a0f306b9b75 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:43.164588 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70f6598e-3f10-4c54-aa36-a6b5e946cc77 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1491 microversion: 2.1 time: 0.386983 Aug 09 14:33:43.165184 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 401/845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:42 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1491 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:43.170476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c46a8c0-ac5c-4986-bd4d-72c172503d06 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:43.171077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c46a8c0-ac5c-4986-bd4d-72c172503d06 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:43.172309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbe8005c-3bc4-41c1-917b-3a0f306b9b75 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:43.172951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbe8005c-3bc4-41c1-917b-3a0f306b9b75 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:43.174526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbe8005c-3bc4-41c1-917b-3a0f306b9b75 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:43.205068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c46a8c0-ac5c-4986-bd4d-72c172503d06 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:43.208731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c46a8c0-ac5c-4986-bd4d-72c172503d06 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:43.215690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c46a8c0-ac5c-4986-bd4d-72c172503d06 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:43.217229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c46a8c0-ac5c-4986-bd4d-72c172503d06 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:43.219343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c46a8c0-ac5c-4986-bd4d-72c172503d06 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:43.221351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c46a8c0-ac5c-4986-bd4d-72c172503d06 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:43.515850 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dbe8005c-3bc4-41c1-917b-3a0f306b9b75 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "POST /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1/action" status: 202 len: 0 microversion: 2.1 time: 0.391694 Aug 09 14:33:43.516664 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 445/846] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:33:43 2022] POST /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 14:33:43.522951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60f68b1c-93df-4ae4-801f-2705db81817f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:43.524103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60f68b1c-93df-4ae4-801f-2705db81817f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:43.655590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60f68b1c-93df-4ae4-801f-2705db81817f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:43.671152 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60f68b1c-93df-4ae4-801f-2705db81817f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1264 microversion: 2.1 time: 0.152658 Aug 09 14:33:43.675914 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 446/847] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:43 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:43.682047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c46a8c0-ac5c-4986-bd4d-72c172503d06 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:43.689483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-25df76b1-672c-44b1-b7ae-7acb46e9dbe2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:43.694260 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c46a8c0-ac5c-4986-bd4d-72c172503d06 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1465 microversion: 2.1 time: 0.528054 Aug 09 14:33:43.695031 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 402/848] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:43 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1465 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:43.696629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-25df76b1-672c-44b1-b7ae-7acb46e9dbe2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:43.704679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4abcc57-e854-4e9c-beb9-e296a43ab6fe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:43.711057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4abcc57-e854-4e9c-beb9-e296a43ab6fe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:43.714061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25df76b1-672c-44b1-b7ae-7acb46e9dbe2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:43.714625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25df76b1-672c-44b1-b7ae-7acb46e9dbe2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:43.715068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25df76b1-672c-44b1-b7ae-7acb46e9dbe2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:43.715824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25df76b1-672c-44b1-b7ae-7acb46e9dbe2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:43.716276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25df76b1-672c-44b1-b7ae-7acb46e9dbe2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:43.716695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25df76b1-672c-44b1-b7ae-7acb46e9dbe2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:43.720066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4abcc57-e854-4e9c-beb9-e296a43ab6fe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:43.720772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4abcc57-e854-4e9c-beb9-e296a43ab6fe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:43.723942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4abcc57-e854-4e9c-beb9-e296a43ab6fe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:43.724833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4abcc57-e854-4e9c-beb9-e296a43ab6fe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:43.725604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4abcc57-e854-4e9c-beb9-e296a43ab6fe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:43.727049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4abcc57-e854-4e9c-beb9-e296a43ab6fe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:44.025806 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-25df76b1-672c-44b1-b7ae-7acb46e9dbe2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1642 microversion: 2.1 time: 0.348492 Aug 09 14:33:44.044648 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 447/849] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:43 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1642 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:44.049654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bc4bc9a-d8e1-4030-bcd4-5341fee850aa tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf5b280>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:44.126964 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8bc4bc9a-d8e1-4030-bcd4-5341fee850aa tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.081093 Aug 09 14:33:44.140303 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 448/850] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:44 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:44.228439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b4abcc57-e854-4e9c-beb9-e296a43ab6fe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:44.240790 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4abcc57-e854-4e9c-beb9-e296a43ab6fe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.544564 Aug 09 14:33:44.244943 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 403/851] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:43 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:44.251024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d82ba9cb-cb61-4c63-8967-6ecc14fbba1c tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:44.268201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d82ba9cb-cb61-4c63-8967-6ecc14fbba1c tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:44.286095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d82ba9cb-cb61-4c63-8967-6ecc14fbba1c tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:44.286839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d82ba9cb-cb61-4c63-8967-6ecc14fbba1c tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:44.287939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d82ba9cb-cb61-4c63-8967-6ecc14fbba1c tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:44.291810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d82ba9cb-cb61-4c63-8967-6ecc14fbba1c tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:44.292451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d82ba9cb-cb61-4c63-8967-6ecc14fbba1c tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:44.295666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d82ba9cb-cb61-4c63-8967-6ecc14fbba1c tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:44.406330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0e7dc577-e89a-45d1-830b-1e32f956908e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:44.407146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0e7dc577-e89a-45d1-830b-1e32f956908e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:44.422228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e7dc577-e89a-45d1-830b-1e32f956908e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:44.423018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e7dc577-e89a-45d1-830b-1e32f956908e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:44.423743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e7dc577-e89a-45d1-830b-1e32f956908e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:44.424519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e7dc577-e89a-45d1-830b-1e32f956908e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:44.425306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e7dc577-e89a-45d1-830b-1e32f956908e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:44.425940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e7dc577-e89a-45d1-830b-1e32f956908e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:44.662908 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d82ba9cb-cb61-4c63-8967-6ecc14fbba1c tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1642 microversion: 2.1 time: 0.414094 Aug 09 14:33:44.675137 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 404/852] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:44 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1642 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:44.688406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b131b25c-c28a-4500-9f97-760e565f9f5a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:44.694707 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:33:44.694707 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:33:44.697498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b131b25c-c28a-4500-9f97-760e565f9f5a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:44.698232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b131b25c-c28a-4500-9f97-760e565f9f5a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:44.699112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b131b25c-c28a-4500-9f97-760e565f9f5a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:44.700111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b131b25c-c28a-4500-9f97-760e565f9f5a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:44.701360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b131b25c-c28a-4500-9f97-760e565f9f5a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:44.702023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b131b25c-c28a-4500-9f97-760e565f9f5a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:44.748421 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b131b25c-c28a-4500-9f97-760e565f9f5a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.064757 Aug 09 14:33:44.750571 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 405/853] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 9 14:33:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:33:44.766044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-092d57c7-0c5d-440a-9d44-ba4dc5bbdfe5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:44.767753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-092d57c7-0c5d-440a-9d44-ba4dc5bbdfe5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:44.778808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:44.783152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-092d57c7-0c5d-440a-9d44-ba4dc5bbdfe5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:44.784215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-092d57c7-0c5d-440a-9d44-ba4dc5bbdfe5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:44.785025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-092d57c7-0c5d-440a-9d44-ba4dc5bbdfe5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:44.786196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-092d57c7-0c5d-440a-9d44-ba4dc5bbdfe5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:44.787419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-092d57c7-0c5d-440a-9d44-ba4dc5bbdfe5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:44.788163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-092d57c7-0c5d-440a-9d44-ba4dc5bbdfe5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:45.643392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-092d57c7-0c5d-440a-9d44-ba4dc5bbdfe5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:45.669461 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-092d57c7-0c5d-440a-9d44-ba4dc5bbdfe5 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1316 microversion: 2.1 time: 0.893417 Aug 09 14:33:45.673456 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 406/854] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:44 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1316 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:45.689765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e2fa97e8-0593-499c-b93d-44e30d56bac2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:45.690366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e2fa97e8-0593-499c-b93d-44e30d56bac2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:45.706590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2fa97e8-0593-499c-b93d-44e30d56bac2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:45.707282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2fa97e8-0593-499c-b93d-44e30d56bac2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:45.707900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2fa97e8-0593-499c-b93d-44e30d56bac2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:45.708971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2fa97e8-0593-499c-b93d-44e30d56bac2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:45.709797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2fa97e8-0593-499c-b93d-44e30d56bac2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:45.710487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2fa97e8-0593-499c-b93d-44e30d56bac2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:45.819925 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e2fa97e8-0593-499c-b93d-44e30d56bac2 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233/action" status: 202 len: 0 microversion: 2.1 time: 0.145048 Aug 09 14:33:45.820823 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 407/855] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:33:45 2022] POST /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:33:45.826211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4cd725ea-5f76-4ece-9e2f-22c415677878 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd68b430>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:45.901311 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4cd725ea-5f76-4ece-9e2f-22c415677878 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.079094 Aug 09 14:33:45.901891 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 408/856] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:45 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:45.907675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72fac498-1cb3-4c4d-83bd-53e92831b8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:45.908597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-72fac498-1cb3-4c4d-83bd-53e92831b8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:45.919814 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0e7dc577-e89a-45d1-830b-1e32f956908e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1616 microversion: 2.1 time: 1.778152 Aug 09 14:33:45.931588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72fac498-1cb3-4c4d-83bd-53e92831b8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:45.932422 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 449/857] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:44 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1616 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:45.932776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72fac498-1cb3-4c4d-83bd-53e92831b8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:45.933234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72fac498-1cb3-4c4d-83bd-53e92831b8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:45.936850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72fac498-1cb3-4c4d-83bd-53e92831b8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:45.938763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72fac498-1cb3-4c4d-83bd-53e92831b8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:45.944017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72fac498-1cb3-4c4d-83bd-53e92831b8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:45.944400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1672584230", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95a77029-1d4f-4aec-aada-849bacf4e174"}], "security_groups": [{"name": "tempest-securitygroup--1972985161"}], "key_name": "tempest-keypair-907006119", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:46.257978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] validate_networks() for [('95a77029-1d4f-4aec-aada-849bacf4e174', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:33:46.485135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-72fac498-1cb3-4c4d-83bd-53e92831b8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:46.496094 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72fac498-1cb3-4c4d-83bd-53e92831b8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1476 microversion: 2.1 time: 0.592860 Aug 09 14:33:46.497102 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 409/858] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:45 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1476 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:46.501657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-55e2cb3b-b5b1-4980-8569-bdb7bfafd212 req-a1eef94e-48ea-45ce-9079-62f1a8fb966d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d784e6b-2704-47cb-9cb5-225e4cace576", "name": "network-vif-deleted", "tag": "b17957b8-8774-4495-a6d4-74b4c7b3ef18"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:46.525998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-55e2cb3b-b5b1-4980-8569-bdb7bfafd212 req-a1eef94e-48ea-45ce-9079-62f1a8fb966d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:46.527844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-55e2cb3b-b5b1-4980-8569-bdb7bfafd212 req-a1eef94e-48ea-45ce-9079-62f1a8fb966d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:46.529498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-55e2cb3b-b5b1-4980-8569-bdb7bfafd212 req-a1eef94e-48ea-45ce-9079-62f1a8fb966d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:46.556939 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-55e2cb3b-b5b1-4980-8569-bdb7bfafd212 req-a1eef94e-48ea-45ce-9079-62f1a8fb966d service nova] Creating event network-vif-deleted:b17957b8-8774-4495-a6d4-74b4c7b3ef18 for instance 3d784e6b-2704-47cb-9cb5-225e4cace576 on n-h2-844626-8 Aug 09 14:33:46.563119 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-55e2cb3b-b5b1-4980-8569-bdb7bfafd212 req-a1eef94e-48ea-45ce-9079-62f1a8fb966d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064124 Aug 09 14:33:46.563119 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 410/859] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:46.571071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d97ba7ca-3dc1-4021-be64-8e90a9b7a8a6 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:46.572125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d97ba7ca-3dc1-4021-be64-8e90a9b7a8a6 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:46.578808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d97ba7ca-3dc1-4021-be64-8e90a9b7a8a6 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:46.579565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d97ba7ca-3dc1-4021-be64-8e90a9b7a8a6 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:46.580265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d97ba7ca-3dc1-4021-be64-8e90a9b7a8a6 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:46.580969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d97ba7ca-3dc1-4021-be64-8e90a9b7a8a6 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:46.581704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d97ba7ca-3dc1-4021-be64-8e90a9b7a8a6 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:46.582285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d97ba7ca-3dc1-4021-be64-8e90a9b7a8a6 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:47.023253 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d97ba7ca-3dc1-4021-be64-8e90a9b7a8a6 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1647 microversion: 2.1 time: 0.456268 Aug 09 14:33:47.024982 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 411/860] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:46 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1647 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:47.029715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99e4fee5-50fc-4805-a379-898af965a97d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Action: 'create', calling method: .version_select at 0x7f41dd705c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-172927575", "policies": ["affinity"]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:47.054698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-99e4fee5-50fc-4805-a379-898af965a97d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:47.060829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-99e4fee5-50fc-4805-a379-898af965a97d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:47.125844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-99e4fee5-50fc-4805-a379-898af965a97d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:47.131421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-99e4fee5-50fc-4805-a379-898af965a97d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:47.144021 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99e4fee5-50fc-4805-a379-898af965a97d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.117841 Aug 09 14:33:47.145120 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 412/861] 10.222.0.50 () {60 vars in 1174 bytes} [Tue Aug 9 14:33:47 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:47.149883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9eadf49-13d1-4726-9739-3090e2b30efd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:47.150628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9eadf49-13d1-4726-9739-3090e2b30efd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:47.156627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9eadf49-13d1-4726-9739-3090e2b30efd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:47.157231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9eadf49-13d1-4726-9739-3090e2b30efd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:47.157747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9eadf49-13d1-4726-9739-3090e2b30efd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:47.158523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9eadf49-13d1-4726-9739-3090e2b30efd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:47.159056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9eadf49-13d1-4726-9739-3090e2b30efd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:47.159860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9eadf49-13d1-4726-9739-3090e2b30efd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:47.334539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9eadf49-13d1-4726-9739-3090e2b30efd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:47.345307 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9eadf49-13d1-4726-9739-3090e2b30efd tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1322 microversion: 2.1 time: 0.198920 Aug 09 14:33:47.345901 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 413/862] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:47 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:47.350546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1723cfe-901d-4ab9-af8e-d8fd40a8cdad tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd685280>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:47.399077 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1723cfe-901d-4ab9-af8e-d8fd40a8cdad tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.052122 Aug 09 14:33:47.399845 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 414/863] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:47 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:47.404337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1593917668", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "c1f6b3ac-ca89-409d-a9f4-2ebde07115c6"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:47.462634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:33:47.485849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:33:47.486339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:33:47.486756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:33:47.487371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:33:47.487905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:33:47.498170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:47.498649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:47.499078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:47.499820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:47.500300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:47.500776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:47.507691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:47.523699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:47.529497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for user 788fc5ec92a2482db1b27657c4f6b426 and project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:47.542922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:33:47.545291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:33:47.623866 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b75f05a-8527-4e41-8d9f-5859827cc8cf tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.684424 Aug 09 14:33:47.631641 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 450/864] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:33:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:33:47.637815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-86323776-43b6-4dd1-854d-88b1ead0dbf6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:47.638736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-86323776-43b6-4dd1-854d-88b1ead0dbf6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:47.647394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86323776-43b6-4dd1-854d-88b1ead0dbf6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:47.647944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86323776-43b6-4dd1-854d-88b1ead0dbf6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:47.648488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86323776-43b6-4dd1-854d-88b1ead0dbf6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:47.649405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86323776-43b6-4dd1-854d-88b1ead0dbf6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:47.650037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86323776-43b6-4dd1-854d-88b1ead0dbf6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:47.650652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86323776-43b6-4dd1-854d-88b1ead0dbf6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:48.106436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:33:48.107490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:33:48.108510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:33:48.109095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:33:48.110150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:33:48.144427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-86323776-43b6-4dd1-854d-88b1ead0dbf6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:48.184240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:48.187552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:48.188303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:48.189823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:48.191032 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-86323776-43b6-4dd1-854d-88b1ead0dbf6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1475 microversion: 2.1 time: 0.557899 Aug 09 14:33:48.191675 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 451/865] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:47 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1475 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:48.192420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:48.193538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:48.218661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5b15e39f-2627-40a9-9863-a1c9aff5b88a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:48.221289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b15e39f-2627-40a9-9863-a1c9aff5b88a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:48.234170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:48.273158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:48.319312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Going to run 2 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:33:48.327298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 3f0246e9-8417-4083-8430-ceda68df0c44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:33:48.454004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119407) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 09 14:33:48.473813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5b15e39f-2627-40a9-9863-a1c9aff5b88a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:48.482136 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5b15e39f-2627-40a9-9863-a1c9aff5b88a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1241 microversion: 2.1 time: 0.289293 Aug 09 14:33:48.485419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:48.492821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:48.506413 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 452/866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:48 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1241 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:48.516984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ad029d4-3f1f-4ef5-a2b3-ce475ed5c6dd tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:48.517580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ad029d4-3f1f-4ef5-a2b3-ce475ed5c6dd tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:48.548595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ad029d4-3f1f-4ef5-a2b3-ce475ed5c6dd tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:48.549080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ad029d4-3f1f-4ef5-a2b3-ce475ed5c6dd tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:48.549513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ad029d4-3f1f-4ef5-a2b3-ce475ed5c6dd tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:48.550253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ad029d4-3f1f-4ef5-a2b3-ce475ed5c6dd tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:48.550861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ad029d4-3f1f-4ef5-a2b3-ce475ed5c6dd tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:48.557711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ad029d4-3f1f-4ef5-a2b3-ce475ed5c6dd tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:48.566588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:48.577002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:48.594650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=3f0246e9-8417-4083-8430-ceda68df0c44,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:33:48.677259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:48.683021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:48.733505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:48.772397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:48.779932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:48.827582 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-224b91e1-e2a0-47db-a093-3d16f3bf8bd0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.426344 Aug 09 14:33:48.828868 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 415/867] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:33:47 2022] POST /compute/v2.1/servers => generated 32 bytes in 1428 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 09 14:33:48.835313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34f1befb-3d34-4eb3-8d7e-7e4784466d0f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:48.836116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34f1befb-3d34-4eb3-8d7e-7e4784466d0f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:48.844746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34f1befb-3d34-4eb3-8d7e-7e4784466d0f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:48.845445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34f1befb-3d34-4eb3-8d7e-7e4784466d0f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:48.846033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34f1befb-3d34-4eb3-8d7e-7e4784466d0f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:48.847656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34f1befb-3d34-4eb3-8d7e-7e4784466d0f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:48.848272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34f1befb-3d34-4eb3-8d7e-7e4784466d0f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:48.848865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34f1befb-3d34-4eb3-8d7e-7e4784466d0f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:48.854615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:49.989157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-34f1befb-3d34-4eb3-8d7e-7e4784466d0f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:50.017155 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34f1befb-3d34-4eb3-8d7e-7e4784466d0f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1390 microversion: 2.1 time: 1.186632 Aug 09 14:33:50.019439 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 416/868] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:48 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1390 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:50.044938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-219e097f-19ff-46f1-b30e-b7493c221322 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd6484c0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:50.168821 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-219e097f-19ff-46f1-b30e-b7493c221322 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.141227 Aug 09 14:33:50.171888 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 417/869] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:50 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:50.197346 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ad029d4-3f1f-4ef5-a2b3-ce475ed5c6dd tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1627 microversion: 2.1 time: 1.689555 Aug 09 14:33:50.205031 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 453/870] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:48 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1627 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:50.221459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1607c534-8d50-427a-810c-b1336dc2332b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:50.223524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2dfce14-7a5a-40cb-a75e-ba357e93927a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:50.225663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1607c534-8d50-427a-810c-b1336dc2332b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:50.251785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1607c534-8d50-427a-810c-b1336dc2332b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:50.257182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1607c534-8d50-427a-810c-b1336dc2332b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:50.260157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1607c534-8d50-427a-810c-b1336dc2332b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:50.261340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1607c534-8d50-427a-810c-b1336dc2332b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:50.270860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1607c534-8d50-427a-810c-b1336dc2332b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:50.271603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1607c534-8d50-427a-810c-b1336dc2332b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:50.285322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2dfce14-7a5a-40cb-a75e-ba357e93927a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:50.287306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2dfce14-7a5a-40cb-a75e-ba357e93927a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Searching by: {'deleted': False, 'project_id': '9471973b988a4c31be31dde4cef1489e'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:33:50.364287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2dfce14-7a5a-40cb-a75e-ba357e93927a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:50.373459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2dfce14-7a5a-40cb-a75e-ba357e93927a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:50.374528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2dfce14-7a5a-40cb-a75e-ba357e93927a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:50.376981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2dfce14-7a5a-40cb-a75e-ba357e93927a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:50.380145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2dfce14-7a5a-40cb-a75e-ba357e93927a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:50.381580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2dfce14-7a5a-40cb-a75e-ba357e93927a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:50.447220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-a2dfce14-7a5a-40cb-a75e-ba357e93927a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Listed batch of 3 results from cell out of 999 limit. Returned 3 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:33:50.519909 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2dfce14-7a5a-40cb-a75e-ba357e93927a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.344226 Aug 09 14:33:50.522879 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 418/871] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 14:33:50 2022] GET /compute/v2.1/servers => generated 1003 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:50.544229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89705b55-57a3-474a-9a91-7f55be424410 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:50.551538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-89705b55-57a3-474a-9a91-7f55be424410 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:50.573248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89705b55-57a3-474a-9a91-7f55be424410 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:50.574058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89705b55-57a3-474a-9a91-7f55be424410 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:50.575240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89705b55-57a3-474a-9a91-7f55be424410 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:50.576736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89705b55-57a3-474a-9a91-7f55be424410 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:50.578698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89705b55-57a3-474a-9a91-7f55be424410 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:50.581051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89705b55-57a3-474a-9a91-7f55be424410 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:50.906411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-89705b55-57a3-474a-9a91-7f55be424410 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:50.921916 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-89705b55-57a3-474a-9a91-7f55be424410 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1301 microversion: 2.1 time: 0.397664 Aug 09 14:33:50.923291 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 419/872] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:50 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1301 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:50.928578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9383b5cb-9b9f-4636-8235-41dc17565658 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844626-8", "block_migration": true, "disk_over_commit": false}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:50.945718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9383b5cb-9b9f-4636-8235-41dc17565658 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:50.967299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9383b5cb-9b9f-4636-8235-41dc17565658 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:50.970925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9383b5cb-9b9f-4636-8235-41dc17565658 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:50.971458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9383b5cb-9b9f-4636-8235-41dc17565658 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:50.976006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9383b5cb-9b9f-4636-8235-41dc17565658 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:50.980675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9383b5cb-9b9f-4636-8235-41dc17565658 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:50.981247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9383b5cb-9b9f-4636-8235-41dc17565658 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:51.052180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-9383b5cb-9b9f-4636-8235-41dc17565658 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lazy-loading 'flavor' on Instance uuid bd9360b9-5620-4fa1-819c-90485da8e233 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:33:51.063551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1607c534-8d50-427a-810c-b1336dc2332b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:51.080660 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1607c534-8d50-427a-810c-b1336dc2332b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1473 microversion: 2.1 time: 0.863419 Aug 09 14:33:51.082508 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 454/873] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:50 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1473 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:51.094770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d941b3bc-c666-488e-a4b4-be49c40d3a3e req-0e117b15-93d4-406c-aae6-9b0993470884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba6d964-167a-4b1e-94f0-fb74f63c03f1", "name": "network-vif-plugged", "status": "completed", "tag": "e4f9d82e-39ab-4f23-91b4-e30a41b072c4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:51.107425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9383b5cb-9b9f-4636-8235-41dc17565658 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Going to try to live migrate instance to n-h1-844626-8 {{(pid=119407) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 14:33:51.120919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d941b3bc-c666-488e-a4b4-be49c40d3a3e req-0e117b15-93d4-406c-aae6-9b0993470884 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:51.124532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d941b3bc-c666-488e-a4b4-be49c40d3a3e req-0e117b15-93d4-406c-aae6-9b0993470884 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:51.129547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d941b3bc-c666-488e-a4b4-be49c40d3a3e req-0e117b15-93d4-406c-aae6-9b0993470884 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:51.180727 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d941b3bc-c666-488e-a4b4-be49c40d3a3e req-0e117b15-93d4-406c-aae6-9b0993470884 service nova] Creating event network-vif-plugged:e4f9d82e-39ab-4f23-91b4-e30a41b072c4 for instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 on n-h2-844626-8 Aug 09 14:33:51.186634 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d941b3bc-c666-488e-a4b4-be49c40d3a3e req-0e117b15-93d4-406c-aae6-9b0993470884 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102593 Aug 09 14:33:51.204903 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 455/874] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:51.210654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f96871a4-5a66-4c33-a0d7-26956173dc55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:51.229260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f96871a4-5a66-4c33-a0d7-26956173dc55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:51.245874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f96871a4-5a66-4c33-a0d7-26956173dc55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:51.249634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f96871a4-5a66-4c33-a0d7-26956173dc55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:51.259827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f96871a4-5a66-4c33-a0d7-26956173dc55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:51.260920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f96871a4-5a66-4c33-a0d7-26956173dc55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:51.265741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f96871a4-5a66-4c33-a0d7-26956173dc55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:51.266404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f96871a4-5a66-4c33-a0d7-26956173dc55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:51.417744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f96871a4-5a66-4c33-a0d7-26956173dc55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:51.511200 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f96871a4-5a66-4c33-a0d7-26956173dc55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1215 microversion: 2.1 time: 0.304939 Aug 09 14:33:51.520451 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 456/875] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:51 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1215 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:51.532213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81fb0076-1451-44fa-951a-ee7122532352 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:51.534419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81fb0076-1451-44fa-951a-ee7122532352 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:51.552219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81fb0076-1451-44fa-951a-ee7122532352 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:51.554667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81fb0076-1451-44fa-951a-ee7122532352 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:51.555665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81fb0076-1451-44fa-951a-ee7122532352 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:51.556613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81fb0076-1451-44fa-951a-ee7122532352 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:51.557251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81fb0076-1451-44fa-951a-ee7122532352 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:51.565684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81fb0076-1451-44fa-951a-ee7122532352 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:52.369459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-81fb0076-1451-44fa-951a-ee7122532352 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:52.385939 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81fb0076-1451-44fa-951a-ee7122532352 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1390 microversion: 2.1 time: 0.864208 Aug 09 14:33:52.399921 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 457/876] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:51 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1390 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:52.405260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0b106d6-a3f7-46f2-bcf7-5f13b20386ca tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf248b0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:52.513454 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0b106d6-a3f7-46f2-bcf7-5f13b20386ca tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.123591 Aug 09 14:33:52.514100 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 458/877] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:52 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:52.523230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c6d6229-2171-426f-8372-f35052c7bbce tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:52.523828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c6d6229-2171-426f-8372-f35052c7bbce tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:52.558283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c6d6229-2171-426f-8372-f35052c7bbce tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:52.571351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c6d6229-2171-426f-8372-f35052c7bbce tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:52.573444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c6d6229-2171-426f-8372-f35052c7bbce tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:52.575418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c6d6229-2171-426f-8372-f35052c7bbce tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:52.576816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c6d6229-2171-426f-8372-f35052c7bbce tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:52.579651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c6d6229-2171-426f-8372-f35052c7bbce tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:52.720627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c6d6229-2171-426f-8372-f35052c7bbce tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:52.730647 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c6d6229-2171-426f-8372-f35052c7bbce tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1299 microversion: 2.1 time: 0.213578 Aug 09 14:33:52.749759 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 459/878] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:52 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1299 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:52.758379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7968d133-3919-4888-8004-95f4f67639a3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:52.761427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7968d133-3919-4888-8004-95f4f67639a3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:52.777973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7968d133-3919-4888-8004-95f4f67639a3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:52.778839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7968d133-3919-4888-8004-95f4f67639a3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:52.779943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7968d133-3919-4888-8004-95f4f67639a3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:52.784410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7968d133-3919-4888-8004-95f4f67639a3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:52.785229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7968d133-3919-4888-8004-95f4f67639a3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:52.785979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7968d133-3919-4888-8004-95f4f67639a3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:53.183342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7968d133-3919-4888-8004-95f4f67639a3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:53.192158 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7968d133-3919-4888-8004-95f4f67639a3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1470 microversion: 2.1 time: 0.440989 Aug 09 14:33:53.208419 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 460/879] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:52 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1470 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:53.213643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-9ffcbc02-525f-4a02-9c84-344d3bd81e5a req-68233908-5139-4a6d-9acf-2e9004a2e73b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5121011-181e-440e-a97e-7580b76680f8", "tag": "c56a23ec-eaaa-4df9-9eca-746a74cbfa42"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:53.224204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9ffcbc02-525f-4a02-9c84-344d3bd81e5a req-68233908-5139-4a6d-9acf-2e9004a2e73b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:53.225062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9ffcbc02-525f-4a02-9c84-344d3bd81e5a req-68233908-5139-4a6d-9acf-2e9004a2e73b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:53.225695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9ffcbc02-525f-4a02-9c84-344d3bd81e5a req-68233908-5139-4a6d-9acf-2e9004a2e73b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:53.252973 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9ffcbc02-525f-4a02-9c84-344d3bd81e5a req-68233908-5139-4a6d-9acf-2e9004a2e73b service nova] Creating event network-changed:c56a23ec-eaaa-4df9-9eca-746a74cbfa42 for instance e5121011-181e-440e-a97e-7580b76680f8 on n-h1-844626-8 Aug 09 14:33:53.264516 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-9ffcbc02-525f-4a02-9c84-344d3bd81e5a req-68233908-5139-4a6d-9acf-2e9004a2e73b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054428 Aug 09 14:33:53.267998 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 461/880] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:53.280322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c0fbc1d-fd35-4d80-9f32-9021e0d6e0b4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:53.283940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c0fbc1d-fd35-4d80-9f32-9021e0d6e0b4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:53.288455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:53.325617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c0fbc1d-fd35-4d80-9f32-9021e0d6e0b4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:53.326217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c0fbc1d-fd35-4d80-9f32-9021e0d6e0b4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:53.326661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c0fbc1d-fd35-4d80-9f32-9021e0d6e0b4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:53.327571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c0fbc1d-fd35-4d80-9f32-9021e0d6e0b4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:53.328022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c0fbc1d-fd35-4d80-9f32-9021e0d6e0b4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:53.328442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c0fbc1d-fd35-4d80-9f32-9021e0d6e0b4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:53.480094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c0fbc1d-fd35-4d80-9f32-9021e0d6e0b4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:53.489158 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c0fbc1d-fd35-4d80-9f32-9021e0d6e0b4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1277 microversion: 2.1 time: 0.219534 Aug 09 14:33:53.502012 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 462/881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:53 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:53.701512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-353528bc-ac0b-46f0-ae48-474cbdfa943e tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Action: 'create', calling method: .version_select at 0x7f41ddf3f4c0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9iza0Tps9KFOWYn+wYmVdM6E18d1xcNgTsxKqXVdepytrNvzOlUJknPkQoqU2mGaFo85kXYmzbNjAWI/j/85YMVYHW+GFS61sWFk7rmpgtkMHjJldaPoPZ2GTTVynU4A=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-353528bc-ac0b-46f0-ae48-474cbdfa943e tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Request method failure captured: Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 257 Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nBQMGqoz3G4IVyjgwjdAyQazUj42nwouCtNu9OGfBgXf_VcFkfzYXH-8JF8yHs4VlMOz3GJt3wk96fZdSCdJaEaDuOmcR7sv40ngtckn-gZXkzuexs3bcqe9umO6i5okCTdWFqbMrASfpSzU_53gZ0cHASUxSaXaz403FIObQism_c Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:33:53.711542 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:33:53.713261 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b41680127c3c4a5db9dc11fd87910c52", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:53.713261 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:53.713261 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:53.713261 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:53.713261 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:53.713261 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:33:53.713261 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:33:53.713261 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:53.713261 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:53.713261 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:33:53.713261 n-d-844626-8 devstack@n-api.service[119406]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9iza0Tps9KFOWYn+wYmVdM6E18d1xcNgTsxKqXVdepytrNvzOlUJknPkQoqU2mGaFo85kXYmzbNjAWI/j/85YMVYHW+GFS61sWFk7rmpgtkMHjJldaPoPZ2GTTVynU4A=="}} Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9iza0Tps9KFOWYn+wYmVdM6E18d1xcNgTsxKqXVdepytrNvzOlUJknPkQoqU2mGaFo85kXYmzbNjAWI/j/85YMVYHW+GFS61sWFk7rmpgtkMHjJldaPoPZ2GTTVynU4A=='}}} Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:53.714033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:33:53.715171 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:33:53.716590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:33:53.717804 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 09 14:33:53.717804 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:53.719860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-353528bc-ac0b-46f0-ae48-474cbdfa943e tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:53.721472 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-353528bc-ac0b-46f0-ae48-474cbdfa943e tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.202196 Aug 09 14:33:53.724955 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 463/882] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:33:53 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:33:53.735564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4a087ae-5318-493f-9b78-a22b9461f691 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:53.737901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a4a087ae-5318-493f-9b78-a22b9461f691 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:53.752309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4a087ae-5318-493f-9b78-a22b9461f691 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:53.754165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4a087ae-5318-493f-9b78-a22b9461f691 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:53.755895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4a087ae-5318-493f-9b78-a22b9461f691 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:53.756845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4a087ae-5318-493f-9b78-a22b9461f691 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:53.757949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4a087ae-5318-493f-9b78-a22b9461f691 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:53.758608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4a087ae-5318-493f-9b78-a22b9461f691 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:53.926445 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9383b5cb-9b9f-4636-8235-41dc17565658 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233/action" status: 202 len: 0 microversion: 2.1 time: 3.001631 Aug 09 14:33:53.928924 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 420/883] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:33:50 2022] POST /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233/action => generated 0 bytes in 3005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:33:53.937688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-de5f2510-c863-4104-b274-53d6a9a15f70 req-9634c113-7116-4926-84e3-cbc2902f57b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319985c3-0dee-4da4-aeab-bf1d653a147f", "name": "network-vif-unplugged", "status": "completed", "tag": "6313404f-b7f3-4c22-9a42-627cf07b300b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:53.939334 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4a087ae-5318-493f-9b78-a22b9461f691 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "POST /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f/action" status: 204 len: 0 microversion: 2.1 time: 0.212786 Aug 09 14:33:53.943107 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 464/884] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:33:53 2022] POST /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f/action => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:33:53.965315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca6b81f0-2ebd-45bf-b234-36853924e38d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:53.981443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca6b81f0-2ebd-45bf-b234-36853924e38d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:53.993395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-de5f2510-c863-4104-b274-53d6a9a15f70 req-9634c113-7116-4926-84e3-cbc2902f57b2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:53.996308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-de5f2510-c863-4104-b274-53d6a9a15f70 req-9634c113-7116-4926-84e3-cbc2902f57b2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:53.999826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-de5f2510-c863-4104-b274-53d6a9a15f70 req-9634c113-7116-4926-84e3-cbc2902f57b2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:54.017320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca6b81f0-2ebd-45bf-b234-36853924e38d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:54.017879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca6b81f0-2ebd-45bf-b234-36853924e38d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:54.018321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca6b81f0-2ebd-45bf-b234-36853924e38d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:54.019156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca6b81f0-2ebd-45bf-b234-36853924e38d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:54.020007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca6b81f0-2ebd-45bf-b234-36853924e38d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:54.020153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca6b81f0-2ebd-45bf-b234-36853924e38d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:54.075101 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-de5f2510-c863-4104-b274-53d6a9a15f70 req-9634c113-7116-4926-84e3-cbc2902f57b2 service nova] Creating event network-vif-unplugged:6313404f-b7f3-4c22-9a42-627cf07b300b for instance 319985c3-0dee-4da4-aeab-bf1d653a147f on n-h2-844626-8 Aug 09 14:33:54.086953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-de5f2510-c863-4104-b274-53d6a9a15f70 req-9634c113-7116-4926-84e3-cbc2902f57b2 service nova] Instance 319985c3-0dee-4da4-aeab-bf1d653a147f is migrating within the same cell, copying events to all relevant hosts: {'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 14:33:54.102946 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-de5f2510-c863-4104-b274-53d6a9a15f70 req-9634c113-7116-4926-84e3-cbc2902f57b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172332 Aug 09 14:33:54.105420 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 421/885] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:54.120357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dbcbc83a-a40b-4979-8117-04fd7771d7df tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd666af0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:54.213660 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dbcbc83a-a40b-4979-8117-04fd7771d7df tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.101065 Aug 09 14:33:54.214264 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 422/886] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:54 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:54.228759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-291ec5ab-e98f-4aea-98c8-eed4c198dd7d tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Action: 'create', calling method: .version_select at 0x7f41dd665700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-356445054", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:54.250072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-291ec5ab-e98f-4aea-98c8-eed4c198dd7d tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Getting quotas for project b41680127c3c4a5db9dc11fd87910c52. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:54.258865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-291ec5ab-e98f-4aea-98c8-eed4c198dd7d tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Getting quotas for user 078a24bf69a24d059aba85ea0211c9f3 and project b41680127c3c4a5db9dc11fd87910c52. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:54.281747 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-291ec5ab-e98f-4aea-98c8-eed4c198dd7d tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-291ec5ab-e98f-4aea-98c8-eed4c198dd7d tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Request method failure captured: Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 2166 Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBQMGqoz3G4IVyjgwjdAyQazUj42nwouCtNu9OGfBgXf_VcFkfzYXH-8JF8yHs4VlMOz3GJt3wk96fZdSCdJaEaDuOmcR7sv40ngtckn-gZXkzuexs3bcqe9umO6i5okCTdWFqbMrASfpSzU_53gZ0cHASUxSaXaz403FIObQism_c Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b41680127c3c4a5db9dc11fd87910c52", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-356445054", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:33:54.296631 n-d-844626-8 devstack@n-api.service[119407]: exception: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-356445054', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:54.298889 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-291ec5ab-e98f-4aea-98c8-eed4c198dd7d tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-291ec5ab-e98f-4aea-98c8-eed4c198dd7d tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.075597 Aug 09 14:33:54.301615 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 423/887] 10.222.0.50 () {60 vars in 1160 bytes} [Tue Aug 9 14:33:54 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:33:54.306369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67807fce-a6f3-4d4c-8822-0202a2e96913 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:54.307938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-67807fce-a6f3-4d4c-8822-0202a2e96913 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:54.316374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67807fce-a6f3-4d4c-8822-0202a2e96913 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:54.318072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67807fce-a6f3-4d4c-8822-0202a2e96913 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:54.319347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67807fce-a6f3-4d4c-8822-0202a2e96913 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:54.320315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67807fce-a6f3-4d4c-8822-0202a2e96913 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:54.321234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67807fce-a6f3-4d4c-8822-0202a2e96913 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:54.321824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67807fce-a6f3-4d4c-8822-0202a2e96913 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:54.428724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca6b81f0-2ebd-45bf-b234-36853924e38d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:54.446601 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca6b81f0-2ebd-45bf-b234-36853924e38d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1390 microversion: 2.1 time: 0.500187 Aug 09 14:33:54.448201 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 465/888] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:53 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1390 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:54.457757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df45a4b8-d930-4720-ae66-635a3e231988 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:54.461949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-df45a4b8-d930-4720-ae66-635a3e231988 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:54.474034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df45a4b8-d930-4720-ae66-635a3e231988 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:54.474447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df45a4b8-d930-4720-ae66-635a3e231988 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:54.474968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df45a4b8-d930-4720-ae66-635a3e231988 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:54.475623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df45a4b8-d930-4720-ae66-635a3e231988 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:54.476072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df45a4b8-d930-4720-ae66-635a3e231988 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:54.489270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df45a4b8-d930-4720-ae66-635a3e231988 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:54.550053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-67807fce-a6f3-4d4c-8822-0202a2e96913 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:54.570705 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67807fce-a6f3-4d4c-8822-0202a2e96913 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1367 microversion: 2.1 time: 0.264320 Aug 09 14:33:54.572069 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 424/889] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:54 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:54.581310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4b30b125-8740-4058-9f4f-b3b091b8de0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:54.582221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4b30b125-8740-4058-9f4f-b3b091b8de0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:54.598759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b30b125-8740-4058-9f4f-b3b091b8de0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:54.598759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b30b125-8740-4058-9f4f-b3b091b8de0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:54.599276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b30b125-8740-4058-9f4f-b3b091b8de0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:54.599918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b30b125-8740-4058-9f4f-b3b091b8de0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:54.600665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b30b125-8740-4058-9f4f-b3b091b8de0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:54.600795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b30b125-8740-4058-9f4f-b3b091b8de0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:54.811196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-df45a4b8-d930-4720-ae66-635a3e231988 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:54.824363 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-df45a4b8-d930-4720-ae66-635a3e231988 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.375056 Aug 09 14:33:54.824966 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 466/890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:54 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:54.842666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f299cb78-a330-4788-b0df-40117257ed31 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Action: 'create', calling method: .version_select at 0x7f41ddf5b8b0>, body: {"keypair": {"name": "tempest-keypair-1909206167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1gTpdGQ1jqnZKbSpnMBHdWNkWEGAT6i4FO3XRsP6KY4YaZVAbdbWz/JiL8YijsayrKqBWvwyxWWL7v29Vrx+i+HAMo2ksjo6MeWPDl2tOiuiCLUmmmogKnyoBY5l00cQ=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:54.893241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f299cb78-a330-4788-b0df-40117257ed31 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Getting quotas for project b41680127c3c4a5db9dc11fd87910c52. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:54.903004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f299cb78-a330-4788-b0df-40117257ed31 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Getting quotas for user 078a24bf69a24d059aba85ea0211c9f3 and project b41680127c3c4a5db9dc11fd87910c52. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:54.975233 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f299cb78-a330-4788-b0df-40117257ed31 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.145673 Aug 09 14:33:54.976489 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 467/891] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:33:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:54.982468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5b6c9b6-0517-49a6-8d8b-bddb14437b23 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:54.983319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5b6c9b6-0517-49a6-8d8b-bddb14437b23 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:55.016773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5b6c9b6-0517-49a6-8d8b-bddb14437b23 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:55.018956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5b6c9b6-0517-49a6-8d8b-bddb14437b23 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:55.019740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5b6c9b6-0517-49a6-8d8b-bddb14437b23 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:55.020633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5b6c9b6-0517-49a6-8d8b-bddb14437b23 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:55.023518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5b6c9b6-0517-49a6-8d8b-bddb14437b23 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:55.024412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5b6c9b6-0517-49a6-8d8b-bddb14437b23 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:55.062724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4b30b125-8740-4058-9f4f-b3b091b8de0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:55.071434 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4b30b125-8740-4058-9f4f-b3b091b8de0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1470 microversion: 2.1 time: 0.497940 Aug 09 14:33:55.073847 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 425/892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:54 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1470 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:55.098741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2d940ac1-7c64-401f-8e7d-a67356ad301c req-3859dd95-1b16-48ff-b7f4-2f1fcdf55854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8a0577-e7e0-414e-b847-d01ecbd5eb4d", "tag": "0d7b7ce8-4490-4536-b279-18fbab70b99a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:55.129474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2d940ac1-7c64-401f-8e7d-a67356ad301c req-3859dd95-1b16-48ff-b7f4-2f1fcdf55854 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:55.130250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2d940ac1-7c64-401f-8e7d-a67356ad301c req-3859dd95-1b16-48ff-b7f4-2f1fcdf55854 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:55.130858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2d940ac1-7c64-401f-8e7d-a67356ad301c req-3859dd95-1b16-48ff-b7f4-2f1fcdf55854 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:55.135141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f5b6c9b6-0517-49a6-8d8b-bddb14437b23 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:55.150688 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5b6c9b6-0517-49a6-8d8b-bddb14437b23 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1277 microversion: 2.1 time: 0.172806 Aug 09 14:33:55.154416 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2d940ac1-7c64-401f-8e7d-a67356ad301c req-3859dd95-1b16-48ff-b7f4-2f1fcdf55854 service nova] Creating event network-changed:0d7b7ce8-4490-4536-b279-18fbab70b99a for instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d on n-h2-844626-8 Aug 09 14:33:55.155208 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 468/893] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:54 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:55.164191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9ea5ba4-e677-4cfd-8ff2-cc28d523e023 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Action: 'create', calling method: .version_select at 0x7f41ddf5b820>, body: {"keypair": {"name": "tempest-keypair-1909206167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUrwUpI9sIkjWUAxMsyloDirZOOp3wXD9P1ZJ0EEh4qstkZadN539Rl39HUiUcTCoy6otlQ0TVmZnA1BataMfzRsx00PhLcqidkG+RZ3QILPvHbn0vkcBr34yyKPWqNWg=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:55.180879 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2d940ac1-7c64-401f-8e7d-a67356ad301c req-3859dd95-1b16-48ff-b7f4-2f1fcdf55854 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092100 Aug 09 14:33:55.181499 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 426/894] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:55.207909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f9ea5ba4-e677-4cfd-8ff2-cc28d523e023 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Getting quotas for project b41680127c3c4a5db9dc11fd87910c52. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:55.213508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f9ea5ba4-e677-4cfd-8ff2-cc28d523e023 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Getting quotas for user 078a24bf69a24d059aba85ea0211c9f3 and project b41680127c3c4a5db9dc11fd87910c52. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:55.228750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ea90d62-eeef-4c98-bf11-1884fbda4f50 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd7fc700>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:55.281087 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-f9ea5ba4-e677-4cfd-8ff2-cc28d523e023 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] HTTP exception thrown: Key pair 'tempest-keypair-1909206167' already exists. Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9ea5ba4-e677-4cfd-8ff2-cc28d523e023 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Request method failure captured: Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 273 Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nBQMGqoz3G4IVyjgwjdAyQazUj42nwouCtNu9OGfBgXf_VcFkfzYXH-8JF8yHs4VlMOz3GJt3wk96fZdSCdJaEaDuOmcR7sv40ngtckn-gZXkzuexs3bcqe9umO6i5okCTdWFqbMrASfpSzU_53gZ0cHASUxSaXaz403FIObQism_c Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b41680127c3c4a5db9dc11fd87910c52", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: {"keypair": {"name": "tempest-keypair-1909206167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUrwUpI9sIkjWUAxMsyloDirZOOp3wXD9P1ZJ0EEh4qstkZadN539Rl39HUiUcTCoy6otlQ0TVmZnA1BataMfzRsx00PhLcqidkG+RZ3QILPvHbn0vkcBr34yyKPWqNWg=="}} Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: exception: Key pair 'tempest-keypair-1909206167' already exists. Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1909206167', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUrwUpI9sIkjWUAxMsyloDirZOOp3wXD9P1ZJ0EEh4qstkZadN539Rl39HUiUcTCoy6otlQ0TVmZnA1BataMfzRsx00PhLcqidkG+RZ3QILPvHbn0vkcBr34yyKPWqNWg=='}}} Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result.read() Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '078a24bf69a24d059aba85ea0211c9f3-tempest-keypair-1909206167' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 09 14:33:55.288847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi session.flush() Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result.read() Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 09 14:33:55.293450 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '078a24bf69a24d059aba85ea0211c9f3-tempest-keypair-1909206167' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 9, 14, 33, 55, 245574), 'updated_at': None, 'name': 'tempest-keypair-1909206167', 'user_id': '078a24bf69a24d059aba85ea0211c9f3', 'fingerprint': '02:8f:05:b3:52:09:96:f7:9f:fe:3a:66:50:73:59:b6', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUrwUpI9sIkjWUAxMsyloDirZOOp3wXD9P1ZJ0EEh4qstkZadN539Rl39HUiUcTCoy6otlQ0TVmZnA1BataMfzRsx00PhLcqidkG+RZ3QILPvHbn0vkcBr34yyKPWqNWg==', 'type': 'ssh'}] Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6743, in import_key_pair Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi keypair.create() Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._create() Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1909206167' already exists. Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 09 14:33:55.299243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1909206167' already exists. Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1909206167' already exists. Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9ea5ba4-e677-4cfd-8ff2-cc28d523e023 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Returning 409 to user: Key pair 'tempest-keypair-1909206167' already exists. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f9ea5ba4-e677-4cfd-8ff2-cc28d523e023 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.134476 Aug 09 14:33:55.306919 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 469/895] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:33:55 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:33:55.311983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-46990aa3-a55c-4692-9a27-b2ac5fef3b9d tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Calling method '.version_select at 0x7f41ddf50ee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:55.328935 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ea90d62-eeef-4c98-bf11-1884fbda4f50 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.104349 Aug 09 14:33:55.330128 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 427/896] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:55 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:55.356361 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-46990aa3-a55c-4692-9a27-b2ac5fef3b9d tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909206167" status: 202 len: 0 microversion: 2.1 time: 0.057830 Aug 09 14:33:55.366309 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 470/897] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 14:33:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1909206167 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:33:55.370760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a96a16c6-eac6-4cd5-9173-0072a4ed6213 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Action: 'create', calling method: .version_select at 0x7f41dd6659d0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhu0Apg2M18vyQChleqYmmcVDh7ob97wNTDM/mWMEJZ2LTJ+Xyfkm/wuvcOS1YnR3dy84XqCcyE3X+yef/p+fh+8rcGI8Lnwl0cPha5KdVgIQkloiQnyB7LGWLecPSzTw=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a96a16c6-eac6-4cd5-9173-0072a4ed6213 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Request method failure captured: Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 247 Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBQMGqoz3G4IVyjgwjdAyQazUj42nwouCtNu9OGfBgXf_VcFkfzYXH-8JF8yHs4VlMOz3GJt3wk96fZdSCdJaEaDuOmcR7sv40ngtckn-gZXkzuexs3bcqe9umO6i5okCTdWFqbMrASfpSzU_53gZ0cHASUxSaXaz403FIObQism_c Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b41680127c3c4a5db9dc11fd87910c52", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhu0Apg2M18vyQChleqYmmcVDh7ob97wNTDM/mWMEJZ2LTJ+Xyfkm/wuvcOS1YnR3dy84XqCcyE3X+yef/p+fh+8rcGI8Lnwl0cPha5KdVgIQkloiQnyB7LGWLecPSzTw=="}} Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhu0Apg2M18vyQChleqYmmcVDh7ob97wNTDM/mWMEJZ2LTJ+Xyfkm/wuvcOS1YnR3dy84XqCcyE3X+yef/p+fh+8rcGI8Lnwl0cPha5KdVgIQkloiQnyB7LGWLecPSzTw=='}}} Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi '' Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:33:55.374677 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 09 14:33:55.378799 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.381119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a96a16c6-eac6-4cd5-9173-0072a4ed6213 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:55.382393 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a96a16c6-eac6-4cd5-9173-0072a4ed6213 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.015855 Aug 09 14:33:55.383636 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 428/898] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:33:55 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:33:55.392891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d55004f-2ac4-4e34-9d1e-d35ff8be9074 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Action: 'create', calling method: .version_select at 0x7f41ddf5b8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-284770958", "public_key": " "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:55.409688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-6d55004f-2ac4-4e34-9d1e-d35ff8be9074 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Getting quotas for project b41680127c3c4a5db9dc11fd87910c52. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:55.417042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-6d55004f-2ac4-4e34-9d1e-d35ff8be9074 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Getting quotas for user 078a24bf69a24d059aba85ea0211c9f3 and project b41680127c3c4a5db9dc11fd87910c52. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:55.435079 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6d55004f-2ac4-4e34-9d1e-d35ff8be9074 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d55004f-2ac4-4e34-9d1e-d35ff8be9074 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Request method failure captured: Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 94 Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nBQMGqoz3G4IVyjgwjdAyQazUj42nwouCtNu9OGfBgXf_VcFkfzYXH-8JF8yHs4VlMOz3GJt3wk96fZdSCdJaEaDuOmcR7sv40ngtckn-gZXkzuexs3bcqe9umO6i5okCTdWFqbMrASfpSzU_53gZ0cHASUxSaXaz403FIObQism_c Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b41680127c3c4a5db9dc11fd87910c52", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-284770958", "public_key": " "}} Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: exception: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-284770958', 'public_key': ' '}}} Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.438124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:55.442859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.445596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d55004f-2ac4-4e34-9d1e-d35ff8be9074 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:55.446486 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d55004f-2ac4-4e34-9d1e-d35ff8be9074 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.057993 Aug 09 14:33:55.447135 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 471/899] 10.222.0.50 () {60 vars in 1158 bytes} [Tue Aug 9 14:33:55 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 09 14:33:55.462503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-759e796b-8220-4470-b6b8-0e5e344fca02 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Action: 'create', calling method: .version_select at 0x7f41dd665940>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD+KqNYFeJ8zBFGbMeH8LYdz63pgVFYXUi00hl56fok1cEWPsSUfJtFmcDWQjVhpAELiGSQSgEHnxKSGtEjiLDG3kAaN7As1FHhoH7aE7Z4ZHUX50fvGEXq0RO+W9jdLQ=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-759e796b-8220-4470-b6b8-0e5e344fca02 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Request method failure captured: Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 507 Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBQMGqoz3G4IVyjgwjdAyQazUj42nwouCtNu9OGfBgXf_VcFkfzYXH-8JF8yHs4VlMOz3GJt3wk96fZdSCdJaEaDuOmcR7sv40ngtckn-gZXkzuexs3bcqe9umO6i5okCTdWFqbMrASfpSzU_53gZ0cHASUxSaXaz403FIObQism_c Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b41680127c3c4a5db9dc11fd87910c52", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD+KqNYFeJ8zBFGbMeH8LYdz63pgVFYXUi00hl56fok1cEWPsSUfJtFmcDWQjVhpAELiGSQSgEHnxKSGtEjiLDG3kAaN7As1FHhoH7aE7Z4ZHUX50fvGEXq0RO+W9jdLQ=="}} Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD+KqNYFeJ8zBFGbMeH8LYdz63pgVFYXUi00hl56fok1cEWPsSUfJtFmcDWQjVhpAELiGSQSgEHnxKSGtEjiLDG3kAaN7As1FHhoH7aE7Z4ZHUX50fvGEXq0RO+W9jdLQ=='}}} Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 09 14:33:55.471411 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-759e796b-8220-4470-b6b8-0e5e344fca02 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-759e796b-8220-4470-b6b8-0e5e344fca02 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.018194 Aug 09 14:33:55.475382 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 429/900] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:33:55 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:33:55.485015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ede7a4e-1ad8-4700-a60a-a260e00750fb tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:55.485963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ede7a4e-1ad8-4700-a60a-a260e00750fb tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:55.489584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99aeaf36-a655-467e-af1c-bcddfff90104 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Action: 'create', calling method: .version_select at 0x7f41dd666f70>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1101205766", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:55.493957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ede7a4e-1ad8-4700-a60a-a260e00750fb tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:55.495143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ede7a4e-1ad8-4700-a60a-a260e00750fb tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:55.495816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ede7a4e-1ad8-4700-a60a-a260e00750fb tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:55.496840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ede7a4e-1ad8-4700-a60a-a260e00750fb tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:55.497506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ede7a4e-1ad8-4700-a60a-a260e00750fb tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:55.498190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ede7a4e-1ad8-4700-a60a-a260e00750fb tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:55.517819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-99aeaf36-a655-467e-af1c-bcddfff90104 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Getting quotas for project b41680127c3c4a5db9dc11fd87910c52. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:55.531465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-99aeaf36-a655-467e-af1c-bcddfff90104 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Getting quotas for user 078a24bf69a24d059aba85ea0211c9f3 and project b41680127c3c4a5db9dc11fd87910c52. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:55.576833 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-99aeaf36-a655-467e-af1c-bcddfff90104 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99aeaf36-a655-467e-af1c-bcddfff90104 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Request method failure captured: Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 118 Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBQMGqoz3G4IVyjgwjdAyQazUj42nwouCtNu9OGfBgXf_VcFkfzYXH-8JF8yHs4VlMOz3GJt3wk96fZdSCdJaEaDuOmcR7sv40ngtckn-gZXkzuexs3bcqe9umO6i5okCTdWFqbMrASfpSzU_53gZ0cHASUxSaXaz403FIObQism_c Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b41680127c3c4a5db9dc11fd87910c52", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1101205766", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: exception: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1101205766', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Aug 09 14:33:55.578735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99aeaf36-a655-467e-af1c-bcddfff90104 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99aeaf36-a655-467e-af1c-bcddfff90104 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.095288 Aug 09 14:33:55.593343 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 430/901] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:33:55 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:33:55.608706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b042c429-63e6-4297-9fe5-6b771c04d6e8 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Calling method '.version_select at 0x7f41dd5f3a60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:55.633296 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-b042c429-63e6-4297-9fe5-6b771c04d6e8 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1844062058 not found for user 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b042c429-63e6-4297-9fe5-6b771c04d6e8 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Request method failure captured: Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1844062058 HTTP/1.1 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBQMGqoz3G4IVyjgwjdAyQazUj42nwouCtNu9OGfBgXf_VcFkfzYXH-8JF8yHs4VlMOz3GJt3wk96fZdSCdJaEaDuOmcR7sv40ngtckn-gZXkzuexs3bcqe9umO6i5okCTdWFqbMrASfpSzU_53gZ0cHASUxSaXaz403FIObQism_c Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b41680127c3c4a5db9dc11fd87910c52", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b41680127c3c4a5db9dc11fd87910c52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: b41680127c3c4a5db9dc11fd87910c52 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1717146711 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1717146711-project Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: exception: Keypair tempest-keypair-non-existent-1844062058 not found for user 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'tempest-keypair-non-existent-1844062058'} Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6827, in delete_key_pair Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6848, in get_key_pair Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1844062058 not found for user 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.635424 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1844062058 not found for user 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1844062058 not found for user 078a24bf69a24d059aba85ea0211c9f3 Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:33:55.639309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b042c429-63e6-4297-9fe5-6b771c04d6e8 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1844062058 not found for user 078a24bf69a24d059aba85ea0211c9f3 {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:33:55.660613 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b042c429-63e6-4297-9fe5-6b771c04d6e8 tempest-KeyPairsNegativeTestJSON-1717146711 tempest-KeyPairsNegativeTestJSON-1717146711-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1844062058" status: 404 len: 145 microversion: 2.1 time: 0.060677 Aug 09 14:33:55.678526 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 431/902] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 9 14:33:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1844062058 => generated 145 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:33:55.716517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f75cfcf-6ae3-4e0f-b3f8-11c5a6d9093d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:55.721406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f75cfcf-6ae3-4e0f-b3f8-11c5a6d9093d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:55.737801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f75cfcf-6ae3-4e0f-b3f8-11c5a6d9093d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:55.738185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f75cfcf-6ae3-4e0f-b3f8-11c5a6d9093d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:55.742674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f75cfcf-6ae3-4e0f-b3f8-11c5a6d9093d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:55.743488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f75cfcf-6ae3-4e0f-b3f8-11c5a6d9093d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:55.743948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f75cfcf-6ae3-4e0f-b3f8-11c5a6d9093d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:55.744365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f75cfcf-6ae3-4e0f-b3f8-11c5a6d9093d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:55.836531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ede7a4e-1ad8-4700-a60a-a260e00750fb tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:55.849494 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ede7a4e-1ad8-4700-a60a-a260e00750fb tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1390 microversion: 2.1 time: 0.382209 Aug 09 14:33:55.854378 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 472/903] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:55 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1390 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:55.863425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1bfcece4-6640-4b5c-bea1-55f794b05c02 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:55.867173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1bfcece4-6640-4b5c-bea1-55f794b05c02 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:55.883140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bfcece4-6640-4b5c-bea1-55f794b05c02 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:55.883451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bfcece4-6640-4b5c-bea1-55f794b05c02 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:55.883757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bfcece4-6640-4b5c-bea1-55f794b05c02 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:55.884462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bfcece4-6640-4b5c-bea1-55f794b05c02 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:55.884903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bfcece4-6640-4b5c-bea1-55f794b05c02 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:55.885323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bfcece4-6640-4b5c-bea1-55f794b05c02 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:56.440236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1bfcece4-6640-4b5c-bea1-55f794b05c02 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:56.455631 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1bfcece4-6640-4b5c-bea1-55f794b05c02 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.596674 Aug 09 14:33:56.456554 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 473/904] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:55 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:56.467024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-023cf23b-00ca-43cf-a7b0-4e845b48d8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:56.470069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-023cf23b-00ca-43cf-a7b0-4e845b48d8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:56.472508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6f75cfcf-6ae3-4e0f-b3f8-11c5a6d9093d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:56.485775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-023cf23b-00ca-43cf-a7b0-4e845b48d8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:56.492288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-023cf23b-00ca-43cf-a7b0-4e845b48d8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:56.497212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-023cf23b-00ca-43cf-a7b0-4e845b48d8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:56.498887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-023cf23b-00ca-43cf-a7b0-4e845b48d8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:56.500154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-023cf23b-00ca-43cf-a7b0-4e845b48d8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:56.503408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-023cf23b-00ca-43cf-a7b0-4e845b48d8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:56.512721 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f75cfcf-6ae3-4e0f-b3f8-11c5a6d9093d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1367 microversion: 2.1 time: 0.831383 Aug 09 14:33:56.513314 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 432/905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:55 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1367 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:56.530995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-89029a0d-928c-4ee3-87d1-b76e3cec9fc6 req-f520920f-116d-4e33-b580-cfbd654747be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319985c3-0dee-4da4-aeab-bf1d653a147f", "name": "network-vif-plugged", "status": "completed", "tag": "6313404f-b7f3-4c22-9a42-627cf07b300b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:56.574719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-89029a0d-928c-4ee3-87d1-b76e3cec9fc6 req-f520920f-116d-4e33-b580-cfbd654747be service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:56.577651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-89029a0d-928c-4ee3-87d1-b76e3cec9fc6 req-f520920f-116d-4e33-b580-cfbd654747be service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:56.578376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-89029a0d-928c-4ee3-87d1-b76e3cec9fc6 req-f520920f-116d-4e33-b580-cfbd654747be service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:56.616567 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-89029a0d-928c-4ee3-87d1-b76e3cec9fc6 req-f520920f-116d-4e33-b580-cfbd654747be service nova] Creating event network-vif-plugged:6313404f-b7f3-4c22-9a42-627cf07b300b for instance 319985c3-0dee-4da4-aeab-bf1d653a147f on n-h2-844626-8 Aug 09 14:33:56.654051 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-89029a0d-928c-4ee3-87d1-b76e3cec9fc6 req-f520920f-116d-4e33-b580-cfbd654747be service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139496 Aug 09 14:33:56.658457 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 433/906] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:56.670163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0201ebc0-c309-4c58-9ea4-39572abf67f7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:56.670950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0201ebc0-c309-4c58-9ea4-39572abf67f7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:56.684036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0201ebc0-c309-4c58-9ea4-39572abf67f7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:56.684695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0201ebc0-c309-4c58-9ea4-39572abf67f7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:56.685086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0201ebc0-c309-4c58-9ea4-39572abf67f7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:56.685658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0201ebc0-c309-4c58-9ea4-39572abf67f7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:56.687434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0201ebc0-c309-4c58-9ea4-39572abf67f7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:56.687869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0201ebc0-c309-4c58-9ea4-39572abf67f7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:56.922419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-023cf23b-00ca-43cf-a7b0-4e845b48d8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:56.926095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:56.936004 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-023cf23b-00ca-43cf-a7b0-4e845b48d8d7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1462 microversion: 2.1 time: 0.477272 Aug 09 14:33:56.939560 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 474/907] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:56 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1462 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:56.949148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0201ebc0-c309-4c58-9ea4-39572abf67f7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:56.961102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d736e29-b2d2-4cea-ae49-f218f6bd0d6d tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf10c10>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:56.964179 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0201ebc0-c309-4c58-9ea4-39572abf67f7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 0.303292 Aug 09 14:33:56.967291 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 434/908] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:56 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:56.991659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-25d74eee-44e9-4d35-8bb6-813a4dfddbf4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:56.992559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-25d74eee-44e9-4d35-8bb6-813a4dfddbf4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:57.015935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25d74eee-44e9-4d35-8bb6-813a4dfddbf4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:57.019173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25d74eee-44e9-4d35-8bb6-813a4dfddbf4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:57.020696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25d74eee-44e9-4d35-8bb6-813a4dfddbf4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:57.021634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25d74eee-44e9-4d35-8bb6-813a4dfddbf4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:57.022281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25d74eee-44e9-4d35-8bb6-813a4dfddbf4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:57.022899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25d74eee-44e9-4d35-8bb6-813a4dfddbf4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:57.056592 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d736e29-b2d2-4cea-ae49-f218f6bd0d6d tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.115695 Aug 09 14:33:57.060122 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 475/909] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:56 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:57.065871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0acd7ae-a785-4258-9368-f2e197608395 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:57.066593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0acd7ae-a785-4258-9368-f2e197608395 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:57.076954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0acd7ae-a785-4258-9368-f2e197608395 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:57.077676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0acd7ae-a785-4258-9368-f2e197608395 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:57.078278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0acd7ae-a785-4258-9368-f2e197608395 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:57.079179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0acd7ae-a785-4258-9368-f2e197608395 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:57.079879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0acd7ae-a785-4258-9368-f2e197608395 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:57.080692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0acd7ae-a785-4258-9368-f2e197608395 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:57.269883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-25d74eee-44e9-4d35-8bb6-813a4dfddbf4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:57.284373 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-25d74eee-44e9-4d35-8bb6-813a4dfddbf4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1390 microversion: 2.1 time: 0.305063 Aug 09 14:33:57.286270 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 435/910] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:56 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1390 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:57.337418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0acd7ae-a785-4258-9368-f2e197608395 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:57.347076 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0acd7ae-a785-4258-9368-f2e197608395 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1462 microversion: 2.1 time: 0.284194 Aug 09 14:33:57.359666 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 476/911] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:57 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1462 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:57.371235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a3bafe6-c84b-48f3-a963-c03ff9502036 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Action: 'create', calling method: .version_select at 0x7f41dd5f51f0>, body: {"keypair": {"name": "tempest-keypair-970878438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBUPdbyO8IOK7NlhvZJDcz6mJOOQ8Ab+pxlxGggo0UGyZZLQ8bMol2Auh5EB28YRfpZYvkyS28cQo/cIBd3kHv32ARN7l9bSA36WlrTOEpjNo1klo9jLXUto6CQywpAIg=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:57.389610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-7a3bafe6-c84b-48f3-a963-c03ff9502036 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Getting quotas for project 21a086b8d4904e118283cea8eb12b678. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:33:57.397681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-7a3bafe6-c84b-48f3-a963-c03ff9502036 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Getting quotas for user c45d9a126a0841d5938ee21e8e87b293 and project 21a086b8d4904e118283cea8eb12b678. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:33:57.433108 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a3bafe6-c84b-48f3-a963-c03ff9502036 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065995 Aug 09 14:33:57.441879 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 436/912] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:33:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:33:57.491969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31e2dfc8-b929-4100-bc0a-9e57a2bb9810 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:57.493336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31e2dfc8-b929-4100-bc0a-9e57a2bb9810 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:57.503523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31e2dfc8-b929-4100-bc0a-9e57a2bb9810 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:57.506101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31e2dfc8-b929-4100-bc0a-9e57a2bb9810 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:57.515112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31e2dfc8-b929-4100-bc0a-9e57a2bb9810 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:57.519932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31e2dfc8-b929-4100-bc0a-9e57a2bb9810 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:57.520705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31e2dfc8-b929-4100-bc0a-9e57a2bb9810 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:57.523306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31e2dfc8-b929-4100-bc0a-9e57a2bb9810 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:57.524807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:33:57.558323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1a11eb27-f929-4c8d-858e-441da0b5b5b8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:57.559740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1a11eb27-f929-4c8d-858e-441da0b5b5b8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:57.568578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a11eb27-f929-4c8d-858e-441da0b5b5b8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:57.569393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a11eb27-f929-4c8d-858e-441da0b5b5b8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:57.570128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a11eb27-f929-4c8d-858e-441da0b5b5b8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:57.570994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a11eb27-f929-4c8d-858e-441da0b5b5b8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:57.571651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a11eb27-f929-4c8d-858e-441da0b5b5b8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:57.572225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a11eb27-f929-4c8d-858e-441da0b5b5b8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:57.827881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1a11eb27-f929-4c8d-858e-441da0b5b5b8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:57.840229 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1a11eb27-f929-4c8d-858e-441da0b5b5b8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1367 microversion: 2.1 time: 0.288255 Aug 09 14:33:57.841245 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 437/913] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:57 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:57.963558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-31e2dfc8-b929-4100-bc0a-9e57a2bb9810 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:57.978968 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31e2dfc8-b929-4100-bc0a-9e57a2bb9810 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.491466 Aug 09 14:33:57.981121 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 477/914] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:57 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:57.993528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-74454e5f-be61-4135-893c-5754a7f24da4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:57.994262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-74454e5f-be61-4135-893c-5754a7f24da4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:58.005882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74454e5f-be61-4135-893c-5754a7f24da4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:58.011575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74454e5f-be61-4135-893c-5754a7f24da4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:58.012410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74454e5f-be61-4135-893c-5754a7f24da4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:58.023546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74454e5f-be61-4135-893c-5754a7f24da4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:58.026106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74454e5f-be61-4135-893c-5754a7f24da4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:58.033417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74454e5f-be61-4135-893c-5754a7f24da4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:58.073895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b0d4405-82bb-42eb-8adb-0f4eb316e778 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41de02a8b0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:58.147593 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b0d4405-82bb-42eb-8adb-0f4eb316e778 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.077310 Aug 09 14:33:58.149034 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 478/915] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:58 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:33:58.309897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-72b19b76-621b-486b-9df9-c605c613f96f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:58.310846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-72b19b76-621b-486b-9df9-c605c613f96f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:58.320383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b19b76-621b-486b-9df9-c605c613f96f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:58.323415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b19b76-621b-486b-9df9-c605c613f96f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:58.324088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b19b76-621b-486b-9df9-c605c613f96f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:58.326084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b19b76-621b-486b-9df9-c605c613f96f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:58.329412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b19b76-621b-486b-9df9-c605c613f96f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:58.330079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72b19b76-621b-486b-9df9-c605c613f96f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:58.640054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-74454e5f-be61-4135-893c-5754a7f24da4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:58.648795 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-74454e5f-be61-4135-893c-5754a7f24da4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 0.659710 Aug 09 14:33:58.651804 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 438/916] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:57 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:58.679668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-72b19b76-621b-486b-9df9-c605c613f96f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:58.689054 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-72b19b76-621b-486b-9df9-c605c613f96f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1390 microversion: 2.1 time: 0.383765 Aug 09 14:33:58.690147 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 479/917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:58 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1390 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:58.876447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b696676b-8622-40d6-8c64-e84dbc79ad07 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:58.877186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b696676b-8622-40d6-8c64-e84dbc79ad07 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:58.890206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b696676b-8622-40d6-8c64-e84dbc79ad07 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:58.891798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b696676b-8622-40d6-8c64-e84dbc79ad07 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:58.892861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b696676b-8622-40d6-8c64-e84dbc79ad07 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:58.893727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b696676b-8622-40d6-8c64-e84dbc79ad07 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:58.894817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b696676b-8622-40d6-8c64-e84dbc79ad07 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:58.896451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b696676b-8622-40d6-8c64-e84dbc79ad07 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:59.003468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-65a6063e-6461-4658-a73c-83675cb6ed66 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:59.004898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-65a6063e-6461-4658-a73c-83675cb6ed66 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:59.017844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65a6063e-6461-4658-a73c-83675cb6ed66 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:59.023405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65a6063e-6461-4658-a73c-83675cb6ed66 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:59.023749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65a6063e-6461-4658-a73c-83675cb6ed66 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:59.026174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65a6063e-6461-4658-a73c-83675cb6ed66 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:59.027191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65a6063e-6461-4658-a73c-83675cb6ed66 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:59.032731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65a6063e-6461-4658-a73c-83675cb6ed66 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:59.209597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b696676b-8622-40d6-8c64-e84dbc79ad07 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:59.219795 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b696676b-8622-40d6-8c64-e84dbc79ad07 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1367 microversion: 2.1 time: 0.359782 Aug 09 14:33:59.222062 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 439/918] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:58 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:59.244666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f6373bbd-f27c-4a3f-baf4-8c613139f091 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd640e50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:59.341319 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f6373bbd-f27c-4a3f-baf4-8c613139f091 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.112134 Aug 09 14:33:59.342720 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 440/919] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:33:59 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:59.505937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-65a6063e-6461-4658-a73c-83675cb6ed66 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:33:59.525327 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-65a6063e-6461-4658-a73c-83675cb6ed66 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.525925 Aug 09 14:33:59.530636 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 480/920] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:58 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:33:59.611776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-724a39a1-1448-439d-97af-335d4a95445c req-67ce6673-d1f0-4578-85b1-7caaeda3f178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5121011-181e-440e-a97e-7580b76680f8", "name": "network-vif-plugged", "status": "completed", "tag": "c56a23ec-eaaa-4df9-9eca-746a74cbfa42"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:33:59.635181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-724a39a1-1448-439d-97af-335d4a95445c req-67ce6673-d1f0-4578-85b1-7caaeda3f178 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:59.644434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-724a39a1-1448-439d-97af-335d4a95445c req-67ce6673-d1f0-4578-85b1-7caaeda3f178 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:59.648188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-724a39a1-1448-439d-97af-335d4a95445c req-67ce6673-d1f0-4578-85b1-7caaeda3f178 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:59.675883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-846550cb-19c3-4bab-b7a3-e9def966876c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:59.677521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-846550cb-19c3-4bab-b7a3-e9def966876c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:59.698841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-846550cb-19c3-4bab-b7a3-e9def966876c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:59.700083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-846550cb-19c3-4bab-b7a3-e9def966876c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:59.701001 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-724a39a1-1448-439d-97af-335d4a95445c req-67ce6673-d1f0-4578-85b1-7caaeda3f178 service nova] Creating event network-vif-plugged:c56a23ec-eaaa-4df9-9eca-746a74cbfa42 for instance e5121011-181e-440e-a97e-7580b76680f8 on n-h1-844626-8 Aug 09 14:33:59.701990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-846550cb-19c3-4bab-b7a3-e9def966876c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:59.704761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-846550cb-19c3-4bab-b7a3-e9def966876c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:59.706359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-846550cb-19c3-4bab-b7a3-e9def966876c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:59.707078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-846550cb-19c3-4bab-b7a3-e9def966876c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:59.720994 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-724a39a1-1448-439d-97af-335d4a95445c req-67ce6673-d1f0-4578-85b1-7caaeda3f178 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113195 Aug 09 14:33:59.724382 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 441/921] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:33:59.743829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8f628b4-0895-4b6c-b255-c95c5e8f0594 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:33:59.751375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b8f628b4-0895-4b6c-b255-c95c5e8f0594 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:33:59.774586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8f628b4-0895-4b6c-b255-c95c5e8f0594 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:59.777417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8f628b4-0895-4b6c-b255-c95c5e8f0594 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:59.778237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8f628b4-0895-4b6c-b255-c95c5e8f0594 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:33:59.780090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8f628b4-0895-4b6c-b255-c95c5e8f0594 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:33:59.781809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8f628b4-0895-4b6c-b255-c95c5e8f0594 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:33:59.783508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8f628b4-0895-4b6c-b255-c95c5e8f0594 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:00.427651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:00.576714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-846550cb-19c3-4bab-b7a3-e9def966876c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:00.591604 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-846550cb-19c3-4bab-b7a3-e9def966876c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 0.922895 Aug 09 14:34:00.592526 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 481/922] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:59 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:00.597336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e109c0fb-cc2b-4065-9470-ad987f56444f req-d374ab48-4162-4103-8032-d00df35b01c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd9360b9-5620-4fa1-819c-90485da8e233", "name": "network-vif-unplugged", "status": "completed", "tag": "5bd1019d-0599-4147-9f78-e7a7f2989303"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:00.617721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8f628b4-0895-4b6c-b255-c95c5e8f0594 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:00.624380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:00.627219 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8f628b4-0895-4b6c-b255-c95c5e8f0594 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1390 microversion: 2.1 time: 0.898775 Aug 09 14:34:00.644522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e109c0fb-cc2b-4065-9470-ad987f56444f req-d374ab48-4162-4103-8032-d00df35b01c9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:00.645114 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 442/923] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:33:59 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1390 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:00.651108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-66833854-9142-41bc-8dee-bf108d9ab502 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:00.652057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e109c0fb-cc2b-4065-9470-ad987f56444f req-d374ab48-4162-4103-8032-d00df35b01c9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:00.652717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e109c0fb-cc2b-4065-9470-ad987f56444f req-d374ab48-4162-4103-8032-d00df35b01c9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:00.657833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-66833854-9142-41bc-8dee-bf108d9ab502 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:00.665842 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e109c0fb-cc2b-4065-9470-ad987f56444f req-d374ab48-4162-4103-8032-d00df35b01c9 service nova] Creating event network-vif-unplugged:5bd1019d-0599-4147-9f78-e7a7f2989303 for instance bd9360b9-5620-4fa1-819c-90485da8e233 on n-h2-844626-8 Aug 09 14:34:00.672583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66833854-9142-41bc-8dee-bf108d9ab502 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:00.673377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66833854-9142-41bc-8dee-bf108d9ab502 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:00.674004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66833854-9142-41bc-8dee-bf108d9ab502 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:00.675075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66833854-9142-41bc-8dee-bf108d9ab502 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:00.679739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66833854-9142-41bc-8dee-bf108d9ab502 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:00.680500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-66833854-9142-41bc-8dee-bf108d9ab502 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:00.685467 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e109c0fb-cc2b-4065-9470-ad987f56444f req-d374ab48-4162-4103-8032-d00df35b01c9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091516 Aug 09 14:34:00.694299 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 482/924] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:00.699925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2df6577c-e556-4e69-91cd-5213d164b9aa tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf773a0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:00.766774 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2df6577c-e556-4e69-91cd-5213d164b9aa tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.070881 Aug 09 14:34:00.767893 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 483/925] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:00 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:00.772871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c3007e3-0fb8-4024-ba66-7691f2b6a101 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:00.774339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c3007e3-0fb8-4024-ba66-7691f2b6a101 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:00.781148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c3007e3-0fb8-4024-ba66-7691f2b6a101 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:00.782027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c3007e3-0fb8-4024-ba66-7691f2b6a101 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:00.782702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c3007e3-0fb8-4024-ba66-7691f2b6a101 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:00.783785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c3007e3-0fb8-4024-ba66-7691f2b6a101 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:00.784506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c3007e3-0fb8-4024-ba66-7691f2b6a101 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:00.785143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c3007e3-0fb8-4024-ba66-7691f2b6a101 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:01.100263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-66833854-9142-41bc-8dee-bf108d9ab502 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:01.108974 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-66833854-9142-41bc-8dee-bf108d9ab502 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1367 microversion: 2.1 time: 0.462019 Aug 09 14:34:01.109565 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 443/926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:00 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:01.154105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c3007e3-0fb8-4024-ba66-7691f2b6a101 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:01.170576 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c3007e3-0fb8-4024-ba66-7691f2b6a101 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.401217 Aug 09 14:34:01.188037 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 484/927] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:00 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:01.460840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b17254a1-b51d-4095-bc07-d04277b03db5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Calling method '.version_select at 0x7f41dd588670>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:01.467732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17254a1-b51d-4095-bc07-d04277b03db5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:01.468732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17254a1-b51d-4095-bc07-d04277b03db5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:01.484190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17254a1-b51d-4095-bc07-d04277b03db5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:01.501619 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b17254a1-b51d-4095-bc07-d04277b03db5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.048993 Aug 09 14:34:01.502353 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 444/928] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:34:01 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:01.523042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7fcb59af-83c0-422e-b1e3-d1f64f0fa095 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:01.541293 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7fcb59af-83c0-422e-b1e3-d1f64f0fa095 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021383 Aug 09 14:34:01.543695 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 485/929] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:34:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:01.555099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d58254f8-7ec5-4b29-81aa-10ca311cf710 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-833442664", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:01.559780 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:34:01.559780 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:34:01.598234 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d58254f8-7ec5-4b29-81aa-10ca311cf710 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.048460 Aug 09 14:34:01.607883 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 445/930] 10.222.0.50 () {60 vars in 1146 bytes} [Tue Aug 9 14:34:01 2022] POST /compute/v2.1/flavors => generated 498 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:01.613410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7381a1a8-4439-4211-a44f-9132de7bcb46 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:01.618945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96b9517f-4544-4f8f-a14f-e9ab032c6be2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:01.628100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-96b9517f-4544-4f8f-a14f-e9ab032c6be2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:01.649533 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7381a1a8-4439-4211-a44f-9132de7bcb46 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040135 Aug 09 14:34:01.652368 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 486/931] 10.222.0.50 () {58 vars in 1182 bytes} [Tue Aug 9 14:34:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:34:01.665440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40cfbf9d-1863-42f4-b7b4-30cc8218fe09 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:01.673221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96b9517f-4544-4f8f-a14f-e9ab032c6be2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:01.678942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96b9517f-4544-4f8f-a14f-e9ab032c6be2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:01.681236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96b9517f-4544-4f8f-a14f-e9ab032c6be2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:01.683507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40cfbf9d-1863-42f4-b7b4-30cc8218fe09 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:01.685819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96b9517f-4544-4f8f-a14f-e9ab032c6be2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:01.695877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96b9517f-4544-4f8f-a14f-e9ab032c6be2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:01.701706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96b9517f-4544-4f8f-a14f-e9ab032c6be2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:01.744363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40cfbf9d-1863-42f4-b7b4-30cc8218fe09 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:01.751119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40cfbf9d-1863-42f4-b7b4-30cc8218fe09 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:01.752526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40cfbf9d-1863-42f4-b7b4-30cc8218fe09 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:01.756109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40cfbf9d-1863-42f4-b7b4-30cc8218fe09 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:01.759475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40cfbf9d-1863-42f4-b7b4-30cc8218fe09 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:01.762674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40cfbf9d-1863-42f4-b7b4-30cc8218fe09 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:02.125098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-40cfbf9d-1863-42f4-b7b4-30cc8218fe09 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:02.134083 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40cfbf9d-1863-42f4-b7b4-30cc8218fe09 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1390 microversion: 2.1 time: 0.480182 Aug 09 14:34:02.152976 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 487/932] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:01 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1390 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:02.166160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f5041ea-aba7-4d7b-8dd0-2fa635b8d3b5 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf24ee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:02.222295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-96b9517f-4544-4f8f-a14f-e9ab032c6be2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:02.235019 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-96b9517f-4544-4f8f-a14f-e9ab032c6be2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 0.619788 Aug 09 14:34:02.239472 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 446/933] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:01 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:02.252799 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3f5041ea-aba7-4d7b-8dd0-2fa635b8d3b5 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.098501 Aug 09 14:34:02.253567 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 488/934] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:02 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:02.258660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1184997103", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "eeb14548-1469-4dc0-95e8-67a3c1a284fb"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:02.262571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ff0c178a-9e85-4f5e-a439-677a1c42b4fd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:02.270547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ff0c178a-9e85-4f5e-a439-677a1c42b4fd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:02.279967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff0c178a-9e85-4f5e-a439-677a1c42b4fd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:02.286423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff0c178a-9e85-4f5e-a439-677a1c42b4fd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:02.287008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff0c178a-9e85-4f5e-a439-677a1c42b4fd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:02.288069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff0c178a-9e85-4f5e-a439-677a1c42b4fd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:02.288558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff0c178a-9e85-4f5e-a439-677a1c42b4fd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:02.289090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff0c178a-9e85-4f5e-a439-677a1c42b4fd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:02.338341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:34:02.648264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ff0c178a-9e85-4f5e-a439-677a1c42b4fd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:02.680556 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ff0c178a-9e85-4f5e-a439-677a1c42b4fd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1367 microversion: 2.1 time: 0.423715 Aug 09 14:34:02.682160 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 489/935] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:02 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:02.694962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f3ad6217-367a-4d93-9b00-3045cb0ef910 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:02.699371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f3ad6217-367a-4d93-9b00-3045cb0ef910 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:02.720871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3ad6217-367a-4d93-9b00-3045cb0ef910 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:02.726774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3ad6217-367a-4d93-9b00-3045cb0ef910 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:02.727814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3ad6217-367a-4d93-9b00-3045cb0ef910 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:02.730195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3ad6217-367a-4d93-9b00-3045cb0ef910 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:02.731708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3ad6217-367a-4d93-9b00-3045cb0ef910 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:02.732466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3ad6217-367a-4d93-9b00-3045cb0ef910 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:02.771362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:34:02.771969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:34:02.772257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:34:02.772722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:34:02.773160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:34:02.789958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:02.790658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:02.791328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:02.792219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:02.792824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:02.793416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:02.831728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Getting quotas for project 21a086b8d4904e118283cea8eb12b678. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:02.845385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Getting quotas for user c45d9a126a0841d5938ee21e8e87b293 and project 21a086b8d4904e118283cea8eb12b678. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:02.879233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:34:02.883204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:34:02.931435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:02.976604 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-69056403-6ae1-4823-a7b3-927ab2e2a8ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735686 Aug 09 14:34:02.983585 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 447/936] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:34:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:34:02.989347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e60c9d1-fd21-4c8e-86e2-756e185db4e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:02.990204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8e60c9d1-fd21-4c8e-86e2-756e185db4e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:03.063945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f3ad6217-367a-4d93-9b00-3045cb0ef910 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:03.073429 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f3ad6217-367a-4d93-9b00-3045cb0ef910 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.388823 Aug 09 14:34:03.087193 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 490/937] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:02 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:03.101515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-3c70bca0-107e-466b-afcb-77730a917d2f req-6a382016-0a23-4944-9ee3-8f4a83716ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0246e9-8417-4083-8430-ceda68df0c44", "tag": "ec732823-c179-4a62-aa4b-30b642a5fd58"}, {"name": "network-changed", "server_uuid": "10b5daeb-de33-403a-9779-0584f4649656", "tag": "07f06e9a-cd25-4e1e-9de3-2b5bdfc9c324"}, {"name": "network-changed", "server_uuid": "bd9360b9-5620-4fa1-819c-90485da8e233", "tag": "5bd1019d-0599-4147-9f78-e7a7f2989303"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:03.114177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3c70bca0-107e-466b-afcb-77730a917d2f req-6a382016-0a23-4944-9ee3-8f4a83716ae1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:03.114660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3c70bca0-107e-466b-afcb-77730a917d2f req-6a382016-0a23-4944-9ee3-8f4a83716ae1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:03.117924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3c70bca0-107e-466b-afcb-77730a917d2f req-6a382016-0a23-4944-9ee3-8f4a83716ae1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:03.128688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8e60c9d1-fd21-4c8e-86e2-756e185db4e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:03.138714 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8e60c9d1-fd21-4c8e-86e2-756e185db4e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1279 microversion: 2.1 time: 0.152834 Aug 09 14:34:03.142009 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 448/938] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:02 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1279 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:03.163934 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3c70bca0-107e-466b-afcb-77730a917d2f req-6a382016-0a23-4944-9ee3-8f4a83716ae1 service nova] Creating event network-changed:ec732823-c179-4a62-aa4b-30b642a5fd58 for instance 3f0246e9-8417-4083-8430-ceda68df0c44 on n-h1-844626-8 Aug 09 14:34:03.164673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e5ebe917-eda5-40c1-b9db-fe5b3bca9e12 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:03.165261 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3c70bca0-107e-466b-afcb-77730a917d2f req-6a382016-0a23-4944-9ee3-8f4a83716ae1 service nova] Creating event network-changed:07f06e9a-cd25-4e1e-9de3-2b5bdfc9c324 for instance 10b5daeb-de33-403a-9779-0584f4649656 on n-h1-844626-8 Aug 09 14:34:03.165544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e5ebe917-eda5-40c1-b9db-fe5b3bca9e12 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:03.166196 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3c70bca0-107e-466b-afcb-77730a917d2f req-6a382016-0a23-4944-9ee3-8f4a83716ae1 service nova] Creating event network-changed:5bd1019d-0599-4147-9f78-e7a7f2989303 for instance bd9360b9-5620-4fa1-819c-90485da8e233 on n-h2-844626-8 Aug 09 14:34:03.176891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5ebe917-eda5-40c1-b9db-fe5b3bca9e12 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:03.177386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5ebe917-eda5-40c1-b9db-fe5b3bca9e12 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:03.178640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5ebe917-eda5-40c1-b9db-fe5b3bca9e12 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:03.183880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5ebe917-eda5-40c1-b9db-fe5b3bca9e12 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:03.185012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5ebe917-eda5-40c1-b9db-fe5b3bca9e12 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:03.185796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5ebe917-eda5-40c1-b9db-fe5b3bca9e12 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:03.200862 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-3c70bca0-107e-466b-afcb-77730a917d2f req-6a382016-0a23-4944-9ee3-8f4a83716ae1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.100571 Aug 09 14:34:03.201943 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 491/939] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:34:03.258703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9391048f-0488-4549-b364-ee2840cab52c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:03.259799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9391048f-0488-4549-b364-ee2840cab52c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:03.272348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9391048f-0488-4549-b364-ee2840cab52c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:03.277175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9391048f-0488-4549-b364-ee2840cab52c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:03.277897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9391048f-0488-4549-b364-ee2840cab52c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:03.280279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9391048f-0488-4549-b364-ee2840cab52c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:03.280749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9391048f-0488-4549-b364-ee2840cab52c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:03.281171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9391048f-0488-4549-b364-ee2840cab52c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:03.458733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e5ebe917-eda5-40c1-b9db-fe5b3bca9e12 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:03.477366 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e5ebe917-eda5-40c1-b9db-fe5b3bca9e12 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1590 microversion: 2.1 time: 0.316325 Aug 09 14:34:03.478161 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 449/940] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:03 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1590 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:03.488847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e34ad142-2904-4266-bc48-562766027934 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd588940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:03.551848 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e34ad142-2904-4266-bc48-562766027934 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.070927 Aug 09 14:34:03.553044 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 450/941] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:03 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:03.562959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f6e27d9-9498-4d06-9b9e-79017a457d0b tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:03.568789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f6e27d9-9498-4d06-9b9e-79017a457d0b tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:03.580040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6e27d9-9498-4d06-9b9e-79017a457d0b tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:03.583192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6e27d9-9498-4d06-9b9e-79017a457d0b tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:03.583850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6e27d9-9498-4d06-9b9e-79017a457d0b tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:03.584755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6e27d9-9498-4d06-9b9e-79017a457d0b tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:03.587618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6e27d9-9498-4d06-9b9e-79017a457d0b tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:03.588259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f6e27d9-9498-4d06-9b9e-79017a457d0b tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:03.621607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9391048f-0488-4549-b364-ee2840cab52c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:03.630853 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9391048f-0488-4549-b364-ee2840cab52c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 0.377554 Aug 09 14:34:03.634300 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 492/942] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:03 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:03.703977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cfe5f10d-d012-4137-a841-749a0f287f62 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:03.705110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cfe5f10d-d012-4137-a841-749a0f287f62 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:03.716268 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f6e27d9-9498-4d06-9b9e-79017a457d0b tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.160529 Aug 09 14:34:03.716945 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 451/943] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:34:03 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:03.725339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfe5f10d-d012-4137-a841-749a0f287f62 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:03.727031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfe5f10d-d012-4137-a841-749a0f287f62 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:03.727691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfe5f10d-d012-4137-a841-749a0f287f62 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:03.731793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfe5f10d-d012-4137-a841-749a0f287f62 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:03.732492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfe5f10d-d012-4137-a841-749a0f287f62 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:03.733185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfe5f10d-d012-4137-a841-749a0f287f62 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:04.101261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c71395dc-4623-432a-b6af-9d33eaf86b26 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:04.102852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c71395dc-4623-432a-b6af-9d33eaf86b26 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:04.114042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71395dc-4623-432a-b6af-9d33eaf86b26 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:04.114983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71395dc-4623-432a-b6af-9d33eaf86b26 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:04.119603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71395dc-4623-432a-b6af-9d33eaf86b26 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:04.120647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71395dc-4623-432a-b6af-9d33eaf86b26 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:04.121333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71395dc-4623-432a-b6af-9d33eaf86b26 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:04.123131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71395dc-4623-432a-b6af-9d33eaf86b26 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:04.137571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cfe5f10d-d012-4137-a841-749a0f287f62 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:04.147505 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cfe5f10d-d012-4137-a841-749a0f287f62 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1367 microversion: 2.1 time: 0.448939 Aug 09 14:34:04.153962 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 493/944] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:03 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:04.166839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-35e37a8e-ec49-4683-8949-b32c6030a626 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:04.173883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-35e37a8e-ec49-4683-8949-b32c6030a626 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:04.199807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35e37a8e-ec49-4683-8949-b32c6030a626 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:04.202546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35e37a8e-ec49-4683-8949-b32c6030a626 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:04.204410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35e37a8e-ec49-4683-8949-b32c6030a626 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:04.205274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35e37a8e-ec49-4683-8949-b32c6030a626 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:04.208789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35e37a8e-ec49-4683-8949-b32c6030a626 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:04.209529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35e37a8e-ec49-4683-8949-b32c6030a626 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:04.378239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-35e37a8e-ec49-4683-8949-b32c6030a626 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:04.399415 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-35e37a8e-ec49-4683-8949-b32c6030a626 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1275 microversion: 2.1 time: 0.239149 Aug 09 14:34:04.401208 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 494/945] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:04 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1275 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:04.530344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c71395dc-4623-432a-b6af-9d33eaf86b26 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:04.542819 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c71395dc-4623-432a-b6af-9d33eaf86b26 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.442752 Aug 09 14:34:04.543657 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 452/946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:04 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:04.566765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60c51208-01e6-422f-b652-805280e82823 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddec0940>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:04.576010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8caee046-41f9-4b2a-93b8-5d676ff3fb56 req-951e5815-dfb9-43d0-a889-33e77bd13b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8a0577-e7e0-414e-b847-d01ecbd5eb4d", "name": "network-vif-plugged", "status": "completed", "tag": "0d7b7ce8-4490-4536-b279-18fbab70b99a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:04.619320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8caee046-41f9-4b2a-93b8-5d676ff3fb56 req-951e5815-dfb9-43d0-a889-33e77bd13b4b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:04.620559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8caee046-41f9-4b2a-93b8-5d676ff3fb56 req-951e5815-dfb9-43d0-a889-33e77bd13b4b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:04.622418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8caee046-41f9-4b2a-93b8-5d676ff3fb56 req-951e5815-dfb9-43d0-a889-33e77bd13b4b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:04.660495 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60c51208-01e6-422f-b652-805280e82823 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.097604 Aug 09 14:34:04.661600 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 495/947] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:04 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:04.662832 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8caee046-41f9-4b2a-93b8-5d676ff3fb56 req-951e5815-dfb9-43d0-a889-33e77bd13b4b service nova] Creating event network-vif-plugged:0d7b7ce8-4490-4536-b279-18fbab70b99a for instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d on n-h2-844626-8 Aug 09 14:34:04.667433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82c1ff8f-103f-4842-87b4-5224a578bd16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:04.672931 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8caee046-41f9-4b2a-93b8-5d676ff3fb56 req-951e5815-dfb9-43d0-a889-33e77bd13b4b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102518 Aug 09 14:34:04.677329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-82c1ff8f-103f-4842-87b4-5224a578bd16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:04.679488 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 453/948] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:04.696248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82c1ff8f-103f-4842-87b4-5224a578bd16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:04.702508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82c1ff8f-103f-4842-87b4-5224a578bd16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:04.704629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82c1ff8f-103f-4842-87b4-5224a578bd16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:04.705438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82c1ff8f-103f-4842-87b4-5224a578bd16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:04.707472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82c1ff8f-103f-4842-87b4-5224a578bd16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:04.710023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82c1ff8f-103f-4842-87b4-5224a578bd16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:05.152318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-82c1ff8f-103f-4842-87b4-5224a578bd16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:05.167699 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-82c1ff8f-103f-4842-87b4-5224a578bd16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 0.504723 Aug 09 14:34:05.168545 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 496/949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:04 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:05.181076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07b00912-4928-4f68-9bb2-e9958ed5ed6c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:05.181786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07b00912-4928-4f68-9bb2-e9958ed5ed6c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:05.211910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b00912-4928-4f68-9bb2-e9958ed5ed6c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:05.219281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b00912-4928-4f68-9bb2-e9958ed5ed6c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:05.219797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b00912-4928-4f68-9bb2-e9958ed5ed6c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:05.226594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b00912-4928-4f68-9bb2-e9958ed5ed6c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:05.228026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b00912-4928-4f68-9bb2-e9958ed5ed6c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:05.231208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b00912-4928-4f68-9bb2-e9958ed5ed6c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:05.423111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c1e51585-0a4f-450c-ad61-7fd935b21aee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:05.423985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c1e51585-0a4f-450c-ad61-7fd935b21aee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:05.436868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=28 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:05.446482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1e51585-0a4f-450c-ad61-7fd935b21aee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:05.448018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1e51585-0a4f-450c-ad61-7fd935b21aee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:05.450016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1e51585-0a4f-450c-ad61-7fd935b21aee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:05.451836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1e51585-0a4f-450c-ad61-7fd935b21aee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:05.452496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1e51585-0a4f-450c-ad61-7fd935b21aee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:05.458499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1e51585-0a4f-450c-ad61-7fd935b21aee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:05.657165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c1e51585-0a4f-450c-ad61-7fd935b21aee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:05.682380 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c1e51585-0a4f-450c-ad61-7fd935b21aee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1337 microversion: 2.1 time: 0.250350 Aug 09 14:34:05.683589 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 497/950] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:05 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1337 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:05.688860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60546acb-78b5-4c15-b416-dd2624356d5f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:05.689866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60546acb-78b5-4c15-b416-dd2624356d5f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:05.699228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60546acb-78b5-4c15-b416-dd2624356d5f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:05.699912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60546acb-78b5-4c15-b416-dd2624356d5f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:05.700588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60546acb-78b5-4c15-b416-dd2624356d5f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:05.701551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60546acb-78b5-4c15-b416-dd2624356d5f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:05.702103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60546acb-78b5-4c15-b416-dd2624356d5f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:05.702635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60546acb-78b5-4c15-b416-dd2624356d5f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:05.754082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07b00912-4928-4f68-9bb2-e9958ed5ed6c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:05.763371 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07b00912-4928-4f68-9bb2-e9958ed5ed6c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1367 microversion: 2.1 time: 0.589293 Aug 09 14:34:05.764543 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 454/951] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:05 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1367 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:05.775901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75226126-abd4-4fde-a880-4b0b03fa6844 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd588ee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:05.852964 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75226126-abd4-4fde-a880-4b0b03fa6844 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.087125 Aug 09 14:34:05.854587 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 455/952] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:05 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:05.911556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60546acb-78b5-4c15-b416-dd2624356d5f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:05.928207 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60546acb-78b5-4c15-b416-dd2624356d5f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.243332 Aug 09 14:34:05.928720 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 498/953] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:05 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:06.191825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1747f7f7-8f82-4f87-8169-65c935383945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:06.193110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1747f7f7-8f82-4f87-8169-65c935383945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:06.205164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1747f7f7-8f82-4f87-8169-65c935383945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:06.206177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1747f7f7-8f82-4f87-8169-65c935383945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:06.206853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1747f7f7-8f82-4f87-8169-65c935383945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:06.207861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1747f7f7-8f82-4f87-8169-65c935383945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:06.208520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1747f7f7-8f82-4f87-8169-65c935383945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:06.209143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1747f7f7-8f82-4f87-8169-65c935383945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:06.222026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c74f4079-0b77-4782-884b-036f23bf48c1 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:06.223276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c74f4079-0b77-4782-884b-036f23bf48c1 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:06.234260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c74f4079-0b77-4782-884b-036f23bf48c1 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:06.235008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c74f4079-0b77-4782-884b-036f23bf48c1 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:06.235635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c74f4079-0b77-4782-884b-036f23bf48c1 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:06.236502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c74f4079-0b77-4782-884b-036f23bf48c1 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:06.237144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c74f4079-0b77-4782-884b-036f23bf48c1 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:06.239840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c74f4079-0b77-4782-884b-036f23bf48c1 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:06.561003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c74f4079-0b77-4782-884b-036f23bf48c1 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:06.563592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:06.578991 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c74f4079-0b77-4782-884b-036f23bf48c1 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1590 microversion: 2.1 time: 0.360780 Aug 09 14:34:06.593571 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 499/954] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:06 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1590 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:06.616485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-90417ccc-c53e-479b-8420-e454bbf5067b req-a2ce808b-6a69-40e1-b405-23e5941bde25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5121011-181e-440e-a97e-7580b76680f8", "tag": "c56a23ec-eaaa-4df9-9eca-746a74cbfa42"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:06.634830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1747f7f7-8f82-4f87-8169-65c935383945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:06.640131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-90417ccc-c53e-479b-8420-e454bbf5067b req-a2ce808b-6a69-40e1-b405-23e5941bde25 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:06.640927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-90417ccc-c53e-479b-8420-e454bbf5067b req-a2ce808b-6a69-40e1-b405-23e5941bde25 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:06.641564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-90417ccc-c53e-479b-8420-e454bbf5067b req-a2ce808b-6a69-40e1-b405-23e5941bde25 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:06.647700 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1747f7f7-8f82-4f87-8169-65c935383945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 0.458399 Aug 09 14:34:06.663067 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 456/955] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:06 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:06.677283 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-90417ccc-c53e-479b-8420-e454bbf5067b req-a2ce808b-6a69-40e1-b405-23e5941bde25 service nova] Creating event network-changed:c56a23ec-eaaa-4df9-9eca-746a74cbfa42 for instance e5121011-181e-440e-a97e-7580b76680f8 on n-h1-844626-8 Aug 09 14:34:06.690512 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-90417ccc-c53e-479b-8420-e454bbf5067b req-a2ce808b-6a69-40e1-b405-23e5941bde25 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085986 Aug 09 14:34:06.696192 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 500/956] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:06.709959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8461081a-a4cf-4e98-8fe8-3a865f3ee859 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:06.711000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8461081a-a4cf-4e98-8fe8-3a865f3ee859 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:06.724355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8461081a-a4cf-4e98-8fe8-3a865f3ee859 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:06.731269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8461081a-a4cf-4e98-8fe8-3a865f3ee859 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:06.731934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8461081a-a4cf-4e98-8fe8-3a865f3ee859 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:06.736062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8461081a-a4cf-4e98-8fe8-3a865f3ee859 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:06.736636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8461081a-a4cf-4e98-8fe8-3a865f3ee859 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:06.737206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8461081a-a4cf-4e98-8fe8-3a865f3ee859 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:06.791440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-228eef4a-5c8b-411d-9532-a1a1ba728a03 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:06.792052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-228eef4a-5c8b-411d-9532-a1a1ba728a03 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:06.808457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-228eef4a-5c8b-411d-9532-a1a1ba728a03 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:06.808948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-228eef4a-5c8b-411d-9532-a1a1ba728a03 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:06.809378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-228eef4a-5c8b-411d-9532-a1a1ba728a03 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:06.819375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-228eef4a-5c8b-411d-9532-a1a1ba728a03 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:06.819907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-228eef4a-5c8b-411d-9532-a1a1ba728a03 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:06.820444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-228eef4a-5c8b-411d-9532-a1a1ba728a03 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:06.853439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8461081a-a4cf-4e98-8fe8-3a865f3ee859 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:06.866499 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8461081a-a4cf-4e98-8fe8-3a865f3ee859 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1337 microversion: 2.1 time: 0.155855 Aug 09 14:34:06.867437 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 457/957] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:06 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1337 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:06.872203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c27eddb5-d2f8-4a59-af6e-6a8e6156f488 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd58fb80>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:06.943688 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c27eddb5-d2f8-4a59-af6e-6a8e6156f488 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.075010 Aug 09 14:34:06.944751 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 458/958] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:06 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:06.954984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-011fdb18-1212-4220-806d-a1de5cd5596e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:06.956145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-011fdb18-1212-4220-806d-a1de5cd5596e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:06.974890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-011fdb18-1212-4220-806d-a1de5cd5596e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:06.979897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-011fdb18-1212-4220-806d-a1de5cd5596e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:06.983255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-011fdb18-1212-4220-806d-a1de5cd5596e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:06.984191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-011fdb18-1212-4220-806d-a1de5cd5596e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:06.984785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-011fdb18-1212-4220-806d-a1de5cd5596e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:06.989126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-011fdb18-1212-4220-806d-a1de5cd5596e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:07.043017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-228eef4a-5c8b-411d-9532-a1a1ba728a03 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:07.058610 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-228eef4a-5c8b-411d-9532-a1a1ba728a03 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1557 microversion: 2.1 time: 0.273273 Aug 09 14:34:07.063543 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 501/959] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:06 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1557 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:07.090682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0abdb4b1-52cb-4431-9832-c07545c5fbae tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:07.091206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0abdb4b1-52cb-4431-9832-c07545c5fbae tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:07.102629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0abdb4b1-52cb-4431-9832-c07545c5fbae tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:07.103470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0abdb4b1-52cb-4431-9832-c07545c5fbae tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:07.105473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0abdb4b1-52cb-4431-9832-c07545c5fbae tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:07.107266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0abdb4b1-52cb-4431-9832-c07545c5fbae tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:07.107970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0abdb4b1-52cb-4431-9832-c07545c5fbae tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:07.108624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0abdb4b1-52cb-4431-9832-c07545c5fbae tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:07.248828 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0abdb4b1-52cb-4431-9832-c07545c5fbae tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.169654 Aug 09 14:34:07.259037 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 502/960] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:34:07 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-interface => generated 285 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:34:07.396298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-011fdb18-1212-4220-806d-a1de5cd5596e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:07.427128 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-011fdb18-1212-4220-806d-a1de5cd5596e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.461715 Aug 09 14:34:07.427128 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 459/961] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:06 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:07.673587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3a4d26e-95c4-49ae-aa33-2afc06b551a7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:07.674746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3a4d26e-95c4-49ae-aa33-2afc06b551a7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:07.677319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:07.690456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3a4d26e-95c4-49ae-aa33-2afc06b551a7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:07.704472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3a4d26e-95c4-49ae-aa33-2afc06b551a7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:07.705303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3a4d26e-95c4-49ae-aa33-2afc06b551a7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:07.706413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3a4d26e-95c4-49ae-aa33-2afc06b551a7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:07.707702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3a4d26e-95c4-49ae-aa33-2afc06b551a7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:07.710154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3a4d26e-95c4-49ae-aa33-2afc06b551a7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:07.890718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34020531-d380-40e5-a963-4f3a005dee10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:07.891387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34020531-d380-40e5-a963-4f3a005dee10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:07.903764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34020531-d380-40e5-a963-4f3a005dee10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:07.915230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34020531-d380-40e5-a963-4f3a005dee10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:07.915816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34020531-d380-40e5-a963-4f3a005dee10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:07.916707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34020531-d380-40e5-a963-4f3a005dee10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:07.917049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34020531-d380-40e5-a963-4f3a005dee10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:07.924950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34020531-d380-40e5-a963-4f3a005dee10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:08.658481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-34020531-d380-40e5-a963-4f3a005dee10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:08.670133 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34020531-d380-40e5-a963-4f3a005dee10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1337 microversion: 2.1 time: 0.785068 Aug 09 14:34:08.671067 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 460/962] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:07 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1337 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:08.686509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-589be117-4d52-4f39-bdea-efd1afd83505 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd839940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:08.786421 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-589be117-4d52-4f39-bdea-efd1afd83505 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.105881 Aug 09 14:34:08.786421 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 461/963] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:08 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:08.792070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a280409c-6418-48c5-a648-6cd49fbde03d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:08.792993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a280409c-6418-48c5-a648-6cd49fbde03d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:08.831479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a280409c-6418-48c5-a648-6cd49fbde03d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:08.831843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a280409c-6418-48c5-a648-6cd49fbde03d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:08.832381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a280409c-6418-48c5-a648-6cd49fbde03d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:08.833398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a280409c-6418-48c5-a648-6cd49fbde03d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:08.833948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a280409c-6418-48c5-a648-6cd49fbde03d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:08.839110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a280409c-6418-48c5-a648-6cd49fbde03d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:09.105964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b3a4d26e-95c4-49ae-aa33-2afc06b551a7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:09.123952 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3a4d26e-95c4-49ae-aa33-2afc06b551a7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 1.455193 Aug 09 14:34:09.126118 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 503/964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:07 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:09.235685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a280409c-6418-48c5-a648-6cd49fbde03d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:09.250959 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a280409c-6418-48c5-a648-6cd49fbde03d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.467865 Aug 09 14:34:09.251900 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 462/965] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:08 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:09.625544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-31354b92-6846-4a20-ba63-a89e5009fc4a req-bce874a7-a484-49eb-87eb-c44311414f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff8a0577-e7e0-414e-b847-d01ecbd5eb4d", "tag": "0d7b7ce8-4490-4536-b279-18fbab70b99a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:09.636056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-31354b92-6846-4a20-ba63-a89e5009fc4a req-bce874a7-a484-49eb-87eb-c44311414f0d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:09.637029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-31354b92-6846-4a20-ba63-a89e5009fc4a req-bce874a7-a484-49eb-87eb-c44311414f0d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:09.637623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-31354b92-6846-4a20-ba63-a89e5009fc4a req-bce874a7-a484-49eb-87eb-c44311414f0d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:09.651856 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-31354b92-6846-4a20-ba63-a89e5009fc4a req-bce874a7-a484-49eb-87eb-c44311414f0d service nova] Creating event network-changed:0d7b7ce8-4490-4536-b279-18fbab70b99a for instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d on n-h2-844626-8 Aug 09 14:34:09.660561 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-31354b92-6846-4a20-ba63-a89e5009fc4a req-bce874a7-a484-49eb-87eb-c44311414f0d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038710 Aug 09 14:34:09.666331 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 504/966] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:34:09.693784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b9a21366-40af-4c55-b343-01fb54014bfb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:09.694411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b9a21366-40af-4c55-b343-01fb54014bfb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:09.705081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9a21366-40af-4c55-b343-01fb54014bfb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:09.705575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9a21366-40af-4c55-b343-01fb54014bfb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:09.706054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9a21366-40af-4c55-b343-01fb54014bfb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:09.706769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9a21366-40af-4c55-b343-01fb54014bfb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:09.707263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9a21366-40af-4c55-b343-01fb54014bfb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:09.707677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9a21366-40af-4c55-b343-01fb54014bfb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:09.798119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17767c14-9c7a-48ef-a9e4-2eb08f013254 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf10e50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:09.886079 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17767c14-9c7a-48ef-a9e4-2eb08f013254 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1455 microversion: 2.1 time: 0.091975 Aug 09 14:34:09.886662 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 505/967] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:09 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:09.988223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b9a21366-40af-4c55-b343-01fb54014bfb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:09.996266 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b9a21366-40af-4c55-b343-01fb54014bfb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1379 microversion: 2.1 time: 0.306317 Aug 09 14:34:10.012978 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 463/968] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:09 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1379 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:10.151019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b0940f3b-36df-43ec-b263-82d6677605fa tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:10.153147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b0940f3b-36df-43ec-b263-82d6677605fa tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:10.165848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0940f3b-36df-43ec-b263-82d6677605fa tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:10.170360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0940f3b-36df-43ec-b263-82d6677605fa tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:10.171104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0940f3b-36df-43ec-b263-82d6677605fa tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:10.177758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0940f3b-36df-43ec-b263-82d6677605fa tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:10.178570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0940f3b-36df-43ec-b263-82d6677605fa tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:10.180451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0940f3b-36df-43ec-b263-82d6677605fa tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:10.284056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-51971f50-7fe8-4a4f-8466-d2aa33cca547 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:10.284929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-51971f50-7fe8-4a4f-8466-d2aa33cca547 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:10.302529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51971f50-7fe8-4a4f-8466-d2aa33cca547 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:10.303279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51971f50-7fe8-4a4f-8466-d2aa33cca547 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:10.303896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51971f50-7fe8-4a4f-8466-d2aa33cca547 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:10.304796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51971f50-7fe8-4a4f-8466-d2aa33cca547 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:10.305391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51971f50-7fe8-4a4f-8466-d2aa33cca547 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:10.305970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51971f50-7fe8-4a4f-8466-d2aa33cca547 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:10.750950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b0940f3b-36df-43ec-b263-82d6677605fa tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:10.762297 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b0940f3b-36df-43ec-b263-82d6677605fa tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 0.620001 Aug 09 14:34:10.767752 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 506/969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:10 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:10.867286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-51971f50-7fe8-4a4f-8466-d2aa33cca547 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:10.877967 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-51971f50-7fe8-4a4f-8466-d2aa33cca547 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.598795 Aug 09 14:34:10.879891 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 464/970] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:10 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:10.901705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb2f5ba3-3105-4d92-909e-e2816ae01060 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf77b80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:10.972776 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb2f5ba3-3105-4d92-909e-e2816ae01060 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1464 microversion: 2.1 time: 0.075356 Aug 09 14:34:10.973519 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 507/971] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:10 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1464 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:10.989412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e038f1a7-edd7-40b2-9946-d10847b0bbbd tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd640b80>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:11.034382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dc471abb-810b-4b25-933d-2583fd0ba869 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:11.035410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dc471abb-810b-4b25-933d-2583fd0ba869 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:11.060150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc471abb-810b-4b25-933d-2583fd0ba869 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:11.061239 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e038f1a7-edd7-40b2-9946-d10847b0bbbd tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 200 len: 1464 microversion: 2.1 time: 0.077044 Aug 09 14:34:11.065588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc471abb-810b-4b25-933d-2583fd0ba869 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:11.065796 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 465/972] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:10 2022] GET /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 1464 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:11.074652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc471abb-810b-4b25-933d-2583fd0ba869 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:11.078199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc471abb-810b-4b25-933d-2583fd0ba869 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:11.079248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc471abb-810b-4b25-933d-2583fd0ba869 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:11.080127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc471abb-810b-4b25-933d-2583fd0ba869 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:11.087323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-190c047d-c63c-4bbf-8fd3-c59c478a0f9a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:11.091269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-190c047d-c63c-4bbf-8fd3-c59c478a0f9a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:11.118932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190c047d-c63c-4bbf-8fd3-c59c478a0f9a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:11.119471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190c047d-c63c-4bbf-8fd3-c59c478a0f9a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:11.119911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190c047d-c63c-4bbf-8fd3-c59c478a0f9a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:11.120634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190c047d-c63c-4bbf-8fd3-c59c478a0f9a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:11.121072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190c047d-c63c-4bbf-8fd3-c59c478a0f9a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:11.132349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190c047d-c63c-4bbf-8fd3-c59c478a0f9a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:11.382543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dc471abb-810b-4b25-933d-2583fd0ba869 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:11.390124 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dc471abb-810b-4b25-933d-2583fd0ba869 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1379 microversion: 2.1 time: 0.364337 Aug 09 14:34:11.390705 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 508/973] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:11 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1379 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:11.467794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-190c047d-c63c-4bbf-8fd3-c59c478a0f9a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:11.479739 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-190c047d-c63c-4bbf-8fd3-c59c478a0f9a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1" status: 200 len: 1468 microversion: 2.1 time: 0.406493 Aug 09 14:34:11.481185 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 466/974] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:11 2022] GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1 => generated 1468 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:11.502035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-793b5231-74a7-4e1c-9d5b-8efe8a580e4b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1759026469"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:11.505048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-793b5231-74a7-4e1c-9d5b-8efe8a580e4b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:11.512632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-793b5231-74a7-4e1c-9d5b-8efe8a580e4b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:11.513418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-793b5231-74a7-4e1c-9d5b-8efe8a580e4b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:11.514057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-793b5231-74a7-4e1c-9d5b-8efe8a580e4b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:11.515079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-793b5231-74a7-4e1c-9d5b-8efe8a580e4b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:11.515758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-793b5231-74a7-4e1c-9d5b-8efe8a580e4b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:11.516442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-793b5231-74a7-4e1c-9d5b-8efe8a580e4b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:11.760263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-4649ba77-58b7-4534-9bb4-66b7b85fe599 req-2f97210b-19ba-4df1-be18-4e43231c3e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0246e9-8417-4083-8430-ceda68df0c44", "name": "network-vif-plugged", "status": "completed", "tag": "ec732823-c179-4a62-aa4b-30b642a5fd58"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:11.777288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4649ba77-58b7-4534-9bb4-66b7b85fe599 req-2f97210b-19ba-4df1-be18-4e43231c3e39 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:11.778062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4649ba77-58b7-4534-9bb4-66b7b85fe599 req-2f97210b-19ba-4df1-be18-4e43231c3e39 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:11.778646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4649ba77-58b7-4534-9bb4-66b7b85fe599 req-2f97210b-19ba-4df1-be18-4e43231c3e39 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:11.812497 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-4649ba77-58b7-4534-9bb4-66b7b85fe599 req-2f97210b-19ba-4df1-be18-4e43231c3e39 service nova] Creating event network-vif-plugged:ec732823-c179-4a62-aa4b-30b642a5fd58 for instance 3f0246e9-8417-4083-8430-ceda68df0c44 on n-h1-844626-8 Aug 09 14:34:11.835851 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-4649ba77-58b7-4534-9bb4-66b7b85fe599 req-2f97210b-19ba-4df1-be18-4e43231c3e39 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078331 Aug 09 14:34:11.841153 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 467/975] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:11.852668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7187121e-8caf-4d57-a380-999145b8f305 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:11.862454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7187121e-8caf-4d57-a380-999145b8f305 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:11.878815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7187121e-8caf-4d57-a380-999145b8f305 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:11.880131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7187121e-8caf-4d57-a380-999145b8f305 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:11.880760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7187121e-8caf-4d57-a380-999145b8f305 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:11.884170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7187121e-8caf-4d57-a380-999145b8f305 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:11.884964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7187121e-8caf-4d57-a380-999145b8f305 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:11.885637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7187121e-8caf-4d57-a380-999145b8f305 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:11.911967 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-793b5231-74a7-4e1c-9d5b-8efe8a580e4b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "POST /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34/action" status: 202 len: 0 microversion: 2.1 time: 0.408320 Aug 09 14:34:11.924023 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 509/976] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:34:11 2022] POST /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 14:34:11.958201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a8b0ef8-7c85-4b23-9ba7-c182f2fe19c5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:11.962992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a8b0ef8-7c85-4b23-9ba7-c182f2fe19c5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:11.985524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8b0ef8-7c85-4b23-9ba7-c182f2fe19c5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:11.992995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8b0ef8-7c85-4b23-9ba7-c182f2fe19c5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:11.995707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8b0ef8-7c85-4b23-9ba7-c182f2fe19c5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:11.996594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8b0ef8-7c85-4b23-9ba7-c182f2fe19c5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:11.997321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8b0ef8-7c85-4b23-9ba7-c182f2fe19c5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:11.997750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8b0ef8-7c85-4b23-9ba7-c182f2fe19c5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:12.457673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7187121e-8caf-4d57-a380-999145b8f305 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:12.465526 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7187121e-8caf-4d57-a380-999145b8f305 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 0.622755 Aug 09 14:34:12.478757 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 468/977] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:11 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:12.484035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-938da775-18b9-4eed-96cd-8728930f8050 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd5f55e0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:12.527172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9a8b0ef8-7c85-4b23-9ba7-c182f2fe19c5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:12.540435 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-938da775-18b9-4eed-96cd-8728930f8050 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.060206 Aug 09 14:34:12.541030 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 469/978] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:12 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:12.541248 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a8b0ef8-7c85-4b23-9ba7-c182f2fe19c5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.615286 Aug 09 14:34:12.552989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4edbd818-b123-4582-b08e-fdaeb0131083 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:12.553983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4edbd818-b123-4582-b08e-fdaeb0131083 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:12.556574 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 510/979] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:11 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:12.562856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4edbd818-b123-4582-b08e-fdaeb0131083 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:12.565556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4edbd818-b123-4582-b08e-fdaeb0131083 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:12.566027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4edbd818-b123-4582-b08e-fdaeb0131083 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:12.566828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4edbd818-b123-4582-b08e-fdaeb0131083 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:12.569933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4edbd818-b123-4582-b08e-fdaeb0131083 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:12.571898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4edbd818-b123-4582-b08e-fdaeb0131083 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:12.608030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:12.802240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:12.862344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4edbd818-b123-4582-b08e-fdaeb0131083 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:12.872973 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4edbd818-b123-4582-b08e-fdaeb0131083 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1379 microversion: 2.1 time: 0.330870 Aug 09 14:34:12.875068 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 470/980] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:12 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1379 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:13.040791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-2be2de46-3d29-40a4-ad89-8a06263830c1 req-7fa5600f-1688-4adf-9e1b-6135173309c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a", "tag": "1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:13.066176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2be2de46-3d29-40a4-ad89-8a06263830c1 req-7fa5600f-1688-4adf-9e1b-6135173309c0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:13.067952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2be2de46-3d29-40a4-ad89-8a06263830c1 req-7fa5600f-1688-4adf-9e1b-6135173309c0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:13.068467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2be2de46-3d29-40a4-ad89-8a06263830c1 req-7fa5600f-1688-4adf-9e1b-6135173309c0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:13.091202 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-2be2de46-3d29-40a4-ad89-8a06263830c1 req-7fa5600f-1688-4adf-9e1b-6135173309c0 service nova] Creating event network-changed:1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b for instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a on n-h2-844626-8 Aug 09 14:34:13.098556 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-2be2de46-3d29-40a4-ad89-8a06263830c1 req-7fa5600f-1688-4adf-9e1b-6135173309c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060576 Aug 09 14:34:13.099731 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 511/981] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:13.411531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=54 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:13.488319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31554cd5-a9c3-416b-b6db-aadeaedc0284 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:13.489354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31554cd5-a9c3-416b-b6db-aadeaedc0284 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:13.495898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31554cd5-a9c3-416b-b6db-aadeaedc0284 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:13.496368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31554cd5-a9c3-416b-b6db-aadeaedc0284 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:13.496991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31554cd5-a9c3-416b-b6db-aadeaedc0284 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:13.497687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31554cd5-a9c3-416b-b6db-aadeaedc0284 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:13.498133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31554cd5-a9c3-416b-b6db-aadeaedc0284 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:13.498720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31554cd5-a9c3-416b-b6db-aadeaedc0284 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:13.545775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e236051c-3e19-4993-86c3-c5dd15d4e9fa tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Action: 'create', calling method: .version_select at 0x7f41dd666ee0>, body: {"keypair": {"name": "tempest-keypair-10932520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLC4Pu6R6SPQoL2F5sFtznfH2GjHv8KF/VP+3pD5M7MhPtfo7On1DCl+CNdnlGQl8J+w7FxbZvzNy6f9T2Jr9zY/FyLqGP/QeNecw3ROEwZGNFJcIl3DsUuDtpNfyu1w2Q=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:13.564860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e236051c-3e19-4993-86c3-c5dd15d4e9fa tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Getting quotas for project ec1c1fd6a864416caf79394d7e194099. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:13.569738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e236051c-3e19-4993-86c3-c5dd15d4e9fa tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Getting quotas for user 8e9f25ff5f8a422faef06aa2a33a6c97 and project ec1c1fd6a864416caf79394d7e194099. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:13.596817 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e236051c-3e19-4993-86c3-c5dd15d4e9fa tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.189791 Aug 09 14:34:13.597661 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 471/982] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:34:13 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:13.602463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a8e4577-6fe3-4593-8819-972846ef34d4 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd58f3a0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:13.662082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-31554cd5-a9c3-416b-b6db-aadeaedc0284 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:13.671691 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31554cd5-a9c3-416b-b6db-aadeaedc0284 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 0.188895 Aug 09 14:34:13.674830 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a8e4577-6fe3-4593-8819-972846ef34d4 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.075699 Aug 09 14:34:13.675994 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 472/983] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:13 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:13.683926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a63401e-56d0-4cfb-9309-0dbd9519252e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:13.687531 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 512/984] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:13 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:13.687766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a63401e-56d0-4cfb-9309-0dbd9519252e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:13.692196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a63401e-56d0-4cfb-9309-0dbd9519252e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:13.693491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a63401e-56d0-4cfb-9309-0dbd9519252e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:13.693491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a63401e-56d0-4cfb-9309-0dbd9519252e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:13.694343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a63401e-56d0-4cfb-9309-0dbd9519252e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:13.694936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a63401e-56d0-4cfb-9309-0dbd9519252e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:13.695466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a63401e-56d0-4cfb-9309-0dbd9519252e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:13.851251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3a63401e-56d0-4cfb-9309-0dbd9519252e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:13.859531 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a63401e-56d0-4cfb-9309-0dbd9519252e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1501 microversion: 2.1 time: 0.181687 Aug 09 14:34:13.860100 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 473/985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:13 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1501 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:13.898949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-404cb185-bfe7-4ac7-894d-89e17e5ad828 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:13.899769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-404cb185-bfe7-4ac7-894d-89e17e5ad828 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:13.906070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-404cb185-bfe7-4ac7-894d-89e17e5ad828 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:13.906773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-404cb185-bfe7-4ac7-894d-89e17e5ad828 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:13.907237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-404cb185-bfe7-4ac7-894d-89e17e5ad828 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:13.907911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-404cb185-bfe7-4ac7-894d-89e17e5ad828 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:13.908354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-404cb185-bfe7-4ac7-894d-89e17e5ad828 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:13.908793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-404cb185-bfe7-4ac7-894d-89e17e5ad828 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:14.086452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-404cb185-bfe7-4ac7-894d-89e17e5ad828 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:14.095899 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-404cb185-bfe7-4ac7-894d-89e17e5ad828 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1379 microversion: 2.1 time: 0.200426 Aug 09 14:34:14.096893 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 513/986] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:13 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1379 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:14.598988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-da9e7391-865f-42fa-946c-1fc443b3ce44 req-b9a96e6b-8ace-4e7f-b9ee-3a113bac6d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b5daeb-de33-403a-9779-0584f4649656", "name": "network-vif-plugged", "status": "completed", "tag": "07f06e9a-cd25-4e1e-9de3-2b5bdfc9c324"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:14.618018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-da9e7391-865f-42fa-946c-1fc443b3ce44 req-b9a96e6b-8ace-4e7f-b9ee-3a113bac6d3d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:14.622352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-da9e7391-865f-42fa-946c-1fc443b3ce44 req-b9a96e6b-8ace-4e7f-b9ee-3a113bac6d3d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:14.622864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-da9e7391-865f-42fa-946c-1fc443b3ce44 req-b9a96e6b-8ace-4e7f-b9ee-3a113bac6d3d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:14.647646 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-da9e7391-865f-42fa-946c-1fc443b3ce44 req-b9a96e6b-8ace-4e7f-b9ee-3a113bac6d3d service nova] Creating event network-vif-plugged:07f06e9a-cd25-4e1e-9de3-2b5bdfc9c324 for instance 10b5daeb-de33-403a-9779-0584f4649656 on n-h1-844626-8 Aug 09 14:34:14.659748 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-da9e7391-865f-42fa-946c-1fc443b3ce44 req-b9a96e6b-8ace-4e7f-b9ee-3a113bac6d3d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064066 Aug 09 14:34:14.665410 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 474/987] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:14.691226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-983e2893-ac9e-4ce9-bb39-08691b2fef43 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddef9670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:14.703032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79c5d72b-4273-4918-bc91-ed2e26219f35 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:14.704011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79c5d72b-4273-4918-bc91-ed2e26219f35 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:14.725892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c5d72b-4273-4918-bc91-ed2e26219f35 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:14.726836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c5d72b-4273-4918-bc91-ed2e26219f35 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:14.727631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c5d72b-4273-4918-bc91-ed2e26219f35 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:14.728579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c5d72b-4273-4918-bc91-ed2e26219f35 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:14.729037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c5d72b-4273-4918-bc91-ed2e26219f35 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:14.729462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c5d72b-4273-4918-bc91-ed2e26219f35 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:14.771743 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-983e2893-ac9e-4ce9-bb39-08691b2fef43 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.085479 Aug 09 14:34:14.773033 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 514/988] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:14 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:14.886336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3164ab8c-bb13-40ee-86b4-894b63ce3ba5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:14.887527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3164ab8c-bb13-40ee-86b4-894b63ce3ba5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:14.898716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3164ab8c-bb13-40ee-86b4-894b63ce3ba5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:14.899512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3164ab8c-bb13-40ee-86b4-894b63ce3ba5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:14.901067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3164ab8c-bb13-40ee-86b4-894b63ce3ba5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:14.902324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3164ab8c-bb13-40ee-86b4-894b63ce3ba5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:14.903540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3164ab8c-bb13-40ee-86b4-894b63ce3ba5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:14.904411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3164ab8c-bb13-40ee-86b4-894b63ce3ba5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:15.040070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-79c5d72b-4273-4918-bc91-ed2e26219f35 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:15.047809 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79c5d72b-4273-4918-bc91-ed2e26219f35 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 0.350712 Aug 09 14:34:15.069759 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 475/989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:14 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:15.119480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a367c891-5b05-4626-9bdd-3cce46847aca tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:15.120331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a367c891-5b05-4626-9bdd-3cce46847aca tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:15.129329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a367c891-5b05-4626-9bdd-3cce46847aca tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:15.130172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a367c891-5b05-4626-9bdd-3cce46847aca tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:15.130772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a367c891-5b05-4626-9bdd-3cce46847aca tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:15.131670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a367c891-5b05-4626-9bdd-3cce46847aca tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:15.132567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a367c891-5b05-4626-9bdd-3cce46847aca tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:15.133153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a367c891-5b05-4626-9bdd-3cce46847aca tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:15.559817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3164ab8c-bb13-40ee-86b4-894b63ce3ba5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:15.569855 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3164ab8c-bb13-40ee-86b4-894b63ce3ba5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1476 microversion: 2.1 time: 0.692233 Aug 09 14:34:15.571759 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 515/990] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:14 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1476 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:15.590631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52cb6a21-9cca-4d82-81e8-de15ae026ccb tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '.version_select at 0x7f41ddec08b0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:15.594327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52cb6a21-9cca-4d82-81e8-de15ae026ccb tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:15.594975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52cb6a21-9cca-4d82-81e8-de15ae026ccb tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:15.595632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52cb6a21-9cca-4d82-81e8-de15ae026ccb tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:15.622501 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52cb6a21-9cca-4d82-81e8-de15ae026ccb tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 2336 microversion: 2.1 time: 0.027118 Aug 09 14:34:15.627862 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 516/991] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:34:15 2022] GET /compute/v2.1/os-migrations => generated 2336 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:15.636579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a367c891-5b05-4626-9bdd-3cce46847aca tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:15.638387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b616b64-9919-4b70-8448-94fbbe7e0b6f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:15.639148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b616b64-9919-4b70-8448-94fbbe7e0b6f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:15.645793 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a367c891-5b05-4626-9bdd-3cce46847aca tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1379 microversion: 2.1 time: 0.532376 Aug 09 14:34:15.646378 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 476/992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:15 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1379 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:15.654005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b616b64-9919-4b70-8448-94fbbe7e0b6f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:15.654530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b616b64-9919-4b70-8448-94fbbe7e0b6f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:15.654963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b616b64-9919-4b70-8448-94fbbe7e0b6f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:15.655704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b616b64-9919-4b70-8448-94fbbe7e0b6f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:15.656151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b616b64-9919-4b70-8448-94fbbe7e0b6f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:15.656570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b616b64-9919-4b70-8448-94fbbe7e0b6f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:15.793278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6215fccf-0b8d-43e4-b9d6-78a65cecddca tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd5f3e50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:15.875263 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b616b64-9919-4b70-8448-94fbbe7e0b6f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1627 microversion: 2.1 time: 0.241645 Aug 09 14:34:15.883355 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 517/993] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:15 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1627 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:15.884542 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6215fccf-0b8d-43e4-b9d6-78a65cecddca tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.100963 Aug 09 14:34:15.885127 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 477/994] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:15 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:15.892190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "43346d3e-40e6-4cab-92e7-16b9d0e42084"}], "security_groups": [{"name": "tempest-securitygroup--1562805736"}], "key_name": "tempest-keypair-10932520", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:15.910624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0fae01b9-aa0a-4e30-80c5-1bab3532661d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Action: 'create', calling method: .version_select at 0x7f41dd5f3af0>, body: {"keypair": {"name": "tempest-keypair-1120296215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtokoDzcv20J5uz6Zb/VAwGbP1nGjhyyC6AknzKpme66u+FHFTpkK6gJ4g/2dJDjrR9m5mpFjGc6+Su1zV8Jbpr0L7NUMFEWVSkASFw2ylMi6Mti8Y/KLaVNdyLnZEO9Q=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:15.932079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0fae01b9-aa0a-4e30-80c5-1bab3532661d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Getting quotas for project beac39aa567247818bf13c604a1ed8ac. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:15.937736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0fae01b9-aa0a-4e30-80c5-1bab3532661d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Getting quotas for user ca408ac0b6df4c3797409e40335f61aa and project beac39aa567247818bf13c604a1ed8ac. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:15.977393 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0fae01b9-aa0a-4e30-80c5-1bab3532661d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070779 Aug 09 14:34:15.978650 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 478/995] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:34:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:34:16.040731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] validate_networks() for [('43346d3e-40e6-4cab-92e7-16b9d0e42084', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:34:16.076997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22afa533-bd05-4bc0-bfe5-428b85c94743 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:16.077617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22afa533-bd05-4bc0-bfe5-428b85c94743 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:16.093867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22afa533-bd05-4bc0-bfe5-428b85c94743 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:16.094314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22afa533-bd05-4bc0-bfe5-428b85c94743 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:16.094934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22afa533-bd05-4bc0-bfe5-428b85c94743 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:16.100185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22afa533-bd05-4bc0-bfe5-428b85c94743 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:16.101570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22afa533-bd05-4bc0-bfe5-428b85c94743 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:16.104454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22afa533-bd05-4bc0-bfe5-428b85c94743 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:16.521357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22afa533-bd05-4bc0-bfe5-428b85c94743 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:16.533077 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22afa533-bd05-4bc0-bfe5-428b85c94743 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1319 microversion: 2.1 time: 0.458630 Aug 09 14:34:16.535594 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 479/996] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:16 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1319 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:16.670006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d994f7b2-39b7-4e73-bb4d-37172eded8ac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:16.670006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d994f7b2-39b7-4e73-bb4d-37172eded8ac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:16.678665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d994f7b2-39b7-4e73-bb4d-37172eded8ac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:16.680271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d994f7b2-39b7-4e73-bb4d-37172eded8ac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:16.680830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d994f7b2-39b7-4e73-bb4d-37172eded8ac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:16.682024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d994f7b2-39b7-4e73-bb4d-37172eded8ac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:16.682538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d994f7b2-39b7-4e73-bb4d-37172eded8ac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:16.683157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d994f7b2-39b7-4e73-bb4d-37172eded8ac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:16.866235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:34:16.866822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:34:16.867332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:34:16.868015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:34:16.868471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:34:16.873985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d994f7b2-39b7-4e73-bb4d-37172eded8ac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:16.882991 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d994f7b2-39b7-4e73-bb4d-37172eded8ac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1379 microversion: 2.1 time: 0.220093 Aug 09 14:34:16.884010 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 480/997] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:16 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1379 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:16.886605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:16.887070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:16.888108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:16.888842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:16.889294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:16.889715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:16.891722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-76830adc-2254-475d-a730-6752854940ee req-e01b2d6a-bfb7-4d51-b3f6-5b82734f7e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba6d964-167a-4b1e-94f0-fb74f63c03f1", "name": "network-vif-unplugged", "status": "completed", "tag": "e4f9d82e-39ab-4f23-91b4-e30a41b072c4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:16.903625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-76830adc-2254-475d-a730-6752854940ee req-e01b2d6a-bfb7-4d51-b3f6-5b82734f7e7f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:16.904362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-76830adc-2254-475d-a730-6752854940ee req-e01b2d6a-bfb7-4d51-b3f6-5b82734f7e7f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:16.906341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-76830adc-2254-475d-a730-6752854940ee req-e01b2d6a-bfb7-4d51-b3f6-5b82734f7e7f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:16.930788 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-76830adc-2254-475d-a730-6752854940ee req-e01b2d6a-bfb7-4d51-b3f6-5b82734f7e7f service nova] Creating event network-vif-unplugged:e4f9d82e-39ab-4f23-91b4-e30a41b072c4 for instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 on n-h2-844626-8 Aug 09 14:34:16.943517 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-76830adc-2254-475d-a730-6752854940ee req-e01b2d6a-bfb7-4d51-b3f6-5b82734f7e7f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053379 Aug 09 14:34:16.945044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Getting quotas for project ec1c1fd6a864416caf79394d7e194099. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:16.946857 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 481/998] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:16.951359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63f34428-e631-4896-b52e-d4a7c2403753 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd5f3af0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:16.953094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Getting quotas for user 8e9f25ff5f8a422faef06aa2a33a6c97 and project ec1c1fd6a864416caf79394d7e194099. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:16.978970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:34:16.981415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:34:17.037047 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63f34428-e631-4896-b52e-d4a7c2403753 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.089530 Aug 09 14:34:17.037793 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 482/999] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:16 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:17.062352 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fb90a3a4-32f7-4595-b098-c17c3cfccfc1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.175810 Aug 09 14:34:17.063470 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 518/1000] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:34:15 2022] POST /compute/v2.1/servers => generated 409 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:34:17.082030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6eb8bb72-42fb-4343-93f4-efd13bc90642 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:17.084638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6eb8bb72-42fb-4343-93f4-efd13bc90642 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:17.158186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6eb8bb72-42fb-4343-93f4-efd13bc90642 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:17.171516 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6eb8bb72-42fb-4343-93f4-efd13bc90642 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1224 microversion: 2.1 time: 0.096625 Aug 09 14:34:17.173094 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 483/1001] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:17 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:17.565368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c59eb143-7a62-46bf-a5da-5175476adf75 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:17.566629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c59eb143-7a62-46bf-a5da-5175476adf75 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:17.576037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c59eb143-7a62-46bf-a5da-5175476adf75 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:17.576808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c59eb143-7a62-46bf-a5da-5175476adf75 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:17.577352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c59eb143-7a62-46bf-a5da-5175476adf75 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:17.578171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c59eb143-7a62-46bf-a5da-5175476adf75 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:17.579058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c59eb143-7a62-46bf-a5da-5175476adf75 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:17.579711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c59eb143-7a62-46bf-a5da-5175476adf75 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:17.742869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c59eb143-7a62-46bf-a5da-5175476adf75 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:17.753345 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c59eb143-7a62-46bf-a5da-5175476adf75 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1468 microversion: 2.1 time: 0.193296 Aug 09 14:34:17.755194 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 519/1002] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:17 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1468 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:17.776509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-146ef9e9-15ed-4be2-972c-c488f8ac0642 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:17.777111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-146ef9e9-15ed-4be2-972c-c488f8ac0642 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 3f0246e9-8417-4083-8430-ceda68df0c44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:17.790156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146ef9e9-15ed-4be2-972c-c488f8ac0642 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:17.791263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146ef9e9-15ed-4be2-972c-c488f8ac0642 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:17.792545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146ef9e9-15ed-4be2-972c-c488f8ac0642 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:17.794108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146ef9e9-15ed-4be2-972c-c488f8ac0642 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:17.794856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146ef9e9-15ed-4be2-972c-c488f8ac0642 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:17.795720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146ef9e9-15ed-4be2-972c-c488f8ac0642 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:17.810862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-655711548", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "4e9e66ac-24f5-49b8-8427-02f1b1cd91af"}], "security_groups": [{"name": "tempest-securitygroup--1752563668"}], "key_name": "tempest-keypair-1120296215", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:17.972232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] validate_networks() for [('4e9e66ac-24f5-49b8-8427-02f1b1cd91af', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:34:17.982470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-146ef9e9-15ed-4be2-972c-c488f8ac0642 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:17.991456 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-146ef9e9-15ed-4be2-972c-c488f8ac0642 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44" status: 200 len: 1469 microversion: 2.1 time: 0.219315 Aug 09 14:34:17.992714 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 484/1003] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:17 2022] GET /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44 => generated 1469 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:17.998985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9715ebd-cff7-461a-9625-5465bab44074 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:17.999725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9715ebd-cff7-461a-9625-5465bab44074 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:18.006941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9715ebd-cff7-461a-9625-5465bab44074 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:18.007462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9715ebd-cff7-461a-9625-5465bab44074 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:18.007891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9715ebd-cff7-461a-9625-5465bab44074 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:18.008584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9715ebd-cff7-461a-9625-5465bab44074 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:18.009030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9715ebd-cff7-461a-9625-5465bab44074 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:18.009443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9715ebd-cff7-461a-9625-5465bab44074 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:18.226085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9715ebd-cff7-461a-9625-5465bab44074 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:18.241098 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9715ebd-cff7-461a-9625-5465bab44074 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1379 microversion: 2.1 time: 0.246932 Aug 09 14:34:18.242339 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 485/1004] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:17 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1379 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:18.265528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:18.272681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:18.274305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Searching by: {'reservation_id': 'r-j1qli7in', 'deleted': False, 'project_id': '9471973b988a4c31be31dde4cef1489e'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:34:18.280201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:18.281010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:18.281638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:18.282812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:18.283510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:18.284186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:18.446510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:34:18.646290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:34:18.647004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:34:18.647713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:34:18.648919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:34:18.649337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:34:18.664564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:18.665235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:18.665941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:18.667647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:18.668571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:18.669488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:18.698026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Getting quotas for project beac39aa567247818bf13c604a1ed8ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:18.703941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Getting quotas for user ca408ac0b6df4c3797409e40335f61aa and project beac39aa567247818bf13c604a1ed8ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:18.718992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:34:18.721423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:34:18.807739 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aeda1e11-3ec1-4d62-98fb-9e4cc8d0d3ca tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.998516 Aug 09 14:34:18.810363 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 520/1005] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:34:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:34:18.826937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81d58420-3e36-4c61-869c-e18c35efecc2 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddef9e50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:18.833857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:18.841417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:18.842200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:18.843459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:18.894685 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81d58420-3e36-4c61-869c-e18c35efecc2 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.081550 Aug 09 14:34:18.896584 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 521/1006] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:18 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:18.902897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bfec3ac0-2056-4461-973f-9a7819bfb83b tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:18.903788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bfec3ac0-2056-4461-973f-9a7819bfb83b tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:18.910734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfec3ac0-2056-4461-973f-9a7819bfb83b tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:18.911607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfec3ac0-2056-4461-973f-9a7819bfb83b tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:18.912279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfec3ac0-2056-4461-973f-9a7819bfb83b tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:18.913687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfec3ac0-2056-4461-973f-9a7819bfb83b tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:18.914372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfec3ac0-2056-4461-973f-9a7819bfb83b tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:18.915028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfec3ac0-2056-4461-973f-9a7819bfb83b tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:19.053432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bfec3ac0-2056-4461-973f-9a7819bfb83b tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:19.063059 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bfec3ac0-2056-4461-973f-9a7819bfb83b tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1282 microversion: 2.1 time: 0.165225 Aug 09 14:34:19.068063 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 522/1007] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:18 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:19.078692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-431aae14-e606-48b6-9dfd-7516fd85c228 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:19.079630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-431aae14-e606-48b6-9dfd-7516fd85c228 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:19.102377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-431aae14-e606-48b6-9dfd-7516fd85c228 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:19.105012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-431aae14-e606-48b6-9dfd-7516fd85c228 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:19.106080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-431aae14-e606-48b6-9dfd-7516fd85c228 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:19.108789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-431aae14-e606-48b6-9dfd-7516fd85c228 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:19.109268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-431aae14-e606-48b6-9dfd-7516fd85c228 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:19.109698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-431aae14-e606-48b6-9dfd-7516fd85c228 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:19.170459 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4cb500aa-911b-4365-87f9-a89c302ce097 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?reservation_id=r-j1qli7in" status: 200 len: 2930 microversion: 2.1 time: 0.926880 Aug 09 14:34:19.171065 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 486/1008] 10.222.0.50 () {58 vars in 1197 bytes} [Tue Aug 9 14:34:18 2022] GET /compute/v2.1/servers/detail?reservation_id=r-j1qli7in => generated 2930 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:19.177782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9c406bfe-c668-4a9f-81fe-aa1870de11fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:19.178457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9c406bfe-c668-4a9f-81fe-aa1870de11fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:19.189660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:19.376870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9c406bfe-c668-4a9f-81fe-aa1870de11fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:19.385987 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9c406bfe-c668-4a9f-81fe-aa1870de11fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1234 microversion: 2.1 time: 0.211248 Aug 09 14:34:19.389952 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 487/1009] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:19 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1234 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:19.406424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-6a47c3f1-9803-427a-a34a-bb4d064b23f4 req-fa36d894-9f03-4969-b469-e5c240bca546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261b33cd-d9c1-42bc-bb0e-3836fae12d34", "name": "network-vif-plugged", "status": "completed", "tag": "deab8750-c5ac-4d07-a63f-ee59f7fa7a73"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:19.429989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6a47c3f1-9803-427a-a34a-bb4d064b23f4 req-fa36d894-9f03-4969-b469-e5c240bca546 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:19.430545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6a47c3f1-9803-427a-a34a-bb4d064b23f4 req-fa36d894-9f03-4969-b469-e5c240bca546 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:19.431606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6a47c3f1-9803-427a-a34a-bb4d064b23f4 req-fa36d894-9f03-4969-b469-e5c240bca546 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:19.453320 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-6a47c3f1-9803-427a-a34a-bb4d064b23f4 req-fa36d894-9f03-4969-b469-e5c240bca546 service nova] Creating event network-vif-plugged:deab8750-c5ac-4d07-a63f-ee59f7fa7a73 for instance 261b33cd-d9c1-42bc-bb0e-3836fae12d34 on n-h1-844626-8 Aug 09 14:34:19.466224 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-6a47c3f1-9803-427a-a34a-bb4d064b23f4 req-fa36d894-9f03-4969-b469-e5c240bca546 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073424 Aug 09 14:34:19.467224 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 488/1010] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:19.472437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-431aae14-e606-48b6-9dfd-7516fd85c228 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid acd6f697-9f2e-4825-998a-796902617f44 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:34:19.479303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8abbbc6-b40a-48bd-acea-3b3b5f1af313 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:19.497305 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-431aae14-e606-48b6-9dfd-7516fd85c228 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 2345 microversion: 2.25 time: 0.427376 Aug 09 14:34:19.511199 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 523/1011] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:19 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 2345 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:34:19.512657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.compute.server_groups [None req-c8abbbc6-b40a-48bd-acea-3b3b5f1af313 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Querying cell ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) for 2 instances {{(pid=119407) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 09 14:34:19.513584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8abbbc6-b40a-48bd-acea-3b3b5f1af313 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:19.514199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8abbbc6-b40a-48bd-acea-3b3b5f1af313 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:19.514771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8abbbc6-b40a-48bd-acea-3b3b5f1af313 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:19.522781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-96bc73ae-656b-49e7-af6e-27ac1ba21398 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:19.524430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-96bc73ae-656b-49e7-af6e-27ac1ba21398 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:19.546607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96bc73ae-656b-49e7-af6e-27ac1ba21398 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:19.547458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96bc73ae-656b-49e7-af6e-27ac1ba21398 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:19.548211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96bc73ae-656b-49e7-af6e-27ac1ba21398 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:19.549585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96bc73ae-656b-49e7-af6e-27ac1ba21398 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:19.550382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96bc73ae-656b-49e7-af6e-27ac1ba21398 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:19.551473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96bc73ae-656b-49e7-af6e-27ac1ba21398 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:19.590325 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8abbbc6-b40a-48bd-acea-3b3b5f1af313 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/c1f6b3ac-ca89-409d-a9f4-2ebde07115c6" status: 200 len: 265 microversion: 2.1 time: 0.121476 Aug 09 14:34:19.597641 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 489/1012] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:34:19 2022] GET /compute/v2.1/os-server-groups/c1f6b3ac-ca89-409d-a9f4-2ebde07115c6 => generated 265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:19.599437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea151c5d-411c-4419-978e-488b4ceeedb9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:19.602764 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:34:19.602764 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:34:19.604422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea151c5d-411c-4419-978e-488b4ceeedb9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:19.608526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea151c5d-411c-4419-978e-488b4ceeedb9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:19.620870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea151c5d-411c-4419-978e-488b4ceeedb9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:19.623241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea151c5d-411c-4419-978e-488b4ceeedb9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:19.623836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea151c5d-411c-4419-978e-488b4ceeedb9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:19.624374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea151c5d-411c-4419-978e-488b4ceeedb9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:19.661160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:19.712267 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea151c5d-411c-4419-978e-488b4ceeedb9 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.116596 Aug 09 14:34:19.720063 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 490/1013] 10.222.0.50 () {60 vars in 1217 bytes} [Tue Aug 9 14:34:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:34:19.734570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-17f5416e-5e69-413d-aac8-b9a93c88df98 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:19.735493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-17f5416e-5e69-413d-aac8-b9a93c88df98 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:19.756886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17f5416e-5e69-413d-aac8-b9a93c88df98 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:19.761599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17f5416e-5e69-413d-aac8-b9a93c88df98 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:19.762160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17f5416e-5e69-413d-aac8-b9a93c88df98 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:19.763898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17f5416e-5e69-413d-aac8-b9a93c88df98 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:19.764490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17f5416e-5e69-413d-aac8-b9a93c88df98 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:19.765066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17f5416e-5e69-413d-aac8-b9a93c88df98 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:20.011236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-96bc73ae-656b-49e7-af6e-27ac1ba21398 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:20.023070 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-96bc73ae-656b-49e7-af6e-27ac1ba21398 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1379 microversion: 2.1 time: 0.510129 Aug 09 14:34:20.024679 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 524/1014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:19 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1379 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:20.034089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60073168-8cc3-427c-a305-fcbc38a4be6b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddeaa670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:20.089702 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-17f5416e-5e69-413d-aac8-b9a93c88df98 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 200 len: 1619 microversion: 2.1 time: 0.360175 Aug 09 14:34:20.090961 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 491/1015] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:19 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 1619 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:20.097413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3ff48fbc-b4b9-4c4c-b3a5-622de8b240ce tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:20.110749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3ff48fbc-b4b9-4c4c-b3a5-622de8b240ce tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:20.129042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ff48fbc-b4b9-4c4c-b3a5-622de8b240ce tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:20.134464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ff48fbc-b4b9-4c4c-b3a5-622de8b240ce tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:20.134931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ff48fbc-b4b9-4c4c-b3a5-622de8b240ce tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:20.135709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ff48fbc-b4b9-4c4c-b3a5-622de8b240ce tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:20.136174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ff48fbc-b4b9-4c4c-b3a5-622de8b240ce tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:20.141841 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60073168-8cc3-427c-a305-fcbc38a4be6b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.110631 Aug 09 14:34:20.142376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ff48fbc-b4b9-4c4c-b3a5-622de8b240ce tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:20.143262 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 525/1016] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:20 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:20.165209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a96a14fb-48a6-4b85-8620-49664a603626 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:20.167228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a96a14fb-48a6-4b85-8620-49664a603626 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] [instance: 3f0246e9-8417-4083-8430-ceda68df0c44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:20.185610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a96a14fb-48a6-4b85-8620-49664a603626 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:20.188082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a96a14fb-48a6-4b85-8620-49664a603626 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:20.188838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a96a14fb-48a6-4b85-8620-49664a603626 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:20.190310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a96a14fb-48a6-4b85-8620-49664a603626 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:20.193766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a96a14fb-48a6-4b85-8620-49664a603626 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:20.194281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a96a14fb-48a6-4b85-8620-49664a603626 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:20.537450 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a96a14fb-48a6-4b85-8620-49664a603626 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44" status: 200 len: 1620 microversion: 2.1 time: 0.392966 Aug 09 14:34:20.538290 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 526/1017] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:20 2022] GET /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44 => generated 1620 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:20.544725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ee261ca-5c88-496a-9515-3e7a94b07819 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:20.545838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ee261ca-5c88-496a-9515-3e7a94b07819 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:20.553860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ee261ca-5c88-496a-9515-3e7a94b07819 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:20.554656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ee261ca-5c88-496a-9515-3e7a94b07819 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:20.555357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ee261ca-5c88-496a-9515-3e7a94b07819 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:20.556384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ee261ca-5c88-496a-9515-3e7a94b07819 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:20.557059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ee261ca-5c88-496a-9515-3e7a94b07819 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:20.557644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ee261ca-5c88-496a-9515-3e7a94b07819 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:20.684552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ee261ca-5c88-496a-9515-3e7a94b07819 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:20.689294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3ff48fbc-b4b9-4c4c-b3a5-622de8b240ce tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:20.694253 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ee261ca-5c88-496a-9515-3e7a94b07819 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1286 microversion: 2.1 time: 0.154128 Aug 09 14:34:20.694664 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 527/1018] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:20 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:20.703510 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3ff48fbc-b4b9-4c4c-b3a5-622de8b240ce tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1350 microversion: 2.1 time: 0.608947 Aug 09 14:34:20.705771 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 492/1019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:20 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1350 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:20.714021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1df45825-8f43-44dd-b600-722b86c393b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Action: 'create', calling method: .version_select at 0x7f41ddedfe50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1306492958", "policies": ["anti-affinity"]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:20.739592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-1df45825-8f43-44dd-b600-722b86c393b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_groups'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:20.744663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-1df45825-8f43-44dd-b600-722b86c393b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_groups'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:20.879748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-1df45825-8f43-44dd-b600-722b86c393b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_groups'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:20.886020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-1df45825-8f43-44dd-b600-722b86c393b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_groups'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:20.902347 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1df45825-8f43-44dd-b600-722b86c393b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.192886 Aug 09 14:34:20.903330 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 528/1020] 10.222.0.50 () {60 vars in 1174 bytes} [Tue Aug 9 14:34:20 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:21.046143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f3a81c6a-462f-46c6-8abb-f3782608e81c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:21.047365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f3a81c6a-462f-46c6-8abb-f3782608e81c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:21.058006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3a81c6a-462f-46c6-8abb-f3782608e81c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:21.058579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3a81c6a-462f-46c6-8abb-f3782608e81c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:21.070562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3a81c6a-462f-46c6-8abb-f3782608e81c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:21.071495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3a81c6a-462f-46c6-8abb-f3782608e81c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:21.079067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-351639469", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "7bdfa22d-fcd8-4cd6-8024-fd7f4ce5dd54"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:21.086776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3a81c6a-462f-46c6-8abb-f3782608e81c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:21.091576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3a81c6a-462f-46c6-8abb-f3782608e81c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:21.180100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:34:21.430976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f3a81c6a-462f-46c6-8abb-f3782608e81c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:21.443019 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f3a81c6a-462f-46c6-8abb-f3782608e81c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1379 microversion: 2.1 time: 0.400722 Aug 09 14:34:21.445713 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 493/1021] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:21 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1379 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:21.454654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e2e8c042-1653-4707-ad9a-378c7ed5b767 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd6b3700>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:21.552215 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e2e8c042-1653-4707-ad9a-378c7ed5b767 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.103813 Aug 09 14:34:21.553168 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 494/1022] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:21 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:21.563375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-031ed895-e363-4dd2-82dc-727e6c00ff46 req-957d3d20-5553-46ee-b710-4f1b88ad58c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "071cd727-293f-49aa-a7a6-117cf73c817c", "tag": "f42a2f66-2d26-46e2-b779-6c68e7d458fd"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:21.593189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-031ed895-e363-4dd2-82dc-727e6c00ff46 req-957d3d20-5553-46ee-b710-4f1b88ad58c8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:21.595108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-031ed895-e363-4dd2-82dc-727e6c00ff46 req-957d3d20-5553-46ee-b710-4f1b88ad58c8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:21.595886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-031ed895-e363-4dd2-82dc-727e6c00ff46 req-957d3d20-5553-46ee-b710-4f1b88ad58c8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:21.627102 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-031ed895-e363-4dd2-82dc-727e6c00ff46 req-957d3d20-5553-46ee-b710-4f1b88ad58c8 service nova] Creating event network-changed:f42a2f66-2d26-46e2-b779-6c68e7d458fd for instance 071cd727-293f-49aa-a7a6-117cf73c817c on n-h2-844626-8 Aug 09 14:34:21.639098 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-031ed895-e363-4dd2-82dc-727e6c00ff46 req-957d3d20-5553-46ee-b710-4f1b88ad58c8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083984 Aug 09 14:34:21.642207 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 495/1023] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:21.654753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-c03268da-12e1-4d22-acf0-9970795d54f6 req-66b1f3a8-d095-40b7-8b6e-81fda90629b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a", "name": "network-vif-plugged", "status": "completed", "tag": "1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:21.669200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:34:21.670075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:34:21.670652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:34:21.671195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:34:21.671697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:34:21.693738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c03268da-12e1-4d22-acf0-9970795d54f6 req-66b1f3a8-d095-40b7-8b6e-81fda90629b3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:21.694372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c03268da-12e1-4d22-acf0-9970795d54f6 req-66b1f3a8-d095-40b7-8b6e-81fda90629b3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:21.698788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c03268da-12e1-4d22-acf0-9970795d54f6 req-66b1f3a8-d095-40b7-8b6e-81fda90629b3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:21.706629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:21.727444 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-c03268da-12e1-4d22-acf0-9970795d54f6 req-66b1f3a8-d095-40b7-8b6e-81fda90629b3 service nova] Creating event network-vif-plugged:1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b for instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a on n-h2-844626-8 Aug 09 14:34:21.739995 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-c03268da-12e1-4d22-acf0-9970795d54f6 req-66b1f3a8-d095-40b7-8b6e-81fda90629b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096271 Aug 09 14:34:21.744787 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 496/1024] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:21.747009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:21.751470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:21.752045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:21.752924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:21.753843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:21.754517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:21.774640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3296f2b6-16a3-402c-a903-83546b2fbaeb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:21.775695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3296f2b6-16a3-402c-a903-83546b2fbaeb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:21.810681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3296f2b6-16a3-402c-a903-83546b2fbaeb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:21.813309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3296f2b6-16a3-402c-a903-83546b2fbaeb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:21.815753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3296f2b6-16a3-402c-a903-83546b2fbaeb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:21.818930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3296f2b6-16a3-402c-a903-83546b2fbaeb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:21.820056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3296f2b6-16a3-402c-a903-83546b2fbaeb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:21.821696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3296f2b6-16a3-402c-a903-83546b2fbaeb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:21.833217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:21.846296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:21.880647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Going to run 2 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:34:21.882842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:34:21.937840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3296f2b6-16a3-402c-a903-83546b2fbaeb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:21.948235 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3296f2b6-16a3-402c-a903-83546b2fbaeb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1292 microversion: 2.1 time: 0.201322 Aug 09 14:34:21.949799 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 497/1025] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:21 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1292 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:21.965754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33daeefa-f265-452e-86bc-7f8b50b7c9c1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:21.971151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-33daeefa-f265-452e-86bc-7f8b50b7c9c1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:21.983975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33daeefa-f265-452e-86bc-7f8b50b7c9c1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:21.984830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33daeefa-f265-452e-86bc-7f8b50b7c9c1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:21.985263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33daeefa-f265-452e-86bc-7f8b50b7c9c1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:21.985952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33daeefa-f265-452e-86bc-7f8b50b7c9c1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:21.986399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33daeefa-f265-452e-86bc-7f8b50b7c9c1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:21.986918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33daeefa-f265-452e-86bc-7f8b50b7c9c1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:22.020416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=119406) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 09 14:34:22.075479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:22.080811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:22.189424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-33daeefa-f265-452e-86bc-7f8b50b7c9c1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:22.194747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:22.204213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:22.207746 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-33daeefa-f265-452e-86bc-7f8b50b7c9c1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1350 microversion: 2.1 time: 0.256520 Aug 09 14:34:22.209770 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 498/1026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:21 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1350 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:22.210351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:22.241010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=37b23fa3-f32c-4406-a38f-2ba8e7e0df4a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:34:22.350279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:22.363493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:22.446088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:22.457235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'server_group_members'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:22.470224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-499d5c35-1b86-40c4-b4c4-178296b665cb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:22.471003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-499d5c35-1b86-40c4-b4c4-178296b665cb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:22.482175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-499d5c35-1b86-40c4-b4c4-178296b665cb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:22.482894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-499d5c35-1b86-40c4-b4c4-178296b665cb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:22.483481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-499d5c35-1b86-40c4-b4c4-178296b665cb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:22.484314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-499d5c35-1b86-40c4-b4c4-178296b665cb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:22.484942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-499d5c35-1b86-40c4-b4c4-178296b665cb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:22.491422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-499d5c35-1b86-40c4-b4c4-178296b665cb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:22.583918 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-67644acb-29a5-4b1f-baf9-0baf4b83ce6d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.508510 Aug 09 14:34:22.589781 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 529/1027] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:34:21 2022] POST /compute/v2.1/servers => generated 32 bytes in 1515 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Aug 09 14:34:22.599277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fec58dcf-ecad-4467-b184-8c038978fffd tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf5b040>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:22.716109 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fec58dcf-ecad-4467-b184-8c038978fffd tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.124019 Aug 09 14:34:22.723386 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 530/1028] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:22 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:22.723386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cae4ceac-03bf-4e5e-abbe-c0eb479fc568 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:22.739388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cae4ceac-03bf-4e5e-abbe-c0eb479fc568 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:22.740523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cae4ceac-03bf-4e5e-abbe-c0eb479fc568 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Searching by: {'deleted': False, 'project_id': '9471973b988a4c31be31dde4cef1489e'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:34:22.770532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cae4ceac-03bf-4e5e-abbe-c0eb479fc568 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:22.773826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cae4ceac-03bf-4e5e-abbe-c0eb479fc568 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:22.777009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cae4ceac-03bf-4e5e-abbe-c0eb479fc568 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:22.781013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cae4ceac-03bf-4e5e-abbe-c0eb479fc568 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:22.781576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cae4ceac-03bf-4e5e-abbe-c0eb479fc568 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:22.782100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cae4ceac-03bf-4e5e-abbe-c0eb479fc568 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:22.855156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-cae4ceac-03bf-4e5e-abbe-c0eb479fc568 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:34:22.903587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-499d5c35-1b86-40c4-b4c4-178296b665cb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:22.916201 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-499d5c35-1b86-40c4-b4c4-178296b665cb tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1379 microversion: 2.1 time: 0.450818 Aug 09 14:34:22.929982 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 499/1029] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:22 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1379 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:22.960078 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cae4ceac-03bf-4e5e-abbe-c0eb479fc568 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.241879 Aug 09 14:34:22.961394 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 531/1030] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 14:34:22 2022] GET /compute/v2.1/servers => generated 1663 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:22.977739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-adcb4df1-5ab3-4366-a1f6-a03c1b9f87cf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:22.978373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-adcb4df1-5ab3-4366-a1f6-a03c1b9f87cf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:22.982526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5b4c105-26c4-460d-a02e-0168b1b784cf tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:22.983341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c5b4c105-26c4-460d-a02e-0168b1b784cf tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:22.990842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5b4c105-26c4-460d-a02e-0168b1b784cf tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:22.992680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5b4c105-26c4-460d-a02e-0168b1b784cf tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:22.992680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5b4c105-26c4-460d-a02e-0168b1b784cf tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:22.992680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5b4c105-26c4-460d-a02e-0168b1b784cf tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:23.004641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5b4c105-26c4-460d-a02e-0168b1b784cf tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:23.008173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5b4c105-26c4-460d-a02e-0168b1b784cf tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:23.130084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-adcb4df1-5ab3-4366-a1f6-a03c1b9f87cf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:23.138207 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-adcb4df1-5ab3-4366-a1f6-a03c1b9f87cf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1218 microversion: 2.1 time: 0.163369 Aug 09 14:34:23.139122 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 532/1031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:22 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:23.201430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c5b4c105-26c4-460d-a02e-0168b1b784cf tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:23.212581 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c5b4c105-26c4-460d-a02e-0168b1b784cf tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1292 microversion: 2.1 time: 0.239138 Aug 09 14:34:23.214244 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 500/1032] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:22 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1292 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:23.233470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-459a142e-cc31-4ba8-aa93-e849e14d9b2f tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:23.234241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-459a142e-cc31-4ba8-aa93-e849e14d9b2f tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:23.254286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-459a142e-cc31-4ba8-aa93-e849e14d9b2f tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:23.254782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-459a142e-cc31-4ba8-aa93-e849e14d9b2f tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:23.255281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-459a142e-cc31-4ba8-aa93-e849e14d9b2f tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:23.255997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-459a142e-cc31-4ba8-aa93-e849e14d9b2f tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:23.256456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-459a142e-cc31-4ba8-aa93-e849e14d9b2f tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:23.256908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-459a142e-cc31-4ba8-aa93-e849e14d9b2f tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:23.534843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-459a142e-cc31-4ba8-aa93-e849e14d9b2f tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:23.547140 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-459a142e-cc31-4ba8-aa93-e849e14d9b2f tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1350 microversion: 2.1 time: 0.318579 Aug 09 14:34:23.547961 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 533/1033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:23 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1350 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:23.730674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0e71474f-43cd-46a4-b0a4-b4f3fd84e3d5 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd770280>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:23.803320 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0e71474f-43cd-46a4-b0a4-b4f3fd84e3d5 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.076481 Aug 09 14:34:23.804233 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 501/1034] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:23 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:23.939833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f93df5a8-fc74-45b3-aedc-916633126e64 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:23.940682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f93df5a8-fc74-45b3-aedc-916633126e64 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:23.950147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f93df5a8-fc74-45b3-aedc-916633126e64 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:23.952962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f93df5a8-fc74-45b3-aedc-916633126e64 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:23.954080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f93df5a8-fc74-45b3-aedc-916633126e64 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:23.957386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f93df5a8-fc74-45b3-aedc-916633126e64 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:23.957941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f93df5a8-fc74-45b3-aedc-916633126e64 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:23.958445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f93df5a8-fc74-45b3-aedc-916633126e64 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:24.168023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f65dfdca-de66-450f-a40e-1986412f5b16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:24.168659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f65dfdca-de66-450f-a40e-1986412f5b16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:24.183897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f93df5a8-fc74-45b3-aedc-916633126e64 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:24.190322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f65dfdca-de66-450f-a40e-1986412f5b16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:24.193809 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f93df5a8-fc74-45b3-aedc-916633126e64 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1529 microversion: 2.1 time: 0.259490 Aug 09 14:34:24.195075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f65dfdca-de66-450f-a40e-1986412f5b16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:24.198214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f65dfdca-de66-450f-a40e-1986412f5b16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:24.199429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f65dfdca-de66-450f-a40e-1986412f5b16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:24.199860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f65dfdca-de66-450f-a40e-1986412f5b16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:24.200447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f65dfdca-de66-450f-a40e-1986412f5b16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:24.223850 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 534/1035] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:23 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1529 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:24.231716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4908b5d0-db15-416c-b90f-be75da217866 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:24.232583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4908b5d0-db15-416c-b90f-be75da217866 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:24.240890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4908b5d0-db15-416c-b90f-be75da217866 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:24.242107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4908b5d0-db15-416c-b90f-be75da217866 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:24.242690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4908b5d0-db15-416c-b90f-be75da217866 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:24.243575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4908b5d0-db15-416c-b90f-be75da217866 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:24.244164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4908b5d0-db15-416c-b90f-be75da217866 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:24.244836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4908b5d0-db15-416c-b90f-be75da217866 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:24.312688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f65dfdca-de66-450f-a40e-1986412f5b16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:24.330528 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f65dfdca-de66-450f-a40e-1986412f5b16 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1222 microversion: 2.1 time: 0.175154 Aug 09 14:34:24.343109 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 502/1036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:24 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1222 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:24.343109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fdfa27d8-a695-4204-9c1e-69d3618a921d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:24.343109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fdfa27d8-a695-4204-9c1e-69d3618a921d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:24.347487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdfa27d8-a695-4204-9c1e-69d3618a921d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:24.348331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdfa27d8-a695-4204-9c1e-69d3618a921d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:24.349551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdfa27d8-a695-4204-9c1e-69d3618a921d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:24.350460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdfa27d8-a695-4204-9c1e-69d3618a921d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:24.351060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdfa27d8-a695-4204-9c1e-69d3618a921d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:24.351647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdfa27d8-a695-4204-9c1e-69d3618a921d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:24.497863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4908b5d0-db15-416c-b90f-be75da217866 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:24.505633 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4908b5d0-db15-416c-b90f-be75da217866 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1529 microversion: 2.1 time: 0.280407 Aug 09 14:34:24.510730 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 535/1037] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:24 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1529 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:24.519623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3276ad94-7199-4aa4-a053-64ff28e3fc0b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70778de6-1090-46cf-882c-05df9432aaaf", "device": "/dev/xvdb"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:24.522972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3276ad94-7199-4aa4-a053-64ff28e3fc0b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:24.536943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3276ad94-7199-4aa4-a053-64ff28e3fc0b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:24.538730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3276ad94-7199-4aa4-a053-64ff28e3fc0b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:24.543611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3276ad94-7199-4aa4-a053-64ff28e3fc0b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:24.545826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3276ad94-7199-4aa4-a053-64ff28e3fc0b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:24.548334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3276ad94-7199-4aa4-a053-64ff28e3fc0b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:24.548976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3276ad94-7199-4aa4-a053-64ff28e3fc0b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:24.562717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fdfa27d8-a695-4204-9c1e-69d3618a921d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:24.572411 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fdfa27d8-a695-4204-9c1e-69d3618a921d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1360 microversion: 2.1 time: 0.238880 Aug 09 14:34:24.585598 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 503/1038] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:24 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1360 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:24.585598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8f9504a4-900b-4ab4-b1a4-5c344931a374 req-0b35fd93-b8e7-4113-8aa3-9a772c309fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf11da1-82f0-41e7-bdef-9bbea7629ef0", "tag": "510915b8-0436-4bd0-8a98-8b38c250325d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:24.591429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8f9504a4-900b-4ab4-b1a4-5c344931a374 req-0b35fd93-b8e7-4113-8aa3-9a772c309fd9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:24.593625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8f9504a4-900b-4ab4-b1a4-5c344931a374 req-0b35fd93-b8e7-4113-8aa3-9a772c309fd9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:24.594151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8f9504a4-900b-4ab4-b1a4-5c344931a374 req-0b35fd93-b8e7-4113-8aa3-9a772c309fd9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:24.627874 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8f9504a4-900b-4ab4-b1a4-5c344931a374 req-0b35fd93-b8e7-4113-8aa3-9a772c309fd9 service nova] Creating event network-changed:510915b8-0436-4bd0-8a98-8b38c250325d for instance aaf11da1-82f0-41e7-bdef-9bbea7629ef0 on n-h1-844626-8 Aug 09 14:34:24.633900 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8f9504a4-900b-4ab4-b1a4-5c344931a374 req-0b35fd93-b8e7-4113-8aa3-9a772c309fd9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057242 Aug 09 14:34:24.635237 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 504/1039] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:24.642523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7002b7b-33b1-4fdd-b74e-c5206f12f37b tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:24.643623 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:34:24.643623 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:34:24.679470 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e7002b7b-33b1-4fdd-b74e-c5206f12f37b tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/eeb14548-1469-4dc0-95e8-67a3c1a284fb" status: 202 len: 0 microversion: 2.1 time: 0.042686 Aug 09 14:34:24.681072 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 505/1040] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:34:24 2022] DELETE /compute/v2.1/flavors/eeb14548-1469-4dc0-95e8-67a3c1a284fb => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:34:24.697824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ad6538c-b867-4bfb-926d-49a6038dd8c7 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:24.698827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ad6538c-b867-4bfb-926d-49a6038dd8c7 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:24.712848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad6538c-b867-4bfb-926d-49a6038dd8c7 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:24.713751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad6538c-b867-4bfb-926d-49a6038dd8c7 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:24.718270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad6538c-b867-4bfb-926d-49a6038dd8c7 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:24.719149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad6538c-b867-4bfb-926d-49a6038dd8c7 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:24.719799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad6538c-b867-4bfb-926d-49a6038dd8c7 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:24.720305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad6538c-b867-4bfb-926d-49a6038dd8c7 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:24.945003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ad6538c-b867-4bfb-926d-49a6038dd8c7 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:24.960993 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ad6538c-b867-4bfb-926d-49a6038dd8c7 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1350 microversion: 2.1 time: 0.273621 Aug 09 14:34:24.983442 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 506/1041] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:24 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1350 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:24.983442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba70bc93-8244-46b0-8e07-6fb8b15f92ee tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:25.024603 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba70bc93-8244-46b0-8e07-6fb8b15f92ee tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.053170 Aug 09 14:34:25.038481 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 507/1042] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:34:24 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:25.043304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-924e6089-1b62-461b-ab01-8308687cf833 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd7704c0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:25.120039 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-924e6089-1b62-461b-ab01-8308687cf833 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.080358 Aug 09 14:34:25.121230 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 508/1043] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:25 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:25.139073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:25.141788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:25.148553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:25.151757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:25.152427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:25.153357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:25.154010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:25.155402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:25.293381 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3276ad94-7199-4aa4-a053-64ff28e3fc0b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "POST /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.780156 Aug 09 14:34:25.295151 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 536/1044] 10.222.0.50 () {62 vars in 1364 bytes} [Tue Aug 9 14:34:24 2022] POST /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments => generated 194 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:34:25.337382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:25.355518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Old instance type tempest-test_resize_flavor_-833442664, new instance type m1.heat {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 14:34:25.356965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0fc7220b-7d71-4210-8cff-d980d4915d14 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:25.357786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0fc7220b-7d71-4210-8cff-d980d4915d14 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:25.369090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:34:25.369807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:34:25.375630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:34:25.376481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:34:25.377180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:34:25.390785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fc7220b-7d71-4210-8cff-d980d4915d14 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:25.394610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fc7220b-7d71-4210-8cff-d980d4915d14 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:25.395711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fc7220b-7d71-4210-8cff-d980d4915d14 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:25.396607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fc7220b-7d71-4210-8cff-d980d4915d14 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:25.409533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fc7220b-7d71-4210-8cff-d980d4915d14 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:25.416694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fc7220b-7d71-4210-8cff-d980d4915d14 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:25.553583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0fc7220b-7d71-4210-8cff-d980d4915d14 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:25.567775 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0fc7220b-7d71-4210-8cff-d980d4915d14 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1270 microversion: 2.1 time: 0.214182 Aug 09 14:34:25.568977 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 537/1045] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:25 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1270 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:25.600821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e6f6d57-faf8-4541-a53a-06627c34d0c0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:25.605040 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5089a41a-7f48-48e2-8547-9813d74ee4a8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "POST /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a/action" status: 202 len: 0 microversion: 2.1 time: 0.480120 Aug 09 14:34:25.606623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2e6f6d57-faf8-4541-a53a-06627c34d0c0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:25.612233 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 509/1046] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:34:25 2022] POST /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:34:25.628266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b380e3c6-c84d-4396-a32b-11f09e439db6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:25.628891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b380e3c6-c84d-4396-a32b-11f09e439db6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:25.637169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e6f6d57-faf8-4541-a53a-06627c34d0c0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:25.637674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e6f6d57-faf8-4541-a53a-06627c34d0c0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:25.641250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e6f6d57-faf8-4541-a53a-06627c34d0c0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:25.641978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e6f6d57-faf8-4541-a53a-06627c34d0c0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:25.647551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e6f6d57-faf8-4541-a53a-06627c34d0c0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:25.650106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e6f6d57-faf8-4541-a53a-06627c34d0c0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:25.664021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b380e3c6-c84d-4396-a32b-11f09e439db6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:25.669424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b380e3c6-c84d-4396-a32b-11f09e439db6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:25.670184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b380e3c6-c84d-4396-a32b-11f09e439db6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:25.670740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b380e3c6-c84d-4396-a32b-11f09e439db6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:25.676963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b380e3c6-c84d-4396-a32b-11f09e439db6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:25.677493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b380e3c6-c84d-4396-a32b-11f09e439db6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:26.172716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b380e3c6-c84d-4396-a32b-11f09e439db6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:26.187906 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b380e3c6-c84d-4396-a32b-11f09e439db6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1538 microversion: 2.1 time: 0.570169 Aug 09 14:34:26.194154 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 510/1047] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:25 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1538 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:26.205275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2e6f6d57-faf8-4541-a53a-06627c34d0c0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:26.208004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-54832a67-4cf4-4195-9d7a-0001a54e9051 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:26.213207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-54832a67-4cf4-4195-9d7a-0001a54e9051 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:26.214691 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2e6f6d57-faf8-4541-a53a-06627c34d0c0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1360 microversion: 2.1 time: 0.623956 Aug 09 14:34:26.218594 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 538/1048] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:25 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1360 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:26.238094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54832a67-4cf4-4195-9d7a-0001a54e9051 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:26.238985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54832a67-4cf4-4195-9d7a-0001a54e9051 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:26.240423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54832a67-4cf4-4195-9d7a-0001a54e9051 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:26.241353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54832a67-4cf4-4195-9d7a-0001a54e9051 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:26.242002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54832a67-4cf4-4195-9d7a-0001a54e9051 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:26.242620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54832a67-4cf4-4195-9d7a-0001a54e9051 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:26.255371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d466d4e-e994-4735-b74f-4134356921f7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd7e3a0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:26.347703 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4d466d4e-e994-4735-b74f-4134356921f7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.113227 Aug 09 14:34:26.348393 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 539/1049] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:26 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:26.561736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-54832a67-4cf4-4195-9d7a-0001a54e9051 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:26.577117 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-54832a67-4cf4-4195-9d7a-0001a54e9051 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1350 microversion: 2.1 time: 0.378786 Aug 09 14:34:26.579964 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 511/1050] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:26 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1350 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:26.594776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a7224dc-5a51-4850-99bb-20b310f226df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:26.594776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a7224dc-5a51-4850-99bb-20b310f226df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:26.610211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a7224dc-5a51-4850-99bb-20b310f226df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:26.611830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a7224dc-5a51-4850-99bb-20b310f226df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:26.613677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a7224dc-5a51-4850-99bb-20b310f226df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:26.614615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a7224dc-5a51-4850-99bb-20b310f226df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:26.616312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a7224dc-5a51-4850-99bb-20b310f226df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:26.618206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a7224dc-5a51-4850-99bb-20b310f226df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:26.724340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4a7224dc-5a51-4850-99bb-20b310f226df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:26.735079 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a7224dc-5a51-4850-99bb-20b310f226df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1276 microversion: 2.1 time: 0.145007 Aug 09 14:34:26.752349 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 540/1051] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:26 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:27.214911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0196341-07c5-4578-ac2c-9e0bfe8c0451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:27.216478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0196341-07c5-4578-ac2c-9e0bfe8c0451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:27.227186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0196341-07c5-4578-ac2c-9e0bfe8c0451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:27.227994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0196341-07c5-4578-ac2c-9e0bfe8c0451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:27.228605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0196341-07c5-4578-ac2c-9e0bfe8c0451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:27.229559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0196341-07c5-4578-ac2c-9e0bfe8c0451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:27.230167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0196341-07c5-4578-ac2c-9e0bfe8c0451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:27.230796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0196341-07c5-4578-ac2c-9e0bfe8c0451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:27.239165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-65cf1e6d-f1a5-43ef-a646-cd31b4c2ff82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:27.239979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-65cf1e6d-f1a5-43ef-a646-cd31b4c2ff82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:27.253937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65cf1e6d-f1a5-43ef-a646-cd31b4c2ff82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:27.254430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65cf1e6d-f1a5-43ef-a646-cd31b4c2ff82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:27.254861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65cf1e6d-f1a5-43ef-a646-cd31b4c2ff82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:27.255602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65cf1e6d-f1a5-43ef-a646-cd31b4c2ff82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:27.256050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65cf1e6d-f1a5-43ef-a646-cd31b4c2ff82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:27.256481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65cf1e6d-f1a5-43ef-a646-cd31b4c2ff82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:27.516053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0196341-07c5-4578-ac2c-9e0bfe8c0451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:27.539173 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0196341-07c5-4578-ac2c-9e0bfe8c0451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1538 microversion: 2.1 time: 0.329077 Aug 09 14:34:27.551516 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 512/1052] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:27 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1538 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:27.560736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5f6cf1c0-3895-480f-952b-da72b5c688ee tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd697430>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:27.584060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-65cf1e6d-f1a5-43ef-a646-cd31b4c2ff82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:27.592489 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-65cf1e6d-f1a5-43ef-a646-cd31b4c2ff82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1360 microversion: 2.1 time: 0.357996 Aug 09 14:34:27.593522 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 541/1053] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:27 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1360 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:27.621274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dc6689f7-3e79-4e0f-8704-3ba86b154781 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:27.621885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dc6689f7-3e79-4e0f-8704-3ba86b154781 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:27.640274 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5f6cf1c0-3895-480f-952b-da72b5c688ee tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.089571 Aug 09 14:34:27.641490 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 513/1054] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:27 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:27.654485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc6689f7-3e79-4e0f-8704-3ba86b154781 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:27.654961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc6689f7-3e79-4e0f-8704-3ba86b154781 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:27.660708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc6689f7-3e79-4e0f-8704-3ba86b154781 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:27.661717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc6689f7-3e79-4e0f-8704-3ba86b154781 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:27.664938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc6689f7-3e79-4e0f-8704-3ba86b154781 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:27.667385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc6689f7-3e79-4e0f-8704-3ba86b154781 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:27.759521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1f13ca09-1b84-4589-a38f-2512d8a662ac tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:27.760146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1f13ca09-1b84-4589-a38f-2512d8a662ac tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:27.771298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f13ca09-1b84-4589-a38f-2512d8a662ac tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:27.771963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f13ca09-1b84-4589-a38f-2512d8a662ac tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:27.772550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f13ca09-1b84-4589-a38f-2512d8a662ac tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:27.779788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f13ca09-1b84-4589-a38f-2512d8a662ac tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:27.780518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f13ca09-1b84-4589-a38f-2512d8a662ac tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:27.781109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f13ca09-1b84-4589-a38f-2512d8a662ac tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:27.969407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dc6689f7-3e79-4e0f-8704-3ba86b154781 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:27.979367 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dc6689f7-3e79-4e0f-8704-3ba86b154781 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1350 microversion: 2.1 time: 0.371562 Aug 09 14:34:27.982506 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 542/1055] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:27 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1350 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:28.016586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1f13ca09-1b84-4589-a38f-2512d8a662ac tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:28.044687 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1f13ca09-1b84-4589-a38f-2512d8a662ac tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1276 microversion: 2.1 time: 0.289076 Aug 09 14:34:28.045619 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 514/1056] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:27 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1276 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:28.566428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f6bcbb1e-1bb3-4553-93d4-7aae1d5e413d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:28.567498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f6bcbb1e-1bb3-4553-93d4-7aae1d5e413d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:28.580224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6bcbb1e-1bb3-4553-93d4-7aae1d5e413d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:28.581149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6bcbb1e-1bb3-4553-93d4-7aae1d5e413d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:28.583352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6bcbb1e-1bb3-4553-93d4-7aae1d5e413d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:28.584973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6bcbb1e-1bb3-4553-93d4-7aae1d5e413d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:28.586029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6bcbb1e-1bb3-4553-93d4-7aae1d5e413d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:28.588120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6bcbb1e-1bb3-4553-93d4-7aae1d5e413d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:28.613350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3efc0b46-8246-43c8-9f6f-9df8adb6a170 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:28.614392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3efc0b46-8246-43c8-9f6f-9df8adb6a170 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:28.630065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3efc0b46-8246-43c8-9f6f-9df8adb6a170 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:28.633772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3efc0b46-8246-43c8-9f6f-9df8adb6a170 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:28.634359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3efc0b46-8246-43c8-9f6f-9df8adb6a170 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:28.638588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3efc0b46-8246-43c8-9f6f-9df8adb6a170 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:28.639463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3efc0b46-8246-43c8-9f6f-9df8adb6a170 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:28.640134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3efc0b46-8246-43c8-9f6f-9df8adb6a170 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:28.961912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f6bcbb1e-1bb3-4553-93d4-7aae1d5e413d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:28.964975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:28.974966 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f6bcbb1e-1bb3-4553-93d4-7aae1d5e413d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1538 microversion: 2.1 time: 0.410834 Aug 09 14:34:28.977391 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 543/1057] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:28 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1538 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:28.994396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88dfe06e-59a9-405e-b528-88ecc2e8889b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd959d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:29.064036 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88dfe06e-59a9-405e-b528-88ecc2e8889b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.085318 Aug 09 14:34:29.065048 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 544/1058] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:28 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:29.078998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-62f65fb3-47f1-46f7-87ee-19f42852f0fd req-d09a90f0-f7d6-4587-aabf-57f864027542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071cd727-293f-49aa-a7a6-117cf73c817c", "name": "network-vif-plugged", "status": "completed", "tag": "f42a2f66-2d26-46e2-b779-6c68e7d458fd"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:29.117477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-62f65fb3-47f1-46f7-87ee-19f42852f0fd req-d09a90f0-f7d6-4587-aabf-57f864027542 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:29.117961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-62f65fb3-47f1-46f7-87ee-19f42852f0fd req-d09a90f0-f7d6-4587-aabf-57f864027542 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:29.118379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-62f65fb3-47f1-46f7-87ee-19f42852f0fd req-d09a90f0-f7d6-4587-aabf-57f864027542 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:29.157917 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-62f65fb3-47f1-46f7-87ee-19f42852f0fd req-d09a90f0-f7d6-4587-aabf-57f864027542 service nova] Creating event network-vif-plugged:f42a2f66-2d26-46e2-b779-6c68e7d458fd for instance 071cd727-293f-49aa-a7a6-117cf73c817c on n-h2-844626-8 Aug 09 14:34:29.159254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3efc0b46-8246-43c8-9f6f-9df8adb6a170 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:29.169559 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3efc0b46-8246-43c8-9f6f-9df8adb6a170 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1360 microversion: 2.1 time: 0.559962 Aug 09 14:34:29.170630 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-62f65fb3-47f1-46f7-87ee-19f42852f0fd req-d09a90f0-f7d6-4587-aabf-57f864027542 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103992 Aug 09 14:34:29.171289 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 545/1059] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:29.173323 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 515/1060] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:28 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1360 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:29.183767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07c9d678-ca8b-401b-8b82-3b1bfa90e5ce tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:29.187845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07c9d678-ca8b-401b-8b82-3b1bfa90e5ce tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:29.193249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-769e564b-738a-4177-b67c-4f1e590af112 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:29.193958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-769e564b-738a-4177-b67c-4f1e590af112 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:29.209420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-769e564b-738a-4177-b67c-4f1e590af112 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:29.213368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-769e564b-738a-4177-b67c-4f1e590af112 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:29.214021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-769e564b-738a-4177-b67c-4f1e590af112 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:29.214901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-769e564b-738a-4177-b67c-4f1e590af112 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:29.215108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07c9d678-ca8b-401b-8b82-3b1bfa90e5ce tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:29.215686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-769e564b-738a-4177-b67c-4f1e590af112 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:29.216293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-769e564b-738a-4177-b67c-4f1e590af112 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:29.216908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07c9d678-ca8b-401b-8b82-3b1bfa90e5ce tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:29.217369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07c9d678-ca8b-401b-8b82-3b1bfa90e5ce tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:29.218094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07c9d678-ca8b-401b-8b82-3b1bfa90e5ce tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:29.218551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07c9d678-ca8b-401b-8b82-3b1bfa90e5ce tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:29.222299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07c9d678-ca8b-401b-8b82-3b1bfa90e5ce tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:29.384716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=14 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:29.548659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-769e564b-738a-4177-b67c-4f1e590af112 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:29.559414 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-769e564b-738a-4177-b67c-4f1e590af112 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1350 microversion: 2.1 time: 0.386914 Aug 09 14:34:29.560197 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 546/1061] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:29 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1350 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:29.587694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07c9d678-ca8b-401b-8b82-3b1bfa90e5ce tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:29.603976 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07c9d678-ca8b-401b-8b82-3b1bfa90e5ce tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1318 microversion: 2.1 time: 0.429171 Aug 09 14:34:29.604710 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 516/1062] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:29 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:29.925211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7f7c540e-902b-4bfb-9a47-9267ff3526e4 req-0d957e10-641e-4f7b-9021-5fc8d6227037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dafd735-c6e0-4036-b7ea-974a7cabc4ea", "tag": "b83853b5-967d-41c3-93ac-9eda0a6fe81a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:29.932866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:29.938199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7f7c540e-902b-4bfb-9a47-9267ff3526e4 req-0d957e10-641e-4f7b-9021-5fc8d6227037 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:29.938919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7f7c540e-902b-4bfb-9a47-9267ff3526e4 req-0d957e10-641e-4f7b-9021-5fc8d6227037 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:29.939686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7f7c540e-902b-4bfb-9a47-9267ff3526e4 req-0d957e10-641e-4f7b-9021-5fc8d6227037 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:29.954675 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7f7c540e-902b-4bfb-9a47-9267ff3526e4 req-0d957e10-641e-4f7b-9021-5fc8d6227037 service nova] Creating event network-changed:b83853b5-967d-41c3-93ac-9eda0a6fe81a for instance 5dafd735-c6e0-4036-b7ea-974a7cabc4ea on n-h2-844626-8 Aug 09 14:34:29.963028 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7f7c540e-902b-4bfb-9a47-9267ff3526e4 req-0d957e10-641e-4f7b-9021-5fc8d6227037 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052865 Aug 09 14:34:29.963967 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 547/1063] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:30.001945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d489605-f2d7-4554-96b5-54ebdbcf96d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:30.002828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d489605-f2d7-4554-96b5-54ebdbcf96d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:30.010160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:30.012250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d489605-f2d7-4554-96b5-54ebdbcf96d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:30.013004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d489605-f2d7-4554-96b5-54ebdbcf96d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:30.013668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d489605-f2d7-4554-96b5-54ebdbcf96d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:30.014569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d489605-f2d7-4554-96b5-54ebdbcf96d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:30.015394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d489605-f2d7-4554-96b5-54ebdbcf96d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:30.016101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d489605-f2d7-4554-96b5-54ebdbcf96d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:30.082061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40b2dae5-8fb7-4c70-80ba-0fc2d7bbd1e7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddeb5a60>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:30.151699 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40b2dae5-8fb7-4c70-80ba-0fc2d7bbd1e7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.074110 Aug 09 14:34:30.170085 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 548/1064] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:30 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:30.195679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be131671-2263-4e35-b107-300e9c4d31f8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:30.196912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be131671-2263-4e35-b107-300e9c4d31f8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:30.213288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be131671-2263-4e35-b107-300e9c4d31f8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:30.215637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be131671-2263-4e35-b107-300e9c4d31f8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:30.216386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be131671-2263-4e35-b107-300e9c4d31f8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:30.217465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be131671-2263-4e35-b107-300e9c4d31f8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:30.218651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be131671-2263-4e35-b107-300e9c4d31f8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:30.219307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be131671-2263-4e35-b107-300e9c4d31f8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:30.507017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d489605-f2d7-4554-96b5-54ebdbcf96d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:30.516721 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d489605-f2d7-4554-96b5-54ebdbcf96d8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1538 microversion: 2.1 time: 0.519895 Aug 09 14:34:30.524090 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 517/1065] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:29 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1538 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:30.580913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-141d972d-311f-490b-a33b-727c88043330 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:30.581749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-141d972d-311f-490b-a33b-727c88043330 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:30.595033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-141d972d-311f-490b-a33b-727c88043330 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:30.595592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-141d972d-311f-490b-a33b-727c88043330 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:30.596093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-141d972d-311f-490b-a33b-727c88043330 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:30.596810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-141d972d-311f-490b-a33b-727c88043330 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:30.597341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-141d972d-311f-490b-a33b-727c88043330 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:30.597685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-141d972d-311f-490b-a33b-727c88043330 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:30.616588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-be131671-2263-4e35-b107-300e9c4d31f8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:30.632798 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be131671-2263-4e35-b107-300e9c4d31f8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1360 microversion: 2.1 time: 0.442393 Aug 09 14:34:30.633653 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 549/1066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:30 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1360 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:30.643612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-61ada948-bfb2-4bfe-b2f1-9bed1b1c3fec tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:30.644285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-61ada948-bfb2-4bfe-b2f1-9bed1b1c3fec tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:30.653941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61ada948-bfb2-4bfe-b2f1-9bed1b1c3fec tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:30.654445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61ada948-bfb2-4bfe-b2f1-9bed1b1c3fec tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:30.654859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61ada948-bfb2-4bfe-b2f1-9bed1b1c3fec tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:30.655612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61ada948-bfb2-4bfe-b2f1-9bed1b1c3fec tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:30.656070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61ada948-bfb2-4bfe-b2f1-9bed1b1c3fec tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:30.656471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61ada948-bfb2-4bfe-b2f1-9bed1b1c3fec tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:30.897894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-141d972d-311f-490b-a33b-727c88043330 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:30.913438 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-141d972d-311f-490b-a33b-727c88043330 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1350 microversion: 2.1 time: 0.336750 Aug 09 14:34:30.914432 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 518/1067] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:30 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1350 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:30.952296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-61ada948-bfb2-4bfe-b2f1-9bed1b1c3fec tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:30.962458 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-61ada948-bfb2-4bfe-b2f1-9bed1b1c3fec tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1318 microversion: 2.1 time: 0.327063 Aug 09 14:34:30.963273 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 550/1068] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:30 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1318 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:31.170331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bb4975f1-53cb-4474-b0bb-6ea4cc0a5e31 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd7fc3a0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:31.242403 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bb4975f1-53cb-4474-b0bb-6ea4cc0a5e31 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.077416 Aug 09 14:34:31.252876 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 519/1069] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:31 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:31.544238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-effc0b5f-3970-41f1-8ad1-a4a5fb1d157c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:31.545272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-effc0b5f-3970-41f1-8ad1-a4a5fb1d157c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:31.553134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-effc0b5f-3970-41f1-8ad1-a4a5fb1d157c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:31.553836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-effc0b5f-3970-41f1-8ad1-a4a5fb1d157c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:31.554427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-effc0b5f-3970-41f1-8ad1-a4a5fb1d157c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:31.555354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-effc0b5f-3970-41f1-8ad1-a4a5fb1d157c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:31.555968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-effc0b5f-3970-41f1-8ad1-a4a5fb1d157c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:31.556526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-effc0b5f-3970-41f1-8ad1-a4a5fb1d157c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:31.653502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70e58dc1-a7bd-4721-b743-66d97c71e3d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:31.654098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-70e58dc1-a7bd-4721-b743-66d97c71e3d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:31.665335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70e58dc1-a7bd-4721-b743-66d97c71e3d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:31.665830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70e58dc1-a7bd-4721-b743-66d97c71e3d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:31.666265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70e58dc1-a7bd-4721-b743-66d97c71e3d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:31.666972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70e58dc1-a7bd-4721-b743-66d97c71e3d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:31.667448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70e58dc1-a7bd-4721-b743-66d97c71e3d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:31.667869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70e58dc1-a7bd-4721-b743-66d97c71e3d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:31.842133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-effc0b5f-3970-41f1-8ad1-a4a5fb1d157c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:31.853012 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-effc0b5f-3970-41f1-8ad1-a4a5fb1d157c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1538 microversion: 2.1 time: 0.312686 Aug 09 14:34:31.854190 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 551/1070] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:31 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1538 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:31.907151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-70e58dc1-a7bd-4721-b743-66d97c71e3d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:31.910047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:31.917362 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70e58dc1-a7bd-4721-b743-66d97c71e3d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1360 microversion: 2.1 time: 0.267534 Aug 09 14:34:31.918584 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 520/1071] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:31 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1360 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:31.943761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2547b36c-5c54-4291-af51-e77c58a1f040 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:31.944706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2547b36c-5c54-4291-af51-e77c58a1f040 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:31.956798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2547b36c-5c54-4291-af51-e77c58a1f040 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:31.959953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2547b36c-5c54-4291-af51-e77c58a1f040 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:31.961134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2547b36c-5c54-4291-af51-e77c58a1f040 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:31.962067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2547b36c-5c54-4291-af51-e77c58a1f040 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:31.962912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2547b36c-5c54-4291-af51-e77c58a1f040 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:31.963806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2547b36c-5c54-4291-af51-e77c58a1f040 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:31.985798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1166b01f-a91a-41d1-904a-1d88ffbe12c2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:31.986856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1166b01f-a91a-41d1-904a-1d88ffbe12c2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:32.000037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1166b01f-a91a-41d1-904a-1d88ffbe12c2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:32.001086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1166b01f-a91a-41d1-904a-1d88ffbe12c2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:32.006727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1166b01f-a91a-41d1-904a-1d88ffbe12c2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:32.007909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1166b01f-a91a-41d1-904a-1d88ffbe12c2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:32.009938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1166b01f-a91a-41d1-904a-1d88ffbe12c2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:32.011921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1166b01f-a91a-41d1-904a-1d88ffbe12c2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:32.321459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1166b01f-a91a-41d1-904a-1d88ffbe12c2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:32.332601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2547b36c-5c54-4291-af51-e77c58a1f040 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:32.334266 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1166b01f-a91a-41d1-904a-1d88ffbe12c2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1318 microversion: 2.1 time: 0.351865 Aug 09 14:34:32.347325 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2547b36c-5c54-4291-af51-e77c58a1f040 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1540 microversion: 2.1 time: 0.403645 Aug 09 14:34:32.353500 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 521/1072] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:31 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:32.354657 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 552/1073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:31 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1540 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:32.369018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b18f0f61-bf45-4584-b3db-7262ad296936 req-46682f97-447e-468e-acd6-1daee3b64eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37b23fa3-f32c-4406-a38f-2ba8e7e0df4a", "tag": "d2163219-49e5-4bac-b7be-0786277eb832"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:32.377408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0165be1-5b5d-47ca-9396-51884ba7ffc6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd80dc0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:32.391497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b18f0f61-bf45-4584-b3db-7262ad296936 req-46682f97-447e-468e-acd6-1daee3b64eb7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:32.392284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b18f0f61-bf45-4584-b3db-7262ad296936 req-46682f97-447e-468e-acd6-1daee3b64eb7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:32.393540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b18f0f61-bf45-4584-b3db-7262ad296936 req-46682f97-447e-468e-acd6-1daee3b64eb7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:32.437220 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b18f0f61-bf45-4584-b3db-7262ad296936 req-46682f97-447e-468e-acd6-1daee3b64eb7 service nova] Creating event network-changed:d2163219-49e5-4bac-b7be-0786277eb832 for instance 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a on n-h1-844626-8 Aug 09 14:34:32.443791 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b18f0f61-bf45-4584-b3db-7262ad296936 req-46682f97-447e-468e-acd6-1daee3b64eb7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085718 Aug 09 14:34:32.444685 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 522/1074] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:32.450786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c27424d1-9ad5-4a7a-92f5-4478317ede8e tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:32.451721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c27424d1-9ad5-4a7a-92f5-4478317ede8e tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:32.459429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c27424d1-9ad5-4a7a-92f5-4478317ede8e tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:32.461499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c27424d1-9ad5-4a7a-92f5-4478317ede8e tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:32.461499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c27424d1-9ad5-4a7a-92f5-4478317ede8e tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:32.462789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c27424d1-9ad5-4a7a-92f5-4478317ede8e tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:32.463737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c27424d1-9ad5-4a7a-92f5-4478317ede8e tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:32.464370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c27424d1-9ad5-4a7a-92f5-4478317ede8e tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:32.470106 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0165be1-5b5d-47ca-9396-51884ba7ffc6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.098027 Aug 09 14:34:32.471076 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 553/1075] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:32 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:32.598849 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c27424d1-9ad5-4a7a-92f5-4478317ede8e tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.152592 Aug 09 14:34:32.606761 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 523/1076] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:34:32 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:32.873792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5b824583-5efd-4501-8c9b-6768b0c45e78 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:32.874398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b824583-5efd-4501-8c9b-6768b0c45e78 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:32.877241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:32.885116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b824583-5efd-4501-8c9b-6768b0c45e78 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:32.885603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b824583-5efd-4501-8c9b-6768b0c45e78 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:32.886022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b824583-5efd-4501-8c9b-6768b0c45e78 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:32.890721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b824583-5efd-4501-8c9b-6768b0c45e78 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:32.892731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b824583-5efd-4501-8c9b-6768b0c45e78 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:32.894500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b824583-5efd-4501-8c9b-6768b0c45e78 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:32.946165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-61fc15fa-d635-42d0-bf1a-86890512b837 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:32.946796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-61fc15fa-d635-42d0-bf1a-86890512b837 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:32.966851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61fc15fa-d635-42d0-bf1a-86890512b837 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:32.967693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61fc15fa-d635-42d0-bf1a-86890512b837 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:32.970716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61fc15fa-d635-42d0-bf1a-86890512b837 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:32.975120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61fc15fa-d635-42d0-bf1a-86890512b837 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:32.978348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61fc15fa-d635-42d0-bf1a-86890512b837 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:32.979434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61fc15fa-d635-42d0-bf1a-86890512b837 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:33.134281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=44 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:33.904502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-61fc15fa-d635-42d0-bf1a-86890512b837 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:33.912256 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-61fc15fa-d635-42d0-bf1a-86890512b837 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1360 microversion: 2.1 time: 0.971419 Aug 09 14:34:33.939581 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 524/1077] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:32 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1360 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:33.946480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb2538b6-f8d5-459b-b272-2d92a0faf1b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:33.947812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb2538b6-f8d5-459b-b272-2d92a0faf1b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:33.972064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb2538b6-f8d5-459b-b272-2d92a0faf1b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:33.972823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb2538b6-f8d5-459b-b272-2d92a0faf1b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:33.973417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb2538b6-f8d5-459b-b272-2d92a0faf1b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:33.974299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb2538b6-f8d5-459b-b272-2d92a0faf1b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:33.974898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb2538b6-f8d5-459b-b272-2d92a0faf1b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:33.975492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb2538b6-f8d5-459b-b272-2d92a0faf1b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:34.007739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5b824583-5efd-4501-8c9b-6768b0c45e78 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:34.035611 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5b824583-5efd-4501-8c9b-6768b0c45e78 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 1.165392 Aug 09 14:34:34.038677 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 554/1078] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:32 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:34.053567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-10cf3f1a-5a31-435a-bcbe-6e7b8eadce16 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dde38040>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:34.139684 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-10cf3f1a-5a31-435a-bcbe-6e7b8eadce16 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.099661 Aug 09 14:34:34.147466 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 555/1079] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:34 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:34.353426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fb2538b6-f8d5-459b-b272-2d92a0faf1b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:34.379109 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb2538b6-f8d5-459b-b272-2d92a0faf1b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1318 microversion: 2.1 time: 0.425819 Aug 09 14:34:34.379109 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 525/1080] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:33 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1318 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:34.648343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1d1013f2-887d-4b27-897b-d9a22fbd7b58 req-149d46d4-9f22-4d58-9595-c40f6e32e7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "071cd727-293f-49aa-a7a6-117cf73c817c", "tag": "f42a2f66-2d26-46e2-b779-6c68e7d458fd"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:34.661842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1d1013f2-887d-4b27-897b-d9a22fbd7b58 req-149d46d4-9f22-4d58-9595-c40f6e32e7f5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:34.662341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1d1013f2-887d-4b27-897b-d9a22fbd7b58 req-149d46d4-9f22-4d58-9595-c40f6e32e7f5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:34.662765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1d1013f2-887d-4b27-897b-d9a22fbd7b58 req-149d46d4-9f22-4d58-9595-c40f6e32e7f5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:34.677603 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1d1013f2-887d-4b27-897b-d9a22fbd7b58 req-149d46d4-9f22-4d58-9595-c40f6e32e7f5 service nova] Creating event network-changed:f42a2f66-2d26-46e2-b779-6c68e7d458fd for instance 071cd727-293f-49aa-a7a6-117cf73c817c on n-h2-844626-8 Aug 09 14:34:34.683536 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1d1013f2-887d-4b27-897b-d9a22fbd7b58 req-149d46d4-9f22-4d58-9595-c40f6e32e7f5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039958 Aug 09 14:34:34.684517 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 556/1081] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:34:34.956696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6a8b9df6-8316-4484-bfc9-43a9950ccae3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:34.958500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6a8b9df6-8316-4484-bfc9-43a9950ccae3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:34.980040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a8b9df6-8316-4484-bfc9-43a9950ccae3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:34.980850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a8b9df6-8316-4484-bfc9-43a9950ccae3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:34.981526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a8b9df6-8316-4484-bfc9-43a9950ccae3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:34.982483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a8b9df6-8316-4484-bfc9-43a9950ccae3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:34.984160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a8b9df6-8316-4484-bfc9-43a9950ccae3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:34.984813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a8b9df6-8316-4484-bfc9-43a9950ccae3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:35.063537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04604055-891c-4e5f-a69e-0a76b89375e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:35.069523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-04604055-891c-4e5f-a69e-0a76b89375e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:35.087402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04604055-891c-4e5f-a69e-0a76b89375e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:35.088119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04604055-891c-4e5f-a69e-0a76b89375e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:35.088719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04604055-891c-4e5f-a69e-0a76b89375e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:35.089600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04604055-891c-4e5f-a69e-0a76b89375e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:35.092059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04604055-891c-4e5f-a69e-0a76b89375e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:35.092795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04604055-891c-4e5f-a69e-0a76b89375e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:35.274406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6a8b9df6-8316-4484-bfc9-43a9950ccae3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:35.285491 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6a8b9df6-8316-4484-bfc9-43a9950ccae3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1360 microversion: 2.1 time: 0.335106 Aug 09 14:34:35.289024 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 526/1082] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:34 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1360 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:35.298155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2fabee38-52ed-4625-aabd-0331443748ad tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd58f9d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:35.325466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-04604055-891c-4e5f-a69e-0a76b89375e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:35.338278 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-04604055-891c-4e5f-a69e-0a76b89375e9 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.279124 Aug 09 14:34:35.339764 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 557/1083] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:35 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:35.389677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be06d34b-e272-4db3-86c0-b47b65e955c0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:35.390284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be06d34b-e272-4db3-86c0-b47b65e955c0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:35.400623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be06d34b-e272-4db3-86c0-b47b65e955c0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:35.401326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be06d34b-e272-4db3-86c0-b47b65e955c0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:35.401922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be06d34b-e272-4db3-86c0-b47b65e955c0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:35.402764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be06d34b-e272-4db3-86c0-b47b65e955c0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:35.402976 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2fabee38-52ed-4625-aabd-0331443748ad tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.111795 Aug 09 14:34:35.403610 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 527/1084] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:35 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:35.403828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be06d34b-e272-4db3-86c0-b47b65e955c0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:35.404374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be06d34b-e272-4db3-86c0-b47b65e955c0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:35.621974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-be06d34b-e272-4db3-86c0-b47b65e955c0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:35.632045 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be06d34b-e272-4db3-86c0-b47b65e955c0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1318 microversion: 2.1 time: 0.247870 Aug 09 14:34:35.643628 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 558/1085] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:35 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:36.084022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9fc6a7f1-081f-47c8-8f29-9baaa8f944d3 req-380dbb52-5d7c-44a6-8c6d-1351bd2e9994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf11da1-82f0-41e7-bdef-9bbea7629ef0", "name": "network-vif-plugged", "status": "completed", "tag": "510915b8-0436-4bd0-8a98-8b38c250325d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:36.097004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9fc6a7f1-081f-47c8-8f29-9baaa8f944d3 req-380dbb52-5d7c-44a6-8c6d-1351bd2e9994 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:36.097826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9fc6a7f1-081f-47c8-8f29-9baaa8f944d3 req-380dbb52-5d7c-44a6-8c6d-1351bd2e9994 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:36.098569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9fc6a7f1-081f-47c8-8f29-9baaa8f944d3 req-380dbb52-5d7c-44a6-8c6d-1351bd2e9994 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:36.112014 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9fc6a7f1-081f-47c8-8f29-9baaa8f944d3 req-380dbb52-5d7c-44a6-8c6d-1351bd2e9994 service nova] Creating event network-vif-plugged:510915b8-0436-4bd0-8a98-8b38c250325d for instance aaf11da1-82f0-41e7-bdef-9bbea7629ef0 on n-h1-844626-8 Aug 09 14:34:36.117764 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9fc6a7f1-081f-47c8-8f29-9baaa8f944d3 req-380dbb52-5d7c-44a6-8c6d-1351bd2e9994 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038772 Aug 09 14:34:36.119136 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 528/1086] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:36.310633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-76b372a0-05a6-4ce6-81ce-11acc0282e3f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:36.311508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-76b372a0-05a6-4ce6-81ce-11acc0282e3f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:36.327934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76b372a0-05a6-4ce6-81ce-11acc0282e3f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:36.328732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76b372a0-05a6-4ce6-81ce-11acc0282e3f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:36.332337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76b372a0-05a6-4ce6-81ce-11acc0282e3f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:36.342395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76b372a0-05a6-4ce6-81ce-11acc0282e3f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:36.347104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76b372a0-05a6-4ce6-81ce-11acc0282e3f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:36.347572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76b372a0-05a6-4ce6-81ce-11acc0282e3f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:36.362267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28b70bca-b94f-4bc4-9492-1ca84b631f04 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:36.363014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28b70bca-b94f-4bc4-9492-1ca84b631f04 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:36.388267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28b70bca-b94f-4bc4-9492-1ca84b631f04 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:36.390921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28b70bca-b94f-4bc4-9492-1ca84b631f04 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:36.392106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28b70bca-b94f-4bc4-9492-1ca84b631f04 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:36.397329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28b70bca-b94f-4bc4-9492-1ca84b631f04 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:36.397811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28b70bca-b94f-4bc4-9492-1ca84b631f04 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:36.398244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28b70bca-b94f-4bc4-9492-1ca84b631f04 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:36.645138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-76b372a0-05a6-4ce6-81ce-11acc0282e3f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:36.655076 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-76b372a0-05a6-4ce6-81ce-11acc0282e3f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1360 microversion: 2.1 time: 0.348682 Aug 09 14:34:36.656543 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 559/1087] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:36 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1360 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:36.662268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c01f1237-a4d7-4ff4-af7c-4762bbc6a68d tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd80280>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:36.700946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-28b70bca-b94f-4bc4-9492-1ca84b631f04 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:36.709300 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28b70bca-b94f-4bc4-9492-1ca84b631f04 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.352017 Aug 09 14:34:36.712443 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c01f1237-a4d7-4ff4-af7c-4762bbc6a68d tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1455 microversion: 2.1 time: 0.054461 Aug 09 14:34:36.719667 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 560/1088] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:36 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:36.723052 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 529/1089] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:36 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:36.725070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e618fa5-133f-4b80-a9a7-efa817ec3fe5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:36.725578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8e618fa5-133f-4b80-a9a7-efa817ec3fe5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:36.733363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e618fa5-133f-4b80-a9a7-efa817ec3fe5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:36.733906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e618fa5-133f-4b80-a9a7-efa817ec3fe5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:36.734426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e618fa5-133f-4b80-a9a7-efa817ec3fe5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:36.735191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e618fa5-133f-4b80-a9a7-efa817ec3fe5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:36.735693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e618fa5-133f-4b80-a9a7-efa817ec3fe5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:36.736119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e618fa5-133f-4b80-a9a7-efa817ec3fe5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:36.877370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e618fa5-133f-4b80-a9a7-efa817ec3fe5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:36.884888 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e618fa5-133f-4b80-a9a7-efa817ec3fe5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1318 microversion: 2.1 time: 0.164184 Aug 09 14:34:36.885441 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 561/1090] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:36 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:37.689994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5b4322f-0de7-4c09-9847-fc1e4d421f06 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:37.690834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5b4322f-0de7-4c09-9847-fc1e4d421f06 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:37.700795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5b4322f-0de7-4c09-9847-fc1e4d421f06 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:37.701471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5b4322f-0de7-4c09-9847-fc1e4d421f06 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:37.702077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5b4322f-0de7-4c09-9847-fc1e4d421f06 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:37.703044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5b4322f-0de7-4c09-9847-fc1e4d421f06 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:37.703714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5b4322f-0de7-4c09-9847-fc1e4d421f06 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:37.704298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5b4322f-0de7-4c09-9847-fc1e4d421f06 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:37.727372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32626237-4d62-4e11-a9be-1b71f269be31 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd5ba60>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:37.780345 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32626237-4d62-4e11-a9be-1b71f269be31 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1464 microversion: 2.1 time: 0.056854 Aug 09 14:34:37.781181 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 562/1091] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:37 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1464 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:37.795532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae5bb18a-eaa9-449c-b58b-294f98745451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:37.796152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae5bb18a-eaa9-449c-b58b-294f98745451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:37.806372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae5bb18a-eaa9-449c-b58b-294f98745451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:37.807111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae5bb18a-eaa9-449c-b58b-294f98745451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:37.807718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae5bb18a-eaa9-449c-b58b-294f98745451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:37.808578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae5bb18a-eaa9-449c-b58b-294f98745451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:37.809183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae5bb18a-eaa9-449c-b58b-294f98745451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:37.809667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae5bb18a-eaa9-449c-b58b-294f98745451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:37.853014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5b4322f-0de7-4c09-9847-fc1e4d421f06 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:37.860868 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5b4322f-0de7-4c09-9847-fc1e4d421f06 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1360 microversion: 2.1 time: 0.176500 Aug 09 14:34:37.861544 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 530/1092] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:37 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:37.867121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1c25be7-59d2-4a37-ae89-9bb5e0bc98a1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd804b80>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:37.916160 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1c25be7-59d2-4a37-ae89-9bb5e0bc98a1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 200 len: 1464 microversion: 2.1 time: 0.053571 Aug 09 14:34:37.916745 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 531/1093] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:37 2022] GET /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 1464 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:37.924918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72e14cbc-8976-4eab-909c-b8338149663b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:37.925603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-72e14cbc-8976-4eab-909c-b8338149663b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:37.932214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e14cbc-8976-4eab-909c-b8338149663b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:37.932768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e14cbc-8976-4eab-909c-b8338149663b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:37.933260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e14cbc-8976-4eab-909c-b8338149663b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:37.934019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e14cbc-8976-4eab-909c-b8338149663b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:37.934529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e14cbc-8976-4eab-909c-b8338149663b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:37.935113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e14cbc-8976-4eab-909c-b8338149663b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:37.963020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ae5bb18a-eaa9-449c-b58b-294f98745451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:37.971446 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae5bb18a-eaa9-449c-b58b-294f98745451 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.180357 Aug 09 14:34:37.972239 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 563/1094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:37 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:37.976603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa6d3b85-72c1-4c0a-ade6-94c6bb902904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:37.979839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa6d3b85-72c1-4c0a-ade6-94c6bb902904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:37.982995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa6d3b85-72c1-4c0a-ade6-94c6bb902904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:37.983517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa6d3b85-72c1-4c0a-ade6-94c6bb902904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:37.983949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa6d3b85-72c1-4c0a-ade6-94c6bb902904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:37.984643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa6d3b85-72c1-4c0a-ade6-94c6bb902904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:37.985088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa6d3b85-72c1-4c0a-ade6-94c6bb902904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:37.985508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa6d3b85-72c1-4c0a-ade6-94c6bb902904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:38.135072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-72e14cbc-8976-4eab-909c-b8338149663b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:38.145261 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72e14cbc-8976-4eab-909c-b8338149663b tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1318 microversion: 2.1 time: 0.226875 Aug 09 14:34:38.145796 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 532/1095] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:37 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:38.161950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa6d3b85-72c1-4c0a-ade6-94c6bb902904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:38.170302 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa6d3b85-72c1-4c0a-ade6-94c6bb902904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1466 microversion: 2.1 time: 0.197268 Aug 09 14:34:38.170985 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 564/1096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:37 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1466 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:38.192054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e44b02a-c15c-4afe-94ea-6a45d0042eea tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1711658684"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:38.194570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9e44b02a-c15c-4afe-94ea-6a45d0042eea tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:38.201690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e44b02a-c15c-4afe-94ea-6a45d0042eea tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:38.202401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e44b02a-c15c-4afe-94ea-6a45d0042eea tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:38.202905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e44b02a-c15c-4afe-94ea-6a45d0042eea tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:38.203704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e44b02a-c15c-4afe-94ea-6a45d0042eea tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:38.204226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e44b02a-c15c-4afe-94ea-6a45d0042eea tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:38.204711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e44b02a-c15c-4afe-94ea-6a45d0042eea tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:38.317042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-751b6d6e-d628-491c-ae0a-71e1158cab63 req-9b18b95e-3eb7-438b-8c6e-b935d014a243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dafd735-c6e0-4036-b7ea-974a7cabc4ea", "name": "network-vif-plugged", "status": "completed", "tag": "b83853b5-967d-41c3-93ac-9eda0a6fe81a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:38.330787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-751b6d6e-d628-491c-ae0a-71e1158cab63 req-9b18b95e-3eb7-438b-8c6e-b935d014a243 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:38.331338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-751b6d6e-d628-491c-ae0a-71e1158cab63 req-9b18b95e-3eb7-438b-8c6e-b935d014a243 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:38.331840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-751b6d6e-d628-491c-ae0a-71e1158cab63 req-9b18b95e-3eb7-438b-8c6e-b935d014a243 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:38.347852 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-751b6d6e-d628-491c-ae0a-71e1158cab63 req-9b18b95e-3eb7-438b-8c6e-b935d014a243 service nova] Creating event network-vif-plugged:b83853b5-967d-41c3-93ac-9eda0a6fe81a for instance 5dafd735-c6e0-4036-b7ea-974a7cabc4ea on n-h2-844626-8 Aug 09 14:34:38.357530 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-751b6d6e-d628-491c-ae0a-71e1158cab63 req-9b18b95e-3eb7-438b-8c6e-b935d014a243 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045812 Aug 09 14:34:38.358157 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 565/1097] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:38.419128 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e44b02a-c15c-4afe-94ea-6a45d0042eea tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "POST /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1/action" status: 202 len: 0 microversion: 2.1 time: 0.231487 Aug 09 14:34:38.419813 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 533/1098] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:34:38 2022] POST /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 14:34:38.431514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-deb72b5b-ef7a-42e7-9bc3-cc171d775c44 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddda0790>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:38.480260 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-deb72b5b-ef7a-42e7-9bc3-cc171d775c44 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.052696 Aug 09 14:34:38.481282 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 566/1099] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:38 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:38.888020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34c28b7a-c3cf-4cb3-880a-357e286fddb3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:38.889029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34c28b7a-c3cf-4cb3-880a-357e286fddb3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:38.899920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34c28b7a-c3cf-4cb3-880a-357e286fddb3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:38.900713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34c28b7a-c3cf-4cb3-880a-357e286fddb3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:38.901457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34c28b7a-c3cf-4cb3-880a-357e286fddb3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:38.902585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34c28b7a-c3cf-4cb3-880a-357e286fddb3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:38.903384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34c28b7a-c3cf-4cb3-880a-357e286fddb3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:38.904076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34c28b7a-c3cf-4cb3-880a-357e286fddb3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:38.993288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1741147b-c788-4d5d-9b05-aa556df26e00 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:38.994005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1741147b-c788-4d5d-9b05-aa556df26e00 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:39.001226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1741147b-c788-4d5d-9b05-aa556df26e00 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:39.001702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1741147b-c788-4d5d-9b05-aa556df26e00 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:39.002126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1741147b-c788-4d5d-9b05-aa556df26e00 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:39.002793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1741147b-c788-4d5d-9b05-aa556df26e00 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:39.003276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1741147b-c788-4d5d-9b05-aa556df26e00 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:39.003706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1741147b-c788-4d5d-9b05-aa556df26e00 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:39.052703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-34c28b7a-c3cf-4cb3-880a-357e286fddb3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:39.060629 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34c28b7a-c3cf-4cb3-880a-357e286fddb3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1542 microversion: 2.1 time: 0.181306 Aug 09 14:34:39.061207 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 534/1100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:38 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1542 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:39.080888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e1bf3888-1fed-4bcd-81bd-6e464dd2475a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:39.081495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e1bf3888-1fed-4bcd-81bd-6e464dd2475a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:39.087698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1bf3888-1fed-4bcd-81bd-6e464dd2475a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:39.088168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1bf3888-1fed-4bcd-81bd-6e464dd2475a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:39.088598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1bf3888-1fed-4bcd-81bd-6e464dd2475a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:39.089278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1bf3888-1fed-4bcd-81bd-6e464dd2475a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:39.089707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1bf3888-1fed-4bcd-81bd-6e464dd2475a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:39.090119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1bf3888-1fed-4bcd-81bd-6e464dd2475a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:39.159787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1741147b-c788-4d5d-9b05-aa556df26e00 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:39.168109 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1741147b-c788-4d5d-9b05-aa556df26e00 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.179620 Aug 09 14:34:39.168723 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 567/1101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:38 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:39.173143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b8a595d-9e32-470e-923b-e4f3a165bf1c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:39.173692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b8a595d-9e32-470e-923b-e4f3a165bf1c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:39.177256 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e1bf3888-1fed-4bcd-81bd-6e464dd2475a tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100287 Aug 09 14:34:39.177933 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 535/1102] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:34:39 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:34:39.180413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b8a595d-9e32-470e-923b-e4f3a165bf1c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:39.180894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b8a595d-9e32-470e-923b-e4f3a165bf1c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:39.181317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b8a595d-9e32-470e-923b-e4f3a165bf1c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:39.181998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b8a595d-9e32-470e-923b-e4f3a165bf1c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:39.182436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b8a595d-9e32-470e-923b-e4f3a165bf1c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:39.182844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b8a595d-9e32-470e-923b-e4f3a165bf1c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:39.316465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6b8a595d-9e32-470e-923b-e4f3a165bf1c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:39.324097 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b8a595d-9e32-470e-923b-e4f3a165bf1c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1318 microversion: 2.1 time: 0.154379 Aug 09 14:34:39.324644 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 568/1103] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:39 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:39.496228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-80b1308d-6ff6-47a7-b323-f31e632f28a3 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd78ae50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:39.540832 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-80b1308d-6ff6-47a7-b323-f31e632f28a3 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.048539 Aug 09 14:34:39.541399 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 536/1104] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:39 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:40.122834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e151c02d-6fcd-46bf-a384-4a12dacf85d5 req-da30ca67-a627-47f9-ac15-6bc4a124f7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf11da1-82f0-41e7-bdef-9bbea7629ef0", "tag": "510915b8-0436-4bd0-8a98-8b38c250325d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:40.133633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e151c02d-6fcd-46bf-a384-4a12dacf85d5 req-da30ca67-a627-47f9-ac15-6bc4a124f7a9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:40.134376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e151c02d-6fcd-46bf-a384-4a12dacf85d5 req-da30ca67-a627-47f9-ac15-6bc4a124f7a9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:40.134948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e151c02d-6fcd-46bf-a384-4a12dacf85d5 req-da30ca67-a627-47f9-ac15-6bc4a124f7a9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:40.149853 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e151c02d-6fcd-46bf-a384-4a12dacf85d5 req-da30ca67-a627-47f9-ac15-6bc4a124f7a9 service nova] Creating event network-changed:510915b8-0436-4bd0-8a98-8b38c250325d for instance aaf11da1-82f0-41e7-bdef-9bbea7629ef0 on n-h1-844626-8 Aug 09 14:34:40.155018 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e151c02d-6fcd-46bf-a384-4a12dacf85d5 req-da30ca67-a627-47f9-ac15-6bc4a124f7a9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036088 Aug 09 14:34:40.155862 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 569/1105] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:40.190431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42538e57-2495-4cb9-9544-551e5841f971 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:40.191219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-42538e57-2495-4cb9-9544-551e5841f971 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:40.199456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42538e57-2495-4cb9-9544-551e5841f971 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:40.199761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42538e57-2495-4cb9-9544-551e5841f971 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:40.200218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42538e57-2495-4cb9-9544-551e5841f971 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:40.200896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42538e57-2495-4cb9-9544-551e5841f971 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:40.201510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42538e57-2495-4cb9-9544-551e5841f971 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:40.201932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42538e57-2495-4cb9-9544-551e5841f971 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:40.345174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-605e089b-cb7e-4c38-b960-6eafbfc55a2a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:40.346238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-605e089b-cb7e-4c38-b960-6eafbfc55a2a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:40.349064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-42538e57-2495-4cb9-9544-551e5841f971 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:40.353806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-605e089b-cb7e-4c38-b960-6eafbfc55a2a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:40.354424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-605e089b-cb7e-4c38-b960-6eafbfc55a2a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:40.355029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-605e089b-cb7e-4c38-b960-6eafbfc55a2a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:40.356105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-605e089b-cb7e-4c38-b960-6eafbfc55a2a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:40.356558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-605e089b-cb7e-4c38-b960-6eafbfc55a2a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:40.356979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-605e089b-cb7e-4c38-b960-6eafbfc55a2a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:40.358212 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-42538e57-2495-4cb9-9544-551e5841f971 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.172823 Aug 09 14:34:40.359900 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 537/1106] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:40 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:40.494373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-605e089b-cb7e-4c38-b960-6eafbfc55a2a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:40.496859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:40.503784 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-605e089b-cb7e-4c38-b960-6eafbfc55a2a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1468 microversion: 2.1 time: 0.162739 Aug 09 14:34:40.504600 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 570/1107] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:40 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1468 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:40.519966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f15579a9-13e9-4d70-80bd-9942b24a7c96 req-4d4fbd7b-2fa5-4d93-9c3f-21ede4e48b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b23fa3-f32c-4406-a38f-2ba8e7e0df4a", "name": "network-vif-plugged", "status": "completed", "tag": "d2163219-49e5-4bac-b7be-0786277eb832"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:40.530653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7e26d739-7028-43f2-ac38-5106c75aff34 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:40.533435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7e26d739-7028-43f2-ac38-5106c75aff34 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:40.535576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f15579a9-13e9-4d70-80bd-9942b24a7c96 req-4d4fbd7b-2fa5-4d93-9c3f-21ede4e48b98 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:40.536286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f15579a9-13e9-4d70-80bd-9942b24a7c96 req-4d4fbd7b-2fa5-4d93-9c3f-21ede4e48b98 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:40.536765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f15579a9-13e9-4d70-80bd-9942b24a7c96 req-4d4fbd7b-2fa5-4d93-9c3f-21ede4e48b98 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:40.539671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e26d739-7028-43f2-ac38-5106c75aff34 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:40.540071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e26d739-7028-43f2-ac38-5106c75aff34 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:40.541619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e26d739-7028-43f2-ac38-5106c75aff34 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:40.541619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e26d739-7028-43f2-ac38-5106c75aff34 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:40.541619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e26d739-7028-43f2-ac38-5106c75aff34 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:40.542034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e26d739-7028-43f2-ac38-5106c75aff34 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:40.549047 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f15579a9-13e9-4d70-80bd-9942b24a7c96 req-4d4fbd7b-2fa5-4d93-9c3f-21ede4e48b98 service nova] Creating event network-vif-plugged:d2163219-49e5-4bac-b7be-0786277eb832 for instance 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a on n-h1-844626-8 Aug 09 14:34:40.554273 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f15579a9-13e9-4d70-80bd-9942b24a7c96 req-4d4fbd7b-2fa5-4d93-9c3f-21ede4e48b98 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038511 Aug 09 14:34:40.555048 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 538/1108] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:40.559775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1817ed5-e271-470b-8806-405bf52248e9 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd78a310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:40.606993 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1817ed5-e271-470b-8806-405bf52248e9 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.050891 Aug 09 14:34:40.607829 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 539/1109] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:40 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:40.685746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7e26d739-7028-43f2-ac38-5106c75aff34 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:40.693775 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7e26d739-7028-43f2-ac38-5106c75aff34 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a" status: 200 len: 1318 microversion: 2.1 time: 0.166834 Aug 09 14:34:40.694555 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 571/1110] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:40 2022] GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:41.380685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b115ca50-4176-42f0-a43b-a1e5f81d21e3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:41.381531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b115ca50-4176-42f0-a43b-a1e5f81d21e3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:41.394400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b115ca50-4176-42f0-a43b-a1e5f81d21e3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:41.394873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b115ca50-4176-42f0-a43b-a1e5f81d21e3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:41.395341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b115ca50-4176-42f0-a43b-a1e5f81d21e3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:41.396023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b115ca50-4176-42f0-a43b-a1e5f81d21e3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:41.396465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b115ca50-4176-42f0-a43b-a1e5f81d21e3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:41.396881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b115ca50-4176-42f0-a43b-a1e5f81d21e3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:41.532096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b115ca50-4176-42f0-a43b-a1e5f81d21e3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:41.539662 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b115ca50-4176-42f0-a43b-a1e5f81d21e3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.164685 Aug 09 14:34:41.540232 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 540/1111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:41 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:41.626115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a3a07261-617d-4c61-bb57-752504e4df19 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd800d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:41.673291 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a3a07261-617d-4c61-bb57-752504e4df19 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.051009 Aug 09 14:34:41.673901 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 572/1112] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:41 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:41.714683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3322cd09-02ff-4919-b578-56b9840ea376 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:41.715261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3322cd09-02ff-4919-b578-56b9840ea376 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:41.721662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3322cd09-02ff-4919-b578-56b9840ea376 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:41.722166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3322cd09-02ff-4919-b578-56b9840ea376 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:41.722591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3322cd09-02ff-4919-b578-56b9840ea376 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:41.723307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3322cd09-02ff-4919-b578-56b9840ea376 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:41.723749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3322cd09-02ff-4919-b578-56b9840ea376 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:41.724184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3322cd09-02ff-4919-b578-56b9840ea376 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:41.863534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3322cd09-02ff-4919-b578-56b9840ea376 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:41.871583 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3322cd09-02ff-4919-b578-56b9840ea376 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a" status: 200 len: 1318 microversion: 2.1 time: 0.160989 Aug 09 14:34:41.872193 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 541/1113] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:41 2022] GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:42.561603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fad0cd29-ce47-4985-9c32-f85e24961075 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:42.562336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fad0cd29-ce47-4985-9c32-f85e24961075 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:42.569843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad0cd29-ce47-4985-9c32-f85e24961075 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:42.570367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad0cd29-ce47-4985-9c32-f85e24961075 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:42.570800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad0cd29-ce47-4985-9c32-f85e24961075 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:42.571644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad0cd29-ce47-4985-9c32-f85e24961075 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:42.572062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad0cd29-ce47-4985-9c32-f85e24961075 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:42.572466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad0cd29-ce47-4985-9c32-f85e24961075 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:42.580399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a52a0812-45ff-4d10-8d93-b62f6db1b2a1 req-da489fb0-835c-4d27-9b39-ec3cfeabdf43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261b33cd-d9c1-42bc-bb0e-3836fae12d34", "name": "network-vif-unplugged", "status": "completed", "tag": "deab8750-c5ac-4d07-a63f-ee59f7fa7a73"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:42.596127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a52a0812-45ff-4d10-8d93-b62f6db1b2a1 req-da489fb0-835c-4d27-9b39-ec3cfeabdf43 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:42.596884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a52a0812-45ff-4d10-8d93-b62f6db1b2a1 req-da489fb0-835c-4d27-9b39-ec3cfeabdf43 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:42.597406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a52a0812-45ff-4d10-8d93-b62f6db1b2a1 req-da489fb0-835c-4d27-9b39-ec3cfeabdf43 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:42.623729 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a52a0812-45ff-4d10-8d93-b62f6db1b2a1 req-da489fb0-835c-4d27-9b39-ec3cfeabdf43 service nova] Creating event network-vif-unplugged:deab8750-c5ac-4d07-a63f-ee59f7fa7a73 for instance 261b33cd-d9c1-42bc-bb0e-3836fae12d34 on n-h1-844626-8 Aug 09 14:34:42.629610 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a52a0812-45ff-4d10-8d93-b62f6db1b2a1 req-da489fb0-835c-4d27-9b39-ec3cfeabdf43 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054016 Aug 09 14:34:42.630327 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 542/1114] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:42.688964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3aef71f9-6d97-4520-a49a-21fdaf6c38f6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd86d940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:42.713547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fad0cd29-ce47-4985-9c32-f85e24961075 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:42.721480 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fad0cd29-ce47-4985-9c32-f85e24961075 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.163937 Aug 09 14:34:42.722046 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 573/1115] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:42 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:42.746820 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3aef71f9-6d97-4520-a49a-21fdaf6c38f6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.062051 Aug 09 14:34:42.747451 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 543/1116] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:42 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:42.895327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b5e97c32-f089-4245-b792-dc01560c4921 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:42.895965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b5e97c32-f089-4245-b792-dc01560c4921 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:42.902344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5e97c32-f089-4245-b792-dc01560c4921 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:42.903152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5e97c32-f089-4245-b792-dc01560c4921 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:42.903919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5e97c32-f089-4245-b792-dc01560c4921 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:42.905181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5e97c32-f089-4245-b792-dc01560c4921 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:42.905922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5e97c32-f089-4245-b792-dc01560c4921 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:42.906498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5e97c32-f089-4245-b792-dc01560c4921 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:43.095509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b5e97c32-f089-4245-b792-dc01560c4921 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:43.103967 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b5e97c32-f089-4245-b792-dc01560c4921 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a" status: 200 len: 1318 microversion: 2.1 time: 0.215114 Aug 09 14:34:43.117056 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 574/1117] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:42 2022] GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:43.743141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9507e3f3-4b0c-48b3-8152-8e46c82f9210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:43.744489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9507e3f3-4b0c-48b3-8152-8e46c82f9210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:43.747817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:43.752651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9507e3f3-4b0c-48b3-8152-8e46c82f9210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:43.753360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9507e3f3-4b0c-48b3-8152-8e46c82f9210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:43.753789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9507e3f3-4b0c-48b3-8152-8e46c82f9210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:43.754488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9507e3f3-4b0c-48b3-8152-8e46c82f9210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:43.755009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9507e3f3-4b0c-48b3-8152-8e46c82f9210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:43.755457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9507e3f3-4b0c-48b3-8152-8e46c82f9210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:43.762745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e2b72a3d-fca3-44d2-b261-4b1acfc38f80 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddeb5a60>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:43.774266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:43.824158 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e2b72a3d-fca3-44d2-b261-4b1acfc38f80 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.066299 Aug 09 14:34:43.825255 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 575/1118] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:43 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:43.901975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9507e3f3-4b0c-48b3-8152-8e46c82f9210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:43.909925 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9507e3f3-4b0c-48b3-8152-8e46c82f9210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.171860 Aug 09 14:34:43.910490 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 544/1119] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:43 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:44.087982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1abcf1da-197d-4cf9-aeb5-3c595b6c688f tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:44.088589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1abcf1da-197d-4cf9-aeb5-3c595b6c688f tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:44.095647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1abcf1da-197d-4cf9-aeb5-3c595b6c688f tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:44.096133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1abcf1da-197d-4cf9-aeb5-3c595b6c688f tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:44.096580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1abcf1da-197d-4cf9-aeb5-3c595b6c688f tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:44.097268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1abcf1da-197d-4cf9-aeb5-3c595b6c688f tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:44.097726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1abcf1da-197d-4cf9-aeb5-3c595b6c688f tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:44.098148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1abcf1da-197d-4cf9-aeb5-3c595b6c688f tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:44.124605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b96a4b59-fce8-45cc-8502-620129faa973 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:44.125820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b96a4b59-fce8-45cc-8502-620129faa973 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:44.132071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b96a4b59-fce8-45cc-8502-620129faa973 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:44.132561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b96a4b59-fce8-45cc-8502-620129faa973 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:44.132991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b96a4b59-fce8-45cc-8502-620129faa973 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:44.140964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b96a4b59-fce8-45cc-8502-620129faa973 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:44.141628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b96a4b59-fce8-45cc-8502-620129faa973 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:44.142239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b96a4b59-fce8-45cc-8502-620129faa973 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:44.313805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-1abcf1da-197d-4cf9-aeb5-3c595b6c688f tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid acd6f697-9f2e-4825-998a-796902617f44 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:34:44.335017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b96a4b59-fce8-45cc-8502-620129faa973 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:44.335540 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1abcf1da-197d-4cf9-aeb5-3c595b6c688f tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 2423 microversion: 2.25 time: 0.251173 Aug 09 14:34:44.342904 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b96a4b59-fce8-45cc-8502-620129faa973 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a" status: 200 len: 1318 microversion: 2.1 time: 0.222134 Aug 09 14:34:44.355111 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 545/1120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:44 2022] GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:44.355314 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 576/1121] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:44 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 2423 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:34:44.359855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5633a00-bafe-4c0e-9f48-d25de1bf87af tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844626-8", "block_migration": "auto"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:44.363048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c5633a00-bafe-4c0e-9f48-d25de1bf87af tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:44.369541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5633a00-bafe-4c0e-9f48-d25de1bf87af tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:44.370030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5633a00-bafe-4c0e-9f48-d25de1bf87af tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:44.370461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5633a00-bafe-4c0e-9f48-d25de1bf87af tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:44.371204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5633a00-bafe-4c0e-9f48-d25de1bf87af tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:44.372420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5633a00-bafe-4c0e-9f48-d25de1bf87af tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:44.372589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5633a00-bafe-4c0e-9f48-d25de1bf87af tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:44.403566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-c5633a00-bafe-4c0e-9f48-d25de1bf87af tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'flavor' on Instance uuid acd6f697-9f2e-4825-998a-796902617f44 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:34:44.418260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c5633a00-bafe-4c0e-9f48-d25de1bf87af tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: acd6f697-9f2e-4825-998a-796902617f44] Going to try to live migrate instance to n-h2-844626-8 {{(pid=119407) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 14:34:44.651683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5da97fd1-7f56-4ebb-9552-b634052c1cdc req-15758cc2-405a-42dc-bd5f-c9e329167e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba6d964-167a-4b1e-94f0-fb74f63c03f1", "name": "network-vif-plugged", "status": "completed", "tag": "e4f9d82e-39ab-4f23-91b4-e30a41b072c4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:44.666847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5da97fd1-7f56-4ebb-9552-b634052c1cdc req-15758cc2-405a-42dc-bd5f-c9e329167e11 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:44.667357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5da97fd1-7f56-4ebb-9552-b634052c1cdc req-15758cc2-405a-42dc-bd5f-c9e329167e11 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:44.667807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5da97fd1-7f56-4ebb-9552-b634052c1cdc req-15758cc2-405a-42dc-bd5f-c9e329167e11 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:44.682419 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5da97fd1-7f56-4ebb-9552-b634052c1cdc req-15758cc2-405a-42dc-bd5f-c9e329167e11 service nova] Creating event network-vif-plugged:e4f9d82e-39ab-4f23-91b4-e30a41b072c4 for instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 on n-h2-844626-8 Aug 09 14:34:44.687775 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5da97fd1-7f56-4ebb-9552-b634052c1cdc req-15758cc2-405a-42dc-bd5f-c9e329167e11 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039692 Aug 09 14:34:44.688870 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 577/1122] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:44.839849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1272b609-0ed5-4671-9d8d-9a42a5382153 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd4d9d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:44.914718 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1272b609-0ed5-4671-9d8d-9a42a5382153 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.076837 Aug 09 14:34:44.916282 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 578/1123] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:44 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:44.936961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-abd54dd2-cb29-4052-b321-ea094201992e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:44.939730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-abd54dd2-cb29-4052-b321-ea094201992e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:44.959988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-abd54dd2-cb29-4052-b321-ea094201992e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:44.961983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-abd54dd2-cb29-4052-b321-ea094201992e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:44.963146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-abd54dd2-cb29-4052-b321-ea094201992e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:44.964280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-abd54dd2-cb29-4052-b321-ea094201992e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:44.965036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-abd54dd2-cb29-4052-b321-ea094201992e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:44.965683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-abd54dd2-cb29-4052-b321-ea094201992e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:45.152125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-abd54dd2-cb29-4052-b321-ea094201992e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:45.161694 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-abd54dd2-cb29-4052-b321-ea094201992e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.234271 Aug 09 14:34:45.162426 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 579/1124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:44 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:45.366013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81d178f1-80dd-4071-ad11-36c45423f80d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:45.366918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81d178f1-80dd-4071-ad11-36c45423f80d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:45.374309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81d178f1-80dd-4071-ad11-36c45423f80d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:45.375312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81d178f1-80dd-4071-ad11-36c45423f80d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:45.375542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81d178f1-80dd-4071-ad11-36c45423f80d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:45.376472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81d178f1-80dd-4071-ad11-36c45423f80d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:45.377054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81d178f1-80dd-4071-ad11-36c45423f80d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:45.377668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81d178f1-80dd-4071-ad11-36c45423f80d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:45.662107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-81d178f1-80dd-4071-ad11-36c45423f80d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:45.687073 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81d178f1-80dd-4071-ad11-36c45423f80d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a" status: 200 len: 1466 microversion: 2.1 time: 0.316525 Aug 09 14:34:45.699766 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 580/1125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:45 2022] GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a => generated 1466 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:45.710085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:45.733245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:45.733245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Searching by: {'reservation_id': 'r-l6edxooc', 'deleted': False, 'project_id': '9471973b988a4c31be31dde4cef1489e'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:34:45.747005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:45.753632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:45.754244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:45.755057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:45.755583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:45.756005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:46.088962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:34:46.092168 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c5633a00-bafe-4c0e-9f48-d25de1bf87af tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/action" status: 202 len: 0 microversion: 2.25 time: 1.734997 Aug 09 14:34:46.094261 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 546/1126] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:34:44 2022] POST /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/action => generated 0 bytes in 1739 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:34:46.099515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2679c241-1192-4d26-aa9f-ad53c94be800 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd86ddc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:46.151709 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2679c241-1192-4d26-aa9f-ad53c94be800 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.055961 Aug 09 14:34:46.152531 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 547/1127] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:46 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:46.168474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bcb4fc1f-faf2-4672-a991-5980167c9deb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:46.169087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bcb4fc1f-faf2-4672-a991-5980167c9deb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:46.176463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb4fc1f-faf2-4672-a991-5980167c9deb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:46.177197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb4fc1f-faf2-4672-a991-5980167c9deb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:46.177807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb4fc1f-faf2-4672-a991-5980167c9deb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:46.178760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb4fc1f-faf2-4672-a991-5980167c9deb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:46.179416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb4fc1f-faf2-4672-a991-5980167c9deb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:46.179984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb4fc1f-faf2-4672-a991-5980167c9deb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:46.184718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:46.193335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:46.193966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:46.194571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:46.419037 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9ab2b66-af1f-4d46-a429-5c171ec87251 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/detail?reservation_id=r-l6edxooc" status: 200 len: 2927 microversion: 2.1 time: 0.712884 Aug 09 14:34:46.419802 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 581/1128] 10.222.0.50 () {58 vars in 1197 bytes} [Tue Aug 9 14:34:45 2022] GET /compute/v2.1/servers/detail?reservation_id=r-l6edxooc => generated 2927 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:46.425007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ca458dd-00a9-4f58-9512-da55eb2b3a8f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:46.426266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ca458dd-00a9-4f58-9512-da55eb2b3a8f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:46.440878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ca458dd-00a9-4f58-9512-da55eb2b3a8f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:46.447603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bcb4fc1f-faf2-4672-a991-5980167c9deb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:46.453572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ca458dd-00a9-4f58-9512-da55eb2b3a8f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:46.458713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bcb4fc1f-faf2-4672-a991-5980167c9deb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:46.459471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ca458dd-00a9-4f58-9512-da55eb2b3a8f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:46.463781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ca458dd-00a9-4f58-9512-da55eb2b3a8f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:46.463781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ca458dd-00a9-4f58-9512-da55eb2b3a8f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:46.463781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ca458dd-00a9-4f58-9512-da55eb2b3a8f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:46.466603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bcb4fc1f-faf2-4672-a991-5980167c9deb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:46.479600 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bcb4fc1f-faf2-4672-a991-5980167c9deb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.305691 Aug 09 14:34:46.480743 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 548/1129] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:46 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:34:46.485637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3aaa2258-ddbb-4f24-9e38-c18417ada686 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:46.519046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.compute.server_groups [None req-3aaa2258-ddbb-4f24-9e38-c18417ada686 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Querying cell ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) for 2 instances {{(pid=119407) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 09 14:34:46.520221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3aaa2258-ddbb-4f24-9e38-c18417ada686 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:46.520866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3aaa2258-ddbb-4f24-9e38-c18417ada686 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:46.521458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3aaa2258-ddbb-4f24-9e38-c18417ada686 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:46.545366 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3aaa2258-ddbb-4f24-9e38-c18417ada686 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/7bdfa22d-fcd8-4cd6-8024-fd7f4ce5dd54" status: 200 len: 271 microversion: 2.1 time: 0.062656 Aug 09 14:34:46.552611 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 549/1130] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:34:46 2022] GET /compute/v2.1/os-server-groups/7bdfa22d-fcd8-4cd6-8024-fd7f4ce5dd54 => generated 271 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:46.558476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-59ab4da4-62e7-4c27-bc55-6a2b0fda1325 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:46.559415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-59ab4da4-62e7-4c27-bc55-6a2b0fda1325 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:46.569164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59ab4da4-62e7-4c27-bc55-6a2b0fda1325 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:46.569907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59ab4da4-62e7-4c27-bc55-6a2b0fda1325 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:46.570568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59ab4da4-62e7-4c27-bc55-6a2b0fda1325 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:46.571574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59ab4da4-62e7-4c27-bc55-6a2b0fda1325 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:46.572230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59ab4da4-62e7-4c27-bc55-6a2b0fda1325 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:46.572869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59ab4da4-62e7-4c27-bc55-6a2b0fda1325 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:46.682994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ca458dd-00a9-4f58-9512-da55eb2b3a8f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:46.698145 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ca458dd-00a9-4f58-9512-da55eb2b3a8f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.275436 Aug 09 14:34:46.713565 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 582/1131] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:46 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:46.762312 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-59ab4da4-62e7-4c27-bc55-6a2b0fda1325 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 200 len: 1619 microversion: 2.1 time: 0.208171 Aug 09 14:34:46.763636 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 550/1132] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:46 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 1619 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:46.790250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fc4cef5-6fe9-4f20-8f55-f04f565628a9 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:46.791284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3fc4cef5-6fe9-4f20-8f55-f04f565628a9 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:46.805346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fc4cef5-6fe9-4f20-8f55-f04f565628a9 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:46.807000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fc4cef5-6fe9-4f20-8f55-f04f565628a9 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:46.811938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fc4cef5-6fe9-4f20-8f55-f04f565628a9 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:46.812995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fc4cef5-6fe9-4f20-8f55-f04f565628a9 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:46.814112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fc4cef5-6fe9-4f20-8f55-f04f565628a9 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:46.814574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fc4cef5-6fe9-4f20-8f55-f04f565628a9 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:46.961598 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fc4cef5-6fe9-4f20-8f55-f04f565628a9 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a" status: 200 len: 1617 microversion: 2.1 time: 0.175771 Aug 09 14:34:46.962423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 583/1133] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:46 2022] GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a => generated 1617 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:47.051151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-401485666", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "5c29a36e-08bc-48f8-ae8c-029a5dbf060f"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:47.114766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:34:47.167829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04a5a29d-1dc8-4cf9-9a8f-2c31face06cf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd80c10>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:47.219552 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-04a5a29d-1dc8-4cf9-9a8f-2c31face06cf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.056438 Aug 09 14:34:47.220853 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 584/1134] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:47 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:47.367303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:34:47.368258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:34:47.368740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:34:47.369346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:34:47.369697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:34:47.381659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:47.382142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:47.382800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:47.383602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:47.384362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:47.385237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:47.403525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:34:47.409573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:34:47.423492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:34:47.426350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:34:47.475457 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0835030c-7c09-4ba7-850d-dbf797643757 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.428603 Aug 09 14:34:47.476696 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 551/1135] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:34:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:34:47.488088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3145b730-77b6-44c1-94c1-ba5ad9e97ba1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:47.488992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3145b730-77b6-44c1-94c1-ba5ad9e97ba1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:47.506742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc2436c3-de12-4355-9625-cf983abf94f8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:47.507442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fc2436c3-de12-4355-9625-cf983abf94f8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:47.545704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2436c3-de12-4355-9625-cf983abf94f8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:47.546464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2436c3-de12-4355-9625-cf983abf94f8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:47.547209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2436c3-de12-4355-9625-cf983abf94f8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:47.548102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2436c3-de12-4355-9625-cf983abf94f8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:47.550033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2436c3-de12-4355-9625-cf983abf94f8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:47.550951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2436c3-de12-4355-9625-cf983abf94f8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:47.559005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3145b730-77b6-44c1-94c1-ba5ad9e97ba1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:47.572383 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3145b730-77b6-44c1-94c1-ba5ad9e97ba1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1216 microversion: 2.1 time: 0.088834 Aug 09 14:34:47.580073 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 585/1136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:47 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1216 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:47.725505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a1a3b3e-62aa-48ea-8ec9-4f364793beee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:47.726506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a1a3b3e-62aa-48ea-8ec9-4f364793beee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:47.736553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a1a3b3e-62aa-48ea-8ec9-4f364793beee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:47.739754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a1a3b3e-62aa-48ea-8ec9-4f364793beee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:47.741296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a1a3b3e-62aa-48ea-8ec9-4f364793beee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:47.742430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a1a3b3e-62aa-48ea-8ec9-4f364793beee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:47.744211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a1a3b3e-62aa-48ea-8ec9-4f364793beee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:47.748301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a1a3b3e-62aa-48ea-8ec9-4f364793beee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:47.751403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc2436c3-de12-4355-9625-cf983abf94f8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:47.784681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc2436c3-de12-4355-9625-cf983abf94f8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:47.796172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc2436c3-de12-4355-9625-cf983abf94f8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:47.799254 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc2436c3-de12-4355-9625-cf983abf94f8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.296700 Aug 09 14:34:47.800206 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 552/1137] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:47 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:34:47.980152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a1a3b3e-62aa-48ea-8ec9-4f364793beee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:47.998400 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a1a3b3e-62aa-48ea-8ec9-4f364793beee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.270696 Aug 09 14:34:48.007384 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 586/1138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:47 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:48.233882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0b158d8-2ec3-441d-ba62-5756902cd8ad tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd816940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:48.306541 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0b158d8-2ec3-441d-ba62-5756902cd8ad tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.076370 Aug 09 14:34:48.317638 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 553/1139] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:48 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:48.596397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-10d6121d-795f-4b0e-83c2-f0f3a4788c18 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:48.596916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-10d6121d-795f-4b0e-83c2-f0f3a4788c18 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:48.607894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10d6121d-795f-4b0e-83c2-f0f3a4788c18 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:48.608643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10d6121d-795f-4b0e-83c2-f0f3a4788c18 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:48.609467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10d6121d-795f-4b0e-83c2-f0f3a4788c18 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:48.611617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10d6121d-795f-4b0e-83c2-f0f3a4788c18 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:48.612699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10d6121d-795f-4b0e-83c2-f0f3a4788c18 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:48.613374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10d6121d-795f-4b0e-83c2-f0f3a4788c18 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:48.698782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-10d6121d-795f-4b0e-83c2-f0f3a4788c18 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:48.711584 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-10d6121d-795f-4b0e-83c2-f0f3a4788c18 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1268 microversion: 2.1 time: 0.119128 Aug 09 14:34:48.723850 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 587/1140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:48 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1268 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:48.826675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eafd9d61-fd08-4245-8c01-24cd1439c5b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:48.827736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eafd9d61-fd08-4245-8c01-24cd1439c5b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:48.839485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eafd9d61-fd08-4245-8c01-24cd1439c5b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:48.843525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eafd9d61-fd08-4245-8c01-24cd1439c5b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:48.844187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eafd9d61-fd08-4245-8c01-24cd1439c5b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:48.845037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eafd9d61-fd08-4245-8c01-24cd1439c5b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:48.845538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eafd9d61-fd08-4245-8c01-24cd1439c5b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:48.846139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eafd9d61-fd08-4245-8c01-24cd1439c5b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:49.053660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a94e01c9-52d3-4079-8b9e-e817537dfffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:49.054830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a94e01c9-52d3-4079-8b9e-e817537dfffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:49.087944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eafd9d61-fd08-4245-8c01-24cd1439c5b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:49.093382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a94e01c9-52d3-4079-8b9e-e817537dfffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:49.099178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eafd9d61-fd08-4245-8c01-24cd1439c5b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:49.101408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eafd9d61-fd08-4245-8c01-24cd1439c5b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:49.102778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a94e01c9-52d3-4079-8b9e-e817537dfffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:49.103273 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eafd9d61-fd08-4245-8c01-24cd1439c5b7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.280938 Aug 09 14:34:49.105964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a94e01c9-52d3-4079-8b9e-e817537dfffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:49.107110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a94e01c9-52d3-4079-8b9e-e817537dfffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:49.110357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a94e01c9-52d3-4079-8b9e-e817537dfffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:49.117350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a94e01c9-52d3-4079-8b9e-e817537dfffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:49.120133 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 554/1141] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:48 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:34:49.324606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a5e13c70-a867-48f3-bd61-b1b3d342daf3 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd7baa60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:49.391585 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a5e13c70-a867-48f3-bd61-b1b3d342daf3 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.073514 Aug 09 14:34:49.401904 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 555/1142] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:49 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:49.415107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a94e01c9-52d3-4079-8b9e-e817537dfffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:49.424990 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a94e01c9-52d3-4079-8b9e-e817537dfffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.376051 Aug 09 14:34:49.435020 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 588/1143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:49 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:49.734000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f96127ec-e9ed-44bc-a875-d845145c8e90 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:49.734705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f96127ec-e9ed-44bc-a875-d845145c8e90 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:49.744032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f96127ec-e9ed-44bc-a875-d845145c8e90 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:49.746690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f96127ec-e9ed-44bc-a875-d845145c8e90 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:49.747169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f96127ec-e9ed-44bc-a875-d845145c8e90 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:49.747898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f96127ec-e9ed-44bc-a875-d845145c8e90 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:49.748355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f96127ec-e9ed-44bc-a875-d845145c8e90 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:49.750959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f96127ec-e9ed-44bc-a875-d845145c8e90 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:49.878920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f96127ec-e9ed-44bc-a875-d845145c8e90 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:49.889320 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f96127ec-e9ed-44bc-a875-d845145c8e90 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1274 microversion: 2.1 time: 0.159304 Aug 09 14:34:49.890279 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 556/1144] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:49 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:50.127814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-925f4ab5-6fb8-4128-9997-e68f30842e76 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:50.128548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-925f4ab5-6fb8-4128-9997-e68f30842e76 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:50.150624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-925f4ab5-6fb8-4128-9997-e68f30842e76 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:50.151334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-925f4ab5-6fb8-4128-9997-e68f30842e76 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:50.154321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-925f4ab5-6fb8-4128-9997-e68f30842e76 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:50.155139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-925f4ab5-6fb8-4128-9997-e68f30842e76 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:50.161159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-925f4ab5-6fb8-4128-9997-e68f30842e76 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:50.164308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-925f4ab5-6fb8-4128-9997-e68f30842e76 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:50.408253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81975ebf-3090-41ea-80ef-86bbc1cb2ffe tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd8163a0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:50.509556 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81975ebf-3090-41ea-80ef-86bbc1cb2ffe tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.105193 Aug 09 14:34:50.510188 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 557/1145] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:50 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:50.524811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-789f2406-1772-4b2e-9943-63370afbf7bd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:50.540765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-789f2406-1772-4b2e-9943-63370afbf7bd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:50.578930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-789f2406-1772-4b2e-9943-63370afbf7bd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:50.579448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-789f2406-1772-4b2e-9943-63370afbf7bd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:50.579951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-789f2406-1772-4b2e-9943-63370afbf7bd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:50.580659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-789f2406-1772-4b2e-9943-63370afbf7bd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:50.581097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-789f2406-1772-4b2e-9943-63370afbf7bd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:50.587882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-925f4ab5-6fb8-4128-9997-e68f30842e76 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:50.593134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-789f2406-1772-4b2e-9943-63370afbf7bd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:50.606962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-925f4ab5-6fb8-4128-9997-e68f30842e76 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:50.610140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-925f4ab5-6fb8-4128-9997-e68f30842e76 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:50.613980 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-925f4ab5-6fb8-4128-9997-e68f30842e76 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.491566 Aug 09 14:34:50.616708 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 589/1146] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:50 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:34:50.897435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-789f2406-1772-4b2e-9943-63370afbf7bd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:50.908638 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-789f2406-1772-4b2e-9943-63370afbf7bd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.387650 Aug 09 14:34:50.910627 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 558/1147] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:50 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:50.917240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-634a1b07-b0ae-4f82-8165-abc85f1eb8d5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:50.918236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-634a1b07-b0ae-4f82-8165-abc85f1eb8d5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:50.935224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-634a1b07-b0ae-4f82-8165-abc85f1eb8d5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:50.935667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-634a1b07-b0ae-4f82-8165-abc85f1eb8d5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:50.936135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-634a1b07-b0ae-4f82-8165-abc85f1eb8d5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:50.936895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-634a1b07-b0ae-4f82-8165-abc85f1eb8d5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:50.947993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-634a1b07-b0ae-4f82-8165-abc85f1eb8d5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:50.949168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-634a1b07-b0ae-4f82-8165-abc85f1eb8d5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:51.205025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-634a1b07-b0ae-4f82-8165-abc85f1eb8d5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:51.219569 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-634a1b07-b0ae-4f82-8165-abc85f1eb8d5 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1316 microversion: 2.1 time: 0.313413 Aug 09 14:34:51.220819 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 590/1148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:50 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1316 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:51.528290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16a0d69c-31ec-4898-90d7-67cd6057e85c tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd847c10>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:51.595797 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16a0d69c-31ec-4898-90d7-67cd6057e85c tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.073442 Aug 09 14:34:51.602663 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 559/1149] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:51 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:51.637472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91f23bdd-52e8-45b2-b6c7-fa2a6e78f3fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:51.638071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91f23bdd-52e8-45b2-b6c7-fa2a6e78f3fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:51.650826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91f23bdd-52e8-45b2-b6c7-fa2a6e78f3fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:51.651358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91f23bdd-52e8-45b2-b6c7-fa2a6e78f3fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:51.651791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91f23bdd-52e8-45b2-b6c7-fa2a6e78f3fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:51.652497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91f23bdd-52e8-45b2-b6c7-fa2a6e78f3fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:51.652945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91f23bdd-52e8-45b2-b6c7-fa2a6e78f3fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:51.653365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91f23bdd-52e8-45b2-b6c7-fa2a6e78f3fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:51.686229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-47fed08f-d642-4835-8d74-48890ac38446 req-b2ed25d6-bf03-4443-87fc-137ac5affcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89965e92-ea8e-49a6-a4d8-3cea1d171b08", "tag": "95e19b52-da20-48ba-b1b2-3455496deab0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:51.701753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-47fed08f-d642-4835-8d74-48890ac38446 req-b2ed25d6-bf03-4443-87fc-137ac5affcb5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:51.702726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-47fed08f-d642-4835-8d74-48890ac38446 req-b2ed25d6-bf03-4443-87fc-137ac5affcb5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:51.703689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-47fed08f-d642-4835-8d74-48890ac38446 req-b2ed25d6-bf03-4443-87fc-137ac5affcb5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:51.723235 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-47fed08f-d642-4835-8d74-48890ac38446 req-b2ed25d6-bf03-4443-87fc-137ac5affcb5 service nova] Creating event network-changed:95e19b52-da20-48ba-b1b2-3455496deab0 for instance 89965e92-ea8e-49a6-a4d8-3cea1d171b08 on n-h2-844626-8 Aug 09 14:34:51.732792 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-47fed08f-d642-4835-8d74-48890ac38446 req-b2ed25d6-bf03-4443-87fc-137ac5affcb5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049678 Aug 09 14:34:51.732792 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 560/1150] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:34:51.879405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91f23bdd-52e8-45b2-b6c7-fa2a6e78f3fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:51.889666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91f23bdd-52e8-45b2-b6c7-fa2a6e78f3fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:51.891263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91f23bdd-52e8-45b2-b6c7-fa2a6e78f3fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:51.892710 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91f23bdd-52e8-45b2-b6c7-fa2a6e78f3fc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.259132 Aug 09 14:34:51.907984 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 591/1151] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:51 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:34:51.933810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1eaf4c06-e754-4618-b1c4-86f7cc8e7813 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:51.934521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1eaf4c06-e754-4618-b1c4-86f7cc8e7813 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:51.941110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1eaf4c06-e754-4618-b1c4-86f7cc8e7813 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:51.941911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1eaf4c06-e754-4618-b1c4-86f7cc8e7813 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:51.942508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1eaf4c06-e754-4618-b1c4-86f7cc8e7813 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:51.943248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1eaf4c06-e754-4618-b1c4-86f7cc8e7813 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:51.943690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1eaf4c06-e754-4618-b1c4-86f7cc8e7813 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:51.944276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1eaf4c06-e754-4618-b1c4-86f7cc8e7813 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:52.138626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1eaf4c06-e754-4618-b1c4-86f7cc8e7813 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:52.149019 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1eaf4c06-e754-4618-b1c4-86f7cc8e7813 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.222638 Aug 09 14:34:52.152237 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 561/1152] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:51 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:52.241855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c3c8ca5-0f65-4346-9c02-1cb3ce2f253f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:52.243106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2c3c8ca5-0f65-4346-9c02-1cb3ce2f253f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:52.250276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c3c8ca5-0f65-4346-9c02-1cb3ce2f253f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:52.250751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c3c8ca5-0f65-4346-9c02-1cb3ce2f253f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:52.251403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c3c8ca5-0f65-4346-9c02-1cb3ce2f253f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:52.252326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c3c8ca5-0f65-4346-9c02-1cb3ce2f253f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:52.252927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c3c8ca5-0f65-4346-9c02-1cb3ce2f253f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:52.253493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c3c8ca5-0f65-4346-9c02-1cb3ce2f253f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:52.258592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:52.406050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2c3c8ca5-0f65-4346-9c02-1cb3ce2f253f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:52.421521 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2c3c8ca5-0f65-4346-9c02-1cb3ce2f253f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1316 microversion: 2.1 time: 0.184210 Aug 09 14:34:52.422115 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 592/1153] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:52 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:52.615895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5fb6fd2-6caa-48b3-b4c2-1408b1b30eb1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd812280>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:52.679366 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5fb6fd2-6caa-48b3-b4c2-1408b1b30eb1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.067317 Aug 09 14:34:52.680937 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 562/1154] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:52 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:52.899223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dd306a83-271b-4ec7-a78c-e570ec44ccc7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:52.899788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dd306a83-271b-4ec7-a78c-e570ec44ccc7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:52.906680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd306a83-271b-4ec7-a78c-e570ec44ccc7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:52.907277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd306a83-271b-4ec7-a78c-e570ec44ccc7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:52.907857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd306a83-271b-4ec7-a78c-e570ec44ccc7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:52.908654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd306a83-271b-4ec7-a78c-e570ec44ccc7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:52.909204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd306a83-271b-4ec7-a78c-e570ec44ccc7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:52.909711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd306a83-271b-4ec7-a78c-e570ec44ccc7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:52.916597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fdf54fcb-e6f4-41ad-9309-7f8b0077dea6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:52.917452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fdf54fcb-e6f4-41ad-9309-7f8b0077dea6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:52.930764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdf54fcb-e6f4-41ad-9309-7f8b0077dea6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:52.931277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdf54fcb-e6f4-41ad-9309-7f8b0077dea6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:52.931711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdf54fcb-e6f4-41ad-9309-7f8b0077dea6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:52.932420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdf54fcb-e6f4-41ad-9309-7f8b0077dea6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:52.932869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdf54fcb-e6f4-41ad-9309-7f8b0077dea6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:52.933289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fdf54fcb-e6f4-41ad-9309-7f8b0077dea6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:52.938918 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dd306a83-271b-4ec7-a78c-e570ec44ccc7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/ips" status: 200 len: 150 microversion: 2.1 time: 0.043946 Aug 09 14:34:52.940179 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 593/1155] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:34:52 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:53.115323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fdf54fcb-e6f4-41ad-9309-7f8b0077dea6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:53.126083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fdf54fcb-e6f4-41ad-9309-7f8b0077dea6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:53.127678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fdf54fcb-e6f4-41ad-9309-7f8b0077dea6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:53.128877 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fdf54fcb-e6f4-41ad-9309-7f8b0077dea6 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.216227 Aug 09 14:34:53.141910 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 563/1156] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:52 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:34:53.171740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67283cf1-d1b8-4fed-81f0-78dc0b85eda7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:53.172415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-67283cf1-d1b8-4fed-81f0-78dc0b85eda7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:53.182398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67283cf1-d1b8-4fed-81f0-78dc0b85eda7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:53.183012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67283cf1-d1b8-4fed-81f0-78dc0b85eda7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:53.183554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67283cf1-d1b8-4fed-81f0-78dc0b85eda7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:53.184339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67283cf1-d1b8-4fed-81f0-78dc0b85eda7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:53.184881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67283cf1-d1b8-4fed-81f0-78dc0b85eda7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:53.185391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67283cf1-d1b8-4fed-81f0-78dc0b85eda7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:53.366224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-67283cf1-d1b8-4fed-81f0-78dc0b85eda7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:53.377808 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-67283cf1-d1b8-4fed-81f0-78dc0b85eda7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.209429 Aug 09 14:34:53.392586 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 594/1157] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:53 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:53.442459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-46047ecc-9578-4f45-b0b5-d7042a583597 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:53.443064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-46047ecc-9578-4f45-b0b5-d7042a583597 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:53.452472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46047ecc-9578-4f45-b0b5-d7042a583597 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:53.452693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46047ecc-9578-4f45-b0b5-d7042a583597 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:53.452938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46047ecc-9578-4f45-b0b5-d7042a583597 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:53.453708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46047ecc-9578-4f45-b0b5-d7042a583597 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:53.454275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46047ecc-9578-4f45-b0b5-d7042a583597 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:53.454582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46047ecc-9578-4f45-b0b5-d7042a583597 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:53.628519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-46047ecc-9578-4f45-b0b5-d7042a583597 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:53.637463 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-46047ecc-9578-4f45-b0b5-d7042a583597 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1316 microversion: 2.1 time: 0.199302 Aug 09 14:34:53.653854 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 564/1158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:53 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:53.694594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2472bec4-86a3-44d7-b2fb-d626db86331e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf109d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:53.744274 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2472bec4-86a3-44d7-b2fb-d626db86331e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.053608 Aug 09 14:34:53.754372 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 595/1159] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:53 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:54.227722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93882459-b36e-40bc-bc57-9e29440260cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:54.229138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93882459-b36e-40bc-bc57-9e29440260cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:54.236234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93882459-b36e-40bc-bc57-9e29440260cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:54.247048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93882459-b36e-40bc-bc57-9e29440260cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:54.249163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93882459-b36e-40bc-bc57-9e29440260cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:54.250146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93882459-b36e-40bc-bc57-9e29440260cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:54.253063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93882459-b36e-40bc-bc57-9e29440260cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:54.254102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93882459-b36e-40bc-bc57-9e29440260cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:54.402006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2df8f90d-9816-428d-b0d9-cdba4b13f030 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:54.402623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2df8f90d-9816-428d-b0d9-cdba4b13f030 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:54.412430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df8f90d-9816-428d-b0d9-cdba4b13f030 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:54.412920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df8f90d-9816-428d-b0d9-cdba4b13f030 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:54.416168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df8f90d-9816-428d-b0d9-cdba4b13f030 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:54.417248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df8f90d-9816-428d-b0d9-cdba4b13f030 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:54.417955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df8f90d-9816-428d-b0d9-cdba4b13f030 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:54.418395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df8f90d-9816-428d-b0d9-cdba4b13f030 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:54.427852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-93882459-b36e-40bc-bc57-9e29440260cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:54.443060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-93882459-b36e-40bc-bc57-9e29440260cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:54.444876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-93882459-b36e-40bc-bc57-9e29440260cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:54.446337 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93882459-b36e-40bc-bc57-9e29440260cf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.281489 Aug 09 14:34:54.447768 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 565/1160] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:54 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:34:54.630930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2df8f90d-9816-428d-b0d9-cdba4b13f030 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:54.655233 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2df8f90d-9816-428d-b0d9-cdba4b13f030 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.258589 Aug 09 14:34:54.665352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22ce7957-9aaf-4e55-88e8-d67eb7289719 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:54.666646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22ce7957-9aaf-4e55-88e8-d67eb7289719 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:54.675786 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 596/1161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:54 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:54.681920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ce7957-9aaf-4e55-88e8-d67eb7289719 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:54.682419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ce7957-9aaf-4e55-88e8-d67eb7289719 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:54.682852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ce7957-9aaf-4e55-88e8-d67eb7289719 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:54.683640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ce7957-9aaf-4e55-88e8-d67eb7289719 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:54.687648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ce7957-9aaf-4e55-88e8-d67eb7289719 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:54.691236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ce7957-9aaf-4e55-88e8-d67eb7289719 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:54.760611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32da159e-2923-43bb-834c-17d943d6668a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf10310>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:54.820737 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32da159e-2923-43bb-834c-17d943d6668a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1455 microversion: 2.1 time: 0.063762 Aug 09 14:34:54.829394 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 597/1162] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:54 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:54.910438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22ce7957-9aaf-4e55-88e8-d67eb7289719 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:54.913512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:54.921160 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22ce7957-9aaf-4e55-88e8-d67eb7289719 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1316 microversion: 2.1 time: 0.261719 Aug 09 14:34:54.922056 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 566/1163] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:54 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:55.472455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-945bb501-2989-44ab-848f-c1019d341717 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:55.473047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-945bb501-2989-44ab-848f-c1019d341717 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:55.479810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-945bb501-2989-44ab-848f-c1019d341717 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:55.480282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-945bb501-2989-44ab-848f-c1019d341717 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:55.480694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-945bb501-2989-44ab-848f-c1019d341717 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:55.481371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-945bb501-2989-44ab-848f-c1019d341717 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:55.481817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-945bb501-2989-44ab-848f-c1019d341717 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:55.482235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-945bb501-2989-44ab-848f-c1019d341717 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:55.617284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-945bb501-2989-44ab-848f-c1019d341717 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:55.625981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-945bb501-2989-44ab-848f-c1019d341717 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:55.627521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-945bb501-2989-44ab-848f-c1019d341717 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:55.628700 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-945bb501-2989-44ab-848f-c1019d341717 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.161790 Aug 09 14:34:55.629270 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 598/1164] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:55 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:34:55.678553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c796ab9f-9a82-459b-9c63-69d7f39a74a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:55.679308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c796ab9f-9a82-459b-9c63-69d7f39a74a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:55.687272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c796ab9f-9a82-459b-9c63-69d7f39a74a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:55.687753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c796ab9f-9a82-459b-9c63-69d7f39a74a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:55.688183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c796ab9f-9a82-459b-9c63-69d7f39a74a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:55.688874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c796ab9f-9a82-459b-9c63-69d7f39a74a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:55.689326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c796ab9f-9a82-459b-9c63-69d7f39a74a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:55.689746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c796ab9f-9a82-459b-9c63-69d7f39a74a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:55.838609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8272d05e-3692-42a7-be5b-802922fc74ee tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf778b0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:55.845295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:55.847462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c796ab9f-9a82-459b-9c63-69d7f39a74a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:55.856270 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c796ab9f-9a82-459b-9c63-69d7f39a74a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.181957 Aug 09 14:34:55.856935 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 567/1165] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:55 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:55.862011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75689fbc-30f3-4689-aece-99132dadacbc tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce83608f-0064-4037-b4b8-62ae9888919b"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:55.864640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75689fbc-30f3-4689-aece-99132dadacbc tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:55.871751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75689fbc-30f3-4689-aece-99132dadacbc tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:55.872339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75689fbc-30f3-4689-aece-99132dadacbc tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:55.872808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75689fbc-30f3-4689-aece-99132dadacbc tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:55.873641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75689fbc-30f3-4689-aece-99132dadacbc tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:55.874175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75689fbc-30f3-4689-aece-99132dadacbc tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:55.874635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75689fbc-30f3-4689-aece-99132dadacbc tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:55.889832 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8272d05e-3692-42a7-be5b-802922fc74ee tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1464 microversion: 2.1 time: 0.056587 Aug 09 14:34:55.890416 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 599/1166] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:55 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1464 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:55.903359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a51adf4b-bf63-4023-b8b1-0429b6b9b942 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf5b9d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:55.949139 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a51adf4b-bf63-4023-b8b1-0429b6b9b942 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 200 len: 1464 microversion: 2.1 time: 0.049451 Aug 09 14:34:55.949720 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 600/1167] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:55 2022] GET /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 1464 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:55.954334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-474ff09b-95ed-4e9c-af67-844291fb6b82 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:55.955003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-474ff09b-95ed-4e9c-af67-844291fb6b82 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:55.961596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-474ff09b-95ed-4e9c-af67-844291fb6b82 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:55.962113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-474ff09b-95ed-4e9c-af67-844291fb6b82 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:55.962546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-474ff09b-95ed-4e9c-af67-844291fb6b82 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:55.963500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-474ff09b-95ed-4e9c-af67-844291fb6b82 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:55.963949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-474ff09b-95ed-4e9c-af67-844291fb6b82 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:55.964375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-474ff09b-95ed-4e9c-af67-844291fb6b82 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:56.109967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-474ff09b-95ed-4e9c-af67-844291fb6b82 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:56.118497 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-474ff09b-95ed-4e9c-af67-844291fb6b82 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1316 microversion: 2.1 time: 0.167649 Aug 09 14:34:56.119263 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 601/1168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:55 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:56.123932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42d03388-cf79-4c12-b8ed-3b99a900efb6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:56.124896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42d03388-cf79-4c12-b8ed-3b99a900efb6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:56.131551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42d03388-cf79-4c12-b8ed-3b99a900efb6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:56.132245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42d03388-cf79-4c12-b8ed-3b99a900efb6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:56.132849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42d03388-cf79-4c12-b8ed-3b99a900efb6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:56.133544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42d03388-cf79-4c12-b8ed-3b99a900efb6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:56.133992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42d03388-cf79-4c12-b8ed-3b99a900efb6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:56.134415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42d03388-cf79-4c12-b8ed-3b99a900efb6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:56.183683 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75689fbc-30f3-4689-aece-99132dadacbc tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325357 Aug 09 14:34:56.184453 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 568/1169] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 14:34:55 2022] POST /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:56.292693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42d03388-cf79-4c12-b8ed-3b99a900efb6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:56.301202 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42d03388-cf79-4c12-b8ed-3b99a900efb6 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1" status: 200 len: 1468 microversion: 2.1 time: 0.180742 Aug 09 14:34:56.302372 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 602/1170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:56 2022] GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1 => generated 1468 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:56.322992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-335a6f78-a2c7-4d36-baeb-6253b02d70f7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd8fd30>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:56.426658 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-335a6f78-a2c7-4d36-baeb-6253b02d70f7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images?changes-since=2022-08-09T14%3A33%3A20Z" status: 200 len: 1902 microversion: 2.1 time: 0.108097 Aug 09 14:34:56.427583 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 569/1171] 10.222.0.50 () {58 vars in 1199 bytes} [Tue Aug 9 14:34:56 2022] GET /compute/v2.1/images?changes-since=2022-08-09T14%3A33%3A20Z => generated 1902 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:56.441607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d8857d1-837a-4237-8edb-d74be8ed098e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf5b040>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:56.515595 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d8857d1-837a-4237-8edb-d74be8ed098e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1009373993" status: 200 len: 485 microversion: 2.1 time: 0.078462 Aug 09 14:34:56.519151 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 603/1172] 10.222.0.50 () {58 vars in 1231 bytes} [Tue Aug 9 14:34:56 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1009373993 => generated 485 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:56.531078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bdea4606-ae3b-46b2-b727-5abff481b3aa tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41def37820>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:56.621158 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bdea4606-ae3b-46b2-b727-5abff481b3aa tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images?server=1ba6d964-167a-4b1e-94f0-fb74f63c03f1" status: 200 len: 958 microversion: 2.1 time: 0.096044 Aug 09 14:34:56.621728 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 570/1173] 10.222.0.50 () {58 vars in 1209 bytes} [Tue Aug 9 14:34:56 2022] GET /compute/v2.1/images?server=1ba6d964-167a-4b1e-94f0-fb74f63c03f1 => generated 958 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:56.634714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a8186c93-41e6-4e13-b08a-25834e79b212 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddda09d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:56.653729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-761e952f-d724-461f-9ec1-1ee597d695b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:56.654592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-761e952f-d724-461f-9ec1-1ee597d695b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:56.661753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-761e952f-d724-461f-9ec1-1ee597d695b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:56.662572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-761e952f-d724-461f-9ec1-1ee597d695b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:56.663191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-761e952f-d724-461f-9ec1-1ee597d695b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:56.664061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-761e952f-d724-461f-9ec1-1ee597d695b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:56.664645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-761e952f-d724-461f-9ec1-1ee597d695b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:56.665193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-761e952f-d724-461f-9ec1-1ee597d695b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:56.698713 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a8186c93-41e6-4e13-b08a-25834e79b212 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 485 microversion: 2.1 time: 0.068112 Aug 09 14:34:56.699341 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 604/1174] 10.222.0.50 () {58 vars in 1317 bytes} [Tue Aug 9 14:34:56 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 485 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:56.711522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9faf0c4f-54f7-414f-88c1-9fad8a864041 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41de0bbaf0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:56.781265 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9faf0c4f-54f7-414f-88c1-9fad8a864041 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 485 microversion: 2.1 time: 0.073429 Aug 09 14:34:56.782169 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 605/1175] 10.222.0.50 () {58 vars in 1303 bytes} [Tue Aug 9 14:34:56 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 485 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:56.794028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4500d40-ba7d-41ee-a6d2-1be9e8776bbf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddf5bb80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:56.822842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-761e952f-d724-461f-9ec1-1ee597d695b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:56.832129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-761e952f-d724-461f-9ec1-1ee597d695b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:56.833624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-761e952f-d724-461f-9ec1-1ee597d695b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:56.834773 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-761e952f-d724-461f-9ec1-1ee597d695b1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.186390 Aug 09 14:34:56.839148 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 571/1176] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:56 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:34:56.880480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c1ba0ae6-042b-4a59-8f7f-3ba3fb134de3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:56.881175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c1ba0ae6-042b-4a59-8f7f-3ba3fb134de3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:56.888957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1ba0ae6-042b-4a59-8f7f-3ba3fb134de3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:56.889559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1ba0ae6-042b-4a59-8f7f-3ba3fb134de3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:56.890278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1ba0ae6-042b-4a59-8f7f-3ba3fb134de3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:56.891165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1ba0ae6-042b-4a59-8f7f-3ba3fb134de3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:56.891741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1ba0ae6-042b-4a59-8f7f-3ba3fb134de3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:56.892471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1ba0ae6-042b-4a59-8f7f-3ba3fb134de3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:56.912601 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b4500d40-ba7d-41ee-a6d2-1be9e8776bbf tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.122214 Aug 09 14:34:56.913447 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 606/1177] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 9 14:34:56 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:56.929241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f335f3f-c430-4dea-9f67-3a7bf76ddc8b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41de051ca0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.003205 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f335f3f-c430-4dea-9f67-3a7bf76ddc8b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1431 microversion: 2.1 time: 0.077942 Aug 09 14:34:57.004146 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 607/1178] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 9 14:34:56 2022] GET /compute/v2.1/images?type=snapshot => generated 1431 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:57.017504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-605470c7-0ff4-41ab-ba95-decbbe537ab7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd96ee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.056935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c1ba0ae6-042b-4a59-8f7f-3ba3fb134de3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:57.066348 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c1ba0ae6-042b-4a59-8f7f-3ba3fb134de3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.192616 Aug 09 14:34:57.067338 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 572/1179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:56 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:57.112586 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-605470c7-0ff4-41ab-ba95-decbbe537ab7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.099016 Aug 09 14:34:57.113168 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 608/1180] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:34:57 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:57.126295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d9944066-4631-42f7-9483-99460428a56d tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd596ee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.141055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1919f739-0c09-4b62-a673-a11e931881a0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.141968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1919f739-0c09-4b62-a673-a11e931881a0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:57.151504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1919f739-0c09-4b62-a673-a11e931881a0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:57.152046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1919f739-0c09-4b62-a673-a11e931881a0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:57.152485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1919f739-0c09-4b62-a673-a11e931881a0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:57.153395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1919f739-0c09-4b62-a673-a11e931881a0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:57.153868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1919f739-0c09-4b62-a673-a11e931881a0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:57.154286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1919f739-0c09-4b62-a673-a11e931881a0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:57.212129 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d9944066-4631-42f7-9483-99460428a56d tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/detail?changes-since=2022-08-09T14%3A33%3A15Z" status: 200 len: 6334 microversion: 2.1 time: 0.089711 Aug 09 14:34:57.212760 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 573/1181] 10.222.0.50 () {58 vars in 1220 bytes} [Tue Aug 9 14:34:57 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-09T14%3A33%3A15Z => generated 6334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:57.232299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8cc3429e-8cb0-48d9-a6af-63ce6d73d950 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd588e50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.280146 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8cc3429e-8cb0-48d9-a6af-63ce6d73d950 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1009373993" status: 200 len: 665 microversion: 2.1 time: 0.051799 Aug 09 14:34:57.280990 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 574/1182] 10.222.0.50 () {58 vars in 1252 bytes} [Tue Aug 9 14:34:57 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1009373993 => generated 665 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:57.295869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1a94ad6f-4e5e-4e54-966f-b437bb5a904b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd5f3310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.311336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1919f739-0c09-4b62-a673-a11e931881a0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:57.323652 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1919f739-0c09-4b62-a673-a11e931881a0 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1316 microversion: 2.1 time: 0.186333 Aug 09 14:34:57.324865 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 609/1183] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:57 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:57.358565 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1a94ad6f-4e5e-4e54-966f-b437bb5a904b tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1467 microversion: 2.1 time: 0.066402 Aug 09 14:34:57.359188 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 575/1184] 10.222.0.50 () {58 vars in 1338 bytes} [Tue Aug 9 14:34:57 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fv2.1%2Fservers%2F261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1467 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:57.373619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84550f2d-501d-4500-9255-19858d3aec5d tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddda0670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.426620 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84550f2d-501d-4500-9255-19858d3aec5d tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1467 microversion: 2.1 time: 0.056941 Aug 09 14:34:57.427391 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 610/1185] 10.222.0.50 () {58 vars in 1324 bytes} [Tue Aug 9 14:34:57 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.50%2Fcompute%2Fservers%2F261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1467 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:57.440497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:57.441413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:57.446028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62f3d678-d4a4-4378-8138-f77d80b1a00e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd5889d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.538317 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-62f3d678-d4a4-4378-8138-f77d80b1a00e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.098904 Aug 09 14:34:57.539047 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 576/1186] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 9 14:34:57 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:57.559323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e313cb56-c30e-43b7-8bf3-42c50d759cce tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd96820>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.564848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:57.629970 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e313cb56-c30e-43b7-8bf3-42c50d759cce tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4377 microversion: 2.1 time: 0.075165 Aug 09 14:34:57.630954 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 611/1187] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 9 14:34:57 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4377 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:57.647810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e2893c82-bafa-4b78-89db-f59fd3ac3831 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dd588700>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.696131 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e2893c82-bafa-4b78-89db-f59fd3ac3831 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/f0e08d35-6013-4ff5-9f41-f40d5739b250" status: 200 len: 784 microversion: 2.1 time: 0.052581 Aug 09 14:34:57.696725 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 577/1188] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:34:57 2022] GET /compute/v2.1/images/f0e08d35-6013-4ff5-9f41-f40d5739b250 => generated 784 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:57.712245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a1ded152-c936-4e40-b4a1-057e93a202cc tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddda0ee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.762397 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a1ded152-c936-4e40-b4a1-057e93a202cc tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.054330 Aug 09 14:34:57.763180 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 612/1189] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:34:57 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:57.779018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a4e3fcc-d40a-448f-ba2a-a5a0b04fdbda tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd8fe50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.859162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2df8595e-9fb7-47ce-9614-0e474171eb11 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:57.859775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2df8595e-9fb7-47ce-9614-0e474171eb11 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:57.874924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df8595e-9fb7-47ce-9614-0e474171eb11 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:57.875455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df8595e-9fb7-47ce-9614-0e474171eb11 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:57.875890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df8595e-9fb7-47ce-9614-0e474171eb11 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:57.876679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df8595e-9fb7-47ce-9614-0e474171eb11 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:57.877134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df8595e-9fb7-47ce-9614-0e474171eb11 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:57.877696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2df8595e-9fb7-47ce-9614-0e474171eb11 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:58.033833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2df8595e-9fb7-47ce-9614-0e474171eb11 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:58.047691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2df8595e-9fb7-47ce-9614-0e474171eb11 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:58.049504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2df8595e-9fb7-47ce-9614-0e474171eb11 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:58.051120 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2df8595e-9fb7-47ce-9614-0e474171eb11 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.196457 Aug 09 14:34:58.055128 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 613/1190] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:57 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:34:58.091026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-af9a5719-215e-43d5-80ee-b938fe48b6d6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:58.091742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-af9a5719-215e-43d5-80ee-b938fe48b6d6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:58.098007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af9a5719-215e-43d5-80ee-b938fe48b6d6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:58.098790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af9a5719-215e-43d5-80ee-b938fe48b6d6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:58.099483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af9a5719-215e-43d5-80ee-b938fe48b6d6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:58.100486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af9a5719-215e-43d5-80ee-b938fe48b6d6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:58.100940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af9a5719-215e-43d5-80ee-b938fe48b6d6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:58.101366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af9a5719-215e-43d5-80ee-b938fe48b6d6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:58.249675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-af9a5719-215e-43d5-80ee-b938fe48b6d6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:58.252508 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a4e3fcc-d40a-448f-ba2a-a5a0b04fdbda tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "DELETE /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50" status: 204 len: 0 microversion: 2.1 time: 0.477548 Aug 09 14:34:58.253329 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 578/1191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:57 2022] DELETE /compute/v2.1/images/1e236d19-2e7f-4a00-9975-5e608f374b50 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:34:58.260959 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-af9a5719-215e-43d5-80ee-b938fe48b6d6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.177135 Aug 09 14:34:58.261851 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 614/1192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:58 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:58.262037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a4f972e9-0bb6-4674-ad7f-6a4e66a32261 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddd8f040>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:58.344819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7d9e1a7-65b8-48a3-9afd-36f7d456c366 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:58.345548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7d9e1a7-65b8-48a3-9afd-36f7d456c366 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:58.354753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7d9e1a7-65b8-48a3-9afd-36f7d456c366 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:58.355522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7d9e1a7-65b8-48a3-9afd-36f7d456c366 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:58.356140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7d9e1a7-65b8-48a3-9afd-36f7d456c366 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:58.357197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7d9e1a7-65b8-48a3-9afd-36f7d456c366 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:58.357811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7d9e1a7-65b8-48a3-9afd-36f7d456c366 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:58.358438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7d9e1a7-65b8-48a3-9afd-36f7d456c366 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:58.544540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7d9e1a7-65b8-48a3-9afd-36f7d456c366 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:58.555297 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7d9e1a7-65b8-48a3-9afd-36f7d456c366 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1316 microversion: 2.1 time: 0.213959 Aug 09 14:34:58.555916 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 615/1193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:58 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:58.561262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-940bc3db-bd71-4209-b629-1d4cb33833d3 req-d0ba1374-06ac-46f6-a552-8a4c074eb7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89965e92-ea8e-49a6-a4d8-3cea1d171b08", "name": "network-vif-plugged", "status": "completed", "tag": "95e19b52-da20-48ba-b1b2-3455496deab0"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:34:58.575793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-940bc3db-bd71-4209-b629-1d4cb33833d3 req-d0ba1374-06ac-46f6-a552-8a4c074eb7bb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:58.576219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-940bc3db-bd71-4209-b629-1d4cb33833d3 req-d0ba1374-06ac-46f6-a552-8a4c074eb7bb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:58.576703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-940bc3db-bd71-4209-b629-1d4cb33833d3 req-d0ba1374-06ac-46f6-a552-8a4c074eb7bb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:58.595299 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-940bc3db-bd71-4209-b629-1d4cb33833d3 req-d0ba1374-06ac-46f6-a552-8a4c074eb7bb service nova] Creating event network-vif-plugged:95e19b52-da20-48ba-b1b2-3455496deab0 for instance 89965e92-ea8e-49a6-a4d8-3cea1d171b08 on n-h2-844626-8 Aug 09 14:34:58.606397 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-940bc3db-bd71-4209-b629-1d4cb33833d3 req-d0ba1374-06ac-46f6-a552-8a4c074eb7bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048203 Aug 09 14:34:58.609397 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 616/1194] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:34:58.868371 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a4f972e9-0bb6-4674-ad7f-6a4e66a32261 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "DELETE /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f" status: 204 len: 0 microversion: 2.1 time: 0.610235 Aug 09 14:34:58.868976 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 579/1195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:58 2022] DELETE /compute/v2.1/images/bd208c50-9bc3-44d3-b3dd-e3cd66577d7f => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:34:58.878349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4007a741-00d3-40dc-8474-153958730b1f tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41ddda0430>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:59.074435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-13d45cd4-1790-4d8e-9d37-7c052c6763c2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:59.075415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-13d45cd4-1790-4d8e-9d37-7c052c6763c2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:59.082840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d45cd4-1790-4d8e-9d37-7c052c6763c2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:59.083465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d45cd4-1790-4d8e-9d37-7c052c6763c2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:59.084007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d45cd4-1790-4d8e-9d37-7c052c6763c2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:59.084957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d45cd4-1790-4d8e-9d37-7c052c6763c2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:59.085759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d45cd4-1790-4d8e-9d37-7c052c6763c2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:59.086502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d45cd4-1790-4d8e-9d37-7c052c6763c2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:59.239510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-13d45cd4-1790-4d8e-9d37-7c052c6763c2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:59.252681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-13d45cd4-1790-4d8e-9d37-7c052c6763c2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:59.256346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-13d45cd4-1790-4d8e-9d37-7c052c6763c2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:59.258659 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-13d45cd4-1790-4d8e-9d37-7c052c6763c2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.188142 Aug 09 14:34:59.275103 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 580/1196] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:34:59 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:34:59.282320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1e9c33e8-1a90-4b9d-bc7b-6bf684ca7c83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:59.283042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1e9c33e8-1a90-4b9d-bc7b-6bf684ca7c83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:59.290086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e9c33e8-1a90-4b9d-bc7b-6bf684ca7c83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:59.290614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e9c33e8-1a90-4b9d-bc7b-6bf684ca7c83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:59.291070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e9c33e8-1a90-4b9d-bc7b-6bf684ca7c83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:59.291816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e9c33e8-1a90-4b9d-bc7b-6bf684ca7c83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:59.292260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e9c33e8-1a90-4b9d-bc7b-6bf684ca7c83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:59.292680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e9c33e8-1a90-4b9d-bc7b-6bf684ca7c83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:59.333208 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4007a741-00d3-40dc-8474-153958730b1f tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "DELETE /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034" status: 204 len: 0 microversion: 2.1 time: 0.459713 Aug 09 14:34:59.333864 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 617/1197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:58 2022] DELETE /compute/v2.1/images/a61532bc-a60a-455a-9374-d59dac2b9034 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:34:59.341906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-237154fb-b141-47b3-a43e-b4312115ede1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:59.342676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-237154fb-b141-47b3-a43e-b4312115ede1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:59.349845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-237154fb-b141-47b3-a43e-b4312115ede1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:59.350332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-237154fb-b141-47b3-a43e-b4312115ede1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:59.350768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-237154fb-b141-47b3-a43e-b4312115ede1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:59.351503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-237154fb-b141-47b3-a43e-b4312115ede1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:59.351953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-237154fb-b141-47b3-a43e-b4312115ede1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:59.352401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-237154fb-b141-47b3-a43e-b4312115ede1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:59.378319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-237154fb-b141-47b3-a43e-b4312115ede1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:34:59.442701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e9c33e8-1a90-4b9d-bc7b-6bf684ca7c83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:59.452366 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1e9c33e8-1a90-4b9d-bc7b-6bf684ca7c83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.174322 Aug 09 14:34:59.454271 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 581/1198] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:59 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:34:59.455116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:34:59.479869 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-237154fb-b141-47b3-a43e-b4312115ede1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "DELETE /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 204 len: 0 microversion: 2.1 time: 0.139004 Aug 09 14:34:59.481030 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 618/1199] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:34:59 2022] DELETE /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:34:59.489936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6a2562f7-8a84-4e4b-adb4-c2c918790877 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:59.490554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6a2562f7-8a84-4e4b-adb4-c2c918790877 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:59.497325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a2562f7-8a84-4e4b-adb4-c2c918790877 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:59.497817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a2562f7-8a84-4e4b-adb4-c2c918790877 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:59.498248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a2562f7-8a84-4e4b-adb4-c2c918790877 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:59.498957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a2562f7-8a84-4e4b-adb4-c2c918790877 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:59.499438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a2562f7-8a84-4e4b-adb4-c2c918790877 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:59.499857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a2562f7-8a84-4e4b-adb4-c2c918790877 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:59.579918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb351f2e-6baa-4ae3-a63d-a602442c7e83 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:34:59.580607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bb351f2e-6baa-4ae3-a63d-a602442c7e83 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:34:59.587886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb351f2e-6baa-4ae3-a63d-a602442c7e83 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:59.589038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb351f2e-6baa-4ae3-a63d-a602442c7e83 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:59.589740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb351f2e-6baa-4ae3-a63d-a602442c7e83 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:59.590686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb351f2e-6baa-4ae3-a63d-a602442c7e83 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:34:59.591556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb351f2e-6baa-4ae3-a63d-a602442c7e83 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:34:59.592199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb351f2e-6baa-4ae3-a63d-a602442c7e83 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:34:59.668975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6a2562f7-8a84-4e4b-adb4-c2c918790877 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:59.677886 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6a2562f7-8a84-4e4b-adb4-c2c918790877 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1472 microversion: 2.1 time: 0.192212 Aug 09 14:34:59.678684 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 582/1200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:59 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:34:59.756751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bb351f2e-6baa-4ae3-a63d-a602442c7e83 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:34:59.765008 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb351f2e-6baa-4ae3-a63d-a602442c7e83 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1316 microversion: 2.1 time: 0.189464 Aug 09 14:34:59.765648 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 619/1201] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:34:59 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:00.282219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a3d3c78d-5fa0-47ec-b24b-fee858d88794 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:00.284097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a3d3c78d-5fa0-47ec-b24b-fee858d88794 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:00.292590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3d3c78d-5fa0-47ec-b24b-fee858d88794 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:00.293549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3d3c78d-5fa0-47ec-b24b-fee858d88794 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:00.294249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3d3c78d-5fa0-47ec-b24b-fee858d88794 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:00.294966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3d3c78d-5fa0-47ec-b24b-fee858d88794 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:00.295449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3d3c78d-5fa0-47ec-b24b-fee858d88794 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:00.295865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3d3c78d-5fa0-47ec-b24b-fee858d88794 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:00.471805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a3d3c78d-5fa0-47ec-b24b-fee858d88794 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:00.475298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cb38aa63-2c3a-4d4a-b1a2-43065fc1ca3a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:00.476503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cb38aa63-2c3a-4d4a-b1a2-43065fc1ca3a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:00.482099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a3d3c78d-5fa0-47ec-b24b-fee858d88794 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:00.483701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a3d3c78d-5fa0-47ec-b24b-fee858d88794 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:00.485274 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a3d3c78d-5fa0-47ec-b24b-fee858d88794 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.207174 Aug 09 14:35:00.486108 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 583/1202] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:00 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:00.492986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb38aa63-2c3a-4d4a-b1a2-43065fc1ca3a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:00.495118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb38aa63-2c3a-4d4a-b1a2-43065fc1ca3a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:00.497603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb38aa63-2c3a-4d4a-b1a2-43065fc1ca3a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:00.498436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb38aa63-2c3a-4d4a-b1a2-43065fc1ca3a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:00.498988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb38aa63-2c3a-4d4a-b1a2-43065fc1ca3a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:00.501099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb38aa63-2c3a-4d4a-b1a2-43065fc1ca3a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:00.626078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-eae96546-1836-4896-b1a6-b186eef1f195 req-7e7e61fd-2aab-41cd-9e4a-b73263d134d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba6d964-167a-4b1e-94f0-fb74f63c03f1", "name": "network-vif-unplugged", "status": "completed", "tag": "e4f9d82e-39ab-4f23-91b4-e30a41b072c4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:00.638705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eae96546-1836-4896-b1a6-b186eef1f195 req-7e7e61fd-2aab-41cd-9e4a-b73263d134d7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:00.639990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eae96546-1836-4896-b1a6-b186eef1f195 req-7e7e61fd-2aab-41cd-9e4a-b73263d134d7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:00.640635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eae96546-1836-4896-b1a6-b186eef1f195 req-7e7e61fd-2aab-41cd-9e4a-b73263d134d7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:00.641953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cb38aa63-2c3a-4d4a-b1a2-43065fc1ca3a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:00.653677 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-eae96546-1836-4896-b1a6-b186eef1f195 req-7e7e61fd-2aab-41cd-9e4a-b73263d134d7 service nova] Creating event network-vif-unplugged:e4f9d82e-39ab-4f23-91b4-e30a41b072c4 for instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 on n-h2-844626-8 Aug 09 14:35:00.654407 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cb38aa63-2c3a-4d4a-b1a2-43065fc1ca3a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.183656 Aug 09 14:35:00.658435 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 620/1203] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:00 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:00.659902 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-eae96546-1836-4896-b1a6-b186eef1f195 req-7e7e61fd-2aab-41cd-9e4a-b73263d134d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037423 Aug 09 14:35:00.660589 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 584/1204] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:35:00.699306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8b4a6b6c-ac7a-4907-8480-3ee580dbb15a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:00.699912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8b4a6b6c-ac7a-4907-8480-3ee580dbb15a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:00.706247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b4a6b6c-ac7a-4907-8480-3ee580dbb15a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:00.706847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b4a6b6c-ac7a-4907-8480-3ee580dbb15a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:00.707352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b4a6b6c-ac7a-4907-8480-3ee580dbb15a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:00.708075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b4a6b6c-ac7a-4907-8480-3ee580dbb15a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:00.708552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b4a6b6c-ac7a-4907-8480-3ee580dbb15a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:00.708993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b4a6b6c-ac7a-4907-8480-3ee580dbb15a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:00.786780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-55c8e2af-81fa-4fd9-9287-dc9bb35fda22 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:00.787736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-55c8e2af-81fa-4fd9-9287-dc9bb35fda22 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:00.794314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55c8e2af-81fa-4fd9-9287-dc9bb35fda22 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:00.795067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55c8e2af-81fa-4fd9-9287-dc9bb35fda22 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:00.795688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55c8e2af-81fa-4fd9-9287-dc9bb35fda22 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:00.796550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55c8e2af-81fa-4fd9-9287-dc9bb35fda22 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:00.797149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55c8e2af-81fa-4fd9-9287-dc9bb35fda22 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:00.797717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55c8e2af-81fa-4fd9-9287-dc9bb35fda22 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:00.859265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8b4a6b6c-ac7a-4907-8480-3ee580dbb15a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:00.867656 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8b4a6b6c-ac7a-4907-8480-3ee580dbb15a tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1472 microversion: 2.1 time: 0.172314 Aug 09 14:35:00.868215 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 621/1205] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:00 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:00.944211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-55c8e2af-81fa-4fd9-9287-dc9bb35fda22 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:00.952284 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-55c8e2af-81fa-4fd9-9287-dc9bb35fda22 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1466 microversion: 2.1 time: 0.169976 Aug 09 14:35:00.952900 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 585/1206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:00 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1466 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:00.971959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f34847eb-8b57-4f4c-aff7-39097d84d57e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:00.972565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f34847eb-8b57-4f4c-aff7-39097d84d57e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:00.979113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f34847eb-8b57-4f4c-aff7-39097d84d57e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:00.979613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f34847eb-8b57-4f4c-aff7-39097d84d57e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:00.980040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f34847eb-8b57-4f4c-aff7-39097d84d57e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:00.980727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f34847eb-8b57-4f4c-aff7-39097d84d57e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:00.981176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f34847eb-8b57-4f4c-aff7-39097d84d57e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:00.981593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f34847eb-8b57-4f4c-aff7-39097d84d57e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:00.984078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:01.131559 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f34847eb-8b57-4f4c-aff7-39097d84d57e tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1617 microversion: 2.1 time: 0.163181 Aug 09 14:35:01.132354 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 622/1207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:00 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1617 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:01.195134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-790186957", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["5c29a36e-08bc-48f8-ae8c-029a5dbf060f"]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:01.253439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:35:01.495833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:35:01.496385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:35:01.496699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:35:01.497096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:35:01.497495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:35:01.506645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:01.507148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:01.507579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:01.508300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:01.508724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-74cb5cf5-d45d-4cac-98a0-530f487a8415 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:01.508850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:01.509141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:01.509436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-74cb5cf5-d45d-4cac-98a0-530f487a8415 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:01.516097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74cb5cf5-d45d-4cac-98a0-530f487a8415 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:01.516592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74cb5cf5-d45d-4cac-98a0-530f487a8415 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:01.517032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74cb5cf5-d45d-4cac-98a0-530f487a8415 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:01.517796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74cb5cf5-d45d-4cac-98a0-530f487a8415 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:01.518240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74cb5cf5-d45d-4cac-98a0-530f487a8415 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:01.518652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74cb5cf5-d45d-4cac-98a0-530f487a8415 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:01.527190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:35:01.532134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:35:01.545824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:35:01.548489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:35:01.595147 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1184f330-c264-414e-927e-29ca4c2aa04e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.403719 Aug 09 14:35:01.596074 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 586/1208] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:35:01.607356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30d7b269-e431-4346-9eee-01694f83ad02 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:01.608069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30d7b269-e431-4346-9eee-01694f83ad02 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:01.999948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30d7b269-e431-4346-9eee-01694f83ad02 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:02.011395 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30d7b269-e431-4346-9eee-01694f83ad02 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1216 microversion: 2.1 time: 0.407857 Aug 09 14:35:02.014409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-74cb5cf5-d45d-4cac-98a0-530f487a8415 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:02.024240 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 587/1209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:01 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1216 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:02.028594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-74cb5cf5-d45d-4cac-98a0-530f487a8415 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:02.030408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-74cb5cf5-d45d-4cac-98a0-530f487a8415 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:02.031137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1b8d424f-a5fa-4567-8f8a-05d480b7fbd3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:02.032053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1b8d424f-a5fa-4567-8f8a-05d480b7fbd3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:02.033063 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-74cb5cf5-d45d-4cac-98a0-530f487a8415 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.528264 Aug 09 14:35:02.034336 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 623/1210] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:01 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:35:02.040281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5affc80c-0bb3-4e8c-b645-3e0df8e695e1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:02.040750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8d424f-a5fa-4567-8f8a-05d480b7fbd3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:02.041231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8d424f-a5fa-4567-8f8a-05d480b7fbd3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:02.041378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5affc80c-0bb3-4e8c-b645-3e0df8e695e1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:02.041650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8d424f-a5fa-4567-8f8a-05d480b7fbd3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:02.042529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8d424f-a5fa-4567-8f8a-05d480b7fbd3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:02.043140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8d424f-a5fa-4567-8f8a-05d480b7fbd3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:02.043704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8d424f-a5fa-4567-8f8a-05d480b7fbd3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:02.051031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5affc80c-0bb3-4e8c-b645-3e0df8e695e1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:02.051888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5affc80c-0bb3-4e8c-b645-3e0df8e695e1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:02.052413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5affc80c-0bb3-4e8c-b645-3e0df8e695e1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:02.053353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5affc80c-0bb3-4e8c-b645-3e0df8e695e1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:02.054016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5affc80c-0bb3-4e8c-b645-3e0df8e695e1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:02.054899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5affc80c-0bb3-4e8c-b645-3e0df8e695e1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:02.266786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1b8d424f-a5fa-4567-8f8a-05d480b7fbd3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:02.270679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5affc80c-0bb3-4e8c-b645-3e0df8e695e1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:02.278914 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5affc80c-0bb3-4e8c-b645-3e0df8e695e1 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 200 len: 1472 microversion: 2.1 time: 0.243006 Aug 09 14:35:02.279952 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 624/1211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:02 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:02.281729 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1b8d424f-a5fa-4567-8f8a-05d480b7fbd3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.256270 Aug 09 14:35:02.282382 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 588/1212] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:02 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:02.396625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d943a3c4-f652-407e-8039-e059c787e1d2 req-80ae532b-95f0-45b3-bede-ea40766fec1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261b33cd-d9c1-42bc-bb0e-3836fae12d34", "name": "network-vif-deleted", "tag": "deab8750-c5ac-4d07-a63f-ee59f7fa7a73"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:02.406822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d943a3c4-f652-407e-8039-e059c787e1d2 req-80ae532b-95f0-45b3-bede-ea40766fec1c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:02.407332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d943a3c4-f652-407e-8039-e059c787e1d2 req-80ae532b-95f0-45b3-bede-ea40766fec1c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:02.407789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d943a3c4-f652-407e-8039-e059c787e1d2 req-80ae532b-95f0-45b3-bede-ea40766fec1c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:02.418983 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d943a3c4-f652-407e-8039-e059c787e1d2 req-80ae532b-95f0-45b3-bede-ea40766fec1c service nova] Creating event network-vif-deleted:deab8750-c5ac-4d07-a63f-ee59f7fa7a73 for instance 261b33cd-d9c1-42bc-bb0e-3836fae12d34 on n-h1-844626-8 Aug 09 14:35:02.424931 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d943a3c4-f652-407e-8039-e059c787e1d2 req-80ae532b-95f0-45b3-bede-ea40766fec1c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032152 Aug 09 14:35:02.426067 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 625/1213] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:03.036562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3012dd26-1c2a-4326-9c85-204f80c83096 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:03.037348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3012dd26-1c2a-4326-9c85-204f80c83096 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:03.044453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3012dd26-1c2a-4326-9c85-204f80c83096 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:03.045303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3012dd26-1c2a-4326-9c85-204f80c83096 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:03.045891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3012dd26-1c2a-4326-9c85-204f80c83096 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:03.046790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3012dd26-1c2a-4326-9c85-204f80c83096 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:03.047451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3012dd26-1c2a-4326-9c85-204f80c83096 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:03.048041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3012dd26-1c2a-4326-9c85-204f80c83096 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:03.062655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-26471cdd-d57d-4439-956e-47b44ca10b80 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:03.063615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-26471cdd-d57d-4439-956e-47b44ca10b80 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:03.075320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26471cdd-d57d-4439-956e-47b44ca10b80 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:03.076541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26471cdd-d57d-4439-956e-47b44ca10b80 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:03.077202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26471cdd-d57d-4439-956e-47b44ca10b80 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:03.077999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26471cdd-d57d-4439-956e-47b44ca10b80 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:03.080804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26471cdd-d57d-4439-956e-47b44ca10b80 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:03.081768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26471cdd-d57d-4439-956e-47b44ca10b80 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:03.117495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3012dd26-1c2a-4326-9c85-204f80c83096 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:03.126042 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3012dd26-1c2a-4326-9c85-204f80c83096 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1276 microversion: 2.1 time: 0.093400 Aug 09 14:35:03.127455 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 589/1214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:03 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:03.247274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-26471cdd-d57d-4439-956e-47b44ca10b80 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:03.258483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-26471cdd-d57d-4439-956e-47b44ca10b80 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:03.259276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-26471cdd-d57d-4439-956e-47b44ca10b80 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:03.260561 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-26471cdd-d57d-4439-956e-47b44ca10b80 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.205915 Aug 09 14:35:03.261232 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 626/1215] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:03 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:03.301616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0541a176-fb0d-4a1e-a7bf-7f0d12079230 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:03.302240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0541a176-fb0d-4a1e-a7bf-7f0d12079230 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 261b33cd-d9c1-42bc-bb0e-3836fae12d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:03.302867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b816a8e6-23b1-49fa-a669-3dbc97600758 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:03.303616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b816a8e6-23b1-49fa-a669-3dbc97600758 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:03.308921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0541a176-fb0d-4a1e-a7bf-7f0d12079230 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:03.309413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0541a176-fb0d-4a1e-a7bf-7f0d12079230 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:03.310040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b816a8e6-23b1-49fa-a669-3dbc97600758 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:03.310173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0541a176-fb0d-4a1e-a7bf-7f0d12079230 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:03.310729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b816a8e6-23b1-49fa-a669-3dbc97600758 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:03.310861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0541a176-fb0d-4a1e-a7bf-7f0d12079230 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:03.311250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0541a176-fb0d-4a1e-a7bf-7f0d12079230 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:03.311457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b816a8e6-23b1-49fa-a669-3dbc97600758 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:03.311673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0541a176-fb0d-4a1e-a7bf-7f0d12079230 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:03.312326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b816a8e6-23b1-49fa-a669-3dbc97600758 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:03.312870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b816a8e6-23b1-49fa-a669-3dbc97600758 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:03.313386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b816a8e6-23b1-49fa-a669-3dbc97600758 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:03.326105 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-0541a176-fb0d-4a1e-a7bf-7f0d12079230 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] HTTP exception thrown: Instance 261b33cd-d9c1-42bc-bb0e-3836fae12d34 could not be found. Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0541a176-fb0d-4a1e-a7bf-7f0d12079230 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Request method failure captured: Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 HTTP/1.1 Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nAqINQsgeYjahBWKXd2Nd92GXyJjddZYc01xdUDWov3GJAqUZs_cSEpNtm_mZsNngdHrxMKF3e1PpyF0Bys71JJPjCe6aeq9PRJIPTnKEt7GyIMrEECULjYRPud7ZMAubCqaQDBHS42ZMpw3MBQWlHsLO7JqUzGeeFc4XEkY1x7N50 Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: a9197a5676004ed888ef46000067e150 Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ListImageFiltersTestJSON-1119937407 Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a9197a5676004ed888ef46000067e150", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a9197a5676004ed888ef46000067e150"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a9197a5676004ed888ef46000067e150"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a9197a5676004ed888ef46000067e150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ListImageFiltersTestJSON-1119937407 Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: a9197a5676004ed888ef46000067e150 Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1119937407 Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ListImageFiltersTestJSON-1119937407-project Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 8b1fd7b4e40e49828ab24bfced256417 Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ListImageFiltersTestJSON-1119937407-project Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 261b33cd-d9c1-42bc-bb0e-3836fae12d34 could not be found. Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '261b33cd-d9c1-42bc-bb0e-3836fae12d34'} Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 261b33cd-d9c1-42bc-bb0e-3836fae12d34 could not be found. Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 261b33cd-d9c1-42bc-bb0e-3836fae12d34 could not be found. Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:03.327996 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:03.333877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:03.333877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:03.333877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:03.333877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:03.333877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:03.333877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 261b33cd-d9c1-42bc-bb0e-3836fae12d34 could not be found. Aug 09 14:35:03.333877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:03.333877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0541a176-fb0d-4a1e-a7bf-7f0d12079230 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Returning 404 to user: Instance 261b33cd-d9c1-42bc-bb0e-3836fae12d34 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:03.333877 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0541a176-fb0d-4a1e-a7bf-7f0d12079230 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34" status: 404 len: 111 microversion: 2.1 time: 0.033923 Aug 09 14:35:03.335741 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 590/1216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:03 2022] GET /compute/v2.1/servers/261b33cd-d9c1-42bc-bb0e-3836fae12d34 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:35:03.340362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-04b5f82b-2a19-4a38-b3e0-cffdc7e13695 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:03.340931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-04b5f82b-2a19-4a38-b3e0-cffdc7e13695 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:03.347178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04b5f82b-2a19-4a38-b3e0-cffdc7e13695 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:03.347735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04b5f82b-2a19-4a38-b3e0-cffdc7e13695 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:03.348229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04b5f82b-2a19-4a38-b3e0-cffdc7e13695 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:03.349183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04b5f82b-2a19-4a38-b3e0-cffdc7e13695 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:03.349714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04b5f82b-2a19-4a38-b3e0-cffdc7e13695 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:03.350331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04b5f82b-2a19-4a38-b3e0-cffdc7e13695 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:03.377840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-04b5f82b-2a19-4a38-b3e0-cffdc7e13695 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:35:03.458013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:03.483431 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-04b5f82b-2a19-4a38-b3e0-cffdc7e13695 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1" status: 204 len: 0 microversion: 2.1 time: 0.146241 Aug 09 14:35:03.487795 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 591/1217] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:03 2022] DELETE /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:35:03.494291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c9568a1b-de31-4cfc-8655-5f80a8a7bc5e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:03.494990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c9568a1b-de31-4cfc-8655-5f80a8a7bc5e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:03.501150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b816a8e6-23b1-49fa-a669-3dbc97600758 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:03.501343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9568a1b-de31-4cfc-8655-5f80a8a7bc5e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:03.501813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9568a1b-de31-4cfc-8655-5f80a8a7bc5e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:03.502284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9568a1b-de31-4cfc-8655-5f80a8a7bc5e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:03.502979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9568a1b-de31-4cfc-8655-5f80a8a7bc5e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:03.503452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9568a1b-de31-4cfc-8655-5f80a8a7bc5e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:03.503859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9568a1b-de31-4cfc-8655-5f80a8a7bc5e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:03.508929 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b816a8e6-23b1-49fa-a669-3dbc97600758 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.210750 Aug 09 14:35:03.517181 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 627/1218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:03 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:03.520177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:03.640725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c9568a1b-de31-4cfc-8655-5f80a8a7bc5e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:03.653959 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c9568a1b-de31-4cfc-8655-5f80a8a7bc5e tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1" status: 200 len: 1474 microversion: 2.1 time: 0.164039 Aug 09 14:35:03.655749 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 592/1219] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:03 2022] GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1 => generated 1474 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:04.148054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1f3d3a8-aacb-4f90-9701-732a8420b69f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:04.149015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1f3d3a8-aacb-4f90-9701-732a8420b69f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:04.156610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1f3d3a8-aacb-4f90-9701-732a8420b69f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:04.157221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1f3d3a8-aacb-4f90-9701-732a8420b69f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:04.157777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1f3d3a8-aacb-4f90-9701-732a8420b69f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:04.158482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1f3d3a8-aacb-4f90-9701-732a8420b69f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:04.158956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1f3d3a8-aacb-4f90-9701-732a8420b69f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:04.159429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1f3d3a8-aacb-4f90-9701-732a8420b69f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:04.284053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44290a5a-ff9e-4986-86e9-fd8227aa2de9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:04.285452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44290a5a-ff9e-4986-86e9-fd8227aa2de9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:04.293038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44290a5a-ff9e-4986-86e9-fd8227aa2de9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:04.293579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44290a5a-ff9e-4986-86e9-fd8227aa2de9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:04.294241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44290a5a-ff9e-4986-86e9-fd8227aa2de9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:04.294368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e1f3d3a8-aacb-4f90-9701-732a8420b69f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:04.295046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44290a5a-ff9e-4986-86e9-fd8227aa2de9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:04.295631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44290a5a-ff9e-4986-86e9-fd8227aa2de9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:04.297147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44290a5a-ff9e-4986-86e9-fd8227aa2de9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:04.302831 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1f3d3a8-aacb-4f90-9701-732a8420b69f tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1316 microversion: 2.1 time: 0.158798 Aug 09 14:35:04.307158 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 628/1220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:04 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:04.440332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-12d64c3b-54ad-4300-9fc6-161190641730 req-c94b2e44-dbba-49b0-8f12-23750604d00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd6f697-9f2e-4825-998a-796902617f44", "name": "network-vif-unplugged", "status": "completed", "tag": "ee2a1cef-a2ec-4b5c-a13d-9c50e9639eb0"}, {"name": "network-changed", "server_uuid": "acd6f697-9f2e-4825-998a-796902617f44", "tag": "ee2a1cef-a2ec-4b5c-a13d-9c50e9639eb0"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:04.445178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-44290a5a-ff9e-4986-86e9-fd8227aa2de9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:04.454271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-44290a5a-ff9e-4986-86e9-fd8227aa2de9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:04.455970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-12d64c3b-54ad-4300-9fc6-161190641730 req-c94b2e44-dbba-49b0-8f12-23750604d00f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:04.456453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-12d64c3b-54ad-4300-9fc6-161190641730 req-c94b2e44-dbba-49b0-8f12-23750604d00f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:04.456779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-44290a5a-ff9e-4986-86e9-fd8227aa2de9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:04.456902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-12d64c3b-54ad-4300-9fc6-161190641730 req-c94b2e44-dbba-49b0-8f12-23750604d00f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:04.458267 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44290a5a-ff9e-4986-86e9-fd8227aa2de9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.178357 Aug 09 14:35:04.459103 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 593/1221] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:04 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:35:04.468965 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-12d64c3b-54ad-4300-9fc6-161190641730 req-c94b2e44-dbba-49b0-8f12-23750604d00f service nova] Creating event network-vif-unplugged:ee2a1cef-a2ec-4b5c-a13d-9c50e9639eb0 for instance acd6f697-9f2e-4825-998a-796902617f44 on n-h1-844626-8 Aug 09 14:35:04.469802 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-12d64c3b-54ad-4300-9fc6-161190641730 req-c94b2e44-dbba-49b0-8f12-23750604d00f service nova] Creating event network-changed:ee2a1cef-a2ec-4b5c-a13d-9c50e9639eb0 for instance acd6f697-9f2e-4825-998a-796902617f44 on n-h1-844626-8 Aug 09 14:35:04.476319 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-12d64c3b-54ad-4300-9fc6-161190641730 req-c94b2e44-dbba-49b0-8f12-23750604d00f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.039820 Aug 09 14:35:04.476949 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 629/1222] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:04.529889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85477d03-eed0-4e94-a980-58f20228d77b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:04.530488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85477d03-eed0-4e94-a980-58f20228d77b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:04.536885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85477d03-eed0-4e94-a980-58f20228d77b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:04.537299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85477d03-eed0-4e94-a980-58f20228d77b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:04.537726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85477d03-eed0-4e94-a980-58f20228d77b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:04.538420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85477d03-eed0-4e94-a980-58f20228d77b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:04.538858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85477d03-eed0-4e94-a980-58f20228d77b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:04.539302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85477d03-eed0-4e94-a980-58f20228d77b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:04.672066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-85477d03-eed0-4e94-a980-58f20228d77b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:04.677967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-efa818eb-c003-4533-b447-33c163452904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:04.678701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-efa818eb-c003-4533-b447-33c163452904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:04.680148 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85477d03-eed0-4e94-a980-58f20228d77b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.154124 Aug 09 14:35:04.680985 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 594/1223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:04 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:04.686660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efa818eb-c003-4533-b447-33c163452904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:04.687190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efa818eb-c003-4533-b447-33c163452904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:04.687612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efa818eb-c003-4533-b447-33c163452904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:04.688311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efa818eb-c003-4533-b447-33c163452904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:04.688792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efa818eb-c003-4533-b447-33c163452904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:04.689185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efa818eb-c003-4533-b447-33c163452904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:04.826424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-efa818eb-c003-4533-b447-33c163452904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:04.835771 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-efa818eb-c003-4533-b447-33c163452904 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1" status: 200 len: 1474 microversion: 2.1 time: 0.162324 Aug 09 14:35:04.836395 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 630/1224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:04 2022] GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1 => generated 1474 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:05.324693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b948469-560a-4e10-8d4b-23c9fa255d26 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:05.325295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b948469-560a-4e10-8d4b-23c9fa255d26 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:05.333191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b948469-560a-4e10-8d4b-23c9fa255d26 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:05.333771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b948469-560a-4e10-8d4b-23c9fa255d26 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:05.334251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b948469-560a-4e10-8d4b-23c9fa255d26 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:05.334953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b948469-560a-4e10-8d4b-23c9fa255d26 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:05.335435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b948469-560a-4e10-8d4b-23c9fa255d26 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:05.335853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b948469-560a-4e10-8d4b-23c9fa255d26 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:05.477376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b948469-560a-4e10-8d4b-23c9fa255d26 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:05.481951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db369df0-564b-4f78-a2c0-bedab2da5ebf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:05.482654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db369df0-564b-4f78-a2c0-bedab2da5ebf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:05.485268 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b948469-560a-4e10-8d4b-23c9fa255d26 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1316 microversion: 2.1 time: 0.164553 Aug 09 14:35:05.485958 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 595/1225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:05 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:05.490090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db369df0-564b-4f78-a2c0-bedab2da5ebf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:05.490648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db369df0-564b-4f78-a2c0-bedab2da5ebf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:05.491177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db369df0-564b-4f78-a2c0-bedab2da5ebf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:05.491956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db369df0-564b-4f78-a2c0-bedab2da5ebf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:05.492476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db369df0-564b-4f78-a2c0-bedab2da5ebf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:05.492964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db369df0-564b-4f78-a2c0-bedab2da5ebf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:05.645520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-db369df0-564b-4f78-a2c0-bedab2da5ebf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:05.654803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-db369df0-564b-4f78-a2c0-bedab2da5ebf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:05.656350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-db369df0-564b-4f78-a2c0-bedab2da5ebf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:05.657653 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db369df0-564b-4f78-a2c0-bedab2da5ebf tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.179583 Aug 09 14:35:05.658228 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 631/1226] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:05 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:05.702351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27a2cb7a-2bd8-43c4-bc9d-8bb59f6325a7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:05.703207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-27a2cb7a-2bd8-43c4-bc9d-8bb59f6325a7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:05.709626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27a2cb7a-2bd8-43c4-bc9d-8bb59f6325a7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:05.710168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27a2cb7a-2bd8-43c4-bc9d-8bb59f6325a7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:05.710668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27a2cb7a-2bd8-43c4-bc9d-8bb59f6325a7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:05.711450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27a2cb7a-2bd8-43c4-bc9d-8bb59f6325a7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:05.711980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27a2cb7a-2bd8-43c4-bc9d-8bb59f6325a7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:05.712460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27a2cb7a-2bd8-43c4-bc9d-8bb59f6325a7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:05.846556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-27a2cb7a-2bd8-43c4-bc9d-8bb59f6325a7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:05.856254 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-27a2cb7a-2bd8-43c4-bc9d-8bb59f6325a7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.158482 Aug 09 14:35:05.856851 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 596/1227] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:05 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:05.857726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07746a9a-e0d4-418d-b128-b8478d68ddf7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:05.858342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07746a9a-e0d4-418d-b128-b8478d68ddf7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:05.867311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07746a9a-e0d4-418d-b128-b8478d68ddf7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:05.867931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07746a9a-e0d4-418d-b128-b8478d68ddf7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:05.868473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07746a9a-e0d4-418d-b128-b8478d68ddf7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:05.869279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07746a9a-e0d4-418d-b128-b8478d68ddf7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:05.869918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07746a9a-e0d4-418d-b128-b8478d68ddf7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:05.870361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07746a9a-e0d4-418d-b128-b8478d68ddf7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:06.017319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07746a9a-e0d4-418d-b128-b8478d68ddf7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:06.031876 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07746a9a-e0d4-418d-b128-b8478d68ddf7 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1" status: 200 len: 1474 microversion: 2.1 time: 0.178666 Aug 09 14:35:06.032518 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 632/1228] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:05 2022] GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1 => generated 1474 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:06.506254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aa290f96-bf43-4f07-a7bf-99ddfd577435 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:06.506881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aa290f96-bf43-4f07-a7bf-99ddfd577435 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:06.514004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa290f96-bf43-4f07-a7bf-99ddfd577435 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:06.514490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa290f96-bf43-4f07-a7bf-99ddfd577435 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:06.514922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa290f96-bf43-4f07-a7bf-99ddfd577435 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:06.515647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa290f96-bf43-4f07-a7bf-99ddfd577435 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:06.516103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa290f96-bf43-4f07-a7bf-99ddfd577435 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:06.516515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa290f96-bf43-4f07-a7bf-99ddfd577435 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:06.642688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ba2bb053-a3e2-43d9-9d93-36bbf6873df9 req-69e5236b-c1b3-44e6-9228-ce157f0bdf63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e378f03a-f41f-4a85-b1bd-68c0f863acd8", "tag": "e9321539-69db-4652-aad2-ee56c29966f9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:06.653671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ba2bb053-a3e2-43d9-9d93-36bbf6873df9 req-69e5236b-c1b3-44e6-9228-ce157f0bdf63 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:06.654367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ba2bb053-a3e2-43d9-9d93-36bbf6873df9 req-69e5236b-c1b3-44e6-9228-ce157f0bdf63 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:06.654793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ba2bb053-a3e2-43d9-9d93-36bbf6873df9 req-69e5236b-c1b3-44e6-9228-ce157f0bdf63 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:06.655358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aa290f96-bf43-4f07-a7bf-99ddfd577435 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:06.664633 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aa290f96-bf43-4f07-a7bf-99ddfd577435 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1316 microversion: 2.1 time: 0.162254 Aug 09 14:35:06.666579 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 597/1229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:06 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:06.667265 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ba2bb053-a3e2-43d9-9d93-36bbf6873df9 req-69e5236b-c1b3-44e6-9228-ce157f0bdf63 service nova] Creating event network-changed:e9321539-69db-4652-aad2-ee56c29966f9 for instance e378f03a-f41f-4a85-b1bd-68c0f863acd8 on n-h2-844626-8 Aug 09 14:35:06.672894 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ba2bb053-a3e2-43d9-9d93-36bbf6873df9 req-69e5236b-c1b3-44e6-9228-ce157f0bdf63 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033973 Aug 09 14:35:06.673542 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 633/1230] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:06.681653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0e5877d-19e9-4766-b5e9-2626f7056846 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:06.682258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0e5877d-19e9-4766-b5e9-2626f7056846 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:06.688609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e5877d-19e9-4766-b5e9-2626f7056846 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:06.689289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e5877d-19e9-4766-b5e9-2626f7056846 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:06.689721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e5877d-19e9-4766-b5e9-2626f7056846 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:06.690430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e5877d-19e9-4766-b5e9-2626f7056846 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:06.690878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e5877d-19e9-4766-b5e9-2626f7056846 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:06.691308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0e5877d-19e9-4766-b5e9-2626f7056846 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:06.826711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0e5877d-19e9-4766-b5e9-2626f7056846 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:06.835910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0e5877d-19e9-4766-b5e9-2626f7056846 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:06.837443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0e5877d-19e9-4766-b5e9-2626f7056846 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:06.838628 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0e5877d-19e9-4766-b5e9-2626f7056846 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.161452 Aug 09 14:35:06.854296 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 598/1231] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:06 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:06.877995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a76fa636-f37f-4b77-bfa5-e48ef1430b7c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:06.878746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a76fa636-f37f-4b77-bfa5-e48ef1430b7c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:06.885335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a76fa636-f37f-4b77-bfa5-e48ef1430b7c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:06.885817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a76fa636-f37f-4b77-bfa5-e48ef1430b7c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:06.886257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a76fa636-f37f-4b77-bfa5-e48ef1430b7c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:06.886956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a76fa636-f37f-4b77-bfa5-e48ef1430b7c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:06.887428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a76fa636-f37f-4b77-bfa5-e48ef1430b7c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:06.887849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a76fa636-f37f-4b77-bfa5-e48ef1430b7c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:07.025022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a76fa636-f37f-4b77-bfa5-e48ef1430b7c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:07.033337 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a76fa636-f37f-4b77-bfa5-e48ef1430b7c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.159937 Aug 09 14:35:07.034246 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 634/1232] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:06 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:07.054105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1344fcbe-b3c7-48ad-a407-230aa0230040 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:07.054761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1344fcbe-b3c7-48ad-a407-230aa0230040 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:07.061030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1344fcbe-b3c7-48ad-a407-230aa0230040 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:07.061552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1344fcbe-b3c7-48ad-a407-230aa0230040 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:07.061975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1344fcbe-b3c7-48ad-a407-230aa0230040 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:07.062887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1344fcbe-b3c7-48ad-a407-230aa0230040 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:07.063407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1344fcbe-b3c7-48ad-a407-230aa0230040 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:07.064057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1344fcbe-b3c7-48ad-a407-230aa0230040 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:07.129372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1344fcbe-b3c7-48ad-a407-230aa0230040 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:07.137477 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1344fcbe-b3c7-48ad-a407-230aa0230040 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1" status: 200 len: 1432 microversion: 2.1 time: 0.087513 Aug 09 14:35:07.138049 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 599/1233] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:07 2022] GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1 => generated 1432 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:07.686272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07813e63-77c3-468b-ae22-f47139ac461d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:07.686841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07813e63-77c3-468b-ae22-f47139ac461d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:07.694506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07813e63-77c3-468b-ae22-f47139ac461d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:07.695004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07813e63-77c3-468b-ae22-f47139ac461d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:07.695476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07813e63-77c3-468b-ae22-f47139ac461d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:07.696181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07813e63-77c3-468b-ae22-f47139ac461d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:07.696633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07813e63-77c3-468b-ae22-f47139ac461d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:07.697060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07813e63-77c3-468b-ae22-f47139ac461d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:07.839982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07813e63-77c3-468b-ae22-f47139ac461d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:07.848338 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07813e63-77c3-468b-ae22-f47139ac461d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1316 microversion: 2.1 time: 0.165970 Aug 09 14:35:07.849053 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 635/1234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:07 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:07.862510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-625e9389-3dd4-41c4-b9fb-f75cdc572e1c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:07.863335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-625e9389-3dd4-41c4-b9fb-f75cdc572e1c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:07.870681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625e9389-3dd4-41c4-b9fb-f75cdc572e1c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:07.871188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625e9389-3dd4-41c4-b9fb-f75cdc572e1c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:07.871610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625e9389-3dd4-41c4-b9fb-f75cdc572e1c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:07.872297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625e9389-3dd4-41c4-b9fb-f75cdc572e1c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:07.872737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625e9389-3dd4-41c4-b9fb-f75cdc572e1c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:07.873166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625e9389-3dd4-41c4-b9fb-f75cdc572e1c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:08.015236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-625e9389-3dd4-41c4-b9fb-f75cdc572e1c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:08.024671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-625e9389-3dd4-41c4-b9fb-f75cdc572e1c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:08.026256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-625e9389-3dd4-41c4-b9fb-f75cdc572e1c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:08.027680 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-625e9389-3dd4-41c4-b9fb-f75cdc572e1c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.169318 Aug 09 14:35:08.028271 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 600/1235] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:07 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:08.054571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b0094080-536f-4287-9877-4fb714142a29 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:08.055483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b0094080-536f-4287-9877-4fb714142a29 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:08.063060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0094080-536f-4287-9877-4fb714142a29 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:08.063588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0094080-536f-4287-9877-4fb714142a29 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:08.064152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0094080-536f-4287-9877-4fb714142a29 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:08.064943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0094080-536f-4287-9877-4fb714142a29 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:08.065394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0094080-536f-4287-9877-4fb714142a29 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:08.065819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0094080-536f-4287-9877-4fb714142a29 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:08.159843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b457bdb-b024-4b43-addd-c936efde7604 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:08.162137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b457bdb-b024-4b43-addd-c936efde7604 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:08.168917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b457bdb-b024-4b43-addd-c936efde7604 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:08.169407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b457bdb-b024-4b43-addd-c936efde7604 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:08.169837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b457bdb-b024-4b43-addd-c936efde7604 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:08.170573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b457bdb-b024-4b43-addd-c936efde7604 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:08.171041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b457bdb-b024-4b43-addd-c936efde7604 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:08.171457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b457bdb-b024-4b43-addd-c936efde7604 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:08.206386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b0094080-536f-4287-9877-4fb714142a29 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:08.214445 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b0094080-536f-4287-9877-4fb714142a29 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1543 microversion: 2.1 time: 0.164437 Aug 09 14:35:08.215046 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 636/1236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:08 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1543 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:08.235875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9b457bdb-b024-4b43-addd-c936efde7604 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b1fd7b4e40e49828ab24bfced256417', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9197a5676004ed888ef46000067e150', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:08.244020 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b457bdb-b024-4b43-addd-c936efde7604 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1" status: 200 len: 1303 microversion: 2.1 time: 0.088587 Aug 09 14:35:08.244609 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 601/1237] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:08 2022] GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1 => generated 1303 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:08.701914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-afc9dfc7-3bd8-4aff-afd8-85ed17a56abe req-9725c9a2-24a1-416d-9375-7f1584a49f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ba6d964-167a-4b1e-94f0-fb74f63c03f1", "name": "network-vif-deleted", "tag": "e4f9d82e-39ab-4f23-91b4-e30a41b072c4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:08.713178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-afc9dfc7-3bd8-4aff-afd8-85ed17a56abe req-9725c9a2-24a1-416d-9375-7f1584a49f6c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:08.713678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-afc9dfc7-3bd8-4aff-afd8-85ed17a56abe req-9725c9a2-24a1-416d-9375-7f1584a49f6c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:08.714129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-afc9dfc7-3bd8-4aff-afd8-85ed17a56abe req-9725c9a2-24a1-416d-9375-7f1584a49f6c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:08.726721 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-afc9dfc7-3bd8-4aff-afd8-85ed17a56abe req-9725c9a2-24a1-416d-9375-7f1584a49f6c service nova] Creating event network-vif-deleted:e4f9d82e-39ab-4f23-91b4-e30a41b072c4 for instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 on n-h2-844626-8 Aug 09 14:35:08.732495 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-afc9dfc7-3bd8-4aff-afd8-85ed17a56abe req-9725c9a2-24a1-416d-9375-7f1584a49f6c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034493 Aug 09 14:35:08.733360 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 637/1238] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:08.869150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dde3b68c-81f4-46de-a6fd-d1c37422be66 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:08.870018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dde3b68c-81f4-46de-a6fd-d1c37422be66 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:08.877715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dde3b68c-81f4-46de-a6fd-d1c37422be66 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:08.878198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dde3b68c-81f4-46de-a6fd-d1c37422be66 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:08.878623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dde3b68c-81f4-46de-a6fd-d1c37422be66 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:08.879734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dde3b68c-81f4-46de-a6fd-d1c37422be66 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:08.880188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dde3b68c-81f4-46de-a6fd-d1c37422be66 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:08.880602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dde3b68c-81f4-46de-a6fd-d1c37422be66 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:09.045292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dde3b68c-81f4-46de-a6fd-d1c37422be66 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:09.051561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0c698f32-7733-4b14-833c-5cfba8b65215 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:09.052352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0c698f32-7733-4b14-833c-5cfba8b65215 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:09.054162 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dde3b68c-81f4-46de-a6fd-d1c37422be66 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1316 microversion: 2.1 time: 0.189143 Aug 09 14:35:09.054768 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 602/1239] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:08 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:09.059182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c698f32-7733-4b14-833c-5cfba8b65215 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:09.059741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c698f32-7733-4b14-833c-5cfba8b65215 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:09.060236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c698f32-7733-4b14-833c-5cfba8b65215 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:09.060934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c698f32-7733-4b14-833c-5cfba8b65215 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:09.061412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c698f32-7733-4b14-833c-5cfba8b65215 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:09.061828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c698f32-7733-4b14-833c-5cfba8b65215 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:09.207993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0c698f32-7733-4b14-833c-5cfba8b65215 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:09.216865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0c698f32-7733-4b14-833c-5cfba8b65215 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:09.218397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0c698f32-7733-4b14-833c-5cfba8b65215 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:09.220281 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0c698f32-7733-4b14-833c-5cfba8b65215 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.173588 Aug 09 14:35:09.220854 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 638/1240] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:09 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:35:09.237329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0c276a9-b8b3-4878-b224-24cfcfa60ffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:09.237859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0c276a9-b8b3-4878-b224-24cfcfa60ffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:09.245788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0c276a9-b8b3-4878-b224-24cfcfa60ffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:09.246809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0c276a9-b8b3-4878-b224-24cfcfa60ffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:09.247482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0c276a9-b8b3-4878-b224-24cfcfa60ffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:09.248188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0c276a9-b8b3-4878-b224-24cfcfa60ffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:09.248654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0c276a9-b8b3-4878-b224-24cfcfa60ffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:09.249393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0c276a9-b8b3-4878-b224-24cfcfa60ffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:09.263947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5413a03f-ee54-4ef4-b7af-3b8f9ba80808 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:09.264551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5413a03f-ee54-4ef4-b7af-3b8f9ba80808 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] [instance: 1ba6d964-167a-4b1e-94f0-fb74f63c03f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:09.280059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5413a03f-ee54-4ef4-b7af-3b8f9ba80808 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:09.280771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5413a03f-ee54-4ef4-b7af-3b8f9ba80808 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:09.281095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5413a03f-ee54-4ef4-b7af-3b8f9ba80808 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:09.281778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5413a03f-ee54-4ef4-b7af-3b8f9ba80808 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:09.282233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5413a03f-ee54-4ef4-b7af-3b8f9ba80808 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:09.282690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5413a03f-ee54-4ef4-b7af-3b8f9ba80808 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:09.302889 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-5413a03f-ee54-4ef4-b7af-3b8f9ba80808 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] HTTP exception thrown: Instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 could not be found. Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5413a03f-ee54-4ef4-b7af-3b8f9ba80808 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Request method failure captured: Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1 HTTP/1.1 Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nAqINQsgeYjahBWKXd2Nd92GXyJjddZYc01xdUDWov3GJAqUZs_cSEpNtm_mZsNngdHrxMKF3e1PpyF0Bys71JJPjCe6aeq9PRJIPTnKEt7GyIMrEECULjYRPud7ZMAubCqaQDBHS42ZMpw3MBQWlHsLO7JqUzGeeFc4XEkY1x7N50 Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a9197a5676004ed888ef46000067e150 Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ListImageFiltersTestJSON-1119937407 Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a9197a5676004ed888ef46000067e150", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a9197a5676004ed888ef46000067e150"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a9197a5676004ed888ef46000067e150"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a9197a5676004ed888ef46000067e150"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ListImageFiltersTestJSON-1119937407 Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a9197a5676004ed888ef46000067e150 Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1119937407 Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ListImageFiltersTestJSON-1119937407-project Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 8b1fd7b4e40e49828ab24bfced256417 Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ListImageFiltersTestJSON-1119937407-project Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 could not be found. Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '1ba6d964-167a-4b1e-94f0-fb74f63c03f1'} Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 could not be found. Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 could not be found. Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:09.305317 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:09.309391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:09.309391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:09.309391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:09.309391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:09.309391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:09.309391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 could not be found. Aug 09 14:35:09.309391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:09.312002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5413a03f-ee54-4ef4-b7af-3b8f9ba80808 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Returning 404 to user: Instance 1ba6d964-167a-4b1e-94f0-fb74f63c03f1 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:09.313102 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5413a03f-ee54-4ef4-b7af-3b8f9ba80808 tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1" status: 404 len: 111 microversion: 2.1 time: 0.053054 Aug 09 14:35:09.314157 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 639/1241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:09 2022] GET /compute/v2.1/servers/1ba6d964-167a-4b1e-94f0-fb74f63c03f1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:35:09.319617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a37cdf7f-c98e-443a-a252-934f35b941d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: .version_select at 0x7f41ddf241f0>, body: {"keypair": {"name": "tempest-keypair-1426994126", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErucuXQadlXEefYySa6XsFq+y0wlH1Nhbzikmt70mwCxwFBd0DNQW385jM8FYMY7fKmjNbNHHxk7JbqV/jgN70xxRdAm9cjBJdCsdbTt/GpSuIBRG93huWDXP37UevzRw=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:09.340111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-a37cdf7f-c98e-443a-a252-934f35b941d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:35:09.345093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-a37cdf7f-c98e-443a-a252-934f35b941d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for user 788fc5ec92a2482db1b27657c4f6b426 and project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:35:09.378615 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a37cdf7f-c98e-443a-a252-934f35b941d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063066 Aug 09 14:35:09.379707 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 640/1242] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:35:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:09.384897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f18dbb27-36ed-421e-849b-cd14b7f1463c tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41de17d4c0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:09.440689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0c276a9-b8b3-4878-b224-24cfcfa60ffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:09.458871 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0c276a9-b8b3-4878-b224-24cfcfa60ffe tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1542 microversion: 2.1 time: 0.224015 Aug 09 14:35:09.461060 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 603/1243] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:09 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1542 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:09.655758 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f18dbb27-36ed-421e-849b-cd14b7f1463c tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "DELETE /compute/v2.1/images/37b93773-84ef-4e24-b8cb-16017e8918d7" status: 204 len: 0 microversion: 2.1 time: 0.274571 Aug 09 14:35:09.656342 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 641/1244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:09 2022] DELETE /compute/v2.1/images/37b93773-84ef-4e24-b8cb-16017e8918d7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:35:09.664796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f53de8e3-bb6a-4c21-91b9-1fc6045177ea tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41dde60c10>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:09.897652 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f53de8e3-bb6a-4c21-91b9-1fc6045177ea tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "DELETE /compute/v2.1/images/cff39c94-ccdd-4b3e-9538-9f47a01755c2" status: 204 len: 0 microversion: 2.1 time: 0.236825 Aug 09 14:35:09.901220 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 604/1245] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:09 2022] DELETE /compute/v2.1/images/cff39c94-ccdd-4b3e-9538-9f47a01755c2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:35:09.907331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9849f85-332f-4d55-8ffd-3dd29bae4bcd tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] Calling method '.version_select at 0x7f41de215ca0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:10.076182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d8cd2ec-3f88-4016-8b3b-9084d7ce9e72 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:10.076800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1d8cd2ec-3f88-4016-8b3b-9084d7ce9e72 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:10.084254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d8cd2ec-3f88-4016-8b3b-9084d7ce9e72 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:10.084857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d8cd2ec-3f88-4016-8b3b-9084d7ce9e72 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:10.085163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d8cd2ec-3f88-4016-8b3b-9084d7ce9e72 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:10.085866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d8cd2ec-3f88-4016-8b3b-9084d7ce9e72 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:10.086558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d8cd2ec-3f88-4016-8b3b-9084d7ce9e72 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:10.087041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d8cd2ec-3f88-4016-8b3b-9084d7ce9e72 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:10.196401 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c9849f85-332f-4d55-8ffd-3dd29bae4bcd tempest-ListImageFiltersTestJSON-1119937407 tempest-ListImageFiltersTestJSON-1119937407-project] 10.222.0.50 "DELETE /compute/v2.1/images/cca40997-f9ac-4862-a31f-1d532fef0d9e" status: 204 len: 0 microversion: 2.1 time: 0.293421 Aug 09 14:35:10.197433 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 642/1246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:09 2022] DELETE /compute/v2.1/images/cca40997-f9ac-4862-a31f-1d532fef0d9e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:35:10.247464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a16c0074-722c-4fd5-864f-9ed02ee338f4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:10.248528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a16c0074-722c-4fd5-864f-9ed02ee338f4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:10.257290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a16c0074-722c-4fd5-864f-9ed02ee338f4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:10.258144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a16c0074-722c-4fd5-864f-9ed02ee338f4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:10.259747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a16c0074-722c-4fd5-864f-9ed02ee338f4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:10.263884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d8cd2ec-3f88-4016-8b3b-9084d7ce9e72 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:10.268392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a16c0074-722c-4fd5-864f-9ed02ee338f4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:10.269037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a16c0074-722c-4fd5-864f-9ed02ee338f4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:10.269575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a16c0074-722c-4fd5-864f-9ed02ee338f4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:10.272530 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1d8cd2ec-3f88-4016-8b3b-9084d7ce9e72 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1316 microversion: 2.1 time: 0.199527 Aug 09 14:35:10.273284 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 605/1247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:10 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1316 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:10.431522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a16c0074-722c-4fd5-864f-9ed02ee338f4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:10.447000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a16c0074-722c-4fd5-864f-9ed02ee338f4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:10.451003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a16c0074-722c-4fd5-864f-9ed02ee338f4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:10.453150 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a16c0074-722c-4fd5-864f-9ed02ee338f4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.211684 Aug 09 14:35:10.454084 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 643/1248] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:10 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:10.482103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3e17db33-f26e-4cdd-abf6-5b2da18f93ff tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:10.482718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3e17db33-f26e-4cdd-abf6-5b2da18f93ff tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:10.507864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e17db33-f26e-4cdd-abf6-5b2da18f93ff tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:10.508248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e17db33-f26e-4cdd-abf6-5b2da18f93ff tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:10.508775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e17db33-f26e-4cdd-abf6-5b2da18f93ff tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:10.509504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e17db33-f26e-4cdd-abf6-5b2da18f93ff tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:10.509952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e17db33-f26e-4cdd-abf6-5b2da18f93ff tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:10.510561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e17db33-f26e-4cdd-abf6-5b2da18f93ff tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:10.669615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3e17db33-f26e-4cdd-abf6-5b2da18f93ff tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:10.678941 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3e17db33-f26e-4cdd-abf6-5b2da18f93ff tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1542 microversion: 2.1 time: 0.200935 Aug 09 14:35:10.680683 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 606/1249] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:10 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1542 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:10.756110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7a0bb006-7053-48b3-be69-9708b326275d req-b4231b97-e9be-48d7-9d18-4498bf54c2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a", "name": "network-vif-unplugged", "status": "completed", "tag": "1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b"}, {"name": "network-changed", "server_uuid": "02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a", "tag": "1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:10.766380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7a0bb006-7053-48b3-be69-9708b326275d req-b4231b97-e9be-48d7-9d18-4498bf54c2c4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:10.766852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7a0bb006-7053-48b3-be69-9708b326275d req-b4231b97-e9be-48d7-9d18-4498bf54c2c4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:10.767350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7a0bb006-7053-48b3-be69-9708b326275d req-b4231b97-e9be-48d7-9d18-4498bf54c2c4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:10.780205 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7a0bb006-7053-48b3-be69-9708b326275d req-b4231b97-e9be-48d7-9d18-4498bf54c2c4 service nova] Creating event network-vif-unplugged:1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b for instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a on n-h1-844626-8 Aug 09 14:35:10.780712 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7a0bb006-7053-48b3-be69-9708b326275d req-b4231b97-e9be-48d7-9d18-4498bf54c2c4 service nova] Creating event network-changed:1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b for instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a on n-h1-844626-8 Aug 09 14:35:10.786715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-7a0bb006-7053-48b3-be69-9708b326275d req-b4231b97-e9be-48d7-9d18-4498bf54c2c4 service nova] Instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 14:35:10.798980 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7a0bb006-7053-48b3-be69-9708b326275d req-b4231b97-e9be-48d7-9d18-4498bf54c2c4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.046504 Aug 09 14:35:10.799809 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 644/1250] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:11.269337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1855134103", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95a77029-1d4f-4aec-aada-849bacf4e174"}], "security_groups": [{"name": "tempest-securitygroup--1423303008"}], "key_name": "tempest-keypair-1426994126", "user_data": "}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:11.296701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aea1c805-bef8-4f54-a0e8-c39cc8487ba2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:11.297831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aea1c805-bef8-4f54-a0e8-c39cc8487ba2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:11.307803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aea1c805-bef8-4f54-a0e8-c39cc8487ba2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:11.308287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aea1c805-bef8-4f54-a0e8-c39cc8487ba2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:11.308888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aea1c805-bef8-4f54-a0e8-c39cc8487ba2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:11.309739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aea1c805-bef8-4f54-a0e8-c39cc8487ba2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:11.310359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aea1c805-bef8-4f54-a0e8-c39cc8487ba2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:11.310927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aea1c805-bef8-4f54-a0e8-c39cc8487ba2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:11.327576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:11.442290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] validate_networks() for [('95a77029-1d4f-4aec-aada-849bacf4e174', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:35:11.520502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:11.542453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aea1c805-bef8-4f54-a0e8-c39cc8487ba2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:11.550665 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aea1c805-bef8-4f54-a0e8-c39cc8487ba2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1316 microversion: 2.1 time: 0.258765 Aug 09 14:35:11.551318 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 645/1251] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:11 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:11.559643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b0aec6b-889a-4093-95d5-39efa48af4e1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:11.560710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b0aec6b-889a-4093-95d5-39efa48af4e1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:11.567534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b0aec6b-889a-4093-95d5-39efa48af4e1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:11.568344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b0aec6b-889a-4093-95d5-39efa48af4e1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:11.568942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b0aec6b-889a-4093-95d5-39efa48af4e1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:11.569825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b0aec6b-889a-4093-95d5-39efa48af4e1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:11.570428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b0aec6b-889a-4093-95d5-39efa48af4e1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:11.570996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b0aec6b-889a-4093-95d5-39efa48af4e1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:11.820172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b0aec6b-889a-4093-95d5-39efa48af4e1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:11.830242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b0aec6b-889a-4093-95d5-39efa48af4e1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:11.831798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b0aec6b-889a-4093-95d5-39efa48af4e1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:11.833482 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b0aec6b-889a-4093-95d5-39efa48af4e1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.281063 Aug 09 14:35:11.834233 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 646/1252] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:11 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:11.840287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4dc4e14-3d0d-4162-8f5b-7f41ef01e206 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:11.841138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a4dc4e14-3d0d-4162-8f5b-7f41ef01e206 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:11.847730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4dc4e14-3d0d-4162-8f5b-7f41ef01e206 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:11.848466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4dc4e14-3d0d-4162-8f5b-7f41ef01e206 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:11.849067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4dc4e14-3d0d-4162-8f5b-7f41ef01e206 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:11.850077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4dc4e14-3d0d-4162-8f5b-7f41ef01e206 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:11.850530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4dc4e14-3d0d-4162-8f5b-7f41ef01e206 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:11.850970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4dc4e14-3d0d-4162-8f5b-7f41ef01e206 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:12.015939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:12.052460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:35:12.053026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:35:12.053589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:35:12.054168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:35:12.055231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:35:12.064647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:12.065430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:12.065856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:12.066579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:12.067029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:12.067461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:12.070914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4dc4e14-3d0d-4162-8f5b-7f41ef01e206 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:12.079523 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4dc4e14-3d0d-4162-8f5b-7f41ef01e206 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1474 microversion: 2.1 time: 0.243578 Aug 09 14:35:12.081219 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 647/1253] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:11 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1474 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:12.088946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:35:12.093686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for user 788fc5ec92a2482db1b27657c4f6b426 and project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:35:12.106317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:35:12.108643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:35:12.159233 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5cf293a2-ab9d-40d5-bafc-a314248f9e87 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.893895 Aug 09 14:35:12.159882 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 607/1254] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:35:12.170864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a29d3136-cd67-42f8-8730-efd6ec2819a4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:12.171483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a29d3136-cd67-42f8-8730-efd6ec2819a4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:12.238553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a29d3136-cd67-42f8-8730-efd6ec2819a4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:12.254838 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a29d3136-cd67-42f8-8730-efd6ec2819a4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1242 microversion: 2.1 time: 0.087811 Aug 09 14:35:12.255662 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 648/1255] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:12 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:12.573133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6320c7b5-00f0-499d-9239-db40ac65f5b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:12.573883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6320c7b5-00f0-499d-9239-db40ac65f5b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:12.582766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6320c7b5-00f0-499d-9239-db40ac65f5b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:12.583745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6320c7b5-00f0-499d-9239-db40ac65f5b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:12.584354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6320c7b5-00f0-499d-9239-db40ac65f5b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:12.585224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6320c7b5-00f0-499d-9239-db40ac65f5b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:12.585838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6320c7b5-00f0-499d-9239-db40ac65f5b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:12.586258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6320c7b5-00f0-499d-9239-db40ac65f5b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:12.754963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6320c7b5-00f0-499d-9239-db40ac65f5b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:12.764391 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6320c7b5-00f0-499d-9239-db40ac65f5b7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1316 microversion: 2.1 time: 0.195341 Aug 09 14:35:12.777993 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 608/1256] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:12 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:12.857530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52220c8f-0b45-465c-8055-f0488c51b7bd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:12.858266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52220c8f-0b45-465c-8055-f0488c51b7bd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:12.867574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52220c8f-0b45-465c-8055-f0488c51b7bd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:12.868400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52220c8f-0b45-465c-8055-f0488c51b7bd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:12.868913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52220c8f-0b45-465c-8055-f0488c51b7bd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:12.869756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52220c8f-0b45-465c-8055-f0488c51b7bd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:12.870385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52220c8f-0b45-465c-8055-f0488c51b7bd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:12.870926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52220c8f-0b45-465c-8055-f0488c51b7bd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:13.077257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-52220c8f-0b45-465c-8055-f0488c51b7bd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:13.090577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-52220c8f-0b45-465c-8055-f0488c51b7bd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:13.093251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-52220c8f-0b45-465c-8055-f0488c51b7bd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:13.094977 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52220c8f-0b45-465c-8055-f0488c51b7bd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.241647 Aug 09 14:35:13.096137 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 649/1257] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:12 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:13.104952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79946919-061a-4372-aac4-50d068b226c1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:13.105708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79946919-061a-4372-aac4-50d068b226c1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:13.112889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79946919-061a-4372-aac4-50d068b226c1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:13.113782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79946919-061a-4372-aac4-50d068b226c1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:13.114561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79946919-061a-4372-aac4-50d068b226c1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:13.115739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79946919-061a-4372-aac4-50d068b226c1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:13.116193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79946919-061a-4372-aac4-50d068b226c1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:13.116999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79946919-061a-4372-aac4-50d068b226c1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:13.276041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87b5f1e9-a95b-4428-bc65-01d65b72cb12 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:13.276950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-87b5f1e9-a95b-4428-bc65-01d65b72cb12 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:13.284116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87b5f1e9-a95b-4428-bc65-01d65b72cb12 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:13.284999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87b5f1e9-a95b-4428-bc65-01d65b72cb12 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:13.285676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87b5f1e9-a95b-4428-bc65-01d65b72cb12 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:13.286609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87b5f1e9-a95b-4428-bc65-01d65b72cb12 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:13.287338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87b5f1e9-a95b-4428-bc65-01d65b72cb12 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:13.287974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87b5f1e9-a95b-4428-bc65-01d65b72cb12 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:13.303577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-79946919-061a-4372-aac4-50d068b226c1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:13.314390 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79946919-061a-4372-aac4-50d068b226c1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1474 microversion: 2.1 time: 0.215440 Aug 09 14:35:13.328224 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 609/1258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:13 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1474 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:13.387441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-87b5f1e9-a95b-4428-bc65-01d65b72cb12 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:13.398619 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87b5f1e9-a95b-4428-bc65-01d65b72cb12 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1294 microversion: 2.1 time: 0.126492 Aug 09 14:35:13.399574 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 650/1259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:13 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1294 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:13.802761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dfb12e4e-28e8-4026-b9a7-445aec584629 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:13.805922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dfb12e4e-28e8-4026-b9a7-445aec584629 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:13.831583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfb12e4e-28e8-4026-b9a7-445aec584629 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:13.832080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfb12e4e-28e8-4026-b9a7-445aec584629 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:13.832510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfb12e4e-28e8-4026-b9a7-445aec584629 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:13.833393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfb12e4e-28e8-4026-b9a7-445aec584629 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:13.834067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfb12e4e-28e8-4026-b9a7-445aec584629 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:13.834519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfb12e4e-28e8-4026-b9a7-445aec584629 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.055782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dfb12e4e-28e8-4026-b9a7-445aec584629 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:14.058096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:14.065639 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dfb12e4e-28e8-4026-b9a7-445aec584629 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1316 microversion: 2.1 time: 0.281894 Aug 09 14:35:14.070391 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 610/1260] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:13 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:14.129165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e78e205-8518-46cd-80c6-36b1233f78ea tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:14.130678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e78e205-8518-46cd-80c6-36b1233f78ea tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:14.140680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e78e205-8518-46cd-80c6-36b1233f78ea tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.141174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e78e205-8518-46cd-80c6-36b1233f78ea tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.141642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e78e205-8518-46cd-80c6-36b1233f78ea tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.142355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e78e205-8518-46cd-80c6-36b1233f78ea tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.142808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e78e205-8518-46cd-80c6-36b1233f78ea tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.143390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e78e205-8518-46cd-80c6-36b1233f78ea tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.311702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e78e205-8518-46cd-80c6-36b1233f78ea tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:14.321399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e78e205-8518-46cd-80c6-36b1233f78ea tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:14.322916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e78e205-8518-46cd-80c6-36b1233f78ea tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:14.324227 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e78e205-8518-46cd-80c6-36b1233f78ea tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.201043 Aug 09 14:35:14.339112 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 651/1261] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:14 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:14.339333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1308bce1-439a-4668-92b8-f0fdc9a3555e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:14.339333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1308bce1-439a-4668-92b8-f0fdc9a3555e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:14.343591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1308bce1-439a-4668-92b8-f0fdc9a3555e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.344070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1308bce1-439a-4668-92b8-f0fdc9a3555e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.344613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1308bce1-439a-4668-92b8-f0fdc9a3555e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.345249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1308bce1-439a-4668-92b8-f0fdc9a3555e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.345688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1308bce1-439a-4668-92b8-f0fdc9a3555e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.346287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1308bce1-439a-4668-92b8-f0fdc9a3555e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.423844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b21dc656-2f77-41e7-af4f-e58170b436d1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:14.424743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b21dc656-2f77-41e7-af4f-e58170b436d1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:14.446789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b21dc656-2f77-41e7-af4f-e58170b436d1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.449249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b21dc656-2f77-41e7-af4f-e58170b436d1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.449701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b21dc656-2f77-41e7-af4f-e58170b436d1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.452104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b21dc656-2f77-41e7-af4f-e58170b436d1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.452578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b21dc656-2f77-41e7-af4f-e58170b436d1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.453005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b21dc656-2f77-41e7-af4f-e58170b436d1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.587633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1308bce1-439a-4668-92b8-f0fdc9a3555e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:14.598457 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1308bce1-439a-4668-92b8-f0fdc9a3555e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1471 microversion: 2.1 time: 0.264151 Aug 09 14:35:14.619767 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 611/1262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:14 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1471 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:14.630971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:14.632627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:14.639421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.640179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.640765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.641837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.642447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.643019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.658561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b21dc656-2f77-41e7-af4f-e58170b436d1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:14.668150 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b21dc656-2f77-41e7-af4f-e58170b436d1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1302 microversion: 2.1 time: 0.252682 Aug 09 14:35:14.669327 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 652/1263] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:14 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1302 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:14.674348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db2c7e1d-b03c-4105-8bd5-7a609b6829f0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:14.675406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db2c7e1d-b03c-4105-8bd5-7a609b6829f0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:14.686650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db2c7e1d-b03c-4105-8bd5-7a609b6829f0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.687152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db2c7e1d-b03c-4105-8bd5-7a609b6829f0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.687848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db2c7e1d-b03c-4105-8bd5-7a609b6829f0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.688628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db2c7e1d-b03c-4105-8bd5-7a609b6829f0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.689245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db2c7e1d-b03c-4105-8bd5-7a609b6829f0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.689843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db2c7e1d-b03c-4105-8bd5-7a609b6829f0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.723712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db2c7e1d-b03c-4105-8bd5-7a609b6829f0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:35:14.730344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.731937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.732387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.733209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.734265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.734850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.777540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Getting quotas for project 21a086b8d4904e118283cea8eb12b678. Resources: {'cores', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:35:14.790590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Getting quotas for user c45d9a126a0841d5938ee21e8e87b293 and project 21a086b8d4904e118283cea8eb12b678. Resources: {'cores', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:35:14.937076 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db2c7e1d-b03c-4105-8bd5-7a609b6829f0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 204 len: 0 microversion: 2.1 time: 0.265742 Aug 09 14:35:14.938339 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 653/1264] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:14 2022] DELETE /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:35:14.958610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c6a66de-ffbd-4373-ae2f-068603057db4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:14.960206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6c6a66de-ffbd-4373-ae2f-068603057db4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:14.964336 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4d8d1d2-22c4-4b3d-a700-2ac7fff0cac5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "POST /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a/action" status: 202 len: 0 microversion: 2.1 time: 0.341088 Aug 09 14:35:14.969802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c6a66de-ffbd-4373-ae2f-068603057db4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.970614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c6a66de-ffbd-4373-ae2f-068603057db4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.970739 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 612/1265] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:35:14 2022] POST /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:14.971454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c6a66de-ffbd-4373-ae2f-068603057db4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.972782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c6a66de-ffbd-4373-ae2f-068603057db4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:14.973749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c6a66de-ffbd-4373-ae2f-068603057db4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:14.974391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c6a66de-ffbd-4373-ae2f-068603057db4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:14.984573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ae3237f9-2d95-4a35-a96b-6c35450a362e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:14.985421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ae3237f9-2d95-4a35-a96b-6c35450a362e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:15.005443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae3237f9-2d95-4a35-a96b-6c35450a362e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:15.005933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae3237f9-2d95-4a35-a96b-6c35450a362e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:15.006367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae3237f9-2d95-4a35-a96b-6c35450a362e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:15.007108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae3237f9-2d95-4a35-a96b-6c35450a362e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:15.007556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae3237f9-2d95-4a35-a96b-6c35450a362e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:15.007976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ae3237f9-2d95-4a35-a96b-6c35450a362e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:15.233341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6c6a66de-ffbd-4373-ae2f-068603057db4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:15.246662 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6c6a66de-ffbd-4373-ae2f-068603057db4 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1714 microversion: 2.1 time: 0.290511 Aug 09 14:35:15.249834 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 654/1266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:14 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1714 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:15.257984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c1c4dfc0-7769-41dd-b5de-fa0056381a80 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:15.263980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c1c4dfc0-7769-41dd-b5de-fa0056381a80 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:15.274313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c4dfc0-7769-41dd-b5de-fa0056381a80 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:15.279291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c4dfc0-7769-41dd-b5de-fa0056381a80 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:15.280168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c4dfc0-7769-41dd-b5de-fa0056381a80 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:15.281263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c4dfc0-7769-41dd-b5de-fa0056381a80 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:15.281949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c4dfc0-7769-41dd-b5de-fa0056381a80 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:15.284043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c4dfc0-7769-41dd-b5de-fa0056381a80 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:15.318526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ae3237f9-2d95-4a35-a96b-6c35450a362e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:15.328300 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ae3237f9-2d95-4a35-a96b-6c35450a362e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1470 microversion: 2.1 time: 0.356179 Aug 09 14:35:15.330792 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 613/1267] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:14 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1470 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:15.368579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32eb2821-3b3e-4bac-ac25-820a1dadcffd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:15.369194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32eb2821-3b3e-4bac-ac25-820a1dadcffd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:15.376621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32eb2821-3b3e-4bac-ac25-820a1dadcffd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:15.377107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32eb2821-3b3e-4bac-ac25-820a1dadcffd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:15.377538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32eb2821-3b3e-4bac-ac25-820a1dadcffd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:15.378230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32eb2821-3b3e-4bac-ac25-820a1dadcffd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:15.378674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32eb2821-3b3e-4bac-ac25-820a1dadcffd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:15.379114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32eb2821-3b3e-4bac-ac25-820a1dadcffd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:15.624074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-32eb2821-3b3e-4bac-ac25-820a1dadcffd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:15.638261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-32eb2821-3b3e-4bac-ac25-820a1dadcffd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:15.642843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c1c4dfc0-7769-41dd-b5de-fa0056381a80 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:15.653166 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c1c4dfc0-7769-41dd-b5de-fa0056381a80 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1316 microversion: 2.1 time: 0.401191 Aug 09 14:35:15.655823 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 655/1268] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:15 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1316 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:15.656049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-32eb2821-3b3e-4bac-ac25-820a1dadcffd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:15.658467 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32eb2821-3b3e-4bac-ac25-820a1dadcffd tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.297819 Aug 09 14:35:15.662383 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 614/1269] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:15 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:15.690239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-da09b689-7012-4503-bce4-bb2abbfa4f96 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:15.696565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-da09b689-7012-4503-bce4-bb2abbfa4f96 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:15.703826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da09b689-7012-4503-bce4-bb2abbfa4f96 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:15.704617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da09b689-7012-4503-bce4-bb2abbfa4f96 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:15.705217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da09b689-7012-4503-bce4-bb2abbfa4f96 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:15.706104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da09b689-7012-4503-bce4-bb2abbfa4f96 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:15.708354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da09b689-7012-4503-bce4-bb2abbfa4f96 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:15.711843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da09b689-7012-4503-bce4-bb2abbfa4f96 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:15.817363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da09b689-7012-4503-bce4-bb2abbfa4f96 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:15.825585 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-da09b689-7012-4503-bce4-bb2abbfa4f96 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1300 microversion: 2.1 time: 0.139312 Aug 09 14:35:15.826228 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 656/1270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:15 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:15.833572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-206290f1-0c32-4e89-89c9-f95246821513 req-d458f275-adb4-4eb0-82f2-ded7b0c4c9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e378f03a-f41f-4a85-b1bd-68c0f863acd8", "name": "network-vif-plugged", "status": "completed", "tag": "e9321539-69db-4652-aad2-ee56c29966f9"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:15.849826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-206290f1-0c32-4e89-89c9-f95246821513 req-d458f275-adb4-4eb0-82f2-ded7b0c4c9d0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:15.850695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-206290f1-0c32-4e89-89c9-f95246821513 req-d458f275-adb4-4eb0-82f2-ded7b0c4c9d0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:15.851364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-206290f1-0c32-4e89-89c9-f95246821513 req-d458f275-adb4-4eb0-82f2-ded7b0c4c9d0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:15.863894 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-206290f1-0c32-4e89-89c9-f95246821513 req-d458f275-adb4-4eb0-82f2-ded7b0c4c9d0 service nova] Creating event network-vif-plugged:e9321539-69db-4652-aad2-ee56c29966f9 for instance e378f03a-f41f-4a85-b1bd-68c0f863acd8 on n-h2-844626-8 Aug 09 14:35:15.869939 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-206290f1-0c32-4e89-89c9-f95246821513 req-d458f275-adb4-4eb0-82f2-ded7b0c4c9d0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040019 Aug 09 14:35:15.871270 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 615/1271] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:16.270180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-141b4d2c-1ee1-4665-9578-c0ec3b49c839 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:16.270728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-141b4d2c-1ee1-4665-9578-c0ec3b49c839 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:16.280434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-141b4d2c-1ee1-4665-9578-c0ec3b49c839 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:16.281198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-141b4d2c-1ee1-4665-9578-c0ec3b49c839 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:16.281789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-141b4d2c-1ee1-4665-9578-c0ec3b49c839 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:16.283706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-141b4d2c-1ee1-4665-9578-c0ec3b49c839 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:16.284376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-141b4d2c-1ee1-4665-9578-c0ec3b49c839 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:16.285360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-141b4d2c-1ee1-4665-9578-c0ec3b49c839 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:16.359341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3289d86a-5fcf-42b4-919d-56837dbbd942 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:16.360846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3289d86a-5fcf-42b4-919d-56837dbbd942 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:16.375820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3289d86a-5fcf-42b4-919d-56837dbbd942 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:16.376711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3289d86a-5fcf-42b4-919d-56837dbbd942 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:16.377382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3289d86a-5fcf-42b4-919d-56837dbbd942 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:16.378100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3289d86a-5fcf-42b4-919d-56837dbbd942 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:16.378549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3289d86a-5fcf-42b4-919d-56837dbbd942 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:16.378966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3289d86a-5fcf-42b4-919d-56837dbbd942 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:16.519431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-141b4d2c-1ee1-4665-9578-c0ec3b49c839 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:16.543105 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-141b4d2c-1ee1-4665-9578-c0ec3b49c839 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1714 microversion: 2.1 time: 0.276843 Aug 09 14:35:16.548447 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 657/1272] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:16 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1714 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:16.594341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3289d86a-5fcf-42b4-919d-56837dbbd942 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:16.603202 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3289d86a-5fcf-42b4-919d-56837dbbd942 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1470 microversion: 2.1 time: 0.251916 Aug 09 14:35:16.604391 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 616/1273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:16 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1470 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:16.677086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c5f54da-1077-4fc5-a775-92ff6436b583 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:16.677696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c5f54da-1077-4fc5-a775-92ff6436b583 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:16.685461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2e0f2d3-aba0-4d5f-a2b8-2384f775a31d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:16.686083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b2e0f2d3-aba0-4d5f-a2b8-2384f775a31d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:16.690075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c5f54da-1077-4fc5-a775-92ff6436b583 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:16.690575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c5f54da-1077-4fc5-a775-92ff6436b583 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:16.691010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c5f54da-1077-4fc5-a775-92ff6436b583 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:16.691747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c5f54da-1077-4fc5-a775-92ff6436b583 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:16.692192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c5f54da-1077-4fc5-a775-92ff6436b583 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:16.692593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2e0f2d3-aba0-4d5f-a2b8-2384f775a31d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:16.692749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c5f54da-1077-4fc5-a775-92ff6436b583 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:16.693380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2e0f2d3-aba0-4d5f-a2b8-2384f775a31d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:16.693807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2e0f2d3-aba0-4d5f-a2b8-2384f775a31d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:16.694502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2e0f2d3-aba0-4d5f-a2b8-2384f775a31d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:16.694950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2e0f2d3-aba0-4d5f-a2b8-2384f775a31d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:16.695394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2e0f2d3-aba0-4d5f-a2b8-2384f775a31d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:17.062014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c5f54da-1077-4fc5-a775-92ff6436b583 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:17.079805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2e0f2d3-aba0-4d5f-a2b8-2384f775a31d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:17.087030 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c5f54da-1077-4fc5-a775-92ff6436b583 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1316 microversion: 2.1 time: 0.410566 Aug 09 14:35:17.088357 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 658/1274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:16 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1316 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:17.094651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2e0f2d3-aba0-4d5f-a2b8-2384f775a31d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:17.100118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2e0f2d3-aba0-4d5f-a2b8-2384f775a31d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:17.101415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e8d9d78-7079-409b-80dc-92e0ed6b1ea6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:17.102172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e8d9d78-7079-409b-80dc-92e0ed6b1ea6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:17.102743 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2e0f2d3-aba0-4d5f-a2b8-2384f775a31d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.421461 Aug 09 14:35:17.104749 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 617/1275] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:16 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:17.109526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:17.116644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e8d9d78-7079-409b-80dc-92e0ed6b1ea6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:17.122800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e8d9d78-7079-409b-80dc-92e0ed6b1ea6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:17.123433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e8d9d78-7079-409b-80dc-92e0ed6b1ea6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:17.124269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e8d9d78-7079-409b-80dc-92e0ed6b1ea6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:17.124946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e8d9d78-7079-409b-80dc-92e0ed6b1ea6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:17.126264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e8d9d78-7079-409b-80dc-92e0ed6b1ea6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:17.201965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1e8d9d78-7079-409b-80dc-92e0ed6b1ea6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:17.210096 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e8d9d78-7079-409b-80dc-92e0ed6b1ea6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1300 microversion: 2.1 time: 0.119117 Aug 09 14:35:17.211000 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 659/1276] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:17 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:17.569981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9a9ee3b1-8870-4070-bc63-9ed39cb28985 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:17.571328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9a9ee3b1-8870-4070-bc63-9ed39cb28985 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:17.581991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9ee3b1-8870-4070-bc63-9ed39cb28985 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:17.583832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9ee3b1-8870-4070-bc63-9ed39cb28985 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:17.584347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9ee3b1-8870-4070-bc63-9ed39cb28985 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:17.585216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9ee3b1-8870-4070-bc63-9ed39cb28985 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:17.585925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9ee3b1-8870-4070-bc63-9ed39cb28985 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:17.586566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9ee3b1-8870-4070-bc63-9ed39cb28985 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:17.628759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d80df6cf-e1ab-4e00-ac7b-dd41a86febdd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:17.630854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d80df6cf-e1ab-4e00-ac7b-dd41a86febdd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:17.662525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d80df6cf-e1ab-4e00-ac7b-dd41a86febdd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:17.667498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d80df6cf-e1ab-4e00-ac7b-dd41a86febdd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:17.669857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d80df6cf-e1ab-4e00-ac7b-dd41a86febdd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:17.671030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d80df6cf-e1ab-4e00-ac7b-dd41a86febdd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:17.672295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d80df6cf-e1ab-4e00-ac7b-dd41a86febdd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:17.676737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d80df6cf-e1ab-4e00-ac7b-dd41a86febdd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:18.297980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9a9ee3b1-8870-4070-bc63-9ed39cb28985 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:18.344607 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9a9ee3b1-8870-4070-bc63-9ed39cb28985 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1714 microversion: 2.1 time: 0.777802 Aug 09 14:35:18.346959 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 618/1277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:17 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1714 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:18.355209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-202dc276-10b2-43c2-8e69-a5198210f892 req-9164bae1-1e38-48a5-99fd-24e4be591040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a", "name": "network-vif-plugged", "status": "completed", "tag": "1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:18.362913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d80df6cf-e1ab-4e00-ac7b-dd41a86febdd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:18.378541 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d80df6cf-e1ab-4e00-ac7b-dd41a86febdd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1470 microversion: 2.1 time: 0.757190 Aug 09 14:35:18.379410 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 660/1278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:17 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1470 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:18.389699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db433974-dd0a-49cd-8b51-c8c863f31b0d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:18.395840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db433974-dd0a-49cd-8b51-c8c863f31b0d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:18.398557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-202dc276-10b2-43c2-8e69-a5198210f892 req-9164bae1-1e38-48a5-99fd-24e4be591040 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:18.399331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-202dc276-10b2-43c2-8e69-a5198210f892 req-9164bae1-1e38-48a5-99fd-24e4be591040 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:18.403536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-202dc276-10b2-43c2-8e69-a5198210f892 req-9164bae1-1e38-48a5-99fd-24e4be591040 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:18.411984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db433974-dd0a-49cd-8b51-c8c863f31b0d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:18.412486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db433974-dd0a-49cd-8b51-c8c863f31b0d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:18.412918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db433974-dd0a-49cd-8b51-c8c863f31b0d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:18.413837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db433974-dd0a-49cd-8b51-c8c863f31b0d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:18.414450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db433974-dd0a-49cd-8b51-c8c863f31b0d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:18.415037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db433974-dd0a-49cd-8b51-c8c863f31b0d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:18.429030 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-202dc276-10b2-43c2-8e69-a5198210f892 req-9164bae1-1e38-48a5-99fd-24e4be591040 service nova] Creating event network-vif-plugged:1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b for instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a on n-h1-844626-8 Aug 09 14:35:18.435773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-202dc276-10b2-43c2-8e69-a5198210f892 req-9164bae1-1e38-48a5-99fd-24e4be591040 service nova] Instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 14:35:18.449537 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-202dc276-10b2-43c2-8e69-a5198210f892 req-9164bae1-1e38-48a5-99fd-24e4be591040 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100775 Aug 09 14:35:18.450198 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 619/1279] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:18.452826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:18.463655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b071cf1-5e8f-4bad-9299-e920503d841f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:18.464637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b071cf1-5e8f-4bad-9299-e920503d841f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:18.472025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b071cf1-5e8f-4bad-9299-e920503d841f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:18.472834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b071cf1-5e8f-4bad-9299-e920503d841f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:18.473286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b071cf1-5e8f-4bad-9299-e920503d841f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:18.474052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b071cf1-5e8f-4bad-9299-e920503d841f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:18.474534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b071cf1-5e8f-4bad-9299-e920503d841f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:18.475206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b071cf1-5e8f-4bad-9299-e920503d841f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:18.705983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-db433974-dd0a-49cd-8b51-c8c863f31b0d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:18.718568 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db433974-dd0a-49cd-8b51-c8c863f31b0d tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1466 microversion: 2.1 time: 0.337424 Aug 09 14:35:18.722617 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 661/1280] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:18 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1466 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:18.738024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-602db380-49dd-47a2-95b4-de512065fac5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:18.738024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-602db380-49dd-47a2-95b4-de512065fac5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:18.760669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-602db380-49dd-47a2-95b4-de512065fac5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:18.761183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-602db380-49dd-47a2-95b4-de512065fac5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:18.761635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-602db380-49dd-47a2-95b4-de512065fac5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:18.762333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-602db380-49dd-47a2-95b4-de512065fac5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:18.766998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-602db380-49dd-47a2-95b4-de512065fac5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:18.767780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-602db380-49dd-47a2-95b4-de512065fac5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:18.769410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b071cf1-5e8f-4bad-9299-e920503d841f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:18.781797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b071cf1-5e8f-4bad-9299-e920503d841f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:18.785873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b071cf1-5e8f-4bad-9299-e920503d841f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:18.803720 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b071cf1-5e8f-4bad-9299-e920503d841f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.351828 Aug 09 14:35:18.805351 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 620/1281] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:18 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:18.820792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f657e21f-df44-435e-8bb1-01bae0e984a3 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:18.824024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f657e21f-df44-435e-8bb1-01bae0e984a3 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:18.855067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f657e21f-df44-435e-8bb1-01bae0e984a3 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:18.860624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f657e21f-df44-435e-8bb1-01bae0e984a3 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:18.861792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f657e21f-df44-435e-8bb1-01bae0e984a3 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:18.863310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f657e21f-df44-435e-8bb1-01bae0e984a3 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:18.864005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f657e21f-df44-435e-8bb1-01bae0e984a3 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:18.864560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f657e21f-df44-435e-8bb1-01bae0e984a3 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:18.891838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-602db380-49dd-47a2-95b4-de512065fac5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:18.908468 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-602db380-49dd-47a2-95b4-de512065fac5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1300 microversion: 2.1 time: 0.184604 Aug 09 14:35:18.909947 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 662/1282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:18 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1300 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:19.078884 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f657e21f-df44-435e-8bb1-01bae0e984a3 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1617 microversion: 2.1 time: 0.271633 Aug 09 14:35:19.080166 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 621/1283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:18 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1617 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:19.208407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1720042510", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "5c29a36e-08bc-48f8-ae8c-029a5dbf060f"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:19.269052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:35:19.374835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14d5ff3c-cb95-42a0-9177-28184f191f59 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:19.375745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14d5ff3c-cb95-42a0-9177-28184f191f59 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:19.385891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14d5ff3c-cb95-42a0-9177-28184f191f59 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:19.386453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14d5ff3c-cb95-42a0-9177-28184f191f59 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:19.386968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14d5ff3c-cb95-42a0-9177-28184f191f59 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:19.387894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14d5ff3c-cb95-42a0-9177-28184f191f59 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:19.388457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14d5ff3c-cb95-42a0-9177-28184f191f59 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:19.389017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14d5ff3c-cb95-42a0-9177-28184f191f59 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:19.600235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:35:19.601109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:35:19.601980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:35:19.602740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:35:19.603432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:35:19.619714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:19.620450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:19.621031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:19.621941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:19.622554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:19.623153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:19.643700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for project 9471973b988a4c31be31dde4cef1489e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:35:19.649086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Getting quotas for user d68dcb9c00cf4ffebcc05a7d44793468 and project 9471973b988a4c31be31dde4cef1489e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:35:19.651393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14d5ff3c-cb95-42a0-9177-28184f191f59 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:19.665702 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14d5ff3c-cb95-42a0-9177-28184f191f59 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1714 microversion: 2.1 time: 0.300071 Aug 09 14:35:19.691204 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 622/1284] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:19 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1714 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:19.693644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b599f130-6f36-4977-a6b1-58ea5fe13a49 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:19.695976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b599f130-6f36-4977-a6b1-58ea5fe13a49 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:19.707609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b599f130-6f36-4977-a6b1-58ea5fe13a49 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:19.708218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b599f130-6f36-4977-a6b1-58ea5fe13a49 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:19.708791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b599f130-6f36-4977-a6b1-58ea5fe13a49 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:19.709803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b599f130-6f36-4977-a6b1-58ea5fe13a49 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:19.711254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b599f130-6f36-4977-a6b1-58ea5fe13a49 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:19.711767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b599f130-6f36-4977-a6b1-58ea5fe13a49 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:19.712815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:35:19.718228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:35:19.812201 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-922a9138-fb8d-4ef4-b82b-8acfe4080acb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608493 Aug 09 14:35:19.814276 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 663/1285] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:35:19.850137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d3524186-4487-437d-9b17-e0b1cf2c6fa8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:19.850764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3524186-4487-437d-9b17-e0b1cf2c6fa8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:19.977857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d3524186-4487-437d-9b17-e0b1cf2c6fa8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:19.986458 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d3524186-4487-437d-9b17-e0b1cf2c6fa8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1217 microversion: 2.1 time: 0.148965 Aug 09 14:35:19.999816 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 664/1286] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:19 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:20.005558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-713d54c3-7d8d-4dc2-b6ab-7c781c8e257d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:20.006519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-713d54c3-7d8d-4dc2-b6ab-7c781c8e257d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:20.018299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b599f130-6f36-4977-a6b1-58ea5fe13a49 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:20.034522 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b599f130-6f36-4977-a6b1-58ea5fe13a49 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1470 microversion: 2.1 time: 0.351288 Aug 09 14:35:20.036005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-713d54c3-7d8d-4dc2-b6ab-7c781c8e257d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:20.036525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-713d54c3-7d8d-4dc2-b6ab-7c781c8e257d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:20.036958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-713d54c3-7d8d-4dc2-b6ab-7c781c8e257d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:20.037680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-713d54c3-7d8d-4dc2-b6ab-7c781c8e257d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:20.038120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-713d54c3-7d8d-4dc2-b6ab-7c781c8e257d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:20.038530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-713d54c3-7d8d-4dc2-b6ab-7c781c8e257d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:20.048518 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 623/1287] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:19 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1470 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:20.321567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-329667011", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "709902d5-3695-4c5b-b93a-9a6a11c6141b"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:20.333400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-713d54c3-7d8d-4dc2-b6ab-7c781c8e257d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:20.368225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-713d54c3-7d8d-4dc2-b6ab-7c781c8e257d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:20.375308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-713d54c3-7d8d-4dc2-b6ab-7c781c8e257d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:20.378514 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-713d54c3-7d8d-4dc2-b6ab-7c781c8e257d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.377542 Aug 09 14:35:20.398577 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 665/1288] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:19 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:20.423176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37bfc577-a46d-4c41-9394-384f2351d639 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:20.425202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37bfc577-a46d-4c41-9394-384f2351d639 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:20.432956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37bfc577-a46d-4c41-9394-384f2351d639 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:20.435104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37bfc577-a46d-4c41-9394-384f2351d639 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:20.435791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37bfc577-a46d-4c41-9394-384f2351d639 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:20.436770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37bfc577-a46d-4c41-9394-384f2351d639 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:20.437425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37bfc577-a46d-4c41-9394-384f2351d639 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:20.438273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37bfc577-a46d-4c41-9394-384f2351d639 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:20.448859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] validate_networks() for [('709902d5-3695-4c5b-b93a-9a6a11c6141b', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:35:21.256085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-37bfc577-a46d-4c41-9394-384f2351d639 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:21.269103 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37bfc577-a46d-4c41-9394-384f2351d639 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1368 microversion: 2.1 time: 0.864402 Aug 09 14:35:21.280340 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 666/1289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:20 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1368 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:21.285006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc2786c9-1abc-4bc2-8a27-1ea83e6eeb3f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:21.287312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc2786c9-1abc-4bc2-8a27-1ea83e6eeb3f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:21.294362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc2786c9-1abc-4bc2-8a27-1ea83e6eeb3f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:21.294852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc2786c9-1abc-4bc2-8a27-1ea83e6eeb3f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:21.296043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc2786c9-1abc-4bc2-8a27-1ea83e6eeb3f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:21.296765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc2786c9-1abc-4bc2-8a27-1ea83e6eeb3f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:21.297219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc2786c9-1abc-4bc2-8a27-1ea83e6eeb3f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:21.297643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc2786c9-1abc-4bc2-8a27-1ea83e6eeb3f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:21.527362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bc2786c9-1abc-4bc2-8a27-1ea83e6eeb3f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:21.543939 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc2786c9-1abc-4bc2-8a27-1ea83e6eeb3f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1646 microversion: 2.1 time: 0.273056 Aug 09 14:35:21.551707 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 667/1290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:21 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1646 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:21.567617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fdcd813b-64bb-44ae-aec2-78e99b55ef24 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:21.568354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fdcd813b-64bb-44ae-aec2-78e99b55ef24 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:21.579420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdcd813b-64bb-44ae-aec2-78e99b55ef24 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:21.580015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdcd813b-64bb-44ae-aec2-78e99b55ef24 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:21.580517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdcd813b-64bb-44ae-aec2-78e99b55ef24 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:21.583813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdcd813b-64bb-44ae-aec2-78e99b55ef24 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:21.584372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdcd813b-64bb-44ae-aec2-78e99b55ef24 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:21.584876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdcd813b-64bb-44ae-aec2-78e99b55ef24 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:21.785145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:35:21.785748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:35:21.785896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fdcd813b-64bb-44ae-aec2-78e99b55ef24 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:21.786240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:35:21.786643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:35:21.787586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:35:21.793648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:21.798394 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fdcd813b-64bb-44ae-aec2-78e99b55ef24 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1277 microversion: 2.1 time: 0.245374 Aug 09 14:35:21.799233 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 668/1291] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:21 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:21.805276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a2b4e48-5c6d-4e59-9da2-843552102215 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:21.805887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5a2b4e48-5c6d-4e59-9da2-843552102215 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:21.812707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a2b4e48-5c6d-4e59-9da2-843552102215 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:21.814213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a2b4e48-5c6d-4e59-9da2-843552102215 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:21.814834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a2b4e48-5c6d-4e59-9da2-843552102215 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:21.815754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a2b4e48-5c6d-4e59-9da2-843552102215 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:21.816360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a2b4e48-5c6d-4e59-9da2-843552102215 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:21.818252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a2b4e48-5c6d-4e59-9da2-843552102215 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:21.824214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:21.824993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:21.825716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:21.826787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:21.828514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:21.833415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:21.873067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Getting quotas for project ad88df8fe4f6443b873e9ebb10bb16be. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:35:21.879228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Getting quotas for user efbc2ae0e55c485ebed9f44090bfcfcd and project ad88df8fe4f6443b873e9ebb10bb16be. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:35:21.894292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:35:21.897112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:35:21.968294 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d493020-b508-4c3c-aac5-7939ca57943c tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.916177 Aug 09 14:35:21.970435 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 624/1292] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:35:21.981165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-831964d8-eaea-4d80-bc99-22007ff3cf2b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:21.984150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-831964d8-eaea-4d80-bc99-22007ff3cf2b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:21.998241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-831964d8-eaea-4d80-bc99-22007ff3cf2b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:22.004020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-831964d8-eaea-4d80-bc99-22007ff3cf2b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:22.004738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-831964d8-eaea-4d80-bc99-22007ff3cf2b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:22.007202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-831964d8-eaea-4d80-bc99-22007ff3cf2b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:22.007864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-831964d8-eaea-4d80-bc99-22007ff3cf2b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:22.009214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-831964d8-eaea-4d80-bc99-22007ff3cf2b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:22.022744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5a2b4e48-5c6d-4e59-9da2-843552102215 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:22.039478 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5a2b4e48-5c6d-4e59-9da2-843552102215 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1470 microversion: 2.1 time: 0.238567 Aug 09 14:35:22.040661 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 669/1293] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:21 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:22.048404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-9a2b0a91-1b18-40eb-ace5-c60daeddf3f8 req-92428619-d66c-47fe-8184-bcc993f025f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5121011-181e-440e-a97e-7580b76680f8", "name": "network-vif-deleted", "tag": "c56a23ec-eaaa-4df9-9eca-746a74cbfa42"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:22.066444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9a2b0a91-1b18-40eb-ace5-c60daeddf3f8 req-92428619-d66c-47fe-8184-bcc993f025f1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:22.067227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9a2b0a91-1b18-40eb-ace5-c60daeddf3f8 req-92428619-d66c-47fe-8184-bcc993f025f1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:22.068252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9a2b0a91-1b18-40eb-ace5-c60daeddf3f8 req-92428619-d66c-47fe-8184-bcc993f025f1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:22.082481 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9a2b0a91-1b18-40eb-ace5-c60daeddf3f8 req-92428619-d66c-47fe-8184-bcc993f025f1 service nova] Creating event network-vif-deleted:c56a23ec-eaaa-4df9-9eca-746a74cbfa42 for instance e5121011-181e-440e-a97e-7580b76680f8 on n-h1-844626-8 Aug 09 14:35:22.135911 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-9a2b0a91-1b18-40eb-ace5-c60daeddf3f8 req-92428619-d66c-47fe-8184-bcc993f025f1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083698 Aug 09 14:35:22.140311 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 670/1294] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:22.167924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9ca87cdd-2a52-4bbd-a05c-29f753d43261 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:22.172762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9ca87cdd-2a52-4bbd-a05c-29f753d43261 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:22.415137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9ca87cdd-2a52-4bbd-a05c-29f753d43261 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:22.432223 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9ca87cdd-2a52-4bbd-a05c-29f753d43261 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1216 microversion: 2.1 time: 0.286379 Aug 09 14:35:22.433969 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 671/1295] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:22 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1216 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:22.441388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-504feedc-e69f-4b1d-aadb-d34c64d1ba49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:22.445825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-504feedc-e69f-4b1d-aadb-d34c64d1ba49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:22.447946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-831964d8-eaea-4d80-bc99-22007ff3cf2b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:22.463250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-831964d8-eaea-4d80-bc99-22007ff3cf2b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:22.466352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-831964d8-eaea-4d80-bc99-22007ff3cf2b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:22.466749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-504feedc-e69f-4b1d-aadb-d34c64d1ba49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:22.467325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-504feedc-e69f-4b1d-aadb-d34c64d1ba49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:22.467723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-504feedc-e69f-4b1d-aadb-d34c64d1ba49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:22.469122 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-831964d8-eaea-4d80-bc99-22007ff3cf2b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1814 microversion: 2.25 time: 0.496933 Aug 09 14:35:22.470277 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 625/1296] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:21 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1814 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:22.486378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-504feedc-e69f-4b1d-aadb-d34c64d1ba49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:22.486378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-504feedc-e69f-4b1d-aadb-d34c64d1ba49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:22.486378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-504feedc-e69f-4b1d-aadb-d34c64d1ba49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:22.495000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7fbe7fab-3d35-4079-831d-82fa16b16eb9 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:22.495943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7fbe7fab-3d35-4079-831d-82fa16b16eb9 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:22.503440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fbe7fab-3d35-4079-831d-82fa16b16eb9 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:22.504248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fbe7fab-3d35-4079-831d-82fa16b16eb9 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:22.504877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fbe7fab-3d35-4079-831d-82fa16b16eb9 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:22.505807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fbe7fab-3d35-4079-831d-82fa16b16eb9 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:22.506460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fbe7fab-3d35-4079-831d-82fa16b16eb9 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:22.506875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fbe7fab-3d35-4079-831d-82fa16b16eb9 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:22.511964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:22.555334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7fbe7fab-3d35-4079-831d-82fa16b16eb9 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:35:22.696416 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7fbe7fab-3d35-4079-831d-82fa16b16eb9 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "DELETE /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 204 len: 0 microversion: 2.1 time: 0.205017 Aug 09 14:35:22.698914 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 626/1297] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:22 2022] DELETE /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:35:22.710327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-939228fe-74fb-45b9-97f9-8262e85878d0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:22.713359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-939228fe-74fb-45b9-97f9-8262e85878d0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:22.727779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-939228fe-74fb-45b9-97f9-8262e85878d0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:22.729934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-939228fe-74fb-45b9-97f9-8262e85878d0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:22.730510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-939228fe-74fb-45b9-97f9-8262e85878d0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:22.732425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-939228fe-74fb-45b9-97f9-8262e85878d0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:22.733076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-939228fe-74fb-45b9-97f9-8262e85878d0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:22.734489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-939228fe-74fb-45b9-97f9-8262e85878d0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:22.777182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-504feedc-e69f-4b1d-aadb-d34c64d1ba49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:22.784872 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-504feedc-e69f-4b1d-aadb-d34c64d1ba49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1368 microversion: 2.1 time: 0.349264 Aug 09 14:35:22.787599 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 672/1298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:22 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1368 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:22.796540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-064c89e4-5794-44ca-8803-129792156c91 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:22.808107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-064c89e4-5794-44ca-8803-129792156c91 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:22.814715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-064c89e4-5794-44ca-8803-129792156c91 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:22.815519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-064c89e4-5794-44ca-8803-129792156c91 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:22.815970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-064c89e4-5794-44ca-8803-129792156c91 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:22.816934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-064c89e4-5794-44ca-8803-129792156c91 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:22.817413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-064c89e4-5794-44ca-8803-129792156c91 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:22.817841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-064c89e4-5794-44ca-8803-129792156c91 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:22.977628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-939228fe-74fb-45b9-97f9-8262e85878d0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ef713c75d461291b2a6937db4a4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5a1dc39fe54b69b5473a9f86dcd34b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:23.002468 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-939228fe-74fb-45b9-97f9-8262e85878d0 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 200 len: 1646 microversion: 2.1 time: 0.301963 Aug 09 14:35:23.003397 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 627/1299] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:22 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 1646 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:23.029779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9bf1075-1a4a-42fc-8a52-f811b49b6f51 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:23.030998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a9bf1075-1a4a-42fc-8a52-f811b49b6f51 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:23.050357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9bf1075-1a4a-42fc-8a52-f811b49b6f51 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.052303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9bf1075-1a4a-42fc-8a52-f811b49b6f51 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.053289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9bf1075-1a4a-42fc-8a52-f811b49b6f51 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:23.056226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9bf1075-1a4a-42fc-8a52-f811b49b6f51 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.057770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9bf1075-1a4a-42fc-8a52-f811b49b6f51 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.059051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9bf1075-1a4a-42fc-8a52-f811b49b6f51 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:23.186102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a9bf1075-1a4a-42fc-8a52-f811b49b6f51 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:23.199051 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a9bf1075-1a4a-42fc-8a52-f811b49b6f51 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1287 microversion: 2.1 time: 0.193076 Aug 09 14:35:23.200344 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 628/1300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:23 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:23.206532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-97a1d07c-957a-46e7-a900-fd8e4bac9b10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:23.208323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-97a1d07c-957a-46e7-a900-fd8e4bac9b10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:23.215270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a1d07c-957a-46e7-a900-fd8e4bac9b10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.216594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a1d07c-957a-46e7-a900-fd8e4bac9b10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.217476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a1d07c-957a-46e7-a900-fd8e4bac9b10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:23.218338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a1d07c-957a-46e7-a900-fd8e4bac9b10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.218973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a1d07c-957a-46e7-a900-fd8e4bac9b10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.219707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a1d07c-957a-46e7-a900-fd8e4bac9b10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:23.240671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-064c89e4-5794-44ca-8803-129792156c91 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:23.272098 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-064c89e4-5794-44ca-8803-129792156c91 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1665 microversion: 2.1 time: 0.481717 Aug 09 14:35:23.274450 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 673/1301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:22 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1665 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:23.419344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-97a1d07c-957a-46e7-a900-fd8e4bac9b10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:23.427924 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-97a1d07c-957a-46e7-a900-fd8e4bac9b10 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1470 microversion: 2.1 time: 0.226228 Aug 09 14:35:23.428819 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 629/1302] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:23 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1470 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:23.454017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-76f392cf-b563-4358-8892-21b079cc9c28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:23.454810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-76f392cf-b563-4358-8892-21b079cc9c28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:23.461383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76f392cf-b563-4358-8892-21b079cc9c28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.462200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76f392cf-b563-4358-8892-21b079cc9c28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.462736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76f392cf-b563-4358-8892-21b079cc9c28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:23.463587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76f392cf-b563-4358-8892-21b079cc9c28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.464229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76f392cf-b563-4358-8892-21b079cc9c28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.464737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76f392cf-b563-4358-8892-21b079cc9c28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:23.495888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-71a62e46-7991-4072-b571-affde00a8620 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:23.496509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-71a62e46-7991-4072-b571-affde00a8620 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:23.504525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71a62e46-7991-4072-b571-affde00a8620 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.505006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71a62e46-7991-4072-b571-affde00a8620 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.505433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71a62e46-7991-4072-b571-affde00a8620 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:23.506117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71a62e46-7991-4072-b571-affde00a8620 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.506559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71a62e46-7991-4072-b571-affde00a8620 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.506962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71a62e46-7991-4072-b571-affde00a8620 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:23.538756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-76f392cf-b563-4358-8892-21b079cc9c28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:23.549327 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-76f392cf-b563-4358-8892-21b079cc9c28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1220 microversion: 2.1 time: 0.099080 Aug 09 14:35:23.550545 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 674/1303] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:23 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:23.779401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-71a62e46-7991-4072-b571-affde00a8620 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:23.789869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-71a62e46-7991-4072-b571-affde00a8620 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:23.791421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-71a62e46-7991-4072-b571-affde00a8620 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:23.792629 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-71a62e46-7991-4072-b571-affde00a8620 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1804 microversion: 2.25 time: 0.301022 Aug 09 14:35:23.793199 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 630/1304] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:23 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1804 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:35:23.810336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-54fcd8ab-cf7b-4fea-a4d7-7f4de4bfea75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:23.815541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-54fcd8ab-cf7b-4fea-a4d7-7f4de4bfea75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:23.818110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54fcd8ab-cf7b-4fea-a4d7-7f4de4bfea75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.818592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54fcd8ab-cf7b-4fea-a4d7-7f4de4bfea75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.819025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54fcd8ab-cf7b-4fea-a4d7-7f4de4bfea75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:23.819738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54fcd8ab-cf7b-4fea-a4d7-7f4de4bfea75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.820345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54fcd8ab-cf7b-4fea-a4d7-7f4de4bfea75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.820942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54fcd8ab-cf7b-4fea-a4d7-7f4de4bfea75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:23.822238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-80939212-6394-41f5-b239-9c8c1fcfb07c tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '.version_select at 0x7f41dd3c6e50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:23.834893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80939212-6394-41f5-b239-9c8c1fcfb07c tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.835561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80939212-6394-41f5-b239-9c8c1fcfb07c tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.836001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80939212-6394-41f5-b239-9c8c1fcfb07c tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:23.854014 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-80939212-6394-41f5-b239-9c8c1fcfb07c tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 3625 microversion: 2.25 time: 0.037037 Aug 09 14:35:23.855735 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 631/1305] 10.222.0.50 () {60 vars in 1184 bytes} [Tue Aug 9 14:35:23 2022] GET /compute/v2.1/os-migrations => generated 3625 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:23.874861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d9a5bfd9-03d8-4c56-bfe8-d9b28a676372 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:23.875528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d9a5bfd9-03d8-4c56-bfe8-d9b28a676372 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:23.883025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9a5bfd9-03d8-4c56-bfe8-d9b28a676372 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.883583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9a5bfd9-03d8-4c56-bfe8-d9b28a676372 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.884016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9a5bfd9-03d8-4c56-bfe8-d9b28a676372 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:23.884709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9a5bfd9-03d8-4c56-bfe8-d9b28a676372 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:23.885352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9a5bfd9-03d8-4c56-bfe8-d9b28a676372 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:23.885927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9a5bfd9-03d8-4c56-bfe8-d9b28a676372 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.261748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-54fcd8ab-cf7b-4fea-a4d7-7f4de4bfea75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:24.272735 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-54fcd8ab-cf7b-4fea-a4d7-7f4de4bfea75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1368 microversion: 2.1 time: 0.466510 Aug 09 14:35:24.274607 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 675/1306] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:23 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1368 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:24.279774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a3f1ed7-47e4-41a7-bd35-abf5453005f8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:24.280563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a3f1ed7-47e4-41a7-bd35-abf5453005f8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:24.290078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-d9a5bfd9-03d8-4c56-bfe8-d9b28a676372 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid acd6f697-9f2e-4825-998a-796902617f44 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:35:24.294178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a3f1ed7-47e4-41a7-bd35-abf5453005f8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.294897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a3f1ed7-47e4-41a7-bd35-abf5453005f8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.295527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a3f1ed7-47e4-41a7-bd35-abf5453005f8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.297234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a3f1ed7-47e4-41a7-bd35-abf5453005f8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.298449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a3f1ed7-47e4-41a7-bd35-abf5453005f8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.299125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a3f1ed7-47e4-41a7-bd35-abf5453005f8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.316958 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d9a5bfd9-03d8-4c56-bfe8-d9b28a676372 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 2423 microversion: 2.25 time: 0.448574 Aug 09 14:35:24.323894 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-1a3f1ed7-47e4-41a7-bd35-abf5453005f8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] HTTP exception thrown: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a3f1ed7-47e4-41a7-bd35-abf5453005f8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Request method failure captured: Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 HTTP/1.1 Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_mJq-XS0usX0sFnSH5QyFgBA-r9J8li62XHP88QkfgSta60kP74mogwNGT0qyvbm9xKO6_aZi3gmXyA-iXnBJCUIwy9Up6iSXMNDaexFeNNNkqKdmmWjtj435mVlUgBJNt39Z6rWXn3tpfxLxjjlJozsSclzfj9uh73b4L_mQALVs Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea5a1dc39fe54b69b5473a9f86dcd34b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d11ef713c75d461291b2a6937db4a4b1 Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'e5121011-181e-440e-a97e-7580b76680f8'} Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:24.325929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:24.331307 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:24.331307 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:24.331307 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:24.331307 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:24.331307 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:24.331307 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:24.331307 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:24.331307 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:24.331307 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:24.333220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a3f1ed7-47e4-41a7-bd35-abf5453005f8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Returning 404 to user: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:24.334330 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a3f1ed7-47e4-41a7-bd35-abf5453005f8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 404 len: 111 microversion: 2.1 time: 0.058549 Aug 09 14:35:24.335149 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 676/1307] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:24 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:35:24.337826 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 632/1308] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:23 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 2423 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:24.340497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e8e42015-854c-41a7-a93c-dff0b08dcac6 req-38303b6e-2cb8-49f4-8319-4b8378c792c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd1379b-b2dc-4866-9a3f-d4d03c495a25", "tag": "bb7074b5-7f36-447d-8b2a-ef303f0bc953"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:24.350437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6735a045-bb1b-4ab6-8ac8-a98ab3d5dbb4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:24.351015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e8e42015-854c-41a7-a93c-dff0b08dcac6 req-38303b6e-2cb8-49f4-8319-4b8378c792c4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.351488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6735a045-bb1b-4ab6-8ac8-a98ab3d5dbb4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:24.351655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e8e42015-854c-41a7-a93c-dff0b08dcac6 req-38303b6e-2cb8-49f4-8319-4b8378c792c4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.352085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e8e42015-854c-41a7-a93c-dff0b08dcac6 req-38303b6e-2cb8-49f4-8319-4b8378c792c4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.359128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6735a045-bb1b-4ab6-8ac8-a98ab3d5dbb4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.359845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6735a045-bb1b-4ab6-8ac8-a98ab3d5dbb4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.360489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6735a045-bb1b-4ab6-8ac8-a98ab3d5dbb4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.361369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6735a045-bb1b-4ab6-8ac8-a98ab3d5dbb4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.361959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6735a045-bb1b-4ab6-8ac8-a98ab3d5dbb4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.362517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6735a045-bb1b-4ab6-8ac8-a98ab3d5dbb4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.365239 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e8e42015-854c-41a7-a93c-dff0b08dcac6 req-38303b6e-2cb8-49f4-8319-4b8378c792c4 service nova] Creating event network-changed:bb7074b5-7f36-447d-8b2a-ef303f0bc953 for instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 on n-h1-844626-8 Aug 09 14:35:24.372250 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e8e42015-854c-41a7-a93c-dff0b08dcac6 req-38303b6e-2cb8-49f4-8319-4b8378c792c4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035708 Aug 09 14:35:24.373780 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 677/1309] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:24.380891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-142cbb3a-727c-4a35-94fb-4b148f7ad945 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:24.381838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-142cbb3a-727c-4a35-94fb-4b148f7ad945 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:24.390731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-142cbb3a-727c-4a35-94fb-4b148f7ad945 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.392191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-142cbb3a-727c-4a35-94fb-4b148f7ad945 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.392838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-142cbb3a-727c-4a35-94fb-4b148f7ad945 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.394126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-142cbb3a-727c-4a35-94fb-4b148f7ad945 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.394767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-142cbb3a-727c-4a35-94fb-4b148f7ad945 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.395497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-142cbb3a-727c-4a35-94fb-4b148f7ad945 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.628758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6735a045-bb1b-4ab6-8ac8-a98ab3d5dbb4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:24.639629 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6735a045-bb1b-4ab6-8ac8-a98ab3d5dbb4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1275 microversion: 2.1 time: 0.299599 Aug 09 14:35:24.651715 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 633/1310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:24 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1275 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:24.651715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ab71faa2-89e1-40df-b132-1bcab181ca83 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:24.651715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ab71faa2-89e1-40df-b132-1bcab181ca83 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:24.658809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab71faa2-89e1-40df-b132-1bcab181ca83 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.659555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab71faa2-89e1-40df-b132-1bcab181ca83 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.660261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab71faa2-89e1-40df-b132-1bcab181ca83 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.661143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab71faa2-89e1-40df-b132-1bcab181ca83 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.661800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab71faa2-89e1-40df-b132-1bcab181ca83 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.662413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab71faa2-89e1-40df-b132-1bcab181ca83 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.681038 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-ab71faa2-89e1-40df-b132-1bcab181ca83 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] HTTP exception thrown: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ab71faa2-89e1-40df-b132-1bcab181ca83 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Request method failure captured: Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 HTTP/1.1 Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_mJq-XS0usX0sFnSH5QyFgBA-r9J8li62XHP88QkfgSta60kP74mogwNGT0qyvbm9xKO6_aZi3gmXyA-iXnBJCUIwy9Up6iSXMNDaexFeNNNkqKdmmWjtj435mVlUgBJNt39Z6rWXn3tpfxLxjjlJozsSclzfj9uh73b4L_mQALVs Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea5a1dc39fe54b69b5473a9f86dcd34b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d11ef713c75d461291b2a6937db4a4b1 Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3d784e6b-2704-47cb-9cb5-225e4cace576'} Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:24.683615 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:24.689680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:24.689680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:24.689680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:24.689680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:24.689680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:24.689680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:24.689680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:24.689680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:24.689680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:24.689680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:24.689680 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:24.691593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ab71faa2-89e1-40df-b132-1bcab181ca83 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Returning 404 to user: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:24.692467 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ab71faa2-89e1-40df-b132-1bcab181ca83 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 404 len: 111 microversion: 2.1 time: 0.050634 Aug 09 14:35:24.693043 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 634/1311] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:24 2022] DELETE /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:35:24.697868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1206be28-3b50-498f-bdd6-796b12329891 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:24.698761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1206be28-3b50-498f-bdd6-796b12329891 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:24.705618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1206be28-3b50-498f-bdd6-796b12329891 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.706195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1206be28-3b50-498f-bdd6-796b12329891 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.706891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1206be28-3b50-498f-bdd6-796b12329891 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.707691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1206be28-3b50-498f-bdd6-796b12329891 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.708390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1206be28-3b50-498f-bdd6-796b12329891 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.709016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1206be28-3b50-498f-bdd6-796b12329891 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.741245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-142cbb3a-727c-4a35-94fb-4b148f7ad945 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:24.750258 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-142cbb3a-727c-4a35-94fb-4b148f7ad945 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1665 microversion: 2.1 time: 0.374851 Aug 09 14:35:24.752203 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 678/1312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:24 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1665 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:24.757209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-10a4cada-72e7-438f-8ca6-f14ec23514c5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:24.758115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-10a4cada-72e7-438f-8ca6-f14ec23514c5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:24.779283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10a4cada-72e7-438f-8ca6-f14ec23514c5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.779786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10a4cada-72e7-438f-8ca6-f14ec23514c5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.780643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10a4cada-72e7-438f-8ca6-f14ec23514c5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:24.781674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10a4cada-72e7-438f-8ca6-f14ec23514c5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:24.782893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10a4cada-72e7-438f-8ca6-f14ec23514c5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:24.783562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10a4cada-72e7-438f-8ca6-f14ec23514c5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:25.134435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-1206be28-3b50-498f-bdd6-796b12329891 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid acd6f697-9f2e-4825-998a-796902617f44 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:35:25.163940 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1206be28-3b50-498f-bdd6-796b12329891 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 2423 microversion: 2.25 time: 0.469398 Aug 09 14:35:25.165003 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 635/1313] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:35:24 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 2423 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:35:25.184191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-909aa687-5e03-4b20-b0c2-9426fe111b01 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:25.185765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-909aa687-5e03-4b20-b0c2-9426fe111b01 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:25.197851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-909aa687-5e03-4b20-b0c2-9426fe111b01 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:25.202120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-909aa687-5e03-4b20-b0c2-9426fe111b01 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:25.202572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-909aa687-5e03-4b20-b0c2-9426fe111b01 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:25.203340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-909aa687-5e03-4b20-b0c2-9426fe111b01 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:25.203788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-909aa687-5e03-4b20-b0c2-9426fe111b01 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:25.204242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-909aa687-5e03-4b20-b0c2-9426fe111b01 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:25.394164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-909aa687-5e03-4b20-b0c2-9426fe111b01 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:25.402972 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-909aa687-5e03-4b20-b0c2-9426fe111b01 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1286 microversion: 2.1 time: 0.236640 Aug 09 14:35:25.407703 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 636/1314] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:25 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1286 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:25.408310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-10a4cada-72e7-438f-8ca6-f14ec23514c5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:25.419235 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-10a4cada-72e7-438f-8ca6-f14ec23514c5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1536 microversion: 2.1 time: 0.665677 Aug 09 14:35:25.424869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-87fc30ac-d9c7-47dd-94f4-502796c1d542 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:25.425249 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 679/1315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:24 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1536 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:25.425944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-87fc30ac-d9c7-47dd-94f4-502796c1d542 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:25.438139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3af0cc21-c437-457a-a339-fe3c6bd158f7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:25.439002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3af0cc21-c437-457a-a339-fe3c6bd158f7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:25.439926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87fc30ac-d9c7-47dd-94f4-502796c1d542 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:25.440527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87fc30ac-d9c7-47dd-94f4-502796c1d542 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:25.441055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87fc30ac-d9c7-47dd-94f4-502796c1d542 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:25.442349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87fc30ac-d9c7-47dd-94f4-502796c1d542 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:25.442928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87fc30ac-d9c7-47dd-94f4-502796c1d542 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:25.443858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87fc30ac-d9c7-47dd-94f4-502796c1d542 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:25.450287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3af0cc21-c437-457a-a339-fe3c6bd158f7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:25.450784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3af0cc21-c437-457a-a339-fe3c6bd158f7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:25.451446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3af0cc21-c437-457a-a339-fe3c6bd158f7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:25.452330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3af0cc21-c437-457a-a339-fe3c6bd158f7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:25.452937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3af0cc21-c437-457a-a339-fe3c6bd158f7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:25.454166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3af0cc21-c437-457a-a339-fe3c6bd158f7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:25.474708 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-87fc30ac-d9c7-47dd-94f4-502796c1d542 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] HTTP exception thrown: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-87fc30ac-d9c7-47dd-94f4-502796c1d542 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Request method failure captured: Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 HTTP/1.1 Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_mJq-XS0usX0sFnSH5QyFgBA-r9J8li62XHP88QkfgSta60kP74mogwNGT0qyvbm9xKO6_aZi3gmXyA-iXnBJCUIwy9Up6iSXMNDaexFeNNNkqKdmmWjtj435mVlUgBJNt39Z6rWXn3tpfxLxjjlJozsSclzfj9uh73b4L_mQALVs Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea5a1dc39fe54b69b5473a9f86dcd34b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d11ef713c75d461291b2a6937db4a4b1 Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3d784e6b-2704-47cb-9cb5-225e4cace576'} Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:25.478543 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:25.483240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:25.483240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:25.483240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:25.483240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:25.483240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:25.483240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:25.483240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:25.483240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:25.483240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:25.483240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-87fc30ac-d9c7-47dd-94f4-502796c1d542 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Returning 404 to user: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:25.483240 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-87fc30ac-d9c7-47dd-94f4-502796c1d542 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 404 len: 111 microversion: 2.1 time: 0.073225 Aug 09 14:35:25.484403 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 637/1316] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:25 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:35:25.497764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-737262d0-fb64-41d6-b0e2-a63b237d4925 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:25.500329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-737262d0-fb64-41d6-b0e2-a63b237d4925 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:25.513716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-737262d0-fb64-41d6-b0e2-a63b237d4925 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:25.514212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-737262d0-fb64-41d6-b0e2-a63b237d4925 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:25.519697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-737262d0-fb64-41d6-b0e2-a63b237d4925 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:25.520491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-737262d0-fb64-41d6-b0e2-a63b237d4925 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:25.521001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-737262d0-fb64-41d6-b0e2-a63b237d4925 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:25.521439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-737262d0-fb64-41d6-b0e2-a63b237d4925 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:25.658378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-3af0cc21-c437-457a-a339-fe3c6bd158f7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lazy-loading 'services' on Instance uuid acd6f697-9f2e-4825-998a-796902617f44 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:35:25.801871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-737262d0-fb64-41d6-b0e2-a63b237d4925 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:25.809660 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3af0cc21-c437-457a-a339-fe3c6bd158f7 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "DELETE /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments/70778de6-1090-46cf-882c-05df9432aaaf" status: 202 len: 0 microversion: 2.25 time: 0.382470 Aug 09 14:35:25.815863 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-737262d0-fb64-41d6-b0e2-a63b237d4925 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1368 microversion: 2.1 time: 0.325039 Aug 09 14:35:25.816539 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 638/1317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:25 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1368 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:25.828891 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 680/1318] 10.222.0.50 () {60 vars in 1457 bytes} [Tue Aug 9 14:35:25 2022] DELETE /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments/70778de6-1090-46cf-882c-05df9432aaaf => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:35:25.830778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e226f3e-74d6-491d-8715-933f5bfde67d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '.version_select at 0x7f41dd816940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:25.846029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5fe8156b-bcd2-44ae-a9d8-bce039499ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:25.847585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5fe8156b-bcd2-44ae-a9d8-bce039499ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:25.875781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe8156b-bcd2-44ae-a9d8-bce039499ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:25.877829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe8156b-bcd2-44ae-a9d8-bce039499ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:25.879696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe8156b-bcd2-44ae-a9d8-bce039499ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:25.882645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe8156b-bcd2-44ae-a9d8-bce039499ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:25.884401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe8156b-bcd2-44ae-a9d8-bce039499ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:25.886103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe8156b-bcd2-44ae-a9d8-bce039499ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:25.887555 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8e226f3e-74d6-491d-8715-933f5bfde67d tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853064886" status: 202 len: 0 microversion: 2.1 time: 0.064493 Aug 09 14:35:25.888309 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 639/1319] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 14:35:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853064886 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:25.893583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07418c8b-11f5-4839-987d-8fb8de59d790 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:25.894484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07418c8b-11f5-4839-987d-8fb8de59d790 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:25.904890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07418c8b-11f5-4839-987d-8fb8de59d790 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:25.906981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07418c8b-11f5-4839-987d-8fb8de59d790 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:25.908050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07418c8b-11f5-4839-987d-8fb8de59d790 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:25.910540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07418c8b-11f5-4839-987d-8fb8de59d790 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:25.911466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07418c8b-11f5-4839-987d-8fb8de59d790 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:25.912102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07418c8b-11f5-4839-987d-8fb8de59d790 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:26.364924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5fe8156b-bcd2-44ae-a9d8-bce039499ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:26.374323 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5fe8156b-bcd2-44ae-a9d8-bce039499ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1317 microversion: 2.1 time: 0.542125 Aug 09 14:35:26.374922 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 681/1320] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:25 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:26.392495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3cfd2865-7fab-4a0c-a8b7-6348a069e45c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:26.394964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3cfd2865-7fab-4a0c-a8b7-6348a069e45c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:26.410348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cfd2865-7fab-4a0c-a8b7-6348a069e45c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:26.410843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cfd2865-7fab-4a0c-a8b7-6348a069e45c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:26.411988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cfd2865-7fab-4a0c-a8b7-6348a069e45c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:26.412767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cfd2865-7fab-4a0c-a8b7-6348a069e45c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:26.413454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cfd2865-7fab-4a0c-a8b7-6348a069e45c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:26.414086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cfd2865-7fab-4a0c-a8b7-6348a069e45c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:26.417388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:26.442298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07418c8b-11f5-4839-987d-8fb8de59d790 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:26.453978 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07418c8b-11f5-4839-987d-8fb8de59d790 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1665 microversion: 2.1 time: 0.564169 Aug 09 14:35:26.466620 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 640/1321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:25 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1665 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:26.466620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ab203c39-233c-470f-a0e7-ca4d8a28f39b tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:26.466620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ab203c39-233c-470f-a0e7-ca4d8a28f39b tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:26.468508 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3cfd2865-7fab-4a0c-a8b7-6348a069e45c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081469 Aug 09 14:35:26.470201 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 682/1322] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:35:26 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:35:26.483148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c7b5930-d541-40c7-997e-a150af13fdac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:26.483795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c7b5930-d541-40c7-997e-a150af13fdac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:26.485676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab203c39-233c-470f-a0e7-ca4d8a28f39b tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:26.486200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab203c39-233c-470f-a0e7-ca4d8a28f39b tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:26.486627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab203c39-233c-470f-a0e7-ca4d8a28f39b tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:26.487364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab203c39-233c-470f-a0e7-ca4d8a28f39b tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:26.487806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab203c39-233c-470f-a0e7-ca4d8a28f39b tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:26.488218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab203c39-233c-470f-a0e7-ca4d8a28f39b tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:26.495181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c7b5930-d541-40c7-997e-a150af13fdac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:26.496092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c7b5930-d541-40c7-997e-a150af13fdac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:26.496691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c7b5930-d541-40c7-997e-a150af13fdac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:26.498099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c7b5930-d541-40c7-997e-a150af13fdac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:26.499459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c7b5930-d541-40c7-997e-a150af13fdac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:26.500435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c7b5930-d541-40c7-997e-a150af13fdac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:26.671344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ab203c39-233c-470f-a0e7-ca4d8a28f39b tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:26.684520 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ab203c39-233c-470f-a0e7-ca4d8a28f39b tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1274 microversion: 2.1 time: 0.219545 Aug 09 14:35:26.699383 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 641/1323] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:26 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1274 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:26.711404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8d4db667-67da-4a44-85cd-d65083dcb293 req-67a8d1cd-31b4-49b8-8ccd-407d1ec917a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a", "name": "network-vif-unplugged", "status": "completed", "tag": "1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:26.726846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8d4db667-67da-4a44-85cd-d65083dcb293 req-67a8d1cd-31b4-49b8-8ccd-407d1ec917a7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:26.727588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8d4db667-67da-4a44-85cd-d65083dcb293 req-67a8d1cd-31b4-49b8-8ccd-407d1ec917a7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:26.728019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8d4db667-67da-4a44-85cd-d65083dcb293 req-67a8d1cd-31b4-49b8-8ccd-407d1ec917a7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:26.749957 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8d4db667-67da-4a44-85cd-d65083dcb293 req-67a8d1cd-31b4-49b8-8ccd-407d1ec917a7 service nova] Creating event network-vif-unplugged:1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b for instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a on n-h2-844626-8 Aug 09 14:35:26.762065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-8d4db667-67da-4a44-85cd-d65083dcb293 req-67a8d1cd-31b4-49b8-8ccd-407d1ec917a7 service nova] Instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 14:35:26.794688 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8d4db667-67da-4a44-85cd-d65083dcb293 req-67a8d1cd-31b4-49b8-8ccd-407d1ec917a7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091331 Aug 09 14:35:26.798353 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 642/1324] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:26.839144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f85409a-56ed-4a51-bff0-e2703fc9b0b3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:26.840245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f85409a-56ed-4a51-bff0-e2703fc9b0b3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:26.848301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f85409a-56ed-4a51-bff0-e2703fc9b0b3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:26.849022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f85409a-56ed-4a51-bff0-e2703fc9b0b3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:26.849632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f85409a-56ed-4a51-bff0-e2703fc9b0b3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:26.850476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f85409a-56ed-4a51-bff0-e2703fc9b0b3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:26.851063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f85409a-56ed-4a51-bff0-e2703fc9b0b3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:26.851712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f85409a-56ed-4a51-bff0-e2703fc9b0b3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:27.265707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6f85409a-56ed-4a51-bff0-e2703fc9b0b3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:27.277418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c7b5930-d541-40c7-997e-a150af13fdac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:27.287589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:27.341076 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c7b5930-d541-40c7-997e-a150af13fdac tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1536 microversion: 2.1 time: 0.868179 Aug 09 14:35:27.342020 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 683/1325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:26 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1536 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:27.349164 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f85409a-56ed-4a51-bff0-e2703fc9b0b3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1368 microversion: 2.1 time: 0.514467 Aug 09 14:35:27.365601 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 643/1326] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:26 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1368 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:27.394569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef0b7811-7bdd-4838-9f64-86d012157300 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:27.395917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef0b7811-7bdd-4838-9f64-86d012157300 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:27.404510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef0b7811-7bdd-4838-9f64-86d012157300 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:27.406040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef0b7811-7bdd-4838-9f64-86d012157300 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:27.406819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef0b7811-7bdd-4838-9f64-86d012157300 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:27.407871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef0b7811-7bdd-4838-9f64-86d012157300 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:27.408497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef0b7811-7bdd-4838-9f64-86d012157300 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:27.409074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef0b7811-7bdd-4838-9f64-86d012157300 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:27.481659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ad92d3f-d465-48a4-8510-9b5e87205845 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:27.483123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ad92d3f-d465-48a4-8510-9b5e87205845 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:27.490806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad92d3f-d465-48a4-8510-9b5e87205845 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:27.491473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad92d3f-d465-48a4-8510-9b5e87205845 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:27.492146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad92d3f-d465-48a4-8510-9b5e87205845 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:27.493310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad92d3f-d465-48a4-8510-9b5e87205845 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:27.494033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad92d3f-d465-48a4-8510-9b5e87205845 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:27.494674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ad92d3f-d465-48a4-8510-9b5e87205845 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:27.846853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ad92d3f-d465-48a4-8510-9b5e87205845 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:27.865925 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ad92d3f-d465-48a4-8510-9b5e87205845 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1597 microversion: 2.1 time: 0.387133 Aug 09 14:35:27.868854 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 644/1327] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:27 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1597 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:27.881646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e71148a-e01a-406e-9730-3cdd1856e777 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:27.885446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e71148a-e01a-406e-9730-3cdd1856e777 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:27.896940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e71148a-e01a-406e-9730-3cdd1856e777 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:27.899001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e71148a-e01a-406e-9730-3cdd1856e777 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:27.900207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e71148a-e01a-406e-9730-3cdd1856e777 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:27.914839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e71148a-e01a-406e-9730-3cdd1856e777 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:27.915783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e71148a-e01a-406e-9730-3cdd1856e777 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:27.923688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e71148a-e01a-406e-9730-3cdd1856e777 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:28.052176 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e71148a-e01a-406e-9730-3cdd1856e777 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.180483 Aug 09 14:35:28.053275 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 645/1328] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:35:27 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:35:28.066426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7385b0bb-4006-4366-9075-89fd40135c47 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:28.067330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7385b0bb-4006-4366-9075-89fd40135c47 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:28.079462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7385b0bb-4006-4366-9075-89fd40135c47 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:28.080226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7385b0bb-4006-4366-9075-89fd40135c47 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:28.080803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7385b0bb-4006-4366-9075-89fd40135c47 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:28.083029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7385b0bb-4006-4366-9075-89fd40135c47 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:28.083665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7385b0bb-4006-4366-9075-89fd40135c47 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:28.084797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7385b0bb-4006-4366-9075-89fd40135c47 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:28.223300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7385b0bb-4006-4366-9075-89fd40135c47 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:28.232176 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7385b0bb-4006-4366-9075-89fd40135c47 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1274 microversion: 2.1 time: 0.177621 Aug 09 14:35:28.252182 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 646/1329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:28 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:28.257597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-987b0e9d-76fb-4336-ab76-38493c00c9fd req-5c1a2e19-948d-4da0-959d-5d648157939a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "071cd727-293f-49aa-a7a6-117cf73c817c", "name": "network-vif-deleted", "tag": "f42a2f66-2d26-46e2-b779-6c68e7d458fd"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:28.267644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-987b0e9d-76fb-4336-ab76-38493c00c9fd req-5c1a2e19-948d-4da0-959d-5d648157939a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:28.268393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-987b0e9d-76fb-4336-ab76-38493c00c9fd req-5c1a2e19-948d-4da0-959d-5d648157939a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:28.268965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-987b0e9d-76fb-4336-ab76-38493c00c9fd req-5c1a2e19-948d-4da0-959d-5d648157939a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:28.292979 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-987b0e9d-76fb-4336-ab76-38493c00c9fd req-5c1a2e19-948d-4da0-959d-5d648157939a service nova] Creating event network-vif-deleted:f42a2f66-2d26-46e2-b779-6c68e7d458fd for instance 071cd727-293f-49aa-a7a6-117cf73c817c on n-h2-844626-8 Aug 09 14:35:28.300700 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-987b0e9d-76fb-4336-ab76-38493c00c9fd req-5c1a2e19-948d-4da0-959d-5d648157939a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046865 Aug 09 14:35:28.303249 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 647/1330] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:28.365728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b9fcbd4e-67c9-48ee-9648-d4474374fa51 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:28.367757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b9fcbd4e-67c9-48ee-9648-d4474374fa51 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:28.380588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9fcbd4e-67c9-48ee-9648-d4474374fa51 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:28.381457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9fcbd4e-67c9-48ee-9648-d4474374fa51 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:28.384766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9fcbd4e-67c9-48ee-9648-d4474374fa51 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:28.385710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9fcbd4e-67c9-48ee-9648-d4474374fa51 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:28.386318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9fcbd4e-67c9-48ee-9648-d4474374fa51 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:28.386872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9fcbd4e-67c9-48ee-9648-d4474374fa51 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:28.398737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef0b7811-7bdd-4838-9f64-86d012157300 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:28.414777 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef0b7811-7bdd-4838-9f64-86d012157300 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1317 microversion: 2.1 time: 1.022927 Aug 09 14:35:28.417373 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 684/1331] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:27 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1317 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:28.430686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3407621e-a62a-4a62-9e51-6f19f027db5e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:28.433144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3407621e-a62a-4a62-9e51-6f19f027db5e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:28.446888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3407621e-a62a-4a62-9e51-6f19f027db5e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:28.447775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3407621e-a62a-4a62-9e51-6f19f027db5e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:28.448682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3407621e-a62a-4a62-9e51-6f19f027db5e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:28.449580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3407621e-a62a-4a62-9e51-6f19f027db5e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:28.450189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3407621e-a62a-4a62-9e51-6f19f027db5e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:28.450777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3407621e-a62a-4a62-9e51-6f19f027db5e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:28.905185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b9fcbd4e-67c9-48ee-9648-d4474374fa51 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:28.920984 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b9fcbd4e-67c9-48ee-9648-d4474374fa51 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1536 microversion: 2.1 time: 0.561589 Aug 09 14:35:28.921597 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 648/1332] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:28 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1536 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:28.928473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f6e1603b-a43d-4fd0-8ee4-c718c3f46b3d req-12d26ff5-869a-404a-b16a-968f8727e0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a", "tag": "1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b"}, {"name": "network-changed", "server_uuid": "88fb81c4-0d70-467d-b9af-b07c64aff027", "tag": "2d464e59-9fb7-4f9b-b35f-829e9230de3c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:28.956326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3407621e-a62a-4a62-9e51-6f19f027db5e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:28.959043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f6e1603b-a43d-4fd0-8ee4-c718c3f46b3d req-12d26ff5-869a-404a-b16a-968f8727e0c1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:28.960700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f6e1603b-a43d-4fd0-8ee4-c718c3f46b3d req-12d26ff5-869a-404a-b16a-968f8727e0c1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:28.961163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f6e1603b-a43d-4fd0-8ee4-c718c3f46b3d req-12d26ff5-869a-404a-b16a-968f8727e0c1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:28.965426 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3407621e-a62a-4a62-9e51-6f19f027db5e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1368 microversion: 2.1 time: 0.546751 Aug 09 14:35:28.972314 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 685/1333] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:28 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1368 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:28.977805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:28.983292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:28.996180 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f6e1603b-a43d-4fd0-8ee4-c718c3f46b3d req-12d26ff5-869a-404a-b16a-968f8727e0c1 service nova] Creating event network-changed:1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b for instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a on n-h2-844626-8 Aug 09 14:35:28.997365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:28.997706 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f6e1603b-a43d-4fd0-8ee4-c718c3f46b3d req-12d26ff5-869a-404a-b16a-968f8727e0c1 service nova] Creating event network-changed:2d464e59-9fb7-4f9b-b35f-829e9230de3c for instance 88fb81c4-0d70-467d-b9af-b07c64aff027 on n-h1-844626-8 Aug 09 14:35:28.998063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:28.998586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:28.999444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:28.999979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.000530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.016404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-f6e1603b-a43d-4fd0-8ee4-c718c3f46b3d req-12d26ff5-869a-404a-b16a-968f8727e0c1 service nova] Instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 14:35:29.049948 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f6e1603b-a43d-4fd0-8ee4-c718c3f46b3d req-12d26ff5-869a-404a-b16a-968f8727e0c1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.124237 Aug 09 14:35:29.051815 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 649/1334] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:29.062556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.063435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.064079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.064744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lazy-loading 'fault' on Instance uuid 071cd727-293f-49aa-a7a6-117cf73c817c {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:35:29.065611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14d4e411-356d-4644-9aad-0c0916e93d3a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.077326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14d4e411-356d-4644-9aad-0c0916e93d3a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:29.085383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14d4e411-356d-4644-9aad-0c0916e93d3a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.085897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14d4e411-356d-4644-9aad-0c0916e93d3a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.086328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14d4e411-356d-4644-9aad-0c0916e93d3a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.087041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14d4e411-356d-4644-9aad-0c0916e93d3a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.087507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14d4e411-356d-4644-9aad-0c0916e93d3a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.087920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14d4e411-356d-4644-9aad-0c0916e93d3a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.122356 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14d4e411-356d-4644-9aad-0c0916e93d3a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.061121 Aug 09 14:35:29.123460 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 650/1335] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:35:29 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:35:29.166963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:29.175834 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0ea6781-3c05-479f-88c5-2926ae13801a tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1314 microversion: 2.1 time: 0.202078 Aug 09 14:35:29.176656 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 686/1336] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:28 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:29.194595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0d51238b-f0d5-402a-b53f-e54918d5597e tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.195599 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:29.195599 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:35:29.215298 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0d51238b-f0d5-402a-b53f-e54918d5597e tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1980919458" status: 202 len: 0 microversion: 2.1 time: 0.024776 Aug 09 14:35:29.219164 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 651/1337] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:35:29 2022] DELETE /compute/v2.1/flavors/1980919458 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:29.224245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee8eca80-75e6-411f-af1f-8b970281f3d3 tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.244625 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee8eca80-75e6-411f-af1f-8b970281f3d3 tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.023932 Aug 09 14:35:29.245228 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 687/1338] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:35:29 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:29.263353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b36b8d7e-08ee-4ded-8fa8-27abc537ca28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.264150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b36b8d7e-08ee-4ded-8fa8-27abc537ca28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:29.264415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32aa98da-d21f-45d1-98a6-3d4c509694b0 tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.265266 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:29.265266 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:35:29.272736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b36b8d7e-08ee-4ded-8fa8-27abc537ca28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.274137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b36b8d7e-08ee-4ded-8fa8-27abc537ca28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.274672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b36b8d7e-08ee-4ded-8fa8-27abc537ca28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.275599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b36b8d7e-08ee-4ded-8fa8-27abc537ca28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.276208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b36b8d7e-08ee-4ded-8fa8-27abc537ca28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.276821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b36b8d7e-08ee-4ded-8fa8-27abc537ca28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.286307 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32aa98da-d21f-45d1-98a6-3d4c509694b0 tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1478225061" status: 202 len: 0 microversion: 2.1 time: 0.025211 Aug 09 14:35:29.293431 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 688/1339] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:35:29 2022] DELETE /compute/v2.1/flavors/1478225061 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 14:35:29.303311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7425dadc-8e4a-4d34-a3a3-5ae385e9c4ad tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.333748 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7425dadc-8e4a-4d34-a3a3-5ae385e9c4ad tempest-ServersWithSpecificFlavorTestJSON-735754661 tempest-ServersWithSpecificFlavorTestJSON-735754661-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038665 Aug 09 14:35:29.348917 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 689/1340] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:35:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:29.364037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9e36111f-651d-45e4-a410-0c43ac53191f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.367248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9e36111f-651d-45e4-a410-0c43ac53191f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:29.378827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e36111f-651d-45e4-a410-0c43ac53191f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.382374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e36111f-651d-45e4-a410-0c43ac53191f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.382764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e36111f-651d-45e4-a410-0c43ac53191f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.385701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e36111f-651d-45e4-a410-0c43ac53191f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.395029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e36111f-651d-45e4-a410-0c43ac53191f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.395650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e36111f-651d-45e4-a410-0c43ac53191f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.409980 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-9e36111f-651d-45e4-a410-0c43ac53191f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] HTTP exception thrown: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9e36111f-651d-45e4-a410-0c43ac53191f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Request method failure captured: Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 HTTP/1.1 Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_mJq-XS0usX0sFnSH5QyFgBA-r9J8li62XHP88QkfgSta60kP74mogwNGT0qyvbm9xKO6_aZi3gmXyA-iXnBJCUIwy9Up6iSXMNDaexFeNNNkqKdmmWjtj435mVlUgBJNt39Z6rWXn3tpfxLxjjlJozsSclzfj9uh73b4L_mQALVs Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea5a1dc39fe54b69b5473a9f86dcd34b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d11ef713c75d461291b2a6937db4a4b1 Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'e5121011-181e-440e-a97e-7580b76680f8'} Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:29.412538 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:29.417230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:29.417230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.417230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:29.417230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.417230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:29.417230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:29.417230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:29.417230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:29.417230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:29.417230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:29.417230 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.418983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9e36111f-651d-45e4-a410-0c43ac53191f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Returning 404 to user: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:29.420051 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9e36111f-651d-45e4-a410-0c43ac53191f tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 404 len: 111 microversion: 2.1 time: 0.060095 Aug 09 14:35:29.424166 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 690/1341] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:29 2022] DELETE /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:35:29.429771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-574e02ee-2857-4a9b-836a-0f58b5da5abe tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.430610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-574e02ee-2857-4a9b-836a-0f58b5da5abe tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: e5121011-181e-440e-a97e-7580b76680f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:29.438825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-574e02ee-2857-4a9b-836a-0f58b5da5abe tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.439656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-574e02ee-2857-4a9b-836a-0f58b5da5abe tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.440277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-574e02ee-2857-4a9b-836a-0f58b5da5abe tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.441155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-574e02ee-2857-4a9b-836a-0f58b5da5abe tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.441782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-574e02ee-2857-4a9b-836a-0f58b5da5abe tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.442354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-574e02ee-2857-4a9b-836a-0f58b5da5abe tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.458397 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-574e02ee-2857-4a9b-836a-0f58b5da5abe tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] HTTP exception thrown: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-574e02ee-2857-4a9b-836a-0f58b5da5abe tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Request method failure captured: Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 HTTP/1.1 Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_mJq-XS0usX0sFnSH5QyFgBA-r9J8li62XHP88QkfgSta60kP74mogwNGT0qyvbm9xKO6_aZi3gmXyA-iXnBJCUIwy9Up6iSXMNDaexFeNNNkqKdmmWjtj435mVlUgBJNt39Z6rWXn3tpfxLxjjlJozsSclzfj9uh73b4L_mQALVs Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea5a1dc39fe54b69b5473a9f86dcd34b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d11ef713c75d461291b2a6937db4a4b1 Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'e5121011-181e-440e-a97e-7580b76680f8'} Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:29.460433 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.464856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:29.464856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.464856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:29.464856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:29.464856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:29.464856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:29.464856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:29.464856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. Aug 09 14:35:29.464856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.466404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-574e02ee-2857-4a9b-836a-0f58b5da5abe tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Returning 404 to user: Instance e5121011-181e-440e-a97e-7580b76680f8 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:29.467543 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-574e02ee-2857-4a9b-836a-0f58b5da5abe tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8" status: 404 len: 111 microversion: 2.1 time: 0.041772 Aug 09 14:35:29.468301 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 691/1342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:29 2022] GET /compute/v2.1/servers/e5121011-181e-440e-a97e-7580b76680f8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:35:29.476516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b36b8d7e-08ee-4ded-8fa8-27abc537ca28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:29.481990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6dca23dc-838c-46f0-9b47-5a9177fa5ee8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.482805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6dca23dc-838c-46f0-9b47-5a9177fa5ee8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:29.485331 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b36b8d7e-08ee-4ded-8fa8-27abc537ca28 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1316 microversion: 2.1 time: 0.226021 Aug 09 14:35:29.495892 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 652/1343] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:29 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:29.495892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e15aa17b-b9da-425f-b85b-8565b0e63ba8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.496351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dca23dc-838c-46f0-9b47-5a9177fa5ee8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.496458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e15aa17b-b9da-425f-b85b-8565b0e63ba8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:29.496540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dca23dc-838c-46f0-9b47-5a9177fa5ee8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.496540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dca23dc-838c-46f0-9b47-5a9177fa5ee8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.496540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dca23dc-838c-46f0-9b47-5a9177fa5ee8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.496540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dca23dc-838c-46f0-9b47-5a9177fa5ee8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.496540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dca23dc-838c-46f0-9b47-5a9177fa5ee8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.500513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e15aa17b-b9da-425f-b85b-8565b0e63ba8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.501055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e15aa17b-b9da-425f-b85b-8565b0e63ba8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.501494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e15aa17b-b9da-425f-b85b-8565b0e63ba8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.502196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e15aa17b-b9da-425f-b85b-8565b0e63ba8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.502770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e15aa17b-b9da-425f-b85b-8565b0e63ba8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.503312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e15aa17b-b9da-425f-b85b-8565b0e63ba8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.518348 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e15aa17b-b9da-425f-b85b-8565b0e63ba8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] HTTP exception thrown: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e15aa17b-b9da-425f-b85b-8565b0e63ba8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Request method failure captured: Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 HTTP/1.1 Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_mJq-XS0usX0sFnSH5QyFgBA-r9J8li62XHP88QkfgSta60kP74mogwNGT0qyvbm9xKO6_aZi3gmXyA-iXnBJCUIwy9Up6iSXMNDaexFeNNNkqKdmmWjtj435mVlUgBJNt39Z6rWXn3tpfxLxjjlJozsSclzfj9uh73b4L_mQALVs Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea5a1dc39fe54b69b5473a9f86dcd34b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d11ef713c75d461291b2a6937db4a4b1 Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3d784e6b-2704-47cb-9cb5-225e4cace576'} Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:29.520201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e15aa17b-b9da-425f-b85b-8565b0e63ba8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Returning 404 to user: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:29.525213 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e15aa17b-b9da-425f-b85b-8565b0e63ba8 tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 404 len: 111 microversion: 2.1 time: 0.034229 Aug 09 14:35:29.526638 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 653/1344] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:29 2022] DELETE /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:35:29.531527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b5505135-d3e5-4ce7-b556-64b263ed201a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.532496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b5505135-d3e5-4ce7-b556-64b263ed201a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] [instance: 3d784e6b-2704-47cb-9cb5-225e4cace576] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:29.538942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5505135-d3e5-4ce7-b556-64b263ed201a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.539539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5505135-d3e5-4ce7-b556-64b263ed201a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.540071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5505135-d3e5-4ce7-b556-64b263ed201a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.540816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5505135-d3e5-4ce7-b556-64b263ed201a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.541338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5505135-d3e5-4ce7-b556-64b263ed201a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.541826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5505135-d3e5-4ce7-b556-64b263ed201a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.569524 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-b5505135-d3e5-4ce7-b556-64b263ed201a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] HTTP exception thrown: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b5505135-d3e5-4ce7-b556-64b263ed201a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Request method failure captured: Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 HTTP/1.1 Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_mJq-XS0usX0sFnSH5QyFgBA-r9J8li62XHP88QkfgSta60kP74mogwNGT0qyvbm9xKO6_aZi3gmXyA-iXnBJCUIwy9Up6iSXMNDaexFeNNNkqKdmmWjtj435mVlUgBJNt39Z6rWXn3tpfxLxjjlJozsSclzfj9uh73b4L_mQALVs Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea5a1dc39fe54b69b5473a9f86dcd34b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea5a1dc39fe54b69b5473a9f86dcd34b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: ea5a1dc39fe54b69b5473a9f86dcd34b Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573 Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d11ef713c75d461291b2a6937db4a4b1 Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1453883573-project Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3d784e6b-2704-47cb-9cb5-225e4cace576'} Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:29.571152 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.575351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:29.575351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.575351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:29.575351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:29.575351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:29.575351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:29.575351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:29.575351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. Aug 09 14:35:29.575351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:29.575351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b5505135-d3e5-4ce7-b556-64b263ed201a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] Returning 404 to user: Instance 3d784e6b-2704-47cb-9cb5-225e4cace576 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:29.575351 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b5505135-d3e5-4ce7-b556-64b263ed201a tempest-ServersWithSpecificFlavorTestJSON-1453883573 tempest-ServersWithSpecificFlavorTestJSON-1453883573-project] 10.222.0.50 "GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576" status: 404 len: 111 microversion: 2.1 time: 0.044883 Aug 09 14:35:29.575351 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 654/1345] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:29 2022] GET /compute/v2.1/servers/3d784e6b-2704-47cb-9cb5-225e4cace576 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:35:29.634116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:29.698186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6dca23dc-838c-46f0-9b47-5a9177fa5ee8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:29.706814 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6dca23dc-838c-46f0-9b47-5a9177fa5ee8 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1317 microversion: 2.1 time: 0.237105 Aug 09 14:35:29.707742 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 692/1346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:29 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:29.943718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48784092-8c4a-4efc-9c1f-c9b4bc4fb3ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.945442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48784092-8c4a-4efc-9c1f-c9b4bc4fb3ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:29.953640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48784092-8c4a-4efc-9c1f-c9b4bc4fb3ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.954664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48784092-8c4a-4efc-9c1f-c9b4bc4fb3ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.955653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48784092-8c4a-4efc-9c1f-c9b4bc4fb3ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.956777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48784092-8c4a-4efc-9c1f-c9b4bc4fb3ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:29.958213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48784092-8c4a-4efc-9c1f-c9b4bc4fb3ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:29.959070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48784092-8c4a-4efc-9c1f-c9b4bc4fb3ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:29.994091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01316a6f-b3bb-4c5e-a5d8-36dc3b345738 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:29.994737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01316a6f-b3bb-4c5e-a5d8-36dc3b345738 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:30.010073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01316a6f-b3bb-4c5e-a5d8-36dc3b345738 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:30.010814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01316a6f-b3bb-4c5e-a5d8-36dc3b345738 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:30.012106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01316a6f-b3bb-4c5e-a5d8-36dc3b345738 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:30.014188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01316a6f-b3bb-4c5e-a5d8-36dc3b345738 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:30.014188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01316a6f-b3bb-4c5e-a5d8-36dc3b345738 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:30.014489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01316a6f-b3bb-4c5e-a5d8-36dc3b345738 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:30.267108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-01316a6f-b3bb-4c5e-a5d8-36dc3b345738 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:30.271164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48784092-8c4a-4efc-9c1f-c9b4bc4fb3ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:30.277987 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01316a6f-b3bb-4c5e-a5d8-36dc3b345738 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1368 microversion: 2.1 time: 0.289032 Aug 09 14:35:30.278583 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 693/1347] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:29 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:30.285795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa346851-5ba7-4a62-840e-6f272682c0c8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:30.288679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa346851-5ba7-4a62-840e-6f272682c0c8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:30.293845 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48784092-8c4a-4efc-9c1f-c9b4bc4fb3ee tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1536 microversion: 2.1 time: 0.355721 Aug 09 14:35:30.294435 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 655/1348] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:29 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1536 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:30.298119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa346851-5ba7-4a62-840e-6f272682c0c8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:30.298870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa346851-5ba7-4a62-840e-6f272682c0c8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:30.299881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa346851-5ba7-4a62-840e-6f272682c0c8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:30.300043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:30.300706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:30.301367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa346851-5ba7-4a62-840e-6f272682c0c8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:30.302991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa346851-5ba7-4a62-840e-6f272682c0c8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:30.303665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa346851-5ba7-4a62-840e-6f272682c0c8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:30.310072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:30.316067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:30.316655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:30.317644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:30.318208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:30.319418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:30.344273 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa346851-5ba7-4a62-840e-6f272682c0c8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.062861 Aug 09 14:35:30.345527 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 694/1349] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:35:30 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:35:30.358389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:30.358859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:30.359696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:30.360428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lazy-loading 'fault' on Instance uuid 071cd727-293f-49aa-a7a6-117cf73c817c {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:35:30.422646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e9f25ff5f8a422faef06aa2a33a6c97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1c1fd6a864416caf79394d7e194099', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:30.432744 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a59e7d77-4cb9-4447-aa66-a28227eac140 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 200 len: 1314 microversion: 2.1 time: 0.136912 Aug 09 14:35:30.434391 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 656/1350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:30 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:30.512439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-388025da-99cc-4473-9ed6-201c016fc948 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:30.513145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-388025da-99cc-4473-9ed6-201c016fc948 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:30.522633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-388025da-99cc-4473-9ed6-201c016fc948 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:30.525266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-388025da-99cc-4473-9ed6-201c016fc948 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:30.525844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-388025da-99cc-4473-9ed6-201c016fc948 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:30.527602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-388025da-99cc-4473-9ed6-201c016fc948 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:30.535570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-388025da-99cc-4473-9ed6-201c016fc948 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:30.536195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-388025da-99cc-4473-9ed6-201c016fc948 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:30.731843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f683748-9521-4cdb-98ab-cd82f3868675 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:30.732935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f683748-9521-4cdb-98ab-cd82f3868675 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:30.748712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f683748-9521-4cdb-98ab-cd82f3868675 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:30.750750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f683748-9521-4cdb-98ab-cd82f3868675 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:30.751531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f683748-9521-4cdb-98ab-cd82f3868675 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:30.752461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f683748-9521-4cdb-98ab-cd82f3868675 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:30.753167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f683748-9521-4cdb-98ab-cd82f3868675 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:30.753795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f683748-9521-4cdb-98ab-cd82f3868675 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:30.871415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-388025da-99cc-4473-9ed6-201c016fc948 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:30.894886 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-388025da-99cc-4473-9ed6-201c016fc948 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1316 microversion: 2.1 time: 0.386760 Aug 09 14:35:30.898446 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 695/1351] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:30 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:31.110408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2f683748-9521-4cdb-98ab-cd82f3868675 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:31.126114 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f683748-9521-4cdb-98ab-cd82f3868675 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1317 microversion: 2.1 time: 0.398505 Aug 09 14:35:31.139114 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 657/1352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:30 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:31.301372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ddbc993-741c-4db8-ae95-77dc1b660334 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:31.302182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ddbc993-741c-4db8-ae95-77dc1b660334 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:31.308635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ddbc993-741c-4db8-ae95-77dc1b660334 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.309115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ddbc993-741c-4db8-ae95-77dc1b660334 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.309542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ddbc993-741c-4db8-ae95-77dc1b660334 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.320326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ddbc993-741c-4db8-ae95-77dc1b660334 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.320954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ddbc993-741c-4db8-ae95-77dc1b660334 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.321400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ddbc993-741c-4db8-ae95-77dc1b660334 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.321988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1608a183-fe9d-4226-8663-840d624b7b9c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:31.323596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1608a183-fe9d-4226-8663-840d624b7b9c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:31.337024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1608a183-fe9d-4226-8663-840d624b7b9c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.341245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1608a183-fe9d-4226-8663-840d624b7b9c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.341920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1608a183-fe9d-4226-8663-840d624b7b9c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.342729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1608a183-fe9d-4226-8663-840d624b7b9c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.343219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1608a183-fe9d-4226-8663-840d624b7b9c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.345779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1608a183-fe9d-4226-8663-840d624b7b9c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.670522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1608a183-fe9d-4226-8663-840d624b7b9c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:31.680207 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1608a183-fe9d-4226-8663-840d624b7b9c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1529 microversion: 2.1 time: 0.365749 Aug 09 14:35:31.695303 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 658/1353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:31 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1529 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:31.695303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7bb7f296-7f44-491b-bb65-d74b57bdd3a1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:31.695303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7bb7f296-7f44-491b-bb65-d74b57bdd3a1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:31.695303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb7f296-7f44-491b-bb65-d74b57bdd3a1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.695303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb7f296-7f44-491b-bb65-d74b57bdd3a1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.695756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb7f296-7f44-491b-bb65-d74b57bdd3a1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.696448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb7f296-7f44-491b-bb65-d74b57bdd3a1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.696896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb7f296-7f44-491b-bb65-d74b57bdd3a1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.697310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb7f296-7f44-491b-bb65-d74b57bdd3a1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.731449 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7bb7f296-7f44-491b-bb65-d74b57bdd3a1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.049213 Aug 09 14:35:31.732350 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 659/1354] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:35:31 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:35:31.737495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0663df4b-f76e-4108-bbf6-edb8e98fff91 req-52deed07-2039-41b4-a957-6a2856c14150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd1379b-b2dc-4866-9a3f-d4d03c495a25", "name": "network-vif-plugged", "status": "completed", "tag": "bb7074b5-7f36-447d-8b2a-ef303f0bc953"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:31.747143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0663df4b-f76e-4108-bbf6-edb8e98fff91 req-52deed07-2039-41b4-a957-6a2856c14150 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.747620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0663df4b-f76e-4108-bbf6-edb8e98fff91 req-52deed07-2039-41b4-a957-6a2856c14150 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.748165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0663df4b-f76e-4108-bbf6-edb8e98fff91 req-52deed07-2039-41b4-a957-6a2856c14150 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.751688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ddbc993-741c-4db8-ae95-77dc1b660334 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:31.762685 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0663df4b-f76e-4108-bbf6-edb8e98fff91 req-52deed07-2039-41b4-a957-6a2856c14150 service nova] Creating event network-vif-plugged:bb7074b5-7f36-447d-8b2a-ef303f0bc953 for instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 on n-h1-844626-8 Aug 09 14:35:31.763947 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ddbc993-741c-4db8-ae95-77dc1b660334 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1368 microversion: 2.1 time: 0.467561 Aug 09 14:35:31.768817 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 696/1355] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:31 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1368 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:31.769052 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0663df4b-f76e-4108-bbf6-edb8e98fff91 req-52deed07-2039-41b4-a957-6a2856c14150 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035006 Aug 09 14:35:31.769701 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 660/1356] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:31.775219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-61456629-35c7-4704-8468-0a6fb763adbd req-f7832224-5c6a-495e-86a0-34f03fa41215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8e83a4-e16d-4a23-a596-61224bdf98b6", "tag": "6032a560-a43f-47d1-88ad-7d302223a7a5"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:31.784487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:31.787911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-61456629-35c7-4704-8468-0a6fb763adbd req-f7832224-5c6a-495e-86a0-34f03fa41215 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.788684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-61456629-35c7-4704-8468-0a6fb763adbd req-f7832224-5c6a-495e-86a0-34f03fa41215 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.789955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-61456629-35c7-4704-8468-0a6fb763adbd req-f7832224-5c6a-495e-86a0-34f03fa41215 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.798138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37be96b8-ed7e-4008-ab56-0616f20cbca3 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:31.801218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37be96b8-ed7e-4008-ab56-0616f20cbca3 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] [instance: 071cd727-293f-49aa-a7a6-117cf73c817c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:31.807500 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-61456629-35c7-4704-8468-0a6fb763adbd req-f7832224-5c6a-495e-86a0-34f03fa41215 service nova] Creating event network-changed:6032a560-a43f-47d1-88ad-7d302223a7a5 for instance 3b8e83a4-e16d-4a23-a596-61224bdf98b6 on n-h2-844626-8 Aug 09 14:35:31.813942 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-61456629-35c7-4704-8468-0a6fb763adbd req-f7832224-5c6a-495e-86a0-34f03fa41215 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042760 Aug 09 14:35:31.814939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:31.815415 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 661/1357] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:31.822614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44b4f958-6da4-4c03-89d6-61b4ef11cef3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:31.823684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44b4f958-6da4-4c03-89d6-61b4ef11cef3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:31.833033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44b4f958-6da4-4c03-89d6-61b4ef11cef3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.833623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44b4f958-6da4-4c03-89d6-61b4ef11cef3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.834155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44b4f958-6da4-4c03-89d6-61b4ef11cef3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.835154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44b4f958-6da4-4c03-89d6-61b4ef11cef3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.835733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44b4f958-6da4-4c03-89d6-61b4ef11cef3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.836248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44b4f958-6da4-4c03-89d6-61b4ef11cef3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.848496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37be96b8-ed7e-4008-ab56-0616f20cbca3 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.858610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=7 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:31.858962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37be96b8-ed7e-4008-ab56-0616f20cbca3 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.859476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37be96b8-ed7e-4008-ab56-0616f20cbca3 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.862590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37be96b8-ed7e-4008-ab56-0616f20cbca3 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.863423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37be96b8-ed7e-4008-ab56-0616f20cbca3 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.863868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37be96b8-ed7e-4008-ab56-0616f20cbca3 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.888781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=12 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:31.904456 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-37be96b8-ed7e-4008-ab56-0616f20cbca3 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] HTTP exception thrown: Instance 071cd727-293f-49aa-a7a6-117cf73c817c could not be found. Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37be96b8-ed7e-4008-ab56-0616f20cbca3 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Request method failure captured: Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c HTTP/1.1 Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nBl43Lm9ff2EjdZ_e8S_pawD4CTRochmqi4y5yUc1Z5e-T_8iSSLWW9meOswoAybhgtVPiO_rFEPP_-OPBTMaDwVNeNd0v8qw0qQTvfJswEPhmKEfNv1FdFd_shExwlC3xZkialE7LtNUtLsRLo3n4zs0EST4WcNECqhfWOAqYQQWw Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ec1c1fd6a864416caf79394d7e194099 Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestFqdnHostnames-752630230 Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ec1c1fd6a864416caf79394d7e194099", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ec1c1fd6a864416caf79394d7e194099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ec1c1fd6a864416caf79394d7e194099"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ec1c1fd6a864416caf79394d7e194099"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestFqdnHostnames-752630230 Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ec1c1fd6a864416caf79394d7e194099 Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-752630230 Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestFqdnHostnames-752630230-project Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 8e9f25ff5f8a422faef06aa2a33a6c97 Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestFqdnHostnames-752630230-project Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 071cd727-293f-49aa-a7a6-117cf73c817c could not be found. Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '071cd727-293f-49aa-a7a6-117cf73c817c'} Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 071cd727-293f-49aa-a7a6-117cf73c817c could not be found. Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 071cd727-293f-49aa-a7a6-117cf73c817c could not be found. Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:31.906462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:31.912022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:31.912022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:31.912022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:31.912022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:31.912022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:31.912022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 071cd727-293f-49aa-a7a6-117cf73c817c could not be found. Aug 09 14:35:31.912022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:31.912022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37be96b8-ed7e-4008-ab56-0616f20cbca3 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Returning 404 to user: Instance 071cd727-293f-49aa-a7a6-117cf73c817c could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:31.912022 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37be96b8-ed7e-4008-ab56-0616f20cbca3 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c" status: 404 len: 111 microversion: 2.1 time: 0.137765 Aug 09 14:35:31.912022 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 697/1358] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:31 2022] GET /compute/v2.1/servers/071cd727-293f-49aa-a7a6-117cf73c817c => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:35:31.918007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7ff94d71-8108-4d11-9363-01fc3fdd7aa1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] Calling method '.version_select at 0x7f41ddd7e310>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:31.939768 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7ff94d71-8108-4d11-9363-01fc3fdd7aa1 tempest-ServersTestFqdnHostnames-752630230 tempest-ServersTestFqdnHostnames-752630230-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-10932520" status: 202 len: 0 microversion: 2.1 time: 0.025918 Aug 09 14:35:31.943818 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 698/1359] 10.222.0.50 () {58 vars in 1215 bytes} [Tue Aug 9 14:35:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-10932520 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:31.949307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aca7e25d-f364-4fee-9955-1c471c016133 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:31.950462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aca7e25d-f364-4fee-9955-1c471c016133 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:31.960024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aca7e25d-f364-4fee-9955-1c471c016133 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.960760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aca7e25d-f364-4fee-9955-1c471c016133 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.961364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aca7e25d-f364-4fee-9955-1c471c016133 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:31.962227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aca7e25d-f364-4fee-9955-1c471c016133 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:31.962833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aca7e25d-f364-4fee-9955-1c471c016133 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:31.964587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aca7e25d-f364-4fee-9955-1c471c016133 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:32.169410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-44b4f958-6da4-4c03-89d6-61b4ef11cef3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:32.182102 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44b4f958-6da4-4c03-89d6-61b4ef11cef3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1529 microversion: 2.1 time: 0.364232 Aug 09 14:35:32.184062 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 662/1360] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:31 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1529 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:32.194201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2adde88c-6764-4172-9f67-17162e3379d1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:32.195149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2adde88c-6764-4172-9f67-17162e3379d1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:32.201955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2adde88c-6764-4172-9f67-17162e3379d1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:32.202435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2adde88c-6764-4172-9f67-17162e3379d1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:32.203056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2adde88c-6764-4172-9f67-17162e3379d1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:32.203863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2adde88c-6764-4172-9f67-17162e3379d1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:32.204596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2adde88c-6764-4172-9f67-17162e3379d1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:32.205399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2adde88c-6764-4172-9f67-17162e3379d1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:32.376661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aca7e25d-f364-4fee-9955-1c471c016133 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:32.388987 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aca7e25d-f364-4fee-9955-1c471c016133 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1316 microversion: 2.1 time: 0.443784 Aug 09 14:35:32.391374 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 699/1361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:31 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:32.397015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b5df832-e2bf-4d14-8ede-f3c5302eed1e tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:32.398510 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:32.398510 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:35:32.408781 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6b5df832-e2bf-4d14-8ede-f3c5302eed1e tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] HTTP exception thrown: Flavor eeb14548-1469-4dc0-95e8-67a3c1a284fb could not be found. Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b5df832-e2bf-4d14-8ede-f3c5302eed1e tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Request method failure captured: Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/flavors/eeb14548-1469-4dc0-95e8-67a3c1a284fb HTTP/1.1 Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_QHSI87S5EdqnO-QwJaFvCUR5hOHfqHcBhY6SE0c6ECxakkMuloujnoNo6zPkV0zS9IKucxolDnoFD110ElsqU2DbCn-ITRODDv7PU8bMPa_8tuBWf9qTvoG6JHG5-mndWGeWLD7wC9YYbyy_SlpUUVxQe5aQ3JmC6MUYJtx7zG_E Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ade9d9f6a2064be4b4c0d9bb65c10afe Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-MigrationsAdminTest-94267328 Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ade9d9f6a2064be4b4c0d9bb65c10afe", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ade9d9f6a2064be4b4c0d9bb65c10afe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ade9d9f6a2064be4b4c0d9bb65c10afe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ade9d9f6a2064be4b4c0d9bb65c10afe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-MigrationsAdminTest-94267328 Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ade9d9f6a2064be4b4c0d9bb65c10afe Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-MigrationsAdminTest-94267328 Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-MigrationsAdminTest-94267328-project-admin Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 4b6bcc9d7723487a9655932727c72c0d Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-MigrationsAdminTest-94267328-project-admin Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: exception: Flavor eeb14548-1469-4dc0-95e8-67a3c1a284fb could not be found. Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'eeb14548-1469-4dc0-95e8-67a3c1a284fb'} Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor eeb14548-1469-4dc0-95e8-67a3c1a284fb could not be found. Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor eeb14548-1469-4dc0-95e8-67a3c1a284fb could not be found. Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:32.415040 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:32.419530 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:32.419530 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:32.419530 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:32.419530 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:32.419530 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:32.419530 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:32.419530 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor eeb14548-1469-4dc0-95e8-67a3c1a284fb could not be found. Aug 09 14:35:32.419530 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:32.424078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b5df832-e2bf-4d14-8ede-f3c5302eed1e tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Returning 404 to user: Flavor eeb14548-1469-4dc0-95e8-67a3c1a284fb could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:32.425534 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b5df832-e2bf-4d14-8ede-f3c5302eed1e tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/eeb14548-1469-4dc0-95e8-67a3c1a284fb" status: 404 len: 109 microversion: 2.1 time: 0.032858 Aug 09 14:35:32.431634 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 700/1362] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:32 2022] DELETE /compute/v2.1/flavors/eeb14548-1469-4dc0-95e8-67a3c1a284fb => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:35:32.498514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2adde88c-6764-4172-9f67-17162e3379d1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:32.511699 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2adde88c-6764-4172-9f67-17162e3379d1 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1317 microversion: 2.1 time: 0.326190 Aug 09 14:35:32.515421 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 663/1363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:32 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:32.557068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2075035875", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:32.565469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=16 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:32.611852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:35:32.745149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-50b725ca-b408-4e83-a546-6e642ba835da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:32.748046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-50b725ca-b408-4e83-a546-6e642ba835da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:32.755686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50b725ca-b408-4e83-a546-6e642ba835da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:32.756891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50b725ca-b408-4e83-a546-6e642ba835da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:32.757511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50b725ca-b408-4e83-a546-6e642ba835da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:32.758466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50b725ca-b408-4e83-a546-6e642ba835da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:32.759161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50b725ca-b408-4e83-a546-6e642ba835da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:32.759783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50b725ca-b408-4e83-a546-6e642ba835da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:32.795857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:32.802457 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50b725ca-b408-4e83-a546-6e642ba835da tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.062086 Aug 09 14:35:32.803072 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 664/1364] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:35:32 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:32.814666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58d98eeb-71a6-4eef-a675-ce4b21d5b7d8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:32.815984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58d98eeb-71a6-4eef-a675-ce4b21d5b7d8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:32.826929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d98eeb-71a6-4eef-a675-ce4b21d5b7d8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:32.827538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d98eeb-71a6-4eef-a675-ce4b21d5b7d8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:32.828799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d98eeb-71a6-4eef-a675-ce4b21d5b7d8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:32.829986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d98eeb-71a6-4eef-a675-ce4b21d5b7d8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:32.830655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d98eeb-71a6-4eef-a675-ce4b21d5b7d8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:32.831430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58d98eeb-71a6-4eef-a675-ce4b21d5b7d8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:33.178366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:35:33.178825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:35:33.179304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:35:33.179715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:35:33.180118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:35:33.197736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:33.199973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:33.200511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:33.201326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:33.204642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:33.205344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:33.235604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Getting quotas for project 21a086b8d4904e118283cea8eb12b678. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:35:33.242474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Getting quotas for user c45d9a126a0841d5938ee21e8e87b293 and project 21a086b8d4904e118283cea8eb12b678. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:35:33.257722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:35:33.259534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-58d98eeb-71a6-4eef-a675-ce4b21d5b7d8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:33.261454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:35:33.280229 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58d98eeb-71a6-4eef-a675-ce4b21d5b7d8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1368 microversion: 2.1 time: 0.473271 Aug 09 14:35:33.281712 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 665/1365] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:32 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1368 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:33.348765 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e6120fc8-137b-4f98-91b1-eafd484a1210 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796569 Aug 09 14:35:33.349438 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 701/1366] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:35:33.362819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30e6758d-6f5a-47fc-8d4e-c3b0bb456cb8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:33.363778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30e6758d-6f5a-47fc-8d4e-c3b0bb456cb8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:33.412411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d2a1e148-3b1c-4c11-94ca-647ed8e6184d tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:33.413021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d2a1e148-3b1c-4c11-94ca-647ed8e6184d tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:33.429522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2a1e148-3b1c-4c11-94ca-647ed8e6184d tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:33.430797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2a1e148-3b1c-4c11-94ca-647ed8e6184d tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:33.432663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2a1e148-3b1c-4c11-94ca-647ed8e6184d tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:33.435183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2a1e148-3b1c-4c11-94ca-647ed8e6184d tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:33.436264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2a1e148-3b1c-4c11-94ca-647ed8e6184d tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:33.439556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2a1e148-3b1c-4c11-94ca-647ed8e6184d tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:33.516360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30e6758d-6f5a-47fc-8d4e-c3b0bb456cb8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:33.531673 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30e6758d-6f5a-47fc-8d4e-c3b0bb456cb8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1213 microversion: 2.1 time: 0.173037 Aug 09 14:35:33.533050 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 666/1367] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:33 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1213 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:33.539780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-65ca4378-4d22-4568-9f03-2c88fdd9c392 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:33.545127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-65ca4378-4d22-4568-9f03-2c88fdd9c392 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:33.565120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65ca4378-4d22-4568-9f03-2c88fdd9c392 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:33.566243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65ca4378-4d22-4568-9f03-2c88fdd9c392 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:33.568343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65ca4378-4d22-4568-9f03-2c88fdd9c392 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:33.570483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65ca4378-4d22-4568-9f03-2c88fdd9c392 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:33.575246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65ca4378-4d22-4568-9f03-2c88fdd9c392 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:33.576222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65ca4378-4d22-4568-9f03-2c88fdd9c392 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:33.880049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d2a1e148-3b1c-4c11-94ca-647ed8e6184d tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:33.892949 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d2a1e148-3b1c-4c11-94ca-647ed8e6184d tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1316 microversion: 2.1 time: 0.482794 Aug 09 14:35:33.896031 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 702/1368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:33 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:33.999467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-65ca4378-4d22-4568-9f03-2c88fdd9c392 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:34.022379 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-65ca4378-4d22-4568-9f03-2c88fdd9c392 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1317 microversion: 2.1 time: 0.487873 Aug 09 14:35:34.034994 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 667/1369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:33 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:34.306290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cda27bcb-c81f-4eaf-856e-02652dd99c2e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:34.307672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cda27bcb-c81f-4eaf-856e-02652dd99c2e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:34.338962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cda27bcb-c81f-4eaf-856e-02652dd99c2e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:34.339470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cda27bcb-c81f-4eaf-856e-02652dd99c2e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:34.343547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cda27bcb-c81f-4eaf-856e-02652dd99c2e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:34.348508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cda27bcb-c81f-4eaf-856e-02652dd99c2e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:34.351051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cda27bcb-c81f-4eaf-856e-02652dd99c2e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:34.353361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cda27bcb-c81f-4eaf-856e-02652dd99c2e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:34.553684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bec969df-fad8-4575-9669-27addb204172 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:34.555247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bec969df-fad8-4575-9669-27addb204172 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:34.563601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bec969df-fad8-4575-9669-27addb204172 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:34.568293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bec969df-fad8-4575-9669-27addb204172 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:34.569267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bec969df-fad8-4575-9669-27addb204172 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:34.571981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bec969df-fad8-4575-9669-27addb204172 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:34.573535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bec969df-fad8-4575-9669-27addb204172 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:34.576181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bec969df-fad8-4575-9669-27addb204172 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:34.709004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cda27bcb-c81f-4eaf-856e-02652dd99c2e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:34.718661 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cda27bcb-c81f-4eaf-856e-02652dd99c2e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1558 microversion: 2.1 time: 0.416562 Aug 09 14:35:34.723264 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 703/1370] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:34 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1558 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:34.752586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-052f3b66-c1b7-4d49-84ff-a93da4c6741b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:34.753431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-052f3b66-c1b7-4d49-84ff-a93da4c6741b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:34.759948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bec969df-fad8-4575-9669-27addb204172 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:34.761873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-052f3b66-c1b7-4d49-84ff-a93da4c6741b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:34.764468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-052f3b66-c1b7-4d49-84ff-a93da4c6741b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:34.766685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-052f3b66-c1b7-4d49-84ff-a93da4c6741b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:34.767791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-052f3b66-c1b7-4d49-84ff-a93da4c6741b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:34.770528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-052f3b66-c1b7-4d49-84ff-a93da4c6741b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:34.771285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-052f3b66-c1b7-4d49-84ff-a93da4c6741b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:34.777382 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bec969df-fad8-4575-9669-27addb204172 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1217 microversion: 2.1 time: 0.226924 Aug 09 14:35:34.780911 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 668/1371] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:34 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1217 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:34.929168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67cddae0-f5c3-48bb-9b73-7a9f01b6da05 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:34.929471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-67cddae0-f5c3-48bb-9b73-7a9f01b6da05 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:34.967556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cddae0-f5c3-48bb-9b73-7a9f01b6da05 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:34.968216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cddae0-f5c3-48bb-9b73-7a9f01b6da05 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:34.970543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cddae0-f5c3-48bb-9b73-7a9f01b6da05 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:34.971358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cddae0-f5c3-48bb-9b73-7a9f01b6da05 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:34.971826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cddae0-f5c3-48bb-9b73-7a9f01b6da05 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:34.972711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67cddae0-f5c3-48bb-9b73-7a9f01b6da05 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:35.014344 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-052f3b66-c1b7-4d49-84ff-a93da4c6741b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.269687 Aug 09 14:35:35.017032 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 704/1372] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:35:34 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25/os-interface => generated 285 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:35.054970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-29599460-6a2d-4067-8c24-fa69e949d7fd tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:35.055859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-29599460-6a2d-4067-8c24-fa69e949d7fd tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:35.067286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29599460-6a2d-4067-8c24-fa69e949d7fd tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:35.070937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29599460-6a2d-4067-8c24-fa69e949d7fd tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:35.072601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29599460-6a2d-4067-8c24-fa69e949d7fd tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:35.074159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29599460-6a2d-4067-8c24-fa69e949d7fd tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:35.074818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29599460-6a2d-4067-8c24-fa69e949d7fd tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:35.076228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29599460-6a2d-4067-8c24-fa69e949d7fd tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:36.052606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-67cddae0-f5c3-48bb-9b73-7a9f01b6da05 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:36.071859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-29599460-6a2d-4067-8c24-fa69e949d7fd tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:36.084423 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-29599460-6a2d-4067-8c24-fa69e949d7fd tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1317 microversion: 2.1 time: 1.033040 Aug 09 14:35:36.085001 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 705/1373] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:35 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1317 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:36.100377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1019dfdc-80b7-4caa-89c8-7bb89170f3de tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:36.101544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1019dfdc-80b7-4caa-89c8-7bb89170f3de tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:36.118849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1019dfdc-80b7-4caa-89c8-7bb89170f3de tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:36.119621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1019dfdc-80b7-4caa-89c8-7bb89170f3de tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:36.120481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1019dfdc-80b7-4caa-89c8-7bb89170f3de tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:36.121686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1019dfdc-80b7-4caa-89c8-7bb89170f3de tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:36.122336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1019dfdc-80b7-4caa-89c8-7bb89170f3de tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:36.123488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1019dfdc-80b7-4caa-89c8-7bb89170f3de tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:36.128659 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67cddae0-f5c3-48bb-9b73-7a9f01b6da05 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1316 microversion: 2.1 time: 1.205487 Aug 09 14:35:36.130848 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 669/1374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:34 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1316 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:36.157655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:36.619026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1019dfdc-80b7-4caa-89c8-7bb89170f3de tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:36.642618 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1019dfdc-80b7-4caa-89c8-7bb89170f3de tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1271 microversion: 2.1 time: 0.555977 Aug 09 14:35:36.655863 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 706/1375] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:36 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1271 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:36.665639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0100e21e-4b3c-40b1-abdb-3f0e23a8c0d2 req-528951fe-2391-43c5-ba48-382270f8347d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fb81c4-0d70-467d-b9af-b07c64aff027", "name": "network-vif-plugged", "status": "completed", "tag": "2d464e59-9fb7-4f9b-b35f-829e9230de3c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:36.703041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0100e21e-4b3c-40b1-abdb-3f0e23a8c0d2 req-528951fe-2391-43c5-ba48-382270f8347d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:36.705022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0100e21e-4b3c-40b1-abdb-3f0e23a8c0d2 req-528951fe-2391-43c5-ba48-382270f8347d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:36.706192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0100e21e-4b3c-40b1-abdb-3f0e23a8c0d2 req-528951fe-2391-43c5-ba48-382270f8347d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:36.740225 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0100e21e-4b3c-40b1-abdb-3f0e23a8c0d2 req-528951fe-2391-43c5-ba48-382270f8347d service nova] Creating event network-vif-plugged:2d464e59-9fb7-4f9b-b35f-829e9230de3c for instance 88fb81c4-0d70-467d-b9af-b07c64aff027 on n-h1-844626-8 Aug 09 14:35:36.761891 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0100e21e-4b3c-40b1-abdb-3f0e23a8c0d2 req-528951fe-2391-43c5-ba48-382270f8347d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127957 Aug 09 14:35:36.762729 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 670/1376] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:37.121837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c1ea1daf-85b6-4d9b-9fce-517484301580 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:37.122409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c1ea1daf-85b6-4d9b-9fce-517484301580 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:37.132209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1ea1daf-85b6-4d9b-9fce-517484301580 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:37.133189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1ea1daf-85b6-4d9b-9fce-517484301580 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:37.133838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1ea1daf-85b6-4d9b-9fce-517484301580 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:37.135068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1ea1daf-85b6-4d9b-9fce-517484301580 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:37.135908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1ea1daf-85b6-4d9b-9fce-517484301580 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:37.136566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1ea1daf-85b6-4d9b-9fce-517484301580 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:37.175315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-43fc39c9-b644-40f3-9496-e1891e5a0505 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:37.176631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-43fc39c9-b644-40f3-9496-e1891e5a0505 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:37.204597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43fc39c9-b644-40f3-9496-e1891e5a0505 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:37.205642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43fc39c9-b644-40f3-9496-e1891e5a0505 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:37.206482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43fc39c9-b644-40f3-9496-e1891e5a0505 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:37.208003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43fc39c9-b644-40f3-9496-e1891e5a0505 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:37.208878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43fc39c9-b644-40f3-9496-e1891e5a0505 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:37.210093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43fc39c9-b644-40f3-9496-e1891e5a0505 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:37.647066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c1ea1daf-85b6-4d9b-9fce-517484301580 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:37.656712 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c1ea1daf-85b6-4d9b-9fce-517484301580 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1317 microversion: 2.1 time: 0.539664 Aug 09 14:35:37.658470 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 707/1377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:37 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:37.665104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-57f214a6-0daa-4be1-92fe-9ee517a6a747 req-56079440-aefb-44f0-a01d-f300b4753e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd1379b-b2dc-4866-9a3f-d4d03c495a25", "tag": "bb7074b5-7f36-447d-8b2a-ef303f0bc953"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:37.684132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-57f214a6-0daa-4be1-92fe-9ee517a6a747 req-56079440-aefb-44f0-a01d-f300b4753e4e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:37.685043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-57f214a6-0daa-4be1-92fe-9ee517a6a747 req-56079440-aefb-44f0-a01d-f300b4753e4e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:37.685322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-43fc39c9-b644-40f3-9496-e1891e5a0505 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:37.686505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-57f214a6-0daa-4be1-92fe-9ee517a6a747 req-56079440-aefb-44f0-a01d-f300b4753e4e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:37.695974 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-43fc39c9-b644-40f3-9496-e1891e5a0505 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1316 microversion: 2.1 time: 0.526079 Aug 09 14:35:37.697265 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 671/1378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:37 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1316 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:37.711428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2b05bf46-d486-4ae2-9c66-93cd7ad1ab83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:37.712571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2b05bf46-d486-4ae2-9c66-93cd7ad1ab83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:37.717340 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-57f214a6-0daa-4be1-92fe-9ee517a6a747 req-56079440-aefb-44f0-a01d-f300b4753e4e service nova] Creating event network-changed:bb7074b5-7f36-447d-8b2a-ef303f0bc953 for instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 on n-h1-844626-8 Aug 09 14:35:37.724364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b05bf46-d486-4ae2-9c66-93cd7ad1ab83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:37.725259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b05bf46-d486-4ae2-9c66-93cd7ad1ab83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:37.725917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b05bf46-d486-4ae2-9c66-93cd7ad1ab83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:37.726874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b05bf46-d486-4ae2-9c66-93cd7ad1ab83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:37.727627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b05bf46-d486-4ae2-9c66-93cd7ad1ab83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:37.728524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b05bf46-d486-4ae2-9c66-93cd7ad1ab83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:37.731389 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-57f214a6-0daa-4be1-92fe-9ee517a6a747 req-56079440-aefb-44f0-a01d-f300b4753e4e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070575 Aug 09 14:35:37.733969 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 708/1379] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:37.911070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b05bf46-d486-4ae2-9c66-93cd7ad1ab83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:37.923868 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2b05bf46-d486-4ae2-9c66-93cd7ad1ab83 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1271 microversion: 2.1 time: 0.225147 Aug 09 14:35:37.924691 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 672/1380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:37 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:38.602184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-828ce56d-3138-45c8-9ea2-fe9d42fcda30 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:38.603040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-828ce56d-3138-45c8-9ea2-fe9d42fcda30 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:38.617703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-828ce56d-3138-45c8-9ea2-fe9d42fcda30 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:38.618222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-828ce56d-3138-45c8-9ea2-fe9d42fcda30 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:38.621701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-828ce56d-3138-45c8-9ea2-fe9d42fcda30 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:38.624327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-828ce56d-3138-45c8-9ea2-fe9d42fcda30 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:38.624839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-828ce56d-3138-45c8-9ea2-fe9d42fcda30 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:38.625294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-828ce56d-3138-45c8-9ea2-fe9d42fcda30 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:38.682010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c288aa01-5912-4313-83ef-ac322fa58581 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:38.683344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c288aa01-5912-4313-83ef-ac322fa58581 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:38.696806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c288aa01-5912-4313-83ef-ac322fa58581 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:38.697299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c288aa01-5912-4313-83ef-ac322fa58581 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:38.697710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c288aa01-5912-4313-83ef-ac322fa58581 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:38.707342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c288aa01-5912-4313-83ef-ac322fa58581 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:38.708074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c288aa01-5912-4313-83ef-ac322fa58581 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:38.708682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c288aa01-5912-4313-83ef-ac322fa58581 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:39.075946 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-828ce56d-3138-45c8-9ea2-fe9d42fcda30 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1812 microversion: 2.1 time: 0.479910 Aug 09 14:35:39.093395 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 709/1381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:38 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1812 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:39.096871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c288aa01-5912-4313-83ef-ac322fa58581 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:39.099066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6dc6bb19-f453-4722-a2d3-49bf405bce76 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:39.099715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6dc6bb19-f453-4722-a2d3-49bf405bce76 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:39.107710 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c288aa01-5912-4313-83ef-ac322fa58581 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1317 microversion: 2.1 time: 0.429528 Aug 09 14:35:39.120391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc6bb19-f453-4722-a2d3-49bf405bce76 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:39.122091 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 673/1382] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:38 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:39.124834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc6bb19-f453-4722-a2d3-49bf405bce76 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:39.125579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc6bb19-f453-4722-a2d3-49bf405bce76 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:39.127276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc6bb19-f453-4722-a2d3-49bf405bce76 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:39.127987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc6bb19-f453-4722-a2d3-49bf405bce76 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:39.128588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc6bb19-f453-4722-a2d3-49bf405bce76 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:39.146647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f89a0e44-dd40-42bd-8dbc-9240d53449a3 req-017a33bd-090f-4c7e-835d-2ced398b842b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a", "name": "network-vif-plugged", "status": "completed", "tag": "1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:39.190914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f89a0e44-dd40-42bd-8dbc-9240d53449a3 req-017a33bd-090f-4c7e-835d-2ced398b842b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:39.191343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f89a0e44-dd40-42bd-8dbc-9240d53449a3 req-017a33bd-090f-4c7e-835d-2ced398b842b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:39.193730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f89a0e44-dd40-42bd-8dbc-9240d53449a3 req-017a33bd-090f-4c7e-835d-2ced398b842b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:39.228301 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f89a0e44-dd40-42bd-8dbc-9240d53449a3 req-017a33bd-090f-4c7e-835d-2ced398b842b service nova] Creating event network-vif-plugged:1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b for instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a on n-h2-844626-8 Aug 09 14:35:39.268253 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f89a0e44-dd40-42bd-8dbc-9240d53449a3 req-017a33bd-090f-4c7e-835d-2ced398b842b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143088 Aug 09 14:35:39.273233 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 674/1383] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:39.283782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f15005fb-6b59-4d20-8faf-fc71e68164a5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:39.293187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f15005fb-6b59-4d20-8faf-fc71e68164a5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:39.309153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f15005fb-6b59-4d20-8faf-fc71e68164a5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:39.315455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f15005fb-6b59-4d20-8faf-fc71e68164a5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:39.316614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f15005fb-6b59-4d20-8faf-fc71e68164a5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:39.320987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f15005fb-6b59-4d20-8faf-fc71e68164a5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:39.321896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f15005fb-6b59-4d20-8faf-fc71e68164a5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:39.323268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f15005fb-6b59-4d20-8faf-fc71e68164a5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:39.513865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6dc6bb19-f453-4722-a2d3-49bf405bce76 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:39.526393 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6dc6bb19-f453-4722-a2d3-49bf405bce76 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1316 microversion: 2.1 time: 0.431785 Aug 09 14:35:39.527819 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 710/1384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:39 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:39.543072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-613dcb46-54fc-46cb-b66d-93f75551209b tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:39.546259 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:39.546259 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:35:39.551541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-613dcb46-54fc-46cb-b66d-93f75551209b tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:39.553810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-613dcb46-54fc-46cb-b66d-93f75551209b tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:39.557796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-613dcb46-54fc-46cb-b66d-93f75551209b tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:39.558846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-613dcb46-54fc-46cb-b66d-93f75551209b tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:39.559526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-613dcb46-54fc-46cb-b66d-93f75551209b tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:39.560128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-613dcb46-54fc-46cb-b66d-93f75551209b tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:39.600213 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-613dcb46-54fc-46cb-b66d-93f75551209b tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.065098 Aug 09 14:35:39.601480 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 711/1385] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 9 14:35:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:39.655597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f15005fb-6b59-4d20-8faf-fc71e68164a5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:39.670160 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f15005fb-6b59-4d20-8faf-fc71e68164a5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1313 microversion: 2.1 time: 0.395064 Aug 09 14:35:39.672783 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 675/1386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:39 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:40.139488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3bbd1721-8d4b-4567-a0b0-20ddd57fccd9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:40.140492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3bbd1721-8d4b-4567-a0b0-20ddd57fccd9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:40.173801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbd1721-8d4b-4567-a0b0-20ddd57fccd9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:40.175004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbd1721-8d4b-4567-a0b0-20ddd57fccd9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:40.175936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbd1721-8d4b-4567-a0b0-20ddd57fccd9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:40.176810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbd1721-8d4b-4567-a0b0-20ddd57fccd9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:40.177503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbd1721-8d4b-4567-a0b0-20ddd57fccd9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:40.178159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbd1721-8d4b-4567-a0b0-20ddd57fccd9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:40.541520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3bbd1721-8d4b-4567-a0b0-20ddd57fccd9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:40.553038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4a00de4-d405-4338-bed9-30cb291a1feb tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:40.553763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4a00de4-d405-4338-bed9-30cb291a1feb tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:40.562730 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3bbd1721-8d4b-4567-a0b0-20ddd57fccd9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1467 microversion: 2.1 time: 0.436316 Aug 09 14:35:40.566405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4a00de4-d405-4338-bed9-30cb291a1feb tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:40.567272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4a00de4-d405-4338-bed9-30cb291a1feb tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:40.567930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4a00de4-d405-4338-bed9-30cb291a1feb tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:40.568881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4a00de4-d405-4338-bed9-30cb291a1feb tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:40.569543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4a00de4-d405-4338-bed9-30cb291a1feb tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:40.570203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4a00de4-d405-4338-bed9-30cb291a1feb tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:40.590873 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 712/1387] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:40 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1467 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:40.599773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62e02024-6902-472e-b9e5-071bb3a37d11 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:40.605074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-62e02024-6902-472e-b9e5-071bb3a37d11 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:40.615054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62e02024-6902-472e-b9e5-071bb3a37d11 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:40.615860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62e02024-6902-472e-b9e5-071bb3a37d11 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:40.616757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62e02024-6902-472e-b9e5-071bb3a37d11 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:40.617888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62e02024-6902-472e-b9e5-071bb3a37d11 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:40.618501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62e02024-6902-472e-b9e5-071bb3a37d11 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:40.619385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62e02024-6902-472e-b9e5-071bb3a37d11 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:41.007414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b4a00de4-d405-4338-bed9-30cb291a1feb tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:41.026298 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4a00de4-d405-4338-bed9-30cb291a1feb tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1316 microversion: 2.1 time: 0.477217 Aug 09 14:35:41.028499 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 676/1388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:40 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:41.046001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0f4d7a3c-c5ff-4c06-8cbf-5edeaa107831 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:41.047226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0f4d7a3c-c5ff-4c06-8cbf-5edeaa107831 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:41.072586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f4d7a3c-c5ff-4c06-8cbf-5edeaa107831 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:41.073102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f4d7a3c-c5ff-4c06-8cbf-5edeaa107831 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:41.073547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f4d7a3c-c5ff-4c06-8cbf-5edeaa107831 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:41.074407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f4d7a3c-c5ff-4c06-8cbf-5edeaa107831 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:41.074721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f4d7a3c-c5ff-4c06-8cbf-5edeaa107831 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:41.075169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f4d7a3c-c5ff-4c06-8cbf-5edeaa107831 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:41.164688 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-62e02024-6902-472e-b9e5-071bb3a37d11 tempest-ServersOnMultiNodesTest-1485669339 tempest-ServersOnMultiNodesTest-1485669339-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1618 microversion: 2.1 time: 0.572551 Aug 09 14:35:41.168102 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 713/1389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:40 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1618 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:41.193540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d66e3362-53f2-4d83-a4d6-ecfa3462c341 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:41.194478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d66e3362-53f2-4d83-a4d6-ecfa3462c341 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:41.209397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d66e3362-53f2-4d83-a4d6-ecfa3462c341 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:41.210248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d66e3362-53f2-4d83-a4d6-ecfa3462c341 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:41.217627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d66e3362-53f2-4d83-a4d6-ecfa3462c341 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:41.220281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d66e3362-53f2-4d83-a4d6-ecfa3462c341 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:41.221041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d66e3362-53f2-4d83-a4d6-ecfa3462c341 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:41.222587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d66e3362-53f2-4d83-a4d6-ecfa3462c341 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:41.290346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d66e3362-53f2-4d83-a4d6-ecfa3462c341 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:35:41.435461 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d66e3362-53f2-4d83-a4d6-ecfa3462c341 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "DELETE /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 204 len: 0 microversion: 2.1 time: 0.244555 Aug 09 14:35:41.442133 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 714/1390] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:41 2022] DELETE /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:35:41.456282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c127538a-8565-4559-ac87-34eaad4dc537 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:41.456995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c127538a-8565-4559-ac87-34eaad4dc537 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:41.479735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c127538a-8565-4559-ac87-34eaad4dc537 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:41.480786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c127538a-8565-4559-ac87-34eaad4dc537 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:41.481231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c127538a-8565-4559-ac87-34eaad4dc537 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:41.482861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c127538a-8565-4559-ac87-34eaad4dc537 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:41.485273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c127538a-8565-4559-ac87-34eaad4dc537 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:41.485720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c127538a-8565-4559-ac87-34eaad4dc537 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:41.666767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0f4d7a3c-c5ff-4c06-8cbf-5edeaa107831 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:41.681568 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0f4d7a3c-c5ff-4c06-8cbf-5edeaa107831 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1313 microversion: 2.1 time: 0.651167 Aug 09 14:35:41.696068 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 677/1391] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:41 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1313 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:41.812737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-085c3a8a-f835-4d48-b3b6-100a316d2a8d req-b855ed2b-dd71-45ca-8bfe-99bc1c4475e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9192b19-8eae-49be-94bd-9a7cb5ace3e0", "tag": "73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:41.840585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-085c3a8a-f835-4d48-b3b6-100a316d2a8d req-b855ed2b-dd71-45ca-8bfe-99bc1c4475e5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:41.842679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-085c3a8a-f835-4d48-b3b6-100a316d2a8d req-b855ed2b-dd71-45ca-8bfe-99bc1c4475e5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:41.843620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-085c3a8a-f835-4d48-b3b6-100a316d2a8d req-b855ed2b-dd71-45ca-8bfe-99bc1c4475e5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:41.908527 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-085c3a8a-f835-4d48-b3b6-100a316d2a8d req-b855ed2b-dd71-45ca-8bfe-99bc1c4475e5 service nova] Creating event network-changed:73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e for instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 on n-h2-844626-8 Aug 09 14:35:41.917475 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-085c3a8a-f835-4d48-b3b6-100a316d2a8d req-b855ed2b-dd71-45ca-8bfe-99bc1c4475e5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109182 Aug 09 14:35:41.918308 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 678/1392] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:35:42.004937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c127538a-8565-4559-ac87-34eaad4dc537 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:42.019357 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c127538a-8565-4559-ac87-34eaad4dc537 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1473 microversion: 2.1 time: 0.572837 Aug 09 14:35:42.023389 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 715/1393] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:41 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1473 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:42.049893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2255a29a-a1b6-4e1e-8e3f-a06749c36c85 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:42.050517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2255a29a-a1b6-4e1e-8e3f-a06749c36c85 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:42.065822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2255a29a-a1b6-4e1e-8e3f-a06749c36c85 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:42.066306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2255a29a-a1b6-4e1e-8e3f-a06749c36c85 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:42.066767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2255a29a-a1b6-4e1e-8e3f-a06749c36c85 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:42.067777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2255a29a-a1b6-4e1e-8e3f-a06749c36c85 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:42.068226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2255a29a-a1b6-4e1e-8e3f-a06749c36c85 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:42.068645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2255a29a-a1b6-4e1e-8e3f-a06749c36c85 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:42.158537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e63e1b59-0b31-4619-a085-9f0c67846ce3 req-8b462625-35bf-4c86-9c42-01da8a3af1ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8e83a4-e16d-4a23-a596-61224bdf98b6", "name": "network-vif-plugged", "status": "completed", "tag": "6032a560-a43f-47d1-88ad-7d302223a7a5"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:42.187202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e63e1b59-0b31-4619-a085-9f0c67846ce3 req-8b462625-35bf-4c86-9c42-01da8a3af1ac service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:42.199840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e63e1b59-0b31-4619-a085-9f0c67846ce3 req-8b462625-35bf-4c86-9c42-01da8a3af1ac service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:42.200809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e63e1b59-0b31-4619-a085-9f0c67846ce3 req-8b462625-35bf-4c86-9c42-01da8a3af1ac service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:42.229299 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e63e1b59-0b31-4619-a085-9f0c67846ce3 req-8b462625-35bf-4c86-9c42-01da8a3af1ac service nova] Creating event network-vif-plugged:6032a560-a43f-47d1-88ad-7d302223a7a5 for instance 3b8e83a4-e16d-4a23-a596-61224bdf98b6 on n-h2-844626-8 Aug 09 14:35:42.244171 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e63e1b59-0b31-4619-a085-9f0c67846ce3 req-8b462625-35bf-4c86-9c42-01da8a3af1ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089173 Aug 09 14:35:42.245349 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 716/1394] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:35:42.584873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2255a29a-a1b6-4e1e-8e3f-a06749c36c85 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:42.587315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-74edd157-7266-435a-a6ee-d7ff6a6555b3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "192e85c5-410e-4327-8c20-3f6653471458", "device": "/dev/xvdb"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:42.590402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-74edd157-7266-435a-a6ee-d7ff6a6555b3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:42.598388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74edd157-7266-435a-a6ee-d7ff6a6555b3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:42.599161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74edd157-7266-435a-a6ee-d7ff6a6555b3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:42.599764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74edd157-7266-435a-a6ee-d7ff6a6555b3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:42.601446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74edd157-7266-435a-a6ee-d7ff6a6555b3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:42.602054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74edd157-7266-435a-a6ee-d7ff6a6555b3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:42.603316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74edd157-7266-435a-a6ee-d7ff6a6555b3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:42.605463 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2255a29a-a1b6-4e1e-8e3f-a06749c36c85 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1316 microversion: 2.1 time: 0.560931 Aug 09 14:35:42.606060 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 679/1395] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:42 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1316 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:42.706019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6916e18b-91b7-44bc-90e6-37b7cd92cc80 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:42.706740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6916e18b-91b7-44bc-90e6-37b7cd92cc80 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:42.723572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6916e18b-91b7-44bc-90e6-37b7cd92cc80 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:42.723572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6916e18b-91b7-44bc-90e6-37b7cd92cc80 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:42.723572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6916e18b-91b7-44bc-90e6-37b7cd92cc80 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:42.723572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6916e18b-91b7-44bc-90e6-37b7cd92cc80 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:42.725088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6916e18b-91b7-44bc-90e6-37b7cd92cc80 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:42.725620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6916e18b-91b7-44bc-90e6-37b7cd92cc80 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:43.087715 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-74edd157-7266-435a-a6ee-d7ff6a6555b3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "POST /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.503515 Aug 09 14:35:43.088930 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 717/1396] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 14:35:42 2022] POST /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments => generated 194 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:43.095644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cb27c8ed-87d4-48dd-a3ac-7ae64fc52066 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:43.096862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cb27c8ed-87d4-48dd-a3ac-7ae64fc52066 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:43.105147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb27c8ed-87d4-48dd-a3ac-7ae64fc52066 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:43.106348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb27c8ed-87d4-48dd-a3ac-7ae64fc52066 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:43.106967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb27c8ed-87d4-48dd-a3ac-7ae64fc52066 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:43.107905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb27c8ed-87d4-48dd-a3ac-7ae64fc52066 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:43.108721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb27c8ed-87d4-48dd-a3ac-7ae64fc52066 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:43.110820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb27c8ed-87d4-48dd-a3ac-7ae64fc52066 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:43.161810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6916e18b-91b7-44bc-90e6-37b7cd92cc80 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:43.172258 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6916e18b-91b7-44bc-90e6-37b7cd92cc80 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1313 microversion: 2.1 time: 0.470036 Aug 09 14:35:43.176378 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 680/1397] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:42 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:43.256405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:43.453759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cb27c8ed-87d4-48dd-a3ac-7ae64fc52066 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:43.474100 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cb27c8ed-87d4-48dd-a3ac-7ae64fc52066 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1473 microversion: 2.1 time: 0.381636 Aug 09 14:35:43.476198 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 718/1398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:43 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1473 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:43.627867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e39279ff-0166-468b-8e53-cc7ca83ad3ee tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:43.628593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e39279ff-0166-468b-8e53-cc7ca83ad3ee tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:43.631411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:43.655551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e39279ff-0166-468b-8e53-cc7ca83ad3ee tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:43.656991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e39279ff-0166-468b-8e53-cc7ca83ad3ee tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:43.658643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e39279ff-0166-468b-8e53-cc7ca83ad3ee tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:43.661696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e39279ff-0166-468b-8e53-cc7ca83ad3ee tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:43.663103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e39279ff-0166-468b-8e53-cc7ca83ad3ee tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:43.663886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e39279ff-0166-468b-8e53-cc7ca83ad3ee tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:44.196987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-47b572e9-9245-48d0-b091-19bf814f0d7a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:44.198049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-47b572e9-9245-48d0-b091-19bf814f0d7a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:44.210290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47b572e9-9245-48d0-b091-19bf814f0d7a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:44.211813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47b572e9-9245-48d0-b091-19bf814f0d7a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:44.213957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47b572e9-9245-48d0-b091-19bf814f0d7a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:44.216093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47b572e9-9245-48d0-b091-19bf814f0d7a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:44.225184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47b572e9-9245-48d0-b091-19bf814f0d7a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:44.230063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47b572e9-9245-48d0-b091-19bf814f0d7a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:44.470283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e39279ff-0166-468b-8e53-cc7ca83ad3ee tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:44.483362 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e39279ff-0166-468b-8e53-cc7ca83ad3ee tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1316 microversion: 2.1 time: 0.859957 Aug 09 14:35:44.484779 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 681/1399] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:43 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1316 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:44.501626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75b2cc89-b319-4bbe-9f9f-6bf3e8fac3e3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:44.502175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75b2cc89-b319-4bbe-9f9f-6bf3e8fac3e3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:44.522738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75b2cc89-b319-4bbe-9f9f-6bf3e8fac3e3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:44.523257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75b2cc89-b319-4bbe-9f9f-6bf3e8fac3e3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:44.523682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75b2cc89-b319-4bbe-9f9f-6bf3e8fac3e3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:44.524593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75b2cc89-b319-4bbe-9f9f-6bf3e8fac3e3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:44.525037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75b2cc89-b319-4bbe-9f9f-6bf3e8fac3e3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:44.525619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75b2cc89-b319-4bbe-9f9f-6bf3e8fac3e3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:44.828311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-47b572e9-9245-48d0-b091-19bf814f0d7a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:44.846405 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-47b572e9-9245-48d0-b091-19bf814f0d7a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1313 microversion: 2.1 time: 0.648787 Aug 09 14:35:44.852355 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 719/1400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:44 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1313 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:44.871490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-75b2cc89-b319-4bbe-9f9f-6bf3e8fac3e3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:44.893072 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75b2cc89-b319-4bbe-9f9f-6bf3e8fac3e3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 200 len: 1473 microversion: 2.1 time: 0.392797 Aug 09 14:35:44.906871 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 682/1401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:44 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 1473 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:45.507458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c3fa7490-9c1f-4b3a-9a7b-621d2d5da47e tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:45.508924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c3fa7490-9c1f-4b3a-9a7b-621d2d5da47e tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:45.517459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3fa7490-9c1f-4b3a-9a7b-621d2d5da47e tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:45.536537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3fa7490-9c1f-4b3a-9a7b-621d2d5da47e tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:45.538302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3fa7490-9c1f-4b3a-9a7b-621d2d5da47e tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:45.539404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3fa7490-9c1f-4b3a-9a7b-621d2d5da47e tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:45.540014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3fa7490-9c1f-4b3a-9a7b-621d2d5da47e tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:45.540594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3fa7490-9c1f-4b3a-9a7b-621d2d5da47e tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:45.766081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1473af9d-98a4-42aa-ba38-8550dfaea7ea req-8947f839-ccaf-49c4-b87a-43cecd09657c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88fb81c4-0d70-467d-b9af-b07c64aff027", "name": "network-vif-deleted", "tag": "2d464e59-9fb7-4f9b-b35f-829e9230de3c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:45.802653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1473af9d-98a4-42aa-ba38-8550dfaea7ea req-8947f839-ccaf-49c4-b87a-43cecd09657c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:45.804089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1473af9d-98a4-42aa-ba38-8550dfaea7ea req-8947f839-ccaf-49c4-b87a-43cecd09657c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:45.804541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1473af9d-98a4-42aa-ba38-8550dfaea7ea req-8947f839-ccaf-49c4-b87a-43cecd09657c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:45.831284 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1473af9d-98a4-42aa-ba38-8550dfaea7ea req-8947f839-ccaf-49c4-b87a-43cecd09657c service nova] Creating event network-vif-deleted:2d464e59-9fb7-4f9b-b35f-829e9230de3c for instance 88fb81c4-0d70-467d-b9af-b07c64aff027 on n-h1-844626-8 Aug 09 14:35:45.845478 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1473af9d-98a4-42aa-ba38-8550dfaea7ea req-8947f839-ccaf-49c4-b87a-43cecd09657c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.403777 Aug 09 14:35:45.850903 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 720/1402] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:45.887341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34edaac8-c7c2-4713-8922-ae902128b5f7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:45.888366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34edaac8-c7c2-4713-8922-ae902128b5f7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:45.898097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34edaac8-c7c2-4713-8922-ae902128b5f7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:45.903928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34edaac8-c7c2-4713-8922-ae902128b5f7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:45.909550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34edaac8-c7c2-4713-8922-ae902128b5f7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:45.910622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34edaac8-c7c2-4713-8922-ae902128b5f7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:45.911342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34edaac8-c7c2-4713-8922-ae902128b5f7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:45.911978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34edaac8-c7c2-4713-8922-ae902128b5f7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:46.571833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34edaac8-c7c2-4713-8922-ae902128b5f7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:46.588364 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34edaac8-c7c2-4713-8922-ae902128b5f7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1313 microversion: 2.1 time: 0.706604 Aug 09 14:35:46.589145 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 721/1403] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:45 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1313 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:46.604735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-247e9e8b-5649-4c2e-8e45-3806e3d20a5a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:46.605620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-247e9e8b-5649-4c2e-8e45-3806e3d20a5a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 88fb81c4-0d70-467d-b9af-b07c64aff027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:46.617449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247e9e8b-5649-4c2e-8e45-3806e3d20a5a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:46.618207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247e9e8b-5649-4c2e-8e45-3806e3d20a5a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:46.618852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247e9e8b-5649-4c2e-8e45-3806e3d20a5a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:46.619780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247e9e8b-5649-4c2e-8e45-3806e3d20a5a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:46.620402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247e9e8b-5649-4c2e-8e45-3806e3d20a5a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:46.625825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247e9e8b-5649-4c2e-8e45-3806e3d20a5a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:46.656204 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-247e9e8b-5649-4c2e-8e45-3806e3d20a5a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] HTTP exception thrown: Instance 88fb81c4-0d70-467d-b9af-b07c64aff027 could not be found. Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-247e9e8b-5649-4c2e-8e45-3806e3d20a5a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Request method failure captured: Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 HTTP/1.1 Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nAxd9eijW7X2rhOnHb4abugVXlQo199zVPOYR0vHABm_qKntSOkPPdw-VVY24AM5btmhqYeipUr5RjEYqu5zrO_lbVw7jUtDNDItvIwQLV5L8fl2A08iRmDBWaFdl8nTidxhJ88XTQb2v6LwvvWrJ1KlYEj00AMV3DPEo-4IzdmtKY Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9471973b988a4c31be31dde4cef1489e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d68dcb9c00cf4ffebcc05a7d44793468 Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 88fb81c4-0d70-467d-b9af-b07c64aff027 could not be found. Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '88fb81c4-0d70-467d-b9af-b07c64aff027'} Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88fb81c4-0d70-467d-b9af-b07c64aff027 could not be found. Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88fb81c4-0d70-467d-b9af-b07c64aff027 could not be found. Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:46.664033 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:46.668432 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:46.668432 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:46.668432 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:46.668432 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:46.668432 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:46.668432 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88fb81c4-0d70-467d-b9af-b07c64aff027 could not be found. Aug 09 14:35:46.668432 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:46.670286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-247e9e8b-5649-4c2e-8e45-3806e3d20a5a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Returning 404 to user: Instance 88fb81c4-0d70-467d-b9af-b07c64aff027 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:46.671382 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-247e9e8b-5649-4c2e-8e45-3806e3d20a5a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027" status: 404 len: 111 microversion: 2.1 time: 0.071645 Aug 09 14:35:46.683120 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 722/1404] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:46 2022] GET /compute/v2.1/servers/88fb81c4-0d70-467d-b9af-b07c64aff027 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:35:46.691291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d4432278-1fc2-480f-9249-9a6dfbcb9faf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:46.692102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d4432278-1fc2-480f-9249-9a6dfbcb9faf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:46.701815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4432278-1fc2-480f-9249-9a6dfbcb9faf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:46.716009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4432278-1fc2-480f-9249-9a6dfbcb9faf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:46.716870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4432278-1fc2-480f-9249-9a6dfbcb9faf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:46.717978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4432278-1fc2-480f-9249-9a6dfbcb9faf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:46.718527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4432278-1fc2-480f-9249-9a6dfbcb9faf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:46.719061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4432278-1fc2-480f-9249-9a6dfbcb9faf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:46.776183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:46.781182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d4432278-1fc2-480f-9249-9a6dfbcb9faf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:35:46.899645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c3fa7490-9c1f-4b3a-9a7b-621d2d5da47e tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:46.922247 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c3fa7490-9c1f-4b3a-9a7b-621d2d5da47e tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1505 microversion: 2.1 time: 1.418694 Aug 09 14:35:46.926557 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 683/1405] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:45 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1505 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:46.958465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a13c09bb-3864-42b1-81c9-ba7d6a79a983 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:46.958796 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d4432278-1fc2-480f-9249-9a6dfbcb9faf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 204 len: 0 microversion: 2.1 time: 0.271502 Aug 09 14:35:46.962336 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 723/1406] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:46 2022] DELETE /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:35:46.963851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a13c09bb-3864-42b1-81c9-ba7d6a79a983 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:46.971864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c172ac5-8383-42c4-8437-5ed3608905bf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:46.974144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6c172ac5-8383-42c4-8437-5ed3608905bf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:46.980738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a13c09bb-3864-42b1-81c9-ba7d6a79a983 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:46.981544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a13c09bb-3864-42b1-81c9-ba7d6a79a983 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:46.982175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a13c09bb-3864-42b1-81c9-ba7d6a79a983 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:46.984724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a13c09bb-3864-42b1-81c9-ba7d6a79a983 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:46.986502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a13c09bb-3864-42b1-81c9-ba7d6a79a983 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:46.988894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a13c09bb-3864-42b1-81c9-ba7d6a79a983 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:46.992207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c172ac5-8383-42c4-8437-5ed3608905bf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:46.992989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c172ac5-8383-42c4-8437-5ed3608905bf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:46.993571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c172ac5-8383-42c4-8437-5ed3608905bf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:46.994450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c172ac5-8383-42c4-8437-5ed3608905bf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:46.995042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c172ac5-8383-42c4-8437-5ed3608905bf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:46.995632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c172ac5-8383-42c4-8437-5ed3608905bf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:47.037196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:47.064964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a13c09bb-3864-42b1-81c9-ba7d6a79a983 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:47.067108 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a13c09bb-3864-42b1-81c9-ba7d6a79a983 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6/os-instance-actions/req-8d493020-b508-4c3c-aac5-7939ca57943c" status: 200 len: 313 microversion: 2.1 time: 0.125305 Aug 09 14:35:47.068378 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 684/1407] 10.222.0.50 () {58 vars in 1419 bytes} [Tue Aug 9 14:35:46 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6/os-instance-actions/req-8d493020-b508-4c3c-aac5-7939ca57943c => generated 313 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:35:47.089161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a88354c-f565-4d12-97ca-bac31ef12d49 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:47.101507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a88354c-f565-4d12-97ca-bac31ef12d49 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:47.126958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a88354c-f565-4d12-97ca-bac31ef12d49 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:47.127396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a88354c-f565-4d12-97ca-bac31ef12d49 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:47.127828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a88354c-f565-4d12-97ca-bac31ef12d49 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:47.128535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a88354c-f565-4d12-97ca-bac31ef12d49 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:47.133559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a88354c-f565-4d12-97ca-bac31ef12d49 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:47.136792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a88354c-f565-4d12-97ca-bac31ef12d49 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:47.272691 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a88354c-f565-4d12-97ca-bac31ef12d49 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "POST /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6/action" status: 202 len: 0 microversion: 2.1 time: 0.194424 Aug 09 14:35:47.276678 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 685/1408] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:35:47 2022] POST /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:47.282316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-53838373-bc05-48f3-b2d8-1498c6268204 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:47.283026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-53838373-bc05-48f3-b2d8-1498c6268204 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:47.290597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53838373-bc05-48f3-b2d8-1498c6268204 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:47.291127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53838373-bc05-48f3-b2d8-1498c6268204 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:47.291553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53838373-bc05-48f3-b2d8-1498c6268204 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:47.292272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53838373-bc05-48f3-b2d8-1498c6268204 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:47.292849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53838373-bc05-48f3-b2d8-1498c6268204 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:47.293291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53838373-bc05-48f3-b2d8-1498c6268204 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:47.335663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6c172ac5-8383-42c4-8437-5ed3608905bf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:47.350696 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6c172ac5-8383-42c4-8437-5ed3608905bf tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1472 microversion: 2.1 time: 0.386183 Aug 09 14:35:47.352307 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 724/1409] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:46 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1472 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:47.580907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-53838373-bc05-48f3-b2d8-1498c6268204 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:47.591638 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-53838373-bc05-48f3-b2d8-1498c6268204 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1507 microversion: 2.1 time: 0.313607 Aug 09 14:35:47.592498 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 686/1410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:47 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1507 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:47.610532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fca13d2-ce9b-44f8-b741-8ca685e2c649 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:47.611749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3fca13d2-ce9b-44f8-b741-8ca685e2c649 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:47.638698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fca13d2-ce9b-44f8-b741-8ca685e2c649 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:47.641245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fca13d2-ce9b-44f8-b741-8ca685e2c649 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:47.650569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fca13d2-ce9b-44f8-b741-8ca685e2c649 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:47.652043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fca13d2-ce9b-44f8-b741-8ca685e2c649 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:47.655197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fca13d2-ce9b-44f8-b741-8ca685e2c649 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:47.656595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fca13d2-ce9b-44f8-b741-8ca685e2c649 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:48.130793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3fca13d2-ce9b-44f8-b741-8ca685e2c649 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:48.150919 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fca13d2-ce9b-44f8-b741-8ca685e2c649 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1313 microversion: 2.1 time: 0.540506 Aug 09 14:35:48.166914 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 725/1411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:47 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1313 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:48.378407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c8df19a-6f7f-4cad-bb55-e5b6204474eb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:48.380338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3c8df19a-6f7f-4cad-bb55-e5b6204474eb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:48.402677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c8df19a-6f7f-4cad-bb55-e5b6204474eb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:48.403409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c8df19a-6f7f-4cad-bb55-e5b6204474eb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:48.404088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c8df19a-6f7f-4cad-bb55-e5b6204474eb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:48.405018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c8df19a-6f7f-4cad-bb55-e5b6204474eb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:48.405652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c8df19a-6f7f-4cad-bb55-e5b6204474eb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:48.406446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c8df19a-6f7f-4cad-bb55-e5b6204474eb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:48.623646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d957359-6961-4d14-a678-100cf074fcbf tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:48.624631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d957359-6961-4d14-a678-100cf074fcbf tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:48.637476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d957359-6961-4d14-a678-100cf074fcbf tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:48.638309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d957359-6961-4d14-a678-100cf074fcbf tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:48.639117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d957359-6961-4d14-a678-100cf074fcbf tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:48.641525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d957359-6961-4d14-a678-100cf074fcbf tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:48.644107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d957359-6961-4d14-a678-100cf074fcbf tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:48.644839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d957359-6961-4d14-a678-100cf074fcbf tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:49.023162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3c8df19a-6f7f-4cad-bb55-e5b6204474eb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:49.038460 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3c8df19a-6f7f-4cad-bb55-e5b6204474eb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1472 microversion: 2.1 time: 0.664714 Aug 09 14:35:49.053270 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 687/1412] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:48 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1472 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:49.177072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0e5ae71-93b0-4738-8d3a-d101edca2f34 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:49.178094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0e5ae71-93b0-4738-8d3a-d101edca2f34 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:49.191372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e5ae71-93b0-4738-8d3a-d101edca2f34 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:49.194458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e5ae71-93b0-4738-8d3a-d101edca2f34 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:49.195738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e5ae71-93b0-4738-8d3a-d101edca2f34 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:49.196623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e5ae71-93b0-4738-8d3a-d101edca2f34 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:49.197583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e5ae71-93b0-4738-8d3a-d101edca2f34 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:49.203857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d957359-6961-4d14-a678-100cf074fcbf tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:49.215996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e5ae71-93b0-4738-8d3a-d101edca2f34 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:49.227180 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d957359-6961-4d14-a678-100cf074fcbf tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1507 microversion: 2.1 time: 0.603841 Aug 09 14:35:49.229199 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 726/1413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:48 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1507 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:49.878726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0e5ae71-93b0-4738-8d3a-d101edca2f34 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:49.896429 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0e5ae71-93b0-4738-8d3a-d101edca2f34 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1313 microversion: 2.1 time: 0.726285 Aug 09 14:35:49.899615 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 688/1414] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:49 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1313 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:50.066545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df344dbc-c857-40a4-bc3b-4f3dd6f13425 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:50.067193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-df344dbc-c857-40a4-bc3b-4f3dd6f13425 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:50.073374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:50.090922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df344dbc-c857-40a4-bc3b-4f3dd6f13425 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:50.091447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df344dbc-c857-40a4-bc3b-4f3dd6f13425 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:50.104629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df344dbc-c857-40a4-bc3b-4f3dd6f13425 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:50.105601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df344dbc-c857-40a4-bc3b-4f3dd6f13425 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:50.106096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df344dbc-c857-40a4-bc3b-4f3dd6f13425 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:50.106630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df344dbc-c857-40a4-bc3b-4f3dd6f13425 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:50.253771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c72d267-f3af-44e4-8811-39c615e42a99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:50.254769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c72d267-f3af-44e4-8811-39c615e42a99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:50.278272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c72d267-f3af-44e4-8811-39c615e42a99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:50.279589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c72d267-f3af-44e4-8811-39c615e42a99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:50.280115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c72d267-f3af-44e4-8811-39c615e42a99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:50.281105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c72d267-f3af-44e4-8811-39c615e42a99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:50.284327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c72d267-f3af-44e4-8811-39c615e42a99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:50.285592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c72d267-f3af-44e4-8811-39c615e42a99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:50.733698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-df344dbc-c857-40a4-bc3b-4f3dd6f13425 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:50.748362 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-df344dbc-c857-40a4-bc3b-4f3dd6f13425 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1472 microversion: 2.1 time: 0.686104 Aug 09 14:35:50.749597 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 727/1415] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:50 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1472 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:51.207866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c72d267-f3af-44e4-8811-39c615e42a99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:51.218867 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c72d267-f3af-44e4-8811-39c615e42a99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1507 microversion: 2.1 time: 0.970242 Aug 09 14:35:51.219517 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 689/1416] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:50 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1507 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:51.254624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58ba82eb-8f6f-486a-b10e-de27c7498762 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:51.255285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58ba82eb-8f6f-486a-b10e-de27c7498762 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:51.278025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ba82eb-8f6f-486a-b10e-de27c7498762 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:51.279077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ba82eb-8f6f-486a-b10e-de27c7498762 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:51.282891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ba82eb-8f6f-486a-b10e-de27c7498762 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:51.284836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ba82eb-8f6f-486a-b10e-de27c7498762 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:51.286004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ba82eb-8f6f-486a-b10e-de27c7498762 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:51.286588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58ba82eb-8f6f-486a-b10e-de27c7498762 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:51.640362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-58ba82eb-8f6f-486a-b10e-de27c7498762 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:51.655134 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58ba82eb-8f6f-486a-b10e-de27c7498762 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1313 microversion: 2.1 time: 0.412182 Aug 09 14:35:51.656406 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 690/1417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:51 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:51.772162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:51.773038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:51.786340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:51.792165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:51.795464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:51.798111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:51.801570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:51.804926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:51.880013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-addaf938-4602-4dab-8817-6fa0c334967b req-0e9ae1c1-3b56-4eb2-9f4b-7cdf47c17a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e378f03a-f41f-4a85-b1bd-68c0f863acd8", "name": "network-vif-deleted", "tag": "e9321539-69db-4652-aad2-ee56c29966f9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:51.905912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-addaf938-4602-4dab-8817-6fa0c334967b req-0e9ae1c1-3b56-4eb2-9f4b-7cdf47c17a75 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:51.906509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-addaf938-4602-4dab-8817-6fa0c334967b req-0e9ae1c1-3b56-4eb2-9f4b-7cdf47c17a75 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:51.906949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-addaf938-4602-4dab-8817-6fa0c334967b req-0e9ae1c1-3b56-4eb2-9f4b-7cdf47c17a75 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:51.917425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:51.919373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:51.920511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:51.921461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lazy-loading 'fault' on Instance uuid e378f03a-f41f-4a85-b1bd-68c0f863acd8 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:35:51.947302 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-addaf938-4602-4dab-8817-6fa0c334967b req-0e9ae1c1-3b56-4eb2-9f4b-7cdf47c17a75 service nova] Creating event network-vif-deleted:e9321539-69db-4652-aad2-ee56c29966f9 for instance e378f03a-f41f-4a85-b1bd-68c0f863acd8 on n-h2-844626-8 Aug 09 14:35:51.963539 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-addaf938-4602-4dab-8817-6fa0c334967b req-0e9ae1c1-3b56-4eb2-9f4b-7cdf47c17a75 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.130638 Aug 09 14:35:51.979558 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 728/1418] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:35:52.037933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:52.049399 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-95a269f7-ec4a-4dfb-a53d-e10c63af5602 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 200 len: 1306 microversion: 2.1 time: 0.281790 Aug 09 14:35:52.055072 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 691/1419] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:51 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 1306 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:52.182791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c7dc9777-e5a9-4553-aa72-8a41d62a8d24 req-220702fd-ec62-4b84-90b3-892a3825a0bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9192b19-8eae-49be-94bd-9a7cb5ace3e0", "name": "network-vif-plugged", "status": "completed", "tag": "73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:52.202166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c7dc9777-e5a9-4553-aa72-8a41d62a8d24 req-220702fd-ec62-4b84-90b3-892a3825a0bf service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:52.204550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c7dc9777-e5a9-4553-aa72-8a41d62a8d24 req-220702fd-ec62-4b84-90b3-892a3825a0bf service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:52.205309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c7dc9777-e5a9-4553-aa72-8a41d62a8d24 req-220702fd-ec62-4b84-90b3-892a3825a0bf service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:52.231033 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-c7dc9777-e5a9-4553-aa72-8a41d62a8d24 req-220702fd-ec62-4b84-90b3-892a3825a0bf service nova] Creating event network-vif-plugged:73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e for instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 on n-h2-844626-8 Aug 09 14:35:52.243994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-73891d06-403a-478e-bfa1-10212beeb6f4 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:52.247154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-73891d06-403a-478e-bfa1-10212beeb6f4 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:52.282766 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c7dc9777-e5a9-4553-aa72-8a41d62a8d24 req-220702fd-ec62-4b84-90b3-892a3825a0bf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103828 Aug 09 14:35:52.283464 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 729/1420] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:52.290062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73891d06-403a-478e-bfa1-10212beeb6f4 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:52.290547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73891d06-403a-478e-bfa1-10212beeb6f4 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:52.303186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73891d06-403a-478e-bfa1-10212beeb6f4 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:52.304229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73891d06-403a-478e-bfa1-10212beeb6f4 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:52.304851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73891d06-403a-478e-bfa1-10212beeb6f4 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:52.307239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73891d06-403a-478e-bfa1-10212beeb6f4 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:52.681287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee5ae67c-bc48-4a54-87e4-0da69da92b7f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:52.682035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee5ae67c-bc48-4a54-87e4-0da69da92b7f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:52.693158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee5ae67c-bc48-4a54-87e4-0da69da92b7f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:52.694018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee5ae67c-bc48-4a54-87e4-0da69da92b7f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:52.694889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee5ae67c-bc48-4a54-87e4-0da69da92b7f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:52.695818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee5ae67c-bc48-4a54-87e4-0da69da92b7f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:52.696454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee5ae67c-bc48-4a54-87e4-0da69da92b7f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:52.697033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee5ae67c-bc48-4a54-87e4-0da69da92b7f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:52.883761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-73891d06-403a-478e-bfa1-10212beeb6f4 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:52.917967 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-73891d06-403a-478e-bfa1-10212beeb6f4 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1505 microversion: 2.1 time: 0.678685 Aug 09 14:35:52.921608 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 692/1421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:52 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1505 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:52.942488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a8b535fb-5f53-4ef8-a7f6-eccf2836ee51 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '.version_select at 0x7f41dd361670>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:52.943600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a8b535fb-5f53-4ef8-a7f6-eccf2836ee51 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:52.957495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b535fb-5f53-4ef8-a7f6-eccf2836ee51 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:52.958027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b535fb-5f53-4ef8-a7f6-eccf2836ee51 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:52.961772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b535fb-5f53-4ef8-a7f6-eccf2836ee51 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:52.967271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b535fb-5f53-4ef8-a7f6-eccf2836ee51 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:52.968133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b535fb-5f53-4ef8-a7f6-eccf2836ee51 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:52.970905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b535fb-5f53-4ef8-a7f6-eccf2836ee51 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:53.044788 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a8b535fb-5f53-4ef8-a7f6-eccf2836ee51 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.106194 Aug 09 14:35:53.056791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ee5ae67c-bc48-4a54-87e4-0da69da92b7f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:53.059873 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 693/1422] 10.222.0.50 () {58 vars in 1296 bytes} [Tue Aug 9 14:35:52 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6/os-instance-actions => generated 611 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:35:53.067532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e6bcf6d3-6a00-4d63-a573-0ebb492b9d99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:53.068473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e6bcf6d3-6a00-4d63-a573-0ebb492b9d99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:53.068629 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee5ae67c-bc48-4a54-87e4-0da69da92b7f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1313 microversion: 2.1 time: 0.391580 Aug 09 14:35:53.069525 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 730/1423] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:52 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:53.091134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bb0e737-ca51-414b-b0d1-8d1c0dee8efb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:53.091800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8bb0e737-ca51-414b-b0d1-8d1c0dee8efb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: e378f03a-f41f-4a85-b1bd-68c0f863acd8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:53.094488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6bcf6d3-6a00-4d63-a573-0ebb492b9d99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:53.095257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6bcf6d3-6a00-4d63-a573-0ebb492b9d99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:53.095715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6bcf6d3-6a00-4d63-a573-0ebb492b9d99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:53.096692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6bcf6d3-6a00-4d63-a573-0ebb492b9d99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:53.097450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6bcf6d3-6a00-4d63-a573-0ebb492b9d99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:53.098089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6bcf6d3-6a00-4d63-a573-0ebb492b9d99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:53.103397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bb0e737-ca51-414b-b0d1-8d1c0dee8efb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:53.106128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bb0e737-ca51-414b-b0d1-8d1c0dee8efb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:53.106831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bb0e737-ca51-414b-b0d1-8d1c0dee8efb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:53.108202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bb0e737-ca51-414b-b0d1-8d1c0dee8efb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:53.108946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bb0e737-ca51-414b-b0d1-8d1c0dee8efb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:53.109627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bb0e737-ca51-414b-b0d1-8d1c0dee8efb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:53.146368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e6bcf6d3-6a00-4d63-a573-0ebb492b9d99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:35:53.154198 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-8bb0e737-ca51-414b-b0d1-8d1c0dee8efb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] HTTP exception thrown: Instance e378f03a-f41f-4a85-b1bd-68c0f863acd8 could not be found. Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bb0e737-ca51-414b-b0d1-8d1c0dee8efb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Request method failure captured: Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 HTTP/1.1 Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nAxd9eijW7X2rhOnHb4abugVXlQo199zVPOYR0vHABm_qKntSOkPPdw-VVY24AM5btmhqYeipUr5RjEYqu5zrO_lbVw7jUtDNDItvIwQLV5L8fl2A08iRmDBWaFdl8nTidxhJ88XTQb2v6LwvvWrJ1KlYEj00AMV3DPEo-4IzdmtKY Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9471973b988a4c31be31dde4cef1489e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d68dcb9c00cf4ffebcc05a7d44793468 Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance e378f03a-f41f-4a85-b1bd-68c0f863acd8 could not be found. Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'e378f03a-f41f-4a85-b1bd-68c0f863acd8'} Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e378f03a-f41f-4a85-b1bd-68c0f863acd8 could not be found. Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e378f03a-f41f-4a85-b1bd-68c0f863acd8 could not be found. Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:53.155967 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:53.160773 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:53.160773 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:53.160773 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:53.160773 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:53.160773 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:53.160773 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e378f03a-f41f-4a85-b1bd-68c0f863acd8 could not be found. Aug 09 14:35:53.160773 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:35:53.160773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bb0e737-ca51-414b-b0d1-8d1c0dee8efb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Returning 404 to user: Instance e378f03a-f41f-4a85-b1bd-68c0f863acd8 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:53.160773 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8bb0e737-ca51-414b-b0d1-8d1c0dee8efb tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8" status: 404 len: 111 microversion: 2.1 time: 0.071846 Aug 09 14:35:53.163756 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 731/1424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:53 2022] GET /compute/v2.1/servers/e378f03a-f41f-4a85-b1bd-68c0f863acd8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:35:53.168733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4c55e5fc-3fbe-48b7-ac87-29508d26b502 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:53.169234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4c55e5fc-3fbe-48b7-ac87-29508d26b502 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:53.189203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:53.212942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c55e5fc-3fbe-48b7-ac87-29508d26b502 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:53.219228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c55e5fc-3fbe-48b7-ac87-29508d26b502 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:53.219960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c55e5fc-3fbe-48b7-ac87-29508d26b502 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:53.223608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c55e5fc-3fbe-48b7-ac87-29508d26b502 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:53.224368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c55e5fc-3fbe-48b7-ac87-29508d26b502 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:53.224971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c55e5fc-3fbe-48b7-ac87-29508d26b502 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:53.309625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4c55e5fc-3fbe-48b7-ac87-29508d26b502 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:35:53.329806 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e6bcf6d3-6a00-4d63-a573-0ebb492b9d99 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 204 len: 0 microversion: 2.1 time: 0.267963 Aug 09 14:35:53.330874 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 694/1425] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:53 2022] DELETE /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:35:53.344451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d6e9313-6008-4f94-877a-c3d1b5796ee9 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:53.345790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d6e9313-6008-4f94-877a-c3d1b5796ee9 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:53.354701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d6e9313-6008-4f94-877a-c3d1b5796ee9 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:53.357202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d6e9313-6008-4f94-877a-c3d1b5796ee9 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:53.357202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d6e9313-6008-4f94-877a-c3d1b5796ee9 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:53.357202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d6e9313-6008-4f94-877a-c3d1b5796ee9 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:53.357558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d6e9313-6008-4f94-877a-c3d1b5796ee9 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:53.358049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d6e9313-6008-4f94-877a-c3d1b5796ee9 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:53.482909 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4c55e5fc-3fbe-48b7-ac87-29508d26b502 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "DELETE /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 204 len: 0 microversion: 2.1 time: 0.317749 Aug 09 14:35:53.483650 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 732/1426] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:53 2022] DELETE /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:35:53.493198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5cf89714-72a1-425c-9c06-3f1f0ab094df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:53.500204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5cf89714-72a1-425c-9c06-3f1f0ab094df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:53.514261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cf89714-72a1-425c-9c06-3f1f0ab094df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:53.514756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cf89714-72a1-425c-9c06-3f1f0ab094df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:53.515231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cf89714-72a1-425c-9c06-3f1f0ab094df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:53.516001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cf89714-72a1-425c-9c06-3f1f0ab094df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:53.516449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cf89714-72a1-425c-9c06-3f1f0ab094df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:53.517004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cf89714-72a1-425c-9c06-3f1f0ab094df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:53.728717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d6e9313-6008-4f94-877a-c3d1b5796ee9 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:53.740107 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d6e9313-6008-4f94-877a-c3d1b5796ee9 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1511 microversion: 2.1 time: 0.402982 Aug 09 14:35:53.748131 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 695/1427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:53 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:53.852931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cf89714-72a1-425c-9c06-3f1f0ab094df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:53.874011 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5cf89714-72a1-425c-9c06-3f1f0ab094df tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1472 microversion: 2.1 time: 0.385661 Aug 09 14:35:53.885115 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 733/1428] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:53 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1472 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:54.089932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c37e8ef-4a86-4d94-8285-e79d3d1b69ec tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:54.090562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6c37e8ef-4a86-4d94-8285-e79d3d1b69ec tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:54.104589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c37e8ef-4a86-4d94-8285-e79d3d1b69ec tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:54.107976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c37e8ef-4a86-4d94-8285-e79d3d1b69ec tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:54.108509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c37e8ef-4a86-4d94-8285-e79d3d1b69ec tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:54.109268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c37e8ef-4a86-4d94-8285-e79d3d1b69ec tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:54.111287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c37e8ef-4a86-4d94-8285-e79d3d1b69ec tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:54.111772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c37e8ef-4a86-4d94-8285-e79d3d1b69ec tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:54.328318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6c37e8ef-4a86-4d94-8285-e79d3d1b69ec tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:54.340054 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6c37e8ef-4a86-4d94-8285-e79d3d1b69ec tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1313 microversion: 2.1 time: 0.255130 Aug 09 14:35:54.341846 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 696/1429] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:54 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:54.780215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13cf26aa-e154-4405-94e8-258fbc6e5148 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:54.783157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-13cf26aa-e154-4405-94e8-258fbc6e5148 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:54.823022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13cf26aa-e154-4405-94e8-258fbc6e5148 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:54.824014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13cf26aa-e154-4405-94e8-258fbc6e5148 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:54.828283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13cf26aa-e154-4405-94e8-258fbc6e5148 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:54.830114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13cf26aa-e154-4405-94e8-258fbc6e5148 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:54.832169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13cf26aa-e154-4405-94e8-258fbc6e5148 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:54.833850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13cf26aa-e154-4405-94e8-258fbc6e5148 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:54.896658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5176469a-d25b-4482-bcb0-77c0ea509c55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:54.897280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5176469a-d25b-4482-bcb0-77c0ea509c55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:54.915953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5176469a-d25b-4482-bcb0-77c0ea509c55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:54.916479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5176469a-d25b-4482-bcb0-77c0ea509c55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:54.916921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5176469a-d25b-4482-bcb0-77c0ea509c55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:54.917781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5176469a-d25b-4482-bcb0-77c0ea509c55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:54.918101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5176469a-d25b-4482-bcb0-77c0ea509c55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:54.918677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5176469a-d25b-4482-bcb0-77c0ea509c55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:55.495000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-13cf26aa-e154-4405-94e8-258fbc6e5148 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:55.510045 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-13cf26aa-e154-4405-94e8-258fbc6e5148 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1511 microversion: 2.1 time: 0.732471 Aug 09 14:35:55.517898 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 734/1430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:54 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1511 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:55.527580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e74d37b8-b99e-4013-aad6-bf2807de8913 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:55.536509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e74d37b8-b99e-4013-aad6-bf2807de8913 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:55.556654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e74d37b8-b99e-4013-aad6-bf2807de8913 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:55.559505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e74d37b8-b99e-4013-aad6-bf2807de8913 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:55.560157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e74d37b8-b99e-4013-aad6-bf2807de8913 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:55.561056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e74d37b8-b99e-4013-aad6-bf2807de8913 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:55.562204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e74d37b8-b99e-4013-aad6-bf2807de8913 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:55.564138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e74d37b8-b99e-4013-aad6-bf2807de8913 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:55.998808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5176469a-d25b-4482-bcb0-77c0ea509c55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:56.007852 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5176469a-d25b-4482-bcb0-77c0ea509c55 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1472 microversion: 2.1 time: 1.115205 Aug 09 14:35:56.012123 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 697/1431] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:54 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1472 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:35:56.227394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e74d37b8-b99e-4013-aad6-bf2807de8913 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:56.239835 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e74d37b8-b99e-4013-aad6-bf2807de8913 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1462 microversion: 2.1 time: 0.720655 Aug 09 14:35:56.240561 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 735/1432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:55 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1462 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:56.261550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee2cbb3e-8f09-4fab-a432-603e886e76f5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:56.262539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee2cbb3e-8f09-4fab-a432-603e886e76f5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:56.274722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee2cbb3e-8f09-4fab-a432-603e886e76f5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:56.277703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee2cbb3e-8f09-4fab-a432-603e886e76f5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:56.278455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee2cbb3e-8f09-4fab-a432-603e886e76f5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:56.279495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee2cbb3e-8f09-4fab-a432-603e886e76f5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:56.280165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee2cbb3e-8f09-4fab-a432-603e886e76f5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:56.280783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee2cbb3e-8f09-4fab-a432-603e886e76f5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:56.318479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d087488-ede8-486b-945f-4ce7de662ec1 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1876232549", "id": 805800277, "os-flavor-access:is_public": "True"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:56.322090 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:56.322090 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:35:56.350941 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3d087488-ede8-486b-945f-4ce7de662ec1 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.328519 Aug 09 14:35:56.352145 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 698/1433] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:56 2022] POST /compute/v2.1/flavors => generated 427 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:56.367664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58221681-d1d9-48b7-9251-b77aed2c566e tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:56.370399 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:56.370399 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:35:56.411785 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58221681-d1d9-48b7-9251-b77aed2c566e tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/805800277" status: 202 len: 0 microversion: 2.1 time: 0.051362 Aug 09 14:35:56.416061 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 699/1434] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:35:56 2022] DELETE /compute/v2.1/flavors/805800277 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:56.421116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ad09e1ab-0c27-4018-8a92-db902b320590 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:56.453753 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ad09e1ab-0c27-4018-8a92-db902b320590 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036432 Aug 09 14:35:56.467526 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 700/1435] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:35:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:56.473043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1f26d633-1cfe-4046-8adb-3b440f0171a5 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-445908746", "id": 1043993068, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:56.504568 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1f26d633-1cfe-4046-8adb-3b440f0171a5 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.035492 Aug 09 14:35:56.508068 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 701/1436] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:56 2022] POST /compute/v2.1/flavors => generated 416 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:56.521812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8f34b569-f07a-4178-bea5-0d975e9ad27c tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:56.538659 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee2cbb3e-8f09-4fab-a432-603e886e76f5 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1613 microversion: 2.1 time: 0.280855 Aug 09 14:35:56.540511 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 736/1437] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:56 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1613 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:56.553621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-76bbbdd5-2548-4530-84f9-6438a956e4ed tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:56.554490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-76bbbdd5-2548-4530-84f9-6438a956e4ed tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:56.558072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:56.572260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76bbbdd5-2548-4530-84f9-6438a956e4ed tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:56.572775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76bbbdd5-2548-4530-84f9-6438a956e4ed tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:56.573416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76bbbdd5-2548-4530-84f9-6438a956e4ed tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:56.574157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76bbbdd5-2548-4530-84f9-6438a956e4ed tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:56.574644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76bbbdd5-2548-4530-84f9-6438a956e4ed tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:56.575069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76bbbdd5-2548-4530-84f9-6438a956e4ed tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:56.583907 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8f34b569-f07a-4178-bea5-0d975e9ad27c tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.068175 Aug 09 14:35:56.584859 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 702/1438] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:35:56 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:56.591679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5af8a136-866f-4cdc-9069-2ff42f80362f tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:56.592640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5af8a136-866f-4cdc-9069-2ff42f80362f tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:56.603301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5af8a136-866f-4cdc-9069-2ff42f80362f tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:56.605245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5af8a136-866f-4cdc-9069-2ff42f80362f tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:56.606074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5af8a136-866f-4cdc-9069-2ff42f80362f tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:56.612857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5af8a136-866f-4cdc-9069-2ff42f80362f tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:56.614917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5af8a136-866f-4cdc-9069-2ff42f80362f tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:56.615674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5af8a136-866f-4cdc-9069-2ff42f80362f tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:56.622411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:56.659503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5af8a136-866f-4cdc-9069-2ff42f80362f tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4b6bcc9d7723487a9655932727c72c0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ade9d9f6a2064be4b4c0d9bb65c10afe', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:56.660370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5af8a136-866f-4cdc-9069-2ff42f80362f tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] flavor_id is None. Assuming migration. {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 09 14:35:56.660874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5af8a136-866f-4cdc-9069-2ff42f80362f tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 14:35:56.796453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-76bbbdd5-2548-4530-84f9-6438a956e4ed tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:56.808870 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-76bbbdd5-2548-4530-84f9-6438a956e4ed tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1511 microversion: 2.1 time: 0.264485 Aug 09 14:35:56.811386 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 737/1439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:56 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1511 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:56.822010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-66056465-ecc6-4482-9135-a5e030a65664 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:56.824330 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:56.824330 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:35:56.871861 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-66056465-ecc6-4482-9135-a5e030a65664 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1043993068" status: 202 len: 0 microversion: 2.1 time: 0.057862 Aug 09 14:35:56.873248 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 738/1440] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:35:56 2022] DELETE /compute/v2.1/flavors/1043993068 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:56.883610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-78fec351-b15e-447d-9b6c-9440131de014 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:56.910646 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-78fec351-b15e-447d-9b6c-9440131de014 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032700 Aug 09 14:35:56.914390 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5af8a136-866f-4cdc-9069-2ff42f80362f tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0/action" status: 202 len: 0 microversion: 2.1 time: 0.326477 Aug 09 14:35:56.914663 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 703/1441] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:35:56 2022] POST /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:56.925134 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 739/1442] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:35:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:56.932596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1803de34-24a6-4cf4-a0b8-395473d4aa4f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:56.933575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1803de34-24a6-4cf4-a0b8-395473d4aa4f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:56.944206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e8b5464-fd48-4315-99dd-88550ed9345e tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-109240209", "id": 523855190, "os-flavor-access:is_public": "True"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:56.948146 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:56.948146 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:35:56.951869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1803de34-24a6-4cf4-a0b8-395473d4aa4f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:56.953736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1803de34-24a6-4cf4-a0b8-395473d4aa4f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:56.954727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1803de34-24a6-4cf4-a0b8-395473d4aa4f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:56.957204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1803de34-24a6-4cf4-a0b8-395473d4aa4f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:56.957940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1803de34-24a6-4cf4-a0b8-395473d4aa4f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:56.959983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1803de34-24a6-4cf4-a0b8-395473d4aa4f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:56.980686 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5e8b5464-fd48-4315-99dd-88550ed9345e tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.040507 Aug 09 14:35:56.983859 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 740/1443] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:56 2022] POST /compute/v2.1/flavors => generated 425 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:35:57.004169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e0482a1-28a0-4c95-9ed9-b6f4822a426d tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:57.047721 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e0482a1-28a0-4c95-9ed9-b6f4822a426d tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/523855190" status: 202 len: 0 microversion: 2.1 time: 0.054816 Aug 09 14:35:57.048309 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 741/1444] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:35:56 2022] DELETE /compute/v2.1/flavors/523855190 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:57.053392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7a42942-6478-47e5-bfb5-a95833e224a4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:57.053997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7a42942-6478-47e5-bfb5-a95833e224a4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:57.069004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7a42942-6478-47e5-bfb5-a95833e224a4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:57.069506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7a42942-6478-47e5-bfb5-a95833e224a4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:57.070019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7a42942-6478-47e5-bfb5-a95833e224a4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:57.070913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7a42942-6478-47e5-bfb5-a95833e224a4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:57.071553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7a42942-6478-47e5-bfb5-a95833e224a4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:57.072136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7a42942-6478-47e5-bfb5-a95833e224a4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:57.491902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1803de34-24a6-4cf4-a0b8-395473d4aa4f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:57.507417 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1803de34-24a6-4cf4-a0b8-395473d4aa4f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1471 microversion: 2.1 time: 0.584942 Aug 09 14:35:57.519116 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 704/1445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:56 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1471 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:57.524603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09042de4-ecbc-419a-af57-45ab92dcd1a8 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:57.527063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7a42942-6478-47e5-bfb5-a95833e224a4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:57.529633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:35:57.541949 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7a42942-6478-47e5-bfb5-a95833e224a4 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1472 microversion: 2.1 time: 0.492280 Aug 09 14:35:57.548260 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 742/1446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:57 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1472 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:57.573623 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09042de4-ecbc-419a-af57-45ab92dcd1a8 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.064440 Aug 09 14:35:57.587071 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 705/1447] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:35:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:57.598149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-09e88415-ce8a-4be5-8022-3f02801a4f9e tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1789196344", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:57.601624 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:57.601624 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:35:57.637798 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-09e88415-ce8a-4be5-8022-3f02801a4f9e tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.043689 Aug 09 14:35:57.638659 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 743/1448] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:57 2022] POST /compute/v2.1/flavors => generated 507 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:57.650800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5589a9a9-e769-450e-b150-450124e41201 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:57.651891 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:57.651891 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:35:57.689456 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5589a9a9-e769-450e-b150-450124e41201 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/63e1fcf0-9cf1-4fa3-b72a-580823ce5668" status: 202 len: 0 microversion: 2.1 time: 0.042341 Aug 09 14:35:57.699730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee369ba0-7524-440a-941c-01f8c13ea6df tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:57.700359 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 706/1449] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:57 2022] DELETE /compute/v2.1/flavors/63e1fcf0-9cf1-4fa3-b72a-580823ce5668 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:57.747717 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee369ba0-7524-440a-941c-01f8c13ea6df tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051964 Aug 09 14:35:57.748332 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 744/1450] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:35:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:57.769703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0fabe89-119e-4d43-8abe-f0712df4a2f7 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1593207667", "id": "f2763ef5-627b-4782-b980-e0f6b1eaaeae", "os-flavor-access:is_public": "True"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:57.773383 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:57.773383 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:35:57.810652 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b0fabe89-119e-4d43-8abe-f0712df4a2f7 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.045690 Aug 09 14:35:57.821096 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 707/1451] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:57 2022] POST /compute/v2.1/flavors => generated 507 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:57.836292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e421f7bf-f81f-4b0d-822e-9c5dbea9da7c tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:57.838167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f123b90c-d24c-4348-9166-14cb73021f04 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:57.839448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f123b90c-d24c-4348-9166-14cb73021f04 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:57.854201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f123b90c-d24c-4348-9166-14cb73021f04 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:57.855227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f123b90c-d24c-4348-9166-14cb73021f04 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:57.856018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f123b90c-d24c-4348-9166-14cb73021f04 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:57.856901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f123b90c-d24c-4348-9166-14cb73021f04 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:57.858173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f123b90c-d24c-4348-9166-14cb73021f04 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:57.858914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f123b90c-d24c-4348-9166-14cb73021f04 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:57.880339 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e421f7bf-f81f-4b0d-822e-9c5dbea9da7c tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/f2763ef5-627b-4782-b980-e0f6b1eaaeae" status: 202 len: 0 microversion: 2.1 time: 0.047812 Aug 09 14:35:57.880929 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 708/1452] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:35:57 2022] DELETE /compute/v2.1/flavors/f2763ef5-627b-4782-b980-e0f6b1eaaeae => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:57.897595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5c2b7d0-eb9a-4514-9acd-b2a8ca3f2681 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:57.950868 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5c2b7d0-eb9a-4514-9acd-b2a8ca3f2681 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063054 Aug 09 14:35:57.963307 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 709/1453] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:35:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:58.007624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2bcae3f9-fdeb-48b2-88b6-26a3739d9cf3 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1581941153", "id": 1711945749, "os-flavor-access:is_public": "True"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:58.057850 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2bcae3f9-fdeb-48b2-88b6-26a3739d9cf3 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.055384 Aug 09 14:35:58.058817 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 710/1454] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:58 2022] POST /compute/v2.1/flavors => generated 414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:58.072034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91c79b75-b45f-4194-9cca-dff53395ef43 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:58.087458 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91c79b75-b45f-4194-9cca-dff53395ef43 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1711945749" status: 200 len: 414 microversion: 2.1 time: 0.020151 Aug 09 14:35:58.088466 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 711/1455] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:35:58 2022] GET /compute/v2.1/flavors/1711945749 => generated 414 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:35:58.357967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9abb87dc-a4fb-4e36-b310-b3b61172d94a tempest-FlavorsAdminTestJSON-1579664462 tempest-FlavorsAdminTestJSON-1579664462-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:58.369597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f123b90c-d24c-4348-9166-14cb73021f04 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:58.386752 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f123b90c-d24c-4348-9166-14cb73021f04 tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1511 microversion: 2.1 time: 0.554478 Aug 09 14:35:58.389855 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 745/1456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:57 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1511 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:58.420983 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9abb87dc-a4fb-4e36-b310-b3b61172d94a tempest-FlavorsAdminTestJSON-1579664462 tempest-FlavorsAdminTestJSON-1579664462-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.323538 Aug 09 14:35:58.426855 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 712/1457] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:35:58 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:58.442605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8876e3a0-763e-4d9d-88b1-7ba2443d70bf tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:58.443757 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:58.443757 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:35:58.464372 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8876e3a0-763e-4d9d-88b1-7ba2443d70bf tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1711945749" status: 202 len: 0 microversion: 2.1 time: 0.026336 Aug 09 14:35:58.490923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16f26fd0-e52e-41c0-8145-ed0ab4ede3bf tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:58.503223 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 746/1458] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:35:58 2022] DELETE /compute/v2.1/flavors/1711945749 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:58.533009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1fab0e2e-80a2-4336-a568-1e9d4cfa526e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:58.533666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1fab0e2e-80a2-4336-a568-1e9d4cfa526e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:58.556849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fab0e2e-80a2-4336-a568-1e9d4cfa526e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:58.561375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fab0e2e-80a2-4336-a568-1e9d4cfa526e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:58.561824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fab0e2e-80a2-4336-a568-1e9d4cfa526e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:58.562595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fab0e2e-80a2-4336-a568-1e9d4cfa526e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:58.568348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fab0e2e-80a2-4336-a568-1e9d4cfa526e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:58.568823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fab0e2e-80a2-4336-a568-1e9d4cfa526e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:58.582189 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16f26fd0-e52e-41c0-8145-ed0ab4ede3bf tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.107777 Aug 09 14:35:58.600078 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 713/1459] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:35:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:58.615452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c046a8f8-1bbd-4857-b8a4-63d244c698da tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:58.616066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c046a8f8-1bbd-4857-b8a4-63d244c698da tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:58.651832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c046a8f8-1bbd-4857-b8a4-63d244c698da tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:58.652458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c046a8f8-1bbd-4857-b8a4-63d244c698da tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:58.652943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c046a8f8-1bbd-4857-b8a4-63d244c698da tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:58.653765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c046a8f8-1bbd-4857-b8a4-63d244c698da tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:58.654237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c046a8f8-1bbd-4857-b8a4-63d244c698da tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:58.654653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c046a8f8-1bbd-4857-b8a4-63d244c698da tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:58.873860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c046a8f8-1bbd-4857-b8a4-63d244c698da tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:58.909475 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c046a8f8-1bbd-4857-b8a4-63d244c698da tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 200 len: 1301 microversion: 2.1 time: 0.307916 Aug 09 14:35:58.911497 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 714/1460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:58 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 1301 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:58.923350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4842dee-3e94-4988-ad7f-b3c024267eaa tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-195205509", "id": 1036620203, "os-flavor-access:is_public": "False"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:58.936483 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:58.936483 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:35:58.994147 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4842dee-3e94-4988-ad7f-b3c024267eaa tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.080868 Aug 09 14:35:58.995009 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 715/1461] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:58 2022] POST /compute/v2.1/flavors => generated 429 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:59.041207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-53504104-ac46-4d57-8b14-4127ad04d1f6 req-28d7c3ad-868e-4fa5-b51f-997d63e81787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89965e92-ea8e-49a6-a4d8-3cea1d171b08", "name": "network-vif-deleted", "tag": "95e19b52-da20-48ba-b1b2-3455496deab0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:59.092900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-53504104-ac46-4d57-8b14-4127ad04d1f6 req-28d7c3ad-868e-4fa5-b51f-997d63e81787 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:59.093381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-53504104-ac46-4d57-8b14-4127ad04d1f6 req-28d7c3ad-868e-4fa5-b51f-997d63e81787 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:59.093925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-53504104-ac46-4d57-8b14-4127ad04d1f6 req-28d7c3ad-868e-4fa5-b51f-997d63e81787 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:59.226768 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-53504104-ac46-4d57-8b14-4127ad04d1f6 req-28d7c3ad-868e-4fa5-b51f-997d63e81787 service nova] Creating event network-vif-deleted:95e19b52-da20-48ba-b1b2-3455496deab0 for instance 89965e92-ea8e-49a6-a4d8-3cea1d171b08 on n-h2-844626-8 Aug 09 14:35:59.250798 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-53504104-ac46-4d57-8b14-4127ad04d1f6 req-28d7c3ad-868e-4fa5-b51f-997d63e81787 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231349 Aug 09 14:35:59.256434 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 716/1462] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:59.299732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4b666a0-93c9-4295-ae6b-a77d5a5cc1ac tempest-FlavorsAdminTestJSON-1579664462 tempest-FlavorsAdminTestJSON-1579664462-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "1036620203"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:59.342425 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-d4b666a0-93c9-4295-ae6b-a77d5a5cc1ac tempest-FlavorsAdminTestJSON-1579664462 tempest-FlavorsAdminTestJSON-1579664462-project] HTTP exception thrown: Flavor 1036620203 could not be found. Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4b666a0-93c9-4295-ae6b-a77d5a5cc1ac tempest-FlavorsAdminTestJSON-1579664462 tempest-FlavorsAdminTestJSON-1579664462-project] Request method failure captured: Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 107 Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nDKyUqastkj-pkqS0FoPzYkoYdEi0q_UrfVJPA-kkqouptuBtu9_HmX-fXRgLXds4n_zmFV53km3W1arSV9aSYeOJgWStMCUxAlGBrcjuol5imP24U0Xg9L9goHFn5Iw6ODKX5y2KjYVqaA9sKyJZS6RLzxQ8Vu2K3dnsefRxCEpms Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 4369487223d54982a8e5905ea2948a55 Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FlavorsAdminTestJSON-1579664462 Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4369487223d54982a8e5905ea2948a55", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4369487223d54982a8e5905ea2948a55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4369487223d54982a8e5905ea2948a55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4369487223d54982a8e5905ea2948a55"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FlavorsAdminTestJSON-1579664462 Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 4369487223d54982a8e5905ea2948a55 Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1579664462 Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FlavorsAdminTestJSON-1579664462-project Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d8c1425bf23548adbf24a876f4fbfbb3 Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FlavorsAdminTestJSON-1579664462-project Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "test", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "1036620203"}} Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: exception: Flavor 1036620203 could not be found. Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '1036620203'}}} Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1036620203 could not be found. Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:35:59.364528 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1036620203 could not be found. Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1036620203 could not be found. Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4b666a0-93c9-4295-ae6b-a77d5a5cc1ac tempest-FlavorsAdminTestJSON-1579664462 tempest-FlavorsAdminTestJSON-1579664462-project] Returning 400 to user: Flavor 1036620203 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4b666a0-93c9-4295-ae6b-a77d5a5cc1ac tempest-FlavorsAdminTestJSON-1579664462 tempest-FlavorsAdminTestJSON-1579664462-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.108575 Aug 09 14:35:59.374062 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 717/1463] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:59 2022] POST /compute/v2.1/servers => generated 81 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:35:59.406952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a002eed6-a54c-4086-afd3-e79c34c44173 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:59.411828 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:59.411828 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:35:59.478222 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a002eed6-a54c-4086-afd3-e79c34c44173 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1036620203" status: 202 len: 0 microversion: 2.1 time: 0.104607 Aug 09 14:35:59.480749 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 718/1464] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:35:59 2022] DELETE /compute/v2.1/flavors/1036620203 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:35:59.486084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1894e814-a671-4d96-a163-effec01285ab tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:59.486839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1894e814-a671-4d96-a163-effec01285ab tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:59.499051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1894e814-a671-4d96-a163-effec01285ab tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:59.500030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1894e814-a671-4d96-a163-effec01285ab tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:59.501272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1894e814-a671-4d96-a163-effec01285ab tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:59.503525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1894e814-a671-4d96-a163-effec01285ab tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:59.504680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1894e814-a671-4d96-a163-effec01285ab tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:59.505443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1894e814-a671-4d96-a163-effec01285ab tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:59.650297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1894e814-a671-4d96-a163-effec01285ab tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efbc2ae0e55c485ebed9f44090bfcfcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad88df8fe4f6443b873e9ebb10bb16be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:59.667938 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1894e814-a671-4d96-a163-effec01285ab tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 200 len: 1469 microversion: 2.1 time: 0.183474 Aug 09 14:35:59.671621 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 719/1465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:59 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:59.691460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4c068a59-5dda-4675-9f3c-28f86f75c1b4 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:59.811766 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4c068a59-5dda-4675-9f3c-28f86f75c1b4 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.134275 Aug 09 14:35:59.815505 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 720/1466] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:35:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:59.830082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1fab0e2e-80a2-4336-a568-1e9d4cfa526e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:35:59.834552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-75fe6841-2294-4474-bc1e-3ef1bb9f56fc req-761c7348-6316-4138-bbb5-bce8bfe4dd7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8e83a4-e16d-4a23-a596-61224bdf98b6", "name": "network-vif-deleted", "tag": "6032a560-a43f-47d1-88ad-7d302223a7a5"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:59.842253 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1fab0e2e-80a2-4336-a568-1e9d4cfa526e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1471 microversion: 2.1 time: 1.313711 Aug 09 14:35:59.844609 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 747/1467] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:58 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1471 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:35:59.857806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-75fe6841-2294-4474-bc1e-3ef1bb9f56fc req-761c7348-6316-4138-bbb5-bce8bfe4dd7b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:59.858282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-75fe6841-2294-4474-bc1e-3ef1bb9f56fc req-761c7348-6316-4138-bbb5-bce8bfe4dd7b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:59.862579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-75fe6841-2294-4474-bc1e-3ef1bb9f56fc req-761c7348-6316-4138-bbb5-bce8bfe4dd7b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:59.868131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-faa323bd-afab-4e2e-8d96-11257db70b83 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-306073637", "id": 306897533, "os-flavor-access:is_public": "False"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:59.871320 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:35:59.871320 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:35:59.894263 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-75fe6841-2294-4474-bc1e-3ef1bb9f56fc req-761c7348-6316-4138-bbb5-bce8bfe4dd7b service nova] Creating event network-vif-deleted:6032a560-a43f-47d1-88ad-7d302223a7a5 for instance 3b8e83a4-e16d-4a23-a596-61224bdf98b6 on n-h2-844626-8 Aug 09 14:35:59.906140 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-75fe6841-2294-4474-bc1e-3ef1bb9f56fc req-761c7348-6316-4138-bbb5-bce8bfe4dd7b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089079 Aug 09 14:35:59.908473 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 721/1468] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:59.940094 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-faa323bd-afab-4e2e-8d96-11257db70b83 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.094367 Aug 09 14:35:59.940384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c68316e-f3f6-45b3-a1b7-4ca23156ffae tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:35:59.941287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3c68316e-f3f6-45b3-a1b7-4ca23156ffae tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 89965e92-ea8e-49a6-a4d8-3cea1d171b08] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:35:59.945065 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 748/1469] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:59 2022] POST /compute/v2.1/flavors => generated 411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:35:59.966690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-052d90c5-44a2-4b03-886d-6bc607d41adf tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-266884474", "id": 238045208, "os-flavor-access:is_public": "True"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:35:59.974919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c68316e-f3f6-45b3-a1b7-4ca23156ffae tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:59.975768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c68316e-f3f6-45b3-a1b7-4ca23156ffae tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:59.976442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c68316e-f3f6-45b3-a1b7-4ca23156ffae tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:59.977406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c68316e-f3f6-45b3-a1b7-4ca23156ffae tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:35:59.978088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c68316e-f3f6-45b3-a1b7-4ca23156ffae tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:35:59.978750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c68316e-f3f6-45b3-a1b7-4ca23156ffae tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:35:59.996448 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-3c68316e-f3f6-45b3-a1b7-4ca23156ffae tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] HTTP exception thrown: Instance 89965e92-ea8e-49a6-a4d8-3cea1d171b08 could not be found. Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c68316e-f3f6-45b3-a1b7-4ca23156ffae tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Request method failure captured: Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 HTTP/1.1 Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nAxd9eijW7X2rhOnHb4abugVXlQo199zVPOYR0vHABm_qKntSOkPPdw-VVY24AM5btmhqYeipUr5RjEYqu5zrO_lbVw7jUtDNDItvIwQLV5L8fl2A08iRmDBWaFdl8nTidxhJ88XTQb2v6LwvvWrJ1KlYEj00AMV3DPEo-4IzdmtKY Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9471973b988a4c31be31dde4cef1489e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d68dcb9c00cf4ffebcc05a7d44793468 Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 89965e92-ea8e-49a6-a4d8-3cea1d171b08 could not be found. Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '89965e92-ea8e-49a6-a4d8-3cea1d171b08'} Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89965e92-ea8e-49a6-a4d8-3cea1d171b08 could not be found. Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89965e92-ea8e-49a6-a4d8-3cea1d171b08 could not be found. Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:35:59.998515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:00.003195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:00.003195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:00.003195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:00.003195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:00.003195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:00.003195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89965e92-ea8e-49a6-a4d8-3cea1d171b08 could not be found. Aug 09 14:36:00.003195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:00.015749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c68316e-f3f6-45b3-a1b7-4ca23156ffae tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Returning 404 to user: Instance 89965e92-ea8e-49a6-a4d8-3cea1d171b08 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:00.016739 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3c68316e-f3f6-45b3-a1b7-4ca23156ffae tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08" status: 404 len: 111 microversion: 2.1 time: 0.084657 Aug 09 14:36:00.017329 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 722/1470] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:35:59 2022] GET /compute/v2.1/servers/89965e92-ea8e-49a6-a4d8-3cea1d171b08 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:36:00.026628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d93d976-10f0-4514-8521-b0ef3c4435d7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.027049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d93d976-10f0-4514-8521-b0ef3c4435d7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:00.037077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d93d976-10f0-4514-8521-b0ef3c4435d7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:00.037568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d93d976-10f0-4514-8521-b0ef3c4435d7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:00.037999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d93d976-10f0-4514-8521-b0ef3c4435d7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:00.038708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d93d976-10f0-4514-8521-b0ef3c4435d7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:00.039191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d93d976-10f0-4514-8521-b0ef3c4435d7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:00.039609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d93d976-10f0-4514-8521-b0ef3c4435d7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:00.043413 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-052d90c5-44a2-4b03-886d-6bc607d41adf tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.089242 Aug 09 14:36:00.044068 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 749/1471] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:35:59 2022] POST /compute/v2.1/flavors => generated 410 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:00.057528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb283278-d26b-44a4-aabf-39b41d6ca579 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.081547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d93d976-10f0-4514-8521-b0ef3c4435d7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:36:00.115667 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb283278-d26b-44a4-aabf-39b41d6ca579 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.051175 Aug 09 14:36:00.121038 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 750/1472] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Aug 9 14:36:00 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:36:00.128542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe729fa7-5a72-4015-8b88-f6ef403e694e tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.157279 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fe729fa7-5a72-4015-8b88-f6ef403e694e tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.028119 Aug 09 14:36:00.165552 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 751/1473] 10.222.0.50 () {58 vars in 1177 bytes} [Tue Aug 9 14:36:00 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:36:00.172017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-921d4829-43b2-4125-b834-02c99eb06def tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.187879 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-921d4829-43b2-4125-b834-02c99eb06def tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.020338 Aug 09 14:36:00.189044 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 752/1474] 10.222.0.50 () {58 vars in 1171 bytes} [Tue Aug 9 14:36:00 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:00.208171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9dd85ffd-0fbd-4a4e-8f4a-7c8363238707 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.239931 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d93d976-10f0-4514-8521-b0ef3c4435d7 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "DELETE /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a" status: 204 len: 0 microversion: 2.1 time: 0.217871 Aug 09 14:36:00.240869 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 723/1475] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:36:00 2022] DELETE /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:36:00.254082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91ae1a9b-63d7-4fbc-9286-f55cbfcad2cc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.254671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-91ae1a9b-63d7-4fbc-9286-f55cbfcad2cc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:00.258131 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9dd85ffd-0fbd-4a4e-8f4a-7c8363238707 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.057514 Aug 09 14:36:00.270862 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 753/1476] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Aug 9 14:36:00 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:00.276383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e4065b7-c996-42d1-b997-a4ae4c912152 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.283678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91ae1a9b-63d7-4fbc-9286-f55cbfcad2cc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:00.285766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91ae1a9b-63d7-4fbc-9286-f55cbfcad2cc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:00.286259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91ae1a9b-63d7-4fbc-9286-f55cbfcad2cc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:00.286995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91ae1a9b-63d7-4fbc-9286-f55cbfcad2cc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:00.287555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91ae1a9b-63d7-4fbc-9286-f55cbfcad2cc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:00.288170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91ae1a9b-63d7-4fbc-9286-f55cbfcad2cc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:00.327443 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6e4065b7-c996-42d1-b997-a4ae4c912152 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5391 microversion: 2.1 time: 0.054787 Aug 09 14:36:00.368096 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 754/1477] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Aug 9 14:36:00 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5391 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:00.374694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-91ae1a9b-63d7-4fbc-9286-f55cbfcad2cc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:36:00.377455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8a993664-aae6-4503-8cf9-8fff3a8f1de5 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.427834 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8a993664-aae6-4503-8cf9-8fff3a8f1de5 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5391 microversion: 2.1 time: 0.056808 Aug 09 14:36:00.429520 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 755/1478] 10.222.0.50 () {58 vars in 1175 bytes} [Tue Aug 9 14:36:00 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5391 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:00.458033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4658d4c-f439-4d2b-b2c1-13d0e7934988 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.484956 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b4658d4c-f439-4d2b-b2c1-13d0e7934988 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5391 microversion: 2.1 time: 0.034683 Aug 09 14:36:00.486361 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 756/1479] 10.222.0.50 () {58 vars in 1173 bytes} [Tue Aug 9 14:36:00 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5391 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:00.491866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be11492e-c57e-4da2-b111-bd10ca204a8f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.492712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be11492e-c57e-4da2-b111-bd10ca204a8f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:00.500722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be11492e-c57e-4da2-b111-bd10ca204a8f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:00.501922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be11492e-c57e-4da2-b111-bd10ca204a8f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:00.502911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be11492e-c57e-4da2-b111-bd10ca204a8f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:00.503838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be11492e-c57e-4da2-b111-bd10ca204a8f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:00.504452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be11492e-c57e-4da2-b111-bd10ca204a8f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:00.505244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be11492e-c57e-4da2-b111-bd10ca204a8f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:00.601334 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91ae1a9b-63d7-4fbc-9286-f55cbfcad2cc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 204 len: 0 microversion: 2.1 time: 0.355902 Aug 09 14:36:00.602251 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 724/1480] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:36:00 2022] DELETE /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:36:00.609313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f75da1e7-fee8-4800-b915-55499f3f7603 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.663394 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f75da1e7-fee8-4800-b915-55499f3f7603 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5391 microversion: 2.1 time: 0.059822 Aug 09 14:36:00.666591 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 725/1481] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Aug 9 14:36:00 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5391 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:00.682319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4dcd0a5f-31be-4f3a-8aea-b9e8cf68b628 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.684993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4dcd0a5f-31be-4f3a-8aea-b9e8cf68b628 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:00.693422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dcd0a5f-31be-4f3a-8aea-b9e8cf68b628 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:00.694376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dcd0a5f-31be-4f3a-8aea-b9e8cf68b628 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:00.695013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dcd0a5f-31be-4f3a-8aea-b9e8cf68b628 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:00.696010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dcd0a5f-31be-4f3a-8aea-b9e8cf68b628 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:00.697851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dcd0a5f-31be-4f3a-8aea-b9e8cf68b628 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:00.698493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dcd0a5f-31be-4f3a-8aea-b9e8cf68b628 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:00.787175 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be11492e-c57e-4da2-b111-bd10ca204a8f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1858 microversion: 2.1 time: 0.299395 Aug 09 14:36:00.815098 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 757/1482] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:00 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1858 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:00.820683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34559f2c-7e7b-4b99-8009-8e59853f9088 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.821352 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:00.821352 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:36:00.862751 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34559f2c-7e7b-4b99-8009-8e59853f9088 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/238045208" status: 202 len: 0 microversion: 2.1 time: 0.046228 Aug 09 14:36:00.864100 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 758/1483] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:36:00 2022] DELETE /compute/v2.1/flavors/238045208 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:36:00.871810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-968c703b-1048-455e-975e-4e9309b39aba tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:00.873861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-968c703b-1048-455e-975e-4e9309b39aba tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] [instance: 3b8e83a4-e16d-4a23-a596-61224bdf98b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:00.889078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-968c703b-1048-455e-975e-4e9309b39aba tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:00.889754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-968c703b-1048-455e-975e-4e9309b39aba tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:00.890342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-968c703b-1048-455e-975e-4e9309b39aba tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:00.891405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-968c703b-1048-455e-975e-4e9309b39aba tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:00.892009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-968c703b-1048-455e-975e-4e9309b39aba tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:00.892580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-968c703b-1048-455e-975e-4e9309b39aba tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:00.908623 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-968c703b-1048-455e-975e-4e9309b39aba tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] HTTP exception thrown: Instance 3b8e83a4-e16d-4a23-a596-61224bdf98b6 could not be found. Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-968c703b-1048-455e-975e-4e9309b39aba tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Request method failure captured: Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 HTTP/1.1 Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nCnOYnt8w4DT2Op73ruoTmN6TCbTOrz2BnL3Q1PNIkd242lQFEirV0LR5-5v_GBqaeFFo0ohQwuERxXKcu_KVUx-ApAjrL91m1oL47greCYX0v8jJKuOeOeUnzSeIax3EiwnUmyu2SpOljqCgIhyUcmDRNlLiLryZk5xd5UUr-_1Ig Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ad88df8fe4f6443b873e9ebb10bb16be Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-InstanceActionsTestJSON-1096346929 Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ad88df8fe4f6443b873e9ebb10bb16be", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ad88df8fe4f6443b873e9ebb10bb16be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad88df8fe4f6443b873e9ebb10bb16be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ad88df8fe4f6443b873e9ebb10bb16be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-InstanceActionsTestJSON-1096346929 Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ad88df8fe4f6443b873e9ebb10bb16be Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1096346929 Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-InstanceActionsTestJSON-1096346929-project Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: efbc2ae0e55c485ebed9f44090bfcfcd Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-InstanceActionsTestJSON-1096346929-project Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 3b8e83a4-e16d-4a23-a596-61224bdf98b6 could not be found. Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '3b8e83a4-e16d-4a23-a596-61224bdf98b6'} Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8e83a4-e16d-4a23-a596-61224bdf98b6 could not be found. Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8e83a4-e16d-4a23-a596-61224bdf98b6 could not be found. Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:00.910545 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:00.915368 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:00.915368 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:00.915368 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:00.915368 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:00.915368 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:00.915368 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8e83a4-e16d-4a23-a596-61224bdf98b6 could not be found. Aug 09 14:36:00.915368 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:00.916576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-968c703b-1048-455e-975e-4e9309b39aba tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] Returning 404 to user: Instance 3b8e83a4-e16d-4a23-a596-61224bdf98b6 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:00.917613 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-968c703b-1048-455e-975e-4e9309b39aba tempest-InstanceActionsTestJSON-1096346929 tempest-InstanceActionsTestJSON-1096346929-project] 10.222.0.50 "GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6" status: 404 len: 111 microversion: 2.1 time: 0.052370 Aug 09 14:36:00.922791 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 759/1484] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:00 2022] GET /compute/v2.1/servers/3b8e83a4-e16d-4a23-a596-61224bdf98b6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:00.928352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8cbc2fe6-7e89-4448-9440-e62c05405323 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-844626-8", "block_migration": true, "disk_over_commit": false}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:00.931372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8cbc2fe6-7e89-4448-9440-e62c05405323 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:00.939881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cbc2fe6-7e89-4448-9440-e62c05405323 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:00.940640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cbc2fe6-7e89-4448-9440-e62c05405323 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:00.941234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cbc2fe6-7e89-4448-9440-e62c05405323 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:00.942156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cbc2fe6-7e89-4448-9440-e62c05405323 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:00.942789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cbc2fe6-7e89-4448-9440-e62c05405323 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:00.943426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cbc2fe6-7e89-4448-9440-e62c05405323 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:00.983385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-8cbc2fe6-7e89-4448-9440-e62c05405323 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lazy-loading 'flavor' on Instance uuid aaf11da1-82f0-41e7-bdef-9bbea7629ef0 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:36:01.000840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8cbc2fe6-7e89-4448-9440-e62c05405323 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Going to try to live migrate instance to n-h2-844626-8 {{(pid=119406) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 14:36:01.157720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4dcd0a5f-31be-4f3a-8aea-b9e8cf68b628 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:01.174664 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4dcd0a5f-31be-4f3a-8aea-b9e8cf68b628 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a" status: 200 len: 1472 microversion: 2.1 time: 0.505303 Aug 09 14:36:01.175584 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 726/1485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:00 2022] GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a => generated 1472 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:01.180918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-812b31ed-3085-46e0-bfb2-905dd8638045 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:01.181558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-812b31ed-3085-46e0-bfb2-905dd8638045 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:01.203964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-812b31ed-3085-46e0-bfb2-905dd8638045 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:01.204467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-812b31ed-3085-46e0-bfb2-905dd8638045 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:01.204901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-812b31ed-3085-46e0-bfb2-905dd8638045 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:01.205612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-812b31ed-3085-46e0-bfb2-905dd8638045 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:01.206060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-812b31ed-3085-46e0-bfb2-905dd8638045 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:01.206478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-812b31ed-3085-46e0-bfb2-905dd8638045 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:01.451507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-812b31ed-3085-46e0-bfb2-905dd8638045 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:01.466155 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-812b31ed-3085-46e0-bfb2-905dd8638045 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1471 microversion: 2.1 time: 0.289409 Aug 09 14:36:01.466759 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 727/1486] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:01 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:01.501439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0687543-024d-4e25-aa8b-748f7b667e71 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:01.530657 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0687543-024d-4e25-aa8b-748f7b667e71 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049616 Aug 09 14:36:01.546872 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 728/1487] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:01.558682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2136a81-211d-42df-98dc-463f5e9d8d92 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:01.559620 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:01.559620 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:01.601684 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2136a81-211d-42df-98dc-463f5e9d8d92 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/306897533" status: 202 len: 0 microversion: 2.1 time: 0.052545 Aug 09 14:36:01.605748 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 729/1488] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:36:01 2022] DELETE /compute/v2.1/flavors/306897533 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:36:01.610389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-56fc6eb0-1769-45d7-923d-5d7ff8b401ab tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:01.656585 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-56fc6eb0-1769-45d7-923d-5d7ff8b401ab tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044797 Aug 09 14:36:01.681219 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 730/1489] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:01.693164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82923ffd-9771-4a95-8031-424cf513771c tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1590074698", "id": 1130570734, "os-flavor-access:is_public": "False"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:01.704116 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:01.704116 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:01.735237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=12,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:01.754651 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82923ffd-9771-4a95-8031-424cf513771c tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.071944 Aug 09 14:36:01.759283 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 731/1490] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:36:01 2022] POST /compute/v2.1/flavors => generated 415 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:01.777932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e144379d-dbb8-4b14-aa92-7735147be40f tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:01.836793 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e144379d-dbb8-4b14-aa92-7735147be40f tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071122 Aug 09 14:36:01.837626 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 732/1491] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:36:01.854551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea2e7ff6-5f83-4b6a-9596-8fb6f687f758 tempest-FlavorsAdminTestJSON-1579664462 tempest-FlavorsAdminTestJSON-1579664462-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:01.894049 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea2e7ff6-5f83-4b6a-9596-8fb6f687f758 tempest-FlavorsAdminTestJSON-1579664462 tempest-FlavorsAdminTestJSON-1579664462-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043447 Aug 09 14:36:01.906244 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 733/1492] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:01.911836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c7e69578-dd97-411d-af23-efb4936500e7 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:01.945230 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c7e69578-dd97-411d-af23-efb4936500e7 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1130570734" status: 202 len: 0 microversion: 2.1 time: 0.037084 Aug 09 14:36:01.947937 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 734/1493] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:36:01 2022] DELETE /compute/v2.1/flavors/1130570734 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 14:36:01.963932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6fd4bf5f-d08d-41c1-9cbf-bfd510ade0e1 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:02.024791 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6fd4bf5f-d08d-41c1-9cbf-bfd510ade0e1 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067896 Aug 09 14:36:02.025816 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 735/1494] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:02.050362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6e9f2c0e-7f9d-4845-8d17-48cff3bbf6b5 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1996030295", "id": 871214028, "os-flavor-access:is_public": "True"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:02.082233 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6e9f2c0e-7f9d-4845-8d17-48cff3bbf6b5 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.036171 Aug 09 14:36:02.089915 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 736/1495] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:36:02 2022] POST /compute/v2.1/flavors => generated 411 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:36:02.097925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3e63ca76-53da-47f0-adcb-2f818d8c592f tempest-FlavorsAdminTestJSON-1579664462 tempest-FlavorsAdminTestJSON-1579664462-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:02.159379 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3e63ca76-53da-47f0-adcb-2f818d8c592f tempest-FlavorsAdminTestJSON-1579664462 tempest-FlavorsAdminTestJSON-1579664462-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.063220 Aug 09 14:36:02.171294 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 737/1496] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:02 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:02.182555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63e9cf8c-7a46-400b-a04b-807443feab69 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:02.222850 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63e9cf8c-7a46-400b-a04b-807443feab69 tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/871214028" status: 202 len: 0 microversion: 2.1 time: 0.044996 Aug 09 14:36:02.223861 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 738/1497] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:36:02 2022] DELETE /compute/v2.1/flavors/871214028 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 14:36:02.234038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-318673fe-ef0d-4965-851e-0dff6b87816e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:02.234927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-318673fe-ef0d-4965-851e-0dff6b87816e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:02.250959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-318673fe-ef0d-4965-851e-0dff6b87816e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:02.251616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-318673fe-ef0d-4965-851e-0dff6b87816e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:02.252152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-318673fe-ef0d-4965-851e-0dff6b87816e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:02.254384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-318673fe-ef0d-4965-851e-0dff6b87816e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:02.258189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-318673fe-ef0d-4965-851e-0dff6b87816e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:02.258945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-318673fe-ef0d-4965-851e-0dff6b87816e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:03.157298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-318673fe-ef0d-4965-851e-0dff6b87816e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:03.170588 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-318673fe-ef0d-4965-851e-0dff6b87816e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a" status: 200 len: 1472 microversion: 2.1 time: 0.943831 Aug 09 14:36:03.174058 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 739/1498] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:02 2022] GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a => generated 1472 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:03.191493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09224147-4719-422e-814c-987afbdb0f0d tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:03.222501 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09224147-4719-422e-814c-987afbdb0f0d tempest-FlavorsAdminTestJSON-1335720777 tempest-FlavorsAdminTestJSON-1335720777-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046971 Aug 09 14:36:03.223699 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 740/1499] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:03.229252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8ee4f43-7ac3-481f-969e-2fd69076b97b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:03.231992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8ee4f43-7ac3-481f-969e-2fd69076b97b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:03.282234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8ee4f43-7ac3-481f-969e-2fd69076b97b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:03.283286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8ee4f43-7ac3-481f-969e-2fd69076b97b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:03.286472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8ee4f43-7ac3-481f-969e-2fd69076b97b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:03.287713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8ee4f43-7ac3-481f-969e-2fd69076b97b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:03.288438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8ee4f43-7ac3-481f-969e-2fd69076b97b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:03.290301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8ee4f43-7ac3-481f-969e-2fd69076b97b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:04.337844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e8ee4f43-7ac3-481f-969e-2fd69076b97b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:04.350967 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8ee4f43-7ac3-481f-969e-2fd69076b97b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1471 microversion: 2.1 time: 1.125709 Aug 09 14:36:04.354917 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 741/1500] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:03 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1471 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:04.369565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0186e77d-2055-4a62-8738-5ddc90748eb3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:04.382066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0186e77d-2055-4a62-8738-5ddc90748eb3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:04.411693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0186e77d-2055-4a62-8738-5ddc90748eb3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:04.416995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0186e77d-2055-4a62-8738-5ddc90748eb3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:04.417998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0186e77d-2055-4a62-8738-5ddc90748eb3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:04.420125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0186e77d-2055-4a62-8738-5ddc90748eb3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:04.426263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0186e77d-2055-4a62-8738-5ddc90748eb3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:04.428135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0186e77d-2055-4a62-8738-5ddc90748eb3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:04.640966 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8cbc2fe6-7e89-4448-9440-e62c05405323 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/action" status: 202 len: 0 microversion: 2.1 time: 3.716578 Aug 09 14:36:04.642754 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 760/1501] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:36:00 2022] POST /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/action => generated 0 bytes in 3719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:36:04.650545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c2ced14b-0cb6-4daa-9f69-7e153a2f0a4b req-f0a37f20-8d19-43c8-ad7d-1f29f64af384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dafd735-c6e0-4036-b7ea-974a7cabc4ea", "name": "network-vif-deleted", "tag": "b83853b5-967d-41c3-93ac-9eda0a6fe81a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:04.754227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c2ced14b-0cb6-4daa-9f69-7e153a2f0a4b req-f0a37f20-8d19-43c8-ad7d-1f29f64af384 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:04.758468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c2ced14b-0cb6-4daa-9f69-7e153a2f0a4b req-f0a37f20-8d19-43c8-ad7d-1f29f64af384 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:04.759931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c2ced14b-0cb6-4daa-9f69-7e153a2f0a4b req-f0a37f20-8d19-43c8-ad7d-1f29f64af384 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:04.841296 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-c2ced14b-0cb6-4daa-9f69-7e153a2f0a4b req-f0a37f20-8d19-43c8-ad7d-1f29f64af384 service nova] Creating event network-vif-deleted:b83853b5-967d-41c3-93ac-9eda0a6fe81a for instance 5dafd735-c6e0-4036-b7ea-974a7cabc4ea on n-h2-844626-8 Aug 09 14:36:04.860506 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c2ced14b-0cb6-4daa-9f69-7e153a2f0a4b req-f0a37f20-8d19-43c8-ad7d-1f29f64af384 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211038 Aug 09 14:36:04.861998 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 761/1502] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:04.878022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f229a392-c723-499a-93b6-4891785ef6cb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:04.880762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f229a392-c723-499a-93b6-4891785ef6cb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:04.916770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f229a392-c723-499a-93b6-4891785ef6cb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:04.923256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f229a392-c723-499a-93b6-4891785ef6cb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:04.924201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f229a392-c723-499a-93b6-4891785ef6cb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:04.930936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f229a392-c723-499a-93b6-4891785ef6cb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:04.932385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f229a392-c723-499a-93b6-4891785ef6cb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:04.940428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f229a392-c723-499a-93b6-4891785ef6cb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:05.246898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0186e77d-2055-4a62-8738-5ddc90748eb3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:05.260143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:05.269669 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0186e77d-2055-4a62-8738-5ddc90748eb3 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a" status: 200 len: 1472 microversion: 2.1 time: 0.911751 Aug 09 14:36:05.273543 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 742/1503] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:04 2022] GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a => generated 1472 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:05.376988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dfe19219-7e3a-47a9-aecf-bf80920b4192 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:05.377669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dfe19219-7e3a-47a9-aecf-bf80920b4192 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:05.402830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfe19219-7e3a-47a9-aecf-bf80920b4192 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:05.405981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfe19219-7e3a-47a9-aecf-bf80920b4192 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:05.407711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfe19219-7e3a-47a9-aecf-bf80920b4192 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:05.409603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfe19219-7e3a-47a9-aecf-bf80920b4192 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:05.412647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfe19219-7e3a-47a9-aecf-bf80920b4192 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:05.413305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfe19219-7e3a-47a9-aecf-bf80920b4192 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:06.027995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dfe19219-7e3a-47a9-aecf-bf80920b4192 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:06.040869 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dfe19219-7e3a-47a9-aecf-bf80920b4192 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.669923 Aug 09 14:36:06.042938 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 743/1504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:05 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:06.236767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f229a392-c723-499a-93b6-4891785ef6cb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:06.254822 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f229a392-c723-499a-93b6-4891785ef6cb tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 1.390595 Aug 09 14:36:06.259529 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 762/1505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:04 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:06.293662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:06.294269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:06.309196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:06.309777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:06.313070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:06.316261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:06.316767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:06.317234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:06.422743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:06.424896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:06.427856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:06.428920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lazy-loading 'fault' on Instance uuid 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:36:06.568525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:06.583442 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e9318b4f-6527-4e40-b172-20d1f7a27a08 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a" status: 200 len: 1308 microversion: 2.1 time: 0.293688 Aug 09 14:36:06.585238 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 744/1506] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:06 2022] GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a => generated 1308 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:06.928645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-a6143c7e-8620-4fa3-a8e8-271c4769fe63 req-f1a785cf-76dc-43ee-8581-cb4f6cd93ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37b23fa3-f32c-4406-a38f-2ba8e7e0df4a", "name": "network-vif-deleted", "tag": "d2163219-49e5-4bac-b7be-0786277eb832"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:06.960741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a6143c7e-8620-4fa3-a8e8-271c4769fe63 req-f1a785cf-76dc-43ee-8581-cb4f6cd93ef1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:06.961308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a6143c7e-8620-4fa3-a8e8-271c4769fe63 req-f1a785cf-76dc-43ee-8581-cb4f6cd93ef1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:06.961936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a6143c7e-8620-4fa3-a8e8-271c4769fe63 req-f1a785cf-76dc-43ee-8581-cb4f6cd93ef1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:06.995283 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-a6143c7e-8620-4fa3-a8e8-271c4769fe63 req-f1a785cf-76dc-43ee-8581-cb4f6cd93ef1 service nova] Creating event network-vif-deleted:d2163219-49e5-4bac-b7be-0786277eb832 for instance 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a on n-h1-844626-8 Aug 09 14:36:07.022358 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-a6143c7e-8620-4fa3-a8e8-271c4769fe63 req-f1a785cf-76dc-43ee-8581-cb4f6cd93ef1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088179 Aug 09 14:36:07.031952 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 763/1507] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:07.066224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-29d72155-400f-4ea4-b6fd-4806016762d4 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:07.066924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-29d72155-400f-4ea4-b6fd-4806016762d4 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:07.082043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29d72155-400f-4ea4-b6fd-4806016762d4 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:07.082533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29d72155-400f-4ea4-b6fd-4806016762d4 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:07.083358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29d72155-400f-4ea4-b6fd-4806016762d4 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:07.087751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29d72155-400f-4ea4-b6fd-4806016762d4 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:07.088555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29d72155-400f-4ea4-b6fd-4806016762d4 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:07.090037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29d72155-400f-4ea4-b6fd-4806016762d4 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:07.206571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-940285582", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "f179f60c-387b-4e6c-a4a4-ea86cb4aceb3"}, {"uuid": "6dc190a4-b75c-4319-8a56-7382abcb606a"}, {"uuid": "f179f60c-387b-4e6c-a4a4-ea86cb4aceb3"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:07.233052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=12,nova_api:INSERT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:07.305077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] validate_networks() for [('f179f60c-387b-4e6c-a4a4-ea86cb4aceb3', None, None, None, None, None), ('6dc190a4-b75c-4319-8a56-7382abcb606a', None, None, None, None, None), ('f179f60c-387b-4e6c-a4a4-ea86cb4aceb3', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:36:07.736316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-29d72155-400f-4ea4-b6fd-4806016762d4 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:07.763727 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-29d72155-400f-4ea4-b6fd-4806016762d4 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.702920 Aug 09 14:36:07.767173 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 745/1508] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:07 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:07.777982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0d2133f0-152c-433a-9128-8ca6e34dc10d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:07.800189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0d2133f0-152c-433a-9128-8ca6e34dc10d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:07.823234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d2133f0-152c-433a-9128-8ca6e34dc10d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:07.824215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d2133f0-152c-433a-9128-8ca6e34dc10d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:07.827496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d2133f0-152c-433a-9128-8ca6e34dc10d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:07.829820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d2133f0-152c-433a-9128-8ca6e34dc10d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:07.833566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d2133f0-152c-433a-9128-8ca6e34dc10d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:07.834897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d2133f0-152c-433a-9128-8ca6e34dc10d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:08.386769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0d2133f0-152c-433a-9128-8ca6e34dc10d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:08.401053 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0d2133f0-152c-433a-9128-8ca6e34dc10d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.632000 Aug 09 14:36:08.415117 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 746/1509] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:07 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:08.426302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75f31c34-20b0-4702-834f-3eaeb6f785a6 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:08.427049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75f31c34-20b0-4702-834f-3eaeb6f785a6 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:08.437186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75f31c34-20b0-4702-834f-3eaeb6f785a6 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:08.438947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75f31c34-20b0-4702-834f-3eaeb6f785a6 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:08.439880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75f31c34-20b0-4702-834f-3eaeb6f785a6 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:08.442059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75f31c34-20b0-4702-834f-3eaeb6f785a6 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:08.443060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75f31c34-20b0-4702-834f-3eaeb6f785a6 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:08.445615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75f31c34-20b0-4702-834f-3eaeb6f785a6 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:08.490832 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-75f31c34-20b0-4702-834f-3eaeb6f785a6 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] HTTP exception thrown: Instance 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a could not be found. Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75f31c34-20b0-4702-834f-3eaeb6f785a6 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Request method failure captured: Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a HTTP/1.1 Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nAxd9eijW7X2rhOnHb4abugVXlQo199zVPOYR0vHABm_qKntSOkPPdw-VVY24AM5btmhqYeipUr5RjEYqu5zrO_lbVw7jUtDNDItvIwQLV5L8fl2A08iRmDBWaFdl8nTidxhJ88XTQb2v6LwvvWrJ1KlYEj00AMV3DPEo-4IzdmtKY Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9471973b988a4c31be31dde4cef1489e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d68dcb9c00cf4ffebcc05a7d44793468 Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a could not be found. Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '37b23fa3-f32c-4406-a38f-2ba8e7e0df4a'} Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a could not be found. Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a could not be found. Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:08.496166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:08.501418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:08.501418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:08.501418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:08.501418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:08.501418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:08.501418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a could not be found. Aug 09 14:36:08.501418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:08.503034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75f31c34-20b0-4702-834f-3eaeb6f785a6 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Returning 404 to user: Instance 37b23fa3-f32c-4406-a38f-2ba8e7e0df4a could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:08.506998 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75f31c34-20b0-4702-834f-3eaeb6f785a6 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a" status: 404 len: 111 microversion: 2.1 time: 0.103167 Aug 09 14:36:08.507790 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 747/1510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:08 2022] GET /compute/v2.1/servers/37b23fa3-f32c-4406-a38f-2ba8e7e0df4a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:08.517805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-570334260", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "3fec08e6-958d-4908-98b5-60037a88730d"}], "block_device_mapping_v2": [{"uuid": "898c1380-83c9-410b-9571-fa9585f56ecf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:08.709903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] validate_networks() for [('3fec08e6-958d-4908-98b5-60037a88730d', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:36:09.801395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:36:09.801941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:36:09.802266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:36:09.802673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:36:09.803102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:36:09.834209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:36:09.835548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:36:09.836296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:36:09.836940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:36:09.837692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:36:09.838365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:09.839259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:09.839877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:09.840650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:09.841111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:09.845350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:09.858572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:09.860539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:09.861592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:09.864093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:09.864876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:09.865596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:09.895283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Getting quotas for project d512f92fc41c45edbd209ab51922e5d7. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:36:09.907258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Getting quotas for project 54de373a9e684301905608f195bb56b9. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:36:09.908058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Getting quotas for user 247d1747ce074adb8b1e56a459e8cd51 and project d512f92fc41c45edbd209ab51922e5d7. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:36:09.920724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Getting quotas for user 00f1751674ba4df68ea6905988cd6510 and project 54de373a9e684301905608f195bb56b9. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:36:09.967051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:36:09.970207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:36:10.044408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:36:10.046552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='898c1380-83c9-410b-9571-fa9585f56ecf',volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:36:10.081128 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c1bce411-3133-4ae4-800c-cb426364c847 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.880118 Aug 09 14:36:10.082150 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 764/1511] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:36:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:36:10.090981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1dbb5676-7335-48d6-8307-f0d5c1e2451c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:10.092121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1dbb5676-7335-48d6-8307-f0d5c1e2451c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5dafd735-c6e0-4036-b7ea-974a7cabc4ea] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:10.144105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dbb5676-7335-48d6-8307-f0d5c1e2451c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:10.150677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dbb5676-7335-48d6-8307-f0d5c1e2451c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:10.152420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dbb5676-7335-48d6-8307-f0d5c1e2451c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:10.154180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dbb5676-7335-48d6-8307-f0d5c1e2451c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:10.156764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dbb5676-7335-48d6-8307-f0d5c1e2451c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:10.158380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dbb5676-7335-48d6-8307-f0d5c1e2451c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:10.229107 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-1dbb5676-7335-48d6-8307-f0d5c1e2451c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] HTTP exception thrown: Instance 5dafd735-c6e0-4036-b7ea-974a7cabc4ea could not be found. Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1dbb5676-7335-48d6-8307-f0d5c1e2451c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Request method failure captured: Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea HTTP/1.1 Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nAxd9eijW7X2rhOnHb4abugVXlQo199zVPOYR0vHABm_qKntSOkPPdw-VVY24AM5btmhqYeipUr5RjEYqu5zrO_lbVw7jUtDNDItvIwQLV5L8fl2A08iRmDBWaFdl8nTidxhJ88XTQb2v6LwvvWrJ1KlYEj00AMV3DPEo-4IzdmtKY Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9471973b988a4c31be31dde4cef1489e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d68dcb9c00cf4ffebcc05a7d44793468 Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 5dafd735-c6e0-4036-b7ea-974a7cabc4ea could not be found. Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '5dafd735-c6e0-4036-b7ea-974a7cabc4ea'} Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dafd735-c6e0-4036-b7ea-974a7cabc4ea could not be found. Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dafd735-c6e0-4036-b7ea-974a7cabc4ea could not be found. Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:10.233050 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:10.240008 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:10.240008 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:10.240008 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:10.240008 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:10.240008 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:10.240008 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dafd735-c6e0-4036-b7ea-974a7cabc4ea could not be found. Aug 09 14:36:10.240008 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:10.245628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1dbb5676-7335-48d6-8307-f0d5c1e2451c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Returning 404 to user: Instance 5dafd735-c6e0-4036-b7ea-974a7cabc4ea could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:10.246772 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1dbb5676-7335-48d6-8307-f0d5c1e2451c tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea" status: 404 len: 111 microversion: 2.1 time: 0.163673 Aug 09 14:36:10.247726 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 765/1512] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:10 2022] GET /compute/v2.1/servers/5dafd735-c6e0-4036-b7ea-974a7cabc4ea => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:10.266573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-500473ab-56ac-455c-8fb9-42063e20ac36 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:10.274201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-500473ab-56ac-455c-8fb9-42063e20ac36 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:10.302229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-500473ab-56ac-455c-8fb9-42063e20ac36 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:10.303344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-500473ab-56ac-455c-8fb9-42063e20ac36 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:10.304168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-500473ab-56ac-455c-8fb9-42063e20ac36 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:10.305737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-500473ab-56ac-455c-8fb9-42063e20ac36 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:10.312597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-500473ab-56ac-455c-8fb9-42063e20ac36 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:10.313967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-500473ab-56ac-455c-8fb9-42063e20ac36 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:10.487921 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3d6afde5-d35a-4f7e-9b0d-70ec692f6131 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.978716 Aug 09 14:36:10.498643 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 748/1513] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:36:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1990 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 14:36:10.517381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c10ba8dc-477b-4c3f-9f97-aef0c90ea422 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:10.518179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c10ba8dc-477b-4c3f-9f97-aef0c90ea422 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:10.542204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c10ba8dc-477b-4c3f-9f97-aef0c90ea422 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:10.543709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c10ba8dc-477b-4c3f-9f97-aef0c90ea422 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:10.545116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c10ba8dc-477b-4c3f-9f97-aef0c90ea422 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:10.546528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c10ba8dc-477b-4c3f-9f97-aef0c90ea422 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:10.549671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c10ba8dc-477b-4c3f-9f97-aef0c90ea422 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:10.550323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c10ba8dc-477b-4c3f-9f97-aef0c90ea422 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:11.060417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-500473ab-56ac-455c-8fb9-42063e20ac36 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:11.114100 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-500473ab-56ac-455c-8fb9-42063e20ac36 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.855505 Aug 09 14:36:11.116170 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 766/1514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:10 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:11.164084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0e9fc56-d36f-4ffd-8568-ca9c068ce800 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:11.165349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0e9fc56-d36f-4ffd-8568-ca9c068ce800 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:11.228843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c10ba8dc-477b-4c3f-9f97-aef0c90ea422 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:11.279185 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c10ba8dc-477b-4c3f-9f97-aef0c90ea422 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.778870 Aug 09 14:36:11.301570 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 749/1515] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:10 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:11.328846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b98cad74-5038-4ea5-b45e-117fc0f16795 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:11.444747 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b98cad74-5038-4ea5-b45e-117fc0f16795 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/7bdfa22d-fcd8-4cd6-8024-fd7f4ce5dd54" status: 204 len: 0 microversion: 2.1 time: 0.128997 Aug 09 14:36:11.445676 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 750/1516] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 14:36:11 2022] DELETE /compute/v2.1/os-server-groups/7bdfa22d-fcd8-4cd6-8024-fd7f4ce5dd54 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:36:11.453375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82246fbb-4a67-43b2-b589-a2940a7d5585 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:11.453984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82246fbb-4a67-43b2-b589-a2940a7d5585 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:11.559698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0e9fc56-d36f-4ffd-8568-ca9c068ce800 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:11.584048 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0e9fc56-d36f-4ffd-8568-ca9c068ce800 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1212 microversion: 2.1 time: 0.462977 Aug 09 14:36:11.608154 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 767/1517] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:11 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1212 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:11.645311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7e46fb7-f5b4-4ea4-b3bf-93048b508ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:11.647177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7e46fb7-f5b4-4ea4-b3bf-93048b508ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 3f0246e9-8417-4083-8430-ceda68df0c44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:11.682290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7e46fb7-f5b4-4ea4-b3bf-93048b508ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:11.683122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7e46fb7-f5b4-4ea4-b3bf-93048b508ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:11.684209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7e46fb7-f5b4-4ea4-b3bf-93048b508ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:11.685771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7e46fb7-f5b4-4ea4-b3bf-93048b508ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:11.686816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7e46fb7-f5b4-4ea4-b3bf-93048b508ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:11.687984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7e46fb7-f5b4-4ea4-b3bf-93048b508ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:11.717112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-82246fbb-4a67-43b2-b589-a2940a7d5585 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:11.734670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-82246fbb-4a67-43b2-b589-a2940a7d5585 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:11.740644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-82246fbb-4a67-43b2-b589-a2940a7d5585 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:11.742503 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82246fbb-4a67-43b2-b589-a2940a7d5585 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1103 microversion: 2.25 time: 0.294095 Aug 09 14:36:11.748654 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 751/1518] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:11 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1103 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:11.758336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7e46fb7-f5b4-4ea4-b3bf-93048b508ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 3f0246e9-8417-4083-8430-ceda68df0c44] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:36:11.986528 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7e46fb7-f5b4-4ea4-b3bf-93048b508ec9 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44" status: 204 len: 0 microversion: 2.1 time: 0.370590 Aug 09 14:36:11.986528 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 768/1519] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:36:11 2022] DELETE /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:36:11.995415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db5b5bfd-bacb-4b7c-88c0-8fd736d8455a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:11.996048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-db5b5bfd-bacb-4b7c-88c0-8fd736d8455a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:12.013324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db5b5bfd-bacb-4b7c-88c0-8fd736d8455a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:12.027371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db5b5bfd-bacb-4b7c-88c0-8fd736d8455a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:12.031992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db5b5bfd-bacb-4b7c-88c0-8fd736d8455a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:12.034180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db5b5bfd-bacb-4b7c-88c0-8fd736d8455a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:12.035883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db5b5bfd-bacb-4b7c-88c0-8fd736d8455a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:12.036955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db5b5bfd-bacb-4b7c-88c0-8fd736d8455a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:12.137336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9d2d8191-4b4d-41a8-b2c0-49643e22d8c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:12.138729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d2d8191-4b4d-41a8-b2c0-49643e22d8c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:12.149151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-db5b5bfd-bacb-4b7c-88c0-8fd736d8455a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:36:12.161998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d2d8191-4b4d-41a8-b2c0-49643e22d8c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:12.162500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d2d8191-4b4d-41a8-b2c0-49643e22d8c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:12.162939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d2d8191-4b4d-41a8-b2c0-49643e22d8c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:12.163701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d2d8191-4b4d-41a8-b2c0-49643e22d8c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:12.164145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d2d8191-4b4d-41a8-b2c0-49643e22d8c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:12.165404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d2d8191-4b4d-41a8-b2c0-49643e22d8c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:12.428902 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-db5b5bfd-bacb-4b7c-88c0-8fd736d8455a tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "DELETE /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 204 len: 0 microversion: 2.1 time: 0.432312 Aug 09 14:36:12.431217 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 752/1520] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:36:11 2022] DELETE /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:36:12.458356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4183a714-dfeb-45a8-a4ac-79a9127bb6e0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:12.464296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4183a714-dfeb-45a8-a4ac-79a9127bb6e0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:12.482121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4183a714-dfeb-45a8-a4ac-79a9127bb6e0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:12.482615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4183a714-dfeb-45a8-a4ac-79a9127bb6e0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:12.483041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4183a714-dfeb-45a8-a4ac-79a9127bb6e0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:12.486650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4183a714-dfeb-45a8-a4ac-79a9127bb6e0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:12.489314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4183a714-dfeb-45a8-a4ac-79a9127bb6e0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:12.489753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4183a714-dfeb-45a8-a4ac-79a9127bb6e0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:12.547716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9d2d8191-4b4d-41a8-b2c0-49643e22d8c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:12.566700 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9d2d8191-4b4d-41a8-b2c0-49643e22d8c8 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.429526 Aug 09 14:36:12.580358 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 769/1521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:12 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:36:12.599774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91aa099d-b635-41ff-9751-bb1113c4e9bc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:12.607482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91aa099d-b635-41ff-9751-bb1113c4e9bc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 3f0246e9-8417-4083-8430-ceda68df0c44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:12.634268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91aa099d-b635-41ff-9751-bb1113c4e9bc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:12.634848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91aa099d-b635-41ff-9751-bb1113c4e9bc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:12.635320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91aa099d-b635-41ff-9751-bb1113c4e9bc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:12.636130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91aa099d-b635-41ff-9751-bb1113c4e9bc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:12.636915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91aa099d-b635-41ff-9751-bb1113c4e9bc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:12.637882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91aa099d-b635-41ff-9751-bb1113c4e9bc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:12.877550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4183a714-dfeb-45a8-a4ac-79a9127bb6e0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:12.895614 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4183a714-dfeb-45a8-a4ac-79a9127bb6e0 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.454586 Aug 09 14:36:12.899468 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 753/1522] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:12 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:12.921968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5453b0f-71c9-440a-96f4-0e88b3564f4f tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:12.928077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c5453b0f-71c9-440a-96f4-0e88b3564f4f tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:12.946343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5453b0f-71c9-440a-96f4-0e88b3564f4f tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:12.952836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5453b0f-71c9-440a-96f4-0e88b3564f4f tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:12.954510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5453b0f-71c9-440a-96f4-0e88b3564f4f tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:12.959012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5453b0f-71c9-440a-96f4-0e88b3564f4f tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:12.960639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5453b0f-71c9-440a-96f4-0e88b3564f4f tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:12.962412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5453b0f-71c9-440a-96f4-0e88b3564f4f tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:13.064293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91aa099d-b635-41ff-9751-bb1113c4e9bc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:13.080937 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91aa099d-b635-41ff-9751-bb1113c4e9bc tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44" status: 200 len: 1475 microversion: 2.1 time: 0.494665 Aug 09 14:36:13.085676 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 770/1523] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:12 2022] GET /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44 => generated 1475 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:13.336895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c5453b0f-71c9-440a-96f4-0e88b3564f4f tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:13.352801 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c5453b0f-71c9-440a-96f4-0e88b3564f4f tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1282 microversion: 2.1 time: 0.451352 Aug 09 14:36:13.353402 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 754/1524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:12 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1282 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:13.384679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-107b3246-bce5-42d2-b1e3-4d189944f139 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:13.386623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-107b3246-bce5-42d2-b1e3-4d189944f139 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:13.405942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-107b3246-bce5-42d2-b1e3-4d189944f139 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:13.406457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-107b3246-bce5-42d2-b1e3-4d189944f139 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:13.406880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-107b3246-bce5-42d2-b1e3-4d189944f139 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:13.407651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-107b3246-bce5-42d2-b1e3-4d189944f139 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:13.408108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-107b3246-bce5-42d2-b1e3-4d189944f139 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:13.408534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-107b3246-bce5-42d2-b1e3-4d189944f139 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:13.505124 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-107b3246-bce5-42d2-b1e3-4d189944f139 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25/ips" status: 200 len: 150 microversion: 2.1 time: 0.150631 Aug 09 14:36:13.517509 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 755/1525] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:36:13 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25/ips => generated 150 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:13.526101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5e06ee2-ea45-4d9c-aee1-a3e328918cb1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:13.528717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5e06ee2-ea45-4d9c-aee1-a3e328918cb1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:13.549869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5e06ee2-ea45-4d9c-aee1-a3e328918cb1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:13.551639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5e06ee2-ea45-4d9c-aee1-a3e328918cb1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:13.552695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5e06ee2-ea45-4d9c-aee1-a3e328918cb1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:13.555458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5e06ee2-ea45-4d9c-aee1-a3e328918cb1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:13.556713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5e06ee2-ea45-4d9c-aee1-a3e328918cb1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:13.557566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5e06ee2-ea45-4d9c-aee1-a3e328918cb1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:13.610718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-95e0808a-7bdf-4462-8d8d-9fbb5295b8a7 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1763280380", "id": 943214621, "os-flavor-access:is_public": "False"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:13.615577 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:13.615577 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:36:13.661521 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-95e0808a-7bdf-4462-8d8d-9fbb5295b8a7 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.563402 Aug 09 14:36:13.664689 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 771/1526] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:36:13 2022] POST /compute/v2.1/flavors => generated 428 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:13.679780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e21248c9-093a-4545-be44-0cb2256dd910 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce83608f-0064-4037-b4b8-62ae9888919b"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:13.680420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5e06ee2-ea45-4d9c-aee1-a3e328918cb1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:13.684457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e21248c9-093a-4545-be44-0cb2256dd910 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:13.699792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e21248c9-093a-4545-be44-0cb2256dd910 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:13.700312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e21248c9-093a-4545-be44-0cb2256dd910 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:13.700750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e21248c9-093a-4545-be44-0cb2256dd910 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:13.701657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e21248c9-093a-4545-be44-0cb2256dd910 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:13.701956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e21248c9-093a-4545-be44-0cb2256dd910 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:13.702380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e21248c9-093a-4545-be44-0cb2256dd910 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:13.703266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5e06ee2-ea45-4d9c-aee1-a3e328918cb1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:13.708116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5e06ee2-ea45-4d9c-aee1-a3e328918cb1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:13.716283 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5e06ee2-ea45-4d9c-aee1-a3e328918cb1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1250 microversion: 2.25 time: 0.190196 Aug 09 14:36:13.717266 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 756/1527] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:13 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1250 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:13.726654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1643d3c0-4342-4509-8805-cfa606bdd8fa tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:13.729209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1643d3c0-4342-4509-8805-cfa606bdd8fa tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:13.752350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1643d3c0-4342-4509-8805-cfa606bdd8fa tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:13.755023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1643d3c0-4342-4509-8805-cfa606bdd8fa tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:13.755611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1643d3c0-4342-4509-8805-cfa606bdd8fa tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:13.756445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1643d3c0-4342-4509-8805-cfa606bdd8fa tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:13.756988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1643d3c0-4342-4509-8805-cfa606bdd8fa tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:13.757493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1643d3c0-4342-4509-8805-cfa606bdd8fa tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:14.042816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1643d3c0-4342-4509-8805-cfa606bdd8fa tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:14.051634 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1643d3c0-4342-4509-8805-cfa606bdd8fa tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.333009 Aug 09 14:36:14.055723 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 757/1528] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:13 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:14.069621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5bcd5aa3-1673-4f85-8e79-12a824fcdfe3 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e0f6e4c3f69e4ba7ba7e9a3bf86165e3"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:14.072913 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:14.072913 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:14.200002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:14.208002 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5bcd5aa3-1673-4f85-8e79-12a824fcdfe3 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/943214621/action" status: 200 len: 96 microversion: 2.1 time: 0.150691 Aug 09 14:36:14.213992 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 758/1529] 10.222.0.50 () {60 vars in 1197 bytes} [Tue Aug 9 14:36:14 2022] POST /compute/v2.1/flavors/943214621/action => generated 96 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:14.219359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b9b14cba-ff9d-4e28-88ad-abaddbf6fc03 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:14.220307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b9b14cba-ff9d-4e28-88ad-abaddbf6fc03 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:14.227816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9b14cba-ff9d-4e28-88ad-abaddbf6fc03 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:14.228662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9b14cba-ff9d-4e28-88ad-abaddbf6fc03 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:14.229297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9b14cba-ff9d-4e28-88ad-abaddbf6fc03 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:14.230219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9b14cba-ff9d-4e28-88ad-abaddbf6fc03 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:14.230851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9b14cba-ff9d-4e28-88ad-abaddbf6fc03 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:14.231568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9b14cba-ff9d-4e28-88ad-abaddbf6fc03 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:14.546008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b9b14cba-ff9d-4e28-88ad-abaddbf6fc03 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:14.564134 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b9b14cba-ff9d-4e28-88ad-abaddbf6fc03 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.346550 Aug 09 14:36:14.567526 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 759/1530] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:14 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:14.578025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a0bcdb2-7101-4320-b5f3-a9303d8d1d67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:14.578639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a0bcdb2-7101-4320-b5f3-a9303d8d1d67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 3f0246e9-8417-4083-8430-ceda68df0c44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:14.597962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a0bcdb2-7101-4320-b5f3-a9303d8d1d67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:14.598509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a0bcdb2-7101-4320-b5f3-a9303d8d1d67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:14.598949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a0bcdb2-7101-4320-b5f3-a9303d8d1d67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:14.599701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a0bcdb2-7101-4320-b5f3-a9303d8d1d67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:14.600146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a0bcdb2-7101-4320-b5f3-a9303d8d1d67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:14.600556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a0bcdb2-7101-4320-b5f3-a9303d8d1d67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:15.013066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a0bcdb2-7101-4320-b5f3-a9303d8d1d67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:15.024214 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a0bcdb2-7101-4320-b5f3-a9303d8d1d67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44" status: 200 len: 1475 microversion: 2.1 time: 0.453818 Aug 09 14:36:15.040834 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 760/1531] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:14 2022] GET /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44 => generated 1475 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:15.213201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8022a10f-34b7-48e8-9880-9ce04df7f690 tempest-FlavorsAccessTestJSON-1262242056 tempest-FlavorsAccessTestJSON-1262242056-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:15.250051 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8022a10f-34b7-48e8-9880-9ce04df7f690 tempest-FlavorsAccessTestJSON-1262242056 tempest-FlavorsAccessTestJSON-1262242056-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.207357 Aug 09 14:36:15.251577 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 761/1532] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:15 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:15.259312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5f1bba7c-f9e1-466f-b493-6e6c0698a580 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:15.260353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5f1bba7c-f9e1-466f-b493-6e6c0698a580 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:15.268281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f1bba7c-f9e1-466f-b493-6e6c0698a580 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:15.269251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f1bba7c-f9e1-466f-b493-6e6c0698a580 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:15.269957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f1bba7c-f9e1-466f-b493-6e6c0698a580 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:15.270900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f1bba7c-f9e1-466f-b493-6e6c0698a580 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:15.271688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f1bba7c-f9e1-466f-b493-6e6c0698a580 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:15.272330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f1bba7c-f9e1-466f-b493-6e6c0698a580 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:15.622344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5f1bba7c-f9e1-466f-b493-6e6c0698a580 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:15.639823 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5f1bba7c-f9e1-466f-b493-6e6c0698a580 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1312 microversion: 2.1 time: 0.386889 Aug 09 14:36:15.640719 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 762/1533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:15 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1312 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:15.658868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-889ab221-ffb3-4c3f-a282-28a24d36fe68 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:15.659562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-889ab221-ffb3-4c3f-a282-28a24d36fe68 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:15.665988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-889ab221-ffb3-4c3f-a282-28a24d36fe68 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:15.666467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-889ab221-ffb3-4c3f-a282-28a24d36fe68 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:15.667506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-889ab221-ffb3-4c3f-a282-28a24d36fe68 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:15.667646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-889ab221-ffb3-4c3f-a282-28a24d36fe68 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:15.668043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-889ab221-ffb3-4c3f-a282-28a24d36fe68 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:15.668456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-889ab221-ffb3-4c3f-a282-28a24d36fe68 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:15.672951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:16.057779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-889ab221-ffb3-4c3f-a282-28a24d36fe68 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:16.085924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-889ab221-ffb3-4c3f-a282-28a24d36fe68 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:16.090788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-889ab221-ffb3-4c3f-a282-28a24d36fe68 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:16.094961 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-889ab221-ffb3-4c3f-a282-28a24d36fe68 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1292 microversion: 2.25 time: 0.440713 Aug 09 14:36:16.096332 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 763/1534] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:15 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1292 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:16.118849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62f2ef73-b2ec-4bc6-bedf-d1cf74543731 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:16.119512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-62f2ef73-b2ec-4bc6-bedf-d1cf74543731 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:16.130410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62f2ef73-b2ec-4bc6-bedf-d1cf74543731 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:16.130894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62f2ef73-b2ec-4bc6-bedf-d1cf74543731 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:16.132570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62f2ef73-b2ec-4bc6-bedf-d1cf74543731 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:16.133494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62f2ef73-b2ec-4bc6-bedf-d1cf74543731 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:16.136708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62f2ef73-b2ec-4bc6-bedf-d1cf74543731 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:16.137508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62f2ef73-b2ec-4bc6-bedf-d1cf74543731 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:16.819258 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-e21248c9-093a-4545-be44-0cb2256dd910 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Invalid volume: volume ce83608f-0064-4037-b4b8-62ae9888919b is already attached to instances: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e21248c9-093a-4545-be44-0cb2256dd910 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25/os-volume_attachments HTTP/1.1 Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 74 Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: {"volumeAttachment": {"volumeId": "ce83608f-0064-4037-b4b8-62ae9888919b"}} Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid volume: volume ce83608f-0064-4037-b4b8-62ae9888919b is already attached to instances: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'server_id': '9bd1379b-b2dc-4866-9a3f-d4d03c495a25', 'body': {'volumeAttachment': {'volumeId': 'ce83608f-0064-4037-b4b8-62ae9888919b'}}} Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce83608f-0064-4037-b4b8-62ae9888919b is already attached to instances: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:36:16.844994 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce83608f-0064-4037-b4b8-62ae9888919b is already attached to instances: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce83608f-0064-4037-b4b8-62ae9888919b is already attached to instances: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d Aug 09 14:36:16.849340 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:16.853129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e21248c9-093a-4545-be44-0cb2256dd910 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 400 to user: Invalid volume: volume ce83608f-0064-4037-b4b8-62ae9888919b is already attached to instances: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:16.854690 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e21248c9-093a-4545-be44-0cb2256dd910 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 3.188918 Aug 09 14:36:16.856056 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 772/1535] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 14:36:13 2022] POST /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25/os-volume_attachments => generated 174 bytes in 3191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:36:16.861723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4815c8bd-4f3a-43e4-becf-8f460b56a844 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e0f6e4c3f69e4ba7ba7e9a3bf86165e3"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:16.870478 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:16.870478 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:36:17.041141 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4815c8bd-4f3a-43e4-becf-8f460b56a844 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/943214621/action" status: 200 len: 21 microversion: 2.1 time: 0.183286 Aug 09 14:36:17.047765 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 773/1536] 10.222.0.50 () {60 vars in 1197 bytes} [Tue Aug 9 14:36:16 2022] POST /compute/v2.1/flavors/943214621/action => generated 21 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:17.055148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fbb1e87-259e-4658-a1e0-3be9f0b3bebc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:17.056283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3fbb1e87-259e-4658-a1e0-3be9f0b3bebc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:17.065661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fbb1e87-259e-4658-a1e0-3be9f0b3bebc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:17.066455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fbb1e87-259e-4658-a1e0-3be9f0b3bebc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:17.067917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fbb1e87-259e-4658-a1e0-3be9f0b3bebc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:17.070116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fbb1e87-259e-4658-a1e0-3be9f0b3bebc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:17.071271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fbb1e87-259e-4658-a1e0-3be9f0b3bebc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:17.072083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fbb1e87-259e-4658-a1e0-3be9f0b3bebc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:17.702899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-62f2ef73-b2ec-4bc6-bedf-d1cf74543731 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:17.715188 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-62f2ef73-b2ec-4bc6-bedf-d1cf74543731 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 1.614521 Aug 09 14:36:17.715797 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 764/1537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:16 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:17.722721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf3a452f-4ff2-4ab3-b06d-912fa5b96945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:17.723743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf3a452f-4ff2-4ab3-b06d-912fa5b96945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 3f0246e9-8417-4083-8430-ceda68df0c44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:17.734507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf3a452f-4ff2-4ab3-b06d-912fa5b96945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:17.735998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf3a452f-4ff2-4ab3-b06d-912fa5b96945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:17.737557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf3a452f-4ff2-4ab3-b06d-912fa5b96945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:17.740875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf3a452f-4ff2-4ab3-b06d-912fa5b96945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:17.742984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf3a452f-4ff2-4ab3-b06d-912fa5b96945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:17.743643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf3a452f-4ff2-4ab3-b06d-912fa5b96945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:17.782287 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-bf3a452f-4ff2-4ab3-b06d-912fa5b96945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] HTTP exception thrown: Instance 3f0246e9-8417-4083-8430-ceda68df0c44 could not be found. Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf3a452f-4ff2-4ab3-b06d-912fa5b96945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Request method failure captured: Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44 HTTP/1.1 Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nAxd9eijW7X2rhOnHb4abugVXlQo199zVPOYR0vHABm_qKntSOkPPdw-VVY24AM5btmhqYeipUr5RjEYqu5zrO_lbVw7jUtDNDItvIwQLV5L8fl2A08iRmDBWaFdl8nTidxhJ88XTQb2v6LwvvWrJ1KlYEj00AMV3DPEo-4IzdmtKY Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9471973b988a4c31be31dde4cef1489e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d68dcb9c00cf4ffebcc05a7d44793468 Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 3f0246e9-8417-4083-8430-ceda68df0c44 could not be found. Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3f0246e9-8417-4083-8430-ceda68df0c44'} Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f0246e9-8417-4083-8430-ceda68df0c44 could not be found. Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f0246e9-8417-4083-8430-ceda68df0c44 could not be found. Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:17.787784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:17.792122 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:17.792122 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:17.792122 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:17.792122 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:17.792122 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:17.792122 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f0246e9-8417-4083-8430-ceda68df0c44 could not be found. Aug 09 14:36:17.792122 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:17.792122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf3a452f-4ff2-4ab3-b06d-912fa5b96945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Returning 404 to user: Instance 3f0246e9-8417-4083-8430-ceda68df0c44 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:17.792122 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf3a452f-4ff2-4ab3-b06d-912fa5b96945 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44" status: 404 len: 111 microversion: 2.1 time: 0.071570 Aug 09 14:36:17.792122 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 765/1538] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:17 2022] GET /compute/v2.1/servers/3f0246e9-8417-4083-8430-ceda68df0c44 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:17.806615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0c704bdd-e780-4fc1-9451-d601dc4d0577 req-90616f4c-2adc-41af-8ea7-e4ff28c67284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b5daeb-de33-403a-9779-0584f4649656", "name": "network-vif-deleted", "tag": "07f06e9a-cd25-4e1e-9de3-2b5bdfc9c324"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:17.841627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0c704bdd-e780-4fc1-9451-d601dc4d0577 req-90616f4c-2adc-41af-8ea7-e4ff28c67284 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:17.842245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0c704bdd-e780-4fc1-9451-d601dc4d0577 req-90616f4c-2adc-41af-8ea7-e4ff28c67284 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:17.842774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0c704bdd-e780-4fc1-9451-d601dc4d0577 req-90616f4c-2adc-41af-8ea7-e4ff28c67284 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:17.854573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3fbb1e87-259e-4658-a1e0-3be9f0b3bebc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:17.871519 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fbb1e87-259e-4658-a1e0-3be9f0b3bebc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.819794 Aug 09 14:36:17.873827 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 774/1539] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:17 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:17.879022 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0c704bdd-e780-4fc1-9451-d601dc4d0577 req-90616f4c-2adc-41af-8ea7-e4ff28c67284 service nova] Creating event network-vif-deleted:07f06e9a-cd25-4e1e-9de3-2b5bdfc9c324 for instance 10b5daeb-de33-403a-9779-0584f4649656 on n-h1-844626-8 Aug 09 14:36:17.886449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c58c5833-dfdc-4be6-80b0-46743db6561a tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:17.887359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c58c5833-dfdc-4be6-80b0-46743db6561a tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:17.891343 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0c704bdd-e780-4fc1-9451-d601dc4d0577 req-90616f4c-2adc-41af-8ea7-e4ff28c67284 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095483 Aug 09 14:36:17.893955 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 766/1540] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:17.905770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c58c5833-dfdc-4be6-80b0-46743db6561a tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:17.908262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c58c5833-dfdc-4be6-80b0-46743db6561a tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:17.908639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4b1df32-bb4e-4ef9-9707-1379242ffff6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:17.909257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4b1df32-bb4e-4ef9-9707-1379242ffff6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:17.915652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c58c5833-dfdc-4be6-80b0-46743db6561a tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:17.916604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c58c5833-dfdc-4be6-80b0-46743db6561a tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:17.917158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c58c5833-dfdc-4be6-80b0-46743db6561a tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:17.917979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c58c5833-dfdc-4be6-80b0-46743db6561a tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:17.923809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:17.926809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4b1df32-bb4e-4ef9-9707-1379242ffff6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:17.929549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4b1df32-bb4e-4ef9-9707-1379242ffff6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:17.930278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4b1df32-bb4e-4ef9-9707-1379242ffff6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:17.931139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4b1df32-bb4e-4ef9-9707-1379242ffff6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:17.931612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4b1df32-bb4e-4ef9-9707-1379242ffff6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:17.932031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4b1df32-bb4e-4ef9-9707-1379242ffff6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:18.008788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4b1df32-bb4e-4ef9-9707-1379242ffff6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:36:18.208056 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4b1df32-bb4e-4ef9-9707-1379242ffff6 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 204 len: 0 microversion: 2.1 time: 0.311992 Aug 09 14:36:18.209375 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 767/1541] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:36:17 2022] DELETE /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:36:18.227098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36c6f2e4-f77c-462c-a0c7-435b5c281887 tempest-FlavorsAccessTestJSON-1262242056 tempest-FlavorsAccessTestJSON-1262242056-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:18.308091 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36c6f2e4-f77c-462c-a0c7-435b5c281887 tempest-FlavorsAccessTestJSON-1262242056 tempest-FlavorsAccessTestJSON-1262242056-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058838 Aug 09 14:36:18.321507 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 768/1542] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:18.338850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62878f8c-ebba-484a-bf46-8ddb84227ca5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:18.346760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-62878f8c-ebba-484a-bf46-8ddb84227ca5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:18.363775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62878f8c-ebba-484a-bf46-8ddb84227ca5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:18.364276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62878f8c-ebba-484a-bf46-8ddb84227ca5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:18.365793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62878f8c-ebba-484a-bf46-8ddb84227ca5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:18.366736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62878f8c-ebba-484a-bf46-8ddb84227ca5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:18.367505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62878f8c-ebba-484a-bf46-8ddb84227ca5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:18.368276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62878f8c-ebba-484a-bf46-8ddb84227ca5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:18.641397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c58c5833-dfdc-4be6-80b0-46743db6561a tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:18.652551 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c58c5833-dfdc-4be6-80b0-46743db6561a tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.777565 Aug 09 14:36:18.656841 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 775/1543] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:17 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:18.668848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b8ed30d6-44ef-4a8d-8888-9e6ca026320d req-f81aea97-c740-4b57-a0a2-97db68db270c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268d8e06-f80e-4f5e-8710-578f4eef5bab", "tag": "4115b00e-91cf-4c28-b173-c0ec442c3cfb"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:18.694433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b8ed30d6-44ef-4a8d-8888-9e6ca026320d req-f81aea97-c740-4b57-a0a2-97db68db270c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:18.694914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b8ed30d6-44ef-4a8d-8888-9e6ca026320d req-f81aea97-c740-4b57-a0a2-97db68db270c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:18.695367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b8ed30d6-44ef-4a8d-8888-9e6ca026320d req-f81aea97-c740-4b57-a0a2-97db68db270c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:18.718033 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b8ed30d6-44ef-4a8d-8888-9e6ca026320d req-f81aea97-c740-4b57-a0a2-97db68db270c service nova] Creating event network-changed:4115b00e-91cf-4c28-b173-c0ec442c3cfb for instance 268d8e06-f80e-4f5e-8710-578f4eef5bab on n-h2-844626-8 Aug 09 14:36:18.742135 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b8ed30d6-44ef-4a8d-8888-9e6ca026320d req-f81aea97-c740-4b57-a0a2-97db68db270c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083041 Aug 09 14:36:18.742777 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 776/1544] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:18.758478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c3694c1-e054-4ee1-82a5-5da893dcf55e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:18.760104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2c3694c1-e054-4ee1-82a5-5da893dcf55e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 10b5daeb-de33-403a-9779-0584f4649656] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:18.776517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c3694c1-e054-4ee1-82a5-5da893dcf55e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:18.779153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c3694c1-e054-4ee1-82a5-5da893dcf55e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:18.781591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c3694c1-e054-4ee1-82a5-5da893dcf55e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:18.784534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c3694c1-e054-4ee1-82a5-5da893dcf55e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:18.785302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c3694c1-e054-4ee1-82a5-5da893dcf55e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:18.785900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c3694c1-e054-4ee1-82a5-5da893dcf55e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:18.852947 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-2c3694c1-e054-4ee1-82a5-5da893dcf55e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] HTTP exception thrown: Instance 10b5daeb-de33-403a-9779-0584f4649656 could not be found. Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c3694c1-e054-4ee1-82a5-5da893dcf55e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Request method failure captured: Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 HTTP/1.1 Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nAxd9eijW7X2rhOnHb4abugVXlQo199zVPOYR0vHABm_qKntSOkPPdw-VVY24AM5btmhqYeipUr5RjEYqu5zrO_lbVw7jUtDNDItvIwQLV5L8fl2A08iRmDBWaFdl8nTidxhJ88XTQb2v6LwvvWrJ1KlYEj00AMV3DPEo-4IzdmtKY Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9471973b988a4c31be31dde4cef1489e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d68dcb9c00cf4ffebcc05a7d44793468 Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 10b5daeb-de33-403a-9779-0584f4649656 could not be found. Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '10b5daeb-de33-403a-9779-0584f4649656'} Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b5daeb-de33-403a-9779-0584f4649656 could not be found. Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b5daeb-de33-403a-9779-0584f4649656 could not be found. Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:18.859724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:18.864418 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:18.864418 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:18.864418 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:18.864418 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:18.864418 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:18.864418 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b5daeb-de33-403a-9779-0584f4649656 could not be found. Aug 09 14:36:18.864418 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:18.868339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c3694c1-e054-4ee1-82a5-5da893dcf55e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Returning 404 to user: Instance 10b5daeb-de33-403a-9779-0584f4649656 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:18.872379 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2c3694c1-e054-4ee1-82a5-5da893dcf55e tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656" status: 404 len: 111 microversion: 2.1 time: 0.121955 Aug 09 14:36:18.875290 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 777/1545] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:18 2022] GET /compute/v2.1/servers/10b5daeb-de33-403a-9779-0584f4649656 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:18.893288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e66f15ec-aa7b-4cc6-89cd-4827d7fa023c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:18.894797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e66f15ec-aa7b-4cc6-89cd-4827d7fa023c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:18.900842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-62878f8c-ebba-484a-bf46-8ddb84227ca5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:18.903313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e66f15ec-aa7b-4cc6-89cd-4827d7fa023c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:18.904078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e66f15ec-aa7b-4cc6-89cd-4827d7fa023c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:18.904736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e66f15ec-aa7b-4cc6-89cd-4827d7fa023c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:18.905931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e66f15ec-aa7b-4cc6-89cd-4827d7fa023c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:18.906614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e66f15ec-aa7b-4cc6-89cd-4827d7fa023c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:18.908006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e66f15ec-aa7b-4cc6-89cd-4827d7fa023c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:18.912505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-62878f8c-ebba-484a-bf46-8ddb84227ca5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:18.914378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-62878f8c-ebba-484a-bf46-8ddb84227ca5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:18.920340 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-62878f8c-ebba-484a-bf46-8ddb84227ca5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1292 microversion: 2.25 time: 0.591602 Aug 09 14:36:18.921735 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 769/1546] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:18 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1292 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:18.928969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc109ba0-72a1-454b-ba5f-78eeaeebbcb7 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:18.941320 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:18.941320 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:18.988426 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc109ba0-72a1-454b-ba5f-78eeaeebbcb7 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/943214621" status: 202 len: 0 microversion: 2.1 time: 0.065324 Aug 09 14:36:18.995518 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 770/1547] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:36:18 2022] DELETE /compute/v2.1/flavors/943214621 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:36:19.001399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eda72b38-77b8-4d4d-bd0e-45fefb20bcb1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:19.016945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eda72b38-77b8-4d4d-bd0e-45fefb20bcb1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:19.044702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eda72b38-77b8-4d4d-bd0e-45fefb20bcb1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:19.063517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eda72b38-77b8-4d4d-bd0e-45fefb20bcb1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:19.064113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eda72b38-77b8-4d4d-bd0e-45fefb20bcb1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:19.064953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eda72b38-77b8-4d4d-bd0e-45fefb20bcb1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:19.065434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eda72b38-77b8-4d4d-bd0e-45fefb20bcb1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:19.065854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eda72b38-77b8-4d4d-bd0e-45fefb20bcb1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:19.487874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e66f15ec-aa7b-4cc6-89cd-4827d7fa023c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:19.499616 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e66f15ec-aa7b-4cc6-89cd-4827d7fa023c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1683 microversion: 2.1 time: 0.622310 Aug 09 14:36:19.500261 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 778/1548] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:18 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1683 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:19.526033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b578baf9-1628-4928-abb4-54c57077a6c2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:19.601205 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b578baf9-1628-4928-abb4-54c57077a6c2 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/c1f6b3ac-ca89-409d-a9f4-2ebde07115c6" status: 204 len: 0 microversion: 2.1 time: 0.099793 Aug 09 14:36:19.601819 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 779/1549] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 14:36:19 2022] DELETE /compute/v2.1/os-server-groups/c1f6b3ac-ca89-409d-a9f4-2ebde07115c6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:36:19.611360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-75ce9066-bfee-489a-a301-7b613f2f1e45 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:19.612358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-75ce9066-bfee-489a-a301-7b613f2f1e45 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:19.627061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eda72b38-77b8-4d4d-bd0e-45fefb20bcb1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:19.638114 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eda72b38-77b8-4d4d-bd0e-45fefb20bcb1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.640738 Aug 09 14:36:19.643755 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 771/1550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:18 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:19.649736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a7f6a741-d3f8-44c6-bad2-612ed24fe732 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:19.654200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75ce9066-bfee-489a-a301-7b613f2f1e45 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:19.655638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75ce9066-bfee-489a-a301-7b613f2f1e45 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:19.656487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75ce9066-bfee-489a-a301-7b613f2f1e45 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:19.657573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75ce9066-bfee-489a-a301-7b613f2f1e45 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:19.658803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75ce9066-bfee-489a-a301-7b613f2f1e45 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:19.660493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75ce9066-bfee-489a-a301-7b613f2f1e45 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:19.722928 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a7f6a741-d3f8-44c6-bad2-612ed24fe732 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.077806 Aug 09 14:36:19.726569 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 772/1551] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:19.732390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33c81727-f50e-462c-a2b9-42cb039ede67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:19.732888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-33c81727-f50e-462c-a2b9-42cb039ede67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:19.753922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33c81727-f50e-462c-a2b9-42cb039ede67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:19.754416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33c81727-f50e-462c-a2b9-42cb039ede67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:19.754853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33c81727-f50e-462c-a2b9-42cb039ede67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:19.760925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33c81727-f50e-462c-a2b9-42cb039ede67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:19.761434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33c81727-f50e-462c-a2b9-42cb039ede67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:19.761883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33c81727-f50e-462c-a2b9-42cb039ede67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:19.826699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-33c81727-f50e-462c-a2b9-42cb039ede67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:36:19.874857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:19.926779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:20.024718 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-33c81727-f50e-462c-a2b9-42cb039ede67 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 204 len: 0 microversion: 2.1 time: 0.296378 Aug 09 14:36:20.026195 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 773/1552] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:36:19 2022] DELETE /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:36:20.034947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b1ba1975-b2ed-423e-bb95-cb447976083d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:20.046600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b1ba1975-b2ed-423e-bb95-cb447976083d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:20.054659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ba1975-b2ed-423e-bb95-cb447976083d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:20.055200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ba1975-b2ed-423e-bb95-cb447976083d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:20.060756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ba1975-b2ed-423e-bb95-cb447976083d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:20.061600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ba1975-b2ed-423e-bb95-cb447976083d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:20.062312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ba1975-b2ed-423e-bb95-cb447976083d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:20.062898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ba1975-b2ed-423e-bb95-cb447976083d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:20.375691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-75ce9066-bfee-489a-a301-7b613f2f1e45 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:20.396157 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-75ce9066-bfee-489a-a301-7b613f2f1e45 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.789586 Aug 09 14:36:20.397696 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 780/1553] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:19 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:20.405703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cb82b92e-dbe2-4497-9f06-5a27abdd3731 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-592171449", "id": 1280090688, "os-flavor-access:is_public": "False"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:20.415895 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:20.415895 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:36:20.451787 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cb82b92e-dbe2-4497-9f06-5a27abdd3731 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.051403 Aug 09 14:36:20.456682 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 781/1554] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:36:20 2022] POST /compute/v2.1/flavors => generated 430 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:20.537210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b1ba1975-b2ed-423e-bb95-cb447976083d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:20.555743 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b1ba1975-b2ed-423e-bb95-cb447976083d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.527948 Aug 09 14:36:20.571571 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 774/1555] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:20 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:20.580750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-05bb425b-b968-4911-88e8-d3799cb9cc18 req-d9dc8600-615c-4410-bd09-ff007e25fe5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0246e9-8417-4083-8430-ceda68df0c44", "name": "network-vif-deleted", "tag": "ec732823-c179-4a62-aa4b-30b642a5fd58"}, {"name": "network-changed", "server_uuid": "5c0c3435-cbf1-447d-ba66-fbdf16ccc900", "tag": "355f3c7f-c299-41a4-a805-e747d83a3716"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:20.605463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-05bb425b-b968-4911-88e8-d3799cb9cc18 req-d9dc8600-615c-4410-bd09-ff007e25fe5f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:20.605981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-05bb425b-b968-4911-88e8-d3799cb9cc18 req-d9dc8600-615c-4410-bd09-ff007e25fe5f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:20.606404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-05bb425b-b968-4911-88e8-d3799cb9cc18 req-d9dc8600-615c-4410-bd09-ff007e25fe5f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:20.636756 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-05bb425b-b968-4911-88e8-d3799cb9cc18 req-d9dc8600-615c-4410-bd09-ff007e25fe5f service nova] Creating event network-vif-deleted:ec732823-c179-4a62-aa4b-30b642a5fd58 for instance 3f0246e9-8417-4083-8430-ceda68df0c44 on n-h1-844626-8 Aug 09 14:36:20.643353 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-05bb425b-b968-4911-88e8-d3799cb9cc18 req-d9dc8600-615c-4410-bd09-ff007e25fe5f service nova] Creating event network-changed:355f3c7f-c299-41a4-a805-e747d83a3716 for instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 on n-h2-844626-8 Aug 09 14:36:20.668335 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-05bb425b-b968-4911-88e8-d3799cb9cc18 req-d9dc8600-615c-4410-bd09-ff007e25fe5f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.095344 Aug 09 14:36:20.669658 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 775/1556] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:20.675897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-155d5f72-b03c-4255-b663-3bf0560b2a73 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:20.677024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-155d5f72-b03c-4255-b663-3bf0560b2a73 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:20.686772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-155d5f72-b03c-4255-b663-3bf0560b2a73 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:20.687727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-155d5f72-b03c-4255-b663-3bf0560b2a73 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:20.688413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-155d5f72-b03c-4255-b663-3bf0560b2a73 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:20.689403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-155d5f72-b03c-4255-b663-3bf0560b2a73 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:20.690101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-155d5f72-b03c-4255-b663-3bf0560b2a73 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:20.690744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-155d5f72-b03c-4255-b663-3bf0560b2a73 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:20.740747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8d51329-4329-4681-9190-b19859c5784c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:20.741842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8d51329-4329-4681-9190-b19859c5784c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:20.752071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8d51329-4329-4681-9190-b19859c5784c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:20.752686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8d51329-4329-4681-9190-b19859c5784c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:20.753140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8d51329-4329-4681-9190-b19859c5784c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:20.754118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8d51329-4329-4681-9190-b19859c5784c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:20.754751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8d51329-4329-4681-9190-b19859c5784c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:20.755211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8d51329-4329-4681-9190-b19859c5784c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:21.583068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:21.730678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:21.807311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-155d5f72-b03c-4255-b663-3bf0560b2a73 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:21.818234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8d51329-4329-4681-9190-b19859c5784c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:21.823872 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-155d5f72-b03c-4255-b663-3bf0560b2a73 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1471 microversion: 2.1 time: 1.152463 Aug 09 14:36:21.837614 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 776/1557] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:20 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1471 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:21.837614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-02a8ddbc-7a38-4623-b4bb-c56f840d4a2c tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:21.837614 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:21.837614 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:21.862353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8d51329-4329-4681-9190-b19859c5784c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:21.863736 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-02a8ddbc-7a38-4623-b4bb-c56f840d4a2c tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1280090688/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.028009 Aug 09 14:36:21.864414 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 777/1558] 10.222.0.50 () {58 vars in 1209 bytes} [Tue Aug 9 14:36:21 2022] GET /compute/v2.1/flavors/1280090688/os-flavor-access => generated 21 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:21.869924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a4480342-eed2-4455-8300-d6d14f9d4856 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:21.870058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a4480342-eed2-4455-8300-d6d14f9d4856 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:21.877934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8d51329-4329-4681-9190-b19859c5784c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:21.883800 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e8d51329-4329-4681-9190-b19859c5784c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1292 microversion: 2.25 time: 1.423175 Aug 09 14:36:21.885508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4480342-eed2-4455-8300-d6d14f9d4856 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:21.885995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4480342-eed2-4455-8300-d6d14f9d4856 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:21.886611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4480342-eed2-4455-8300-d6d14f9d4856 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:21.887600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4480342-eed2-4455-8300-d6d14f9d4856 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:21.888212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4480342-eed2-4455-8300-d6d14f9d4856 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:21.888789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4480342-eed2-4455-8300-d6d14f9d4856 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:21.890489 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 782/1559] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:20 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1292 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:21.901935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fbcfa299-c52d-4322-8b06-3745498b6bda tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:21.902548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fbcfa299-c52d-4322-8b06-3745498b6bda tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:21.911849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbcfa299-c52d-4322-8b06-3745498b6bda tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:21.912569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbcfa299-c52d-4322-8b06-3745498b6bda tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:21.913426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbcfa299-c52d-4322-8b06-3745498b6bda tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:21.914709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbcfa299-c52d-4322-8b06-3745498b6bda tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:21.915360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbcfa299-c52d-4322-8b06-3745498b6bda tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:21.915935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbcfa299-c52d-4322-8b06-3745498b6bda tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:22.188970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a4480342-eed2-4455-8300-d6d14f9d4856 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:22.224436 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a4480342-eed2-4455-8300-d6d14f9d4856 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1615 microversion: 2.1 time: 0.358848 Aug 09 14:36:22.225044 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 778/1560] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:21 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1615 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:22.241384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-feb7598f-2214-4089-b762-c5746c7085a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:22.242702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-feb7598f-2214-4089-b762-c5746c7085a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:22.259985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-feb7598f-2214-4089-b762-c5746c7085a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:22.264260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-feb7598f-2214-4089-b762-c5746c7085a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:22.264998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-feb7598f-2214-4089-b762-c5746c7085a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:22.265929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-feb7598f-2214-4089-b762-c5746c7085a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:22.271966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-feb7598f-2214-4089-b762-c5746c7085a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:22.272459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-feb7598f-2214-4089-b762-c5746c7085a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:22.679773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fbcfa299-c52d-4322-8b06-3745498b6bda tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:22.723440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-feb7598f-2214-4089-b762-c5746c7085a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:22.737302 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fbcfa299-c52d-4322-8b06-3745498b6bda tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.843306 Aug 09 14:36:22.755124 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 783/1561] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:21 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:22.755481 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-feb7598f-2214-4089-b762-c5746c7085a2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.512323 Aug 09 14:36:22.755481 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 779/1562] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:22 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:22.764448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c41b8c2-4929-4ea4-88c9-5b1354965dc1 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:22.764714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-749212c7-5415-40bf-8b52-c8cc4179bc1c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:22.765390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-749212c7-5415-40bf-8b52-c8cc4179bc1c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:22.766471 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:22.766471 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:22.789120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-749212c7-5415-40bf-8b52-c8cc4179bc1c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:22.789584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-749212c7-5415-40bf-8b52-c8cc4179bc1c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:22.790002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-749212c7-5415-40bf-8b52-c8cc4179bc1c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:22.790731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-749212c7-5415-40bf-8b52-c8cc4179bc1c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:22.791245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-749212c7-5415-40bf-8b52-c8cc4179bc1c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:22.791675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-749212c7-5415-40bf-8b52-c8cc4179bc1c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:22.803388 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2c41b8c2-4929-4ea4-88c9-5b1354965dc1 tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1280090688" status: 202 len: 0 microversion: 2.1 time: 0.059001 Aug 09 14:36:22.811470 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 780/1563] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:36:22 2022] DELETE /compute/v2.1/flavors/1280090688 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:36:22.818607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc90b583-5b85-40ad-8ae7-dec93c1e97da tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:22.891453 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc90b583-5b85-40ad-8ae7-dec93c1e97da tempest-FlavorsAccessTestJSON-1962206756 tempest-FlavorsAccessTestJSON-1962206756-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.078084 Aug 09 14:36:22.892558 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 781/1564] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:22.901937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1e4d0072-a492-4403-904c-103cfc685955 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:22.903494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1e4d0072-a492-4403-904c-103cfc685955 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:22.937141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e4d0072-a492-4403-904c-103cfc685955 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:22.937647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e4d0072-a492-4403-904c-103cfc685955 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:22.938230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e4d0072-a492-4403-904c-103cfc685955 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:22.938802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e4d0072-a492-4403-904c-103cfc685955 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:22.939337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e4d0072-a492-4403-904c-103cfc685955 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:22.939686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e4d0072-a492-4403-904c-103cfc685955 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:23.370707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-749212c7-5415-40bf-8b52-c8cc4179bc1c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:23.383746 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-749212c7-5415-40bf-8b52-c8cc4179bc1c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.640097 Aug 09 14:36:23.400172 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 784/1565] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:22 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:23.410953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0806911f-81d1-4a1d-8daa-89c45861bc04 req-260721c8-31cc-40ab-a4a2-69180b342951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c0c3435-cbf1-447d-ba66-fbdf16ccc900", "tag": "24797387-c810-4f1a-8344-fb81d45d7aa5"}, {"server_uuid": "9bd1379b-b2dc-4866-9a3f-d4d03c495a25", "name": "network-vif-deleted", "tag": "bb7074b5-7f36-447d-8b2a-ef303f0bc953"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:23.440949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0806911f-81d1-4a1d-8daa-89c45861bc04 req-260721c8-31cc-40ab-a4a2-69180b342951 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:23.441432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0806911f-81d1-4a1d-8daa-89c45861bc04 req-260721c8-31cc-40ab-a4a2-69180b342951 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:23.441863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0806911f-81d1-4a1d-8daa-89c45861bc04 req-260721c8-31cc-40ab-a4a2-69180b342951 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:23.481602 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0806911f-81d1-4a1d-8daa-89c45861bc04 req-260721c8-31cc-40ab-a4a2-69180b342951 service nova] Creating event network-changed:24797387-c810-4f1a-8344-fb81d45d7aa5 for instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 on n-h2-844626-8 Aug 09 14:36:23.482226 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0806911f-81d1-4a1d-8daa-89c45861bc04 req-260721c8-31cc-40ab-a4a2-69180b342951 service nova] Creating event network-vif-deleted:bb7074b5-7f36-447d-8b2a-ef303f0bc953 for instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 on n-h1-844626-8 Aug 09 14:36:23.504799 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0806911f-81d1-4a1d-8daa-89c45861bc04 req-260721c8-31cc-40ab-a4a2-69180b342951 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.102799 Aug 09 14:36:23.506284 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 785/1566] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:23.516680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-455d6904-3dd0-42ac-b060-6c991db7aeb2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:23.517961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-455d6904-3dd0-42ac-b060-6c991db7aeb2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:23.530751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-455d6904-3dd0-42ac-b060-6c991db7aeb2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:23.531701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-455d6904-3dd0-42ac-b060-6c991db7aeb2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:23.532575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-455d6904-3dd0-42ac-b060-6c991db7aeb2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:23.536296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-455d6904-3dd0-42ac-b060-6c991db7aeb2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:23.537306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-455d6904-3dd0-42ac-b060-6c991db7aeb2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:23.537968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-455d6904-3dd0-42ac-b060-6c991db7aeb2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:23.605234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e4d0072-a492-4403-904c-103cfc685955 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd68dcb9c00cf4ffebcc05a7d44793468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9471973b988a4c31be31dde4cef1489e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:23.613208 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1e4d0072-a492-4403-904c-103cfc685955 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 200 len: 1471 microversion: 2.1 time: 0.719352 Aug 09 14:36:23.623126 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 782/1567] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:22 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 1471 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:23.630436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:23.631051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:23.642947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:23.647686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:23.648442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:23.650006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:23.650640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:23.651262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:23.727382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:23.728138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:23.728762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:23.729373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lazy-loading 'fault' on Instance uuid 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:36:23.878481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:23.885503 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7f8d0cd1-af7b-4f67-8995-9a02f7a3d170 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 200 len: 1332 microversion: 2.1 time: 0.260940 Aug 09 14:36:23.886098 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 783/1568] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:23 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 1332 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:23.909094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-976928dc-8111-4eac-a5eb-39a8a0407259 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:23.913139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-976928dc-8111-4eac-a5eb-39a8a0407259 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:23.935010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-976928dc-8111-4eac-a5eb-39a8a0407259 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:23.935740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-976928dc-8111-4eac-a5eb-39a8a0407259 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:23.936334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-976928dc-8111-4eac-a5eb-39a8a0407259 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:23.937343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-976928dc-8111-4eac-a5eb-39a8a0407259 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:23.937944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-976928dc-8111-4eac-a5eb-39a8a0407259 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:23.938513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-976928dc-8111-4eac-a5eb-39a8a0407259 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:23.993867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:24.143407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-455d6904-3dd0-42ac-b060-6c991db7aeb2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:24.157781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-455d6904-3dd0-42ac-b060-6c991db7aeb2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:24.167031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-455d6904-3dd0-42ac-b060-6c991db7aeb2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:24.168671 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-455d6904-3dd0-42ac-b060-6c991db7aeb2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1292 microversion: 2.25 time: 0.660938 Aug 09 14:36:24.169489 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 786/1569] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:23 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1292 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:24.174765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eed9155b-e2ff-46d7-a703-e33f902e1f85 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:24.177893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eed9155b-e2ff-46d7-a703-e33f902e1f85 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:24.200287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eed9155b-e2ff-46d7-a703-e33f902e1f85 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:24.200792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eed9155b-e2ff-46d7-a703-e33f902e1f85 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:24.205492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eed9155b-e2ff-46d7-a703-e33f902e1f85 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:24.206379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eed9155b-e2ff-46d7-a703-e33f902e1f85 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:24.206862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eed9155b-e2ff-46d7-a703-e33f902e1f85 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:24.207333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eed9155b-e2ff-46d7-a703-e33f902e1f85 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:24.384280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-976928dc-8111-4eac-a5eb-39a8a0407259 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:24.403267 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-976928dc-8111-4eac-a5eb-39a8a0407259 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.497987 Aug 09 14:36:24.404116 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 784/1570] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:23 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:24.409048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-c92efb4d-5a6b-469f-97bd-a332305de67b req-0cc0aa12-1504-43c7-a0cd-f8f3e2e2fe3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c29a36e-08bc-48f8-ae8c-029a5dbf060f", "name": "network-vif-deleted", "tag": "2137f1f1-d9de-48cb-9103-f3fd05beec4f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:24.434069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c92efb4d-5a6b-469f-97bd-a332305de67b req-0cc0aa12-1504-43c7-a0cd-f8f3e2e2fe3d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:24.434687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c92efb4d-5a6b-469f-97bd-a332305de67b req-0cc0aa12-1504-43c7-a0cd-f8f3e2e2fe3d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:24.435243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c92efb4d-5a6b-469f-97bd-a332305de67b req-0cc0aa12-1504-43c7-a0cd-f8f3e2e2fe3d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:24.455707 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-c92efb4d-5a6b-469f-97bd-a332305de67b req-0cc0aa12-1504-43c7-a0cd-f8f3e2e2fe3d service nova] Creating event network-vif-deleted:2137f1f1-d9de-48cb-9103-f3fd05beec4f for instance 5c29a36e-08bc-48f8-ae8c-029a5dbf060f on n-h1-844626-8 Aug 09 14:36:24.476916 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-c92efb4d-5a6b-469f-97bd-a332305de67b req-0cc0aa12-1504-43c7-a0cd-f8f3e2e2fe3d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071317 Aug 09 14:36:24.477539 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 785/1571] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:24.493213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0cff560-a368-4017-88c8-94c86ad26c42 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:24.494210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b0cff560-a368-4017-88c8-94c86ad26c42 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:24.508601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0cff560-a368-4017-88c8-94c86ad26c42 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:24.509159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0cff560-a368-4017-88c8-94c86ad26c42 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:24.509609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0cff560-a368-4017-88c8-94c86ad26c42 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:24.510368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0cff560-a368-4017-88c8-94c86ad26c42 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:24.511499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0cff560-a368-4017-88c8-94c86ad26c42 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:24.512166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0cff560-a368-4017-88c8-94c86ad26c42 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:24.848328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eed9155b-e2ff-46d7-a703-e33f902e1f85 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:24.856097 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eed9155b-e2ff-46d7-a703-e33f902e1f85 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.685319 Aug 09 14:36:24.856704 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 787/1572] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:24 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:24.874157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-98cab21f-70e2-4fa0-95cb-f402b049c579 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:24.875334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-98cab21f-70e2-4fa0-95cb-f402b049c579 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] [instance: 5c29a36e-08bc-48f8-ae8c-029a5dbf060f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:24.882831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98cab21f-70e2-4fa0-95cb-f402b049c579 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:24.883687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98cab21f-70e2-4fa0-95cb-f402b049c579 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:24.884350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98cab21f-70e2-4fa0-95cb-f402b049c579 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:24.885277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98cab21f-70e2-4fa0-95cb-f402b049c579 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:24.886275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98cab21f-70e2-4fa0-95cb-f402b049c579 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:24.886948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98cab21f-70e2-4fa0-95cb-f402b049c579 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:24.912066 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-98cab21f-70e2-4fa0-95cb-f402b049c579 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] HTTP exception thrown: Instance 5c29a36e-08bc-48f8-ae8c-029a5dbf060f could not be found. Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-98cab21f-70e2-4fa0-95cb-f402b049c579 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Request method failure captured: Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f HTTP/1.1 Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nAxd9eijW7X2rhOnHb4abugVXlQo199zVPOYR0vHABm_qKntSOkPPdw-VVY24AM5btmhqYeipUr5RjEYqu5zrO_lbVw7jUtDNDItvIwQLV5L8fl2A08iRmDBWaFdl8nTidxhJ88XTQb2v6LwvvWrJ1KlYEj00AMV3DPEo-4IzdmtKY Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9471973b988a4c31be31dde4cef1489e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9471973b988a4c31be31dde4cef1489e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9471973b988a4c31be31dde4cef1489e Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-79157913 Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d68dcb9c00cf4ffebcc05a7d44793468 Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersOnMultiNodesTest-79157913-project Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 5c29a36e-08bc-48f8-ae8c-029a5dbf060f could not be found. Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '5c29a36e-08bc-48f8-ae8c-029a5dbf060f'} Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c29a36e-08bc-48f8-ae8c-029a5dbf060f could not be found. Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c29a36e-08bc-48f8-ae8c-029a5dbf060f could not be found. Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:24.914194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:24.918961 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:24.918961 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:24.918961 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:24.918961 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:24.918961 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:24.918961 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c29a36e-08bc-48f8-ae8c-029a5dbf060f could not be found. Aug 09 14:36:24.918961 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:24.926483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-98cab21f-70e2-4fa0-95cb-f402b049c579 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] Returning 404 to user: Instance 5c29a36e-08bc-48f8-ae8c-029a5dbf060f could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:24.927704 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-98cab21f-70e2-4fa0-95cb-f402b049c579 tempest-ServersOnMultiNodesTest-79157913 tempest-ServersOnMultiNodesTest-79157913-project] 10.222.0.50 "GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f" status: 404 len: 111 microversion: 2.1 time: 0.065426 Aug 09 14:36:24.932265 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 788/1573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:24 2022] GET /compute/v2.1/servers/5c29a36e-08bc-48f8-ae8c-029a5dbf060f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:24.938735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-78ee5217-6046-4b20-81ee-4b89b7142d6e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:24.940286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-78ee5217-6046-4b20-81ee-4b89b7142d6e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:24.947014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78ee5217-6046-4b20-81ee-4b89b7142d6e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:24.947900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78ee5217-6046-4b20-81ee-4b89b7142d6e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:24.948791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78ee5217-6046-4b20-81ee-4b89b7142d6e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:24.949761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78ee5217-6046-4b20-81ee-4b89b7142d6e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:24.950432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78ee5217-6046-4b20-81ee-4b89b7142d6e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:24.951056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78ee5217-6046-4b20-81ee-4b89b7142d6e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:24.968869 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-78ee5217-6046-4b20-81ee-4b89b7142d6e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-78ee5217-6046-4b20-81ee-4b89b7142d6e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 HTTP/1.1 Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '9bd1379b-b2dc-4866-9a3f-d4d03c495a25'} Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:24.970890 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:24.975034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:24.975034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:24.975034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:24.975034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:24.975034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:24.975034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:36:24.975034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:24.978426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-78ee5217-6046-4b20-81ee-4b89b7142d6e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 404 to user: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:24.980400 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-78ee5217-6046-4b20-81ee-4b89b7142d6e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 404 len: 111 microversion: 2.1 time: 0.046199 Aug 09 14:36:24.981753 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 789/1574] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:24 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:24.993245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb7fe46c-9d12-45bd-8a85-bc5b2506554f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '.version_select at 0x7f41ddbba040>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:25.041511 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb7fe46c-9d12-45bd-8a85-bc5b2506554f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426994126" status: 202 len: 0 microversion: 2.1 time: 0.052223 Aug 09 14:36:25.042209 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 790/1575] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 14:36:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426994126 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:36:25.194053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-75715235-6b05-4392-86db-4ef89698354c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:25.194784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-75715235-6b05-4392-86db-4ef89698354c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:25.205399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75715235-6b05-4392-86db-4ef89698354c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:25.205892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75715235-6b05-4392-86db-4ef89698354c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:25.209636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75715235-6b05-4392-86db-4ef89698354c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:25.214445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75715235-6b05-4392-86db-4ef89698354c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:25.215253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75715235-6b05-4392-86db-4ef89698354c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:25.215932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75715235-6b05-4392-86db-4ef89698354c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:25.522435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b0cff560-a368-4017-88c8-94c86ad26c42 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:25.537607 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b0cff560-a368-4017-88c8-94c86ad26c42 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 1.058679 Aug 09 14:36:25.543681 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 786/1576] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:24 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:25.565107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9fb4397a-ffc6-4931-918a-ef256159a6ec tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:25.568942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9fb4397a-ffc6-4931-918a-ef256159a6ec tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:25.584488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9fb4397a-ffc6-4931-918a-ef256159a6ec tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:25.587757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9fb4397a-ffc6-4931-918a-ef256159a6ec tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:25.588967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9fb4397a-ffc6-4931-918a-ef256159a6ec tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:25.591032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9fb4397a-ffc6-4931-918a-ef256159a6ec tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:25.595106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9fb4397a-ffc6-4931-918a-ef256159a6ec tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:25.595830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9fb4397a-ffc6-4931-918a-ef256159a6ec tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:26.425229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-75715235-6b05-4392-86db-4ef89698354c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:26.436988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-75715235-6b05-4392-86db-4ef89698354c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:26.441463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-75715235-6b05-4392-86db-4ef89698354c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:26.453478 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-75715235-6b05-4392-86db-4ef89698354c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1280 microversion: 2.25 time: 1.263326 Aug 09 14:36:26.469932 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 791/1577] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:25 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1280 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:26.484269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-4c4eda1a-fc74-4639-9e69-e259e60a5d18 req-4990fd7a-fac4-4a0d-bf3c-822243558f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c0c3435-cbf1-447d-ba66-fbdf16ccc900", "tag": "4ed9abf1-1e6f-4ead-ae47-ad41d975b753"}, {"server_uuid": "aaf11da1-82f0-41e7-bdef-9bbea7629ef0", "name": "network-vif-unplugged", "status": "completed", "tag": "510915b8-0436-4bd0-8a98-8b38c250325d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:26.498150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4c4eda1a-fc74-4639-9e69-e259e60a5d18 req-4990fd7a-fac4-4a0d-bf3c-822243558f87 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:26.498933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4c4eda1a-fc74-4639-9e69-e259e60a5d18 req-4990fd7a-fac4-4a0d-bf3c-822243558f87 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:26.499662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4c4eda1a-fc74-4639-9e69-e259e60a5d18 req-4990fd7a-fac4-4a0d-bf3c-822243558f87 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:26.514654 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4c4eda1a-fc74-4639-9e69-e259e60a5d18 req-4990fd7a-fac4-4a0d-bf3c-822243558f87 service nova] Creating event network-changed:4ed9abf1-1e6f-4ead-ae47-ad41d975b753 for instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 on n-h2-844626-8 Aug 09 14:36:26.515634 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4c4eda1a-fc74-4639-9e69-e259e60a5d18 req-4990fd7a-fac4-4a0d-bf3c-822243558f87 service nova] Creating event network-vif-unplugged:510915b8-0436-4bd0-8a98-8b38c250325d for instance aaf11da1-82f0-41e7-bdef-9bbea7629ef0 on n-h1-844626-8 Aug 09 14:36:26.526148 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-4c4eda1a-fc74-4639-9e69-e259e60a5d18 req-4990fd7a-fac4-4a0d-bf3c-822243558f87 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.054268 Aug 09 14:36:26.527363 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 792/1578] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:26.532973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c243084c-606d-42f5-8910-4cf20264250d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:26.534652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c243084c-606d-42f5-8910-4cf20264250d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:26.542215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c243084c-606d-42f5-8910-4cf20264250d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:26.542900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c243084c-606d-42f5-8910-4cf20264250d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:26.544341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c243084c-606d-42f5-8910-4cf20264250d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:26.545930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c243084c-606d-42f5-8910-4cf20264250d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:26.547059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c243084c-606d-42f5-8910-4cf20264250d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:26.547781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c243084c-606d-42f5-8910-4cf20264250d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:26.741888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9fb4397a-ffc6-4931-918a-ef256159a6ec tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:26.752518 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9fb4397a-ffc6-4931-918a-ef256159a6ec tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 1.206129 Aug 09 14:36:26.769474 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 787/1579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:25 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:26.776351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba76cd56-20af-4b7f-a907-dc02ff122160 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:26.776787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba76cd56-20af-4b7f-a907-dc02ff122160 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:26.791305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba76cd56-20af-4b7f-a907-dc02ff122160 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:26.792044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba76cd56-20af-4b7f-a907-dc02ff122160 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:26.792658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba76cd56-20af-4b7f-a907-dc02ff122160 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:26.793546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba76cd56-20af-4b7f-a907-dc02ff122160 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:26.794150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba76cd56-20af-4b7f-a907-dc02ff122160 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:26.794726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba76cd56-20af-4b7f-a907-dc02ff122160 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:27.198950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c243084c-606d-42f5-8910-4cf20264250d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:27.215614 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c243084c-606d-42f5-8910-4cf20264250d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.686751 Aug 09 14:36:27.216213 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 793/1580] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:26 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:27.411924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba76cd56-20af-4b7f-a907-dc02ff122160 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:27.425955 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba76cd56-20af-4b7f-a907-dc02ff122160 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.654666 Aug 09 14:36:27.428008 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 788/1581] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:26 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:27.494145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42182202-aee9-490f-a166-6dea3988ca1b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:27.496932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42182202-aee9-490f-a166-6dea3988ca1b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:27.540243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42182202-aee9-490f-a166-6dea3988ca1b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:27.543551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42182202-aee9-490f-a166-6dea3988ca1b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:27.551515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42182202-aee9-490f-a166-6dea3988ca1b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:27.555409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42182202-aee9-490f-a166-6dea3988ca1b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:27.564238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42182202-aee9-490f-a166-6dea3988ca1b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:27.564661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42182202-aee9-490f-a166-6dea3988ca1b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:27.793187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0352388-916e-44ee-a97a-d67ae9ad0473 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:27.796423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0352388-916e-44ee-a97a-d67ae9ad0473 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:27.840443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0352388-916e-44ee-a97a-d67ae9ad0473 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:27.847285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0352388-916e-44ee-a97a-d67ae9ad0473 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:27.850184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0352388-916e-44ee-a97a-d67ae9ad0473 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:27.856423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0352388-916e-44ee-a97a-d67ae9ad0473 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:27.857371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0352388-916e-44ee-a97a-d67ae9ad0473 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:27.858206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0352388-916e-44ee-a97a-d67ae9ad0473 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:27.902648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42182202-aee9-490f-a166-6dea3988ca1b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:27.917775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42182202-aee9-490f-a166-6dea3988ca1b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:27.920530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42182202-aee9-490f-a166-6dea3988ca1b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:27.928690 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42182202-aee9-490f-a166-6dea3988ca1b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1280 microversion: 2.25 time: 0.440145 Aug 09 14:36:27.929616 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 794/1582] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:27 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1280 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:36:28.178069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0352388-916e-44ee-a97a-d67ae9ad0473 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:28.209837 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0352388-916e-44ee-a97a-d67ae9ad0473 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.432373 Aug 09 14:36:28.230627 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 789/1583] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:27 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:28.240729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-251fb900-cb00-4e89-a17a-7f22c7cc5fcd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:28.241550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-251fb900-cb00-4e89-a17a-7f22c7cc5fcd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:28.251566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:28.254238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-251fb900-cb00-4e89-a17a-7f22c7cc5fcd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:28.255566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-251fb900-cb00-4e89-a17a-7f22c7cc5fcd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:28.256682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-251fb900-cb00-4e89-a17a-7f22c7cc5fcd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:28.257581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-251fb900-cb00-4e89-a17a-7f22c7cc5fcd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:28.258192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-251fb900-cb00-4e89-a17a-7f22c7cc5fcd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:28.258911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-251fb900-cb00-4e89-a17a-7f22c7cc5fcd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:28.412712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c6040288-b0e8-4037-bc59-f810915bdd92 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:28.415113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c6040288-b0e8-4037-bc59-f810915bdd92 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:28.429857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6040288-b0e8-4037-bc59-f810915bdd92 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:28.433049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6040288-b0e8-4037-bc59-f810915bdd92 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:28.433568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6040288-b0e8-4037-bc59-f810915bdd92 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:28.435551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6040288-b0e8-4037-bc59-f810915bdd92 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:28.436941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6040288-b0e8-4037-bc59-f810915bdd92 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:28.439055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6040288-b0e8-4037-bc59-f810915bdd92 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:28.622599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-251fb900-cb00-4e89-a17a-7f22c7cc5fcd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:28.642901 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-251fb900-cb00-4e89-a17a-7f22c7cc5fcd tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.406400 Aug 09 14:36:28.646560 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 795/1584] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:28 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:28.658253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-53693fb6-16c0-48c0-bde1-e75607affa72 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:28.658875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53693fb6-16c0-48c0-bde1-e75607affa72 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:28.676538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53693fb6-16c0-48c0-bde1-e75607affa72 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:28.676935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53693fb6-16c0-48c0-bde1-e75607affa72 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:28.677364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53693fb6-16c0-48c0-bde1-e75607affa72 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:28.678158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53693fb6-16c0-48c0-bde1-e75607affa72 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:28.678841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53693fb6-16c0-48c0-bde1-e75607affa72 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:28.679301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53693fb6-16c0-48c0-bde1-e75607affa72 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:28.769812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-c6040288-b0e8-4037-bc59-f810915bdd92 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lazy-loading 'services' on Instance uuid ff8a0577-e7e0-414e-b847-d01ecbd5eb4d {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:36:28.902486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-53693fb6-16c0-48c0-bde1-e75607affa72 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:28.913732 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-53693fb6-16c0-48c0-bde1-e75607affa72 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.265508 Aug 09 14:36:28.914915 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 796/1585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:28 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:28.920966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-521421a8-4140-45d3-88f1-bf024da872cf req-e80013e5-a256-4777-a664-f4bd13aea0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaf11da1-82f0-41e7-bdef-9bbea7629ef0", "tag": "510915b8-0436-4bd0-8a98-8b38c250325d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:28.933629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-521421a8-4140-45d3-88f1-bf024da872cf req-e80013e5-a256-4777-a664-f4bd13aea0b7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:28.934105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-521421a8-4140-45d3-88f1-bf024da872cf req-e80013e5-a256-4777-a664-f4bd13aea0b7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:28.934604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-521421a8-4140-45d3-88f1-bf024da872cf req-e80013e5-a256-4777-a664-f4bd13aea0b7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:28.957416 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-521421a8-4140-45d3-88f1-bf024da872cf req-e80013e5-a256-4777-a664-f4bd13aea0b7 service nova] Creating event network-changed:510915b8-0436-4bd0-8a98-8b38c250325d for instance aaf11da1-82f0-41e7-bdef-9bbea7629ef0 on n-h1-844626-8 Aug 09 14:36:28.963624 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-521421a8-4140-45d3-88f1-bf024da872cf req-e80013e5-a256-4777-a664-f4bd13aea0b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046404 Aug 09 14:36:28.965006 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 797/1586] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:28.972110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d9e19d9f-000f-4f76-b05f-527cb0d59d69 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:28.973046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d9e19d9f-000f-4f76-b05f-527cb0d59d69 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:28.980262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9e19d9f-000f-4f76-b05f-527cb0d59d69 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:28.981060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9e19d9f-000f-4f76-b05f-527cb0d59d69 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:28.981738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9e19d9f-000f-4f76-b05f-527cb0d59d69 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:28.983133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9e19d9f-000f-4f76-b05f-527cb0d59d69 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:28.983856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9e19d9f-000f-4f76-b05f-527cb0d59d69 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:28.984832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9e19d9f-000f-4f76-b05f-527cb0d59d69 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:29.060214 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c6040288-b0e8-4037-bc59-f810915bdd92 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments/ce83608f-0064-4037-b4b8-62ae9888919b" status: 202 len: 0 microversion: 2.1 time: 0.655718 Aug 09 14:36:29.063448 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 790/1587] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 14:36:28 2022] DELETE /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments/ce83608f-0064-4037-b4b8-62ae9888919b => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:36:29.075977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d22b44b7-88fd-42ad-abdc-f43ed5db0d66 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:29.082037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d22b44b7-88fd-42ad-abdc-f43ed5db0d66 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:29.094752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22b44b7-88fd-42ad-abdc-f43ed5db0d66 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:29.095354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22b44b7-88fd-42ad-abdc-f43ed5db0d66 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:29.095690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22b44b7-88fd-42ad-abdc-f43ed5db0d66 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:29.096381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22b44b7-88fd-42ad-abdc-f43ed5db0d66 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:29.096820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22b44b7-88fd-42ad-abdc-f43ed5db0d66 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:29.097226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22b44b7-88fd-42ad-abdc-f43ed5db0d66 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:29.150402 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d22b44b7-88fd-42ad-abdc-f43ed5db0d66 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079093 Aug 09 14:36:29.155861 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 791/1588] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:29 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:29.404218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d9e19d9f-000f-4f76-b05f-527cb0d59d69 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:29.413363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d9e19d9f-000f-4f76-b05f-527cb0d59d69 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:29.415649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d9e19d9f-000f-4f76-b05f-527cb0d59d69 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:29.417107 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d9e19d9f-000f-4f76-b05f-527cb0d59d69 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1280 microversion: 2.25 time: 0.450812 Aug 09 14:36:29.427940 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 798/1589] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:28 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1280 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:29.439831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-532f3c7e-edbe-43c5-aee1-1c5cc11b810d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:29.440720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-532f3c7e-edbe-43c5-aee1-1c5cc11b810d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:29.447974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-532f3c7e-edbe-43c5-aee1-1c5cc11b810d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:29.448724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-532f3c7e-edbe-43c5-aee1-1c5cc11b810d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:29.449366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-532f3c7e-edbe-43c5-aee1-1c5cc11b810d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:29.450883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-532f3c7e-edbe-43c5-aee1-1c5cc11b810d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:29.451802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-532f3c7e-edbe-43c5-aee1-1c5cc11b810d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:29.452528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-532f3c7e-edbe-43c5-aee1-1c5cc11b810d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:29.453110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-344306203", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "0c915d97-e771-4fca-80a2-def8c48b637c"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:29.475442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:29.558050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] validate_networks() for [('0c915d97-e771-4fca-80a2-def8c48b637c', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:36:29.819117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-532f3c7e-edbe-43c5-aee1-1c5cc11b810d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:29.835826 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-532f3c7e-edbe-43c5-aee1-1c5cc11b810d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.398809 Aug 09 14:36:29.836497 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 799/1590] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:29 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:29.843934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-80946434-8f59-45ba-994b-a8577cd38628 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:29.843934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-80946434-8f59-45ba-994b-a8577cd38628 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:29.854244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80946434-8f59-45ba-994b-a8577cd38628 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:29.854877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80946434-8f59-45ba-994b-a8577cd38628 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:29.855353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80946434-8f59-45ba-994b-a8577cd38628 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:29.856610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80946434-8f59-45ba-994b-a8577cd38628 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:29.857192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80946434-8f59-45ba-994b-a8577cd38628 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:29.857622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80946434-8f59-45ba-994b-a8577cd38628 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:30.116349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-80946434-8f59-45ba-994b-a8577cd38628 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:30.125451 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-80946434-8f59-45ba-994b-a8577cd38628 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.287692 Aug 09 14:36:30.126821 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 800/1591] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:29 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:30.438068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79445715-0140-4eb0-86af-5c9e1caf1b37 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-648515376", "ram": 512, "vcpus": 1, "disk": 10, "id": 1454583808, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:30.444154 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:30.444154 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:36:30.461933 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-79445715-0140-4eb0-86af-5c9e1caf1b37 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.333719 Aug 09 14:36:30.463135 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 801/1592] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:36:30 2022] POST /compute/v2.1/flavors => generated 415 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:30.471773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0977fff8-cd6b-4e5d-8bc9-95046b4f74a5 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:30.477333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0977fff8-cd6b-4e5d-8bc9-95046b4f74a5 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:30.484156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0977fff8-cd6b-4e5d-8bc9-95046b4f74a5 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:30.484655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0977fff8-cd6b-4e5d-8bc9-95046b4f74a5 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:30.485091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0977fff8-cd6b-4e5d-8bc9-95046b4f74a5 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:30.485859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0977fff8-cd6b-4e5d-8bc9-95046b4f74a5 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:30.486363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0977fff8-cd6b-4e5d-8bc9-95046b4f74a5 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:30.486668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0977fff8-cd6b-4e5d-8bc9-95046b4f74a5 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:30.624815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:36:30.625996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:36:30.626490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:36:30.626901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:36:30.627342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:36:30.650120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:30.650572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:30.651035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:30.651786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:30.652209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:30.652661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:30.684972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Getting quotas for project 8ce04a888a334631a8431dd8782211f2. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:36:30.690961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:30.693186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Getting quotas for user 894752596caa444c95cadf2b8dd38243 and project 8ce04a888a334631a8431dd8782211f2. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:36:30.719117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:36:30.721951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:36:30.783254 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6b9f7d62-7824-4722-a701-5cadbae8356a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.614912 Aug 09 14:36:30.784524 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 792/1593] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:36:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:36:30.790969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-61e41944-18cf-4b51-b63d-331aba4896c5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:30.791406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0977fff8-cd6b-4e5d-8bc9-95046b4f74a5 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:30.794144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-61e41944-18cf-4b51-b63d-331aba4896c5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:30.803429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61e41944-18cf-4b51-b63d-331aba4896c5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:30.804124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61e41944-18cf-4b51-b63d-331aba4896c5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:30.804913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61e41944-18cf-4b51-b63d-331aba4896c5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:30.806408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61e41944-18cf-4b51-b63d-331aba4896c5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:30.807033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61e41944-18cf-4b51-b63d-331aba4896c5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:30.807637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61e41944-18cf-4b51-b63d-331aba4896c5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:30.826946 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0977fff8-cd6b-4e5d-8bc9-95046b4f74a5 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.360709 Aug 09 14:36:30.832051 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 802/1594] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:30 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:30.851774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-736697a8-d834-4aa6-9cde-2da60ba538e5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:30.852395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-736697a8-d834-4aa6-9cde-2da60ba538e5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:30.866899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-736697a8-d834-4aa6-9cde-2da60ba538e5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:30.867431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-736697a8-d834-4aa6-9cde-2da60ba538e5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:30.867927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-736697a8-d834-4aa6-9cde-2da60ba538e5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:30.868642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-736697a8-d834-4aa6-9cde-2da60ba538e5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:30.869098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-736697a8-d834-4aa6-9cde-2da60ba538e5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:30.869531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-736697a8-d834-4aa6-9cde-2da60ba538e5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:30.896206 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-61e41944-18cf-4b51-b63d-331aba4896c5 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110309 Aug 09 14:36:30.904234 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 793/1595] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:30 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:30.922903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8a569764-c2e4-4670-978a-d5520e5404b1 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:30.929461 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:30.929461 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:31.014891 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8a569764-c2e4-4670-978a-d5520e5404b1 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1454583808/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.109413 Aug 09 14:36:31.017519 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 794/1596] 10.222.0.50 () {60 vars in 1224 bytes} [Tue Aug 9 14:36:30 2022] POST /compute/v2.1/flavors/1454583808/os-extra_specs => generated 66 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:31.030156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4562c36-9c5c-4987-b58b-01550dde42c3 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:31.030832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4562c36-9c5c-4987-b58b-01550dde42c3 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:31.158420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b4562c36-9c5c-4987-b58b-01550dde42c3 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:31.174339 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4562c36-9c5c-4987-b58b-01550dde42c3 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1224 microversion: 2.1 time: 0.155392 Aug 09 14:36:31.176090 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 795/1597] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:31 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1224 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:31.181249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0a1518e-40de-4146-8c4f-6cb4625de26f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:31.183276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0a1518e-40de-4146-8c4f-6cb4625de26f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:31.190322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0a1518e-40de-4146-8c4f-6cb4625de26f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:31.191188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0a1518e-40de-4146-8c4f-6cb4625de26f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:31.191826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0a1518e-40de-4146-8c4f-6cb4625de26f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:31.193344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0a1518e-40de-4146-8c4f-6cb4625de26f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:31.194170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0a1518e-40de-4146-8c4f-6cb4625de26f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:31.194836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0a1518e-40de-4146-8c4f-6cb4625de26f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:31.726780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-736697a8-d834-4aa6-9cde-2da60ba538e5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:31.736493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-736697a8-d834-4aa6-9cde-2da60ba538e5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:31.738197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-736697a8-d834-4aa6-9cde-2da60ba538e5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:31.739409 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-736697a8-d834-4aa6-9cde-2da60ba538e5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1280 microversion: 2.25 time: 0.906170 Aug 09 14:36:31.751212 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 803/1598] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:30 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1280 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:31.848486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a0a1518e-40de-4146-8c4f-6cb4625de26f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:31.857112 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0a1518e-40de-4146-8c4f-6cb4625de26f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.679568 Aug 09 14:36:31.857715 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 796/1599] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:31 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:31.875959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a37c181b-132c-469c-8dbc-86195eef8495 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:31.881995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a37c181b-132c-469c-8dbc-86195eef8495 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:31.893670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a37c181b-132c-469c-8dbc-86195eef8495 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:31.898200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a37c181b-132c-469c-8dbc-86195eef8495 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:31.899050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a37c181b-132c-469c-8dbc-86195eef8495 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:31.900828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a37c181b-132c-469c-8dbc-86195eef8495 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:31.903570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a37c181b-132c-469c-8dbc-86195eef8495 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:31.904232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a37c181b-132c-469c-8dbc-86195eef8495 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:32.042267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c3d52ec-df25-4fd0-bb95-5a71c4d39ded tempest-FlavorsExtraSpecsTestJSON-1150683745 tempest-FlavorsExtraSpecsTestJSON-1150683745-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:32.054730 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6c3d52ec-df25-4fd0-bb95-5a71c4d39ded tempest-FlavorsExtraSpecsTestJSON-1150683745 tempest-FlavorsExtraSpecsTestJSON-1150683745-project] 10.222.0.50 "GET /compute/v2.1/flavors/1454583808/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.312445 Aug 09 14:36:32.055968 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 804/1600] 10.222.0.50 () {58 vars in 1203 bytes} [Tue Aug 9 14:36:31 2022] GET /compute/v2.1/flavors/1454583808/os-extra_specs => generated 66 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:32.167666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-688235376", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:32.228484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a37c181b-132c-469c-8dbc-86195eef8495 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:32.239374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:36:32.240601 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a37c181b-132c-469c-8dbc-86195eef8495 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.368696 Aug 09 14:36:32.241508 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 797/1601] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:31 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:32.246389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aca674d7-0b26-4ee3-8972-a3720ad0bf75 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:32.253167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aca674d7-0b26-4ee3-8972-a3720ad0bf75 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:32.269208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aca674d7-0b26-4ee3-8972-a3720ad0bf75 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:32.269991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aca674d7-0b26-4ee3-8972-a3720ad0bf75 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:32.270803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aca674d7-0b26-4ee3-8972-a3720ad0bf75 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:32.271889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aca674d7-0b26-4ee3-8972-a3720ad0bf75 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:32.272201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aca674d7-0b26-4ee3-8972-a3720ad0bf75 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:32.272722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aca674d7-0b26-4ee3-8972-a3720ad0bf75 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:32.797327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aca674d7-0b26-4ee3-8972-a3720ad0bf75 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:32.806173 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aca674d7-0b26-4ee3-8972-a3720ad0bf75 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.563359 Aug 09 14:36:32.812347 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 798/1602] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:32 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:32.819815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ce5a81b-fa29-4c37-942b-e844cb84bc2c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:32.826914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0ce5a81b-fa29-4c37-942b-e844cb84bc2c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:32.841511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ce5a81b-fa29-4c37-942b-e844cb84bc2c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:32.844767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ce5a81b-fa29-4c37-942b-e844cb84bc2c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:32.845432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ce5a81b-fa29-4c37-942b-e844cb84bc2c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:32.847542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ce5a81b-fa29-4c37-942b-e844cb84bc2c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:32.848483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ce5a81b-fa29-4c37-942b-e844cb84bc2c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:32.849171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ce5a81b-fa29-4c37-942b-e844cb84bc2c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:32.896973 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0ce5a81b-fa29-4c37-942b-e844cb84bc2c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082933 Aug 09 14:36:32.899670 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 799/1603] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:32 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:32.910553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-102d9553-e2f2-4fc2-adad-e489003af817 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:32.915417 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:32.915417 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:32.951519 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-102d9553-e2f2-4fc2-adad-e489003af817 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1454583808/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048808 Aug 09 14:36:32.958554 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 800/1604] 10.222.0.50 () {60 vars in 1224 bytes} [Tue Aug 9 14:36:32 2022] POST /compute/v2.1/flavors/1454583808/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:32.972344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-277030f6-03b3-4507-8e9f-85c46a4c5ae6 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:32.973244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-277030f6-03b3-4507-8e9f-85c46a4c5ae6 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:32.980917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-277030f6-03b3-4507-8e9f-85c46a4c5ae6 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:32.981430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-277030f6-03b3-4507-8e9f-85c46a4c5ae6 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:32.981860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-277030f6-03b3-4507-8e9f-85c46a4c5ae6 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:32.982632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-277030f6-03b3-4507-8e9f-85c46a4c5ae6 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:32.983106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-277030f6-03b3-4507-8e9f-85c46a4c5ae6 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:32.983854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-277030f6-03b3-4507-8e9f-85c46a4c5ae6 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:33.107664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:36:33.108419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:36:33.109146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:36:33.109907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:36:33.110526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:36:33.123605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:33.125558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:33.126707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:33.128784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:33.129828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:33.130576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:33.150838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-277030f6-03b3-4507-8e9f-85c46a4c5ae6 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:33.171730 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-277030f6-03b3-4507-8e9f-85c46a4c5ae6 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1282 microversion: 2.1 time: 0.207850 Aug 09 14:36:33.174134 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 801/1605] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:32 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1282 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:33.194827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-694fed8a-ca22-4bd9-b324-f208d6c05adb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:33.198149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-694fed8a-ca22-4bd9-b324-f208d6c05adb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:33.202881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Getting quotas for project 2c6d6b857c2c464dbd7cd82e46825976. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:36:33.212921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-694fed8a-ca22-4bd9-b324-f208d6c05adb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:33.213401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-694fed8a-ca22-4bd9-b324-f208d6c05adb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:33.213836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-694fed8a-ca22-4bd9-b324-f208d6c05adb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:33.214525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-694fed8a-ca22-4bd9-b324-f208d6c05adb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:33.215295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-694fed8a-ca22-4bd9-b324-f208d6c05adb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:33.216557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Getting quotas for user 51435a3f14654a77925d34c516c6fd1e and project 2c6d6b857c2c464dbd7cd82e46825976. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:36:33.227703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-694fed8a-ca22-4bd9-b324-f208d6c05adb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:33.291776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:36:33.296248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:36:33.368640 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9af34d66-5d0f-450a-aae8-6a8c888743cd tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310672 Aug 09 14:36:33.369482 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 805/1606] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:36:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:36:33.376193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b751c717-9cf4-4a0f-93a0-65df79e32bb8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:33.376814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b751c717-9cf4-4a0f-93a0-65df79e32bb8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:33.383316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b751c717-9cf4-4a0f-93a0-65df79e32bb8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:33.384017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b751c717-9cf4-4a0f-93a0-65df79e32bb8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:33.384612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b751c717-9cf4-4a0f-93a0-65df79e32bb8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:33.385324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b751c717-9cf4-4a0f-93a0-65df79e32bb8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:33.385919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b751c717-9cf4-4a0f-93a0-65df79e32bb8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:33.386487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b751c717-9cf4-4a0f-93a0-65df79e32bb8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:33.618093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-694fed8a-ca22-4bd9-b324-f208d6c05adb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:33.630119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-694fed8a-ca22-4bd9-b324-f208d6c05adb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:33.632408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-694fed8a-ca22-4bd9-b324-f208d6c05adb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:33.633602 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-694fed8a-ca22-4bd9-b324-f208d6c05adb tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1280 microversion: 2.25 time: 0.454777 Aug 09 14:36:33.634172 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 802/1607] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:33 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1280 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:33.640106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f018d2e4-ad64-4185-85a8-d158cd69aa51 tempest-FlavorsExtraSpecsTestJSON-1150683745 tempest-FlavorsExtraSpecsTestJSON-1150683745-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:33.654471 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f018d2e4-ad64-4185-85a8-d158cd69aa51 tempest-FlavorsExtraSpecsTestJSON-1150683745 tempest-FlavorsExtraSpecsTestJSON-1150683745-project] 10.222.0.50 "GET /compute/v2.1/flavors/1454583808/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.019035 Aug 09 14:36:33.655753 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 803/1608] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:36:33 2022] GET /compute/v2.1/flavors/1454583808/os-extra_specs/hw:numa_nodes => generated 22 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:33.661498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df5503e1-87bf-4368-b839-9b5aeb1d0cd2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:33.662372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df5503e1-87bf-4368-b839-9b5aeb1d0cd2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:33.670609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df5503e1-87bf-4368-b839-9b5aeb1d0cd2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:33.671729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df5503e1-87bf-4368-b839-9b5aeb1d0cd2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:33.672373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df5503e1-87bf-4368-b839-9b5aeb1d0cd2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:33.673384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df5503e1-87bf-4368-b839-9b5aeb1d0cd2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:33.673825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df5503e1-87bf-4368-b839-9b5aeb1d0cd2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:33.674386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df5503e1-87bf-4368-b839-9b5aeb1d0cd2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:33.734212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b751c717-9cf4-4a0f-93a0-65df79e32bb8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:33.743953 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b751c717-9cf4-4a0f-93a0-65df79e32bb8 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.372665 Aug 09 14:36:33.746233 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 806/1609] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:33 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:33.762946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-10383f0d-b539-45ac-a3d6-ca326ba935a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:33.763994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-10383f0d-b539-45ac-a3d6-ca326ba935a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:33.909484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-10383f0d-b539-45ac-a3d6-ca326ba935a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:33.924555 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-10383f0d-b539-45ac-a3d6-ca326ba935a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1213 microversion: 2.1 time: 0.175008 Aug 09 14:36:33.926427 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 807/1610] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:33 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1213 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:33.941858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f1eac33-67ba-4787-ae7d-1762bc7a68dc tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:33.945419 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:33.945419 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:36:33.992625 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2f1eac33-67ba-4787-ae7d-1762bc7a68dc tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors/1454583808/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064341 Aug 09 14:36:33.993248 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 808/1611] 10.222.0.50 () {60 vars in 1224 bytes} [Tue Aug 9 14:36:33 2022] POST /compute/v2.1/flavors/1454583808/os-extra_specs => generated 66 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:34.004617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-779264ec-e03f-4a2a-804f-00e53e3ab0c6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:34.005568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-779264ec-e03f-4a2a-804f-00e53e3ab0c6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:34.013844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-779264ec-e03f-4a2a-804f-00e53e3ab0c6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:34.014740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-779264ec-e03f-4a2a-804f-00e53e3ab0c6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:34.015425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-779264ec-e03f-4a2a-804f-00e53e3ab0c6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:34.017189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-779264ec-e03f-4a2a-804f-00e53e3ab0c6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:34.018300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-779264ec-e03f-4a2a-804f-00e53e3ab0c6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:34.019506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-779264ec-e03f-4a2a-804f-00e53e3ab0c6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:34.063392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-df5503e1-87bf-4368-b839-9b5aeb1d0cd2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:34.076880 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df5503e1-87bf-4368-b839-9b5aeb1d0cd2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.419828 Aug 09 14:36:34.081076 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 804/1612] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:33 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:34.095876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0bafe1e0-de33-4a32-9b14-123ebdb2c557 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:34.098337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0bafe1e0-de33-4a32-9b14-123ebdb2c557 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:34.113641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bafe1e0-de33-4a32-9b14-123ebdb2c557 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:34.114298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bafe1e0-de33-4a32-9b14-123ebdb2c557 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:34.114921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bafe1e0-de33-4a32-9b14-123ebdb2c557 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:34.115747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bafe1e0-de33-4a32-9b14-123ebdb2c557 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:34.116282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bafe1e0-de33-4a32-9b14-123ebdb2c557 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:34.116775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bafe1e0-de33-4a32-9b14-123ebdb2c557 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:34.133833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:34.154307 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0bafe1e0-de33-4a32-9b14-123ebdb2c557 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070385 Aug 09 14:36:34.155458 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 805/1613] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:34 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:34.160665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79a71d23-3f17-458e-a572-15dbd88d4d6b tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:34.170431 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79a71d23-3f17-458e-a572-15dbd88d4d6b tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1454583808/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013601 Aug 09 14:36:34.171210 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 806/1614] 10.222.0.50 () {58 vars in 1203 bytes} [Tue Aug 9 14:36:34 2022] GET /compute/v2.1/flavors/1454583808/os-extra_specs => generated 66 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:34.186245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5f710b5d-5f57-4618-81ea-e027200e7c64 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:34.190170 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:34.190170 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:34.235883 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5f710b5d-5f57-4618-81ea-e027200e7c64 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] 10.222.0.50 "PUT /compute/v2.1/flavors/1454583808/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.055485 Aug 09 14:36:34.237108 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 807/1615] 10.222.0.50 () {60 vars in 1265 bytes} [Tue Aug 9 14:36:34 2022] PUT /compute/v2.1/flavors/1454583808/os-extra_specs/hw:numa_nodes => generated 22 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:34.245154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-43f3bad9-f061-4b98-8e9f-35b0fa09ff9d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:34.246016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-43f3bad9-f061-4b98-8e9f-35b0fa09ff9d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:34.253253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43f3bad9-f061-4b98-8e9f-35b0fa09ff9d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:34.254084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43f3bad9-f061-4b98-8e9f-35b0fa09ff9d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:34.254711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43f3bad9-f061-4b98-8e9f-35b0fa09ff9d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:34.255697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43f3bad9-f061-4b98-8e9f-35b0fa09ff9d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:34.256341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43f3bad9-f061-4b98-8e9f-35b0fa09ff9d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:34.256948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43f3bad9-f061-4b98-8e9f-35b0fa09ff9d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:34.382025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-43f3bad9-f061-4b98-8e9f-35b0fa09ff9d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:34.394643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-779264ec-e03f-4a2a-804f-00e53e3ab0c6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:34.408225 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-779264ec-e03f-4a2a-804f-00e53e3ab0c6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.408487 Aug 09 14:36:34.409423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 809/1616] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:33 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:34.414137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-468a4244-b511-42e5-ab01-d193f535fa65 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:34.424923 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-43f3bad9-f061-4b98-8e9f-35b0fa09ff9d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1282 microversion: 2.1 time: 0.168271 Aug 09 14:36:34.426121 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 808/1617] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:34 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1282 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:34.432149 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-468a4244-b511-42e5-ab01-d193f535fa65 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1454583808/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.021405 Aug 09 14:36:34.438016 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 810/1618] 10.222.0.50 () {58 vars in 1203 bytes} [Tue Aug 9 14:36:34 2022] GET /compute/v2.1/flavors/1454583808/os-extra_specs => generated 66 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:34.444821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-629cc32c-4922-4f05-955d-8bf570d44150 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:34.447768 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:34.447768 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:34.487607 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-629cc32c-4922-4f05-955d-8bf570d44150 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1454583808/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.047743 Aug 09 14:36:34.492243 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 809/1619] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:36:34 2022] DELETE /compute/v2.1/flavors/1454583808/os-extra_specs/hw:numa_nodes => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:36:34.497730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b0c57101-0397-40f8-b957-f5ec4a64972f tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:34.498503 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:34.498503 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:36:34.526046 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b0c57101-0397-40f8-b957-f5ec4a64972f tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1454583808/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.032096 Aug 09 14:36:34.530638 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 811/1620] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:36:34 2022] DELETE /compute/v2.1/flavors/1454583808/os-extra_specs/hw:cpu_policy => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:36:34.535605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67a71ea1-d884-4e47-bb7e-3b931c227539 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:34.544135 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67a71ea1-d884-4e47-bb7e-3b931c227539 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/1454583808/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012154 Aug 09 14:36:34.547176 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 810/1621] 10.222.0.50 () {58 vars in 1203 bytes} [Tue Aug 9 14:36:34 2022] GET /compute/v2.1/flavors/1454583808/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:34.560342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b0e6828b-f7c0-4cb1-971b-7b5283fee9a2 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:34.561179 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:34.561179 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:36:34.612440 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b0e6828b-f7c0-4cb1-971b-7b5283fee9a2 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1454583808" status: 202 len: 0 microversion: 2.1 time: 0.059832 Aug 09 14:36:34.613218 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 812/1622] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:36:34 2022] DELETE /compute/v2.1/flavors/1454583808 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:36:34.621788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e6ba9e2f-f2fa-482a-b212-051f966b8d79 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:34.659152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0c15d2e-54dd-4784-b39d-2da259e2663e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:34.659918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0c15d2e-54dd-4784-b39d-2da259e2663e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:34.670426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c15d2e-54dd-4784-b39d-2da259e2663e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:34.671507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c15d2e-54dd-4784-b39d-2da259e2663e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:34.673658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c15d2e-54dd-4784-b39d-2da259e2663e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:34.674475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c15d2e-54dd-4784-b39d-2da259e2663e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:34.675495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c15d2e-54dd-4784-b39d-2da259e2663e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:34.676281 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e6ba9e2f-f2fa-482a-b212-051f966b8d79 tempest-FlavorsExtraSpecsTestJSON-1188365721 tempest-FlavorsExtraSpecsTestJSON-1188365721-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058575 Aug 09 14:36:34.676749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c15d2e-54dd-4784-b39d-2da259e2663e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:34.677661 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 811/1623] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:34.766784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4fcd717-2d72-48c5-91fc-52bfb6834f33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:34.767876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4fcd717-2d72-48c5-91fc-52bfb6834f33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:34.781078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4fcd717-2d72-48c5-91fc-52bfb6834f33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:34.781838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4fcd717-2d72-48c5-91fc-52bfb6834f33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:34.782582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4fcd717-2d72-48c5-91fc-52bfb6834f33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:34.783706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4fcd717-2d72-48c5-91fc-52bfb6834f33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:34.784968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4fcd717-2d72-48c5-91fc-52bfb6834f33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:34.785846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4fcd717-2d72-48c5-91fc-52bfb6834f33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:35.075332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0c15d2e-54dd-4784-b39d-2da259e2663e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:35.086899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0c15d2e-54dd-4784-b39d-2da259e2663e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:35.088475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0c15d2e-54dd-4784-b39d-2da259e2663e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:35.089828 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0c15d2e-54dd-4784-b39d-2da259e2663e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1280 microversion: 2.25 time: 0.435325 Aug 09 14:36:35.112237 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 813/1624] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:34 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1280 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:36:35.123339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ba9e7dca-5b4b-4f67-97b0-e13146e12382 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:35.123949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ba9e7dca-5b4b-4f67-97b0-e13146e12382 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:35.141464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba9e7dca-5b4b-4f67-97b0-e13146e12382 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:35.154661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba9e7dca-5b4b-4f67-97b0-e13146e12382 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:35.155731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba9e7dca-5b4b-4f67-97b0-e13146e12382 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:35.158740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba9e7dca-5b4b-4f67-97b0-e13146e12382 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:35.159378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba9e7dca-5b4b-4f67-97b0-e13146e12382 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:35.160106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba9e7dca-5b4b-4f67-97b0-e13146e12382 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:35.167104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d4fcd717-2d72-48c5-91fc-52bfb6834f33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:35.186100 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4fcd717-2d72-48c5-91fc-52bfb6834f33 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.422121 Aug 09 14:36:35.188746 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 812/1625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:34 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:36:35.202013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27050479-b6ef-4edc-b1e4-b0ef690dcd66 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:35.205271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-27050479-b6ef-4edc-b1e4-b0ef690dcd66 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:35.221890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27050479-b6ef-4edc-b1e4-b0ef690dcd66 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:35.224219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27050479-b6ef-4edc-b1e4-b0ef690dcd66 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:35.226078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27050479-b6ef-4edc-b1e4-b0ef690dcd66 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:35.228004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27050479-b6ef-4edc-b1e4-b0ef690dcd66 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:35.228485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27050479-b6ef-4edc-b1e4-b0ef690dcd66 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:35.228916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27050479-b6ef-4edc-b1e4-b0ef690dcd66 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:35.390275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ba9e7dca-5b4b-4f67-97b0-e13146e12382 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:35.398854 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ba9e7dca-5b4b-4f67-97b0-e13146e12382 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1271 microversion: 2.1 time: 0.285627 Aug 09 14:36:35.399567 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 814/1626] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:35 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1271 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:35.429012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9d196f63-df7f-4e24-9d2a-48cf1c4f9374 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:35.431354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d196f63-df7f-4e24-9d2a-48cf1c4f9374 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:35.445543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d196f63-df7f-4e24-9d2a-48cf1c4f9374 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:35.446303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d196f63-df7f-4e24-9d2a-48cf1c4f9374 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:35.446922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d196f63-df7f-4e24-9d2a-48cf1c4f9374 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:35.447854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d196f63-df7f-4e24-9d2a-48cf1c4f9374 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:35.448971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d196f63-df7f-4e24-9d2a-48cf1c4f9374 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:35.449587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d196f63-df7f-4e24-9d2a-48cf1c4f9374 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:35.481634 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9d196f63-df7f-4e24-9d2a-48cf1c4f9374 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057109 Aug 09 14:36:35.482237 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 815/1627] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:35 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:35.491857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e3f6edb0-e41d-4250-8ca8-6bd3127657e8 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:35.499930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e3f6edb0-e41d-4250-8ca8-6bd3127657e8 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:35.507671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3f6edb0-e41d-4250-8ca8-6bd3127657e8 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:35.508435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3f6edb0-e41d-4250-8ca8-6bd3127657e8 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:35.509142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3f6edb0-e41d-4250-8ca8-6bd3127657e8 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:35.510453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3f6edb0-e41d-4250-8ca8-6bd3127657e8 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:35.511274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3f6edb0-e41d-4250-8ca8-6bd3127657e8 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:35.512042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3f6edb0-e41d-4250-8ca8-6bd3127657e8 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:35.742476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-27050479-b6ef-4edc-b1e4-b0ef690dcd66 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:35.758168 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-27050479-b6ef-4edc-b1e4-b0ef690dcd66 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1476 microversion: 2.1 time: 0.567158 Aug 09 14:36:35.759471 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 813/1628] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:35 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1476 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:35.772763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9a9393cd-684a-4174-810e-3e404fa90e0d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:35.774119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9a9393cd-684a-4174-810e-3e404fa90e0d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:35.788868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9393cd-684a-4174-810e-3e404fa90e0d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:35.790911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9393cd-684a-4174-810e-3e404fa90e0d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:35.794992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9393cd-684a-4174-810e-3e404fa90e0d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:35.797358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9393cd-684a-4174-810e-3e404fa90e0d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:35.798825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9393cd-684a-4174-810e-3e404fa90e0d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:35.801646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9393cd-684a-4174-810e-3e404fa90e0d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:36.080890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e3f6edb0-e41d-4250-8ca8-6bd3127657e8 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:36.094181 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e3f6edb0-e41d-4250-8ca8-6bd3127657e8 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.605378 Aug 09 14:36:36.117486 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 816/1629] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:35 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:36.124552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5f96d5fe-588b-48a8-ab8e-90a6bcf3c7ef tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:36.125172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5f96d5fe-588b-48a8-ab8e-90a6bcf3c7ef tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:36.132348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f96d5fe-588b-48a8-ab8e-90a6bcf3c7ef tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:36.133098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f96d5fe-588b-48a8-ab8e-90a6bcf3c7ef tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:36.133707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f96d5fe-588b-48a8-ab8e-90a6bcf3c7ef tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:36.134603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f96d5fe-588b-48a8-ab8e-90a6bcf3c7ef tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:36.135303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f96d5fe-588b-48a8-ab8e-90a6bcf3c7ef tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:36.135902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f96d5fe-588b-48a8-ab8e-90a6bcf3c7ef tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:36.457407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9a9393cd-684a-4174-810e-3e404fa90e0d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:36.468555 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9a9393cd-684a-4174-810e-3e404fa90e0d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1324 microversion: 2.1 time: 0.705997 Aug 09 14:36:36.470266 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 814/1630] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:35 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1324 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:36.669703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-7ff3442f-f179-4cf3-b866-f977aeb490d8 req-44980197-2e60-431c-9e13-1d6a3d016667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0c3435-cbf1-447d-ba66-fbdf16ccc900", "name": "network-vif-plugged", "status": "completed", "tag": "355f3c7f-c299-41a4-a805-e747d83a3716"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:36.685907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7ff3442f-f179-4cf3-b866-f977aeb490d8 req-44980197-2e60-431c-9e13-1d6a3d016667 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:36.688627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7ff3442f-f179-4cf3-b866-f977aeb490d8 req-44980197-2e60-431c-9e13-1d6a3d016667 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:36.689631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7ff3442f-f179-4cf3-b866-f977aeb490d8 req-44980197-2e60-431c-9e13-1d6a3d016667 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:36.693945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f96d5fe-588b-48a8-ab8e-90a6bcf3c7ef tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:36.706065 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-7ff3442f-f179-4cf3-b866-f977aeb490d8 req-44980197-2e60-431c-9e13-1d6a3d016667 service nova] Creating event network-vif-plugged:355f3c7f-c299-41a4-a805-e747d83a3716 for instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 on n-h2-844626-8 Aug 09 14:36:36.711005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f96d5fe-588b-48a8-ab8e-90a6bcf3c7ef tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:36.714145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f96d5fe-588b-48a8-ab8e-90a6bcf3c7ef tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:36.714626 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-7ff3442f-f179-4cf3-b866-f977aeb490d8 req-44980197-2e60-431c-9e13-1d6a3d016667 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241818 Aug 09 14:36:36.716067 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 815/1631] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:36.720248 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5f96d5fe-588b-48a8-ab8e-90a6bcf3c7ef tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1280 microversion: 2.25 time: 0.599876 Aug 09 14:36:36.735123 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 817/1632] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:36 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1280 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:36.736535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d06c1434-1493-4a6f-8218-f39d82da335e tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:36.736634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d06c1434-1493-4a6f-8218-f39d82da335e tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:36.737744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-45919fba-a02d-4876-80ed-bfb1bf96de41 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:36.747302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-45919fba-a02d-4876-80ed-bfb1bf96de41 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:36.760203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d06c1434-1493-4a6f-8218-f39d82da335e tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:36.763385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d06c1434-1493-4a6f-8218-f39d82da335e tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:36.764389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d06c1434-1493-4a6f-8218-f39d82da335e tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:36.768433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d06c1434-1493-4a6f-8218-f39d82da335e tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:36.771136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45919fba-a02d-4876-80ed-bfb1bf96de41 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:36.771767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45919fba-a02d-4876-80ed-bfb1bf96de41 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:36.772198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45919fba-a02d-4876-80ed-bfb1bf96de41 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:36.772620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d06c1434-1493-4a6f-8218-f39d82da335e tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:36.772921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45919fba-a02d-4876-80ed-bfb1bf96de41 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:36.773371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45919fba-a02d-4876-80ed-bfb1bf96de41 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:36.773790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45919fba-a02d-4876-80ed-bfb1bf96de41 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:36.774338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d06c1434-1493-4a6f-8218-f39d82da335e tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:37.340514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-45919fba-a02d-4876-80ed-bfb1bf96de41 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:37.354317 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-45919fba-a02d-4876-80ed-bfb1bf96de41 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.636220 Aug 09 14:36:37.355723 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 816/1633] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:36 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:37.364903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e622248-3c74-4c04-b9d6-66bc7cbb7c10 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:37.368341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e622248-3c74-4c04-b9d6-66bc7cbb7c10 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:37.383473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e622248-3c74-4c04-b9d6-66bc7cbb7c10 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:37.384695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e622248-3c74-4c04-b9d6-66bc7cbb7c10 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:37.385488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e622248-3c74-4c04-b9d6-66bc7cbb7c10 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:37.386926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e622248-3c74-4c04-b9d6-66bc7cbb7c10 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:37.387668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e622248-3c74-4c04-b9d6-66bc7cbb7c10 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:37.389602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e622248-3c74-4c04-b9d6-66bc7cbb7c10 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:37.398819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d06c1434-1493-4a6f-8218-f39d82da335e tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:37.433429 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d06c1434-1493-4a6f-8218-f39d82da335e tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1313 microversion: 2.1 time: 0.703997 Aug 09 14:36:37.439200 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 818/1634] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:36 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1313 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:37.465762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b89b0ac1-0f9c-4856-a1c6-d58e3e396a17 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:37.468570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b89b0ac1-0f9c-4856-a1c6-d58e3e396a17 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:37.489944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b89b0ac1-0f9c-4856-a1c6-d58e3e396a17 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:37.500572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b89b0ac1-0f9c-4856-a1c6-d58e3e396a17 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:37.501335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b89b0ac1-0f9c-4856-a1c6-d58e3e396a17 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:37.502280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b89b0ac1-0f9c-4856-a1c6-d58e3e396a17 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:37.502898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b89b0ac1-0f9c-4856-a1c6-d58e3e396a17 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:37.503619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b89b0ac1-0f9c-4856-a1c6-d58e3e396a17 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:37.518024 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e622248-3c74-4c04-b9d6-66bc7cbb7c10 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160914 Aug 09 14:36:37.521831 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 817/1635] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:37 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:37.547239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4820a3e7-2ba6-49b0-ba30-5974bbf8550b tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:37.550408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4820a3e7-2ba6-49b0-ba30-5974bbf8550b tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:37.559926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4820a3e7-2ba6-49b0-ba30-5974bbf8550b tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:37.559926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4820a3e7-2ba6-49b0-ba30-5974bbf8550b tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:37.560244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4820a3e7-2ba6-49b0-ba30-5974bbf8550b tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:37.561161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4820a3e7-2ba6-49b0-ba30-5974bbf8550b tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:37.561789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4820a3e7-2ba6-49b0-ba30-5974bbf8550b tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:37.562543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4820a3e7-2ba6-49b0-ba30-5974bbf8550b tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.062587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b89b0ac1-0f9c-4856-a1c6-d58e3e396a17 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:38.081241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4820a3e7-2ba6-49b0-ba30-5974bbf8550b tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:38.082207 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b89b0ac1-0f9c-4856-a1c6-d58e3e396a17 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1475 microversion: 2.1 time: 0.637913 Aug 09 14:36:38.083707 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 819/1636] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:37 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1475 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:38.091138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-516d7705-9091-4ac0-86c3-9ba6d7f4c6fe tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:38.092189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-516d7705-9091-4ac0-86c3-9ba6d7f4c6fe tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:38.103515 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4820a3e7-2ba6-49b0-ba30-5974bbf8550b tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.579967 Aug 09 14:36:38.111627 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 818/1637] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:37 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:38.116921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-516d7705-9091-4ac0-86c3-9ba6d7f4c6fe tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.117429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-516d7705-9091-4ac0-86c3-9ba6d7f4c6fe tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.117876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-516d7705-9091-4ac0-86c3-9ba6d7f4c6fe tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.120133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-86f70229-4128-47b2-a767-eb9db58bf1d1 req-5ee7cdb2-1dd5-4a4f-bccb-99fcc05379b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a158321c-16c9-4d13-a869-5fe62e776295", "tag": "d1ea82ad-9d17-40d8-9de6-0db3f4198af1"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:38.121924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-516d7705-9091-4ac0-86c3-9ba6d7f4c6fe tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.122424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-516d7705-9091-4ac0-86c3-9ba6d7f4c6fe tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.122914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-516d7705-9091-4ac0-86c3-9ba6d7f4c6fe tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.127668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:38.146404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-86f70229-4128-47b2-a767-eb9db58bf1d1 req-5ee7cdb2-1dd5-4a4f-bccb-99fcc05379b2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.146404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-86f70229-4128-47b2-a767-eb9db58bf1d1 req-5ee7cdb2-1dd5-4a4f-bccb-99fcc05379b2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.146404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-86f70229-4128-47b2-a767-eb9db58bf1d1 req-5ee7cdb2-1dd5-4a4f-bccb-99fcc05379b2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.170078 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-86f70229-4128-47b2-a767-eb9db58bf1d1 req-5ee7cdb2-1dd5-4a4f-bccb-99fcc05379b2 service nova] Creating event network-changed:d1ea82ad-9d17-40d8-9de6-0db3f4198af1 for instance a158321c-16c9-4d13-a869-5fe62e776295 on n-h1-844626-8 Aug 09 14:36:38.181310 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-86f70229-4128-47b2-a767-eb9db58bf1d1 req-5ee7cdb2-1dd5-4a4f-bccb-99fcc05379b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068243 Aug 09 14:36:38.184693 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 819/1638] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:38.190826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-abb7b042-935a-4bac-9b19-02b21cca9722 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:38.191622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-abb7b042-935a-4bac-9b19-02b21cca9722 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:38.223367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abb7b042-935a-4bac-9b19-02b21cca9722 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.224116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abb7b042-935a-4bac-9b19-02b21cca9722 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.224730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abb7b042-935a-4bac-9b19-02b21cca9722 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.225643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abb7b042-935a-4bac-9b19-02b21cca9722 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.226850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abb7b042-935a-4bac-9b19-02b21cca9722 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.227619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abb7b042-935a-4bac-9b19-02b21cca9722 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.581525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-516d7705-9091-4ac0-86c3-9ba6d7f4c6fe tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:38.594464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-abb7b042-935a-4bac-9b19-02b21cca9722 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:38.602365 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-516d7705-9091-4ac0-86c3-9ba6d7f4c6fe tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1324 microversion: 2.1 time: 0.516841 Aug 09 14:36:38.604258 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 820/1639] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:38 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1324 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:38.609827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-abb7b042-935a-4bac-9b19-02b21cca9722 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:38.611368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-abb7b042-935a-4bac-9b19-02b21cca9722 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:38.612733 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-abb7b042-935a-4bac-9b19-02b21cca9722 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1280 microversion: 2.25 time: 0.426892 Aug 09 14:36:38.616665 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 820/1640] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:38 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1280 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:38.631263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48091245-523c-4050-98f1-1058ced93497 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:38.632169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48091245-523c-4050-98f1-1058ced93497 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:38.647029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48091245-523c-4050-98f1-1058ced93497 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.647766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48091245-523c-4050-98f1-1058ced93497 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.648242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48091245-523c-4050-98f1-1058ced93497 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.648936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48091245-523c-4050-98f1-1058ced93497 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.649444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48091245-523c-4050-98f1-1058ced93497 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.649869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48091245-523c-4050-98f1-1058ced93497 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.649976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7598226a-fa8d-418a-b19b-fb3688b7214d req-0850e811-60ce-41ca-a19e-78fd10b52615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bca7020-9984-4d3f-bbaa-9b08bb396e45", "tag": "6a96fb4b-302c-4503-9633-e8019d37935e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:38.674178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7598226a-fa8d-418a-b19b-fb3688b7214d req-0850e811-60ce-41ca-a19e-78fd10b52615 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.676751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7598226a-fa8d-418a-b19b-fb3688b7214d req-0850e811-60ce-41ca-a19e-78fd10b52615 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.677179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7598226a-fa8d-418a-b19b-fb3688b7214d req-0850e811-60ce-41ca-a19e-78fd10b52615 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.693284 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7598226a-fa8d-418a-b19b-fb3688b7214d req-0850e811-60ce-41ca-a19e-78fd10b52615 service nova] Creating event network-changed:6a96fb4b-302c-4503-9633-e8019d37935e for instance 0bca7020-9984-4d3f-bbaa-9b08bb396e45 on n-h1-844626-8 Aug 09 14:36:38.700269 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7598226a-fa8d-418a-b19b-fb3688b7214d req-0850e811-60ce-41ca-a19e-78fd10b52615 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094511 Aug 09 14:36:38.702478 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 821/1641] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:38.711984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-14a867b2-76f4-4271-b693-7ee325e46e9c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:38.713102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-14a867b2-76f4-4271-b693-7ee325e46e9c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:38.722235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14a867b2-76f4-4271-b693-7ee325e46e9c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.723300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14a867b2-76f4-4271-b693-7ee325e46e9c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.724043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14a867b2-76f4-4271-b693-7ee325e46e9c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.725115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14a867b2-76f4-4271-b693-7ee325e46e9c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.726031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14a867b2-76f4-4271-b693-7ee325e46e9c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.726792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14a867b2-76f4-4271-b693-7ee325e46e9c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.928123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48091245-523c-4050-98f1-1058ced93497 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:38.942636 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48091245-523c-4050-98f1-1058ced93497 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.324614 Aug 09 14:36:38.943542 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 821/1642] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:38 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:38.949539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bd5ad3e1-5362-44f7-8ce9-17021c8a3da4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:38.952341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bd5ad3e1-5362-44f7-8ce9-17021c8a3da4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:38.959697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd5ad3e1-5362-44f7-8ce9-17021c8a3da4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.960408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd5ad3e1-5362-44f7-8ce9-17021c8a3da4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.960837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd5ad3e1-5362-44f7-8ce9-17021c8a3da4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.964704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd5ad3e1-5362-44f7-8ce9-17021c8a3da4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.964869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-14a867b2-76f4-4271-b693-7ee325e46e9c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:38.965269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd5ad3e1-5362-44f7-8ce9-17021c8a3da4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.965702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd5ad3e1-5362-44f7-8ce9-17021c8a3da4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:38.972783 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-14a867b2-76f4-4271-b693-7ee325e46e9c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1313 microversion: 2.1 time: 0.268734 Aug 09 14:36:38.973382 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 822/1643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:38 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:38.979007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-84c3663e-7c91-4de2-961f-18f6850454fd req-c63bbca3-4075-4395-8757-53d9364a49fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0c3435-cbf1-447d-ba66-fbdf16ccc900", "name": "network-vif-plugged", "status": "completed", "tag": "4ed9abf1-1e6f-4ead-ae47-ad41d975b753"}, {"server_uuid": "5c0c3435-cbf1-447d-ba66-fbdf16ccc900", "name": "network-vif-plugged", "status": "completed", "tag": "24797387-c810-4f1a-8344-fb81d45d7aa5"}, {"server_uuid": "268d8e06-f80e-4f5e-8710-578f4eef5bab", "name": "network-vif-plugged", "status": "completed", "tag": "4115b00e-91cf-4c28-b173-c0ec442c3cfb"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:38.990116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-84c3663e-7c91-4de2-961f-18f6850454fd req-c63bbca3-4075-4395-8757-53d9364a49fa service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:38.990594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-84c3663e-7c91-4de2-961f-18f6850454fd req-c63bbca3-4075-4395-8757-53d9364a49fa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:38.991034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-84c3663e-7c91-4de2-961f-18f6850454fd req-c63bbca3-4075-4395-8757-53d9364a49fa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.004636 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-84c3663e-7c91-4de2-961f-18f6850454fd req-c63bbca3-4075-4395-8757-53d9364a49fa service nova] Creating event network-vif-plugged:4ed9abf1-1e6f-4ead-ae47-ad41d975b753 for instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 on n-h2-844626-8 Aug 09 14:36:39.005064 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-84c3663e-7c91-4de2-961f-18f6850454fd req-c63bbca3-4075-4395-8757-53d9364a49fa service nova] Creating event network-vif-plugged:24797387-c810-4f1a-8344-fb81d45d7aa5 for instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 on n-h2-844626-8 Aug 09 14:36:39.006584 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-84c3663e-7c91-4de2-961f-18f6850454fd req-c63bbca3-4075-4395-8757-53d9364a49fa service nova] Creating event network-vif-plugged:4115b00e-91cf-4c28-b173-c0ec442c3cfb for instance 268d8e06-f80e-4f5e-8710-578f4eef5bab on n-h2-844626-8 Aug 09 14:36:39.012873 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-84c3663e-7c91-4de2-961f-18f6850454fd req-c63bbca3-4075-4395-8757-53d9364a49fa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038330 Aug 09 14:36:39.013164 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bd5ad3e1-5362-44f7-8ce9-17021c8a3da4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068304 Aug 09 14:36:39.019546 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 822/1644] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:38 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:39.019955 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 823/1645] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:39.092213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94b2f181-3964-4553-8c4f-7ddde43cc05c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:39.092739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94b2f181-3964-4553-8c4f-7ddde43cc05c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:39.099181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94b2f181-3964-4553-8c4f-7ddde43cc05c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.099908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94b2f181-3964-4553-8c4f-7ddde43cc05c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.100465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94b2f181-3964-4553-8c4f-7ddde43cc05c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.101171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94b2f181-3964-4553-8c4f-7ddde43cc05c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.101782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94b2f181-3964-4553-8c4f-7ddde43cc05c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.102350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94b2f181-3964-4553-8c4f-7ddde43cc05c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.104496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91415545-10c3-4dca-bba3-a6613fa7fb25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:39.105207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91415545-10c3-4dca-bba3-a6613fa7fb25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:39.116800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91415545-10c3-4dca-bba3-a6613fa7fb25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.117300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91415545-10c3-4dca-bba3-a6613fa7fb25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.117739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91415545-10c3-4dca-bba3-a6613fa7fb25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.118940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91415545-10c3-4dca-bba3-a6613fa7fb25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.119421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91415545-10c3-4dca-bba3-a6613fa7fb25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.119861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91415545-10c3-4dca-bba3-a6613fa7fb25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.135996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94b2f181-3964-4553-8c4f-7ddde43cc05c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:36:39.242259 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94b2f181-3964-4553-8c4f-7ddde43cc05c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 204 len: 0 microversion: 2.1 time: 0.153496 Aug 09 14:36:39.247292 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 823/1646] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:36:39 2022] DELETE /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:36:39.264289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0d74a3f5-2659-4a8a-afbb-5a2f7eb007f6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:39.265391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0d74a3f5-2659-4a8a-afbb-5a2f7eb007f6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:39.279876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d74a3f5-2659-4a8a-afbb-5a2f7eb007f6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.280405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d74a3f5-2659-4a8a-afbb-5a2f7eb007f6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.280997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d74a3f5-2659-4a8a-afbb-5a2f7eb007f6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.281648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d74a3f5-2659-4a8a-afbb-5a2f7eb007f6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.282051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d74a3f5-2659-4a8a-afbb-5a2f7eb007f6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.283416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d74a3f5-2659-4a8a-afbb-5a2f7eb007f6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.444835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91415545-10c3-4dca-bba3-a6613fa7fb25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:39.454210 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91415545-10c3-4dca-bba3-a6613fa7fb25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1475 microversion: 2.1 time: 0.354084 Aug 09 14:36:39.467397 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 824/1647] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:39 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1475 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:36:39.467397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52a64a3f-0c3e-47e2-8fbb-c5b6ee37ec6f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:39.467397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52a64a3f-0c3e-47e2-8fbb-c5b6ee37ec6f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:39.474145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52a64a3f-0c3e-47e2-8fbb-c5b6ee37ec6f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.475231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52a64a3f-0c3e-47e2-8fbb-c5b6ee37ec6f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.475873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52a64a3f-0c3e-47e2-8fbb-c5b6ee37ec6f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.476783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52a64a3f-0c3e-47e2-8fbb-c5b6ee37ec6f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.477512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52a64a3f-0c3e-47e2-8fbb-c5b6ee37ec6f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.478133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52a64a3f-0c3e-47e2-8fbb-c5b6ee37ec6f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.483727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:39.618941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0d74a3f5-2659-4a8a-afbb-5a2f7eb007f6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:39.628229 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0d74a3f5-2659-4a8a-afbb-5a2f7eb007f6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.379293 Aug 09 14:36:39.642875 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 824/1648] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:39 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:39.648554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee10202b-b114-41d1-b2d6-f435d5d63f6a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:39.649600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee10202b-b114-41d1-b2d6-f435d5d63f6a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:39.657024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee10202b-b114-41d1-b2d6-f435d5d63f6a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.657890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee10202b-b114-41d1-b2d6-f435d5d63f6a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.658647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee10202b-b114-41d1-b2d6-f435d5d63f6a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.659647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee10202b-b114-41d1-b2d6-f435d5d63f6a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.660351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee10202b-b114-41d1-b2d6-f435d5d63f6a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.661037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee10202b-b114-41d1-b2d6-f435d5d63f6a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.926604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-52a64a3f-0c3e-47e2-8fbb-c5b6ee37ec6f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:39.934603 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52a64a3f-0c3e-47e2-8fbb-c5b6ee37ec6f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1682 microversion: 2.1 time: 0.471636 Aug 09 14:36:39.949527 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 825/1649] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:39 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1682 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:39.952327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee10202b-b114-41d1-b2d6-f435d5d63f6a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:39.956535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71bcd612-518f-4c68-8ee7-5199a37d68ed tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:39.957377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-71bcd612-518f-4c68-8ee7-5199a37d68ed tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:39.964160 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee10202b-b114-41d1-b2d6-f435d5d63f6a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1324 microversion: 2.1 time: 0.319682 Aug 09 14:36:39.964909 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 825/1650] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:39 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1324 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:39.965202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71bcd612-518f-4c68-8ee7-5199a37d68ed tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.965893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71bcd612-518f-4c68-8ee7-5199a37d68ed tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.966492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71bcd612-518f-4c68-8ee7-5199a37d68ed tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.967409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71bcd612-518f-4c68-8ee7-5199a37d68ed tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.968035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71bcd612-518f-4c68-8ee7-5199a37d68ed tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.968592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71bcd612-518f-4c68-8ee7-5199a37d68ed tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.979390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5f22dd82-6aaf-4203-82ed-8324862556f4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:39.981818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5f22dd82-6aaf-4203-82ed-8324862556f4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:39.993564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f22dd82-6aaf-4203-82ed-8324862556f4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.994127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f22dd82-6aaf-4203-82ed-8324862556f4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.994971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f22dd82-6aaf-4203-82ed-8324862556f4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:39.995455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f22dd82-6aaf-4203-82ed-8324862556f4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:39.995972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f22dd82-6aaf-4203-82ed-8324862556f4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:39.996543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f22dd82-6aaf-4203-82ed-8324862556f4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:40.211407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-71bcd612-518f-4c68-8ee7-5199a37d68ed tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:40.226246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5f22dd82-6aaf-4203-82ed-8324862556f4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:40.228735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:40.234903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-71bcd612-518f-4c68-8ee7-5199a37d68ed tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:40.237309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-71bcd612-518f-4c68-8ee7-5199a37d68ed tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:40.239224 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-71bcd612-518f-4c68-8ee7-5199a37d68ed tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1280 microversion: 2.25 time: 0.288249 Aug 09 14:36:40.239478 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5f22dd82-6aaf-4203-82ed-8324862556f4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.267234 Aug 09 14:36:40.240611 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 826/1651] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:39 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1280 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:40.246194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62d55143-c31f-422d-8f39-9b7cb037f88b tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:40.247040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-62d55143-c31f-422d-8f39-9b7cb037f88b tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:40.252574 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 826/1652] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:39 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:40.253733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:40.256240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62d55143-c31f-422d-8f39-9b7cb037f88b tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:40.257000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62d55143-c31f-422d-8f39-9b7cb037f88b tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:40.257617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62d55143-c31f-422d-8f39-9b7cb037f88b tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:40.258379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62d55143-c31f-422d-8f39-9b7cb037f88b tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:40.258833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62d55143-c31f-422d-8f39-9b7cb037f88b tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:40.259292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62d55143-c31f-422d-8f39-9b7cb037f88b tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:40.414954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-62d55143-c31f-422d-8f39-9b7cb037f88b tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:40.426690 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-62d55143-c31f-422d-8f39-9b7cb037f88b tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1313 microversion: 2.1 time: 0.184122 Aug 09 14:36:40.431124 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 827/1653] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:40 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:40.480728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2b05a85f-0097-4de9-ba8d-9e54b9d57f1c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:40.482320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2b05a85f-0097-4de9-ba8d-9e54b9d57f1c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:40.492310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b05a85f-0097-4de9-ba8d-9e54b9d57f1c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:40.493006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b05a85f-0097-4de9-ba8d-9e54b9d57f1c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:40.493606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b05a85f-0097-4de9-ba8d-9e54b9d57f1c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:40.494473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b05a85f-0097-4de9-ba8d-9e54b9d57f1c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:40.495076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b05a85f-0097-4de9-ba8d-9e54b9d57f1c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:40.495664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b05a85f-0097-4de9-ba8d-9e54b9d57f1c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:40.640910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b05a85f-0097-4de9-ba8d-9e54b9d57f1c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:40.649265 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2b05a85f-0097-4de9-ba8d-9e54b9d57f1c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1475 microversion: 2.1 time: 0.172268 Aug 09 14:36:40.650089 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 827/1654] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:40 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1475 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:40.666699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6bcf53aa-2b36-40c3-a088-1f10b4a6f783 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:40.667349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6bcf53aa-2b36-40c3-a088-1f10b4a6f783 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:40.672577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:40.674747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bcf53aa-2b36-40c3-a088-1f10b4a6f783 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:40.675288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bcf53aa-2b36-40c3-a088-1f10b4a6f783 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:40.675865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bcf53aa-2b36-40c3-a088-1f10b4a6f783 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:40.676571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bcf53aa-2b36-40c3-a088-1f10b4a6f783 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:40.677012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bcf53aa-2b36-40c3-a088-1f10b4a6f783 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:40.677598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bcf53aa-2b36-40c3-a088-1f10b4a6f783 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:40.697901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5310260d-5395-4fea-9761-7d53c865f15d tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Calling method '.version_select at 0x7f41ddb9b550>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:40.698893 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:40.698893 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:36:40.700197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5310260d-5395-4fea-9761-7d53c865f15d tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:40.700741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5310260d-5395-4fea-9761-7d53c865f15d tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:40.701237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5310260d-5395-4fea-9761-7d53c865f15d tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:40.715966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5310260d-5395-4fea-9761-7d53c865f15d tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:40.716529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5310260d-5395-4fea-9761-7d53c865f15d tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:40.717028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5310260d-5395-4fea-9761-7d53c865f15d tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:40.728136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5310260d-5395-4fea-9761-7d53c865f15d tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:40.728713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5310260d-5395-4fea-9761-7d53c865f15d tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:40.729211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5310260d-5395-4fea-9761-7d53c865f15d tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:40.736776 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5310260d-5395-4fea-9761-7d53c865f15d tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.183025 Aug 09 14:36:40.737710 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 828/1655] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:40.742373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d57f3085-16ee-46d3-ac41-01ba90fdbe15 req-93f1fa24-9dfc-4f36-b089-c92225d14ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9192b19-8eae-49be-94bd-9a7cb5ace3e0", "name": "network-vif-unplugged", "status": "completed", "tag": "73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e"}, {"name": "network-changed", "server_uuid": "a9192b19-8eae-49be-94bd-9a7cb5ace3e0", "tag": "73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:40.754275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d57f3085-16ee-46d3-ac41-01ba90fdbe15 req-93f1fa24-9dfc-4f36-b089-c92225d14ed3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:40.755005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d57f3085-16ee-46d3-ac41-01ba90fdbe15 req-93f1fa24-9dfc-4f36-b089-c92225d14ed3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:40.755691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d57f3085-16ee-46d3-ac41-01ba90fdbe15 req-93f1fa24-9dfc-4f36-b089-c92225d14ed3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:40.772040 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d57f3085-16ee-46d3-ac41-01ba90fdbe15 req-93f1fa24-9dfc-4f36-b089-c92225d14ed3 service nova] Creating event network-vif-unplugged:73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e for instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 on n-h1-844626-8 Aug 09 14:36:40.772702 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d57f3085-16ee-46d3-ac41-01ba90fdbe15 req-93f1fa24-9dfc-4f36-b089-c92225d14ed3 service nova] Creating event network-changed:73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e for instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 on n-h1-844626-8 Aug 09 14:36:40.778813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-d57f3085-16ee-46d3-ac41-01ba90fdbe15 req-93f1fa24-9dfc-4f36-b089-c92225d14ed3 service nova] Instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 14:36:40.790539 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d57f3085-16ee-46d3-ac41-01ba90fdbe15 req-93f1fa24-9dfc-4f36-b089-c92225d14ed3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.051467 Aug 09 14:36:40.791331 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 829/1656] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:40.960431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87ee1438-6b4d-4a2d-bd2d-f06ada6e29ca tempest-HypervisorAdminNegativeUnderV252Test-1717076813 tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project] Calling method '.version_select at 0x7f41ddb9bca0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:40.962213 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:40.962213 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:36:40.964413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-87ee1438-6b4d-4a2d-bd2d-f06ada6e29ca tempest-HypervisorAdminNegativeUnderV252Test-1717076813 tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '820cf62c419841bfa7b134efcd4b7379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70590e1153c74da38b84571f2b338211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87ee1438-6b4d-4a2d-bd2d-f06ada6e29ca tempest-HypervisorAdminNegativeUnderV252Test-1717076813 tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project] Request method failure captured: Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hypervisors/n-h1-844626-8/search HTTP/1.1 Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nD3QusVcEzaylGwyjW0E_Q6_ItZBRMR06BBiM2PX5DCUap365YlvMu0qf8Kkh-MYf4VuhkKuERScqi8KoLCtOOxITIdp4y4n5Er-tahbK5StWUzGJ9xfr8SQRVimBQiMuz_Hbb8nyVZxN4e9-wxuXDuzlfTdkmNwHtwoS1qehcuxPc Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 70590e1153c74da38b84571f2b338211 Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1717076813 Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_70590e1153c74da38b84571f2b338211", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/70590e1153c74da38b84571f2b338211"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/70590e1153c74da38b84571f2b338211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/70590e1153c74da38b84571f2b338211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1717076813 Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 70590e1153c74da38b84571f2b338211 Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1717076813 Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 820cf62c419841bfa7b134efcd4b7379 Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'n-h1-844626-8'} Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:40.966809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:40.973398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:40.973398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:40.973398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:40.973398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:36:40.973398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:36:40.973398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 09 14:36:40.973398 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:40.975644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87ee1438-6b4d-4a2d-bd2d-f06ada6e29ca tempest-HypervisorAdminNegativeUnderV252Test-1717076813 tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:40.977073 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87ee1438-6b4d-4a2d-bd2d-f06ada6e29ca tempest-HypervisorAdminNegativeUnderV252Test-1717076813 tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/n-h1-844626-8/search" status: 403 len: 117 microversion: 2.1 time: 0.184436 Aug 09 14:36:40.977899 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 830/1657] 10.222.0.50 () {58 vars in 1209 bytes} [Tue Aug 9 14:36:40 2022] GET /compute/v2.1/os-hypervisors/n-h1-844626-8/search => generated 117 bytes in 186 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:40.990112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1670531-1e14-4e9e-8212-8d08d078eeeb tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:40.991606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f1670531-1e14-4e9e-8212-8d08d078eeeb tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:41.003656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1670531-1e14-4e9e-8212-8d08d078eeeb tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:41.004740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1670531-1e14-4e9e-8212-8d08d078eeeb tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:41.006361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1670531-1e14-4e9e-8212-8d08d078eeeb tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:41.007915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1670531-1e14-4e9e-8212-8d08d078eeeb tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:41.008679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1670531-1e14-4e9e-8212-8d08d078eeeb tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:41.009508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1670531-1e14-4e9e-8212-8d08d078eeeb tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:41.163514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:41.216581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6bcf53aa-2b36-40c3-a088-1f10b4a6f783 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:41.224935 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6bcf53aa-2b36-40c3-a088-1f10b4a6f783 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.573583 Aug 09 14:36:41.234891 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 828/1658] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:40 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:41.240617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4b2d95dc-7c83-4975-8e3e-772637d42d73 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:41.241237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4b2d95dc-7c83-4975-8e3e-772637d42d73 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:41.247894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b2d95dc-7c83-4975-8e3e-772637d42d73 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:41.248368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b2d95dc-7c83-4975-8e3e-772637d42d73 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:41.249564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b2d95dc-7c83-4975-8e3e-772637d42d73 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:41.250580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b2d95dc-7c83-4975-8e3e-772637d42d73 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:41.251215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b2d95dc-7c83-4975-8e3e-772637d42d73 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:41.251638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b2d95dc-7c83-4975-8e3e-772637d42d73 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:41.567319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4b2d95dc-7c83-4975-8e3e-772637d42d73 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:41.571780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f1670531-1e14-4e9e-8212-8d08d078eeeb tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:41.576754 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4b2d95dc-7c83-4975-8e3e-772637d42d73 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1324 microversion: 2.1 time: 0.349561 Aug 09 14:36:41.578482 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 829/1659] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:41 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1324 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:41.583971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e6356f7-d8bb-4378-851c-c51bfb4d7a34 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Calling method '.version_select at 0x7f41dd3c65e0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:41.585203 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:41.585203 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:41.586577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6356f7-d8bb-4378-851c-c51bfb4d7a34 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:41.587312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6356f7-d8bb-4378-851c-c51bfb4d7a34 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:41.587958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6356f7-d8bb-4378-851c-c51bfb4d7a34 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:41.590570 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f1670531-1e14-4e9e-8212-8d08d078eeeb tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1682 microversion: 2.1 time: 0.606778 Aug 09 14:36:41.594577 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 831/1660] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:40 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1682 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:41.607541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-296937fb-7164-4e5b-9a42-51f8b974ed1c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:41.607541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-296937fb-7164-4e5b-9a42-51f8b974ed1c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:41.613042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-296937fb-7164-4e5b-9a42-51f8b974ed1c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:41.613714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-296937fb-7164-4e5b-9a42-51f8b974ed1c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:41.614147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-296937fb-7164-4e5b-9a42-51f8b974ed1c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:41.614882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-296937fb-7164-4e5b-9a42-51f8b974ed1c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:41.615368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-296937fb-7164-4e5b-9a42-51f8b974ed1c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:41.615584 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-9e6356f7-d8bb-4378-851c-c51bfb4d7a34 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 09 14:36:41.616440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-296937fb-7164-4e5b-9a42-51f8b974ed1c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e6356f7-d8bb-4378-851c-c51bfb4d7a34 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Request method failure captured: Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nD4FZCCf-km7RjxJaa92tQ0imB_xieRczdy0ODLqM4Znzeg_sZafgvX0fQTJX_6Op1mCNXc9wMieEKWpwenb4-aGplonLusXbnz9YBtork8M8yKqxzrVWnEhku7sHkyrRvShVLS89RUonuhUJe74dqNuxb_BWCedAQmgqmBKnMpqac Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 3c57b06cdad74de89249a44a75064573 Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1853645316 Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c57b06cdad74de89249a44a75064573", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c57b06cdad74de89249a44a75064573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c57b06cdad74de89249a44a75064573"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c57b06cdad74de89249a44a75064573"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1853645316 Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 3c57b06cdad74de89249a44a75064573 Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1853645316 Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: a94b1d642a0547a0988e7a538846fdca Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 09 14:36:41.617655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:41.623376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e6356f7-d8bb-4378-851c-c51bfb4d7a34 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:41.623376 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e6356f7-d8bb-4378-851c-c51bfb4d7a34 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.039349 Aug 09 14:36:41.623376 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 830/1661] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:36:41 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:41.628760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27e87126-7414-4114-b009-1bc52503f5d9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:41.629449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-27e87126-7414-4114-b009-1bc52503f5d9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:41.637683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27e87126-7414-4114-b009-1bc52503f5d9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:41.638172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27e87126-7414-4114-b009-1bc52503f5d9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:41.638606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27e87126-7414-4114-b009-1bc52503f5d9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:41.639446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27e87126-7414-4114-b009-1bc52503f5d9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:41.639915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27e87126-7414-4114-b009-1bc52503f5d9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:41.640339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27e87126-7414-4114-b009-1bc52503f5d9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.028281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-27e87126-7414-4114-b009-1bc52503f5d9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:42.048031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-296937fb-7164-4e5b-9a42-51f8b974ed1c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:42.051465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-27e87126-7414-4114-b009-1bc52503f5d9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:42.053622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-27e87126-7414-4114-b009-1bc52503f5d9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:42.055407 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-27e87126-7414-4114-b009-1bc52503f5d9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1280 microversion: 2.25 time: 0.434543 Aug 09 14:36:42.068278 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-296937fb-7164-4e5b-9a42-51f8b974ed1c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.468350 Aug 09 14:36:42.068548 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 831/1662] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:41 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1280 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:42.068944 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 832/1663] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:41 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:42.077446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c62047be-68c4-4226-abea-0b8b4f7470c9 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:42.078059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c62047be-68c4-4226-abea-0b8b4f7470c9 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:42.081260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-955f8ec4-14f2-4f4f-ba0b-931eb21a8f01 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Calling method '.version_select at 0x7f41ddd7ee50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:42.082267 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:42.082267 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:36:42.083665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-955f8ec4-14f2-4f4f-ba0b-931eb21a8f01 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.084610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-955f8ec4-14f2-4f4f-ba0b-931eb21a8f01 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.086253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-955f8ec4-14f2-4f4f-ba0b-931eb21a8f01 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.092789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c62047be-68c4-4226-abea-0b8b4f7470c9 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.093518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c62047be-68c4-4226-abea-0b8b4f7470c9 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.094211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c62047be-68c4-4226-abea-0b8b4f7470c9 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.095228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c62047be-68c4-4226-abea-0b8b4f7470c9 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.096114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c62047be-68c4-4226-abea-0b8b4f7470c9 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.096773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c62047be-68c4-4226-abea-0b8b4f7470c9 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.107874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-955f8ec4-14f2-4f4f-ba0b-931eb21a8f01 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.108489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-955f8ec4-14f2-4f4f-ba0b-931eb21a8f01 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.109001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-955f8ec4-14f2-4f4f-ba0b-931eb21a8f01 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.123161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-955f8ec4-14f2-4f4f-ba0b-931eb21a8f01 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.123635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-955f8ec4-14f2-4f4f-ba0b-931eb21a8f01 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.124092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-955f8ec4-14f2-4f4f-ba0b-931eb21a8f01 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.132750 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-955f8ec4-14f2-4f4f-ba0b-931eb21a8f01 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.061790 Aug 09 14:36:42.133546 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 833/1664] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:36:42 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:42.138354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88e23dad-59f6-4244-895c-861a31fd4f8d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:42.138968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-88e23dad-59f6-4244-895c-861a31fd4f8d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:42.151610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88e23dad-59f6-4244-895c-861a31fd4f8d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.152113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88e23dad-59f6-4244-895c-861a31fd4f8d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.152549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88e23dad-59f6-4244-895c-861a31fd4f8d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.153266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88e23dad-59f6-4244-895c-861a31fd4f8d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.153730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88e23dad-59f6-4244-895c-861a31fd4f8d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.154155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88e23dad-59f6-4244-895c-861a31fd4f8d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.350150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c62047be-68c4-4226-abea-0b8b4f7470c9 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:42.358627 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c62047be-68c4-4226-abea-0b8b4f7470c9 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1313 microversion: 2.1 time: 0.291978 Aug 09 14:36:42.372785 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 832/1665] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:42 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:42.379427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db7fa0a8-b021-4e1e-93ad-29a0d071a892 tempest-HypervisorAdminNegativeUnderV252Test-1717076813 tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project] Calling method '.version_select at 0x7f41dd1e0310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:42.380265 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:42.380265 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:42.381699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-db7fa0a8-b021-4e1e-93ad-29a0d071a892 tempest-HypervisorAdminNegativeUnderV252Test-1717076813 tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '820cf62c419841bfa7b134efcd4b7379', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70590e1153c74da38b84571f2b338211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db7fa0a8-b021-4e1e-93ad-29a0d071a892 tempest-HypervisorAdminNegativeUnderV252Test-1717076813 tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project] Request method failure captured: Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nD3QusVcEzaylGwyjW0E_Q6_ItZBRMR06BBiM2PX5DCUap365YlvMu0qf8Kkh-MYf4VuhkKuERScqi8KoLCtOOxITIdp4y4n5Er-tahbK5StWUzGJ9xfr8SQRVimBQiMuz_Hbb8nyVZxN4e9-wxuXDuzlfTdkmNwHtwoS1qehcuxPc Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 70590e1153c74da38b84571f2b338211 Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1717076813 Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_70590e1153c74da38b84571f2b338211", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/70590e1153c74da38b84571f2b338211"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/70590e1153c74da38b84571f2b338211"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/70590e1153c74da38b84571f2b338211"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1717076813 Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 70590e1153c74da38b84571f2b338211 Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1717076813 Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 820cf62c419841bfa7b134efcd4b7379 Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '1'} Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:42.384891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:42.389967 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:42.389967 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:42.389967 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:42.389967 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:36:42.389967 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:36:42.389967 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 09 14:36:42.389967 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:42.389967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db7fa0a8-b021-4e1e-93ad-29a0d071a892 tempest-HypervisorAdminNegativeUnderV252Test-1717076813 tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:42.389967 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-db7fa0a8-b021-4e1e-93ad-29a0d071a892 tempest-HypervisorAdminNegativeUnderV252Test-1717076813 tempest-HypervisorAdminNegativeUnderV252Test-1717076813-project] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.012609 Aug 09 14:36:42.389967 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 833/1666] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 9 14:36:42 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:42.399935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0af2a32-8c30-4e7a-a8b5-414aeb6b8e9c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:42.400560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e0af2a32-8c30-4e7a-a8b5-414aeb6b8e9c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:42.418556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-88e23dad-59f6-4244-895c-861a31fd4f8d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:42.426503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0af2a32-8c30-4e7a-a8b5-414aeb6b8e9c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.427251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0af2a32-8c30-4e7a-a8b5-414aeb6b8e9c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.427864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0af2a32-8c30-4e7a-a8b5-414aeb6b8e9c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.428765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0af2a32-8c30-4e7a-a8b5-414aeb6b8e9c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.429487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0af2a32-8c30-4e7a-a8b5-414aeb6b8e9c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.430201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0af2a32-8c30-4e7a-a8b5-414aeb6b8e9c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.437218 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88e23dad-59f6-4244-895c-861a31fd4f8d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1473 microversion: 2.1 time: 0.302924 Aug 09 14:36:42.439677 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 834/1667] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:42 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1473 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:42.453047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-18ad841d-d15e-4af0-9d14-ad6b5387e8a0 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Calling method '.version_select at 0x7f41ddb9b700>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:42.454608 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:42.454608 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:36:42.458981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18ad841d-d15e-4af0-9d14-ad6b5387e8a0 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.459747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18ad841d-d15e-4af0-9d14-ad6b5387e8a0 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.460278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18ad841d-d15e-4af0-9d14-ad6b5387e8a0 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.468239 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-18ad841d-d15e-4af0-9d14-ad6b5387e8a0 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] HTTP exception thrown: No hypervisor matching '599383b6-2bac-4253-994f-7e776971250e' could be found. Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-18ad841d-d15e-4af0-9d14-ad6b5387e8a0 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Request method failure captured: Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-hypervisors/599383b6-2bac-4253-994f-7e776971250e/servers HTTP/1.1 Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nD4FZCCf-km7RjxJaa92tQ0imB_xieRczdy0ODLqM4Znzeg_sZafgvX0fQTJX_6Op1mCNXc9wMieEKWpwenb4-aGplonLusXbnz9YBtork8M8yKqxzrVWnEhku7sHkyrRvShVLS89RUonuhUJe74dqNuxb_BWCedAQmgqmBKnMpqac Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 3c57b06cdad74de89249a44a75064573 Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1853645316 Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c57b06cdad74de89249a44a75064573", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c57b06cdad74de89249a44a75064573"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c57b06cdad74de89249a44a75064573"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c57b06cdad74de89249a44a75064573"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1853645316 Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 3c57b06cdad74de89249a44a75064573 Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1853645316 Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: a94b1d642a0547a0988e7a538846fdca Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: exception: No hypervisor matching '599383b6-2bac-4253-994f-7e776971250e' could be found. Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '599383b6-2bac-4253-994f-7e776971250e'} Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '599383b6-2bac-4253-994f-7e776971250e' could be found. Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '599383b6-2bac-4253-994f-7e776971250e' could be found. Aug 09 14:36:42.471356 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:42.476391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-18ad841d-d15e-4af0-9d14-ad6b5387e8a0 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] Returning 404 to user: No hypervisor matching '599383b6-2bac-4253-994f-7e776971250e' could be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:42.477717 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-18ad841d-d15e-4af0-9d14-ad6b5387e8a0 tempest-HypervisorAdminNegativeUnderV252Test-1853645316 tempest-HypervisorAdminNegativeUnderV252Test-1853645316-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors/599383b6-2bac-4253-994f-7e776971250e/servers" status: 404 len: 123 microversion: 2.1 time: 0.036615 Aug 09 14:36:42.478434 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 835/1668] 10.222.0.50 () {58 vars in 1281 bytes} [Tue Aug 9 14:36:42 2022] GET /compute/v2.1/os-hypervisors/599383b6-2bac-4253-994f-7e776971250e/servers => generated 123 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:42.598965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99591bd6-358e-4373-b198-4a5cff3c5925 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:42.601074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-99591bd6-358e-4373-b198-4a5cff3c5925 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:42.616059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99591bd6-358e-4373-b198-4a5cff3c5925 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.621481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99591bd6-358e-4373-b198-4a5cff3c5925 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.622160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99591bd6-358e-4373-b198-4a5cff3c5925 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.623950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99591bd6-358e-4373-b198-4a5cff3c5925 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.627509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99591bd6-358e-4373-b198-4a5cff3c5925 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.628728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99591bd6-358e-4373-b198-4a5cff3c5925 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.800075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e0af2a32-8c30-4e7a-a8b5-414aeb6b8e9c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:42.811796 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0af2a32-8c30-4e7a-a8b5-414aeb6b8e9c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1354 microversion: 2.1 time: 0.416890 Aug 09 14:36:42.812398 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 834/1669] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:42 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1354 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:42.825520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9634dc1f-b999-423c-b698-c57caa714417 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:42.825520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9634dc1f-b999-423c-b698-c57caa714417 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:42.839927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9634dc1f-b999-423c-b698-c57caa714417 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.840579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9634dc1f-b999-423c-b698-c57caa714417 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.841125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9634dc1f-b999-423c-b698-c57caa714417 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.847935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9634dc1f-b999-423c-b698-c57caa714417 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:42.851567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9634dc1f-b999-423c-b698-c57caa714417 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:42.852021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9634dc1f-b999-423c-b698-c57caa714417 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:42.899746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-99591bd6-358e-4373-b198-4a5cff3c5925 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:42.910059 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-99591bd6-358e-4373-b198-4a5cff3c5925 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1324 microversion: 2.1 time: 0.314937 Aug 09 14:36:42.911166 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 836/1670] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:42 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1324 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:36:43.060855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1ce40920-fa71-4e70-92cf-42452d98ba55 req-6d4c4907-bc8d-4325-9fcd-7a48b4d0f4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a158321c-16c9-4d13-a869-5fe62e776295", "name": "network-vif-plugged", "status": "completed", "tag": "d1ea82ad-9d17-40d8-9de6-0db3f4198af1"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:43.079353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1ce40920-fa71-4e70-92cf-42452d98ba55 req-6d4c4907-bc8d-4325-9fcd-7a48b4d0f4eb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.083837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1ce40920-fa71-4e70-92cf-42452d98ba55 req-6d4c4907-bc8d-4325-9fcd-7a48b4d0f4eb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.084480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1ce40920-fa71-4e70-92cf-42452d98ba55 req-6d4c4907-bc8d-4325-9fcd-7a48b4d0f4eb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:43.114042 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1ce40920-fa71-4e70-92cf-42452d98ba55 req-6d4c4907-bc8d-4325-9fcd-7a48b4d0f4eb service nova] Creating event network-vif-plugged:d1ea82ad-9d17-40d8-9de6-0db3f4198af1 for instance a158321c-16c9-4d13-a869-5fe62e776295 on n-h1-844626-8 Aug 09 14:36:43.128990 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1ce40920-fa71-4e70-92cf-42452d98ba55 req-6d4c4907-bc8d-4325-9fcd-7a48b4d0f4eb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072710 Aug 09 14:36:43.130014 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 837/1671] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:36:43.139583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd6b5f0d-1db4-4a3b-b13d-8d10a7620be2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:43.141625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd6b5f0d-1db4-4a3b-b13d-8d10a7620be2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:43.159793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd6b5f0d-1db4-4a3b-b13d-8d10a7620be2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.160602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd6b5f0d-1db4-4a3b-b13d-8d10a7620be2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.161452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd6b5f0d-1db4-4a3b-b13d-8d10a7620be2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:43.162420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd6b5f0d-1db4-4a3b-b13d-8d10a7620be2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.163135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd6b5f0d-1db4-4a3b-b13d-8d10a7620be2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.163668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd6b5f0d-1db4-4a3b-b13d-8d10a7620be2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:43.170022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:43.175030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9634dc1f-b999-423c-b698-c57caa714417 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:43.185365 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9634dc1f-b999-423c-b698-c57caa714417 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 200 len: 1682 microversion: 2.1 time: 0.371925 Aug 09 14:36:43.186570 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 835/1672] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:42 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 1682 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:43.191960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-209f8752-a18c-4a6c-bc2f-3fce320125a5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:43.192817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-209f8752-a18c-4a6c-bc2f-3fce320125a5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:43.208953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-209f8752-a18c-4a6c-bc2f-3fce320125a5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.209689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-209f8752-a18c-4a6c-bc2f-3fce320125a5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.210269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-209f8752-a18c-4a6c-bc2f-3fce320125a5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:43.211110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-209f8752-a18c-4a6c-bc2f-3fce320125a5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.211754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-209f8752-a18c-4a6c-bc2f-3fce320125a5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.212325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-209f8752-a18c-4a6c-bc2f-3fce320125a5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:43.389257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fd6b5f0d-1db4-4a3b-b13d-8d10a7620be2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:43.400244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fd6b5f0d-1db4-4a3b-b13d-8d10a7620be2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:43.403807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fd6b5f0d-1db4-4a3b-b13d-8d10a7620be2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:43.405105 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd6b5f0d-1db4-4a3b-b13d-8d10a7620be2 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1476 microversion: 2.25 time: 0.273699 Aug 09 14:36:43.405695 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 838/1673] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:43 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1476 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:43.414998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-76b68c33-a24e-4688-9a0b-5fc5757ea22f tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:43.418817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-76b68c33-a24e-4688-9a0b-5fc5757ea22f tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:43.449243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76b68c33-a24e-4688-9a0b-5fc5757ea22f tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.451207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76b68c33-a24e-4688-9a0b-5fc5757ea22f tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.451707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76b68c33-a24e-4688-9a0b-5fc5757ea22f tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:43.452585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76b68c33-a24e-4688-9a0b-5fc5757ea22f tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.454889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76b68c33-a24e-4688-9a0b-5fc5757ea22f tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.455518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76b68c33-a24e-4688-9a0b-5fc5757ea22f tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:43.493132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-209f8752-a18c-4a6c-bc2f-3fce320125a5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:43.505420 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-209f8752-a18c-4a6c-bc2f-3fce320125a5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.317049 Aug 09 14:36:43.508481 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 836/1674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:43 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:43.528492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e8c6191-b08b-4ced-9c4a-4a99304af070 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:43.529279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e8c6191-b08b-4ced-9c4a-4a99304af070 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:43.537412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e8c6191-b08b-4ced-9c4a-4a99304af070 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.538375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e8c6191-b08b-4ced-9c4a-4a99304af070 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.538991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e8c6191-b08b-4ced-9c4a-4a99304af070 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:43.540110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e8c6191-b08b-4ced-9c4a-4a99304af070 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.541371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e8c6191-b08b-4ced-9c4a-4a99304af070 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.542820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e8c6191-b08b-4ced-9c4a-4a99304af070 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:43.884470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-76b68c33-a24e-4688-9a0b-5fc5757ea22f tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:43.898561 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-76b68c33-a24e-4688-9a0b-5fc5757ea22f tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1313 microversion: 2.1 time: 0.491760 Aug 09 14:36:43.911969 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 839/1675] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:43 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1313 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:43.911969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-285eb18c-c7a9-4b65-85a9-1e6a7d2248fc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:43.911969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-285eb18c-c7a9-4b65-85a9-1e6a7d2248fc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:43.912631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-5e8c6191-b08b-4ced-9c4a-4a99304af070 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 268d8e06-f80e-4f5e-8710-578f4eef5bab {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:36:43.917278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:43.921912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-285eb18c-c7a9-4b65-85a9-1e6a7d2248fc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.925452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-285eb18c-c7a9-4b65-85a9-1e6a7d2248fc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.926812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-285eb18c-c7a9-4b65-85a9-1e6a7d2248fc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:43.928193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-285eb18c-c7a9-4b65-85a9-1e6a7d2248fc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.931455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-285eb18c-c7a9-4b65-85a9-1e6a7d2248fc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.934369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-285eb18c-c7a9-4b65-85a9-1e6a7d2248fc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:43.956269 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e8c6191-b08b-4ced-9c4a-4a99304af070 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1968 microversion: 2.25 time: 0.446026 Aug 09 14:36:43.956888 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 837/1676] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:43 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1968 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:43.966389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cb2801eb-a054-4e00-9f64-71b2c15eef6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:43.967115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cb2801eb-a054-4e00-9f64-71b2c15eef6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:43.986779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb2801eb-a054-4e00-9f64-71b2c15eef6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.987309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb2801eb-a054-4e00-9f64-71b2c15eef6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.992325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb2801eb-a054-4e00-9f64-71b2c15eef6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:43.994633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb2801eb-a054-4e00-9f64-71b2c15eef6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:43.996762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb2801eb-a054-4e00-9f64-71b2c15eef6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:43.997881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb2801eb-a054-4e00-9f64-71b2c15eef6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:44.320201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cb2801eb-a054-4e00-9f64-71b2c15eef6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:44.328186 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cb2801eb-a054-4e00-9f64-71b2c15eef6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1801 microversion: 2.1 time: 0.367069 Aug 09 14:36:44.329154 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 838/1677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:43 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1801 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:44.335529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-490ac12e-feb6-4a89-a06c-bbe39838485f tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:44.337903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-490ac12e-feb6-4a89-a06c-bbe39838485f tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:44.348464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-490ac12e-feb6-4a89-a06c-bbe39838485f tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:44.349461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-490ac12e-feb6-4a89-a06c-bbe39838485f tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:44.350819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-490ac12e-feb6-4a89-a06c-bbe39838485f tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:44.351791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-490ac12e-feb6-4a89-a06c-bbe39838485f tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:44.352425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-490ac12e-feb6-4a89-a06c-bbe39838485f tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:44.352849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-490ac12e-feb6-4a89-a06c-bbe39838485f tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:44.658712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-285eb18c-c7a9-4b65-85a9-1e6a7d2248fc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:44.667455 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-285eb18c-c7a9-4b65-85a9-1e6a7d2248fc tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1473 microversion: 2.1 time: 0.767018 Aug 09 14:36:44.668372 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 840/1678] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:43 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1473 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:44.676513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b6265b3b-bfa0-4fad-939b-704bbfe52d90 req-90515afe-5307-438c-8f88-0cc6ab28e6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff8a0577-e7e0-414e-b847-d01ecbd5eb4d", "name": "network-vif-deleted", "tag": "0d7b7ce8-4490-4536-b279-18fbab70b99a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:44.687299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b6265b3b-bfa0-4fad-939b-704bbfe52d90 req-90515afe-5307-438c-8f88-0cc6ab28e6d9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:44.688101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b6265b3b-bfa0-4fad-939b-704bbfe52d90 req-90515afe-5307-438c-8f88-0cc6ab28e6d9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:44.688567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b6265b3b-bfa0-4fad-939b-704bbfe52d90 req-90515afe-5307-438c-8f88-0cc6ab28e6d9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:44.701262 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b6265b3b-bfa0-4fad-939b-704bbfe52d90 req-90515afe-5307-438c-8f88-0cc6ab28e6d9 service nova] Creating event network-vif-deleted:0d7b7ce8-4490-4536-b279-18fbab70b99a for instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d on n-h2-844626-8 Aug 09 14:36:44.707324 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b6265b3b-bfa0-4fad-939b-704bbfe52d90 req-90515afe-5307-438c-8f88-0cc6ab28e6d9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037424 Aug 09 14:36:44.708667 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 841/1679] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:44.716817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b04419ad-eae0-4a12-8afa-c42b7fa3a58a tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:44.717888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b04419ad-eae0-4a12-8afa-c42b7fa3a58a tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:44.725381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04419ad-eae0-4a12-8afa-c42b7fa3a58a tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:44.726375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04419ad-eae0-4a12-8afa-c42b7fa3a58a tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:44.726690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-490ac12e-feb6-4a89-a06c-bbe39838485f tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:44.727429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04419ad-eae0-4a12-8afa-c42b7fa3a58a tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:44.728374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04419ad-eae0-4a12-8afa-c42b7fa3a58a tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:44.729067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04419ad-eae0-4a12-8afa-c42b7fa3a58a tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:44.729724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04419ad-eae0-4a12-8afa-c42b7fa3a58a tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:44.742370 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-490ac12e-feb6-4a89-a06c-bbe39838485f tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1324 microversion: 2.1 time: 0.411904 Aug 09 14:36:44.743944 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 839/1680] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:44 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1324 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:44.754421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34780e33-0a01-45f0-bf70-2871366b2232 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:44.755378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34780e33-0a01-45f0-bf70-2871366b2232 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:44.762235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34780e33-0a01-45f0-bf70-2871366b2232 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:44.763277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34780e33-0a01-45f0-bf70-2871366b2232 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:44.764130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34780e33-0a01-45f0-bf70-2871366b2232 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:44.765105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34780e33-0a01-45f0-bf70-2871366b2232 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:44.766024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34780e33-0a01-45f0-bf70-2871366b2232 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:44.767273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34780e33-0a01-45f0-bf70-2871366b2232 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:44.783970 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-34780e33-0a01-45f0-bf70-2871366b2232 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34780e33-0a01-45f0-bf70-2871366b2232 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d HTTP/1.1 Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'ff8a0577-e7e0-414e-b847-d01ecbd5eb4d'} Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:44.785876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:44.791961 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:44.791961 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:44.791961 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:44.791961 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:44.791961 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:44.791961 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:36:44.791961 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:44.791961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34780e33-0a01-45f0-bf70-2871366b2232 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 404 to user: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:44.791961 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34780e33-0a01-45f0-bf70-2871366b2232 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 404 len: 111 microversion: 2.1 time: 0.042347 Aug 09 14:36:44.791961 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 840/1681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:44 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:44.799586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d343601f-162e-4822-a893-cb03155a7712 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:44.800191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d343601f-162e-4822-a893-cb03155a7712 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:44.807106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d343601f-162e-4822-a893-cb03155a7712 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:44.807685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d343601f-162e-4822-a893-cb03155a7712 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:44.808192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d343601f-162e-4822-a893-cb03155a7712 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:44.808989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d343601f-162e-4822-a893-cb03155a7712 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:44.809508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d343601f-162e-4822-a893-cb03155a7712 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:44.810185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d343601f-162e-4822-a893-cb03155a7712 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:44.838924 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d343601f-162e-4822-a893-cb03155a7712 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900/ips" status: 200 len: 215 microversion: 2.1 time: 0.045955 Aug 09 14:36:44.839694 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 841/1682] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:36:44 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900/ips => generated 215 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:44.846637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efcede96-0168-4aea-b05d-55b86f8826a4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:44.847338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-efcede96-0168-4aea-b05d-55b86f8826a4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:44.854370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efcede96-0168-4aea-b05d-55b86f8826a4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:44.854970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efcede96-0168-4aea-b05d-55b86f8826a4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:44.855760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efcede96-0168-4aea-b05d-55b86f8826a4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:44.856946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efcede96-0168-4aea-b05d-55b86f8826a4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:44.857703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efcede96-0168-4aea-b05d-55b86f8826a4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:44.858177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efcede96-0168-4aea-b05d-55b86f8826a4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:45.515696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-b04419ad-eae0-4a12-8afa-c42b7fa3a58a tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 268d8e06-f80e-4f5e-8710-578f4eef5bab {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:36:45.529942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-efcede96-0168-4aea-b05d-55b86f8826a4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:45.539541 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b04419ad-eae0-4a12-8afa-c42b7fa3a58a tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1968 microversion: 2.25 time: 0.829344 Aug 09 14:36:45.539762 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-efcede96-0168-4aea-b05d-55b86f8826a4 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.698863 Aug 09 14:36:45.540213 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 842/1683] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:44 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:45.551299 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 842/1684] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:44 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1968 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:45.558217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d4cf731-77e2-4d6e-b697-ffa3bf47bf8e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '.version_select at 0x7f41ddb09670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:45.559512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c59f7182-94ab-4da9-a41e-bc7ad9bad840 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:45.560207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c59f7182-94ab-4da9-a41e-bc7ad9bad840 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:45.567430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c59f7182-94ab-4da9-a41e-bc7ad9bad840 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:45.568138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c59f7182-94ab-4da9-a41e-bc7ad9bad840 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:45.569003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c59f7182-94ab-4da9-a41e-bc7ad9bad840 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:45.570173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c59f7182-94ab-4da9-a41e-bc7ad9bad840 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:45.570847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c59f7182-94ab-4da9-a41e-bc7ad9bad840 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:45.571518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c59f7182-94ab-4da9-a41e-bc7ad9bad840 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:45.587317 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d4cf731-77e2-4d6e-b697-ffa3bf47bf8e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-907006119" status: 202 len: 0 microversion: 2.1 time: 0.041345 Aug 09 14:36:45.587959 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 843/1685] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 9 14:36:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-907006119 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:36:45.618871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-108bc2e8-6782-491a-a178-71d07f26732c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:45.620655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-108bc2e8-6782-491a-a178-71d07f26732c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:45.622935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c59f7182-94ab-4da9-a41e-bc7ad9bad840 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:36:45.628348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-108bc2e8-6782-491a-a178-71d07f26732c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:45.628842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-108bc2e8-6782-491a-a178-71d07f26732c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:45.629872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-108bc2e8-6782-491a-a178-71d07f26732c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:45.630935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-108bc2e8-6782-491a-a178-71d07f26732c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:45.631417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-108bc2e8-6782-491a-a178-71d07f26732c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:45.631882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-108bc2e8-6782-491a-a178-71d07f26732c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:45.792285 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c59f7182-94ab-4da9-a41e-bc7ad9bad840 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 204 len: 0 microversion: 2.1 time: 0.239342 Aug 09 14:36:45.798012 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 843/1686] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:36:45 2022] DELETE /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:36:45.803507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3074c17f-0c7d-4233-b928-ebe6993f990c req-a4eaea35-9d24-43b0-9b5c-c25a2184a30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bca7020-9984-4d3f-bbaa-9b08bb396e45", "name": "network-vif-plugged", "status": "completed", "tag": "6a96fb4b-302c-4503-9633-e8019d37935e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:45.813816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3074c17f-0c7d-4233-b928-ebe6993f990c req-a4eaea35-9d24-43b0-9b5c-c25a2184a30c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:45.814618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3074c17f-0c7d-4233-b928-ebe6993f990c req-a4eaea35-9d24-43b0-9b5c-c25a2184a30c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:45.815254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3074c17f-0c7d-4233-b928-ebe6993f990c req-a4eaea35-9d24-43b0-9b5c-c25a2184a30c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:45.831509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:45.834528 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3074c17f-0c7d-4233-b928-ebe6993f990c req-a4eaea35-9d24-43b0-9b5c-c25a2184a30c service nova] Creating event network-vif-plugged:6a96fb4b-302c-4503-9633-e8019d37935e for instance 0bca7020-9984-4d3f-bbaa-9b08bb396e45 on n-h1-844626-8 Aug 09 14:36:45.841500 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3074c17f-0c7d-4233-b928-ebe6993f990c req-a4eaea35-9d24-43b0-9b5c-c25a2184a30c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041649 Aug 09 14:36:45.843127 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 844/1687] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:45.852720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96469f2d-867e-4bd9-a651-716b7db46acd tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:45.867586 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:36:45.867586 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:36:45.869654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96469f2d-867e-4bd9-a651-716b7db46acd tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:45.871123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96469f2d-867e-4bd9-a651-716b7db46acd tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:45.871856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96469f2d-867e-4bd9-a651-716b7db46acd tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:45.872898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96469f2d-867e-4bd9-a651-716b7db46acd tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:45.873593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96469f2d-867e-4bd9-a651-716b7db46acd tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:45.874292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96469f2d-867e-4bd9-a651-716b7db46acd tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:45.922473 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-96469f2d-867e-4bd9-a651-716b7db46acd tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.077398 Aug 09 14:36:45.928114 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 845/1688] 10.222.0.50 () {60 vars in 1217 bytes} [Tue Aug 9 14:36:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:36:45.939685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b444fc4e-135e-4a07-a295-4e344196572c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:45.941386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b444fc4e-135e-4a07-a295-4e344196572c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:45.950201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b444fc4e-135e-4a07-a295-4e344196572c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:45.950770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b444fc4e-135e-4a07-a295-4e344196572c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:45.952068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b444fc4e-135e-4a07-a295-4e344196572c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:45.953706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b444fc4e-135e-4a07-a295-4e344196572c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:45.954312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b444fc4e-135e-4a07-a295-4e344196572c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:45.954876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b444fc4e-135e-4a07-a295-4e344196572c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:45.998049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-108bc2e8-6782-491a-a178-71d07f26732c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:46.016151 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-108bc2e8-6782-491a-a178-71d07f26732c tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1313 microversion: 2.1 time: 0.405108 Aug 09 14:36:46.017054 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 844/1689] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:45 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:46.023808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b2a5e7b-62b4-4e86-8cbe-2b5e0da9a97e tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:46.024679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b2a5e7b-62b4-4e86-8cbe-2b5e0da9a97e tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:46.037760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b2a5e7b-62b4-4e86-8cbe-2b5e0da9a97e tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:46.038530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b2a5e7b-62b4-4e86-8cbe-2b5e0da9a97e tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:46.041568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b2a5e7b-62b4-4e86-8cbe-2b5e0da9a97e tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:46.042526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b2a5e7b-62b4-4e86-8cbe-2b5e0da9a97e tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:46.044270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b2a5e7b-62b4-4e86-8cbe-2b5e0da9a97e tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:46.044919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b2a5e7b-62b4-4e86-8cbe-2b5e0da9a97e tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:46.278224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b444fc4e-135e-4a07-a295-4e344196572c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:46.292498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9b2a5e7b-62b4-4e86-8cbe-2b5e0da9a97e tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:46.293346 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b444fc4e-135e-4a07-a295-4e344196572c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1470 microversion: 2.1 time: 0.362660 Aug 09 14:36:46.294956 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 846/1690] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:45 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1470 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:46.300076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:46.308541 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b2a5e7b-62b4-4e86-8cbe-2b5e0da9a97e tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1520 microversion: 2.1 time: 0.290233 Aug 09 14:36:46.322803 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 845/1691] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:46 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:46.322803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3d8f7ec-a2f5-4142-a29e-64203a61595b tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844626-8", "block_migration": "auto"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:46.324581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3d8f7ec-a2f5-4142-a29e-64203a61595b tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:46.326587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ada08ecc-e6c1-47ef-9da5-27101de616a1 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:46.328129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ada08ecc-e6c1-47ef-9da5-27101de616a1 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:46.333617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3d8f7ec-a2f5-4142-a29e-64203a61595b tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:46.334107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3d8f7ec-a2f5-4142-a29e-64203a61595b tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:46.334536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3d8f7ec-a2f5-4142-a29e-64203a61595b tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:46.335279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3d8f7ec-a2f5-4142-a29e-64203a61595b tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:46.335739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3d8f7ec-a2f5-4142-a29e-64203a61595b tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:46.336155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3d8f7ec-a2f5-4142-a29e-64203a61595b tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:46.345462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ada08ecc-e6c1-47ef-9da5-27101de616a1 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:46.346378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ada08ecc-e6c1-47ef-9da5-27101de616a1 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:46.347150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ada08ecc-e6c1-47ef-9da5-27101de616a1 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:46.349508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ada08ecc-e6c1-47ef-9da5-27101de616a1 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:46.350576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ada08ecc-e6c1-47ef-9da5-27101de616a1 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:46.351634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ada08ecc-e6c1-47ef-9da5-27101de616a1 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:46.377486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-b3d8f7ec-a2f5-4142-a29e-64203a61595b tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'flavor' on Instance uuid 268d8e06-f80e-4f5e-8710-578f4eef5bab {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:36:46.419631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3d8f7ec-a2f5-4142-a29e-64203a61595b tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Going to try to live migrate instance to n-h1-844626-8 {{(pid=119406) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 14:36:46.626332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ada08ecc-e6c1-47ef-9da5-27101de616a1 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:46.641562 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ada08ecc-e6c1-47ef-9da5-27101de616a1 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1807 microversion: 2.1 time: 0.343962 Aug 09 14:36:46.642585 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 847/1692] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:46 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1807 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:46.651163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5caf528c-63aa-4ca9-a8be-9bbbe751f258 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:46.652083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5caf528c-63aa-4ca9-a8be-9bbbe751f258 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:46.669139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5caf528c-63aa-4ca9-a8be-9bbbe751f258 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:46.670696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5caf528c-63aa-4ca9-a8be-9bbbe751f258 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:46.671710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5caf528c-63aa-4ca9-a8be-9bbbe751f258 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:46.673046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5caf528c-63aa-4ca9-a8be-9bbbe751f258 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:46.674279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5caf528c-63aa-4ca9-a8be-9bbbe751f258 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:46.674926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5caf528c-63aa-4ca9-a8be-9bbbe751f258 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:46.822179 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5caf528c-63aa-4ca9-a8be-9bbbe751f258 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "POST /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0/action" status: 202 len: 0 microversion: 2.1 time: 0.178029 Aug 09 14:36:46.823163 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 848/1693] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:36:46 2022] POST /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:36:46.829885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0015520-b773-45f2-808d-c1d5f66c640d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:46.830830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0015520-b773-45f2-808d-c1d5f66c640d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:46.838595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0015520-b773-45f2-808d-c1d5f66c640d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:46.839071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0015520-b773-45f2-808d-c1d5f66c640d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:46.839531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0015520-b773-45f2-808d-c1d5f66c640d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:46.840651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0015520-b773-45f2-808d-c1d5f66c640d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:46.841603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0015520-b773-45f2-808d-c1d5f66c640d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:46.841603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0015520-b773-45f2-808d-c1d5f66c640d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:46.874573 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-f0015520-b773-45f2-808d-c1d5f66c640d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] HTTP exception thrown: Action 999 not found Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0015520-b773-45f2-808d-c1d5f66c640d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Request method failure captured: Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295/os-instance-actions/999 HTTP/1.1 Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nDsPVLIFbA8Qwq5e6Al4r8MNkmzTbosfgImfQAF2p9M9eSpKFOza6qSuP5vr0xf7xNPEroSWWZPZec6BjmT6WyvFuMAff31S4xTn2EZMFE2P-p8j0TNqQmMVQNwQY5o8sND2N2FkZ2-EZOZH--vEJPYGCkGYZa0K-R-0zJravRjQII Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 8ce04a888a334631a8431dd8782211f2 Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1744263224 Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8ce04a888a334631a8431dd8782211f2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8ce04a888a334631a8431dd8782211f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ce04a888a334631a8431dd8782211f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ce04a888a334631a8431dd8782211f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1744263224 Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 8ce04a888a334631a8431dd8782211f2 Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1744263224 Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-InstanceActionsNegativeTestJSON-1744263224-project Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 894752596caa444c95cadf2b8dd38243 Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1744263224-project Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: exception: Action 999 not found Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'server_id': 'a158321c-16c9-4d13-a869-5fe62e776295', 'id': '999'} Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 09 14:36:46.878734 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:46.886923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0015520-b773-45f2-808d-c1d5f66c640d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Returning 404 to user: Action 999 not found {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:46.886923 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0015520-b773-45f2-808d-c1d5f66c640d tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.056280 Aug 09 14:36:46.886923 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 849/1694] 10.222.0.50 () {58 vars in 1308 bytes} [Tue Aug 9 14:36:46 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295/os-instance-actions/999 => generated 66 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:36:46.890274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aa5328e8-8909-4215-b5ed-ad26f9deac42 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:46.890903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aa5328e8-8909-4215-b5ed-ad26f9deac42 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:46.897685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa5328e8-8909-4215-b5ed-ad26f9deac42 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:46.898193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa5328e8-8909-4215-b5ed-ad26f9deac42 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:46.898618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa5328e8-8909-4215-b5ed-ad26f9deac42 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:46.899431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa5328e8-8909-4215-b5ed-ad26f9deac42 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:46.899877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa5328e8-8909-4215-b5ed-ad26f9deac42 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:46.901854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa5328e8-8909-4215-b5ed-ad26f9deac42 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:47.055924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aa5328e8-8909-4215-b5ed-ad26f9deac42 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:47.069108 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aa5328e8-8909-4215-b5ed-ad26f9deac42 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1717 microversion: 2.1 time: 0.186533 Aug 09 14:36:47.070187 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 850/1695] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:46 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:47.078356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-45dbac5b-c241-45d3-a193-5ef82421c7e9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: .version_select at 0x7f41dd1c9670>, body: {"keypair": {"name": "tempest-keypair-806116061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNgDQT7e0XpYUnZR53TY2IuyKaLz0UxDzXdT5ZqsjC1DnBNdV+9Ku1SkHu9UTuoFnPAVDQuwr1GTZhknREPzuFwtKZTQRubjCm0CMMLJlbYxGZOW4B2c+1icZo7ZwO+CA=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:47.101618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-45dbac5b-c241-45d3-a193-5ef82421c7e9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:36:47.107401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-45dbac5b-c241-45d3-a193-5ef82421c7e9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for user 788fc5ec92a2482db1b27657c4f6b426 and project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:36:47.149182 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-45dbac5b-c241-45d3-a193-5ef82421c7e9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077228 Aug 09 14:36:47.150880 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 851/1696] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:36:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:47.157808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5f690d09-c03b-46d0-8cb1-75f5738a8b6d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:47.159469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5f690d09-c03b-46d0-8cb1-75f5738a8b6d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:47.167809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f690d09-c03b-46d0-8cb1-75f5738a8b6d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:47.168302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f690d09-c03b-46d0-8cb1-75f5738a8b6d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:47.168738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f690d09-c03b-46d0-8cb1-75f5738a8b6d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:47.169648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f690d09-c03b-46d0-8cb1-75f5738a8b6d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:47.170109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f690d09-c03b-46d0-8cb1-75f5738a8b6d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:47.170566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f690d09-c03b-46d0-8cb1-75f5738a8b6d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:47.499349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5f690d09-c03b-46d0-8cb1-75f5738a8b6d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:47.514792 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5f690d09-c03b-46d0-8cb1-75f5738a8b6d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1469 microversion: 2.1 time: 0.360872 Aug 09 14:36:47.515933 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 852/1697] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:47 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1469 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:47.545676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5360c31d-705c-430a-8618-910e3755961a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '.version_select at 0x7f41dd349dc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:47.547191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5360c31d-705c-430a-8618-910e3755961a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: 2511fd1c-8407-4d8e-9049-29a0b26c75a9] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:47.563723 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-5360c31d-705c-430a-8618-910e3755961a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] HTTP exception thrown: Instance 2511fd1c-8407-4d8e-9049-29a0b26c75a9 could not be found. Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5360c31d-705c-430a-8618-910e3755961a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Request method failure captured: Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/2511fd1c-8407-4d8e-9049-29a0b26c75a9/os-instance-actions HTTP/1.1 Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nDsPVLIFbA8Qwq5e6Al4r8MNkmzTbosfgImfQAF2p9M9eSpKFOza6qSuP5vr0xf7xNPEroSWWZPZec6BjmT6WyvFuMAff31S4xTn2EZMFE2P-p8j0TNqQmMVQNwQY5o8sND2N2FkZ2-EZOZH--vEJPYGCkGYZa0K-R-0zJravRjQII Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 8ce04a888a334631a8431dd8782211f2 Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1744263224 Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8ce04a888a334631a8431dd8782211f2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8ce04a888a334631a8431dd8782211f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ce04a888a334631a8431dd8782211f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ce04a888a334631a8431dd8782211f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1744263224 Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 8ce04a888a334631a8431dd8782211f2 Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1744263224 Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-InstanceActionsNegativeTestJSON-1744263224-project Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 894752596caa444c95cadf2b8dd38243 Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1744263224-project Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 2511fd1c-8407-4d8e-9049-29a0b26c75a9 could not be found. Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'server_id': '2511fd1c-8407-4d8e-9049-29a0b26c75a9'} Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2511fd1c-8407-4d8e-9049-29a0b26c75a9 could not be found. Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:36:47.566512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2511fd1c-8407-4d8e-9049-29a0b26c75a9 could not be found. Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2511fd1c-8407-4d8e-9049-29a0b26c75a9 could not be found. Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5360c31d-705c-430a-8618-910e3755961a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Returning 404 to user: Instance 2511fd1c-8407-4d8e-9049-29a0b26c75a9 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:47.572948 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5360c31d-705c-430a-8618-910e3755961a tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/2511fd1c-8407-4d8e-9049-29a0b26c75a9/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.048022 Aug 09 14:36:47.575530 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 853/1698] 10.222.0.50 () {58 vars in 1296 bytes} [Tue Aug 9 14:36:47 2022] GET /compute/v2.1/servers/2511fd1c-8407-4d8e-9049-29a0b26c75a9/os-instance-actions => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:47.588571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c7b2e5d-7536-48e0-81cc-808951601bb8 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:47.590312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5c7b2e5d-7536-48e0-81cc-808951601bb8 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:47.606510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c7b2e5d-7536-48e0-81cc-808951601bb8 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:47.607501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c7b2e5d-7536-48e0-81cc-808951601bb8 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:47.608560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c7b2e5d-7536-48e0-81cc-808951601bb8 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:47.609906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c7b2e5d-7536-48e0-81cc-808951601bb8 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:47.610634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c7b2e5d-7536-48e0-81cc-808951601bb8 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:47.611180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c7b2e5d-7536-48e0-81cc-808951601bb8 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:47.964263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c7b2e5d-7536-48e0-81cc-808951601bb8 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:47.977930 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c7b2e5d-7536-48e0-81cc-808951601bb8 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1313 microversion: 2.1 time: 0.401104 Aug 09 14:36:48.008346 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 854/1699] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:47 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:48.011177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-25f6a5a9-132d-41cc-a71f-35a49bfc5935 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:48.011902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-25f6a5a9-132d-41cc-a71f-35a49bfc5935 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:48.023666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25f6a5a9-132d-41cc-a71f-35a49bfc5935 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:48.028180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25f6a5a9-132d-41cc-a71f-35a49bfc5935 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:48.028847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25f6a5a9-132d-41cc-a71f-35a49bfc5935 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:48.030499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25f6a5a9-132d-41cc-a71f-35a49bfc5935 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:48.030969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25f6a5a9-132d-41cc-a71f-35a49bfc5935 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:48.033686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25f6a5a9-132d-41cc-a71f-35a49bfc5935 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:48.071780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-25f6a5a9-132d-41cc-a71f-35a49bfc5935 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:36:48.160206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:48.176011 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-25f6a5a9-132d-41cc-a71f-35a49bfc5935 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 204 len: 0 microversion: 2.1 time: 0.176446 Aug 09 14:36:48.177801 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 855/1700] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:36:47 2022] DELETE /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:36:48.184699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8212aa2-dde0-486a-99cd-22edbbf16cda tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:48.185888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b8212aa2-dde0-486a-99cd-22edbbf16cda tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:48.197207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8212aa2-dde0-486a-99cd-22edbbf16cda tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:48.198155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8212aa2-dde0-486a-99cd-22edbbf16cda tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:48.198838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8212aa2-dde0-486a-99cd-22edbbf16cda tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:48.199671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8212aa2-dde0-486a-99cd-22edbbf16cda tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:48.200736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8212aa2-dde0-486a-99cd-22edbbf16cda tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:48.201216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8212aa2-dde0-486a-99cd-22edbbf16cda tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:48.498190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8212aa2-dde0-486a-99cd-22edbbf16cda tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:48.505687 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8212aa2-dde0-486a-99cd-22edbbf16cda tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1807 microversion: 2.1 time: 0.326299 Aug 09 14:36:48.506560 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 856/1701] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:48 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1807 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:48.527541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-d47a13de-0b77-4ddb-ac3a-a2210e571c8e req-cc2923dd-4a92-499a-b653-e4ae2c749c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9192b19-8eae-49be-94bd-9a7cb5ace3e0", "name": "network-vif-plugged", "status": "completed", "tag": "73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:48.545845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d47a13de-0b77-4ddb-ac3a-a2210e571c8e req-cc2923dd-4a92-499a-b653-e4ae2c749c85 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:48.546803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d47a13de-0b77-4ddb-ac3a-a2210e571c8e req-cc2923dd-4a92-499a-b653-e4ae2c749c85 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:48.547454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d47a13de-0b77-4ddb-ac3a-a2210e571c8e req-cc2923dd-4a92-499a-b653-e4ae2c749c85 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:48.591503 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d47a13de-0b77-4ddb-ac3a-a2210e571c8e req-cc2923dd-4a92-499a-b653-e4ae2c749c85 service nova] Creating event network-vif-plugged:73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e for instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 on n-h1-844626-8 Aug 09 14:36:48.600416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-d47a13de-0b77-4ddb-ac3a-a2210e571c8e req-cc2923dd-4a92-499a-b653-e4ae2c749c85 service nova] Instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 14:36:48.620445 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-d47a13de-0b77-4ddb-ac3a-a2210e571c8e req-cc2923dd-4a92-499a-b653-e4ae2c749c85 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098704 Aug 09 14:36:48.621752 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 857/1702] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:48.627701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b44e213-ce9c-4e1d-9264-a7c3e43a959e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:48.628640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5b44e213-ce9c-4e1d-9264-a7c3e43a959e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:48.643154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b44e213-ce9c-4e1d-9264-a7c3e43a959e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:48.643942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b44e213-ce9c-4e1d-9264-a7c3e43a959e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:48.644552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b44e213-ce9c-4e1d-9264-a7c3e43a959e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:48.645663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b44e213-ce9c-4e1d-9264-a7c3e43a959e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:48.646282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b44e213-ce9c-4e1d-9264-a7c3e43a959e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:48.646930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b44e213-ce9c-4e1d-9264-a7c3e43a959e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:48.755937 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3d8f7ec-a2f5-4142-a29e-64203a61595b tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab/action" status: 202 len: 0 microversion: 2.25 time: 2.439066 Aug 09 14:36:48.756724 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 846/1703] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:36:46 2022] POST /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab/action => generated 0 bytes in 2441 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:36:48.857322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5b44e213-ce9c-4e1d-9264-a7c3e43a959e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:48.867947 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5b44e213-ce9c-4e1d-9264-a7c3e43a959e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1707 microversion: 2.1 time: 0.244761 Aug 09 14:36:48.869270 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 858/1704] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:48 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1707 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:48.874696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c14ecd6a-c6e3-47a1-87c2-3437cb69dc25 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:48.875367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c14ecd6a-c6e3-47a1-87c2-3437cb69dc25 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:48.894770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c14ecd6a-c6e3-47a1-87c2-3437cb69dc25 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:48.895198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c14ecd6a-c6e3-47a1-87c2-3437cb69dc25 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:48.895837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c14ecd6a-c6e3-47a1-87c2-3437cb69dc25 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:48.897427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c14ecd6a-c6e3-47a1-87c2-3437cb69dc25 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:48.898055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c14ecd6a-c6e3-47a1-87c2-3437cb69dc25 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:48.898993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c14ecd6a-c6e3-47a1-87c2-3437cb69dc25 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:48.942765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-340384020", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:48.999275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:36:49.137101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c14ecd6a-c6e3-47a1-87c2-3437cb69dc25 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:49.148886 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c14ecd6a-c6e3-47a1-87c2-3437cb69dc25 tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1526 microversion: 2.1 time: 0.278100 Aug 09 14:36:49.149726 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 859/1705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:48 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1526 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:49.161354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-17ba1a41-48df-4ee2-a61a-d613487dce7e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:49.162043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-17ba1a41-48df-4ee2-a61a-d613487dce7e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:49.169511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17ba1a41-48df-4ee2-a61a-d613487dce7e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:49.169819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17ba1a41-48df-4ee2-a61a-d613487dce7e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:49.170270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17ba1a41-48df-4ee2-a61a-d613487dce7e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:49.171032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17ba1a41-48df-4ee2-a61a-d613487dce7e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:49.171589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17ba1a41-48df-4ee2-a61a-d613487dce7e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:49.172173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17ba1a41-48df-4ee2-a61a-d613487dce7e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:49.276010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:36:49.276483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:36:49.277118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:36:49.277744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:36:49.278405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:36:49.293523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:49.297027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:49.300730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:49.301923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:49.302605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:49.304560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:49.369415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Getting quotas for project 27e653d20943429d8c845d3c9a61f7d8. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:36:49.388046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Getting quotas for user 6c8ac8ccb50b49719fc1cc9f758b11ba and project 27e653d20943429d8c845d3c9a61f7d8. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:36:49.415990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-17ba1a41-48df-4ee2-a61a-d613487dce7e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:49.425265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:49.430655 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-17ba1a41-48df-4ee2-a61a-d613487dce7e tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1469 microversion: 2.1 time: 0.279476 Aug 09 14:36:49.435764 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 860/1706] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:49 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1469 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:49.438989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:36:49.443238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:36:49.449160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-dc4ef3a4-255e-4156-8813-a5dba6b0da8a req-0c91e647-1306-45c1-9236-b8371956933a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0c3435-cbf1-447d-ba66-fbdf16ccc900", "name": "network-vif-deleted", "tag": "355f3c7f-c299-41a4-a805-e747d83a3716"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:49.480666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dc4ef3a4-255e-4156-8813-a5dba6b0da8a req-0c91e647-1306-45c1-9236-b8371956933a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:49.481935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dc4ef3a4-255e-4156-8813-a5dba6b0da8a req-0c91e647-1306-45c1-9236-b8371956933a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:49.483270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dc4ef3a4-255e-4156-8813-a5dba6b0da8a req-0c91e647-1306-45c1-9236-b8371956933a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:49.529476 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-dc4ef3a4-255e-4156-8813-a5dba6b0da8a req-0c91e647-1306-45c1-9236-b8371956933a service nova] Creating event network-vif-deleted:355f3c7f-c299-41a4-a805-e747d83a3716 for instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 on n-h2-844626-8 Aug 09 14:36:49.534857 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-dc4ef3a4-255e-4156-8813-a5dba6b0da8a req-0c91e647-1306-45c1-9236-b8371956933a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097775 Aug 09 14:36:49.541091 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-acdfea1b-79bc-4add-90ba-ec06bea4a7f2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783129 Aug 09 14:36:49.542421 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 847/1707] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:36:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:36:49.547897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f8339cf-d33b-45f3-83ca-9d9468a0e879 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:49.548728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2f8339cf-d33b-45f3-83ca-9d9468a0e879 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:49.555485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f8339cf-d33b-45f3-83ca-9d9468a0e879 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:49.556209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f8339cf-d33b-45f3-83ca-9d9468a0e879 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:49.556805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f8339cf-d33b-45f3-83ca-9d9468a0e879 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:49.558306 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 861/1708] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:49.559621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f8339cf-d33b-45f3-83ca-9d9468a0e879 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:49.560270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f8339cf-d33b-45f3-83ca-9d9468a0e879 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:49.561010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f8339cf-d33b-45f3-83ca-9d9468a0e879 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:49.574360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9e02177-cb72-4a56-87e2-93ea8f814f51 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '.version_select at 0x7f41dd191ee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:49.590750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9e02177-cb72-4a56-87e2-93ea8f814f51 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:49.591275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9e02177-cb72-4a56-87e2-93ea8f814f51 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:49.591713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9e02177-cb72-4a56-87e2-93ea8f814f51 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:49.625529 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a9e02177-cb72-4a56-87e2-93ea8f814f51 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 4275 microversion: 2.1 time: 0.058375 Aug 09 14:36:49.637455 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 862/1709] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:36:49 2022] GET /compute/v2.1/os-migrations => generated 4275 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:49.643358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e4755d5-21b0-4d48-a0f5-896adf1d65a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:49.643838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8e4755d5-21b0-4d48-a0f5-896adf1d65a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:49.650311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e4755d5-21b0-4d48-a0f5-896adf1d65a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:49.650779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e4755d5-21b0-4d48-a0f5-896adf1d65a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:49.651234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e4755d5-21b0-4d48-a0f5-896adf1d65a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:49.651979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e4755d5-21b0-4d48-a0f5-896adf1d65a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:49.652396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e4755d5-21b0-4d48-a0f5-896adf1d65a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:49.652874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e4755d5-21b0-4d48-a0f5-896adf1d65a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:50.038158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8e4755d5-21b0-4d48-a0f5-896adf1d65a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:50.038608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2f8339cf-d33b-45f3-83ca-9d9468a0e879 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:50.054160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2f8339cf-d33b-45f3-83ca-9d9468a0e879 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:50.057944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2f8339cf-d33b-45f3-83ca-9d9468a0e879 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:50.061800 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2f8339cf-d33b-45f3-83ca-9d9468a0e879 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.516654 Aug 09 14:36:50.069497 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8e4755d5-21b0-4d48-a0f5-896adf1d65a0 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1463 microversion: 2.1 time: 0.430821 Aug 09 14:36:50.070421 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 863/1711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:49 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1463 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:50.079631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36b2d310-c4e7-4c76-a3fc-63b35709153d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:50.081655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36b2d310-c4e7-4c76-a3fc-63b35709153d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:50.088634 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 848/1711] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:49 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:50.097656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b2d310-c4e7-4c76-a3fc-63b35709153d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:50.099117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b2d310-c4e7-4c76-a3fc-63b35709153d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:50.099804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b2d310-c4e7-4c76-a3fc-63b35709153d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:50.100729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b2d310-c4e7-4c76-a3fc-63b35709153d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:50.101371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b2d310-c4e7-4c76-a3fc-63b35709153d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:50.101992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b2d310-c4e7-4c76-a3fc-63b35709153d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:50.106976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-462487178", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:50.203935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:36:50.471896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-36b2d310-c4e7-4c76-a3fc-63b35709153d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:50.482213 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36b2d310-c4e7-4c76-a3fc-63b35709153d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 200 len: 1650 microversion: 2.1 time: 0.410445 Aug 09 14:36:50.484862 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 864/1712] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:50 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 1650 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:50.516564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b55d3f26-2912-4bbc-b265-6fd5cd40024a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:50.519044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b55d3f26-2912-4bbc-b265-6fd5cd40024a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:50.542285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b55d3f26-2912-4bbc-b265-6fd5cd40024a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:50.549185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b55d3f26-2912-4bbc-b265-6fd5cd40024a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:50.551559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b55d3f26-2912-4bbc-b265-6fd5cd40024a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:50.555170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b55d3f26-2912-4bbc-b265-6fd5cd40024a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:50.555697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b55d3f26-2912-4bbc-b265-6fd5cd40024a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:50.563707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b55d3f26-2912-4bbc-b265-6fd5cd40024a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:50.812065 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b55d3f26-2912-4bbc-b265-6fd5cd40024a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1858 microversion: 2.1 time: 0.325774 Aug 09 14:36:50.813710 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 865/1713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:50 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1858 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:50.856638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:36:50.857135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:36:50.858272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:36:50.859442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:36:50.859996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:36:50.870728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:50.871525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:50.872127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:50.872845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:50.873373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:50.873927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:50.892920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Getting quotas for project 27e653d20943429d8c845d3c9a61f7d8. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:36:50.898245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Getting quotas for user 6c8ac8ccb50b49719fc1cc9f758b11ba and project 27e653d20943429d8c845d3c9a61f7d8. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:36:50.910725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:36:50.913265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:36:50.976809 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a3eebd85-f46a-49f9-a57b-8a7da269aecf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886613 Aug 09 14:36:50.984474 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 849/1714] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:36:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:36:50.987854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cb6aa51e-5e9d-4397-93af-e1fb6351c729 tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Calling method '.version_select at 0x7f41dd2d3af0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:50.990464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8cb1473b-24c1-43e0-a78e-c2c012ff0deb tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:50.991368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8cb1473b-24c1-43e0-a78e-c2c012ff0deb tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:50.999628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cb1473b-24c1-43e0-a78e-c2c012ff0deb tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:51.000511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cb1473b-24c1-43e0-a78e-c2c012ff0deb tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:51.001147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cb1473b-24c1-43e0-a78e-c2c012ff0deb tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:51.002057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cb1473b-24c1-43e0-a78e-c2c012ff0deb tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:51.002707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cb1473b-24c1-43e0-a78e-c2c012ff0deb tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:51.003362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cb1473b-24c1-43e0-a78e-c2c012ff0deb tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:51.016826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb6aa51e-5e9d-4397-93af-e1fb6351c729 tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:51.017797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb6aa51e-5e9d-4397-93af-e1fb6351c729 tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:51.019533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb6aa51e-5e9d-4397-93af-e1fb6351c729 tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:51.041903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb6aa51e-5e9d-4397-93af-e1fb6351c729 tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:51.042593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb6aa51e-5e9d-4397-93af-e1fb6351c729 tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:51.043224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb6aa51e-5e9d-4397-93af-e1fb6351c729 tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:51.081770 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cb6aa51e-5e9d-4397-93af-e1fb6351c729 tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/2c6d6b857c2c464dbd7cd82e46825976?start=2022-08-08T14%3A36%3A50.091133&end=2022-08-10T14%3A36%3A50.091133" status: 200 len: 694 microversion: 2.1 time: 0.266071 Aug 09 14:36:51.081770 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 866/1715] 10.222.0.50 () {58 vars in 1412 bytes} [Tue Aug 9 14:36:50 2022] GET /compute/v2.1/os-simple-tenant-usage/2c6d6b857c2c464dbd7cd82e46825976?start=2022-08-08T14%3A36%3A50.091133&end=2022-08-10T14%3A36%3A50.091133 => generated 694 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:51.086987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-87aca436-98dd-490f-b3f1-cd32d3dc7529 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:51.098948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-87aca436-98dd-490f-b3f1-cd32d3dc7529 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:51.109424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87aca436-98dd-490f-b3f1-cd32d3dc7529 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:51.110623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87aca436-98dd-490f-b3f1-cd32d3dc7529 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:51.112015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87aca436-98dd-490f-b3f1-cd32d3dc7529 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:51.113414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87aca436-98dd-490f-b3f1-cd32d3dc7529 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:51.114955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87aca436-98dd-490f-b3f1-cd32d3dc7529 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:51.115732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87aca436-98dd-490f-b3f1-cd32d3dc7529 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:51.319292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8cb1473b-24c1-43e0-a78e-c2c012ff0deb tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:51.330720 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8cb1473b-24c1-43e0-a78e-c2c012ff0deb tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1526 microversion: 2.1 time: 0.344401 Aug 09 14:36:51.333227 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 850/1716] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:50 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1526 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:51.356548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-266953822", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95a77029-1d4f-4aec-aada-849bacf4e174"}], "security_groups": [{"name": "tempest-securitygroup--87856631"}], "key_name": "tempest-keypair-806116061", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:51.360981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-87aca436-98dd-490f-b3f1-cd32d3dc7529 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:51.370448 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-87aca436-98dd-490f-b3f1-cd32d3dc7529 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1469 microversion: 2.1 time: 0.287296 Aug 09 14:36:51.376158 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 867/1717] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:51 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1469 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:51.381299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-54a6a845-76a8-4e60-99df-d4b14ad2043a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:51.403335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-54a6a845-76a8-4e60-99df-d4b14ad2043a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:51.415530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54a6a845-76a8-4e60-99df-d4b14ad2043a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:51.416164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54a6a845-76a8-4e60-99df-d4b14ad2043a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:51.416838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54a6a845-76a8-4e60-99df-d4b14ad2043a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:51.417806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54a6a845-76a8-4e60-99df-d4b14ad2043a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:51.418550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54a6a845-76a8-4e60-99df-d4b14ad2043a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:51.419248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54a6a845-76a8-4e60-99df-d4b14ad2043a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:51.566405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] validate_networks() for [('95a77029-1d4f-4aec-aada-849bacf4e174', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:36:51.703148 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-54a6a845-76a8-4e60-99df-d4b14ad2043a tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1858 microversion: 2.1 time: 0.325533 Aug 09 14:36:51.703745 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 868/1718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:51 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1858 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:51.708523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e6fb9aa-72f1-4383-abc6-1014290e2d8b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:51.709137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8e6fb9aa-72f1-4383-abc6-1014290e2d8b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:51.748004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e6fb9aa-72f1-4383-abc6-1014290e2d8b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:51.750645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e6fb9aa-72f1-4383-abc6-1014290e2d8b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:51.752584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e6fb9aa-72f1-4383-abc6-1014290e2d8b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:51.753656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e6fb9aa-72f1-4383-abc6-1014290e2d8b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:51.754228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e6fb9aa-72f1-4383-abc6-1014290e2d8b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:51.754876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e6fb9aa-72f1-4383-abc6-1014290e2d8b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:51.840898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8e6fb9aa-72f1-4383-abc6-1014290e2d8b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:51.853665 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8e6fb9aa-72f1-4383-abc6-1014290e2d8b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1217 microversion: 2.1 time: 0.148154 Aug 09 14:36:51.855734 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 869/1719] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:51 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:51.867372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dff3fc03-3212-445b-bde2-e3f80affc895 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:51.868024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dff3fc03-3212-445b-bde2-e3f80affc895 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:51.883386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff3fc03-3212-445b-bde2-e3f80affc895 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:51.884178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff3fc03-3212-445b-bde2-e3f80affc895 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:51.884863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff3fc03-3212-445b-bde2-e3f80affc895 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:51.885973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff3fc03-3212-445b-bde2-e3f80affc895 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:51.886647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff3fc03-3212-445b-bde2-e3f80affc895 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:51.887419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff3fc03-3212-445b-bde2-e3f80affc895 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.063237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dff3fc03-3212-445b-bde2-e3f80affc895 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:52.072835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dff3fc03-3212-445b-bde2-e3f80affc895 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:52.074626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dff3fc03-3212-445b-bde2-e3f80affc895 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:52.076049 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dff3fc03-3212-445b-bde2-e3f80affc895 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.218293 Aug 09 14:36:52.077637 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 870/1720] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:51 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:52.082765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89d7ae94-255f-4397-be3f-8cec4ee7ba73 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '.version_select at 0x7f41dd169e50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:52.094158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89d7ae94-255f-4397-be3f-8cec4ee7ba73 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.094643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89d7ae94-255f-4397-be3f-8cec4ee7ba73 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.095072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89d7ae94-255f-4397-be3f-8cec4ee7ba73 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.104781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89d7ae94-255f-4397-be3f-8cec4ee7ba73 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.105643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89d7ae94-255f-4397-be3f-8cec4ee7ba73 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.106318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89d7ae94-255f-4397-be3f-8cec4ee7ba73 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.126944 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-89d7ae94-255f-4397-be3f-8cec4ee7ba73 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/2c6d6b857c2c464dbd7cd82e46825976?start=2022-08-08T14%3A36%3A50.091133&end=2022-08-10T14%3A36%3A50.091133" status: 200 len: 694 microversion: 2.1 time: 0.047599 Aug 09 14:36:52.127828 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 871/1721] 10.222.0.50 () {58 vars in 1412 bytes} [Tue Aug 9 14:36:52 2022] GET /compute/v2.1/os-simple-tenant-usage/2c6d6b857c2c464dbd7cd82e46825976?start=2022-08-08T14%3A36%3A50.091133&end=2022-08-10T14%3A36%3A50.091133 => generated 694 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:52.142360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bdc98b3f-ddd1-4e08-ae7d-49c76e68a274 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:52.143067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bdc98b3f-ddd1-4e08-ae7d-49c76e68a274 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:52.157895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdc98b3f-ddd1-4e08-ae7d-49c76e68a274 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.158311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdc98b3f-ddd1-4e08-ae7d-49c76e68a274 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.158751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdc98b3f-ddd1-4e08-ae7d-49c76e68a274 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.159550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdc98b3f-ddd1-4e08-ae7d-49c76e68a274 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.160020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdc98b3f-ddd1-4e08-ae7d-49c76e68a274 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.160369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdc98b3f-ddd1-4e08-ae7d-49c76e68a274 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.178474 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-bdc98b3f-ddd1-4e08-ae7d-49c76e68a274 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] HTTP exception thrown: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bdc98b3f-ddd1-4e08-ae7d-49c76e68a274 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Request method failure captured: Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 HTTP/1.1 Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nDQMJZd9DU-CMdNEpzJ7lwOlKu96UlsmbXN476U2zkuRmVW-1byUjrtijYC5h5gF3kNQzRNwU52_L8ENTPaiSz-nxM0C0nH6d-swsQy4EkVE26FV8yPiUxAAxo_i-D11nZGj8s5KPLxpCC9VWEyfk64LkyHoMA2SPtSzOnnH5aZ_x4 Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 54de373a9e684301905608f195bb56b9 Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestMultiNic-2131063812 Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_54de373a9e684301905608f195bb56b9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/54de373a9e684301905608f195bb56b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54de373a9e684301905608f195bb56b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54de373a9e684301905608f195bb56b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestMultiNic-2131063812 Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 54de373a9e684301905608f195bb56b9 Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestMultiNic-2131063812 Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestMultiNic-2131063812-project Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 00f1751674ba4df68ea6905988cd6510 Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestMultiNic-2131063812-project Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '5c0c3435-cbf1-447d-ba66-fbdf16ccc900'} Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:52.180211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:52.184898 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:52.184898 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:52.184898 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:52.184898 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:52.184898 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:52.184898 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:36:52.184898 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:36:52.184898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bdc98b3f-ddd1-4e08-ae7d-49c76e68a274 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Returning 404 to user: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:52.184898 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bdc98b3f-ddd1-4e08-ae7d-49c76e68a274 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 404 len: 111 microversion: 2.1 time: 0.052496 Aug 09 14:36:52.184898 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 872/1722] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:52 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:52.187388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-d8988624-9739-42c5-83f6-416e2bcc0a53 req-35b0255a-cf90-4d77-b3ba-e28d4c619219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0c3435-cbf1-447d-ba66-fbdf16ccc900", "name": "network-vif-deleted", "tag": "4ed9abf1-1e6f-4ead-ae47-ad41d975b753"}, {"server_uuid": "5c0c3435-cbf1-447d-ba66-fbdf16ccc900", "name": "network-vif-deleted", "tag": "24797387-c810-4f1a-8344-fb81d45d7aa5"}, {"server_uuid": "a158321c-16c9-4d13-a869-5fe62e776295", "name": "network-vif-deleted", "tag": "d1ea82ad-9d17-40d8-9de6-0db3f4198af1"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:52.198257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d8988624-9739-42c5-83f6-416e2bcc0a53 req-35b0255a-cf90-4d77-b3ba-e28d4c619219 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.198724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d8988624-9739-42c5-83f6-416e2bcc0a53 req-35b0255a-cf90-4d77-b3ba-e28d4c619219 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.199218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d8988624-9739-42c5-83f6-416e2bcc0a53 req-35b0255a-cf90-4d77-b3ba-e28d4c619219 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.212296 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d8988624-9739-42c5-83f6-416e2bcc0a53 req-35b0255a-cf90-4d77-b3ba-e28d4c619219 service nova] Creating event network-vif-deleted:4ed9abf1-1e6f-4ead-ae47-ad41d975b753 for instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 on n-h2-844626-8 Aug 09 14:36:52.212781 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d8988624-9739-42c5-83f6-416e2bcc0a53 req-35b0255a-cf90-4d77-b3ba-e28d4c619219 service nova] Creating event network-vif-deleted:24797387-c810-4f1a-8344-fb81d45d7aa5 for instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 on n-h2-844626-8 Aug 09 14:36:52.213271 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d8988624-9739-42c5-83f6-416e2bcc0a53 req-35b0255a-cf90-4d77-b3ba-e28d4c619219 service nova] Creating event network-vif-deleted:d1ea82ad-9d17-40d8-9de6-0db3f4198af1 for instance a158321c-16c9-4d13-a869-5fe62e776295 on n-h1-844626-8 Aug 09 14:36:52.221443 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-d8988624-9739-42c5-83f6-416e2bcc0a53 req-35b0255a-cf90-4d77-b3ba-e28d4c619219 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038153 Aug 09 14:36:52.222044 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 873/1723] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:52.227642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a99128e5-3077-4dd4-a1c7-d6422666d041 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:52.228223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a99128e5-3077-4dd4-a1c7-d6422666d041 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:52.234573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a99128e5-3077-4dd4-a1c7-d6422666d041 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.235071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a99128e5-3077-4dd4-a1c7-d6422666d041 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.235526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a99128e5-3077-4dd4-a1c7-d6422666d041 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.236212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a99128e5-3077-4dd4-a1c7-d6422666d041 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.236654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a99128e5-3077-4dd4-a1c7-d6422666d041 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.237089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a99128e5-3077-4dd4-a1c7-d6422666d041 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.324707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-a99128e5-3077-4dd4-a1c7-d6422666d041 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lazy-loading 'services' on Instance uuid aaf11da1-82f0-41e7-bdef-9bbea7629ef0 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:36:52.442791 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a99128e5-3077-4dd4-a1c7-d6422666d041 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "DELETE /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments/192e85c5-410e-4327-8c20-3f6653471458" status: 202 len: 0 microversion: 2.1 time: 0.217346 Aug 09 14:36:52.449804 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 874/1724] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 14:36:52 2022] DELETE /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments/192e85c5-410e-4327-8c20-3f6653471458 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:36:52.459038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-68ba0354-ffeb-4722-9e9a-5f9e936a051f tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Calling method '.version_select at 0x7f41dd173dc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:52.470642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68ba0354-ffeb-4722-9e9a-5f9e936a051f tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.472427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68ba0354-ffeb-4722-9e9a-5f9e936a051f tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.473077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68ba0354-ffeb-4722-9e9a-5f9e936a051f tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.491799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68ba0354-ffeb-4722-9e9a-5f9e936a051f tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.492823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68ba0354-ffeb-4722-9e9a-5f9e936a051f tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.493463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68ba0354-ffeb-4722-9e9a-5f9e936a051f tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.588915 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-68ba0354-ffeb-4722-9e9a-5f9e936a051f tempest-TenantUsagesTestJSON-1608797263 tempest-TenantUsagesTestJSON-1608797263-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-08T14%3A36%3A50.091133&end=2022-08-10T14%3A36%3A50.091133&detailed=1" status: 200 len: 22346 microversion: 2.1 time: 0.137482 Aug 09 14:36:52.589538 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 875/1725] 10.222.0.50 () {58 vars in 1335 bytes} [Tue Aug 9 14:36:52 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-08T14%3A36%3A50.091133&end=2022-08-10T14%3A36%3A50.091133&detailed=1 => generated 22346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:36:52.596063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:52.597044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:52.620159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.620658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.621083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.621783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.622392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.622836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.699479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:36:52.700048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:36:52.701139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:36:52.701552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:36:52.702110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:36:52.711918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.712609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.713302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.714402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.715145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.715781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.735483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:36:52.741196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for user 788fc5ec92a2482db1b27657c4f6b426 and project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:36:52.756076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:36:52.758692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:36:52.811235 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31c9e50e-f082-4fad-a658-8c298a74e39e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.476727 Aug 09 14:36:52.812548 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 851/1726] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:36:51 2022] POST /compute/v2.1/servers => generated 400 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:36:52.817757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-25dc5726-019d-414b-9336-2cedec784db2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:52.818650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-25dc5726-019d-414b-9336-2cedec784db2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:52.825653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25dc5726-019d-414b-9336-2cedec784db2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.826429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25dc5726-019d-414b-9336-2cedec784db2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.827163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25dc5726-019d-414b-9336-2cedec784db2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.828102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25dc5726-019d-414b-9336-2cedec784db2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.828732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25dc5726-019d-414b-9336-2cedec784db2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.829322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25dc5726-019d-414b-9336-2cedec784db2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.909177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:52.909779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:52.911464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:52.913570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lazy-loading 'fault' on Instance uuid a158321c-16c9-4d13-a869-5fe62e776295 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:36:53.144367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '894752596caa444c95cadf2b8dd38243', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ce04a888a334631a8431dd8782211f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:53.167764 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0f46862-d56e-4088-9116-a8cbf550b4ca tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 200 len: 1314 microversion: 2.1 time: 0.577093 Aug 09 14:36:53.168681 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 876/1727] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:52 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:53.187470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-68d2b9f1-06a2-4c70-a2dd-2a0cc4e9a279 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:53.189885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-68d2b9f1-06a2-4c70-a2dd-2a0cc4e9a279 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:53.225016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68d2b9f1-06a2-4c70-a2dd-2a0cc4e9a279 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:53.225294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68d2b9f1-06a2-4c70-a2dd-2a0cc4e9a279 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:53.227436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68d2b9f1-06a2-4c70-a2dd-2a0cc4e9a279 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:53.227970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68d2b9f1-06a2-4c70-a2dd-2a0cc4e9a279 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:53.230322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68d2b9f1-06a2-4c70-a2dd-2a0cc4e9a279 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:53.230864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68d2b9f1-06a2-4c70-a2dd-2a0cc4e9a279 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:53.261591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-25dc5726-019d-414b-9336-2cedec784db2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:53.276694 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-25dc5726-019d-414b-9336-2cedec784db2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1469 microversion: 2.1 time: 0.462811 Aug 09 14:36:53.285241 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 852/1728] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:52 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1469 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:53.306166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be494ed1-8fe9-4049-9cae-301596d6e5ef tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:53.307074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be494ed1-8fe9-4049-9cae-301596d6e5ef tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:53.313783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:53.315998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be494ed1-8fe9-4049-9cae-301596d6e5ef tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:53.316754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be494ed1-8fe9-4049-9cae-301596d6e5ef tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:53.317424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be494ed1-8fe9-4049-9cae-301596d6e5ef tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:53.318375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be494ed1-8fe9-4049-9cae-301596d6e5ef tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:53.319472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be494ed1-8fe9-4049-9cae-301596d6e5ef tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:53.320243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be494ed1-8fe9-4049-9cae-301596d6e5ef tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:53.364890 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-68d2b9f1-06a2-4c70-a2dd-2a0cc4e9a279 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195078 Aug 09 14:36:53.367681 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 877/1729] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:53 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:53.390202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-adf41728-c0a1-44c0-b9b2-f44cccf609f4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:53.390831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-adf41728-c0a1-44c0-b9b2-f44cccf609f4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:53.434744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be494ed1-8fe9-4049-9cae-301596d6e5ef tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:36:53.585547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-adf41728-c0a1-44c0-b9b2-f44cccf609f4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:53.604975 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-adf41728-c0a1-44c0-b9b2-f44cccf609f4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1240 microversion: 2.1 time: 0.234233 Aug 09 14:36:53.605568 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 878/1730] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:53 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1240 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:53.623397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cec1684d-3d32-4e0b-aaec-8d5ea77c9ca7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:53.624566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cec1684d-3d32-4e0b-aaec-8d5ea77c9ca7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:53.645339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec1684d-3d32-4e0b-aaec-8d5ea77c9ca7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:53.657067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec1684d-3d32-4e0b-aaec-8d5ea77c9ca7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:53.662260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec1684d-3d32-4e0b-aaec-8d5ea77c9ca7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:53.665777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec1684d-3d32-4e0b-aaec-8d5ea77c9ca7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:53.668695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec1684d-3d32-4e0b-aaec-8d5ea77c9ca7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:53.671367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cec1684d-3d32-4e0b-aaec-8d5ea77c9ca7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:53.673598 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be494ed1-8fe9-4049-9cae-301596d6e5ef tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 204 len: 0 microversion: 2.1 time: 0.385682 Aug 09 14:36:53.679655 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 853/1731] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:36:53 2022] DELETE /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:36:53.706442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df6242de-bc10-48a5-b818-5ed5ffef6216 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:53.707425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-df6242de-bc10-48a5-b818-5ed5ffef6216 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:53.730549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df6242de-bc10-48a5-b818-5ed5ffef6216 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:53.733089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df6242de-bc10-48a5-b818-5ed5ffef6216 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:53.734120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df6242de-bc10-48a5-b818-5ed5ffef6216 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:53.736055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df6242de-bc10-48a5-b818-5ed5ffef6216 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:53.738351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df6242de-bc10-48a5-b818-5ed5ffef6216 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:53.738835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df6242de-bc10-48a5-b818-5ed5ffef6216 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:53.801732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cec1684d-3d32-4e0b-aaec-8d5ea77c9ca7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:53.821959 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cec1684d-3d32-4e0b-aaec-8d5ea77c9ca7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1273 microversion: 2.1 time: 0.215276 Aug 09 14:36:53.822541 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 879/1732] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:53 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1273 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:53.827844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1ba2dbb-f30c-449a-8a1b-80c99ed567b2 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:53.832992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1ba2dbb-f30c-449a-8a1b-80c99ed567b2 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:53.852516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1ba2dbb-f30c-449a-8a1b-80c99ed567b2 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:53.853412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1ba2dbb-f30c-449a-8a1b-80c99ed567b2 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:53.854084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1ba2dbb-f30c-449a-8a1b-80c99ed567b2 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:53.855056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1ba2dbb-f30c-449a-8a1b-80c99ed567b2 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:53.860913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1ba2dbb-f30c-449a-8a1b-80c99ed567b2 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:53.861699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1ba2dbb-f30c-449a-8a1b-80c99ed567b2 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:54.148030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-df6242de-bc10-48a5-b818-5ed5ffef6216 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:54.160198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-df6242de-bc10-48a5-b818-5ed5ffef6216 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:54.161996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-df6242de-bc10-48a5-b818-5ed5ffef6216 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:54.163299 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-df6242de-bc10-48a5-b818-5ed5ffef6216 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.477849 Aug 09 14:36:54.186419 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 854/1733] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:53 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:54.200275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d79fec56-a6e8-4563-b914-1816908a6dab tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:54.200911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d79fec56-a6e8-4563-b914-1816908a6dab tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] [instance: a158321c-16c9-4d13-a869-5fe62e776295] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:54.208298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d79fec56-a6e8-4563-b914-1816908a6dab tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:54.208822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d79fec56-a6e8-4563-b914-1816908a6dab tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:54.209258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d79fec56-a6e8-4563-b914-1816908a6dab tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:54.210017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d79fec56-a6e8-4563-b914-1816908a6dab tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:54.210460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d79fec56-a6e8-4563-b914-1816908a6dab tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:54.210871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d79fec56-a6e8-4563-b914-1816908a6dab tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:54.227962 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-d79fec56-a6e8-4563-b914-1816908a6dab tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] HTTP exception thrown: Instance a158321c-16c9-4d13-a869-5fe62e776295 could not be found. Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d79fec56-a6e8-4563-b914-1816908a6dab tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Request method failure captured: Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 HTTP/1.1 Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nDsPVLIFbA8Qwq5e6Al4r8MNkmzTbosfgImfQAF2p9M9eSpKFOza6qSuP5vr0xf7xNPEroSWWZPZec6BjmT6WyvFuMAff31S4xTn2EZMFE2P-p8j0TNqQmMVQNwQY5o8sND2N2FkZ2-EZOZH--vEJPYGCkGYZa0K-R-0zJravRjQII Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 8ce04a888a334631a8431dd8782211f2 Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1744263224 Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8ce04a888a334631a8431dd8782211f2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8ce04a888a334631a8431dd8782211f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ce04a888a334631a8431dd8782211f2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8ce04a888a334631a8431dd8782211f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1744263224 Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 8ce04a888a334631a8431dd8782211f2 Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1744263224 Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-InstanceActionsNegativeTestJSON-1744263224-project Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 894752596caa444c95cadf2b8dd38243 Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1744263224-project Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance a158321c-16c9-4d13-a869-5fe62e776295 could not be found. Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'a158321c-16c9-4d13-a869-5fe62e776295'} Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a158321c-16c9-4d13-a869-5fe62e776295 could not be found. Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a158321c-16c9-4d13-a869-5fe62e776295 could not be found. Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:54.229673 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:36:54.238583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:54.238583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:36:54.238583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:36:54.238583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:36:54.238583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:36:54.238583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:36:54.238583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a158321c-16c9-4d13-a869-5fe62e776295 could not be found. Aug 09 14:36:54.238583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:36:54.238583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d79fec56-a6e8-4563-b914-1816908a6dab tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] Returning 404 to user: Instance a158321c-16c9-4d13-a869-5fe62e776295 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:36:54.238583 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d79fec56-a6e8-4563-b914-1816908a6dab tempest-InstanceActionsNegativeTestJSON-1744263224 tempest-InstanceActionsNegativeTestJSON-1744263224-project] 10.222.0.50 "GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295" status: 404 len: 111 microversion: 2.1 time: 0.042998 Aug 09 14:36:54.238583 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 855/1734] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:54 2022] GET /compute/v2.1/servers/a158321c-16c9-4d13-a869-5fe62e776295 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:36:54.240528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1ba2dbb-f30c-449a-8a1b-80c99ed567b2 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:54.247683 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1ba2dbb-f30c-449a-8a1b-80c99ed567b2 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1469 microversion: 2.1 time: 0.423527 Aug 09 14:36:54.248804 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 880/1735] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:53 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1469 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:54.303655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-422a73f1-21eb-4103-9b25-530dfee5851b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:54.304579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-422a73f1-21eb-4103-9b25-530dfee5851b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:54.318353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-422a73f1-21eb-4103-9b25-530dfee5851b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:54.320617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-422a73f1-21eb-4103-9b25-530dfee5851b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:54.321270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-422a73f1-21eb-4103-9b25-530dfee5851b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:54.324473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-422a73f1-21eb-4103-9b25-530dfee5851b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:54.325363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-422a73f1-21eb-4103-9b25-530dfee5851b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:54.336927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-422a73f1-21eb-4103-9b25-530dfee5851b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:54.380254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5df6c767-a076-4962-9946-1cc5577b168d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:54.382933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5df6c767-a076-4962-9946-1cc5577b168d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:54.390891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5df6c767-a076-4962-9946-1cc5577b168d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:54.392124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5df6c767-a076-4962-9946-1cc5577b168d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:54.393159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5df6c767-a076-4962-9946-1cc5577b168d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:54.395038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5df6c767-a076-4962-9946-1cc5577b168d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:54.396150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5df6c767-a076-4962-9946-1cc5577b168d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:54.397081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5df6c767-a076-4962-9946-1cc5577b168d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:54.442560 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5df6c767-a076-4962-9946-1cc5577b168d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066455 Aug 09 14:36:54.443917 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 881/1736] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:54 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:54.609678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3c5eeacb-f017-46d2-9fc8-be6219768bab req-fc1b754c-3f26-4f8c-bce4-1a51d29d82f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9192b19-8eae-49be-94bd-9a7cb5ace3e0", "name": "network-vif-unplugged", "status": "completed", "tag": "73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:54.620642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3c5eeacb-f017-46d2-9fc8-be6219768bab req-fc1b754c-3f26-4f8c-bce4-1a51d29d82f6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:54.621379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3c5eeacb-f017-46d2-9fc8-be6219768bab req-fc1b754c-3f26-4f8c-bce4-1a51d29d82f6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:54.621974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3c5eeacb-f017-46d2-9fc8-be6219768bab req-fc1b754c-3f26-4f8c-bce4-1a51d29d82f6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:54.637546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:54.645875 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3c5eeacb-f017-46d2-9fc8-be6219768bab req-fc1b754c-3f26-4f8c-bce4-1a51d29d82f6 service nova] Creating event network-vif-unplugged:73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e for instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 on n-h2-844626-8 Aug 09 14:36:54.652663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-3c5eeacb-f017-46d2-9fc8-be6219768bab req-fc1b754c-3f26-4f8c-bce4-1a51d29d82f6 service nova] Instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 14:36:54.660117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-422a73f1-21eb-4103-9b25-530dfee5851b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:54.670256 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-422a73f1-21eb-4103-9b25-530dfee5851b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1469 microversion: 2.1 time: 0.371464 Aug 09 14:36:54.675367 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 856/1737] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:54 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1469 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:54.690544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc1b1a91-0ced-4d4c-bf3d-b5e83754dd2a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:54.690744 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3c5eeacb-f017-46d2-9fc8-be6219768bab req-fc1b754c-3f26-4f8c-bce4-1a51d29d82f6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082497 Aug 09 14:36:54.690880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc1b1a91-0ced-4d4c-bf3d-b5e83754dd2a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:54.691360 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 882/1738] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:54.696392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc1b1a91-0ced-4d4c-bf3d-b5e83754dd2a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:54.697463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc1b1a91-0ced-4d4c-bf3d-b5e83754dd2a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:54.698411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc1b1a91-0ced-4d4c-bf3d-b5e83754dd2a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:54.699459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc1b1a91-0ced-4d4c-bf3d-b5e83754dd2a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:54.700090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc1b1a91-0ced-4d4c-bf3d-b5e83754dd2a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:54.700667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc1b1a91-0ced-4d4c-bf3d-b5e83754dd2a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:54.777783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bc1b1a91-0ced-4d4c-bf3d-b5e83754dd2a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:54.787550 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc1b1a91-0ced-4d4c-bf3d-b5e83754dd2a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1244 microversion: 2.1 time: 0.110749 Aug 09 14:36:54.788809 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 857/1739] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:54 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1244 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:54.849403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-624e81ad-8eb1-4e95-ba26-3a980d453f88 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:54.850113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-624e81ad-8eb1-4e95-ba26-3a980d453f88 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:54.862633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-624e81ad-8eb1-4e95-ba26-3a980d453f88 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:54.869719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-624e81ad-8eb1-4e95-ba26-3a980d453f88 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:54.870573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-624e81ad-8eb1-4e95-ba26-3a980d453f88 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:54.871858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-624e81ad-8eb1-4e95-ba26-3a980d453f88 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:54.872493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-624e81ad-8eb1-4e95-ba26-3a980d453f88 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:54.873117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-624e81ad-8eb1-4e95-ba26-3a980d453f88 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:54.990591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-624e81ad-8eb1-4e95-ba26-3a980d453f88 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:55.038839 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-624e81ad-8eb1-4e95-ba26-3a980d453f88 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1283 microversion: 2.1 time: 0.191658 Aug 09 14:36:55.051155 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 883/1740] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:54 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1283 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:36:55.190790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fbae930f-137e-473d-9bf5-70e28b520390 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:55.191696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fbae930f-137e-473d-9bf5-70e28b520390 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:55.205462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbae930f-137e-473d-9bf5-70e28b520390 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:55.208355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbae930f-137e-473d-9bf5-70e28b520390 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:55.209843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbae930f-137e-473d-9bf5-70e28b520390 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:55.210810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbae930f-137e-473d-9bf5-70e28b520390 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:55.211852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbae930f-137e-473d-9bf5-70e28b520390 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:55.214055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbae930f-137e-473d-9bf5-70e28b520390 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:55.268661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-69c5e4f0-b5f5-4184-87f4-930ff49566ae tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:55.269582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-69c5e4f0-b5f5-4184-87f4-930ff49566ae tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:55.284106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69c5e4f0-b5f5-4184-87f4-930ff49566ae tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:55.286901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69c5e4f0-b5f5-4184-87f4-930ff49566ae tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:55.287653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69c5e4f0-b5f5-4184-87f4-930ff49566ae tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:55.292036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69c5e4f0-b5f5-4184-87f4-930ff49566ae tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:55.293806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69c5e4f0-b5f5-4184-87f4-930ff49566ae tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:55.295332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69c5e4f0-b5f5-4184-87f4-930ff49566ae tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:55.617694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fbae930f-137e-473d-9bf5-70e28b520390 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:55.626502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fbae930f-137e-473d-9bf5-70e28b520390 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:55.628052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fbae930f-137e-473d-9bf5-70e28b520390 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:55.629298 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fbae930f-137e-473d-9bf5-70e28b520390 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.442814 Aug 09 14:36:55.629877 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 858/1741] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:55 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:55.659815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb3cd151-4e51-45e7-9924-bea6c0d0d4aa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:55.662175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eb3cd151-4e51-45e7-9924-bea6c0d0d4aa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:55.686581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb3cd151-4e51-45e7-9924-bea6c0d0d4aa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:55.687219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb3cd151-4e51-45e7-9924-bea6c0d0d4aa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:55.687614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb3cd151-4e51-45e7-9924-bea6c0d0d4aa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:55.688363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb3cd151-4e51-45e7-9924-bea6c0d0d4aa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:55.688835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb3cd151-4e51-45e7-9924-bea6c0d0d4aa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:55.689282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb3cd151-4e51-45e7-9924-bea6c0d0d4aa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:55.706524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-69c5e4f0-b5f5-4184-87f4-930ff49566ae tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:55.718817 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-69c5e4f0-b5f5-4184-87f4-930ff49566ae tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1469 microversion: 2.1 time: 0.452722 Aug 09 14:36:55.739045 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 884/1742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:55 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1469 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:55.754648 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb3cd151-4e51-45e7-9924-bea6c0d0d4aa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123256 Aug 09 14:36:55.755478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48877b52-ff77-4dd7-8454-9bc21824d990 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:55.759309 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 859/1743] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:55 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:55.773134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48877b52-ff77-4dd7-8454-9bc21824d990 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:55.805304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48877b52-ff77-4dd7-8454-9bc21824d990 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:55.810108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb57d049-572d-4898-97ff-512806ace7b0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:55.811354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48877b52-ff77-4dd7-8454-9bc21824d990 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:55.811928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48877b52-ff77-4dd7-8454-9bc21824d990 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:55.812358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bb57d049-572d-4898-97ff-512806ace7b0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:55.814740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48877b52-ff77-4dd7-8454-9bc21824d990 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:55.818923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48877b52-ff77-4dd7-8454-9bc21824d990 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:55.819630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48877b52-ff77-4dd7-8454-9bc21824d990 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:55.831458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb57d049-572d-4898-97ff-512806ace7b0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:55.832405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb57d049-572d-4898-97ff-512806ace7b0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:55.833055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb57d049-572d-4898-97ff-512806ace7b0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:55.834011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb57d049-572d-4898-97ff-512806ace7b0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:55.834659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb57d049-572d-4898-97ff-512806ace7b0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:55.835427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb57d049-572d-4898-97ff-512806ace7b0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:56.152624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bb57d049-572d-4898-97ff-512806ace7b0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:56.170856 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb57d049-572d-4898-97ff-512806ace7b0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1310 microversion: 2.1 time: 0.365099 Aug 09 14:36:56.171895 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 860/1744] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:55 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1310 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:36:56.177452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7e9e1f00-311f-434a-a398-03ff70eb8c41 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:56.178480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7e9e1f00-311f-434a-a398-03ff70eb8c41 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:56.199752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e9e1f00-311f-434a-a398-03ff70eb8c41 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:56.203465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e9e1f00-311f-434a-a398-03ff70eb8c41 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:56.203919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e9e1f00-311f-434a-a398-03ff70eb8c41 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:56.204662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e9e1f00-311f-434a-a398-03ff70eb8c41 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:56.205129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e9e1f00-311f-434a-a398-03ff70eb8c41 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:56.205540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e9e1f00-311f-434a-a398-03ff70eb8c41 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:56.242023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:36:56.357476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7e9e1f00-311f-434a-a398-03ff70eb8c41 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:56.367181 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7e9e1f00-311f-434a-a398-03ff70eb8c41 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1271 microversion: 2.1 time: 0.193569 Aug 09 14:36:56.370093 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 861/1745] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:56 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:56.479278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48877b52-ff77-4dd7-8454-9bc21824d990 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:56.496975 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48877b52-ff77-4dd7-8454-9bc21824d990 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1469 microversion: 2.1 time: 0.756416 Aug 09 14:36:56.497570 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 885/1746] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:55 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1469 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:56.654853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ef5cc87-9c9d-4822-b585-d8f95e7e29ee tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:56.655546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ef5cc87-9c9d-4822-b585-d8f95e7e29ee tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:56.669066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ef5cc87-9c9d-4822-b585-d8f95e7e29ee tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:56.670194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ef5cc87-9c9d-4822-b585-d8f95e7e29ee tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:56.670853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ef5cc87-9c9d-4822-b585-d8f95e7e29ee tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:56.671945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ef5cc87-9c9d-4822-b585-d8f95e7e29ee tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:56.675851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ef5cc87-9c9d-4822-b585-d8f95e7e29ee tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:56.676559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ef5cc87-9c9d-4822-b585-d8f95e7e29ee tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:56.747442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-10d7c483-0653-41ea-81ae-2a70c8863604 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:56.748637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-10d7c483-0653-41ea-81ae-2a70c8863604 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:56.758011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10d7c483-0653-41ea-81ae-2a70c8863604 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:56.758908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10d7c483-0653-41ea-81ae-2a70c8863604 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:56.759637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10d7c483-0653-41ea-81ae-2a70c8863604 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:56.760583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10d7c483-0653-41ea-81ae-2a70c8863604 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:56.761256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10d7c483-0653-41ea-81ae-2a70c8863604 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:56.761935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10d7c483-0653-41ea-81ae-2a70c8863604 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:57.124124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ef5cc87-9c9d-4822-b585-d8f95e7e29ee tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:57.134367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ef5cc87-9c9d-4822-b585-d8f95e7e29ee tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:57.141775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ef5cc87-9c9d-4822-b585-d8f95e7e29ee tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:57.143653 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ef5cc87-9c9d-4822-b585-d8f95e7e29ee tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.493554 Aug 09 14:36:57.144834 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 862/1747] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:56 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:57.151911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88281df7-f409-47e9-b3a5-af4319548977 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:57.185835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-88281df7-f409-47e9-b3a5-af4319548977 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:57.194172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88281df7-f409-47e9-b3a5-af4319548977 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:57.195013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88281df7-f409-47e9-b3a5-af4319548977 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:57.195806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88281df7-f409-47e9-b3a5-af4319548977 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:57.197054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88281df7-f409-47e9-b3a5-af4319548977 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:57.197753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88281df7-f409-47e9-b3a5-af4319548977 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:57.198384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88281df7-f409-47e9-b3a5-af4319548977 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:57.234727 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88281df7-f409-47e9-b3a5-af4319548977 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087854 Aug 09 14:36:57.236244 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 863/1748] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:57 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:57.248270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-37da9254-abc0-4e5f-a369-7087043bc2f0 req-f58c426f-917a-4574-a2ff-76a33dca88a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bca7020-9984-4d3f-bbaa-9b08bb396e45", "name": "network-vif-unplugged", "status": "completed", "tag": "6a96fb4b-302c-4503-9633-e8019d37935e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:57.267941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-37da9254-abc0-4e5f-a369-7087043bc2f0 req-f58c426f-917a-4574-a2ff-76a33dca88a0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:57.268892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-37da9254-abc0-4e5f-a369-7087043bc2f0 req-f58c426f-917a-4574-a2ff-76a33dca88a0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:57.269553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-37da9254-abc0-4e5f-a369-7087043bc2f0 req-f58c426f-917a-4574-a2ff-76a33dca88a0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:57.286149 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-37da9254-abc0-4e5f-a369-7087043bc2f0 req-f58c426f-917a-4574-a2ff-76a33dca88a0 service nova] Creating event network-vif-unplugged:6a96fb4b-302c-4503-9633-e8019d37935e for instance 0bca7020-9984-4d3f-bbaa-9b08bb396e45 on n-h1-844626-8 Aug 09 14:36:57.293242 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-37da9254-abc0-4e5f-a369-7087043bc2f0 req-f58c426f-917a-4574-a2ff-76a33dca88a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055475 Aug 09 14:36:57.295644 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 864/1749] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:57.299207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-10d7c483-0653-41ea-81ae-2a70c8863604 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:57.301872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-968f59e1-03f1-4f41-bcd1-6883901fb03d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:57.303136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-968f59e1-03f1-4f41-bcd1-6883901fb03d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:57.310451 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-10d7c483-0653-41ea-81ae-2a70c8863604 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1469 microversion: 2.1 time: 0.566478 Aug 09 14:36:57.312114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-968f59e1-03f1-4f41-bcd1-6883901fb03d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:57.312648 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 886/1750] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:56 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1469 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:36:57.313453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-968f59e1-03f1-4f41-bcd1-6883901fb03d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:57.314409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-968f59e1-03f1-4f41-bcd1-6883901fb03d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:57.315363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-968f59e1-03f1-4f41-bcd1-6883901fb03d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:57.316181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-968f59e1-03f1-4f41-bcd1-6883901fb03d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:57.316794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-968f59e1-03f1-4f41-bcd1-6883901fb03d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:57.371619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-eeb36593-8d6b-4321-9202-5af261f97ae5 req-dcd653eb-08b5-4d2c-9578-d383cc3f627b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9192b19-8eae-49be-94bd-9a7cb5ace3e0", "tag": "73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:57.395801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eeb36593-8d6b-4321-9202-5af261f97ae5 req-dcd653eb-08b5-4d2c-9578-d383cc3f627b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:57.397119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eeb36593-8d6b-4321-9202-5af261f97ae5 req-dcd653eb-08b5-4d2c-9578-d383cc3f627b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:57.397810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eeb36593-8d6b-4321-9202-5af261f97ae5 req-dcd653eb-08b5-4d2c-9578-d383cc3f627b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:57.414910 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-eeb36593-8d6b-4321-9202-5af261f97ae5 req-dcd653eb-08b5-4d2c-9578-d383cc3f627b service nova] Creating event network-changed:73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e for instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 on n-h2-844626-8 Aug 09 14:36:57.422985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-eeb36593-8d6b-4321-9202-5af261f97ae5 req-dcd653eb-08b5-4d2c-9578-d383cc3f627b service nova] Instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 14:36:57.439062 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-eeb36593-8d6b-4321-9202-5af261f97ae5 req-dcd653eb-08b5-4d2c-9578-d383cc3f627b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070764 Aug 09 14:36:57.440269 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 887/1751] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:36:57.446922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd832c2c-c389-48a3-814b-98e2680990fb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:57.447818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd832c2c-c389-48a3-814b-98e2680990fb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:57.457587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd832c2c-c389-48a3-814b-98e2680990fb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:57.458170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd832c2c-c389-48a3-814b-98e2680990fb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:57.458809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd832c2c-c389-48a3-814b-98e2680990fb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:57.459868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd832c2c-c389-48a3-814b-98e2680990fb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:57.471774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-968f59e1-03f1-4f41-bcd1-6883901fb03d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:57.483687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd832c2c-c389-48a3-814b-98e2680990fb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:57.486568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd832c2c-c389-48a3-814b-98e2680990fb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:57.491641 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-968f59e1-03f1-4f41-bcd1-6883901fb03d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1298 microversion: 2.1 time: 0.194406 Aug 09 14:36:57.493200 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 865/1752] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:57 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1298 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:57.519518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f19c3dab-41d5-410e-8e52-2bb37a472f25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:57.520431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f19c3dab-41d5-410e-8e52-2bb37a472f25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:57.528187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f19c3dab-41d5-410e-8e52-2bb37a472f25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:57.529350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f19c3dab-41d5-410e-8e52-2bb37a472f25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:57.530014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f19c3dab-41d5-410e-8e52-2bb37a472f25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:57.530897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f19c3dab-41d5-410e-8e52-2bb37a472f25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:57.531868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f19c3dab-41d5-410e-8e52-2bb37a472f25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:57.532539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f19c3dab-41d5-410e-8e52-2bb37a472f25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:57.810742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd832c2c-c389-48a3-814b-98e2680990fb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:57.831007 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd832c2c-c389-48a3-814b-98e2680990fb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1313 microversion: 2.1 time: 0.388620 Aug 09 14:36:57.832360 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 888/1753] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:57 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:57.841214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f19c3dab-41d5-410e-8e52-2bb37a472f25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:57.857574 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f19c3dab-41d5-410e-8e52-2bb37a472f25 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1469 microversion: 2.1 time: 0.342709 Aug 09 14:36:57.860773 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 866/1754] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:57 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1469 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:58.152089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-52a2f78c-06b0-4729-83fa-da24d897a0cc req-eecbeb96-22b0-47d4-9a35-7f732ad51656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70ce2470-a122-46db-b968-ff9fc15c3166", "tag": "ddc11171-a7ed-4bdb-9894-e754060ea66f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:58.170465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ede9ac2a-e723-4054-ae40-7ad8f92f9b1a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:58.171954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ede9ac2a-e723-4054-ae40-7ad8f92f9b1a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:58.190929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ede9ac2a-e723-4054-ae40-7ad8f92f9b1a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.192406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ede9ac2a-e723-4054-ae40-7ad8f92f9b1a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.193044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ede9ac2a-e723-4054-ae40-7ad8f92f9b1a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:58.193573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-52a2f78c-06b0-4729-83fa-da24d897a0cc req-eecbeb96-22b0-47d4-9a35-7f732ad51656 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.194151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-52a2f78c-06b0-4729-83fa-da24d897a0cc req-eecbeb96-22b0-47d4-9a35-7f732ad51656 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.194413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ede9ac2a-e723-4054-ae40-7ad8f92f9b1a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.194752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-52a2f78c-06b0-4729-83fa-da24d897a0cc req-eecbeb96-22b0-47d4-9a35-7f732ad51656 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:58.195300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ede9ac2a-e723-4054-ae40-7ad8f92f9b1a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.195932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ede9ac2a-e723-4054-ae40-7ad8f92f9b1a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:58.213843 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-52a2f78c-06b0-4729-83fa-da24d897a0cc req-eecbeb96-22b0-47d4-9a35-7f732ad51656 service nova] Creating event network-changed:ddc11171-a7ed-4bdb-9894-e754060ea66f for instance 70ce2470-a122-46db-b968-ff9fc15c3166 on n-h1-844626-8 Aug 09 14:36:58.221424 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-52a2f78c-06b0-4729-83fa-da24d897a0cc req-eecbeb96-22b0-47d4-9a35-7f732ad51656 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073941 Aug 09 14:36:58.224817 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 889/1755] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:58.267320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d99717e-a804-4aa1-89e0-0052169d324b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:58.270077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d99717e-a804-4aa1-89e0-0052169d324b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:58.285189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d99717e-a804-4aa1-89e0-0052169d324b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.287326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d99717e-a804-4aa1-89e0-0052169d324b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.287782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d99717e-a804-4aa1-89e0-0052169d324b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:58.288593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d99717e-a804-4aa1-89e0-0052169d324b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.289038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d99717e-a804-4aa1-89e0-0052169d324b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.289504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d99717e-a804-4aa1-89e0-0052169d324b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:58.347582 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d99717e-a804-4aa1-89e0-0052169d324b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087644 Aug 09 14:36:58.348562 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 890/1756] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:58 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:58.360384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b1ee645b-3ce6-4a52-b2b9-defb074f0b36 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:58.361000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b1ee645b-3ce6-4a52-b2b9-defb074f0b36 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:58.367411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ee645b-3ce6-4a52-b2b9-defb074f0b36 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.368198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ee645b-3ce6-4a52-b2b9-defb074f0b36 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.368846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ee645b-3ce6-4a52-b2b9-defb074f0b36 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:58.369757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ee645b-3ce6-4a52-b2b9-defb074f0b36 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.370445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ee645b-3ce6-4a52-b2b9-defb074f0b36 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.371059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ee645b-3ce6-4a52-b2b9-defb074f0b36 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:58.575201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ede9ac2a-e723-4054-ae40-7ad8f92f9b1a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:58.593084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ede9ac2a-e723-4054-ae40-7ad8f92f9b1a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:58.596806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ede9ac2a-e723-4054-ae40-7ad8f92f9b1a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:58.598785 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ede9ac2a-e723-4054-ae40-7ad8f92f9b1a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.433489 Aug 09 14:36:58.599985 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 867/1757] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:58 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:36:58.605471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e5fa4d27-3311-466b-ae5f-ab5fd0dd1734 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:58.606574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e5fa4d27-3311-466b-ae5f-ab5fd0dd1734 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:58.613582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5fa4d27-3311-466b-ae5f-ab5fd0dd1734 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.614286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5fa4d27-3311-466b-ae5f-ab5fd0dd1734 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.614990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5fa4d27-3311-466b-ae5f-ab5fd0dd1734 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:58.616228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5fa4d27-3311-466b-ae5f-ab5fd0dd1734 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.617160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5fa4d27-3311-466b-ae5f-ab5fd0dd1734 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.617742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5fa4d27-3311-466b-ae5f-ab5fd0dd1734 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:58.756717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b1ee645b-3ce6-4a52-b2b9-defb074f0b36 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:58.768523 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b1ee645b-3ce6-4a52-b2b9-defb074f0b36 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1469 microversion: 2.1 time: 0.418126 Aug 09 14:36:58.769540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e5fa4d27-3311-466b-ae5f-ab5fd0dd1734 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:58.771332 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 891/1758] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:58 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1469 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:58.793406 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e5fa4d27-3311-466b-ae5f-ab5fd0dd1734 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1298 microversion: 2.1 time: 0.192083 Aug 09 14:36:58.808978 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 868/1759] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:58 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1298 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:58.854020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b957ec60-c3df-4a3f-89a7-96342c5ab9bd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:58.854985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b957ec60-c3df-4a3f-89a7-96342c5ab9bd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:58.869337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b957ec60-c3df-4a3f-89a7-96342c5ab9bd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.869889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b957ec60-c3df-4a3f-89a7-96342c5ab9bd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.871495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b957ec60-c3df-4a3f-89a7-96342c5ab9bd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:58.872267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b957ec60-c3df-4a3f-89a7-96342c5ab9bd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.872751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b957ec60-c3df-4a3f-89a7-96342c5ab9bd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.873185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b957ec60-c3df-4a3f-89a7-96342c5ab9bd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:58.881060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-298d8c93-1520-401b-aa0d-cf3a5115f3a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:58.881787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-298d8c93-1520-401b-aa0d-cf3a5115f3a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:58.892798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-298d8c93-1520-401b-aa0d-cf3a5115f3a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.895151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-298d8c93-1520-401b-aa0d-cf3a5115f3a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.895790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-298d8c93-1520-401b-aa0d-cf3a5115f3a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:58.896679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-298d8c93-1520-401b-aa0d-cf3a5115f3a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:58.898961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-298d8c93-1520-401b-aa0d-cf3a5115f3a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:58.899601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-298d8c93-1520-401b-aa0d-cf3a5115f3a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:59.487886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-298d8c93-1520-401b-aa0d-cf3a5115f3a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:59.497432 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-298d8c93-1520-401b-aa0d-cf3a5115f3a0 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1469 microversion: 2.1 time: 0.621025 Aug 09 14:36:59.516252 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 869/1760] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:58 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1469 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:36:59.525233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6353a7f2-b2b4-4b0c-8c9e-ad050f342540 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:59.532700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6353a7f2-b2b4-4b0c-8c9e-ad050f342540 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:59.551376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b957ec60-c3df-4a3f-89a7-96342c5ab9bd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:59.559548 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b957ec60-c3df-4a3f-89a7-96342c5ab9bd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1313 microversion: 2.1 time: 0.709836 Aug 09 14:36:59.560150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6353a7f2-b2b4-4b0c-8c9e-ad050f342540 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:59.560970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6353a7f2-b2b4-4b0c-8c9e-ad050f342540 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:59.561605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6353a7f2-b2b4-4b0c-8c9e-ad050f342540 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:59.575807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6353a7f2-b2b4-4b0c-8c9e-ad050f342540 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:59.576361 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 892/1761] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:58 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1313 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:59.580174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6353a7f2-b2b4-4b0c-8c9e-ad050f342540 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:59.581569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6353a7f2-b2b4-4b0c-8c9e-ad050f342540 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:59.585980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-39c1277b-c153-434a-b80c-d2dc580f065f req-8784c082-769c-4477-a4a6-50ee25990475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bca7020-9984-4d3f-bbaa-9b08bb396e45", "name": "network-vif-deleted", "tag": "6a96fb4b-302c-4503-9633-e8019d37935e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:36:59.600013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-39c1277b-c153-434a-b80c-d2dc580f065f req-8784c082-769c-4477-a4a6-50ee25990475 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:59.600619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-39c1277b-c153-434a-b80c-d2dc580f065f req-8784c082-769c-4477-a4a6-50ee25990475 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:59.601151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-39c1277b-c153-434a-b80c-d2dc580f065f req-8784c082-769c-4477-a4a6-50ee25990475 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:59.618891 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-39c1277b-c153-434a-b80c-d2dc580f065f req-8784c082-769c-4477-a4a6-50ee25990475 service nova] Creating event network-vif-deleted:6a96fb4b-302c-4503-9633-e8019d37935e for instance 0bca7020-9984-4d3f-bbaa-9b08bb396e45 on n-h1-844626-8 Aug 09 14:36:59.627348 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6353a7f2-b2b4-4b0c-8c9e-ad050f342540 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108979 Aug 09 14:36:59.628644 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 870/1762] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:36:59 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:36:59.631206 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-39c1277b-c153-434a-b80c-d2dc580f065f req-8784c082-769c-4477-a4a6-50ee25990475 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053153 Aug 09 14:36:59.633153 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 893/1763] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:36:59.637388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8729b1e-5e4f-4a91-8129-f2159414f14e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:59.638710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8729b1e-5e4f-4a91-8129-f2159414f14e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:59.650245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8729b1e-5e4f-4a91-8129-f2159414f14e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:59.652156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8729b1e-5e4f-4a91-8129-f2159414f14e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:59.652808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8729b1e-5e4f-4a91-8129-f2159414f14e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:59.653931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8729b1e-5e4f-4a91-8129-f2159414f14e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:59.654767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8729b1e-5e4f-4a91-8129-f2159414f14e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:59.656392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8729b1e-5e4f-4a91-8129-f2159414f14e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:59.795229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:59.796114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:59.808623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:59.809135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:59.809570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:59.815312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:59.816197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:59.816858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:59.871555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:59.872328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:59.872946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:59.873711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lazy-loading 'fault' on Instance uuid 0bca7020-9984-4d3f-bbaa-9b08bb396e45 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:36:59.919443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8729b1e-5e4f-4a91-8129-f2159414f14e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:59.934119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8729b1e-5e4f-4a91-8129-f2159414f14e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:59.936104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8729b1e-5e4f-4a91-8129-f2159414f14e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:59.940583 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e8729b1e-5e4f-4a91-8129-f2159414f14e tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.310353 Aug 09 14:36:59.944432 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 871/1764] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:36:59 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:36:59.947120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51435a3f14654a77925d34c516c6fd1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c6d6b857c2c464dbd7cd82e46825976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:36:59.954914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79b31159-eb2b-4d68-81e1-4a831c898c43 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:36:59.957458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-79b31159-eb2b-4d68-81e1-4a831c898c43 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:36:59.957901 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c816e8f2-f1dc-458a-bc37-7c1fe48e76b7 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 200 len: 1303 microversion: 2.1 time: 0.166608 Aug 09 14:36:59.967980 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 894/1765] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:59 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 1303 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:36:59.972561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79b31159-eb2b-4d68-81e1-4a831c898c43 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:59.977895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79b31159-eb2b-4d68-81e1-4a831c898c43 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:59.978803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79b31159-eb2b-4d68-81e1-4a831c898c43 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:36:59.979832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79b31159-eb2b-4d68-81e1-4a831c898c43 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:36:59.980493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79b31159-eb2b-4d68-81e1-4a831c898c43 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:36:59.981338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79b31159-eb2b-4d68-81e1-4a831c898c43 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:00.087701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-79b31159-eb2b-4d68-81e1-4a831c898c43 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:00.097541 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-79b31159-eb2b-4d68-81e1-4a831c898c43 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1298 microversion: 2.1 time: 0.151829 Aug 09 14:37:00.111570 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 872/1766] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:36:59 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1298 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:00.525753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8a1bcf5-e4cc-49c4-8a11-94f0135d3e4a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:00.526565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b8a1bcf5-e4cc-49c4-8a11-94f0135d3e4a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:00.542002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8a1bcf5-e4cc-49c4-8a11-94f0135d3e4a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:00.542729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8a1bcf5-e4cc-49c4-8a11-94f0135d3e4a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:00.544064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8a1bcf5-e4cc-49c4-8a11-94f0135d3e4a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:00.545551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8a1bcf5-e4cc-49c4-8a11-94f0135d3e4a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:00.550070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8a1bcf5-e4cc-49c4-8a11-94f0135d3e4a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:00.550812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8a1bcf5-e4cc-49c4-8a11-94f0135d3e4a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:00.586008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07a6a6d7-c5cb-4018-a083-d14a6d1c833c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:00.587809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07a6a6d7-c5cb-4018-a083-d14a6d1c833c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:00.604892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07a6a6d7-c5cb-4018-a083-d14a6d1c833c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:00.613760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07a6a6d7-c5cb-4018-a083-d14a6d1c833c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:00.614216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07a6a6d7-c5cb-4018-a083-d14a6d1c833c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:00.615529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07a6a6d7-c5cb-4018-a083-d14a6d1c833c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:00.616561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07a6a6d7-c5cb-4018-a083-d14a6d1c833c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:00.622950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07a6a6d7-c5cb-4018-a083-d14a6d1c833c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:01.201327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8a1bcf5-e4cc-49c4-8a11-94f0135d3e4a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:01.211229 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8a1bcf5-e4cc-49c4-8a11-94f0135d3e4a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1469 microversion: 2.1 time: 0.691499 Aug 09 14:37:01.211833 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 895/1767] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:00 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1469 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:01.227059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60960ab5-1484-4f72-b532-2ed8a7eb07bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:01.227976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-60960ab5-1484-4f72-b532-2ed8a7eb07bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:01.236586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07a6a6d7-c5cb-4018-a083-d14a6d1c833c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:01.243508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60960ab5-1484-4f72-b532-2ed8a7eb07bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:01.244027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60960ab5-1484-4f72-b532-2ed8a7eb07bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:01.244602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60960ab5-1484-4f72-b532-2ed8a7eb07bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:01.245546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60960ab5-1484-4f72-b532-2ed8a7eb07bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:01.246256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60960ab5-1484-4f72-b532-2ed8a7eb07bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:01.246682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60960ab5-1484-4f72-b532-2ed8a7eb07bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:01.247674 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07a6a6d7-c5cb-4018-a083-d14a6d1c833c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1313 microversion: 2.1 time: 0.669268 Aug 09 14:37:01.260325 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 873/1768] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:00 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1313 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:01.271845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca7d2c3a-2788-4c5c-b1b6-c3c3d23e95c4 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:01.272839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca7d2c3a-2788-4c5c-b1b6-c3c3d23e95c4 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] [instance: 0bca7020-9984-4d3f-bbaa-9b08bb396e45] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:01.281942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca7d2c3a-2788-4c5c-b1b6-c3c3d23e95c4 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:01.282818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca7d2c3a-2788-4c5c-b1b6-c3c3d23e95c4 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:01.283509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca7d2c3a-2788-4c5c-b1b6-c3c3d23e95c4 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:01.285216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca7d2c3a-2788-4c5c-b1b6-c3c3d23e95c4 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:01.285927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca7d2c3a-2788-4c5c-b1b6-c3c3d23e95c4 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:01.286611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca7d2c3a-2788-4c5c-b1b6-c3c3d23e95c4 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:01.305925 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ca7d2c3a-2788-4c5c-b1b6-c3c3d23e95c4 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] HTTP exception thrown: Instance 0bca7020-9984-4d3f-bbaa-9b08bb396e45 could not be found. Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca7d2c3a-2788-4c5c-b1b6-c3c3d23e95c4 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Request method failure captured: Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 HTTP/1.1 Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nDuGwIfljCevea0ode9BcYcSoQxq-ZPfp4lWS_wzVo6wh0e-pDlubhR0N6gHzAG3PlE81-kwGM0eA-iLg-4pjCsVWGUQ0vKcMOpHxaHBBiy6VlOJTjz5vfeR1xAcSporA8i1sxlRzGM5SdUZwruPSvSGpo5epHlnd5AjCcNiejLQeI Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 2c6d6b857c2c464dbd7cd82e46825976 Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TenantUsagesTestJSON-1259485157 Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2c6d6b857c2c464dbd7cd82e46825976", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2c6d6b857c2c464dbd7cd82e46825976"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c6d6b857c2c464dbd7cd82e46825976"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2c6d6b857c2c464dbd7cd82e46825976"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TenantUsagesTestJSON-1259485157 Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 2c6d6b857c2c464dbd7cd82e46825976 Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1259485157 Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TenantUsagesTestJSON-1259485157-project Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 51435a3f14654a77925d34c516c6fd1e Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TenantUsagesTestJSON-1259485157-project Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 0bca7020-9984-4d3f-bbaa-9b08bb396e45 could not be found. Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '0bca7020-9984-4d3f-bbaa-9b08bb396e45'} Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bca7020-9984-4d3f-bbaa-9b08bb396e45 could not be found. Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bca7020-9984-4d3f-bbaa-9b08bb396e45 could not be found. Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:37:01.308232 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:01.312987 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:01.312987 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:37:01.312987 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:37:01.312987 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:37:01.312987 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:37:01.312987 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bca7020-9984-4d3f-bbaa-9b08bb396e45 could not be found. Aug 09 14:37:01.312987 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:01.316067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca7d2c3a-2788-4c5c-b1b6-c3c3d23e95c4 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] Returning 404 to user: Instance 0bca7020-9984-4d3f-bbaa-9b08bb396e45 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:37:01.317232 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca7d2c3a-2788-4c5c-b1b6-c3c3d23e95c4 tempest-TenantUsagesTestJSON-1259485157 tempest-TenantUsagesTestJSON-1259485157-project] 10.222.0.50 "GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45" status: 404 len: 111 microversion: 2.1 time: 0.052114 Aug 09 14:37:01.318060 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 874/1769] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:01 2022] GET /compute/v2.1/servers/0bca7020-9984-4d3f-bbaa-9b08bb396e45 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:37:01.324851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f024eb2-e4a1-4629-b51b-c69ded379354 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:01.326224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f024eb2-e4a1-4629-b51b-c69ded379354 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:01.333330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f024eb2-e4a1-4629-b51b-c69ded379354 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:01.334171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f024eb2-e4a1-4629-b51b-c69ded379354 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:01.335800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f024eb2-e4a1-4629-b51b-c69ded379354 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:01.336797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f024eb2-e4a1-4629-b51b-c69ded379354 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:01.337727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f024eb2-e4a1-4629-b51b-c69ded379354 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:01.338374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f024eb2-e4a1-4629-b51b-c69ded379354 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:01.525916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0f024eb2-e4a1-4629-b51b-c69ded379354 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:01.541465 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f024eb2-e4a1-4629-b51b-c69ded379354 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1298 microversion: 2.1 time: 0.222020 Aug 09 14:37:01.548023 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 875/1770] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:01 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1298 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:01.878215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60960ab5-1484-4f72-b532-2ed8a7eb07bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:01.895185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60960ab5-1484-4f72-b532-2ed8a7eb07bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:01.905395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60960ab5-1484-4f72-b532-2ed8a7eb07bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:01.911683 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60960ab5-1484-4f72-b532-2ed8a7eb07bc tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.697865 Aug 09 14:37:01.915425 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 896/1771] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:01 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:02.232736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cdd30286-0453-4f58-90a1-2594dd12fce3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:02.233732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cdd30286-0453-4f58-90a1-2594dd12fce3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:02.247667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdd30286-0453-4f58-90a1-2594dd12fce3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:02.249663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdd30286-0453-4f58-90a1-2594dd12fce3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:02.250198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdd30286-0453-4f58-90a1-2594dd12fce3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:02.252533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdd30286-0453-4f58-90a1-2594dd12fce3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:02.253127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdd30286-0453-4f58-90a1-2594dd12fce3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:02.255365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cdd30286-0453-4f58-90a1-2594dd12fce3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:02.271581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3f1775e3-1a25-47cc-8bb3-0d463b63939c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:02.272778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3f1775e3-1a25-47cc-8bb3-0d463b63939c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:02.285788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f1775e3-1a25-47cc-8bb3-0d463b63939c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:02.286682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f1775e3-1a25-47cc-8bb3-0d463b63939c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:02.288423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f1775e3-1a25-47cc-8bb3-0d463b63939c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:02.289488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f1775e3-1a25-47cc-8bb3-0d463b63939c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:02.295148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f1775e3-1a25-47cc-8bb3-0d463b63939c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:02.296205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f1775e3-1a25-47cc-8bb3-0d463b63939c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:02.492798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:02.724758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:02.751193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=18 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:02.932300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cdd30286-0453-4f58-90a1-2594dd12fce3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:02.941565 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cdd30286-0453-4f58-90a1-2594dd12fce3 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1462 microversion: 2.1 time: 0.713279 Aug 09 14:37:02.961758 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 876/1772] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:02 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1462 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:02.977894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b8984bf-4dba-4c44-a29f-8b47ffcf040e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:02.981419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b8984bf-4dba-4c44-a29f-8b47ffcf040e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:03.004606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b8984bf-4dba-4c44-a29f-8b47ffcf040e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:03.007433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b8984bf-4dba-4c44-a29f-8b47ffcf040e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:03.008958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b8984bf-4dba-4c44-a29f-8b47ffcf040e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:03.012249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3f1775e3-1a25-47cc-8bb3-0d463b63939c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:03.012942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b8984bf-4dba-4c44-a29f-8b47ffcf040e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:03.032914 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3f1775e3-1a25-47cc-8bb3-0d463b63939c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1313 microversion: 2.1 time: 0.764278 Aug 09 14:37:03.043614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b8984bf-4dba-4c44-a29f-8b47ffcf040e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:03.043614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b8984bf-4dba-4c44-a29f-8b47ffcf040e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:03.048330 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 897/1773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:02 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:37:03.068880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-26564cff-baff-4ddd-b677-a14c0349f0d4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:03.071649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-26564cff-baff-4ddd-b677-a14c0349f0d4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:03.093016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26564cff-baff-4ddd-b677-a14c0349f0d4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:03.094806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26564cff-baff-4ddd-b677-a14c0349f0d4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:03.095489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26564cff-baff-4ddd-b677-a14c0349f0d4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:03.098364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26564cff-baff-4ddd-b677-a14c0349f0d4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:03.099745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26564cff-baff-4ddd-b677-a14c0349f0d4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:03.101521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26564cff-baff-4ddd-b677-a14c0349f0d4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:03.518660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b8984bf-4dba-4c44-a29f-8b47ffcf040e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:03.527717 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b8984bf-4dba-4c44-a29f-8b47ffcf040e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1364 microversion: 2.1 time: 0.564893 Aug 09 14:37:03.542440 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 877/1774] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:02 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1364 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:03.542440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19051df2-700d-4d98-b253-926cac6c2c13 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:03.542440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-19051df2-700d-4d98-b253-926cac6c2c13 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:03.553647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19051df2-700d-4d98-b253-926cac6c2c13 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:03.554150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19051df2-700d-4d98-b253-926cac6c2c13 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:03.554589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19051df2-700d-4d98-b253-926cac6c2c13 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:03.559119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19051df2-700d-4d98-b253-926cac6c2c13 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:03.559635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19051df2-700d-4d98-b253-926cac6c2c13 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:03.560076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19051df2-700d-4d98-b253-926cac6c2c13 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:03.578956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-26564cff-baff-4ddd-b677-a14c0349f0d4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:03.592961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-26564cff-baff-4ddd-b677-a14c0349f0d4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:03.607218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-26564cff-baff-4ddd-b677-a14c0349f0d4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:03.616409 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-26564cff-baff-4ddd-b677-a14c0349f0d4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.560278 Aug 09 14:37:03.617203 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 898/1775] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:03 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:04.061045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ed70459-93a4-4fbd-98da-2b97236ba774 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:04.061945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0ed70459-93a4-4fbd-98da-2b97236ba774 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:04.064408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:04.074739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed70459-93a4-4fbd-98da-2b97236ba774 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:04.079904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed70459-93a4-4fbd-98da-2b97236ba774 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:04.080657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed70459-93a4-4fbd-98da-2b97236ba774 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:04.081585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed70459-93a4-4fbd-98da-2b97236ba774 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:04.082248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed70459-93a4-4fbd-98da-2b97236ba774 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:04.087886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ed70459-93a4-4fbd-98da-2b97236ba774 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:04.620462 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-19051df2-700d-4d98-b253-926cac6c2c13 tempest-MigrationsAdminTest-94267328 tempest-MigrationsAdminTest-94267328-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1613 microversion: 2.1 time: 1.084466 Aug 09 14:37:04.622030 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 878/1776] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:03 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1613 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:04.642128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8020d42-a8b8-41e0-99d4-ea9b05b853ff tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:04.643067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8020d42-a8b8-41e0-99d4-ea9b05b853ff tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:04.664411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8020d42-a8b8-41e0-99d4-ea9b05b853ff tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:04.665429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8020d42-a8b8-41e0-99d4-ea9b05b853ff tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:04.666287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8020d42-a8b8-41e0-99d4-ea9b05b853ff tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:04.668884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8020d42-a8b8-41e0-99d4-ea9b05b853ff tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:04.669538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8020d42-a8b8-41e0-99d4-ea9b05b853ff tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:04.674531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8020d42-a8b8-41e0-99d4-ea9b05b853ff tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:04.748914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:04.968572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0ed70459-93a4-4fbd-98da-2b97236ba774 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:04.984154 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0ed70459-93a4-4fbd-98da-2b97236ba774 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1313 microversion: 2.1 time: 0.926982 Aug 09 14:37:04.984778 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 899/1777] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:04 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1313 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:37:05.000344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c8833d4-e58a-4523-9cb6-87adce501da0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:05.001355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5c8833d4-e58a-4523-9cb6-87adce501da0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:05.015673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8833d4-e58a-4523-9cb6-87adce501da0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:05.016553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8833d4-e58a-4523-9cb6-87adce501da0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:05.017307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8833d4-e58a-4523-9cb6-87adce501da0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:05.018218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8833d4-e58a-4523-9cb6-87adce501da0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:05.018844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8833d4-e58a-4523-9cb6-87adce501da0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:05.019676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c8833d4-e58a-4523-9cb6-87adce501da0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:05.062321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:05.329697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f8020d42-a8b8-41e0-99d4-ea9b05b853ff tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:05.338227 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8020d42-a8b8-41e0-99d4-ea9b05b853ff tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1364 microversion: 2.1 time: 0.713146 Aug 09 14:37:05.340430 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 879/1778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:04 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1364 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:05.369625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42c231f4-240a-470f-a60d-e19e1a3b1325 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:05.373412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42c231f4-240a-470f-a60d-e19e1a3b1325 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:05.388508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42c231f4-240a-470f-a60d-e19e1a3b1325 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:05.390560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42c231f4-240a-470f-a60d-e19e1a3b1325 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:05.391321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42c231f4-240a-470f-a60d-e19e1a3b1325 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:05.394643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42c231f4-240a-470f-a60d-e19e1a3b1325 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:05.397545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42c231f4-240a-470f-a60d-e19e1a3b1325 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:05.398102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42c231f4-240a-470f-a60d-e19e1a3b1325 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:05.467116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42c231f4-240a-470f-a60d-e19e1a3b1325 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:37:05.631822 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42c231f4-240a-470f-a60d-e19e1a3b1325 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 204 len: 0 microversion: 2.1 time: 0.274937 Aug 09 14:37:05.633328 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 880/1779] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:37:05 2022] DELETE /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:37:05.643319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7da890ca-805e-402f-9c0f-584da337c2f1 req-268fd66e-014a-48b2-97fb-35d1520dbecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce57f31b-ee4d-4e34-9f08-5de27e71d393", "tag": "e1d8480a-75cc-470c-9389-4486ebc228d7"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:05.672837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7da890ca-805e-402f-9c0f-584da337c2f1 req-268fd66e-014a-48b2-97fb-35d1520dbecb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:05.678717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7da890ca-805e-402f-9c0f-584da337c2f1 req-268fd66e-014a-48b2-97fb-35d1520dbecb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:05.679537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7da890ca-805e-402f-9c0f-584da337c2f1 req-268fd66e-014a-48b2-97fb-35d1520dbecb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:05.716164 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7da890ca-805e-402f-9c0f-584da337c2f1 req-268fd66e-014a-48b2-97fb-35d1520dbecb service nova] Creating event network-changed:e1d8480a-75cc-470c-9389-4486ebc228d7 for instance ce57f31b-ee4d-4e34-9f08-5de27e71d393 on n-h1-844626-8 Aug 09 14:37:05.724989 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7da890ca-805e-402f-9c0f-584da337c2f1 req-268fd66e-014a-48b2-97fb-35d1520dbecb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089828 Aug 09 14:37:05.726714 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 881/1780] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:05.738343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-afa140b6-4bf1-49d0-ad27-a2fd7212326a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:05.741611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-afa140b6-4bf1-49d0-ad27-a2fd7212326a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:05.764236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afa140b6-4bf1-49d0-ad27-a2fd7212326a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:05.764827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afa140b6-4bf1-49d0-ad27-a2fd7212326a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:05.766263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afa140b6-4bf1-49d0-ad27-a2fd7212326a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:05.769491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afa140b6-4bf1-49d0-ad27-a2fd7212326a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:05.771343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afa140b6-4bf1-49d0-ad27-a2fd7212326a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:05.772850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afa140b6-4bf1-49d0-ad27-a2fd7212326a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:05.825298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c8833d4-e58a-4523-9cb6-87adce501da0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:05.837317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c8833d4-e58a-4523-9cb6-87adce501da0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:05.847148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c8833d4-e58a-4523-9cb6-87adce501da0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:05.849473 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c8833d4-e58a-4523-9cb6-87adce501da0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.863365 Aug 09 14:37:05.863266 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 900/1781] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:04 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:05.978650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1027561429", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "e3d0d942-a4ce-4d65-a1a7-7abc3ef8852f"}, {"uuid": "381533bf-0d03-46e5-85c4-af6d383989a0"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:06.102669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-afa140b6-4bf1-49d0-ad27-a2fd7212326a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:06.127228 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-afa140b6-4bf1-49d0-ad27-a2fd7212326a tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1468 microversion: 2.1 time: 0.398960 Aug 09 14:37:06.132586 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 882/1782] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:05 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1468 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:06.134502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] validate_networks() for [('e3d0d942-a4ce-4d65-a1a7-7abc3ef8852f', None, None, None, None, None), ('381533bf-0d03-46e5-85c4-af6d383989a0', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:37:06.146296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0aa2e1cc-bdf9-4913-ba91-a3a6d967dfa6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:06.150392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0aa2e1cc-bdf9-4913-ba91-a3a6d967dfa6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:06.171461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa2e1cc-bdf9-4913-ba91-a3a6d967dfa6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:06.172862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa2e1cc-bdf9-4913-ba91-a3a6d967dfa6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:06.173300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa2e1cc-bdf9-4913-ba91-a3a6d967dfa6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:06.174012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa2e1cc-bdf9-4913-ba91-a3a6d967dfa6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:06.174465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa2e1cc-bdf9-4913-ba91-a3a6d967dfa6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:06.174884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa2e1cc-bdf9-4913-ba91-a3a6d967dfa6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:06.885166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0aa2e1cc-bdf9-4913-ba91-a3a6d967dfa6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:06.903073 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0aa2e1cc-bdf9-4913-ba91-a3a6d967dfa6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1313 microversion: 2.1 time: 0.768860 Aug 09 14:37:06.904214 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 883/1783] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:06 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1313 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:06.915553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a41f7e2-4171-451e-accf-89faa40d0023 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:06.923586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a41f7e2-4171-451e-accf-89faa40d0023 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:06.941202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a41f7e2-4171-451e-accf-89faa40d0023 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:06.943036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a41f7e2-4171-451e-accf-89faa40d0023 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:06.945228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a41f7e2-4171-451e-accf-89faa40d0023 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:06.963994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a41f7e2-4171-451e-accf-89faa40d0023 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:06.968255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a41f7e2-4171-451e-accf-89faa40d0023 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:06.970438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a41f7e2-4171-451e-accf-89faa40d0023 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:08.002700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a41f7e2-4171-451e-accf-89faa40d0023 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:08.010403 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a41f7e2-4171-451e-accf-89faa40d0023 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1364 microversion: 2.1 time: 1.104272 Aug 09 14:37:08.011017 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 884/1784] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:06 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1364 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:08.023627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3732b030-efdd-41bb-834b-8b34bb3ac663 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:08.029833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3732b030-efdd-41bb-834b-8b34bb3ac663 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:08.045610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3732b030-efdd-41bb-834b-8b34bb3ac663 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:08.046107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3732b030-efdd-41bb-834b-8b34bb3ac663 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:08.046545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3732b030-efdd-41bb-834b-8b34bb3ac663 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:08.047604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3732b030-efdd-41bb-834b-8b34bb3ac663 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:08.048058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3732b030-efdd-41bb-834b-8b34bb3ac663 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:08.048477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3732b030-efdd-41bb-834b-8b34bb3ac663 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:08.207208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:37:08.208363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:37:08.209047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:37:08.209623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:37:08.210190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:37:08.213737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=99 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:08.237684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:08.246048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:08.246731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:08.247615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:08.248089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:08.248595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:08.318378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Getting quotas for project 54de373a9e684301905608f195bb56b9. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:37:08.330426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Getting quotas for user 00f1751674ba4df68ea6905988cd6510 and project 54de373a9e684301905608f195bb56b9. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:37:08.365900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:37:08.371419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:37:08.397794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3732b030-efdd-41bb-834b-8b34bb3ac663 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:08.409911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3732b030-efdd-41bb-834b-8b34bb3ac663 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:08.413924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3732b030-efdd-41bb-834b-8b34bb3ac663 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:08.419045 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3732b030-efdd-41bb-834b-8b34bb3ac663 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.406921 Aug 09 14:37:08.434499 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 885/1785] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:08 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:08.434499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ecf187a-e03b-48ff-993d-487823864fef tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:08.436827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ecf187a-e03b-48ff-993d-487823864fef tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:08.470435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ecf187a-e03b-48ff-993d-487823864fef tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:08.472931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ecf187a-e03b-48ff-993d-487823864fef tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:08.474299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ecf187a-e03b-48ff-993d-487823864fef tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:08.476573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ecf187a-e03b-48ff-993d-487823864fef tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:08.478224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ecf187a-e03b-48ff-993d-487823864fef tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:08.479189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ecf187a-e03b-48ff-993d-487823864fef tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:08.492800 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e59c13da-d0fc-42fa-b38a-78a14a5ede3c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.518207 Aug 09 14:37:08.497485 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 901/1786] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:37:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:37:08.508689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b6526b64-82c1-489c-bb29-83adfa4deb1a req-3c008769-78dc-4a1b-9efe-be0563f12f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ce2470-a122-46db-b968-ff9fc15c3166", "name": "network-vif-plugged", "status": "completed", "tag": "ddc11171-a7ed-4bdb-9894-e754060ea66f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:08.550236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b6526b64-82c1-489c-bb29-83adfa4deb1a req-3c008769-78dc-4a1b-9efe-be0563f12f9c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:08.559361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b6526b64-82c1-489c-bb29-83adfa4deb1a req-3c008769-78dc-4a1b-9efe-be0563f12f9c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:08.560909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b6526b64-82c1-489c-bb29-83adfa4deb1a req-3c008769-78dc-4a1b-9efe-be0563f12f9c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:08.595847 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b6526b64-82c1-489c-bb29-83adfa4deb1a req-3c008769-78dc-4a1b-9efe-be0563f12f9c service nova] Creating event network-vif-plugged:ddc11171-a7ed-4bdb-9894-e754060ea66f for instance 70ce2470-a122-46db-b968-ff9fc15c3166 on n-h1-844626-8 Aug 09 14:37:08.613546 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b6526b64-82c1-489c-bb29-83adfa4deb1a req-3c008769-78dc-4a1b-9efe-be0563f12f9c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114331 Aug 09 14:37:08.614189 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 902/1787] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:08.627510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-647b461a-bc14-46ba-8415-22bf895fb542 req-c64362b1-c90d-4160-97ec-c93820be4eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a2bdaee-7506-41d7-89d8-033540a2613d", "tag": "ac0b0587-1765-4942-9531-0558c309477e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:08.661233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-647b461a-bc14-46ba-8415-22bf895fb542 req-c64362b1-c90d-4160-97ec-c93820be4eae service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:08.662125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-647b461a-bc14-46ba-8415-22bf895fb542 req-c64362b1-c90d-4160-97ec-c93820be4eae service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:08.663026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-647b461a-bc14-46ba-8415-22bf895fb542 req-c64362b1-c90d-4160-97ec-c93820be4eae service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:08.693805 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-647b461a-bc14-46ba-8415-22bf895fb542 req-c64362b1-c90d-4160-97ec-c93820be4eae service nova] Creating event network-changed:ac0b0587-1765-4942-9531-0558c309477e for instance 7a2bdaee-7506-41d7-89d8-033540a2613d on n-h1-844626-8 Aug 09 14:37:08.710476 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-647b461a-bc14-46ba-8415-22bf895fb542 req-c64362b1-c90d-4160-97ec-c93820be4eae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093344 Aug 09 14:37:08.711529 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 903/1788] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:08.722503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aaeb3a72-bec9-4a35-8298-d4f4d1e901c3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:08.723382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aaeb3a72-bec9-4a35-8298-d4f4d1e901c3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:08.744212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaeb3a72-bec9-4a35-8298-d4f4d1e901c3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:08.745533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaeb3a72-bec9-4a35-8298-d4f4d1e901c3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:08.750993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaeb3a72-bec9-4a35-8298-d4f4d1e901c3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:08.753640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaeb3a72-bec9-4a35-8298-d4f4d1e901c3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:08.756797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaeb3a72-bec9-4a35-8298-d4f4d1e901c3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:08.757927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaeb3a72-bec9-4a35-8298-d4f4d1e901c3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:09.105698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aaeb3a72-bec9-4a35-8298-d4f4d1e901c3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:09.153718 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aaeb3a72-bec9-4a35-8298-d4f4d1e901c3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1313 microversion: 2.1 time: 0.436596 Aug 09 14:37:09.155714 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 904/1789] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:08 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:09.174456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ecf187a-e03b-48ff-993d-487823864fef tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:09.194941 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ecf187a-e03b-48ff-993d-487823864fef tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1468 microversion: 2.1 time: 0.769892 Aug 09 14:37:09.208648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ff406e89-f622-40fb-a02f-bb787195fa14 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:09.210160 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 886/1790] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:08 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1468 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:09.211951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ff406e89-f622-40fb-a02f-bb787195fa14 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:09.214274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1844668b-82b8-4a32-8c67-af45f0191337 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:09.215250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1844668b-82b8-4a32-8c67-af45f0191337 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:09.222223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1844668b-82b8-4a32-8c67-af45f0191337 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:09.222983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1844668b-82b8-4a32-8c67-af45f0191337 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:09.223626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1844668b-82b8-4a32-8c67-af45f0191337 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:09.224519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1844668b-82b8-4a32-8c67-af45f0191337 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:09.225144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1844668b-82b8-4a32-8c67-af45f0191337 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:09.225727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1844668b-82b8-4a32-8c67-af45f0191337 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:09.348266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ff406e89-f622-40fb-a02f-bb787195fa14 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:09.358694 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ff406e89-f622-40fb-a02f-bb787195fa14 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1213 microversion: 2.1 time: 0.200340 Aug 09 14:37:09.359275 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 905/1791] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:09 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:09.454530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b5e0118f-3581-439b-8024-2f258bcc3ad5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:09.455165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b5e0118f-3581-439b-8024-2f258bcc3ad5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:09.465823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5e0118f-3581-439b-8024-2f258bcc3ad5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:09.467707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5e0118f-3581-439b-8024-2f258bcc3ad5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:09.468976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5e0118f-3581-439b-8024-2f258bcc3ad5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:09.471144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5e0118f-3581-439b-8024-2f258bcc3ad5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:09.474054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5e0118f-3581-439b-8024-2f258bcc3ad5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:09.474756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5e0118f-3581-439b-8024-2f258bcc3ad5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:09.572120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1844668b-82b8-4a32-8c67-af45f0191337 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:09.586718 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1844668b-82b8-4a32-8c67-af45f0191337 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1364 microversion: 2.1 time: 0.372735 Aug 09 14:37:09.600695 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 887/1792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:09 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1364 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:09.836332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b5e0118f-3581-439b-8024-2f258bcc3ad5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:09.860001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b5e0118f-3581-439b-8024-2f258bcc3ad5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:09.864978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b5e0118f-3581-439b-8024-2f258bcc3ad5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:09.868480 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b5e0118f-3581-439b-8024-2f258bcc3ad5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.425545 Aug 09 14:37:09.876799 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 906/1793] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:09 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:37:10.181034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-003c3779-c959-465c-a735-14349cbea974 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:10.183502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-003c3779-c959-465c-a735-14349cbea974 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:10.195511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-003c3779-c959-465c-a735-14349cbea974 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:10.199330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-003c3779-c959-465c-a735-14349cbea974 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:10.201127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-003c3779-c959-465c-a735-14349cbea974 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:10.202320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-003c3779-c959-465c-a735-14349cbea974 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:10.202806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-003c3779-c959-465c-a735-14349cbea974 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:10.204681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-003c3779-c959-465c-a735-14349cbea974 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:10.225466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f7194b09-57ad-4323-bc5e-3dea41937733 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:10.226802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7194b09-57ad-4323-bc5e-3dea41937733 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:10.245590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7194b09-57ad-4323-bc5e-3dea41937733 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:10.246893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7194b09-57ad-4323-bc5e-3dea41937733 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:10.248547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7194b09-57ad-4323-bc5e-3dea41937733 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:10.252340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7194b09-57ad-4323-bc5e-3dea41937733 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:10.256786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7194b09-57ad-4323-bc5e-3dea41937733 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:10.257873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7194b09-57ad-4323-bc5e-3dea41937733 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:10.696149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f7194b09-57ad-4323-bc5e-3dea41937733 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:10.710545 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f7194b09-57ad-4323-bc5e-3dea41937733 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 200 len: 1426 microversion: 2.1 time: 0.498150 Aug 09 14:37:10.712186 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 907/1794] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:10 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 1426 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:10.729169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0653bf63-10c6-43b3-b587-3413f72f225d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:10.730282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0653bf63-10c6-43b3-b587-3413f72f225d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:10.749872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0653bf63-10c6-43b3-b587-3413f72f225d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:10.752944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0653bf63-10c6-43b3-b587-3413f72f225d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:10.754595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0653bf63-10c6-43b3-b587-3413f72f225d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:10.757003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0653bf63-10c6-43b3-b587-3413f72f225d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:10.758262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0653bf63-10c6-43b3-b587-3413f72f225d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:10.759784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0653bf63-10c6-43b3-b587-3413f72f225d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:10.948496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0653bf63-10c6-43b3-b587-3413f72f225d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:10.962772 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0653bf63-10c6-43b3-b587-3413f72f225d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1217 microversion: 2.1 time: 0.248672 Aug 09 14:37:10.969788 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 908/1795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:10 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1217 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:10.990398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07b0b641-33f6-4c87-ba74-2d8117ee7e09 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:10.993232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07b0b641-33f6-4c87-ba74-2d8117ee7e09 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:11.014893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b0b641-33f6-4c87-ba74-2d8117ee7e09 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:11.015839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b0b641-33f6-4c87-ba74-2d8117ee7e09 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:11.025144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b0b641-33f6-4c87-ba74-2d8117ee7e09 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:11.026373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b0b641-33f6-4c87-ba74-2d8117ee7e09 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:11.030358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b0b641-33f6-4c87-ba74-2d8117ee7e09 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:11.033249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07b0b641-33f6-4c87-ba74-2d8117ee7e09 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:11.074556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-003c3779-c959-465c-a735-14349cbea974 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:11.084030 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-003c3779-c959-465c-a735-14349cbea974 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1313 microversion: 2.1 time: 0.908233 Aug 09 14:37:11.084639 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 888/1796] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:10 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1313 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:11.135320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-80d23940-e668-41ad-905e-d9499412ab3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:11.136007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-80d23940-e668-41ad-905e-d9499412ab3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:11.170493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80d23940-e668-41ad-905e-d9499412ab3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:11.171362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80d23940-e668-41ad-905e-d9499412ab3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:11.172413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80d23940-e668-41ad-905e-d9499412ab3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:11.173359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80d23940-e668-41ad-905e-d9499412ab3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:11.174745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80d23940-e668-41ad-905e-d9499412ab3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:11.176006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80d23940-e668-41ad-905e-d9499412ab3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:11.505840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07b0b641-33f6-4c87-ba74-2d8117ee7e09 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:11.515788 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07b0b641-33f6-4c87-ba74-2d8117ee7e09 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1364 microversion: 2.1 time: 0.543643 Aug 09 14:37:11.516397 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 909/1797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:10 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1364 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:11.524234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b98eea4b-0b85-4ff6-859a-abee2028f987 req-a92f844f-f58b-4ddd-b15a-b497154dc891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9192b19-8eae-49be-94bd-9a7cb5ace3e0", "name": "network-vif-deleted", "tag": "73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:11.561390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b98eea4b-0b85-4ff6-859a-abee2028f987 req-a92f844f-f58b-4ddd-b15a-b497154dc891 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:11.563802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b98eea4b-0b85-4ff6-859a-abee2028f987 req-a92f844f-f58b-4ddd-b15a-b497154dc891 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:11.573107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b98eea4b-0b85-4ff6-859a-abee2028f987 req-a92f844f-f58b-4ddd-b15a-b497154dc891 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:11.600862 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b98eea4b-0b85-4ff6-859a-abee2028f987 req-a92f844f-f58b-4ddd-b15a-b497154dc891 service nova] Creating event network-vif-deleted:73c16225-2c8f-48bb-a5e2-3a41bf0f6e0e for instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 on n-h2-844626-8 Aug 09 14:37:11.603135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-80d23940-e668-41ad-905e-d9499412ab3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:11.618604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-80d23940-e668-41ad-905e-d9499412ab3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:11.624492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-80d23940-e668-41ad-905e-d9499412ab3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:11.626130 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-80d23940-e668-41ad-905e-d9499412ab3d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.527824 Aug 09 14:37:11.627260 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b98eea4b-0b85-4ff6-859a-abee2028f987 req-a92f844f-f58b-4ddd-b15a-b497154dc891 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106389 Aug 09 14:37:11.627899 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 910/1798] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:11.629714 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 889/1799] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:11 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:11.740012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ca9441ec-92ea-4d64-8a26-697f2ad8b67d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:11.740982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ca9441ec-92ea-4d64-8a26-697f2ad8b67d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: a9192b19-8eae-49be-94bd-9a7cb5ace3e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:11.760439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9441ec-92ea-4d64-8a26-697f2ad8b67d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:11.761700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9441ec-92ea-4d64-8a26-697f2ad8b67d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:11.763497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9441ec-92ea-4d64-8a26-697f2ad8b67d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:11.764472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9441ec-92ea-4d64-8a26-697f2ad8b67d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:11.765153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9441ec-92ea-4d64-8a26-697f2ad8b67d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:11.765733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca9441ec-92ea-4d64-8a26-697f2ad8b67d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:11.801758 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-ca9441ec-92ea-4d64-8a26-697f2ad8b67d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] HTTP exception thrown: Instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 could not be found. Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ca9441ec-92ea-4d64-8a26-697f2ad8b67d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Request method failure captured: Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 HTTP/1.1 Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_PSpamP3PkBEfxc1aBq7A-wlWS8IBO2evcyAT9GQhfTEKq24_uExuYvSdqYfP0rfj5XhpaLWmCAflZ2wdPdaw36lS2CvA36WN_F0xOuGQ3M1UINpIS_y3XQcmWND5r5lVmzq_3OXTtAeLuAIdBuwk1eJhEQvFEGiAstCboyQPGk7Q Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 21a086b8d4904e118283cea8eb12b678 Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-MigrationsAdminTest-729516492 Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_21a086b8d4904e118283cea8eb12b678", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/21a086b8d4904e118283cea8eb12b678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/21a086b8d4904e118283cea8eb12b678"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/21a086b8d4904e118283cea8eb12b678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-MigrationsAdminTest-729516492 Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 21a086b8d4904e118283cea8eb12b678 Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-MigrationsAdminTest-729516492 Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-MigrationsAdminTest-729516492-project Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: c45d9a126a0841d5938ee21e8e87b293 Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-MigrationsAdminTest-729516492-project Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 could not be found. Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'a9192b19-8eae-49be-94bd-9a7cb5ace3e0'} Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 could not be found. Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 could not be found. Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:37:11.809317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:11.815138 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:11.815138 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:37:11.815138 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:37:11.815138 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:37:11.815138 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:37:11.815138 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 could not be found. Aug 09 14:37:11.815138 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:11.819723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ca9441ec-92ea-4d64-8a26-697f2ad8b67d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Returning 404 to user: Instance a9192b19-8eae-49be-94bd-9a7cb5ace3e0 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:37:11.820875 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ca9441ec-92ea-4d64-8a26-697f2ad8b67d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0" status: 404 len: 111 microversion: 2.1 time: 0.089082 Aug 09 14:37:11.821702 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 911/1800] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:11 2022] GET /compute/v2.1/servers/a9192b19-8eae-49be-94bd-9a7cb5ace3e0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:37:11.831336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8617e20e-bbd2-46ce-8a74-eeec7c98b9b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:11.832147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8617e20e-bbd2-46ce-8a74-eeec7c98b9b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:11.840556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8617e20e-bbd2-46ce-8a74-eeec7c98b9b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:11.841369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8617e20e-bbd2-46ce-8a74-eeec7c98b9b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:11.842100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8617e20e-bbd2-46ce-8a74-eeec7c98b9b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:11.843289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8617e20e-bbd2-46ce-8a74-eeec7c98b9b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:11.843957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8617e20e-bbd2-46ce-8a74-eeec7c98b9b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:11.844622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8617e20e-bbd2-46ce-8a74-eeec7c98b9b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:11.912656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8617e20e-bbd2-46ce-8a74-eeec7c98b9b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:37:11.993870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f556f78a-6c43-417d-905c-d83f02da018d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:11.994774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f556f78a-6c43-417d-905c-d83f02da018d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:12.016207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f556f78a-6c43-417d-905c-d83f02da018d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:12.017819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f556f78a-6c43-417d-905c-d83f02da018d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:12.018273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f556f78a-6c43-417d-905c-d83f02da018d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:12.026289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f556f78a-6c43-417d-905c-d83f02da018d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:12.028707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f556f78a-6c43-417d-905c-d83f02da018d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:12.030435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f556f78a-6c43-417d-905c-d83f02da018d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:12.130200 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8617e20e-bbd2-46ce-8a74-eeec7c98b9b7 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "DELETE /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 204 len: 0 microversion: 2.1 time: 0.301931 Aug 09 14:37:12.136559 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 890/1801] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:37:11 2022] DELETE /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:37:12.144800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-451da236-d77d-4ecd-98d5-5e70436df1b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:12.145427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-451da236-d77d-4ecd-98d5-5e70436df1b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:12.164644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-451da236-d77d-4ecd-98d5-5e70436df1b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:12.165428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-451da236-d77d-4ecd-98d5-5e70436df1b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:12.166024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-451da236-d77d-4ecd-98d5-5e70436df1b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:12.166980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-451da236-d77d-4ecd-98d5-5e70436df1b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:12.167720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-451da236-d77d-4ecd-98d5-5e70436df1b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:12.168385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-451da236-d77d-4ecd-98d5-5e70436df1b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:12.191676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f556f78a-6c43-417d-905c-d83f02da018d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:12.204621 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f556f78a-6c43-417d-905c-d83f02da018d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1265 microversion: 2.1 time: 0.215519 Aug 09 14:37:12.205732 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 912/1802] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:11 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:12.211078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16937cfd-82cd-4a81-9019-9a60d90b2284 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:12.213588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-16937cfd-82cd-4a81-9019-9a60d90b2284 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:12.221897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16937cfd-82cd-4a81-9019-9a60d90b2284 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:12.222869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16937cfd-82cd-4a81-9019-9a60d90b2284 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:12.223789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16937cfd-82cd-4a81-9019-9a60d90b2284 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:12.224920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16937cfd-82cd-4a81-9019-9a60d90b2284 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:12.225552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16937cfd-82cd-4a81-9019-9a60d90b2284 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:12.226134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16937cfd-82cd-4a81-9019-9a60d90b2284 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:12.571540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-16937cfd-82cd-4a81-9019-9a60d90b2284 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:12.581857 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16937cfd-82cd-4a81-9019-9a60d90b2284 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1535 microversion: 2.1 time: 0.374936 Aug 09 14:37:12.589212 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 913/1803] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:12 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1535 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:12.600306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d22b9df8-1d0f-4403-ad4b-ba856de046b4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:12.603603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d22b9df8-1d0f-4403-ad4b-ba856de046b4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:12.620519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22b9df8-1d0f-4403-ad4b-ba856de046b4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:12.623573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22b9df8-1d0f-4403-ad4b-ba856de046b4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:12.624270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22b9df8-1d0f-4403-ad4b-ba856de046b4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:12.625534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22b9df8-1d0f-4403-ad4b-ba856de046b4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:12.626025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22b9df8-1d0f-4403-ad4b-ba856de046b4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:12.626454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22b9df8-1d0f-4403-ad4b-ba856de046b4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:12.644065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-451da236-d77d-4ecd-98d5-5e70436df1b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:12.662823 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-451da236-d77d-4ecd-98d5-5e70436df1b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1462 microversion: 2.1 time: 0.524526 Aug 09 14:37:12.664255 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 891/1804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:12 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1462 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:12.670589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-90dbd7c5-7a99-47b9-bb63-1eb542a6e6d5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:12.671254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-90dbd7c5-7a99-47b9-bb63-1eb542a6e6d5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:12.680798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90dbd7c5-7a99-47b9-bb63-1eb542a6e6d5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:12.681298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90dbd7c5-7a99-47b9-bb63-1eb542a6e6d5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:12.681730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90dbd7c5-7a99-47b9-bb63-1eb542a6e6d5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:12.682445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90dbd7c5-7a99-47b9-bb63-1eb542a6e6d5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:12.685158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90dbd7c5-7a99-47b9-bb63-1eb542a6e6d5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:12.685918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90dbd7c5-7a99-47b9-bb63-1eb542a6e6d5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:12.933492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d22b9df8-1d0f-4403-ad4b-ba856de046b4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:12.945624 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d22b9df8-1d0f-4403-ad4b-ba856de046b4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1364 microversion: 2.1 time: 0.354966 Aug 09 14:37:12.946234 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 914/1805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:12 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1364 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:12.966500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aa0e8b69-0d8e-4fe9-892c-1518f85eb5b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:12.967518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aa0e8b69-0d8e-4fe9-892c-1518f85eb5b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:12.974511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0e8b69-0d8e-4fe9-892c-1518f85eb5b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:12.975347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0e8b69-0d8e-4fe9-892c-1518f85eb5b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:12.975991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0e8b69-0d8e-4fe9-892c-1518f85eb5b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:12.976950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0e8b69-0d8e-4fe9-892c-1518f85eb5b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:12.977573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0e8b69-0d8e-4fe9-892c-1518f85eb5b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:12.978377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa0e8b69-0d8e-4fe9-892c-1518f85eb5b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:12.990121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-90dbd7c5-7a99-47b9-bb63-1eb542a6e6d5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:13.006677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-90dbd7c5-7a99-47b9-bb63-1eb542a6e6d5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:13.008916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-90dbd7c5-7a99-47b9-bb63-1eb542a6e6d5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:13.010904 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-90dbd7c5-7a99-47b9-bb63-1eb542a6e6d5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.344161 Aug 09 14:37:13.012670 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 892/1806] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:12 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:13.228098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f326f0b1-23de-4cfe-9be6-3411a9586883 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:13.229490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f326f0b1-23de-4cfe-9be6-3411a9586883 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:13.240684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f326f0b1-23de-4cfe-9be6-3411a9586883 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:13.242729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f326f0b1-23de-4cfe-9be6-3411a9586883 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:13.244467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f326f0b1-23de-4cfe-9be6-3411a9586883 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:13.247968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f326f0b1-23de-4cfe-9be6-3411a9586883 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:13.251684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f326f0b1-23de-4cfe-9be6-3411a9586883 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:13.252621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f326f0b1-23de-4cfe-9be6-3411a9586883 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:13.293708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aa0e8b69-0d8e-4fe9-892c-1518f85eb5b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:13.301764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:13.306068 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aa0e8b69-0d8e-4fe9-892c-1518f85eb5b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1313 microversion: 2.1 time: 0.345312 Aug 09 14:37:13.306768 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 915/1807] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:12 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:13.391410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f326f0b1-23de-4cfe-9be6-3411a9586883 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:13.404505 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f326f0b1-23de-4cfe-9be6-3411a9586883 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1283 microversion: 2.1 time: 0.180763 Aug 09 14:37:13.405697 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 893/1808] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:13 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1283 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:13.620745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5cb135ff-5462-4701-a227-91b6d27f029d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:13.622174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5cb135ff-5462-4701-a227-91b6d27f029d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:13.639825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb135ff-5462-4701-a227-91b6d27f029d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:13.640642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb135ff-5462-4701-a227-91b6d27f029d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:13.644278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb135ff-5462-4701-a227-91b6d27f029d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:13.646305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb135ff-5462-4701-a227-91b6d27f029d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:13.648150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb135ff-5462-4701-a227-91b6d27f029d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:13.654439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb135ff-5462-4701-a227-91b6d27f029d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:13.902430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5cb135ff-5462-4701-a227-91b6d27f029d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:13.956654 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5cb135ff-5462-4701-a227-91b6d27f029d tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1535 microversion: 2.1 time: 0.349504 Aug 09 14:37:13.958668 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 916/1809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:13 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1535 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:13.967012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d4aaf3f-01b9-4200-9241-e1d995135e68 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:13.967924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3d4aaf3f-01b9-4200-9241-e1d995135e68 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:13.974712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:13.981680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d4aaf3f-01b9-4200-9241-e1d995135e68 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:13.982194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d4aaf3f-01b9-4200-9241-e1d995135e68 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:13.987766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d4aaf3f-01b9-4200-9241-e1d995135e68 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:13.990331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d4aaf3f-01b9-4200-9241-e1d995135e68 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:13.990823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d4aaf3f-01b9-4200-9241-e1d995135e68 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:13.993273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d4aaf3f-01b9-4200-9241-e1d995135e68 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:14.044849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72cb62a6-bff5-4e71-ae18-d5f3ba53e536 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:14.047664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-72cb62a6-bff5-4e71-ae18-d5f3ba53e536 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:14.071791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72cb62a6-bff5-4e71-ae18-d5f3ba53e536 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:14.073801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72cb62a6-bff5-4e71-ae18-d5f3ba53e536 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:14.078784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72cb62a6-bff5-4e71-ae18-d5f3ba53e536 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:14.084949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72cb62a6-bff5-4e71-ae18-d5f3ba53e536 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:14.089079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72cb62a6-bff5-4e71-ae18-d5f3ba53e536 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:14.093088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72cb62a6-bff5-4e71-ae18-d5f3ba53e536 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:14.374559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d4aaf3f-01b9-4200-9241-e1d995135e68 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:14.383474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-72cb62a6-bff5-4e71-ae18-d5f3ba53e536 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:14.388233 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d4aaf3f-01b9-4200-9241-e1d995135e68 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1364 microversion: 2.1 time: 0.426023 Aug 09 14:37:14.388913 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 894/1810] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:13 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1364 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:14.403136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-72cb62a6-bff5-4e71-ae18-d5f3ba53e536 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:14.405029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79f8eeea-67b7-4f71-aad2-07356f72b401 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:14.405649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-79f8eeea-67b7-4f71-aad2-07356f72b401 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:14.410296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-72cb62a6-bff5-4e71-ae18-d5f3ba53e536 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:14.413350 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72cb62a6-bff5-4e71-ae18-d5f3ba53e536 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.379060 Aug 09 14:37:14.414203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79f8eeea-67b7-4f71-aad2-07356f72b401 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:14.415268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79f8eeea-67b7-4f71-aad2-07356f72b401 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:14.416203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79f8eeea-67b7-4f71-aad2-07356f72b401 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:14.416452 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 917/1811] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:14 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:14.417537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79f8eeea-67b7-4f71-aad2-07356f72b401 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:14.418233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79f8eeea-67b7-4f71-aad2-07356f72b401 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:14.418956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79f8eeea-67b7-4f71-aad2-07356f72b401 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:14.431956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-661d6258-f4b7-4827-86de-65ba6adeb798 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:14.433277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-661d6258-f4b7-4827-86de-65ba6adeb798 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:14.452929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-661d6258-f4b7-4827-86de-65ba6adeb798 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:14.453544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-661d6258-f4b7-4827-86de-65ba6adeb798 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:14.453865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-661d6258-f4b7-4827-86de-65ba6adeb798 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:14.454891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-661d6258-f4b7-4827-86de-65ba6adeb798 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:14.455348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-661d6258-f4b7-4827-86de-65ba6adeb798 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:14.455772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-661d6258-f4b7-4827-86de-65ba6adeb798 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:14.602854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-661d6258-f4b7-4827-86de-65ba6adeb798 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:14.615877 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-661d6258-f4b7-4827-86de-65ba6adeb798 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1271 microversion: 2.1 time: 0.193289 Aug 09 14:37:14.627715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-79f8eeea-67b7-4f71-aad2-07356f72b401 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:14.636839 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 918/1812] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:14 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:14.640420 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-79f8eeea-67b7-4f71-aad2-07356f72b401 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1313 microversion: 2.1 time: 0.248052 Aug 09 14:37:14.641734 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 895/1813] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:14 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:14.985962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40a305ad-5f70-4f28-bf86-818b9808d223 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:14.989834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40a305ad-5f70-4f28-bf86-818b9808d223 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:15.008989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40a305ad-5f70-4f28-bf86-818b9808d223 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:15.011359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40a305ad-5f70-4f28-bf86-818b9808d223 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:15.016133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40a305ad-5f70-4f28-bf86-818b9808d223 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:15.022063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40a305ad-5f70-4f28-bf86-818b9808d223 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:15.022858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40a305ad-5f70-4f28-bf86-818b9808d223 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:15.023672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40a305ad-5f70-4f28-bf86-818b9808d223 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:15.368248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40a305ad-5f70-4f28-bf86-818b9808d223 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:15.388021 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40a305ad-5f70-4f28-bf86-818b9808d223 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1535 microversion: 2.1 time: 0.412285 Aug 09 14:37:15.392986 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 919/1814] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:14 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1535 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:15.410774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7219311a-eb20-4ea7-9972-2f9cf1773903 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:15.412682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7219311a-eb20-4ea7-9972-2f9cf1773903 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:15.434734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7219311a-eb20-4ea7-9972-2f9cf1773903 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:15.435683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7219311a-eb20-4ea7-9972-2f9cf1773903 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:15.437779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7219311a-eb20-4ea7-9972-2f9cf1773903 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:15.439898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7219311a-eb20-4ea7-9972-2f9cf1773903 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:15.441029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7219311a-eb20-4ea7-9972-2f9cf1773903 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:15.441758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7219311a-eb20-4ea7-9972-2f9cf1773903 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:15.443707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bef7e0e5-9095-4585-99f0-c9f7519e7f14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:15.444417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bef7e0e5-9095-4585-99f0-c9f7519e7f14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:15.463258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bef7e0e5-9095-4585-99f0-c9f7519e7f14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:15.466020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bef7e0e5-9095-4585-99f0-c9f7519e7f14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:15.468126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bef7e0e5-9095-4585-99f0-c9f7519e7f14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:15.471346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bef7e0e5-9095-4585-99f0-c9f7519e7f14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:15.471984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bef7e0e5-9095-4585-99f0-c9f7519e7f14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:15.474087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bef7e0e5-9095-4585-99f0-c9f7519e7f14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:15.903610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7219311a-eb20-4ea7-9972-2f9cf1773903 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:15.911657 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7219311a-eb20-4ea7-9972-2f9cf1773903 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1364 microversion: 2.1 time: 0.505580 Aug 09 14:37:15.915498 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 896/1815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:15 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1364 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:15.927609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-89889f56-1be7-4ab8-933b-2a6ca301435e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:15.928794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-89889f56-1be7-4ab8-933b-2a6ca301435e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:15.943465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89889f56-1be7-4ab8-933b-2a6ca301435e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:15.943958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89889f56-1be7-4ab8-933b-2a6ca301435e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:15.944388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89889f56-1be7-4ab8-933b-2a6ca301435e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:15.950507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89889f56-1be7-4ab8-933b-2a6ca301435e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:15.951005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89889f56-1be7-4ab8-933b-2a6ca301435e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:15.951556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89889f56-1be7-4ab8-933b-2a6ca301435e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:15.975714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bef7e0e5-9095-4585-99f0-c9f7519e7f14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:15.998369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bef7e0e5-9095-4585-99f0-c9f7519e7f14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:16.001410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bef7e0e5-9095-4585-99f0-c9f7519e7f14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:16.006398 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bef7e0e5-9095-4585-99f0-c9f7519e7f14 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.567965 Aug 09 14:37:16.007898 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 920/1816] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:15 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:16.034380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bab50754-659d-4566-a327-38f0cf23f6b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:16.035255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bab50754-659d-4566-a327-38f0cf23f6b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:16.050976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bab50754-659d-4566-a327-38f0cf23f6b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:16.053260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bab50754-659d-4566-a327-38f0cf23f6b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:16.054473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bab50754-659d-4566-a327-38f0cf23f6b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:16.056398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-89889f56-1be7-4ab8-933b-2a6ca301435e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:16.061006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bab50754-659d-4566-a327-38f0cf23f6b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:16.063072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bab50754-659d-4566-a327-38f0cf23f6b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:16.064674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bab50754-659d-4566-a327-38f0cf23f6b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:16.065436 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-89889f56-1be7-4ab8-933b-2a6ca301435e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1271 microversion: 2.1 time: 0.148554 Aug 09 14:37:16.080032 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 897/1817] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:15 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:16.120919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:16.418956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bab50754-659d-4566-a327-38f0cf23f6b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:16.425761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b6a5a883-8f72-4288-a77c-651cb13301b1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:16.427385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6a5a883-8f72-4288-a77c-651cb13301b1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:16.466409 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bab50754-659d-4566-a327-38f0cf23f6b2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1313 microversion: 2.1 time: 0.440432 Aug 09 14:37:16.466409 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 921/1818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:16 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:16.478025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6a5a883-8f72-4288-a77c-651cb13301b1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:16.478025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6a5a883-8f72-4288-a77c-651cb13301b1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:16.478025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6a5a883-8f72-4288-a77c-651cb13301b1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:16.478025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6a5a883-8f72-4288-a77c-651cb13301b1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:16.478025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6a5a883-8f72-4288-a77c-651cb13301b1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:16.478025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6a5a883-8f72-4288-a77c-651cb13301b1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:16.481763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-6a6d0bb6-6537-4ce7-a59d-a322c6e3745c req-26c942b0-7bfc-4fee-9479-544b936f3c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268d8e06-f80e-4f5e-8710-578f4eef5bab", "name": "network-vif-unplugged", "status": "completed", "tag": "4115b00e-91cf-4c28-b173-c0ec442c3cfb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:16.529792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6a6d0bb6-6537-4ce7-a59d-a322c6e3745c req-26c942b0-7bfc-4fee-9479-544b936f3c34 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:16.530275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6a6d0bb6-6537-4ce7-a59d-a322c6e3745c req-26c942b0-7bfc-4fee-9479-544b936f3c34 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:16.530715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6a6d0bb6-6537-4ce7-a59d-a322c6e3745c req-26c942b0-7bfc-4fee-9479-544b936f3c34 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:16.590999 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-6a6d0bb6-6537-4ce7-a59d-a322c6e3745c req-26c942b0-7bfc-4fee-9479-544b936f3c34 service nova] Creating event network-vif-unplugged:4115b00e-91cf-4c28-b173-c0ec442c3cfb for instance 268d8e06-f80e-4f5e-8710-578f4eef5bab on n-h2-844626-8 Aug 09 14:37:16.610653 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-6a6d0bb6-6537-4ce7-a59d-a322c6e3745c req-26c942b0-7bfc-4fee-9479-544b936f3c34 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148354 Aug 09 14:37:16.613529 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 922/1819] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:16.769585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b6a5a883-8f72-4288-a77c-651cb13301b1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:16.781768 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b6a5a883-8f72-4288-a77c-651cb13301b1 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1535 microversion: 2.1 time: 0.371756 Aug 09 14:37:16.784289 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 898/1820] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:16 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1535 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:37:16.939809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d198d61e-09ad-4838-83ce-43f7f0f104ca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:16.940539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d198d61e-09ad-4838-83ce-43f7f0f104ca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:16.951892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d198d61e-09ad-4838-83ce-43f7f0f104ca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:16.957357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d198d61e-09ad-4838-83ce-43f7f0f104ca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:16.957357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d198d61e-09ad-4838-83ce-43f7f0f104ca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:16.957357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d198d61e-09ad-4838-83ce-43f7f0f104ca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:16.957357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d198d61e-09ad-4838-83ce-43f7f0f104ca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:16.957357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d198d61e-09ad-4838-83ce-43f7f0f104ca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:17.032908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b7e4ab0-c23d-43fd-aa06-5c36e9bc71f0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:17.033879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b7e4ab0-c23d-43fd-aa06-5c36e9bc71f0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:17.045249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b7e4ab0-c23d-43fd-aa06-5c36e9bc71f0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:17.048204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b7e4ab0-c23d-43fd-aa06-5c36e9bc71f0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:17.049117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b7e4ab0-c23d-43fd-aa06-5c36e9bc71f0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:17.052842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b7e4ab0-c23d-43fd-aa06-5c36e9bc71f0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:17.053462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b7e4ab0-c23d-43fd-aa06-5c36e9bc71f0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:17.055779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b7e4ab0-c23d-43fd-aa06-5c36e9bc71f0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:17.254879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d198d61e-09ad-4838-83ce-43f7f0f104ca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:17.265159 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d198d61e-09ad-4838-83ce-43f7f0f104ca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1364 microversion: 2.1 time: 0.329766 Aug 09 14:37:17.278007 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 923/1821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:16 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:17.292998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9bb8b99b-06ea-4479-abe8-02be5e1aa326 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:17.293622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9bb8b99b-06ea-4479-abe8-02be5e1aa326 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:17.316983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9bb8b99b-06ea-4479-abe8-02be5e1aa326 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:17.317484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9bb8b99b-06ea-4479-abe8-02be5e1aa326 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:17.317917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9bb8b99b-06ea-4479-abe8-02be5e1aa326 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:17.318628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9bb8b99b-06ea-4479-abe8-02be5e1aa326 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:17.319071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9bb8b99b-06ea-4479-abe8-02be5e1aa326 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:17.319562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9bb8b99b-06ea-4479-abe8-02be5e1aa326 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:17.412004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6b7e4ab0-c23d-43fd-aa06-5c36e9bc71f0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:17.425919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6b7e4ab0-c23d-43fd-aa06-5c36e9bc71f0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:17.434936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6b7e4ab0-c23d-43fd-aa06-5c36e9bc71f0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:17.436407 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b7e4ab0-c23d-43fd-aa06-5c36e9bc71f0 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.409271 Aug 09 14:37:17.453499 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 899/1822] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:17 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:17.496325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-09942371-0172-4667-9b30-3cffb33f96b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:17.496758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-09942371-0172-4667-9b30-3cffb33f96b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:17.522622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09942371-0172-4667-9b30-3cffb33f96b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:17.523210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09942371-0172-4667-9b30-3cffb33f96b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:17.523655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09942371-0172-4667-9b30-3cffb33f96b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:17.536049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09942371-0172-4667-9b30-3cffb33f96b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:17.536815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09942371-0172-4667-9b30-3cffb33f96b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:17.537147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-09942371-0172-4667-9b30-3cffb33f96b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:18.042931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9bb8b99b-06ea-4479-abe8-02be5e1aa326 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:18.061570 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9bb8b99b-06ea-4479-abe8-02be5e1aa326 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1313 microversion: 2.1 time: 0.775418 Aug 09 14:37:18.063498 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 924/1823] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:17 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1313 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:18.078090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:18.079174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:18.096240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:18.097614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:18.099861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:18.101092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:18.103195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:18.104397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:18.120103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-09942371-0172-4667-9b30-3cffb33f96b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:18.129777 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-09942371-0172-4667-9b30-3cffb33f96b6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1313 microversion: 2.1 time: 0.639043 Aug 09 14:37:18.130383 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 900/1824] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:17 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:18.154979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ca35ecb6-458a-468f-952e-60994cd3401f req-de0143ac-0a19-43e9-b3e1-85736a95b290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce57f31b-ee4d-4e34-9f08-5de27e71d393", "name": "network-vif-plugged", "status": "completed", "tag": "e1d8480a-75cc-470c-9389-4486ebc228d7"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:18.199464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:18.201132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:18.201982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:18.203377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lazy-loading 'fault' on Instance uuid 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:37:18.206277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ca35ecb6-458a-468f-952e-60994cd3401f req-de0143ac-0a19-43e9-b3e1-85736a95b290 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:18.207837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ca35ecb6-458a-468f-952e-60994cd3401f req-de0143ac-0a19-43e9-b3e1-85736a95b290 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:18.208348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ca35ecb6-458a-468f-952e-60994cd3401f req-de0143ac-0a19-43e9-b3e1-85736a95b290 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:18.242674 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ca35ecb6-458a-468f-952e-60994cd3401f req-de0143ac-0a19-43e9-b3e1-85736a95b290 service nova] Creating event network-vif-plugged:e1d8480a-75cc-470c-9389-4486ebc228d7 for instance ce57f31b-ee4d-4e34-9f08-5de27e71d393 on n-h1-844626-8 Aug 09 14:37:18.256138 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ca35ecb6-458a-468f-952e-60994cd3401f req-de0143ac-0a19-43e9-b3e1-85736a95b290 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116675 Aug 09 14:37:18.256821 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 901/1825] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:18.267256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:18.277490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:18.291747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-74ece357-eb05-49a7-be22-d16e6d50223c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:18.292452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-74ece357-eb05-49a7-be22-d16e6d50223c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:18.308427 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3c825765-8b8f-4289-84c3-1ae7f4530b8b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 200 len: 1369 microversion: 2.1 time: 0.241315 Aug 09 14:37:18.309118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74ece357-eb05-49a7-be22-d16e6d50223c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:18.309698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74ece357-eb05-49a7-be22-d16e6d50223c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:18.311516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74ece357-eb05-49a7-be22-d16e6d50223c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:18.313159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74ece357-eb05-49a7-be22-d16e6d50223c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:18.313972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74ece357-eb05-49a7-be22-d16e6d50223c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:18.315177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74ece357-eb05-49a7-be22-d16e6d50223c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:18.319699 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 925/1826] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:18 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 1369 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:18.484778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4d0c7ba-5424-4d61-adbd-fcfc34be8ff4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:18.485996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e4d0c7ba-5424-4d61-adbd-fcfc34be8ff4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:18.511262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d0c7ba-5424-4d61-adbd-fcfc34be8ff4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:18.512524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d0c7ba-5424-4d61-adbd-fcfc34be8ff4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:18.513550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d0c7ba-5424-4d61-adbd-fcfc34be8ff4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:18.514696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d0c7ba-5424-4d61-adbd-fcfc34be8ff4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:18.516459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d0c7ba-5424-4d61-adbd-fcfc34be8ff4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:18.519857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4d0c7ba-5424-4d61-adbd-fcfc34be8ff4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:18.805274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-74ece357-eb05-49a7-be22-d16e6d50223c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:18.817790 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-74ece357-eb05-49a7-be22-d16e6d50223c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1364 microversion: 2.1 time: 0.529858 Aug 09 14:37:18.822552 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 902/1827] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:18 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1364 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:18.833085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-4331a4f3-615e-4e00-bd25-862e05d6b24f req-2c4a8913-1faa-459d-bdd5-bdccd3f3ac5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a", "name": "network-vif-deleted", "tag": "1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:18.862264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4331a4f3-615e-4e00-bd25-862e05d6b24f req-2c4a8913-1faa-459d-bdd5-bdccd3f3ac5a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:18.864335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4331a4f3-615e-4e00-bd25-862e05d6b24f req-2c4a8913-1faa-459d-bdd5-bdccd3f3ac5a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:18.864809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4331a4f3-615e-4e00-bd25-862e05d6b24f req-2c4a8913-1faa-459d-bdd5-bdccd3f3ac5a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:18.895549 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4331a4f3-615e-4e00-bd25-862e05d6b24f req-2c4a8913-1faa-459d-bdd5-bdccd3f3ac5a service nova] Creating event network-vif-deleted:1b8e57c2-6f2a-4547-ab66-d2ff68f5f96b for instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a on n-h2-844626-8 Aug 09 14:37:18.901802 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-4331a4f3-615e-4e00-bd25-862e05d6b24f req-2c4a8913-1faa-459d-bdd5-bdccd3f3ac5a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077375 Aug 09 14:37:18.903021 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 903/1828] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:19.025357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e4d0c7ba-5424-4d61-adbd-fcfc34be8ff4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:19.038950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e4d0c7ba-5424-4d61-adbd-fcfc34be8ff4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:19.040922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e4d0c7ba-5424-4d61-adbd-fcfc34be8ff4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:19.042329 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4d0c7ba-5424-4d61-adbd-fcfc34be8ff4 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.564765 Aug 09 14:37:19.043420 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 926/1829] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:18 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:19.087216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-572f7a97-62b3-431f-8550-f2de0eb4fd89 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:19.088262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-572f7a97-62b3-431f-8550-f2de0eb4fd89 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:19.098505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-572f7a97-62b3-431f-8550-f2de0eb4fd89 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:19.099296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-572f7a97-62b3-431f-8550-f2de0eb4fd89 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:19.099981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-572f7a97-62b3-431f-8550-f2de0eb4fd89 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:19.100906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-572f7a97-62b3-431f-8550-f2de0eb4fd89 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:19.102220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-572f7a97-62b3-431f-8550-f2de0eb4fd89 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:19.102906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-572f7a97-62b3-431f-8550-f2de0eb4fd89 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:19.154373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7534655d-f1d0-421d-843c-bb15fe57e771 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:19.155128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7534655d-f1d0-421d-843c-bb15fe57e771 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:19.167778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7534655d-f1d0-421d-843c-bb15fe57e771 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:19.168570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7534655d-f1d0-421d-843c-bb15fe57e771 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:19.171064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7534655d-f1d0-421d-843c-bb15fe57e771 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:19.172375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7534655d-f1d0-421d-843c-bb15fe57e771 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:19.173851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7534655d-f1d0-421d-843c-bb15fe57e771 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:19.175070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7534655d-f1d0-421d-843c-bb15fe57e771 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:19.353343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:19.479933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-572f7a97-62b3-431f-8550-f2de0eb4fd89 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:19.493091 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-572f7a97-62b3-431f-8550-f2de0eb4fd89 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1313 microversion: 2.1 time: 0.410666 Aug 09 14:37:19.494034 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 904/1830] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:19 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:19.500208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a8e1ab1-df40-4d79-8f20-a8933d72112b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:19.506420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a8e1ab1-df40-4d79-8f20-a8933d72112b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:19.522943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8e1ab1-df40-4d79-8f20-a8933d72112b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:19.527684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8e1ab1-df40-4d79-8f20-a8933d72112b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:19.528144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8e1ab1-df40-4d79-8f20-a8933d72112b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:19.528893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8e1ab1-df40-4d79-8f20-a8933d72112b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:19.529445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8e1ab1-df40-4d79-8f20-a8933d72112b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:19.529632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7534655d-f1d0-421d-843c-bb15fe57e771 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:19.532731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8e1ab1-df40-4d79-8f20-a8933d72112b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:19.542331 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7534655d-f1d0-421d-843c-bb15fe57e771 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1313 microversion: 2.1 time: 0.392324 Aug 09 14:37:19.545620 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 927/1831] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:19 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:37:19.571133 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-9a8e1ab1-df40-4d79-8f20-a8933d72112b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] HTTP exception thrown: Instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a could not be found. Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a8e1ab1-df40-4d79-8f20-a8933d72112b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Request method failure captured: Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a HTTP/1.1 Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_PSpamP3PkBEfxc1aBq7A-wlWS8IBO2evcyAT9GQhfTEKq24_uExuYvSdqYfP0rfj5XhpaLWmCAflZ2wdPdaw36lS2CvA36WN_F0xOuGQ3M1UINpIS_y3XQcmWND5r5lVmzq_3OXTtAeLuAIdBuwk1eJhEQvFEGiAstCboyQPGk7Q Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 21a086b8d4904e118283cea8eb12b678 Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-MigrationsAdminTest-729516492 Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_21a086b8d4904e118283cea8eb12b678", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/21a086b8d4904e118283cea8eb12b678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/21a086b8d4904e118283cea8eb12b678"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/21a086b8d4904e118283cea8eb12b678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-MigrationsAdminTest-729516492 Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 21a086b8d4904e118283cea8eb12b678 Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-MigrationsAdminTest-729516492 Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-MigrationsAdminTest-729516492-project Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: c45d9a126a0841d5938ee21e8e87b293 Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-MigrationsAdminTest-729516492-project Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a could not be found. Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a'} Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a could not be found. Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a could not be found. Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:37:19.573115 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:19.579616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:19.579616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:37:19.579616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:37:19.579616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:37:19.579616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:37:19.579616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a could not be found. Aug 09 14:37:19.579616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:19.581487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a8e1ab1-df40-4d79-8f20-a8933d72112b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Returning 404 to user: Instance 02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:37:19.582436 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a8e1ab1-df40-4d79-8f20-a8933d72112b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a" status: 404 len: 111 microversion: 2.1 time: 0.086064 Aug 09 14:37:19.583024 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 905/1832] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:19 2022] GET /compute/v2.1/servers/02b0d3f0-ccd5-4ef6-bb59-57a423fdff8a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:37:19.592772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c57a668-c962-48b9-98ef-86c1f1a58eec tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '.version_select at 0x7f41dd32d3a0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:19.618277 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c57a668-c962-48b9-98ef-86c1f1a58eec tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-970878438" status: 202 len: 0 microversion: 2.1 time: 0.030225 Aug 09 14:37:19.622106 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 928/1833] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 9 14:37:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-970878438 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:37:19.843788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-50c3b98c-134f-4344-80f4-db848c41252e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:19.846421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-50c3b98c-134f-4344-80f4-db848c41252e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:19.865501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c3b98c-134f-4344-80f4-db848c41252e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:19.869266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c3b98c-134f-4344-80f4-db848c41252e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:19.870941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c3b98c-134f-4344-80f4-db848c41252e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:19.871997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c3b98c-134f-4344-80f4-db848c41252e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:19.875967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c3b98c-134f-4344-80f4-db848c41252e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:19.877037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c3b98c-134f-4344-80f4-db848c41252e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:20.071325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75fa15e7-23ed-47e4-91f6-3756be1ef33f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:20.072383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75fa15e7-23ed-47e4-91f6-3756be1ef33f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:20.088186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75fa15e7-23ed-47e4-91f6-3756be1ef33f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:20.089091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75fa15e7-23ed-47e4-91f6-3756be1ef33f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:20.089762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75fa15e7-23ed-47e4-91f6-3756be1ef33f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:20.093849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75fa15e7-23ed-47e4-91f6-3756be1ef33f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:20.094699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75fa15e7-23ed-47e4-91f6-3756be1ef33f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:20.095522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75fa15e7-23ed-47e4-91f6-3756be1ef33f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:20.473746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-50c3b98c-134f-4344-80f4-db848c41252e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:20.485975 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-50c3b98c-134f-4344-80f4-db848c41252e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1364 microversion: 2.1 time: 0.647847 Aug 09 14:37:20.486607 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 906/1834] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:19 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1364 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:20.491214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-4a41ba8e-b316-42a4-878f-31dad41660d3 req-18264b62-cc79-4654-833e-15a4957659d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a2bdaee-7506-41d7-89d8-033540a2613d", "name": "network-vif-plugged", "status": "completed", "tag": "ac0b0587-1765-4942-9531-0558c309477e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:20.514383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4a41ba8e-b316-42a4-878f-31dad41660d3 req-18264b62-cc79-4654-833e-15a4957659d4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:20.515069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4a41ba8e-b316-42a4-878f-31dad41660d3 req-18264b62-cc79-4654-833e-15a4957659d4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:20.515693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4a41ba8e-b316-42a4-878f-31dad41660d3 req-18264b62-cc79-4654-833e-15a4957659d4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:20.527783 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4a41ba8e-b316-42a4-878f-31dad41660d3 req-18264b62-cc79-4654-833e-15a4957659d4 service nova] Creating event network-vif-plugged:ac0b0587-1765-4942-9531-0558c309477e for instance 7a2bdaee-7506-41d7-89d8-033540a2613d on n-h1-844626-8 Aug 09 14:37:20.533446 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-4a41ba8e-b316-42a4-878f-31dad41660d3 req-18264b62-cc79-4654-833e-15a4957659d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045604 Aug 09 14:37:20.534345 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 907/1835] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:20.541102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f9809bc-a281-4fa7-821f-319b6fa6f951 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:20.542054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2f9809bc-a281-4fa7-821f-319b6fa6f951 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:20.551593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f9809bc-a281-4fa7-821f-319b6fa6f951 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:20.552389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f9809bc-a281-4fa7-821f-319b6fa6f951 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:20.553162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f9809bc-a281-4fa7-821f-319b6fa6f951 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:20.554126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f9809bc-a281-4fa7-821f-319b6fa6f951 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:20.554771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f9809bc-a281-4fa7-821f-319b6fa6f951 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:20.555400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f9809bc-a281-4fa7-821f-319b6fa6f951 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:20.808152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-75fa15e7-23ed-47e4-91f6-3756be1ef33f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:20.824447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-75fa15e7-23ed-47e4-91f6-3756be1ef33f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:20.826109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-75fa15e7-23ed-47e4-91f6-3756be1ef33f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:20.827548 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75fa15e7-23ed-47e4-91f6-3756be1ef33f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.762681 Aug 09 14:37:20.848380 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 929/1836] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:20 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:20.859591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-192c97cd-5e8c-4d6d-bbd1-3df877db512b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:20.861283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-192c97cd-5e8c-4d6d-bbd1-3df877db512b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:20.873406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-192c97cd-5e8c-4d6d-bbd1-3df877db512b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:20.877586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-192c97cd-5e8c-4d6d-bbd1-3df877db512b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:20.879251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-192c97cd-5e8c-4d6d-bbd1-3df877db512b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:20.881110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-192c97cd-5e8c-4d6d-bbd1-3df877db512b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:20.883245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-192c97cd-5e8c-4d6d-bbd1-3df877db512b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:20.884555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-192c97cd-5e8c-4d6d-bbd1-3df877db512b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:21.211996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2f9809bc-a281-4fa7-821f-319b6fa6f951 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:21.248786 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2f9809bc-a281-4fa7-821f-319b6fa6f951 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1313 microversion: 2.1 time: 0.694497 Aug 09 14:37:21.248786 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 908/1837] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:20 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1313 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:21.258627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-bbaaf93a-1b2e-456a-94e4-102507a1c0f7 req-bc10e8a2-d0c7-43bc-8f62-f56a7ac8d502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268d8e06-f80e-4f5e-8710-578f4eef5bab", "tag": "4115b00e-91cf-4c28-b173-c0ec442c3cfb"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:21.290334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-192c97cd-5e8c-4d6d-bbd1-3df877db512b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:21.291029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bbaaf93a-1b2e-456a-94e4-102507a1c0f7 req-bc10e8a2-d0c7-43bc-8f62-f56a7ac8d502 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:21.295781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bbaaf93a-1b2e-456a-94e4-102507a1c0f7 req-bc10e8a2-d0c7-43bc-8f62-f56a7ac8d502 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:21.296489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bbaaf93a-1b2e-456a-94e4-102507a1c0f7 req-bc10e8a2-d0c7-43bc-8f62-f56a7ac8d502 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:21.299799 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-192c97cd-5e8c-4d6d-bbd1-3df877db512b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1463 microversion: 2.1 time: 0.448696 Aug 09 14:37:21.304179 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 930/1838] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:20 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1463 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:21.324482 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-bbaaf93a-1b2e-456a-94e4-102507a1c0f7 req-bc10e8a2-d0c7-43bc-8f62-f56a7ac8d502 service nova] Creating event network-changed:4115b00e-91cf-4c28-b173-c0ec442c3cfb for instance 268d8e06-f80e-4f5e-8710-578f4eef5bab on n-h2-844626-8 Aug 09 14:37:21.345606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-83dbfcfa-2682-4934-a5cf-96aa8350eb12 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:21.349687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-83dbfcfa-2682-4934-a5cf-96aa8350eb12 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:21.353628 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-bbaaf93a-1b2e-456a-94e4-102507a1c0f7 req-bc10e8a2-d0c7-43bc-8f62-f56a7ac8d502 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115022 Aug 09 14:37:21.354337 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 909/1839] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:21.356609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83dbfcfa-2682-4934-a5cf-96aa8350eb12 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:21.357297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83dbfcfa-2682-4934-a5cf-96aa8350eb12 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:21.357609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83dbfcfa-2682-4934-a5cf-96aa8350eb12 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:21.358837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83dbfcfa-2682-4934-a5cf-96aa8350eb12 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:21.380927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83dbfcfa-2682-4934-a5cf-96aa8350eb12 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:21.380927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83dbfcfa-2682-4934-a5cf-96aa8350eb12 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:21.464683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-83dbfcfa-2682-4934-a5cf-96aa8350eb12 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:37:21.507169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08aa8ac9-fd97-4fa9-a4fc-35a2b4d7ba99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:21.508330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-08aa8ac9-fd97-4fa9-a4fc-35a2b4d7ba99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:21.523707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08aa8ac9-fd97-4fa9-a4fc-35a2b4d7ba99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:21.524676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08aa8ac9-fd97-4fa9-a4fc-35a2b4d7ba99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:21.525693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08aa8ac9-fd97-4fa9-a4fc-35a2b4d7ba99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:21.526795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08aa8ac9-fd97-4fa9-a4fc-35a2b4d7ba99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:21.527428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08aa8ac9-fd97-4fa9-a4fc-35a2b4d7ba99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:21.529767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08aa8ac9-fd97-4fa9-a4fc-35a2b4d7ba99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:21.689135 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-83dbfcfa-2682-4934-a5cf-96aa8350eb12 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "DELETE /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 204 len: 0 microversion: 2.1 time: 0.346982 Aug 09 14:37:21.691022 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 931/1840] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:37:21 2022] DELETE /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:37:21.714940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-391351374", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ce57f31b-ee4d-4e34-9f08-5de27e71d393"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:21.835736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:37:21.962647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-08aa8ac9-fd97-4fa9-a4fc-35a2b4d7ba99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:21.971899 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-08aa8ac9-fd97-4fa9-a4fc-35a2b4d7ba99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1364 microversion: 2.1 time: 0.469342 Aug 09 14:37:21.974976 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 910/1841] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:21 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1364 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:21.990949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-98ea0c8f-6981-4aed-b817-bf063ca27fd6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:21.991578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-98ea0c8f-6981-4aed-b817-bf063ca27fd6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:22.001552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98ea0c8f-6981-4aed-b817-bf063ca27fd6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:22.002048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98ea0c8f-6981-4aed-b817-bf063ca27fd6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:22.002483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98ea0c8f-6981-4aed-b817-bf063ca27fd6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:22.003234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98ea0c8f-6981-4aed-b817-bf063ca27fd6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:22.003685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98ea0c8f-6981-4aed-b817-bf063ca27fd6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:22.009784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98ea0c8f-6981-4aed-b817-bf063ca27fd6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:22.390282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:37:22.390900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:37:22.391799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:37:22.392359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:37:22.392927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:37:22.411151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-98ea0c8f-6981-4aed-b817-bf063ca27fd6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:22.412671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:22.413206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:22.417186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:22.418396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:22.420146 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-98ea0c8f-6981-4aed-b817-bf063ca27fd6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1468 microversion: 2.1 time: 0.442170 Aug 09 14:37:22.421094 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 911/1842] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:21 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1468 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:22.427035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-030cf497-9728-4779-9ef7-e940dfea2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:22.427836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-030cf497-9728-4779-9ef7-e940dfea2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:22.431189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:22.431821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:22.438213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-030cf497-9728-4779-9ef7-e940dfea2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:22.438698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-030cf497-9728-4779-9ef7-e940dfea2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:22.439753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-030cf497-9728-4779-9ef7-e940dfea2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:22.440535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-030cf497-9728-4779-9ef7-e940dfea2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:22.440986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-030cf497-9728-4779-9ef7-e940dfea2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:22.442356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-030cf497-9728-4779-9ef7-e940dfea2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:22.471101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Getting quotas for project 27e653d20943429d8c845d3c9a61f7d8. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:37:22.483873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Getting quotas for user 6c8ac8ccb50b49719fc1cc9f758b11ba and project 27e653d20943429d8c845d3c9a61f7d8. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:37:22.506050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:37:22.508740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:37:22.564030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:22.672918 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7284ea26-50f0-4977-8248-85c593976007 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978903 Aug 09 14:37:22.675830 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 932/1843] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:37:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:37:22.687578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ac05767a-50b0-4393-9e26-84125d493251 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:22.690809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ac05767a-50b0-4393-9e26-84125d493251 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:22.709759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac05767a-50b0-4393-9e26-84125d493251 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:22.710325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac05767a-50b0-4393-9e26-84125d493251 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:22.710778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac05767a-50b0-4393-9e26-84125d493251 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:22.711524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac05767a-50b0-4393-9e26-84125d493251 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:22.712640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac05767a-50b0-4393-9e26-84125d493251 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:22.713264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac05767a-50b0-4393-9e26-84125d493251 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:22.937048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-030cf497-9728-4779-9ef7-e940dfea2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:22.965376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-030cf497-9728-4779-9ef7-e940dfea2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:22.967371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-030cf497-9728-4779-9ef7-e940dfea2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:22.968725 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-030cf497-9728-4779-9ef7-e940dfea2d6a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.546598 Aug 09 14:37:22.974106 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 912/1844] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:22 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:23.001775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-af8354a7-ada7-4690-b4df-a01d1032e680 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:23.004566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-af8354a7-ada7-4690-b4df-a01d1032e680 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:23.123374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-af8354a7-ada7-4690-b4df-a01d1032e680 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:23.134670 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-af8354a7-ada7-4690-b4df-a01d1032e680 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1213 microversion: 2.1 time: 0.158238 Aug 09 14:37:23.135280 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 913/1845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:22 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:23.151066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-92d080b9-26c0-4563-be79-008143e3730e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:23.162250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-92d080b9-26c0-4563-be79-008143e3730e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:23.180127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92d080b9-26c0-4563-be79-008143e3730e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:23.182281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92d080b9-26c0-4563-be79-008143e3730e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:23.185383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92d080b9-26c0-4563-be79-008143e3730e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:23.187640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92d080b9-26c0-4563-be79-008143e3730e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:23.191717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92d080b9-26c0-4563-be79-008143e3730e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:23.192388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92d080b9-26c0-4563-be79-008143e3730e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:23.253335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:23.446116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac05767a-50b0-4393-9e26-84125d493251 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:23.459668 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ac05767a-50b0-4393-9e26-84125d493251 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 0.782174 Aug 09 14:37:23.465317 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 933/1846] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:22 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:23.481653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8c71f34-9e22-4a02-b0fc-d68a4647d33b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:23.482687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8c71f34-9e22-4a02-b0fc-d68a4647d33b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:23.495610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8c71f34-9e22-4a02-b0fc-d68a4647d33b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:23.496432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8c71f34-9e22-4a02-b0fc-d68a4647d33b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:23.497046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8c71f34-9e22-4a02-b0fc-d68a4647d33b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:23.498025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8c71f34-9e22-4a02-b0fc-d68a4647d33b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:23.500512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8c71f34-9e22-4a02-b0fc-d68a4647d33b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:23.501549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8c71f34-9e22-4a02-b0fc-d68a4647d33b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:24.510196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e8c71f34-9e22-4a02-b0fc-d68a4647d33b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:24.521820 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8c71f34-9e22-4a02-b0fc-d68a4647d33b tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1468 microversion: 2.1 time: 1.055008 Aug 09 14:37:24.526287 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 934/1847] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:23 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1468 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:24.543069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e03c9afe-66dc-40fe-a06e-c1e847c4ec37 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:24.544242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e03c9afe-66dc-40fe-a06e-c1e847c4ec37 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:24.559562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e03c9afe-66dc-40fe-a06e-c1e847c4ec37 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:24.561186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e03c9afe-66dc-40fe-a06e-c1e847c4ec37 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:24.561814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e03c9afe-66dc-40fe-a06e-c1e847c4ec37 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:24.566205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e03c9afe-66dc-40fe-a06e-c1e847c4ec37 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:24.566936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e03c9afe-66dc-40fe-a06e-c1e847c4ec37 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:24.567621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e03c9afe-66dc-40fe-a06e-c1e847c4ec37 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:25.176694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-92d080b9-26c0-4563-be79-008143e3730e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:25.203581 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-92d080b9-26c0-4563-be79-008143e3730e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1553 microversion: 2.1 time: 2.066690 Aug 09 14:37:25.226815 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 914/1848] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:23 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1553 bytes in 2091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:25.252480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-989b6ae4-0618-43a5-98a8-9d11ce1e1987 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:25.253506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-989b6ae4-0618-43a5-98a8-9d11ce1e1987 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:25.278631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e03c9afe-66dc-40fe-a06e-c1e847c4ec37 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:25.286174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-989b6ae4-0618-43a5-98a8-9d11ce1e1987 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:25.287478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-989b6ae4-0618-43a5-98a8-9d11ce1e1987 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:25.291034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-989b6ae4-0618-43a5-98a8-9d11ce1e1987 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:25.300845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e03c9afe-66dc-40fe-a06e-c1e847c4ec37 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:25.301061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-989b6ae4-0618-43a5-98a8-9d11ce1e1987 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:25.302055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-989b6ae4-0618-43a5-98a8-9d11ce1e1987 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:25.302816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-989b6ae4-0618-43a5-98a8-9d11ce1e1987 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:25.316822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e03c9afe-66dc-40fe-a06e-c1e847c4ec37 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:25.318676 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e03c9afe-66dc-40fe-a06e-c1e847c4ec37 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.791142 Aug 09 14:37:25.319675 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 935/1849] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:24 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:25.335889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7ca418ef-80d7-4e37-ad63-a6a66102484c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:25.337682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7ca418ef-80d7-4e37-ad63-a6a66102484c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:25.363030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ca418ef-80d7-4e37-ad63-a6a66102484c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:25.363931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ca418ef-80d7-4e37-ad63-a6a66102484c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:25.368060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ca418ef-80d7-4e37-ad63-a6a66102484c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:25.369572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ca418ef-80d7-4e37-ad63-a6a66102484c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:25.370455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ca418ef-80d7-4e37-ad63-a6a66102484c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:25.371406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ca418ef-80d7-4e37-ad63-a6a66102484c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:25.612263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-989b6ae4-0618-43a5-98a8-9d11ce1e1987 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:25.647300 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-989b6ae4-0618-43a5-98a8-9d11ce1e1987 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1271 microversion: 2.1 time: 0.412630 Aug 09 14:37:25.648822 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 915/1850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:25 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1271 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:25.677787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84bda824-5ae7-4511-98f8-648e6a4d1421 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:25.679272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84bda824-5ae7-4511-98f8-648e6a4d1421 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:25.732166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bda824-5ae7-4511-98f8-648e6a4d1421 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:25.733126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bda824-5ae7-4511-98f8-648e6a4d1421 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:25.733883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bda824-5ae7-4511-98f8-648e6a4d1421 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:25.735135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bda824-5ae7-4511-98f8-648e6a4d1421 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:25.738105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bda824-5ae7-4511-98f8-648e6a4d1421 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:25.739622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bda824-5ae7-4511-98f8-648e6a4d1421 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:26.068816 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84bda824-5ae7-4511-98f8-648e6a4d1421 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.417217 Aug 09 14:37:26.073719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7ca418ef-80d7-4e37-ad63-a6a66102484c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:26.076898 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 916/1851] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:37:25 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-interface => generated 284 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:26.095643 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7ca418ef-80d7-4e37-ad63-a6a66102484c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 0.773688 Aug 09 14:37:26.097553 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 936/1852] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:25 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:26.103342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:26.104693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:26.142901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-7f9abb7a-36ec-4eec-9229-2829389e9702 req-0766b5ab-a4ff-4838-9b73-ade983098813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "319985c3-0dee-4da4-aeab-bf1d653a147f", "name": "network-vif-deleted", "tag": "6313404f-b7f3-4c22-9a42-627cf07b300b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:26.150872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:26.161212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:26.162054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:26.164554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:26.164961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7f9abb7a-36ec-4eec-9229-2829389e9702 req-0766b5ab-a4ff-4838-9b73-ade983098813 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:26.165665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7f9abb7a-36ec-4eec-9229-2829389e9702 req-0766b5ab-a4ff-4838-9b73-ade983098813 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:26.166289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7f9abb7a-36ec-4eec-9229-2829389e9702 req-0766b5ab-a4ff-4838-9b73-ade983098813 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:26.168901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:26.170443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:26.193698 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-7f9abb7a-36ec-4eec-9229-2829389e9702 req-0766b5ab-a4ff-4838-9b73-ade983098813 service nova] Creating event network-vif-deleted:6313404f-b7f3-4c22-9a42-627cf07b300b for instance 319985c3-0dee-4da4-aeab-bf1d653a147f on n-h2-844626-8 Aug 09 14:37:26.199678 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-7f9abb7a-36ec-4eec-9229-2829389e9702 req-0766b5ab-a4ff-4838-9b73-ade983098813 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071606 Aug 09 14:37:26.201184 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 937/1853] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:26.246945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:26.260241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:26.262151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:26.263541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lazy-loading 'fault' on Instance uuid 319985c3-0dee-4da4-aeab-bf1d653a147f {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:37:26.384524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09801dfd-06aa-489e-a155-2129bb9dc72d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:26.404614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-09801dfd-06aa-489e-a155-2129bb9dc72d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:26.419205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:26.429359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09801dfd-06aa-489e-a155-2129bb9dc72d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:26.444031 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5b8baf21-6d16-43b1-9090-b233e6e389f6 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 200 len: 1303 microversion: 2.1 time: 0.365029 Aug 09 14:37:26.470506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09801dfd-06aa-489e-a155-2129bb9dc72d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:26.470506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09801dfd-06aa-489e-a155-2129bb9dc72d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:26.470506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09801dfd-06aa-489e-a155-2129bb9dc72d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:26.470506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09801dfd-06aa-489e-a155-2129bb9dc72d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:26.470506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09801dfd-06aa-489e-a155-2129bb9dc72d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:26.472190 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 917/1854] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:26 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 1303 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:26.673154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b9c7a88-4cc7-4c55-ae89-2f0214c6d021 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:26.674436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b9c7a88-4cc7-4c55-ae89-2f0214c6d021 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:26.697743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b9c7a88-4cc7-4c55-ae89-2f0214c6d021 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:26.698553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b9c7a88-4cc7-4c55-ae89-2f0214c6d021 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:26.701991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b9c7a88-4cc7-4c55-ae89-2f0214c6d021 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:26.703315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b9c7a88-4cc7-4c55-ae89-2f0214c6d021 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:26.704108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b9c7a88-4cc7-4c55-ae89-2f0214c6d021 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:26.704885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b9c7a88-4cc7-4c55-ae89-2f0214c6d021 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:26.934839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b9c7a88-4cc7-4c55-ae89-2f0214c6d021 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:26.961447 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b9c7a88-4cc7-4c55-ae89-2f0214c6d021 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1271 microversion: 2.1 time: 0.295091 Aug 09 14:37:26.969075 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 918/1855] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:26 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1271 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:27.117847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cc0b43ff-a335-4e3e-9518-0f5127513b99 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:27.118371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cc0b43ff-a335-4e3e-9518-0f5127513b99 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:27.126122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc0b43ff-a335-4e3e-9518-0f5127513b99 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:27.129306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc0b43ff-a335-4e3e-9518-0f5127513b99 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:27.135543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc0b43ff-a335-4e3e-9518-0f5127513b99 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:27.136550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc0b43ff-a335-4e3e-9518-0f5127513b99 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:27.142424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc0b43ff-a335-4e3e-9518-0f5127513b99 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:27.143124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc0b43ff-a335-4e3e-9518-0f5127513b99 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:27.151858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-09801dfd-06aa-489e-a155-2129bb9dc72d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:27.169609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-09801dfd-06aa-489e-a155-2129bb9dc72d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:27.174117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-09801dfd-06aa-489e-a155-2129bb9dc72d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:27.178497 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09801dfd-06aa-489e-a155-2129bb9dc72d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.814192 Aug 09 14:37:27.181475 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 938/1856] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:26 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:27.444618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-472c062c-3ce1-435e-8f30-e209a5d2647b req-00704841-94a7-47ed-95b3-535f21f4f953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d615dd5-c0ab-4d52-946b-7773c9605ac7", "tag": "f86d7401-99bd-4bda-9d44-57e788fd6714"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:27.472126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-472c062c-3ce1-435e-8f30-e209a5d2647b req-00704841-94a7-47ed-95b3-535f21f4f953 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:27.474574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-472c062c-3ce1-435e-8f30-e209a5d2647b req-00704841-94a7-47ed-95b3-535f21f4f953 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:27.475363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-472c062c-3ce1-435e-8f30-e209a5d2647b req-00704841-94a7-47ed-95b3-535f21f4f953 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:27.496218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:27.500170 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-472c062c-3ce1-435e-8f30-e209a5d2647b req-00704841-94a7-47ed-95b3-535f21f4f953 service nova] Creating event network-changed:f86d7401-99bd-4bda-9d44-57e788fd6714 for instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 on n-h1-844626-8 Aug 09 14:37:27.511117 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-472c062c-3ce1-435e-8f30-e209a5d2647b req-00704841-94a7-47ed-95b3-535f21f4f953 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069787 Aug 09 14:37:27.513739 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 939/1857] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:37:27.522679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4443ff3-b693-47f1-87db-eda53a44973c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:27.524195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e4443ff3-b693-47f1-87db-eda53a44973c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: 319985c3-0dee-4da4-aeab-bf1d653a147f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:27.537069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4443ff3-b693-47f1-87db-eda53a44973c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:27.539042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4443ff3-b693-47f1-87db-eda53a44973c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:27.539764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4443ff3-b693-47f1-87db-eda53a44973c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:27.541373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4443ff3-b693-47f1-87db-eda53a44973c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:27.543166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4443ff3-b693-47f1-87db-eda53a44973c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:27.544066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4443ff3-b693-47f1-87db-eda53a44973c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:27.567723 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e4443ff3-b693-47f1-87db-eda53a44973c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] HTTP exception thrown: Instance 319985c3-0dee-4da4-aeab-bf1d653a147f could not be found. Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4443ff3-b693-47f1-87db-eda53a44973c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Request method failure captured: Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f HTTP/1.1 Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_PSpamP3PkBEfxc1aBq7A-wlWS8IBO2evcyAT9GQhfTEKq24_uExuYvSdqYfP0rfj5XhpaLWmCAflZ2wdPdaw36lS2CvA36WN_F0xOuGQ3M1UINpIS_y3XQcmWND5r5lVmzq_3OXTtAeLuAIdBuwk1eJhEQvFEGiAstCboyQPGk7Q Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 21a086b8d4904e118283cea8eb12b678 Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-MigrationsAdminTest-729516492 Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_21a086b8d4904e118283cea8eb12b678", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/21a086b8d4904e118283cea8eb12b678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/21a086b8d4904e118283cea8eb12b678"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/21a086b8d4904e118283cea8eb12b678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-MigrationsAdminTest-729516492 Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 21a086b8d4904e118283cea8eb12b678 Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-MigrationsAdminTest-729516492 Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-MigrationsAdminTest-729516492-project Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: c45d9a126a0841d5938ee21e8e87b293 Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-MigrationsAdminTest-729516492-project Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 319985c3-0dee-4da4-aeab-bf1d653a147f could not be found. Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '319985c3-0dee-4da4-aeab-bf1d653a147f'} Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 319985c3-0dee-4da4-aeab-bf1d653a147f could not be found. Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 319985c3-0dee-4da4-aeab-bf1d653a147f could not be found. Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:37:27.570622 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:27.581824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:27.581824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:37:27.581824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:37:27.581824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:37:27.581824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:37:27.581824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 319985c3-0dee-4da4-aeab-bf1d653a147f could not be found. Aug 09 14:37:27.581824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:27.586533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4443ff3-b693-47f1-87db-eda53a44973c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Returning 404 to user: Instance 319985c3-0dee-4da4-aeab-bf1d653a147f could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:37:27.587885 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4443ff3-b693-47f1-87db-eda53a44973c tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f" status: 404 len: 111 microversion: 2.1 time: 0.071329 Aug 09 14:37:27.589116 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 940/1858] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:27 2022] GET /compute/v2.1/servers/319985c3-0dee-4da4-aeab-bf1d653a147f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:37:27.598575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-697b192f-4345-4314-9cb2-40b08908f352 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:27.599492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-697b192f-4345-4314-9cb2-40b08908f352 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:27.610507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-697b192f-4345-4314-9cb2-40b08908f352 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:27.612244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-697b192f-4345-4314-9cb2-40b08908f352 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:27.613958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-697b192f-4345-4314-9cb2-40b08908f352 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:27.618613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-697b192f-4345-4314-9cb2-40b08908f352 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:27.620152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-697b192f-4345-4314-9cb2-40b08908f352 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:27.620826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-697b192f-4345-4314-9cb2-40b08908f352 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:27.743248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-697b192f-4345-4314-9cb2-40b08908f352 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:37:27.929854 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-697b192f-4345-4314-9cb2-40b08908f352 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 204 len: 0 microversion: 2.1 time: 0.333919 Aug 09 14:37:27.932361 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 941/1859] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:37:27 2022] DELETE /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:37:27.947894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42ab195a-180a-4687-b63b-ce21511dae0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:27.951193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-42ab195a-180a-4687-b63b-ce21511dae0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:27.981930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42ab195a-180a-4687-b63b-ce21511dae0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:27.985668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42ab195a-180a-4687-b63b-ce21511dae0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:27.986343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42ab195a-180a-4687-b63b-ce21511dae0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:27.989132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42ab195a-180a-4687-b63b-ce21511dae0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:27.990317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42ab195a-180a-4687-b63b-ce21511dae0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:27.990317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42ab195a-180a-4687-b63b-ce21511dae0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:27.995649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cc0b43ff-a335-4e3e-9518-0f5127513b99 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:28.011619 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cc0b43ff-a335-4e3e-9518-0f5127513b99 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 0.897374 Aug 09 14:37:28.030999 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 919/1860] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:27 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:28.039551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec8ae882-3173-4050-ac5b-8531405b2a10 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:28.041223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ec8ae882-3173-4050-ac5b-8531405b2a10 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:28.053755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec8ae882-3173-4050-ac5b-8531405b2a10 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:28.054674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec8ae882-3173-4050-ac5b-8531405b2a10 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:28.055396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec8ae882-3173-4050-ac5b-8531405b2a10 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:28.056369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec8ae882-3173-4050-ac5b-8531405b2a10 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:28.057318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec8ae882-3173-4050-ac5b-8531405b2a10 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:28.058006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec8ae882-3173-4050-ac5b-8531405b2a10 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:28.249854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ec8ae882-3173-4050-ac5b-8531405b2a10 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:28.274447 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec8ae882-3173-4050-ac5b-8531405b2a10 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1271 microversion: 2.1 time: 0.240271 Aug 09 14:37:28.291330 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 920/1861] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:28 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:28.300840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f30a2dcf-5b3d-4c57-b8a4-6b69f276db9d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:28.301721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f30a2dcf-5b3d-4c57-b8a4-6b69f276db9d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:28.311923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f30a2dcf-5b3d-4c57-b8a4-6b69f276db9d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:28.312693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f30a2dcf-5b3d-4c57-b8a4-6b69f276db9d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:28.313904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f30a2dcf-5b3d-4c57-b8a4-6b69f276db9d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:28.315034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f30a2dcf-5b3d-4c57-b8a4-6b69f276db9d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:28.315680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f30a2dcf-5b3d-4c57-b8a4-6b69f276db9d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:28.316351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f30a2dcf-5b3d-4c57-b8a4-6b69f276db9d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:28.501709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-42ab195a-180a-4687-b63b-ce21511dae0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:28.518167 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-42ab195a-180a-4687-b63b-ce21511dae0f tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1468 microversion: 2.1 time: 0.579120 Aug 09 14:37:28.519169 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 942/1862] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:27 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1468 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:28.701508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f30a2dcf-5b3d-4c57-b8a4-6b69f276db9d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:28.711895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f30a2dcf-5b3d-4c57-b8a4-6b69f276db9d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:28.715530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f30a2dcf-5b3d-4c57-b8a4-6b69f276db9d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:28.718432 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f30a2dcf-5b3d-4c57-b8a4-6b69f276db9d tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.424912 Aug 09 14:37:28.720974 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 921/1863] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:28 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:29.058958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36af9e15-351d-44e9-8ff9-988d2916ac4d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:29.061070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36af9e15-351d-44e9-8ff9-988d2916ac4d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:29.080239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36af9e15-351d-44e9-8ff9-988d2916ac4d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:29.082043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36af9e15-351d-44e9-8ff9-988d2916ac4d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:29.083715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36af9e15-351d-44e9-8ff9-988d2916ac4d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:29.085725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36af9e15-351d-44e9-8ff9-988d2916ac4d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:29.113646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36af9e15-351d-44e9-8ff9-988d2916ac4d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:29.116425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36af9e15-351d-44e9-8ff9-988d2916ac4d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:29.169581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7bbcb617-8d8a-4341-895c-16755983bdee req-7f4274aa-cdcf-49a9-84b0-c3eeb827ea5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a2bdaee-7506-41d7-89d8-033540a2613d", "tag": "ac0b0587-1765-4942-9531-0558c309477e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:29.195070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7bbcb617-8d8a-4341-895c-16755983bdee req-7f4274aa-cdcf-49a9-84b0-c3eeb827ea5b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:29.196039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7bbcb617-8d8a-4341-895c-16755983bdee req-7f4274aa-cdcf-49a9-84b0-c3eeb827ea5b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:29.196668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7bbcb617-8d8a-4341-895c-16755983bdee req-7f4274aa-cdcf-49a9-84b0-c3eeb827ea5b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:29.219441 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7bbcb617-8d8a-4341-895c-16755983bdee req-7f4274aa-cdcf-49a9-84b0-c3eeb827ea5b service nova] Creating event network-changed:ac0b0587-1765-4942-9531-0558c309477e for instance 7a2bdaee-7506-41d7-89d8-033540a2613d on n-h1-844626-8 Aug 09 14:37:29.260648 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7bbcb617-8d8a-4341-895c-16755983bdee req-7f4274aa-cdcf-49a9-84b0-c3eeb827ea5b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096069 Aug 09 14:37:29.262090 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 922/1864] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:37:29.303070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fad66c74-699d-4df4-852a-8abd7e310dd0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:29.304152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fad66c74-699d-4df4-852a-8abd7e310dd0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:29.322765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad66c74-699d-4df4-852a-8abd7e310dd0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:29.323299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad66c74-699d-4df4-852a-8abd7e310dd0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:29.323740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad66c74-699d-4df4-852a-8abd7e310dd0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:29.324463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad66c74-699d-4df4-852a-8abd7e310dd0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:29.324918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad66c74-699d-4df4-852a-8abd7e310dd0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:29.325339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fad66c74-699d-4df4-852a-8abd7e310dd0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:29.348767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-36af9e15-351d-44e9-8ff9-988d2916ac4d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:29.360650 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36af9e15-351d-44e9-8ff9-988d2916ac4d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 0.323175 Aug 09 14:37:29.361573 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 943/1865] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:29 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:29.543817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8367f515-b355-41d1-a298-5295ad31b6a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:29.544796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8367f515-b355-41d1-a298-5295ad31b6a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:29.577989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8367f515-b355-41d1-a298-5295ad31b6a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:29.578705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8367f515-b355-41d1-a298-5295ad31b6a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:29.579297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8367f515-b355-41d1-a298-5295ad31b6a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:29.584958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8367f515-b355-41d1-a298-5295ad31b6a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:29.585659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8367f515-b355-41d1-a298-5295ad31b6a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:29.586251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8367f515-b355-41d1-a298-5295ad31b6a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:29.679610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fad66c74-699d-4df4-852a-8abd7e310dd0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:29.691982 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fad66c74-699d-4df4-852a-8abd7e310dd0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1271 microversion: 2.1 time: 0.393741 Aug 09 14:37:29.695215 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 923/1866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:29 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1271 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:29.742887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d08e56d3-e9a3-4d4c-b9f3-60d4a1015ce1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:29.743530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d08e56d3-e9a3-4d4c-b9f3-60d4a1015ce1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:29.757823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d08e56d3-e9a3-4d4c-b9f3-60d4a1015ce1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:29.758324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d08e56d3-e9a3-4d4c-b9f3-60d4a1015ce1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:29.758844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d08e56d3-e9a3-4d4c-b9f3-60d4a1015ce1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:29.759665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d08e56d3-e9a3-4d4c-b9f3-60d4a1015ce1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:29.760122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d08e56d3-e9a3-4d4c-b9f3-60d4a1015ce1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:29.760550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d08e56d3-e9a3-4d4c-b9f3-60d4a1015ce1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:30.437287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d08e56d3-e9a3-4d4c-b9f3-60d4a1015ce1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:30.464822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d08e56d3-e9a3-4d4c-b9f3-60d4a1015ce1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:30.467411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d08e56d3-e9a3-4d4c-b9f3-60d4a1015ce1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:30.469362 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d08e56d3-e9a3-4d4c-b9f3-60d4a1015ce1 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.730309 Aug 09 14:37:30.470266 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 924/1867] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:29 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:37:30.494929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-932a0875-3b19-46c7-9622-d8033a5b013c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:30.496407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-932a0875-3b19-46c7-9622-d8033a5b013c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:30.512612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-932a0875-3b19-46c7-9622-d8033a5b013c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:30.519218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-932a0875-3b19-46c7-9622-d8033a5b013c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:30.519958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-932a0875-3b19-46c7-9622-d8033a5b013c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:30.520960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-932a0875-3b19-46c7-9622-d8033a5b013c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:30.522365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-932a0875-3b19-46c7-9622-d8033a5b013c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:30.522997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-932a0875-3b19-46c7-9622-d8033a5b013c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:30.611183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8367f515-b355-41d1-a298-5295ad31b6a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:30.633165 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8367f515-b355-41d1-a298-5295ad31b6a2 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1468 microversion: 2.1 time: 1.096485 Aug 09 14:37:30.636954 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 944/1868] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:29 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1468 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:30.729380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30d6987c-fd97-44b6-a720-3e7557865f25 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:30.730782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30d6987c-fd97-44b6-a720-3e7557865f25 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:30.739471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30d6987c-fd97-44b6-a720-3e7557865f25 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:30.740562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30d6987c-fd97-44b6-a720-3e7557865f25 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:30.741494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30d6987c-fd97-44b6-a720-3e7557865f25 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:30.742393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30d6987c-fd97-44b6-a720-3e7557865f25 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:30.743292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30d6987c-fd97-44b6-a720-3e7557865f25 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:30.743900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30d6987c-fd97-44b6-a720-3e7557865f25 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:31.098888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-932a0875-3b19-46c7-9622-d8033a5b013c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:31.111377 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-932a0875-3b19-46c7-9622-d8033a5b013c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 0.625341 Aug 09 14:37:31.114931 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 925/1869] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:30 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:31.350988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-dc044475-ee65-4a6d-ba76-edae4f71c3c2 req-da2ec232-fda2-400e-b8d7-43f3ddcdcd00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4125ae9-163d-4e42-b277-f309f031f352", "name": "network-vif-deleted", "tag": "3ce4965e-717b-4943-b658-c4cc8884f87e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:31.352531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30d6987c-fd97-44b6-a720-3e7557865f25 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:31.366685 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30d6987c-fd97-44b6-a720-3e7557865f25 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1313 microversion: 2.1 time: 0.642237 Aug 09 14:37:31.367320 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 945/1870] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:30 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1313 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:31.390881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dc044475-ee65-4a6d-ba76-edae4f71c3c2 req-da2ec232-fda2-400e-b8d7-43f3ddcdcd00 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:31.391417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dc044475-ee65-4a6d-ba76-edae4f71c3c2 req-da2ec232-fda2-400e-b8d7-43f3ddcdcd00 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:31.391857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dc044475-ee65-4a6d-ba76-edae4f71c3c2 req-da2ec232-fda2-400e-b8d7-43f3ddcdcd00 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:31.415978 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-dc044475-ee65-4a6d-ba76-edae4f71c3c2 req-da2ec232-fda2-400e-b8d7-43f3ddcdcd00 service nova] Creating event network-vif-deleted:3ce4965e-717b-4943-b658-c4cc8884f87e for instance c4125ae9-163d-4e42-b277-f309f031f352 on n-h1-844626-8 Aug 09 14:37:31.434757 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-dc044475-ee65-4a6d-ba76-edae4f71c3c2 req-da2ec232-fda2-400e-b8d7-43f3ddcdcd00 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088574 Aug 09 14:37:31.435731 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 926/1871] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:31.497545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5d38d5c9-ca04-4f35-9f40-6ba6f037ca5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:31.498847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5d38d5c9-ca04-4f35-9f40-6ba6f037ca5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:31.512885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d38d5c9-ca04-4f35-9f40-6ba6f037ca5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:31.513468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d38d5c9-ca04-4f35-9f40-6ba6f037ca5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:31.517321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d38d5c9-ca04-4f35-9f40-6ba6f037ca5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:31.518459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d38d5c9-ca04-4f35-9f40-6ba6f037ca5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:31.525913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d38d5c9-ca04-4f35-9f40-6ba6f037ca5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:31.526976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d38d5c9-ca04-4f35-9f40-6ba6f037ca5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:31.619592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-08ec7c88-c248-4bcb-a904-a277d97ee0bc req-5ab90867-a04a-4fc8-97ce-eda390686372 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d615dd5-c0ab-4d52-946b-7773c9605ac7", "tag": "73754091-7b0d-4b6b-a529-2d3bfb2eeb3f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:31.640219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-08ec7c88-c248-4bcb-a904-a277d97ee0bc req-5ab90867-a04a-4fc8-97ce-eda390686372 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:31.640698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-08ec7c88-c248-4bcb-a904-a277d97ee0bc req-5ab90867-a04a-4fc8-97ce-eda390686372 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:31.641164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-08ec7c88-c248-4bcb-a904-a277d97ee0bc req-5ab90867-a04a-4fc8-97ce-eda390686372 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:31.670667 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-08ec7c88-c248-4bcb-a904-a277d97ee0bc req-5ab90867-a04a-4fc8-97ce-eda390686372 service nova] Creating event network-changed:73754091-7b0d-4b6b-a529-2d3bfb2eeb3f for instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 on n-h1-844626-8 Aug 09 14:37:31.682509 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-08ec7c88-c248-4bcb-a904-a277d97ee0bc req-5ab90867-a04a-4fc8-97ce-eda390686372 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065311 Aug 09 14:37:31.683769 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 927/1872] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:31.695492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:31.696428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:31.704170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:31.704997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:31.707424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:31.708448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:31.709138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:31.709636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:31.758644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:31.759982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:31.760603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:31.761216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lazy-loading 'fault' on Instance uuid c4125ae9-163d-4e42-b277-f309f031f352 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:37:31.774683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5d38d5c9-ca04-4f35-9f40-6ba6f037ca5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:31.786599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5d38d5c9-ca04-4f35-9f40-6ba6f037ca5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:31.788640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5d38d5c9-ca04-4f35-9f40-6ba6f037ca5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:31.791462 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5d38d5c9-ca04-4f35-9f40-6ba6f037ca5a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1486 microversion: 2.25 time: 0.301963 Aug 09 14:37:31.792544 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 946/1873] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:31 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1486 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:31.884566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c45d9a126a0841d5938ee21e8e87b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21a086b8d4904e118283cea8eb12b678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:31.903436 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cb56e2ff-c23d-451c-a11f-e5231a107152 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 200 len: 1302 microversion: 2.1 time: 0.218367 Aug 09 14:37:31.913380 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 928/1874] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:31 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 1302 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:32.147877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b9bcb53-10ec-49b8-a3ca-4ab606eb45f9 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:32.148958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b9bcb53-10ec-49b8-a3ca-4ab606eb45f9 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:32.158682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b9bcb53-10ec-49b8-a3ca-4ab606eb45f9 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:32.159487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b9bcb53-10ec-49b8-a3ca-4ab606eb45f9 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:32.160209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b9bcb53-10ec-49b8-a3ca-4ab606eb45f9 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:32.161203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b9bcb53-10ec-49b8-a3ca-4ab606eb45f9 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:32.161791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b9bcb53-10ec-49b8-a3ca-4ab606eb45f9 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:32.162296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b9bcb53-10ec-49b8-a3ca-4ab606eb45f9 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:32.391118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0065790d-9d6f-4016-9df2-60b947af6457 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:32.391847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0065790d-9d6f-4016-9df2-60b947af6457 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:32.404252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b9bcb53-10ec-49b8-a3ca-4ab606eb45f9 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:32.408840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0065790d-9d6f-4016-9df2-60b947af6457 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:32.410661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0065790d-9d6f-4016-9df2-60b947af6457 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:32.411698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0065790d-9d6f-4016-9df2-60b947af6457 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:32.413076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0065790d-9d6f-4016-9df2-60b947af6457 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:32.414006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0065790d-9d6f-4016-9df2-60b947af6457 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:32.414853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0065790d-9d6f-4016-9df2-60b947af6457 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:32.427130 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b9bcb53-10ec-49b8-a3ca-4ab606eb45f9 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 0.286236 Aug 09 14:37:32.427748 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 947/1875] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:32 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:32.790350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0065790d-9d6f-4016-9df2-60b947af6457 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:32.819277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:32.820322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:32.825951 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0065790d-9d6f-4016-9df2-60b947af6457 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1313 microversion: 2.1 time: 0.418010 Aug 09 14:37:32.826926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bb552b7e-de73-4078-b113-66b8ad04a55a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:32.827676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bb552b7e-de73-4078-b113-66b8ad04a55a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:32.830484 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 929/1876] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:32 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:32.848489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb552b7e-de73-4078-b113-66b8ad04a55a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:32.849488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb552b7e-de73-4078-b113-66b8ad04a55a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:32.852352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb552b7e-de73-4078-b113-66b8ad04a55a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:32.853387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb552b7e-de73-4078-b113-66b8ad04a55a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:32.854408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb552b7e-de73-4078-b113-66b8ad04a55a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:32.855067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb552b7e-de73-4078-b113-66b8ad04a55a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:32.938985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c26d80be-9b8e-4c93-a53f-0c0e2ae6c9f5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:32.939770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c26d80be-9b8e-4c93-a53f-0c0e2ae6c9f5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] [instance: c4125ae9-163d-4e42-b277-f309f031f352] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:32.955428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c26d80be-9b8e-4c93-a53f-0c0e2ae6c9f5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:32.955676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c26d80be-9b8e-4c93-a53f-0c0e2ae6c9f5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:32.956131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c26d80be-9b8e-4c93-a53f-0c0e2ae6c9f5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:32.958901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c26d80be-9b8e-4c93-a53f-0c0e2ae6c9f5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:32.960180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c26d80be-9b8e-4c93-a53f-0c0e2ae6c9f5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:32.961428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c26d80be-9b8e-4c93-a53f-0c0e2ae6c9f5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:33.007229 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-c26d80be-9b8e-4c93-a53f-0c0e2ae6c9f5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] HTTP exception thrown: Instance c4125ae9-163d-4e42-b277-f309f031f352 could not be found. Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c26d80be-9b8e-4c93-a53f-0c0e2ae6c9f5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Request method failure captured: Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 HTTP/1.1 Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_PSpamP3PkBEfxc1aBq7A-wlWS8IBO2evcyAT9GQhfTEKq24_uExuYvSdqYfP0rfj5XhpaLWmCAflZ2wdPdaw36lS2CvA36WN_F0xOuGQ3M1UINpIS_y3XQcmWND5r5lVmzq_3OXTtAeLuAIdBuwk1eJhEQvFEGiAstCboyQPGk7Q Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 21a086b8d4904e118283cea8eb12b678 Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-MigrationsAdminTest-729516492 Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_21a086b8d4904e118283cea8eb12b678", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/21a086b8d4904e118283cea8eb12b678"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/21a086b8d4904e118283cea8eb12b678"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/21a086b8d4904e118283cea8eb12b678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-MigrationsAdminTest-729516492 Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 21a086b8d4904e118283cea8eb12b678 Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-MigrationsAdminTest-729516492 Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-MigrationsAdminTest-729516492-project Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: c45d9a126a0841d5938ee21e8e87b293 Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-MigrationsAdminTest-729516492-project Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance c4125ae9-163d-4e42-b277-f309f031f352 could not be found. Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'c4125ae9-163d-4e42-b277-f309f031f352'} Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4125ae9-163d-4e42-b277-f309f031f352 could not be found. Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4125ae9-163d-4e42-b277-f309f031f352 could not be found. Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:37:33.031850 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:33.039958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:33.039958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:37:33.039958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:37:33.039958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:37:33.039958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:37:33.039958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4125ae9-163d-4e42-b277-f309f031f352 could not be found. Aug 09 14:37:33.039958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:37:33.039958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c26d80be-9b8e-4c93-a53f-0c0e2ae6c9f5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] Returning 404 to user: Instance c4125ae9-163d-4e42-b277-f309f031f352 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:37:33.039958 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c26d80be-9b8e-4c93-a53f-0c0e2ae6c9f5 tempest-MigrationsAdminTest-729516492 tempest-MigrationsAdminTest-729516492-project] 10.222.0.50 "GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352" status: 404 len: 111 microversion: 2.1 time: 0.106472 Aug 09 14:37:33.041627 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 930/1877] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:32 2022] GET /compute/v2.1/servers/c4125ae9-163d-4e42-b277-f309f031f352 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:37:33.198405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bb552b7e-de73-4078-b113-66b8ad04a55a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:33.212622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bb552b7e-de73-4078-b113-66b8ad04a55a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:33.217590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bb552b7e-de73-4078-b113-66b8ad04a55a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:33.222225 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bb552b7e-de73-4078-b113-66b8ad04a55a tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1476 microversion: 2.25 time: 0.403814 Aug 09 14:37:33.238723 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 948/1878] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:32 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1476 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:33.253805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-159e732e-a681-457a-93ee-e1b9b44bf347 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '.version_select at 0x7f41dda8d940>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:33.263577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-159e732e-a681-457a-93ee-e1b9b44bf347 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:33.264765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-159e732e-a681-457a-93ee-e1b9b44bf347 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:33.265209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-159e732e-a681-457a-93ee-e1b9b44bf347 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:33.295783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1562191194", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "4e9e66ac-24f5-49b8-8427-02f1b1cd91af"}], "block_device_mapping_v2": [{"uuid": "36d04aff-1d65-4672-b3ff-919a4ae6d656", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:33.298366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:33.308988 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-159e732e-a681-457a-93ee-e1b9b44bf347 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.065786 Aug 09 14:37:33.320057 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 931/1879] 10.222.0.50 () {60 vars in 1184 bytes} [Tue Aug 9 14:37:33 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:33.330943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22e7d76d-a7e7-4d09-8082-f96f29033936 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:33.347338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22e7d76d-a7e7-4d09-8082-f96f29033936 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:33.364588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e7d76d-a7e7-4d09-8082-f96f29033936 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:33.365755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e7d76d-a7e7-4d09-8082-f96f29033936 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:33.368593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e7d76d-a7e7-4d09-8082-f96f29033936 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:33.370304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e7d76d-a7e7-4d09-8082-f96f29033936 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:33.373369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e7d76d-a7e7-4d09-8082-f96f29033936 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:33.374045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22e7d76d-a7e7-4d09-8082-f96f29033936 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:33.465947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] validate_networks() for [('4e9e66ac-24f5-49b8-8427-02f1b1cd91af', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:37:33.611539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-22e7d76d-a7e7-4d09-8082-f96f29033936 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] Lazy-loading 'services' on Instance uuid 268d8e06-f80e-4f5e-8710-578f4eef5bab {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:37:33.651864 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22e7d76d-a7e7-4d09-8082-f96f29033936 tempest-LiveAutoBlockMigrationV225Test-1669933926 tempest-LiveAutoBlockMigrationV225Test-1669933926-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1968 microversion: 2.25 time: 0.328464 Aug 09 14:37:33.656924 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 932/1880] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:33 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1968 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:33.670991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f308d8f-e665-43ec-90c6-efad645affc0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:33.672276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6f308d8f-e665-43ec-90c6-efad645affc0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:33.682981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f308d8f-e665-43ec-90c6-efad645affc0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:33.683810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f308d8f-e665-43ec-90c6-efad645affc0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:33.684131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f308d8f-e665-43ec-90c6-efad645affc0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:33.684823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f308d8f-e665-43ec-90c6-efad645affc0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:33.685470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f308d8f-e665-43ec-90c6-efad645affc0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:33.685884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f308d8f-e665-43ec-90c6-efad645affc0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:34.644378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f308d8f-e665-43ec-90c6-efad645affc0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:34.648517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:34.664076 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f308d8f-e665-43ec-90c6-efad645affc0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 1.005348 Aug 09 14:37:34.665663 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 933/1881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:33 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:34.673131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-135fd5e0-54ae-4664-9022-50d83a4ae35b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:34.673914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-135fd5e0-54ae-4664-9022-50d83a4ae35b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:34.680798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-135fd5e0-54ae-4664-9022-50d83a4ae35b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:34.682153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-135fd5e0-54ae-4664-9022-50d83a4ae35b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:34.683019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-135fd5e0-54ae-4664-9022-50d83a4ae35b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:34.684068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-135fd5e0-54ae-4664-9022-50d83a4ae35b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:34.684745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-135fd5e0-54ae-4664-9022-50d83a4ae35b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:34.685442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-135fd5e0-54ae-4664-9022-50d83a4ae35b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:34.727133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-135fd5e0-54ae-4664-9022-50d83a4ae35b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:37:34.916928 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-135fd5e0-54ae-4664-9022-50d83a4ae35b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "DELETE /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 204 len: 0 microversion: 2.25 time: 0.249761 Aug 09 14:37:34.919037 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 934/1882] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:37:34 2022] DELETE /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:37:34.927550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e5a14fc3-38d6-4bd1-8eb3-0cca6f184867 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:34.929454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e5a14fc3-38d6-4bd1-8eb3-0cca6f184867 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:34.949612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5a14fc3-38d6-4bd1-8eb3-0cca6f184867 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:34.950276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5a14fc3-38d6-4bd1-8eb3-0cca6f184867 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:34.950781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5a14fc3-38d6-4bd1-8eb3-0cca6f184867 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:34.955135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5a14fc3-38d6-4bd1-8eb3-0cca6f184867 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:34.955504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5a14fc3-38d6-4bd1-8eb3-0cca6f184867 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:34.956525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5a14fc3-38d6-4bd1-8eb3-0cca6f184867 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:35.268048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:37:35.269091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:37:35.269801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:37:35.270463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:37:35.271112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:37:35.288786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:35.289343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:35.289839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:35.290775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:35.291705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:35.299784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:35.305741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e5a14fc3-38d6-4bd1-8eb3-0cca6f184867 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:35.314860 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e5a14fc3-38d6-4bd1-8eb3-0cca6f184867 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1313 microversion: 2.1 time: 0.394068 Aug 09 14:37:35.333527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Getting quotas for project beac39aa567247818bf13c604a1ed8ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:37:35.336177 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 935/1883] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:34 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:35.343910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b6894e7b-9b53-40d9-b8dd-d65170e76e24 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:35.344519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6894e7b-9b53-40d9-b8dd-d65170e76e24 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:35.346754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Getting quotas for user ca408ac0b6df4c3797409e40335f61aa and project beac39aa567247818bf13c604a1ed8ac. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:37:35.362352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6894e7b-9b53-40d9-b8dd-d65170e76e24 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:35.362845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6894e7b-9b53-40d9-b8dd-d65170e76e24 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:35.368280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6894e7b-9b53-40d9-b8dd-d65170e76e24 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:35.369100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6894e7b-9b53-40d9-b8dd-d65170e76e24 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:35.369574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6894e7b-9b53-40d9-b8dd-d65170e76e24 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:35.370000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6894e7b-9b53-40d9-b8dd-d65170e76e24 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:35.526063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:37:35.528864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='36d04aff-1d65-4672-b3ff-919a4ae6d656',volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:37:35.763639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b6894e7b-9b53-40d9-b8dd-d65170e76e24 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:35.779605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b6894e7b-9b53-40d9-b8dd-d65170e76e24 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:35.781306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b6894e7b-9b53-40d9-b8dd-d65170e76e24 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:35.787424 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b6894e7b-9b53-40d9-b8dd-d65170e76e24 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1482 microversion: 2.25 time: 0.445965 Aug 09 14:37:35.788192 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 936/1884] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:35 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1482 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:35.799951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f33385ca-9197-4292-8cd3-cbdae313230d req-5199efa0-1854-4f04-aa06-8168faebf161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a676431f-5bb5-48a8-87b7-ba9dbc1006ed", "tag": "3094e50f-5e28-4faa-8608-b1f1946763b3"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:35.806769 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-190e5c6d-34c8-44f1-988a-4ec12e6555d3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.520995 Aug 09 14:37:35.808012 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 949/1885] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:37:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:37:35.818303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75b51d32-6b96-4daf-8302-7b5c8b33c3f0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:35.819705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75b51d32-6b96-4daf-8302-7b5c8b33c3f0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:35.843603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75b51d32-6b96-4daf-8302-7b5c8b33c3f0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:35.845785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75b51d32-6b96-4daf-8302-7b5c8b33c3f0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:35.845963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f33385ca-9197-4292-8cd3-cbdae313230d req-5199efa0-1854-4f04-aa06-8168faebf161 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:35.847272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75b51d32-6b96-4daf-8302-7b5c8b33c3f0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:35.850076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75b51d32-6b96-4daf-8302-7b5c8b33c3f0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:35.850329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f33385ca-9197-4292-8cd3-cbdae313230d req-5199efa0-1854-4f04-aa06-8168faebf161 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:35.851001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f33385ca-9197-4292-8cd3-cbdae313230d req-5199efa0-1854-4f04-aa06-8168faebf161 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:35.851213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75b51d32-6b96-4daf-8302-7b5c8b33c3f0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:35.851433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75b51d32-6b96-4daf-8302-7b5c8b33c3f0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:35.884838 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f33385ca-9197-4292-8cd3-cbdae313230d req-5199efa0-1854-4f04-aa06-8168faebf161 service nova] Creating event network-changed:3094e50f-5e28-4faa-8608-b1f1946763b3 for instance a676431f-5bb5-48a8-87b7-ba9dbc1006ed on n-h1-844626-8 Aug 09 14:37:35.897565 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f33385ca-9197-4292-8cd3-cbdae313230d req-5199efa0-1854-4f04-aa06-8168faebf161 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107264 Aug 09 14:37:35.900361 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 937/1886] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:35.914388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-123c006a-814f-4f4d-a9df-97ac66513834 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:35.915580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-123c006a-814f-4f4d-a9df-97ac66513834 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:35.946438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:36.165963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-123c006a-814f-4f4d-a9df-97ac66513834 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:36.177606 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-123c006a-814f-4f4d-a9df-97ac66513834 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1053 microversion: 2.1 time: 0.275656 Aug 09 14:37:36.185176 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 938/1887] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:35 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1053 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:36.350915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d23f6170-3dee-4023-a8b5-cedc1cc71930 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:36.352068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d23f6170-3dee-4023-a8b5-cedc1cc71930 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:36.385504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d23f6170-3dee-4023-a8b5-cedc1cc71930 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:36.386169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d23f6170-3dee-4023-a8b5-cedc1cc71930 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:36.390880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d23f6170-3dee-4023-a8b5-cedc1cc71930 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:36.391875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d23f6170-3dee-4023-a8b5-cedc1cc71930 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:36.392350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d23f6170-3dee-4023-a8b5-cedc1cc71930 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:36.392782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d23f6170-3dee-4023-a8b5-cedc1cc71930 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:36.450457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-75b51d32-6b96-4daf-8302-7b5c8b33c3f0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:36.465508 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75b51d32-6b96-4daf-8302-7b5c8b33c3f0 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 0.656034 Aug 09 14:37:36.469391 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 950/1888] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:35 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:36.812949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-74cde93c-7503-448a-9a74-885d50597d21 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:36.813576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-74cde93c-7503-448a-9a74-885d50597d21 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:36.828729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74cde93c-7503-448a-9a74-885d50597d21 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:36.829221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74cde93c-7503-448a-9a74-885d50597d21 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:36.829658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74cde93c-7503-448a-9a74-885d50597d21 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:36.830378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74cde93c-7503-448a-9a74-885d50597d21 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:36.830828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74cde93c-7503-448a-9a74-885d50597d21 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:36.831283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74cde93c-7503-448a-9a74-885d50597d21 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:37.038350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d23f6170-3dee-4023-a8b5-cedc1cc71930 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:37.046008 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d23f6170-3dee-4023-a8b5-cedc1cc71930 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1313 microversion: 2.1 time: 0.712844 Aug 09 14:37:37.046974 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 939/1889] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:36 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1313 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:37:37.205485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3037a84d-d454-4075-8ad8-999010b6b5b6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:37.206096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3037a84d-d454-4075-8ad8-999010b6b5b6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:37.220238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3037a84d-d454-4075-8ad8-999010b6b5b6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:37.220627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3037a84d-d454-4075-8ad8-999010b6b5b6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:37.221108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3037a84d-d454-4075-8ad8-999010b6b5b6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:37.221923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3037a84d-d454-4075-8ad8-999010b6b5b6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:37.222381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3037a84d-d454-4075-8ad8-999010b6b5b6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:37.222802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3037a84d-d454-4075-8ad8-999010b6b5b6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:37.361396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-74cde93c-7503-448a-9a74-885d50597d21 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:37.366500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3037a84d-d454-4075-8ad8-999010b6b5b6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:37.387018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-74cde93c-7503-448a-9a74-885d50597d21 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:37.389429 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3037a84d-d454-4075-8ad8-999010b6b5b6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1151 microversion: 2.1 time: 0.188076 Aug 09 14:37:37.390396 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 940/1890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:37 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1151 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:37:37.390852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-74cde93c-7503-448a-9a74-885d50597d21 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:37.393238 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-74cde93c-7503-448a-9a74-885d50597d21 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1482 microversion: 2.25 time: 0.584693 Aug 09 14:37:37.408006 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 951/1891] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:36 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1482 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:37.490685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f96eb571-9f5e-4117-b0a4-eb2e24bf247d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:37.491493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f96eb571-9f5e-4117-b0a4-eb2e24bf247d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:37.504545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f96eb571-9f5e-4117-b0a4-eb2e24bf247d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:37.505539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f96eb571-9f5e-4117-b0a4-eb2e24bf247d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:37.506275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f96eb571-9f5e-4117-b0a4-eb2e24bf247d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:37.507333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f96eb571-9f5e-4117-b0a4-eb2e24bf247d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:37.516734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f96eb571-9f5e-4117-b0a4-eb2e24bf247d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:37.519399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f96eb571-9f5e-4117-b0a4-eb2e24bf247d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:38.067428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-90d01b7b-8bad-4592-b99a-282c574d1c3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:38.068033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-90d01b7b-8bad-4592-b99a-282c574d1c3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:38.075057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d01b7b-8bad-4592-b99a-282c574d1c3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:38.075633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d01b7b-8bad-4592-b99a-282c574d1c3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:38.076284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d01b7b-8bad-4592-b99a-282c574d1c3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:38.077162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d01b7b-8bad-4592-b99a-282c574d1c3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:38.077766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d01b7b-8bad-4592-b99a-282c574d1c3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:38.078471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d01b7b-8bad-4592-b99a-282c574d1c3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:38.657049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f96eb571-9f5e-4117-b0a4-eb2e24bf247d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:38.669930 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f96eb571-9f5e-4117-b0a4-eb2e24bf247d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 1.183681 Aug 09 14:37:38.672397 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 941/1892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:37 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:38.682393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a94b0c89-173c-4689-b4db-441f7840c19f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:38.686354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a94b0c89-173c-4689-b4db-441f7840c19f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:38.698545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a94b0c89-173c-4689-b4db-441f7840c19f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:38.699034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a94b0c89-173c-4689-b4db-441f7840c19f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:38.699476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a94b0c89-173c-4689-b4db-441f7840c19f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:38.705942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a94b0c89-173c-4689-b4db-441f7840c19f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:38.706687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a94b0c89-173c-4689-b4db-441f7840c19f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:38.707544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a94b0c89-173c-4689-b4db-441f7840c19f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:38.947578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-90d01b7b-8bad-4592-b99a-282c574d1c3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:38.957916 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-90d01b7b-8bad-4592-b99a-282c574d1c3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1313 microversion: 2.1 time: 0.894336 Aug 09 14:37:38.958527 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 952/1893] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:38 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1313 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:38.989626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c51efeb-cdb0-4589-a67b-8bd614464363 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:38.990246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c51efeb-cdb0-4589-a67b-8bd614464363 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:39.013618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c51efeb-cdb0-4589-a67b-8bd614464363 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:39.014409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c51efeb-cdb0-4589-a67b-8bd614464363 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:39.015003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c51efeb-cdb0-4589-a67b-8bd614464363 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:39.015907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c51efeb-cdb0-4589-a67b-8bd614464363 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:39.016824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c51efeb-cdb0-4589-a67b-8bd614464363 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:39.016824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c51efeb-cdb0-4589-a67b-8bd614464363 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:39.286376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a94b0c89-173c-4689-b4db-441f7840c19f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:39.295420 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a94b0c89-173c-4689-b4db-441f7840c19f tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1169 microversion: 2.1 time: 0.621887 Aug 09 14:37:39.301931 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 942/1894] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:38 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1169 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:39.314143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c51efeb-cdb0-4589-a67b-8bd614464363 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:39.349029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c51efeb-cdb0-4589-a67b-8bd614464363 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:39.355879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c51efeb-cdb0-4589-a67b-8bd614464363 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:39.361122 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c51efeb-cdb0-4589-a67b-8bd614464363 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1440 microversion: 2.25 time: 0.381352 Aug 09 14:37:39.366138 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 953/1895] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:38 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1440 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:39.415907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-d178e6b5-a094-4790-8b20-430b4e2a3515 req-da92be12-44e5-4876-9601-c1331b3d88c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268d8e06-f80e-4f5e-8710-578f4eef5bab", "name": "network-vif-deleted", "tag": "4115b00e-91cf-4c28-b173-c0ec442c3cfb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:39.445875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d178e6b5-a094-4790-8b20-430b4e2a3515 req-da92be12-44e5-4876-9601-c1331b3d88c1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:39.448281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d178e6b5-a094-4790-8b20-430b4e2a3515 req-da92be12-44e5-4876-9601-c1331b3d88c1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:39.448761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d178e6b5-a094-4790-8b20-430b4e2a3515 req-da92be12-44e5-4876-9601-c1331b3d88c1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:39.496620 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d178e6b5-a094-4790-8b20-430b4e2a3515 req-da92be12-44e5-4876-9601-c1331b3d88c1 service nova] Creating event network-vif-deleted:4115b00e-91cf-4c28-b173-c0ec442c3cfb for instance 268d8e06-f80e-4f5e-8710-578f4eef5bab on n-h1-844626-8 Aug 09 14:37:39.529240 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-d178e6b5-a094-4790-8b20-430b4e2a3515 req-da92be12-44e5-4876-9601-c1331b3d88c1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110022 Aug 09 14:37:39.534190 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 954/1896] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:37:39.699855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e64681f-ddb3-4603-9d93-b134ed44d619 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:39.700603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e64681f-ddb3-4603-9d93-b134ed44d619 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:39.721958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e64681f-ddb3-4603-9d93-b134ed44d619 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:39.722452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e64681f-ddb3-4603-9d93-b134ed44d619 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:39.722887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e64681f-ddb3-4603-9d93-b134ed44d619 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:39.723647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e64681f-ddb3-4603-9d93-b134ed44d619 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:39.724104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e64681f-ddb3-4603-9d93-b134ed44d619 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:39.724520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e64681f-ddb3-4603-9d93-b134ed44d619 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:39.754675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1721203765", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "d79a2537-561c-403a-a022-2f8cd997c3ab"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:39.893914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] validate_networks() for [('d79a2537-561c-403a-a022-2f8cd997c3ab', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:37:41.150452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e64681f-ddb3-4603-9d93-b134ed44d619 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:41.167011 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e64681f-ddb3-4603-9d93-b134ed44d619 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 1.475181 Aug 09 14:37:41.173217 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 955/1897] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:39 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:41.189348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aa88643b-c8a0-434a-9699-3b72d3e1705a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:41.190334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aa88643b-c8a0-434a-9699-3b72d3e1705a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:41.197894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa88643b-c8a0-434a-9699-3b72d3e1705a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:41.198740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa88643b-c8a0-434a-9699-3b72d3e1705a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:41.199790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa88643b-c8a0-434a-9699-3b72d3e1705a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:41.200973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa88643b-c8a0-434a-9699-3b72d3e1705a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:41.201654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa88643b-c8a0-434a-9699-3b72d3e1705a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:41.202400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa88643b-c8a0-434a-9699-3b72d3e1705a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:42.183604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:37:42.184913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:37:42.185938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:37:42.186540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:37:42.187702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:37:42.215954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:42.217797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:42.218462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:42.219446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:42.222176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:42.222962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:42.261638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aa88643b-c8a0-434a-9699-3b72d3e1705a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:42.272992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:42.298122 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aa88643b-c8a0-434a-9699-3b72d3e1705a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1313 microversion: 2.1 time: 1.123361 Aug 09 14:37:42.298746 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 956/1898] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:41 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1313 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:42.314824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82831951-6946-4751-ab5d-d757dc108777 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:42.319766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82831951-6946-4751-ab5d-d757dc108777 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:42.331753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82831951-6946-4751-ab5d-d757dc108777 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:42.332527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82831951-6946-4751-ab5d-d757dc108777 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:42.334714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82831951-6946-4751-ab5d-d757dc108777 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:42.335684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82831951-6946-4751-ab5d-d757dc108777 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:42.340096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82831951-6946-4751-ab5d-d757dc108777 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:42.340262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Getting quotas for project fce0f597febb44249ab111c4c2978c39. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:37:42.340852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82831951-6946-4751-ab5d-d757dc108777 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:42.348075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Getting quotas for user b31aa283446d4db0bda4679cc10eb277 and project fce0f597febb44249ab111c4c2978c39. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:37:42.372336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:37:42.376191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:37:42.474338 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9d1de667-f8ca-45f3-b3b8-b7c2d4f67ce4 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.171054 Aug 09 14:37:42.479036 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 943/1899] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:37:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:37:42.490660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4b27e78-dba1-4e91-9d3d-8552165ecc1f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:42.492319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a4b27e78-dba1-4e91-9d3d-8552165ecc1f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:42.507038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4b27e78-dba1-4e91-9d3d-8552165ecc1f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:42.507880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4b27e78-dba1-4e91-9d3d-8552165ecc1f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:42.509362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4b27e78-dba1-4e91-9d3d-8552165ecc1f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:42.510281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4b27e78-dba1-4e91-9d3d-8552165ecc1f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:42.510949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4b27e78-dba1-4e91-9d3d-8552165ecc1f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:42.512232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4b27e78-dba1-4e91-9d3d-8552165ecc1f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:42.676712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4b27e78-dba1-4e91-9d3d-8552165ecc1f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:42.690070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4b27e78-dba1-4e91-9d3d-8552165ecc1f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:42.691846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4b27e78-dba1-4e91-9d3d-8552165ecc1f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:42.693901 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4b27e78-dba1-4e91-9d3d-8552165ecc1f tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1265 microversion: 2.25 time: 0.212169 Aug 09 14:37:42.695715 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 944/1900] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:42 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:42.708901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0d4e98a-0b2d-4d84-9960-234f173ca701 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:42.709403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0d4e98a-0b2d-4d84-9960-234f173ca701 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:42.720770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0d4e98a-0b2d-4d84-9960-234f173ca701 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:42.725485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0d4e98a-0b2d-4d84-9960-234f173ca701 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:42.725944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0d4e98a-0b2d-4d84-9960-234f173ca701 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:42.726672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0d4e98a-0b2d-4d84-9960-234f173ca701 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:42.727145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0d4e98a-0b2d-4d84-9960-234f173ca701 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:42.727728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0d4e98a-0b2d-4d84-9960-234f173ca701 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:42.934500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-82831951-6946-4751-ab5d-d757dc108777 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:42.943351 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82831951-6946-4751-ab5d-d757dc108777 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1211 microversion: 2.1 time: 0.636322 Aug 09 14:37:42.959711 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 957/1901] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:42 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1211 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:42.959711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-95c6dc46-8ee2-4e77-a67c-44249442f346 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:42.971635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-95c6dc46-8ee2-4e77-a67c-44249442f346 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:43.196101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-95c6dc46-8ee2-4e77-a67c-44249442f346 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31aa283446d4db0bda4679cc10eb277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0f597febb44249ab111c4c2978c39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:43.208745 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-95c6dc46-8ee2-4e77-a67c-44249442f346 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 200 len: 1217 microversion: 2.1 time: 0.259493 Aug 09 14:37:43.211711 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 958/1902] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:42 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 1217 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:43.323794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c81b2b1-a837-4f61-a7c5-3fd39945f3a5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:43.324617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5c81b2b1-a837-4f61-a7c5-3fd39945f3a5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:43.337112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c81b2b1-a837-4f61-a7c5-3fd39945f3a5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:43.340125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c81b2b1-a837-4f61-a7c5-3fd39945f3a5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:43.340571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c81b2b1-a837-4f61-a7c5-3fd39945f3a5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:43.341380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c81b2b1-a837-4f61-a7c5-3fd39945f3a5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:43.341829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c81b2b1-a837-4f61-a7c5-3fd39945f3a5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:43.350005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c81b2b1-a837-4f61-a7c5-3fd39945f3a5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:43.424572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0d4e98a-0b2d-4d84-9960-234f173ca701 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:43.436404 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0d4e98a-0b2d-4d84-9960-234f173ca701 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 0.739235 Aug 09 14:37:43.437047 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 945/1903] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:42 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:43.725565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca80305c-8339-49fc-8184-481ad4a0f3ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:43.728638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca80305c-8339-49fc-8184-481ad4a0f3ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:43.745150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca80305c-8339-49fc-8184-481ad4a0f3ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:43.747732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca80305c-8339-49fc-8184-481ad4a0f3ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:43.748376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca80305c-8339-49fc-8184-481ad4a0f3ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:43.753618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca80305c-8339-49fc-8184-481ad4a0f3ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:43.757618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca80305c-8339-49fc-8184-481ad4a0f3ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:43.759012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca80305c-8339-49fc-8184-481ad4a0f3ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:43.943846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca80305c-8339-49fc-8184-481ad4a0f3ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:43.953782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca80305c-8339-49fc-8184-481ad4a0f3ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:43.955343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca80305c-8339-49fc-8184-481ad4a0f3ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:43.956493 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca80305c-8339-49fc-8184-481ad4a0f3ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1265 microversion: 2.25 time: 0.234854 Aug 09 14:37:43.963515 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 946/1904] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:43 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:43.977703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39327efa-1f03-4347-80bf-1f2ef6173185 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:43.978576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39327efa-1f03-4347-80bf-1f2ef6173185 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:43.994755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39327efa-1f03-4347-80bf-1f2ef6173185 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:43.995578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39327efa-1f03-4347-80bf-1f2ef6173185 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:43.996185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39327efa-1f03-4347-80bf-1f2ef6173185 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:43.997071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39327efa-1f03-4347-80bf-1f2ef6173185 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:43.997957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39327efa-1f03-4347-80bf-1f2ef6173185 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:43.998543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39327efa-1f03-4347-80bf-1f2ef6173185 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:44.241994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c81b2b1-a837-4f61-a7c5-3fd39945f3a5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:44.253835 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c81b2b1-a837-4f61-a7c5-3fd39945f3a5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1313 microversion: 2.1 time: 0.934537 Aug 09 14:37:44.257926 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 959/1905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:43 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1313 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:37:44.285263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2674b4b6-cb19-43cc-a769-657b39123b6c tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:44.286972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2674b4b6-cb19-43cc-a769-657b39123b6c tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:44.307976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2674b4b6-cb19-43cc-a769-657b39123b6c tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:44.307976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2674b4b6-cb19-43cc-a769-657b39123b6c tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:44.307976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2674b4b6-cb19-43cc-a769-657b39123b6c tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:44.307976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2674b4b6-cb19-43cc-a769-657b39123b6c tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:44.307976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2674b4b6-cb19-43cc-a769-657b39123b6c tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:44.307976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2674b4b6-cb19-43cc-a769-657b39123b6c tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:44.808508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2674b4b6-cb19-43cc-a769-657b39123b6c tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31aa283446d4db0bda4679cc10eb277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0f597febb44249ab111c4c2978c39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:44.818363 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2674b4b6-cb19-43cc-a769-657b39123b6c tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 200 len: 1287 microversion: 2.1 time: 0.545025 Aug 09 14:37:44.823435 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 960/1906] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:44 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 1287 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:44.844899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f4c4bdb-c824-4195-b7ce-01e8a8edb280 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:44.845798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f4c4bdb-c824-4195-b7ce-01e8a8edb280 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:44.865360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f4c4bdb-c824-4195-b7ce-01e8a8edb280 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:44.871488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f4c4bdb-c824-4195-b7ce-01e8a8edb280 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:44.871936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f4c4bdb-c824-4195-b7ce-01e8a8edb280 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:44.875419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f4c4bdb-c824-4195-b7ce-01e8a8edb280 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:44.876151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f4c4bdb-c824-4195-b7ce-01e8a8edb280 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:44.877487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f4c4bdb-c824-4195-b7ce-01e8a8edb280 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:45.306856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-39327efa-1f03-4347-80bf-1f2ef6173185 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:45.316963 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39327efa-1f03-4347-80bf-1f2ef6173185 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1211 microversion: 2.1 time: 1.343147 Aug 09 14:37:45.320845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:45.322807 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 947/1907] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:43 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1211 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:45.334162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b4d41251-8462-4813-9e3d-57a9ab8ab94d req-b75143c6-8bba-4f07-a761-db761828db4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c508aaa8-11d1-4593-b840-91b8295b6f8e", "tag": "6db596c5-3bac-4ac1-8c68-1f1c20808428"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:45.362771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2f4c4bdb-c824-4195-b7ce-01e8a8edb280 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:45.367774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b4d41251-8462-4813-9e3d-57a9ab8ab94d req-b75143c6-8bba-4f07-a761-db761828db4b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:45.372407 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f4c4bdb-c824-4195-b7ce-01e8a8edb280 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 0.547539 Aug 09 14:37:45.373326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b4d41251-8462-4813-9e3d-57a9ab8ab94d req-b75143c6-8bba-4f07-a761-db761828db4b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:45.374749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b4d41251-8462-4813-9e3d-57a9ab8ab94d req-b75143c6-8bba-4f07-a761-db761828db4b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:45.375239 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 961/1908] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:44 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:45.385974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2c5764c-3345-4649-841c-439e96980022 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:45.396170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c2c5764c-3345-4649-841c-439e96980022 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:45.415290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2c5764c-3345-4649-841c-439e96980022 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:45.425643 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b4d41251-8462-4813-9e3d-57a9ab8ab94d req-b75143c6-8bba-4f07-a761-db761828db4b service nova] Creating event network-changed:6db596c5-3bac-4ac1-8c68-1f1c20808428 for instance c508aaa8-11d1-4593-b840-91b8295b6f8e on n-h2-844626-8 Aug 09 14:37:45.426689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2c5764c-3345-4649-841c-439e96980022 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:45.427378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2c5764c-3345-4649-841c-439e96980022 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:45.428434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2c5764c-3345-4649-841c-439e96980022 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:45.432459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2c5764c-3345-4649-841c-439e96980022 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:45.433275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2c5764c-3345-4649-841c-439e96980022 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:45.437627 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b4d41251-8462-4813-9e3d-57a9ab8ab94d req-b75143c6-8bba-4f07-a761-db761828db4b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113185 Aug 09 14:37:45.445929 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 948/1909] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:45.451840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60d33ed6-0e21-4493-8816-ce0f82d05bf5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:45.466881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60d33ed6-0e21-4493-8816-ce0f82d05bf5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:45.491275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d33ed6-0e21-4493-8816-ce0f82d05bf5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:45.491887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d33ed6-0e21-4493-8816-ce0f82d05bf5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:45.493457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d33ed6-0e21-4493-8816-ce0f82d05bf5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:45.495210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d33ed6-0e21-4493-8816-ce0f82d05bf5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:45.496229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d33ed6-0e21-4493-8816-ce0f82d05bf5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:45.497088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d33ed6-0e21-4493-8816-ce0f82d05bf5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:45.599993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2c5764c-3345-4649-841c-439e96980022 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:45.616812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2c5764c-3345-4649-841c-439e96980022 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:45.622093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2c5764c-3345-4649-841c-439e96980022 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:45.623710 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2c5764c-3345-4649-841c-439e96980022 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1265 microversion: 2.25 time: 0.247323 Aug 09 14:37:45.625446 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 962/1910] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:45 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:45.847452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78a64863-5a18-434f-8095-515b381822d6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:45.848141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-78a64863-5a18-434f-8095-515b381822d6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:45.858478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78a64863-5a18-434f-8095-515b381822d6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:45.861512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78a64863-5a18-434f-8095-515b381822d6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:45.862199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78a64863-5a18-434f-8095-515b381822d6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:45.863635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78a64863-5a18-434f-8095-515b381822d6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:45.867856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78a64863-5a18-434f-8095-515b381822d6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:45.868516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78a64863-5a18-434f-8095-515b381822d6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:46.620633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60d33ed6-0e21-4493-8816-ce0f82d05bf5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:46.639069 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60d33ed6-0e21-4493-8816-ce0f82d05bf5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1313 microversion: 2.1 time: 1.190163 Aug 09 14:37:46.645056 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 949/1911] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:45 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1313 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:46.660408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-45475a22-3c2b-437f-ab3c-5bc669f3722b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:46.661606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-45475a22-3c2b-437f-ab3c-5bc669f3722b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:46.681176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45475a22-3c2b-437f-ab3c-5bc669f3722b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:46.689902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45475a22-3c2b-437f-ab3c-5bc669f3722b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:46.692831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45475a22-3c2b-437f-ab3c-5bc669f3722b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:46.694801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45475a22-3c2b-437f-ab3c-5bc669f3722b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:46.697689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45475a22-3c2b-437f-ab3c-5bc669f3722b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:46.698396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45475a22-3c2b-437f-ab3c-5bc669f3722b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:47.695351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-78a64863-5a18-434f-8095-515b381822d6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31aa283446d4db0bda4679cc10eb277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0f597febb44249ab111c4c2978c39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:47.708151 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78a64863-5a18-434f-8095-515b381822d6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 200 len: 1317 microversion: 2.1 time: 1.865041 Aug 09 14:37:47.710645 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 963/1912] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:45 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 1317 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:47.720211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81061c25-15b8-402e-85d3-a29bb4a0bbfb tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:47.722798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-81061c25-15b8-402e-85d3-a29bb4a0bbfb tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:47.736730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81061c25-15b8-402e-85d3-a29bb4a0bbfb tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:47.737623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81061c25-15b8-402e-85d3-a29bb4a0bbfb tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:47.739328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81061c25-15b8-402e-85d3-a29bb4a0bbfb tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:47.743425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81061c25-15b8-402e-85d3-a29bb4a0bbfb tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:47.744134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81061c25-15b8-402e-85d3-a29bb4a0bbfb tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:47.744726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81061c25-15b8-402e-85d3-a29bb4a0bbfb tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:47.759917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45475a22-3c2b-437f-ab3c-5bc669f3722b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:47.787648 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-45475a22-3c2b-437f-ab3c-5bc669f3722b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1211 microversion: 2.1 time: 1.140784 Aug 09 14:37:47.788289 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 950/1913] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:46 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1211 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:47.803335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3843b250-0830-45a9-a3d9-973fbafed1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:47.804231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3843b250-0830-45a9-a3d9-973fbafed1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:47.828327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3843b250-0830-45a9-a3d9-973fbafed1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:47.831620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3843b250-0830-45a9-a3d9-973fbafed1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:47.832426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3843b250-0830-45a9-a3d9-973fbafed1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:47.834473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3843b250-0830-45a9-a3d9-973fbafed1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:47.836142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3843b250-0830-45a9-a3d9-973fbafed1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:47.838365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3843b250-0830-45a9-a3d9-973fbafed1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:48.150221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3843b250-0830-45a9-a3d9-973fbafed1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:48.157877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:48.172303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3843b250-0830-45a9-a3d9-973fbafed1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:48.174369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3843b250-0830-45a9-a3d9-973fbafed1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:48.181462 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3843b250-0830-45a9-a3d9-973fbafed1b3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1265 microversion: 2.25 time: 0.391850 Aug 09 14:37:48.182961 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 951/1914] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:47 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1265 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:48.195779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-cc4a4e5e-50f0-4cbf-a345-0992bb7cdb73 req-10c040b8-4591-4771-a273-8b0a73da22a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d615dd5-c0ab-4d52-946b-7773c9605ac7", "name": "network-vif-plugged", "status": "completed", "tag": "f86d7401-99bd-4bda-9d44-57e788fd6714"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:48.221176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cc4a4e5e-50f0-4cbf-a345-0992bb7cdb73 req-10c040b8-4591-4771-a273-8b0a73da22a9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:48.223425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cc4a4e5e-50f0-4cbf-a345-0992bb7cdb73 req-10c040b8-4591-4771-a273-8b0a73da22a9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:48.224115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cc4a4e5e-50f0-4cbf-a345-0992bb7cdb73 req-10c040b8-4591-4771-a273-8b0a73da22a9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:48.261198 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-cc4a4e5e-50f0-4cbf-a345-0992bb7cdb73 req-10c040b8-4591-4771-a273-8b0a73da22a9 service nova] Creating event network-vif-plugged:f86d7401-99bd-4bda-9d44-57e788fd6714 for instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 on n-h1-844626-8 Aug 09 14:37:48.274278 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-cc4a4e5e-50f0-4cbf-a345-0992bb7cdb73 req-10c040b8-4591-4771-a273-8b0a73da22a9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088129 Aug 09 14:37:48.277610 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 952/1915] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:48.287746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-58e9cb88-4c90-4036-90c0-d0987ad8609f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:48.293618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-58e9cb88-4c90-4036-90c0-d0987ad8609f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:48.312077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58e9cb88-4c90-4036-90c0-d0987ad8609f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:48.314714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58e9cb88-4c90-4036-90c0-d0987ad8609f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:48.315559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58e9cb88-4c90-4036-90c0-d0987ad8609f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:48.316527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58e9cb88-4c90-4036-90c0-d0987ad8609f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:48.319881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58e9cb88-4c90-4036-90c0-d0987ad8609f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:48.322086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58e9cb88-4c90-4036-90c0-d0987ad8609f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:48.570109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-81061c25-15b8-402e-85d3-a29bb4a0bbfb tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:48.584379 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81061c25-15b8-402e-85d3-a29bb4a0bbfb tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 0.872377 Aug 09 14:37:48.584983 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 964/1916] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:47 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:48.624862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-58e9cb88-4c90-4036-90c0-d0987ad8609f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:48.635216 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-58e9cb88-4c90-4036-90c0-d0987ad8609f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1313 microversion: 2.1 time: 0.355083 Aug 09 14:37:48.641661 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 953/1917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:48 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1313 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:48.737433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f43f481b-6724-4b39-8db9-3065c63ce05b tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:48.738067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f43f481b-6724-4b39-8db9-3065c63ce05b tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:48.748486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f43f481b-6724-4b39-8db9-3065c63ce05b tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:48.748982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f43f481b-6724-4b39-8db9-3065c63ce05b tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:48.749419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f43f481b-6724-4b39-8db9-3065c63ce05b tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:48.753558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f43f481b-6724-4b39-8db9-3065c63ce05b tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:48.754213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f43f481b-6724-4b39-8db9-3065c63ce05b tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:48.757006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f43f481b-6724-4b39-8db9-3065c63ce05b tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:48.814178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-56c8f75e-8631-45a5-b5c9-2e43fdb36423 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:48.814788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-56c8f75e-8631-45a5-b5c9-2e43fdb36423 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:48.835672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c8f75e-8631-45a5-b5c9-2e43fdb36423 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:48.836317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c8f75e-8631-45a5-b5c9-2e43fdb36423 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:48.836977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c8f75e-8631-45a5-b5c9-2e43fdb36423 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:48.838579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c8f75e-8631-45a5-b5c9-2e43fdb36423 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:48.840956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c8f75e-8631-45a5-b5c9-2e43fdb36423 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:48.841688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c8f75e-8631-45a5-b5c9-2e43fdb36423 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:49.744855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-56c8f75e-8631-45a5-b5c9-2e43fdb36423 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:49.748327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f43f481b-6724-4b39-8db9-3065c63ce05b tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31aa283446d4db0bda4679cc10eb277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0f597febb44249ab111c4c2978c39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:49.756512 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-56c8f75e-8631-45a5-b5c9-2e43fdb36423 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1211 microversion: 2.1 time: 0.946693 Aug 09 14:37:49.768587 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 954/1918] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:48 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1211 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:37:49.778544 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f43f481b-6724-4b39-8db9-3065c63ce05b tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 200 len: 1317 microversion: 2.1 time: 1.047212 Aug 09 14:37:49.789265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0ae53164-6b80-4144-b38e-c0efc4e9075d req-ea6e3461-6987-488c-80f1-d6108c9783dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a37cd4a-5a1b-4991-a1d1-fc67d7b68941", "tag": "d91969e1-e6a2-4d1a-9db3-fa4934ddc34c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:49.789713 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 965/1919] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:48 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 1317 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:49.790650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7f86571-91fe-4dd7-a22b-a672c51126a9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:49.791289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b7f86571-91fe-4dd7-a22b-a672c51126a9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:49.814684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0ae53164-6b80-4144-b38e-c0efc4e9075d req-ea6e3461-6987-488c-80f1-d6108c9783dc service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:49.817619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0ae53164-6b80-4144-b38e-c0efc4e9075d req-ea6e3461-6987-488c-80f1-d6108c9783dc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:49.818114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0ae53164-6b80-4144-b38e-c0efc4e9075d req-ea6e3461-6987-488c-80f1-d6108c9783dc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:49.821718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7f86571-91fe-4dd7-a22b-a672c51126a9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:49.822578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7f86571-91fe-4dd7-a22b-a672c51126a9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:49.823018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7f86571-91fe-4dd7-a22b-a672c51126a9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:49.823756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7f86571-91fe-4dd7-a22b-a672c51126a9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:49.839395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7f86571-91fe-4dd7-a22b-a672c51126a9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:49.840020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7f86571-91fe-4dd7-a22b-a672c51126a9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:49.846349 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0ae53164-6b80-4144-b38e-c0efc4e9075d req-ea6e3461-6987-488c-80f1-d6108c9783dc service nova] Creating event network-changed:d91969e1-e6a2-4d1a-9db3-fa4934ddc34c for instance 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 on n-h2-844626-8 Aug 09 14:37:49.852752 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0ae53164-6b80-4144-b38e-c0efc4e9075d req-ea6e3461-6987-488c-80f1-d6108c9783dc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082788 Aug 09 14:37:49.859066 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 955/1920] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:49.868547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a9b4290-beff-4659-b4c3-395680185c62 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:49.875771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a9b4290-beff-4659-b4c3-395680185c62 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:49.891120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a9b4290-beff-4659-b4c3-395680185c62 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:49.891918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a9b4290-beff-4659-b4c3-395680185c62 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:49.894177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a9b4290-beff-4659-b4c3-395680185c62 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:49.895786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a9b4290-beff-4659-b4c3-395680185c62 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:49.898289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a9b4290-beff-4659-b4c3-395680185c62 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:49.898984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a9b4290-beff-4659-b4c3-395680185c62 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:50.206254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b7f86571-91fe-4dd7-a22b-a672c51126a9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:50.219247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b7f86571-91fe-4dd7-a22b-a672c51126a9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:50.228807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b7f86571-91fe-4dd7-a22b-a672c51126a9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:50.230358 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7f86571-91fe-4dd7-a22b-a672c51126a9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1265 microversion: 2.25 time: 0.443721 Aug 09 14:37:50.231163 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 966/1921] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:49 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1265 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:50.240122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d342ff32-3281-42a1-b686-33e248209655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:50.249812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d342ff32-3281-42a1-b686-33e248209655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:50.265875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d342ff32-3281-42a1-b686-33e248209655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:50.266638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d342ff32-3281-42a1-b686-33e248209655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:50.267390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d342ff32-3281-42a1-b686-33e248209655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:50.268284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d342ff32-3281-42a1-b686-33e248209655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:50.268911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d342ff32-3281-42a1-b686-33e248209655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:50.269493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d342ff32-3281-42a1-b686-33e248209655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:50.719437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a9b4290-beff-4659-b4c3-395680185c62 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:50.745172 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a9b4290-beff-4659-b4c3-395680185c62 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 0.880590 Aug 09 14:37:50.767483 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 956/1922] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:49 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:50.803656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d342ff32-3281-42a1-b686-33e248209655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:50.818394 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d342ff32-3281-42a1-b686-33e248209655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1313 microversion: 2.1 time: 0.581849 Aug 09 14:37:50.819939 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 967/1923] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:50 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:50.827217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-32ac4419-12ff-4ab8-ae4b-6e1004d65f20 req-ac29c95f-be0d-4672-8975-e29c995236ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a676431f-5bb5-48a8-87b7-ba9dbc1006ed", "name": "network-vif-plugged", "status": "completed", "tag": "3094e50f-5e28-4faa-8608-b1f1946763b3"}, {"server_uuid": "4d615dd5-c0ab-4d52-946b-7773c9605ac7", "name": "network-vif-plugged", "status": "completed", "tag": "73754091-7b0d-4b6b-a529-2d3bfb2eeb3f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:50.842182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-32ac4419-12ff-4ab8-ae4b-6e1004d65f20 req-ac29c95f-be0d-4672-8975-e29c995236ba service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:50.842942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-32ac4419-12ff-4ab8-ae4b-6e1004d65f20 req-ac29c95f-be0d-4672-8975-e29c995236ba service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:50.844540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-32ac4419-12ff-4ab8-ae4b-6e1004d65f20 req-ac29c95f-be0d-4672-8975-e29c995236ba service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:50.873979 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-32ac4419-12ff-4ab8-ae4b-6e1004d65f20 req-ac29c95f-be0d-4672-8975-e29c995236ba service nova] Creating event network-vif-plugged:3094e50f-5e28-4faa-8608-b1f1946763b3 for instance a676431f-5bb5-48a8-87b7-ba9dbc1006ed on n-h1-844626-8 Aug 09 14:37:50.875869 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-32ac4419-12ff-4ab8-ae4b-6e1004d65f20 req-ac29c95f-be0d-4672-8975-e29c995236ba service nova] Creating event network-vif-plugged:73754091-7b0d-4b6b-a529-2d3bfb2eeb3f for instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 on n-h1-844626-8 Aug 09 14:37:50.888912 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-32ac4419-12ff-4ab8-ae4b-6e1004d65f20 req-ac29c95f-be0d-4672-8975-e29c995236ba service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067016 Aug 09 14:37:50.889732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1542051260", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "8e5664a1-4e3d-47e9-ac93-f7a76fb16596"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:50.890455 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 968/1924] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:50.896994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5fc929c6-8d38-4351-adbc-40b4ae698ba3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:50.898342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5fc929c6-8d38-4351-adbc-40b4ae698ba3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:50.907514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fc929c6-8d38-4351-adbc-40b4ae698ba3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:50.910428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fc929c6-8d38-4351-adbc-40b4ae698ba3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:50.911072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fc929c6-8d38-4351-adbc-40b4ae698ba3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:50.912188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fc929c6-8d38-4351-adbc-40b4ae698ba3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:50.912861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fc929c6-8d38-4351-adbc-40b4ae698ba3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:50.913476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fc929c6-8d38-4351-adbc-40b4ae698ba3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:51.033210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] validate_networks() for [('8e5664a1-4e3d-47e9-ac93-f7a76fb16596', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:37:51.672403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5fc929c6-8d38-4351-adbc-40b4ae698ba3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:51.685808 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5fc929c6-8d38-4351-adbc-40b4ae698ba3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1211 microversion: 2.1 time: 0.794347 Aug 09 14:37:51.686424 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 969/1925] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:50 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1211 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:51.703252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5711b50d-ff30-42cc-8663-bccd3285eeab tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:51.708116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5711b50d-ff30-42cc-8663-bccd3285eeab tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:51.727798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5711b50d-ff30-42cc-8663-bccd3285eeab tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:51.728295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5711b50d-ff30-42cc-8663-bccd3285eeab tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:51.728729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5711b50d-ff30-42cc-8663-bccd3285eeab tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:51.729447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5711b50d-ff30-42cc-8663-bccd3285eeab tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:51.729896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5711b50d-ff30-42cc-8663-bccd3285eeab tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:51.730319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5711b50d-ff30-42cc-8663-bccd3285eeab tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:52.167944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5711b50d-ff30-42cc-8663-bccd3285eeab tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31aa283446d4db0bda4679cc10eb277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0f597febb44249ab111c4c2978c39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:52.184716 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5711b50d-ff30-42cc-8663-bccd3285eeab tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 200 len: 1317 microversion: 2.1 time: 0.495364 Aug 09 14:37:52.188228 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 970/1926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:51 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:52.198221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:52.199933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:52.224499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:52.227479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:52.230694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:52.235064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:52.238333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:52.242194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:52.244647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:52.319644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:52.326284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:52.327161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:52.327870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:52.328736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lazy-loading 'fault' on Instance uuid 268d8e06-f80e-4f5e-8710-578f4eef5bab {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:37:52.362909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:53.046021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:53.055488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:53.057458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:53.058837 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ccb77502-b58c-4fbc-a921-956509e0dd28 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 200 len: 1270 microversion: 2.25 time: 0.869346 Aug 09 14:37:53.059684 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 971/1927] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:52 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 1270 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:37:53.079583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-038b1bac-a2fc-4bbc-9cd3-cd7a251ecbbe tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:53.080413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-038b1bac-a2fc-4bbc-9cd3-cd7a251ecbbe tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:53.087969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-038b1bac-a2fc-4bbc-9cd3-cd7a251ecbbe tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:53.088729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-038b1bac-a2fc-4bbc-9cd3-cd7a251ecbbe tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:53.089407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-038b1bac-a2fc-4bbc-9cd3-cd7a251ecbbe tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:53.090287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-038b1bac-a2fc-4bbc-9cd3-cd7a251ecbbe tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:53.091249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-038b1bac-a2fc-4bbc-9cd3-cd7a251ecbbe tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:53.091843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-038b1bac-a2fc-4bbc-9cd3-cd7a251ecbbe tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:53.202692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:53.530085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:37:53.536249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:37:53.536412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:37:53.536831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:37:53.537270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:37:53.547799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-038b1bac-a2fc-4bbc-9cd3-cd7a251ecbbe tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:53.554338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:53.554818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:53.555457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:53.556205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:53.556654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:53.557956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:53.560668 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-038b1bac-a2fc-4bbc-9cd3-cd7a251ecbbe tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1334 microversion: 2.1 time: 0.484899 Aug 09 14:37:53.568700 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 972/1928] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:53 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1334 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:53.580331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a31eea94-57e3-4602-b471-f97741a9d175 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:53.583201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a31eea94-57e3-4602-b471-f97741a9d175 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:53.598860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Getting quotas for project 46d8cf5b02944869a9ad2541a4e2af62. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:37:53.600164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a31eea94-57e3-4602-b471-f97741a9d175 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:53.600868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a31eea94-57e3-4602-b471-f97741a9d175 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:53.602369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a31eea94-57e3-4602-b471-f97741a9d175 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:53.604384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a31eea94-57e3-4602-b471-f97741a9d175 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:53.607300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a31eea94-57e3-4602-b471-f97741a9d175 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:53.608801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a31eea94-57e3-4602-b471-f97741a9d175 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:53.612004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Getting quotas for user 6275c73b47be44c4a646761442343063 and project 46d8cf5b02944869a9ad2541a4e2af62. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:37:53.660040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:37:53.669023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:37:53.758059 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-686b2ce6-f03c-496d-94fc-78c88d5b05f0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.988984 Aug 09 14:37:53.770271 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 957/1929] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:37:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:37:53.780595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-652f6c93-a351-4368-a213-7a3421ada53d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:53.781276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-652f6c93-a351-4368-a213-7a3421ada53d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:53.789900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-652f6c93-a351-4368-a213-7a3421ada53d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:53.791659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-652f6c93-a351-4368-a213-7a3421ada53d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:53.792483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-652f6c93-a351-4368-a213-7a3421ada53d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:53.793377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-652f6c93-a351-4368-a213-7a3421ada53d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:53.794215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-652f6c93-a351-4368-a213-7a3421ada53d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:53.794822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-652f6c93-a351-4368-a213-7a3421ada53d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:53.861017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a31eea94-57e3-4602-b471-f97741a9d175 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:53.870315 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a31eea94-57e3-4602-b471-f97741a9d175 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1462 microversion: 2.1 time: 0.300294 Aug 09 14:37:53.878202 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 973/1930] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:53 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1462 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:53.889014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c6258a99-f78f-42b8-aead-bd8688438524 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:53.890653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c6258a99-f78f-42b8-aead-bd8688438524 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:53.899011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6258a99-f78f-42b8-aead-bd8688438524 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:53.899798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6258a99-f78f-42b8-aead-bd8688438524 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:53.900298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6258a99-f78f-42b8-aead-bd8688438524 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:53.901156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6258a99-f78f-42b8-aead-bd8688438524 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:53.901733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6258a99-f78f-42b8-aead-bd8688438524 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:53.902641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6258a99-f78f-42b8-aead-bd8688438524 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:54.001757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-652f6c93-a351-4368-a213-7a3421ada53d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:54.015971 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-652f6c93-a351-4368-a213-7a3421ada53d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1211 microversion: 2.1 time: 0.239231 Aug 09 14:37:54.023577 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 958/1931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:53 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1211 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:54.023577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70f9b3e2-fc1e-43df-bab4-e7e1ec713617 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:54.023577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-70f9b3e2-fc1e-43df-bab4-e7e1ec713617 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:54.091254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c6258a99-f78f-42b8-aead-bd8688438524 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31aa283446d4db0bda4679cc10eb277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0f597febb44249ab111c4c2978c39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:54.110322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:54.145034 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c6258a99-f78f-42b8-aead-bd8688438524 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 200 len: 1317 microversion: 2.1 time: 0.261207 Aug 09 14:37:54.145768 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 974/1932] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:53 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:54.178719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-70f9b3e2-fc1e-43df-bab4-e7e1ec713617 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:54.188026 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70f9b3e2-fc1e-43df-bab4-e7e1ec713617 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1224 microversion: 2.1 time: 0.170028 Aug 09 14:37:54.189567 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 959/1933] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:54 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1224 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:54.418960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-693d863f-296b-4ad6-a1ff-d37149c9c488 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Action: 'create', calling method: .version_select at 0x7f41dd3f3ca0>, body: {"keypair": {"name": "tempest-keypair-1490370686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJ2OPySij7Lr6o5Y2FscOn2fFTrmz5pkNs5qNigXa+XsrDhdYYCA0eJe7YCrTZg6vc2kW8Dlg8g6C23eecIAv/8BAusbl/3y9M7c/SisKpXiVmZos/9spQjlTd4qHDZ4g=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:54.449664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8cb6f592-81ae-4ce5-a3a9-7eee6989ba93 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:54.456836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-693d863f-296b-4ad6-a1ff-d37149c9c488 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Getting quotas for project ec96cdb5ea0f42c6ad2044517c6dbffa. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:37:54.459179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8cb6f592-81ae-4ce5-a3a9-7eee6989ba93 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Searching by: {'deleted': False, 'project_id': 'a943e057d55d4f01af7fa2367739cfad'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:37:54.468496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-693d863f-296b-4ad6-a1ff-d37149c9c488 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Getting quotas for user 68639dd3894d4af7a49f3ffee8beb889 and project ec96cdb5ea0f42c6ad2044517c6dbffa. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:37:54.486249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cb6f592-81ae-4ce5-a3a9-7eee6989ba93 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:54.488831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cb6f592-81ae-4ce5-a3a9-7eee6989ba93 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:54.490740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cb6f592-81ae-4ce5-a3a9-7eee6989ba93 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:54.492720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cb6f592-81ae-4ce5-a3a9-7eee6989ba93 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:54.493429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cb6f592-81ae-4ce5-a3a9-7eee6989ba93 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:54.494665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cb6f592-81ae-4ce5-a3a9-7eee6989ba93 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:54.521076 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-693d863f-296b-4ad6-a1ff-d37149c9c488 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.373275 Aug 09 14:37:54.521733 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 975/1934] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:37:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:54.533557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a32bb4c1-64ea-4419-95a2-df826648d816 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:54.534219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a32bb4c1-64ea-4419-95a2-df826648d816 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 268d8e06-f80e-4f5e-8710-578f4eef5bab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:54.547759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a32bb4c1-64ea-4419-95a2-df826648d816 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:54.548273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a32bb4c1-64ea-4419-95a2-df826648d816 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:54.548702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a32bb4c1-64ea-4419-95a2-df826648d816 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:54.553291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a32bb4c1-64ea-4419-95a2-df826648d816 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:54.554063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a32bb4c1-64ea-4419-95a2-df826648d816 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:54.554656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a32bb4c1-64ea-4419-95a2-df826648d816 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:54.555517 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8cb6f592-81ae-4ce5-a3a9-7eee6989ba93 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.364799 Aug 09 14:37:54.559528 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 960/1935] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:37:54 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:37:54.576820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b474d285-204a-4fa4-9edd-eb615ab9b80f req-97ed1c5c-f9cf-4127-816e-12ec9f1a7041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a37cd4a-5a1b-4991-a1d1-fc67d7b68941", "name": "network-vif-plugged", "status": "completed", "tag": "d91969e1-e6a2-4d1a-9db3-fa4934ddc34c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:54.587976 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-a32bb4c1-64ea-4419-95a2-df826648d816 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] HTTP exception thrown: Instance 268d8e06-f80e-4f5e-8710-578f4eef5bab could not be found. Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a32bb4c1-64ea-4419-95a2-df826648d816 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Request method failure captured: Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab HTTP/1.1 Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-nEY-BXVJUAYCvJbx2MxtnAO_woEd-x4ozzlUD5NfN1OL1LxcrQg_D1sDTrsL6sa1DAIs2yEdmZDFGaHREGEYTTTrfihQrn3meSTYClf6wUI828uVo601DlSJaswiDNfrp4Lexy4BKDOuwdiEW8COqJbFyTlWGdXCzEEL6Nx457d8 Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.25 Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: d512f92fc41c45edbd209ab51922e5d7 Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1110762263 Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d512f92fc41c45edbd209ab51922e5d7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d512f92fc41c45edbd209ab51922e5d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d512f92fc41c45edbd209ab51922e5d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d512f92fc41c45edbd209ab51922e5d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1110762263 Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: d512f92fc41c45edbd209ab51922e5d7 Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1110762263 Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-LiveAutoBlockMigrationV225Test-1110762263-project Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 247d1747ce074adb8b1e56a459e8cd51 Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1110762263-project Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 268d8e06-f80e-4f5e-8710-578f4eef5bab could not be found. Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '268d8e06-f80e-4f5e-8710-578f4eef5bab'} Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 268d8e06-f80e-4f5e-8710-578f4eef5bab could not be found. Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 268d8e06-f80e-4f5e-8710-578f4eef5bab could not be found. Aug 09 14:37:54.592371 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:54.599500 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:37:54.599500 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:54.599500 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:37:54.599500 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:37:54.599500 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:37:54.599500 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:37:54.599500 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:37:54.599500 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 268d8e06-f80e-4f5e-8710-578f4eef5bab could not be found. Aug 09 14:37:54.599500 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:37:54.603472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b474d285-204a-4fa4-9edd-eb615ab9b80f req-97ed1c5c-f9cf-4127-816e-12ec9f1a7041 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:54.606762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b474d285-204a-4fa4-9edd-eb615ab9b80f req-97ed1c5c-f9cf-4127-816e-12ec9f1a7041 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:54.608300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b474d285-204a-4fa4-9edd-eb615ab9b80f req-97ed1c5c-f9cf-4127-816e-12ec9f1a7041 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:54.608819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a32bb4c1-64ea-4419-95a2-df826648d816 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Returning 404 to user: Instance 268d8e06-f80e-4f5e-8710-578f4eef5bab could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:37:54.610113 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a32bb4c1-64ea-4419-95a2-df826648d816 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab" status: 404 len: 111 microversion: 2.25 time: 0.087437 Aug 09 14:37:54.620433 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 976/1936] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:37:54 2022] GET /compute/v2.1/servers/268d8e06-f80e-4f5e-8710-578f4eef5bab => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:37:54.636844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:54.650751 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b474d285-204a-4fa4-9edd-eb615ab9b80f req-97ed1c5c-f9cf-4127-816e-12ec9f1a7041 service nova] Creating event network-vif-plugged:d91969e1-e6a2-4d1a-9db3-fa4934ddc34c for instance 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 on n-h2-844626-8 Aug 09 14:37:54.656228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Searching by: {'deleted': False} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:37:54.665220 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b474d285-204a-4fa4-9edd-eb615ab9b80f req-97ed1c5c-f9cf-4127-816e-12ec9f1a7041 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104047 Aug 09 14:37:54.669990 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 961/1937] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:54.678993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:54.679900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:54.681371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:54.684619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:54.686666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:54.688465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2fb183ed-c0dd-42f8-b659-c3c81278c11e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:54.689175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:54.697248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2fb183ed-c0dd-42f8-b659-c3c81278c11e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:54.714844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb183ed-c0dd-42f8-b659-c3c81278c11e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:54.715487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb183ed-c0dd-42f8-b659-c3c81278c11e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:54.716309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb183ed-c0dd-42f8-b659-c3c81278c11e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:54.722115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb183ed-c0dd-42f8-b659-c3c81278c11e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:54.722988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb183ed-c0dd-42f8-b659-c3c81278c11e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:54.723698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb183ed-c0dd-42f8-b659-c3c81278c11e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:55.051033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Listed batch of 14 results from cell out of 1000 limit. Returned 14 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:37:55.117905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2fb183ed-c0dd-42f8-b659-c3c81278c11e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:55.134013 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2fb183ed-c0dd-42f8-b659-c3c81278c11e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1668 microversion: 2.1 time: 0.454382 Aug 09 14:37:55.134865 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 962/1938] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:54 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1668 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:55.157169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-58cf2af7-e757-4a14-b6d8-48dd3f758440 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:55.157807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-58cf2af7-e757-4a14-b6d8-48dd3f758440 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:55.197777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:55.198511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58cf2af7-e757-4a14-b6d8-48dd3f758440 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:55.199182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:55.199368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58cf2af7-e757-4a14-b6d8-48dd3f758440 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:55.200528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:55.200707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58cf2af7-e757-4a14-b6d8-48dd3f758440 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:55.201396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58cf2af7-e757-4a14-b6d8-48dd3f758440 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:55.206739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58cf2af7-e757-4a14-b6d8-48dd3f758440 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:55.207933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58cf2af7-e757-4a14-b6d8-48dd3f758440 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:55.559028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-58cf2af7-e757-4a14-b6d8-48dd3f758440 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:55.570383 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-58cf2af7-e757-4a14-b6d8-48dd3f758440 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1199 microversion: 2.1 time: 0.433654 Aug 09 14:37:55.571387 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 963/1939] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:55 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1199 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:55.587622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-59403c51-4ff0-41ab-a979-6d2fbe890e6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:55.588383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-59403c51-4ff0-41ab-a979-6d2fbe890e6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:55.595291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59403c51-4ff0-41ab-a979-6d2fbe890e6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:55.595795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59403c51-4ff0-41ab-a979-6d2fbe890e6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:55.596230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59403c51-4ff0-41ab-a979-6d2fbe890e6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:55.596942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59403c51-4ff0-41ab-a979-6d2fbe890e6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:55.597389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59403c51-4ff0-41ab-a979-6d2fbe890e6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:55.597807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59403c51-4ff0-41ab-a979-6d2fbe890e6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:55.625750 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-59403c51-4ff0-41ab-a979-6d2fbe890e6e tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7/ips" status: 200 len: 178 microversion: 2.1 time: 0.052930 Aug 09 14:37:55.626352 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 964/1940] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:37:55 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7/ips => generated 178 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:55.631141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d1144781-e550-4b23-8d4c-64cb47d7a370 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:55.632057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d1144781-e550-4b23-8d4c-64cb47d7a370 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:55.638909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1144781-e550-4b23-8d4c-64cb47d7a370 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:55.639735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1144781-e550-4b23-8d4c-64cb47d7a370 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:55.640169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1144781-e550-4b23-8d4c-64cb47d7a370 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:55.640898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1144781-e550-4b23-8d4c-64cb47d7a370 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:55.641326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1144781-e550-4b23-8d4c-64cb47d7a370 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:55.641747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1144781-e550-4b23-8d4c-64cb47d7a370 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:55.888508 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e98137ad-bc90-4e3b-9e7f-53df3812fd4a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 22770 microversion: 2.1 time: 1.263947 Aug 09 14:37:55.891486 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 977/1941] 10.222.0.50 () {58 vars in 1171 bytes} [Tue Aug 9 14:37:54 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 22770 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:37:55.906877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-53f57745-93e4-48d7-be47-ae993af3f5ae tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:55.914181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-53f57745-93e4-48d7-be47-ae993af3f5ae tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:55.936768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53f57745-93e4-48d7-be47-ae993af3f5ae tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:55.937594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53f57745-93e4-48d7-be47-ae993af3f5ae tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:55.938226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53f57745-93e4-48d7-be47-ae993af3f5ae tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:55.938930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53f57745-93e4-48d7-be47-ae993af3f5ae tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:55.942702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53f57745-93e4-48d7-be47-ae993af3f5ae tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:55.943499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53f57745-93e4-48d7-be47-ae993af3f5ae tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:56.059755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d1144781-e550-4b23-8d4c-64cb47d7a370 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31aa283446d4db0bda4679cc10eb277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0f597febb44249ab111c4c2978c39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:56.071287 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d1144781-e550-4b23-8d4c-64cb47d7a370 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 200 len: 1317 microversion: 2.1 time: 0.443662 Aug 09 14:37:56.076160 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 965/1942] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:55 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:56.089562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-478e3ecd-2bea-48dc-acd1-caded2a836a7 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:56.090380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-478e3ecd-2bea-48dc-acd1-caded2a836a7 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:56.105778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-478e3ecd-2bea-48dc-acd1-caded2a836a7 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:56.108660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-478e3ecd-2bea-48dc-acd1-caded2a836a7 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:56.112922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-478e3ecd-2bea-48dc-acd1-caded2a836a7 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:56.114968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-478e3ecd-2bea-48dc-acd1-caded2a836a7 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:56.118039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-478e3ecd-2bea-48dc-acd1-caded2a836a7 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:56.119347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-478e3ecd-2bea-48dc-acd1-caded2a836a7 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:56.120547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-53f57745-93e4-48d7-be47-ae993af3f5ae tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:56.131267 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-53f57745-93e4-48d7-be47-ae993af3f5ae tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1276 microversion: 2.1 time: 0.238446 Aug 09 14:37:56.144075 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 978/1943] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:55 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1276 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:56.150278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d65464eb-c99e-4a32-8ad8-61507823ddd4 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:56.159898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d65464eb-c99e-4a32-8ad8-61507823ddd4 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Searching by: {'deleted': False, 'project_id': 'a943e057d55d4f01af7fa2367739cfad'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:37:56.165066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-478e3ecd-2bea-48dc-acd1-caded2a836a7 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:37:56.183741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d65464eb-c99e-4a32-8ad8-61507823ddd4 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:56.184239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d65464eb-c99e-4a32-8ad8-61507823ddd4 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:56.184743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d65464eb-c99e-4a32-8ad8-61507823ddd4 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:56.189079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d65464eb-c99e-4a32-8ad8-61507823ddd4 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:56.189562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d65464eb-c99e-4a32-8ad8-61507823ddd4 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:56.189994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d65464eb-c99e-4a32-8ad8-61507823ddd4 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:56.314832 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-478e3ecd-2bea-48dc-acd1-caded2a836a7 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 204 len: 0 microversion: 2.1 time: 0.236968 Aug 09 14:37:56.316386 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 966/1944] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:37:56 2022] DELETE /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:37:56.331342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-26d6d884-8dc9-4693-8267-c69c31c88bea tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:56.332640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-26d6d884-8dc9-4693-8267-c69c31c88bea tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:56.344922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26d6d884-8dc9-4693-8267-c69c31c88bea tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:56.345735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26d6d884-8dc9-4693-8267-c69c31c88bea tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:56.346616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26d6d884-8dc9-4693-8267-c69c31c88bea tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:56.347846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26d6d884-8dc9-4693-8267-c69c31c88bea tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:56.348648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26d6d884-8dc9-4693-8267-c69c31c88bea tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:56.349439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26d6d884-8dc9-4693-8267-c69c31c88bea tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:56.439144 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d65464eb-c99e-4a32-8ad8-61507823ddd4 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?tenant_id=27e653d20943429d8c845d3c9a61f7d8" status: 200 len: 15 microversion: 2.1 time: 0.293411 Aug 09 14:37:56.440089 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 979/1945] 10.222.0.50 () {58 vars in 1231 bytes} [Tue Aug 9 14:37:56 2022] GET /compute/v2.1/servers/detail?tenant_id=27e653d20943429d8c845d3c9a61f7d8 => generated 15 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:37:56.462985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:56.499782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Searching by: {'tenant_id': '27e653d20943429d8c845d3c9a61f7d8', 'deleted': False} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:37:56.514087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:56.516160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:56.517513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:56.520185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:56.522551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:56.524548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:56.606907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:37:56.726150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-26d6d884-8dc9-4693-8267-c69c31c88bea tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:56.735562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:56.737553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:56.738977 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-26d6d884-8dc9-4693-8267-c69c31c88bea tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1674 microversion: 2.1 time: 0.417658 Aug 09 14:37:56.739738 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 967/1946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:56 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1674 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:56.740017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:56.758221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-292a289b-7689-4c48-869c-63e284442563 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:56.761636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-292a289b-7689-4c48-869c-63e284442563 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:56.775996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292a289b-7689-4c48-869c-63e284442563 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:56.777618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292a289b-7689-4c48-869c-63e284442563 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:56.778477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292a289b-7689-4c48-869c-63e284442563 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:56.783687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292a289b-7689-4c48-869c-63e284442563 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:56.784491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292a289b-7689-4c48-869c-63e284442563 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:56.785078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292a289b-7689-4c48-869c-63e284442563 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.139151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-292a289b-7689-4c48-869c-63e284442563 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:57.141700 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37dd6314-b161-4225-ac33-4997e0f4c358 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=27e653d20943429d8c845d3c9a61f7d8" status: 200 len: 4823 microversion: 2.1 time: 0.684186 Aug 09 14:37:57.142864 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 980/1947] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 9 14:37:56 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=27e653d20943429d8c845d3c9a61f7d8 => generated 4823 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:37:57.157105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df5bb015-62b7-4598-a25a-9b4e542e3087 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:57.158034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df5bb015-62b7-4598-a25a-9b4e542e3087 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:57.167298 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-292a289b-7689-4c48-869c-63e284442563 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1199 microversion: 2.1 time: 0.412824 Aug 09 14:37:57.168265 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 968/1948] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:56 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1199 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:57.177960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df5bb015-62b7-4598-a25a-9b4e542e3087 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.177960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df5bb015-62b7-4598-a25a-9b4e542e3087 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.179160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df5bb015-62b7-4598-a25a-9b4e542e3087 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.180373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df5bb015-62b7-4598-a25a-9b4e542e3087 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.181210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df5bb015-62b7-4598-a25a-9b4e542e3087 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.182576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df5bb015-62b7-4598-a25a-9b4e542e3087 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.188131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3874ec76-ebff-4796-8028-d27494791352 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:57.190503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3874ec76-ebff-4796-8028-d27494791352 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:57.194019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:57.198643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3874ec76-ebff-4796-8028-d27494791352 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.199624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3874ec76-ebff-4796-8028-d27494791352 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.200748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3874ec76-ebff-4796-8028-d27494791352 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.201942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3874ec76-ebff-4796-8028-d27494791352 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.202639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3874ec76-ebff-4796-8028-d27494791352 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.203312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3874ec76-ebff-4796-8028-d27494791352 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.309134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3874ec76-ebff-4796-8028-d27494791352 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:57.321475 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3874ec76-ebff-4796-8028-d27494791352 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1282 microversion: 2.1 time: 0.140197 Aug 09 14:37:57.325941 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 969/1949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:57 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1282 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:57.342914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e5b83db-5308-42a4-a93a-0fafa4a6b2b5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:57.362987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e5b83db-5308-42a4-a93a-0fafa4a6b2b5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Searching by: {'tenant_id': 'a943e057d55d4f01af7fa2367739cfad', 'deleted': False} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:37:57.377374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5b83db-5308-42a4-a93a-0fafa4a6b2b5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.377988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5b83db-5308-42a4-a93a-0fafa4a6b2b5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.379436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5b83db-5308-42a4-a93a-0fafa4a6b2b5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.380713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5b83db-5308-42a4-a93a-0fafa4a6b2b5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.381416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5b83db-5308-42a4-a93a-0fafa4a6b2b5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.382071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e5b83db-5308-42a4-a93a-0fafa4a6b2b5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.416134 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e5b83db-5308-42a4-a93a-0fafa4a6b2b5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a943e057d55d4f01af7fa2367739cfad" status: 200 len: 15 microversion: 2.1 time: 0.085461 Aug 09 14:37:57.429825 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 970/1950] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 9 14:37:57 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a943e057d55d4f01af7fa2367739cfad => generated 15 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:37:57.449503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f290c815-d48a-4013-bce4-17d6b38ffc42 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:57.458239 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f290c815-d48a-4013-bce4-17d6b38ffc42 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.015061 Aug 09 14:37:57.471117 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 971/1951] 10.222.0.50 () {58 vars in 1189 bytes} [Tue Aug 9 14:37:57 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:37:57.484379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c3d1ac14-32cf-491c-bc47-a5b9caf67b2b tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:57.497253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-df5bb015-62b7-4598-a25a-9b4e542e3087 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31aa283446d4db0bda4679cc10eb277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0f597febb44249ab111c4c2978c39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:57.498533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c3d1ac14-32cf-491c-bc47-a5b9caf67b2b tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:57.506955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3d1ac14-32cf-491c-bc47-a5b9caf67b2b tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.507588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3d1ac14-32cf-491c-bc47-a5b9caf67b2b tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.508018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3d1ac14-32cf-491c-bc47-a5b9caf67b2b tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.508738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3d1ac14-32cf-491c-bc47-a5b9caf67b2b tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.509186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3d1ac14-32cf-491c-bc47-a5b9caf67b2b tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.509600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3d1ac14-32cf-491c-bc47-a5b9caf67b2b tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.511878 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df5bb015-62b7-4598-a25a-9b4e542e3087 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 200 len: 1505 microversion: 2.1 time: 0.367211 Aug 09 14:37:57.528021 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 981/1952] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:57 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:57.537599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a6bcad3d-7024-424a-9ba2-ea140bd06a61 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:57.538465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a6bcad3d-7024-424a-9ba2-ea140bd06a61 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:57.545289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6bcad3d-7024-424a-9ba2-ea140bd06a61 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.546721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6bcad3d-7024-424a-9ba2-ea140bd06a61 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.547427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6bcad3d-7024-424a-9ba2-ea140bd06a61 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.548348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6bcad3d-7024-424a-9ba2-ea140bd06a61 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.549001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6bcad3d-7024-424a-9ba2-ea140bd06a61 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.549625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6bcad3d-7024-424a-9ba2-ea140bd06a61 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.575633 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a6bcad3d-7024-424a-9ba2-ea140bd06a61 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941/ips" status: 200 len: 108 microversion: 2.1 time: 0.042619 Aug 09 14:37:57.584472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:37:57.585645 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 982/1953] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:37:57 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941/ips => generated 108 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:37:57.591286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8ed1d52f-69f2-463e-b749-f3f93c68b743 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:57.592104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8ed1d52f-69f2-463e-b749-f3f93c68b743 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:57.598857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ed1d52f-69f2-463e-b749-f3f93c68b743 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.599663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ed1d52f-69f2-463e-b749-f3f93c68b743 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.600547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ed1d52f-69f2-463e-b749-f3f93c68b743 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.601489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ed1d52f-69f2-463e-b749-f3f93c68b743 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.602150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ed1d52f-69f2-463e-b749-f3f93c68b743 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.603057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ed1d52f-69f2-463e-b749-f3f93c68b743 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.654009 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8ed1d52f-69f2-463e-b749-f3f93c68b743 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941/ips" status: 200 len: 108 microversion: 2.1 time: 0.066757 Aug 09 14:37:57.666790 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 983/1954] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:37:57 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941/ips => generated 108 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:57.667050 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c3d1ac14-32cf-491c-bc47-a5b9caf67b2b tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action" status: 202 len: 0 microversion: 2.1 time: 0.177376 Aug 09 14:37:57.667050 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 972/1955] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:37:57 2022] POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:37:57.679717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-56b955f0-25dd-4fb8-8557-e56411109a03 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:57.681959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cf044196-c3f6-4750-9a68-8b2e8725a31d tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:57.682465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cf044196-c3f6-4750-9a68-8b2e8725a31d tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:57.690203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-56b955f0-25dd-4fb8-8557-e56411109a03 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:57.690940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-56b955f0-25dd-4fb8-8557-e56411109a03 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '27e653d20943429d8c845d3c9a61f7d8'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:37:57.698667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf044196-c3f6-4750-9a68-8b2e8725a31d tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.699178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf044196-c3f6-4750-9a68-8b2e8725a31d tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.699613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf044196-c3f6-4750-9a68-8b2e8725a31d tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.701683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf044196-c3f6-4750-9a68-8b2e8725a31d tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.703844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf044196-c3f6-4750-9a68-8b2e8725a31d tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.705498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cf044196-c3f6-4750-9a68-8b2e8725a31d tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.707342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56b955f0-25dd-4fb8-8557-e56411109a03 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.707856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56b955f0-25dd-4fb8-8557-e56411109a03 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.708285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56b955f0-25dd-4fb8-8557-e56411109a03 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.710120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56b955f0-25dd-4fb8-8557-e56411109a03 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.710580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56b955f0-25dd-4fb8-8557-e56411109a03 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.711001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56b955f0-25dd-4fb8-8557-e56411109a03 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.767229 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cf044196-c3f6-4750-9a68-8b2e8725a31d tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941/ips/tempest-ServerAddressesTestJSON-620666230-network" status: 200 len: 93 microversion: 2.1 time: 0.093625 Aug 09 14:37:57.774450 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 973/1956] 10.222.0.50 () {58 vars in 1398 bytes} [Tue Aug 9 14:37:57 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941/ips/tempest-ServerAddressesTestJSON-620666230-network => generated 93 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:37:57.783627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2038813429", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "81aaa2b1-5362-4182-9406-b54bfbcbf2bf"}], "security_groups": [{"name": "tempest-securitygroup--593390925"}], "key_name": "tempest-keypair-1490370686", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:57.801039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-56b955f0-25dd-4fb8-8557-e56411109a03 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:37:57.875104 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-56b955f0-25dd-4fb8-8557-e56411109a03 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.210284 Aug 09 14:37:57.875716 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 984/1957] 10.222.0.50 () {58 vars in 1150 bytes} [Tue Aug 9 14:37:57 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:37:57.880556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2da02daa-d371-4edc-9bdc-857c2a25a69d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:57.881163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2da02daa-d371-4edc-9bdc-857c2a25a69d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:57.894321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2da02daa-d371-4edc-9bdc-857c2a25a69d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.894975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2da02daa-d371-4edc-9bdc-857c2a25a69d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.895527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2da02daa-d371-4edc-9bdc-857c2a25a69d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.896406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2da02daa-d371-4edc-9bdc-857c2a25a69d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:57.896972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2da02daa-d371-4edc-9bdc-857c2a25a69d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:57.897488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2da02daa-d371-4edc-9bdc-857c2a25a69d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:57.942015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] validate_networks() for [('81aaa2b1-5362-4182-9406-b54bfbcbf2bf', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:37:58.586969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:37:58.587561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:37:58.588138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:37:58.588679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:37:58.589340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:37:58.606902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:58.607815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:58.612813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:58.614004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:58.614688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:58.615642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:58.665780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2da02daa-d371-4edc-9bdc-857c2a25a69d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:58.677560 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2da02daa-d371-4edc-9bdc-857c2a25a69d tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1674 microversion: 2.1 time: 0.800740 Aug 09 14:37:58.678987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Getting quotas for project ec96cdb5ea0f42c6ad2044517c6dbffa. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:37:58.679948 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 985/1958] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:57 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1674 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:58.692406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ef88fb7-79c1-451b-a7b0-21119848a5ac tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:58.693076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0ef88fb7-79c1-451b-a7b0-21119848a5ac tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:58.699433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Getting quotas for user 68639dd3894d4af7a49f3ffee8beb889 and project ec96cdb5ea0f42c6ad2044517c6dbffa. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:37:58.712608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ef88fb7-79c1-451b-a7b0-21119848a5ac tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:58.713241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ef88fb7-79c1-451b-a7b0-21119848a5ac tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:58.713786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ef88fb7-79c1-451b-a7b0-21119848a5ac tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:58.718108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ef88fb7-79c1-451b-a7b0-21119848a5ac tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:58.718725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ef88fb7-79c1-451b-a7b0-21119848a5ac tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:58.720879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ef88fb7-79c1-451b-a7b0-21119848a5ac tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:58.729136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:37:58.741043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:37:58.786937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0ef88fb7-79c1-451b-a7b0-21119848a5ac tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:37:58.872018 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2a7afd9e-9b6a-480e-a7d4-c0808d4ba218 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.096966 Aug 09 14:37:58.872606 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 974/1959] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:37:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:37:58.908837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99603460-830c-4a32-bc1b-034c70ccd8f9 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:37:58.916755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-99603460-830c-4a32-bc1b-034c70ccd8f9 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:58.952182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99603460-830c-4a32-bc1b-034c70ccd8f9 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:58.954956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99603460-830c-4a32-bc1b-034c70ccd8f9 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:58.955423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99603460-830c-4a32-bc1b-034c70ccd8f9 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:58.959424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99603460-830c-4a32-bc1b-034c70ccd8f9 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:58.959966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99603460-830c-4a32-bc1b-034c70ccd8f9 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:58.960404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99603460-830c-4a32-bc1b-034c70ccd8f9 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:59.043975 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0ef88fb7-79c1-451b-a7b0-21119848a5ac tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 204 len: 0 microversion: 2.1 time: 0.362061 Aug 09 14:37:59.044705 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 986/1960] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:37:58 2022] DELETE /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:37:59.056377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-931bcf62-df93-475f-b410-21aa5e904247 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:59.058720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-931bcf62-df93-475f-b410-21aa5e904247 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:59.074255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-931bcf62-df93-475f-b410-21aa5e904247 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:59.074768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-931bcf62-df93-475f-b410-21aa5e904247 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:59.077692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-931bcf62-df93-475f-b410-21aa5e904247 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:59.081941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-931bcf62-df93-475f-b410-21aa5e904247 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:59.082458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-931bcf62-df93-475f-b410-21aa5e904247 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:59.082910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-931bcf62-df93-475f-b410-21aa5e904247 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:59.200684 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-99603460-830c-4a32-bc1b-034c70ccd8f9 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action" status: 202 len: 0 microversion: 2.1 time: 0.308211 Aug 09 14:37:59.201854 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 975/1961] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:37:58 2022] POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:37:59.212307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6adc0939-1b44-406a-a0b5-02fa9afac2b9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:59.213000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6adc0939-1b44-406a-a0b5-02fa9afac2b9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:59.229938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6adc0939-1b44-406a-a0b5-02fa9afac2b9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:59.231152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6adc0939-1b44-406a-a0b5-02fa9afac2b9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:59.234167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6adc0939-1b44-406a-a0b5-02fa9afac2b9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:59.235586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6adc0939-1b44-406a-a0b5-02fa9afac2b9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:59.236215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6adc0939-1b44-406a-a0b5-02fa9afac2b9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:59.237861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6adc0939-1b44-406a-a0b5-02fa9afac2b9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:59.484809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-931bcf62-df93-475f-b410-21aa5e904247 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:59.499066 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-931bcf62-df93-475f-b410-21aa5e904247 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1199 microversion: 2.1 time: 0.453070 Aug 09 14:37:59.500035 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 987/1962] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:59 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1199 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:59.513825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-52402a92-276b-4dce-a3ae-8052acd625a0 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:59.514448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-52402a92-276b-4dce-a3ae-8052acd625a0 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:59.717884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-52402a92-276b-4dce-a3ae-8052acd625a0 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:37:59.730450 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-52402a92-276b-4dce-a3ae-8052acd625a0 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1242 microversion: 2.1 time: 0.229155 Aug 09 14:37:59.731562 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 988/1963] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:59 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1242 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:37:59.741916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8a3f519a-a8b7-4b92-8eea-cb419cb3625f tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:37:59.744608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8a3f519a-a8b7-4b92-8eea-cb419cb3625f tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:37:59.769452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a3f519a-a8b7-4b92-8eea-cb419cb3625f tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:59.770176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a3f519a-a8b7-4b92-8eea-cb419cb3625f tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:59.779500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a3f519a-a8b7-4b92-8eea-cb419cb3625f tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:37:59.781127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a3f519a-a8b7-4b92-8eea-cb419cb3625f tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:37:59.782996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a3f519a-a8b7-4b92-8eea-cb419cb3625f tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:37:59.799466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a3f519a-a8b7-4b92-8eea-cb419cb3625f tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:00.125937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6adc0939-1b44-406a-a0b5-02fa9afac2b9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:00.141451 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6adc0939-1b44-406a-a0b5-02fa9afac2b9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1324 microversion: 2.1 time: 0.937204 Aug 09 14:38:00.143897 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 976/1964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:59 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1324 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:00.158537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a6b3c62-672c-4c3c-a23f-64c49c053f5a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:00.159067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5a6b3c62-672c-4c3c-a23f-64c49c053f5a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:00.218773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a6b3c62-672c-4c3c-a23f-64c49c053f5a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:00.219394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a6b3c62-672c-4c3c-a23f-64c49c053f5a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:00.219841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a6b3c62-672c-4c3c-a23f-64c49c053f5a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:00.235349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a6b3c62-672c-4c3c-a23f-64c49c053f5a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:00.245508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a6b3c62-672c-4c3c-a23f-64c49c053f5a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:00.246222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a6b3c62-672c-4c3c-a23f-64c49c053f5a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:00.668701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8a3f519a-a8b7-4b92-8eea-cb419cb3625f tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31aa283446d4db0bda4679cc10eb277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0f597febb44249ab111c4c2978c39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:00.683794 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8a3f519a-a8b7-4b92-8eea-cb419cb3625f tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 200 len: 1511 microversion: 2.1 time: 0.951117 Aug 09 14:38:00.685059 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 989/1965] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:37:59 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 1511 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:00.690245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-201012bf-a998-4a51-8ca6-e6fc5b676baa tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:00.691096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-201012bf-a998-4a51-8ca6-e6fc5b676baa tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:00.697595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201012bf-a998-4a51-8ca6-e6fc5b676baa tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:00.698695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201012bf-a998-4a51-8ca6-e6fc5b676baa tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:00.699577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201012bf-a998-4a51-8ca6-e6fc5b676baa tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:00.700557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201012bf-a998-4a51-8ca6-e6fc5b676baa tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:00.701176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201012bf-a998-4a51-8ca6-e6fc5b676baa tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:00.701739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201012bf-a998-4a51-8ca6-e6fc5b676baa tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:00.978153 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5a6b3c62-672c-4c3c-a23f-64c49c053f5a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1614 microversion: 2.1 time: 0.831501 Aug 09 14:38:00.995807 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 977/1966] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:00 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1614 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:01.009752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-2e98df9c-9f13-4564-a1a1-067488a37c31 req-dc80cfba-0d7a-4050-8877-4c3089999a14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d615dd5-c0ab-4d52-946b-7773c9605ac7", "name": "network-vif-deleted", "tag": "f86d7401-99bd-4bda-9d44-57e788fd6714"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:01.037607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2e98df9c-9f13-4564-a1a1-067488a37c31 req-dc80cfba-0d7a-4050-8877-4c3089999a14 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:01.038466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2e98df9c-9f13-4564-a1a1-067488a37c31 req-dc80cfba-0d7a-4050-8877-4c3089999a14 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:01.044301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2e98df9c-9f13-4564-a1a1-067488a37c31 req-dc80cfba-0d7a-4050-8877-4c3089999a14 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:01.054189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-201012bf-a998-4a51-8ca6-e6fc5b676baa tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00f1751674ba4df68ea6905988cd6510', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54de373a9e684301905608f195bb56b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:01.070614 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-201012bf-a998-4a51-8ca6-e6fc5b676baa tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 200 len: 1653 microversion: 2.1 time: 0.384216 Aug 09 14:38:01.076209 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 990/1967] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:00 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 1653 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:01.080036 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-2e98df9c-9f13-4564-a1a1-067488a37c31 req-dc80cfba-0d7a-4050-8877-4c3089999a14 service nova] Creating event network-vif-deleted:f86d7401-99bd-4bda-9d44-57e788fd6714 for instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 on n-h1-844626-8 Aug 09 14:38:01.085513 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-2e98df9c-9f13-4564-a1a1-067488a37c31 req-dc80cfba-0d7a-4050-8877-4c3089999a14 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087877 Aug 09 14:38:01.086724 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 978/1968] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:01.092509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-db393609-d146-4050-a0c7-6795ff3d0d71 req-18da8658-b22f-4854-a0b0-8b79974bf804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46aa8418-3f46-4f90-bb08-763d20055e1c", "tag": "d159e2a0-cd63-4b05-83ad-effb48febb0c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:01.113656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-db393609-d146-4050-a0c7-6795ff3d0d71 req-18da8658-b22f-4854-a0b0-8b79974bf804 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:01.116938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3beb1488-cd97-4a22-ac66-6404c6ebfdb1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:01.119382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3beb1488-cd97-4a22-ac66-6404c6ebfdb1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:01.121419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-db393609-d146-4050-a0c7-6795ff3d0d71 req-18da8658-b22f-4854-a0b0-8b79974bf804 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:01.124059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-db393609-d146-4050-a0c7-6795ff3d0d71 req-18da8658-b22f-4854-a0b0-8b79974bf804 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:01.138001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3beb1488-cd97-4a22-ac66-6404c6ebfdb1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:01.152724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3beb1488-cd97-4a22-ac66-6404c6ebfdb1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:01.153550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3beb1488-cd97-4a22-ac66-6404c6ebfdb1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:01.154458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3beb1488-cd97-4a22-ac66-6404c6ebfdb1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:01.156904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3beb1488-cd97-4a22-ac66-6404c6ebfdb1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:01.157702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3beb1488-cd97-4a22-ac66-6404c6ebfdb1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:01.168839 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-db393609-d146-4050-a0c7-6795ff3d0d71 req-18da8658-b22f-4854-a0b0-8b79974bf804 service nova] Creating event network-changed:d159e2a0-cd63-4b05-83ad-effb48febb0c for instance 46aa8418-3f46-4f90-bb08-763d20055e1c on n-h2-844626-8 Aug 09 14:38:01.183959 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-db393609-d146-4050-a0c7-6795ff3d0d71 req-18da8658-b22f-4854-a0b0-8b79974bf804 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106234 Aug 09 14:38:01.197641 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 991/1969] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:01.206756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1a674f6b-81d9-420b-a929-98ef49073739 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:01.211752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1a674f6b-81d9-420b-a929-98ef49073739 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:01.225701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a674f6b-81d9-420b-a929-98ef49073739 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:01.226282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a674f6b-81d9-420b-a929-98ef49073739 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:01.227422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a674f6b-81d9-420b-a929-98ef49073739 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:01.231866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a674f6b-81d9-420b-a929-98ef49073739 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:01.232431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a674f6b-81d9-420b-a929-98ef49073739 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:01.232930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a674f6b-81d9-420b-a929-98ef49073739 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:01.579939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1a674f6b-81d9-420b-a929-98ef49073739 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:01.588898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:01.593929 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1a674f6b-81d9-420b-a929-98ef49073739 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1312 microversion: 2.1 time: 0.393523 Aug 09 14:38:01.596693 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 992/1970] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:01 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:01.614515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9c2d98f9-dcf9-4eee-8045-8d58fcf73f9a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:01.615464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9c2d98f9-dcf9-4eee-8045-8d58fcf73f9a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:01.623279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c2d98f9-dcf9-4eee-8045-8d58fcf73f9a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:01.624034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c2d98f9-dcf9-4eee-8045-8d58fcf73f9a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:01.624653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c2d98f9-dcf9-4eee-8045-8d58fcf73f9a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:01.625547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c2d98f9-dcf9-4eee-8045-8d58fcf73f9a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:01.626340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c2d98f9-dcf9-4eee-8045-8d58fcf73f9a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:01.635361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c2d98f9-dcf9-4eee-8045-8d58fcf73f9a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:01.710784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3beb1488-cd97-4a22-ac66-6404c6ebfdb1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:01.722754 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3beb1488-cd97-4a22-ac66-6404c6ebfdb1 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1199 microversion: 2.1 time: 0.634612 Aug 09 14:38:01.725255 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 979/1971] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:01 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1199 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:01.742169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e6efc4d-cf6e-4ef1-b5ff-2e8ab60e4f53 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:01.743035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e6efc4d-cf6e-4ef1-b5ff-2e8ab60e4f53 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:01.776121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e6efc4d-cf6e-4ef1-b5ff-2e8ab60e4f53 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:01.776644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e6efc4d-cf6e-4ef1-b5ff-2e8ab60e4f53 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:01.777085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e6efc4d-cf6e-4ef1-b5ff-2e8ab60e4f53 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:01.777833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e6efc4d-cf6e-4ef1-b5ff-2e8ab60e4f53 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:01.778500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e6efc4d-cf6e-4ef1-b5ff-2e8ab60e4f53 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:01.778936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e6efc4d-cf6e-4ef1-b5ff-2e8ab60e4f53 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:02.728899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1e6efc4d-cf6e-4ef1-b5ff-2e8ab60e4f53 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:02.739630 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e6efc4d-cf6e-4ef1-b5ff-2e8ab60e4f53 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1324 microversion: 2.1 time: 1.012494 Aug 09 14:38:02.752028 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 980/1972] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:01 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1324 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:02.760813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01708c88-d3ea-4b4b-aeb8-8031ccb25fa3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:02.761647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01708c88-d3ea-4b4b-aeb8-8031ccb25fa3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:02.774562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01708c88-d3ea-4b4b-aeb8-8031ccb25fa3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:02.777068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01708c88-d3ea-4b4b-aeb8-8031ccb25fa3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:02.777733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01708c88-d3ea-4b4b-aeb8-8031ccb25fa3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:02.784617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01708c88-d3ea-4b4b-aeb8-8031ccb25fa3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:02.784966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01708c88-d3ea-4b4b-aeb8-8031ccb25fa3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:02.785670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01708c88-d3ea-4b4b-aeb8-8031ccb25fa3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:02.824725 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9c2d98f9-dcf9-4eee-8045-8d58fcf73f9a tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1614 microversion: 2.1 time: 1.222537 Aug 09 14:38:02.825362 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 993/1973] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:01 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1614 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:02.839394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-963c3356-1135-42e0-aa66-d15858dd13bf tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:02.839394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-963c3356-1135-42e0-aa66-d15858dd13bf tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:02.846206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-963c3356-1135-42e0-aa66-d15858dd13bf tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:02.846692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-963c3356-1135-42e0-aa66-d15858dd13bf tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:02.847314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-963c3356-1135-42e0-aa66-d15858dd13bf tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:02.848127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01708c88-d3ea-4b4b-aeb8-8031ccb25fa3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:38:02.848288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-963c3356-1135-42e0-aa66-d15858dd13bf tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:02.849234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-963c3356-1135-42e0-aa66-d15858dd13bf tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:02.849728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-963c3356-1135-42e0-aa66-d15858dd13bf tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:02.985918 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01708c88-d3ea-4b4b-aeb8-8031ccb25fa3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "DELETE /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 204 len: 0 microversion: 2.25 time: 0.229693 Aug 09 14:38:02.986891 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 981/1974] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:38:02 2022] DELETE /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:38:02.996119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40e61fb4-8b90-484b-a63e-b3eea3dde115 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:02.997212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40e61fb4-8b90-484b-a63e-b3eea3dde115 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:03.009266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e61fb4-8b90-484b-a63e-b3eea3dde115 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.010476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e61fb4-8b90-484b-a63e-b3eea3dde115 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.011334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e61fb4-8b90-484b-a63e-b3eea3dde115 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.012738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e61fb4-8b90-484b-a63e-b3eea3dde115 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.013411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e61fb4-8b90-484b-a63e-b3eea3dde115 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.014034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40e61fb4-8b90-484b-a63e-b3eea3dde115 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.029274 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-40e61fb4-8b90-484b-a63e-b3eea3dde115 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] HTTP exception thrown: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40e61fb4-8b90-484b-a63e-b3eea3dde115 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Request method failure captured: Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 HTTP/1.1 Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nDQMJZd9DU-CMdNEpzJ7lwOlKu96UlsmbXN476U2zkuRmVW-1byUjrtijYC5h5gF3kNQzRNwU52_L8ENTPaiSz-nxM0C0nH6d-swsQy4EkVE26FV8yPiUxAAxo_i-D11nZGj8s5KPLxpCC9VWEyfk64LkyHoMA2SPtSzOnnH5aZ_x4 Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 54de373a9e684301905608f195bb56b9 Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_54de373a9e684301905608f195bb56b9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/54de373a9e684301905608f195bb56b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54de373a9e684301905608f195bb56b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54de373a9e684301905608f195bb56b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 54de373a9e684301905608f195bb56b9 Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestMultiNic-2131063812-project Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 00f1751674ba4df68ea6905988cd6510 Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestMultiNic-2131063812-project Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '4d615dd5-c0ab-4d52-946b-7773c9605ac7'} Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:03.032646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:03.037556 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:03.037556 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:03.037556 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:03.037556 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:03.037556 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:03.037556 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:03.037556 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:03.040872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40e61fb4-8b90-484b-a63e-b3eea3dde115 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Returning 404 to user: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:03.042069 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40e61fb4-8b90-484b-a63e-b3eea3dde115 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 404 len: 111 microversion: 2.1 time: 0.053871 Aug 09 14:38:03.043350 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 982/1975] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:02 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:38:03.049107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4878e858-1a42-434e-adaf-47e94d5e983d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:03.050320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4878e858-1a42-434e-adaf-47e94d5e983d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:03.057261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-963c3356-1135-42e0-aa66-d15858dd13bf tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31aa283446d4db0bda4679cc10eb277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0f597febb44249ab111c4c2978c39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:03.068247 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-963c3356-1135-42e0-aa66-d15858dd13bf tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 200 len: 1469 microversion: 2.1 time: 0.241712 Aug 09 14:38:03.085323 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 994/1976] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:02 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 1469 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:03.085832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4878e858-1a42-434e-adaf-47e94d5e983d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.085832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4878e858-1a42-434e-adaf-47e94d5e983d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.085832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4878e858-1a42-434e-adaf-47e94d5e983d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.085832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4878e858-1a42-434e-adaf-47e94d5e983d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.085832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4878e858-1a42-434e-adaf-47e94d5e983d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.085832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4878e858-1a42-434e-adaf-47e94d5e983d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.089430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-caa72714-ef93-47d9-bd67-8a272935c997 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:03.090048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-caa72714-ef93-47d9-bd67-8a272935c997 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:03.105672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caa72714-ef93-47d9-bd67-8a272935c997 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.106662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caa72714-ef93-47d9-bd67-8a272935c997 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.107630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caa72714-ef93-47d9-bd67-8a272935c997 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.108605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caa72714-ef93-47d9-bd67-8a272935c997 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.109300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caa72714-ef93-47d9-bd67-8a272935c997 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.109944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caa72714-ef93-47d9-bd67-8a272935c997 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.373082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4878e858-1a42-434e-adaf-47e94d5e983d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:03.381835 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4878e858-1a42-434e-adaf-47e94d5e983d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1367 microversion: 2.1 time: 0.336780 Aug 09 14:38:03.382409 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 983/1977] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:03 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:03.387568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-10cbb962-58dd-4e6b-b4e5-4700526cd9ca tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:03.393914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-caa72714-ef93-47d9-bd67-8a272935c997 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:03.395455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-10cbb962-58dd-4e6b-b4e5-4700526cd9ca tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Searching by: {'host': 'n-h1-844626-8', 'deleted': False} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:38:03.402691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10cbb962-58dd-4e6b-b4e5-4700526cd9ca tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.403509 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-caa72714-ef93-47d9-bd67-8a272935c997 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1199 microversion: 2.1 time: 0.322930 Aug 09 14:38:03.403664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10cbb962-58dd-4e6b-b4e5-4700526cd9ca tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.404164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10cbb962-58dd-4e6b-b4e5-4700526cd9ca tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.404787 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 995/1978] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:03 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1199 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:03.404933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10cbb962-58dd-4e6b-b4e5-4700526cd9ca tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.405312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10cbb962-58dd-4e6b-b4e5-4700526cd9ca tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.405711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10cbb962-58dd-4e6b-b4e5-4700526cd9ca tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.409671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a65b2a9a-8cb5-4288-ad10-41e875bfc5d3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:03.410490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a65b2a9a-8cb5-4288-ad10-41e875bfc5d3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:03.436662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a65b2a9a-8cb5-4288-ad10-41e875bfc5d3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.437551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a65b2a9a-8cb5-4288-ad10-41e875bfc5d3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.438161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a65b2a9a-8cb5-4288-ad10-41e875bfc5d3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.439279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a65b2a9a-8cb5-4288-ad10-41e875bfc5d3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.439901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a65b2a9a-8cb5-4288-ad10-41e875bfc5d3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.442666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a65b2a9a-8cb5-4288-ad10-41e875bfc5d3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.635458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-10cbb962-58dd-4e6b-b4e5-4700526cd9ca tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:38:03.741463 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-10cbb962-58dd-4e6b-b4e5-4700526cd9ca tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "GET /compute/v2.1/servers?host=n-h1-844626-8&all_tenants=1" status: 200 len: 1968 microversion: 2.1 time: 0.357553 Aug 09 14:38:03.742185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a65b2a9a-8cb5-4288-ad10-41e875bfc5d3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:03.747372 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 984/1979] 10.222.0.50 () {58 vars in 1190 bytes} [Tue Aug 9 14:38:03 2022] GET /compute/v2.1/servers?host=n-h1-844626-8&all_tenants=1 => generated 1968 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:03.747547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0cb6aaa7-3c64-4601-9260-6d6e36467fb5 req-c65eaa39-10a8-4781-84b1-b382be9d615e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d615dd5-c0ab-4d52-946b-7773c9605ac7", "name": "network-vif-deleted", "tag": "73754091-7b0d-4b6b-a529-2d3bfb2eeb3f"}, {"server_uuid": "1a37cd4a-5a1b-4991-a1d1-fc67d7b68941", "name": "network-vif-deleted", "tag": "d91969e1-e6a2-4d1a-9db3-fa4934ddc34c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:03.762604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0cb6aaa7-3c64-4601-9260-6d6e36467fb5 req-c65eaa39-10a8-4781-84b1-b382be9d615e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.763188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a65b2a9a-8cb5-4288-ad10-41e875bfc5d3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:03.763759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0cb6aaa7-3c64-4601-9260-6d6e36467fb5 req-c65eaa39-10a8-4781-84b1-b382be9d615e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.764464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0cb6aaa7-3c64-4601-9260-6d6e36467fb5 req-c65eaa39-10a8-4781-84b1-b382be9d615e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.770193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a65b2a9a-8cb5-4288-ad10-41e875bfc5d3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:03.771762 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a65b2a9a-8cb5-4288-ad10-41e875bfc5d3 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1732 microversion: 2.25 time: 0.366053 Aug 09 14:38:03.773499 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 996/1980] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:38:03 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1732 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:38:03.778164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0450a64c-39f0-4b8c-a51f-2f56be070d89 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:03.794939 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0cb6aaa7-3c64-4601-9260-6d6e36467fb5 req-c65eaa39-10a8-4781-84b1-b382be9d615e service nova] Creating event network-vif-deleted:73754091-7b0d-4b6b-a529-2d3bfb2eeb3f for instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 on n-h1-844626-8 Aug 09 14:38:03.797324 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0cb6aaa7-3c64-4601-9260-6d6e36467fb5 req-c65eaa39-10a8-4781-84b1-b382be9d615e service nova] Creating event network-vif-deleted:d91969e1-e6a2-4d1a-9db3-fa4934ddc34c for instance 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 on n-h2-844626-8 Aug 09 14:38:03.798576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0450a64c-39f0-4b8c-a51f-2f56be070d89 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:38:03.814361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0450a64c-39f0-4b8c-a51f-2f56be070d89 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.815401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0450a64c-39f0-4b8c-a51f-2f56be070d89 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.816248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0450a64c-39f0-4b8c-a51f-2f56be070d89 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.817317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0450a64c-39f0-4b8c-a51f-2f56be070d89 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.818099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0450a64c-39f0-4b8c-a51f-2f56be070d89 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.818598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0450a64c-39f0-4b8c-a51f-2f56be070d89 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.823762 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0cb6aaa7-3c64-4601-9260-6d6e36467fb5 req-c65eaa39-10a8-4781-84b1-b382be9d615e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079328 Aug 09 14:38:03.824773 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 985/1981] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:03.830648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2be2bb12-f119-42fe-bee8-6b15de314f28 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:03.831705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2be2bb12-f119-42fe-bee8-6b15de314f28 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:03.850165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2be2bb12-f119-42fe-bee8-6b15de314f28 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.851185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2be2bb12-f119-42fe-bee8-6b15de314f28 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.852171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2be2bb12-f119-42fe-bee8-6b15de314f28 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.853275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2be2bb12-f119-42fe-bee8-6b15de314f28 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.854071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2be2bb12-f119-42fe-bee8-6b15de314f28 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.854801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2be2bb12-f119-42fe-bee8-6b15de314f28 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.918127 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0450a64c-39f0-4b8c-a51f-2f56be070d89 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.143341 Aug 09 14:38:03.929041 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 997/1982] 10.222.0.50 () {58 vars in 1196 bytes} [Tue Aug 9 14:38:03 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:38:03.930974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-39eb7601-992a-4e8a-af07-3c2125ebc2fc req-3f133d94-0973-4962-9349-dd99fe001048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa831790-4a10-456d-bfc3-72ca22cb40a5", "tag": "9a914ca2-408c-4fab-9a17-50495a71b5b3"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:03.948504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-39eb7601-992a-4e8a-af07-3c2125ebc2fc req-3f133d94-0973-4962-9349-dd99fe001048 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.949256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-39eb7601-992a-4e8a-af07-3c2125ebc2fc req-3f133d94-0973-4962-9349-dd99fe001048 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.950179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-39eb7601-992a-4e8a-af07-3c2125ebc2fc req-3f133d94-0973-4962-9349-dd99fe001048 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.965424 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-39eb7601-992a-4e8a-af07-3c2125ebc2fc req-3f133d94-0973-4962-9349-dd99fe001048 service nova] Creating event network-changed:9a914ca2-408c-4fab-9a17-50495a71b5b3 for instance fa831790-4a10-456d-bfc3-72ca22cb40a5 on n-h1-844626-8 Aug 09 14:38:03.971345 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-39eb7601-992a-4e8a-af07-3c2125ebc2fc req-3f133d94-0973-4962-9349-dd99fe001048 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044549 Aug 09 14:38:03.972924 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 998/1983] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:03.980528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d1c5d9b-eba8-4ca7-b99e-e0d253f25e48 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:03.983766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d1c5d9b-eba8-4ca7-b99e-e0d253f25e48 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:03.990397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d1c5d9b-eba8-4ca7-b99e-e0d253f25e48 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.990720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d1c5d9b-eba8-4ca7-b99e-e0d253f25e48 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.991188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d1c5d9b-eba8-4ca7-b99e-e0d253f25e48 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:03.997554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d1c5d9b-eba8-4ca7-b99e-e0d253f25e48 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:03.998108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d1c5d9b-eba8-4ca7-b99e-e0d253f25e48 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:03.998833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d1c5d9b-eba8-4ca7-b99e-e0d253f25e48 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:04.180951 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d1c5d9b-eba8-4ca7-b99e-e0d253f25e48 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action" status: 202 len: 0 microversion: 2.1 time: 0.206033 Aug 09 14:38:04.181892 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 999/1984] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:38:03 2022] POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:38:04.195846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:04.196562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:04.205336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:04.205855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:04.206301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:04.206993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:04.207458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:04.208049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:04.265177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2be2bb12-f119-42fe-bee8-6b15de314f28 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:04.275793 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2be2bb12-f119-42fe-bee8-6b15de314f28 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1324 microversion: 2.1 time: 0.449401 Aug 09 14:38:04.279359 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 986/1985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:03 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1324 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:04.286499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:04.289725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:04.290315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:04.291546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:04.294093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:04.295308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lazy-loading 'fault' on Instance uuid 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:38:04.313009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:04.313583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:04.314095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:04.314888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:04.315460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:04.316034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:04.421262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:04.443508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:38:04.446615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:38:04.447365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:38:04.447995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:38:04.448810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:38:04.481533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b31aa283446d4db0bda4679cc10eb277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fce0f597febb44249ab111c4c2978c39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:04.489984 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e7034a3e-dc60-4596-8428-d735d1e27eb6 tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 200 len: 1307 microversion: 2.1 time: 0.306628 Aug 09 14:38:04.498721 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1000/1986] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:04 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 1307 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:04.504046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8b8fed12-db41-4bab-a4de-bbf4e188dbe1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:04.505840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8b8fed12-db41-4bab-a4de-bbf4e188dbe1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:04.526874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b8fed12-db41-4bab-a4de-bbf4e188dbe1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:04.527500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b8fed12-db41-4bab-a4de-bbf4e188dbe1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:04.528229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b8fed12-db41-4bab-a4de-bbf4e188dbe1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:04.529551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b8fed12-db41-4bab-a4de-bbf4e188dbe1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:04.530278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b8fed12-db41-4bab-a4de-bbf4e188dbe1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:04.530955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b8fed12-db41-4bab-a4de-bbf4e188dbe1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:04.551767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:04.568517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:04.569557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:04.572133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:04.573869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:04.574562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:04.576820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:04.608301 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2a25f4ba-310b-4b97-9ac0-347bd9e067dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action" status: 202 len: 1067 microversion: 2.1 time: 0.327487 Aug 09 14:38:04.621424 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 987/1987] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:38:04 2022] POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action => generated 1067 bytes in 341 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 09 14:38:04.627784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e4cfa1ef-70e6-4c2b-80da-42713a6a895c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:04.628764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e4cfa1ef-70e6-4c2b-80da-42713a6a895c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:04.641769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4cfa1ef-70e6-4c2b-80da-42713a6a895c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:04.642680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4cfa1ef-70e6-4c2b-80da-42713a6a895c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:04.642774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4cfa1ef-70e6-4c2b-80da-42713a6a895c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:04.644375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4cfa1ef-70e6-4c2b-80da-42713a6a895c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:04.645054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4cfa1ef-70e6-4c2b-80da-42713a6a895c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:04.645684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4cfa1ef-70e6-4c2b-80da-42713a6a895c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:05.080611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8b8fed12-db41-4bab-a4de-bbf4e188dbe1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:05.089553 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8b8fed12-db41-4bab-a4de-bbf4e188dbe1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1367 microversion: 2.1 time: 0.589277 Aug 09 14:38:05.091109 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1001/1988] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:04 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1367 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:05.108480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af2f21ea-1a16-4f37-9b98-5a8d74027b3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:05.109561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-af2f21ea-1a16-4f37-9b98-5a8d74027b3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:05.117751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af2f21ea-1a16-4f37-9b98-5a8d74027b3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:05.118539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af2f21ea-1a16-4f37-9b98-5a8d74027b3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:05.119191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af2f21ea-1a16-4f37-9b98-5a8d74027b3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:05.120139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af2f21ea-1a16-4f37-9b98-5a8d74027b3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:05.120912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af2f21ea-1a16-4f37-9b98-5a8d74027b3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:05.121546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af2f21ea-1a16-4f37-9b98-5a8d74027b3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:05.129635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e4cfa1ef-70e6-4c2b-80da-42713a6a895c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:05.147977 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e4cfa1ef-70e6-4c2b-80da-42713a6a895c tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1199 microversion: 2.1 time: 0.525005 Aug 09 14:38:05.148968 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 988/1989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:04 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1199 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:05.153826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5604173-8c8a-4b32-be0d-cc77e60fdab9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:05.154435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c5604173-8c8a-4b32-be0d-cc77e60fdab9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:05.170653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5604173-8c8a-4b32-be0d-cc77e60fdab9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:05.171486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5604173-8c8a-4b32-be0d-cc77e60fdab9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:05.172133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5604173-8c8a-4b32-be0d-cc77e60fdab9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:05.173250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5604173-8c8a-4b32-be0d-cc77e60fdab9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:05.173873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5604173-8c8a-4b32-be0d-cc77e60fdab9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:05.174301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5604173-8c8a-4b32-be0d-cc77e60fdab9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:05.309905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5604173-8c8a-4b32-be0d-cc77e60fdab9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:05.318527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5604173-8c8a-4b32-be0d-cc77e60fdab9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:05.320412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5604173-8c8a-4b32-be0d-cc77e60fdab9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:05.322040 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c5604173-8c8a-4b32-be0d-cc77e60fdab9 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 200 len: 1665 microversion: 2.25 time: 0.172030 Aug 09 14:38:05.335965 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 989/1990] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:38:05 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 1665 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:38:05.343725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-461aa0e9-f30c-414e-87c6-4a34a7d9eadb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:05.344510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-461aa0e9-f30c-414e-87c6-4a34a7d9eadb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:05.351236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461aa0e9-f30c-414e-87c6-4a34a7d9eadb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:05.352057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461aa0e9-f30c-414e-87c6-4a34a7d9eadb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:05.352577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461aa0e9-f30c-414e-87c6-4a34a7d9eadb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:05.353583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461aa0e9-f30c-414e-87c6-4a34a7d9eadb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:05.354294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461aa0e9-f30c-414e-87c6-4a34a7d9eadb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:05.360039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461aa0e9-f30c-414e-87c6-4a34a7d9eadb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:05.499360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-af2f21ea-1a16-4f37-9b98-5a8d74027b3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:05.513092 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af2f21ea-1a16-4f37-9b98-5a8d74027b3f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1471 microversion: 2.1 time: 0.419760 Aug 09 14:38:05.514321 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1002/1991] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:05 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:05.532419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fab2a187-0355-4933-8f9c-b71313a07e2a tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:05.533042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fab2a187-0355-4933-8f9c-b71313a07e2a tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] [instance: 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:05.544483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab2a187-0355-4933-8f9c-b71313a07e2a tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:05.544988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab2a187-0355-4933-8f9c-b71313a07e2a tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:05.549974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab2a187-0355-4933-8f9c-b71313a07e2a tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:05.550896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab2a187-0355-4933-8f9c-b71313a07e2a tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:05.551654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab2a187-0355-4933-8f9c-b71313a07e2a tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:05.552128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fab2a187-0355-4933-8f9c-b71313a07e2a tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:05.582734 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-fab2a187-0355-4933-8f9c-b71313a07e2a tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] HTTP exception thrown: Instance 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 could not be found. Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fab2a187-0355-4933-8f9c-b71313a07e2a tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Request method failure captured: Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 HTTP/1.1 Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nEyGuNG9gXV3Knvs0jIwLlkjrmFMLMnq-5K95g12DH9mlQtzkVpAMIt0kcj8R2e1AmTtmAZPAcK2mUmFzFN-mksBXnXkqzJd8PLTCwCI929QUO-2Fyr51Lb9pcSY_5LsdICAxTrzJ88o2sxOSCQ2JuPak7I9xTRveoksC7X_Qi2wG0 Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: fce0f597febb44249ab111c4c2978c39 Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerAddressesTestJSON-416624631 Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fce0f597febb44249ab111c4c2978c39", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fce0f597febb44249ab111c4c2978c39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce0f597febb44249ab111c4c2978c39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fce0f597febb44249ab111c4c2978c39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerAddressesTestJSON-416624631 Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: fce0f597febb44249ab111c4c2978c39 Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerAddressesTestJSON-416624631 Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerAddressesTestJSON-416624631-project Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: b31aa283446d4db0bda4679cc10eb277 Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerAddressesTestJSON-416624631-project Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 could not be found. Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '1a37cd4a-5a1b-4991-a1d1-fc67d7b68941'} Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 could not be found. Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 could not be found. Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:05.586474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:05.591876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:05.591876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:05.591876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:05.591876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:05.591876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:05.591876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 could not be found. Aug 09 14:38:05.591876 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:05.591876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fab2a187-0355-4933-8f9c-b71313a07e2a tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] Returning 404 to user: Instance 1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:05.591876 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fab2a187-0355-4933-8f9c-b71313a07e2a tempest-ServerAddressesTestJSON-416624631 tempest-ServerAddressesTestJSON-416624631-project] 10.222.0.50 "GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941" status: 404 len: 111 microversion: 2.1 time: 0.072484 Aug 09 14:38:05.591876 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1003/1992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:05 2022] GET /compute/v2.1/servers/1a37cd4a-5a1b-4991-a1d1-fc67d7b68941 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:38:05.629516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-461aa0e9-f30c-414e-87c6-4a34a7d9eadb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:05.637147 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-461aa0e9-f30c-414e-87c6-4a34a7d9eadb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1324 microversion: 2.1 time: 0.299978 Aug 09 14:38:05.637841 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 990/1993] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:05 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:06.112688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8816b2c9-30ed-481d-b985-b753984ac58e tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:06.114127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8816b2c9-30ed-481d-b985-b753984ac58e tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:06.122770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8816b2c9-30ed-481d-b985-b753984ac58e tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:06.123931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8816b2c9-30ed-481d-b985-b753984ac58e tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:06.124824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8816b2c9-30ed-481d-b985-b753984ac58e tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:06.125844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8816b2c9-30ed-481d-b985-b753984ac58e tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:06.126622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8816b2c9-30ed-481d-b985-b753984ac58e tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:06.127377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8816b2c9-30ed-481d-b985-b753984ac58e tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:06.171712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c36c2494-a1d2-4280-9530-462ffc601c82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:06.172339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c36c2494-a1d2-4280-9530-462ffc601c82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:06.184646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c36c2494-a1d2-4280-9530-462ffc601c82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:06.185403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c36c2494-a1d2-4280-9530-462ffc601c82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:06.186108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c36c2494-a1d2-4280-9530-462ffc601c82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:06.187013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c36c2494-a1d2-4280-9530-462ffc601c82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:06.187499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c36c2494-a1d2-4280-9530-462ffc601c82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:06.189832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c36c2494-a1d2-4280-9530-462ffc601c82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:06.401644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c36c2494-a1d2-4280-9530-462ffc601c82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:06.404714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8816b2c9-30ed-481d-b985-b753984ac58e tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:06.412186 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c36c2494-a1d2-4280-9530-462ffc601c82 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1199 microversion: 2.1 time: 0.244826 Aug 09 14:38:06.412869 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8816b2c9-30ed-481d-b985-b753984ac58e tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1367 microversion: 2.1 time: 0.305054 Aug 09 14:38:06.413774 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1004/1994] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:06 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:06.419976 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 991/1995] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:06 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1199 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:06.427003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e52f475-3af8-40be-b825-57f9660701ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:06.427368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f00e32cd-98e1-45e9-911d-b26584325708 req-cabf7603-1902-4dbe-9d39-2d3476381869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd6f697-9f2e-4825-998a-796902617f44", "name": "network-vif-deleted", "tag": "ee2a1cef-a2ec-4b5c-a13d-9c50e9639eb0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:06.431012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2e52f475-3af8-40be-b825-57f9660701ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: acd6f697-9f2e-4825-998a-796902617f44] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:06.437617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f00e32cd-98e1-45e9-911d-b26584325708 req-cabf7603-1902-4dbe-9d39-2d3476381869 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:06.438210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f00e32cd-98e1-45e9-911d-b26584325708 req-cabf7603-1902-4dbe-9d39-2d3476381869 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:06.438803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f00e32cd-98e1-45e9-911d-b26584325708 req-cabf7603-1902-4dbe-9d39-2d3476381869 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:06.439344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e52f475-3af8-40be-b825-57f9660701ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:06.440042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e52f475-3af8-40be-b825-57f9660701ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:06.440686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e52f475-3af8-40be-b825-57f9660701ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:06.441597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e52f475-3af8-40be-b825-57f9660701ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:06.442235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e52f475-3af8-40be-b825-57f9660701ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:06.442849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e52f475-3af8-40be-b825-57f9660701ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:06.454760 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f00e32cd-98e1-45e9-911d-b26584325708 req-cabf7603-1902-4dbe-9d39-2d3476381869 service nova] Creating event network-vif-deleted:ee2a1cef-a2ec-4b5c-a13d-9c50e9639eb0 for instance acd6f697-9f2e-4825-998a-796902617f44 on n-h2-844626-8 Aug 09 14:38:06.458905 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-2e52f475-3af8-40be-b825-57f9660701ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] HTTP exception thrown: Instance acd6f697-9f2e-4825-998a-796902617f44 could not be found. Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e52f475-3af8-40be-b825-57f9660701ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Request method failure captured: Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 HTTP/1.1 Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-nEY-BXVJUAYCvJbx2MxtnAO_woEd-x4ozzlUD5NfN1OL1LxcrQg_D1sDTrsL6sa1DAIs2yEdmZDFGaHREGEYTTTrfihQrn3meSTYClf6wUI828uVo601DlSJaswiDNfrp4Lexy4BKDOuwdiEW8COqJbFyTlWGdXCzEEL6Nx457d8 Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.25 Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: d512f92fc41c45edbd209ab51922e5d7 Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1110762263 Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d512f92fc41c45edbd209ab51922e5d7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d512f92fc41c45edbd209ab51922e5d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d512f92fc41c45edbd209ab51922e5d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d512f92fc41c45edbd209ab51922e5d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1110762263 Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: d512f92fc41c45edbd209ab51922e5d7 Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1110762263 Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-LiveAutoBlockMigrationV225Test-1110762263-project Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 247d1747ce074adb8b1e56a459e8cd51 Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1110762263-project Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance acd6f697-9f2e-4825-998a-796902617f44 could not be found. Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'acd6f697-9f2e-4825-998a-796902617f44'} Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd6f697-9f2e-4825-998a-796902617f44 could not be found. Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd6f697-9f2e-4825-998a-796902617f44 could not be found. Aug 09 14:38:06.460933 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:06.466083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:06.466083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:06.466083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:06.466083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:06.466083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:06.466083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:06.466083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:06.466083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd6f697-9f2e-4825-998a-796902617f44 could not be found. Aug 09 14:38:06.466083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:06.467953 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f00e32cd-98e1-45e9-911d-b26584325708 req-cabf7603-1902-4dbe-9d39-2d3476381869 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045616 Aug 09 14:38:06.467953 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1005/1996] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:06.468299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e52f475-3af8-40be-b825-57f9660701ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Returning 404 to user: Instance acd6f697-9f2e-4825-998a-796902617f44 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:06.468299 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2e52f475-3af8-40be-b825-57f9660701ec tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44" status: 404 len: 111 microversion: 2.25 time: 0.043108 Aug 09 14:38:06.468299 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 992/1997] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:38:06 2022] GET /compute/v2.1/servers/acd6f697-9f2e-4825-998a-796902617f44 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:38:06.474632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-868bccb3-bba9-4ee7-afe8-29a09222fc04 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '.version_select at 0x7f41dd33e9d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:06.487850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:06.497530 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-868bccb3-bba9-4ee7-afe8-29a09222fc04 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-610303194" status: 204 len: 0 microversion: 2.25 time: 0.027332 Aug 09 14:38:06.498217 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1006/1998] 10.222.0.50 () {60 vars in 1259 bytes} [Tue Aug 9 14:38:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-610303194 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 09 14:38:06.538915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7d1425b3-f83f-454a-a509-3ab5d81d3dda tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:06.540056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7d1425b3-f83f-454a-a509-3ab5d81d3dda tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:06.551050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d1425b3-f83f-454a-a509-3ab5d81d3dda tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:06.551578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d1425b3-f83f-454a-a509-3ab5d81d3dda tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:06.552008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d1425b3-f83f-454a-a509-3ab5d81d3dda tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:06.553139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d1425b3-f83f-454a-a509-3ab5d81d3dda tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:06.553740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d1425b3-f83f-454a-a509-3ab5d81d3dda tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:06.554606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d1425b3-f83f-454a-a509-3ab5d81d3dda tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:06.662641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4c7221ad-373a-486e-bfd7-882426a370f9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:06.663738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4c7221ad-373a-486e-bfd7-882426a370f9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:06.689370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c7221ad-373a-486e-bfd7-882426a370f9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:06.690162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c7221ad-373a-486e-bfd7-882426a370f9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:06.694066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c7221ad-373a-486e-bfd7-882426a370f9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:06.695039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c7221ad-373a-486e-bfd7-882426a370f9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:06.695805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c7221ad-373a-486e-bfd7-882426a370f9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:06.707730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c7221ad-373a-486e-bfd7-882426a370f9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:06.812847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7d1425b3-f83f-454a-a509-3ab5d81d3dda tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:06.833211 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7d1425b3-f83f-454a-a509-3ab5d81d3dda tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1471 microversion: 2.1 time: 0.292890 Aug 09 14:38:06.833905 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 993/1999] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:06 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:07.072023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4c7221ad-373a-486e-bfd7-882426a370f9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:07.085706 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4c7221ad-373a-486e-bfd7-882426a370f9 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1324 microversion: 2.1 time: 0.431199 Aug 09 14:38:07.088645 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1007/2000] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:06 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1324 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:07.398971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d3b70d1f-43ab-4c1a-9c00-7ef9b6f00256 req-b398b906-1a54-4b9d-ae22-78e601f04396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46aa8418-3f46-4f90-bb08-763d20055e1c", "name": "network-vif-plugged", "status": "completed", "tag": "d159e2a0-cd63-4b05-83ad-effb48febb0c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:07.417187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d3b70d1f-43ab-4c1a-9c00-7ef9b6f00256 req-b398b906-1a54-4b9d-ae22-78e601f04396 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:07.417668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d3b70d1f-43ab-4c1a-9c00-7ef9b6f00256 req-b398b906-1a54-4b9d-ae22-78e601f04396 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:07.418095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d3b70d1f-43ab-4c1a-9c00-7ef9b6f00256 req-b398b906-1a54-4b9d-ae22-78e601f04396 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:07.433877 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d3b70d1f-43ab-4c1a-9c00-7ef9b6f00256 req-b398b906-1a54-4b9d-ae22-78e601f04396 service nova] Creating event network-vif-plugged:d159e2a0-cd63-4b05-83ad-effb48febb0c for instance 46aa8418-3f46-4f90-bb08-763d20055e1c on n-h2-844626-8 Aug 09 14:38:07.434864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0feb9e4d-e0f0-4ff8-8321-f2594bc48198 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:07.435610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0feb9e4d-e0f0-4ff8-8321-f2594bc48198 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:07.441958 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d3b70d1f-43ab-4c1a-9c00-7ef9b6f00256 req-b398b906-1a54-4b9d-ae22-78e601f04396 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050967 Aug 09 14:38:07.443193 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 994/2001] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:07.449618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e97661bc-3409-4067-83e0-34876326e295 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:07.450629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e97661bc-3409-4067-83e0-34876326e295 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:07.457714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e97661bc-3409-4067-83e0-34876326e295 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:07.458454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e97661bc-3409-4067-83e0-34876326e295 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:07.458589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0feb9e4d-e0f0-4ff8-8321-f2594bc48198 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:07.459059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0feb9e4d-e0f0-4ff8-8321-f2594bc48198 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:07.459501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e97661bc-3409-4067-83e0-34876326e295 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:07.459632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0feb9e4d-e0f0-4ff8-8321-f2594bc48198 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:07.460544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e97661bc-3409-4067-83e0-34876326e295 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:07.461196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e97661bc-3409-4067-83e0-34876326e295 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:07.462065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e97661bc-3409-4067-83e0-34876326e295 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:07.462618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0feb9e4d-e0f0-4ff8-8321-f2594bc48198 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:07.463121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0feb9e4d-e0f0-4ff8-8321-f2594bc48198 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:07.463539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0feb9e4d-e0f0-4ff8-8321-f2594bc48198 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:07.716222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e97661bc-3409-4067-83e0-34876326e295 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:07.722988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0feb9e4d-e0f0-4ff8-8321-f2594bc48198 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:07.731741 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0feb9e4d-e0f0-4ff8-8321-f2594bc48198 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1367 microversion: 2.1 time: 0.301625 Aug 09 14:38:07.731981 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e97661bc-3409-4067-83e0-34876326e295 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1199 microversion: 2.1 time: 0.286861 Aug 09 14:38:07.732378 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 995/2002] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:07 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1199 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:07.733396 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1008/2003] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:07 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:38:07.750092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cd5715f7-3141-4342-bd16-0209a1eb0787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:07.750585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cd5715f7-3141-4342-bd16-0209a1eb0787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:07.758538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd5715f7-3141-4342-bd16-0209a1eb0787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:07.759331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd5715f7-3141-4342-bd16-0209a1eb0787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:07.759764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd5715f7-3141-4342-bd16-0209a1eb0787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:07.760493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd5715f7-3141-4342-bd16-0209a1eb0787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:07.760923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd5715f7-3141-4342-bd16-0209a1eb0787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:07.761561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd5715f7-3141-4342-bd16-0209a1eb0787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:07.788631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cd5715f7-3141-4342-bd16-0209a1eb0787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:38:07.853705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b38704f-1c06-419d-9a56-dbee62a2f485 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:07.854748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b38704f-1c06-419d-9a56-dbee62a2f485 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:07.862566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b38704f-1c06-419d-9a56-dbee62a2f485 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:07.863142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b38704f-1c06-419d-9a56-dbee62a2f485 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:07.863646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b38704f-1c06-419d-9a56-dbee62a2f485 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:07.864358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b38704f-1c06-419d-9a56-dbee62a2f485 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:07.864807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b38704f-1c06-419d-9a56-dbee62a2f485 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:07.865290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b38704f-1c06-419d-9a56-dbee62a2f485 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:07.894527 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cd5715f7-3141-4342-bd16-0209a1eb0787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 204 len: 0 microversion: 2.25 time: 0.147965 Aug 09 14:38:07.895601 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 996/2004] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:38:07 2022] DELETE /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:38:07.910834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee227b3f-a8da-4bc4-beeb-5f25465f7787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:07.911889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee227b3f-a8da-4bc4-beeb-5f25465f7787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:07.921115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee227b3f-a8da-4bc4-beeb-5f25465f7787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:07.922048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee227b3f-a8da-4bc4-beeb-5f25465f7787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:07.922759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee227b3f-a8da-4bc4-beeb-5f25465f7787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:07.924748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee227b3f-a8da-4bc4-beeb-5f25465f7787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:07.925326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee227b3f-a8da-4bc4-beeb-5f25465f7787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:07.925819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee227b3f-a8da-4bc4-beeb-5f25465f7787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.068036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9b38704f-1c06-419d-9a56-dbee62a2f485 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:08.086415 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b38704f-1c06-419d-9a56-dbee62a2f485 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1471 microversion: 2.1 time: 0.236305 Aug 09 14:38:08.087992 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1009/2005] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:07 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1471 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:08.113103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2dbf505a-cbf9-46a0-8023-9b2a026fabbf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:08.113993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2dbf505a-cbf9-46a0-8023-9b2a026fabbf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:08.121037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dbf505a-cbf9-46a0-8023-9b2a026fabbf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.121620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dbf505a-cbf9-46a0-8023-9b2a026fabbf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.122118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dbf505a-cbf9-46a0-8023-9b2a026fabbf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.122937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dbf505a-cbf9-46a0-8023-9b2a026fabbf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.123527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dbf505a-cbf9-46a0-8023-9b2a026fabbf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.124352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dbf505a-cbf9-46a0-8023-9b2a026fabbf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.370094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2dbf505a-cbf9-46a0-8023-9b2a026fabbf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:08.378493 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2dbf505a-cbf9-46a0-8023-9b2a026fabbf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1324 microversion: 2.1 time: 0.275465 Aug 09 14:38:08.391294 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1010/2006] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:08 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1324 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:08.432708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7e8af56-3b3a-4e81-9421-e8fc84caa5cc tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:08.433013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ee227b3f-a8da-4bc4-beeb-5f25465f7787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:08.434332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e7e8af56-3b3a-4e81-9421-e8fc84caa5cc tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:08.443971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ee227b3f-a8da-4bc4-beeb-5f25465f7787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:08.445589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ee227b3f-a8da-4bc4-beeb-5f25465f7787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:08.447596 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee227b3f-a8da-4bc4-beeb-5f25465f7787 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1549 microversion: 2.25 time: 0.545326 Aug 09 14:38:08.449683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7e8af56-3b3a-4e81-9421-e8fc84caa5cc tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.450858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7e8af56-3b3a-4e81-9421-e8fc84caa5cc tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.451354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7e8af56-3b3a-4e81-9421-e8fc84caa5cc tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.452569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7e8af56-3b3a-4e81-9421-e8fc84caa5cc tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.452959 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 997/2007] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:38:07 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1549 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:38:08.453478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7e8af56-3b3a-4e81-9421-e8fc84caa5cc tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.454166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7e8af56-3b3a-4e81-9421-e8fc84caa5cc tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.472394 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e7e8af56-3b3a-4e81-9421-e8fc84caa5cc tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] HTTP exception thrown: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7e8af56-3b3a-4e81-9421-e8fc84caa5cc tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Request method failure captured: Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 HTTP/1.1 Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nDQMJZd9DU-CMdNEpzJ7lwOlKu96UlsmbXN476U2zkuRmVW-1byUjrtijYC5h5gF3kNQzRNwU52_L8ENTPaiSz-nxM0C0nH6d-swsQy4EkVE26FV8yPiUxAAxo_i-D11nZGj8s5KPLxpCC9VWEyfk64LkyHoMA2SPtSzOnnH5aZ_x4 Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 54de373a9e684301905608f195bb56b9 Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_54de373a9e684301905608f195bb56b9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/54de373a9e684301905608f195bb56b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54de373a9e684301905608f195bb56b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54de373a9e684301905608f195bb56b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 54de373a9e684301905608f195bb56b9 Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestMultiNic-2131063812-project Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 00f1751674ba4df68ea6905988cd6510 Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestMultiNic-2131063812-project Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '4d615dd5-c0ab-4d52-946b-7773c9605ac7'} Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:38:08.474213 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:38:08.479040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:08.479040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.479040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:08.479040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.479040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:08.479040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:08.479040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:08.479040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:08.479040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:08.479040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:08.479040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.481690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7e8af56-3b3a-4e81-9421-e8fc84caa5cc tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Returning 404 to user: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:08.482895 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e7e8af56-3b3a-4e81-9421-e8fc84caa5cc tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 404 len: 111 microversion: 2.1 time: 0.060479 Aug 09 14:38:08.483854 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1011/2008] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:38:08 2022] DELETE /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:38:08.492396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55b7f1d3-deb9-4ac8-a091-c0f5df47298c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:08.493104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55b7f1d3-deb9-4ac8-a091-c0f5df47298c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 4d615dd5-c0ab-4d52-946b-7773c9605ac7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:08.499981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55b7f1d3-deb9-4ac8-a091-c0f5df47298c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.500593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55b7f1d3-deb9-4ac8-a091-c0f5df47298c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.511078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55b7f1d3-deb9-4ac8-a091-c0f5df47298c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.512624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55b7f1d3-deb9-4ac8-a091-c0f5df47298c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.513421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55b7f1d3-deb9-4ac8-a091-c0f5df47298c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.514615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55b7f1d3-deb9-4ac8-a091-c0f5df47298c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.537078 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-55b7f1d3-deb9-4ac8-a091-c0f5df47298c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] HTTP exception thrown: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55b7f1d3-deb9-4ac8-a091-c0f5df47298c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Request method failure captured: Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 HTTP/1.1 Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nDQMJZd9DU-CMdNEpzJ7lwOlKu96UlsmbXN476U2zkuRmVW-1byUjrtijYC5h5gF3kNQzRNwU52_L8ENTPaiSz-nxM0C0nH6d-swsQy4EkVE26FV8yPiUxAAxo_i-D11nZGj8s5KPLxpCC9VWEyfk64LkyHoMA2SPtSzOnnH5aZ_x4 Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 54de373a9e684301905608f195bb56b9 Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_54de373a9e684301905608f195bb56b9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/54de373a9e684301905608f195bb56b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54de373a9e684301905608f195bb56b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54de373a9e684301905608f195bb56b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 54de373a9e684301905608f195bb56b9 Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestMultiNic-2131063812-project Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 00f1751674ba4df68ea6905988cd6510 Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestMultiNic-2131063812-project Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '4d615dd5-c0ab-4d52-946b-7773c9605ac7'} Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:08.539004 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.546759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:08.546759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:08.546759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:08.546759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:08.546759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:08.546759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. Aug 09 14:38:08.546759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.546759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55b7f1d3-deb9-4ac8-a091-c0f5df47298c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Returning 404 to user: Instance 4d615dd5-c0ab-4d52-946b-7773c9605ac7 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:08.546759 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-55b7f1d3-deb9-4ac8-a091-c0f5df47298c tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7" status: 404 len: 111 microversion: 2.1 time: 0.052262 Aug 09 14:38:08.546759 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 998/2009] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:08 2022] GET /compute/v2.1/servers/4d615dd5-c0ab-4d52-946b-7773c9605ac7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:38:08.549880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f089283c-2993-44fb-97c8-023f98d3bd78 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:08.550666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f089283c-2993-44fb-97c8-023f98d3bd78 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:08.556558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f089283c-2993-44fb-97c8-023f98d3bd78 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.557041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f089283c-2993-44fb-97c8-023f98d3bd78 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.557646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f089283c-2993-44fb-97c8-023f98d3bd78 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.558346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f089283c-2993-44fb-97c8-023f98d3bd78 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.559205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f089283c-2993-44fb-97c8-023f98d3bd78 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.559876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f089283c-2993-44fb-97c8-023f98d3bd78 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.575524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:08.577330 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-f089283c-2993-44fb-97c8-023f98d3bd78 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] HTTP exception thrown: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f089283c-2993-44fb-97c8-023f98d3bd78 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Request method failure captured: Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 HTTP/1.1 Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nDQMJZd9DU-CMdNEpzJ7lwOlKu96UlsmbXN476U2zkuRmVW-1byUjrtijYC5h5gF3kNQzRNwU52_L8ENTPaiSz-nxM0C0nH6d-swsQy4EkVE26FV8yPiUxAAxo_i-D11nZGj8s5KPLxpCC9VWEyfk64LkyHoMA2SPtSzOnnH5aZ_x4 Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 54de373a9e684301905608f195bb56b9 Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_54de373a9e684301905608f195bb56b9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/54de373a9e684301905608f195bb56b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54de373a9e684301905608f195bb56b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54de373a9e684301905608f195bb56b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 54de373a9e684301905608f195bb56b9 Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestMultiNic-2131063812-project Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 00f1751674ba4df68ea6905988cd6510 Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestMultiNic-2131063812-project Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '5c0c3435-cbf1-447d-ba66-fbdf16ccc900'} Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:38:08.579199 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:38:08.583811 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:38:08.583811 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.583811 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:08.583811 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.583811 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:08.583811 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:08.583811 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:08.583811 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:08.583811 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:08.583811 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:38:08.583811 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.586278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f089283c-2993-44fb-97c8-023f98d3bd78 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Returning 404 to user: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:08.587531 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f089283c-2993-44fb-97c8-023f98d3bd78 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 404 len: 111 microversion: 2.1 time: 0.042201 Aug 09 14:38:08.595192 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1012/2010] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:38:08 2022] DELETE /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:38:08.597192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe922b22-4cb7-43b1-b85a-54afd1291fb6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:08.598066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fe922b22-4cb7-43b1-b85a-54afd1291fb6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] [instance: 5c0c3435-cbf1-447d-ba66-fbdf16ccc900] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:08.604674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe922b22-4cb7-43b1-b85a-54afd1291fb6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.605471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe922b22-4cb7-43b1-b85a-54afd1291fb6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.606214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe922b22-4cb7-43b1-b85a-54afd1291fb6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.607173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe922b22-4cb7-43b1-b85a-54afd1291fb6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.607867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe922b22-4cb7-43b1-b85a-54afd1291fb6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.608533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe922b22-4cb7-43b1-b85a-54afd1291fb6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.623042 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-fe922b22-4cb7-43b1-b85a-54afd1291fb6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] HTTP exception thrown: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe922b22-4cb7-43b1-b85a-54afd1291fb6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Request method failure captured: Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 HTTP/1.1 Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nDQMJZd9DU-CMdNEpzJ7lwOlKu96UlsmbXN476U2zkuRmVW-1byUjrtijYC5h5gF3kNQzRNwU52_L8ENTPaiSz-nxM0C0nH6d-swsQy4EkVE26FV8yPiUxAAxo_i-D11nZGj8s5KPLxpCC9VWEyfk64LkyHoMA2SPtSzOnnH5aZ_x4 Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 54de373a9e684301905608f195bb56b9 Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_54de373a9e684301905608f195bb56b9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/54de373a9e684301905608f195bb56b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54de373a9e684301905608f195bb56b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/54de373a9e684301905608f195bb56b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 54de373a9e684301905608f195bb56b9 Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestMultiNic-2131063812 Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestMultiNic-2131063812-project Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 00f1751674ba4df68ea6905988cd6510 Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestMultiNic-2131063812-project Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '5c0c3435-cbf1-447d-ba66-fbdf16ccc900'} Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:08.624899 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.630322 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:08.630322 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:08.630322 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:08.630322 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:08.630322 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:08.630322 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. Aug 09 14:38:08.630322 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:08.630322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe922b22-4cb7-43b1-b85a-54afd1291fb6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] Returning 404 to user: Instance 5c0c3435-cbf1-447d-ba66-fbdf16ccc900 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:08.630322 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fe922b22-4cb7-43b1-b85a-54afd1291fb6 tempest-ServersTestMultiNic-2131063812 tempest-ServersTestMultiNic-2131063812-project] 10.222.0.50 "GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900" status: 404 len: 111 microversion: 2.1 time: 0.033412 Aug 09 14:38:08.630322 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 999/2011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:08 2022] GET /compute/v2.1/servers/5c0c3435-cbf1-447d-ba66-fbdf16ccc900 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:38:08.752773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-150e4bac-b80a-463c-8068-4ec73489e2fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:08.753609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-150e4bac-b80a-463c-8068-4ec73489e2fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:08.753796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aaeaabf7-b5d8-4c0d-83fd-e8beca94e663 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:08.754391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aaeaabf7-b5d8-4c0d-83fd-e8beca94e663 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:08.758126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=14 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:08.761806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-150e4bac-b80a-463c-8068-4ec73489e2fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.762358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-150e4bac-b80a-463c-8068-4ec73489e2fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.762786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-150e4bac-b80a-463c-8068-4ec73489e2fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.763768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-150e4bac-b80a-463c-8068-4ec73489e2fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.764077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aaeaabf7-b5d8-4c0d-83fd-e8beca94e663 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.764245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-150e4bac-b80a-463c-8068-4ec73489e2fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.764560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aaeaabf7-b5d8-4c0d-83fd-e8beca94e663 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.764681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-150e4bac-b80a-463c-8068-4ec73489e2fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.764993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aaeaabf7-b5d8-4c0d-83fd-e8beca94e663 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.765700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aaeaabf7-b5d8-4c0d-83fd-e8beca94e663 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:08.766126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aaeaabf7-b5d8-4c0d-83fd-e8beca94e663 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:08.766863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aaeaabf7-b5d8-4c0d-83fd-e8beca94e663 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:08.975439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aaeaabf7-b5d8-4c0d-83fd-e8beca94e663 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:08.977002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-150e4bac-b80a-463c-8068-4ec73489e2fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:08.985242 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aaeaabf7-b5d8-4c0d-83fd-e8beca94e663 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1367 microversion: 2.1 time: 0.235494 Aug 09 14:38:08.985540 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-150e4bac-b80a-463c-8068-4ec73489e2fa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1199 microversion: 2.1 time: 0.236983 Aug 09 14:38:08.990791 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1000/2012] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:08 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:08.991764 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1013/2013] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:08 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1199 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:09.110301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1637c5c2-4970-413b-9ec3-0348d77e4961 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:09.111241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1637c5c2-4970-413b-9ec3-0348d77e4961 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:09.118280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1637c5c2-4970-413b-9ec3-0348d77e4961 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:09.119165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1637c5c2-4970-413b-9ec3-0348d77e4961 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:09.119606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1637c5c2-4970-413b-9ec3-0348d77e4961 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:09.120423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1637c5c2-4970-413b-9ec3-0348d77e4961 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:09.120963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1637c5c2-4970-413b-9ec3-0348d77e4961 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:09.121429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1637c5c2-4970-413b-9ec3-0348d77e4961 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:09.262658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1637c5c2-4970-413b-9ec3-0348d77e4961 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:09.270776 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1637c5c2-4970-413b-9ec3-0348d77e4961 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1471 microversion: 2.1 time: 0.164568 Aug 09 14:38:09.271392 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1001/2014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:09 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:09.400302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8c8c5144-4d22-4a33-acb2-7613c99b961e tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:09.400966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8c8c5144-4d22-4a33-acb2-7613c99b961e tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:09.407500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c8c5144-4d22-4a33-acb2-7613c99b961e tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:09.407972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c8c5144-4d22-4a33-acb2-7613c99b961e tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:09.408567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c8c5144-4d22-4a33-acb2-7613c99b961e tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:09.409986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c8c5144-4d22-4a33-acb2-7613c99b961e tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:09.409986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c8c5144-4d22-4a33-acb2-7613c99b961e tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:09.410240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c8c5144-4d22-4a33-acb2-7613c99b961e tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:09.471516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8365f3fc-7e6f-4357-a3a5-c0d3a9053fc5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:09.472094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8365f3fc-7e6f-4357-a3a5-c0d3a9053fc5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:09.479794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8365f3fc-7e6f-4357-a3a5-c0d3a9053fc5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:09.480266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8365f3fc-7e6f-4357-a3a5-c0d3a9053fc5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:09.481349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8365f3fc-7e6f-4357-a3a5-c0d3a9053fc5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:09.481792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8365f3fc-7e6f-4357-a3a5-c0d3a9053fc5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:09.482295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8365f3fc-7e6f-4357-a3a5-c0d3a9053fc5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:09.482949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8365f3fc-7e6f-4357-a3a5-c0d3a9053fc5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:09.603513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8c8c5144-4d22-4a33-acb2-7613c99b961e tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:09.612183 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8c8c5144-4d22-4a33-acb2-7613c99b961e tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1521 microversion: 2.1 time: 0.215822 Aug 09 14:38:09.613421 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1014/2015] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:09 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:09.618258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a1f7fb29-9b7a-4e40-b1de-947f8bd034aa req-fa871669-a773-443c-9913-50d9ac9b2c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c508aaa8-11d1-4593-b840-91b8295b6f8e", "name": "network-vif-plugged", "status": "completed", "tag": "6db596c5-3bac-4ac1-8c68-1f1c20808428"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:09.634034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a1f7fb29-9b7a-4e40-b1de-947f8bd034aa req-fa871669-a773-443c-9913-50d9ac9b2c67 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:09.634895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a1f7fb29-9b7a-4e40-b1de-947f8bd034aa req-fa871669-a773-443c-9913-50d9ac9b2c67 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:09.635348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a1f7fb29-9b7a-4e40-b1de-947f8bd034aa req-fa871669-a773-443c-9913-50d9ac9b2c67 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:09.648348 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a1f7fb29-9b7a-4e40-b1de-947f8bd034aa req-fa871669-a773-443c-9913-50d9ac9b2c67 service nova] Creating event network-vif-plugged:6db596c5-3bac-4ac1-8c68-1f1c20808428 for instance c508aaa8-11d1-4593-b840-91b8295b6f8e on n-h2-844626-8 Aug 09 14:38:09.656178 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a1f7fb29-9b7a-4e40-b1de-947f8bd034aa req-fa871669-a773-443c-9913-50d9ac9b2c67 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039887 Aug 09 14:38:09.656779 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1015/2016] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:09.663907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f300b0cb-db26-4be3-8eff-9adbab2f0c18 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Action: 'create', calling method: .version_select at 0x7f41ddd8fee0>, body: {"pool": null} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:09.674775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8365f3fc-7e6f-4357-a3a5-c0d3a9053fc5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:09.702592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8365f3fc-7e6f-4357-a3a5-c0d3a9053fc5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:09.708253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8365f3fc-7e6f-4357-a3a5-c0d3a9053fc5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:09.709782 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8365f3fc-7e6f-4357-a3a5-c0d3a9053fc5 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1549 microversion: 2.25 time: 0.243655 Aug 09 14:38:09.712590 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1002/2017] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:38:09 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1549 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:38:09.722577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=10 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:10.015190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aaae29ec-4d3d-4b8c-9b03-8bc7e950d578 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:10.015190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aaae29ec-4d3d-4b8c-9b03-8bc7e950d578 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:10.020540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:10.022234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aaae29ec-4d3d-4b8c-9b03-8bc7e950d578 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:10.022896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aaae29ec-4d3d-4b8c-9b03-8bc7e950d578 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:10.023697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aaae29ec-4d3d-4b8c-9b03-8bc7e950d578 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:10.024672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aaae29ec-4d3d-4b8c-9b03-8bc7e950d578 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:10.025378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aaae29ec-4d3d-4b8c-9b03-8bc7e950d578 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:10.026021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aaae29ec-4d3d-4b8c-9b03-8bc7e950d578 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:10.050566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:10.363718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aaae29ec-4d3d-4b8c-9b03-8bc7e950d578 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:10.374454 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aaae29ec-4d3d-4b8c-9b03-8bc7e950d578 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1367 microversion: 2.1 time: 0.371228 Aug 09 14:38:10.378299 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1003/2018] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:10 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:10.388466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1ba4fd7-d935-4683-96c4-974efd6aaa57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:10.389338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f1ba4fd7-d935-4683-96c4-974efd6aaa57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:10.396647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1ba4fd7-d935-4683-96c4-974efd6aaa57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:10.397447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1ba4fd7-d935-4683-96c4-974efd6aaa57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:10.398073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1ba4fd7-d935-4683-96c4-974efd6aaa57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:10.399145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1ba4fd7-d935-4683-96c4-974efd6aaa57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:10.399875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1ba4fd7-d935-4683-96c4-974efd6aaa57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:10.407782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1ba4fd7-d935-4683-96c4-974efd6aaa57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:10.684394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f1ba4fd7-d935-4683-96c4-974efd6aaa57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:10.694515 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f1ba4fd7-d935-4683-96c4-974efd6aaa57 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1199 microversion: 2.1 time: 0.313431 Aug 09 14:38:10.708578 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1004/2019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:10 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1199 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:10.708578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-459c6a2f-ec0b-4591-9213-dd2abac5ac12 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:10.708578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-459c6a2f-ec0b-4591-9213-dd2abac5ac12 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:10.717523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-459c6a2f-ec0b-4591-9213-dd2abac5ac12 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:10.721940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-459c6a2f-ec0b-4591-9213-dd2abac5ac12 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:10.725351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-459c6a2f-ec0b-4591-9213-dd2abac5ac12 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:10.726240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-459c6a2f-ec0b-4591-9213-dd2abac5ac12 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:10.726889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-459c6a2f-ec0b-4591-9213-dd2abac5ac12 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:10.728730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-459c6a2f-ec0b-4591-9213-dd2abac5ac12 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:10.985169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-459c6a2f-ec0b-4591-9213-dd2abac5ac12 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:10.993371 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-459c6a2f-ec0b-4591-9213-dd2abac5ac12 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1471 microversion: 2.1 time: 0.291216 Aug 09 14:38:10.994075 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1005/2020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:10 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1471 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:10.999021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-42ec1b32-4bcf-4baa-9f7c-29d090e54dfe req-7ad2e244-1896-40f2-a069-7a8136011589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f49c755-de1e-44c2-98de-f6654c0a94a5", "name": "network-vif-deleted", "tag": "73ab8dbc-ce85-43aa-8083-f3979fc042ef"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:11.009306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-42ec1b32-4bcf-4baa-9f7c-29d090e54dfe req-7ad2e244-1896-40f2-a069-7a8136011589 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:11.009927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-42ec1b32-4bcf-4baa-9f7c-29d090e54dfe req-7ad2e244-1896-40f2-a069-7a8136011589 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:11.010458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-42ec1b32-4bcf-4baa-9f7c-29d090e54dfe req-7ad2e244-1896-40f2-a069-7a8136011589 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:11.022954 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-42ec1b32-4bcf-4baa-9f7c-29d090e54dfe req-7ad2e244-1896-40f2-a069-7a8136011589 service nova] Creating event network-vif-deleted:73ab8dbc-ce85-43aa-8083-f3979fc042ef for instance 0f49c755-de1e-44c2-98de-f6654c0a94a5 on n-h2-844626-8 Aug 09 14:38:11.030764 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-42ec1b32-4bcf-4baa-9f7c-29d090e54dfe req-7ad2e244-1896-40f2-a069-7a8136011589 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035244 Aug 09 14:38:11.032030 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1006/2021] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:11.037335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:11.038174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:11.046190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:11.046190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:11.046190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:11.046598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:11.047047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:11.047536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:11.083238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:11.083976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:11.084653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:11.085076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lazy-loading 'fault' on Instance uuid 0f49c755-de1e-44c2-98de-f6654c0a94a5 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:38:11.164282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:11.189376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:11.191724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:11.194034 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d6037d03-4ad6-4e77-9865-48b978d695ac tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 200 len: 1351 microversion: 2.25 time: 0.160842 Aug 09 14:38:11.195326 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1007/2022] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:38:11 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 1351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:38:11.399812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2facabf-6553-42e1-af66-5d47fa332ebf tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:11.400712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f2facabf-6553-42e1-af66-5d47fa332ebf tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:11.413630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2facabf-6553-42e1-af66-5d47fa332ebf tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:11.414228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2facabf-6553-42e1-af66-5d47fa332ebf tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:11.415067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2facabf-6553-42e1-af66-5d47fa332ebf tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:11.417722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2facabf-6553-42e1-af66-5d47fa332ebf tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:11.418478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2facabf-6553-42e1-af66-5d47fa332ebf tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:11.422537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2facabf-6553-42e1-af66-5d47fa332ebf tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:11.765377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f2facabf-6553-42e1-af66-5d47fa332ebf tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:11.775849 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f2facabf-6553-42e1-af66-5d47fa332ebf tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1367 microversion: 2.1 time: 0.379987 Aug 09 14:38:11.777698 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1008/2023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:11 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:11.783202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc2d9490-8282-4f3c-9037-105b365a4d45 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:11.783947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc2d9490-8282-4f3c-9037-105b365a4d45 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:11.794552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc2d9490-8282-4f3c-9037-105b365a4d45 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:11.795110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc2d9490-8282-4f3c-9037-105b365a4d45 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:11.795557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc2d9490-8282-4f3c-9037-105b365a4d45 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:11.796608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc2d9490-8282-4f3c-9037-105b365a4d45 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:11.797123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc2d9490-8282-4f3c-9037-105b365a4d45 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:11.797625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc2d9490-8282-4f3c-9037-105b365a4d45 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:11.826116 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc2d9490-8282-4f3c-9037-105b365a4d45 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/ips" status: 200 len: 149 microversion: 2.1 time: 0.046684 Aug 09 14:38:11.827021 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1009/2024] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:38:11 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:11.832826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-45f54e85-d4c1-4f5e-9f23-4a4c63d3bf11 req-6ebc520f-af75-4d2b-ba7f-2d6c8e7655c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa831790-4a10-456d-bfc3-72ca22cb40a5", "name": "network-vif-plugged", "status": "completed", "tag": "9a914ca2-408c-4fab-9a17-50495a71b5b3"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:11.850592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-45f54e85-d4c1-4f5e-9f23-4a4c63d3bf11 req-6ebc520f-af75-4d2b-ba7f-2d6c8e7655c7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:11.852505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-45f54e85-d4c1-4f5e-9f23-4a4c63d3bf11 req-6ebc520f-af75-4d2b-ba7f-2d6c8e7655c7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:11.853486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-45f54e85-d4c1-4f5e-9f23-4a4c63d3bf11 req-6ebc520f-af75-4d2b-ba7f-2d6c8e7655c7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:11.872337 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-45f54e85-d4c1-4f5e-9f23-4a4c63d3bf11 req-6ebc520f-af75-4d2b-ba7f-2d6c8e7655c7 service nova] Creating event network-vif-plugged:9a914ca2-408c-4fab-9a17-50495a71b5b3 for instance fa831790-4a10-456d-bfc3-72ca22cb40a5 on n-h1-844626-8 Aug 09 14:38:11.878998 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-45f54e85-d4c1-4f5e-9f23-4a4c63d3bf11 req-6ebc520f-af75-4d2b-ba7f-2d6c8e7655c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050227 Aug 09 14:38:11.884518 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1010/2025] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:11.890507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9c135e76-2a93-4cb5-a003-d42d05ad770e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:11.891503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9c135e76-2a93-4cb5-a003-d42d05ad770e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:11.905213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c135e76-2a93-4cb5-a003-d42d05ad770e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:11.905905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c135e76-2a93-4cb5-a003-d42d05ad770e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:11.906511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c135e76-2a93-4cb5-a003-d42d05ad770e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:11.908225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c135e76-2a93-4cb5-a003-d42d05ad770e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:11.908854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c135e76-2a93-4cb5-a003-d42d05ad770e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:11.910067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c135e76-2a93-4cb5-a003-d42d05ad770e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:12.210052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9c135e76-2a93-4cb5-a003-d42d05ad770e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:12.216711 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f300b0cb-db26-4be3-8eff-9adbab2f0c18 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.558488 Aug 09 14:38:12.217880 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1016/2026] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 9 14:38:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:12.225486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bfffcec0-ca92-4004-bb09-5307f7803e9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:12.226253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bfffcec0-ca92-4004-bb09-5307f7803e9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:12.234765 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9c135e76-2a93-4cb5-a003-d42d05ad770e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1382 microversion: 2.1 time: 0.347903 Aug 09 14:38:12.235657 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1011/2027] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:11 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1382 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:12.236063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfffcec0-ca92-4004-bb09-5307f7803e9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:12.236706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfffcec0-ca92-4004-bb09-5307f7803e9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:12.237161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfffcec0-ca92-4004-bb09-5307f7803e9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:12.237948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfffcec0-ca92-4004-bb09-5307f7803e9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:12.238407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfffcec0-ca92-4004-bb09-5307f7803e9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:12.238900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfffcec0-ca92-4004-bb09-5307f7803e9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:12.257583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b0d8365-dcd0-4ec7-bcba-d0ab218eea0c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:12.258244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b0d8365-dcd0-4ec7-bcba-d0ab218eea0c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 0f49c755-de1e-44c2-98de-f6654c0a94a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:12.265788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b0d8365-dcd0-4ec7-bcba-d0ab218eea0c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:12.266548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b0d8365-dcd0-4ec7-bcba-d0ab218eea0c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:12.266695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b0d8365-dcd0-4ec7-bcba-d0ab218eea0c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:12.267556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b0d8365-dcd0-4ec7-bcba-d0ab218eea0c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:12.268160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b0d8365-dcd0-4ec7-bcba-d0ab218eea0c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:12.268580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b0d8365-dcd0-4ec7-bcba-d0ab218eea0c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:12.283025 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4b0d8365-dcd0-4ec7-bcba-d0ab218eea0c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] HTTP exception thrown: Instance 0f49c755-de1e-44c2-98de-f6654c0a94a5 could not be found. Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b0d8365-dcd0-4ec7-bcba-d0ab218eea0c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Request method failure captured: Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 HTTP/1.1 Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m-nEY-BXVJUAYCvJbx2MxtnAO_woEd-x4ozzlUD5NfN1OL1LxcrQg_D1sDTrsL6sa1DAIs2yEdmZDFGaHREGEYTTTrfihQrn3meSTYClf6wUI828uVo601DlSJaswiDNfrp4Lexy4BKDOuwdiEW8COqJbFyTlWGdXCzEEL6Nx457d8 Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.25 Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: d512f92fc41c45edbd209ab51922e5d7 Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1110762263 Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d512f92fc41c45edbd209ab51922e5d7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d512f92fc41c45edbd209ab51922e5d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d512f92fc41c45edbd209ab51922e5d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d512f92fc41c45edbd209ab51922e5d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1110762263 Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: d512f92fc41c45edbd209ab51922e5d7 Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1110762263 Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-LiveAutoBlockMigrationV225Test-1110762263-project Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 247d1747ce074adb8b1e56a459e8cd51 Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1110762263-project Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 0f49c755-de1e-44c2-98de-f6654c0a94a5 could not be found. Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '0f49c755-de1e-44c2-98de-f6654c0a94a5'} Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f49c755-de1e-44c2-98de-f6654c0a94a5 could not be found. Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f49c755-de1e-44c2-98de-f6654c0a94a5 could not be found. Aug 09 14:38:12.284995 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:12.301843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:12.301843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:12.301843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:12.301843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:12.301843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:12.301843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:12.301843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:12.301843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f49c755-de1e-44c2-98de-f6654c0a94a5 could not be found. Aug 09 14:38:12.301843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:12.301843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b0d8365-dcd0-4ec7-bcba-d0ab218eea0c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Returning 404 to user: Instance 0f49c755-de1e-44c2-98de-f6654c0a94a5 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:12.301843 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b0d8365-dcd0-4ec7-bcba-d0ab218eea0c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5" status: 404 len: 111 microversion: 2.25 time: 0.049004 Aug 09 14:38:12.301843 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1012/2028] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:38:12 2022] GET /compute/v2.1/servers/0f49c755-de1e-44c2-98de-f6654c0a94a5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:38:12.441557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bfffcec0-ca92-4004-bb09-5307f7803e9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:12.460830 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bfffcec0-ca92-4004-bb09-5307f7803e9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1471 microversion: 2.1 time: 0.241459 Aug 09 14:38:12.479499 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1017/2029] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:12 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1471 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:12.487185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7fe07b48-b7fb-4925-9e8c-22d9011675d8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:12.487987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7fe07b48-b7fb-4925-9e8c-22d9011675d8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:12.503223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-14ba966e-7556-431b-9e98-f29b5c46894f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:12.504045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-14ba966e-7556-431b-9e98-f29b5c46894f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:12.510224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14ba966e-7556-431b-9e98-f29b5c46894f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:12.510711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14ba966e-7556-431b-9e98-f29b5c46894f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:12.512673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fe07b48-b7fb-4925-9e8c-22d9011675d8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:12.513153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fe07b48-b7fb-4925-9e8c-22d9011675d8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:12.513789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fe07b48-b7fb-4925-9e8c-22d9011675d8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:12.514257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fe07b48-b7fb-4925-9e8c-22d9011675d8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:12.514695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fe07b48-b7fb-4925-9e8c-22d9011675d8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:12.518484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14ba966e-7556-431b-9e98-f29b5c46894f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:12.519326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14ba966e-7556-431b-9e98-f29b5c46894f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:12.519899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14ba966e-7556-431b-9e98-f29b5c46894f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:12.520358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-14ba966e-7556-431b-9e98-f29b5c46894f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:12.521509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fe07b48-b7fb-4925-9e8c-22d9011675d8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:12.558067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7fe07b48-b7fb-4925-9e8c-22d9011675d8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:38:12.680839 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7fe07b48-b7fb-4925-9e8c-22d9011675d8 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "DELETE /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 204 len: 0 microversion: 2.25 time: 0.197057 Aug 09 14:38:12.683014 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1018/2030] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:38:12 2022] DELETE /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:38:12.688691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-90082724", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "8e5664a1-4e3d-47e9-ac93-f7a76fb16596"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:12.769431 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-14ba966e-7556-431b-9e98-f29b5c46894f tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1533 microversion: 2.1 time: 0.476107 Aug 09 14:38:12.776070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] validate_networks() for [('8e5664a1-4e3d-47e9-ac93-f7a76fb16596', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:38:12.778897 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1013/2031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:12 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1533 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:12.794138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67913174-7cf0-404a-9640-9216f7bab03b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:12.796102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-67913174-7cf0-404a-9640-9216f7bab03b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:12.802966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67913174-7cf0-404a-9640-9216f7bab03b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:12.803775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67913174-7cf0-404a-9640-9216f7bab03b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:12.804392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67913174-7cf0-404a-9640-9216f7bab03b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:12.805281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67913174-7cf0-404a-9640-9216f7bab03b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:12.805892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67913174-7cf0-404a-9640-9216f7bab03b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:12.806488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67913174-7cf0-404a-9640-9216f7bab03b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:13.353607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-67913174-7cf0-404a-9640-9216f7bab03b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:13.397145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-67913174-7cf0-404a-9640-9216f7bab03b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:13.399449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-67913174-7cf0-404a-9640-9216f7bab03b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:13.411001 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-67913174-7cf0-404a-9640-9216f7bab03b tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1564 microversion: 2.25 time: 0.624343 Aug 09 14:38:13.416393 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1014/2032] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:38:12 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1564 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:38:13.429761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ac69cfe-f162-4f55-8b7c-8d0d7e76698c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:13.430391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1ac69cfe-f162-4f55-8b7c-8d0d7e76698c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:13.449973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ac69cfe-f162-4f55-8b7c-8d0d7e76698c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:13.450533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ac69cfe-f162-4f55-8b7c-8d0d7e76698c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:13.450974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ac69cfe-f162-4f55-8b7c-8d0d7e76698c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:13.451756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ac69cfe-f162-4f55-8b7c-8d0d7e76698c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:13.456410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ac69cfe-f162-4f55-8b7c-8d0d7e76698c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:13.457838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ac69cfe-f162-4f55-8b7c-8d0d7e76698c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:13.509896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=10 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:13.804364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:38:13.805447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:38:13.806090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:38:13.806670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:38:13.807109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:38:13.836632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:13.837128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:13.837559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:13.838303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:13.838765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:13.839223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:13.880120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Getting quotas for project 46d8cf5b02944869a9ad2541a4e2af62. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:38:13.897670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Getting quotas for user 6275c73b47be44c4a646761442343063 and project 46d8cf5b02944869a9ad2541a4e2af62. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:38:13.925534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:38:13.931211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:38:14.059533 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-441627d6-cef9-4a1e-a49c-691f4f824f98 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.374832 Aug 09 14:38:14.069083 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1019/2033] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:38:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:38:14.077352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3f1dc6ad-5682-4719-9fbf-d253463e8f23 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:14.079195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3f1dc6ad-5682-4719-9fbf-d253463e8f23 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:14.094710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f1dc6ad-5682-4719-9fbf-d253463e8f23 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:14.095232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f1dc6ad-5682-4719-9fbf-d253463e8f23 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:14.095663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f1dc6ad-5682-4719-9fbf-d253463e8f23 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:14.096358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f1dc6ad-5682-4719-9fbf-d253463e8f23 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:14.096981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f1dc6ad-5682-4719-9fbf-d253463e8f23 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:14.097554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f1dc6ad-5682-4719-9fbf-d253463e8f23 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:14.199671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1ac69cfe-f162-4f55-8b7c-8d0d7e76698c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:14.210899 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1ac69cfe-f162-4f55-8b7c-8d0d7e76698c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1367 microversion: 2.1 time: 0.792053 Aug 09 14:38:14.214018 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1015/2034] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:13 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1367 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:14.221716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ff77725f-c201-4f24-a02d-242df17ff529 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:14.222803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ff77725f-c201-4f24-a02d-242df17ff529 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:14.240964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff77725f-c201-4f24-a02d-242df17ff529 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:14.245312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff77725f-c201-4f24-a02d-242df17ff529 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:14.245774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff77725f-c201-4f24-a02d-242df17ff529 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:14.246565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff77725f-c201-4f24-a02d-242df17ff529 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:14.247019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff77725f-c201-4f24-a02d-242df17ff529 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:14.247468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff77725f-c201-4f24-a02d-242df17ff529 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:14.616150 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3f1dc6ad-5682-4719-9fbf-d253463e8f23 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1533 microversion: 2.1 time: 0.542545 Aug 09 14:38:14.627535 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1020/2035] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:14 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1533 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:14.627535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5371ca2d-8b0e-4e4f-9fc2-e63998e83bce tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:14.627535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5371ca2d-8b0e-4e4f-9fc2-e63998e83bce tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:14.765684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5371ca2d-8b0e-4e4f-9fc2-e63998e83bce tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:14.774047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ff77725f-c201-4f24-a02d-242df17ff529 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:14.781765 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5371ca2d-8b0e-4e4f-9fc2-e63998e83bce tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1222 microversion: 2.1 time: 0.162513 Aug 09 14:38:14.784165 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ff77725f-c201-4f24-a02d-242df17ff529 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1471 microversion: 2.1 time: 0.567842 Aug 09 14:38:14.785570 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1016/2036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:14 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1471 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:14.797997 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1021/2037] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:14 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1222 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:14.805894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-841c8b18-fff3-4753-ada3-fdc905cc85c6 req-301ae228-b21d-40f9-b000-f8bae9513bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50063b74-64e4-46e0-a842-cfd6735d25ac", "name": "network-vif-deleted", "tag": "fc3132c5-cc58-4ae3-a9ab-ada9e2c1a56d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:14.814439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:14.815097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:14.824828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-841c8b18-fff3-4753-ada3-fdc905cc85c6 req-301ae228-b21d-40f9-b000-f8bae9513bf5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:14.825537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-841c8b18-fff3-4753-ada3-fdc905cc85c6 req-301ae228-b21d-40f9-b000-f8bae9513bf5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:14.826176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-841c8b18-fff3-4753-ada3-fdc905cc85c6 req-301ae228-b21d-40f9-b000-f8bae9513bf5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:14.838647 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-841c8b18-fff3-4753-ada3-fdc905cc85c6 req-301ae228-b21d-40f9-b000-f8bae9513bf5 service nova] Creating event network-vif-deleted:fc3132c5-cc58-4ae3-a9ab-ada9e2c1a56d for instance 50063b74-64e4-46e0-a842-cfd6735d25ac on n-h2-844626-8 Aug 09 14:38:14.843696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:14.845268 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-841c8b18-fff3-4753-ada3-fdc905cc85c6 req-301ae228-b21d-40f9-b000-f8bae9513bf5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045126 Aug 09 14:38:14.847265 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1022/2038] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:14.847421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:14.848768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:14.851425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:14.853312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:14.853806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:14.854533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1369f041-5723-4549-ade3-cbae7ae1eba8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0ddaa94-4090-423a-8602-716b54fddb0f"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:14.858252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1369f041-5723-4549-ade3-cbae7ae1eba8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:14.865412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1369f041-5723-4549-ade3-cbae7ae1eba8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:14.867813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1369f041-5723-4549-ade3-cbae7ae1eba8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:14.868420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1369f041-5723-4549-ade3-cbae7ae1eba8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:14.869255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1369f041-5723-4549-ade3-cbae7ae1eba8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:14.869714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1369f041-5723-4549-ade3-cbae7ae1eba8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:14.870436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1369f041-5723-4549-ade3-cbae7ae1eba8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:14.935918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:14.936553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:14.937022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:14.937564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lazy-loading 'fault' on Instance uuid 50063b74-64e4-46e0-a842-cfd6735d25ac {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:38:15.073494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:15.100112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:15.111948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '247d1747ce074adb8b1e56a459e8cd51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd512f92fc41c45edbd209ab51922e5d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:15.113061 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a6866dd-dbdd-4ebb-bff5-12a05b80a39c tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 200 len: 1351 microversion: 2.25 time: 0.313627 Aug 09 14:38:15.126737 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1017/2039] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:38:14 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 1351 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:38:15.133742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fa46b384-ca56-4c2b-a06b-4ca7dc998e55 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:15.148082 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:38:15.148082 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:38:15.150400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa46b384-ca56-4c2b-a06b-4ca7dc998e55 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:15.150913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa46b384-ca56-4c2b-a06b-4ca7dc998e55 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:15.153411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa46b384-ca56-4c2b-a06b-4ca7dc998e55 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:15.156834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa46b384-ca56-4c2b-a06b-4ca7dc998e55 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:15.157527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa46b384-ca56-4c2b-a06b-4ca7dc998e55 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:15.157964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa46b384-ca56-4c2b-a06b-4ca7dc998e55 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:15.202041 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fa46b384-ca56-4c2b-a06b-4ca7dc998e55 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.073788 Aug 09 14:38:15.203020 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1018/2040] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 9 14:38:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:15.216682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e6c80095-53c0-4a1a-bb22-020d012e9756 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-844626-8", "block_migration": false, "disk_over_commit": false}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:15.220648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e6c80095-53c0-4a1a-bb22-020d012e9756 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:15.227887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6c80095-53c0-4a1a-bb22-020d012e9756 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:15.229517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6c80095-53c0-4a1a-bb22-020d012e9756 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:15.230121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6c80095-53c0-4a1a-bb22-020d012e9756 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:15.231326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6c80095-53c0-4a1a-bb22-020d012e9756 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:15.232075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6c80095-53c0-4a1a-bb22-020d012e9756 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:15.232816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6c80095-53c0-4a1a-bb22-020d012e9756 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:15.272330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-e6c80095-53c0-4a1a-bb22-020d012e9756 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lazy-loading 'flavor' on Instance uuid c508aaa8-11d1-4593-b840-91b8295b6f8e {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:38:15.299258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e6c80095-53c0-4a1a-bb22-020d012e9756 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Going to try to live migrate instance to n-h1-844626-8 {{(pid=119406) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 14:38:15.472243 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1369f041-5723-4549-ade3-cbae7ae1eba8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.622867 Aug 09 14:38:15.474266 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1023/2041] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 14:38:14 2022] POST /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments => generated 194 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:15.495803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-56694f35-403b-4723-9038-2000fcfc4529 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:15.496628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-56694f35-403b-4723-9038-2000fcfc4529 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:15.518512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56694f35-403b-4723-9038-2000fcfc4529 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:15.519476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56694f35-403b-4723-9038-2000fcfc4529 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:15.520919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56694f35-403b-4723-9038-2000fcfc4529 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:15.521865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56694f35-403b-4723-9038-2000fcfc4529 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:15.529821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56694f35-403b-4723-9038-2000fcfc4529 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:15.531411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56694f35-403b-4723-9038-2000fcfc4529 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:15.808494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-56694f35-403b-4723-9038-2000fcfc4529 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:15.818153 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-56694f35-403b-4723-9038-2000fcfc4529 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1556 microversion: 2.1 time: 0.341512 Aug 09 14:38:15.831503 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1024/2042] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:15 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1556 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:15.838675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-90d6a738-26bf-4f01-9f26-b6b3b946aa3a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:15.839578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-90d6a738-26bf-4f01-9f26-b6b3b946aa3a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:15.848028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d6a738-26bf-4f01-9f26-b6b3b946aa3a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:15.848759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d6a738-26bf-4f01-9f26-b6b3b946aa3a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:15.849349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d6a738-26bf-4f01-9f26-b6b3b946aa3a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:15.850205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d6a738-26bf-4f01-9f26-b6b3b946aa3a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:15.850867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d6a738-26bf-4f01-9f26-b6b3b946aa3a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:15.851466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90d6a738-26bf-4f01-9f26-b6b3b946aa3a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:15.950180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-90d6a738-26bf-4f01-9f26-b6b3b946aa3a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:15.959986 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-90d6a738-26bf-4f01-9f26-b6b3b946aa3a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1274 microversion: 2.1 time: 0.127202 Aug 09 14:38:15.960726 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1025/2043] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:15 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:15.966659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3209106e-3bb4-416f-9dbc-d5851804a8d7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:15.967496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3209106e-3bb4-416f-9dbc-d5851804a8d7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:15.974534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3209106e-3bb4-416f-9dbc-d5851804a8d7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:15.975269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3209106e-3bb4-416f-9dbc-d5851804a8d7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:15.975871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3209106e-3bb4-416f-9dbc-d5851804a8d7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:15.976773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3209106e-3bb4-416f-9dbc-d5851804a8d7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:15.977442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3209106e-3bb4-416f-9dbc-d5851804a8d7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:15.978101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3209106e-3bb4-416f-9dbc-d5851804a8d7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:16.228284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3209106e-3bb4-416f-9dbc-d5851804a8d7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:16.246203 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3209106e-3bb4-416f-9dbc-d5851804a8d7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1471 microversion: 2.1 time: 0.284075 Aug 09 14:38:16.246864 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1026/2044] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:15 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1471 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:16.263261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2dd6e114-461c-419c-82ef-31eb7d7ccf06 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:16.263973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2dd6e114-461c-419c-82ef-31eb7d7ccf06 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:16.278841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dd6e114-461c-419c-82ef-31eb7d7ccf06 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:16.279643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dd6e114-461c-419c-82ef-31eb7d7ccf06 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:16.280265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dd6e114-461c-419c-82ef-31eb7d7ccf06 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:16.281133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dd6e114-461c-419c-82ef-31eb7d7ccf06 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:16.281737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dd6e114-461c-419c-82ef-31eb7d7ccf06 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:16.282307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dd6e114-461c-419c-82ef-31eb7d7ccf06 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:16.410312 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2dd6e114-461c-419c-82ef-31eb7d7ccf06 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162317 Aug 09 14:38:16.410915 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1027/2045] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:38:16 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:16.430512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-828bf686-59cf-4e38-994b-ebb7d0b7fb83 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:16.431723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-828bf686-59cf-4e38-994b-ebb7d0b7fb83 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] [instance: 50063b74-64e4-46e0-a842-cfd6735d25ac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:16.446545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-828bf686-59cf-4e38-994b-ebb7d0b7fb83 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:16.447410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-828bf686-59cf-4e38-994b-ebb7d0b7fb83 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:16.448118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-828bf686-59cf-4e38-994b-ebb7d0b7fb83 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:16.451358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-828bf686-59cf-4e38-994b-ebb7d0b7fb83 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:16.452077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-828bf686-59cf-4e38-994b-ebb7d0b7fb83 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:16.452699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-828bf686-59cf-4e38-994b-ebb7d0b7fb83 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:16.488690 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-828bf686-59cf-4e38-994b-ebb7d0b7fb83 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] HTTP exception thrown: Instance 50063b74-64e4-46e0-a842-cfd6735d25ac could not be found. Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-828bf686-59cf-4e38-994b-ebb7d0b7fb83 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Request method failure captured: Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac HTTP/1.1 Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m-nEY-BXVJUAYCvJbx2MxtnAO_woEd-x4ozzlUD5NfN1OL1LxcrQg_D1sDTrsL6sa1DAIs2yEdmZDFGaHREGEYTTTrfihQrn3meSTYClf6wUI828uVo601DlSJaswiDNfrp4Lexy4BKDOuwdiEW8COqJbFyTlWGdXCzEEL6Nx457d8 Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.25 Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: d512f92fc41c45edbd209ab51922e5d7 Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1110762263 Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d512f92fc41c45edbd209ab51922e5d7", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d512f92fc41c45edbd209ab51922e5d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d512f92fc41c45edbd209ab51922e5d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d512f92fc41c45edbd209ab51922e5d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1110762263 Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: d512f92fc41c45edbd209ab51922e5d7 Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1110762263 Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-LiveAutoBlockMigrationV225Test-1110762263-project Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 247d1747ce074adb8b1e56a459e8cd51 Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1110762263-project Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 50063b74-64e4-46e0-a842-cfd6735d25ac could not be found. Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '50063b74-64e4-46e0-a842-cfd6735d25ac'} Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50063b74-64e4-46e0-a842-cfd6735d25ac could not be found. Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50063b74-64e4-46e0-a842-cfd6735d25ac could not be found. Aug 09 14:38:16.490380 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:16.495824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:16.495824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:16.495824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:16.495824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:16.495824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:16.495824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:16.495824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:16.495824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50063b74-64e4-46e0-a842-cfd6735d25ac could not be found. Aug 09 14:38:16.495824 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:16.495824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-828bf686-59cf-4e38-994b-ebb7d0b7fb83 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] Returning 404 to user: Instance 50063b74-64e4-46e0-a842-cfd6735d25ac could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:16.495824 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-828bf686-59cf-4e38-994b-ebb7d0b7fb83 tempest-LiveAutoBlockMigrationV225Test-1110762263 tempest-LiveAutoBlockMigrationV225Test-1110762263-project] 10.222.0.50 "GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac" status: 404 len: 111 microversion: 2.25 time: 0.065182 Aug 09 14:38:16.504679 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1028/2046] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:38:16 2022] GET /compute/v2.1/servers/50063b74-64e4-46e0-a842-cfd6735d25ac => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:38:16.983757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c7ac2fd6-71c1-422e-834a-852dd37554c5 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:16.985393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c7ac2fd6-71c1-422e-834a-852dd37554c5 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:16.996557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7ac2fd6-71c1-422e-834a-852dd37554c5 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:16.999123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7ac2fd6-71c1-422e-834a-852dd37554c5 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:17.000125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7ac2fd6-71c1-422e-834a-852dd37554c5 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:17.001876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7ac2fd6-71c1-422e-834a-852dd37554c5 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:17.002587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7ac2fd6-71c1-422e-834a-852dd37554c5 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:17.007553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7ac2fd6-71c1-422e-834a-852dd37554c5 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:17.230083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c7ac2fd6-71c1-422e-834a-852dd37554c5 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:17.248701 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c7ac2fd6-71c1-422e-834a-852dd37554c5 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1280 microversion: 2.1 time: 0.270577 Aug 09 14:38:17.252430 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1029/2047] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:16 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:17.271981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4bd4ea87-56a5-4c2a-94a2-076170300655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:17.273030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4bd4ea87-56a5-4c2a-94a2-076170300655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:17.285799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4bd4ea87-56a5-4c2a-94a2-076170300655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:17.288251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4bd4ea87-56a5-4c2a-94a2-076170300655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:17.288926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4bd4ea87-56a5-4c2a-94a2-076170300655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:17.293856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4bd4ea87-56a5-4c2a-94a2-076170300655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:17.295366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4bd4ea87-56a5-4c2a-94a2-076170300655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:17.296356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4bd4ea87-56a5-4c2a-94a2-076170300655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:17.849683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4bd4ea87-56a5-4c2a-94a2-076170300655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:17.863736 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4bd4ea87-56a5-4c2a-94a2-076170300655 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1471 microversion: 2.1 time: 0.597544 Aug 09 14:38:17.868858 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1030/2048] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:17 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1471 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:18.274146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-77618265-24b3-4007-ba8a-ea8adfba8fd2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:18.274789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-77618265-24b3-4007-ba8a-ea8adfba8fd2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:18.283179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77618265-24b3-4007-ba8a-ea8adfba8fd2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:18.283668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77618265-24b3-4007-ba8a-ea8adfba8fd2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:18.284088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77618265-24b3-4007-ba8a-ea8adfba8fd2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:18.284792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77618265-24b3-4007-ba8a-ea8adfba8fd2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:18.285224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77618265-24b3-4007-ba8a-ea8adfba8fd2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:18.285640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77618265-24b3-4007-ba8a-ea8adfba8fd2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:18.351976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:19.252537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-77618265-24b3-4007-ba8a-ea8adfba8fd2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:19.267056 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-77618265-24b3-4007-ba8a-ea8adfba8fd2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1322 microversion: 2.1 time: 0.994111 Aug 09 14:38:19.268532 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1031/2049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:18 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1322 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:38:19.279551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da39889b-1045-4381-98b2-550cf740c7d3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:19.283699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da39889b-1045-4381-98b2-550cf740c7d3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:19.302245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da39889b-1045-4381-98b2-550cf740c7d3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:19.303123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da39889b-1045-4381-98b2-550cf740c7d3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:19.303733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da39889b-1045-4381-98b2-550cf740c7d3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:19.304651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da39889b-1045-4381-98b2-550cf740c7d3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:19.306692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da39889b-1045-4381-98b2-550cf740c7d3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:19.307329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da39889b-1045-4381-98b2-550cf740c7d3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:19.735470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-da39889b-1045-4381-98b2-550cf740c7d3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:19.748376 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da39889b-1045-4381-98b2-550cf740c7d3 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1477 microversion: 2.1 time: 0.478215 Aug 09 14:38:19.749033 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1032/2050] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:19 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1477 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:19.768899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-6617afc1-4029-4813-841b-470467961195 req-600c6e28-f6fb-48b1-a639-377275cf0fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa831790-4a10-456d-bfc3-72ca22cb40a5", "tag": "9a914ca2-408c-4fab-9a17-50495a71b5b3"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:19.815808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6617afc1-4029-4813-841b-470467961195 req-600c6e28-f6fb-48b1-a639-377275cf0fd2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:19.816272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6617afc1-4029-4813-841b-470467961195 req-600c6e28-f6fb-48b1-a639-377275cf0fd2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:19.816891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6617afc1-4029-4813-841b-470467961195 req-600c6e28-f6fb-48b1-a639-377275cf0fd2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:19.837688 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-6617afc1-4029-4813-841b-470467961195 req-600c6e28-f6fb-48b1-a639-377275cf0fd2 service nova] Creating event network-changed:9a914ca2-408c-4fab-9a17-50495a71b5b3 for instance fa831790-4a10-456d-bfc3-72ca22cb40a5 on n-h1-844626-8 Aug 09 14:38:19.853092 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-6617afc1-4029-4813-841b-470467961195 req-600c6e28-f6fb-48b1-a639-377275cf0fd2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096050 Aug 09 14:38:19.854417 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1033/2051] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:20.298134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ffa68d7f-57e1-4413-822e-584c74a0fe76 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:20.298905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffa68d7f-57e1-4413-822e-584c74a0fe76 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:20.320015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffa68d7f-57e1-4413-822e-584c74a0fe76 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:20.320496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffa68d7f-57e1-4413-822e-584c74a0fe76 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:20.323133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffa68d7f-57e1-4413-822e-584c74a0fe76 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:20.330956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffa68d7f-57e1-4413-822e-584c74a0fe76 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:20.334213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffa68d7f-57e1-4413-822e-584c74a0fe76 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:20.334857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffa68d7f-57e1-4413-822e-584c74a0fe76 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:21.201233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffa68d7f-57e1-4413-822e-584c74a0fe76 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:21.213400 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ffa68d7f-57e1-4413-822e-584c74a0fe76 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1322 microversion: 2.1 time: 0.925317 Aug 09 14:38:21.214538 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1034/2052] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:20 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1322 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:21.222437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0d22821f-7574-41cd-931b-ddcd565a7a1e req-4c7b3997-2dda-44b4-86c1-474c5e5f2b0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c52cb1b7-ac29-4831-9cdc-c780890bb79b", "tag": "f7499fd5-59fc-4400-9c2c-8c34b7007aea"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:21.247388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0d22821f-7574-41cd-931b-ddcd565a7a1e req-4c7b3997-2dda-44b4-86c1-474c5e5f2b0e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:21.248176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0d22821f-7574-41cd-931b-ddcd565a7a1e req-4c7b3997-2dda-44b4-86c1-474c5e5f2b0e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:21.248765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0d22821f-7574-41cd-931b-ddcd565a7a1e req-4c7b3997-2dda-44b4-86c1-474c5e5f2b0e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:21.276247 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0d22821f-7574-41cd-931b-ddcd565a7a1e req-4c7b3997-2dda-44b4-86c1-474c5e5f2b0e service nova] Creating event network-changed:f7499fd5-59fc-4400-9c2c-8c34b7007aea for instance c52cb1b7-ac29-4831-9cdc-c780890bb79b on n-h2-844626-8 Aug 09 14:38:21.293067 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0d22821f-7574-41cd-931b-ddcd565a7a1e req-4c7b3997-2dda-44b4-86c1-474c5e5f2b0e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077016 Aug 09 14:38:21.294300 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1035/2053] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:21.299778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b38f34f-7a54-470c-b8f1-228de6ec2619 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:21.307994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b38f34f-7a54-470c-b8f1-228de6ec2619 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:21.317676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b38f34f-7a54-470c-b8f1-228de6ec2619 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:21.318416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b38f34f-7a54-470c-b8f1-228de6ec2619 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:21.319028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b38f34f-7a54-470c-b8f1-228de6ec2619 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:21.321283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b38f34f-7a54-470c-b8f1-228de6ec2619 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:21.321283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b38f34f-7a54-470c-b8f1-228de6ec2619 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:21.321283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b38f34f-7a54-470c-b8f1-228de6ec2619 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:21.720979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b38f34f-7a54-470c-b8f1-228de6ec2619 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:21.730150 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b38f34f-7a54-470c-b8f1-228de6ec2619 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1477 microversion: 2.1 time: 0.434641 Aug 09 14:38:21.736955 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1036/2054] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:21 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1477 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:22.117576 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e6c80095-53c0-4a1a-bb22-020d012e9756 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e/action" status: 202 len: 0 microversion: 2.1 time: 6.905427 Aug 09 14:38:22.124490 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1019/2055] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:38:15 2022] POST /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e/action => generated 0 bytes in 6910 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 14:38:22.138974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60cfb1d1-fc2e-456b-8f24-f40e0738f212 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:22.139916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-60cfb1d1-fc2e-456b-8f24-f40e0738f212 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:22.149016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60cfb1d1-fc2e-456b-8f24-f40e0738f212 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:22.149420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60cfb1d1-fc2e-456b-8f24-f40e0738f212 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:22.150440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60cfb1d1-fc2e-456b-8f24-f40e0738f212 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:22.152184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60cfb1d1-fc2e-456b-8f24-f40e0738f212 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:22.153142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60cfb1d1-fc2e-456b-8f24-f40e0738f212 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:22.154369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60cfb1d1-fc2e-456b-8f24-f40e0738f212 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:22.243817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-54741753-a5b5-4186-a291-2ef741d05ddb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:22.244939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-54741753-a5b5-4186-a291-2ef741d05ddb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:22.273694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54741753-a5b5-4186-a291-2ef741d05ddb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:22.274646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54741753-a5b5-4186-a291-2ef741d05ddb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:22.275354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54741753-a5b5-4186-a291-2ef741d05ddb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:22.276383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54741753-a5b5-4186-a291-2ef741d05ddb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:22.277063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54741753-a5b5-4186-a291-2ef741d05ddb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:22.277786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54741753-a5b5-4186-a291-2ef741d05ddb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:22.306439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:22.809847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60cfb1d1-fc2e-456b-8f24-f40e0738f212 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:22.834074 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60cfb1d1-fc2e-456b-8f24-f40e0738f212 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.707586 Aug 09 14:38:22.836324 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1037/2056] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:22 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:22.853948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d5b9a6f-6b90-4a54-b087-bb0a1013a965 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:22.857136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d5b9a6f-6b90-4a54-b087-bb0a1013a965 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:22.884222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d5b9a6f-6b90-4a54-b087-bb0a1013a965 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:22.885222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d5b9a6f-6b90-4a54-b087-bb0a1013a965 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:22.886043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d5b9a6f-6b90-4a54-b087-bb0a1013a965 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:22.887202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d5b9a6f-6b90-4a54-b087-bb0a1013a965 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:22.888048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d5b9a6f-6b90-4a54-b087-bb0a1013a965 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:22.889756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d5b9a6f-6b90-4a54-b087-bb0a1013a965 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:23.857390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=12 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:24.003767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-54741753-a5b5-4186-a291-2ef741d05ddb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:24.034307 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-54741753-a5b5-4186-a291-2ef741d05ddb tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1322 microversion: 2.1 time: 1.802878 Aug 09 14:38:24.044037 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1020/2057] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:22 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1322 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:24.072432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-407a58f7-1e11-4339-af25-5fa032c3e31d req-cb9264b6-57ad-4d30-960d-2b11ef64088a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce57f31b-ee4d-4e34-9f08-5de27e71d393", "name": "network-vif-unplugged", "status": "completed", "tag": "e1d8480a-75cc-470c-9389-4486ebc228d7"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:24.133322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-407a58f7-1e11-4339-af25-5fa032c3e31d req-cb9264b6-57ad-4d30-960d-2b11ef64088a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:24.135191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-407a58f7-1e11-4339-af25-5fa032c3e31d req-cb9264b6-57ad-4d30-960d-2b11ef64088a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:24.137803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-407a58f7-1e11-4339-af25-5fa032c3e31d req-cb9264b6-57ad-4d30-960d-2b11ef64088a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:24.161201 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-407a58f7-1e11-4339-af25-5fa032c3e31d req-cb9264b6-57ad-4d30-960d-2b11ef64088a service nova] Creating event network-vif-unplugged:e1d8480a-75cc-470c-9389-4486ebc228d7 for instance ce57f31b-ee4d-4e34-9f08-5de27e71d393 on n-h1-844626-8 Aug 09 14:38:24.170166 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-407a58f7-1e11-4339-af25-5fa032c3e31d req-cb9264b6-57ad-4d30-960d-2b11ef64088a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119755 Aug 09 14:38:24.172346 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1021/2058] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:24.178619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0d8d077-a520-4cd7-b767-4005cd845c40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:24.179689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0d8d077-a520-4cd7-b767-4005cd845c40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:24.188121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0d8d077-a520-4cd7-b767-4005cd845c40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:24.189014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0d8d077-a520-4cd7-b767-4005cd845c40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:24.189913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0d8d077-a520-4cd7-b767-4005cd845c40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:24.190893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0d8d077-a520-4cd7-b767-4005cd845c40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:24.192757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0d8d077-a520-4cd7-b767-4005cd845c40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:24.194630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0d8d077-a520-4cd7-b767-4005cd845c40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:24.412539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d5b9a6f-6b90-4a54-b087-bb0a1013a965 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:24.433372 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d5b9a6f-6b90-4a54-b087-bb0a1013a965 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1477 microversion: 2.1 time: 1.594699 Aug 09 14:38:24.435721 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1038/2059] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:22 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1477 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:24.762947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0d8d077-a520-4cd7-b767-4005cd845c40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:24.779169 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0d8d077-a520-4cd7-b767-4005cd845c40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.604383 Aug 09 14:38:24.780120 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1022/2060] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:24 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:25.066448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06653e8d-297b-4600-9d57-3302cda0a42d tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:25.068028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06653e8d-297b-4600-9d57-3302cda0a42d tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:25.075742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:25.080480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06653e8d-297b-4600-9d57-3302cda0a42d tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:25.081201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06653e8d-297b-4600-9d57-3302cda0a42d tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:25.081827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06653e8d-297b-4600-9d57-3302cda0a42d tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:25.084835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06653e8d-297b-4600-9d57-3302cda0a42d tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:25.085745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06653e8d-297b-4600-9d57-3302cda0a42d tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:25.086605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06653e8d-297b-4600-9d57-3302cda0a42d tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:25.460399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-307a780e-bfed-4597-b194-cd37643d67fe tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:25.461005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-307a780e-bfed-4597-b194-cd37643d67fe tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:25.475379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:25.504659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-307a780e-bfed-4597-b194-cd37643d67fe tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:25.509084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-307a780e-bfed-4597-b194-cd37643d67fe tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:25.510857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-307a780e-bfed-4597-b194-cd37643d67fe tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:25.513018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-307a780e-bfed-4597-b194-cd37643d67fe tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:25.513496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-307a780e-bfed-4597-b194-cd37643d67fe tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:25.516931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-307a780e-bfed-4597-b194-cd37643d67fe tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:25.544480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-06653e8d-297b-4600-9d57-3302cda0a42d tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:25.560411 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06653e8d-297b-4600-9d57-3302cda0a42d tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1322 microversion: 2.1 time: 0.500081 Aug 09 14:38:25.569840 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1039/2061] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:25 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:25.801268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b2c89df-6149-4007-bf69-4a777b307387 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:25.802485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0b2c89df-6149-4007-bf69-4a777b307387 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:25.816426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b2c89df-6149-4007-bf69-4a777b307387 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:25.816924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b2c89df-6149-4007-bf69-4a777b307387 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:25.817361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b2c89df-6149-4007-bf69-4a777b307387 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:25.818083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b2c89df-6149-4007-bf69-4a777b307387 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:25.818529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b2c89df-6149-4007-bf69-4a777b307387 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:25.818960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b2c89df-6149-4007-bf69-4a777b307387 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:25.836518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-307a780e-bfed-4597-b194-cd37643d67fe tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:25.848892 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-307a780e-bfed-4597-b194-cd37643d67fe tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1477 microversion: 2.1 time: 0.391024 Aug 09 14:38:25.849521 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1023/2062] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:25 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:38:26.089752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0b2c89df-6149-4007-bf69-4a777b307387 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:26.100139 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b2c89df-6149-4007-bf69-4a777b307387 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.301992 Aug 09 14:38:26.117686 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1040/2063] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:25 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:26.591985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-53e22e11-7263-4993-b6bb-8f1a6b38fcaf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:26.596636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53e22e11-7263-4993-b6bb-8f1a6b38fcaf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:26.613048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53e22e11-7263-4993-b6bb-8f1a6b38fcaf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:26.614313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53e22e11-7263-4993-b6bb-8f1a6b38fcaf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:26.615940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53e22e11-7263-4993-b6bb-8f1a6b38fcaf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:26.621998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53e22e11-7263-4993-b6bb-8f1a6b38fcaf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:26.622724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53e22e11-7263-4993-b6bb-8f1a6b38fcaf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:26.623377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53e22e11-7263-4993-b6bb-8f1a6b38fcaf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:26.874605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99d66d5b-a198-4a4e-b54b-f03e8f792c77 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:26.875276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-99d66d5b-a198-4a4e-b54b-f03e8f792c77 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:26.889206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99d66d5b-a198-4a4e-b54b-f03e8f792c77 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:26.889688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99d66d5b-a198-4a4e-b54b-f03e8f792c77 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:26.890117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99d66d5b-a198-4a4e-b54b-f03e8f792c77 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:26.890825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99d66d5b-a198-4a4e-b54b-f03e8f792c77 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:26.891303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99d66d5b-a198-4a4e-b54b-f03e8f792c77 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:26.891718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99d66d5b-a198-4a4e-b54b-f03e8f792c77 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:26.994856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-53e22e11-7263-4993-b6bb-8f1a6b38fcaf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:27.010501 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-53e22e11-7263-4993-b6bb-8f1a6b38fcaf tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1322 microversion: 2.1 time: 0.422291 Aug 09 14:38:27.011256 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1024/2064] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:26 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:27.123239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43d6283d-699a-43a9-8004-9718cef041f2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:27.124241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-43d6283d-699a-43a9-8004-9718cef041f2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:27.136893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d6283d-699a-43a9-8004-9718cef041f2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:27.137586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d6283d-699a-43a9-8004-9718cef041f2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:27.142036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d6283d-699a-43a9-8004-9718cef041f2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:27.142912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d6283d-699a-43a9-8004-9718cef041f2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:27.143519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d6283d-699a-43a9-8004-9718cef041f2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:27.144056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43d6283d-699a-43a9-8004-9718cef041f2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:27.333848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-99d66d5b-a198-4a4e-b54b-f03e8f792c77 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:27.344525 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99d66d5b-a198-4a4e-b54b-f03e8f792c77 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1477 microversion: 2.1 time: 0.476499 Aug 09 14:38:27.351063 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1041/2065] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:26 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1477 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:38:27.489314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-43d6283d-699a-43a9-8004-9718cef041f2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:27.498999 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-43d6283d-699a-43a9-8004-9718cef041f2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.381905 Aug 09 14:38:27.512818 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1025/2066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:27 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:27.687373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-19a35185-34a6-4eb2-ba16-8ac793cda10d req-e09923cb-999d-4470-b686-efc24b6d6110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce57f31b-ee4d-4e34-9f08-5de27e71d393", "name": "network-vif-plugged", "status": "completed", "tag": "e1d8480a-75cc-470c-9389-4486ebc228d7"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:27.710762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-19a35185-34a6-4eb2-ba16-8ac793cda10d req-e09923cb-999d-4470-b686-efc24b6d6110 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:27.711690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-19a35185-34a6-4eb2-ba16-8ac793cda10d req-e09923cb-999d-4470-b686-efc24b6d6110 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:27.712393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-19a35185-34a6-4eb2-ba16-8ac793cda10d req-e09923cb-999d-4470-b686-efc24b6d6110 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:27.726896 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-19a35185-34a6-4eb2-ba16-8ac793cda10d req-e09923cb-999d-4470-b686-efc24b6d6110 service nova] Creating event network-vif-plugged:e1d8480a-75cc-470c-9389-4486ebc228d7 for instance ce57f31b-ee4d-4e34-9f08-5de27e71d393 on n-h1-844626-8 Aug 09 14:38:27.733642 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-19a35185-34a6-4eb2-ba16-8ac793cda10d req-e09923cb-999d-4470-b686-efc24b6d6110 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049950 Aug 09 14:38:27.735554 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1042/2067] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:28.037785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eca13e1a-8397-42f3-a275-005c2b8dc544 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:28.039509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eca13e1a-8397-42f3-a275-005c2b8dc544 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:28.050213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eca13e1a-8397-42f3-a275-005c2b8dc544 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:28.051844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eca13e1a-8397-42f3-a275-005c2b8dc544 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:28.053330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eca13e1a-8397-42f3-a275-005c2b8dc544 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:28.055008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eca13e1a-8397-42f3-a275-005c2b8dc544 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:28.055969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eca13e1a-8397-42f3-a275-005c2b8dc544 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:28.056650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eca13e1a-8397-42f3-a275-005c2b8dc544 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:28.266422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eca13e1a-8397-42f3-a275-005c2b8dc544 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:28.277305 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eca13e1a-8397-42f3-a275-005c2b8dc544 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1322 microversion: 2.1 time: 0.244629 Aug 09 14:38:28.278736 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1026/2068] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:28 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:28.390860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58a574e6-e9fc-43eb-a7d4-e1786d584121 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:28.392509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58a574e6-e9fc-43eb-a7d4-e1786d584121 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:28.400967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a574e6-e9fc-43eb-a7d4-e1786d584121 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:28.401737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a574e6-e9fc-43eb-a7d4-e1786d584121 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:28.402393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a574e6-e9fc-43eb-a7d4-e1786d584121 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:28.403312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a574e6-e9fc-43eb-a7d4-e1786d584121 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:28.403917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a574e6-e9fc-43eb-a7d4-e1786d584121 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:28.404523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58a574e6-e9fc-43eb-a7d4-e1786d584121 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:28.521982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8916603b-c24a-471c-84e4-c06a03a6cc89 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:28.522934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8916603b-c24a-471c-84e4-c06a03a6cc89 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:28.533846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8916603b-c24a-471c-84e4-c06a03a6cc89 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:28.534649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8916603b-c24a-471c-84e4-c06a03a6cc89 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:28.535294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8916603b-c24a-471c-84e4-c06a03a6cc89 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:28.536504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8916603b-c24a-471c-84e4-c06a03a6cc89 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:28.538059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8916603b-c24a-471c-84e4-c06a03a6cc89 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:28.538926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8916603b-c24a-471c-84e4-c06a03a6cc89 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:28.744749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-58a574e6-e9fc-43eb-a7d4-e1786d584121 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:28.755010 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58a574e6-e9fc-43eb-a7d4-e1786d584121 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1477 microversion: 2.1 time: 0.384820 Aug 09 14:38:28.755644 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1043/2069] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:28 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1477 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:28.821013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8916603b-c24a-471c-84e4-c06a03a6cc89 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:28.829982 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8916603b-c24a-471c-84e4-c06a03a6cc89 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.314256 Aug 09 14:38:28.831133 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1027/2070] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:28 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:29.299350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7925a2ba-928c-4fe4-a1ca-a4466084aa60 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:29.300262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7925a2ba-928c-4fe4-a1ca-a4466084aa60 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:29.309163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7925a2ba-928c-4fe4-a1ca-a4466084aa60 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:29.315785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7925a2ba-928c-4fe4-a1ca-a4466084aa60 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:29.316395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7925a2ba-928c-4fe4-a1ca-a4466084aa60 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:29.317240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7925a2ba-928c-4fe4-a1ca-a4466084aa60 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:29.317780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7925a2ba-928c-4fe4-a1ca-a4466084aa60 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:29.318473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7925a2ba-928c-4fe4-a1ca-a4466084aa60 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:29.581686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7925a2ba-928c-4fe4-a1ca-a4466084aa60 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:29.590111 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7925a2ba-928c-4fe4-a1ca-a4466084aa60 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1322 microversion: 2.1 time: 0.295887 Aug 09 14:38:29.594067 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1044/2071] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:29 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:29.776304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7ddacb9-cfc9-4ee3-8df7-502c681508d8 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:29.777696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f7ddacb9-cfc9-4ee3-8df7-502c681508d8 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:29.785345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7ddacb9-cfc9-4ee3-8df7-502c681508d8 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:29.786239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7ddacb9-cfc9-4ee3-8df7-502c681508d8 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:29.786999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7ddacb9-cfc9-4ee3-8df7-502c681508d8 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:29.787953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7ddacb9-cfc9-4ee3-8df7-502c681508d8 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:29.788614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7ddacb9-cfc9-4ee3-8df7-502c681508d8 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:29.789241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7ddacb9-cfc9-4ee3-8df7-502c681508d8 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:29.853064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3dd51420-3137-4ec1-8070-6a142c5ecaa5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:29.854137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3dd51420-3137-4ec1-8070-6a142c5ecaa5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:29.868056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dd51420-3137-4ec1-8070-6a142c5ecaa5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:29.873471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dd51420-3137-4ec1-8070-6a142c5ecaa5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:29.874411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dd51420-3137-4ec1-8070-6a142c5ecaa5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:29.875734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dd51420-3137-4ec1-8070-6a142c5ecaa5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:29.876403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dd51420-3137-4ec1-8070-6a142c5ecaa5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:29.877294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dd51420-3137-4ec1-8070-6a142c5ecaa5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:30.197330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f7ddacb9-cfc9-4ee3-8df7-502c681508d8 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:30.209908 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f7ddacb9-cfc9-4ee3-8df7-502c681508d8 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1477 microversion: 2.1 time: 0.437546 Aug 09 14:38:30.212858 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1028/2072] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:29 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1477 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:30.317456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3dd51420-3137-4ec1-8070-6a142c5ecaa5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:30.330922 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3dd51420-3137-4ec1-8070-6a142c5ecaa5 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.482254 Aug 09 14:38:30.340470 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1045/2073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:29 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:38:30.614164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c34cae26-34e2-4924-9936-bcaa03e444f3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:30.614870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c34cae26-34e2-4924-9936-bcaa03e444f3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:30.625572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c34cae26-34e2-4924-9936-bcaa03e444f3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:30.625745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c34cae26-34e2-4924-9936-bcaa03e444f3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:30.628486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c34cae26-34e2-4924-9936-bcaa03e444f3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:30.629329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c34cae26-34e2-4924-9936-bcaa03e444f3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:30.630703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c34cae26-34e2-4924-9936-bcaa03e444f3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:30.631333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c34cae26-34e2-4924-9936-bcaa03e444f3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:30.898882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c34cae26-34e2-4924-9936-bcaa03e444f3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:30.910966 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c34cae26-34e2-4924-9936-bcaa03e444f3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1322 microversion: 2.1 time: 0.297047 Aug 09 14:38:30.925216 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1029/2074] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:30 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:30.945725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-18c8fbc8-74f3-4857-b311-d9332cbdbf29 req-f354e837-7483-4b04-8926-c9001ff9abba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c52cb1b7-ac29-4831-9cdc-c780890bb79b", "name": "network-vif-plugged", "status": "completed", "tag": "f7499fd5-59fc-4400-9c2c-8c34b7007aea"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:30.972798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:30.980456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-18c8fbc8-74f3-4857-b311-d9332cbdbf29 req-f354e837-7483-4b04-8926-c9001ff9abba service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:30.984518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-18c8fbc8-74f3-4857-b311-d9332cbdbf29 req-f354e837-7483-4b04-8926-c9001ff9abba service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:30.988974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-18c8fbc8-74f3-4857-b311-d9332cbdbf29 req-f354e837-7483-4b04-8926-c9001ff9abba service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:31.059576 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-18c8fbc8-74f3-4857-b311-d9332cbdbf29 req-f354e837-7483-4b04-8926-c9001ff9abba service nova] Creating event network-vif-plugged:f7499fd5-59fc-4400-9c2c-8c34b7007aea for instance c52cb1b7-ac29-4831-9cdc-c780890bb79b on n-h2-844626-8 Aug 09 14:38:31.075014 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-18c8fbc8-74f3-4857-b311-d9332cbdbf29 req-f354e837-7483-4b04-8926-c9001ff9abba service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130891 Aug 09 14:38:31.078163 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1046/2075] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:31.234663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-27241a77-14b1-4216-90bb-ab7bcbfcfd42 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:31.235616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-27241a77-14b1-4216-90bb-ab7bcbfcfd42 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:31.252191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27241a77-14b1-4216-90bb-ab7bcbfcfd42 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:31.254980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27241a77-14b1-4216-90bb-ab7bcbfcfd42 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:31.255454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27241a77-14b1-4216-90bb-ab7bcbfcfd42 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:31.256243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27241a77-14b1-4216-90bb-ab7bcbfcfd42 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:31.256796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27241a77-14b1-4216-90bb-ab7bcbfcfd42 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:31.257263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27241a77-14b1-4216-90bb-ab7bcbfcfd42 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:31.299573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b461b9f-e91c-4141-8e2a-6240353d3fa9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0ddaa94-4090-423a-8602-716b54fddb0f"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:31.302841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0b461b9f-e91c-4141-8e2a-6240353d3fa9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:31.319674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b461b9f-e91c-4141-8e2a-6240353d3fa9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:31.325025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b461b9f-e91c-4141-8e2a-6240353d3fa9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:31.325487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b461b9f-e91c-4141-8e2a-6240353d3fa9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:31.328000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b461b9f-e91c-4141-8e2a-6240353d3fa9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:31.330615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b461b9f-e91c-4141-8e2a-6240353d3fa9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:31.331131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b461b9f-e91c-4141-8e2a-6240353d3fa9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:31.535918 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-0b461b9f-e91c-4141-8e2a-6240353d3fa9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Invalid volume: volume e0ddaa94-4090-423a-8602-716b54fddb0f is already attached to instances: 7a2bdaee-7506-41d7-89d8-033540a2613d Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b461b9f-e91c-4141-8e2a-6240353d3fa9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments HTTP/1.1 Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 74 Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: {"volumeAttachment": {"volumeId": "e0ddaa94-4090-423a-8602-716b54fddb0f"}} Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid volume: volume e0ddaa94-4090-423a-8602-716b54fddb0f is already attached to instances: 7a2bdaee-7506-41d7-89d8-033540a2613d Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'server_id': '7a2bdaee-7506-41d7-89d8-033540a2613d', 'body': {'volumeAttachment': {'volumeId': 'e0ddaa94-4090-423a-8602-716b54fddb0f'}}} Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e0ddaa94-4090-423a-8602-716b54fddb0f is already attached to instances: 7a2bdaee-7506-41d7-89d8-033540a2613d Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:38:31.539727 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e0ddaa94-4090-423a-8602-716b54fddb0f is already attached to instances: 7a2bdaee-7506-41d7-89d8-033540a2613d Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e0ddaa94-4090-423a-8602-716b54fddb0f is already attached to instances: 7a2bdaee-7506-41d7-89d8-033540a2613d Aug 09 14:38:31.545583 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:31.553109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b461b9f-e91c-4141-8e2a-6240353d3fa9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 400 to user: Invalid volume: volume e0ddaa94-4090-423a-8602-716b54fddb0f is already attached to instances: 7a2bdaee-7506-41d7-89d8-033540a2613d {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:31.554412 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b461b9f-e91c-4141-8e2a-6240353d3fa9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.260335 Aug 09 14:38:31.560486 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1047/2076] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 14:38:31 2022] POST /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments => generated 174 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:38:31.571870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16571fc6-760d-4dea-afed-0c52e4d2a07b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:31.572735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-16571fc6-760d-4dea-afed-0c52e4d2a07b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:31.586690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16571fc6-760d-4dea-afed-0c52e4d2a07b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:31.593192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16571fc6-760d-4dea-afed-0c52e4d2a07b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:31.593853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16571fc6-760d-4dea-afed-0c52e4d2a07b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:31.594791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16571fc6-760d-4dea-afed-0c52e4d2a07b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:31.596525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16571fc6-760d-4dea-afed-0c52e4d2a07b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:31.600837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16571fc6-760d-4dea-afed-0c52e4d2a07b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:31.926096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-27241a77-14b1-4216-90bb-ab7bcbfcfd42 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:31.942567 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-27241a77-14b1-4216-90bb-ab7bcbfcfd42 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1463 microversion: 2.1 time: 0.710000 Aug 09 14:38:31.965017 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1030/2077] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:31 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1463 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:31.981561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-90d2fe92-4eb4-4fe3-aecb-6dde0d8ba987 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:31.982348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-90d2fe92-4eb4-4fe3-aecb-6dde0d8ba987 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:32.000960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90d2fe92-4eb4-4fe3-aecb-6dde0d8ba987 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:32.002086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90d2fe92-4eb4-4fe3-aecb-6dde0d8ba987 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:32.006316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90d2fe92-4eb4-4fe3-aecb-6dde0d8ba987 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:32.007223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90d2fe92-4eb4-4fe3-aecb-6dde0d8ba987 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:32.007827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90d2fe92-4eb4-4fe3-aecb-6dde0d8ba987 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:32.008385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90d2fe92-4eb4-4fe3-aecb-6dde0d8ba987 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:32.100508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-16571fc6-760d-4dea-afed-0c52e4d2a07b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:32.115194 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16571fc6-760d-4dea-afed-0c52e4d2a07b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.551686 Aug 09 14:38:32.133644 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1048/2078] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:31 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:32.147286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8f9aa723-f5df-471d-b6a7-fc3fe6806941 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:32.159298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8f9aa723-f5df-471d-b6a7-fc3fe6806941 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:32.186271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f9aa723-f5df-471d-b6a7-fc3fe6806941 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:32.187751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f9aa723-f5df-471d-b6a7-fc3fe6806941 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:32.190273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f9aa723-f5df-471d-b6a7-fc3fe6806941 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:32.191362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f9aa723-f5df-471d-b6a7-fc3fe6806941 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:32.193110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f9aa723-f5df-471d-b6a7-fc3fe6806941 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:32.193757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f9aa723-f5df-471d-b6a7-fc3fe6806941 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:32.218714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-90d2fe92-4eb4-4fe3-aecb-6dde0d8ba987 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lazy-loading 'services' on Instance uuid 7a2bdaee-7506-41d7-89d8-033540a2613d {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:38:32.398091 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-90d2fe92-4eb4-4fe3-aecb-6dde0d8ba987 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments/e0ddaa94-4090-423a-8602-716b54fddb0f" status: 202 len: 0 microversion: 2.1 time: 0.428822 Aug 09 14:38:32.399601 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1031/2079] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 14:38:31 2022] DELETE /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments/e0ddaa94-4090-423a-8602-716b54fddb0f => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:38:32.408244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a64c312-317c-4130-9014-a204153ebe9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:32.409121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a64c312-317c-4130-9014-a204153ebe9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:32.418455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a64c312-317c-4130-9014-a204153ebe9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:32.419257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a64c312-317c-4130-9014-a204153ebe9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:32.421602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a64c312-317c-4130-9014-a204153ebe9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:32.422997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a64c312-317c-4130-9014-a204153ebe9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:32.423768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a64c312-317c-4130-9014-a204153ebe9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:32.424300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a64c312-317c-4130-9014-a204153ebe9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:32.855827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8f9aa723-f5df-471d-b6a7-fc3fe6806941 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:32.865251 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8f9aa723-f5df-471d-b6a7-fc3fe6806941 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1322 microversion: 2.1 time: 0.727978 Aug 09 14:38:32.872482 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1049/2080] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:32 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1322 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:32.888586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9893ca62-74cf-4ea9-9138-21299faedcd3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:32.897504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9893ca62-74cf-4ea9-9138-21299faedcd3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:32.903347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2a64c312-317c-4130-9014-a204153ebe9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:32.911652 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2a64c312-317c-4130-9014-a204153ebe9e tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1463 microversion: 2.1 time: 0.510692 Aug 09 14:38:32.913014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9893ca62-74cf-4ea9-9138-21299faedcd3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:32.915445 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1032/2081] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:32 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1463 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:32.920075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9893ca62-74cf-4ea9-9138-21299faedcd3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:32.921026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9893ca62-74cf-4ea9-9138-21299faedcd3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:32.921799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9893ca62-74cf-4ea9-9138-21299faedcd3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:32.922313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9893ca62-74cf-4ea9-9138-21299faedcd3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:32.922740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9893ca62-74cf-4ea9-9138-21299faedcd3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:33.003810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:33.015531 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9893ca62-74cf-4ea9-9138-21299faedcd3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140432 Aug 09 14:38:33.016489 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1050/2082] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:38:32 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:33.027664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:33.038351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:33.076868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:33.077392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:33.077834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:33.078552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:33.079003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:33.079453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:33.204841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-309479275", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "bd317c1b-dbf9-4a6f-b83f-8160e46b2998"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:33.349999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] validate_networks() for [('bd317c1b-dbf9-4a6f-b83f-8160e46b2998', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:38:33.360963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:38:33.366762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:38:33.367450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:38:33.368039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:38:33.368610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:38:33.523833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:33.542531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:33.556372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:33.558351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:33.559326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:33.568256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:33.568920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:33.631040 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9a9b3b26-656d-4374-ab63-5d4294aae07a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action" status: 202 len: 1067 microversion: 2.1 time: 0.613438 Aug 09 14:38:33.655258 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1051/2083] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:38:33 2022] POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action => generated 1067 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 09 14:38:33.655258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-330ac242-dd85-49d1-adb7-60fdb90b2848 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:33.655258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-330ac242-dd85-49d1-adb7-60fdb90b2848 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:33.679344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-330ac242-dd85-49d1-adb7-60fdb90b2848 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:33.679837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-330ac242-dd85-49d1-adb7-60fdb90b2848 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:33.680267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-330ac242-dd85-49d1-adb7-60fdb90b2848 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:33.681118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-330ac242-dd85-49d1-adb7-60fdb90b2848 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:33.681566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-330ac242-dd85-49d1-adb7-60fdb90b2848 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:33.681982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-330ac242-dd85-49d1-adb7-60fdb90b2848 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:34.979609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:38:34.980603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:38:34.982824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:38:34.983571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:38:34.984160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:38:35.011884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:35.013201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:35.014037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:35.015060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:35.015818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:35.016481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:35.047014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Getting quotas for project 3d715f7d59ae497b88931ca1a472c239. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:38:35.054333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Getting quotas for user 83af2ac2f8eb4f9a8c8fe6cbc1e5f02b and project 3d715f7d59ae497b88931ca1a472c239. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:38:35.087119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:38:35.089485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: c9832bbc-9306-44af-b9ce-2237f27500e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:38:35.098041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-330ac242-dd85-49d1-adb7-60fdb90b2848 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:35.120219 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-330ac242-dd85-49d1-adb7-60fdb90b2848 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 1.471156 Aug 09 14:38:35.122326 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1052/2084] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:33 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:35.161699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b697e42-eaeb-48bb-85f4-7166b7f7eef4 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:35.162305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b697e42-eaeb-48bb-85f4-7166b7f7eef4 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:35.170368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b697e42-eaeb-48bb-85f4-7166b7f7eef4 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:35.170850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b697e42-eaeb-48bb-85f4-7166b7f7eef4 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:35.171308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b697e42-eaeb-48bb-85f4-7166b7f7eef4 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:35.179221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b697e42-eaeb-48bb-85f4-7166b7f7eef4 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:35.180137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b697e42-eaeb-48bb-85f4-7166b7f7eef4 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:35.180863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b697e42-eaeb-48bb-85f4-7166b7f7eef4 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:35.254688 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d42973a6-bf87-4a7a-ab93-d411208358b5 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.335400 Aug 09 14:38:35.259471 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1033/2085] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:38:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:38:35.267219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a6f5aed4-3fd4-4bda-a519-a95427a36390 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:35.267844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a6f5aed4-3fd4-4bda-a519-a95427a36390 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:35.291415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6f5aed4-3fd4-4bda-a519-a95427a36390 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:35.292154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6f5aed4-3fd4-4bda-a519-a95427a36390 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:35.295463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6f5aed4-3fd4-4bda-a519-a95427a36390 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:35.297286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6f5aed4-3fd4-4bda-a519-a95427a36390 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:35.301423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6f5aed4-3fd4-4bda-a519-a95427a36390 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:35.302157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6f5aed4-3fd4-4bda-a519-a95427a36390 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:36.285783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a6f5aed4-3fd4-4bda-a519-a95427a36390 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:36.312455 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a6f5aed4-3fd4-4bda-a519-a95427a36390 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 200 len: 1519 microversion: 2.1 time: 1.045586 Aug 09 14:38:36.315807 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1034/2086] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:35 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 1519 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:36.332001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9127178-0568-4e7d-81bb-99da28c0e432 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:36.340345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9127178-0568-4e7d-81bb-99da28c0e432 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:36.357195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9127178-0568-4e7d-81bb-99da28c0e432 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:36.366850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9127178-0568-4e7d-81bb-99da28c0e432 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:36.369821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9127178-0568-4e7d-81bb-99da28c0e432 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:36.373302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9127178-0568-4e7d-81bb-99da28c0e432 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:36.376206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9127178-0568-4e7d-81bb-99da28c0e432 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:36.377728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9127178-0568-4e7d-81bb-99da28c0e432 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:36.459527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9b697e42-eaeb-48bb-85f4-7166b7f7eef4 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:36.468118 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b697e42-eaeb-48bb-85f4-7166b7f7eef4 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 1.334809 Aug 09 14:38:36.479536 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1053/2087] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:35 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:36.489149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7469de67-dfa4-486d-8c71-7a181ff0c52c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:36.489842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7469de67-dfa4-486d-8c71-7a181ff0c52c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: c9832bbc-9306-44af-b9ce-2237f27500e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:36.508036 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9127178-0568-4e7d-81bb-99da28c0e432 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191034 Aug 09 14:38:36.509285 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1035/2088] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:38:36 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:36.516388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7002a8e3-d9ad-4a43-bea0-2132b0ed1e51 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:36.517996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7002a8e3-d9ad-4a43-bea0-2132b0ed1e51 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:36.518620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7469de67-dfa4-486d-8c71-7a181ff0c52c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:36.519339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7469de67-dfa4-486d-8c71-7a181ff0c52c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:36.519868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7469de67-dfa4-486d-8c71-7a181ff0c52c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:36.521313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7469de67-dfa4-486d-8c71-7a181ff0c52c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:36.522164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7469de67-dfa4-486d-8c71-7a181ff0c52c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:36.522590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7469de67-dfa4-486d-8c71-7a181ff0c52c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:36.552064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7002a8e3-d9ad-4a43-bea0-2132b0ed1e51 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:36.552932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7002a8e3-d9ad-4a43-bea0-2132b0ed1e51 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:36.553645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7002a8e3-d9ad-4a43-bea0-2132b0ed1e51 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:36.554994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7002a8e3-d9ad-4a43-bea0-2132b0ed1e51 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:36.558107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7002a8e3-d9ad-4a43-bea0-2132b0ed1e51 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:36.558866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7002a8e3-d9ad-4a43-bea0-2132b0ed1e51 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:36.962109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7469de67-dfa4-486d-8c71-7a181ff0c52c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af2ac2f8eb4f9a8c8fe6cbc1e5f02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d715f7d59ae497b88931ca1a472c239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:36.980899 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7469de67-dfa4-486d-8c71-7a181ff0c52c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0" status: 200 len: 1227 microversion: 2.1 time: 0.499913 Aug 09 14:38:36.985514 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1054/2089] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:36 2022] GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0 => generated 1227 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:37.012219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.109"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:37.023522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:37.051770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:37.056347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:37.059636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:37.061743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:37.065385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:37.066824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:37.132028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "refresh_cache-46aa8418-3f46-4f90-bb08-763d20055e1c" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:38:37.139875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquired lock "refresh_cache-46aa8418-3f46-4f90-bb08-763d20055e1c" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:38:37.155596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7002a8e3-d9ad-4a43-bea0-2132b0ed1e51 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:37.167135 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7002a8e3-d9ad-4a43-bea0-2132b0ed1e51 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.655596 Aug 09 14:38:37.168677 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1036/2090] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:36 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:37.492762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b5aeee9a-7d1e-470b-bb65-f4436924ccaf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:37.493654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b5aeee9a-7d1e-470b-bb65-f4436924ccaf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:37.504817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5aeee9a-7d1e-470b-bb65-f4436924ccaf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:37.505316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5aeee9a-7d1e-470b-bb65-f4436924ccaf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:37.505747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5aeee9a-7d1e-470b-bb65-f4436924ccaf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:37.506490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5aeee9a-7d1e-470b-bb65-f4436924ccaf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:37.506886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5aeee9a-7d1e-470b-bb65-f4436924ccaf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:37.507404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5aeee9a-7d1e-470b-bb65-f4436924ccaf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:37.929388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b5aeee9a-7d1e-470b-bb65-f4436924ccaf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:37.933773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:37.951922 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b5aeee9a-7d1e-470b-bb65-f4436924ccaf tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 0.462315 Aug 09 14:38:37.955419 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1037/2091] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:37 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:37.967636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8190f4c4-d412-4e50-98ce-262334f721e4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:37.973751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8190f4c4-d412-4e50-98ce-262334f721e4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:37.988331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8190f4c4-d412-4e50-98ce-262334f721e4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:37.988823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8190f4c4-d412-4e50-98ce-262334f721e4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:37.989861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8190f4c4-d412-4e50-98ce-262334f721e4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:37.992898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8190f4c4-d412-4e50-98ce-262334f721e4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:37.993788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8190f4c4-d412-4e50-98ce-262334f721e4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:37.995297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8190f4c4-d412-4e50-98ce-262334f721e4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:38.062854 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8190f4c4-d412-4e50-98ce-262334f721e4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103877 Aug 09 14:38:38.066234 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1038/2092] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:38:37 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:38.081513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-80089c0e-6969-4f2e-9b1e-c7d488488471 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:38.082427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-80089c0e-6969-4f2e-9b1e-c7d488488471 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: c9832bbc-9306-44af-b9ce-2237f27500e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:38.091544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80089c0e-6969-4f2e-9b1e-c7d488488471 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:38.092034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80089c0e-6969-4f2e-9b1e-c7d488488471 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:38.092467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80089c0e-6969-4f2e-9b1e-c7d488488471 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:38.093243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80089c0e-6969-4f2e-9b1e-c7d488488471 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:38.093744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80089c0e-6969-4f2e-9b1e-c7d488488471 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:38.094277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80089c0e-6969-4f2e-9b1e-c7d488488471 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:38.244592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-80089c0e-6969-4f2e-9b1e-c7d488488471 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af2ac2f8eb4f9a8c8fe6cbc1e5f02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d715f7d59ae497b88931ca1a472c239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:38.255099 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-80089c0e-6969-4f2e-9b1e-c7d488488471 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0" status: 200 len: 1281 microversion: 2.1 time: 0.183290 Aug 09 14:38:38.256410 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1039/2093] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:38 2022] GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0 => generated 1281 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:38.267205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b200e106-d56e-468b-9db5-a18c9e3ab75b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:38.269792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b200e106-d56e-468b-9db5-a18c9e3ab75b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:38.287069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b200e106-d56e-468b-9db5-a18c9e3ab75b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:38.288460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b200e106-d56e-468b-9db5-a18c9e3ab75b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:38.289141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b200e106-d56e-468b-9db5-a18c9e3ab75b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:38.290097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b200e106-d56e-468b-9db5-a18c9e3ab75b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:38.290780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b200e106-d56e-468b-9db5-a18c9e3ab75b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:38.291836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b200e106-d56e-468b-9db5-a18c9e3ab75b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:38.641965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b200e106-d56e-468b-9db5-a18c9e3ab75b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:38.661932 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b200e106-d56e-468b-9db5-a18c9e3ab75b tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.403410 Aug 09 14:38:38.662708 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1040/2094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:38 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:38.936262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-609504489", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "ff403168-deb6-48c7-93ae-a7884ca6bc0e"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:39.016613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] validate_networks() for [('ff403168-deb6-48c7-93ae-a7884ca6bc0e', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:38:40.096738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:38:40.097459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:38:40.097609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:38:40.098017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:38:40.098424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:38:40.100511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:40.119821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:40.121165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:40.122902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:40.125046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:40.126144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:40.126747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:40.155265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Getting quotas for project a61c381646364214a62210a2d8672314. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:38:40.162908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Getting quotas for user 74c10f0e3a40477f86dfd6cdd03fe0f6 and project a61c381646364214a62210a2d8672314. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:38:40.179739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:38:40.183137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:38:40.305110 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0dc995a-dc9c-4ffc-9d97-a44f6ee1dd27 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.641161 Aug 09 14:38:40.310652 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1041/2095] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:38:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:38:40.317036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Building network info cache for instance {{(pid=119407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 14:38:40.325799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7a0c213d-3768-41a5-a9a7-d12c34285abb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:40.332246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7a0c213d-3768-41a5-a9a7-d12c34285abb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:40.348827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a0c213d-3768-41a5-a9a7-d12c34285abb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:40.349323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a0c213d-3768-41a5-a9a7-d12c34285abb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:40.352295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a0c213d-3768-41a5-a9a7-d12c34285abb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:40.353064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a0c213d-3768-41a5-a9a7-d12c34285abb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:40.353635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a0c213d-3768-41a5-a9a7-d12c34285abb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:40.354005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a0c213d-3768-41a5-a9a7-d12c34285abb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:41.306509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7a0c213d-3768-41a5-a9a7-d12c34285abb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:41.326638 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7a0c213d-3768-41a5-a9a7-d12c34285abb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 1.010280 Aug 09 14:38:41.328054 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1042/2096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:40 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:41.368665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-effa9718-a087-4a4e-aa4e-9d1bcc1de342 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:41.378094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-effa9718-a087-4a4e-aa4e-9d1bcc1de342 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:41.394699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-effa9718-a087-4a4e-aa4e-9d1bcc1de342 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:41.398456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-effa9718-a087-4a4e-aa4e-9d1bcc1de342 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:41.398970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-effa9718-a087-4a4e-aa4e-9d1bcc1de342 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:41.406094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-effa9718-a087-4a4e-aa4e-9d1bcc1de342 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:41.406094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-effa9718-a087-4a4e-aa4e-9d1bcc1de342 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:41.406094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-effa9718-a087-4a4e-aa4e-9d1bcc1de342 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:41.556787 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-effa9718-a087-4a4e-aa4e-9d1bcc1de342 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208085 Aug 09 14:38:41.559000 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1043/2097] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:38:41 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:41.571723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9299e631-1ee9-41f7-8baf-929109dd1e8b tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:41.572361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9299e631-1ee9-41f7-8baf-929109dd1e8b tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: c9832bbc-9306-44af-b9ce-2237f27500e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:41.582632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9299e631-1ee9-41f7-8baf-929109dd1e8b tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:41.583219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9299e631-1ee9-41f7-8baf-929109dd1e8b tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:41.583880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9299e631-1ee9-41f7-8baf-929109dd1e8b tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:41.584778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9299e631-1ee9-41f7-8baf-929109dd1e8b tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:41.585441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9299e631-1ee9-41f7-8baf-929109dd1e8b tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:41.586028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9299e631-1ee9-41f7-8baf-929109dd1e8b tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:42.143392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9299e631-1ee9-41f7-8baf-929109dd1e8b tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af2ac2f8eb4f9a8c8fe6cbc1e5f02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d715f7d59ae497b88931ca1a472c239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:42.156052 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9299e631-1ee9-41f7-8baf-929109dd1e8b tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0" status: 200 len: 1323 microversion: 2.1 time: 0.594575 Aug 09 14:38:42.157406 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1044/2098] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:41 2022] GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0 => generated 1323 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:42.163053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f464cd26-18d5-436e-b51c-c5fd229ab35f req-eaf344c6-37c0-4655-b1b7-df6932151ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9832bbc-9306-44af-b9ce-2237f27500e0", "tag": "e595419e-7100-4f50-9ae7-7041176de044"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:42.175263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f464cd26-18d5-436e-b51c-c5fd229ab35f req-eaf344c6-37c0-4655-b1b7-df6932151ad7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:42.176002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f464cd26-18d5-436e-b51c-c5fd229ab35f req-eaf344c6-37c0-4655-b1b7-df6932151ad7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:42.176646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f464cd26-18d5-436e-b51c-c5fd229ab35f req-eaf344c6-37c0-4655-b1b7-df6932151ad7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:42.193354 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f464cd26-18d5-436e-b51c-c5fd229ab35f req-eaf344c6-37c0-4655-b1b7-df6932151ad7 service nova] Creating event network-changed:e595419e-7100-4f50-9ae7-7041176de044 for instance c9832bbc-9306-44af-b9ce-2237f27500e0 on n-h1-844626-8 Aug 09 14:38:42.203209 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f464cd26-18d5-436e-b51c-c5fd229ab35f req-eaf344c6-37c0-4655-b1b7-df6932151ad7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042700 Aug 09 14:38:42.206099 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1045/2099] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:42.211950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-536258df-5175-47d1-9930-688b604014bc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:42.212864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-536258df-5175-47d1-9930-688b604014bc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:42.220427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536258df-5175-47d1-9930-688b604014bc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:42.221210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536258df-5175-47d1-9930-688b604014bc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:42.221868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536258df-5175-47d1-9930-688b604014bc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:42.223482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536258df-5175-47d1-9930-688b604014bc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:42.224123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536258df-5175-47d1-9930-688b604014bc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:42.224745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536258df-5175-47d1-9930-688b604014bc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:42.636547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-536258df-5175-47d1-9930-688b604014bc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:42.664558 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-536258df-5175-47d1-9930-688b604014bc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.456908 Aug 09 14:38:42.666595 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1046/2100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:42 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:42.682752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f6b4ce28-06df-4865-953d-ad869f0fadf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:42.687600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f6b4ce28-06df-4865-953d-ad869f0fadf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:42.715895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b4ce28-06df-4865-953d-ad869f0fadf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:42.732456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b4ce28-06df-4865-953d-ad869f0fadf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:42.733461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b4ce28-06df-4865-953d-ad869f0fadf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:42.737120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b4ce28-06df-4865-953d-ad869f0fadf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:42.738217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b4ce28-06df-4865-953d-ad869f0fadf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:42.739156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b4ce28-06df-4865-953d-ad869f0fadf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:42.778849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Updating instance_info_cache with network_info: [{"id": "d159e2a0-cd63-4b05-83ad-effb48febb0c", "address": "fa:16:3e:71:1b:33", "network": {"id": "8e5664a1-4e3d-47e9-ac93-f7a76fb16596", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1401338871-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "46d8cf5b02944869a9ad2541a4e2af62", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd159e2a0-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 14:38:42.816000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Releasing lock "refresh_cache-46aa8418-3f46-4f90-bb08-763d20055e1c" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:38:42.822002 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-400b3547-859d-4aa0-b115-51ffda244d84 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "POST /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c/action" status: 202 len: 0 microversion: 2.1 time: 5.832073 Aug 09 14:38:42.822340 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1055/2101] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:38:36 2022] POST /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c/action => generated 0 bytes in 5835 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 14:38:42.836384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-6943aa39-fc74-4b87-9795-089a35e7097f req-0345e9ab-1113-4fa8-a19f-3417440a2cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46aa8418-3f46-4f90-bb08-763d20055e1c", "tag": "d159e2a0-cd63-4b05-83ad-effb48febb0c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:42.857696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f6b4ce28-06df-4865-953d-ad869f0fadf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:42.866561 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f6b4ce28-06df-4865-953d-ad869f0fadf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1287 microversion: 2.1 time: 0.198655 Aug 09 14:38:42.867696 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1047/2102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:42 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1287 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:42.882545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6943aa39-fc74-4b87-9795-089a35e7097f req-0345e9ab-1113-4fa8-a19f-3417440a2cc3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:42.883136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6943aa39-fc74-4b87-9795-089a35e7097f req-0345e9ab-1113-4fa8-a19f-3417440a2cc3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:42.883581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6943aa39-fc74-4b87-9795-089a35e7097f req-0345e9ab-1113-4fa8-a19f-3417440a2cc3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:42.908586 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-6943aa39-fc74-4b87-9795-089a35e7097f req-0345e9ab-1113-4fa8-a19f-3417440a2cc3 service nova] Creating event network-changed:d159e2a0-cd63-4b05-83ad-effb48febb0c for instance 46aa8418-3f46-4f90-bb08-763d20055e1c on n-h2-844626-8 Aug 09 14:38:42.937837 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-6943aa39-fc74-4b87-9795-089a35e7097f req-0345e9ab-1113-4fa8-a19f-3417440a2cc3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113168 Aug 09 14:38:42.942281 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1056/2103] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:42.953727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-034a0d63-fd25-4ba7-9212-f7e64ff42d9f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:42.956750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-034a0d63-fd25-4ba7-9212-f7e64ff42d9f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:42.963626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-034a0d63-fd25-4ba7-9212-f7e64ff42d9f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:42.964387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-034a0d63-fd25-4ba7-9212-f7e64ff42d9f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:42.965096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-034a0d63-fd25-4ba7-9212-f7e64ff42d9f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:42.965996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-034a0d63-fd25-4ba7-9212-f7e64ff42d9f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:42.966622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-034a0d63-fd25-4ba7-9212-f7e64ff42d9f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:42.967456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-034a0d63-fd25-4ba7-9212-f7e64ff42d9f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:43.024613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f812c0c1-b8a5-4f74-9b0b-dff7d469c0d0 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Action: 'update', calling method: .version_select at 0x7f41dda55e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:43.114163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f812c0c1-b8a5-4f74-9b0b-dff7d469c0d0 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:43.114945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f812c0c1-b8a5-4f74-9b0b-dff7d469c0d0 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:43.115463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f812c0c1-b8a5-4f74-9b0b-dff7d469c0d0 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:43.116224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f812c0c1-b8a5-4f74-9b0b-dff7d469c0d0 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:43.116695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f812c0c1-b8a5-4f74-9b0b-dff7d469c0d0 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:43.117121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f812c0c1-b8a5-4f74-9b0b-dff7d469c0d0 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:43.184292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-034a0d63-fd25-4ba7-9212-f7e64ff42d9f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:43.195658 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-034a0d63-fd25-4ba7-9212-f7e64ff42d9f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 0.251276 Aug 09 14:38:43.196461 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1057/2104] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:42 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:43.205021 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f812c0c1-b8a5-4f74-9b0b-dff7d469c0d0 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/a24e5e6856aa4bbfb0da3426715e30f1" status: 200 len: 148 microversion: 2.57 time: 0.335904 Aug 09 14:38:43.206691 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1048/2105] 10.222.0.50 () {62 vars in 1303 bytes} [Tue Aug 9 14:38:42 2022] PUT /compute/v2.1/os-quota-sets/a24e5e6856aa4bbfb0da3426715e30f1 => generated 148 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:38:43.212717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.109"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:43.216021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:43.225044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:43.225750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:43.226331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:43.228004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:43.228004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:43.228313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:43.259729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "refresh_cache-c52cb1b7-ac29-4831-9cdc-c780890bb79b" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:38:43.260174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquired lock "refresh_cache-c52cb1b7-ac29-4831-9cdc-c780890bb79b" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:38:43.382493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e3e90df1-cde1-4fab-af6a-42cfd1b2ed99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:43.385082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e3e90df1-cde1-4fab-af6a-42cfd1b2ed99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:43.398624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3e90df1-cde1-4fab-af6a-42cfd1b2ed99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:43.400695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3e90df1-cde1-4fab-af6a-42cfd1b2ed99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:43.401138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3e90df1-cde1-4fab-af6a-42cfd1b2ed99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:43.401844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3e90df1-cde1-4fab-af6a-42cfd1b2ed99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:43.402357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3e90df1-cde1-4fab-af6a-42cfd1b2ed99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:43.402770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3e90df1-cde1-4fab-af6a-42cfd1b2ed99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:43.468359 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e3e90df1-cde1-4fab-af6a-42cfd1b2ed99 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.269672 Aug 09 14:38:43.478274 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1058/2106] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:38:43 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d/os-volume_attachments => generated 25 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:38:43.487255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0801d2b-383f-49e8-9ae4-724c0505083d tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:43.491663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0801d2b-383f-49e8-9ae4-724c0505083d tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: c9832bbc-9306-44af-b9ce-2237f27500e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:43.511176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0801d2b-383f-49e8-9ae4-724c0505083d tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:43.512021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0801d2b-383f-49e8-9ae4-724c0505083d tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:43.512685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0801d2b-383f-49e8-9ae4-724c0505083d tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:43.513649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0801d2b-383f-49e8-9ae4-724c0505083d tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:43.514357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0801d2b-383f-49e8-9ae4-724c0505083d tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:43.514998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0801d2b-383f-49e8-9ae4-724c0505083d tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:43.827983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a0801d2b-383f-49e8-9ae4-724c0505083d tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af2ac2f8eb4f9a8c8fe6cbc1e5f02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d715f7d59ae497b88931ca1a472c239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:43.842253 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0801d2b-383f-49e8-9ae4-724c0505083d tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0" status: 200 len: 1323 microversion: 2.1 time: 0.362510 Aug 09 14:38:43.842883 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1059/2107] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:43 2022] GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0 => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:43.849973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ceabd2f-b7dc-454f-970f-7f68bc040833 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Calling method '.version_select at 0x7f41dee8ba60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:43.969155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ceabd2f-b7dc-454f-970f-7f68bc040833 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:43.969993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ceabd2f-b7dc-454f-970f-7f68bc040833 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:43.970833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ceabd2f-b7dc-454f-970f-7f68bc040833 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:43.971843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ceabd2f-b7dc-454f-970f-7f68bc040833 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:43.972653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ceabd2f-b7dc-454f-970f-7f68bc040833 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:43.973375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ceabd2f-b7dc-454f-970f-7f68bc040833 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:43.999317 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ceabd2f-b7dc-454f-970f-7f68bc040833 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/a24e5e6856aa4bbfb0da3426715e30f1/detail" status: 200 len: 463 microversion: 2.57 time: 0.155176 Aug 09 14:38:44.000373 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1060/2108] 10.222.0.50 () {60 vars in 1304 bytes} [Tue Aug 9 14:38:43 2022] GET /compute/v2.1/os-quota-sets/a24e5e6856aa4bbfb0da3426715e30f1/detail => generated 463 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:38:44.011968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c18727a3-5fd1-469d-aa20-471f6e409eca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:44.012770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c18727a3-5fd1-469d-aa20-471f6e409eca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:44.023628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c18727a3-5fd1-469d-aa20-471f6e409eca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:44.024340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c18727a3-5fd1-469d-aa20-471f6e409eca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:44.024971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c18727a3-5fd1-469d-aa20-471f6e409eca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:44.026520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c18727a3-5fd1-469d-aa20-471f6e409eca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:44.027301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c18727a3-5fd1-469d-aa20-471f6e409eca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:44.028015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c18727a3-5fd1-469d-aa20-471f6e409eca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:44.095073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c18727a3-5fd1-469d-aa20-471f6e409eca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:38:44.243253 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c18727a3-5fd1-469d-aa20-471f6e409eca tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 204 len: 0 microversion: 2.1 time: 0.241224 Aug 09 14:38:44.244168 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1061/2109] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:38:44 2022] DELETE /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:38:44.249770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c715ae8d-5319-4575-a54e-ef93c3182189 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:44.250670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c715ae8d-5319-4575-a54e-ef93c3182189 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:44.257631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c715ae8d-5319-4575-a54e-ef93c3182189 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:44.258334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c715ae8d-5319-4575-a54e-ef93c3182189 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:44.258970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c715ae8d-5319-4575-a54e-ef93c3182189 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:44.259882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c715ae8d-5319-4575-a54e-ef93c3182189 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:44.260500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c715ae8d-5319-4575-a54e-ef93c3182189 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:44.261123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c715ae8d-5319-4575-a54e-ef93c3182189 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:44.923721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c715ae8d-5319-4575-a54e-ef93c3182189 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:44.932526 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c715ae8d-5319-4575-a54e-ef93c3182189 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.686973 Aug 09 14:38:44.933373 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1062/2110] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:44 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:44.938240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-47baadbd-aa6b-49b7-bf67-fc916a25f522 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:44.939168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-47baadbd-aa6b-49b7-bf67-fc916a25f522 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:44.945188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47baadbd-aa6b-49b7-bf67-fc916a25f522 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:44.945988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47baadbd-aa6b-49b7-bf67-fc916a25f522 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:44.946628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47baadbd-aa6b-49b7-bf67-fc916a25f522 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:44.947366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47baadbd-aa6b-49b7-bf67-fc916a25f522 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:44.947871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47baadbd-aa6b-49b7-bf67-fc916a25f522 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:44.948352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47baadbd-aa6b-49b7-bf67-fc916a25f522 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:45.186426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-47baadbd-aa6b-49b7-bf67-fc916a25f522 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:45.194401 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-47baadbd-aa6b-49b7-bf67-fc916a25f522 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1317 microversion: 2.1 time: 0.259673 Aug 09 14:38:45.195311 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1063/2111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:44 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1317 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:45.200118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-807f9687-7f67-4b8d-856a-d48fa64d2d9a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:45.200895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-807f9687-7f67-4b8d-856a-d48fa64d2d9a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:45.207298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-807f9687-7f67-4b8d-856a-d48fa64d2d9a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:45.207877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-807f9687-7f67-4b8d-856a-d48fa64d2d9a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:45.208299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-807f9687-7f67-4b8d-856a-d48fa64d2d9a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:45.209093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-807f9687-7f67-4b8d-856a-d48fa64d2d9a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:45.209744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-807f9687-7f67-4b8d-856a-d48fa64d2d9a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:45.210160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-807f9687-7f67-4b8d-856a-d48fa64d2d9a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:45.214576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:45.465305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-807f9687-7f67-4b8d-856a-d48fa64d2d9a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:45.473268 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-807f9687-7f67-4b8d-856a-d48fa64d2d9a tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 0.276759 Aug 09 14:38:45.473925 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1064/2112] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:45 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:45.479062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Action: 'update', calling method: .version_select at 0x7f41dd7efee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:45.545646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:45.546258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:45.546696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:45.547573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:45.548023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:45.548443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:45.583467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:45.583949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:45.584386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:45.585109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:45.585559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:45.585980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:45.653067 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3ddba0d3-458f-42d3-bf4b-dd562b4b2ea5 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/a24e5e6856aa4bbfb0da3426715e30f1?user_id=d00474aed4eb47b29e79c3439a40e8d6" status: 200 len: 148 microversion: 2.57 time: 0.177731 Aug 09 14:38:45.654837 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1065/2113] 10.222.0.50 () {62 vars in 1384 bytes} [Tue Aug 9 14:38:45 2022] PUT /compute/v2.1/os-quota-sets/a24e5e6856aa4bbfb0da3426715e30f1?user_id=d00474aed4eb47b29e79c3439a40e8d6 => generated 148 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:38:45.659922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c69daef3-b80f-4395-9089-9080c98ceae7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:45.661966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c69daef3-b80f-4395-9089-9080c98ceae7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:45.666867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c69daef3-b80f-4395-9089-9080c98ceae7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:45.667395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c69daef3-b80f-4395-9089-9080c98ceae7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:45.667871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c69daef3-b80f-4395-9089-9080c98ceae7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:45.668581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c69daef3-b80f-4395-9089-9080c98ceae7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:45.669030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c69daef3-b80f-4395-9089-9080c98ceae7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:45.670078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c69daef3-b80f-4395-9089-9080c98ceae7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:45.962626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c69daef3-b80f-4395-9089-9080c98ceae7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:45.976475 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c69daef3-b80f-4395-9089-9080c98ceae7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1678 microversion: 2.1 time: 0.319894 Aug 09 14:38:45.977438 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1066/2114] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:45 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1678 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:45.982779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-e98826fd-e218-47ca-9bbe-8f7bb4890db8 req-f3534f26-aff4-4b62-9cba-ea495fa5225c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74c528e1-bc7a-4791-9a0f-de8414ea9077", "tag": "056748cf-883c-4a7b-85dd-4283d05e1cbe"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:45.997758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e98826fd-e218-47ca-9bbe-8f7bb4890db8 req-f3534f26-aff4-4b62-9cba-ea495fa5225c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:45.999301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e98826fd-e218-47ca-9bbe-8f7bb4890db8 req-f3534f26-aff4-4b62-9cba-ea495fa5225c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:45.999795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e98826fd-e218-47ca-9bbe-8f7bb4890db8 req-f3534f26-aff4-4b62-9cba-ea495fa5225c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:46.013150 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-e98826fd-e218-47ca-9bbe-8f7bb4890db8 req-f3534f26-aff4-4b62-9cba-ea495fa5225c service nova] Creating event network-changed:056748cf-883c-4a7b-85dd-4283d05e1cbe for instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 on n-h2-844626-8 Aug 09 14:38:46.018716 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-e98826fd-e218-47ca-9bbe-8f7bb4890db8 req-f3534f26-aff4-4b62-9cba-ea495fa5225c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039798 Aug 09 14:38:46.020268 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1067/2115] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:46.028051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a7fdbb7d-14b2-497b-b450-49559b26c86f tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:46.029085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a7fdbb7d-14b2-497b-b450-49559b26c86f tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: c9832bbc-9306-44af-b9ce-2237f27500e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:46.038258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7fdbb7d-14b2-497b-b450-49559b26c86f tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:46.039071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7fdbb7d-14b2-497b-b450-49559b26c86f tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:46.039866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7fdbb7d-14b2-497b-b450-49559b26c86f tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:46.041058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7fdbb7d-14b2-497b-b450-49559b26c86f tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:46.041721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7fdbb7d-14b2-497b-b450-49559b26c86f tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:46.042531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7fdbb7d-14b2-497b-b450-49559b26c86f tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:46.289290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a7fdbb7d-14b2-497b-b450-49559b26c86f tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af2ac2f8eb4f9a8c8fe6cbc1e5f02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d715f7d59ae497b88931ca1a472c239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:46.298772 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a7fdbb7d-14b2-497b-b450-49559b26c86f tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0" status: 200 len: 1323 microversion: 2.1 time: 0.276942 Aug 09 14:38:46.299824 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1068/2116] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:46 2022] GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0 => generated 1323 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:46.305208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-56e6155c-95dd-48d5-8682-8c1c876f1a22 req-ec32cf94-105a-4ac5-b6a3-ee5aa4dab085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c508aaa8-11d1-4593-b840-91b8295b6f8e", "name": "network-vif-unplugged", "status": "completed", "tag": "6db596c5-3bac-4ac1-8c68-1f1c20808428"}, {"name": "network-changed", "server_uuid": "c508aaa8-11d1-4593-b840-91b8295b6f8e", "tag": "6db596c5-3bac-4ac1-8c68-1f1c20808428"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:46.317044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-56e6155c-95dd-48d5-8682-8c1c876f1a22 req-ec32cf94-105a-4ac5-b6a3-ee5aa4dab085 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:46.317516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-56e6155c-95dd-48d5-8682-8c1c876f1a22 req-ec32cf94-105a-4ac5-b6a3-ee5aa4dab085 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:46.318048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-56e6155c-95dd-48d5-8682-8c1c876f1a22 req-ec32cf94-105a-4ac5-b6a3-ee5aa4dab085 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:46.332613 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-56e6155c-95dd-48d5-8682-8c1c876f1a22 req-ec32cf94-105a-4ac5-b6a3-ee5aa4dab085 service nova] Creating event network-vif-unplugged:6db596c5-3bac-4ac1-8c68-1f1c20808428 for instance c508aaa8-11d1-4593-b840-91b8295b6f8e on n-h2-844626-8 Aug 09 14:38:46.333151 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-56e6155c-95dd-48d5-8682-8c1c876f1a22 req-ec32cf94-105a-4ac5-b6a3-ee5aa4dab085 service nova] Creating event network-changed:6db596c5-3bac-4ac1-8c68-1f1c20808428 for instance c508aaa8-11d1-4593-b840-91b8295b6f8e on n-h2-844626-8 Aug 09 14:38:46.339620 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-56e6155c-95dd-48d5-8682-8c1c876f1a22 req-ec32cf94-105a-4ac5-b6a3-ee5aa4dab085 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.038335 Aug 09 14:38:46.340732 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1069/2117] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:46.346366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba570e46-e7d0-4f47-86ac-3f95cc8b7f77 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] Calling method '.version_select at 0x7f41dd3888b0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:46.370918 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.network.neutron [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] re-assign floating IP 172.25.5.109 from instance 46aa8418-3f46-4f90-bb08-763d20055e1c Aug 09 14:38:46.440293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Building network info cache for instance {{(pid=119406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 14:38:46.458550 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba570e46-e7d0-4f47-86ac-3f95cc8b7f77 tempest-QuotasAdminTestV257-654674015 tempest-QuotasAdminTestV257-654674015-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/a24e5e6856aa4bbfb0da3426715e30f1?user_id=d00474aed4eb47b29e79c3439a40e8d6" status: 200 len: 190 microversion: 2.57 time: 0.116567 Aug 09 14:38:46.465113 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1070/2118] 10.222.0.50 () {60 vars in 1364 bytes} [Tue Aug 9 14:38:46 2022] GET /compute/v2.1/os-quota-sets/a24e5e6856aa4bbfb0da3426715e30f1?user_id=d00474aed4eb47b29e79c3439a40e8d6 => generated 190 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:38:46.465113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a2112af8-8c50-4734-8fd2-0cba6be4daeb req-ad647a9b-8278-4273-a32e-8e2d6466c85c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9832bbc-9306-44af-b9ce-2237f27500e0", "name": "network-vif-plugged", "status": "completed", "tag": "e595419e-7100-4f50-9ae7-7041176de044"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:46.493561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a2112af8-8c50-4734-8fd2-0cba6be4daeb req-ad647a9b-8278-4273-a32e-8e2d6466c85c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:46.496230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a2112af8-8c50-4734-8fd2-0cba6be4daeb req-ad647a9b-8278-4273-a32e-8e2d6466c85c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:46.499932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a2112af8-8c50-4734-8fd2-0cba6be4daeb req-ad647a9b-8278-4273-a32e-8e2d6466c85c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:46.525146 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a2112af8-8c50-4734-8fd2-0cba6be4daeb req-ad647a9b-8278-4273-a32e-8e2d6466c85c service nova] Creating event network-vif-plugged:e595419e-7100-4f50-9ae7-7041176de044 for instance c9832bbc-9306-44af-b9ce-2237f27500e0 on n-h1-844626-8 Aug 09 14:38:46.531580 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a2112af8-8c50-4734-8fd2-0cba6be4daeb req-ad647a9b-8278-4273-a32e-8e2d6466c85c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069111 Aug 09 14:38:46.531580 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1071/2119] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:46.537714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0e29de5b-db32-4f78-96b1-9bac4c4132dd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:46.538551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0e29de5b-db32-4f78-96b1-9bac4c4132dd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:46.546324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e29de5b-db32-4f78-96b1-9bac4c4132dd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:46.546942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e29de5b-db32-4f78-96b1-9bac4c4132dd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:46.547528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e29de5b-db32-4f78-96b1-9bac4c4132dd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:46.548390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e29de5b-db32-4f78-96b1-9bac4c4132dd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:46.548882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e29de5b-db32-4f78-96b1-9bac4c4132dd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:46.549671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e29de5b-db32-4f78-96b1-9bac4c4132dd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:47.093215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0e29de5b-db32-4f78-96b1-9bac4c4132dd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:47.102090 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0e29de5b-db32-4f78-96b1-9bac4c4132dd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.569028 Aug 09 14:38:47.106116 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1072/2120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:46 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:47.118742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a3edc07-f09d-45a8-8ce9-e0d4a5804057 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:47.119624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a3edc07-f09d-45a8-8ce9-e0d4a5804057 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:47.131724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a3edc07-f09d-45a8-8ce9-e0d4a5804057 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:47.135234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a3edc07-f09d-45a8-8ce9-e0d4a5804057 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:47.135990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a3edc07-f09d-45a8-8ce9-e0d4a5804057 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:47.139537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a3edc07-f09d-45a8-8ce9-e0d4a5804057 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:47.140231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a3edc07-f09d-45a8-8ce9-e0d4a5804057 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:47.146209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a3edc07-f09d-45a8-8ce9-e0d4a5804057 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:47.699340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Updating instance_info_cache with network_info: [{"id": "d159e2a0-cd63-4b05-83ad-effb48febb0c", "address": "fa:16:3e:71:1b:33", "network": {"id": "8e5664a1-4e3d-47e9-ac93-f7a76fb16596", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1401338871-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "46d8cf5b02944869a9ad2541a4e2af62", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd159e2a0-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 14:38:47.730397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Building network info cache for instance {{(pid=119406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 14:38:47.920172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2a3edc07-f09d-45a8-8ce9-e0d4a5804057 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:47.932502 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a3edc07-f09d-45a8-8ce9-e0d4a5804057 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1317 microversion: 2.1 time: 0.823521 Aug 09 14:38:47.934005 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1073/2121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:47 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1317 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:47.941056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1caadb0-1fdb-4f7b-91d2-cc0c860473f7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:47.942086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1caadb0-1fdb-4f7b-91d2-cc0c860473f7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:47.949794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1caadb0-1fdb-4f7b-91d2-cc0c860473f7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:47.951801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1caadb0-1fdb-4f7b-91d2-cc0c860473f7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:47.952663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1caadb0-1fdb-4f7b-91d2-cc0c860473f7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:47.953765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1caadb0-1fdb-4f7b-91d2-cc0c860473f7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:47.954505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1caadb0-1fdb-4f7b-91d2-cc0c860473f7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:47.955880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1caadb0-1fdb-4f7b-91d2-cc0c860473f7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:48.875527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1caadb0-1fdb-4f7b-91d2-cc0c860473f7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:48.889104 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1caadb0-1fdb-4f7b-91d2-cc0c860473f7 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 0.953109 Aug 09 14:38:48.893430 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1074/2122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:47 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:48.905976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d7a6d487-a8d7-47f8-84eb-6bcf9bd6cb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:48.908096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d7a6d487-a8d7-47f8-84eb-6bcf9bd6cb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:48.926820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7a6d487-a8d7-47f8-84eb-6bcf9bd6cb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:48.927877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7a6d487-a8d7-47f8-84eb-6bcf9bd6cb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:48.928550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7a6d487-a8d7-47f8-84eb-6bcf9bd6cb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:48.929637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7a6d487-a8d7-47f8-84eb-6bcf9bd6cb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:48.932714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7a6d487-a8d7-47f8-84eb-6bcf9bd6cb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:48.933440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d7a6d487-a8d7-47f8-84eb-6bcf9bd6cb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:49.094177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d7a6d487-a8d7-47f8-84eb-6bcf9bd6cb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:49.110623 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d7a6d487-a8d7-47f8-84eb-6bcf9bd6cb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 200 len: 1612 microversion: 2.1 time: 0.213669 Aug 09 14:38:49.113122 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1075/2123] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:48 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 1612 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:49.137307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-618d928f-c3d6-4a7d-9004-81d42e5595f9 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:49.138372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-618d928f-c3d6-4a7d-9004-81d42e5595f9 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: c9832bbc-9306-44af-b9ce-2237f27500e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:49.153204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-618d928f-c3d6-4a7d-9004-81d42e5595f9 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:49.153845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-618d928f-c3d6-4a7d-9004-81d42e5595f9 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:49.154457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-618d928f-c3d6-4a7d-9004-81d42e5595f9 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:49.156301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-618d928f-c3d6-4a7d-9004-81d42e5595f9 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:49.159182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-618d928f-c3d6-4a7d-9004-81d42e5595f9 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:49.160157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-618d928f-c3d6-4a7d-9004-81d42e5595f9 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:49.916924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-618d928f-c3d6-4a7d-9004-81d42e5595f9 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af2ac2f8eb4f9a8c8fe6cbc1e5f02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d715f7d59ae497b88931ca1a472c239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:49.940690 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-618d928f-c3d6-4a7d-9004-81d42e5595f9 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0" status: 200 len: 1519 microversion: 2.1 time: 0.806432 Aug 09 14:38:49.943861 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1076/2124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:49 2022] GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0 => generated 1519 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:49.953335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48148b74-815c-41f3-9504-6c84919c737d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:49.955485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48148b74-815c-41f3-9504-6c84919c737d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:49.959647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:49.998754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48148b74-815c-41f3-9504-6c84919c737d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:50.003852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48148b74-815c-41f3-9504-6c84919c737d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:50.004412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Updating instance_info_cache with network_info: [{"id": "f7499fd5-59fc-4400-9c2c-8c34b7007aea", "address": "fa:16:3e:f2:83:fb", "network": {"id": "8e5664a1-4e3d-47e9-ac93-f7a76fb16596", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1401338871-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "46d8cf5b02944869a9ad2541a4e2af62", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf7499fd5-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 14:38:50.006987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48148b74-815c-41f3-9504-6c84919c737d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:50.008237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48148b74-815c-41f3-9504-6c84919c737d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:50.008864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48148b74-815c-41f3-9504-6c84919c737d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:50.009712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48148b74-815c-41f3-9504-6c84919c737d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:50.070311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Releasing lock "refresh_cache-c52cb1b7-ac29-4831-9cdc-c780890bb79b" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:38:50.076063 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ceed5295-b205-4bf6-a400-8e612d768af3 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "POST /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b/action" status: 202 len: 0 microversion: 2.1 time: 6.866429 Aug 09 14:38:50.081921 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1049/2125] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:38:43 2022] POST /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b/action => generated 0 bytes in 6874 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 14:38:50.090162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5359b8c2-4163-431d-820c-2e5d81c7aa39 req-c24c7dad-dd6e-4118-8c15-caf7e9d6caa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46aa8418-3f46-4f90-bb08-763d20055e1c", "tag": "d159e2a0-cd63-4b05-83ad-effb48febb0c"}, {"name": "network-changed", "server_uuid": "c52cb1b7-ac29-4831-9cdc-c780890bb79b", "tag": "f7499fd5-59fc-4400-9c2c-8c34b7007aea"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:50.111951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5359b8c2-4163-431d-820c-2e5d81c7aa39 req-c24c7dad-dd6e-4118-8c15-caf7e9d6caa9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:50.115559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5359b8c2-4163-431d-820c-2e5d81c7aa39 req-c24c7dad-dd6e-4118-8c15-caf7e9d6caa9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:50.119764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5359b8c2-4163-431d-820c-2e5d81c7aa39 req-c24c7dad-dd6e-4118-8c15-caf7e9d6caa9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:50.174541 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5359b8c2-4163-431d-820c-2e5d81c7aa39 req-c24c7dad-dd6e-4118-8c15-caf7e9d6caa9 service nova] Creating event network-changed:d159e2a0-cd63-4b05-83ad-effb48febb0c for instance 46aa8418-3f46-4f90-bb08-763d20055e1c on n-h2-844626-8 Aug 09 14:38:50.175657 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5359b8c2-4163-431d-820c-2e5d81c7aa39 req-c24c7dad-dd6e-4118-8c15-caf7e9d6caa9 service nova] Creating event network-changed:f7499fd5-59fc-4400-9c2c-8c34b7007aea for instance c52cb1b7-ac29-4831-9cdc-c780890bb79b on n-h2-844626-8 Aug 09 14:38:50.196655 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5359b8c2-4163-431d-820c-2e5d81c7aa39 req-c24c7dad-dd6e-4118-8c15-caf7e9d6caa9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.111104 Aug 09 14:38:50.202479 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1050/2126] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:50.219717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b62fdbc0-935e-4d14-965b-285e18ae94f3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:50.221090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b62fdbc0-935e-4d14-965b-285e18ae94f3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:50.232770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b62fdbc0-935e-4d14-965b-285e18ae94f3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:50.233806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b62fdbc0-935e-4d14-965b-285e18ae94f3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:50.234622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b62fdbc0-935e-4d14-965b-285e18ae94f3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:50.235748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b62fdbc0-935e-4d14-965b-285e18ae94f3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:50.236457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b62fdbc0-935e-4d14-965b-285e18ae94f3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:50.237206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b62fdbc0-935e-4d14-965b-285e18ae94f3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:50.571644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48148b74-815c-41f3-9504-6c84919c737d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:50.582997 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48148b74-815c-41f3-9504-6c84919c737d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.636379 Aug 09 14:38:50.583610 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1077/2127] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:49 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:50.592403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2168a42e-ed38-40e7-883e-8529bbb9f0d6 req-9ae3fca2-e1a4-4d6c-a893-dde963b6a291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a2bdaee-7506-41d7-89d8-033540a2613d", "name": "network-vif-deleted", "tag": "ac0b0587-1765-4942-9531-0558c309477e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:50.613435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2168a42e-ed38-40e7-883e-8529bbb9f0d6 req-9ae3fca2-e1a4-4d6c-a893-dde963b6a291 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:50.618286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2168a42e-ed38-40e7-883e-8529bbb9f0d6 req-9ae3fca2-e1a4-4d6c-a893-dde963b6a291 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:50.618957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2168a42e-ed38-40e7-883e-8529bbb9f0d6 req-9ae3fca2-e1a4-4d6c-a893-dde963b6a291 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:50.640966 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2168a42e-ed38-40e7-883e-8529bbb9f0d6 req-9ae3fca2-e1a4-4d6c-a893-dde963b6a291 service nova] Creating event network-vif-deleted:ac0b0587-1765-4942-9531-0558c309477e for instance 7a2bdaee-7506-41d7-89d8-033540a2613d on n-h1-844626-8 Aug 09 14:38:50.659699 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2168a42e-ed38-40e7-883e-8529bbb9f0d6 req-9ae3fca2-e1a4-4d6c-a893-dde963b6a291 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074645 Aug 09 14:38:50.660912 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1078/2128] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:50.671544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-499bc68e-2a56-4667-9603-5050ec95c7dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:50.672686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-499bc68e-2a56-4667-9603-5050ec95c7dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:50.697242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-499bc68e-2a56-4667-9603-5050ec95c7dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:50.698078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-499bc68e-2a56-4667-9603-5050ec95c7dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:50.698505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-499bc68e-2a56-4667-9603-5050ec95c7dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:50.699254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-499bc68e-2a56-4667-9603-5050ec95c7dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:50.700292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-499bc68e-2a56-4667-9603-5050ec95c7dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:50.700292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-499bc68e-2a56-4667-9603-5050ec95c7dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:50.849019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b62fdbc0-935e-4d14-965b-285e18ae94f3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:50.866710 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b62fdbc0-935e-4d14-965b-285e18ae94f3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1317 microversion: 2.1 time: 0.657942 Aug 09 14:38:50.866983 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1051/2129] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:50 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:50.878051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a79165e5-ac07-4174-97ee-8b2a7b9695b4 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.109"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:51.200870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a79165e5-ac07-4174-97ee-8b2a7b9695b4 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:51.207745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a79165e5-ac07-4174-97ee-8b2a7b9695b4 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:51.208474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a79165e5-ac07-4174-97ee-8b2a7b9695b4 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:51.209094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a79165e5-ac07-4174-97ee-8b2a7b9695b4 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:51.210199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a79165e5-ac07-4174-97ee-8b2a7b9695b4 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:51.210833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a79165e5-ac07-4174-97ee-8b2a7b9695b4 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:51.211453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a79165e5-ac07-4174-97ee-8b2a7b9695b4 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:51.264870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-499bc68e-2a56-4667-9603-5050ec95c7dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:51.273279 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-499bc68e-2a56-4667-9603-5050ec95c7dd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 0.610998 Aug 09 14:38:51.273865 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1079/2130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:50 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:51.279987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fec1fbc1-46d0-413b-9989-dc6b359feb06 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:51.280768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fec1fbc1-46d0-413b-9989-dc6b359feb06 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:51.288296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec1fbc1-46d0-413b-9989-dc6b359feb06 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:51.288992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec1fbc1-46d0-413b-9989-dc6b359feb06 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:51.289105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec1fbc1-46d0-413b-9989-dc6b359feb06 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:51.289775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec1fbc1-46d0-413b-9989-dc6b359feb06 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:51.290393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec1fbc1-46d0-413b-9989-dc6b359feb06 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:51.291199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec1fbc1-46d0-413b-9989-dc6b359feb06 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:51.311691 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-fec1fbc1-46d0-413b-9989-dc6b359feb06 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fec1fbc1-46d0-413b-9989-dc6b359feb06 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d HTTP/1.1 Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '7a2bdaee-7506-41d7-89d8-033540a2613d'} Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:51.317598 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.322954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.322954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:51.322954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:51.322954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:51.322954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:51.322954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:38:51.322954 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.324564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fec1fbc1-46d0-413b-9989-dc6b359feb06 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 404 to user: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:51.325585 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fec1fbc1-46d0-413b-9989-dc6b359feb06 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 404 len: 111 microversion: 2.1 time: 0.050641 Aug 09 14:38:51.326632 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1080/2131] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:51 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:38:51.333691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a045429-bb4b-45e9-8377-69d7b306807a tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-573447265", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "bd317c1b-dbf9-4a6f-b83f-8160e46b2998"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a045429-bb4b-45e9-8377-69d7b306807a tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Request method failure captured: Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 242 Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nFoq42Cmp9VqL1BUGdhGX_lCFTrZLCh3-IkMS0RXGspyC7w_VAtIg-HV-yp4x81PgwVia3qzG-8pD03LyUJ__B12_2P_iJc16jMxcR5UyCQbhoGkqvQuy0tMd2eIsjmZTnN02pPjumJr7sqeLAYzoJiPeyl0z0sckz2kK6mcKpTtTo Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3d715f7d59ae497b88931ca1a472c239", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 83af2ac2f8eb4f9a8c8fe6cbc1e5f02b Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-573447265", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "bd317c1b-dbf9-4a6f-b83f-8160e46b2998"}]}} Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-573447265', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'bd317c1b-dbf9-4a6f-b83f-8160e46b2998'}]}}} Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:51.338362 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:51.343585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.346025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a045429-bb4b-45e9-8377-69d7b306807a tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:51.347017 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a045429-bb4b-45e9-8377-69d7b306807a tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.019295 Aug 09 14:38:51.348111 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1081/2132] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:38:51 2022] POST /compute/v2.1/servers => generated 175 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:38:51.352810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3334170e-0b2a-4bc5-9a0a-01492d0273b2 req-60b73dc4-9f58-46f1-b6dd-ed5cc9c84014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c528e1-bc7a-4791-9a0f-de8414ea9077", "name": "network-vif-plugged", "status": "completed", "tag": "056748cf-883c-4a7b-85dd-4283d05e1cbe"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:51.364590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3334170e-0b2a-4bc5-9a0a-01492d0273b2 req-60b73dc4-9f58-46f1-b6dd-ed5cc9c84014 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:51.365874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3334170e-0b2a-4bc5-9a0a-01492d0273b2 req-60b73dc4-9f58-46f1-b6dd-ed5cc9c84014 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:51.366485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3334170e-0b2a-4bc5-9a0a-01492d0273b2 req-60b73dc4-9f58-46f1-b6dd-ed5cc9c84014 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:51.384430 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3334170e-0b2a-4bc5-9a0a-01492d0273b2 req-60b73dc4-9f58-46f1-b6dd-ed5cc9c84014 service nova] Creating event network-vif-plugged:056748cf-883c-4a7b-85dd-4283d05e1cbe for instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 on n-h2-844626-8 Aug 09 14:38:51.399487 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3334170e-0b2a-4bc5-9a0a-01492d0273b2 req-60b73dc4-9f58-46f1-b6dd-ed5cc9c84014 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046691 Aug 09 14:38:51.401922 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1082/2133] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:51.409215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30bb20a9-0af3-4dd7-a37e-22531bce1e75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '.version_select at 0x7f41dd388310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:51.433128 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30bb20a9-0af3-4dd7-a37e-22531bce1e75 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-806116061" status: 202 len: 0 microversion: 2.1 time: 0.029718 Aug 09 14:38:51.433848 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1083/2134] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 9 14:38:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-806116061 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:38:51.443055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf064afd-e379-4341-8622-3540006ba563 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:51.443524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cf064afd-e379-4341-8622-3540006ba563 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: a86ef1e6-f61a-4dce-a5aa-746aa6b152e3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:51.461060 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-cf064afd-e379-4341-8622-3540006ba563 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] HTTP exception thrown: Instance a86ef1e6-f61a-4dce-a5aa-746aa6b152e3 could not be found. Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf064afd-e379-4341-8622-3540006ba563 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Request method failure captured: Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/a86ef1e6-f61a-4dce-a5aa-746aa6b152e3/metadata HTTP/1.1 Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nFoq42Cmp9VqL1BUGdhGX_lCFTrZLCh3-IkMS0RXGspyC7w_VAtIg-HV-yp4x81PgwVia3qzG-8pD03LyUJ__B12_2P_iJc16jMxcR5UyCQbhoGkqvQuy0tMd2eIsjmZTnN02pPjumJr7sqeLAYzoJiPeyl0z0sckz2kK6mcKpTtTo Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3d715f7d59ae497b88931ca1a472c239", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 83af2ac2f8eb4f9a8c8fe6cbc1e5f02b Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance a86ef1e6-f61a-4dce-a5aa-746aa6b152e3 could not be found. Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'server_id': 'a86ef1e6-f61a-4dce-a5aa-746aa6b152e3'} Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a86ef1e6-f61a-4dce-a5aa-746aa6b152e3 could not be found. Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a86ef1e6-f61a-4dce-a5aa-746aa6b152e3 could not be found. Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:51.470639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:51.475507 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:51.475507 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:51.475507 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a86ef1e6-f61a-4dce-a5aa-746aa6b152e3 could not be found. Aug 09 14:38:51.475507 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.475507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf064afd-e379-4341-8622-3540006ba563 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Returning 404 to user: Instance a86ef1e6-f61a-4dce-a5aa-746aa6b152e3 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:51.475507 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf064afd-e379-4341-8622-3540006ba563 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "GET /compute/v2.1/servers/a86ef1e6-f61a-4dce-a5aa-746aa6b152e3/metadata" status: 404 len: 111 microversion: 2.1 time: 0.037454 Aug 09 14:38:51.475507 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1084/2135] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:38:51 2022] GET /compute/v2.1/servers/a86ef1e6-f61a-4dce-a5aa-746aa6b152e3/metadata => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:38:51.613848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8f5a4c5-0fa5-471e-8175-6760215adcab tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:51.622323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c8f5a4c5-0fa5-471e-8175-6760215adcab tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:51.631482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8f5a4c5-0fa5-471e-8175-6760215adcab tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:51.632579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8f5a4c5-0fa5-471e-8175-6760215adcab tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:51.633403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8f5a4c5-0fa5-471e-8175-6760215adcab tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:51.634909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8f5a4c5-0fa5-471e-8175-6760215adcab tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:51.635683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8f5a4c5-0fa5-471e-8175-6760215adcab tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:51.636580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8f5a4c5-0fa5-471e-8175-6760215adcab tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:51.893919 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-a79165e5-ac07-4174-97ee-8b2a7b9695b4 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] HTTP exception thrown: Floating IP 172.25.5.109 is not associated with instance 46aa8418-3f46-4f90-bb08-763d20055e1c. Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a79165e5-ac07-4174-97ee-8b2a7b9695b4 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Request method failure captured: Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c/action HTTP/1.1 Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 49 Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nE94aOs3CPMzo2VJbJHnksrvBTR--c8QNCAPjWYzrC4Aqa2-O6m09duyuiHvSCZKtfFvCrvhKEYPpbhruw9iekG4cZxOmwkYxJRfXz3FoiWSR8joROeZCg7mJGCXM_Iscb1u_Sp1IRMlFMC-BHYnHnwW9SEodimy2FLizYJwFN-y6k Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 46d8cf5b02944869a9ad2541a4e2af62 Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-790761872 Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_46d8cf5b02944869a9ad2541a4e2af62", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/46d8cf5b02944869a9ad2541a4e2af62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/46d8cf5b02944869a9ad2541a4e2af62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/46d8cf5b02944869a9ad2541a4e2af62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-790761872 Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 46d8cf5b02944869a9ad2541a4e2af62 Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-790761872 Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FloatingIPsAssociationTestJSON-790761872-project Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 6275c73b47be44c4a646761442343063 Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-790761872-project Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: {"removeFloatingIp": {"address": "172.25.5.109"}} Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: exception: Floating IP 172.25.5.109 is not associated with instance 46aa8418-3f46-4f90-bb08-763d20055e1c. Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '46aa8418-3f46-4f90-bb08-763d20055e1c', 'body': {'removeFloatingIp': {'address': '172.25.5.109'}}} Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.5.109 is not associated with instance 46aa8418-3f46-4f90-bb08-763d20055e1c. Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.5.109 is not associated with instance 46aa8418-3f46-4f90-bb08-763d20055e1c. Aug 09 14:38:51.896863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.904503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a79165e5-ac07-4174-97ee-8b2a7b9695b4 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Returning 409 to user: Floating IP 172.25.5.109 is not associated with instance 46aa8418-3f46-4f90-bb08-763d20055e1c. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:51.907790 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a79165e5-ac07-4174-97ee-8b2a7b9695b4 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "POST /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c/action" status: 409 len: 146 microversion: 2.1 time: 1.039459 Aug 09 14:38:51.914733 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1052/2136] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:38:50 2022] POST /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c/action => generated 146 bytes in 1047 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:38:51.922258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88d1aeb8-e6a8-445d-89f8-1735c3df1eb3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-227733959", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd317c1b-dbf9-4a6f-b83f-8160e46b2998"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88d1aeb8-e6a8-445d-89f8-1735c3df1eb3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Request method failure captured: Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 498 Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nFoq42Cmp9VqL1BUGdhGX_lCFTrZLCh3-IkMS0RXGspyC7w_VAtIg-HV-yp4x81PgwVia3qzG-8pD03LyUJ__B12_2P_iJc16jMxcR5UyCQbhoGkqvQuy0tMd2eIsjmZTnN02pPjumJr7sqeLAYzoJiPeyl0z0sckz2kK6mcKpTtTo Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3d715f7d59ae497b88931ca1a472c239", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 83af2ac2f8eb4f9a8c8fe6cbc1e5f02b Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-227733959", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd317c1b-dbf9-4a6f-b83f-8160e46b2998"}]}} Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-227733959', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'bd317c1b-dbf9-4a6f-b83f-8160e46b2998'}]}}} Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 14:38:51.943500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:51.947068 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:51.950828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88d1aeb8-e6a8-445d-89f8-1735c3df1eb3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:51.954961 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88d1aeb8-e6a8-445d-89f8-1735c3df1eb3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.038748 Aug 09 14:38:51.964685 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1053/2137] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:38:51 2022] POST /compute/v2.1/servers => generated 687 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:38:51.972826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b791399-1ffc-4eb4-bc73-f1aa9cd5ce3f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:51.974622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b791399-1ffc-4eb4-bc73-f1aa9cd5ce3f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:51.981681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b791399-1ffc-4eb4-bc73-f1aa9cd5ce3f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:51.982175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b791399-1ffc-4eb4-bc73-f1aa9cd5ce3f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:51.982617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b791399-1ffc-4eb4-bc73-f1aa9cd5ce3f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:51.983351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b791399-1ffc-4eb4-bc73-f1aa9cd5ce3f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:51.983808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b791399-1ffc-4eb4-bc73-f1aa9cd5ce3f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:51.984242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b791399-1ffc-4eb4-bc73-f1aa9cd5ce3f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:52.019456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c8f5a4c5-0fa5-471e-8175-6760215adcab tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:52.034332 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8f5a4c5-0fa5-471e-8175-6760215adcab tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1392 microversion: 2.1 time: 0.424201 Aug 09 14:38:52.034951 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1085/2138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:51 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1392 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:38:52.047284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.109"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:52.440402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:52.451050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:52.452258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:52.453685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:52.455378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:52.456407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:52.457459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:52.465539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b791399-1ffc-4eb4-bc73-f1aa9cd5ce3f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:52.478979 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b791399-1ffc-4eb4-bc73-f1aa9cd5ce3f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1317 microversion: 2.1 time: 0.510194 Aug 09 14:38:52.497496 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1054/2139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:51 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:52.504432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c38b6918-66d3-4bc7-8d46-2a5e054b2914 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-879773519", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd317c1b-dbf9-4a6f-b83f-8160e46b2998"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c38b6918-66d3-4bc7-8d46-2a5e054b2914 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Request method failure captured: Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 499 Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nFoq42Cmp9VqL1BUGdhGX_lCFTrZLCh3-IkMS0RXGspyC7w_VAtIg-HV-yp4x81PgwVia3qzG-8pD03LyUJ__B12_2P_iJc16jMxcR5UyCQbhoGkqvQuy0tMd2eIsjmZTnN02pPjumJr7sqeLAYzoJiPeyl0z0sckz2kK6mcKpTtTo Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3d715f7d59ae497b88931ca1a472c239", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 83af2ac2f8eb4f9a8c8fe6cbc1e5f02b Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-879773519", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd317c1b-dbf9-4a6f-b83f-8160e46b2998"}]}} Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-879773519', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'bd317c1b-dbf9-4a6f-b83f-8160e46b2998'}]}}} Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 14:38:52.515858 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:52.522979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.528565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c38b6918-66d3-4bc7-8d46-2a5e054b2914 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:52.529721 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c38b6918-66d3-4bc7-8d46-2a5e054b2914 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.030845 Aug 09 14:38:52.531012 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1055/2140] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:38:52 2022] POST /compute/v2.1/servers => generated 689 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:38:52.538577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fb015b86-b2c9-49db-abb8-f49b99e7b256 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:52.539895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fb015b86-b2c9-49db-abb8-f49b99e7b256 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:52.549956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb015b86-b2c9-49db-abb8-f49b99e7b256 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:52.550703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb015b86-b2c9-49db-abb8-f49b99e7b256 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:52.551391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb015b86-b2c9-49db-abb8-f49b99e7b256 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:52.552110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb015b86-b2c9-49db-abb8-f49b99e7b256 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:52.552574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb015b86-b2c9-49db-abb8-f49b99e7b256 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:52.552988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb015b86-b2c9-49db-abb8-f49b99e7b256 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:52.846276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fb015b86-b2c9-49db-abb8-f49b99e7b256 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:52.862601 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fb015b86-b2c9-49db-abb8-f49b99e7b256 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 0.330171 Aug 09 14:38:52.863509 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1056/2141] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:52 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:52.882396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-508cbc12-94f5-4f23-abf1-18d0962b3801 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1903628775", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd317c1b-dbf9-4a6f-b83f-8160e46b2998"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:52.896532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "refresh_cache-c52cb1b7-ac29-4831-9cdc-c780890bb79b" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:38:52.896721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquired lock "refresh_cache-c52cb1b7-ac29-4831-9cdc-c780890bb79b" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-508cbc12-94f5-4f23-abf1-18d0962b3801 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Request method failure captured: Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 754 Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nFoq42Cmp9VqL1BUGdhGX_lCFTrZLCh3-IkMS0RXGspyC7w_VAtIg-HV-yp4x81PgwVia3qzG-8pD03LyUJ__B12_2P_iJc16jMxcR5UyCQbhoGkqvQuy0tMd2eIsjmZTnN02pPjumJr7sqeLAYzoJiPeyl0z0sckz2kK6mcKpTtTo Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3d715f7d59ae497b88931ca1a472c239", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 83af2ac2f8eb4f9a8c8fe6cbc1e5f02b Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1903628775", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd317c1b-dbf9-4a6f-b83f-8160e46b2998"}]}} Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1903628775', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'bd317c1b-dbf9-4a6f-b83f-8160e46b2998'}]}}} Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:38:52.907287 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:38:52.910681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:38:52.913470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:52.913470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:52.914723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-508cbc12-94f5-4f23-abf1-18d0962b3801 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:52.915925 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-508cbc12-94f5-4f23-abf1-18d0962b3801 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.050983 Aug 09 14:38:52.916830 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1057/2142] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:38:52 2022] POST /compute/v2.1/servers => generated 1197 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 09 14:38:52.921917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fe1cc7a-ca92-4ccd-b498-2c9d476a617a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: .version_select at 0x7f41ddb6eca0>, body: {"keypair": {"name": "tempest-keypair-697553484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcgmxdnTK0kh97PAvcpYuo/2h+1wxKpfX4Wg/tjnd/VaB+SRcBKdQbcylxuAqyhss//qj4aTC3NTeFDBGd3nmDR3jbtAPabGf54KEKE47KlFIuXK8KI8eLGM1q9+f6K2w=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:52.941495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-3fe1cc7a-ca92-4ccd-b498-2c9d476a617a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:38:52.946830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-3fe1cc7a-ca92-4ccd-b498-2c9d476a617a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for user 788fc5ec92a2482db1b27657c4f6b426 and project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:38:52.980196 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fe1cc7a-ca92-4ccd-b498-2c9d476a617a tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061910 Aug 09 14:38:52.983145 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1058/2143] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:38:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:53.060231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2fb07a4b-7d89-437d-8ef6-113b7da2d875 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:53.061277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2fb07a4b-7d89-437d-8ef6-113b7da2d875 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:53.073825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb07a4b-7d89-437d-8ef6-113b7da2d875 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:53.074731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb07a4b-7d89-437d-8ef6-113b7da2d875 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:53.075532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb07a4b-7d89-437d-8ef6-113b7da2d875 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:53.077272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb07a4b-7d89-437d-8ef6-113b7da2d875 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:53.077936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb07a4b-7d89-437d-8ef6-113b7da2d875 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:53.078636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2fb07a4b-7d89-437d-8ef6-113b7da2d875 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:53.085176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:53.128904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:53.436785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2fb07a4b-7d89-437d-8ef6-113b7da2d875 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:53.447074 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2fb07a4b-7d89-437d-8ef6-113b7da2d875 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1382 microversion: 2.1 time: 0.392390 Aug 09 14:38:53.447938 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1059/2144] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:53 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1382 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:38:53.466413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7d6d264b-46b4-4402-8cb3-ad5981ad0f10 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1940452852", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd317c1b-dbf9-4a6f-b83f-8160e46b2998"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7d6d264b-46b4-4402-8cb3-ad5981ad0f10 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Request method failure captured: Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 1266 Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nFoq42Cmp9VqL1BUGdhGX_lCFTrZLCh3-IkMS0RXGspyC7w_VAtIg-HV-yp4x81PgwVia3qzG-8pD03LyUJ__B12_2P_iJc16jMxcR5UyCQbhoGkqvQuy0tMd2eIsjmZTnN02pPjumJr7sqeLAYzoJiPeyl0z0sckz2kK6mcKpTtTo Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3d715f7d59ae497b88931ca1a472c239", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 83af2ac2f8eb4f9a8c8fe6cbc1e5f02b Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1940452852", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "bd317c1b-dbf9-4a6f-b83f-8160e46b2998"}]}} Aug 09 14:38:53.479442 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1940452852', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'bd317c1b-dbf9-4a6f-b83f-8160e46b2998'}]}}} Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:53.482523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:38:53.484128 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:38:53.486584 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:38:53.486584 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:53.487113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7d6d264b-46b4-4402-8cb3-ad5981ad0f10 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:53.505185 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7d6d264b-46b4-4402-8cb3-ad5981ad0f10 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.055579 Aug 09 14:38:53.507465 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1060/2145] 10.222.0.50 () {60 vars in 1148 bytes} [Tue Aug 9 14:38:53 2022] POST /compute/v2.1/servers => generated 2221 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 09 14:38:53.545683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8eab5fd9-787e-4956-ad83-cafb0ed4fe59 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '.version_select at 0x7f41ddadf0d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:53.550524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8eab5fd9-787e-4956-ad83-cafb0ed4fe59 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:53.551475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8eab5fd9-787e-4956-ad83-cafb0ed4fe59 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:53.552079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8eab5fd9-787e-4956-ad83-cafb0ed4fe59 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:53.569178 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8eab5fd9-787e-4956-ad83-cafb0ed4fe59 tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.045615 Aug 09 14:38:53.570383 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1061/2146] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:38:53 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:53.577349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de67db6a-4e94-4fe4-9c52-680104ba1a09 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:53.578369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-de67db6a-4e94-4fe4-9c52-680104ba1a09 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:53.588731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de67db6a-4e94-4fe4-9c52-680104ba1a09 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:53.590274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de67db6a-4e94-4fe4-9c52-680104ba1a09 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:53.591249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de67db6a-4e94-4fe4-9c52-680104ba1a09 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:53.592415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de67db6a-4e94-4fe4-9c52-680104ba1a09 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:53.593199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de67db6a-4e94-4fe4-9c52-680104ba1a09 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:53.594153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de67db6a-4e94-4fe4-9c52-680104ba1a09 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:54.266100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-de67db6a-4e94-4fe4-9c52-680104ba1a09 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:54.273956 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-de67db6a-4e94-4fe4-9c52-680104ba1a09 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1507 microversion: 2.1 time: 0.702273 Aug 09 14:38:54.274784 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1062/2147] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:53 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1507 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:54.279883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12ef3a4e-8175-428e-bdbf-f8af3bcd2325 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:54.280590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-12ef3a4e-8175-428e-bdbf-f8af3bcd2325 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: fcd2aafc-44a6-4805-953a-45886cb1977e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:54.310014 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-12ef3a4e-8175-428e-bdbf-f8af3bcd2325 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] HTTP exception thrown: Instance fcd2aafc-44a6-4805-953a-45886cb1977e could not be found. Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12ef3a4e-8175-428e-bdbf-f8af3bcd2325 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Request method failure captured: Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/fcd2aafc-44a6-4805-953a-45886cb1977e/metadata/test2 HTTP/1.1 Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nFoq42Cmp9VqL1BUGdhGX_lCFTrZLCh3-IkMS0RXGspyC7w_VAtIg-HV-yp4x81PgwVia3qzG-8pD03LyUJ__B12_2P_iJc16jMxcR5UyCQbhoGkqvQuy0tMd2eIsjmZTnN02pPjumJr7sqeLAYzoJiPeyl0z0sckz2kK6mcKpTtTo Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3d715f7d59ae497b88931ca1a472c239", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 83af2ac2f8eb4f9a8c8fe6cbc1e5f02b Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance fcd2aafc-44a6-4805-953a-45886cb1977e could not be found. Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'server_id': 'fcd2aafc-44a6-4805-953a-45886cb1977e', 'id': 'test2'} Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcd2aafc-44a6-4805-953a-45886cb1977e could not be found. Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcd2aafc-44a6-4805-953a-45886cb1977e could not be found. Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:38:54.311869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:38:54.316784 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:38:54.316784 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:38:54.316784 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcd2aafc-44a6-4805-953a-45886cb1977e could not be found. Aug 09 14:38:54.316784 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:38:54.318560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12ef3a4e-8175-428e-bdbf-f8af3bcd2325 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Returning 404 to user: Instance fcd2aafc-44a6-4805-953a-45886cb1977e could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:38:54.319493 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-12ef3a4e-8175-428e-bdbf-f8af3bcd2325 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "GET /compute/v2.1/servers/fcd2aafc-44a6-4805-953a-45886cb1977e/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.043540 Aug 09 14:38:54.320081 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1063/2148] 10.222.0.50 () {58 vars in 1281 bytes} [Tue Aug 9 14:38:54 2022] GET /compute/v2.1/servers/fcd2aafc-44a6-4805-953a-45886cb1977e/metadata/test2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:38:54.335432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60e85a1d-d4d0-49e5-9892-5a78eef3fcea tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:54.336394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60e85a1d-d4d0-49e5-9892-5a78eef3fcea tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:54.343868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60e85a1d-d4d0-49e5-9892-5a78eef3fcea tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:54.344756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60e85a1d-d4d0-49e5-9892-5a78eef3fcea tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:54.345464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60e85a1d-d4d0-49e5-9892-5a78eef3fcea tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:54.346446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60e85a1d-d4d0-49e5-9892-5a78eef3fcea tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:54.347137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60e85a1d-d4d0-49e5-9892-5a78eef3fcea tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:54.347810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60e85a1d-d4d0-49e5-9892-5a78eef3fcea tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:54.697381 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60e85a1d-d4d0-49e5-9892-5a78eef3fcea tempest-LiveMigrationTest-360275307 tempest-LiveMigrationTest-360275307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1533 microversion: 2.1 time: 0.375776 Aug 09 14:38:54.698633 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1064/2149] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:54 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1533 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:54.750621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Building network info cache for instance {{(pid=119407) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 14:38:54.761169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d01328d3-5693-4b8c-8aaf-8450d348f071 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:54.761903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d01328d3-5693-4b8c-8aaf-8450d348f071 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:54.781212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d01328d3-5693-4b8c-8aaf-8450d348f071 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:54.781702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d01328d3-5693-4b8c-8aaf-8450d348f071 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:54.782135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d01328d3-5693-4b8c-8aaf-8450d348f071 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:54.782856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d01328d3-5693-4b8c-8aaf-8450d348f071 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:54.783343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d01328d3-5693-4b8c-8aaf-8450d348f071 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:54.783763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d01328d3-5693-4b8c-8aaf-8450d348f071 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:55.200667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d01328d3-5693-4b8c-8aaf-8450d348f071 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:55.212370 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d01328d3-5693-4b8c-8aaf-8450d348f071 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 0.476418 Aug 09 14:38:55.227662 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1065/2150] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:54 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:55.238444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7dbb6e23-1933-4cdd-87bc-6e5d4c33b2c3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:55.243487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7dbb6e23-1933-4cdd-87bc-6e5d4c33b2c3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:55.263039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dbb6e23-1933-4cdd-87bc-6e5d4c33b2c3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:55.263579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dbb6e23-1933-4cdd-87bc-6e5d4c33b2c3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:55.264012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dbb6e23-1933-4cdd-87bc-6e5d4c33b2c3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:55.264724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dbb6e23-1933-4cdd-87bc-6e5d4c33b2c3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:55.265167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dbb6e23-1933-4cdd-87bc-6e5d4c33b2c3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:55.265583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dbb6e23-1933-4cdd-87bc-6e5d4c33b2c3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:55.531834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7dbb6e23-1933-4cdd-87bc-6e5d4c33b2c3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:55.541122 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7dbb6e23-1933-4cdd-87bc-6e5d4c33b2c3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1507 microversion: 2.1 time: 0.312271 Aug 09 14:38:55.559486 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1066/2151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:55 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1507 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:55.569149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f10dd1ba-8940-42be-9f2c-4dfd02b525a3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:55.570061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f10dd1ba-8940-42be-9f2c-4dfd02b525a3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: c9832bbc-9306-44af-b9ce-2237f27500e0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:55.576911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f10dd1ba-8940-42be-9f2c-4dfd02b525a3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:55.577657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f10dd1ba-8940-42be-9f2c-4dfd02b525a3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:55.578288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f10dd1ba-8940-42be-9f2c-4dfd02b525a3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:55.579200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f10dd1ba-8940-42be-9f2c-4dfd02b525a3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:55.579816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f10dd1ba-8940-42be-9f2c-4dfd02b525a3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:55.580469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f10dd1ba-8940-42be-9f2c-4dfd02b525a3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:55.598401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=7 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:55.626222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f10dd1ba-8940-42be-9f2c-4dfd02b525a3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: c9832bbc-9306-44af-b9ce-2237f27500e0] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:38:55.684256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Updating instance_info_cache with network_info: [{"id": "f7499fd5-59fc-4400-9c2c-8c34b7007aea", "address": "fa:16:3e:f2:83:fb", "network": {"id": "8e5664a1-4e3d-47e9-ac93-f7a76fb16596", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1401338871-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "46d8cf5b02944869a9ad2541a4e2af62", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf7499fd5-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 14:38:55.695078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Releasing lock "refresh_cache-c52cb1b7-ac29-4831-9cdc-c780890bb79b" {{(pid=119407) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:38:55.696672 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5d00f065-384c-4a00-988a-171dda37c8b0 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "POST /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b/action" status: 202 len: 0 microversion: 2.1 time: 3.655966 Aug 09 14:38:55.697926 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1086/2152] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:38:52 2022] POST /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b/action => generated 0 bytes in 3658 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 14:38:55.705608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4550b2d9-404a-47a9-844b-b57911cb71b7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:55.706594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4550b2d9-404a-47a9-844b-b57911cb71b7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:55.715429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4550b2d9-404a-47a9-844b-b57911cb71b7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:55.717356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4550b2d9-404a-47a9-844b-b57911cb71b7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:55.718049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4550b2d9-404a-47a9-844b-b57911cb71b7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:55.719073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4550b2d9-404a-47a9-844b-b57911cb71b7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:55.719761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4550b2d9-404a-47a9-844b-b57911cb71b7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:55.720410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4550b2d9-404a-47a9-844b-b57911cb71b7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:55.763957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4550b2d9-404a-47a9-844b-b57911cb71b7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:38:55.814790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:55.824443 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f10dd1ba-8940-42be-9f2c-4dfd02b525a3 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0" status: 204 len: 0 microversion: 2.1 time: 0.262902 Aug 09 14:38:55.833897 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1067/2153] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:38:55 2022] DELETE /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:38:55.844874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-473a6b61-15bb-47f2-9b2a-a45efac6b3e8 req-c3f5ea6d-62c0-434c-9aa8-e551f3d0bf3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c52cb1b7-ac29-4831-9cdc-c780890bb79b", "tag": "f7499fd5-59fc-4400-9c2c-8c34b7007aea"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:55.855778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-473a6b61-15bb-47f2-9b2a-a45efac6b3e8 req-c3f5ea6d-62c0-434c-9aa8-e551f3d0bf3a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:55.856544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-473a6b61-15bb-47f2-9b2a-a45efac6b3e8 req-c3f5ea6d-62c0-434c-9aa8-e551f3d0bf3a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:55.857176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-473a6b61-15bb-47f2-9b2a-a45efac6b3e8 req-c3f5ea6d-62c0-434c-9aa8-e551f3d0bf3a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:55.871314 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-473a6b61-15bb-47f2-9b2a-a45efac6b3e8 req-c3f5ea6d-62c0-434c-9aa8-e551f3d0bf3a service nova] Creating event network-changed:f7499fd5-59fc-4400-9c2c-8c34b7007aea for instance c52cb1b7-ac29-4831-9cdc-c780890bb79b on n-h2-844626-8 Aug 09 14:38:55.877576 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-473a6b61-15bb-47f2-9b2a-a45efac6b3e8 req-c3f5ea6d-62c0-434c-9aa8-e551f3d0bf3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037228 Aug 09 14:38:55.878867 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1068/2154] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:55.887037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-656694422", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95a77029-1d4f-4aec-aada-849bacf4e174"}], "security_groups": [{"name": "tempest-securitygroup--1309063650"}], "key_name": "tempest-keypair-697553484", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:55.930196 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4550b2d9-404a-47a9-844b-b57911cb71b7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 204 len: 0 microversion: 2.1 time: 0.230668 Aug 09 14:38:55.938879 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1087/2155] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:38:55 2022] DELETE /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:38:55.957547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:55.966023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:55.979212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:55.979706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:55.980199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:55.980891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:55.981348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:55.981761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:56.121423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:38:56.122710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:38:56.123417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:38:56.124413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:38:56.126035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:38:56.165353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] validate_networks() for [('95a77029-1d4f-4aec-aada-849bacf4e174', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:38:56.245051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:56.252028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:56.252845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:56.253738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:56.254552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:56.255115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:56.255728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:56.304929 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f50efec-65d1-48b9-b718-dfaffdd17396 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "POST /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077/action" status: 202 len: 1109 microversion: 2.1 time: 0.359663 Aug 09 14:38:56.305831 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1088/2156] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:38:55 2022] POST /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077/action => generated 1109 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 09 14:38:56.317305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-26275d8a-b157-4356-b7d7-b135a5415bd6 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:56.319736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-26275d8a-b157-4356-b7d7-b135a5415bd6 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:56.335053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26275d8a-b157-4356-b7d7-b135a5415bd6 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:56.336280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26275d8a-b157-4356-b7d7-b135a5415bd6 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:56.337216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26275d8a-b157-4356-b7d7-b135a5415bd6 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:56.338766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26275d8a-b157-4356-b7d7-b135a5415bd6 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:56.340499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26275d8a-b157-4356-b7d7-b135a5415bd6 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:56.341381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26275d8a-b157-4356-b7d7-b135a5415bd6 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:56.440673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-26275d8a-b157-4356-b7d7-b135a5415bd6 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:38:56.453564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=18 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:56.624255 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-26275d8a-b157-4356-b7d7-b135a5415bd6 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 204 len: 0 microversion: 2.1 time: 0.315793 Aug 09 14:38:56.625540 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1089/2157] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:38:56 2022] DELETE /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:38:56.632114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c1e08013-4a48-4a29-87eb-71d86d44a57c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:56.632597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c1e08013-4a48-4a29-87eb-71d86d44a57c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: c9832bbc-9306-44af-b9ce-2237f27500e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:56.643743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1e08013-4a48-4a29-87eb-71d86d44a57c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:56.644230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1e08013-4a48-4a29-87eb-71d86d44a57c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:56.644724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1e08013-4a48-4a29-87eb-71d86d44a57c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:56.645427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1e08013-4a48-4a29-87eb-71d86d44a57c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:56.645980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1e08013-4a48-4a29-87eb-71d86d44a57c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:56.646446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1e08013-4a48-4a29-87eb-71d86d44a57c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:56.886278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c1e08013-4a48-4a29-87eb-71d86d44a57c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af2ac2f8eb4f9a8c8fe6cbc1e5f02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d715f7d59ae497b88931ca1a472c239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:56.895365 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c1e08013-4a48-4a29-87eb-71d86d44a57c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0" status: 200 len: 1525 microversion: 2.1 time: 0.268407 Aug 09 14:38:56.896235 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1090/2158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:56 2022] GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0 => generated 1525 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:56.900988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0e0969e-9b9a-4753-82e4-8aaa2c4cf953 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:56.901599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0e0969e-9b9a-4753-82e4-8aaa2c4cf953 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:56.907593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e0969e-9b9a-4753-82e4-8aaa2c4cf953 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:56.908498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e0969e-9b9a-4753-82e4-8aaa2c4cf953 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:56.908647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e0969e-9b9a-4753-82e4-8aaa2c4cf953 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:56.909322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e0969e-9b9a-4753-82e4-8aaa2c4cf953 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:56.909775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e0969e-9b9a-4753-82e4-8aaa2c4cf953 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:56.910191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e0969e-9b9a-4753-82e4-8aaa2c4cf953 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:56.918622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:38:56.919992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:38:56.920464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:38:56.921085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:38:56.921494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:38:56.932484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:56.933074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:56.933556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:56.934277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:56.934721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:56.935166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:56.952470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:38:56.957527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Getting quotas for user 788fc5ec92a2482db1b27657c4f6b426 and project 5ee97f231f894a7b8f401cce82b7026e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:38:56.971772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:38:56.974167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:38:56.986213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:38:57.031280 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf27368c-8a62-40d1-9a92-0c18d17a958c tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.150549 Aug 09 14:38:57.032257 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1069/2159] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:38:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:38:57.037216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b12255f5-6ac9-4508-a647-6ef87b5265e6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:57.037818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b12255f5-6ac9-4508-a647-6ef87b5265e6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:57.049589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b12255f5-6ac9-4508-a647-6ef87b5265e6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:57.050487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b12255f5-6ac9-4508-a647-6ef87b5265e6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:57.051311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b12255f5-6ac9-4508-a647-6ef87b5265e6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:57.052180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b12255f5-6ac9-4508-a647-6ef87b5265e6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:57.052814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b12255f5-6ac9-4508-a647-6ef87b5265e6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:57.054134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b12255f5-6ac9-4508-a647-6ef87b5265e6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:57.085686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a0e0969e-9b9a-4753-82e4-8aaa2c4cf953 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:57.094937 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0e0969e-9b9a-4753-82e4-8aaa2c4cf953 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1388 microversion: 2.1 time: 0.197832 Aug 09 14:38:57.095982 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1091/2160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:56 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1388 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:57.112303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f8b2441-bfa8-466c-be98-bd1059204001 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:57.113273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f8b2441-bfa8-466c-be98-bd1059204001 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:57.119701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f8b2441-bfa8-466c-be98-bd1059204001 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:57.120312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f8b2441-bfa8-466c-be98-bd1059204001 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:57.121114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f8b2441-bfa8-466c-be98-bd1059204001 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:57.121918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f8b2441-bfa8-466c-be98-bd1059204001 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:57.122553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f8b2441-bfa8-466c-be98-bd1059204001 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:57.123272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f8b2441-bfa8-466c-be98-bd1059204001 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:57.250017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b12255f5-6ac9-4508-a647-6ef87b5265e6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:57.258660 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b12255f5-6ac9-4508-a647-6ef87b5265e6 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 0.225226 Aug 09 14:38:57.259480 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1070/2161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:57 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:57.279410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.109"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:57.282233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:57.289447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:57.290040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:57.290545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:57.291380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:57.291902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:57.292480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:57.311999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6f8b2441-bfa8-466c-be98-bd1059204001 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:57.323343 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f8b2441-bfa8-466c-be98-bd1059204001 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.226110 Aug 09 14:38:57.323880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "refresh_cache-46aa8418-3f46-4f90-bb08-763d20055e1c" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:38:57.324481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquired lock "refresh_cache-46aa8418-3f46-4f90-bb08-763d20055e1c" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:38:57.328103 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1092/2162] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:57 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:57.334405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-728c24ec-1c9c-45c2-8e43-8c151dee30af tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:57.336651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-728c24ec-1c9c-45c2-8e43-8c151dee30af tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:57.413062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-728c24ec-1c9c-45c2-8e43-8c151dee30af tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:57.423968 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-728c24ec-1c9c-45c2-8e43-8c151dee30af tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 200 len: 1240 microversion: 2.1 time: 0.091316 Aug 09 14:38:57.424957 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1093/2163] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:57 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:57.436339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b27d051-f67c-468e-bb07-cb58cac22ac2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "733b1bbd-e6d4-4329-be25-556e25c25b76"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:57.440204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b27d051-f67c-468e-bb07-cb58cac22ac2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:57.447698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b27d051-f67c-468e-bb07-cb58cac22ac2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:57.448480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b27d051-f67c-468e-bb07-cb58cac22ac2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:57.449108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b27d051-f67c-468e-bb07-cb58cac22ac2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:57.449951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b27d051-f67c-468e-bb07-cb58cac22ac2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:57.450555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b27d051-f67c-468e-bb07-cb58cac22ac2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:57.451546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b27d051-f67c-468e-bb07-cb58cac22ac2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:58.053695 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b27d051-f67c-468e-bb07-cb58cac22ac2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "POST /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621410 Aug 09 14:38:58.057594 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1094/2164] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 14:38:57 2022] POST /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments => generated 194 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:38:58.065460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-323489b7-231b-4260-a2f3-29d6b5b1dd9c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:58.066400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-323489b7-231b-4260-a2f3-29d6b5b1dd9c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: c9832bbc-9306-44af-b9ce-2237f27500e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:58.075977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-323489b7-231b-4260-a2f3-29d6b5b1dd9c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:58.077786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-323489b7-231b-4260-a2f3-29d6b5b1dd9c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:58.078842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-323489b7-231b-4260-a2f3-29d6b5b1dd9c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:58.080193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-323489b7-231b-4260-a2f3-29d6b5b1dd9c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:58.081415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-323489b7-231b-4260-a2f3-29d6b5b1dd9c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:58.082900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-323489b7-231b-4260-a2f3-29d6b5b1dd9c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:58.811519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-323489b7-231b-4260-a2f3-29d6b5b1dd9c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af2ac2f8eb4f9a8c8fe6cbc1e5f02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d715f7d59ae497b88931ca1a472c239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:58.821450 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-323489b7-231b-4260-a2f3-29d6b5b1dd9c tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0" status: 200 len: 1525 microversion: 2.1 time: 0.761394 Aug 09 14:38:58.831873 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1095/2165] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:58 2022] GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0 => generated 1525 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:59.182981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1284140435", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": "none"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:38:59.274671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:38:59.275159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:38:59.275603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:38:59.276009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:38:59.276425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:38:59.297158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:59.297508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:59.301700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:59.302611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:59.303135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:59.303596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:59.339162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Getting quotas for project ede6465aee52454782e0ce78386f5f8e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:38:59.345538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Getting quotas for user f2ad1801beca404da231563a6f2fe67f and project ede6465aee52454782e0ce78386f5f8e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:38:59.359457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:38:59.362089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:38:59.416166 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-737592a8-18a2-4dfe-8702-5eb676a4b1c6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.582597 Aug 09 14:38:59.424913 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1096/2166] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:38:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 14:38:59.432773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-174a3a00-fb59-452e-b366-f771afd00b40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:59.433771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-174a3a00-fb59-452e-b366-f771afd00b40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:59.446722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-174a3a00-fb59-452e-b366-f771afd00b40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:59.448399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-174a3a00-fb59-452e-b366-f771afd00b40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:59.453594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-174a3a00-fb59-452e-b366-f771afd00b40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:59.454994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-174a3a00-fb59-452e-b366-f771afd00b40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:59.455738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-174a3a00-fb59-452e-b366-f771afd00b40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:59.457133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-174a3a00-fb59-452e-b366-f771afd00b40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:59.891589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-174a3a00-fb59-452e-b366-f771afd00b40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:38:59.905006 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-174a3a00-fb59-452e-b366-f771afd00b40 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1388 microversion: 2.1 time: 0.478646 Aug 09 14:38:59.906347 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1097/2167] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:59 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1388 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:38:59.914511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-404b9858-d0c7-4a14-be87-6371c818c523 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:38:59.915585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-404b9858-d0c7-4a14-be87-6371c818c523 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:38:59.923731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-404b9858-d0c7-4a14-be87-6371c818c523 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:59.924665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-404b9858-d0c7-4a14-be87-6371c818c523 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:59.925430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-404b9858-d0c7-4a14-be87-6371c818c523 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:38:59.926703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-404b9858-d0c7-4a14-be87-6371c818c523 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:38:59.927383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-404b9858-d0c7-4a14-be87-6371c818c523 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:38:59.928175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-404b9858-d0c7-4a14-be87-6371c818c523 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:00.294389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-404b9858-d0c7-4a14-be87-6371c818c523 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:00.303646 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-404b9858-d0c7-4a14-be87-6371c818c523 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 0.395884 Aug 09 14:39:00.307823 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1098/2168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:38:59 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:00.313908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4272c70a-24c4-44df-8c2d-040ec9b031cb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:00.315365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4272c70a-24c4-44df-8c2d-040ec9b031cb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:00.322335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4272c70a-24c4-44df-8c2d-040ec9b031cb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:00.323036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4272c70a-24c4-44df-8c2d-040ec9b031cb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:00.323757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4272c70a-24c4-44df-8c2d-040ec9b031cb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:00.324628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4272c70a-24c4-44df-8c2d-040ec9b031cb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:00.325344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4272c70a-24c4-44df-8c2d-040ec9b031cb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:00.325973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4272c70a-24c4-44df-8c2d-040ec9b031cb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:00.584276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Building network info cache for instance {{(pid=119406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 14:39:00.599677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4272c70a-24c4-44df-8c2d-040ec9b031cb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:00.609663 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4272c70a-24c4-44df-8c2d-040ec9b031cb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.299681 Aug 09 14:39:00.623755 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1099/2169] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:00 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:00.629138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa7ef350-5215-459c-bb65-c7e9f8036490 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:00.629997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa7ef350-5215-459c-bb65-c7e9f8036490 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:00.636571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa7ef350-5215-459c-bb65-c7e9f8036490 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:00.637253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa7ef350-5215-459c-bb65-c7e9f8036490 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:00.637898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa7ef350-5215-459c-bb65-c7e9f8036490 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:00.638769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa7ef350-5215-459c-bb65-c7e9f8036490 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:00.639480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa7ef350-5215-459c-bb65-c7e9f8036490 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:00.640092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa7ef350-5215-459c-bb65-c7e9f8036490 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:00.644817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:00.847837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fa7ef350-5215-459c-bb65-c7e9f8036490 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:00.860191 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa7ef350-5215-459c-bb65-c7e9f8036490 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 200 len: 1298 microversion: 2.1 time: 0.233975 Aug 09 14:39:00.872750 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1100/2170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:00 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 1298 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:00.887643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5450d2b2-b604-4e08-a023-afa5a9d37e61 req-ae3d4549-ee26-42bf-b8d6-dae8de67f5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9832bbc-9306-44af-b9ce-2237f27500e0", "name": "network-vif-deleted", "tag": "e595419e-7100-4f50-9ae7-7041176de044"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:00.925120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5450d2b2-b604-4e08-a023-afa5a9d37e61 req-ae3d4549-ee26-42bf-b8d6-dae8de67f5e5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:00.925588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5450d2b2-b604-4e08-a023-afa5a9d37e61 req-ae3d4549-ee26-42bf-b8d6-dae8de67f5e5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:00.926013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5450d2b2-b604-4e08-a023-afa5a9d37e61 req-ae3d4549-ee26-42bf-b8d6-dae8de67f5e5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:00.949289 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5450d2b2-b604-4e08-a023-afa5a9d37e61 req-ae3d4549-ee26-42bf-b8d6-dae8de67f5e5 service nova] Creating event network-vif-deleted:e595419e-7100-4f50-9ae7-7041176de044 for instance c9832bbc-9306-44af-b9ce-2237f27500e0 on n-h1-844626-8 Aug 09 14:39:00.963912 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5450d2b2-b604-4e08-a023-afa5a9d37e61 req-ae3d4549-ee26-42bf-b8d6-dae8de67f5e5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089695 Aug 09 14:39:00.964883 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1101/2171] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:00.972169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-186f122f-47eb-4adc-ad5a-f19002c8b26f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:00.974928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-186f122f-47eb-4adc-ad5a-f19002c8b26f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:00.983670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-186f122f-47eb-4adc-ad5a-f19002c8b26f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:00.984430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-186f122f-47eb-4adc-ad5a-f19002c8b26f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:00.985033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-186f122f-47eb-4adc-ad5a-f19002c8b26f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:00.985908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-186f122f-47eb-4adc-ad5a-f19002c8b26f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:00.986510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-186f122f-47eb-4adc-ad5a-f19002c8b26f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:00.987113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-186f122f-47eb-4adc-ad5a-f19002c8b26f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:01.241662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-186f122f-47eb-4adc-ad5a-f19002c8b26f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:01.250645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-186f122f-47eb-4adc-ad5a-f19002c8b26f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:01.252193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-186f122f-47eb-4adc-ad5a-f19002c8b26f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:01.258263 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-186f122f-47eb-4adc-ad5a-f19002c8b26f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "PUT /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1419 microversion: 2.75 time: 0.292037 Aug 09 14:39:01.259451 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1102/2172] 10.222.0.50 () {62 vars in 1297 bytes} [Tue Aug 9 14:39:00 2022] PUT /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1419 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:01.264326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc096a29-f96d-461a-bf60-e2b07140f124 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:01.265148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fc096a29-f96d-461a-bf60-e2b07140f124 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] [instance: c9832bbc-9306-44af-b9ce-2237f27500e0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:01.282366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc096a29-f96d-461a-bf60-e2b07140f124 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:01.282860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc096a29-f96d-461a-bf60-e2b07140f124 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:01.283328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc096a29-f96d-461a-bf60-e2b07140f124 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:01.284030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc096a29-f96d-461a-bf60-e2b07140f124 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:01.284474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc096a29-f96d-461a-bf60-e2b07140f124 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:01.284887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc096a29-f96d-461a-bf60-e2b07140f124 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:01.311006 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-fc096a29-f96d-461a-bf60-e2b07140f124 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] HTTP exception thrown: Instance c9832bbc-9306-44af-b9ce-2237f27500e0 could not be found. Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc096a29-f96d-461a-bf60-e2b07140f124 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Request method failure captured: Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0 HTTP/1.1 Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nFoq42Cmp9VqL1BUGdhGX_lCFTrZLCh3-IkMS0RXGspyC7w_VAtIg-HV-yp4x81PgwVia3qzG-8pD03LyUJ__B12_2P_iJc16jMxcR5UyCQbhoGkqvQuy0tMd2eIsjmZTnN02pPjumJr7sqeLAYzoJiPeyl0z0sckz2kK6mcKpTtTo Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3d715f7d59ae497b88931ca1a472c239", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3d715f7d59ae497b88931ca1a472c239"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 3d715f7d59ae497b88931ca1a472c239 Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1157558808 Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 83af2ac2f8eb4f9a8c8fe6cbc1e5f02b Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1157558808-project Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance c9832bbc-9306-44af-b9ce-2237f27500e0 could not be found. Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'c9832bbc-9306-44af-b9ce-2237f27500e0'} Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9832bbc-9306-44af-b9ce-2237f27500e0 could not be found. Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9832bbc-9306-44af-b9ce-2237f27500e0 could not be found. Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:01.312628 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:01.318059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:01.318059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:01.318059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:01.318059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:01.318059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:01.318059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:01.318059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9832bbc-9306-44af-b9ce-2237f27500e0 could not be found. Aug 09 14:39:01.318059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:01.328114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc096a29-f96d-461a-bf60-e2b07140f124 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] Returning 404 to user: Instance c9832bbc-9306-44af-b9ce-2237f27500e0 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:01.329598 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc096a29-f96d-461a-bf60-e2b07140f124 tempest-ServerMetadataNegativeTestJSON-1157558808 tempest-ServerMetadataNegativeTestJSON-1157558808-project] 10.222.0.50 "GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0" status: 404 len: 111 microversion: 2.1 time: 0.068959 Aug 09 14:39:01.339574 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1103/2173] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:01 2022] GET /compute/v2.1/servers/c9832bbc-9306-44af-b9ce-2237f27500e0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:01.351130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-44f7638c-0eb6-4056-9390-b4f4497a85d8 req-ba5f6b56-3afe-4d92-818f-fe03d410abe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c508aaa8-11d1-4593-b840-91b8295b6f8e", "name": "network-vif-deleted", "tag": "6db596c5-3bac-4ac1-8c68-1f1c20808428"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:01.381459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-44f7638c-0eb6-4056-9390-b4f4497a85d8 req-ba5f6b56-3afe-4d92-818f-fe03d410abe2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:01.383170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-44f7638c-0eb6-4056-9390-b4f4497a85d8 req-ba5f6b56-3afe-4d92-818f-fe03d410abe2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:01.383625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-44f7638c-0eb6-4056-9390-b4f4497a85d8 req-ba5f6b56-3afe-4d92-818f-fe03d410abe2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:01.409585 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-44f7638c-0eb6-4056-9390-b4f4497a85d8 req-ba5f6b56-3afe-4d92-818f-fe03d410abe2 service nova] Creating event network-vif-deleted:6db596c5-3bac-4ac1-8c68-1f1c20808428 for instance c508aaa8-11d1-4593-b840-91b8295b6f8e on n-h1-844626-8 Aug 09 14:39:01.425120 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-44f7638c-0eb6-4056-9390-b4f4497a85d8 req-ba5f6b56-3afe-4d92-818f-fe03d410abe2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084033 Aug 09 14:39:01.425648 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1104/2174] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:01.430899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ffe5732-2a8f-4019-90c9-cdb4dd959da6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:01.431640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4ffe5732-2a8f-4019-90c9-cdb4dd959da6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:01.449352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ffe5732-2a8f-4019-90c9-cdb4dd959da6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:01.455467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ffe5732-2a8f-4019-90c9-cdb4dd959da6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:01.455976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ffe5732-2a8f-4019-90c9-cdb4dd959da6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:01.456736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ffe5732-2a8f-4019-90c9-cdb4dd959da6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:01.457199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ffe5732-2a8f-4019-90c9-cdb4dd959da6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:01.457617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ffe5732-2a8f-4019-90c9-cdb4dd959da6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:01.768319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4ffe5732-2a8f-4019-90c9-cdb4dd959da6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:01.784486 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4ffe5732-2a8f-4019-90c9-cdb4dd959da6 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1184 microversion: 2.1 time: 0.356998 Aug 09 14:39:01.801311 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1105/2175] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:01 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1184 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:01.806513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4c92c031-e055-499c-bc90-48a87ca3dc17 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:01.807165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4c92c031-e055-499c-bc90-48a87ca3dc17 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:01.823586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c92c031-e055-499c-bc90-48a87ca3dc17 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:01.828393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c92c031-e055-499c-bc90-48a87ca3dc17 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:01.829210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c92c031-e055-499c-bc90-48a87ca3dc17 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:01.830145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c92c031-e055-499c-bc90-48a87ca3dc17 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:01.830768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c92c031-e055-499c-bc90-48a87ca3dc17 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:01.831407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c92c031-e055-499c-bc90-48a87ca3dc17 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:02.017096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4c92c031-e055-499c-bc90-48a87ca3dc17 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:02.041391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4c92c031-e055-499c-bc90-48a87ca3dc17 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:02.059044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4c92c031-e055-499c-bc90-48a87ca3dc17 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:02.072444 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4c92c031-e055-499c-bc90-48a87ca3dc17 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1417 microversion: 2.75 time: 0.266451 Aug 09 14:39:02.073884 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1106/2176] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:01 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1417 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:02.079294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3bff964f-c2fd-4b59-ac7e-d0389ddb6f86 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:02.080274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3bff964f-c2fd-4b59-ac7e-d0389ddb6f86 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:02.092629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bff964f-c2fd-4b59-ac7e-d0389ddb6f86 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:02.095846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bff964f-c2fd-4b59-ac7e-d0389ddb6f86 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:02.096600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bff964f-c2fd-4b59-ac7e-d0389ddb6f86 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:02.101175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bff964f-c2fd-4b59-ac7e-d0389ddb6f86 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:02.103453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bff964f-c2fd-4b59-ac7e-d0389ddb6f86 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:02.104308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3bff964f-c2fd-4b59-ac7e-d0389ddb6f86 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:02.766236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3bff964f-c2fd-4b59-ac7e-d0389ddb6f86 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:02.777949 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3bff964f-c2fd-4b59-ac7e-d0389ddb6f86 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 0.702577 Aug 09 14:39:02.779875 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1107/2177] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:02 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:02.785450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-872f1020-637b-4ed1-ba51-cfe2c1facdec tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:02.786463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-872f1020-637b-4ed1-ba51-cfe2c1facdec tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:02.794956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-872f1020-637b-4ed1-ba51-cfe2c1facdec tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:02.795847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-872f1020-637b-4ed1-ba51-cfe2c1facdec tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:02.796815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-872f1020-637b-4ed1-ba51-cfe2c1facdec tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:02.800427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-872f1020-637b-4ed1-ba51-cfe2c1facdec tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:02.801739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-872f1020-637b-4ed1-ba51-cfe2c1facdec tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:02.802411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-872f1020-637b-4ed1-ba51-cfe2c1facdec tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:02.825033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Updating instance_info_cache with network_info: [{"id": "d159e2a0-cd63-4b05-83ad-effb48febb0c", "address": "fa:16:3e:71:1b:33", "network": {"id": "8e5664a1-4e3d-47e9-ac93-f7a76fb16596", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1401338871-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "46d8cf5b02944869a9ad2541a4e2af62", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd159e2a0-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 14:39:02.858441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Releasing lock "refresh_cache-46aa8418-3f46-4f90-bb08-763d20055e1c" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:39:02.859978 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ac81bb1e-c46e-4ab8-815a-ca6010741908 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "POST /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c/action" status: 202 len: 0 microversion: 2.1 time: 5.590381 Aug 09 14:39:02.864072 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1071/2178] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:38:57 2022] POST /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c/action => generated 0 bytes in 5592 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 14:39:02.866718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a764b0c-e5e0-4394-9dcc-1168425c4aac tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:02.867540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a764b0c-e5e0-4394-9dcc-1168425c4aac tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:02.895176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a764b0c-e5e0-4394-9dcc-1168425c4aac tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:02.896655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a764b0c-e5e0-4394-9dcc-1168425c4aac tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:02.937213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a764b0c-e5e0-4394-9dcc-1168425c4aac tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:02.937213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a764b0c-e5e0-4394-9dcc-1168425c4aac tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:02.937213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a764b0c-e5e0-4394-9dcc-1168425c4aac tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:02.937213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a764b0c-e5e0-4394-9dcc-1168425c4aac tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:03.255581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-872f1020-637b-4ed1-ba51-cfe2c1facdec tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:03.265543 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-872f1020-637b-4ed1-ba51-cfe2c1facdec tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.483769 Aug 09 14:39:03.276331 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1108/2179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:02 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:03.284756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ddee1016-c0e4-4094-af21-d07901a85011 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:03.291723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ddee1016-c0e4-4094-af21-d07901a85011 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:03.296627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:03.303368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddee1016-c0e4-4094-af21-d07901a85011 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:03.304050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddee1016-c0e4-4094-af21-d07901a85011 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:03.304620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddee1016-c0e4-4094-af21-d07901a85011 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:03.305451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddee1016-c0e4-4094-af21-d07901a85011 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:03.306045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddee1016-c0e4-4094-af21-d07901a85011 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:03.306555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddee1016-c0e4-4094-af21-d07901a85011 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:03.471268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4a764b0c-e5e0-4394-9dcc-1168425c4aac tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:03.473419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ddee1016-c0e4-4094-af21-d07901a85011 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:03.483947 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ddee1016-c0e4-4094-af21-d07901a85011 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1184 microversion: 2.1 time: 0.206089 Aug 09 14:39:03.485084 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a764b0c-e5e0-4394-9dcc-1168425c4aac tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 200 len: 1366 microversion: 2.1 time: 0.622614 Aug 09 14:39:03.485930 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1072/2180] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:02 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 1366 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:03.499688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb8bed7c-9999-40a0-8948-bed9dcbb6394 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '.version_select at 0x7f41dda1a940>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:03.506732 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1109/2181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:03 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1184 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:03.512807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ee02fcd4-84d5-49db-9c2c-d7984449a785 req-3eaec83f-0da9-44f9-9f94-d54c5eab9367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c52cb1b7-ac29-4831-9cdc-c780890bb79b", "name": "network-vif-deleted", "tag": "f7499fd5-59fc-4400-9c2c-8c34b7007aea"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:03.541017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ee02fcd4-84d5-49db-9c2c-d7984449a785 req-3eaec83f-0da9-44f9-9f94-d54c5eab9367 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:03.541779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ee02fcd4-84d5-49db-9c2c-d7984449a785 req-3eaec83f-0da9-44f9-9f94-d54c5eab9367 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:03.542370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ee02fcd4-84d5-49db-9c2c-d7984449a785 req-3eaec83f-0da9-44f9-9f94-d54c5eab9367 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:03.556606 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ee02fcd4-84d5-49db-9c2c-d7984449a785 req-3eaec83f-0da9-44f9-9f94-d54c5eab9367 service nova] Creating event network-vif-deleted:f7499fd5-59fc-4400-9c2c-8c34b7007aea for instance c52cb1b7-ac29-4831-9cdc-c780890bb79b on n-h2-844626-8 Aug 09 14:39:03.568639 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ee02fcd4-84d5-49db-9c2c-d7984449a785 req-3eaec83f-0da9-44f9-9f94-d54c5eab9367 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060536 Aug 09 14:39:03.585777 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1110/2182] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:03.616953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e167ecf6-85e8-4c8c-88b0-92c3de27cd26 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:03.619612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e167ecf6-85e8-4c8c-88b0-92c3de27cd26 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:03.657392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e167ecf6-85e8-4c8c-88b0-92c3de27cd26 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:03.658086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e167ecf6-85e8-4c8c-88b0-92c3de27cd26 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:03.658931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e167ecf6-85e8-4c8c-88b0-92c3de27cd26 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:03.659930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e167ecf6-85e8-4c8c-88b0-92c3de27cd26 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:03.660649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e167ecf6-85e8-4c8c-88b0-92c3de27cd26 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:03.661161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e167ecf6-85e8-4c8c-88b0-92c3de27cd26 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:03.835022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e167ecf6-85e8-4c8c-88b0-92c3de27cd26 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:03.845094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e167ecf6-85e8-4c8c-88b0-92c3de27cd26 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:03.854020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e167ecf6-85e8-4c8c-88b0-92c3de27cd26 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:03.866417 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e167ecf6-85e8-4c8c-88b0-92c3de27cd26 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1417 microversion: 2.75 time: 0.278891 Aug 09 14:39:03.868376 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1111/2183] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:03 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1417 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:03.879419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-84acf0ef-b49c-44d5-b767-5360ec81a281 req-11cfbfce-1418-4cfe-a636-2402f772a192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46aa8418-3f46-4f90-bb08-763d20055e1c", "tag": "d159e2a0-cd63-4b05-83ad-effb48febb0c"}, {"name": "network-changed", "server_uuid": "b93caae4-bb8e-4f8a-8f1f-acd161acd2f1", "tag": "84f32b2b-49b8-46a0-bf53-209be535d114"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:03.895290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-84acf0ef-b49c-44d5-b767-5360ec81a281 req-11cfbfce-1418-4cfe-a636-2402f772a192 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:03.895992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-84acf0ef-b49c-44d5-b767-5360ec81a281 req-11cfbfce-1418-4cfe-a636-2402f772a192 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:03.896423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-84acf0ef-b49c-44d5-b767-5360ec81a281 req-11cfbfce-1418-4cfe-a636-2402f772a192 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:03.911245 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-84acf0ef-b49c-44d5-b767-5360ec81a281 req-11cfbfce-1418-4cfe-a636-2402f772a192 service nova] Creating event network-changed:d159e2a0-cd63-4b05-83ad-effb48febb0c for instance 46aa8418-3f46-4f90-bb08-763d20055e1c on n-h2-844626-8 Aug 09 14:39:03.912778 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-84acf0ef-b49c-44d5-b767-5360ec81a281 req-11cfbfce-1418-4cfe-a636-2402f772a192 service nova] Creating event network-changed:84f32b2b-49b8-46a0-bf53-209be535d114 for instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 on n-h2-844626-8 Aug 09 14:39:03.923435 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-84acf0ef-b49c-44d5-b767-5360ec81a281 req-11cfbfce-1418-4cfe-a636-2402f772a192 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053507 Aug 09 14:39:03.924658 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1112/2184] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:03.931029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4b5adf8-eb59-4a71-bda8-42dfeac2a61b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:03.931933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4b5adf8-eb59-4a71-bda8-42dfeac2a61b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:03.939570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4b5adf8-eb59-4a71-bda8-42dfeac2a61b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:03.940263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4b5adf8-eb59-4a71-bda8-42dfeac2a61b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:03.942234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4b5adf8-eb59-4a71-bda8-42dfeac2a61b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:03.943509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4b5adf8-eb59-4a71-bda8-42dfeac2a61b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:03.944135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4b5adf8-eb59-4a71-bda8-42dfeac2a61b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:03.944798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4b5adf8-eb59-4a71-bda8-42dfeac2a61b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:04.146827 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb8bed7c-9999-40a0-8948-bed9dcbb6394 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/e781f78e-2529-446c-a0fe-0ba884c23075" status: 200 len: 185 microversion: 2.1 time: 0.659619 Aug 09 14:39:04.148819 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1073/2185] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 9 14:39:03 2022] GET /compute/v2.1/os-floating-ips/e781f78e-2529-446c-a0fe-0ba884c23075 => generated 185 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:04.160911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.109"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:04.367271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d4b5adf8-eb59-4a71-bda8-42dfeac2a61b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:04.376580 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4b5adf8-eb59-4a71-bda8-42dfeac2a61b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1472 microversion: 2.1 time: 0.450336 Aug 09 14:39:04.377202 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1113/2186] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:03 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1472 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:04.391193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48963e43-b05b-48e1-a62a-0a7d0b24d3e5 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:04.391811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48963e43-b05b-48e1-a62a-0a7d0b24d3e5 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:04.413106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:04.414159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48963e43-b05b-48e1-a62a-0a7d0b24d3e5 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:04.414702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48963e43-b05b-48e1-a62a-0a7d0b24d3e5 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:04.415214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48963e43-b05b-48e1-a62a-0a7d0b24d3e5 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:04.416076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48963e43-b05b-48e1-a62a-0a7d0b24d3e5 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:04.416578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48963e43-b05b-48e1-a62a-0a7d0b24d3e5 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:04.417003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48963e43-b05b-48e1-a62a-0a7d0b24d3e5 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:04.422275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:04.422275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:04.425909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:04.425909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:04.439669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:04.440654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:04.687580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48963e43-b05b-48e1-a62a-0a7d0b24d3e5 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:04.697786 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48963e43-b05b-48e1-a62a-0a7d0b24d3e5 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.310540 Aug 09 14:39:04.698700 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1114/2187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:04 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:04.717715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ab0c80df-ec3d-4057-8d0e-0b5226812e85 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:04.718589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ab0c80df-ec3d-4057-8d0e-0b5226812e85 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:04.727403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab0c80df-ec3d-4057-8d0e-0b5226812e85 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:04.728076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab0c80df-ec3d-4057-8d0e-0b5226812e85 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:04.728646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab0c80df-ec3d-4057-8d0e-0b5226812e85 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:04.729509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab0c80df-ec3d-4057-8d0e-0b5226812e85 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:04.730226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab0c80df-ec3d-4057-8d0e-0b5226812e85 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:04.730783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab0c80df-ec3d-4057-8d0e-0b5226812e85 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:04.747690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "refresh_cache-46aa8418-3f46-4f90-bb08-763d20055e1c" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:39:04.748099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquired lock "refresh_cache-46aa8418-3f46-4f90-bb08-763d20055e1c" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:39:04.833929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ab0c80df-ec3d-4057-8d0e-0b5226812e85 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:04.855360 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ab0c80df-ec3d-4057-8d0e-0b5226812e85 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1184 microversion: 2.1 time: 0.137216 Aug 09 14:39:04.856397 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1115/2188] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:04 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1184 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:04.862684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-210654b7-941d-4ea5-b15b-132246c8140e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:04.862684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-210654b7-941d-4ea5-b15b-132246c8140e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:04.874724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-210654b7-941d-4ea5-b15b-132246c8140e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:04.875263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-210654b7-941d-4ea5-b15b-132246c8140e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:04.875703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-210654b7-941d-4ea5-b15b-132246c8140e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:04.876405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-210654b7-941d-4ea5-b15b-132246c8140e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:04.876857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-210654b7-941d-4ea5-b15b-132246c8140e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:04.877312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-210654b7-941d-4ea5-b15b-132246c8140e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:05.504764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-210654b7-941d-4ea5-b15b-132246c8140e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:05.513193 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-210654b7-941d-4ea5-b15b-132246c8140e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 200 len: 1366 microversion: 2.1 time: 0.655853 Aug 09 14:39:05.513837 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1116/2189] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:04 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 1366 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:05.535637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-18cf6ba4-cafe-441d-be4d-2a4251f0f3a6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:05.542410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-18cf6ba4-cafe-441d-be4d-2a4251f0f3a6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:05.558341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18cf6ba4-cafe-441d-be4d-2a4251f0f3a6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:05.560339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18cf6ba4-cafe-441d-be4d-2a4251f0f3a6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:05.562784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18cf6ba4-cafe-441d-be4d-2a4251f0f3a6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:05.564293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18cf6ba4-cafe-441d-be4d-2a4251f0f3a6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:05.569599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18cf6ba4-cafe-441d-be4d-2a4251f0f3a6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:05.570125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18cf6ba4-cafe-441d-be4d-2a4251f0f3a6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:05.799384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-18cf6ba4-cafe-441d-be4d-2a4251f0f3a6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:05.808956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-18cf6ba4-cafe-441d-be4d-2a4251f0f3a6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:05.811454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-18cf6ba4-cafe-441d-be4d-2a4251f0f3a6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:05.817315 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-18cf6ba4-cafe-441d-be4d-2a4251f0f3a6 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1438 microversion: 2.75 time: 0.302543 Aug 09 14:39:05.827776 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1117/2190] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:05 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1438 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:05.843015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30c0c815-9a7b-42f6-93ff-88d5a85256bb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:05.843860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30c0c815-9a7b-42f6-93ff-88d5a85256bb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:05.850069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30c0c815-9a7b-42f6-93ff-88d5a85256bb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:05.850706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30c0c815-9a7b-42f6-93ff-88d5a85256bb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:05.851600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30c0c815-9a7b-42f6-93ff-88d5a85256bb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:05.852427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30c0c815-9a7b-42f6-93ff-88d5a85256bb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:05.853002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30c0c815-9a7b-42f6-93ff-88d5a85256bb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:05.853550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30c0c815-9a7b-42f6-93ff-88d5a85256bb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:06.205586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30c0c815-9a7b-42f6-93ff-88d5a85256bb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:06.214519 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30c0c815-9a7b-42f6-93ff-88d5a85256bb tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1478 microversion: 2.1 time: 0.385389 Aug 09 14:39:06.215729 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1118/2191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:05 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1478 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:06.220703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49ea9ea8-3638-4599-9786-a1100ad83e88 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:06.221483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49ea9ea8-3638-4599-9786-a1100ad83e88 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:06.227674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ea9ea8-3638-4599-9786-a1100ad83e88 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:06.229071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ea9ea8-3638-4599-9786-a1100ad83e88 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:06.229778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ea9ea8-3638-4599-9786-a1100ad83e88 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:06.230785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ea9ea8-3638-4599-9786-a1100ad83e88 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:06.231416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ea9ea8-3638-4599-9786-a1100ad83e88 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:06.232765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ea9ea8-3638-4599-9786-a1100ad83e88 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:06.644074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Building network info cache for instance {{(pid=119406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 14:39:06.659113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-49ea9ea8-3638-4599-9786-a1100ad83e88 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:06.673053 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49ea9ea8-3638-4599-9786-a1100ad83e88 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.450306 Aug 09 14:39:06.674139 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1119/2192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:06 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:06.679764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:06.693834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:06.700201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:06.700770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:06.701273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:06.702144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:06.702661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:06.703184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:06.726072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:06.787163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:39:06.787540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:39:06.788079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:39:06.788490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:39:06.788913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:39:06.872198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:06.880862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:06.881769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:06.882328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:06.883735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:06.884911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:06.885502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:06.943370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:06.966397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=30 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:07.052178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:07.070499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:07.072020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:07.077977 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee7f522d-12a9-4513-aff5-058565ba6cc9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "POST /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3/action" status: 202 len: 1495 microversion: 2.75 time: 0.402728 Aug 09 14:39:07.078623 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1120/2193] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:39:06 2022] POST /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3/action => generated 1495 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 09 14:39:07.115459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d317c9f-b600-4c51-b8ba-830dfcb4938d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:07.128191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1d317c9f-b600-4c51-b8ba-830dfcb4938d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:07.146343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d317c9f-b600-4c51-b8ba-830dfcb4938d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:07.147044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d317c9f-b600-4c51-b8ba-830dfcb4938d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:07.147631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d317c9f-b600-4c51-b8ba-830dfcb4938d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:07.148628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d317c9f-b600-4c51-b8ba-830dfcb4938d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:07.149258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d317c9f-b600-4c51-b8ba-830dfcb4938d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:07.149983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d317c9f-b600-4c51-b8ba-830dfcb4938d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:07.527997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d317c9f-b600-4c51-b8ba-830dfcb4938d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:07.538683 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1d317c9f-b600-4c51-b8ba-830dfcb4938d tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 200 len: 1184 microversion: 2.1 time: 0.426996 Aug 09 14:39:07.543826 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1121/2194] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:07 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 1184 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:07.569236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-98584753-c19e-4a8a-846a-50c16ababdee tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:07.572699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-98584753-c19e-4a8a-846a-50c16ababdee tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:07.588315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98584753-c19e-4a8a-846a-50c16ababdee tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:07.588817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98584753-c19e-4a8a-846a-50c16ababdee tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:07.589338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98584753-c19e-4a8a-846a-50c16ababdee tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:07.597918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98584753-c19e-4a8a-846a-50c16ababdee tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:07.598434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98584753-c19e-4a8a-846a-50c16ababdee tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:07.598863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98584753-c19e-4a8a-846a-50c16ababdee tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.028541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-98584753-c19e-4a8a-846a-50c16ababdee tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:08.047388 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-98584753-c19e-4a8a-846a-50c16ababdee tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 200 len: 1366 microversion: 2.1 time: 0.502020 Aug 09 14:39:08.048312 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1122/2195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:07 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 1366 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:08.055911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-e56891ef-6813-4eaf-9e08-7b847eb6060d req-9379c865-46cb-4554-b1df-ca3a808005c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46aa8418-3f46-4f90-bb08-763d20055e1c", "tag": "d159e2a0-cd63-4b05-83ad-effb48febb0c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:08.079763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e56891ef-6813-4eaf-9e08-7b847eb6060d req-9379c865-46cb-4554-b1df-ca3a808005c7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.081485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e56891ef-6813-4eaf-9e08-7b847eb6060d req-9379c865-46cb-4554-b1df-ca3a808005c7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.081927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e56891ef-6813-4eaf-9e08-7b847eb6060d req-9379c865-46cb-4554-b1df-ca3a808005c7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.104394 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-e56891ef-6813-4eaf-9e08-7b847eb6060d req-9379c865-46cb-4554-b1df-ca3a808005c7 service nova] Creating event network-changed:d159e2a0-cd63-4b05-83ad-effb48febb0c for instance 46aa8418-3f46-4f90-bb08-763d20055e1c on n-h2-844626-8 Aug 09 14:39:08.116346 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-e56891ef-6813-4eaf-9e08-7b847eb6060d req-9379c865-46cb-4554-b1df-ca3a808005c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064985 Aug 09 14:39:08.118269 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1123/2196] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:08.124910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d90a6f2-5c91-47e5-8b58-56ead1483b15 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:08.126566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1d90a6f2-5c91-47e5-8b58-56ead1483b15 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:08.133813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d90a6f2-5c91-47e5-8b58-56ead1483b15 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.134621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d90a6f2-5c91-47e5-8b58-56ead1483b15 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.135439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d90a6f2-5c91-47e5-8b58-56ead1483b15 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.136565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d90a6f2-5c91-47e5-8b58-56ead1483b15 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.137499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d90a6f2-5c91-47e5-8b58-56ead1483b15 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.138145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d90a6f2-5c91-47e5-8b58-56ead1483b15 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.210664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Updating instance_info_cache with network_info: [{"id": "d159e2a0-cd63-4b05-83ad-effb48febb0c", "address": "fa:16:3e:71:1b:33", "network": {"id": "8e5664a1-4e3d-47e9-ac93-f7a76fb16596", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1401338871-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "46d8cf5b02944869a9ad2541a4e2af62", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd159e2a0-cd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 14:39:08.234001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Releasing lock "refresh_cache-46aa8418-3f46-4f90-bb08-763d20055e1c" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:39:08.235044 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9fb103c7-c4b1-4eb2-85f7-66eeb07bdf9a tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "POST /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c/action" status: 202 len: 0 microversion: 2.1 time: 4.079123 Aug 09 14:39:08.235740 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1074/2197] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:39:04 2022] POST /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c/action => generated 0 bytes in 4080 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 14:39:08.250447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c42d697e-5e1f-4b9c-a54d-a8121e52b291 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:08.252212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c42d697e-5e1f-4b9c-a54d-a8121e52b291 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:08.283250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c42d697e-5e1f-4b9c-a54d-a8121e52b291 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.283740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c42d697e-5e1f-4b9c-a54d-a8121e52b291 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.288662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c42d697e-5e1f-4b9c-a54d-a8121e52b291 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.289425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c42d697e-5e1f-4b9c-a54d-a8121e52b291 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.290708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c42d697e-5e1f-4b9c-a54d-a8121e52b291 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.291561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c42d697e-5e1f-4b9c-a54d-a8121e52b291 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.295525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d90a6f2-5c91-47e5-8b58-56ead1483b15 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:08.305808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d90a6f2-5c91-47e5-8b58-56ead1483b15 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:08.307920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d90a6f2-5c91-47e5-8b58-56ead1483b15 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:08.314487 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1d90a6f2-5c91-47e5-8b58-56ead1483b15 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.194439 Aug 09 14:39:08.317018 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1124/2198] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:08 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:08.329920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ef3dff6-344b-4877-8853-2e569869b8d9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:08.331508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ef3dff6-344b-4877-8853-2e569869b8d9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:08.352381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ef3dff6-344b-4877-8853-2e569869b8d9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.353654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ef3dff6-344b-4877-8853-2e569869b8d9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.356076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ef3dff6-344b-4877-8853-2e569869b8d9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.362282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ef3dff6-344b-4877-8853-2e569869b8d9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.363038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ef3dff6-344b-4877-8853-2e569869b8d9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.364367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ef3dff6-344b-4877-8853-2e569869b8d9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.602894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ef3dff6-344b-4877-8853-2e569869b8d9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:08.615173 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ef3dff6-344b-4877-8853-2e569869b8d9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.293145 Aug 09 14:39:08.616000 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1125/2199] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:08 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:08.628457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c42d697e-5e1f-4b9c-a54d-a8121e52b291 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:08.629182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ed6512a-c290-4665-bc69-80a42c3ebfdc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:08.629863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5ed6512a-c290-4665-bc69-80a42c3ebfdc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:08.642745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ed6512a-c290-4665-bc69-80a42c3ebfdc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.643499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ed6512a-c290-4665-bc69-80a42c3ebfdc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.644141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ed6512a-c290-4665-bc69-80a42c3ebfdc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.644405 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c42d697e-5e1f-4b9c-a54d-a8121e52b291 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1478 microversion: 2.1 time: 0.407537 Aug 09 14:39:08.658216 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1075/2200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:08 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1478 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:08.658403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ed6512a-c290-4665-bc69-80a42c3ebfdc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.658403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ed6512a-c290-4665-bc69-80a42c3ebfdc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.659764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ed6512a-c290-4665-bc69-80a42c3ebfdc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.665420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e0f0222-9ed1-48be-8c80-e881e4048f24 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:08.666397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6e0f0222-9ed1-48be-8c80-e881e4048f24 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: c508aaa8-11d1-4593-b840-91b8295b6f8e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:08.675691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e0f0222-9ed1-48be-8c80-e881e4048f24 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.676533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e0f0222-9ed1-48be-8c80-e881e4048f24 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.677212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e0f0222-9ed1-48be-8c80-e881e4048f24 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.678130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e0f0222-9ed1-48be-8c80-e881e4048f24 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.678776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e0f0222-9ed1-48be-8c80-e881e4048f24 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.679431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e0f0222-9ed1-48be-8c80-e881e4048f24 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.696222 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-5ed6512a-c290-4665-bc69-80a42c3ebfdc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] HTTP exception thrown: Instance c52cb1b7-ac29-4831-9cdc-c780890bb79b could not be found. Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ed6512a-c290-4665-bc69-80a42c3ebfdc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Request method failure captured: Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b HTTP/1.1 Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nE94aOs3CPMzo2VJbJHnksrvBTR--c8QNCAPjWYzrC4Aqa2-O6m09duyuiHvSCZKtfFvCrvhKEYPpbhruw9iekG4cZxOmwkYxJRfXz3FoiWSR8joROeZCg7mJGCXM_Iscb1u_Sp1IRMlFMC-BHYnHnwW9SEodimy2FLizYJwFN-y6k Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 46d8cf5b02944869a9ad2541a4e2af62 Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-790761872 Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_46d8cf5b02944869a9ad2541a4e2af62", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/46d8cf5b02944869a9ad2541a4e2af62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/46d8cf5b02944869a9ad2541a4e2af62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/46d8cf5b02944869a9ad2541a4e2af62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-790761872 Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 46d8cf5b02944869a9ad2541a4e2af62 Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-790761872 Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FloatingIPsAssociationTestJSON-790761872-project Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 6275c73b47be44c4a646761442343063 Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-790761872-project Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance c52cb1b7-ac29-4831-9cdc-c780890bb79b could not be found. Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'c52cb1b7-ac29-4831-9cdc-c780890bb79b'} Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c52cb1b7-ac29-4831-9cdc-c780890bb79b could not be found. Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:39:08.700810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:08.704701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c52cb1b7-ac29-4831-9cdc-c780890bb79b could not be found. Aug 09 14:39:08.704701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.704701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:08.704701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.704701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:08.704701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:08.704701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:08.704701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:08.704701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:08.704701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c52cb1b7-ac29-4831-9cdc-c780890bb79b could not be found. Aug 09 14:39:08.704701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.704701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ed6512a-c290-4665-bc69-80a42c3ebfdc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Returning 404 to user: Instance c52cb1b7-ac29-4831-9cdc-c780890bb79b could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:08.706559 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5ed6512a-c290-4665-bc69-80a42c3ebfdc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 404 len: 111 microversion: 2.1 time: 0.087572 Aug 09 14:39:08.707463 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1126/2201] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:39:08 2022] DELETE /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:08.711156 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6e0f0222-9ed1-48be-8c80-e881e4048f24 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] HTTP exception thrown: Instance c508aaa8-11d1-4593-b840-91b8295b6f8e could not be found. Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e0f0222-9ed1-48be-8c80-e881e4048f24 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Request method failure captured: Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e HTTP/1.1 Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_z58ByM3EZa4D7yaO_sOhl8IVjmRW9fK9N_orS9pEymkWWyPGsH6zGI_z4iZShwviKzgVbxznILRz6auxK-ngK1MQNHGV3gQKvPQLSJnCWbyTOUkumSo8VBlpLUBZa1usQFj4V5nhu1hgoTMusUXvObqJcV7HSM2zoFxVmkJvJ0jo Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: beac39aa567247818bf13c604a1ed8ac Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-LiveMigrationTest-1645779934 Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_beac39aa567247818bf13c604a1ed8ac", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/beac39aa567247818bf13c604a1ed8ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beac39aa567247818bf13c604a1ed8ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beac39aa567247818bf13c604a1ed8ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-LiveMigrationTest-1645779934 Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: beac39aa567247818bf13c604a1ed8ac Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-LiveMigrationTest-1645779934 Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-LiveMigrationTest-1645779934-project Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: ca408ac0b6df4c3797409e40335f61aa Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-LiveMigrationTest-1645779934-project Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance c508aaa8-11d1-4593-b840-91b8295b6f8e could not be found. Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'c508aaa8-11d1-4593-b840-91b8295b6f8e'} Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c508aaa8-11d1-4593-b840-91b8295b6f8e could not be found. Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c508aaa8-11d1-4593-b840-91b8295b6f8e could not be found. Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:08.713601 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.718047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:08.718047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:08.718047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:08.718047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:08.718047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:08.718047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c508aaa8-11d1-4593-b840-91b8295b6f8e could not be found. Aug 09 14:39:08.718047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.719389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e0f0222-9ed1-48be-8c80-e881e4048f24 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Returning 404 to user: Instance c508aaa8-11d1-4593-b840-91b8295b6f8e could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:08.720641 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6e0f0222-9ed1-48be-8c80-e881e4048f24 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e" status: 404 len: 111 microversion: 2.1 time: 0.071385 Aug 09 14:39:08.721467 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1076/2202] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:08 2022] GET /compute/v2.1/servers/c508aaa8-11d1-4593-b840-91b8295b6f8e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:08.728928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-daf48072-8a94-457c-913b-10f14ee6c332 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:08.729689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-daf48072-8a94-457c-913b-10f14ee6c332 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: c52cb1b7-ac29-4831-9cdc-c780890bb79b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:08.746301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daf48072-8a94-457c-913b-10f14ee6c332 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.746785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daf48072-8a94-457c-913b-10f14ee6c332 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.747356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daf48072-8a94-457c-913b-10f14ee6c332 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.748166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daf48072-8a94-457c-913b-10f14ee6c332 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:08.749362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daf48072-8a94-457c-913b-10f14ee6c332 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:08.749794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daf48072-8a94-457c-913b-10f14ee6c332 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:08.798628 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-daf48072-8a94-457c-913b-10f14ee6c332 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] HTTP exception thrown: Instance c52cb1b7-ac29-4831-9cdc-c780890bb79b could not be found. Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-daf48072-8a94-457c-913b-10f14ee6c332 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Request method failure captured: Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b HTTP/1.1 Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nE94aOs3CPMzo2VJbJHnksrvBTR--c8QNCAPjWYzrC4Aqa2-O6m09duyuiHvSCZKtfFvCrvhKEYPpbhruw9iekG4cZxOmwkYxJRfXz3FoiWSR8joROeZCg7mJGCXM_Iscb1u_Sp1IRMlFMC-BHYnHnwW9SEodimy2FLizYJwFN-y6k Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 46d8cf5b02944869a9ad2541a4e2af62 Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-790761872 Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_46d8cf5b02944869a9ad2541a4e2af62", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/46d8cf5b02944869a9ad2541a4e2af62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/46d8cf5b02944869a9ad2541a4e2af62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/46d8cf5b02944869a9ad2541a4e2af62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-790761872 Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 46d8cf5b02944869a9ad2541a4e2af62 Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-790761872 Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FloatingIPsAssociationTestJSON-790761872-project Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 6275c73b47be44c4a646761442343063 Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-790761872-project Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance c52cb1b7-ac29-4831-9cdc-c780890bb79b could not be found. Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'c52cb1b7-ac29-4831-9cdc-c780890bb79b'} Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c52cb1b7-ac29-4831-9cdc-c780890bb79b could not be found. Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c52cb1b7-ac29-4831-9cdc-c780890bb79b could not be found. Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.801486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:08.804636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.804636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:08.804636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:08.804636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:08.804636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:08.804636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:08.804636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c52cb1b7-ac29-4831-9cdc-c780890bb79b could not be found. Aug 09 14:39:08.804636 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:08.807976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-daf48072-8a94-457c-913b-10f14ee6c332 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Returning 404 to user: Instance c52cb1b7-ac29-4831-9cdc-c780890bb79b could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:08.809502 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-daf48072-8a94-457c-913b-10f14ee6c332 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b" status: 404 len: 111 microversion: 2.1 time: 0.096298 Aug 09 14:39:08.810949 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1127/2203] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:08 2022] GET /compute/v2.1/servers/c52cb1b7-ac29-4831-9cdc-c780890bb79b => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:08.819435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a0da39b-605b-42b3-9eb2-f01e7d6bf69e tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '.version_select at 0x7f41ddb09e50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:09.073844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d5e129e0-6455-4833-a6be-3684dac7ae70 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:09.074460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d5e129e0-6455-4833-a6be-3684dac7ae70 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:09.089746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5e129e0-6455-4833-a6be-3684dac7ae70 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:09.090213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5e129e0-6455-4833-a6be-3684dac7ae70 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:09.090807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5e129e0-6455-4833-a6be-3684dac7ae70 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:09.091711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5e129e0-6455-4833-a6be-3684dac7ae70 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:09.092293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5e129e0-6455-4833-a6be-3684dac7ae70 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:09.092848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5e129e0-6455-4833-a6be-3684dac7ae70 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:09.325628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:09.352411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:09.486163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d5e129e0-6455-4833-a6be-3684dac7ae70 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:09.513197 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d5e129e0-6455-4833-a6be-3684dac7ae70 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 200 len: 1366 microversion: 2.1 time: 0.443235 Aug 09 14:39:09.526125 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1128/2204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:09 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:09.533919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f04088dd-bbee-4b3a-b4a9-9cab7a3e90b7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:09.534871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f04088dd-bbee-4b3a-b4a9-9cab7a3e90b7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:09.542510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04088dd-bbee-4b3a-b4a9-9cab7a3e90b7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:09.542991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04088dd-bbee-4b3a-b4a9-9cab7a3e90b7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:09.543691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04088dd-bbee-4b3a-b4a9-9cab7a3e90b7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:09.545169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04088dd-bbee-4b3a-b4a9-9cab7a3e90b7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:09.545933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04088dd-bbee-4b3a-b4a9-9cab7a3e90b7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:09.546855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04088dd-bbee-4b3a-b4a9-9cab7a3e90b7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:09.639857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f04088dd-bbee-4b3a-b4a9-9cab7a3e90b7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:09.652007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f04088dd-bbee-4b3a-b4a9-9cab7a3e90b7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:09.654159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f04088dd-bbee-4b3a-b4a9-9cab7a3e90b7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:09.662874 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f04088dd-bbee-4b3a-b4a9-9cab7a3e90b7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.135310 Aug 09 14:39:09.675113 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1129/2205] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:09 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:09.675113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a20b8b07-acb2-4f6e-a58c-d6d17466c467 req-1bf59468-4c3f-43a2-999f-79b268e9060f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93caae4-bb8e-4f8a-8f1f-acd161acd2f1", "name": "network-vif-plugged", "status": "completed", "tag": "84f32b2b-49b8-46a0-bf53-209be535d114"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:09.687708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a20b8b07-acb2-4f6e-a58c-d6d17466c467 req-1bf59468-4c3f-43a2-999f-79b268e9060f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:09.688371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a20b8b07-acb2-4f6e-a58c-d6d17466c467 req-1bf59468-4c3f-43a2-999f-79b268e9060f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:09.688997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a20b8b07-acb2-4f6e-a58c-d6d17466c467 req-1bf59468-4c3f-43a2-999f-79b268e9060f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:09.702733 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a20b8b07-acb2-4f6e-a58c-d6d17466c467 req-1bf59468-4c3f-43a2-999f-79b268e9060f service nova] Creating event network-vif-plugged:84f32b2b-49b8-46a0-bf53-209be535d114 for instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 on n-h2-844626-8 Aug 09 14:39:09.709606 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a20b8b07-acb2-4f6e-a58c-d6d17466c467 req-1bf59468-4c3f-43a2-999f-79b268e9060f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044568 Aug 09 14:39:09.710822 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1130/2206] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:09.719243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef177acd-a241-4cd6-bdb9-40bd72f6691c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:09.720731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ef177acd-a241-4cd6-bdb9-40bd72f6691c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:09.727946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef177acd-a241-4cd6-bdb9-40bd72f6691c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:09.728797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef177acd-a241-4cd6-bdb9-40bd72f6691c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:09.729440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef177acd-a241-4cd6-bdb9-40bd72f6691c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:09.730453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef177acd-a241-4cd6-bdb9-40bd72f6691c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:09.731149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef177acd-a241-4cd6-bdb9-40bd72f6691c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:09.731766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef177acd-a241-4cd6-bdb9-40bd72f6691c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:09.950257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ef177acd-a241-4cd6-bdb9-40bd72f6691c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:09.963712 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ef177acd-a241-4cd6-bdb9-40bd72f6691c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.249909 Aug 09 14:39:09.978474 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1131/2207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:09 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:09.984552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-768439ab-16f5-4d3c-917e-32c02f6f1273 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:09.985288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-768439ab-16f5-4d3c-917e-32c02f6f1273 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:09.994059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-768439ab-16f5-4d3c-917e-32c02f6f1273 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:09.995668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-768439ab-16f5-4d3c-917e-32c02f6f1273 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:09.996144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-768439ab-16f5-4d3c-917e-32c02f6f1273 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:09.996856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-768439ab-16f5-4d3c-917e-32c02f6f1273 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:09.999910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-768439ab-16f5-4d3c-917e-32c02f6f1273 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:10.000402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-768439ab-16f5-4d3c-917e-32c02f6f1273 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:10.302864 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a0da39b-605b-42b3-9eb2-f01e7d6bf69e tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/e781f78e-2529-446c-a0fe-0ba884c23075" status: 202 len: 0 microversion: 2.1 time: 1.487723 Aug 09 14:39:10.306848 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1077/2208] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:39:08 2022] DELETE /compute/v2.1/os-floating-ips/e781f78e-2529-446c-a0fe-0ba884c23075 => generated 0 bytes in 1493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:39:10.312158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ed180e6-dd98-4d14-981a-8260babc3ae8 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:10.312315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ed180e6-dd98-4d14-981a-8260babc3ae8 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:10.320114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ed180e6-dd98-4d14-981a-8260babc3ae8 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:10.320612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ed180e6-dd98-4d14-981a-8260babc3ae8 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:10.321051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ed180e6-dd98-4d14-981a-8260babc3ae8 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:10.321760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ed180e6-dd98-4d14-981a-8260babc3ae8 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:10.322214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ed180e6-dd98-4d14-981a-8260babc3ae8 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:10.322724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ed180e6-dd98-4d14-981a-8260babc3ae8 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:10.333416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-768439ab-16f5-4d3c-917e-32c02f6f1273 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:10.346720 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-768439ab-16f5-4d3c-917e-32c02f6f1273 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1478 microversion: 2.1 time: 0.379156 Aug 09 14:39:10.350716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ed180e6-dd98-4d14-981a-8260babc3ae8 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:39:10.360325 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1132/2209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:09 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1478 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:10.364191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:10.453388 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ed180e6-dd98-4d14-981a-8260babc3ae8 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "DELETE /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 204 len: 0 microversion: 2.1 time: 0.144800 Aug 09 14:39:10.457634 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1078/2210] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:39:10 2022] DELETE /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:39:10.463448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a11e0979-c62d-4cec-bc6e-6fb7d7ff1e9f tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:10.465097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a11e0979-c62d-4cec-bc6e-6fb7d7ff1e9f tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:10.473620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a11e0979-c62d-4cec-bc6e-6fb7d7ff1e9f tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:10.474235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a11e0979-c62d-4cec-bc6e-6fb7d7ff1e9f tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:10.474830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a11e0979-c62d-4cec-bc6e-6fb7d7ff1e9f tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:10.475705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a11e0979-c62d-4cec-bc6e-6fb7d7ff1e9f tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:10.476247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a11e0979-c62d-4cec-bc6e-6fb7d7ff1e9f tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:10.476746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a11e0979-c62d-4cec-bc6e-6fb7d7ff1e9f tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:10.535514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dab7a57f-fd98-4a4b-9584-5f223db7caef tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:10.536220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dab7a57f-fd98-4a4b-9584-5f223db7caef tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:10.542749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab7a57f-fd98-4a4b-9584-5f223db7caef tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:10.543268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab7a57f-fd98-4a4b-9584-5f223db7caef tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:10.543669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab7a57f-fd98-4a4b-9584-5f223db7caef tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:10.544874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab7a57f-fd98-4a4b-9584-5f223db7caef tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:10.545467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab7a57f-fd98-4a4b-9584-5f223db7caef tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:10.546028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab7a57f-fd98-4a4b-9584-5f223db7caef tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:10.771287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a11e0979-c62d-4cec-bc6e-6fb7d7ff1e9f tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:10.794716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dab7a57f-fd98-4a4b-9584-5f223db7caef tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:10.801316 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a11e0979-c62d-4cec-bc6e-6fb7d7ff1e9f tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1527 microversion: 2.1 time: 0.342230 Aug 09 14:39:10.802034 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1133/2211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:10 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1527 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:10.817926 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dab7a57f-fd98-4a4b-9584-5f223db7caef tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 200 len: 1366 microversion: 2.1 time: 0.286680 Aug 09 14:39:10.818521 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1079/2212] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:10 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:39:10.819653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27276390-b2e8-4ae6-ac1c-1f190a44bbc8 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:10.820277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-27276390-b2e8-4ae6-ac1c-1f190a44bbc8 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:10.826912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27276390-b2e8-4ae6-ac1c-1f190a44bbc8 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:10.827542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27276390-b2e8-4ae6-ac1c-1f190a44bbc8 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:10.828045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27276390-b2e8-4ae6-ac1c-1f190a44bbc8 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:10.828854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27276390-b2e8-4ae6-ac1c-1f190a44bbc8 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:10.829307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27276390-b2e8-4ae6-ac1c-1f190a44bbc8 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:10.829727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27276390-b2e8-4ae6-ac1c-1f190a44bbc8 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:10.941381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-27276390-b2e8-4ae6-ac1c-1f190a44bbc8 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:10.953797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-27276390-b2e8-4ae6-ac1c-1f190a44bbc8 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:10.956452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-27276390-b2e8-4ae6-ac1c-1f190a44bbc8 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:10.963394 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-27276390-b2e8-4ae6-ac1c-1f190a44bbc8 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.159784 Aug 09 14:39:10.964143 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1134/2213] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:10 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:10.986535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-916d793e-9c23-4187-864e-d81748534ea8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:10.987213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-916d793e-9c23-4187-864e-d81748534ea8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:10.994381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-916d793e-9c23-4187-864e-d81748534ea8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:10.995275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-916d793e-9c23-4187-864e-d81748534ea8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:10.996650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-916d793e-9c23-4187-864e-d81748534ea8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:10.998051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-916d793e-9c23-4187-864e-d81748534ea8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:10.998684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-916d793e-9c23-4187-864e-d81748534ea8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:10.999316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-916d793e-9c23-4187-864e-d81748534ea8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:11.185532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-916d793e-9c23-4187-864e-d81748534ea8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:11.196229 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-916d793e-9c23-4187-864e-d81748534ea8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.212261 Aug 09 14:39:11.197489 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1080/2214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:10 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:11.370449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d7a88a2-de1e-4545-8f92-0d3313fc7703 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:11.371216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d7a88a2-de1e-4545-8f92-0d3313fc7703 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:11.385106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d7a88a2-de1e-4545-8f92-0d3313fc7703 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:11.385832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d7a88a2-de1e-4545-8f92-0d3313fc7703 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:11.386372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d7a88a2-de1e-4545-8f92-0d3313fc7703 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:11.387491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d7a88a2-de1e-4545-8f92-0d3313fc7703 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:11.392403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d7a88a2-de1e-4545-8f92-0d3313fc7703 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:11.392990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d7a88a2-de1e-4545-8f92-0d3313fc7703 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:11.727048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d7558681-b1be-4592-b6ae-af99eacdfe36 req-4bcb5b12-7d4d-4306-9d04-65890bc54561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce57f31b-ee4d-4e34-9f08-5de27e71d393", "name": "network-vif-plugged", "status": "completed", "tag": "e1d8480a-75cc-470c-9389-4486ebc228d7"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:11.749239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d7558681-b1be-4592-b6ae-af99eacdfe36 req-4bcb5b12-7d4d-4306-9d04-65890bc54561 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:11.749968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d7558681-b1be-4592-b6ae-af99eacdfe36 req-4bcb5b12-7d4d-4306-9d04-65890bc54561 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:11.751295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d7558681-b1be-4592-b6ae-af99eacdfe36 req-4bcb5b12-7d4d-4306-9d04-65890bc54561 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:11.786580 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d7558681-b1be-4592-b6ae-af99eacdfe36 req-4bcb5b12-7d4d-4306-9d04-65890bc54561 service nova] Creating event network-vif-plugged:e1d8480a-75cc-470c-9389-4486ebc228d7 for instance ce57f31b-ee4d-4e34-9f08-5de27e71d393 on n-h1-844626-8 Aug 09 14:39:11.795593 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d7558681-b1be-4592-b6ae-af99eacdfe36 req-4bcb5b12-7d4d-4306-9d04-65890bc54561 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072129 Aug 09 14:39:11.798290 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1081/2215] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:39:11.824297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7345f847-f20d-49fc-ab21-bc7c63de0503 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:11.825525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7345f847-f20d-49fc-ab21-bc7c63de0503 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:11.841151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7345f847-f20d-49fc-ab21-bc7c63de0503 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:11.842232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7345f847-f20d-49fc-ab21-bc7c63de0503 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:11.844037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7345f847-f20d-49fc-ab21-bc7c63de0503 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:11.845071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7345f847-f20d-49fc-ab21-bc7c63de0503 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:11.847343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7345f847-f20d-49fc-ab21-bc7c63de0503 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:11.848020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7345f847-f20d-49fc-ab21-bc7c63de0503 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:12.257564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9d7a88a2-de1e-4545-8f92-0d3313fc7703 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:12.265864 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d7a88a2-de1e-4545-8f92-0d3313fc7703 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1478 microversion: 2.1 time: 0.899764 Aug 09 14:39:12.280644 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1135/2216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:11 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1478 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:12.282164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c6708e02-35b4-4683-8ba4-5f09435019fa tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:12.282802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c6708e02-35b4-4683-8ba4-5f09435019fa tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:12.292736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6708e02-35b4-4683-8ba4-5f09435019fa tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:12.293230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6708e02-35b4-4683-8ba4-5f09435019fa tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:12.293656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6708e02-35b4-4683-8ba4-5f09435019fa tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:12.297404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6708e02-35b4-4683-8ba4-5f09435019fa tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:12.297871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6708e02-35b4-4683-8ba4-5f09435019fa tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:12.300817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6708e02-35b4-4683-8ba4-5f09435019fa tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:12.785959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7345f847-f20d-49fc-ab21-bc7c63de0503 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:12.797735 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7345f847-f20d-49fc-ab21-bc7c63de0503 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1527 microversion: 2.1 time: 0.979262 Aug 09 14:39:12.802640 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1082/2217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:11 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1527 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:12.807663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f3806bfc-990c-46d0-b2e9-14df00463a5f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:12.808270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f3806bfc-990c-46d0-b2e9-14df00463a5f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:12.824464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3806bfc-990c-46d0-b2e9-14df00463a5f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:12.824960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3806bfc-990c-46d0-b2e9-14df00463a5f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:12.825391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3806bfc-990c-46d0-b2e9-14df00463a5f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:12.826149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3806bfc-990c-46d0-b2e9-14df00463a5f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:12.826598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3806bfc-990c-46d0-b2e9-14df00463a5f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:12.827013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3806bfc-990c-46d0-b2e9-14df00463a5f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:12.994569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c6708e02-35b4-4683-8ba4-5f09435019fa tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:13.005403 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c6708e02-35b4-4683-8ba4-5f09435019fa tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 200 len: 1555 microversion: 2.1 time: 0.737452 Aug 09 14:39:13.019160 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1136/2218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:12 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 1555 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:13.026401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db4daf48-4b86-4dd7-b34a-3ea7f7fe9dce tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:13.027398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-db4daf48-4b86-4dd7-b34a-3ea7f7fe9dce tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:13.048257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db4daf48-4b86-4dd7-b34a-3ea7f7fe9dce tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:13.048803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db4daf48-4b86-4dd7-b34a-3ea7f7fe9dce tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:13.049248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db4daf48-4b86-4dd7-b34a-3ea7f7fe9dce tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:13.049971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db4daf48-4b86-4dd7-b34a-3ea7f7fe9dce tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:13.050415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db4daf48-4b86-4dd7-b34a-3ea7f7fe9dce tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:13.050831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db4daf48-4b86-4dd7-b34a-3ea7f7fe9dce tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:13.057504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f3806bfc-990c-46d0-b2e9-14df00463a5f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:13.063828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:13.071826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f3806bfc-990c-46d0-b2e9-14df00463a5f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:13.076887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f3806bfc-990c-46d0-b2e9-14df00463a5f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:13.093559 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f3806bfc-990c-46d0-b2e9-14df00463a5f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.289678 Aug 09 14:39:13.095791 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1083/2219] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:12 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:13.111348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-882e407a-25bf-4453-9d8a-5c6665204df1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:13.112467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-882e407a-25bf-4453-9d8a-5c6665204df1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:13.123458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-882e407a-25bf-4453-9d8a-5c6665204df1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:13.124277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-882e407a-25bf-4453-9d8a-5c6665204df1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:13.129006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-882e407a-25bf-4453-9d8a-5c6665204df1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:13.130101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-882e407a-25bf-4453-9d8a-5c6665204df1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:13.130942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-882e407a-25bf-4453-9d8a-5c6665204df1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:13.131848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-882e407a-25bf-4453-9d8a-5c6665204df1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:13.420640 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-882e407a-25bf-4453-9d8a-5c6665204df1 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.323198 Aug 09 14:39:13.424246 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1084/2220] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:39:13 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-interface => generated 284 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:13.448756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-673227d6-0511-4055-a12f-ce8bdeecbedd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:13.449706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-673227d6-0511-4055-a12f-ce8bdeecbedd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:13.459715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-673227d6-0511-4055-a12f-ce8bdeecbedd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:13.460673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-673227d6-0511-4055-a12f-ce8bdeecbedd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:13.462009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-673227d6-0511-4055-a12f-ce8bdeecbedd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:13.463277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-673227d6-0511-4055-a12f-ce8bdeecbedd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:13.464307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-673227d6-0511-4055-a12f-ce8bdeecbedd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:13.465798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-673227d6-0511-4055-a12f-ce8bdeecbedd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:13.847492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-db4daf48-4b86-4dd7-b34a-3ea7f7fe9dce tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:13.861511 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-db4daf48-4b86-4dd7-b34a-3ea7f7fe9dce tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.848156 Aug 09 14:39:13.862743 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1137/2221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:13 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:13.875791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8b36615b-e1c8-4256-86c7-71b9d3b6ef20 req-ba7fc48d-d643-43e3-8dfc-957a5ceda46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46aa8418-3f46-4f90-bb08-763d20055e1c", "name": "network-vif-deleted", "tag": "d159e2a0-cd63-4b05-83ad-effb48febb0c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:13.936869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8b36615b-e1c8-4256-86c7-71b9d3b6ef20 req-ba7fc48d-d643-43e3-8dfc-957a5ceda46a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:13.937346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8b36615b-e1c8-4256-86c7-71b9d3b6ef20 req-ba7fc48d-d643-43e3-8dfc-957a5ceda46a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:13.937769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8b36615b-e1c8-4256-86c7-71b9d3b6ef20 req-ba7fc48d-d643-43e3-8dfc-957a5ceda46a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:13.970830 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8b36615b-e1c8-4256-86c7-71b9d3b6ef20 req-ba7fc48d-d643-43e3-8dfc-957a5ceda46a service nova] Creating event network-vif-deleted:d159e2a0-cd63-4b05-83ad-effb48febb0c for instance 46aa8418-3f46-4f90-bb08-763d20055e1c on n-h2-844626-8 Aug 09 14:39:13.979477 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8b36615b-e1c8-4256-86c7-71b9d3b6ef20 req-ba7fc48d-d643-43e3-8dfc-957a5ceda46a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114484 Aug 09 14:39:13.984132 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1138/2222] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:14.007883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:14.014355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:14.023373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-673227d6-0511-4055-a12f-ce8bdeecbedd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:14.032900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:14.033995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:14.036046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:14.036891 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-673227d6-0511-4055-a12f-ce8bdeecbedd tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1478 microversion: 2.1 time: 0.599471 Aug 09 14:39:14.037037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:14.037396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:14.037817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:14.038450 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1085/2223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:13 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1478 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:14.123587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e01a5375-586d-431d-bd08-871b7af36c09 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:14.124380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e01a5375-586d-431d-bd08-871b7af36c09 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:14.134295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:14.136607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e01a5375-586d-431d-bd08-871b7af36c09 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:14.137270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:14.137966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e01a5375-586d-431d-bd08-871b7af36c09 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:14.138622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:14.142131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lazy-loading 'fault' on Instance uuid 46aa8418-3f46-4f90-bb08-763d20055e1c {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:14.143023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e01a5375-586d-431d-bd08-871b7af36c09 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:14.147043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e01a5375-586d-431d-bd08-871b7af36c09 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:14.147922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e01a5375-586d-431d-bd08-871b7af36c09 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:14.148543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e01a5375-586d-431d-bd08-871b7af36c09 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:14.370484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6275c73b47be44c4a646761442343063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d8cf5b02944869a9ad2541a4e2af62', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:14.371024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e01a5375-586d-431d-bd08-871b7af36c09 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:14.389115 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df4e1933-779e-4a82-ac85-87d56605bebc tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 200 len: 1314 microversion: 2.1 time: 0.392648 Aug 09 14:39:14.395755 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1139/2224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:13 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:14.396691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e01a5375-586d-431d-bd08-871b7af36c09 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:14.400265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e01a5375-586d-431d-bd08-871b7af36c09 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:14.413330 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e01a5375-586d-431d-bd08-871b7af36c09 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.293744 Aug 09 14:39:14.417598 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1086/2225] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:14 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:14.886630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3905cd13-30c3-404b-a907-d6bdfdd74b1d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:14.887391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3905cd13-30c3-404b-a907-d6bdfdd74b1d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:14.896552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3905cd13-30c3-404b-a907-d6bdfdd74b1d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:14.906071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3905cd13-30c3-404b-a907-d6bdfdd74b1d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:14.907074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3905cd13-30c3-404b-a907-d6bdfdd74b1d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:14.908059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3905cd13-30c3-404b-a907-d6bdfdd74b1d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:14.908730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3905cd13-30c3-404b-a907-d6bdfdd74b1d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:14.909369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3905cd13-30c3-404b-a907-d6bdfdd74b1d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:15.067695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6fe32121-695a-4e5c-b635-9058bbb582e0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:15.071838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6fe32121-695a-4e5c-b635-9058bbb582e0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:15.085525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fe32121-695a-4e5c-b635-9058bbb582e0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:15.095309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fe32121-695a-4e5c-b635-9058bbb582e0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:15.097293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fe32121-695a-4e5c-b635-9058bbb582e0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:15.098849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fe32121-695a-4e5c-b635-9058bbb582e0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:15.099474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fe32121-695a-4e5c-b635-9058bbb582e0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:15.104110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fe32121-695a-4e5c-b635-9058bbb582e0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:15.198086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3905cd13-30c3-404b-a907-d6bdfdd74b1d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:15.216817 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3905cd13-30c3-404b-a907-d6bdfdd74b1d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.332610 Aug 09 14:39:15.219510 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1140/2226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:14 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:15.421094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e95f2d1e-28b3-41f3-b63b-f6d1f54d4da2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:15.423169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e95f2d1e-28b3-41f3-b63b-f6d1f54d4da2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] [instance: 46aa8418-3f46-4f90-bb08-763d20055e1c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:15.431884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e95f2d1e-28b3-41f3-b63b-f6d1f54d4da2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:15.432646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e95f2d1e-28b3-41f3-b63b-f6d1f54d4da2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:15.433222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e95f2d1e-28b3-41f3-b63b-f6d1f54d4da2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:15.434098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e95f2d1e-28b3-41f3-b63b-f6d1f54d4da2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:15.434688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e95f2d1e-28b3-41f3-b63b-f6d1f54d4da2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:15.435279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e95f2d1e-28b3-41f3-b63b-f6d1f54d4da2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:15.474463 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e95f2d1e-28b3-41f3-b63b-f6d1f54d4da2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] HTTP exception thrown: Instance 46aa8418-3f46-4f90-bb08-763d20055e1c could not be found. Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e95f2d1e-28b3-41f3-b63b-f6d1f54d4da2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Request method failure captured: Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c HTTP/1.1 Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nE94aOs3CPMzo2VJbJHnksrvBTR--c8QNCAPjWYzrC4Aqa2-O6m09duyuiHvSCZKtfFvCrvhKEYPpbhruw9iekG4cZxOmwkYxJRfXz3FoiWSR8joROeZCg7mJGCXM_Iscb1u_Sp1IRMlFMC-BHYnHnwW9SEodimy2FLizYJwFN-y6k Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 46d8cf5b02944869a9ad2541a4e2af62 Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-790761872 Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_46d8cf5b02944869a9ad2541a4e2af62", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/46d8cf5b02944869a9ad2541a4e2af62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/46d8cf5b02944869a9ad2541a4e2af62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/46d8cf5b02944869a9ad2541a4e2af62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-790761872 Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 46d8cf5b02944869a9ad2541a4e2af62 Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-790761872 Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FloatingIPsAssociationTestJSON-790761872-project Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 6275c73b47be44c4a646761442343063 Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-790761872-project Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 46aa8418-3f46-4f90-bb08-763d20055e1c could not be found. Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '46aa8418-3f46-4f90-bb08-763d20055e1c'} Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46aa8418-3f46-4f90-bb08-763d20055e1c could not be found. Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46aa8418-3f46-4f90-bb08-763d20055e1c could not be found. Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:15.481900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:15.485451 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:15.485451 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:15.485451 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:15.485451 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:15.485451 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:15.485451 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:15.485451 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46aa8418-3f46-4f90-bb08-763d20055e1c could not be found. Aug 09 14:39:15.485451 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:15.488408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e95f2d1e-28b3-41f3-b63b-f6d1f54d4da2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] Returning 404 to user: Instance 46aa8418-3f46-4f90-bb08-763d20055e1c could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:15.489779 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e95f2d1e-28b3-41f3-b63b-f6d1f54d4da2 tempest-FloatingIPsAssociationTestJSON-790761872 tempest-FloatingIPsAssociationTestJSON-790761872-project] 10.222.0.50 "GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c" status: 404 len: 111 microversion: 2.1 time: 0.073450 Aug 09 14:39:15.491545 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1141/2227] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:15 2022] GET /compute/v2.1/servers/46aa8418-3f46-4f90-bb08-763d20055e1c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:39:15.543152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58644a84-6105-41f9-b19f-668cca245188 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:15.546851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58644a84-6105-41f9-b19f-668cca245188 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:15.585303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58644a84-6105-41f9-b19f-668cca245188 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:15.585806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58644a84-6105-41f9-b19f-668cca245188 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:15.588956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58644a84-6105-41f9-b19f-668cca245188 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:15.592852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58644a84-6105-41f9-b19f-668cca245188 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:15.596003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58644a84-6105-41f9-b19f-668cca245188 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:15.596481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58644a84-6105-41f9-b19f-668cca245188 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:15.842653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-58644a84-6105-41f9-b19f-668cca245188 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:15.855773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-58644a84-6105-41f9-b19f-668cca245188 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:15.859941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-58644a84-6105-41f9-b19f-668cca245188 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:15.861939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6fe32121-695a-4e5c-b635-9058bbb582e0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:15.873854 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6fe32121-695a-4e5c-b635-9058bbb582e0 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1463 microversion: 2.1 time: 0.819384 Aug 09 14:39:15.874404 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58644a84-6105-41f9-b19f-668cca245188 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.381513 Aug 09 14:39:15.875233 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1142/2228] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:15 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:15.887108 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1087/2229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:15 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1463 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:39:15.899286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3fda0597-295c-427d-be68-205f76bfa9f7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:15.900515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fda0597-295c-427d-be68-205f76bfa9f7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:15.905761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-83af59ae-5b20-4a25-a45b-874a38538c12 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:15.907919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fda0597-295c-427d-be68-205f76bfa9f7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:15.908604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fda0597-295c-427d-be68-205f76bfa9f7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:15.908728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-83af59ae-5b20-4a25-a45b-874a38538c12 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:15.909363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fda0597-295c-427d-be68-205f76bfa9f7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:15.910436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fda0597-295c-427d-be68-205f76bfa9f7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:15.911108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fda0597-295c-427d-be68-205f76bfa9f7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:15.911729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fda0597-295c-427d-be68-205f76bfa9f7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:15.930241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83af59ae-5b20-4a25-a45b-874a38538c12 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:15.935018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83af59ae-5b20-4a25-a45b-874a38538c12 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:15.935671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83af59ae-5b20-4a25-a45b-874a38538c12 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:15.944211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83af59ae-5b20-4a25-a45b-874a38538c12 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:15.944867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83af59ae-5b20-4a25-a45b-874a38538c12 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:15.945508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83af59ae-5b20-4a25-a45b-874a38538c12 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:15.970368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fda0597-295c-427d-be68-205f76bfa9f7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:39:16.173218 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3fda0597-295c-427d-be68-205f76bfa9f7 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "DELETE /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 204 len: 0 microversion: 2.1 time: 0.284025 Aug 09 14:39:16.177090 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1143/2230] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:39:15 2022] DELETE /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:39:16.178085 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-83af59ae-5b20-4a25-a45b-874a38538c12 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action" status: 202 len: 0 microversion: 2.1 time: 0.275425 Aug 09 14:39:16.183583 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1088/2231] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:39:15 2022] POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:39:16.194228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64a2ab6d-74d7-4741-9641-4b790f90b367 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:16.195371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-64a2ab6d-74d7-4741-9641-4b790f90b367 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:16.198332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:16.199755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:16.215147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64a2ab6d-74d7-4741-9641-4b790f90b367 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:16.216738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64a2ab6d-74d7-4741-9641-4b790f90b367 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:16.217195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64a2ab6d-74d7-4741-9641-4b790f90b367 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:16.218861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:16.220241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64a2ab6d-74d7-4741-9641-4b790f90b367 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:16.221006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64a2ab6d-74d7-4741-9641-4b790f90b367 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:16.221331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:16.222803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64a2ab6d-74d7-4741-9641-4b790f90b367 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:16.222918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:16.224181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:16.224657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:16.225998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:16.329111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:16.330009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:16.330460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:16.330920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lazy-loading 'fault' on Instance uuid ce57f31b-ee4d-4e34-9f08-5de27e71d393 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:16.868674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-64a2ab6d-74d7-4741-9641-4b790f90b367 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:16.879845 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-64a2ab6d-74d7-4741-9641-4b790f90b367 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1667 microversion: 2.1 time: 0.698032 Aug 09 14:39:16.883447 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1144/2232] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:16 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1667 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:16.897825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e4f2839-140f-4fff-8179-978bfddf3062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:16.902750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9e4f2839-140f-4fff-8179-978bfddf3062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:16.925742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e4f2839-140f-4fff-8179-978bfddf3062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:16.926346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e4f2839-140f-4fff-8179-978bfddf3062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:16.926844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e4f2839-140f-4fff-8179-978bfddf3062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:16.927665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e4f2839-140f-4fff-8179-978bfddf3062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:16.928190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e4f2839-140f-4fff-8179-978bfddf3062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:16.928681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e4f2839-140f-4fff-8179-978bfddf3062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:16.993472 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b953d081-7ad8-4dcf-84b7-188978890e9e tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1597 microversion: 2.1 time: 0.805468 Aug 09 14:39:16.994261 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1089/2233] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:16 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1597 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:17.024812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-01b5ff65-1458-46bc-8ee6-5806ee99100d req-c5b0ee9b-02df-445c-b20d-8adabeae4fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b93caae4-bb8e-4f8a-8f1f-acd161acd2f1", "tag": "84f32b2b-49b8-46a0-bf53-209be535d114"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:17.050696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-01b5ff65-1458-46bc-8ee6-5806ee99100d req-c5b0ee9b-02df-445c-b20d-8adabeae4fc7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:17.051302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-01b5ff65-1458-46bc-8ee6-5806ee99100d req-c5b0ee9b-02df-445c-b20d-8adabeae4fc7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:17.053686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-01b5ff65-1458-46bc-8ee6-5806ee99100d req-c5b0ee9b-02df-445c-b20d-8adabeae4fc7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:17.088285 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-01b5ff65-1458-46bc-8ee6-5806ee99100d req-c5b0ee9b-02df-445c-b20d-8adabeae4fc7 service nova] Creating event network-changed:84f32b2b-49b8-46a0-bf53-209be535d114 for instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 on n-h2-844626-8 Aug 09 14:39:17.104354 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-01b5ff65-1458-46bc-8ee6-5806ee99100d req-c5b0ee9b-02df-445c-b20d-8adabeae4fc7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089480 Aug 09 14:39:17.105402 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1090/2234] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:17.583448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-284b91d6-9b2e-4617-a7b7-be7d1d04c5fd tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "52182ff2-a919-4020-bf4c-0f234749d41c"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:17.589663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-284b91d6-9b2e-4617-a7b7-be7d1d04c5fd tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:17.613682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-284b91d6-9b2e-4617-a7b7-be7d1d04c5fd tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:17.614754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-284b91d6-9b2e-4617-a7b7-be7d1d04c5fd tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:17.615380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-284b91d6-9b2e-4617-a7b7-be7d1d04c5fd tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:17.616474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-284b91d6-9b2e-4617-a7b7-be7d1d04c5fd tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:17.617252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-284b91d6-9b2e-4617-a7b7-be7d1d04c5fd tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:17.617853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-284b91d6-9b2e-4617-a7b7-be7d1d04c5fd tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:17.843988 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-284b91d6-9b2e-4617-a7b7-be7d1d04c5fd tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] HTTP exception thrown: Volume 52182ff2-a919-4020-bf4c-0f234749d41c could not be found. Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-284b91d6-9b2e-4617-a7b7-be7d1d04c5fd tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Request method failure captured: Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: request: PUT /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments/733b1bbd-e6d4-4329-be25-556e25c25b76 HTTP/1.1 Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 74 Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nFBYh3sdbbQ4olfNSPfUXEJwLXMlB5E64vpJOB0fYS4V9i7vtjD4JY-VU4TqYjrYFVXQ02Ae5EVMBJ8ZXzDVmLFxKjexfSVJoIH7VJIDUdHu8f5TmpgzlZaBT7bSXXH1AbpIHrgssw4Qv-XUN4hgGQuJi4BxAHPrHC6yHtAh4RHN_U Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 1bb5e0ca466b429d8e1ff9793637923a Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesAdminNegativeTest-301064868 Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1bb5e0ca466b429d8e1ff9793637923a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1bb5e0ca466b429d8e1ff9793637923a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1bb5e0ca466b429d8e1ff9793637923a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1bb5e0ca466b429d8e1ff9793637923a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-VolumesAdminNegativeTest-301064868 Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 1bb5e0ca466b429d8e1ff9793637923a Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-301064868 Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-VolumesAdminNegativeTest-301064868-project-admin Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e4165a32dea84f0d9928c30a69943a87 Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-VolumesAdminNegativeTest-301064868-project-admin Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: {"volumeAttachment": {"volumeId": "52182ff2-a919-4020-bf4c-0f234749d41c"}} Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: exception: Volume 52182ff2-a919-4020-bf4c-0f234749d41c could not be found. Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'server_id': 'fa831790-4a10-456d-bfc3-72ca22cb40a5', 'id': '733b1bbd-e6d4-4329-be25-556e25c25b76', 'body': {'volumeAttachment': {'volumeId': '52182ff2-a919-4020-bf4c-0f234749d41c'}}} Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52182ff2-a919-4020-bf4c-0f234749d41c could not be found. (HTTP 404) (Request-ID: req-a5a7ba76-d651-4677-8479-5ccaefbc4afa) Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 14:39:17.877081 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52182ff2-a919-4020-bf4c-0f234749d41c could not be found. Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 52182ff2-a919-4020-bf4c-0f234749d41c could not be found. Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52182ff2-a919-4020-bf4c-0f234749d41c could not be found. Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-284b91d6-9b2e-4617-a7b7-be7d1d04c5fd tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Returning 400 to user: Volume 52182ff2-a919-4020-bf4c-0f234749d41c could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-284b91d6-9b2e-4617-a7b7-be7d1d04c5fd tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] 10.222.0.50 "PUT /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments/733b1bbd-e6d4-4329-be25-556e25c25b76" status: 400 len: 107 microversion: 2.1 time: 0.772157 Aug 09 14:39:17.880536 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1091/2235] 10.222.0.50 () {60 vars in 1433 bytes} [Tue Aug 9 14:39:17 2022] PUT /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments/733b1bbd-e6d4-4329-be25-556e25c25b76 => generated 107 bytes in 773 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:39:17.898646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9439bb52-8d0f-4890-9431-aa913f243340 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:17.899482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9439bb52-8d0f-4890-9431-aa913f243340 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:17.910848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9439bb52-8d0f-4890-9431-aa913f243340 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:17.911499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9439bb52-8d0f-4890-9431-aa913f243340 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:17.912014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9439bb52-8d0f-4890-9431-aa913f243340 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:17.912928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9439bb52-8d0f-4890-9431-aa913f243340 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:17.913451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9439bb52-8d0f-4890-9431-aa913f243340 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:17.914128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9439bb52-8d0f-4890-9431-aa913f243340 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:18.045840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9e4f2839-140f-4fff-8179-978bfddf3062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:18.054638 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e4f2839-140f-4fff-8179-978bfddf3062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 1.169834 Aug 09 14:39:18.062048 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1145/2236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:16 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:18.067969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8a4bef1a-3b60-4c1c-8d92-bb3514c89fe5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:18.085098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8a4bef1a-3b60-4c1c-8d92-bb3514c89fe5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:18.092247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:18.106311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a4bef1a-3b60-4c1c-8d92-bb3514c89fe5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:18.107042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a4bef1a-3b60-4c1c-8d92-bb3514c89fe5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:18.111942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a4bef1a-3b60-4c1c-8d92-bb3514c89fe5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:18.112966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a4bef1a-3b60-4c1c-8d92-bb3514c89fe5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:18.113576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a4bef1a-3b60-4c1c-8d92-bb3514c89fe5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:18.114138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a4bef1a-3b60-4c1c-8d92-bb3514c89fe5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:18.252586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9439bb52-8d0f-4890-9431-aa913f243340 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:18.270515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9439bb52-8d0f-4890-9431-aa913f243340 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:18.274361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9439bb52-8d0f-4890-9431-aa913f243340 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:18.294907 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9439bb52-8d0f-4890-9431-aa913f243340 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.408311 Aug 09 14:39:18.319297 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8a4bef1a-3b60-4c1c-8d92-bb3514c89fe5 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action" status: 202 len: 0 microversion: 2.1 time: 0.255523 Aug 09 14:39:18.320251 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1146/2237] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:39:18 2022] POST /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:39:18.325611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ff279320-7d3c-4e3c-a5c7-6831dc16ef36 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:18.326229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ff279320-7d3c-4e3c-a5c7-6831dc16ef36 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:18.327240 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1092/2238] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:17 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:18.334641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff279320-7d3c-4e3c-a5c7-6831dc16ef36 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:18.335913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff279320-7d3c-4e3c-a5c7-6831dc16ef36 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:18.337331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff279320-7d3c-4e3c-a5c7-6831dc16ef36 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:18.340198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff279320-7d3c-4e3c-a5c7-6831dc16ef36 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:18.352037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-058bd4cf-f528-4b62-8528-08c2afc3b7b1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:18.352568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-058bd4cf-f528-4b62-8528-08c2afc3b7b1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:18.353287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff279320-7d3c-4e3c-a5c7-6831dc16ef36 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:18.354826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff279320-7d3c-4e3c-a5c7-6831dc16ef36 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:18.371590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-058bd4cf-f528-4b62-8528-08c2afc3b7b1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:18.377109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-058bd4cf-f528-4b62-8528-08c2afc3b7b1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:18.385097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-058bd4cf-f528-4b62-8528-08c2afc3b7b1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:18.389868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-058bd4cf-f528-4b62-8528-08c2afc3b7b1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:18.390628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-058bd4cf-f528-4b62-8528-08c2afc3b7b1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:18.392031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-058bd4cf-f528-4b62-8528-08c2afc3b7b1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:18.558782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-058bd4cf-f528-4b62-8528-08c2afc3b7b1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lazy-loading 'services' on Instance uuid fa831790-4a10-456d-bfc3-72ca22cb40a5 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:18.583659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:18.705478 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-058bd4cf-f528-4b62-8528-08c2afc3b7b1 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments/733b1bbd-e6d4-4329-be25-556e25c25b76" status: 202 len: 0 microversion: 2.1 time: 0.376672 Aug 09 14:39:18.706429 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1093/2239] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 14:39:18 2022] DELETE /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments/733b1bbd-e6d4-4329-be25-556e25c25b76 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:39:18.712720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc55ee1c-6585-47b3-ac31-d82685b57549 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:18.713912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc55ee1c-6585-47b3-ac31-d82685b57549 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:18.742902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc55ee1c-6585-47b3-ac31-d82685b57549 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:18.747380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc55ee1c-6585-47b3-ac31-d82685b57549 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:18.747961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc55ee1c-6585-47b3-ac31-d82685b57549 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:18.748803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc55ee1c-6585-47b3-ac31-d82685b57549 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:18.749363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc55ee1c-6585-47b3-ac31-d82685b57549 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:18.749792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc55ee1c-6585-47b3-ac31-d82685b57549 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:18.870872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ff279320-7d3c-4e3c-a5c7-6831dc16ef36 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:18.880867 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ff279320-7d3c-4e3c-a5c7-6831dc16ef36 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1667 microversion: 2.1 time: 0.559378 Aug 09 14:39:18.896627 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1147/2240] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:18 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1667 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:18.896627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0ea8d86-d616-457b-83cf-2c801fc5d5ef tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:18.896627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0ea8d86-d616-457b-83cf-2c801fc5d5ef tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:18.899704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0ea8d86-d616-457b-83cf-2c801fc5d5ef tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:18.900231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0ea8d86-d616-457b-83cf-2c801fc5d5ef tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:18.900741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0ea8d86-d616-457b-83cf-2c801fc5d5ef tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:18.901563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0ea8d86-d616-457b-83cf-2c801fc5d5ef tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:18.902010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0ea8d86-d616-457b-83cf-2c801fc5d5ef tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:18.902414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0ea8d86-d616-457b-83cf-2c801fc5d5ef tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:18.940733 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0ea8d86-d616-457b-83cf-2c801fc5d5ef tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057527 Aug 09 14:39:18.941288 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1148/2241] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:39:18 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:19.086262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-560fbaea-d4ac-4c82-acb2-9391bcfa90a4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:19.088121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-560fbaea-d4ac-4c82-acb2-9391bcfa90a4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:19.097166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-560fbaea-d4ac-4c82-acb2-9391bcfa90a4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:19.097940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-560fbaea-d4ac-4c82-acb2-9391bcfa90a4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:19.098513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-560fbaea-d4ac-4c82-acb2-9391bcfa90a4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:19.099513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-560fbaea-d4ac-4c82-acb2-9391bcfa90a4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:19.100339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-560fbaea-d4ac-4c82-acb2-9391bcfa90a4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:19.101582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-560fbaea-d4ac-4c82-acb2-9391bcfa90a4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:19.106724 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc55ee1c-6585-47b3-ac31-d82685b57549 tempest-ServersAdminTestJSON-292888559 tempest-ServersAdminTestJSON-292888559-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1614 microversion: 2.1 time: 0.398238 Aug 09 14:39:19.107865 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1094/2242] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:18 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1614 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:19.130322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-69caf9d2-16d4-4996-9c61-e6fb791c3c99 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:19.131612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-69caf9d2-16d4-4996-9c61-e6fb791c3c99 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:19.146480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69caf9d2-16d4-4996-9c61-e6fb791c3c99 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:19.161668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69caf9d2-16d4-4996-9c61-e6fb791c3c99 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:19.163399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69caf9d2-16d4-4996-9c61-e6fb791c3c99 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:19.165098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69caf9d2-16d4-4996-9c61-e6fb791c3c99 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:19.165793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69caf9d2-16d4-4996-9c61-e6fb791c3c99 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:19.168125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69caf9d2-16d4-4996-9c61-e6fb791c3c99 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:19.225636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-69caf9d2-16d4-4996-9c61-e6fb791c3c99 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:39:19.372711 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-69caf9d2-16d4-4996-9c61-e6fb791c3c99 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 204 len: 0 microversion: 2.1 time: 0.246242 Aug 09 14:39:19.373537 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1095/2243] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:39:19 2022] DELETE /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:39:19.381118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-462d686d-e19f-496d-b702-fe403c6d60d1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:19.382281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-462d686d-e19f-496d-b702-fe403c6d60d1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:19.388992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-462d686d-e19f-496d-b702-fe403c6d60d1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:19.389760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-462d686d-e19f-496d-b702-fe403c6d60d1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:19.390202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-462d686d-e19f-496d-b702-fe403c6d60d1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:19.391008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-462d686d-e19f-496d-b702-fe403c6d60d1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:19.391798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-462d686d-e19f-496d-b702-fe403c6d60d1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:19.392230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-462d686d-e19f-496d-b702-fe403c6d60d1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:19.560735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-462d686d-e19f-496d-b702-fe403c6d60d1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:19.572883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-560fbaea-d4ac-4c82-acb2-9391bcfa90a4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:19.581584 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-560fbaea-d4ac-4c82-acb2-9391bcfa90a4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.499982 Aug 09 14:39:19.594157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-462d686d-e19f-496d-b702-fe403c6d60d1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:19.595895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-462d686d-e19f-496d-b702-fe403c6d60d1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:19.599588 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1149/2244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:19 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:19.615975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-95dc65ea-373e-45b7-86c3-7e0a9d655fde tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:19.621108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-95dc65ea-373e-45b7-86c3-7e0a9d655fde tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:19.636376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95dc65ea-373e-45b7-86c3-7e0a9d655fde tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:19.636802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95dc65ea-373e-45b7-86c3-7e0a9d655fde tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:19.637228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95dc65ea-373e-45b7-86c3-7e0a9d655fde tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:19.641042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95dc65ea-373e-45b7-86c3-7e0a9d655fde tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:19.649209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95dc65ea-373e-45b7-86c3-7e0a9d655fde tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:19.649884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95dc65ea-373e-45b7-86c3-7e0a9d655fde tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:19.650634 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-462d686d-e19f-496d-b702-fe403c6d60d1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.269532 Aug 09 14:39:19.651572 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1096/2245] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:19 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:19.831481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5ed8e613-e23e-455c-9f2c-bb0369ee327a req-becf02a8-dbb9-4bc7-9394-00cabac5c1dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaf11da1-82f0-41e7-bdef-9bbea7629ef0", "name": "network-vif-deleted", "tag": "510915b8-0436-4bd0-8a98-8b38c250325d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:19.895130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5ed8e613-e23e-455c-9f2c-bb0369ee327a req-becf02a8-dbb9-4bc7-9394-00cabac5c1dd service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:19.897957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5ed8e613-e23e-455c-9f2c-bb0369ee327a req-becf02a8-dbb9-4bc7-9394-00cabac5c1dd service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:19.898414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5ed8e613-e23e-455c-9f2c-bb0369ee327a req-becf02a8-dbb9-4bc7-9394-00cabac5c1dd service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:19.938578 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5ed8e613-e23e-455c-9f2c-bb0369ee327a req-becf02a8-dbb9-4bc7-9394-00cabac5c1dd service nova] Creating event network-vif-deleted:510915b8-0436-4bd0-8a98-8b38c250325d for instance aaf11da1-82f0-41e7-bdef-9bbea7629ef0 on n-h2-844626-8 Aug 09 14:39:19.949865 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5ed8e613-e23e-455c-9f2c-bb0369ee327a req-becf02a8-dbb9-4bc7-9394-00cabac5c1dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121872 Aug 09 14:39:19.952064 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1097/2246] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:19.963628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d5ca860-49f7-40a9-8b21-ca43bed01c95 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:19.968272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d5ca860-49f7-40a9-8b21-ca43bed01c95 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:19.978136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d5ca860-49f7-40a9-8b21-ca43bed01c95 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:19.978625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d5ca860-49f7-40a9-8b21-ca43bed01c95 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:19.983633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d5ca860-49f7-40a9-8b21-ca43bed01c95 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:19.986470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d5ca860-49f7-40a9-8b21-ca43bed01c95 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:19.986994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d5ca860-49f7-40a9-8b21-ca43bed01c95 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:19.990399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d5ca860-49f7-40a9-8b21-ca43bed01c95 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:20.169615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0d5ca860-49f7-40a9-8b21-ca43bed01c95 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:20.200992 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d5ca860-49f7-40a9-8b21-ca43bed01c95 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 200 len: 1319 microversion: 2.1 time: 0.246022 Aug 09 14:39:20.201677 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1098/2247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:19 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:20.226782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-370aa9eb-76ad-4efa-840c-e40f5c41563a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:20.233446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-370aa9eb-76ad-4efa-840c-e40f5c41563a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:20.261728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-370aa9eb-76ad-4efa-840c-e40f5c41563a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:20.262239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-370aa9eb-76ad-4efa-840c-e40f5c41563a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:20.262685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-370aa9eb-76ad-4efa-840c-e40f5c41563a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:20.263454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-370aa9eb-76ad-4efa-840c-e40f5c41563a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:20.263911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-370aa9eb-76ad-4efa-840c-e40f5c41563a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:20.264331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-370aa9eb-76ad-4efa-840c-e40f5c41563a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:20.315020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-95dc65ea-373e-45b7-86c3-7e0a9d655fde tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:20.327231 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-95dc65ea-373e-45b7-86c3-7e0a9d655fde tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1468 microversion: 2.1 time: 0.723402 Aug 09 14:39:20.327871 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1150/2248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:19 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1468 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:20.357565 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-370aa9eb-76ad-4efa-840c-e40f5c41563a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154737 Aug 09 14:39:20.374047 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1099/2249] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:39:20 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:20.602203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c4571d5-c83f-43fd-8b5f-ce3386aec30a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:20.602797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c4571d5-c83f-43fd-8b5f-ce3386aec30a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:20.623150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c4571d5-c83f-43fd-8b5f-ce3386aec30a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:20.625291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c4571d5-c83f-43fd-8b5f-ce3386aec30a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:20.626802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c4571d5-c83f-43fd-8b5f-ce3386aec30a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:20.630550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c4571d5-c83f-43fd-8b5f-ce3386aec30a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:20.631377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c4571d5-c83f-43fd-8b5f-ce3386aec30a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:20.634479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c4571d5-c83f-43fd-8b5f-ce3386aec30a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:20.679729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-90777c11-1ff1-4b5f-b19d-afd7dcfe590c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:20.682497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-90777c11-1ff1-4b5f-b19d-afd7dcfe590c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:20.698678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90777c11-1ff1-4b5f-b19d-afd7dcfe590c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:20.699196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90777c11-1ff1-4b5f-b19d-afd7dcfe590c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:20.705265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90777c11-1ff1-4b5f-b19d-afd7dcfe590c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:20.709456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90777c11-1ff1-4b5f-b19d-afd7dcfe590c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:20.709943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90777c11-1ff1-4b5f-b19d-afd7dcfe590c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:20.720676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90777c11-1ff1-4b5f-b19d-afd7dcfe590c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:20.745504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:21.123537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-90777c11-1ff1-4b5f-b19d-afd7dcfe590c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:21.133947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-90777c11-1ff1-4b5f-b19d-afd7dcfe590c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:21.136047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-90777c11-1ff1-4b5f-b19d-afd7dcfe590c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:21.142967 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-90777c11-1ff1-4b5f-b19d-afd7dcfe590c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.467625 Aug 09 14:39:21.155282 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1100/2250] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:20 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:39:21.248173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-276451293", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "7d4b5e6e-1097-46ba-bb21-ff9e1560d087"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:21.251273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c4571d5-c83f-43fd-8b5f-ce3386aec30a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:21.267794 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c4571d5-c83f-43fd-8b5f-ce3386aec30a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.669640 Aug 09 14:39:21.281724 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1151/2251] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:20 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:21.286823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9099ec56-4167-4b10-98cc-68ab9f0a1954 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:21.290533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9099ec56-4167-4b10-98cc-68ab9f0a1954 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: aaf11da1-82f0-41e7-bdef-9bbea7629ef0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:21.308329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9099ec56-4167-4b10-98cc-68ab9f0a1954 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:21.308846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9099ec56-4167-4b10-98cc-68ab9f0a1954 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:21.309286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9099ec56-4167-4b10-98cc-68ab9f0a1954 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:21.309997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9099ec56-4167-4b10-98cc-68ab9f0a1954 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:21.332205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9099ec56-4167-4b10-98cc-68ab9f0a1954 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:21.332833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9099ec56-4167-4b10-98cc-68ab9f0a1954 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:21.355937 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-9099ec56-4167-4b10-98cc-68ab9f0a1954 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] HTTP exception thrown: Instance aaf11da1-82f0-41e7-bdef-9bbea7629ef0 could not be found. Aug 09 14:39:21.364349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] validate_networks() for [('7d4b5e6e-1097-46ba-bb21-ff9e1560d087', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9099ec56-4167-4b10-98cc-68ab9f0a1954 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Request method failure captured: Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 HTTP/1.1 Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_z58ByM3EZa4D7yaO_sOhl8IVjmRW9fK9N_orS9pEymkWWyPGsH6zGI_z4iZShwviKzgVbxznILRz6auxK-ngK1MQNHGV3gQKvPQLSJnCWbyTOUkumSo8VBlpLUBZa1usQFj4V5nhu1hgoTMusUXvObqJcV7HSM2zoFxVmkJvJ0jo Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: beac39aa567247818bf13c604a1ed8ac Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-LiveMigrationTest-1645779934 Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_beac39aa567247818bf13c604a1ed8ac", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/beac39aa567247818bf13c604a1ed8ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beac39aa567247818bf13c604a1ed8ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beac39aa567247818bf13c604a1ed8ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-LiveMigrationTest-1645779934 Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: beac39aa567247818bf13c604a1ed8ac Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-LiveMigrationTest-1645779934 Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-LiveMigrationTest-1645779934-project Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: ca408ac0b6df4c3797409e40335f61aa Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-LiveMigrationTest-1645779934-project Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance aaf11da1-82f0-41e7-bdef-9bbea7629ef0 could not be found. Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'aaf11da1-82f0-41e7-bdef-9bbea7629ef0'} Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaf11da1-82f0-41e7-bdef-9bbea7629ef0 could not be found. Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaf11da1-82f0-41e7-bdef-9bbea7629ef0 could not be found. Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:21.366089 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:21.369323 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:21.369323 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:21.369323 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:21.369323 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:21.369323 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:21.369323 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaf11da1-82f0-41e7-bdef-9bbea7629ef0 could not be found. Aug 09 14:39:21.369323 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:21.369323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9099ec56-4167-4b10-98cc-68ab9f0a1954 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Returning 404 to user: Instance aaf11da1-82f0-41e7-bdef-9bbea7629ef0 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:21.369323 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9099ec56-4167-4b10-98cc-68ab9f0a1954 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0" status: 404 len: 111 microversion: 2.1 time: 0.086080 Aug 09 14:39:21.375460 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1152/2252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:21 2022] GET /compute/v2.1/servers/aaf11da1-82f0-41e7-bdef-9bbea7629ef0 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:21.385008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-24b8f02d-9ed8-4d6c-bfed-d8f4d20f70c5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:21.400048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-24b8f02d-9ed8-4d6c-bfed-d8f4d20f70c5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:21.406792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24b8f02d-9ed8-4d6c-bfed-d8f4d20f70c5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:21.407395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24b8f02d-9ed8-4d6c-bfed-d8f4d20f70c5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:21.408048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24b8f02d-9ed8-4d6c-bfed-d8f4d20f70c5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:21.408913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24b8f02d-9ed8-4d6c-bfed-d8f4d20f70c5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:21.409548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24b8f02d-9ed8-4d6c-bfed-d8f4d20f70c5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:21.410136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-24b8f02d-9ed8-4d6c-bfed-d8f4d20f70c5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:21.961265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-24b8f02d-9ed8-4d6c-bfed-d8f4d20f70c5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:21.970986 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-24b8f02d-9ed8-4d6c-bfed-d8f4d20f70c5 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1468 microversion: 2.1 time: 0.593576 Aug 09 14:39:21.976795 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1153/2253] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:21 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1468 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:21.995944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1c0d3d8d-5e25-4b25-9d96-2ac48046aa8a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:21.999857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1c0d3d8d-5e25-4b25-9d96-2ac48046aa8a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:22.007947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c0d3d8d-5e25-4b25-9d96-2ac48046aa8a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:22.013969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c0d3d8d-5e25-4b25-9d96-2ac48046aa8a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:22.015534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c0d3d8d-5e25-4b25-9d96-2ac48046aa8a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:22.016352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c0d3d8d-5e25-4b25-9d96-2ac48046aa8a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:22.022157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c0d3d8d-5e25-4b25-9d96-2ac48046aa8a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:22.022677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c0d3d8d-5e25-4b25-9d96-2ac48046aa8a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:22.068748 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1c0d3d8d-5e25-4b25-9d96-2ac48046aa8a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090276 Aug 09 14:39:22.070998 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1154/2254] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:39:21 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:22.078588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-687793a1-65fc-4a0c-82e3-785b03e8542e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '.version_select at 0x7f41dd349ee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:22.124426 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-687793a1-65fc-4a0c-82e3-785b03e8542e tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120296215" status: 202 len: 0 microversion: 2.1 time: 0.050973 Aug 09 14:39:22.126712 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1155/2255] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 14:39:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120296215 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:39:22.171682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-83b58e65-c7c9-4bdc-a7fa-149d685daf74 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:22.172904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-83b58e65-c7c9-4bdc-a7fa-149d685daf74 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:22.193528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83b58e65-c7c9-4bdc-a7fa-149d685daf74 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:22.195689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83b58e65-c7c9-4bdc-a7fa-149d685daf74 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:22.196280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83b58e65-c7c9-4bdc-a7fa-149d685daf74 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:22.200422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83b58e65-c7c9-4bdc-a7fa-149d685daf74 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:22.201668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83b58e65-c7c9-4bdc-a7fa-149d685daf74 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:22.202255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83b58e65-c7c9-4bdc-a7fa-149d685daf74 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:22.391055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-83b58e65-c7c9-4bdc-a7fa-149d685daf74 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:22.407713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-83b58e65-c7c9-4bdc-a7fa-149d685daf74 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:22.411562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-83b58e65-c7c9-4bdc-a7fa-149d685daf74 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:22.426235 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-83b58e65-c7c9-4bdc-a7fa-149d685daf74 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.260167 Aug 09 14:39:22.427684 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1156/2256] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:22 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:22.440185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0f69d8a-ebf7-412d-ba4f-54e7bb2c58a9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:22.441836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0f69d8a-ebf7-412d-ba4f-54e7bb2c58a9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:22.464626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0f69d8a-ebf7-412d-ba4f-54e7bb2c58a9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:22.465754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0f69d8a-ebf7-412d-ba4f-54e7bb2c58a9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:22.465986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0f69d8a-ebf7-412d-ba4f-54e7bb2c58a9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:22.466812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0f69d8a-ebf7-412d-ba4f-54e7bb2c58a9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:22.467691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0f69d8a-ebf7-412d-ba4f-54e7bb2c58a9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:22.467998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0f69d8a-ebf7-412d-ba4f-54e7bb2c58a9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:22.790602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:39:22.791060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:39:22.791810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:39:22.792114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:39:22.792520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:39:22.824270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:22.824759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:22.825191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:22.825911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:22.826354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:22.826772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:22.853193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:39:22.860851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for user 03bdf5ec21854ec8b6561a121ce1f1ef and project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:39:22.884447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:39:22.887681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:39:22.908831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a0f69d8a-ebf7-412d-ba4f-54e7bb2c58a9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:22.921689 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0f69d8a-ebf7-412d-ba4f-54e7bb2c58a9 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.489837 Aug 09 14:39:22.923294 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1157/2257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:22 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:22.956966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:22.998329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d6397bcd-8cd3-497c-b74c-e823545f9992 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:22.999222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d6397bcd-8cd3-497c-b74c-e823545f9992 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:23.010839 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-83f6f946-3103-444b-b939-2814cbf39717 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.862976 Aug 09 14:39:23.011376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6397bcd-8cd3-497c-b74c-e823545f9992 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:23.011979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6397bcd-8cd3-497c-b74c-e823545f9992 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:23.012655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6397bcd-8cd3-497c-b74c-e823545f9992 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:23.013828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6397bcd-8cd3-497c-b74c-e823545f9992 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:23.014083 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1101/2258] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:39:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:39:23.015360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6397bcd-8cd3-497c-b74c-e823545f9992 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:23.017170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6397bcd-8cd3-497c-b74c-e823545f9992 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:23.050360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b212e754-f938-4587-8875-a00d79479526 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:23.051161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b212e754-f938-4587-8875-a00d79479526 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:23.272785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b212e754-f938-4587-8875-a00d79479526 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:23.310220 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b212e754-f938-4587-8875-a00d79479526 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1192 microversion: 2.1 time: 0.291190 Aug 09 14:39:23.313684 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1102/2259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:23 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1192 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:23.375404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d7230646-406c-4a13-b769-44cee15340f7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:23.385116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d7230646-406c-4a13-b769-44cee15340f7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:23.438882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7230646-406c-4a13-b769-44cee15340f7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:23.439376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7230646-406c-4a13-b769-44cee15340f7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:23.439820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7230646-406c-4a13-b769-44cee15340f7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:23.443434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7230646-406c-4a13-b769-44cee15340f7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:23.443914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7230646-406c-4a13-b769-44cee15340f7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:23.444344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7230646-406c-4a13-b769-44cee15340f7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:23.628130 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d7230646-406c-4a13-b769-44cee15340f7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.299311 Aug 09 14:39:23.637464 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1103/2260] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:39:23 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments => generated 197 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:23.652491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03e33dbb-9bc4-4a51-988e-61f7583cd024 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:23.653103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03e33dbb-9bc4-4a51-988e-61f7583cd024 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:23.712746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03e33dbb-9bc4-4a51-988e-61f7583cd024 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:23.713328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03e33dbb-9bc4-4a51-988e-61f7583cd024 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:23.713933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03e33dbb-9bc4-4a51-988e-61f7583cd024 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:23.714689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03e33dbb-9bc4-4a51-988e-61f7583cd024 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:23.715174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03e33dbb-9bc4-4a51-988e-61f7583cd024 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:23.715591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03e33dbb-9bc4-4a51-988e-61f7583cd024 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:23.886474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d6397bcd-8cd3-497c-b74c-e823545f9992 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:23.905707 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d6397bcd-8cd3-497c-b74c-e823545f9992 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 200 len: 1426 microversion: 2.1 time: 0.911593 Aug 09 14:39:23.910366 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1158/2261] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:22 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 1426 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:39:23.921913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-116a4b5a-5f00-4be4-9187-ea18659c44bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:23.925753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-116a4b5a-5f00-4be4-9187-ea18659c44bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:23.938837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-116a4b5a-5f00-4be4-9187-ea18659c44bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:23.939355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-116a4b5a-5f00-4be4-9187-ea18659c44bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:23.939870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-116a4b5a-5f00-4be4-9187-ea18659c44bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:23.944195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-116a4b5a-5f00-4be4-9187-ea18659c44bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:23.944672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-116a4b5a-5f00-4be4-9187-ea18659c44bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:23.945209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-116a4b5a-5f00-4be4-9187-ea18659c44bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:23.990866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-03e33dbb-9bc4-4a51-988e-61f7583cd024 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:24.007147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-03e33dbb-9bc4-4a51-988e-61f7583cd024 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:24.022944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-03e33dbb-9bc4-4a51-988e-61f7583cd024 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:24.026580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-116a4b5a-5f00-4be4-9187-ea18659c44bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:39:24.034541 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03e33dbb-9bc4-4a51-988e-61f7583cd024 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.395859 Aug 09 14:39:24.053051 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1104/2262] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:23 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:24.058701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0a595516-29aa-4ec5-8456-4040937544c9 req-d19a3c81-ee4a-416b-8a8c-b02dbeba51d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a676431f-5bb5-48a8-87b7-ba9dbc1006ed", "name": "network-vif-deleted", "tag": "3094e50f-5e28-4faa-8608-b1f1946763b3"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:24.069609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0a595516-29aa-4ec5-8456-4040937544c9 req-d19a3c81-ee4a-416b-8a8c-b02dbeba51d8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.069609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0a595516-29aa-4ec5-8456-4040937544c9 req-d19a3c81-ee4a-416b-8a8c-b02dbeba51d8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.069609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0a595516-29aa-4ec5-8456-4040937544c9 req-d19a3c81-ee4a-416b-8a8c-b02dbeba51d8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:24.084270 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0a595516-29aa-4ec5-8456-4040937544c9 req-d19a3c81-ee4a-416b-8a8c-b02dbeba51d8 service nova] Creating event network-vif-deleted:3094e50f-5e28-4faa-8608-b1f1946763b3 for instance a676431f-5bb5-48a8-87b7-ba9dbc1006ed on n-h1-844626-8 Aug 09 14:39:24.094203 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0a595516-29aa-4ec5-8456-4040937544c9 req-d19a3c81-ee4a-416b-8a8c-b02dbeba51d8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039724 Aug 09 14:39:24.100481 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1105/2263] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:24.108389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60d8589b-0973-4c85-a757-6366ad73a180 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:24.109090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60d8589b-0973-4c85-a757-6366ad73a180 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:24.128411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d8589b-0973-4c85-a757-6366ad73a180 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.128879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d8589b-0973-4c85-a757-6366ad73a180 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.129318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d8589b-0973-4c85-a757-6366ad73a180 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:24.130024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d8589b-0973-4c85-a757-6366ad73a180 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.130463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d8589b-0973-4c85-a757-6366ad73a180 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.132706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d8589b-0973-4c85-a757-6366ad73a180 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:24.224156 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-116a4b5a-5f00-4be4-9187-ea18659c44bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 204 len: 0 microversion: 2.1 time: 0.310411 Aug 09 14:39:24.225020 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1159/2264] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:39:23 2022] DELETE /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:39:24.238114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d766f9a-ca47-43d4-8a6c-07a712fdf5bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:24.239374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d766f9a-ca47-43d4-8a6c-07a712fdf5bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:24.251334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d766f9a-ca47-43d4-8a6c-07a712fdf5bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.252114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d766f9a-ca47-43d4-8a6c-07a712fdf5bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.252677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d766f9a-ca47-43d4-8a6c-07a712fdf5bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:24.253528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d766f9a-ca47-43d4-8a6c-07a712fdf5bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.254184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d766f9a-ca47-43d4-8a6c-07a712fdf5bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.256434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d766f9a-ca47-43d4-8a6c-07a712fdf5bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:24.368616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60d8589b-0973-4c85-a757-6366ad73a180 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:24.383186 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60d8589b-0973-4c85-a757-6366ad73a180 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1514 microversion: 2.1 time: 0.278617 Aug 09 14:39:24.385198 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1106/2265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:24 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:24.402604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-250c0c46-0835-452b-9293-19477fa190d2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:24.406300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-250c0c46-0835-452b-9293-19477fa190d2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:24.444268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-250c0c46-0835-452b-9293-19477fa190d2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.451373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-250c0c46-0835-452b-9293-19477fa190d2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.453134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-250c0c46-0835-452b-9293-19477fa190d2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:24.456797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-250c0c46-0835-452b-9293-19477fa190d2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.457307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-250c0c46-0835-452b-9293-19477fa190d2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.457739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-250c0c46-0835-452b-9293-19477fa190d2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:24.688253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-250c0c46-0835-452b-9293-19477fa190d2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:24.696575 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-250c0c46-0835-452b-9293-19477fa190d2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1188 microversion: 2.1 time: 0.308065 Aug 09 14:39:24.697170 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1107/2266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:24 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:24.718450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-27cddc0e-bc45-4245-ae48-663c7d4a9271 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:24.720936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-27cddc0e-bc45-4245-ae48-663c7d4a9271 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:24.727717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27cddc0e-bc45-4245-ae48-663c7d4a9271 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.728408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27cddc0e-bc45-4245-ae48-663c7d4a9271 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.728982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27cddc0e-bc45-4245-ae48-663c7d4a9271 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:24.729880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27cddc0e-bc45-4245-ae48-663c7d4a9271 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.730490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27cddc0e-bc45-4245-ae48-663c7d4a9271 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.731057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27cddc0e-bc45-4245-ae48-663c7d4a9271 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:24.771674 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-27cddc0e-bc45-4245-ae48-663c7d4a9271 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059259 Aug 09 14:39:24.772796 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1108/2267] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:39:24 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:24.810347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d766f9a-ca47-43d4-8a6c-07a712fdf5bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:24.820184 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d766f9a-ca47-43d4-8a6c-07a712fdf5bd tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1482 microversion: 2.1 time: 0.589633 Aug 09 14:39:24.822034 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1160/2268] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:24 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1482 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:24.931478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c55f9e6-b571-45fe-8e0e-5459dbc8e937 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:24.932291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6c55f9e6-b571-45fe-8e0e-5459dbc8e937 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: a676431f-5bb5-48a8-87b7-ba9dbc1006ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:24.941708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c55f9e6-b571-45fe-8e0e-5459dbc8e937 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.942201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c55f9e6-b571-45fe-8e0e-5459dbc8e937 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.943000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c55f9e6-b571-45fe-8e0e-5459dbc8e937 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:24.943347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c55f9e6-b571-45fe-8e0e-5459dbc8e937 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.943792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c55f9e6-b571-45fe-8e0e-5459dbc8e937 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.944240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c55f9e6-b571-45fe-8e0e-5459dbc8e937 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:24.965214 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6c55f9e6-b571-45fe-8e0e-5459dbc8e937 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] HTTP exception thrown: Instance a676431f-5bb5-48a8-87b7-ba9dbc1006ed could not be found. Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c55f9e6-b571-45fe-8e0e-5459dbc8e937 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Request method failure captured: Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed HTTP/1.1 Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nD-wlutR1zkYM_kfXhTGafVpddHKoV6Y4ofnIWB1Eu8eMfBkEQVQlAmPBTHthIKDlJN_C6Px2WiHNj1ngNhf8I_P4foFBhteCs1aVwla4GyBUNqomEjoFzorK5AwKn_GFJ67aZEkDxRry9-U1DggUAyAca9RKbrkLfu9ekTpOxTMKQ Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 27e653d20943429d8c845d3c9a61f7d8 Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersAdminTestJSON-1785428893 Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_27e653d20943429d8c845d3c9a61f7d8", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/27e653d20943429d8c845d3c9a61f7d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/27e653d20943429d8c845d3c9a61f7d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/27e653d20943429d8c845d3c9a61f7d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersAdminTestJSON-1785428893 Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 27e653d20943429d8c845d3c9a61f7d8 Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersAdminTestJSON-1785428893 Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersAdminTestJSON-1785428893-project Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 6c8ac8ccb50b49719fc1cc9f758b11ba Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersAdminTestJSON-1785428893-project Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance a676431f-5bb5-48a8-87b7-ba9dbc1006ed could not be found. Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'a676431f-5bb5-48a8-87b7-ba9dbc1006ed'} Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a676431f-5bb5-48a8-87b7-ba9dbc1006ed could not be found. Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a676431f-5bb5-48a8-87b7-ba9dbc1006ed could not be found. Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:24.966541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:24.970943 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:24.970943 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:24.970943 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:24.970943 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:24.970943 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:24.970943 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a676431f-5bb5-48a8-87b7-ba9dbc1006ed could not be found. Aug 09 14:39:24.970943 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:24.970943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c55f9e6-b571-45fe-8e0e-5459dbc8e937 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Returning 404 to user: Instance a676431f-5bb5-48a8-87b7-ba9dbc1006ed could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:24.970943 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6c55f9e6-b571-45fe-8e0e-5459dbc8e937 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed" status: 404 len: 111 microversion: 2.1 time: 0.041729 Aug 09 14:39:24.978278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0eb2936-9647-4baa-b822-07db6734b927 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:24.978844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0eb2936-9647-4baa-b822-07db6734b927 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:24.988010 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1109/2269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:24 2022] GET /compute/v2.1/servers/a676431f-5bb5-48a8-87b7-ba9dbc1006ed => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:24.991430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0eb2936-9647-4baa-b822-07db6734b927 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.991918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0eb2936-9647-4baa-b822-07db6734b927 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.992392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0eb2936-9647-4baa-b822-07db6734b927 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:24.993088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0eb2936-9647-4baa-b822-07db6734b927 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:24.993689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0eb2936-9647-4baa-b822-07db6734b927 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:24.994110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0eb2936-9647-4baa-b822-07db6734b927 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:25.060136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ed28badb-757d-44b8-bdf9-f1d4f1b35634 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:25.060957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ed28badb-757d-44b8-bdf9-f1d4f1b35634 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:25.070787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed28badb-757d-44b8-bdf9-f1d4f1b35634 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:25.071889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0eb2936-9647-4baa-b822-07db6734b927 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:39:25.072547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed28badb-757d-44b8-bdf9-f1d4f1b35634 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:25.076402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed28badb-757d-44b8-bdf9-f1d4f1b35634 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:25.077392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed28badb-757d-44b8-bdf9-f1d4f1b35634 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:25.077963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed28badb-757d-44b8-bdf9-f1d4f1b35634 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:25.078603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed28badb-757d-44b8-bdf9-f1d4f1b35634 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:25.200290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ed28badb-757d-44b8-bdf9-f1d4f1b35634 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:25.214557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ed28badb-757d-44b8-bdf9-f1d4f1b35634 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:25.217212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ed28badb-757d-44b8-bdf9-f1d4f1b35634 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:25.237618 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ed28badb-757d-44b8-bdf9-f1d4f1b35634 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.181895 Aug 09 14:39:25.238463 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1110/2270] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:25 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:39:25.267941 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0eb2936-9647-4baa-b822-07db6734b927 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "DELETE /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 204 len: 0 microversion: 2.1 time: 0.293653 Aug 09 14:39:25.269963 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1161/2271] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:39:24 2022] DELETE /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:39:25.278242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f05e41a7-7c38-49d1-aaa5-74daf46dcd4b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:25.278904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f05e41a7-7c38-49d1-aaa5-74daf46dcd4b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:25.289229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f05e41a7-7c38-49d1-aaa5-74daf46dcd4b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:25.289845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f05e41a7-7c38-49d1-aaa5-74daf46dcd4b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:25.290320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f05e41a7-7c38-49d1-aaa5-74daf46dcd4b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:25.291192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f05e41a7-7c38-49d1-aaa5-74daf46dcd4b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:25.291628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f05e41a7-7c38-49d1-aaa5-74daf46dcd4b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:25.292076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f05e41a7-7c38-49d1-aaa5-74daf46dcd4b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:25.406294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a9848b5-bfc5-40ac-96d3-34db8ed2a062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:25.407000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7a9848b5-bfc5-40ac-96d3-34db8ed2a062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:25.419768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9848b5-bfc5-40ac-96d3-34db8ed2a062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:25.420259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9848b5-bfc5-40ac-96d3-34db8ed2a062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:25.420690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9848b5-bfc5-40ac-96d3-34db8ed2a062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:25.421392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9848b5-bfc5-40ac-96d3-34db8ed2a062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:25.421838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9848b5-bfc5-40ac-96d3-34db8ed2a062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:25.422250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9848b5-bfc5-40ac-96d3-34db8ed2a062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:25.732608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f05e41a7-7c38-49d1-aaa5-74daf46dcd4b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:25.743976 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f05e41a7-7c38-49d1-aaa5-74daf46dcd4b tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1468 microversion: 2.1 time: 0.469613 Aug 09 14:39:25.759596 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1111/2272] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:25 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1468 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:25.765182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1258855-dfe8-4b48-ade3-d8b7b892b848 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:25.766871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f1258855-dfe8-4b48-ade3-d8b7b892b848 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:25.782929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1258855-dfe8-4b48-ade3-d8b7b892b848 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:25.784319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1258855-dfe8-4b48-ade3-d8b7b892b848 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:25.787151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1258855-dfe8-4b48-ade3-d8b7b892b848 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:25.787151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1258855-dfe8-4b48-ade3-d8b7b892b848 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:25.787151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1258855-dfe8-4b48-ade3-d8b7b892b848 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:25.787151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1258855-dfe8-4b48-ade3-d8b7b892b848 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:25.862805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:25.927685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7a9848b5-bfc5-40ac-96d3-34db8ed2a062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:25.939015 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a9848b5-bfc5-40ac-96d3-34db8ed2a062 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1520 microversion: 2.1 time: 0.536817 Aug 09 14:39:25.939957 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1162/2273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:25 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1520 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:39:25.982219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99b36d9f-3848-43ce-af08-086cf0da5c6c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:25.985599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-99b36d9f-3848-43ce-af08-086cf0da5c6c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:26.016423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99b36d9f-3848-43ce-af08-086cf0da5c6c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:26.017802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99b36d9f-3848-43ce-af08-086cf0da5c6c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:26.020089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99b36d9f-3848-43ce-af08-086cf0da5c6c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:26.021113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99b36d9f-3848-43ce-af08-086cf0da5c6c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:26.023806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99b36d9f-3848-43ce-af08-086cf0da5c6c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:26.024608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99b36d9f-3848-43ce-af08-086cf0da5c6c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:26.066514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f1258855-dfe8-4b48-ade3-d8b7b892b848 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:26.084731 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f1258855-dfe8-4b48-ade3-d8b7b892b848 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1252 microversion: 2.1 time: 0.323605 Aug 09 14:39:26.088351 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1112/2274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:25 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1252 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:26.110998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6fb8186f-aae4-4508-a094-cb9be7232bfc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:26.111868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6fb8186f-aae4-4508-a094-cb9be7232bfc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:26.141477 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99b36d9f-3848-43ce-af08-086cf0da5c6c tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191869 Aug 09 14:39:26.146420 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1163/2275] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:39:25 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:26.146594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fb8186f-aae4-4508-a094-cb9be7232bfc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:26.146594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fb8186f-aae4-4508-a094-cb9be7232bfc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:26.146594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fb8186f-aae4-4508-a094-cb9be7232bfc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:26.146594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fb8186f-aae4-4508-a094-cb9be7232bfc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:26.161340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fb8186f-aae4-4508-a094-cb9be7232bfc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:26.164249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6fb8186f-aae4-4508-a094-cb9be7232bfc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:26.254423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-37aa97b1-6436-40d9-bca0-8441d3f7d890 req-50684068-511a-4024-8731-d04b00d07c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd9360b9-5620-4fa1-819c-90485da8e233", "name": "network-vif-deleted", "tag": "5bd1019d-0599-4147-9f78-e7a7f2989303"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:26.277398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-37aa97b1-6436-40d9-bca0-8441d3f7d890 req-50684068-511a-4024-8731-d04b00d07c84 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:26.277774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-37aa97b1-6436-40d9-bca0-8441d3f7d890 req-50684068-511a-4024-8731-d04b00d07c84 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:26.278211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-37aa97b1-6436-40d9-bca0-8441d3f7d890 req-50684068-511a-4024-8731-d04b00d07c84 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:26.316288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6fb8186f-aae4-4508-a094-cb9be7232bfc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:26.320928 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-37aa97b1-6436-40d9-bca0-8441d3f7d890 req-50684068-511a-4024-8731-d04b00d07c84 service nova] Creating event network-vif-deleted:5bd1019d-0599-4147-9f78-e7a7f2989303 for instance bd9360b9-5620-4fa1-819c-90485da8e233 on n-h1-844626-8 Aug 09 14:39:26.326568 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6fb8186f-aae4-4508-a094-cb9be7232bfc tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 200 len: 1440 microversion: 2.1 time: 0.235344 Aug 09 14:39:26.343871 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-37aa97b1-6436-40d9-bca0-8441d3f7d890 req-50684068-511a-4024-8731-d04b00d07c84 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089266 Aug 09 14:39:26.343871 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1164/2276] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:26.344753 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1113/2277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:26 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 1440 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:26.359594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-982cba88-325d-4a77-bbd8-cf27486c65a7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:26.360701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-982cba88-325d-4a77-bbd8-cf27486c65a7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:26.370914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-982cba88-325d-4a77-bbd8-cf27486c65a7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:26.371527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-982cba88-325d-4a77-bbd8-cf27486c65a7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:26.372063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-982cba88-325d-4a77-bbd8-cf27486c65a7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:26.374196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-982cba88-325d-4a77-bbd8-cf27486c65a7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:26.375589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-982cba88-325d-4a77-bbd8-cf27486c65a7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:26.376102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-982cba88-325d-4a77-bbd8-cf27486c65a7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:26.476642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-982cba88-325d-4a77-bbd8-cf27486c65a7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:26.487275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-982cba88-325d-4a77-bbd8-cf27486c65a7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:26.489627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-982cba88-325d-4a77-bbd8-cf27486c65a7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:26.495910 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-982cba88-325d-4a77-bbd8-cf27486c65a7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.150938 Aug 09 14:39:26.497685 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1165/2278] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:26 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:26.765339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d6fb932c-cc8d-40ff-8017-23ab6ae6c606 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:26.765972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d6fb932c-cc8d-40ff-8017-23ab6ae6c606 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:26.773948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6fb932c-cc8d-40ff-8017-23ab6ae6c606 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:26.775447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6fb932c-cc8d-40ff-8017-23ab6ae6c606 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:26.776253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6fb932c-cc8d-40ff-8017-23ab6ae6c606 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:26.777194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6fb932c-cc8d-40ff-8017-23ab6ae6c606 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:26.777873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6fb932c-cc8d-40ff-8017-23ab6ae6c606 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:26.778701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6fb932c-cc8d-40ff-8017-23ab6ae6c606 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:26.964279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dafd1109-07db-481c-baaf-5c36c5b53a61 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:26.965287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dafd1109-07db-481c-baaf-5c36c5b53a61 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:26.972557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dafd1109-07db-481c-baaf-5c36c5b53a61 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:26.973307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dafd1109-07db-481c-baaf-5c36c5b53a61 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:26.974022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dafd1109-07db-481c-baaf-5c36c5b53a61 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:26.974924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dafd1109-07db-481c-baaf-5c36c5b53a61 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:26.975671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dafd1109-07db-481c-baaf-5c36c5b53a61 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:26.976308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dafd1109-07db-481c-baaf-5c36c5b53a61 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.075387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d6fb932c-cc8d-40ff-8017-23ab6ae6c606 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:27.084813 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d6fb932c-cc8d-40ff-8017-23ab6ae6c606 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1468 microversion: 2.1 time: 0.324299 Aug 09 14:39:27.085556 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1114/2279] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:26 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1468 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:27.109574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c02f5d0f-ebd2-484e-a4e5-8bde00faa4e9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:27.110145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c02f5d0f-ebd2-484e-a4e5-8bde00faa4e9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:27.122445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c02f5d0f-ebd2-484e-a4e5-8bde00faa4e9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.123296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c02f5d0f-ebd2-484e-a4e5-8bde00faa4e9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.124421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c02f5d0f-ebd2-484e-a4e5-8bde00faa4e9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.125337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c02f5d0f-ebd2-484e-a4e5-8bde00faa4e9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.125749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c02f5d0f-ebd2-484e-a4e5-8bde00faa4e9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.126383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c02f5d0f-ebd2-484e-a4e5-8bde00faa4e9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.329245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c02f5d0f-ebd2-484e-a4e5-8bde00faa4e9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:27.344147 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c02f5d0f-ebd2-484e-a4e5-8bde00faa4e9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1250 microversion: 2.1 time: 0.239066 Aug 09 14:39:27.345005 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1115/2280] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:27 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1250 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:27.361944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13319107-2737-4ceb-b2c6-c7e057c4c32f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:27.364943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-13319107-2737-4ceb-b2c6-c7e057c4c32f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:27.372339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dafd1109-07db-481c-baaf-5c36c5b53a61 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:27.376924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13319107-2737-4ceb-b2c6-c7e057c4c32f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.377842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13319107-2737-4ceb-b2c6-c7e057c4c32f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.381544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13319107-2737-4ceb-b2c6-c7e057c4c32f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.382835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13319107-2737-4ceb-b2c6-c7e057c4c32f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.384145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13319107-2737-4ceb-b2c6-c7e057c4c32f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.384783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13319107-2737-4ceb-b2c6-c7e057c4c32f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.396561 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dafd1109-07db-481c-baaf-5c36c5b53a61 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1520 microversion: 2.1 time: 0.436438 Aug 09 14:39:27.398968 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1166/2281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:26 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1520 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:27.406978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-203f8ea6-9716-4701-bbf3-ff23f999cefa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:27.408729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-203f8ea6-9716-4701-bbf3-ff23f999cefa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: bd9360b9-5620-4fa1-819c-90485da8e233] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:27.422976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-203f8ea6-9716-4701-bbf3-ff23f999cefa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.426695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-203f8ea6-9716-4701-bbf3-ff23f999cefa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.427925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-203f8ea6-9716-4701-bbf3-ff23f999cefa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.429138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-203f8ea6-9716-4701-bbf3-ff23f999cefa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.429757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-203f8ea6-9716-4701-bbf3-ff23f999cefa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.430445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-203f8ea6-9716-4701-bbf3-ff23f999cefa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.440380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:27.467327 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-203f8ea6-9716-4701-bbf3-ff23f999cefa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] HTTP exception thrown: Instance bd9360b9-5620-4fa1-819c-90485da8e233 could not be found. Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-203f8ea6-9716-4701-bbf3-ff23f999cefa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Request method failure captured: Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 HTTP/1.1 Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8m_z58ByM3EZa4D7yaO_sOhl8IVjmRW9fK9N_orS9pEymkWWyPGsH6zGI_z4iZShwviKzgVbxznILRz6auxK-ngK1MQNHGV3gQKvPQLSJnCWbyTOUkumSo8VBlpLUBZa1usQFj4V5nhu1hgoTMusUXvObqJcV7HSM2zoFxVmkJvJ0jo Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: beac39aa567247818bf13c604a1ed8ac Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-LiveMigrationTest-1645779934 Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_beac39aa567247818bf13c604a1ed8ac", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/beac39aa567247818bf13c604a1ed8ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beac39aa567247818bf13c604a1ed8ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beac39aa567247818bf13c604a1ed8ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-LiveMigrationTest-1645779934 Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: beac39aa567247818bf13c604a1ed8ac Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-LiveMigrationTest-1645779934 Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-LiveMigrationTest-1645779934-project Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: ca408ac0b6df4c3797409e40335f61aa Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-LiveMigrationTest-1645779934-project Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance bd9360b9-5620-4fa1-819c-90485da8e233 could not be found. Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'bd9360b9-5620-4fa1-819c-90485da8e233'} Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd9360b9-5620-4fa1-819c-90485da8e233 could not be found. Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd9360b9-5620-4fa1-819c-90485da8e233 could not be found. Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:27.473982 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:27.478283 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:27.478283 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:27.478283 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:27.478283 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:27.478283 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:27.478283 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd9360b9-5620-4fa1-819c-90485da8e233 could not be found. Aug 09 14:39:27.478283 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:27.478283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-203f8ea6-9716-4701-bbf3-ff23f999cefa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Returning 404 to user: Instance bd9360b9-5620-4fa1-819c-90485da8e233 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:27.478283 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-203f8ea6-9716-4701-bbf3-ff23f999cefa tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233" status: 404 len: 111 microversion: 2.1 time: 0.077641 Aug 09 14:39:27.481349 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-13319107-2737-4ceb-b2c6-c7e057c4c32f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.135091 Aug 09 14:39:27.482413 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1116/2282] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:39:27 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:39:27.500067 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1167/2283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:27 2022] GET /compute/v2.1/servers/bd9360b9-5620-4fa1-819c-90485da8e233 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:27.507219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca439905-8695-4250-8463-396b461eb329 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:27.507785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca439905-8695-4250-8463-396b461eb329 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:27.519486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca439905-8695-4250-8463-396b461eb329 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.520015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca439905-8695-4250-8463-396b461eb329 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.520821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca439905-8695-4250-8463-396b461eb329 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.521660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca439905-8695-4250-8463-396b461eb329 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.522241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca439905-8695-4250-8463-396b461eb329 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.522760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca439905-8695-4250-8463-396b461eb329 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.525500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-26cefa5d-9a13-455c-9e39-0ce3ec096d14 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:27.526257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-26cefa5d-9a13-455c-9e39-0ce3ec096d14 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:27.536047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26cefa5d-9a13-455c-9e39-0ce3ec096d14 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.536533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26cefa5d-9a13-455c-9e39-0ce3ec096d14 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.536958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26cefa5d-9a13-455c-9e39-0ce3ec096d14 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.537656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26cefa5d-9a13-455c-9e39-0ce3ec096d14 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.538090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26cefa5d-9a13-455c-9e39-0ce3ec096d14 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.538499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26cefa5d-9a13-455c-9e39-0ce3ec096d14 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.559439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca439905-8695-4250-8463-396b461eb329 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:39:27.760419 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca439905-8695-4250-8463-396b461eb329 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 204 len: 0 microversion: 2.1 time: 0.256904 Aug 09 14:39:27.761405 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1117/2284] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:39:27 2022] DELETE /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:39:27.768684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-42dd4d16-b695-4e8a-b3b9-fb9e32d2f76b req-ab0833f6-aaaf-4b3d-8763-2e76dc67755e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c528e1-bc7a-4791-9a0f-de8414ea9077", "name": "network-vif-unplugged", "status": "completed", "tag": "056748cf-883c-4a7b-85dd-4283d05e1cbe"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:27.783323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-42dd4d16-b695-4e8a-b3b9-fb9e32d2f76b req-ab0833f6-aaaf-4b3d-8763-2e76dc67755e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.784185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-42dd4d16-b695-4e8a-b3b9-fb9e32d2f76b req-ab0833f6-aaaf-4b3d-8763-2e76dc67755e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.784881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-42dd4d16-b695-4e8a-b3b9-fb9e32d2f76b req-ab0833f6-aaaf-4b3d-8763-2e76dc67755e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.798421 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-42dd4d16-b695-4e8a-b3b9-fb9e32d2f76b req-ab0833f6-aaaf-4b3d-8763-2e76dc67755e service nova] Creating event network-vif-unplugged:056748cf-883c-4a7b-85dd-4283d05e1cbe for instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 on n-h2-844626-8 Aug 09 14:39:27.803837 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-42dd4d16-b695-4e8a-b3b9-fb9e32d2f76b req-ab0833f6-aaaf-4b3d-8763-2e76dc67755e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040319 Aug 09 14:39:27.805122 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1118/2285] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:27.810691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7937be2-4ea4-4912-bc51-9020294a5ac3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:27.811912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7937be2-4ea4-4912-bc51-9020294a5ac3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:27.815475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-26cefa5d-9a13-455c-9e39-0ce3ec096d14 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:27.826188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7937be2-4ea4-4912-bc51-9020294a5ac3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.832961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-26cefa5d-9a13-455c-9e39-0ce3ec096d14 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:27.834559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7937be2-4ea4-4912-bc51-9020294a5ac3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.835291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7937be2-4ea4-4912-bc51-9020294a5ac3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.836246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7937be2-4ea4-4912-bc51-9020294a5ac3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:27.836947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7937be2-4ea4-4912-bc51-9020294a5ac3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:27.837072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-26cefa5d-9a13-455c-9e39-0ce3ec096d14 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:27.837634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7937be2-4ea4-4912-bc51-9020294a5ac3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:27.854951 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-26cefa5d-9a13-455c-9e39-0ce3ec096d14 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.333151 Aug 09 14:39:27.865261 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1168/2286] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:27 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:39:27.891785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1873254506", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "81aaa2b1-5362-4182-9406-b54bfbcbf2bf"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:27.991025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] validate_networks() for [('81aaa2b1-5362-4182-9406-b54bfbcbf2bf', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:39:28.323423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7937be2-4ea4-4912-bc51-9020294a5ac3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca408ac0b6df4c3797409e40335f61aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beac39aa567247818bf13c604a1ed8ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:28.337205 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7937be2-4ea4-4912-bc51-9020294a5ac3 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 200 len: 1498 microversion: 2.1 time: 0.530662 Aug 09 14:39:28.337806 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1119/2287] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:27 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 1498 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:28.356424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55cedb7c-6587-4ece-8d29-027177d080d2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:28.357269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55cedb7c-6587-4ece-8d29-027177d080d2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:28.371283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55cedb7c-6587-4ece-8d29-027177d080d2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:28.371776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55cedb7c-6587-4ece-8d29-027177d080d2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:28.372318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55cedb7c-6587-4ece-8d29-027177d080d2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:28.373086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55cedb7c-6587-4ece-8d29-027177d080d2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:28.373540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55cedb7c-6587-4ece-8d29-027177d080d2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:28.374030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55cedb7c-6587-4ece-8d29-027177d080d2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:28.546830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-55cedb7c-6587-4ece-8d29-027177d080d2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:28.556575 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-55cedb7c-6587-4ece-8d29-027177d080d2 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 200 len: 1426 microversion: 2.1 time: 0.203712 Aug 09 14:39:28.557695 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1120/2288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:28 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 1426 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:28.567964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32afde00-f000-4d86-9010-bbfa5eeee0ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:28.569072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-32afde00-f000-4d86-9010-bbfa5eeee0ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:28.579283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32afde00-f000-4d86-9010-bbfa5eeee0ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:28.580223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32afde00-f000-4d86-9010-bbfa5eeee0ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:28.580668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32afde00-f000-4d86-9010-bbfa5eeee0ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:28.581389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32afde00-f000-4d86-9010-bbfa5eeee0ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:28.581873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32afde00-f000-4d86-9010-bbfa5eeee0ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:28.582294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32afde00-f000-4d86-9010-bbfa5eeee0ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:29.656222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-32afde00-f000-4d86-9010-bbfa5eeee0ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:29.671191 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32afde00-f000-4d86-9010-bbfa5eeee0ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1292 microversion: 2.1 time: 1.109442 Aug 09 14:39:29.673180 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1121/2289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:28 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1292 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:29.683396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b57fddda-dccb-4f4f-af9c-a23771a7ee9e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:29.684269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b57fddda-dccb-4f4f-af9c-a23771a7ee9e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:29.691271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b57fddda-dccb-4f4f-af9c-a23771a7ee9e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:29.692077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b57fddda-dccb-4f4f-af9c-a23771a7ee9e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:29.692690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b57fddda-dccb-4f4f-af9c-a23771a7ee9e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:29.693602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b57fddda-dccb-4f4f-af9c-a23771a7ee9e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:29.694231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b57fddda-dccb-4f4f-af9c-a23771a7ee9e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:29.694832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b57fddda-dccb-4f4f-af9c-a23771a7ee9e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:29.995937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:39:29.996950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:39:29.997599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:39:29.998369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:39:29.998982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:39:30.010002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.010866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.011525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.012463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.013113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.013729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.036677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Getting quotas for project ec96cdb5ea0f42c6ad2044517c6dbffa. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:39:30.041656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Getting quotas for user 68639dd3894d4af7a49f3ffee8beb889 and project ec96cdb5ea0f42c6ad2044517c6dbffa. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:39:30.055425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:39:30.057938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:39:30.107525 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-352202ff-dc75-4d3e-98f6-33e7ab9555c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.236603 Aug 09 14:39:30.108184 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1169/2290] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:39:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:39:30.114049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-52824bcd-9f0a-4b0c-ac72-c317f1c9bf9d req-99e73ccf-a960-452e-8322-0cf96c8b288f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70ce2470-a122-46db-b968-ff9fc15c3166", "name": "network-vif-deleted", "tag": "ddc11171-a7ed-4bdb-9894-e754060ea66f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:30.126033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-52824bcd-9f0a-4b0c-ac72-c317f1c9bf9d req-99e73ccf-a960-452e-8322-0cf96c8b288f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.126864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-52824bcd-9f0a-4b0c-ac72-c317f1c9bf9d req-99e73ccf-a960-452e-8322-0cf96c8b288f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.127679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-52824bcd-9f0a-4b0c-ac72-c317f1c9bf9d req-99e73ccf-a960-452e-8322-0cf96c8b288f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.140689 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-52824bcd-9f0a-4b0c-ac72-c317f1c9bf9d req-99e73ccf-a960-452e-8322-0cf96c8b288f service nova] Creating event network-vif-deleted:ddc11171-a7ed-4bdb-9894-e754060ea66f for instance 70ce2470-a122-46db-b968-ff9fc15c3166 on n-h1-844626-8 Aug 09 14:39:30.147602 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-52824bcd-9f0a-4b0c-ac72-c317f1c9bf9d req-99e73ccf-a960-452e-8322-0cf96c8b288f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037987 Aug 09 14:39:30.148804 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1170/2291] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:30.156725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49b4b712-5cca-453f-a68b-70c804df66e9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:30.157605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49b4b712-5cca-453f-a68b-70c804df66e9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:30.165491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49b4b712-5cca-453f-a68b-70c804df66e9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.171107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b57fddda-dccb-4f4f-af9c-a23771a7ee9e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:30.180110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49b4b712-5cca-453f-a68b-70c804df66e9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.180810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49b4b712-5cca-453f-a68b-70c804df66e9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.181992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49b4b712-5cca-453f-a68b-70c804df66e9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.182637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49b4b712-5cca-453f-a68b-70c804df66e9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.184470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49b4b712-5cca-453f-a68b-70c804df66e9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.188282 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b57fddda-dccb-4f4f-af9c-a23771a7ee9e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1520 microversion: 2.1 time: 0.512913 Aug 09 14:39:30.208604 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1122/2292] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:29 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1520 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:30.214586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d812aab-d454-4e9d-bbf5-2c938f2a9bf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:30.215616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3d812aab-d454-4e9d-bbf5-2c938f2a9bf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] [instance: 4ca42dbb-ca4a-4f81-ac33-6d850cd01322] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:30.224933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d812aab-d454-4e9d-bbf5-2c938f2a9bf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.225864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d812aab-d454-4e9d-bbf5-2c938f2a9bf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.227370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d812aab-d454-4e9d-bbf5-2c938f2a9bf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.228407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d812aab-d454-4e9d-bbf5-2c938f2a9bf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.229145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d812aab-d454-4e9d-bbf5-2c938f2a9bf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.229764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d812aab-d454-4e9d-bbf5-2c938f2a9bf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.256528 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-3d812aab-d454-4e9d-bbf5-2c938f2a9bf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] HTTP exception thrown: Instance 4ca42dbb-ca4a-4f81-ac33-6d850cd01322 could not be found. Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d812aab-d454-4e9d-bbf5-2c938f2a9bf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Request method failure captured: Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 HTTP/1.1 Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8m_z58ByM3EZa4D7yaO_sOhl8IVjmRW9fK9N_orS9pEymkWWyPGsH6zGI_z4iZShwviKzgVbxznILRz6auxK-ngK1MQNHGV3gQKvPQLSJnCWbyTOUkumSo8VBlpLUBZa1usQFj4V5nhu1hgoTMusUXvObqJcV7HSM2zoFxVmkJvJ0jo Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: beac39aa567247818bf13c604a1ed8ac Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-LiveMigrationTest-1645779934 Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_beac39aa567247818bf13c604a1ed8ac", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/beac39aa567247818bf13c604a1ed8ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beac39aa567247818bf13c604a1ed8ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/beac39aa567247818bf13c604a1ed8ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-LiveMigrationTest-1645779934 Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: beac39aa567247818bf13c604a1ed8ac Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-LiveMigrationTest-1645779934 Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-LiveMigrationTest-1645779934-project Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: ca408ac0b6df4c3797409e40335f61aa Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-LiveMigrationTest-1645779934-project Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 4ca42dbb-ca4a-4f81-ac33-6d850cd01322 could not be found. Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '4ca42dbb-ca4a-4f81-ac33-6d850cd01322'} Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca42dbb-ca4a-4f81-ac33-6d850cd01322 could not be found. Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca42dbb-ca4a-4f81-ac33-6d850cd01322 could not be found. Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:30.258483 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:30.263779 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:30.263779 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:30.263779 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:30.263779 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:30.263779 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:30.263779 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca42dbb-ca4a-4f81-ac33-6d850cd01322 could not be found. Aug 09 14:39:30.263779 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:30.263779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d812aab-d454-4e9d-bbf5-2c938f2a9bf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] Returning 404 to user: Instance 4ca42dbb-ca4a-4f81-ac33-6d850cd01322 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:30.265464 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d812aab-d454-4e9d-bbf5-2c938f2a9bf2 tempest-LiveMigrationTest-1645779934 tempest-LiveMigrationTest-1645779934-project] 10.222.0.50 "GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322" status: 404 len: 111 microversion: 2.1 time: 0.055084 Aug 09 14:39:30.266565 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1123/2293] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:30 2022] GET /compute/v2.1/servers/4ca42dbb-ca4a-4f81-ac33-6d850cd01322 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:30.278018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99fd749a-ef92-41d7-9155-24b1885bce0c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:30.279690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-99fd749a-ef92-41d7-9155-24b1885bce0c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: 70ce2470-a122-46db-b968-ff9fc15c3166] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:30.288005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99fd749a-ef92-41d7-9155-24b1885bce0c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.288691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99fd749a-ef92-41d7-9155-24b1885bce0c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.289311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99fd749a-ef92-41d7-9155-24b1885bce0c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.290372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99fd749a-ef92-41d7-9155-24b1885bce0c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.290974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99fd749a-ef92-41d7-9155-24b1885bce0c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.291618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99fd749a-ef92-41d7-9155-24b1885bce0c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.308230 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-99fd749a-ef92-41d7-9155-24b1885bce0c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] HTTP exception thrown: Instance 70ce2470-a122-46db-b968-ff9fc15c3166 could not be found. Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99fd749a-ef92-41d7-9155-24b1885bce0c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Request method failure captured: Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 HTTP/1.1 Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nD-wlutR1zkYM_kfXhTGafVpddHKoV6Y4ofnIWB1Eu8eMfBkEQVQlAmPBTHthIKDlJN_C6Px2WiHNj1ngNhf8I_P4foFBhteCs1aVwla4GyBUNqomEjoFzorK5AwKn_GFJ67aZEkDxRry9-U1DggUAyAca9RKbrkLfu9ekTpOxTMKQ Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 27e653d20943429d8c845d3c9a61f7d8 Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersAdminTestJSON-1785428893 Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_27e653d20943429d8c845d3c9a61f7d8", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/27e653d20943429d8c845d3c9a61f7d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/27e653d20943429d8c845d3c9a61f7d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/27e653d20943429d8c845d3c9a61f7d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersAdminTestJSON-1785428893 Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 27e653d20943429d8c845d3c9a61f7d8 Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersAdminTestJSON-1785428893 Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersAdminTestJSON-1785428893-project Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 6c8ac8ccb50b49719fc1cc9f758b11ba Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersAdminTestJSON-1785428893-project Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 70ce2470-a122-46db-b968-ff9fc15c3166 could not be found. Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '70ce2470-a122-46db-b968-ff9fc15c3166'} Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70ce2470-a122-46db-b968-ff9fc15c3166 could not be found. Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70ce2470-a122-46db-b968-ff9fc15c3166 could not be found. Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:30.310116 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:30.313957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:30.313957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:30.313957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:30.313957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:30.313957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:30.313957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70ce2470-a122-46db-b968-ff9fc15c3166 could not be found. Aug 09 14:39:30.313957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:30.315992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99fd749a-ef92-41d7-9155-24b1885bce0c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Returning 404 to user: Instance 70ce2470-a122-46db-b968-ff9fc15c3166 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:30.317008 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-99fd749a-ef92-41d7-9155-24b1885bce0c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166" status: 404 len: 111 microversion: 2.1 time: 0.049204 Aug 09 14:39:30.318247 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1124/2294] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:30 2022] GET /compute/v2.1/servers/70ce2470-a122-46db-b968-ff9fc15c3166 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:30.323895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f2c8489-95ca-427c-bc29-343004cdb1db tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:30.324745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f2c8489-95ca-427c-bc29-343004cdb1db tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:30.419737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-49b4b712-5cca-453f-a68b-70c804df66e9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:30.435877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-49b4b712-5cca-453f-a68b-70c804df66e9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:30.443254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-49b4b712-5cca-453f-a68b-70c804df66e9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:30.449716 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49b4b712-5cca-453f-a68b-70c804df66e9 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.299323 Aug 09 14:39:30.450691 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1171/2295] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:30 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:30.480874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6741c711-7a70-4b6d-afa7-0defdefc9e7c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:30.483365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6741c711-7a70-4b6d-afa7-0defdefc9e7c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:30.500469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6741c711-7a70-4b6d-afa7-0defdefc9e7c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.501380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6741c711-7a70-4b6d-afa7-0defdefc9e7c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.502357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6741c711-7a70-4b6d-afa7-0defdefc9e7c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.503324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6741c711-7a70-4b6d-afa7-0defdefc9e7c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.503892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6741c711-7a70-4b6d-afa7-0defdefc9e7c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.504657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6741c711-7a70-4b6d-afa7-0defdefc9e7c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.563680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6741c711-7a70-4b6d-afa7-0defdefc9e7c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:39:30.595776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f2c8489-95ca-427c-bc29-343004cdb1db tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:30.608421 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f2c8489-95ca-427c-bc29-343004cdb1db tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1218 microversion: 2.1 time: 0.288802 Aug 09 14:39:30.619770 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1125/2296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:30 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1218 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:30.695817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-738117de-3ba7-4b40-a364-4344b1bd9b98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:30.697501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-738117de-3ba7-4b40-a364-4344b1bd9b98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:30.709843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-738117de-3ba7-4b40-a364-4344b1bd9b98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.712623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-738117de-3ba7-4b40-a364-4344b1bd9b98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.713507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-738117de-3ba7-4b40-a364-4344b1bd9b98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.714587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-738117de-3ba7-4b40-a364-4344b1bd9b98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.717644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-738117de-3ba7-4b40-a364-4344b1bd9b98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.718311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-738117de-3ba7-4b40-a364-4344b1bd9b98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.736577 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6741c711-7a70-4b6d-afa7-0defdefc9e7c tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 204 len: 0 microversion: 2.1 time: 0.270372 Aug 09 14:39:30.737674 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1172/2297] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:39:30 2022] DELETE /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:39:30.745989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9640a5ab-e953-4b3b-9189-3ab593fdc6bc tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:30.748208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9640a5ab-e953-4b3b-9189-3ab593fdc6bc tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:30.756694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9640a5ab-e953-4b3b-9189-3ab593fdc6bc tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.757165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9640a5ab-e953-4b3b-9189-3ab593fdc6bc tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.757591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9640a5ab-e953-4b3b-9189-3ab593fdc6bc tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:30.758280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9640a5ab-e953-4b3b-9189-3ab593fdc6bc tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:30.760190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9640a5ab-e953-4b3b-9189-3ab593fdc6bc tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:30.768677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9640a5ab-e953-4b3b-9189-3ab593fdc6bc tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:31.195527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-738117de-3ba7-4b40-a364-4344b1bd9b98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:31.206108 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-738117de-3ba7-4b40-a364-4344b1bd9b98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1292 microversion: 2.1 time: 0.515645 Aug 09 14:39:31.220710 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1126/2298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:30 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1292 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:39:31.227818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-22f8a3eb-5e03-4e3a-a6f9-a578ec8f778a req-a869780c-e303-4dfe-8e45-cfaf0cf8d0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d64f29-b786-4bf3-88ba-02cf6e5f932d", "tag": "9e00268d-9ded-4c06-baf8-124ec50e8424"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:31.242885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-22f8a3eb-5e03-4e3a-a6f9-a578ec8f778a req-a869780c-e303-4dfe-8e45-cfaf0cf8d0ad service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:31.244075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-22f8a3eb-5e03-4e3a-a6f9-a578ec8f778a req-a869780c-e303-4dfe-8e45-cfaf0cf8d0ad service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:31.244727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-22f8a3eb-5e03-4e3a-a6f9-a578ec8f778a req-a869780c-e303-4dfe-8e45-cfaf0cf8d0ad service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:31.259692 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-22f8a3eb-5e03-4e3a-a6f9-a578ec8f778a req-a869780c-e303-4dfe-8e45-cfaf0cf8d0ad service nova] Creating event network-changed:9e00268d-9ded-4c06-baf8-124ec50e8424 for instance 71d64f29-b786-4bf3-88ba-02cf6e5f932d on n-h2-844626-8 Aug 09 14:39:31.267376 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-22f8a3eb-5e03-4e3a-a6f9-a578ec8f778a req-a869780c-e303-4dfe-8e45-cfaf0cf8d0ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044379 Aug 09 14:39:31.269337 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1127/2299] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:31.276398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34fa2cf4-f217-48df-8818-3a6aae2d17fd tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:31.277983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34fa2cf4-f217-48df-8818-3a6aae2d17fd tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:31.287355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34fa2cf4-f217-48df-8818-3a6aae2d17fd tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:31.288037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34fa2cf4-f217-48df-8818-3a6aae2d17fd tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:31.288637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34fa2cf4-f217-48df-8818-3a6aae2d17fd tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:31.289489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34fa2cf4-f217-48df-8818-3a6aae2d17fd tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:31.290084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34fa2cf4-f217-48df-8818-3a6aae2d17fd tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:31.290648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34fa2cf4-f217-48df-8818-3a6aae2d17fd tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:31.314286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9640a5ab-e953-4b3b-9189-3ab593fdc6bc tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:31.327854 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9640a5ab-e953-4b3b-9189-3ab593fdc6bc tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1469 microversion: 2.1 time: 0.585805 Aug 09 14:39:31.328791 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1173/2300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:30 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1469 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:31.479122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e6108fd8-5068-47bb-994e-45f2f8aafeb7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:31.479736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e6108fd8-5068-47bb-994e-45f2f8aafeb7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:31.488905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6108fd8-5068-47bb-994e-45f2f8aafeb7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:31.489401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6108fd8-5068-47bb-994e-45f2f8aafeb7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:31.489834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6108fd8-5068-47bb-994e-45f2f8aafeb7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:31.490549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6108fd8-5068-47bb-994e-45f2f8aafeb7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:31.490991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6108fd8-5068-47bb-994e-45f2f8aafeb7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:31.491446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6108fd8-5068-47bb-994e-45f2f8aafeb7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:31.653060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e6108fd8-5068-47bb-994e-45f2f8aafeb7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:31.668325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e6108fd8-5068-47bb-994e-45f2f8aafeb7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:31.672198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e6108fd8-5068-47bb-994e-45f2f8aafeb7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:31.676892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:31.681671 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e6108fd8-5068-47bb-994e-45f2f8aafeb7 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.206254 Aug 09 14:39:31.683247 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1174/2301] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:31 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:31.692378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-15750b14-f4a5-4f62-9e1c-2c9d568ab7a9 req-3aaf7a30-2312-4545-9b53-c8731e782744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c528e1-bc7a-4791-9a0f-de8414ea9077", "name": "network-vif-plugged", "status": "completed", "tag": "056748cf-883c-4a7b-85dd-4283d05e1cbe"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:31.711962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-15750b14-f4a5-4f62-9e1c-2c9d568ab7a9 req-3aaf7a30-2312-4545-9b53-c8731e782744 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:31.713367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-15750b14-f4a5-4f62-9e1c-2c9d568ab7a9 req-3aaf7a30-2312-4545-9b53-c8731e782744 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:31.714285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-15750b14-f4a5-4f62-9e1c-2c9d568ab7a9 req-3aaf7a30-2312-4545-9b53-c8731e782744 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:31.735891 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-15750b14-f4a5-4f62-9e1c-2c9d568ab7a9 req-3aaf7a30-2312-4545-9b53-c8731e782744 service nova] Creating event network-vif-plugged:056748cf-883c-4a7b-85dd-4283d05e1cbe for instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 on n-h2-844626-8 Aug 09 14:39:31.742717 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-15750b14-f4a5-4f62-9e1c-2c9d568ab7a9 req-3aaf7a30-2312-4545-9b53-c8731e782744 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058084 Aug 09 14:39:31.744605 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1175/2302] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:31.750627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aaaa00a5-d6cd-4fb9-ab17-8c345274a8c3 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:31.751703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aaaa00a5-d6cd-4fb9-ab17-8c345274a8c3 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:31.775456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaaa00a5-d6cd-4fb9-ab17-8c345274a8c3 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:31.776171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaaa00a5-d6cd-4fb9-ab17-8c345274a8c3 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:31.776886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaaa00a5-d6cd-4fb9-ab17-8c345274a8c3 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:31.777750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaaa00a5-d6cd-4fb9-ab17-8c345274a8c3 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:31.778340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaaa00a5-d6cd-4fb9-ab17-8c345274a8c3 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:31.778904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaaa00a5-d6cd-4fb9-ab17-8c345274a8c3 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:31.782002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34fa2cf4-f217-48df-8818-3a6aae2d17fd tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:31.817688 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34fa2cf4-f217-48df-8818-3a6aae2d17fd tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1520 microversion: 2.1 time: 0.543990 Aug 09 14:39:31.819497 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1128/2303] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:31 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1520 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:31.921507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aaaa00a5-d6cd-4fb9-ab17-8c345274a8c3 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:31.940887 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aaaa00a5-d6cd-4fb9-ab17-8c345274a8c3 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1222 microversion: 2.1 time: 0.193404 Aug 09 14:39:31.941984 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1176/2304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:31 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1222 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:32.180899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0d42fd16-8d0b-4c3f-a179-76a9bae2914f req-8c4bfd97-eeee-48ef-b13f-4e2870a23866 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca42dbb-ca4a-4f81-ac33-6d850cd01322", "name": "network-vif-deleted", "tag": "9a9dcfd1-2560-4f1f-9b95-a81d267cb98d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:32.192623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0d42fd16-8d0b-4c3f-a179-76a9bae2914f req-8c4bfd97-eeee-48ef-b13f-4e2870a23866 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:32.193426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0d42fd16-8d0b-4c3f-a179-76a9bae2914f req-8c4bfd97-eeee-48ef-b13f-4e2870a23866 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:32.194056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0d42fd16-8d0b-4c3f-a179-76a9bae2914f req-8c4bfd97-eeee-48ef-b13f-4e2870a23866 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:32.208515 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0d42fd16-8d0b-4c3f-a179-76a9bae2914f req-8c4bfd97-eeee-48ef-b13f-4e2870a23866 service nova] Creating event network-vif-deleted:9a9dcfd1-2560-4f1f-9b95-a81d267cb98d for instance 4ca42dbb-ca4a-4f81-ac33-6d850cd01322 on n-h2-844626-8 Aug 09 14:39:32.214962 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0d42fd16-8d0b-4c3f-a179-76a9bae2914f req-8c4bfd97-eeee-48ef-b13f-4e2870a23866 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039101 Aug 09 14:39:32.217944 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1129/2305] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:32.236542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-31baf640-7ebe-43bc-9d9c-e1b464bdf6d6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:32.237402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-31baf640-7ebe-43bc-9d9c-e1b464bdf6d6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:32.254210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31baf640-7ebe-43bc-9d9c-e1b464bdf6d6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:32.255073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31baf640-7ebe-43bc-9d9c-e1b464bdf6d6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:32.255814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31baf640-7ebe-43bc-9d9c-e1b464bdf6d6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:32.256694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31baf640-7ebe-43bc-9d9c-e1b464bdf6d6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:32.257273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31baf640-7ebe-43bc-9d9c-e1b464bdf6d6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:32.257863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31baf640-7ebe-43bc-9d9c-e1b464bdf6d6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:32.354283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1213ed9-7b89-41de-b772-5ca43b1a8158 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:32.355840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1213ed9-7b89-41de-b772-5ca43b1a8158 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:32.368253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1213ed9-7b89-41de-b772-5ca43b1a8158 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:32.369762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1213ed9-7b89-41de-b772-5ca43b1a8158 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:32.370354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1213ed9-7b89-41de-b772-5ca43b1a8158 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:32.373307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1213ed9-7b89-41de-b772-5ca43b1a8158 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:32.374034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1213ed9-7b89-41de-b772-5ca43b1a8158 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:32.375628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1213ed9-7b89-41de-b772-5ca43b1a8158 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:32.845344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:33.066734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-31baf640-7ebe-43bc-9d9c-e1b464bdf6d6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:33.079528 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-31baf640-7ebe-43bc-9d9c-e1b464bdf6d6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1292 microversion: 2.1 time: 0.852248 Aug 09 14:39:33.080730 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1177/2306] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:32 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1292 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:33.098065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d3dcda08-4c68-41cc-81c4-938dd3e2da5d tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:33.100296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d3dcda08-4c68-41cc-81c4-938dd3e2da5d tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:33.108323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3dcda08-4c68-41cc-81c4-938dd3e2da5d tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:33.109268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3dcda08-4c68-41cc-81c4-938dd3e2da5d tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:33.109933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3dcda08-4c68-41cc-81c4-938dd3e2da5d tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:33.111107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3dcda08-4c68-41cc-81c4-938dd3e2da5d tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:33.111763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3dcda08-4c68-41cc-81c4-938dd3e2da5d tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:33.112405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3dcda08-4c68-41cc-81c4-938dd3e2da5d tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:33.254044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3dcda08-4c68-41cc-81c4-938dd3e2da5d tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:33.259629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e1213ed9-7b89-41de-b772-5ca43b1a8158 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:33.271621 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1213ed9-7b89-41de-b772-5ca43b1a8158 tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1469 microversion: 2.1 time: 0.922661 Aug 09 14:39:33.274462 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1130/2307] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:32 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1469 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:33.282299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-38f8f361-4d9c-43ea-bc2d-b89fcad8f56c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:33.282907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-38f8f361-4d9c-43ea-bc2d-b89fcad8f56c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:33.304975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38f8f361-4d9c-43ea-bc2d-b89fcad8f56c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:33.305601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38f8f361-4d9c-43ea-bc2d-b89fcad8f56c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:33.306048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38f8f361-4d9c-43ea-bc2d-b89fcad8f56c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:33.306793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38f8f361-4d9c-43ea-bc2d-b89fcad8f56c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:33.307315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38f8f361-4d9c-43ea-bc2d-b89fcad8f56c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:33.307835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38f8f361-4d9c-43ea-bc2d-b89fcad8f56c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:33.335031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3dcda08-4c68-41cc-81c4-938dd3e2da5d tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:33.344095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3dcda08-4c68-41cc-81c4-938dd3e2da5d tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:33.348787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:33.355015 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d3dcda08-4c68-41cc-81c4-938dd3e2da5d tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.272927 Aug 09 14:39:33.359704 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1178/2308] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:33 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:33.368900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a06eb10-fbac-4774-aab2-0f35768bc7a8 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:33.370561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a06eb10-fbac-4774-aab2-0f35768bc7a8 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:33.377344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a06eb10-fbac-4774-aab2-0f35768bc7a8 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:33.378705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a06eb10-fbac-4774-aab2-0f35768bc7a8 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:33.379321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a06eb10-fbac-4774-aab2-0f35768bc7a8 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:33.380419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a06eb10-fbac-4774-aab2-0f35768bc7a8 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:33.381145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a06eb10-fbac-4774-aab2-0f35768bc7a8 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:33.382005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a06eb10-fbac-4774-aab2-0f35768bc7a8 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:33.554050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a06eb10-fbac-4774-aab2-0f35768bc7a8 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:33.566288 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a06eb10-fbac-4774-aab2-0f35768bc7a8 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1276 microversion: 2.1 time: 0.204066 Aug 09 14:39:33.567044 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1179/2309] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:33 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1276 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:33.688560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-38f8f361-4d9c-43ea-bc2d-b89fcad8f56c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:33.701486 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-38f8f361-4d9c-43ea-bc2d-b89fcad8f56c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1520 microversion: 2.1 time: 0.425880 Aug 09 14:39:33.702090 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1131/2310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:33 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1520 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:34.046608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5d7465c2-d337-4805-bfe3-e7ea67558d66 req-a01544af-2262-4921-85ba-e4330b9ac72c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce57f31b-ee4d-4e34-9f08-5de27e71d393", "name": "network-vif-deleted", "tag": "e1d8480a-75cc-470c-9389-4486ebc228d7"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:34.067589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5d7465c2-d337-4805-bfe3-e7ea67558d66 req-a01544af-2262-4921-85ba-e4330b9ac72c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:34.068746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5d7465c2-d337-4805-bfe3-e7ea67558d66 req-a01544af-2262-4921-85ba-e4330b9ac72c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:34.069303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5d7465c2-d337-4805-bfe3-e7ea67558d66 req-a01544af-2262-4921-85ba-e4330b9ac72c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:34.095326 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5d7465c2-d337-4805-bfe3-e7ea67558d66 req-a01544af-2262-4921-85ba-e4330b9ac72c service nova] Creating event network-vif-deleted:e1d8480a-75cc-470c-9389-4486ebc228d7 for instance ce57f31b-ee4d-4e34-9f08-5de27e71d393 on n-h1-844626-8 Aug 09 14:39:34.102083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f580def-d36f-4ee5-82f4-1b4e5c7631ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:34.102761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f580def-d36f-4ee5-82f4-1b4e5c7631ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:34.104611 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5d7465c2-d337-4805-bfe3-e7ea67558d66 req-a01544af-2262-4921-85ba-e4330b9ac72c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061921 Aug 09 14:39:34.105378 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1180/2311] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:34.120649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f580def-d36f-4ee5-82f4-1b4e5c7631ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:34.121485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f580def-d36f-4ee5-82f4-1b4e5c7631ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:34.122167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f580def-d36f-4ee5-82f4-1b4e5c7631ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:34.125502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f580def-d36f-4ee5-82f4-1b4e5c7631ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:34.126188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f580def-d36f-4ee5-82f4-1b4e5c7631ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:34.126645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f580def-d36f-4ee5-82f4-1b4e5c7631ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:34.300482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:34.301572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:34.331876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:34.332655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:34.333252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:34.334061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:34.334668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:34.335346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:34.430829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:34.431613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:34.432267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:34.432875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lazy-loading 'fault' on Instance uuid ce57f31b-ee4d-4e34-9f08-5de27e71d393 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:34.559377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8ac8ccb50b49719fc1cc9f758b11ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27e653d20943429d8c845d3c9a61f7d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:34.572968 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ec65ee71-b7cc-4c57-87b2-3bf96aa934ce tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 200 len: 1303 microversion: 2.1 time: 0.283468 Aug 09 14:39:34.575989 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1181/2312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:34 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 1303 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:39:34.588308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05324ba9-95f6-48a0-a0af-7bde3b9183f1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:34.599625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05324ba9-95f6-48a0-a0af-7bde3b9183f1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:34.615177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05324ba9-95f6-48a0-a0af-7bde3b9183f1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:34.617036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05324ba9-95f6-48a0-a0af-7bde3b9183f1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:34.619594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05324ba9-95f6-48a0-a0af-7bde3b9183f1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:34.621570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05324ba9-95f6-48a0-a0af-7bde3b9183f1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:34.622730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05324ba9-95f6-48a0-a0af-7bde3b9183f1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:34.623545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05324ba9-95f6-48a0-a0af-7bde3b9183f1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:34.666503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0f580def-d36f-4ee5-82f4-1b4e5c7631ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:34.684318 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f580def-d36f-4ee5-82f4-1b4e5c7631ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1292 microversion: 2.1 time: 0.587167 Aug 09 14:39:34.686726 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1132/2313] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:34 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1292 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:34.700989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e2ab605-83f3-44ba-860f-18249d8f6e5f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:34.701093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e2ab605-83f3-44ba-860f-18249d8f6e5f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:34.713834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e2ab605-83f3-44ba-860f-18249d8f6e5f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:34.716129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e2ab605-83f3-44ba-860f-18249d8f6e5f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:34.717619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e2ab605-83f3-44ba-860f-18249d8f6e5f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:34.719514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e2ab605-83f3-44ba-860f-18249d8f6e5f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:34.722440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e2ab605-83f3-44ba-860f-18249d8f6e5f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:34.723271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e2ab605-83f3-44ba-860f-18249d8f6e5f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:34.769868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05324ba9-95f6-48a0-a0af-7bde3b9183f1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:34.780147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05324ba9-95f6-48a0-a0af-7bde3b9183f1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:34.790177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05324ba9-95f6-48a0-a0af-7bde3b9183f1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:34.802918 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05324ba9-95f6-48a0-a0af-7bde3b9183f1 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.223859 Aug 09 14:39:34.815647 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1182/2314] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:34 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:34.829773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f3974db-d2b9-4e33-8b09-dcc600b95394 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:34.830542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f3974db-d2b9-4e33-8b09-dcc600b95394 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:34.844660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f3974db-d2b9-4e33-8b09-dcc600b95394 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:34.846711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f3974db-d2b9-4e33-8b09-dcc600b95394 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:34.853820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f3974db-d2b9-4e33-8b09-dcc600b95394 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:34.855011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f3974db-d2b9-4e33-8b09-dcc600b95394 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:34.857682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f3974db-d2b9-4e33-8b09-dcc600b95394 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:34.858990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f3974db-d2b9-4e33-8b09-dcc600b95394 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:34.904986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1e2ab605-83f3-44ba-860f-18249d8f6e5f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:34.925979 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e2ab605-83f3-44ba-860f-18249d8f6e5f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1276 microversion: 2.1 time: 0.234514 Aug 09 14:39:34.927307 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1133/2315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:34 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1276 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:35.223274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6f3974db-d2b9-4e33-8b09-dcc600b95394 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:35.243603 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f3974db-d2b9-4e33-8b09-dcc600b95394 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1505 microversion: 2.1 time: 0.425338 Aug 09 14:39:35.259459 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1183/2316] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:34 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:35.265501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cd8ddf88-8ef6-4e2a-8b2c-7c0b7874f0da tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:35.268052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cd8ddf88-8ef6-4e2a-8b2c-7c0b7874f0da tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:35.284327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd8ddf88-8ef6-4e2a-8b2c-7c0b7874f0da tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:35.285259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd8ddf88-8ef6-4e2a-8b2c-7c0b7874f0da tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:35.287241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd8ddf88-8ef6-4e2a-8b2c-7c0b7874f0da tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:35.288958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd8ddf88-8ef6-4e2a-8b2c-7c0b7874f0da tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:35.290255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd8ddf88-8ef6-4e2a-8b2c-7c0b7874f0da tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:35.294497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd8ddf88-8ef6-4e2a-8b2c-7c0b7874f0da tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:35.578164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cd8ddf88-8ef6-4e2a-8b2c-7c0b7874f0da tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:35.593186 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cd8ddf88-8ef6-4e2a-8b2c-7c0b7874f0da tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 200 len: 1505 microversion: 2.1 time: 0.329315 Aug 09 14:39:35.597405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df8ffdc0-8ad5-40ec-9ca1-e6d667dad57f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:35.598378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df8ffdc0-8ad5-40ec-9ca1-e6d667dad57f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] [instance: ce57f31b-ee4d-4e34-9f08-5de27e71d393] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:35.612270 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1134/2317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:35 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:39:35.613843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df8ffdc0-8ad5-40ec-9ca1-e6d667dad57f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:35.614570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df8ffdc0-8ad5-40ec-9ca1-e6d667dad57f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:35.615380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df8ffdc0-8ad5-40ec-9ca1-e6d667dad57f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:35.616345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df8ffdc0-8ad5-40ec-9ca1-e6d667dad57f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:35.617050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df8ffdc0-8ad5-40ec-9ca1-e6d667dad57f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:35.617938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df8ffdc0-8ad5-40ec-9ca1-e6d667dad57f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:35.624848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43918fd9-57a9-49c9-b6a0-2d97d8c3a619 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:35.628679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-43918fd9-57a9-49c9-b6a0-2d97d8c3a619 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:35.644768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43918fd9-57a9-49c9-b6a0-2d97d8c3a619 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:35.647453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43918fd9-57a9-49c9-b6a0-2d97d8c3a619 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:35.648066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43918fd9-57a9-49c9-b6a0-2d97d8c3a619 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:35.650369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43918fd9-57a9-49c9-b6a0-2d97d8c3a619 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:35.651069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43918fd9-57a9-49c9-b6a0-2d97d8c3a619 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:35.654238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43918fd9-57a9-49c9-b6a0-2d97d8c3a619 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:35.661791 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-df8ffdc0-8ad5-40ec-9ca1-e6d667dad57f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] HTTP exception thrown: Instance ce57f31b-ee4d-4e34-9f08-5de27e71d393 could not be found. Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df8ffdc0-8ad5-40ec-9ca1-e6d667dad57f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Request method failure captured: Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 HTTP/1.1 Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nD-wlutR1zkYM_kfXhTGafVpddHKoV6Y4ofnIWB1Eu8eMfBkEQVQlAmPBTHthIKDlJN_C6Px2WiHNj1ngNhf8I_P4foFBhteCs1aVwla4GyBUNqomEjoFzorK5AwKn_GFJ67aZEkDxRry9-U1DggUAyAca9RKbrkLfu9ekTpOxTMKQ Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 27e653d20943429d8c845d3c9a61f7d8 Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersAdminTestJSON-1785428893 Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_27e653d20943429d8c845d3c9a61f7d8", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/27e653d20943429d8c845d3c9a61f7d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/27e653d20943429d8c845d3c9a61f7d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/27e653d20943429d8c845d3c9a61f7d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersAdminTestJSON-1785428893 Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 27e653d20943429d8c845d3c9a61f7d8 Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersAdminTestJSON-1785428893 Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersAdminTestJSON-1785428893-project Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 6c8ac8ccb50b49719fc1cc9f758b11ba Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersAdminTestJSON-1785428893-project Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance ce57f31b-ee4d-4e34-9f08-5de27e71d393 could not be found. Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'ce57f31b-ee4d-4e34-9f08-5de27e71d393'} Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce57f31b-ee4d-4e34-9f08-5de27e71d393 could not be found. Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce57f31b-ee4d-4e34-9f08-5de27e71d393 could not be found. Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:35.663673 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:35.667728 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:35.667728 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:35.667728 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:35.667728 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:35.667728 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:35.667728 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce57f31b-ee4d-4e34-9f08-5de27e71d393 could not be found. Aug 09 14:39:35.667728 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:35.675459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df8ffdc0-8ad5-40ec-9ca1-e6d667dad57f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] Returning 404 to user: Instance ce57f31b-ee4d-4e34-9f08-5de27e71d393 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:35.676763 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df8ffdc0-8ad5-40ec-9ca1-e6d667dad57f tempest-ServersAdminTestJSON-1785428893 tempest-ServersAdminTestJSON-1785428893-project] 10.222.0.50 "GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393" status: 404 len: 111 microversion: 2.1 time: 0.083547 Aug 09 14:39:35.677874 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1184/2318] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:35 2022] GET /compute/v2.1/servers/ce57f31b-ee4d-4e34-9f08-5de27e71d393 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:35.707491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e664373-21a4-4f2d-8790-a7f9d0a9309d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:35.708691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e664373-21a4-4f2d-8790-a7f9d0a9309d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:35.719565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e664373-21a4-4f2d-8790-a7f9d0a9309d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:35.720185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e664373-21a4-4f2d-8790-a7f9d0a9309d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:35.720844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e664373-21a4-4f2d-8790-a7f9d0a9309d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:35.723068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e664373-21a4-4f2d-8790-a7f9d0a9309d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:35.723768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e664373-21a4-4f2d-8790-a7f9d0a9309d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:35.728926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e664373-21a4-4f2d-8790-a7f9d0a9309d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:35.751829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-43918fd9-57a9-49c9-b6a0-2d97d8c3a619 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:39:35.945178 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-43918fd9-57a9-49c9-b6a0-2d97d8c3a619 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "DELETE /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 204 len: 0 microversion: 2.1 time: 0.329612 Aug 09 14:39:35.946278 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1135/2319] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:39:35 2022] DELETE /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:39:35.953974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-45cf5f28-4893-4584-92b3-7b8863e07142 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:35.957454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-45cf5f28-4893-4584-92b3-7b8863e07142 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:35.984053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45cf5f28-4893-4584-92b3-7b8863e07142 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:35.987130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45cf5f28-4893-4584-92b3-7b8863e07142 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:35.987742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45cf5f28-4893-4584-92b3-7b8863e07142 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:35.988973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45cf5f28-4893-4584-92b3-7b8863e07142 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:35.990183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45cf5f28-4893-4584-92b3-7b8863e07142 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:35.991801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45cf5f28-4893-4584-92b3-7b8863e07142 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:36.158297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45cf5f28-4893-4584-92b3-7b8863e07142 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:36.173064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45cf5f28-4893-4584-92b3-7b8863e07142 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:36.174839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45cf5f28-4893-4584-92b3-7b8863e07142 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:36.197319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e664373-21a4-4f2d-8790-a7f9d0a9309d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:36.199617 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-45cf5f28-4893-4584-92b3-7b8863e07142 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.249877 Aug 09 14:39:36.203118 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1136/2320] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:35 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:36.203750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:36.207825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-75a6673f-2a76-48e7-a2da-d986bc3cc17f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:36.208441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-75a6673f-2a76-48e7-a2da-d986bc3cc17f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:36.214656 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e664373-21a4-4f2d-8790-a7f9d0a9309d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1292 microversion: 2.1 time: 0.511186 Aug 09 14:39:36.224194 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1185/2321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:35 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1292 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:36.236856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1420638401", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "ff403168-deb6-48c7-93ae-a7884ca6bc0e"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:36.241659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75a6673f-2a76-48e7-a2da-d986bc3cc17f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:36.242402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75a6673f-2a76-48e7-a2da-d986bc3cc17f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:36.242859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75a6673f-2a76-48e7-a2da-d986bc3cc17f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:36.243642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75a6673f-2a76-48e7-a2da-d986bc3cc17f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:36.244101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75a6673f-2a76-48e7-a2da-d986bc3cc17f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:36.244576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75a6673f-2a76-48e7-a2da-d986bc3cc17f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:36.360158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] validate_networks() for [('ff403168-deb6-48c7-93ae-a7884ca6bc0e', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:39:36.860328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-75a6673f-2a76-48e7-a2da-d986bc3cc17f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:36.869598 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-75a6673f-2a76-48e7-a2da-d986bc3cc17f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1318 microversion: 2.1 time: 0.665355 Aug 09 14:39:36.874311 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1137/2322] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:36 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1318 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:36.976052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-83011f30-2adb-4644-851d-a1a0790f0cc3 req-81535f5f-7954-4f4b-8fd3-38797719bf26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e70c52-d56b-47f4-887f-6e4001b601c5", "tag": "96341057-cb2c-4da2-a045-05585ffe1eeb"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:37.000370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-83011f30-2adb-4644-851d-a1a0790f0cc3 req-81535f5f-7954-4f4b-8fd3-38797719bf26 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:37.000679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-83011f30-2adb-4644-851d-a1a0790f0cc3 req-81535f5f-7954-4f4b-8fd3-38797719bf26 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:37.001454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-83011f30-2adb-4644-851d-a1a0790f0cc3 req-81535f5f-7954-4f4b-8fd3-38797719bf26 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:37.030006 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-83011f30-2adb-4644-851d-a1a0790f0cc3 req-81535f5f-7954-4f4b-8fd3-38797719bf26 service nova] Creating event network-changed:96341057-cb2c-4da2-a045-05585ffe1eeb for instance e5e70c52-d56b-47f4-887f-6e4001b601c5 on n-h1-844626-8 Aug 09 14:39:37.040302 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-83011f30-2adb-4644-851d-a1a0790f0cc3 req-81535f5f-7954-4f4b-8fd3-38797719bf26 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068186 Aug 09 14:39:37.040939 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1138/2323] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:39:37.225448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34f87d0e-061a-4ab9-b34f-d4390f05e953 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:37.226153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34f87d0e-061a-4ab9-b34f-d4390f05e953 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:37.232613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34f87d0e-061a-4ab9-b34f-d4390f05e953 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:37.233100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34f87d0e-061a-4ab9-b34f-d4390f05e953 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:37.233534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34f87d0e-061a-4ab9-b34f-d4390f05e953 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:37.234425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34f87d0e-061a-4ab9-b34f-d4390f05e953 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:37.234880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34f87d0e-061a-4ab9-b34f-d4390f05e953 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:37.235325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34f87d0e-061a-4ab9-b34f-d4390f05e953 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:37.435654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34f87d0e-061a-4ab9-b34f-d4390f05e953 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:37.446125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34f87d0e-061a-4ab9-b34f-d4390f05e953 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:37.447947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34f87d0e-061a-4ab9-b34f-d4390f05e953 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:37.450277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:37.457982 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34f87d0e-061a-4ab9-b34f-d4390f05e953 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.236793 Aug 09 14:39:37.462055 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1139/2324] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:37 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:39:37.488621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9062504b-837d-4a15-b780-69430f88701e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:37.489237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9062504b-837d-4a15-b780-69430f88701e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:37.500408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9062504b-837d-4a15-b780-69430f88701e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:37.501404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9062504b-837d-4a15-b780-69430f88701e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:37.502079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9062504b-837d-4a15-b780-69430f88701e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:37.503436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9062504b-837d-4a15-b780-69430f88701e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:37.503980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9062504b-837d-4a15-b780-69430f88701e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:37.504381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9062504b-837d-4a15-b780-69430f88701e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:37.921432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9062504b-837d-4a15-b780-69430f88701e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:37.934205 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9062504b-837d-4a15-b780-69430f88701e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1292 microversion: 2.1 time: 0.469987 Aug 09 14:39:37.939151 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1140/2325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:37 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1292 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:37.961549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-26689bdb-6ec5-46f7-b934-daea543f58ae req-e87f3f6e-47ef-4267-94e6-15737e361642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d64f29-b786-4bf3-88ba-02cf6e5f932d", "name": "network-vif-plugged", "status": "completed", "tag": "9e00268d-9ded-4c06-baf8-124ec50e8424"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:37.998325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-26689bdb-6ec5-46f7-b934-daea543f58ae req-e87f3f6e-47ef-4267-94e6-15737e361642 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:38.000351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-26689bdb-6ec5-46f7-b934-daea543f58ae req-e87f3f6e-47ef-4267-94e6-15737e361642 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:38.000951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-26689bdb-6ec5-46f7-b934-daea543f58ae req-e87f3f6e-47ef-4267-94e6-15737e361642 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:38.033890 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-26689bdb-6ec5-46f7-b934-daea543f58ae req-e87f3f6e-47ef-4267-94e6-15737e361642 service nova] Creating event network-vif-plugged:9e00268d-9ded-4c06-baf8-124ec50e8424 for instance 71d64f29-b786-4bf3-88ba-02cf6e5f932d on n-h2-844626-8 Aug 09 14:39:38.071604 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-26689bdb-6ec5-46f7-b934-daea543f58ae req-e87f3f6e-47ef-4267-94e6-15737e361642 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125869 Aug 09 14:39:38.072291 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1141/2326] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:38.132477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0093dcb-e581-49db-b43d-d73f1c0de755 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:38.149416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0093dcb-e581-49db-b43d-d73f1c0de755 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:38.183626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0093dcb-e581-49db-b43d-d73f1c0de755 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:38.184005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0093dcb-e581-49db-b43d-d73f1c0de755 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:38.186804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0093dcb-e581-49db-b43d-d73f1c0de755 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:38.187657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0093dcb-e581-49db-b43d-d73f1c0de755 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:38.188131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0093dcb-e581-49db-b43d-d73f1c0de755 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:38.191436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0093dcb-e581-49db-b43d-d73f1c0de755 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:38.341548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:39:38.342109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:39:38.343019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:39:38.343652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:39:38.344510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:39:38.362626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:38.364350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:38.365090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:38.366343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:38.367227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:38.367988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:38.401754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Getting quotas for project a61c381646364214a62210a2d8672314. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:39:38.426888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Getting quotas for user 74c10f0e3a40477f86dfd6cdd03fe0f6 and project a61c381646364214a62210a2d8672314. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:39:38.456710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:39:38.461520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:39:38.597330 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1a80dfd6-d5d7-4a6c-a5b6-6bc3a311c025 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.371104 Aug 09 14:39:38.599882 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1186/2327] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:39:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:39:38.614342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48889186-c728-44a1-80aa-1312d3397729 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:38.615696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48889186-c728-44a1-80aa-1312d3397729 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:38.650296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48889186-c728-44a1-80aa-1312d3397729 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:38.655893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48889186-c728-44a1-80aa-1312d3397729 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:38.656988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48889186-c728-44a1-80aa-1312d3397729 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:38.658109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48889186-c728-44a1-80aa-1312d3397729 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:38.662545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48889186-c728-44a1-80aa-1312d3397729 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:38.663202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48889186-c728-44a1-80aa-1312d3397729 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:38.789516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0093dcb-e581-49db-b43d-d73f1c0de755 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:38.798708 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0093dcb-e581-49db-b43d-d73f1c0de755 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1318 microversion: 2.1 time: 0.687196 Aug 09 14:39:38.804297 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1142/2328] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:38 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1318 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:38.816596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2272a06-1afe-45d5-822b-97f5f933a47c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:38.817255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c2272a06-1afe-45d5-822b-97f5f933a47c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:38.842674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48889186-c728-44a1-80aa-1312d3397729 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:38.857835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48889186-c728-44a1-80aa-1312d3397729 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:38.863812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48889186-c728-44a1-80aa-1312d3397729 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:38.873941 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48889186-c728-44a1-80aa-1312d3397729 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1447 microversion: 2.75 time: 0.271966 Aug 09 14:39:38.889034 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1187/2329] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:38 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1447 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:38.913791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c2272a06-1afe-45d5-822b-97f5f933a47c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:38.933034 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2272a06-1afe-45d5-822b-97f5f933a47c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1218 microversion: 2.1 time: 0.127090 Aug 09 14:39:38.935829 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1143/2330] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:38 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:38.961809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dbb75539-35ee-4cac-b729-196347c41dff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:38.962732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dbb75539-35ee-4cac-b729-196347c41dff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:38.972633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbb75539-35ee-4cac-b729-196347c41dff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:38.974142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbb75539-35ee-4cac-b729-196347c41dff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:38.974787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbb75539-35ee-4cac-b729-196347c41dff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:38.977157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbb75539-35ee-4cac-b729-196347c41dff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:38.977856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbb75539-35ee-4cac-b729-196347c41dff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:38.978678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbb75539-35ee-4cac-b729-196347c41dff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:39.230203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dbb75539-35ee-4cac-b729-196347c41dff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:39.239807 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dbb75539-35ee-4cac-b729-196347c41dff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1292 microversion: 2.1 time: 0.283134 Aug 09 14:39:39.247145 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1188/2331] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:38 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1292 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:39.372711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8f7aed13-d50f-4ee6-8db7-84fad5599bda req-49baf7c6-6e96-4200-b141-3516641fcd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74c528e1-bc7a-4791-9a0f-de8414ea9077", "name": "network-vif-deleted", "tag": "056748cf-883c-4a7b-85dd-4283d05e1cbe"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:39.393877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8f7aed13-d50f-4ee6-8db7-84fad5599bda req-49baf7c6-6e96-4200-b141-3516641fcd56 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:39.395290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8f7aed13-d50f-4ee6-8db7-84fad5599bda req-49baf7c6-6e96-4200-b141-3516641fcd56 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:39.395925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8f7aed13-d50f-4ee6-8db7-84fad5599bda req-49baf7c6-6e96-4200-b141-3516641fcd56 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:39.409553 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8f7aed13-d50f-4ee6-8db7-84fad5599bda req-49baf7c6-6e96-4200-b141-3516641fcd56 service nova] Creating event network-vif-deleted:056748cf-883c-4a7b-85dd-4283d05e1cbe for instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 on n-h2-844626-8 Aug 09 14:39:39.416699 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8f7aed13-d50f-4ee6-8db7-84fad5599bda req-49baf7c6-6e96-4200-b141-3516641fcd56 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048197 Aug 09 14:39:39.417883 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1144/2332] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:39.730906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2ddf815-9e86-4e61-a767-4b71914c11f5 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Action: 'create', calling method: .version_select at 0x7f41e751d790>, body: {"pool": null} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:39.824906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-256dca53-8eb1-4af4-8a13-9064ec4b7a0d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:39.826016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-256dca53-8eb1-4af4-8a13-9064ec4b7a0d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:39.840483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-256dca53-8eb1-4af4-8a13-9064ec4b7a0d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:39.843652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-256dca53-8eb1-4af4-8a13-9064ec4b7a0d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:39.844996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-256dca53-8eb1-4af4-8a13-9064ec4b7a0d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:39.847629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-256dca53-8eb1-4af4-8a13-9064ec4b7a0d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:39.848471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-256dca53-8eb1-4af4-8a13-9064ec4b7a0d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:39.850758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-256dca53-8eb1-4af4-8a13-9064ec4b7a0d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:40.272749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-256dca53-8eb1-4af4-8a13-9064ec4b7a0d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:40.286165 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-256dca53-8eb1-4af4-8a13-9064ec4b7a0d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1318 microversion: 2.1 time: 0.465295 Aug 09 14:39:40.290047 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1145/2333] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:39 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:40.303834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07d8682d-8132-4f5b-a8c8-2e4e41c5d06f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:40.307991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07d8682d-8132-4f5b-a8c8-2e4e41c5d06f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:40.316077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07d8682d-8132-4f5b-a8c8-2e4e41c5d06f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:40.316651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07d8682d-8132-4f5b-a8c8-2e4e41c5d06f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:40.317188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07d8682d-8132-4f5b-a8c8-2e4e41c5d06f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:40.318029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07d8682d-8132-4f5b-a8c8-2e4e41c5d06f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:40.318552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07d8682d-8132-4f5b-a8c8-2e4e41c5d06f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:40.320599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07d8682d-8132-4f5b-a8c8-2e4e41c5d06f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:40.462947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07d8682d-8132-4f5b-a8c8-2e4e41c5d06f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:40.482875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07d8682d-8132-4f5b-a8c8-2e4e41c5d06f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:40.488842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07d8682d-8132-4f5b-a8c8-2e4e41c5d06f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:40.515953 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07d8682d-8132-4f5b-a8c8-2e4e41c5d06f tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1453 microversion: 2.75 time: 0.223948 Aug 09 14:39:40.525607 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1146/2334] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:40 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1453 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:40.532281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-044cf270-8f02-4210-9541-d906d19a9e10 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:40.533165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-044cf270-8f02-4210-9541-d906d19a9e10 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:40.560507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-044cf270-8f02-4210-9541-d906d19a9e10 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:40.561890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-044cf270-8f02-4210-9541-d906d19a9e10 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:40.562534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-044cf270-8f02-4210-9541-d906d19a9e10 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:40.563529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-044cf270-8f02-4210-9541-d906d19a9e10 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:40.568084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-044cf270-8f02-4210-9541-d906d19a9e10 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:40.568958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-044cf270-8f02-4210-9541-d906d19a9e10 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:40.739291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-044cf270-8f02-4210-9541-d906d19a9e10 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:40.751813 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-044cf270-8f02-4210-9541-d906d19a9e10 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1278 microversion: 2.1 time: 0.222996 Aug 09 14:39:40.752895 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1147/2335] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:40 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1278 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:40.780224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6cd816ed-6556-4318-8974-ce5698d5dce4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:40.780955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6cd816ed-6556-4318-8974-ce5698d5dce4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:40.806635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cd816ed-6556-4318-8974-ce5698d5dce4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:40.807349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cd816ed-6556-4318-8974-ce5698d5dce4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:40.807794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cd816ed-6556-4318-8974-ce5698d5dce4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:40.808514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cd816ed-6556-4318-8974-ce5698d5dce4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:40.808965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cd816ed-6556-4318-8974-ce5698d5dce4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:40.809382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6cd816ed-6556-4318-8974-ce5698d5dce4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:41.296094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6cd816ed-6556-4318-8974-ce5698d5dce4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:41.306255 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6cd816ed-6556-4318-8974-ce5698d5dce4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1471 microversion: 2.1 time: 0.551528 Aug 09 14:39:41.306890 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1148/2336] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:40 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1471 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:41.329708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b53d8045-0194-4fa1-9cb7-946bd457d48d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:41.330309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b53d8045-0194-4fa1-9cb7-946bd457d48d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:41.350656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b53d8045-0194-4fa1-9cb7-946bd457d48d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:41.355507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b53d8045-0194-4fa1-9cb7-946bd457d48d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:41.359690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b53d8045-0194-4fa1-9cb7-946bd457d48d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:41.360459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b53d8045-0194-4fa1-9cb7-946bd457d48d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:41.360925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b53d8045-0194-4fa1-9cb7-946bd457d48d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:41.361348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b53d8045-0194-4fa1-9cb7-946bd457d48d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:41.412981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:41.777021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b53d8045-0194-4fa1-9cb7-946bd457d48d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:41.788476 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b53d8045-0194-4fa1-9cb7-946bd457d48d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1318 microversion: 2.1 time: 0.471856 Aug 09 14:39:41.792035 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1149/2337] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:41 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:41.808605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-245892558", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:41.952757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] validate_networks() for [('7d4b5e6e-1097-46ba-bb21-ff9e1560d087', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:39:43.412495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:39:43.414282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:39:43.415418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:39:43.416504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:39:43.417428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:39:43.441725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:43.442505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:43.443159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:43.446419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:43.455747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:43.456929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:43.501643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:39:43.507567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for user 03bdf5ec21854ec8b6561a121ce1f1ef and project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:39:43.524135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:39:43.527010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 14b01446-ea34-46ad-970b-363da106d2e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:39:43.607044 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2a88e3a4-0b9f-4dec-9a17-5c809690a624 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.813547 Aug 09 14:39:43.611736 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1150/2338] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:39:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:39:43.639577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9e05ee4b-bc10-4326-b95d-ea9d7c9a8035 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:43.641054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9e05ee4b-bc10-4326-b95d-ea9d7c9a8035 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:43.664182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e05ee4b-bc10-4326-b95d-ea9d7c9a8035 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:43.665041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e05ee4b-bc10-4326-b95d-ea9d7c9a8035 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:43.666263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e05ee4b-bc10-4326-b95d-ea9d7c9a8035 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:43.667369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e05ee4b-bc10-4326-b95d-ea9d7c9a8035 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:43.668142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e05ee4b-bc10-4326-b95d-ea9d7c9a8035 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:43.669035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9e05ee4b-bc10-4326-b95d-ea9d7c9a8035 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:43.978640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9e05ee4b-bc10-4326-b95d-ea9d7c9a8035 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:43.990301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9e05ee4b-bc10-4326-b95d-ea9d7c9a8035 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:43.991975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9e05ee4b-bc10-4326-b95d-ea9d7c9a8035 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:44.014827 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d2ddf815-9e86-4e61-a767-4b71914c11f5 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.539494 Aug 09 14:39:44.019064 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9e05ee4b-bc10-4326-b95d-ea9d7c9a8035 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1438 microversion: 2.75 time: 0.405759 Aug 09 14:39:44.019918 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1151/2339] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:43 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1438 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:44.022982 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1189/2340] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 9 14:39:39 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:44.026170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8943dd4c-ba0e-400b-a0ca-0bcd31e80557 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:44.028000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8943dd4c-ba0e-400b-a0ca-0bcd31e80557 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:44.065963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8943dd4c-ba0e-400b-a0ca-0bcd31e80557 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:44.066771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8943dd4c-ba0e-400b-a0ca-0bcd31e80557 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:44.069483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8943dd4c-ba0e-400b-a0ca-0bcd31e80557 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:44.072494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8943dd4c-ba0e-400b-a0ca-0bcd31e80557 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:44.073075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8943dd4c-ba0e-400b-a0ca-0bcd31e80557 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:44.073717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8943dd4c-ba0e-400b-a0ca-0bcd31e80557 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:44.297316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91b1ca5c-d5c3-4d6c-9e64-2ae3b202f054 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:44.300756 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:39:44.300756 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:39:44.302216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91b1ca5c-d5c3-4d6c-9e64-2ae3b202f054 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:44.302777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91b1ca5c-d5c3-4d6c-9e64-2ae3b202f054 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:44.303303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91b1ca5c-d5c3-4d6c-9e64-2ae3b202f054 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:44.304194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91b1ca5c-d5c3-4d6c-9e64-2ae3b202f054 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:44.304710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91b1ca5c-d5c3-4d6c-9e64-2ae3b202f054 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:44.305290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91b1ca5c-d5c3-4d6c-9e64-2ae3b202f054 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:44.332765 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91b1ca5c-d5c3-4d6c-9e64-2ae3b202f054 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.305879 Aug 09 14:39:44.333705 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1190/2341] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:39:44 2022] GET /compute/v2.1/os-services => generated 944 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:44.374154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-246e5360-2e47-4f00-a2bf-a8e2e92b8efa tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:44.375008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-246e5360-2e47-4f00-a2bf-a8e2e92b8efa tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:44.389598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-246e5360-2e47-4f00-a2bf-a8e2e92b8efa tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:44.390084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-246e5360-2e47-4f00-a2bf-a8e2e92b8efa tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:44.390755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-246e5360-2e47-4f00-a2bf-a8e2e92b8efa tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:44.392342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-246e5360-2e47-4f00-a2bf-a8e2e92b8efa tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:44.392941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-246e5360-2e47-4f00-a2bf-a8e2e92b8efa tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:44.393511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-246e5360-2e47-4f00-a2bf-a8e2e92b8efa tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:44.422266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8943dd4c-ba0e-400b-a0ca-0bcd31e80557 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:44.439556 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8943dd4c-ba0e-400b-a0ca-0bcd31e80557 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1318 microversion: 2.1 time: 0.418325 Aug 09 14:39:44.440154 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1152/2342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:44 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:44.456874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:44.457644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 14b01446-ea34-46ad-970b-363da106d2e6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:44.474597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:44.475239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:44.475915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:44.476775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:44.477446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:44.478062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:44.510316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 14b01446-ea34-46ad-970b-363da106d2e6] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:39:44.524166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:44.525160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:44.525858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:44.540988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lazy-loading 'flavor' on Instance uuid 14b01446-ea34-46ad-970b-363da106d2e6 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:44.594438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lazy-loading 'system_metadata' on Instance uuid 14b01446-ea34-46ad-970b-363da106d2e6 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:44.699348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lazy-loading 'metadata' on Instance uuid 14b01446-ea34-46ad-970b-363da106d2e6 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:44.773351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-246e5360-2e47-4f00-a2bf-a8e2e92b8efa tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:44.781976 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-246e5360-2e47-4f00-a2bf-a8e2e92b8efa tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1318 microversion: 2.1 time: 0.446911 Aug 09 14:39:44.782727 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1191/2343] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:44 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:44.787798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3dcaa7a1-3de6-487b-94cd-a159df1e432c tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Calling method '.version_select at 0x7f41dd6b3430>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:44.814854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:44.815382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:44.816083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:44.984850 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f9916f63-97de-42ae-87cb-9fcccf67a521 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6" status: 204 len: 0 microversion: 2.1 time: 0.543209 Aug 09 14:39:44.985671 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1153/2344] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:39:44 2022] DELETE /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:39:45.083535 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3dcaa7a1-3de6-487b-94cd-a159df1e432c tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/a6a6404c-a9a7-419d-9220-6043b3c09b86" status: 200 len: 141 microversion: 2.1 time: 0.299379 Aug 09 14:39:45.086095 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1192/2345] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 9 14:39:44 2022] GET /compute/v2.1/os-floating-ips/a6a6404c-a9a7-419d-9220-6043b3c09b86 => generated 141 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:45.090967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4b7fe74d-0f55-4803-af30-4eee68a6af8a tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:45.094763 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:39:45.094763 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:39:45.096436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b7fe74d-0f55-4803-af30-4eee68a6af8a tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.097058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b7fe74d-0f55-4803-af30-4eee68a6af8a tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.097630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b7fe74d-0f55-4803-af30-4eee68a6af8a tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.099189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b7fe74d-0f55-4803-af30-4eee68a6af8a tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.100465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b7fe74d-0f55-4803-af30-4eee68a6af8a tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.101912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b7fe74d-0f55-4803-af30-4eee68a6af8a tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.133552 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4b7fe74d-0f55-4803-af30-4eee68a6af8a tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.046128 Aug 09 14:39:45.143068 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1193/2346] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 9 14:39:45 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:45.148233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ae88ea9e-4931-4907-b479-764fd236b4cc req-136e7fa8-0a93-48e6-8569-e9bd0442eab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e70c52-d56b-47f4-887f-6e4001b601c5", "name": "network-vif-plugged", "status": "completed", "tag": "96341057-cb2c-4da2-a045-05585ffe1eeb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:45.160720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ae88ea9e-4931-4907-b479-764fd236b4cc req-136e7fa8-0a93-48e6-8569-e9bd0442eab7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.161224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ae88ea9e-4931-4907-b479-764fd236b4cc req-136e7fa8-0a93-48e6-8569-e9bd0442eab7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.161649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ae88ea9e-4931-4907-b479-764fd236b4cc req-136e7fa8-0a93-48e6-8569-e9bd0442eab7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.180036 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ae88ea9e-4931-4907-b479-764fd236b4cc req-136e7fa8-0a93-48e6-8569-e9bd0442eab7 service nova] Creating event network-vif-plugged:96341057-cb2c-4da2-a045-05585ffe1eeb for instance e5e70c52-d56b-47f4-887f-6e4001b601c5 on n-h1-844626-8 Aug 09 14:39:45.185999 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ae88ea9e-4931-4907-b479-764fd236b4cc req-136e7fa8-0a93-48e6-8569-e9bd0442eab7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041050 Aug 09 14:39:45.186885 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1194/2347] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:45.193463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-41ed7fd2-5b52-4e83-80f0-9ad72ca82c0e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:45.194497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-41ed7fd2-5b52-4e83-80f0-9ad72ca82c0e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 14b01446-ea34-46ad-970b-363da106d2e6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:45.233237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41ed7fd2-5b52-4e83-80f0-9ad72ca82c0e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.234195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41ed7fd2-5b52-4e83-80f0-9ad72ca82c0e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.234844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41ed7fd2-5b52-4e83-80f0-9ad72ca82c0e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.236174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41ed7fd2-5b52-4e83-80f0-9ad72ca82c0e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.236937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41ed7fd2-5b52-4e83-80f0-9ad72ca82c0e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.237552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41ed7fd2-5b52-4e83-80f0-9ad72ca82c0e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.303647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:45.306702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:45.312260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-41ed7fd2-5b52-4e83-80f0-9ad72ca82c0e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:45.313255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.313734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.314160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.315014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.315624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.316177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.320504 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-41ed7fd2-5b52-4e83-80f0-9ad72ca82c0e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6" status: 200 len: 1210 microversion: 2.1 time: 0.132106 Aug 09 14:39:45.321490 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1195/2348] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:45 2022] GET /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6 => generated 1210 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:45.338454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f31bcd0-d040-44be-9603-b699e837e3af tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Calling method '.version_select at 0x7f41e75089d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:45.408389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:39:45.408919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:39:45.409385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:39:45.409786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:39:45.410187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:39:45.496304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:45.503534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.504245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.504680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.505517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.506088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.506628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.823716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:45.845766 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c497791a-45eb-498c-a9f0-1a5fa20ee161 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3/action" status: 202 len: 1942 microversion: 2.75 time: 0.855440 Aug 09 14:39:45.846974 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1154/2349] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:39:44 2022] POST /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3/action => generated 1942 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 09 14:39:45.848391 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f31bcd0-d040-44be-9603-b699e837e3af tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.520334 Aug 09 14:39:45.849433 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1196/2350] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 9 14:39:45 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:45.861992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-507c19ad-e2ab-4954-b199-590d7b606262 req-81678ec5-3488-44c9-a8cf-78223799a213 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa434a0-4d01-432e-b168-597c787c0d84", "tag": "8b0c7959-2122-4ff5-8cd4-9a1ea690f499"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:45.865039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2f4cd32-d2f8-4932-b292-f00ad275a1b1 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:45.875654 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:39:45.875654 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:39:45.880322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2f4cd32-d2f8-4932-b292-f00ad275a1b1 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.880825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2f4cd32-d2f8-4932-b292-f00ad275a1b1 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.881267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2f4cd32-d2f8-4932-b292-f00ad275a1b1 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.882030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2f4cd32-d2f8-4932-b292-f00ad275a1b1 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.883387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2f4cd32-d2f8-4932-b292-f00ad275a1b1 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.883957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2f4cd32-d2f8-4932-b292-f00ad275a1b1 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.912558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-507c19ad-e2ab-4954-b199-590d7b606262 req-81678ec5-3488-44c9-a8cf-78223799a213 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.913917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-507c19ad-e2ab-4954-b199-590d7b606262 req-81678ec5-3488-44c9-a8cf-78223799a213 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.914518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-507c19ad-e2ab-4954-b199-590d7b606262 req-81678ec5-3488-44c9-a8cf-78223799a213 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.915542 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2f4cd32-d2f8-4932-b292-f00ad275a1b1 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.067107 Aug 09 14:39:45.917185 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1155/2351] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:39:45 2022] GET /compute/v2.1/os-services => generated 944 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:45.923437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-edd7614d-192c-48a1-88cb-a480ff02e5d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:45.924350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-edd7614d-192c-48a1-88cb-a480ff02e5d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:45.931919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-edd7614d-192c-48a1-88cb-a480ff02e5d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.932438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-edd7614d-192c-48a1-88cb-a480ff02e5d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.932875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-edd7614d-192c-48a1-88cb-a480ff02e5d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.933578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-edd7614d-192c-48a1-88cb-a480ff02e5d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.934030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-edd7614d-192c-48a1-88cb-a480ff02e5d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.934726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-edd7614d-192c-48a1-88cb-a480ff02e5d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.942050 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-507c19ad-e2ab-4954-b199-590d7b606262 req-81678ec5-3488-44c9-a8cf-78223799a213 service nova] Creating event network-changed:8b0c7959-2122-4ff5-8cd4-9a1ea690f499 for instance dfa434a0-4d01-432e-b168-597c787c0d84 on n-h2-844626-8 Aug 09 14:39:45.949032 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-507c19ad-e2ab-4954-b199-590d7b606262 req-81678ec5-3488-44c9-a8cf-78223799a213 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097615 Aug 09 14:39:45.949865 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1197/2352] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:45.978364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f3feea4e-1ba9-411c-bd89-926bc8a0536d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:45.979296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f3feea4e-1ba9-411c-bd89-926bc8a0536d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:45.989519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3feea4e-1ba9-411c-bd89-926bc8a0536d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.990100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3feea4e-1ba9-411c-bd89-926bc8a0536d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.990595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3feea4e-1ba9-411c-bd89-926bc8a0536d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:45.991435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3feea4e-1ba9-411c-bd89-926bc8a0536d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:45.993256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3feea4e-1ba9-411c-bd89-926bc8a0536d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:45.997597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3feea4e-1ba9-411c-bd89-926bc8a0536d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:46.201388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-edd7614d-192c-48a1-88cb-a480ff02e5d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:46.215239 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-edd7614d-192c-48a1-88cb-a480ff02e5d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1318 microversion: 2.1 time: 0.294959 Aug 09 14:39:46.230197 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1156/2353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:45 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:46.235570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d45afe24-f606-4e86-991d-97265095e093 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Calling method '.version_select at 0x7f41ddbfb160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:46.325878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f3feea4e-1ba9-411c-bd89-926bc8a0536d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:46.333418 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f3feea4e-1ba9-411c-bd89-926bc8a0536d tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1318 microversion: 2.1 time: 0.364279 Aug 09 14:39:46.334028 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1198/2354] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:45 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:46.350196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-100ce324-21e1-4b6c-af13-440ad6226b31 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:46.350990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-100ce324-21e1-4b6c-af13-440ad6226b31 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:46.359472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-100ce324-21e1-4b6c-af13-440ad6226b31 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:46.360182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-100ce324-21e1-4b6c-af13-440ad6226b31 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:46.360916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-100ce324-21e1-4b6c-af13-440ad6226b31 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:46.361883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-100ce324-21e1-4b6c-af13-440ad6226b31 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:46.362476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-100ce324-21e1-4b6c-af13-440ad6226b31 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:46.363168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-100ce324-21e1-4b6c-af13-440ad6226b31 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:46.496733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-100ce324-21e1-4b6c-af13-440ad6226b31 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:46.523979 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-100ce324-21e1-4b6c-af13-440ad6226b31 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.188420 Aug 09 14:39:46.527223 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1199/2355] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:46 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:46.532804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0e08e51-9d23-4ff3-b480-2c8dae62f1f5 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:46.535815 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:39:46.535815 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:39:46.537145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e08e51-9d23-4ff3-b480-2c8dae62f1f5 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:46.537715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e08e51-9d23-4ff3-b480-2c8dae62f1f5 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:46.540822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e08e51-9d23-4ff3-b480-2c8dae62f1f5 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:46.541853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e08e51-9d23-4ff3-b480-2c8dae62f1f5 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:46.542408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e08e51-9d23-4ff3-b480-2c8dae62f1f5 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:46.542979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e08e51-9d23-4ff3-b480-2c8dae62f1f5 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:46.592829 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0e08e51-9d23-4ff3-b480-2c8dae62f1f5 tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-844626-8&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.063989 Aug 09 14:39:46.593711 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1200/2356] 10.222.0.50 () {58 vars in 1194 bytes} [Tue Aug 9 14:39:46 2022] GET /compute/v2.1/os-services?host=n-d-844626-8&binary=xxx => generated 16 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:39:46.618396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5f590f19-b516-45b6-8544-a2d14ed2842a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:46.619528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5f590f19-b516-45b6-8544-a2d14ed2842a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 14b01446-ea34-46ad-970b-363da106d2e6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:46.627446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f590f19-b516-45b6-8544-a2d14ed2842a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:46.628246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f590f19-b516-45b6-8544-a2d14ed2842a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:46.628757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f590f19-b516-45b6-8544-a2d14ed2842a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:46.629502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f590f19-b516-45b6-8544-a2d14ed2842a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:46.629990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f590f19-b516-45b6-8544-a2d14ed2842a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:46.630496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f590f19-b516-45b6-8544-a2d14ed2842a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:46.747480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5f590f19-b516-45b6-8544-a2d14ed2842a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:46.756192 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5f590f19-b516-45b6-8544-a2d14ed2842a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6" status: 200 len: 1212 microversion: 2.1 time: 0.152836 Aug 09 14:39:46.757007 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1201/2357] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:46 2022] GET /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6 => generated 1212 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:46.763070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8456a3c9-a03f-462e-9252-b3a8873aaf0c tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:46.766094 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:39:46.766094 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:39:46.767558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8456a3c9-a03f-462e-9252-b3a8873aaf0c tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:46.768365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8456a3c9-a03f-462e-9252-b3a8873aaf0c tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:46.768978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8456a3c9-a03f-462e-9252-b3a8873aaf0c tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:46.769883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8456a3c9-a03f-462e-9252-b3a8873aaf0c tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:46.770586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8456a3c9-a03f-462e-9252-b3a8873aaf0c tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:46.771202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8456a3c9-a03f-462e-9252-b3a8873aaf0c tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:46.796043 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8456a3c9-a03f-462e-9252-b3a8873aaf0c tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.037418 Aug 09 14:39:46.796639 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1202/2358] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:39:46 2022] GET /compute/v2.1/os-services => generated 944 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:46.809433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f18235cd-0374-499e-8b58-f4525a7b8bdf tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:46.812264 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:39:46.812264 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:39:46.813534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f18235cd-0374-499e-8b58-f4525a7b8bdf tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:46.814078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f18235cd-0374-499e-8b58-f4525a7b8bdf tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:46.814576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f18235cd-0374-499e-8b58-f4525a7b8bdf tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:46.815302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f18235cd-0374-499e-8b58-f4525a7b8bdf tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:46.816123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f18235cd-0374-499e-8b58-f4525a7b8bdf tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:46.816123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f18235cd-0374-499e-8b58-f4525a7b8bdf tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:46.839150 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f18235cd-0374-499e-8b58-f4525a7b8bdf tempest-ServicesAdminNegativeTestJSON-2050520769 tempest-ServicesAdminNegativeTestJSON-2050520769-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.033836 Aug 09 14:39:46.846732 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1203/2359] 10.222.0.50 () {58 vars in 1198 bytes} [Tue Aug 9 14:39:46 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 14:39:47.126219 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d45afe24-f606-4e86-991d-97265095e093 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/a6a6404c-a9a7-419d-9220-6043b3c09b86" status: 202 len: 0 microversion: 2.1 time: 0.894949 Aug 09 14:39:47.126881 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1157/2360] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:39:46 2022] DELETE /compute/v2.1/os-floating-ips/a6a6404c-a9a7-419d-9220-6043b3c09b86 => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:39:47.130576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c6c91f5-3d6f-4edf-8366-a2e5f4cbe402 tempest-ServicesAdminNegativeTestJSON-738694903 tempest-ServicesAdminNegativeTestJSON-738694903-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:47.133223 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:39:47.133223 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:39:47.134365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c6c91f5-3d6f-4edf-8366-a2e5f4cbe402 tempest-ServicesAdminNegativeTestJSON-738694903 tempest-ServicesAdminNegativeTestJSON-738694903-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '9f9610e040594a84a08dd3aaec5125eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9110ae2c75847209177bd4901bd46ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c6c91f5-3d6f-4edf-8366-a2e5f4cbe402 tempest-ServicesAdminNegativeTestJSON-738694903 tempest-ServicesAdminNegativeTestJSON-738694903-project] Request method failure captured: Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGsKr5a9QaV9N50mav5IDIf6h6bQT94JljdLF7NBiIv42WCLOZ-h6_nrcsuPczuJ5DhoohD3aYvhiUsU39D6Ee18v4tfa3QAiDvxbG8FDA0bbo6UyrNJ4FDalLSPZ7ssLvOjrkexw-5OvrLMviKYF01Z44hKoeQtaNvl7SYnTQd0Oo Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: d9110ae2c75847209177bd4901bd46ce Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-738694903 Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d9110ae2c75847209177bd4901bd46ce", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d9110ae2c75847209177bd4901bd46ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d9110ae2c75847209177bd4901bd46ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d9110ae2c75847209177bd4901bd46ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-738694903 Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: d9110ae2c75847209177bd4901bd46ce Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-738694903 Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServicesAdminNegativeTestJSON-738694903-project Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 9f9610e040594a84a08dd3aaec5125eb Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-738694903-project Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: action_args: {} Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 09 14:39:47.136168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:47.140153 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:47.140153 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:47.140153 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:47.140153 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:47.140153 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:47.140153 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:39:47.140153 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:39:47.140153 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 09 14:39:47.140153 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:47.140736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52368aaa-e885-4511-a98d-a9aed3ae2c92 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Action: 'create', calling method: .version_select at 0x7f41de215c10>, body: {"pool": null} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:47.141507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c6c91f5-3d6f-4edf-8366-a2e5f4cbe402 tempest-ServicesAdminNegativeTestJSON-738694903 tempest-ServicesAdminNegativeTestJSON-738694903-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:47.142471 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c6c91f5-3d6f-4edf-8366-a2e5f4cbe402 tempest-ServicesAdminNegativeTestJSON-738694903 tempest-ServicesAdminNegativeTestJSON-738694903-project] 10.222.0.50 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.294684 Aug 09 14:39:47.142998 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1204/2361] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:39:46 2022] GET /compute/v2.1/os-services => generated 112 bytes in 296 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:39:47.331572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-13557d1c-2f0d-443b-8bcf-5021bf651965 tempest-QuotaClassesAdminTestJSON-609494807 tempest-QuotaClassesAdminTestJSON-609494807-project-admin] Calling method '.version_select at 0x7f41ddd484c0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:47.332472 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:39:47.332472 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:39:47.359074 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-13557d1c-2f0d-443b-8bcf-5021bf651965 tempest-QuotaClassesAdminTestJSON-609494807 tempest-QuotaClassesAdminTestJSON-609494807-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.159099 Aug 09 14:39:47.360110 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1205/2362] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 9 14:39:47 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:39:47.364968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fd742ffd-95a1-4459-89dc-7967329f5a6b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:47.365693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fd742ffd-95a1-4459-89dc-7967329f5a6b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:47.372229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd742ffd-95a1-4459-89dc-7967329f5a6b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:47.372836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd742ffd-95a1-4459-89dc-7967329f5a6b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:47.373865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd742ffd-95a1-4459-89dc-7967329f5a6b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:47.374345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd742ffd-95a1-4459-89dc-7967329f5a6b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:47.374892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd742ffd-95a1-4459-89dc-7967329f5a6b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:47.375452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd742ffd-95a1-4459-89dc-7967329f5a6b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:47.761362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fd742ffd-95a1-4459-89dc-7967329f5a6b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:47.770351 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fd742ffd-95a1-4459-89dc-7967329f5a6b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1318 microversion: 2.1 time: 0.409104 Aug 09 14:39:47.770937 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1206/2363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:47 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:47.789458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0540078-91a0-4632-b5a8-771059d767dc tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:47.790065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e0540078-91a0-4632-b5a8-771059d767dc tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:47.798307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0540078-91a0-4632-b5a8-771059d767dc tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:47.798807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0540078-91a0-4632-b5a8-771059d767dc tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:47.799266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0540078-91a0-4632-b5a8-771059d767dc tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:47.799947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0540078-91a0-4632-b5a8-771059d767dc tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:47.800513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0540078-91a0-4632-b5a8-771059d767dc tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:47.800930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0540078-91a0-4632-b5a8-771059d767dc tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:48.388118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e0540078-91a0-4632-b5a8-771059d767dc tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:48.395102 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0540078-91a0-4632-b5a8-771059d767dc tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1508 microversion: 2.1 time: 0.609694 Aug 09 14:39:48.395716 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1207/2364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:47 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1508 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:48.400079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-872be9b1-39ad-4d20-9300-2627f370f055 tempest-QuotaClassesAdminTestJSON-609494807 tempest-QuotaClassesAdminTestJSON-609494807-project-admin] Action: 'update', calling method: .version_select at 0x7f41dcbc4310>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:48.403492 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:39:48.403492 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:39:48.447420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:48.767444 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-872be9b1-39ad-4d20-9300-2627f370f055 tempest-QuotaClassesAdminTestJSON-609494807 tempest-QuotaClassesAdminTestJSON-609494807-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.370412 Aug 09 14:39:48.768567 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1208/2365] 10.222.0.50 () {60 vars in 1206 bytes} [Tue Aug 9 14:39:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:48.799241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1286d8c8-65e4-44c1-b511-61b6ad7b9db4 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:48.802780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1286d8c8-65e4-44c1-b511-61b6ad7b9db4 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:48.816826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1286d8c8-65e4-44c1-b511-61b6ad7b9db4 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:48.817333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1286d8c8-65e4-44c1-b511-61b6ad7b9db4 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:48.817789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1286d8c8-65e4-44c1-b511-61b6ad7b9db4 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:48.818501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1286d8c8-65e4-44c1-b511-61b6ad7b9db4 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:48.819470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1286d8c8-65e4-44c1-b511-61b6ad7b9db4 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:48.819886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1286d8c8-65e4-44c1-b511-61b6ad7b9db4 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:48.934063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-1286d8c8-65e4-44c1-b511-61b6ad7b9db4 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:48.955910 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1286d8c8-65e4-44c1-b511-61b6ad7b9db4 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.179899 Aug 09 14:39:48.957206 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1209/2366] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:48 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:48.962276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a7033809-d8ff-4114-89e5-ce2c4e769f28 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:48.963126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a7033809-d8ff-4114-89e5-ce2c4e769f28 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 14b01446-ea34-46ad-970b-363da106d2e6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:48.982823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7033809-d8ff-4114-89e5-ce2c4e769f28 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:48.983431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7033809-d8ff-4114-89e5-ce2c4e769f28 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:48.983866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7033809-d8ff-4114-89e5-ce2c4e769f28 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:48.984572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7033809-d8ff-4114-89e5-ce2c4e769f28 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:48.985021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7033809-d8ff-4114-89e5-ce2c4e769f28 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:48.985437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7033809-d8ff-4114-89e5-ce2c4e769f28 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:49.002857 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-a7033809-d8ff-4114-89e5-ce2c4e769f28 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a7033809-d8ff-4114-89e5-ce2c4e769f28 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6 HTTP/1.1 Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '14b01446-ea34-46ad-970b-363da106d2e6'} Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:49.005177 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:49.008941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:49.008941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:49.008941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:49.008941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:49.008941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:39:49.008941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:39:49.008941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a7033809-d8ff-4114-89e5-ce2c4e769f28 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:49.008941 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a7033809-d8ff-4114-89e5-ce2c4e769f28 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6" status: 404 len: 111 microversion: 2.1 time: 0.048179 Aug 09 14:39:49.008941 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1210/2367] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:48 2022] GET /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:49.018684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-994c28d7-e1b0-40c6-b3a6-9afc8c45e7b9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:49.018684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-994c28d7-e1b0-40c6-b3a6-9afc8c45e7b9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:49.028987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-994c28d7-e1b0-40c6-b3a6-9afc8c45e7b9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:49.028987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-994c28d7-e1b0-40c6-b3a6-9afc8c45e7b9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:49.028987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-994c28d7-e1b0-40c6-b3a6-9afc8c45e7b9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:49.028987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-994c28d7-e1b0-40c6-b3a6-9afc8c45e7b9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:49.028987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-994c28d7-e1b0-40c6-b3a6-9afc8c45e7b9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:49.028987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-994c28d7-e1b0-40c6-b3a6-9afc8c45e7b9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:49.062687 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-994c28d7-e1b0-40c6-b3a6-9afc8c45e7b9 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/ips" status: 200 len: 149 microversion: 2.1 time: 0.054193 Aug 09 14:39:49.063925 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1211/2368] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:39:49 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:49.068085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a242343-e3e3-409e-a5f6-6aabac061617 tempest-QuotaClassesAdminTestJSON-609494807 tempest-QuotaClassesAdminTestJSON-609494807-project-admin] Calling method '.version_select at 0x7f41dd58f700>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:49.068862 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:39:49.068862 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:39:49.081735 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a242343-e3e3-409e-a5f6-6aabac061617 tempest-QuotaClassesAdminTestJSON-609494807 tempest-QuotaClassesAdminTestJSON-609494807-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.017029 Aug 09 14:39:49.088832 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1212/2369] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 9 14:39:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:49.088832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa13309f-bd46-47eb-89b6-202795d53147 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:49.089043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa13309f-bd46-47eb-89b6-202795d53147 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:49.095184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa13309f-bd46-47eb-89b6-202795d53147 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:49.095666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa13309f-bd46-47eb-89b6-202795d53147 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:49.096093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa13309f-bd46-47eb-89b6-202795d53147 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:49.096866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa13309f-bd46-47eb-89b6-202795d53147 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:49.097437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa13309f-bd46-47eb-89b6-202795d53147 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:49.097625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa13309f-bd46-47eb-89b6-202795d53147 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:49.443479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fa13309f-bd46-47eb-89b6-202795d53147 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:49.453008 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa13309f-bd46-47eb-89b6-202795d53147 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1318 microversion: 2.1 time: 0.368404 Aug 09 14:39:49.460249 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1213/2370] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:49 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:49.472704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3e537eeb-e391-43f9-94a0-5b04cb61f9e7 tempest-QuotaClassesAdminTestJSON-609494807 tempest-QuotaClassesAdminTestJSON-609494807-project-admin] Action: 'update', calling method: .version_select at 0x7f41dd770280>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:49.488764 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:39:49.488764 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:39:49.553407 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52368aaa-e885-4511-a98d-a9aed3ae2c92 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.421222 Aug 09 14:39:49.562209 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1158/2371] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 9 14:39:47 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:49.567298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1011515466", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "7d4b5e6e-1097-46ba-bb21-ff9e1560d087"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:49.664148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] validate_networks() for [('7d4b5e6e-1097-46ba-bb21-ff9e1560d087', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:39:49.689632 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3e537eeb-e391-43f9-94a0-5b04cb61f9e7 tempest-QuotaClassesAdminTestJSON-609494807 tempest-QuotaClassesAdminTestJSON-609494807-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.228258 Aug 09 14:39:49.700873 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1214/2372] 10.222.0.50 () {60 vars in 1206 bytes} [Tue Aug 9 14:39:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:49.705872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc30f52b-b9a4-4c4c-9e1d-33a098854cf9 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Calling method '.version_select at 0x7f41dcb50700>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:51.281862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:39:51.282357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:39:51.282818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:39:51.283441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:39:51.283856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:39:51.300728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=19 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:51.305158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:51.307747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:51.308367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:51.309783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:51.310260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:51.310696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:51.354278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:39:51.360285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for user 03bdf5ec21854ec8b6561a121ce1f1ef and project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:39:51.375147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:39:51.377735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:39:51.446686 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-59736720-55c2-4330-8f0e-52940153bea5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.883311 Aug 09 14:39:51.460415 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1159/2373] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:39:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:39:51.479511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-93ed743c-1e00-424f-8a8b-b9ff3f4bcef3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:51.480122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-93ed743c-1e00-424f-8a8b-b9ff3f4bcef3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:51.487707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93ed743c-1e00-424f-8a8b-b9ff3f4bcef3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:51.488277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93ed743c-1e00-424f-8a8b-b9ff3f4bcef3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:51.488992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93ed743c-1e00-424f-8a8b-b9ff3f4bcef3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:51.489652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93ed743c-1e00-424f-8a8b-b9ff3f4bcef3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:51.490374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93ed743c-1e00-424f-8a8b-b9ff3f4bcef3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:51.490909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93ed743c-1e00-424f-8a8b-b9ff3f4bcef3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:51.586727 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc30f52b-b9a4-4c4c-9e1d-33a098854cf9 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/099c2963-f1a7-40e3-a80d-276a8a848184" status: 202 len: 0 microversion: 2.1 time: 1.884568 Aug 09 14:39:51.587357 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1215/2374] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:39:49 2022] DELETE /compute/v2.1/os-floating-ips/099c2963-f1a7-40e3-a80d-276a8a848184 => generated 0 bytes in 1886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:39:51.592238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf6797f5-c9ba-4ed1-828a-aa098897b78b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:51.593009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf6797f5-c9ba-4ed1-828a-aa098897b78b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:51.599907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf6797f5-c9ba-4ed1-828a-aa098897b78b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:51.600614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf6797f5-c9ba-4ed1-828a-aa098897b78b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:51.601238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf6797f5-c9ba-4ed1-828a-aa098897b78b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:51.602032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf6797f5-c9ba-4ed1-828a-aa098897b78b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:51.602486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf6797f5-c9ba-4ed1-828a-aa098897b78b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:51.603194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf6797f5-c9ba-4ed1-828a-aa098897b78b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:51.622970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-93ed743c-1e00-424f-8a8b-b9ff3f4bcef3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:51.656384 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-93ed743c-1e00-424f-8a8b-b9ff3f4bcef3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.193456 Aug 09 14:39:51.663134 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1160/2375] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:51 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:51.669839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9f722ee-36ea-4cbe-8b79-99fbe2448e49 tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "28b997bb-9258-4edf-b7ee-3b24fc0fb3c2"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:51.673931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c9f722ee-36ea-4cbe-8b79-99fbe2448e49 tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:51.684129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9f722ee-36ea-4cbe-8b79-99fbe2448e49 tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:51.684781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9f722ee-36ea-4cbe-8b79-99fbe2448e49 tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:51.685534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9f722ee-36ea-4cbe-8b79-99fbe2448e49 tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:51.686970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9f722ee-36ea-4cbe-8b79-99fbe2448e49 tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:51.687975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9f722ee-36ea-4cbe-8b79-99fbe2448e49 tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:51.688854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9f722ee-36ea-4cbe-8b79-99fbe2448e49 tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:51.772155 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-c9f722ee-36ea-4cbe-8b79-99fbe2448e49 tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] HTTP exception thrown: Volume a853b094-41ab-44de-b3bd-9c61c7be6368 could not be found. Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9f722ee-36ea-4cbe-8b79-99fbe2448e49 tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Request method failure captured: Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: request: PUT /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5/os-volume_attachments/a853b094-41ab-44de-b3bd-9c61c7be6368 HTTP/1.1 Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 74 Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nFBYh3sdbbQ4olfNSPfUXEJwLXMlB5E64vpJOB0fYS4V9i7vtjD4JY-VU4TqYjrYFVXQ02Ae5EVMBJ8ZXzDVmLFxKjexfSVJoIH7VJIDUdHu8f5TmpgzlZaBT7bSXXH1AbpIHrgssw4Qv-XUN4hgGQuJi4BxAHPrHC6yHtAh4RHN_U Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 1bb5e0ca466b429d8e1ff9793637923a Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesAdminNegativeTest-301064868 Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1bb5e0ca466b429d8e1ff9793637923a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1bb5e0ca466b429d8e1ff9793637923a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1bb5e0ca466b429d8e1ff9793637923a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1bb5e0ca466b429d8e1ff9793637923a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-VolumesAdminNegativeTest-301064868 Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 1bb5e0ca466b429d8e1ff9793637923a Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-301064868 Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-VolumesAdminNegativeTest-301064868-project-admin Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e4165a32dea84f0d9928c30a69943a87 Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-VolumesAdminNegativeTest-301064868-project-admin Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: {"volumeAttachment": {"volumeId": "28b997bb-9258-4edf-b7ee-3b24fc0fb3c2"}} Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: exception: Volume a853b094-41ab-44de-b3bd-9c61c7be6368 could not be found. Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'server_id': 'e5e70c52-d56b-47f4-887f-6e4001b601c5', 'id': 'a853b094-41ab-44de-b3bd-9c61c7be6368', 'body': {'volumeAttachment': {'volumeId': '28b997bb-9258-4edf-b7ee-3b24fc0fb3c2'}}} Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a853b094-41ab-44de-b3bd-9c61c7be6368 could not be found. (HTTP 404) (Request-ID: req-b58a1b78-ac3f-4e47-b8d9-93a00fbef542) Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 14:39:51.774434 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a853b094-41ab-44de-b3bd-9c61c7be6368 could not be found. Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a853b094-41ab-44de-b3bd-9c61c7be6368 could not be found. Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a853b094-41ab-44de-b3bd-9c61c7be6368 could not be found. Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9f722ee-36ea-4cbe-8b79-99fbe2448e49 tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] Returning 404 to user: Volume a853b094-41ab-44de-b3bd-9c61c7be6368 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c9f722ee-36ea-4cbe-8b79-99fbe2448e49 tempest-VolumesAdminNegativeTest-301064868 tempest-VolumesAdminNegativeTest-301064868-project-admin] 10.222.0.50 "PUT /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5/os-volume_attachments/a853b094-41ab-44de-b3bd-9c61c7be6368" status: 404 len: 109 microversion: 2.1 time: 0.111066 Aug 09 14:39:51.783795 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1161/2376] 10.222.0.50 () {60 vars in 1433 bytes} [Tue Aug 9 14:39:51 2022] PUT /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5/os-volume_attachments/a853b094-41ab-44de-b3bd-9c61c7be6368 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:51.788167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-284c135f-3dc5-4640-8607-58fa88571b37 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:51.788744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-284c135f-3dc5-4640-8607-58fa88571b37 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:51.800501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:51.882927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-284c135f-3dc5-4640-8607-58fa88571b37 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:51.898633 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-284c135f-3dc5-4640-8607-58fa88571b37 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1221 microversion: 2.1 time: 0.116659 Aug 09 14:39:51.907241 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1162/2377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:51 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1221 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:51.909496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bf6797f5-c9ba-4ed1-828a-aa098897b78b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:51.922810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43044078-afa3-436e-8559-0f22e884db99 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Calling method '.version_select at 0x7f41ddf5bee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:51.929776 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf6797f5-c9ba-4ed1-828a-aa098897b78b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1318 microversion: 2.1 time: 0.339743 Aug 09 14:39:51.931873 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1216/2378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:51 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:51.944697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f54699a5-4b7d-482b-b7c7-968252004761 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9cbbfa2-79c3-44d8-aff3-4e5d72d772f6"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:51.950518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f54699a5-4b7d-482b-b7c7-968252004761 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:51.991988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f54699a5-4b7d-482b-b7c7-968252004761 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:51.992653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f54699a5-4b7d-482b-b7c7-968252004761 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:51.994371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f54699a5-4b7d-482b-b7c7-968252004761 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:51.995607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f54699a5-4b7d-482b-b7c7-968252004761 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:51.996367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f54699a5-4b7d-482b-b7c7-968252004761 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:51.997394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f54699a5-4b7d-482b-b7c7-968252004761 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:52.003785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:52.033537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-43044078-afa3-436e-8559-0f22e884db99 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 099c2963-f1a7-40e3-a80d-276a8a848184 could not be found", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:39:52.034514 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-43044078-afa3-436e-8559-0f22e884db99 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] HTTP exception thrown: Floating IP not found for ID 099c2963-f1a7-40e3-a80d-276a8a848184 Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43044078-afa3-436e-8559-0f22e884db99 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Request method failure captured: Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-floating-ips/099c2963-f1a7-40e3-a80d-276a8a848184 HTTP/1.1 Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGr0vXWDVIXxCGFuqYABJjnuWxNIAWnmoO5NR4YMaz75ZsNINFp05zb-9QfQK5jugn1mH1KYtHMJiWZtHHntm_iz1hgPMqTqVqlfGwLThcj_mtL0-jEFKTm7E5GzGfu0JkszEaRyFfiu4iwxL3ZPHh6F7CqWMXOa3ae0Fy2ANsrY4E Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 5b03760da37d4bef863c02c9fb75eae3 Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FloatingIPsTestJSON-427649484 Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5b03760da37d4bef863c02c9fb75eae3", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5b03760da37d4bef863c02c9fb75eae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b03760da37d4bef863c02c9fb75eae3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b03760da37d4bef863c02c9fb75eae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FloatingIPsTestJSON-427649484 Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 5b03760da37d4bef863c02c9fb75eae3 Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FloatingIPsTestJSON-427649484 Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FloatingIPsTestJSON-427649484-project Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 347ecf6a231540efac84106da2453aff Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FloatingIPsTestJSON-427649484-project Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: exception: Floating IP not found for ID 099c2963-f1a7-40e3-a80d-276a8a848184 Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '099c2963-f1a7-40e3-a80d-276a8a848184'} Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 099c2963-f1a7-40e3-a80d-276a8a848184 could not be found Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d787d79-1495-40a5-835e-c7f996d8c361'] Aug 09 14:39:52.037541 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 099c2963-f1a7-40e3-a80d-276a8a848184. Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 099c2963-f1a7-40e3-a80d-276a8a848184 Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 099c2963-f1a7-40e3-a80d-276a8a848184 Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.042306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43044078-afa3-436e-8559-0f22e884db99 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Returning 404 to user: Floating IP not found for ID 099c2963-f1a7-40e3-a80d-276a8a848184 {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:52.046635 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-43044078-afa3-436e-8559-0f22e884db99 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/099c2963-f1a7-40e3-a80d-276a8a848184" status: 404 len: 111 microversion: 2.1 time: 0.144638 Aug 09 14:39:52.046635 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1163/2379] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 9 14:39:51 2022] GET /compute/v2.1/os-floating-ips/099c2963-f1a7-40e3-a80d-276a8a848184 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:52.067830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-4e0bc48c-71d2-4fdc-9fc5-1097db4f2235 req-aa4a8475-6221-4bb4-9515-94056690851c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa434a0-4d01-432e-b168-597c787c0d84", "name": "network-vif-plugged", "status": "completed", "tag": "8b0c7959-2122-4ff5-8cd4-9a1ea690f499"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:52.105302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4e0bc48c-71d2-4fdc-9fc5-1097db4f2235 req-aa4a8475-6221-4bb4-9515-94056690851c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:52.107887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4e0bc48c-71d2-4fdc-9fc5-1097db4f2235 req-aa4a8475-6221-4bb4-9515-94056690851c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:52.109043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4e0bc48c-71d2-4fdc-9fc5-1097db4f2235 req-aa4a8475-6221-4bb4-9515-94056690851c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:52.123353 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4e0bc48c-71d2-4fdc-9fc5-1097db4f2235 req-aa4a8475-6221-4bb4-9515-94056690851c service nova] Creating event network-vif-plugged:8b0c7959-2122-4ff5-8cd4-9a1ea690f499 for instance dfa434a0-4d01-432e-b168-597c787c0d84 on n-h2-844626-8 Aug 09 14:39:52.129527 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-4e0bc48c-71d2-4fdc-9fc5-1097db4f2235 req-aa4a8475-6221-4bb4-9515-94056690851c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075121 Aug 09 14:39:52.130432 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1164/2380] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:52.141146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c80b3a59-5370-4387-a4e5-ebd691d0d369 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Calling method '.version_select at 0x7f41ddf77b80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:52.217489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-c80b3a59-5370-4387-a4e5-ebd691d0d369 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 099c2963-f1a7-40e3-a80d-276a8a848184 could not be found", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:39:52.218907 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-c80b3a59-5370-4387-a4e5-ebd691d0d369 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] HTTP exception thrown: Floating IP not found for ID 099c2963-f1a7-40e3-a80d-276a8a848184 Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c80b3a59-5370-4387-a4e5-ebd691d0d369 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Request method failure captured: Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-floating-ips/099c2963-f1a7-40e3-a80d-276a8a848184 HTTP/1.1 Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGr0vXWDVIXxCGFuqYABJjnuWxNIAWnmoO5NR4YMaz75ZsNINFp05zb-9QfQK5jugn1mH1KYtHMJiWZtHHntm_iz1hgPMqTqVqlfGwLThcj_mtL0-jEFKTm7E5GzGfu0JkszEaRyFfiu4iwxL3ZPHh6F7CqWMXOa3ae0Fy2ANsrY4E Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 5b03760da37d4bef863c02c9fb75eae3 Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FloatingIPsTestJSON-427649484 Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5b03760da37d4bef863c02c9fb75eae3", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5b03760da37d4bef863c02c9fb75eae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b03760da37d4bef863c02c9fb75eae3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5b03760da37d4bef863c02c9fb75eae3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FloatingIPsTestJSON-427649484 Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 5b03760da37d4bef863c02c9fb75eae3 Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FloatingIPsTestJSON-427649484 Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FloatingIPsTestJSON-427649484-project Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 347ecf6a231540efac84106da2453aff Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FloatingIPsTestJSON-427649484-project Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: exception: Floating IP not found for ID 099c2963-f1a7-40e3-a80d-276a8a848184 Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '099c2963-f1a7-40e3-a80d-276a8a848184'} Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 099c2963-f1a7-40e3-a80d-276a8a848184 could not be found Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-afcc4422-28ad-46e5-908d-5d4a800046ca'] Aug 09 14:39:52.222256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 099c2963-f1a7-40e3-a80d-276a8a848184. Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 099c2963-f1a7-40e3-a80d-276a8a848184 Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 099c2963-f1a7-40e3-a80d-276a8a848184 Aug 09 14:39:52.227490 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:39:52.230578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c80b3a59-5370-4387-a4e5-ebd691d0d369 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] Returning 404 to user: Floating IP not found for ID 099c2963-f1a7-40e3-a80d-276a8a848184 {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:39:52.231765 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c80b3a59-5370-4387-a4e5-ebd691d0d369 tempest-FloatingIPsTestJSON-427649484 tempest-FloatingIPsTestJSON-427649484-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/099c2963-f1a7-40e3-a80d-276a8a848184" status: 404 len: 111 microversion: 2.1 time: 0.099808 Aug 09 14:39:52.238955 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1165/2381] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:39:52 2022] DELETE /compute/v2.1/os-floating-ips/099c2963-f1a7-40e3-a80d-276a8a848184 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:39:52.499824 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f54699a5-4b7d-482b-b7c7-968252004761 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "POST /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.566614 Aug 09 14:39:52.500928 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1217/2382] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 14:39:51 2022] POST /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:52.687652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e46784fc-aba9-4fa9-9878-999446624191 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:52.689408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e46784fc-aba9-4fa9-9878-999446624191 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:52.700419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e46784fc-aba9-4fa9-9878-999446624191 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:52.701170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e46784fc-aba9-4fa9-9878-999446624191 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:52.706132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e46784fc-aba9-4fa9-9878-999446624191 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:52.707905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e46784fc-aba9-4fa9-9878-999446624191 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:52.708602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e46784fc-aba9-4fa9-9878-999446624191 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:52.709639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e46784fc-aba9-4fa9-9878-999446624191 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:52.740080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:52.893948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-e46784fc-aba9-4fa9-9878-999446624191 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:52.918083 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e46784fc-aba9-4fa9-9878-999446624191 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.237142 Aug 09 14:39:52.919896 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1166/2383] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:52 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:52.926174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3cc6a14d-6405-4b17-915f-8352c0540ea2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:52.927186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3cc6a14d-6405-4b17-915f-8352c0540ea2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:52.951869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cc6a14d-6405-4b17-915f-8352c0540ea2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:52.952296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cc6a14d-6405-4b17-915f-8352c0540ea2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:52.953698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb512789-fce4-4a4b-abf8-cc504f887ff6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:52.954913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eb512789-fce4-4a4b-abf8-cc504f887ff6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:52.955026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cc6a14d-6405-4b17-915f-8352c0540ea2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:52.955760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cc6a14d-6405-4b17-915f-8352c0540ea2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:52.956231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cc6a14d-6405-4b17-915f-8352c0540ea2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:52.957414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3cc6a14d-6405-4b17-915f-8352c0540ea2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:52.964472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb512789-fce4-4a4b-abf8-cc504f887ff6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:52.964963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb512789-fce4-4a4b-abf8-cc504f887ff6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:52.965390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb512789-fce4-4a4b-abf8-cc504f887ff6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:52.966091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb512789-fce4-4a4b-abf8-cc504f887ff6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:52.966534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb512789-fce4-4a4b-abf8-cc504f887ff6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:52.966962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb512789-fce4-4a4b-abf8-cc504f887ff6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:53.264281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3cc6a14d-6405-4b17-915f-8352c0540ea2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:53.289942 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3cc6a14d-6405-4b17-915f-8352c0540ea2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1273 microversion: 2.1 time: 0.363960 Aug 09 14:39:53.293895 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1218/2384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:52 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1273 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:39:53.383031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb512789-fce4-4a4b-abf8-cc504f887ff6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:53.394666 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb512789-fce4-4a4b-abf8-cc504f887ff6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1318 microversion: 2.1 time: 0.444841 Aug 09 14:39:53.395300 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1167/2385] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:52 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:53.947962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c4546bc4-4891-47bd-86ba-e0313be94df3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:53.948637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c4546bc4-4891-47bd-86ba-e0313be94df3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:53.963344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4546bc4-4891-47bd-86ba-e0313be94df3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:53.967020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4546bc4-4891-47bd-86ba-e0313be94df3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:53.967622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4546bc4-4891-47bd-86ba-e0313be94df3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:53.971416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4546bc4-4891-47bd-86ba-e0313be94df3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:53.974500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4546bc4-4891-47bd-86ba-e0313be94df3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:53.975217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4546bc4-4891-47bd-86ba-e0313be94df3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:54.313802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-49b3365d-5570-4163-aa38-a5100fe6dd58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:54.314406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-49b3365d-5570-4163-aa38-a5100fe6dd58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:54.336594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b3365d-5570-4163-aa38-a5100fe6dd58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:54.337326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b3365d-5570-4163-aa38-a5100fe6dd58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:54.339623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b3365d-5570-4163-aa38-a5100fe6dd58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:54.340552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b3365d-5570-4163-aa38-a5100fe6dd58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:54.345819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b3365d-5570-4163-aa38-a5100fe6dd58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:54.346741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b3365d-5570-4163-aa38-a5100fe6dd58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:54.537200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-c4546bc4-4891-47bd-86ba-e0313be94df3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:54.576425 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c4546bc4-4891-47bd-86ba-e0313be94df3 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.632510 Aug 09 14:39:54.577851 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1219/2386] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:53 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:54.594961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-296bbd0e-bf41-410a-b405-8d9bbb6e1dd2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:54.595990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-296bbd0e-bf41-410a-b405-8d9bbb6e1dd2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:54.612206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-296bbd0e-bf41-410a-b405-8d9bbb6e1dd2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:54.615437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-296bbd0e-bf41-410a-b405-8d9bbb6e1dd2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:54.615879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-296bbd0e-bf41-410a-b405-8d9bbb6e1dd2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:54.619504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-296bbd0e-bf41-410a-b405-8d9bbb6e1dd2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:54.620241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-296bbd0e-bf41-410a-b405-8d9bbb6e1dd2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:54.620883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-296bbd0e-bf41-410a-b405-8d9bbb6e1dd2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:54.639131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-49b3365d-5570-4163-aa38-a5100fe6dd58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:54.654841 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-49b3365d-5570-4163-aa38-a5100fe6dd58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1279 microversion: 2.1 time: 0.344840 Aug 09 14:39:54.659865 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1168/2387] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:54 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1279 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:39:55.234814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f3e99a3b-89b6-4f21-a546-031c2579db5a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:55.235332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f3e99a3b-89b6-4f21-a546-031c2579db5a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:55.252725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3e99a3b-89b6-4f21-a546-031c2579db5a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:55.253222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3e99a3b-89b6-4f21-a546-031c2579db5a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:55.253652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3e99a3b-89b6-4f21-a546-031c2579db5a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:55.257402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3e99a3b-89b6-4f21-a546-031c2579db5a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:55.257877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3e99a3b-89b6-4f21-a546-031c2579db5a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:55.258298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3e99a3b-89b6-4f21-a546-031c2579db5a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:55.354596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f3e99a3b-89b6-4f21-a546-031c2579db5a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:39:55.542531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-296bbd0e-bf41-410a-b405-8d9bbb6e1dd2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:55.554707 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-296bbd0e-bf41-410a-b405-8d9bbb6e1dd2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1509 microversion: 2.1 time: 0.974963 Aug 09 14:39:55.555339 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1220/2388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:54 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1509 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:55.670199 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f3e99a3b-89b6-4f21-a546-031c2579db5a tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 204 len: 0 microversion: 2.1 time: 0.439076 Aug 09 14:39:55.670817 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1169/2389] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:39:55 2022] DELETE /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:39:55.699649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf2c189e-0747-4f38-95dd-bc7359057422 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:55.704580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf2c189e-0747-4f38-95dd-bc7359057422 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:55.724328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf2c189e-0747-4f38-95dd-bc7359057422 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:55.725159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf2c189e-0747-4f38-95dd-bc7359057422 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:55.726097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf2c189e-0747-4f38-95dd-bc7359057422 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:55.727360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf2c189e-0747-4f38-95dd-bc7359057422 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:55.728001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf2c189e-0747-4f38-95dd-bc7359057422 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:55.731566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf2c189e-0747-4f38-95dd-bc7359057422 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:55.887892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0e7c5f37-af1c-496e-af5a-77f6b0ce5362 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Calling method '.version_select at 0x7f41dcb5f670>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:56.037662 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0e7c5f37-af1c-496e-af5a-77f6b0ce5362 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/7386abb6ecc44bcf9e483016a881000b" status: 200 len: 371 microversion: 2.1 time: 0.478511 Aug 09 14:39:56.038261 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1221/2390] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 9 14:39:55 2022] GET /compute/v2.1/os-quota-sets/7386abb6ecc44bcf9e483016a881000b => generated 371 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:56.052573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d73c73d-9135-4c31-a700-c0c11a66b15f tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:56.057829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d73c73d-9135-4c31-a700-c0c11a66b15f tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:56.073718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d73c73d-9135-4c31-a700-c0c11a66b15f tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:56.075519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d73c73d-9135-4c31-a700-c0c11a66b15f tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:56.077603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d73c73d-9135-4c31-a700-c0c11a66b15f tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:56.080268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d73c73d-9135-4c31-a700-c0c11a66b15f tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:56.081108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d73c73d-9135-4c31-a700-c0c11a66b15f tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:56.086264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d73c73d-9135-4c31-a700-c0c11a66b15f tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:56.233954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-9d73c73d-9135-4c31-a700-c0c11a66b15f tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:56.273718 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d73c73d-9135-4c31-a700-c0c11a66b15f tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.225644 Aug 09 14:39:56.299136 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1222/2391] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:56 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:56.312133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b9db9083-39b6-4ce9-a40f-09a053b426b7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:56.313209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b9db9083-39b6-4ce9-a40f-09a053b426b7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:56.323869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=22,nova_api:INSERT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:56.331421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9db9083-39b6-4ce9-a40f-09a053b426b7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:56.337284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9db9083-39b6-4ce9-a40f-09a053b426b7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:56.338252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9db9083-39b6-4ce9-a40f-09a053b426b7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:56.339271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9db9083-39b6-4ce9-a40f-09a053b426b7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:56.342382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9db9083-39b6-4ce9-a40f-09a053b426b7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:56.343236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9db9083-39b6-4ce9-a40f-09a053b426b7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:56.380068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bf2c189e-0747-4f38-95dd-bc7359057422 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:56.391846 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf2c189e-0747-4f38-95dd-bc7359057422 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1509 microversion: 2.1 time: 0.713541 Aug 09 14:39:56.397213 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1170/2392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:55 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1509 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:56.420633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-607e572c-ab0c-4b8d-8a25-b9d598e52705 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:56.421251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-607e572c-ab0c-4b8d-8a25-b9d598e52705 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:56.436839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-607e572c-ab0c-4b8d-8a25-b9d598e52705 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:56.437321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-607e572c-ab0c-4b8d-8a25-b9d598e52705 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:56.437749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-607e572c-ab0c-4b8d-8a25-b9d598e52705 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:56.452113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-607e572c-ab0c-4b8d-8a25-b9d598e52705 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:56.460024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-607e572c-ab0c-4b8d-8a25-b9d598e52705 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:56.460727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-607e572c-ab0c-4b8d-8a25-b9d598e52705 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:56.594608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-607e572c-ab0c-4b8d-8a25-b9d598e52705 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:56.602336 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-607e572c-ab0c-4b8d-8a25-b9d598e52705 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1279 microversion: 2.1 time: 0.189942 Aug 09 14:39:56.602936 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1171/2393] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:56 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1279 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:56.629745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f411885-4d70-4b74-8001-946f464eaa4b tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Action: 'update', calling method: .version_select at 0x7f41de215160>, body: {"quota_set": {"ram": "5120"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:56.757411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b9db9083-39b6-4ce9-a40f-09a053b426b7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:56.777723 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b9db9083-39b6-4ce9-a40f-09a053b426b7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1514 microversion: 2.1 time: 0.468148 Aug 09 14:39:56.781761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f411885-4d70-4b74-8001-946f464eaa4b tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:56.782271 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1223/2394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:56 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1514 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:56.783644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f411885-4d70-4b74-8001-946f464eaa4b tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:56.784998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f411885-4d70-4b74-8001-946f464eaa4b tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:56.785975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f411885-4d70-4b74-8001-946f464eaa4b tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:56.786636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f411885-4d70-4b74-8001-946f464eaa4b tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:56.787491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f411885-4d70-4b74-8001-946f464eaa4b tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:56.799032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-101fd9cd-a730-45d2-8dd4-005f1b5c405f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:56.807496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-101fd9cd-a730-45d2-8dd4-005f1b5c405f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:56.821391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=14 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:39:56.824668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-101fd9cd-a730-45d2-8dd4-005f1b5c405f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:56.831182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-101fd9cd-a730-45d2-8dd4-005f1b5c405f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:56.834820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-101fd9cd-a730-45d2-8dd4-005f1b5c405f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:56.840721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-101fd9cd-a730-45d2-8dd4-005f1b5c405f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:56.843757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-101fd9cd-a730-45d2-8dd4-005f1b5c405f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:56.844704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-101fd9cd-a730-45d2-8dd4-005f1b5c405f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:56.958385 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f411885-4d70-4b74-8001-946f464eaa4b tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/7386abb6ecc44bcf9e483016a881000b" status: 200 len: 328 microversion: 2.1 time: 0.354158 Aug 09 14:39:56.966517 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1172/2395] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:39:56 2022] PUT /compute/v2.1/os-quota-sets/7386abb6ecc44bcf9e483016a881000b => generated 328 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:56.976112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3129c23d-a0c0-4455-9234-d3eb0b70bf0b tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:57.013962 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3129c23d-a0c0-4455-9234-d3eb0b70bf0b tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-quota-sets/7386abb6ecc44bcf9e483016a881000b" status: 202 len: 0 microversion: 2.1 time: 0.046093 Aug 09 14:39:57.014868 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1173/2396] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:39:56 2022] DELETE /compute/v2.1/os-quota-sets/7386abb6ecc44bcf9e483016a881000b => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:39:57.032585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-261c6f5a-7cc2-4fec-b946-ebb6d73cd290 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Calling method '.version_select at 0x7f41ddec04c0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:57.046057 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-101fd9cd-a730-45d2-8dd4-005f1b5c405f tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "PUT /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1081 microversion: 2.1 time: 0.262373 Aug 09 14:39:57.063775 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1224/2397] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 9 14:39:56 2022] PUT /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1081 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:57.074545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6215d1ab-529a-425b-ab8b-4fb37aed9a64 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:57.075234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6215d1ab-529a-425b-ab8b-4fb37aed9a64 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:57.092662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6215d1ab-529a-425b-ab8b-4fb37aed9a64 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:57.093375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6215d1ab-529a-425b-ab8b-4fb37aed9a64 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:57.093943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6215d1ab-529a-425b-ab8b-4fb37aed9a64 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:57.094842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6215d1ab-529a-425b-ab8b-4fb37aed9a64 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:57.095483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6215d1ab-529a-425b-ab8b-4fb37aed9a64 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:57.096040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6215d1ab-529a-425b-ab8b-4fb37aed9a64 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:57.213102 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-261c6f5a-7cc2-4fec-b946-ebb6d73cd290 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/7386abb6ecc44bcf9e483016a881000b" status: 200 len: 371 microversion: 2.1 time: 0.193862 Aug 09 14:39:57.214528 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1174/2398] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 9 14:39:57 2022] GET /compute/v2.1/os-quota-sets/7386abb6ecc44bcf9e483016a881000b => generated 371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:57.305558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2c6b676-2e6f-425c-8da9-c7f61f5bae2b tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:57.310019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c2c6b676-2e6f-425c-8da9-c7f61f5bae2b tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:57.328200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2c6b676-2e6f-425c-8da9-c7f61f5bae2b tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:57.328700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2c6b676-2e6f-425c-8da9-c7f61f5bae2b tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:57.330925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2c6b676-2e6f-425c-8da9-c7f61f5bae2b tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:57.331867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2c6b676-2e6f-425c-8da9-c7f61f5bae2b tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:57.332472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2c6b676-2e6f-425c-8da9-c7f61f5bae2b tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:57.334353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2c6b676-2e6f-425c-8da9-c7f61f5bae2b tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:57.730950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-c2c6b676-2e6f-425c-8da9-c7f61f5bae2b tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:57.775294 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2c6b676-2e6f-425c-8da9-c7f61f5bae2b tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.473711 Aug 09 14:39:57.791731 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1175/2399] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:57 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:39:57.809433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9544d9f9-1685-4626-877d-fbe632417c75 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Calling method '.version_select at 0x7f41de0d4040>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:57.846302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6215d1ab-529a-425b-ab8b-4fb37aed9a64 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:57.854581 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6215d1ab-529a-425b-ab8b-4fb37aed9a64 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1507 microversion: 2.1 time: 0.789586 Aug 09 14:39:57.859660 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1225/2400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:57 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1507 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:57.871689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1884995-7e99-48a3-82e5-f49631ab9544 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:57.873532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1884995-7e99-48a3-82e5-f49631ab9544 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:57.895419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1884995-7e99-48a3-82e5-f49631ab9544 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:57.896137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1884995-7e99-48a3-82e5-f49631ab9544 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:57.896741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1884995-7e99-48a3-82e5-f49631ab9544 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:57.900165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1884995-7e99-48a3-82e5-f49631ab9544 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:57.900808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1884995-7e99-48a3-82e5-f49631ab9544 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:57.902243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1884995-7e99-48a3-82e5-f49631ab9544 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:58.263611 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9544d9f9-1685-4626-877d-fbe632417c75 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/4a72ab123a974fcf80cf9a167a2c5313/defaults" status: 200 len: 371 microversion: 2.1 time: 0.470574 Aug 09 14:39:58.264577 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1176/2401] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:39:57 2022] GET /compute/v2.1/os-quota-sets/4a72ab123a974fcf80cf9a167a2c5313/defaults => generated 371 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:58.277092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73087812-aa5e-4e2a-8ce3-04043d5f6f2f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:58.277711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-73087812-aa5e-4e2a-8ce3-04043d5f6f2f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:58.290177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73087812-aa5e-4e2a-8ce3-04043d5f6f2f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:58.290736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73087812-aa5e-4e2a-8ce3-04043d5f6f2f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:58.294662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73087812-aa5e-4e2a-8ce3-04043d5f6f2f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:58.295669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73087812-aa5e-4e2a-8ce3-04043d5f6f2f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:58.296070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73087812-aa5e-4e2a-8ce3-04043d5f6f2f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:58.316423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73087812-aa5e-4e2a-8ce3-04043d5f6f2f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:58.676245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1884995-7e99-48a3-82e5-f49631ab9544 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:58.689222 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1884995-7e99-48a3-82e5-f49631ab9544 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1321 microversion: 2.1 time: 0.827986 Aug 09 14:39:58.692149 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1226/2402] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:57 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1321 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:58.709876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-38f789c9-1bb3-4010-9553-be0f8be9bc39 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:58.710498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-38f789c9-1bb3-4010-9553-be0f8be9bc39 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:58.718634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38f789c9-1bb3-4010-9553-be0f8be9bc39 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:58.719512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38f789c9-1bb3-4010-9553-be0f8be9bc39 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:58.720092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38f789c9-1bb3-4010-9553-be0f8be9bc39 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:58.720956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38f789c9-1bb3-4010-9553-be0f8be9bc39 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:58.721548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38f789c9-1bb3-4010-9553-be0f8be9bc39 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:58.722138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38f789c9-1bb3-4010-9553-be0f8be9bc39 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:59.347783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-73087812-aa5e-4e2a-8ce3-04043d5f6f2f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:59.376457 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-73087812-aa5e-4e2a-8ce3-04043d5f6f2f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 200 len: 1514 microversion: 2.1 time: 1.109884 Aug 09 14:39:59.378929 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1177/2403] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:58 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 1514 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:39:59.393390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-da3a7107-0372-46b0-9d3e-77574826a1ae tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Action: 'update', calling method: .version_select at 0x7f41de17d280>, body: {"quota_set": {"ram": "5120"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:39:59.582673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da3a7107-0372-46b0-9d3e-77574826a1ae tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:59.583402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da3a7107-0372-46b0-9d3e-77574826a1ae tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:59.584017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da3a7107-0372-46b0-9d3e-77574826a1ae tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:59.584897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da3a7107-0372-46b0-9d3e-77574826a1ae tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:59.585492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da3a7107-0372-46b0-9d3e-77574826a1ae tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:59.586045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da3a7107-0372-46b0-9d3e-77574826a1ae tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:59.702109 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-da3a7107-0372-46b0-9d3e-77574826a1ae tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/0b545c4228f44e04afd2e4806b30a776" status: 200 len: 328 microversion: 2.1 time: 0.320613 Aug 09 14:39:59.705692 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1178/2404] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:39:59 2022] PUT /compute/v2.1/os-quota-sets/0b545c4228f44e04afd2e4806b30a776 => generated 328 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:39:59.749816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5516d1fc-e5fb-4e43-8cca-706788d0a402 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:39:59.750660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5516d1fc-e5fb-4e43-8cca-706788d0a402 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:39:59.758927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5516d1fc-e5fb-4e43-8cca-706788d0a402 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:59.759757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5516d1fc-e5fb-4e43-8cca-706788d0a402 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:59.760345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5516d1fc-e5fb-4e43-8cca-706788d0a402 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:59.761216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5516d1fc-e5fb-4e43-8cca-706788d0a402 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:39:59.762162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5516d1fc-e5fb-4e43-8cca-706788d0a402 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:39:59.762786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5516d1fc-e5fb-4e43-8cca-706788d0a402 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:39:59.960534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-5516d1fc-e5fb-4e43-8cca-706788d0a402 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:39:59.982321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-38f789c9-1bb3-4010-9553-be0f8be9bc39 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:39:59.992801 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-38f789c9-1bb3-4010-9553-be0f8be9bc39 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1507 microversion: 2.1 time: 1.299289 Aug 09 14:39:59.998732 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5516d1fc-e5fb-4e43-8cca-706788d0a402 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.273828 Aug 09 14:40:00.000089 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1227/2406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:39:58 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1507 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:00.000367 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1179/2406] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:39:59 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:40:00.005168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b82b9ffe-fadd-432a-b5de-846a2f5e8692 req-0818e578-e0d4-4ef0-901a-3eb546805a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e70c52-d56b-47f4-887f-6e4001b601c5", "name": "network-vif-deleted", "tag": "96341057-cb2c-4da2-a045-05585ffe1eeb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:00.005612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8da9aa2-302a-4960-9ba7-67c63f49270c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:00.006370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b8da9aa2-302a-4960-9ba7-67c63f49270c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:00.021796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b82b9ffe-fadd-432a-b5de-846a2f5e8692 req-0818e578-e0d4-4ef0-901a-3eb546805a34 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.024882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b82b9ffe-fadd-432a-b5de-846a2f5e8692 req-0818e578-e0d4-4ef0-901a-3eb546805a34 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.025577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b82b9ffe-fadd-432a-b5de-846a2f5e8692 req-0818e578-e0d4-4ef0-901a-3eb546805a34 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.051074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8da9aa2-302a-4960-9ba7-67c63f49270c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.052366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8da9aa2-302a-4960-9ba7-67c63f49270c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.053111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8da9aa2-302a-4960-9ba7-67c63f49270c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.053951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8da9aa2-302a-4960-9ba7-67c63f49270c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.054408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8da9aa2-302a-4960-9ba7-67c63f49270c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.054838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8da9aa2-302a-4960-9ba7-67c63f49270c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.057288 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b82b9ffe-fadd-432a-b5de-846a2f5e8692 req-0818e578-e0d4-4ef0-901a-3eb546805a34 service nova] Creating event network-vif-deleted:96341057-cb2c-4da2-a045-05585ffe1eeb for instance e5e70c52-d56b-47f4-887f-6e4001b601c5 on n-h1-844626-8 Aug 09 14:40:00.067045 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b82b9ffe-fadd-432a-b5de-846a2f5e8692 req-0818e578-e0d4-4ef0-901a-3eb546805a34 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063495 Aug 09 14:40:00.069004 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1228/2407] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:00.079224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bcf9792a-b6da-4f06-bae1-3ef98409771e tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Calling method '.version_select at 0x7f41dcb39ee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:00.201838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=44,nova_cell0:UPDATE=7 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:00.205504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcf9792a-b6da-4f06-bae1-3ef98409771e tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.206373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcf9792a-b6da-4f06-bae1-3ef98409771e tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.206970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcf9792a-b6da-4f06-bae1-3ef98409771e tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.208381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcf9792a-b6da-4f06-bae1-3ef98409771e tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.209019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcf9792a-b6da-4f06-bae1-3ef98409771e tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.209572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcf9792a-b6da-4f06-bae1-3ef98409771e tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.236653 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bcf9792a-b6da-4f06-bae1-3ef98409771e tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/0b545c4228f44e04afd2e4806b30a776/detail" status: 200 len: 916 microversion: 2.1 time: 0.166431 Aug 09 14:40:00.237460 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1229/2408] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:40:00 2022] GET /compute/v2.1/os-quota-sets/0b545c4228f44e04afd2e4806b30a776/detail => generated 916 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:00.243688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:00.246923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:00.254834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.255884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.256456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.257377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.259059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.259059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.373967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:40:00.374656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:40:00.375296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:40:00.381055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:40:00.381663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:40:00.405134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8da9aa2-302a-4960-9ba7-67c63f49270c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:00.414588 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8da9aa2-302a-4960-9ba7-67c63f49270c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1321 microversion: 2.1 time: 0.412175 Aug 09 14:40:00.419044 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1180/2409] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:00 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:00.422048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37403c5c-518e-46a2-a129-77cca1a8a9c4 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:00.422994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37403c5c-518e-46a2-a129-77cca1a8a9c4 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: e5e70c52-d56b-47f4-887f-6e4001b601c5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:00.437122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37403c5c-518e-46a2-a129-77cca1a8a9c4 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.437612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37403c5c-518e-46a2-a129-77cca1a8a9c4 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.438045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37403c5c-518e-46a2-a129-77cca1a8a9c4 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.438751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37403c5c-518e-46a2-a129-77cca1a8a9c4 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.447808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37403c5c-518e-46a2-a129-77cca1a8a9c4 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.449697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37403c5c-518e-46a2-a129-77cca1a8a9c4 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.478401 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-37403c5c-518e-46a2-a129-77cca1a8a9c4 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] HTTP exception thrown: Instance e5e70c52-d56b-47f4-887f-6e4001b601c5 could not be found. Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37403c5c-518e-46a2-a129-77cca1a8a9c4 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Request method failure captured: Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 HTTP/1.1 Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nEswfPRobhN7BagGEQ9MP7FveFH0yNHRx_plgjf7xw3bsbaI1poqOmkBL447FavGvsjfv6FwW2NM5KLixin--gZXFH5eK2Y3xthPv8p8u5LxbcqL7W2h-DXrifiJd6PMqAQYLo7Vaalue8iy22YS2svcyTnmKjZIVvTK1LGqpxHqto Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ec96cdb5ea0f42c6ad2044517c6dbffa Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesAdminNegativeTest-1800734423 Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ec96cdb5ea0f42c6ad2044517c6dbffa", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ec96cdb5ea0f42c6ad2044517c6dbffa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ec96cdb5ea0f42c6ad2044517c6dbffa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ec96cdb5ea0f42c6ad2044517c6dbffa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-VolumesAdminNegativeTest-1800734423 Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ec96cdb5ea0f42c6ad2044517c6dbffa Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1800734423 Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-VolumesAdminNegativeTest-1800734423-project Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 68639dd3894d4af7a49f3ffee8beb889 Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-VolumesAdminNegativeTest-1800734423-project Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance e5e70c52-d56b-47f4-887f-6e4001b601c5 could not be found. Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'e5e70c52-d56b-47f4-887f-6e4001b601c5'} Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e70c52-d56b-47f4-887f-6e4001b601c5 could not be found. Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e70c52-d56b-47f4-887f-6e4001b601c5 could not be found. Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:00.497406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:00.504957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:00.504957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:00.504957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:00.504957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:00.504957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:00.504957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e70c52-d56b-47f4-887f-6e4001b601c5 could not be found. Aug 09 14:40:00.504957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:00.504957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37403c5c-518e-46a2-a129-77cca1a8a9c4 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Returning 404 to user: Instance e5e70c52-d56b-47f4-887f-6e4001b601c5 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:00.504957 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37403c5c-518e-46a2-a129-77cca1a8a9c4 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5" status: 404 len: 111 microversion: 2.1 time: 0.082148 Aug 09 14:40:00.511567 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1181/2410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:00 2022] GET /compute/v2.1/servers/e5e70c52-d56b-47f4-887f-6e4001b601c5 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:40:00.522662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:00.534685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.535198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.535627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.536317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.546216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.546673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.576690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Action: 'update', calling method: .version_select at 0x7f41ddda0b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:00.636837 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4bd1dbe-0fd4-4db3-9cc8-720d65faf5dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "POST /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84/action" status: 202 len: 1113 microversion: 2.1 time: 0.387208 Aug 09 14:40:00.637583 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1230/2411] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:40:00 2022] POST /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84/action => generated 1113 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 09 14:40:00.654858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5bbc0abd-3418-4373-953a-cea2973594a0 req-3f397b72-b237-4009-adfd-b9d3dde340d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2b61a3-4691-42de-be5c-4e13b1665984", "tag": "39bb8b03-7aec-4785-8277-60d9befab1e0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:00.679832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5bbc0abd-3418-4373-953a-cea2973594a0 req-3f397b72-b237-4009-adfd-b9d3dde340d6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.680505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5bbc0abd-3418-4373-953a-cea2973594a0 req-3f397b72-b237-4009-adfd-b9d3dde340d6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.681290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5bbc0abd-3418-4373-953a-cea2973594a0 req-3f397b72-b237-4009-adfd-b9d3dde340d6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.703275 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5bbc0abd-3418-4373-953a-cea2973594a0 req-3f397b72-b237-4009-adfd-b9d3dde340d6 service nova] Creating event network-changed:39bb8b03-7aec-4785-8277-60d9befab1e0 for instance 6e2b61a3-4691-42de-be5c-4e13b1665984 on n-h2-844626-8 Aug 09 14:40:00.709507 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5bbc0abd-3418-4373-953a-cea2973594a0 req-3f397b72-b237-4009-adfd-b9d3dde340d6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058214 Aug 09 14:40:00.710642 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1231/2412] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:00.717822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93df77d5-8a8d-4716-8260-d3417b1db9ea tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:00.718700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93df77d5-8a8d-4716-8260-d3417b1db9ea tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:00.725390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93df77d5-8a8d-4716-8260-d3417b1db9ea tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.726122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93df77d5-8a8d-4716-8260-d3417b1db9ea tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.726717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93df77d5-8a8d-4716-8260-d3417b1db9ea tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.727598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93df77d5-8a8d-4716-8260-d3417b1db9ea tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.728250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93df77d5-8a8d-4716-8260-d3417b1db9ea tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.728853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93df77d5-8a8d-4716-8260-d3417b1db9ea tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.756439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:00.894927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.895671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.896244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.897096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.897707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.898273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.951357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.952899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.953964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:00.958212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:00.960101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:00.960925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:01.080790 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-94ccffa6-4d4e-4c8d-859d-33848209959c tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/0b545c4228f44e04afd2e4806b30a776?user_id=35abc6952ae24b27a553d66b9e00fc3f" status: 200 len: 328 microversion: 2.1 time: 0.506813 Aug 09 14:40:01.083051 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1182/2413] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:40:00 2022] PUT /compute/v2.1/os-quota-sets/0b545c4228f44e04afd2e4806b30a776?user_id=35abc6952ae24b27a553d66b9e00fc3f => generated 328 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:40:01.088627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db4151bd-fb6b-4f29-8349-9593202ea4b6 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:01.089478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db4151bd-fb6b-4f29-8349-9593202ea4b6 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:01.096769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4151bd-fb6b-4f29-8349-9593202ea4b6 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:01.097495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4151bd-fb6b-4f29-8349-9593202ea4b6 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:01.098166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4151bd-fb6b-4f29-8349-9593202ea4b6 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:01.099047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4151bd-fb6b-4f29-8349-9593202ea4b6 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:01.099724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4151bd-fb6b-4f29-8349-9593202ea4b6 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:01.100427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4151bd-fb6b-4f29-8349-9593202ea4b6 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:01.384805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-db4151bd-fb6b-4f29-8349-9593202ea4b6 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:01.407487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:01.410491 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db4151bd-fb6b-4f29-8349-9593202ea4b6 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.325986 Aug 09 14:40:01.424680 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1183/2414] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:01 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:40:01.436907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c2e2751-771c-47f3-bf34-eb5f4fb92240 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Calling method '.version_select at 0x7f41ddf77670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:01.519559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-93df77d5-8a8d-4716-8260-d3417b1db9ea tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:01.531788 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93df77d5-8a8d-4716-8260-d3417b1db9ea tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1518 microversion: 2.1 time: 0.819393 Aug 09 14:40:01.533886 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1232/2415] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:00 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1518 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:01.556765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ad3869e-38f3-4a17-92b5-bd5cf14eaedc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:01.559231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9ad3869e-38f3-4a17-92b5-bd5cf14eaedc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:01.584603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ad3869e-38f3-4a17-92b5-bd5cf14eaedc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:01.586102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ad3869e-38f3-4a17-92b5-bd5cf14eaedc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:01.587756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ad3869e-38f3-4a17-92b5-bd5cf14eaedc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:01.591355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ad3869e-38f3-4a17-92b5-bd5cf14eaedc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:01.593085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ad3869e-38f3-4a17-92b5-bd5cf14eaedc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:01.593588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ad3869e-38f3-4a17-92b5-bd5cf14eaedc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:01.907923 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c2e2751-771c-47f3-bf34-eb5f4fb92240 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/0b545c4228f44e04afd2e4806b30a776?user_id=35abc6952ae24b27a553d66b9e00fc3f" status: 200 len: 370 microversion: 2.1 time: 0.481983 Aug 09 14:40:01.911395 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1184/2416] 10.222.0.50 () {58 vars in 1323 bytes} [Tue Aug 9 14:40:01 2022] GET /compute/v2.1/os-quota-sets/0b545c4228f44e04afd2e4806b30a776?user_id=35abc6952ae24b27a553d66b9e00fc3f => generated 370 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:01.976065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9ad3869e-38f3-4a17-92b5-bd5cf14eaedc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:01.985357 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ad3869e-38f3-4a17-92b5-bd5cf14eaedc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1321 microversion: 2.1 time: 0.448031 Aug 09 14:40:01.985956 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1233/2417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:01 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1321 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:02.291733 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f24014d0-790c-4cd0-8ee9-0c892e71698d tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] 10.222.0.50 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.203767 Aug 09 14:40:02.292271 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1185/2418] 10.222.0.50 () {58 vars in 1128 bytes} [Tue Aug 9 14:40:02 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 14:40:02.302134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-646e6000-705d-4eae-9fdc-d6f1984ced7f tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Calling method '.version_select at 0x7f41dcb1bf70>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:02.369072 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-646e6000-705d-4eae-9fdc-d6f1984ced7f tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] HTTP exception thrown: Image not found. Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-646e6000-705d-4eae-9fdc-d6f1984ced7f tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Request method failure captured: Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nHBHk6JrfwTsZBNJXwAS31eLP3RdDtzkWlg61GYZFHrYq6CXVDWeYEduOdsneaYfKQuZW7EBbg2pLOrNGJ1egO1b_Se04zASS1qRq88GXTNiut2PsqAMTrR21TZc10JFD-bayEXQVy3C7XivZrlfYLDMrymozDbGFe8NpExjBmm7HI Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 4ca7b8ebe5074754a9a07fb213ed5f0c Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4ca7b8ebe5074754a9a07fb213ed5f0c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 4ca7b8ebe5074754a9a07fb213ed5f0c Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesDeleteNegativeTestJSON-1147975126-project Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 5d156c53519c4453aae5eb5cb8f69473 Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126-project Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: exception: Image not found. Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '-1'} Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.416844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-646e6000-705d-4eae-9fdc-d6f1984ced7f tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Returning 404 to user: Image not found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-646e6000-705d-4eae-9fdc-d6f1984ced7f tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] 10.222.0.50 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.120771 Aug 09 14:40:02.427703 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1234/2419] 10.222.0.50 () {58 vars in 1134 bytes} [Tue Aug 9 14:40:02 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:40:02.450107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79c16dae-a67f-437a-9185-726afe1b0c5c tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:02.450892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f15c353-36a1-4cfd-9488-f77107c7e2f8 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Calling method '.version_select at 0x7f41de215160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:02.457389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79c16dae-a67f-437a-9185-726afe1b0c5c tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:02.474564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c16dae-a67f-437a-9185-726afe1b0c5c tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:02.475828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c16dae-a67f-437a-9185-726afe1b0c5c tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:02.476486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c16dae-a67f-437a-9185-726afe1b0c5c tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:02.477408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c16dae-a67f-437a-9185-726afe1b0c5c tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:02.479225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c16dae-a67f-437a-9185-726afe1b0c5c tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:02.480047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79c16dae-a67f-437a-9185-726afe1b0c5c tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:02.516357 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4f15c353-36a1-4cfd-9488-f77107c7e2f8 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] HTTP exception thrown: Image not found. Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f15c353-36a1-4cfd-9488-f77107c7e2f8 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Request method failure captured: Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/images/2f6fba44-6805-478c-860c-2f9e886473aj HTTP/1.1 Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHBHk6JrfwTsZBNJXwAS31eLP3RdDtzkWlg61GYZFHrYq6CXVDWeYEduOdsneaYfKQuZW7EBbg2pLOrNGJ1egO1b_Se04zASS1qRq88GXTNiut2PsqAMTrR21TZc10JFD-bayEXQVy3C7XivZrlfYLDMrymozDbGFe8NpExjBmm7HI Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 4ca7b8ebe5074754a9a07fb213ed5f0c Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4ca7b8ebe5074754a9a07fb213ed5f0c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 4ca7b8ebe5074754a9a07fb213ed5f0c Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesDeleteNegativeTestJSON-1147975126-project Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 5d156c53519c4453aae5eb5cb8f69473 Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126-project Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '2f6fba44-6805-478c-860c-2f9e886473aj'} Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2f6fba44-6805-478c-860c-2f9e886473aj to delete Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f6fba44-6805-478c-860c-2f9e886473aj could not be found. Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:02.520765 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f15c353-36a1-4cfd-9488-f77107c7e2f8 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:02.525203 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f15c353-36a1-4cfd-9488-f77107c7e2f8 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] 10.222.0.50 "DELETE /compute/v2.1/images/2f6fba44-6805-478c-860c-2f9e886473aj" status: 404 len: 62 microversion: 2.1 time: 0.088588 Aug 09 14:40:02.527911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1186/2420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:02 2022] DELETE /compute/v2.1/images/2f6fba44-6805-478c-860c-2f9e886473aj => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:40:02.546394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a7b76b5-4e63-4108-9417-489a6f44276f tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Calling method '.version_select at 0x7f41de17d820>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:02.588166 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6a7b76b5-4e63-4108-9417-489a6f44276f tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] HTTP exception thrown: Image not found. Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a7b76b5-4e63-4108-9417-489a6f44276f tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Request method failure captured: Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/images/d5b1aafb-d4da-41a8-b4ed-fc953204cda81 HTTP/1.1 Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHBHk6JrfwTsZBNJXwAS31eLP3RdDtzkWlg61GYZFHrYq6CXVDWeYEduOdsneaYfKQuZW7EBbg2pLOrNGJ1egO1b_Se04zASS1qRq88GXTNiut2PsqAMTrR21TZc10JFD-bayEXQVy3C7XivZrlfYLDMrymozDbGFe8NpExjBmm7HI Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 4ca7b8ebe5074754a9a07fb213ed5f0c Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4ca7b8ebe5074754a9a07fb213ed5f0c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 4ca7b8ebe5074754a9a07fb213ed5f0c Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesDeleteNegativeTestJSON-1147975126-project Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 5d156c53519c4453aae5eb5cb8f69473 Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126-project Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'd5b1aafb-d4da-41a8-b4ed-fc953204cda81'} Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d5b1aafb-d4da-41a8-b4ed-fc953204cda81 to delete Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d5b1aafb-d4da-41a8-b4ed-fc953204cda81 could not be found. Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:02.590523 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a7b76b5-4e63-4108-9417-489a6f44276f tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a7b76b5-4e63-4108-9417-489a6f44276f tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] 10.222.0.50 "DELETE /compute/v2.1/images/d5b1aafb-d4da-41a8-b4ed-fc953204cda81" status: 404 len: 62 microversion: 2.1 time: 0.060449 Aug 09 14:40:02.593940 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1187/2421] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:40:02 2022] DELETE /compute/v2.1/images/d5b1aafb-d4da-41a8-b4ed-fc953204cda81 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:40:02.608561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0da2534-4e21-4766-a5ab-3f799280d5c7 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:02.611547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0da2534-4e21-4766-a5ab-3f799280d5c7 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:02.629999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-79c16dae-a67f-437a-9185-726afe1b0c5c tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:02.642538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0da2534-4e21-4766-a5ab-3f799280d5c7 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:02.643708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0da2534-4e21-4766-a5ab-3f799280d5c7 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:02.643708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0da2534-4e21-4766-a5ab-3f799280d5c7 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:02.644378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0da2534-4e21-4766-a5ab-3f799280d5c7 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:02.644835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0da2534-4e21-4766-a5ab-3f799280d5c7 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:02.645368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0da2534-4e21-4766-a5ab-3f799280d5c7 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:02.666761 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79c16dae-a67f-437a-9185-726afe1b0c5c tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.230376 Aug 09 14:40:02.679127 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1235/2422] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:02 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:40:02.684230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a39d7bb-e6a5-475e-98c8-e8b3650986c6 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Calling method '.version_select at 0x7f41dcbcf790>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:02.921480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0da2534-4e21-4766-a5ab-3f799280d5c7 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:02.930291 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0da2534-4e21-4766-a5ab-3f799280d5c7 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1518 microversion: 2.1 time: 0.335767 Aug 09 14:40:02.931535 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1188/2423] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:02 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1518 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:02.940982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c55d0d5b-acc6-491f-b9af-52b48d5eb334 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Calling method '.version_select at 0x7f41ddda0ee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:02.967589 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-c55d0d5b-acc6-491f-b9af-52b48d5eb334 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] HTTP exception thrown: Image not found. Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c55d0d5b-acc6-491f-b9af-52b48d5eb334 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Request method failure captured: Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/images/tempest-invalid-1952517958 HTTP/1.1 Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHBHk6JrfwTsZBNJXwAS31eLP3RdDtzkWlg61GYZFHrYq6CXVDWeYEduOdsneaYfKQuZW7EBbg2pLOrNGJ1egO1b_Se04zASS1qRq88GXTNiut2PsqAMTrR21TZc10JFD-bayEXQVy3C7XivZrlfYLDMrymozDbGFe8NpExjBmm7HI Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 4ca7b8ebe5074754a9a07fb213ed5f0c Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4ca7b8ebe5074754a9a07fb213ed5f0c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 4ca7b8ebe5074754a9a07fb213ed5f0c Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesDeleteNegativeTestJSON-1147975126-project Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 5d156c53519c4453aae5eb5cb8f69473 Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126-project Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'tempest-invalid-1952517958'} Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1952517958 to delete Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1952517958 could not be found. Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.969893 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:40:02.973646 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:02.977614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c55d0d5b-acc6-491f-b9af-52b48d5eb334 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:02.979325 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c55d0d5b-acc6-491f-b9af-52b48d5eb334 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] 10.222.0.50 "DELETE /compute/v2.1/images/tempest-invalid-1952517958" status: 404 len: 62 microversion: 2.1 time: 0.046690 Aug 09 14:40:02.980384 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1189/2424] 10.222.0.50 () {58 vars in 1206 bytes} [Tue Aug 9 14:40:02 2022] DELETE /compute/v2.1/images/tempest-invalid-1952517958 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:40:02.992992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40f78b57-eda9-4c38-b969-acebbd01d2f4 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Calling method '.version_select at 0x7f41ddaea5e0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:03.017009 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-40f78b57-eda9-4c38-b969-acebbd01d2f4 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] HTTP exception thrown: Image not found. Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40f78b57-eda9-4c38-b969-acebbd01d2f4 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Request method failure captured: Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/images/ee9b291e-017d-4b3f-a701-ad4242c44576 HTTP/1.1 Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHBHk6JrfwTsZBNJXwAS31eLP3RdDtzkWlg61GYZFHrYq6CXVDWeYEduOdsneaYfKQuZW7EBbg2pLOrNGJ1egO1b_Se04zASS1qRq88GXTNiut2PsqAMTrR21TZc10JFD-bayEXQVy3C7XivZrlfYLDMrymozDbGFe8NpExjBmm7HI Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 4ca7b8ebe5074754a9a07fb213ed5f0c Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4ca7b8ebe5074754a9a07fb213ed5f0c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4ca7b8ebe5074754a9a07fb213ed5f0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 4ca7b8ebe5074754a9a07fb213ed5f0c Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126 Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesDeleteNegativeTestJSON-1147975126-project Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 5d156c53519c4453aae5eb5cb8f69473 Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1147975126-project Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'ee9b291e-017d-4b3f-a701-ad4242c44576'} Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ee9b291e-017d-4b3f-a701-ad4242c44576 to delete Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ee9b291e-017d-4b3f-a701-ad4242c44576 could not be found. Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:03.019771 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:40:03.023252 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:03.026533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40f78b57-eda9-4c38-b969-acebbd01d2f4 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:03.027798 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40f78b57-eda9-4c38-b969-acebbd01d2f4 tempest-ImagesDeleteNegativeTestJSON-1147975126 tempest-ImagesDeleteNegativeTestJSON-1147975126-project] 10.222.0.50 "DELETE /compute/v2.1/images/ee9b291e-017d-4b3f-a701-ad4242c44576" status: 404 len: 62 microversion: 2.1 time: 0.039844 Aug 09 14:40:03.028875 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1190/2425] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:02 2022] DELETE /compute/v2.1/images/ee9b291e-017d-4b3f-a701-ad4242c44576 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:40:03.054751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6aeadd89-1b7e-4fd6-b2a3-1e3a1f458b91 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:03.055974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6aeadd89-1b7e-4fd6-b2a3-1e3a1f458b91 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:03.070493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6aeadd89-1b7e-4fd6-b2a3-1e3a1f458b91 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:03.072870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6aeadd89-1b7e-4fd6-b2a3-1e3a1f458b91 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:03.075025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6aeadd89-1b7e-4fd6-b2a3-1e3a1f458b91 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:03.076142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6aeadd89-1b7e-4fd6-b2a3-1e3a1f458b91 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:03.077885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6aeadd89-1b7e-4fd6-b2a3-1e3a1f458b91 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:03.078536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6aeadd89-1b7e-4fd6-b2a3-1e3a1f458b91 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:03.086935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:03.174168 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a39d7bb-e6a5-475e-98c8-e8b3650986c6 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/4a72ab123a974fcf80cf9a167a2c5313/defaults" status: 200 len: 371 microversion: 2.1 time: 0.505023 Aug 09 14:40:03.175258 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1236/2426] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:40:02 2022] GET /compute/v2.1/os-quota-sets/4a72ab123a974fcf80cf9a167a2c5313/defaults => generated 371 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:03.195732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1c4cf3cd-5ad5-46bc-aa84-33cbc7758651 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Action: 'update', calling method: .version_select at 0x7f41dcbcf940>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:03.336055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c4cf3cd-5ad5-46bc-aa84-33cbc7758651 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:03.336542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c4cf3cd-5ad5-46bc-aa84-33cbc7758651 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:03.336971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c4cf3cd-5ad5-46bc-aa84-33cbc7758651 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:03.342695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c4cf3cd-5ad5-46bc-aa84-33cbc7758651 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:03.343454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c4cf3cd-5ad5-46bc-aa84-33cbc7758651 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:03.344094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c4cf3cd-5ad5-46bc-aa84-33cbc7758651 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:03.447021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6aeadd89-1b7e-4fd6-b2a3-1e3a1f458b91 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:03.462266 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6aeadd89-1b7e-4fd6-b2a3-1e3a1f458b91 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1321 microversion: 2.1 time: 0.431948 Aug 09 14:40:03.467141 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1191/2427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:03 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:03.694457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1daabc82-443e-4f01-be86-62b224a877a0 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:03.695155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1daabc82-443e-4f01-be86-62b224a877a0 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:03.709081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1daabc82-443e-4f01-be86-62b224a877a0 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:03.709843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1daabc82-443e-4f01-be86-62b224a877a0 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:03.710770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1daabc82-443e-4f01-be86-62b224a877a0 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:03.711766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1daabc82-443e-4f01-be86-62b224a877a0 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:03.712862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1daabc82-443e-4f01-be86-62b224a877a0 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:03.713617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1daabc82-443e-4f01-be86-62b224a877a0 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:03.815982 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1c4cf3cd-5ad5-46bc-aa84-33cbc7758651 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/4a72ab123a974fcf80cf9a167a2c5313" status: 200 len: 329 microversion: 2.1 time: 0.631220 Aug 09 14:40:03.818019 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1237/2428] 10.222.0.50 () {60 vars in 1263 bytes} [Tue Aug 9 14:40:03 2022] PUT /compute/v2.1/os-quota-sets/4a72ab123a974fcf80cf9a167a2c5313 => generated 329 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:03.850696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81f72773-fa35-465e-af1e-59f50eb9f261 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Action: 'update', calling method: .version_select at 0x7f41dcad4160>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:03.995394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-1daabc82-443e-4f01-be86-62b224a877a0 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:04.045907 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1daabc82-443e-4f01-be86-62b224a877a0 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.354174 Aug 09 14:40:04.046748 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1192/2429] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:03 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:40:04.062129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-079f53d7-e7ac-4c91-9dae-0840cd7b4b18 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:04.075039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-079f53d7-e7ac-4c91-9dae-0840cd7b4b18 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:04.097527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-079f53d7-e7ac-4c91-9dae-0840cd7b4b18 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:04.098039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-079f53d7-e7ac-4c91-9dae-0840cd7b4b18 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:04.098488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-079f53d7-e7ac-4c91-9dae-0840cd7b4b18 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:04.104783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-079f53d7-e7ac-4c91-9dae-0840cd7b4b18 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:04.105324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-079f53d7-e7ac-4c91-9dae-0840cd7b4b18 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:04.105759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-079f53d7-e7ac-4c91-9dae-0840cd7b4b18 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:04.390989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-079f53d7-e7ac-4c91-9dae-0840cd7b4b18 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:04.401043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81f72773-fa35-465e-af1e-59f50eb9f261 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:04.403604 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-079f53d7-e7ac-4c91-9dae-0840cd7b4b18 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1518 microversion: 2.1 time: 0.353998 Aug 09 14:40:04.404354 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1193/2430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:04 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1518 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:04.421203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81f72773-fa35-465e-af1e-59f50eb9f261 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:04.421831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81f72773-fa35-465e-af1e-59f50eb9f261 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:04.422569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81f72773-fa35-465e-af1e-59f50eb9f261 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:04.423034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81f72773-fa35-465e-af1e-59f50eb9f261 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:04.423491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81f72773-fa35-465e-af1e-59f50eb9f261 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:04.486133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4522a26-8c95-4561-8c3b-e731a890f6b1 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:04.488055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a4522a26-8c95-4561-8c3b-e731a890f6b1 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:04.498016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4522a26-8c95-4561-8c3b-e731a890f6b1 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:04.500659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4522a26-8c95-4561-8c3b-e731a890f6b1 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:04.503826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4522a26-8c95-4561-8c3b-e731a890f6b1 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:04.504809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4522a26-8c95-4561-8c3b-e731a890f6b1 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:04.505829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4522a26-8c95-4561-8c3b-e731a890f6b1 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:04.506420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4522a26-8c95-4561-8c3b-e731a890f6b1 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:04.737047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=19,nova_api:UPDATE=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:04.844975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4522a26-8c95-4561-8c3b-e731a890f6b1 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:04.881847 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4522a26-8c95-4561-8c3b-e731a890f6b1 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1321 microversion: 2.1 time: 0.396191 Aug 09 14:40:04.883168 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1194/2431] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:04 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:05.077959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d072d30-acb5-4009-8bac-6b81c247564e tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:05.079105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d072d30-acb5-4009-8bac-6b81c247564e tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:05.092636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d072d30-acb5-4009-8bac-6b81c247564e tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:05.093407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d072d30-acb5-4009-8bac-6b81c247564e tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:05.094046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d072d30-acb5-4009-8bac-6b81c247564e tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:05.097261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d072d30-acb5-4009-8bac-6b81c247564e tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:05.098026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d072d30-acb5-4009-8bac-6b81c247564e tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:05.100563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d072d30-acb5-4009-8bac-6b81c247564e tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:05.191301 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81f72773-fa35-465e-af1e-59f50eb9f261 tempest-QuotasAdminTestJSON-393934212 tempest-QuotasAdminTestJSON-393934212-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-quota-sets/4a72ab123a974fcf80cf9a167a2c5313" status: 200 len: 329 microversion: 2.1 time: 1.350762 Aug 09 14:40:05.195131 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1238/2432] 10.222.0.50 () {60 vars in 1263 bytes} [Tue Aug 9 14:40:03 2022] PUT /compute/v2.1/os-quota-sets/4a72ab123a974fcf80cf9a167a2c5313 => generated 329 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:40:05.215854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-5d072d30-acb5-4009-8bac-6b81c247564e tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:05.235318 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d072d30-acb5-4009-8bac-6b81c247564e tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.163146 Aug 09 14:40:05.253930 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1195/2433] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:05 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:40:05.427689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0667a35-da39-4fc3-ae8f-2d18da9297cf tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:05.428672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0667a35-da39-4fc3-ae8f-2d18da9297cf tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:05.436824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0667a35-da39-4fc3-ae8f-2d18da9297cf tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:05.437538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0667a35-da39-4fc3-ae8f-2d18da9297cf tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:05.438184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0667a35-da39-4fc3-ae8f-2d18da9297cf tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:05.438996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0667a35-da39-4fc3-ae8f-2d18da9297cf tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:05.439726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0667a35-da39-4fc3-ae8f-2d18da9297cf tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:05.440389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0667a35-da39-4fc3-ae8f-2d18da9297cf tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:05.628690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c0667a35-da39-4fc3-ae8f-2d18da9297cf tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:05.640994 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0667a35-da39-4fc3-ae8f-2d18da9297cf tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1518 microversion: 2.1 time: 0.217156 Aug 09 14:40:05.644446 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1239/2434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:05 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1518 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:05.909786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5b9a0fa4-650c-4fd3-a038-b9c08390bd27 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:05.912404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b9a0fa4-650c-4fd3-a038-b9c08390bd27 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:05.934393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b9a0fa4-650c-4fd3-a038-b9c08390bd27 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:05.935171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b9a0fa4-650c-4fd3-a038-b9c08390bd27 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:05.935962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b9a0fa4-650c-4fd3-a038-b9c08390bd27 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:05.941846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b9a0fa4-650c-4fd3-a038-b9c08390bd27 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:05.942926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b9a0fa4-650c-4fd3-a038-b9c08390bd27 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:05.955199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b9a0fa4-650c-4fd3-a038-b9c08390bd27 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:06.256606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5b9a0fa4-650c-4fd3-a038-b9c08390bd27 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:06.262227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84ce4b1a-2a3b-46a2-a657-2a5255509c60 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:06.262976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-84ce4b1a-2a3b-46a2-a657-2a5255509c60 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:06.269871 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5b9a0fa4-650c-4fd3-a038-b9c08390bd27 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1321 microversion: 2.1 time: 0.366051 Aug 09 14:40:06.271412 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1196/2435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:05 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:06.275406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84ce4b1a-2a3b-46a2-a657-2a5255509c60 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:06.279236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84ce4b1a-2a3b-46a2-a657-2a5255509c60 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:06.279934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84ce4b1a-2a3b-46a2-a657-2a5255509c60 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:06.280767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84ce4b1a-2a3b-46a2-a657-2a5255509c60 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:06.281336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84ce4b1a-2a3b-46a2-a657-2a5255509c60 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:06.283059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84ce4b1a-2a3b-46a2-a657-2a5255509c60 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:06.483722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-84ce4b1a-2a3b-46a2-a657-2a5255509c60 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:06.639738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1591988423", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:06.768648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:40:06.842732 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-84ce4b1a-2a3b-46a2-a657-2a5255509c60 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.585203 Aug 09 14:40:06.860272 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1240/2436] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:06 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:40:06.866274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b417923e-c1b9-4d49-9cda-9e31e6067e05 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:06.866889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b417923e-c1b9-4d49-9cda-9e31e6067e05 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:06.873688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b417923e-c1b9-4d49-9cda-9e31e6067e05 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:06.874416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b417923e-c1b9-4d49-9cda-9e31e6067e05 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:06.875000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b417923e-c1b9-4d49-9cda-9e31e6067e05 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:06.875887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b417923e-c1b9-4d49-9cda-9e31e6067e05 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:06.876485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b417923e-c1b9-4d49-9cda-9e31e6067e05 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:06.877034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b417923e-c1b9-4d49-9cda-9e31e6067e05 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:07.302746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b417923e-c1b9-4d49-9cda-9e31e6067e05 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:07.313083 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b417923e-c1b9-4d49-9cda-9e31e6067e05 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1518 microversion: 2.1 time: 0.451762 Aug 09 14:40:07.313693 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1241/2437] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:06 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1518 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:07.332125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a2d29c8-2901-4f39-8865-d1f5d2fcb10f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:07.332842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a2d29c8-2901-4f39-8865-d1f5d2fcb10f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:07.350668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a2d29c8-2901-4f39-8865-d1f5d2fcb10f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:07.351453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a2d29c8-2901-4f39-8865-d1f5d2fcb10f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:07.352140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a2d29c8-2901-4f39-8865-d1f5d2fcb10f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:07.353045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a2d29c8-2901-4f39-8865-d1f5d2fcb10f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:07.353672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a2d29c8-2901-4f39-8865-d1f5d2fcb10f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:07.354285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a2d29c8-2901-4f39-8865-d1f5d2fcb10f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:07.496009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:40:07.496917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:40:07.497537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:40:07.498098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:40:07.498874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:40:07.515395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:07.516034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:07.520159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:07.525498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:07.526168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:07.526759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:07.568608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Getting quotas for project 0054032608084cdc8ef35d7638e13615. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:40:07.576833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Getting quotas for user 9f5334b328ca4a32ab7b5b258249bcb9 and project 0054032608084cdc8ef35d7638e13615. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:40:07.607000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:40:07.609319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:40:07.715525 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2837820e-d670-4212-9595-82805eff4c4e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.372017 Aug 09 14:40:07.716875 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1197/2438] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:40:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:40:07.733367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-00c0df0f-b73f-43e5-8833-94da5354016b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:07.735272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-00c0df0f-b73f-43e5-8833-94da5354016b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:07.741594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3a2d29c8-2901-4f39-8865-d1f5d2fcb10f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:07.753616 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a2d29c8-2901-4f39-8865-d1f5d2fcb10f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1321 microversion: 2.1 time: 0.438892 Aug 09 14:40:07.754807 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1242/2439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:07 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1321 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:07.821018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-00c0df0f-b73f-43e5-8833-94da5354016b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:07.829149 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-00c0df0f-b73f-43e5-8833-94da5354016b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1217 microversion: 2.1 time: 0.104827 Aug 09 14:40:07.830813 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1198/2440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:07 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:40:07.873722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ed29426-14fc-4b0b-921f-5a067cac41d2 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:07.874330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ed29426-14fc-4b0b-921f-5a067cac41d2 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:07.891262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ed29426-14fc-4b0b-921f-5a067cac41d2 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:07.892426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ed29426-14fc-4b0b-921f-5a067cac41d2 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:07.893011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ed29426-14fc-4b0b-921f-5a067cac41d2 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:07.893877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ed29426-14fc-4b0b-921f-5a067cac41d2 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:07.894518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ed29426-14fc-4b0b-921f-5a067cac41d2 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:07.895139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ed29426-14fc-4b0b-921f-5a067cac41d2 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:08.003484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-6ed29426-14fc-4b0b-921f-5a067cac41d2 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:08.062274 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ed29426-14fc-4b0b-921f-5a067cac41d2 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.192026 Aug 09 14:40:08.064128 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1243/2441] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:07 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:40:08.334716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32f6037f-70ec-4c09-9d1f-45860bd2a56d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:08.335753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-32f6037f-70ec-4c09-9d1f-45860bd2a56d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:08.356994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32f6037f-70ec-4c09-9d1f-45860bd2a56d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:08.359645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32f6037f-70ec-4c09-9d1f-45860bd2a56d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:08.360315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32f6037f-70ec-4c09-9d1f-45860bd2a56d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:08.363750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32f6037f-70ec-4c09-9d1f-45860bd2a56d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:08.364627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32f6037f-70ec-4c09-9d1f-45860bd2a56d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:08.376593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32f6037f-70ec-4c09-9d1f-45860bd2a56d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:08.602894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d35d3d60-283d-46df-86c5-f5ae15efb9c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:08.604158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d35d3d60-283d-46df-86c5-f5ae15efb9c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:08.618617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d35d3d60-283d-46df-86c5-f5ae15efb9c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:08.619273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d35d3d60-283d-46df-86c5-f5ae15efb9c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:08.619908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d35d3d60-283d-46df-86c5-f5ae15efb9c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:08.620807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d35d3d60-283d-46df-86c5-f5ae15efb9c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:08.621401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d35d3d60-283d-46df-86c5-f5ae15efb9c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:08.621983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d35d3d60-283d-46df-86c5-f5ae15efb9c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:08.638330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-32f6037f-70ec-4c09-9d1f-45860bd2a56d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:08.650269 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32f6037f-70ec-4c09-9d1f-45860bd2a56d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1518 microversion: 2.1 time: 0.319021 Aug 09 14:40:08.650868 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1199/2442] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:08 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1518 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:08.675832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d35d3d60-283d-46df-86c5-f5ae15efb9c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:40:08.757526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-920323bf-f1c4-4770-ab55-71c9b7bd1f4e req-3b7218ae-bd8d-4318-829b-6e006dc7ee58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2b61a3-4691-42de-be5c-4e13b1665984", "name": "network-vif-plugged", "status": "completed", "tag": "39bb8b03-7aec-4785-8277-60d9befab1e0"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:08.776000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-920323bf-f1c4-4770-ab55-71c9b7bd1f4e req-3b7218ae-bd8d-4318-829b-6e006dc7ee58 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:08.778768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-920323bf-f1c4-4770-ab55-71c9b7bd1f4e req-3b7218ae-bd8d-4318-829b-6e006dc7ee58 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:08.780295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-920323bf-f1c4-4770-ab55-71c9b7bd1f4e req-3b7218ae-bd8d-4318-829b-6e006dc7ee58 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:08.806593 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-920323bf-f1c4-4770-ab55-71c9b7bd1f4e req-3b7218ae-bd8d-4318-829b-6e006dc7ee58 service nova] Creating event network-vif-plugged:39bb8b03-7aec-4785-8277-60d9befab1e0 for instance 6e2b61a3-4691-42de-be5c-4e13b1665984 on n-h2-844626-8 Aug 09 14:40:08.817064 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-920323bf-f1c4-4770-ab55-71c9b7bd1f4e req-3b7218ae-bd8d-4318-829b-6e006dc7ee58 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063334 Aug 09 14:40:08.821336 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1200/2443] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:08.839740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ba5c96a-d5d2-4712-83d2-7301471c6bc7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:08.843241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ba5c96a-d5d2-4712-83d2-7301471c6bc7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:08.859830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ba5c96a-d5d2-4712-83d2-7301471c6bc7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:08.860649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ba5c96a-d5d2-4712-83d2-7301471c6bc7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:08.862970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ba5c96a-d5d2-4712-83d2-7301471c6bc7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:08.864104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ba5c96a-d5d2-4712-83d2-7301471c6bc7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:08.866747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ba5c96a-d5d2-4712-83d2-7301471c6bc7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:08.867556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ba5c96a-d5d2-4712-83d2-7301471c6bc7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:08.915535 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d35d3d60-283d-46df-86c5-f5ae15efb9c2 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 204 len: 0 microversion: 2.1 time: 0.318394 Aug 09 14:40:08.917643 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1244/2444] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:40:08 2022] DELETE /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:40:08.939521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c09277c-ad8b-4892-aa29-99dabe39e00d tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:08.940324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6c09277c-ad8b-4892-aa29-99dabe39e00d tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:08.968351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c09277c-ad8b-4892-aa29-99dabe39e00d tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:08.969141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c09277c-ad8b-4892-aa29-99dabe39e00d tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:08.969653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c09277c-ad8b-4892-aa29-99dabe39e00d tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:08.970405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c09277c-ad8b-4892-aa29-99dabe39e00d tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:08.970852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c09277c-ad8b-4892-aa29-99dabe39e00d tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:08.971375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c09277c-ad8b-4892-aa29-99dabe39e00d tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:09.247014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6c09277c-ad8b-4892-aa29-99dabe39e00d tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:09.257688 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6c09277c-ad8b-4892-aa29-99dabe39e00d tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1269 microversion: 2.1 time: 0.335929 Aug 09 14:40:09.258286 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1245/2445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:08 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1269 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:09.277759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1173e9b-b1b8-42e2-8904-83d8ff539ebb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:09.278861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1173e9b-b1b8-42e2-8904-83d8ff539ebb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:09.286378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1173e9b-b1b8-42e2-8904-83d8ff539ebb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:09.286877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1173e9b-b1b8-42e2-8904-83d8ff539ebb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:09.287521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1173e9b-b1b8-42e2-8904-83d8ff539ebb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:09.288228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1173e9b-b1b8-42e2-8904-83d8ff539ebb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:09.288734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1173e9b-b1b8-42e2-8904-83d8ff539ebb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:09.289324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1173e9b-b1b8-42e2-8904-83d8ff539ebb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:09.383128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ba5c96a-d5d2-4712-83d2-7301471c6bc7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:09.392828 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ba5c96a-d5d2-4712-83d2-7301471c6bc7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1321 microversion: 2.1 time: 0.569446 Aug 09 14:40:09.395844 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1201/2446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:08 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1321 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:09.412559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6139e69f-4da9-40ff-a67e-2291fcc2c00d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:09.413259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6139e69f-4da9-40ff-a67e-2291fcc2c00d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:09.438993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6139e69f-4da9-40ff-a67e-2291fcc2c00d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:09.439735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6139e69f-4da9-40ff-a67e-2291fcc2c00d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:09.442522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6139e69f-4da9-40ff-a67e-2291fcc2c00d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:09.446896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6139e69f-4da9-40ff-a67e-2291fcc2c00d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:09.451058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6139e69f-4da9-40ff-a67e-2291fcc2c00d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:09.452951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6139e69f-4da9-40ff-a67e-2291fcc2c00d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:09.706462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-6139e69f-4da9-40ff-a67e-2291fcc2c00d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:09.735414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1173e9b-b1b8-42e2-8904-83d8ff539ebb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:09.748386 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1173e9b-b1b8-42e2-8904-83d8ff539ebb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1680 microversion: 2.1 time: 0.488945 Aug 09 14:40:09.748979 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1246/2447] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:09 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1680 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:09.774800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bfe3ead7-7fe3-48c6-b465-feea5e629e91 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:09.775483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bfe3ead7-7fe3-48c6-b465-feea5e629e91 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:09.780989 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6139e69f-4da9-40ff-a67e-2291fcc2c00d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.383668 Aug 09 14:40:09.782372 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1202/2448] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:09 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:40:09.787845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1354906-80fe-4c20-b046-ae07f0853df7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:09.788610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1354906-80fe-4c20-b046-ae07f0853df7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:09.793294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfe3ead7-7fe3-48c6-b465-feea5e629e91 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:09.795844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfe3ead7-7fe3-48c6-b465-feea5e629e91 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:09.796706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1354906-80fe-4c20-b046-ae07f0853df7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:09.797635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1354906-80fe-4c20-b046-ae07f0853df7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:09.798260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1354906-80fe-4c20-b046-ae07f0853df7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:09.799200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfe3ead7-7fe3-48c6-b465-feea5e629e91 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:09.799333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1354906-80fe-4c20-b046-ae07f0853df7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:09.799925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfe3ead7-7fe3-48c6-b465-feea5e629e91 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:09.800299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1354906-80fe-4c20-b046-ae07f0853df7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:09.800428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfe3ead7-7fe3-48c6-b465-feea5e629e91 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:09.801306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1354906-80fe-4c20-b046-ae07f0853df7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:09.805233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfe3ead7-7fe3-48c6-b465-feea5e629e91 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:09.990160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-b1354906-80fe-4c20-b046-ae07f0853df7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lazy-loading 'services' on Instance uuid b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:10.118216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bfe3ead7-7fe3-48c6-b465-feea5e629e91 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:10.128544 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bfe3ead7-7fe3-48c6-b465-feea5e629e91 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1518 microversion: 2.1 time: 0.370466 Aug 09 14:40:10.131867 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1247/2449] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:09 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1518 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:10.154556 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b1354906-80fe-4c20-b046-ae07f0853df7 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments/c9cbbfa2-79c3-44d8-aff3-4e5d72d772f6" status: 202 len: 0 microversion: 2.1 time: 0.370609 Aug 09 14:40:10.157614 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1203/2450] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 14:40:09 2022] DELETE /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments/c9cbbfa2-79c3-44d8-aff3-4e5d72d772f6 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:40:10.164906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63c5d15b-d00c-4f86-a2ab-e61519f6dad2 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:10.168554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-63c5d15b-d00c-4f86-a2ab-e61519f6dad2 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:10.188454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63c5d15b-d00c-4f86-a2ab-e61519f6dad2 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:10.190356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63c5d15b-d00c-4f86-a2ab-e61519f6dad2 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:10.190356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63c5d15b-d00c-4f86-a2ab-e61519f6dad2 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:10.190675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63c5d15b-d00c-4f86-a2ab-e61519f6dad2 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:10.191424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63c5d15b-d00c-4f86-a2ab-e61519f6dad2 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:10.197186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63c5d15b-d00c-4f86-a2ab-e61519f6dad2 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:10.277700 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63c5d15b-d00c-4f86-a2ab-e61519f6dad2 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117846 Aug 09 14:40:10.278291 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1248/2451] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:40:10 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:10.302323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0fc9bf70-6adb-43be-bf3e-d1e23dd700ac tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:10.303367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0fc9bf70-6adb-43be-bf3e-d1e23dd700ac tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:10.316287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fc9bf70-6adb-43be-bf3e-d1e23dd700ac tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:10.316782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fc9bf70-6adb-43be-bf3e-d1e23dd700ac tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:10.317282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fc9bf70-6adb-43be-bf3e-d1e23dd700ac tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:10.317994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fc9bf70-6adb-43be-bf3e-d1e23dd700ac tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:10.318447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fc9bf70-6adb-43be-bf3e-d1e23dd700ac tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:10.318871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fc9bf70-6adb-43be-bf3e-d1e23dd700ac tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:10.399375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0fc9bf70-6adb-43be-bf3e-d1e23dd700ac tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:10.408524 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0fc9bf70-6adb-43be-bf3e-d1e23dd700ac tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1269 microversion: 2.1 time: 0.133278 Aug 09 14:40:10.410023 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1204/2452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:10 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1269 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:10.417662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-488e887f-1fca-4dcc-b8f3-5c77a50deafa tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:10.418722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-488e887f-1fca-4dcc-b8f3-5c77a50deafa tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:10.425675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-488e887f-1fca-4dcc-b8f3-5c77a50deafa tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:10.435596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-488e887f-1fca-4dcc-b8f3-5c77a50deafa tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:10.438187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-488e887f-1fca-4dcc-b8f3-5c77a50deafa tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:10.439330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-488e887f-1fca-4dcc-b8f3-5c77a50deafa tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:10.440968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-488e887f-1fca-4dcc-b8f3-5c77a50deafa tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:10.441768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-488e887f-1fca-4dcc-b8f3-5c77a50deafa tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:10.520503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:10.774139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b7ab734a-fadf-47f2-b9ae-8c64e3a8626f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:10.776022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b7ab734a-fadf-47f2-b9ae-8c64e3a8626f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:10.782647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7ab734a-fadf-47f2-b9ae-8c64e3a8626f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:10.800904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7ab734a-fadf-47f2-b9ae-8c64e3a8626f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:10.802477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7ab734a-fadf-47f2-b9ae-8c64e3a8626f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:10.803485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7ab734a-fadf-47f2-b9ae-8c64e3a8626f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:10.805063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7ab734a-fadf-47f2-b9ae-8c64e3a8626f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:10.806047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7ab734a-fadf-47f2-b9ae-8c64e3a8626f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:11.224154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-488e887f-1fca-4dcc-b8f3-5c77a50deafa tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:11.249233 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-488e887f-1fca-4dcc-b8f3-5c77a50deafa tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1321 microversion: 2.1 time: 0.831816 Aug 09 14:40:11.252171 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1249/2453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:10 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1321 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:11.268717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c83976b4-6e25-4121-8a9c-9a524bd613f9 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:11.274075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c83976b4-6e25-4121-8a9c-9a524bd613f9 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:11.296873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c83976b4-6e25-4121-8a9c-9a524bd613f9 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:11.298970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c83976b4-6e25-4121-8a9c-9a524bd613f9 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:11.300656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c83976b4-6e25-4121-8a9c-9a524bd613f9 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:11.304242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c83976b4-6e25-4121-8a9c-9a524bd613f9 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:11.305738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c83976b4-6e25-4121-8a9c-9a524bd613f9 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:11.308162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c83976b4-6e25-4121-8a9c-9a524bd613f9 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:11.686727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b7ab734a-fadf-47f2-b9ae-8c64e3a8626f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:11.706277 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b7ab734a-fadf-47f2-b9ae-8c64e3a8626f tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1680 microversion: 2.1 time: 0.936386 Aug 09 14:40:11.706883 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1205/2454] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:10 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1680 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:11.710962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-c83976b4-6e25-4121-8a9c-9a524bd613f9 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:11.759948 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c83976b4-6e25-4121-8a9c-9a524bd613f9 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1929 microversion: 2.75 time: 0.504905 Aug 09 14:40:11.761944 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1250/2455] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:11 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1929 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:40:11.767573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-493361db-c5dd-419e-94c7-f73e0def346d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:11.768721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-493361db-c5dd-419e-94c7-f73e0def346d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:11.788360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-493361db-c5dd-419e-94c7-f73e0def346d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:11.793811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-493361db-c5dd-419e-94c7-f73e0def346d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:11.795829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-493361db-c5dd-419e-94c7-f73e0def346d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:11.796689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-493361db-c5dd-419e-94c7-f73e0def346d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:11.804344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-493361db-c5dd-419e-94c7-f73e0def346d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:11.804344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-493361db-c5dd-419e-94c7-f73e0def346d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:12.212276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91b6f6cf-cb57-4f65-b070-32d678463b17 tempest-SecurityGroupsTestAdminJSON-814276715 tempest-SecurityGroupsTestAdminJSON-814276715-project] Action: 'create', calling method: .version_select at 0x7f41ddd804c0>, body: {"security_group": {"name": "tempest-securitygroup-811462200", "description": "tempest-description-208094966"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:12.340365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-493361db-c5dd-419e-94c7-f73e0def346d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:12.350016 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-493361db-c5dd-419e-94c7-f73e0def346d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1518 microversion: 2.1 time: 0.586652 Aug 09 14:40:12.354152 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1251/2456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:11 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1518 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:12.369374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d9c5e0d-5404-4a6b-8073-7289d7b7ee77 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:12.383752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d9c5e0d-5404-4a6b-8073-7289d7b7ee77 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:12.404411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d9c5e0d-5404-4a6b-8073-7289d7b7ee77 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:12.405764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d9c5e0d-5404-4a6b-8073-7289d7b7ee77 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:12.406305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d9c5e0d-5404-4a6b-8073-7289d7b7ee77 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:12.409605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d9c5e0d-5404-4a6b-8073-7289d7b7ee77 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:12.410172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d9c5e0d-5404-4a6b-8073-7289d7b7ee77 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:12.410676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d9c5e0d-5404-4a6b-8073-7289d7b7ee77 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:12.489341 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d9c5e0d-5404-4a6b-8073-7289d7b7ee77 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.130642 Aug 09 14:40:12.491428 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1252/2457] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:40:12 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:12.503625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ddaf50fb-38fa-435a-b0fb-0e467a77ef63 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:12.504673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ddaf50fb-38fa-435a-b0fb-0e467a77ef63 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:12.514725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddaf50fb-38fa-435a-b0fb-0e467a77ef63 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:12.527394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddaf50fb-38fa-435a-b0fb-0e467a77ef63 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:12.527941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddaf50fb-38fa-435a-b0fb-0e467a77ef63 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:12.528667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddaf50fb-38fa-435a-b0fb-0e467a77ef63 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:12.529123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddaf50fb-38fa-435a-b0fb-0e467a77ef63 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:12.529545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddaf50fb-38fa-435a-b0fb-0e467a77ef63 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:12.710757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ddaf50fb-38fa-435a-b0fb-0e467a77ef63 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:12.726172 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ddaf50fb-38fa-435a-b0fb-0e467a77ef63 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1275 microversion: 2.1 time: 0.233081 Aug 09 14:40:12.726634 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1253/2458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:12 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1275 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:12.737904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7afbcd4a-f27e-410e-89fa-1c1f5ed38b16 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:12.738532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7afbcd4a-f27e-410e-89fa-1c1f5ed38b16 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:12.765943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7afbcd4a-f27e-410e-89fa-1c1f5ed38b16 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:12.766646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7afbcd4a-f27e-410e-89fa-1c1f5ed38b16 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:12.767471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7afbcd4a-f27e-410e-89fa-1c1f5ed38b16 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:12.768391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7afbcd4a-f27e-410e-89fa-1c1f5ed38b16 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:12.768993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7afbcd4a-f27e-410e-89fa-1c1f5ed38b16 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:12.774288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7afbcd4a-f27e-410e-89fa-1c1f5ed38b16 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:13.764165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7afbcd4a-f27e-410e-89fa-1c1f5ed38b16 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:13.775798 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7afbcd4a-f27e-410e-89fa-1c1f5ed38b16 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1500 microversion: 2.1 time: 1.044907 Aug 09 14:40:13.778919 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1254/2459] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:12 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1500 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:13.798507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eaa52cc3-ade8-4186-981d-d17855712eeb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:13.801136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eaa52cc3-ade8-4186-981d-d17855712eeb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:13.832366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaa52cc3-ade8-4186-981d-d17855712eeb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:13.833918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaa52cc3-ade8-4186-981d-d17855712eeb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:13.834574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaa52cc3-ade8-4186-981d-d17855712eeb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:13.835541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaa52cc3-ade8-4186-981d-d17855712eeb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:13.836203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaa52cc3-ade8-4186-981d-d17855712eeb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:13.836848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaa52cc3-ade8-4186-981d-d17855712eeb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:13.958125 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91b6f6cf-cb57-4f65-b070-32d678463b17 tempest-SecurityGroupsTestAdminJSON-814276715 tempest-SecurityGroupsTestAdminJSON-814276715-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.250133 Aug 09 14:40:13.968016 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1206/2460] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:40:11 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:13.972867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79eb53c8-2bb7-4dda-a4e9-a777be885a5d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:13.973475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-79eb53c8-2bb7-4dda-a4e9-a777be885a5d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:14.003986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79eb53c8-2bb7-4dda-a4e9-a777be885a5d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:14.007287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79eb53c8-2bb7-4dda-a4e9-a777be885a5d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:14.011142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79eb53c8-2bb7-4dda-a4e9-a777be885a5d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:14.020768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79eb53c8-2bb7-4dda-a4e9-a777be885a5d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:14.021680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eaa52cc3-ade8-4186-981d-d17855712eeb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68639dd3894d4af7a49f3ffee8beb889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec96cdb5ea0f42c6ad2044517c6dbffa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:14.021924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79eb53c8-2bb7-4dda-a4e9-a777be885a5d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:14.022556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79eb53c8-2bb7-4dda-a4e9-a777be885a5d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:14.031684 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eaa52cc3-ade8-4186-981d-d17855712eeb tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 200 len: 1613 microversion: 2.1 time: 0.251319 Aug 09 14:40:14.032399 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1255/2461] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:13 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 1613 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:14.037664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa4cdc67-5700-4938-9a48-b17d808494de tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:14.038280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa4cdc67-5700-4938-9a48-b17d808494de tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:14.052521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa4cdc67-5700-4938-9a48-b17d808494de tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:14.053009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa4cdc67-5700-4938-9a48-b17d808494de tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:14.053441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa4cdc67-5700-4938-9a48-b17d808494de tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:14.054146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa4cdc67-5700-4938-9a48-b17d808494de tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:14.054589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa4cdc67-5700-4938-9a48-b17d808494de tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:14.055004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa4cdc67-5700-4938-9a48-b17d808494de tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:14.159852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-79eb53c8-2bb7-4dda-a4e9-a777be885a5d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:14.240077 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-79eb53c8-2bb7-4dda-a4e9-a777be885a5d tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1935 microversion: 2.75 time: 0.270839 Aug 09 14:40:14.240695 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1207/2462] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:13 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1935 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:40:14.253298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-750d4fdc-fd44-483b-a8f5-ecff50c1155e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:14.270752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-750d4fdc-fd44-483b-a8f5-ecff50c1155e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:14.293439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-750d4fdc-fd44-483b-a8f5-ecff50c1155e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:14.296120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-750d4fdc-fd44-483b-a8f5-ecff50c1155e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:14.296591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-750d4fdc-fd44-483b-a8f5-ecff50c1155e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:14.297327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-750d4fdc-fd44-483b-a8f5-ecff50c1155e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:14.297790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-750d4fdc-fd44-483b-a8f5-ecff50c1155e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:14.305074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-750d4fdc-fd44-483b-a8f5-ecff50c1155e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:14.419010 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-750d4fdc-fd44-483b-a8f5-ecff50c1155e tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176055 Aug 09 14:40:14.422909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fa4cdc67-5700-4938-9a48-b17d808494de tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:14.423801 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1208/2463] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:40:14 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:14.432107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ecdc08fe-791b-4d8c-9e82-48a39ad83b12 req-ed9584f2-cf96-4abf-96c1-0831a4ab66c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa831790-4a10-456d-bfc3-72ca22cb40a5", "name": "network-vif-deleted", "tag": "9a914ca2-408c-4fab-9a17-50495a71b5b3"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:14.435216 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa4cdc67-5700-4938-9a48-b17d808494de tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1518 microversion: 2.1 time: 0.397907 Aug 09 14:40:14.435946 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1256/2464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:14 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1518 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:14.449745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4577b715-9cd1-488e-899f-6806155fdb33 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:14.450380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4577b715-9cd1-488e-899f-6806155fdb33 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:14.456000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ecdc08fe-791b-4d8c-9e82-48a39ad83b12 req-ed9584f2-cf96-4abf-96c1-0831a4ab66c3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:14.456470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ecdc08fe-791b-4d8c-9e82-48a39ad83b12 req-ed9584f2-cf96-4abf-96c1-0831a4ab66c3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:14.457056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ecdc08fe-791b-4d8c-9e82-48a39ad83b12 req-ed9584f2-cf96-4abf-96c1-0831a4ab66c3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:14.473221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:14.473662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:14.484835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4577b715-9cd1-488e-899f-6806155fdb33 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:14.485575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4577b715-9cd1-488e-899f-6806155fdb33 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:14.486208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4577b715-9cd1-488e-899f-6806155fdb33 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:14.487150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4577b715-9cd1-488e-899f-6806155fdb33 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:14.487783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4577b715-9cd1-488e-899f-6806155fdb33 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:14.488451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4577b715-9cd1-488e-899f-6806155fdb33 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:14.490028 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ecdc08fe-791b-4d8c-9e82-48a39ad83b12 req-ed9584f2-cf96-4abf-96c1-0831a4ab66c3 service nova] Creating event network-vif-deleted:9a914ca2-408c-4fab-9a17-50495a71b5b3 for instance fa831790-4a10-456d-bfc3-72ca22cb40a5 on n-h1-844626-8 Aug 09 14:40:14.496671 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ecdc08fe-791b-4d8c-9e82-48a39ad83b12 req-ed9584f2-cf96-4abf-96c1-0831a4ab66c3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070919 Aug 09 14:40:14.498751 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1209/2465] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:14.513331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db4b4182-8e65-4b7e-8e5e-ca1c2a56a07c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:14.517649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db4b4182-8e65-4b7e-8e5e-ca1c2a56a07c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:14.536161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4b4182-8e65-4b7e-8e5e-ca1c2a56a07c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:14.538302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4b4182-8e65-4b7e-8e5e-ca1c2a56a07c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:14.541911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4b4182-8e65-4b7e-8e5e-ca1c2a56a07c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:14.543282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4b4182-8e65-4b7e-8e5e-ca1c2a56a07c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:14.543888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4b4182-8e65-4b7e-8e5e-ca1c2a56a07c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:14.544447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4b4182-8e65-4b7e-8e5e-ca1c2a56a07c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:15.164131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=69 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:15.500863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4577b715-9cd1-488e-899f-6806155fdb33 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:15.513932 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4577b715-9cd1-488e-899f-6806155fdb33 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1317 microversion: 2.1 time: 1.075847 Aug 09 14:40:15.518021 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1257/2466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:14 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1317 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:15.530463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1f6884b7-a030-49bf-a172-5e4197b1025e tempest-SecurityGroupsTestAdminJSON-814276715 tempest-SecurityGroupsTestAdminJSON-814276715-project] Action: 'create', calling method: .version_select at 0x7f41dcb39040>, body: {"security_group": {"name": "tempest-securitygroup-1452492522", "description": "tempest-description-1906635775"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:15.849095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-db4b4182-8e65-4b7e-8e5e-ca1c2a56a07c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:15.878939 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db4b4182-8e65-4b7e-8e5e-ca1c2a56a07c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1500 microversion: 2.1 time: 1.377591 Aug 09 14:40:15.880341 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1210/2467] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:14 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1500 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:15.890900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31029e6b-3d9f-486f-9f31-46b394eec3c7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:15.895778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31029e6b-3d9f-486f-9f31-46b394eec3c7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] [instance: fa831790-4a10-456d-bfc3-72ca22cb40a5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:15.913216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31029e6b-3d9f-486f-9f31-46b394eec3c7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:15.914360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31029e6b-3d9f-486f-9f31-46b394eec3c7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:15.917001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31029e6b-3d9f-486f-9f31-46b394eec3c7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:15.919788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31029e6b-3d9f-486f-9f31-46b394eec3c7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:15.922698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31029e6b-3d9f-486f-9f31-46b394eec3c7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:15.923628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31029e6b-3d9f-486f-9f31-46b394eec3c7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:15.957880 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-31029e6b-3d9f-486f-9f31-46b394eec3c7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] HTTP exception thrown: Instance fa831790-4a10-456d-bfc3-72ca22cb40a5 could not be found. Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31029e6b-3d9f-486f-9f31-46b394eec3c7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Request method failure captured: Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 HTTP/1.1 Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nEswfPRobhN7BagGEQ9MP7FveFH0yNHRx_plgjf7xw3bsbaI1poqOmkBL447FavGvsjfv6FwW2NM5KLixin--gZXFH5eK2Y3xthPv8p8u5LxbcqL7W2h-DXrifiJd6PMqAQYLo7Vaalue8iy22YS2svcyTnmKjZIVvTK1LGqpxHqto Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ec96cdb5ea0f42c6ad2044517c6dbffa Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesAdminNegativeTest-1800734423 Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ec96cdb5ea0f42c6ad2044517c6dbffa", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ec96cdb5ea0f42c6ad2044517c6dbffa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ec96cdb5ea0f42c6ad2044517c6dbffa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ec96cdb5ea0f42c6ad2044517c6dbffa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-VolumesAdminNegativeTest-1800734423 Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ec96cdb5ea0f42c6ad2044517c6dbffa Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1800734423 Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-VolumesAdminNegativeTest-1800734423-project Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 68639dd3894d4af7a49f3ffee8beb889 Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-VolumesAdminNegativeTest-1800734423-project Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance fa831790-4a10-456d-bfc3-72ca22cb40a5 could not be found. Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'fa831790-4a10-456d-bfc3-72ca22cb40a5'} Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa831790-4a10-456d-bfc3-72ca22cb40a5 could not be found. Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa831790-4a10-456d-bfc3-72ca22cb40a5 could not be found. Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:15.968738 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:15.975069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:15.975069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:15.975069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:15.975069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:15.975069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:15.975069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa831790-4a10-456d-bfc3-72ca22cb40a5 could not be found. Aug 09 14:40:15.975069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:15.979866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31029e6b-3d9f-486f-9f31-46b394eec3c7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Returning 404 to user: Instance fa831790-4a10-456d-bfc3-72ca22cb40a5 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:15.981591 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31029e6b-3d9f-486f-9f31-46b394eec3c7 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5" status: 404 len: 111 microversion: 2.1 time: 0.098934 Aug 09 14:40:15.984528 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1211/2468] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:15 2022] GET /compute/v2.1/servers/fa831790-4a10-456d-bfc3-72ca22cb40a5 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:40:15.992338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17e5f0f4-17a8-4dbc-bd6f-8d8f8728a3e1 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:15.993094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17e5f0f4-17a8-4dbc-bd6f-8d8f8728a3e1 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:16.002760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17e5f0f4-17a8-4dbc-bd6f-8d8f8728a3e1 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:16.003719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17e5f0f4-17a8-4dbc-bd6f-8d8f8728a3e1 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:16.004639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17e5f0f4-17a8-4dbc-bd6f-8d8f8728a3e1 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:16.005691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17e5f0f4-17a8-4dbc-bd6f-8d8f8728a3e1 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:16.006353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17e5f0f4-17a8-4dbc-bd6f-8d8f8728a3e1 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:16.007009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17e5f0f4-17a8-4dbc-bd6f-8d8f8728a3e1 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:16.326132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-17e5f0f4-17a8-4dbc-bd6f-8d8f8728a3e1 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] Lazy-loading 'services' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:16.334128 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1f6884b7-a030-49bf-a172-5e4197b1025e tempest-SecurityGroupsTestAdminJSON-814276715 tempest-SecurityGroupsTestAdminJSON-814276715-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.814568 Aug 09 14:40:16.337922 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1258/2469] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:40:15 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:16.347548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72e2a479-1f46-4633-8c93-b4b22bc281df tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:16.355284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-72e2a479-1f46-4633-8c93-b4b22bc281df tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:16.389551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e2a479-1f46-4633-8c93-b4b22bc281df tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:16.390346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e2a479-1f46-4633-8c93-b4b22bc281df tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:16.399107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e2a479-1f46-4633-8c93-b4b22bc281df tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:16.408066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e2a479-1f46-4633-8c93-b4b22bc281df tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:16.408842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e2a479-1f46-4633-8c93-b4b22bc281df tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:16.409433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e2a479-1f46-4633-8c93-b4b22bc281df tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:16.421384 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17e5f0f4-17a8-4dbc-bd6f-8d8f8728a3e1 tempest-ServersAdmin275Test-1335219014 tempest-ServersAdmin275Test-1335219014-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1920 microversion: 2.75 time: 0.435563 Aug 09 14:40:16.425716 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1212/2470] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:15 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1920 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:40:16.437966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8042bba6-2122-4fbb-b485-fa75aabf6471 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:16.440368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8042bba6-2122-4fbb-b485-fa75aabf6471 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:16.469551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8042bba6-2122-4fbb-b485-fa75aabf6471 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:16.472240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8042bba6-2122-4fbb-b485-fa75aabf6471 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:16.473609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8042bba6-2122-4fbb-b485-fa75aabf6471 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:16.489340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8042bba6-2122-4fbb-b485-fa75aabf6471 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:16.490659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8042bba6-2122-4fbb-b485-fa75aabf6471 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:16.491359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8042bba6-2122-4fbb-b485-fa75aabf6471 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:16.531879 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72e2a479-1f46-4633-8c93-b4b22bc281df tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192427 Aug 09 14:40:16.536765 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1259/2471] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:40:16 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:16.542501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32836140-fc4e-40e1-b38d-8972118ed5af tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:16.546984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32836140-fc4e-40e1-b38d-8972118ed5af tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:16.571740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32836140-fc4e-40e1-b38d-8972118ed5af tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:16.574324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32836140-fc4e-40e1-b38d-8972118ed5af tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:16.574971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32836140-fc4e-40e1-b38d-8972118ed5af tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:16.579005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32836140-fc4e-40e1-b38d-8972118ed5af tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:16.580079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32836140-fc4e-40e1-b38d-8972118ed5af tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:16.580709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32836140-fc4e-40e1-b38d-8972118ed5af tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:16.640783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32836140-fc4e-40e1-b38d-8972118ed5af tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:40:16.770270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=11,nova_api:INSERT=9 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:16.777246 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32836140-fc4e-40e1-b38d-8972118ed5af tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 204 len: 0 microversion: 2.1 time: 0.238920 Aug 09 14:40:16.778570 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1260/2472] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:40:16 2022] DELETE /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:40:16.785325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91c57853-7da6-44a9-af09-88f94f93c433 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] Calling method '.version_select at 0x7f41e751da60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:16.812185 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91c57853-7da6-44a9-af09-88f94f93c433 tempest-VolumesAdminNegativeTest-1800734423 tempest-VolumesAdminNegativeTest-1800734423-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1490370686" status: 202 len: 0 microversion: 2.1 time: 0.030341 Aug 09 14:40:16.816438 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1261/2473] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 14:40:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1490370686 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:40:16.890153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93ea4005-41c5-4577-8b74-58ea286ce1de tempest-SecurityGroupsTestAdminJSON-954960899 tempest-SecurityGroupsTestAdminJSON-954960899-project-admin] Action: 'create', calling method: .version_select at 0x7f41dca3f0d0>, body: {"security_group": {"name": "tempest-securitygroup-1591521347", "description": "tempest-description-273044909"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:17.546105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=17 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:17.695619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8042bba6-2122-4fbb-b485-fa75aabf6471 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:17.704792 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8042bba6-2122-4fbb-b485-fa75aabf6471 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1518 microversion: 2.1 time: 1.274942 Aug 09 14:40:17.714399 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1213/2474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:16 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1518 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:17.719816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60f7dfec-055b-4ff2-978b-ca4461f5a6ab tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:17.720524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60f7dfec-055b-4ff2-978b-ca4461f5a6ab tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:17.737987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f7dfec-055b-4ff2-978b-ca4461f5a6ab tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:17.738825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f7dfec-055b-4ff2-978b-ca4461f5a6ab tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:17.739493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f7dfec-055b-4ff2-978b-ca4461f5a6ab tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:17.740491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f7dfec-055b-4ff2-978b-ca4461f5a6ab tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:17.741126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f7dfec-055b-4ff2-978b-ca4461f5a6ab tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:17.741749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f7dfec-055b-4ff2-978b-ca4461f5a6ab tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:17.803599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60f7dfec-055b-4ff2-978b-ca4461f5a6ab tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:40:17.884270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=49 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:17.987744 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60f7dfec-055b-4ff2-978b-ca4461f5a6ab tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 204 len: 0 microversion: 2.75 time: 0.271576 Aug 09 14:40:17.992683 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1214/2475] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:40:17 2022] DELETE /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:40:18.046396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4712029-db7c-4943-8c10-435bfb1ab42b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:18.048007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4712029-db7c-4943-8c10-435bfb1ab42b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:18.061587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4712029-db7c-4943-8c10-435bfb1ab42b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:18.062206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4712029-db7c-4943-8c10-435bfb1ab42b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:18.062771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4712029-db7c-4943-8c10-435bfb1ab42b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:18.063573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4712029-db7c-4943-8c10-435bfb1ab42b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:18.065574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4712029-db7c-4943-8c10-435bfb1ab42b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:18.066233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4712029-db7c-4943-8c10-435bfb1ab42b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:18.351273 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93ea4005-41c5-4577-8b74-58ea286ce1de tempest-SecurityGroupsTestAdminJSON-954960899 tempest-SecurityGroupsTestAdminJSON-954960899-project-admin] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.531828 Aug 09 14:40:18.353099 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1262/2476] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:40:16 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:18.362893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ef674e0d-3e96-4e9e-82bc-f5d468fc0682 req-d0decd92-f924-4d25-b80b-0f905c238933 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f61de9f-77ce-4797-a4cf-6005d3c64092", "tag": "f033813f-a028-456e-9341-0cb54066aa57"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:18.406319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ef674e0d-3e96-4e9e-82bc-f5d468fc0682 req-d0decd92-f924-4d25-b80b-0f905c238933 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:18.407212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ef674e0d-3e96-4e9e-82bc-f5d468fc0682 req-d0decd92-f924-4d25-b80b-0f905c238933 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:18.407844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ef674e0d-3e96-4e9e-82bc-f5d468fc0682 req-d0decd92-f924-4d25-b80b-0f905c238933 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:18.423117 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ef674e0d-3e96-4e9e-82bc-f5d468fc0682 req-d0decd92-f924-4d25-b80b-0f905c238933 service nova] Creating event network-changed:f033813f-a028-456e-9341-0cb54066aa57 for instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 on n-h1-844626-8 Aug 09 14:40:18.432699 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ef674e0d-3e96-4e9e-82bc-f5d468fc0682 req-d0decd92-f924-4d25-b80b-0f905c238933 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078007 Aug 09 14:40:18.434115 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1263/2477] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:18.441548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-777a9aec-8b02-4ea1-945f-26c0b96f1789 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:18.442746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-777a9aec-8b02-4ea1-945f-26c0b96f1789 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:18.451556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-777a9aec-8b02-4ea1-945f-26c0b96f1789 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:18.452378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-777a9aec-8b02-4ea1-945f-26c0b96f1789 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:18.452999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-777a9aec-8b02-4ea1-945f-26c0b96f1789 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:18.453884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-777a9aec-8b02-4ea1-945f-26c0b96f1789 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:18.454680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-777a9aec-8b02-4ea1-945f-26c0b96f1789 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:18.455329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-777a9aec-8b02-4ea1-945f-26c0b96f1789 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:18.617353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4712029-db7c-4943-8c10-435bfb1ab42b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:18.630405 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4712029-db7c-4943-8c10-435bfb1ab42b tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1317 microversion: 2.1 time: 0.629798 Aug 09 14:40:18.631021 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1215/2478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:17 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1317 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:18.643834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41fd77a9-d000-4b9f-8844-be461d557f1f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:18.648846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-41fd77a9-d000-4b9f-8844-be461d557f1f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:18.669176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41fd77a9-d000-4b9f-8844-be461d557f1f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:18.670935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41fd77a9-d000-4b9f-8844-be461d557f1f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:18.672408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41fd77a9-d000-4b9f-8844-be461d557f1f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:18.672408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41fd77a9-d000-4b9f-8844-be461d557f1f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:18.672613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41fd77a9-d000-4b9f-8844-be461d557f1f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:18.674249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41fd77a9-d000-4b9f-8844-be461d557f1f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:18.775200 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-41fd77a9-d000-4b9f-8844-be461d557f1f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113331 Aug 09 14:40:18.778006 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1216/2479] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:40:18 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:18.810681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c453c7bd-37f4-4297-a459-3106d5624b91 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:18.814718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c453c7bd-37f4-4297-a459-3106d5624b91 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:18.836075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c453c7bd-37f4-4297-a459-3106d5624b91 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:18.836830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c453c7bd-37f4-4297-a459-3106d5624b91 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:18.837696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c453c7bd-37f4-4297-a459-3106d5624b91 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:18.838758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c453c7bd-37f4-4297-a459-3106d5624b91 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:18.839796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c453c7bd-37f4-4297-a459-3106d5624b91 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:18.840597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c453c7bd-37f4-4297-a459-3106d5624b91 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:18.931250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-777a9aec-8b02-4ea1-945f-26c0b96f1789 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:18.943914 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-777a9aec-8b02-4ea1-945f-26c0b96f1789 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1506 microversion: 2.1 time: 0.506068 Aug 09 14:40:18.946606 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1264/2480] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:18 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:18.969098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dba638d4-b692-4d0b-9277-8a8cab98b00b tempest-SecurityGroupsTestAdminJSON-954960899 tempest-SecurityGroupsTestAdminJSON-954960899-project-admin] Action: 'create', calling method: .version_select at 0x7f41e7528c10>, body: {"security_group": {"name": "tempest-securitygroup-1615291683", "description": "tempest-description-1911553706"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:19.063461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c453c7bd-37f4-4297-a459-3106d5624b91 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:19.076246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c453c7bd-37f4-4297-a459-3106d5624b91 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:19.080297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c453c7bd-37f4-4297-a459-3106d5624b91 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:19.092631 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c453c7bd-37f4-4297-a459-3106d5624b91 tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1444 microversion: 2.75 time: 0.313047 Aug 09 14:40:19.119765 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1217/2481] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:18 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1444 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:40:19.130422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc494124-9146-4f26-9248-b7eca264c390 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:19.133569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc494124-9146-4f26-9248-b7eca264c390 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:19.148297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc494124-9146-4f26-9248-b7eca264c390 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:19.149821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc494124-9146-4f26-9248-b7eca264c390 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:19.153205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc494124-9146-4f26-9248-b7eca264c390 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:19.154176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc494124-9146-4f26-9248-b7eca264c390 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:19.154820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc494124-9146-4f26-9248-b7eca264c390 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:19.155484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc494124-9146-4f26-9248-b7eca264c390 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:19.812673 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dba638d4-b692-4d0b-9277-8a8cab98b00b tempest-SecurityGroupsTestAdminJSON-954960899 tempest-SecurityGroupsTestAdminJSON-954960899-project-admin] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.853582 Aug 09 14:40:19.820857 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1265/2482] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:40:18 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:19.837794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-50a46356-72c8-4c7a-8835-c09850f8ae19 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:19.838465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-50a46356-72c8-4c7a-8835-c09850f8ae19 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:19.849959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bc494124-9146-4f26-9248-b7eca264c390 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:19.859542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a46356-72c8-4c7a-8835-c09850f8ae19 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:19.860032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a46356-72c8-4c7a-8835-c09850f8ae19 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:19.860404 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc494124-9146-4f26-9248-b7eca264c390 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1524 microversion: 2.1 time: 0.737024 Aug 09 14:40:19.860536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a46356-72c8-4c7a-8835-c09850f8ae19 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:19.871434 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1218/2483] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:19 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1524 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:19.871526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a46356-72c8-4c7a-8835-c09850f8ae19 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:19.871526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a46356-72c8-4c7a-8835-c09850f8ae19 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:19.871526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50a46356-72c8-4c7a-8835-c09850f8ae19 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:19.886943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-80ed2980-89f8-407b-acf1-8ade35414bd0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:19.897265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-80ed2980-89f8-407b-acf1-8ade35414bd0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:19.944797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80ed2980-89f8-407b-acf1-8ade35414bd0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:19.955466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80ed2980-89f8-407b-acf1-8ade35414bd0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:19.956456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80ed2980-89f8-407b-acf1-8ade35414bd0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:19.959140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80ed2980-89f8-407b-acf1-8ade35414bd0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:19.967206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80ed2980-89f8-407b-acf1-8ade35414bd0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:19.968030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80ed2980-89f8-407b-acf1-8ade35414bd0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:20.069377 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-80ed2980-89f8-407b-acf1-8ade35414bd0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197833 Aug 09 14:40:20.081081 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1219/2484] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:40:19 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:20.086922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eefcfb9c-4e42-42aa-81c4-343029880809 tempest-SecurityGroupsTestAdminJSON-954960899 tempest-SecurityGroupsTestAdminJSON-954960899-project-admin] Calling method '.version_select at 0x7f41de17d820>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:20.185689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-50a46356-72c8-4c7a-8835-c09850f8ae19 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:20.229413 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50a46356-72c8-4c7a-8835-c09850f8ae19 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1317 microversion: 2.1 time: 0.400346 Aug 09 14:40:20.247971 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1266/2485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:19 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1317 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:20.259287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5aabe41d-8de9-41bc-9276-2ab2a77064c3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:20.259911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5aabe41d-8de9-41bc-9276-2ab2a77064c3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:20.285111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5aabe41d-8de9-41bc-9276-2ab2a77064c3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:20.285605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5aabe41d-8de9-41bc-9276-2ab2a77064c3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:20.286033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5aabe41d-8de9-41bc-9276-2ab2a77064c3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:20.286775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5aabe41d-8de9-41bc-9276-2ab2a77064c3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:20.287263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5aabe41d-8de9-41bc-9276-2ab2a77064c3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:20.287681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5aabe41d-8de9-41bc-9276-2ab2a77064c3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:21.146199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5aabe41d-8de9-41bc-9276-2ab2a77064c3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:21.154487 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5aabe41d-8de9-41bc-9276-2ab2a77064c3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 200 len: 1506 microversion: 2.1 time: 0.905299 Aug 09 14:40:21.160933 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1267/2486] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:20 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 1506 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:21.168591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:21.170252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:21.180967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:21.181697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:21.182542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:21.183664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:21.184287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:21.184849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:21.325585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:21.328119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:21.329256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:21.331540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lazy-loading 'fault' on Instance uuid d1d8bb2a-372a-4072-89ff-71a39c98b9b3 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:21.336646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:21.496935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:21.530638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:21.532198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f2ad1801beca404da231563a6f2fe67f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ede6465aee52454782e0ce78386f5f8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:21.567159 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6e50dbd9-7d57-4507-aa79-d873a5c0c30e tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 200 len: 1449 microversion: 2.75 time: 0.404872 Aug 09 14:40:21.579863 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1268/2487] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:21 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 1449 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:40:21.593109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d8a29e9-79c2-4c9e-b24b-beb8a53a46b4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:21.593745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d8a29e9-79c2-4c9e-b24b-beb8a53a46b4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:21.623834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d8a29e9-79c2-4c9e-b24b-beb8a53a46b4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:21.625582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d8a29e9-79c2-4c9e-b24b-beb8a53a46b4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:21.626027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d8a29e9-79c2-4c9e-b24b-beb8a53a46b4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:21.626747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d8a29e9-79c2-4c9e-b24b-beb8a53a46b4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:21.630988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d8a29e9-79c2-4c9e-b24b-beb8a53a46b4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:21.631469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d8a29e9-79c2-4c9e-b24b-beb8a53a46b4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:22.311795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d8a29e9-79c2-4c9e-b24b-beb8a53a46b4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:22.321238 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d8a29e9-79c2-4c9e-b24b-beb8a53a46b4 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1524 microversion: 2.1 time: 0.738888 Aug 09 14:40:22.328118 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1269/2488] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:21 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1524 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:22.333797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f3ed0520-6167-4bf0-9bc8-84993d091720 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:22.338145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f3ed0520-6167-4bf0-9bc8-84993d091720 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:22.366494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3ed0520-6167-4bf0-9bc8-84993d091720 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:22.367547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3ed0520-6167-4bf0-9bc8-84993d091720 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:22.368338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3ed0520-6167-4bf0-9bc8-84993d091720 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:22.374818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3ed0520-6167-4bf0-9bc8-84993d091720 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:22.375673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3ed0520-6167-4bf0-9bc8-84993d091720 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:22.376298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3ed0520-6167-4bf0-9bc8-84993d091720 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:22.473567 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f3ed0520-6167-4bf0-9bc8-84993d091720 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.144027 Aug 09 14:40:22.479222 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1270/2489] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:40:22 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1/os-volume_attachments => generated 25 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:40:22.479222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ffd3e07c-8c30-40fe-b1b8-e2700816526e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:22.495017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffd3e07c-8c30-40fe-b1b8-e2700816526e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:22.526337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffd3e07c-8c30-40fe-b1b8-e2700816526e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:22.536483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffd3e07c-8c30-40fe-b1b8-e2700816526e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:22.541146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffd3e07c-8c30-40fe-b1b8-e2700816526e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:22.541921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffd3e07c-8c30-40fe-b1b8-e2700816526e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:22.542373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffd3e07c-8c30-40fe-b1b8-e2700816526e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:22.543151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffd3e07c-8c30-40fe-b1b8-e2700816526e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:22.894998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffd3e07c-8c30-40fe-b1b8-e2700816526e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:22.907373 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ffd3e07c-8c30-40fe-b1b8-e2700816526e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1317 microversion: 2.1 time: 0.432119 Aug 09 14:40:22.909468 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1271/2490] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:22 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:22.919637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-c4f03576-1053-425b-8a6f-42587c4d5363 req-0ecffed8-aae7-4113-bf0c-2008dc414099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2b61a3-4691-42de-be5c-4e13b1665984", "name": "network-vif-deleted", "tag": "39bb8b03-7aec-4785-8277-60d9befab1e0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:22.940434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c4f03576-1053-425b-8a6f-42587c4d5363 req-0ecffed8-aae7-4113-bf0c-2008dc414099 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:22.943675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c4f03576-1053-425b-8a6f-42587c4d5363 req-0ecffed8-aae7-4113-bf0c-2008dc414099 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:22.944357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c4f03576-1053-425b-8a6f-42587c4d5363 req-0ecffed8-aae7-4113-bf0c-2008dc414099 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:22.973692 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-c4f03576-1053-425b-8a6f-42587c4d5363 req-0ecffed8-aae7-4113-bf0c-2008dc414099 service nova] Creating event network-vif-deleted:39bb8b03-7aec-4785-8277-60d9befab1e0 for instance 6e2b61a3-4691-42de-be5c-4e13b1665984 on n-h2-844626-8 Aug 09 14:40:22.985263 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-c4f03576-1053-425b-8a6f-42587c4d5363 req-0ecffed8-aae7-4113-bf0c-2008dc414099 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066926 Aug 09 14:40:22.987498 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1272/2491] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:23.005243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dcfa14ec-745b-4108-bf4d-5e899b4340f3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:23.010614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dcfa14ec-745b-4108-bf4d-5e899b4340f3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:23.034813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcfa14ec-745b-4108-bf4d-5e899b4340f3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:23.039360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcfa14ec-745b-4108-bf4d-5e899b4340f3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:23.039900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcfa14ec-745b-4108-bf4d-5e899b4340f3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:23.043527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcfa14ec-745b-4108-bf4d-5e899b4340f3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:23.045886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcfa14ec-745b-4108-bf4d-5e899b4340f3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:23.046953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcfa14ec-745b-4108-bf4d-5e899b4340f3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:23.068469 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-dcfa14ec-745b-4108-bf4d-5e899b4340f3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dcfa14ec-745b-4108-bf4d-5e899b4340f3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 HTTP/1.1 Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '6e2b61a3-4691-42de-be5c-4e13b1665984'} Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:23.070351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:23.074767 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:23.074767 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:23.074767 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:23.074767 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:23.074767 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:40:23.074767 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:23.075180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dcfa14ec-745b-4108-bf4d-5e899b4340f3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:23.076153 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dcfa14ec-745b-4108-bf4d-5e899b4340f3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 404 len: 111 microversion: 2.1 time: 0.087275 Aug 09 14:40:23.084504 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1273/2492] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:22 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:40:23.086857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d7a1888-58cb-4aff-a2f5-ee0b1b25624c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:23.087768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d7a1888-58cb-4aff-a2f5-ee0b1b25624c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] [instance: d1d8bb2a-372a-4072-89ff-71a39c98b9b3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:23.095544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d7a1888-58cb-4aff-a2f5-ee0b1b25624c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:23.096162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d7a1888-58cb-4aff-a2f5-ee0b1b25624c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:23.096686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d7a1888-58cb-4aff-a2f5-ee0b1b25624c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:23.097556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d7a1888-58cb-4aff-a2f5-ee0b1b25624c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:23.098098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d7a1888-58cb-4aff-a2f5-ee0b1b25624c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:23.098601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d7a1888-58cb-4aff-a2f5-ee0b1b25624c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:23.116153 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-4d7a1888-58cb-4aff-a2f5-ee0b1b25624c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] HTTP exception thrown: Instance d1d8bb2a-372a-4072-89ff-71a39c98b9b3 could not be found. Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d7a1888-58cb-4aff-a2f5-ee0b1b25624c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Request method failure captured: Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 HTTP/1.1 Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGA9vcee4PAdjJ-rqgYSx_iM41plFS-f0euCRIe38Uxpa3B5d6v9LcFEstviKlfVlVCbUseo8yhzIO44jiRfrvSquf4-iL2CaVF_b1-cIleH099v0EXmujMcyXxK8XStXMZmz2YSFx54KOOJTivXDhDcdmnK_WvA4weGxjmuqs-NlU Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.75 Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: ede6465aee52454782e0ce78386f5f8e Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersAdmin275Test-400243672 Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ede6465aee52454782e0ce78386f5f8e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ede6465aee52454782e0ce78386f5f8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ede6465aee52454782e0ce78386f5f8e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ede6465aee52454782e0ce78386f5f8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersAdmin275Test-400243672 Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: ede6465aee52454782e0ce78386f5f8e Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersAdmin275Test-400243672 Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersAdmin275Test-400243672-project Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f2ad1801beca404da231563a6f2fe67f Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersAdmin275Test-400243672-project Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance d1d8bb2a-372a-4072-89ff-71a39c98b9b3 could not be found. Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'd1d8bb2a-372a-4072-89ff-71a39c98b9b3'} Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1d8bb2a-372a-4072-89ff-71a39c98b9b3 could not be found. Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1d8bb2a-372a-4072-89ff-71a39c98b9b3 could not be found. Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:23.118512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:23.122052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:23.122052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:23.122052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:23.122052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:23.122052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:23.122052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1d8bb2a-372a-4072-89ff-71a39c98b9b3 could not be found. Aug 09 14:40:23.122052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:23.123924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d7a1888-58cb-4aff-a2f5-ee0b1b25624c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] Returning 404 to user: Instance d1d8bb2a-372a-4072-89ff-71a39c98b9b3 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:23.125149 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d7a1888-58cb-4aff-a2f5-ee0b1b25624c tempest-ServersAdmin275Test-400243672 tempest-ServersAdmin275Test-400243672-project] 10.222.0.50 "GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3" status: 404 len: 111 microversion: 2.75 time: 0.047066 Aug 09 14:40:23.126266 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1274/2493] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:40:23 2022] GET /compute/v2.1/servers/d1d8bb2a-372a-4072-89ff-71a39c98b9b3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:40:23.141231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f4d70b9-51b2-4657-a5d6-edf7ef2490bd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:23.142132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f4d70b9-51b2-4657-a5d6-edf7ef2490bd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:23.153088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f4d70b9-51b2-4657-a5d6-edf7ef2490bd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:23.153980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f4d70b9-51b2-4657-a5d6-edf7ef2490bd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:23.154613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f4d70b9-51b2-4657-a5d6-edf7ef2490bd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:23.168707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f4d70b9-51b2-4657-a5d6-edf7ef2490bd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:23.171785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f4d70b9-51b2-4657-a5d6-edf7ef2490bd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:23.173037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f4d70b9-51b2-4657-a5d6-edf7ef2490bd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:23.241372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f4d70b9-51b2-4657-a5d6-edf7ef2490bd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:40:23.518275 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4f4d70b9-51b2-4657-a5d6-edf7ef2490bd tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 204 len: 0 microversion: 2.1 time: 0.388190 Aug 09 14:40:23.523056 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1275/2494] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:40:23 2022] DELETE /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:40:23.536010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f50502b4-3efa-41cf-94df-43128d49d8a0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'create', calling method: .version_select at 0x7f41dcab3ee0>, body: {"keypair": {"name": "tempest-key-1720558121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOgcXFqRUXrC7L3wfgVkVa6mZyEKam0yGR9Y2+vef/IGXcsq25iOA+1y0Ad6f60Dbn+a1HMOCxFVQHkzh2tG2ExcwFpP6wVgIpHCxhvYUN/QLzmXzQze8gdIT3NCiH+eQ=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:23.585085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-f50502b4-3efa-41cf-94df-43128d49d8a0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:40:23.593520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-f50502b4-3efa-41cf-94df-43128d49d8a0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for user 03bdf5ec21854ec8b6561a121ce1f1ef and project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:40:23.662312 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f50502b4-3efa-41cf-94df-43128d49d8a0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.137094 Aug 09 14:40:23.669828 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1276/2495] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:40:23 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:23.676211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-136f7f43-e22e-4e44-a86a-8c922c516c52 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:23.676962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-136f7f43-e22e-4e44-a86a-8c922c516c52 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:23.686172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-136f7f43-e22e-4e44-a86a-8c922c516c52 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:23.690029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-136f7f43-e22e-4e44-a86a-8c922c516c52 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:23.690485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-136f7f43-e22e-4e44-a86a-8c922c516c52 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:23.691417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-136f7f43-e22e-4e44-a86a-8c922c516c52 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:23.691988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-136f7f43-e22e-4e44-a86a-8c922c516c52 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:23.692271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-136f7f43-e22e-4e44-a86a-8c922c516c52 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:24.095001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-136f7f43-e22e-4e44-a86a-8c922c516c52 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:24.108184 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-136f7f43-e22e-4e44-a86a-8c922c516c52 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1524 microversion: 2.1 time: 0.436758 Aug 09 14:40:24.110969 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1277/2496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:23 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1524 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:24.126445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34130144-255a-4137-a4b5-e55ce580eb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:24.127995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34130144-255a-4137-a4b5-e55ce580eb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:24.142184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34130144-255a-4137-a4b5-e55ce580eb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:24.142971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34130144-255a-4137-a4b5-e55ce580eb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:24.143786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34130144-255a-4137-a4b5-e55ce580eb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:24.144741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34130144-255a-4137-a4b5-e55ce580eb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:24.147811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34130144-255a-4137-a4b5-e55ce580eb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:24.148296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34130144-255a-4137-a4b5-e55ce580eb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:24.526030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-34130144-255a-4137-a4b5-e55ce580eb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:24.537994 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34130144-255a-4137-a4b5-e55ce580eb37 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 200 len: 1680 microversion: 2.1 time: 0.425896 Aug 09 14:40:24.547221 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1278/2497] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:24 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 1680 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:24.559124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-666d959f-8a68-4f27-bc19-0721cd47d39b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '.version_select at 0x7f41e7528dc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:24.559124 n-d-844626-8 devstack@n-api.service[119407]: WARNING oslo_db.sqlalchemy.utils [None req-666d959f-8a68-4f27-bc19-0721cd47d39b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 09 14:40:24.585796 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-666d959f-8a68-4f27-bc19-0721cd47d39b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.041942 Aug 09 14:40:24.594182 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1279/2498] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:40:24 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:24.605465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1945b95f-26f4-4275-9baa-1666878c8ee8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:24.606808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1945b95f-26f4-4275-9baa-1666878c8ee8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:24.641487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1945b95f-26f4-4275-9baa-1666878c8ee8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:24.653740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1945b95f-26f4-4275-9baa-1666878c8ee8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:24.654315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1945b95f-26f4-4275-9baa-1666878c8ee8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:24.655661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1945b95f-26f4-4275-9baa-1666878c8ee8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:24.656242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1945b95f-26f4-4275-9baa-1666878c8ee8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:24.656749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1945b95f-26f4-4275-9baa-1666878c8ee8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:24.957323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1945b95f-26f4-4275-9baa-1666878c8ee8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:24.969859 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1945b95f-26f4-4275-9baa-1666878c8ee8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1317 microversion: 2.1 time: 0.377491 Aug 09 14:40:24.970223 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1280/2499] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:24 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:24.975139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-671790037", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "key_name": "tempest-key-1720558121", "networks": [{"uuid": "7d4b5e6e-1097-46ba-bb21-ff9e1560d087"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:25.090341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] validate_networks() for [('7d4b5e6e-1097-46ba-bb21-ff9e1560d087', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:40:26.868405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:40:26.869087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:40:26.869419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:40:26.869883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:40:26.870295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:40:26.882762 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eefcfb9c-4e42-42aa-81c4-343029880809 tempest-SecurityGroupsTestAdminJSON-954960899 tempest-SecurityGroupsTestAdminJSON-954960899-project-admin] 10.222.0.50 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10369 microversion: 2.1 time: 6.799675 Aug 09 14:40:26.884156 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1220/2500] 10.222.0.50 () {58 vars in 1191 bytes} [Tue Aug 9 14:40:20 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10369 bytes in 6803 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:40:26.891988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ffaa07bb-94d2-492b-8cab-c3db2a689811 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:26.891988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ffaa07bb-94d2-492b-8cab-c3db2a689811 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:26.894783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:26.904038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:26.907941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffaa07bb-94d2-492b-8cab-c3db2a689811 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:26.907941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffaa07bb-94d2-492b-8cab-c3db2a689811 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:26.907941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffaa07bb-94d2-492b-8cab-c3db2a689811 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:26.907941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffaa07bb-94d2-492b-8cab-c3db2a689811 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:26.910138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:26.910589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:26.913279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffaa07bb-94d2-492b-8cab-c3db2a689811 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:26.913731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffaa07bb-94d2-492b-8cab-c3db2a689811 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:26.916245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:26.916826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:26.917302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:26.969622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:40:26.982819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for user 03bdf5ec21854ec8b6561a121ce1f1ef and project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:40:27.033413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:40:27.042725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:40:27.121892 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df79b6d5-4015-4ad2-9753-65d257319696 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.149414 Aug 09 14:40:27.132308 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1281/2501] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:40:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:40:27.142656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-954f0713-7525-4461-be2a-882646d5ff4c req-ec660f5c-baff-4f61-a7b9-5ab87505084b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa434a0-4d01-432e-b168-597c787c0d84", "name": "network-vif-plugged", "status": "completed", "tag": "8b0c7959-2122-4ff5-8cd4-9a1ea690f499"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:27.175406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-954f0713-7525-4461-be2a-882646d5ff4c req-ec660f5c-baff-4f61-a7b9-5ab87505084b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:27.176428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-954f0713-7525-4461-be2a-882646d5ff4c req-ec660f5c-baff-4f61-a7b9-5ab87505084b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:27.177017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-954f0713-7525-4461-be2a-882646d5ff4c req-ec660f5c-baff-4f61-a7b9-5ab87505084b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:27.229510 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-954f0713-7525-4461-be2a-882646d5ff4c req-ec660f5c-baff-4f61-a7b9-5ab87505084b service nova] Creating event network-vif-plugged:8b0c7959-2122-4ff5-8cd4-9a1ea690f499 for instance dfa434a0-4d01-432e-b168-597c787c0d84 on n-h2-844626-8 Aug 09 14:40:27.245103 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-954f0713-7525-4461-be2a-882646d5ff4c req-ec660f5c-baff-4f61-a7b9-5ab87505084b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109726 Aug 09 14:40:27.249542 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1282/2502] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:27.261914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3dce9e2f-8f18-4a4f-908b-8cdf03455d28 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:27.265982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3dce9e2f-8f18-4a4f-908b-8cdf03455d28 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:27.286592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dce9e2f-8f18-4a4f-908b-8cdf03455d28 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:27.287110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dce9e2f-8f18-4a4f-908b-8cdf03455d28 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:27.287553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dce9e2f-8f18-4a4f-908b-8cdf03455d28 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:27.288916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dce9e2f-8f18-4a4f-908b-8cdf03455d28 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:27.289352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dce9e2f-8f18-4a4f-908b-8cdf03455d28 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:27.289763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dce9e2f-8f18-4a4f-908b-8cdf03455d28 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:27.390380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ffaa07bb-94d2-492b-8cab-c3db2a689811 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:27.440632 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ffaa07bb-94d2-492b-8cab-c3db2a689811 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1524 microversion: 2.1 time: 0.553994 Aug 09 14:40:27.456007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3dce9e2f-8f18-4a4f-908b-8cdf03455d28 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:27.465978 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1221/2503] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:26 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1524 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:27.467482 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3dce9e2f-8f18-4a4f-908b-8cdf03455d28 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 200 len: 1612 microversion: 2.1 time: 0.216577 Aug 09 14:40:27.470228 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1283/2504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:27 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 1612 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:27.478286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed0750ef-2a20-4a2b-818a-ac89ec6faeca tempest-SecurityGroupsTestAdminJSON-814276715 tempest-SecurityGroupsTestAdminJSON-814276715-project] Calling method '.version_select at 0x7f41dcbd1940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:27.489294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3aeb57ae-45c9-439c-9465-295a8f247127 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:27.490167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3aeb57ae-45c9-439c-9465-295a8f247127 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:27.497615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aeb57ae-45c9-439c-9465-295a8f247127 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:27.498393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aeb57ae-45c9-439c-9465-295a8f247127 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:27.498996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aeb57ae-45c9-439c-9465-295a8f247127 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:27.499873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aeb57ae-45c9-439c-9465-295a8f247127 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:27.500906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aeb57ae-45c9-439c-9465-295a8f247127 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:27.501481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aeb57ae-45c9-439c-9465-295a8f247127 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:28.266391 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed0750ef-2a20-4a2b-818a-ac89ec6faeca tempest-SecurityGroupsTestAdminJSON-814276715 tempest-SecurityGroupsTestAdminJSON-814276715-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.795726 Aug 09 14:40:28.267630 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1284/2505] 10.222.0.50 () {58 vars in 1191 bytes} [Tue Aug 9 14:40:27 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:28.273038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f2d7e616-8565-46ce-89f1-30e84fb95c96 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:28.273999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f2d7e616-8565-46ce-89f1-30e84fb95c96 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:28.294464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2d7e616-8565-46ce-89f1-30e84fb95c96 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:28.295266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2d7e616-8565-46ce-89f1-30e84fb95c96 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:28.295857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2d7e616-8565-46ce-89f1-30e84fb95c96 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:28.296729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2d7e616-8565-46ce-89f1-30e84fb95c96 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:28.297175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2d7e616-8565-46ce-89f1-30e84fb95c96 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:28.297604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2d7e616-8565-46ce-89f1-30e84fb95c96 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:28.401714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3aeb57ae-45c9-439c-9465-295a8f247127 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:28.413500 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3aeb57ae-45c9-439c-9465-295a8f247127 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1317 microversion: 2.1 time: 0.931437 Aug 09 14:40:28.414742 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1222/2506] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:27 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1317 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:28.420555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b66d37fe-38fa-4856-bc71-4ec0667a9c3e tempest-SecurityGroupsTestAdminJSON-954960899 tempest-SecurityGroupsTestAdminJSON-954960899-project-admin] Calling method '.version_select at 0x7f41ddfaa8b0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:28.766961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f2d7e616-8565-46ce-89f1-30e84fb95c96 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:28.783420 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f2d7e616-8565-46ce-89f1-30e84fb95c96 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1232 microversion: 2.1 time: 0.514436 Aug 09 14:40:28.783936 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1285/2507] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:28 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1232 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:28.808065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c54752eb-63f4-4904-b843-edb4ae63ca9d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:28.808734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c54752eb-63f4-4904-b843-edb4ae63ca9d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:28.881417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c54752eb-63f4-4904-b843-edb4ae63ca9d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:28.890347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c54752eb-63f4-4904-b843-edb4ae63ca9d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:28.890899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c54752eb-63f4-4904-b843-edb4ae63ca9d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:28.902873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c54752eb-63f4-4904-b843-edb4ae63ca9d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:28.903513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c54752eb-63f4-4904-b843-edb4ae63ca9d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:28.903946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c54752eb-63f4-4904-b843-edb4ae63ca9d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:29.594438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c54752eb-63f4-4904-b843-edb4ae63ca9d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:29.606173 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c54752eb-63f4-4904-b843-edb4ae63ca9d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1524 microversion: 2.1 time: 0.809664 Aug 09 14:40:29.606776 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1286/2508] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:28 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1524 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:29.625927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:29.627353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:29.645347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:29.652950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:29.653406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:29.654159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:29.654613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:29.655041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:29.681003 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b66d37fe-38fa-4856-bc71-4ec0667a9c3e tempest-SecurityGroupsTestAdminJSON-954960899 tempest-SecurityGroupsTestAdminJSON-954960899-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/d5a5a8ec-83b2-4f85-ab01-7558206b91bb" status: 202 len: 0 microversion: 2.1 time: 1.264729 Aug 09 14:40:29.682588 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1223/2509] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:40:28 2022] DELETE /compute/v2.1/os-security-groups/d5a5a8ec-83b2-4f85-ab01-7558206b91bb => generated 0 bytes in 1267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:40:29.687755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5f7519bf-0400-4dc2-beab-b0a7fa4cee3c req-198bff1b-79e2-42f4-91b4-4c5821a761a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b93caae4-bb8e-4f8a-8f1f-acd161acd2f1", "name": "network-vif-deleted", "tag": "84f32b2b-49b8-46a0-bf53-209be535d114"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:29.732822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5f7519bf-0400-4dc2-beab-b0a7fa4cee3c req-198bff1b-79e2-42f4-91b4-4c5821a761a5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:29.733479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5f7519bf-0400-4dc2-beab-b0a7fa4cee3c req-198bff1b-79e2-42f4-91b4-4c5821a761a5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:29.736709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5f7519bf-0400-4dc2-beab-b0a7fa4cee3c req-198bff1b-79e2-42f4-91b4-4c5821a761a5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:29.747175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:29.747667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:29.748103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:29.748559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lazy-loading 'fault' on Instance uuid b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:40:29.773755 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5f7519bf-0400-4dc2-beab-b0a7fa4cee3c req-198bff1b-79e2-42f4-91b4-4c5821a761a5 service nova] Creating event network-vif-deleted:84f32b2b-49b8-46a0-bf53-209be535d114 for instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 on n-h2-844626-8 Aug 09 14:40:29.797574 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5f7519bf-0400-4dc2-beab-b0a7fa4cee3c req-198bff1b-79e2-42f4-91b4-4c5821a761a5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108612 Aug 09 14:40:29.802175 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1224/2510] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:29.822616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '788fc5ec92a2482db1b27657c4f6b426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ee97f231f894a7b8f401cce82b7026e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:29.824739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e5b3d9fc-4835-4124-ae7b-618fe2edf13e req-93145cca-81eb-48d8-935c-b925b5d5e703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f61de9f-77ce-4797-a4cf-6005d3c64092", "name": "network-vif-plugged", "status": "completed", "tag": "f033813f-a028-456e-9341-0cb54066aa57"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:29.836325 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8259619f-6e6d-403f-bf62-9344f59ff60b tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 200 len: 1330 microversion: 2.1 time: 0.225881 Aug 09 14:40:29.837073 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1287/2511] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:29 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 1330 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:29.856608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23882a4a-7e9e-4bd9-af31-1460865b609f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:29.865195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e5b3d9fc-4835-4124-ae7b-618fe2edf13e req-93145cca-81eb-48d8-935c-b925b5d5e703 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:29.866222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e5b3d9fc-4835-4124-ae7b-618fe2edf13e req-93145cca-81eb-48d8-935c-b925b5d5e703 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:29.868253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e5b3d9fc-4835-4124-ae7b-618fe2edf13e req-93145cca-81eb-48d8-935c-b925b5d5e703 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:29.871655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-23882a4a-7e9e-4bd9-af31-1460865b609f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:29.899062 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e5b3d9fc-4835-4124-ae7b-618fe2edf13e req-93145cca-81eb-48d8-935c-b925b5d5e703 service nova] Creating event network-vif-plugged:f033813f-a028-456e-9341-0cb54066aa57 for instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 on n-h1-844626-8 Aug 09 14:40:29.911881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23882a4a-7e9e-4bd9-af31-1460865b609f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:29.913044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23882a4a-7e9e-4bd9-af31-1460865b609f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:29.913492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23882a4a-7e9e-4bd9-af31-1460865b609f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:29.913660 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e5b3d9fc-4835-4124-ae7b-618fe2edf13e req-93145cca-81eb-48d8-935c-b925b5d5e703 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108683 Aug 09 14:40:29.914210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23882a4a-7e9e-4bd9-af31-1460865b609f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:29.914662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23882a4a-7e9e-4bd9-af31-1460865b609f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:29.915137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23882a4a-7e9e-4bd9-af31-1460865b609f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:29.923791 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1225/2512] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:29.937319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-64eb579e-c698-4380-87f1-d15b0a1a721a tempest-SecurityGroupsTestAdminJSON-954960899 tempest-SecurityGroupsTestAdminJSON-954960899-project-admin] Calling method '.version_select at 0x7f41ddd96a60>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:30.835455 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-64eb579e-c698-4380-87f1-d15b0a1a721a tempest-SecurityGroupsTestAdminJSON-954960899 tempest-SecurityGroupsTestAdminJSON-954960899-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/814c56e5-1160-4748-bd67-c291f3eb4719" status: 202 len: 0 microversion: 2.1 time: 0.903548 Aug 09 14:40:30.837574 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1226/2513] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:40:29 2022] DELETE /compute/v2.1/os-security-groups/814c56e5-1160-4748-bd67-c291f3eb4719 => generated 0 bytes in 913 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:40:30.856948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ae0a589-1229-43e8-920c-0e1ffcebd50d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:30.858472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ae0a589-1229-43e8-920c-0e1ffcebd50d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:30.901831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ae0a589-1229-43e8-920c-0e1ffcebd50d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:30.902559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ae0a589-1229-43e8-920c-0e1ffcebd50d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:30.903258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ae0a589-1229-43e8-920c-0e1ffcebd50d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:30.904202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ae0a589-1229-43e8-920c-0e1ffcebd50d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:30.904850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ae0a589-1229-43e8-920c-0e1ffcebd50d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:30.905433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ae0a589-1229-43e8-920c-0e1ffcebd50d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:31.128921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-23882a4a-7e9e-4bd9-af31-1460865b609f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:31.157728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ae0a589-1229-43e8-920c-0e1ffcebd50d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:31.169001 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ae0a589-1229-43e8-920c-0e1ffcebd50d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1286 microversion: 2.1 time: 0.325181 Aug 09 14:40:31.172249 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23882a4a-7e9e-4bd9-af31-1460865b609f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1317 microversion: 2.1 time: 1.319596 Aug 09 14:40:31.173384 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1288/2514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:29 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1317 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:31.176379 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1227/2515] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:30 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1286 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:31.183181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-20b9ddba-3e27-4f9a-9d38-4654f91bde6d tempest-SecurityGroupsTestAdminJSON-814276715 tempest-SecurityGroupsTestAdminJSON-814276715-project] Calling method '.version_select at 0x7f41ddf24700>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:31.189315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-25025a4c-c484-4796-9834-c038db28888b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:31.203720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-25025a4c-c484-4796-9834-c038db28888b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:31.214532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25025a4c-c484-4796-9834-c038db28888b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:31.215541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25025a4c-c484-4796-9834-c038db28888b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:31.216334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25025a4c-c484-4796-9834-c038db28888b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:31.217341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25025a4c-c484-4796-9834-c038db28888b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:31.226673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25025a4c-c484-4796-9834-c038db28888b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:31.227809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25025a4c-c484-4796-9834-c038db28888b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:31.270708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:31.680158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-25025a4c-c484-4796-9834-c038db28888b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:31.690862 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-25025a4c-c484-4796-9834-c038db28888b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1509 microversion: 2.1 time: 0.513023 Aug 09 14:40:31.704343 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1289/2516] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:31 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1509 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:31.719629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-699a716d-f03e-4808-97d5-ca0a9299d76d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:31.731737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-699a716d-f03e-4808-97d5-ca0a9299d76d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:31.754546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-699a716d-f03e-4808-97d5-ca0a9299d76d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:31.755026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-699a716d-f03e-4808-97d5-ca0a9299d76d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:31.755480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-699a716d-f03e-4808-97d5-ca0a9299d76d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:31.770602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-699a716d-f03e-4808-97d5-ca0a9299d76d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:31.771469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-699a716d-f03e-4808-97d5-ca0a9299d76d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:31.771996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-699a716d-f03e-4808-97d5-ca0a9299d76d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:31.815687 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-699a716d-f03e-4808-97d5-ca0a9299d76d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-699a716d-f03e-4808-97d5-ca0a9299d76d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 HTTP/1.1 Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'b93caae4-bb8e-4f8a-8f1f-acd161acd2f1'} Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:31.830724 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:31.834453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:31.834453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:31.834453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:31.834453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:31.834453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:31.834453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:31.834453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:31.834453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-699a716d-f03e-4808-97d5-ca0a9299d76d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 404 to user: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:31.834453 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-699a716d-f03e-4808-97d5-ca0a9299d76d tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 404 len: 111 microversion: 2.1 time: 0.126537 Aug 09 14:40:31.836764 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1290/2517] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:31 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:40:32.037951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3210d9d0-cbd3-4856-aef7-7b8c2b002121 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:32.041949 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:40:32.041949 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:40:32.045451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3210d9d0-cbd3-4856-aef7-7b8c2b002121 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:32.046343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3210d9d0-cbd3-4856-aef7-7b8c2b002121 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:32.047503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3210d9d0-cbd3-4856-aef7-7b8c2b002121 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:32.048638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3210d9d0-cbd3-4856-aef7-7b8c2b002121 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:32.049271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3210d9d0-cbd3-4856-aef7-7b8c2b002121 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:32.050073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3210d9d0-cbd3-4856-aef7-7b8c2b002121 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:32.068394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:32.088825 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3210d9d0-cbd3-4856-aef7-7b8c2b002121 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.250925 Aug 09 14:40:32.097295 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1291/2518] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:40:31 2022] GET /compute/v2.1/os-services => generated 944 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:32.102401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5168b338-883f-4f20-9254-20714ae4659c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:32.103293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5168b338-883f-4f20-9254-20714ae4659c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:32.110237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5168b338-883f-4f20-9254-20714ae4659c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:32.110988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5168b338-883f-4f20-9254-20714ae4659c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:32.111679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5168b338-883f-4f20-9254-20714ae4659c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:32.112572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5168b338-883f-4f20-9254-20714ae4659c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:32.113214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5168b338-883f-4f20-9254-20714ae4659c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:32.113822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5168b338-883f-4f20-9254-20714ae4659c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:32.778567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5168b338-883f-4f20-9254-20714ae4659c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:32.790244 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5168b338-883f-4f20-9254-20714ae4659c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 200 len: 1509 microversion: 2.1 time: 0.691518 Aug 09 14:40:32.790833 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1292/2519] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:32 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 1509 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:32.799021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-87464b99-eeec-4979-a3a0-0aed37ec5225 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '.version_select at 0x7f41e75075e0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:32.832081 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-87464b99-eeec-4979-a3a0-0aed37ec5225 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-697553484" status: 202 len: 0 microversion: 2.1 time: 0.037258 Aug 09 14:40:32.833940 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1293/2520] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 9 14:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-697553484 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:40:32.839562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c450030a-f039-4a49-aad9-e44bcadcf6b1 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:32.842691 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:40:32.842691 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:40:32.844628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c450030a-f039-4a49-aad9-e44bcadcf6b1 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:32.845568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c450030a-f039-4a49-aad9-e44bcadcf6b1 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:32.846199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c450030a-f039-4a49-aad9-e44bcadcf6b1 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:32.847135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c450030a-f039-4a49-aad9-e44bcadcf6b1 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:32.847786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c450030a-f039-4a49-aad9-e44bcadcf6b1 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:32.848407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c450030a-f039-4a49-aad9-e44bcadcf6b1 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:32.879282 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c450030a-f039-4a49-aad9-e44bcadcf6b1 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?host=n-d-844626-8" status: 200 len: 578 microversion: 2.1 time: 0.043712 Aug 09 14:40:32.880547 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1294/2521] 10.222.0.50 () {58 vars in 1172 bytes} [Tue Aug 9 14:40:32 2022] GET /compute/v2.1/os-services?host=n-d-844626-8 => generated 578 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:32.892908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8eaee1d-c485-4535-b4b3-49f9c3c5bf43 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:32.894076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c8eaee1d-c485-4535-b4b3-49f9c3c5bf43 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:32.903193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8eaee1d-c485-4535-b4b3-49f9c3c5bf43 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:32.904179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8eaee1d-c485-4535-b4b3-49f9c3c5bf43 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:32.905274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8eaee1d-c485-4535-b4b3-49f9c3c5bf43 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:32.906656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8eaee1d-c485-4535-b4b3-49f9c3c5bf43 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:32.907336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8eaee1d-c485-4535-b4b3-49f9c3c5bf43 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:32.909270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8eaee1d-c485-4535-b4b3-49f9c3c5bf43 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:33.127755 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-20b9ddba-3e27-4f9a-9d38-4654f91bde6d tempest-SecurityGroupsTestAdminJSON-814276715 tempest-SecurityGroupsTestAdminJSON-814276715-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/78c9f717-d54a-461d-b4f7-9ce28b2d77ea" status: 202 len: 0 microversion: 2.1 time: 1.945468 Aug 09 14:40:33.134616 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1228/2522] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:40:31 2022] DELETE /compute/v2.1/os-security-groups/78c9f717-d54a-461d-b4f7-9ce28b2d77ea => generated 0 bytes in 1953 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:40:33.144802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ecc64c86-1c43-4596-8247-b0e356072d69 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:33.145414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ecc64c86-1c43-4596-8247-b0e356072d69 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:33.157463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecc64c86-1c43-4596-8247-b0e356072d69 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:33.158766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecc64c86-1c43-4596-8247-b0e356072d69 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:33.159445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecc64c86-1c43-4596-8247-b0e356072d69 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:33.160142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecc64c86-1c43-4596-8247-b0e356072d69 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:33.160761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecc64c86-1c43-4596-8247-b0e356072d69 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:33.161363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecc64c86-1c43-4596-8247-b0e356072d69 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:33.718206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c8eaee1d-c485-4535-b4b3-49f9c3c5bf43 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:33.752249 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8eaee1d-c485-4535-b4b3-49f9c3c5bf43 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1467 microversion: 2.1 time: 0.861500 Aug 09 14:40:33.752965 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1295/2523] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:32 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1467 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:33.787384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2efa38b1-d431-41d3-98c9-c83305cda94c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:33.790861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2efa38b1-d431-41d3-98c9-c83305cda94c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:33.804183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2efa38b1-d431-41d3-98c9-c83305cda94c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:33.804959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2efa38b1-d431-41d3-98c9-c83305cda94c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:33.805610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2efa38b1-d431-41d3-98c9-c83305cda94c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:33.806532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2efa38b1-d431-41d3-98c9-c83305cda94c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:33.807780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2efa38b1-d431-41d3-98c9-c83305cda94c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:33.808398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2efa38b1-d431-41d3-98c9-c83305cda94c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:33.834170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ecc64c86-1c43-4596-8247-b0e356072d69 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:33.846925 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ecc64c86-1c43-4596-8247-b0e356072d69 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1328 microversion: 2.1 time: 0.710847 Aug 09 14:40:33.847797 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1229/2524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:33 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1328 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:33.874381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a9ceb96-64ec-4089-bc66-31d309658836 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:33.884449 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:40:33.884449 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:40:33.886414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a9ceb96-64ec-4089-bc66-31d309658836 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:33.889812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2efa38b1-d431-41d3-98c9-c83305cda94c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:40:33.892761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a9ceb96-64ec-4089-bc66-31d309658836 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:33.893221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a9ceb96-64ec-4089-bc66-31d309658836 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:33.894535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a9ceb96-64ec-4089-bc66-31d309658836 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:33.895003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a9ceb96-64ec-4089-bc66-31d309658836 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:33.895462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a9ceb96-64ec-4089-bc66-31d309658836 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:33.966859 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a9ceb96-64ec-4089-bc66-31d309658836 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.101487 Aug 09 14:40:33.977092 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1230/2525] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 9 14:40:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:33.984290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87a0eb21-bdfe-4af4-a5c7-52d7b085e621 tempest-SecurityGroupsTestAdminJSON-814276715 tempest-SecurityGroupsTestAdminJSON-814276715-project] Calling method '.version_select at 0x7f41ddf24700>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:34.035291 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2efa38b1-d431-41d3-98c9-c83305cda94c tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 204 len: 0 microversion: 2.1 time: 0.277133 Aug 09 14:40:34.045104 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1296/2526] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:40:33 2022] DELETE /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:40:34.057017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ef7f8df0-d902-480b-8f29-3dbec8db691e req-bf113eef-ccf8-4f11-b078-483eea16d0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1bd74c-40fa-4132-84a9-c44b5a28db13", "tag": "805c398a-bd11-4bab-9aa9-cb01d6d0dcd8"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:34.071322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ef7f8df0-d902-480b-8f29-3dbec8db691e req-bf113eef-ccf8-4f11-b078-483eea16d0b0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:34.072126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ef7f8df0-d902-480b-8f29-3dbec8db691e req-bf113eef-ccf8-4f11-b078-483eea16d0b0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:34.072553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ef7f8df0-d902-480b-8f29-3dbec8db691e req-bf113eef-ccf8-4f11-b078-483eea16d0b0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:34.089145 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ef7f8df0-d902-480b-8f29-3dbec8db691e req-bf113eef-ccf8-4f11-b078-483eea16d0b0 service nova] Creating event network-changed:805c398a-bd11-4bab-9aa9-cb01d6d0dcd8 for instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 on n-h2-844626-8 Aug 09 14:40:34.094960 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ef7f8df0-d902-480b-8f29-3dbec8db691e req-bf113eef-ccf8-4f11-b078-483eea16d0b0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047683 Aug 09 14:40:34.096094 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1297/2527] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:34.134244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-be798ab2-3514-42b8-96da-fde10e710ee2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-2054073608", "metadata": {"image_type": "test"}}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:34.140438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-be798ab2-3514-42b8-96da-fde10e710ee2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:34.152433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be798ab2-3514-42b8-96da-fde10e710ee2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:34.153243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be798ab2-3514-42b8-96da-fde10e710ee2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:34.155612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be798ab2-3514-42b8-96da-fde10e710ee2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:34.156658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be798ab2-3514-42b8-96da-fde10e710ee2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:34.157793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be798ab2-3514-42b8-96da-fde10e710ee2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:34.158413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be798ab2-3514-42b8-96da-fde10e710ee2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:34.265871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-be798ab2-3514-42b8-96da-fde10e710ee2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Getting quotas for project 0054032608084cdc8ef35d7638e13615. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:40:34.277378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-be798ab2-3514-42b8-96da-fde10e710ee2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Getting quotas for user 9f5334b328ca4a32ab7b5b258249bcb9 and project 0054032608084cdc8ef35d7638e13615. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:40:34.421523 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87a0eb21-bdfe-4af4-a5c7-52d7b085e621 tempest-SecurityGroupsTestAdminJSON-814276715 tempest-SecurityGroupsTestAdminJSON-814276715-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/db361963-cf7e-489b-be21-e24e37c1454b" status: 202 len: 0 microversion: 2.1 time: 0.442370 Aug 09 14:40:34.422430 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1231/2528] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:40:33 2022] DELETE /compute/v2.1/os-security-groups/db361963-cf7e-489b-be21-e24e37c1454b => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:40:34.433264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-65ae0b6a-cb1b-4c18-9b97-7b0728e25949 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:34.443944 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:40:34.443944 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:40:34.446286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65ae0b6a-cb1b-4c18-9b97-7b0728e25949 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:34.448128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65ae0b6a-cb1b-4c18-9b97-7b0728e25949 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:34.448757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65ae0b6a-cb1b-4c18-9b97-7b0728e25949 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:34.452541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65ae0b6a-cb1b-4c18-9b97-7b0728e25949 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:34.453138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65ae0b6a-cb1b-4c18-9b97-7b0728e25949 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:34.454258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65ae0b6a-cb1b-4c18-9b97-7b0728e25949 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:34.487321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:34.540869 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-65ae0b6a-cb1b-4c18-9b97-7b0728e25949 tempest-ServicesAdminTestJSON-1505648660 tempest-ServicesAdminTestJSON-1505648660-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.117379 Aug 09 14:40:34.548859 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1232/2529] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:40:34 2022] GET /compute/v2.1/os-services => generated 944 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:34.560309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-858953199", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "ff403168-deb6-48c7-93ae-a7884ca6bc0e"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:34.650976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] validate_networks() for [('ff403168-deb6-48c7-93ae-a7884ca6bc0e', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:40:34.658126 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-be798ab2-3514-42b8-96da-fde10e710ee2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "POST /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092/action" status: 202 len: 0 microversion: 2.1 time: 0.560224 Aug 09 14:40:34.658774 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1298/2530] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:40:34 2022] POST /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 14:40:34.670320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1b8f8f6a-9ca6-49b1-90f2-a5e1445af106 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41e75083a0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:34.780955 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1b8f8f6a-9ca6-49b1-90f2-a5e1445af106 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 200 len: 1424 microversion: 2.1 time: 0.115138 Aug 09 14:40:34.781860 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1299/2531] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:40:34 2022] GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:34.873066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-219ca028-7320-48e7-a713-f2f27b09c14a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:34.873835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-219ca028-7320-48e7-a713-f2f27b09c14a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:34.885176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-219ca028-7320-48e7-a713-f2f27b09c14a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:34.885667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-219ca028-7320-48e7-a713-f2f27b09c14a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:34.886103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-219ca028-7320-48e7-a713-f2f27b09c14a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:34.886825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-219ca028-7320-48e7-a713-f2f27b09c14a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:34.887307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-219ca028-7320-48e7-a713-f2f27b09c14a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:34.887729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-219ca028-7320-48e7-a713-f2f27b09c14a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:35.312199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-219ca028-7320-48e7-a713-f2f27b09c14a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:35.327729 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-219ca028-7320-48e7-a713-f2f27b09c14a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1328 microversion: 2.1 time: 0.458253 Aug 09 14:40:35.331772 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1300/2532] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:34 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1328 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:40:35.464829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:40:35.466125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:40:35.466750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:40:35.468858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:40:35.469548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:40:35.504020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:35.504851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:35.505436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:35.508888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:35.509528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:35.511942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:35.587772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Getting quotas for project a61c381646364214a62210a2d8672314. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:40:35.615034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Getting quotas for user 74c10f0e3a40477f86dfd6cdd03fe0f6 and project a61c381646364214a62210a2d8672314. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:40:35.660981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:40:35.668776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:40:35.798578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d74eceae-d5bc-426c-a56e-816c98c4a302 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41e75100d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:35.842420 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88496867-1abf-4722-a76c-7ed80ae83ef6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.292098 Aug 09 14:40:35.852704 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1233/2533] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:40:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:40:35.867597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-20867e92-7bb0-470b-b68a-283037c38685 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:35.868719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-20867e92-7bb0-470b-b68a-283037c38685 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:35.941427 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d74eceae-d5bc-426c-a56e-816c98c4a302 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 200 len: 1424 microversion: 2.1 time: 0.145037 Aug 09 14:40:35.943437 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1301/2534] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:40:35 2022] GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 1424 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:36.123949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-20867e92-7bb0-470b-b68a-283037c38685 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:36.134833 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-20867e92-7bb0-470b-b68a-283037c38685 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1217 microversion: 2.1 time: 0.280036 Aug 09 14:40:36.135453 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1234/2535] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:35 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:36.353155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-889883a0-83bf-4a58-a549-d8fadd5f0b9a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:36.353829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-889883a0-83bf-4a58-a549-d8fadd5f0b9a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:36.367287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-889883a0-83bf-4a58-a549-d8fadd5f0b9a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:36.367792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-889883a0-83bf-4a58-a549-d8fadd5f0b9a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:36.368412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-889883a0-83bf-4a58-a549-d8fadd5f0b9a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:36.369129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-889883a0-83bf-4a58-a549-d8fadd5f0b9a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:36.369580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-889883a0-83bf-4a58-a549-d8fadd5f0b9a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:36.370006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-889883a0-83bf-4a58-a549-d8fadd5f0b9a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:36.756390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-4065f1bc-39af-4c91-8005-fae84a7534d7 req-203da633-c6d1-40ce-92e7-024d6ed6491e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa434a0-4d01-432e-b168-597c787c0d84", "name": "network-vif-deleted", "tag": "8b0c7959-2122-4ff5-8cd4-9a1ea690f499"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:36.781706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4065f1bc-39af-4c91-8005-fae84a7534d7 req-203da633-c6d1-40ce-92e7-024d6ed6491e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:36.783290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4065f1bc-39af-4c91-8005-fae84a7534d7 req-203da633-c6d1-40ce-92e7-024d6ed6491e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:36.785230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4065f1bc-39af-4c91-8005-fae84a7534d7 req-203da633-c6d1-40ce-92e7-024d6ed6491e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:36.804760 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4065f1bc-39af-4c91-8005-fae84a7534d7 req-203da633-c6d1-40ce-92e7-024d6ed6491e service nova] Creating event network-vif-deleted:8b0c7959-2122-4ff5-8cd4-9a1ea690f499 for instance dfa434a0-4d01-432e-b168-597c787c0d84 on n-h2-844626-8 Aug 09 14:40:36.811203 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-4065f1bc-39af-4c91-8005-fae84a7534d7 req-203da633-c6d1-40ce-92e7-024d6ed6491e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063838 Aug 09 14:40:36.816593 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1235/2536] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:36.876325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-889883a0-83bf-4a58-a549-d8fadd5f0b9a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:36.896848 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-889883a0-83bf-4a58-a549-d8fadd5f0b9a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1328 microversion: 2.1 time: 0.544751 Aug 09 14:40:36.897493 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1302/2537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:36 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1328 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:36.959039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d7b62138-7fbd-42b8-8a3c-fbf402c31171 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41ddeaa430>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:37.056926 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d7b62138-7fbd-42b8-8a3c-fbf402c31171 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 200 len: 1424 microversion: 2.1 time: 0.103580 Aug 09 14:40:37.064842 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1236/2538] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:40:36 2022] GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:37.160149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4d8d595-3cd5-476c-bfa3-6b5e5893c9bb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:37.160787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e4d8d595-3cd5-476c-bfa3-6b5e5893c9bb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:37.163048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=10 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:37.443227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e4d8d595-3cd5-476c-bfa3-6b5e5893c9bb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:37.459896 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4d8d595-3cd5-476c-bfa3-6b5e5893c9bb tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1217 microversion: 2.1 time: 0.298399 Aug 09 14:40:37.463457 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1303/2539] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:37 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1217 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:37.920480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a216435a-7bcd-446c-a112-8c705cc799ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:37.922827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a216435a-7bcd-446c-a112-8c705cc799ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:37.954660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a216435a-7bcd-446c-a112-8c705cc799ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:37.957913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a216435a-7bcd-446c-a112-8c705cc799ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:37.961240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a216435a-7bcd-446c-a112-8c705cc799ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:37.966111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a216435a-7bcd-446c-a112-8c705cc799ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:37.966957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a216435a-7bcd-446c-a112-8c705cc799ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:37.972108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a216435a-7bcd-446c-a112-8c705cc799ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:38.079326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0f34a2ab-aaa6-4b0b-84b1-58e6f802e465 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dd6c6790>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:38.618525 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0f34a2ab-aaa6-4b0b-84b1-58e6f802e465 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 200 len: 1424 microversion: 2.1 time: 0.540742 Aug 09 14:40:38.622666 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1304/2540] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:40:38 2022] GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 1424 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:38.674662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a216435a-7bcd-446c-a112-8c705cc799ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:38.692736 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a216435a-7bcd-446c-a112-8c705cc799ce tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1328 microversion: 2.1 time: 0.778717 Aug 09 14:40:38.695061 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1237/2541] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:37 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1328 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:38.700477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3dbbc04c-d054-4b5c-927e-3dceb38397e2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:38.701406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3dbbc04c-d054-4b5c-927e-3dceb38397e2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:38.743712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dbbc04c-d054-4b5c-927e-3dceb38397e2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:38.745706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dbbc04c-d054-4b5c-927e-3dceb38397e2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:38.748534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dbbc04c-d054-4b5c-927e-3dceb38397e2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:38.751912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dbbc04c-d054-4b5c-927e-3dceb38397e2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:38.752927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dbbc04c-d054-4b5c-927e-3dceb38397e2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:38.755044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dbbc04c-d054-4b5c-927e-3dceb38397e2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:39.117778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3dbbc04c-d054-4b5c-927e-3dceb38397e2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:39.129199 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3dbbc04c-d054-4b5c-927e-3dceb38397e2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1277 microversion: 2.1 time: 0.489798 Aug 09 14:40:39.130458 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1305/2542] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:38 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1277 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:39.646143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-18379525-2971-4387-aee9-06eb0a50c27e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41de0d4dc0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:39.717999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-39850e73-2105-4f81-8907-1f521cef414d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:39.720223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-39850e73-2105-4f81-8907-1f521cef414d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:39.739414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39850e73-2105-4f81-8907-1f521cef414d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:39.741685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39850e73-2105-4f81-8907-1f521cef414d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:39.744486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39850e73-2105-4f81-8907-1f521cef414d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:39.746627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39850e73-2105-4f81-8907-1f521cef414d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:39.747281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39850e73-2105-4f81-8907-1f521cef414d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:39.748813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39850e73-2105-4f81-8907-1f521cef414d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:40.765606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-39850e73-2105-4f81-8907-1f521cef414d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:40.788306 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-39850e73-2105-4f81-8907-1f521cef414d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1328 microversion: 2.1 time: 1.071655 Aug 09 14:40:40.789088 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1306/2543] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:39 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1328 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:40.817176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f8ab5f83-fafa-475a-b669-e89f892711dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:40.822909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8ab5f83-fafa-475a-b669-e89f892711dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:40.859007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8ab5f83-fafa-475a-b669-e89f892711dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:40.860875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8ab5f83-fafa-475a-b669-e89f892711dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:40.863425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8ab5f83-fafa-475a-b669-e89f892711dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:40.867461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8ab5f83-fafa-475a-b669-e89f892711dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:40.872231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8ab5f83-fafa-475a-b669-e89f892711dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:40.876596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8ab5f83-fafa-475a-b669-e89f892711dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:41.307455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8ab5f83-fafa-475a-b669-e89f892711dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:41.318876 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f8ab5f83-fafa-475a-b669-e89f892711dc tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1275 microversion: 2.1 time: 0.525872 Aug 09 14:40:41.335497 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1307/2544] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:40 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1275 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:41.353340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-53fa8f2c-22d3-4dd0-8072-ac9bd1bf6d1f req-c96f4651-9381-4152-a1af-2b5ebe4d0d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f61de9f-77ce-4797-a4cf-6005d3c64092", "name": "network-vif-plugged", "status": "completed", "tag": "f033813f-a028-456e-9341-0cb54066aa57"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:41.385879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-53fa8f2c-22d3-4dd0-8072-ac9bd1bf6d1f req-c96f4651-9381-4152-a1af-2b5ebe4d0d81 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:41.391860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-53fa8f2c-22d3-4dd0-8072-ac9bd1bf6d1f req-c96f4651-9381-4152-a1af-2b5ebe4d0d81 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:41.392561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-53fa8f2c-22d3-4dd0-8072-ac9bd1bf6d1f req-c96f4651-9381-4152-a1af-2b5ebe4d0d81 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:41.432508 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-53fa8f2c-22d3-4dd0-8072-ac9bd1bf6d1f req-c96f4651-9381-4152-a1af-2b5ebe4d0d81 service nova] Creating event network-vif-plugged:f033813f-a028-456e-9341-0cb54066aa57 for instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 on n-h1-844626-8 Aug 09 14:40:41.448409 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-53fa8f2c-22d3-4dd0-8072-ac9bd1bf6d1f req-c96f4651-9381-4152-a1af-2b5ebe4d0d81 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111287 Aug 09 14:40:41.453679 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1308/2545] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:42.165614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5aa1b24b-982a-4245-8b6a-a083a680e147 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Calling method '.version_select at 0x7f41dd6c6310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:42.860520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:45.551668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:46.134323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:47.453991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:47.926840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:48.682999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=10 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:51.385128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:51.429899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:40:51.518553 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-5aa1b24b-982a-4245-8b6a-a083a680e147 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] HTTP exception thrown: Image not found. Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5aa1b24b-982a-4245-8b6a-a083a680e147 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Request method failure captured: Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/images/796b9db1-566c-4692-929b-382c42500094/metadata/os_distro HTTP/1.1 Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nHpVAY5jNQmoxw38poc4ogLjBkSekRmMMFHoqOAGHGuX4zYn56dwjqlLNdN6n8p-IzrbNOt3engcBNfXxxlYG2CPXGn8Ky03kmfy44Ca_Ck7ZxNU0_kLeUNCAF8laKcY4Q2AnTkcNinWcYwOW1x7qZVvcSOhYkVUrh0NjuVGOK480Q Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 147ae0f4624c4fb6a9219abe66de5892 Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_147ae0f4624c4fb6a9219abe66de5892", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 147ae0f4624c4fb6a9219abe66de5892 Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesMetadataNegativeTestJSON-1763391174-project Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 58e71468e29b4bae9bc7c06030a5d90c Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174-project Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: exception: Image not found. Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'image_id': '796b9db1-566c-4692-929b-382c42500094', 'id': 'os_distro'} Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 796b9db1-566c-4692-929b-382c42500094 Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 14:40:51.526276 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 796b9db1-566c-4692-929b-382c42500094 could not be found. Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5aa1b24b-982a-4245-8b6a-a083a680e147 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Returning 404 to user: Image not found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:51.530137 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5aa1b24b-982a-4245-8b6a-a083a680e147 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] 10.222.0.50 "DELETE /compute/v2.1/images/796b9db1-566c-4692-929b-382c42500094/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 10.074533 Aug 09 14:40:51.532857 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1309/2546] 10.222.0.50 () {58 vars in 1293 bytes} [Tue Aug 9 14:40:41 2022] DELETE /compute/v2.1/images/796b9db1-566c-4692-929b-382c42500094/metadata/os_distro => generated 62 bytes in 10076 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:40:51.536971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f3bb580-fc02-47cc-b5af-75ec1830208a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:51.537488 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-18379525-2971-4387-aee9-06eb0a50c27e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 200 len: 1424 microversion: 2.1 time: 11.902455 Aug 09 14:40:51.537933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f3bb580-fc02-47cc-b5af-75ec1830208a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:51.538146 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1238/2547] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:40:39 2022] GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 1424 bytes in 11906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:51.552671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f3bb580-fc02-47cc-b5af-75ec1830208a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:51.552671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f3bb580-fc02-47cc-b5af-75ec1830208a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:51.553135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f3bb580-fc02-47cc-b5af-75ec1830208a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:51.553948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f3bb580-fc02-47cc-b5af-75ec1830208a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:51.554400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f3bb580-fc02-47cc-b5af-75ec1830208a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:51.554824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f3bb580-fc02-47cc-b5af-75ec1830208a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:51.618406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1253688331", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:51.700679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] validate_networks() for None {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:40:51.755966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9f3bb580-fc02-47cc-b5af-75ec1830208a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:51.764409 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9f3bb580-fc02-47cc-b5af-75ec1830208a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1328 microversion: 2.1 time: 0.232961 Aug 09 14:40:51.764998 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1310/2548] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:51 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1328 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:51.778995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f39f785a-2216-43ff-a918-1b53e624e9a1 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:51.779639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f39f785a-2216-43ff-a918-1b53e624e9a1 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:51.788879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f39f785a-2216-43ff-a918-1b53e624e9a1 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:51.789290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f39f785a-2216-43ff-a918-1b53e624e9a1 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:51.789783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f39f785a-2216-43ff-a918-1b53e624e9a1 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:51.790477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f39f785a-2216-43ff-a918-1b53e624e9a1 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:51.790923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f39f785a-2216-43ff-a918-1b53e624e9a1 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:51.791379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f39f785a-2216-43ff-a918-1b53e624e9a1 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:52.120515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:40:52.120938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:40:52.121432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:40:52.121838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:40:52.122245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:40:52.141321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:52.141811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:52.142242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:52.142968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:52.143447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:52.143868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:52.157316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f39f785a-2216-43ff-a918-1b53e624e9a1 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:52.169800 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f39f785a-2216-43ff-a918-1b53e624e9a1 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1317 microversion: 2.1 time: 0.403726 Aug 09 14:40:52.178312 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1311/2549] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:51 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:52.197137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-138c7dd5-710f-424d-b266-7076781e61c8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:52.197849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-138c7dd5-710f-424d-b266-7076781e61c8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:52.198500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Getting quotas for project decdc7f4b385405dbd589e276b8bd7be. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:40:52.205016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-138c7dd5-710f-424d-b266-7076781e61c8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:52.206196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-138c7dd5-710f-424d-b266-7076781e61c8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:52.206743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-138c7dd5-710f-424d-b266-7076781e61c8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:52.207728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-138c7dd5-710f-424d-b266-7076781e61c8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:52.208861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-138c7dd5-710f-424d-b266-7076781e61c8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:52.209500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-138c7dd5-710f-424d-b266-7076781e61c8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:52.212716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Getting quotas for user c1592bdd654b42e99c97a9ae2414df80 and project decdc7f4b385405dbd589e276b8bd7be. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:40:52.226734 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-138c7dd5-710f-424d-b266-7076781e61c8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-138c7dd5-710f-424d-b266-7076781e61c8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 HTTP/1.1 Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'b93caae4-bb8e-4f8a-8f1f-acd161acd2f1'} Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:40:52.228846 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:40:52.232591 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:52.232591 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.232591 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:52.232591 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.232591 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:52.232591 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:52.232591 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:52.232591 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:52.232591 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:52.232591 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:52.232591 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.234644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-138c7dd5-710f-424d-b266-7076781e61c8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 404 to user: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:52.235396 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-138c7dd5-710f-424d-b266-7076781e61c8 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 404 len: 111 microversion: 2.1 time: 0.049936 Aug 09 14:40:52.236148 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1312/2550] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:40:52 2022] DELETE /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:40:52.238474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:40:52.240814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:40:52.310810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b49a6330-e2df-4f6f-beec-83eb5f96d865 req-5413e658-134b-45a4-8ba3-0c8c8a0da8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1282c4bf-25e4-40f6-8d30-ad3cd97640f6", "tag": "9e22291a-3296-424f-9afc-553476619095"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:52.322272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b49a6330-e2df-4f6f-beec-83eb5f96d865 req-5413e658-134b-45a4-8ba3-0c8c8a0da8b7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:52.323353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b49a6330-e2df-4f6f-beec-83eb5f96d865 req-5413e658-134b-45a4-8ba3-0c8c8a0da8b7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:52.324196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b49a6330-e2df-4f6f-beec-83eb5f96d865 req-5413e658-134b-45a4-8ba3-0c8c8a0da8b7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:52.343849 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b49a6330-e2df-4f6f-beec-83eb5f96d865 req-5413e658-134b-45a4-8ba3-0c8c8a0da8b7 service nova] Creating event network-changed:9e22291a-3296-424f-9afc-553476619095 for instance 1282c4bf-25e4-40f6-8d30-ad3cd97640f6 on n-h1-844626-8 Aug 09 14:40:52.353570 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70a7c66c-88fc-463a-b586-db52f3508c0b tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809117 Aug 09 14:40:52.364634 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1239/2551] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:40:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:40:52.375611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b5407c04-74b7-475e-b482-fe29cd4fd263 req-faaea375-006e-4b4d-b2fe-af04e9cb086c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1bd74c-40fa-4132-84a9-c44b5a28db13", "name": "network-vif-plugged", "status": "completed", "tag": "805c398a-bd11-4bab-9aa9-cb01d6d0dcd8"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:52.377775 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b49a6330-e2df-4f6f-beec-83eb5f96d865 req-5413e658-134b-45a4-8ba3-0c8c8a0da8b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139865 Aug 09 14:40:52.378388 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1313/2552] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:52.399915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b5407c04-74b7-475e-b482-fe29cd4fd263 req-faaea375-006e-4b4d-b2fe-af04e9cb086c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:52.400907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b5407c04-74b7-475e-b482-fe29cd4fd263 req-faaea375-006e-4b4d-b2fe-af04e9cb086c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:52.404173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b5407c04-74b7-475e-b482-fe29cd4fd263 req-faaea375-006e-4b4d-b2fe-af04e9cb086c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:52.423560 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b5407c04-74b7-475e-b482-fe29cd4fd263 req-faaea375-006e-4b4d-b2fe-af04e9cb086c service nova] Creating event network-vif-plugged:805c398a-bd11-4bab-9aa9-cb01d6d0dcd8 for instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 on n-h2-844626-8 Aug 09 14:40:52.446049 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b5407c04-74b7-475e-b482-fe29cd4fd263 req-faaea375-006e-4b4d-b2fe-af04e9cb086c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079628 Aug 09 14:40:52.448058 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1240/2553] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:52.538262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4552942d-f8bf-4c96-bde0-9e2a4605f836 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] Calling method '.version_select at 0x7f41dd8129d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:52.667095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-765a3e5a-4a08-4735-b2e7-1de622e26643 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Action: 'create', calling method: .version_select at 0x7f41ddd80b80>, body: {"keypair": {"name": "tempest-keypair-1666140331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJ2+ka2KycxNr6eC9Bn8xi0LVcJQQHnVoVBUZMFiqOpajFmD7VW+ueSFicIlr4zoqq/92SC++hfMCo2+HAgbzy4xUzY/yraCnLGFIEjBf7zfP0Ag7jHeH4aF4fZisKfag=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:52.716837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-765a3e5a-4a08-4735-b2e7-1de622e26643 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Getting quotas for project 320d96eea4cd4bcf83a3e69daf2f77a3. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:40:52.724846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-765a3e5a-4a08-4735-b2e7-1de622e26643 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Getting quotas for user a6ddc08c6cfc44fa8ec90cd2752c14ef and project 320d96eea4cd4bcf83a3e69daf2f77a3. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:40:52.763908 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-765a3e5a-4a08-4735-b2e7-1de622e26643 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.314301 Aug 09 14:40:52.777585 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1241/2554] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:40:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:52.783228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1501a55b-69c7-435c-81a9-c77cfa5358a8 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Calling method '.version_select at 0x7f41ddd4ddc0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:52.812188 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-1501a55b-69c7-435c-81a9-c77cfa5358a8 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] HTTP exception thrown: Image not found. Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1501a55b-69c7-435c-81a9-c77cfa5358a8 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Request method failure captured: Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/images/95b0f6e7-862b-4cdc-bdca-9ea107b4ef66/metadata/os_version HTTP/1.1 Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHpVAY5jNQmoxw38poc4ogLjBkSekRmMMFHoqOAGHGuX4zYn56dwjqlLNdN6n8p-IzrbNOt3engcBNfXxxlYG2CPXGn8Ky03kmfy44Ca_Ck7ZxNU0_kLeUNCAF8laKcY4Q2AnTkcNinWcYwOW1x7qZVvcSOhYkVUrh0NjuVGOK480Q Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 147ae0f4624c4fb6a9219abe66de5892 Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_147ae0f4624c4fb6a9219abe66de5892", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 147ae0f4624c4fb6a9219abe66de5892 Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesMetadataNegativeTestJSON-1763391174-project Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 58e71468e29b4bae9bc7c06030a5d90c Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174-project Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'image_id': '95b0f6e7-862b-4cdc-bdca-9ea107b4ef66', 'id': 'os_version'} Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 95b0f6e7-862b-4cdc-bdca-9ea107b4ef66 Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 14:40:52.817327 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 95b0f6e7-862b-4cdc-bdca-9ea107b4ef66 could not be found. Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:40:52.821053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.825602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1501a55b-69c7-435c-81a9-c77cfa5358a8 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:52.826661 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1501a55b-69c7-435c-81a9-c77cfa5358a8 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] 10.222.0.50 "GET /compute/v2.1/images/95b0f6e7-862b-4cdc-bdca-9ea107b4ef66/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.047445 Aug 09 14:40:52.827937 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1242/2555] 10.222.0.50 () {58 vars in 1293 bytes} [Tue Aug 9 14:40:52 2022] GET /compute/v2.1/images/95b0f6e7-862b-4cdc-bdca-9ea107b4ef66/metadata/os_version => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:40:52.839006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19a9a82e-f16c-4f1d-ad06-3357aff4d8f3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:52.841287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-19a9a82e-f16c-4f1d-ad06-3357aff4d8f3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: b93caae4-bb8e-4f8a-8f1f-acd161acd2f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:52.852876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19a9a82e-f16c-4f1d-ad06-3357aff4d8f3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:52.863294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19a9a82e-f16c-4f1d-ad06-3357aff4d8f3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:52.864256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19a9a82e-f16c-4f1d-ad06-3357aff4d8f3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:52.868050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19a9a82e-f16c-4f1d-ad06-3357aff4d8f3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:52.869143 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4552942d-f8bf-4c96-bde0-9e2a4605f836 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.469795 Aug 09 14:40:52.869736 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1314/2556] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 9 14:40:52 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:40:52.870298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19a9a82e-f16c-4f1d-ad06-3357aff4d8f3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:52.871887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19a9a82e-f16c-4f1d-ad06-3357aff4d8f3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:52.876993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ac6248a-4f12-443c-a359-4789a98d002e tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:52.877734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ac6248a-4f12-443c-a359-4789a98d002e tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:52.915857 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-19a9a82e-f16c-4f1d-ad06-3357aff4d8f3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19a9a82e-f16c-4f1d-ad06-3357aff4d8f3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 HTTP/1.1 Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'b93caae4-bb8e-4f8a-8f1f-acd161acd2f1'} Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:52.930468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.934604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:52.934604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:52.934604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:52.934604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:52.934604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:52.934604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. Aug 09 14:40:52.934604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:52.935826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19a9a82e-f16c-4f1d-ad06-3357aff4d8f3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 404 to user: Instance b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:52.936832 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-19a9a82e-f16c-4f1d-ad06-3357aff4d8f3 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1" status: 404 len: 111 microversion: 2.1 time: 0.103567 Aug 09 14:40:52.937576 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1243/2557] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:52 2022] GET /compute/v2.1/servers/b93caae4-bb8e-4f8a-8f1f-acd161acd2f1 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:40:52.952339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-61b64121-6eb2-4c51-9114-d49c10162d47 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41ddd4d9d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:53.026133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ac6248a-4f12-443c-a359-4789a98d002e tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:53.045183 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ac6248a-4f12-443c-a359-4789a98d002e tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1222 microversion: 2.1 time: 0.172069 Aug 09 14:40:53.045760 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1315/2558] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:52 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1222 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:53.046500 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-61b64121-6eb2-4c51-9114-d49c10162d47 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 200 len: 1424 microversion: 2.1 time: 0.107754 Aug 09 14:40:53.047137 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1244/2559] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:40:52 2022] GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 1424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:53.054319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9924aaa-f642-44fd-bf7c-c7118c7fd0b6 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Calling method '.version_select at 0x7f41ddf77670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:53.060456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a443e56-a58b-4802-82bc-f9d8455a364c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:53.062250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a443e56-a58b-4802-82bc-f9d8455a364c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:53.091897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a443e56-a58b-4802-82bc-f9d8455a364c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:53.093911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a443e56-a58b-4802-82bc-f9d8455a364c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:53.095846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a443e56-a58b-4802-82bc-f9d8455a364c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:53.097550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a443e56-a58b-4802-82bc-f9d8455a364c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:53.109925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a443e56-a58b-4802-82bc-f9d8455a364c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:53.113998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a443e56-a58b-4802-82bc-f9d8455a364c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:53.125486 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-f9924aaa-f642-44fd-bf7c-c7118c7fd0b6 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] HTTP exception thrown: Image not found. Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9924aaa-f642-44fd-bf7c-c7118c7fd0b6 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Request method failure captured: Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/images/9a7abc16-5442-4901-8272-8480f252107c/metadata HTTP/1.1 Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHpVAY5jNQmoxw38poc4ogLjBkSekRmMMFHoqOAGHGuX4zYn56dwjqlLNdN6n8p-IzrbNOt3engcBNfXxxlYG2CPXGn8Ky03kmfy44Ca_Ck7ZxNU0_kLeUNCAF8laKcY4Q2AnTkcNinWcYwOW1x7qZVvcSOhYkVUrh0NjuVGOK480Q Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 147ae0f4624c4fb6a9219abe66de5892 Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_147ae0f4624c4fb6a9219abe66de5892", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 147ae0f4624c4fb6a9219abe66de5892 Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesMetadataNegativeTestJSON-1763391174-project Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 58e71468e29b4bae9bc7c06030a5d90c Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174-project Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'image_id': '9a7abc16-5442-4901-8272-8480f252107c'} Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9a7abc16-5442-4901-8272-8480f252107c Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 14:40:53.128387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9a7abc16-5442-4901-8272-8480f252107c could not be found. Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:40:53.132516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.139111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9924aaa-f642-44fd-bf7c-c7118c7fd0b6 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:53.139111 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f9924aaa-f642-44fd-bf7c-c7118c7fd0b6 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] 10.222.0.50 "GET /compute/v2.1/images/9a7abc16-5442-4901-8272-8480f252107c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.086830 Aug 09 14:40:53.139111 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1245/2560] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 9 14:40:53 2022] GET /compute/v2.1/images/9a7abc16-5442-4901-8272-8480f252107c/metadata => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:40:53.158158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67f7426c-6cda-4219-b51d-e6763a266039 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] Action: 'create', calling method: .version_select at 0x7f41dddeaa60>, body: {"pool": "non_exist_pool"} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:53.339136 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-67f7426c-6cda-4219-b51d-e6763a266039 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] HTTP exception thrown: Floating IP pool not found. Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67f7426c-6cda-4219-b51d-e6763a266039 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] Request method failure captured: Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 26 Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHxwkuxqfQqhvt1lmX8tE39V_7zpV6eE32Pb6JLDtpIuU-Aj1dR8bQoPyWp3Q2LQp2bH7LRXADe6Du2zSOrQhAfjWXqIgv0Hqf65LsGF3W7L5toSA5VnZKkqmmCwwYNuvn7CinaX3nxq3ttZQNfzqI_qTYbO95SjQdq9_MOq8oHiB0 Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: c063901a6a63417285733223542b276c Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-609526583 Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c063901a6a63417285733223542b276c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c063901a6a63417285733223542b276c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c063901a6a63417285733223542b276c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c063901a6a63417285733223542b276c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-609526583 Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: c063901a6a63417285733223542b276c Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-609526583 Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-FloatingIPsNegativeTestJSON-609526583-project Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: b26faae2d2fb4d6aa6106b2bf099d55e Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-609526583-project Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: {"pool": "non_exist_pool"} Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: exception: Floating IP pool not found. Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:53.341160 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:53.345257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 09 14:40:53.345257 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.345257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67f7426c-6cda-4219-b51d-e6763a266039 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] Returning 404 to user: Floating IP pool not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:53.345257 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-67f7426c-6cda-4219-b51d-e6763a266039 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.206444 Aug 09 14:40:53.350801 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1246/2561] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 9 14:40:53 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:40:53.369188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b9e28f66-b294-44dd-96e2-92f470aead61 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Action: 'update_all', calling method: .version_select at 0x7f41ddb1ba60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:53.429040 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b9e28f66-b294-44dd-96e2-92f470aead61 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] HTTP exception thrown: Image not found. Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b9e28f66-b294-44dd-96e2-92f470aead61 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Request method failure captured: Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: request: PUT /compute/v2.1/images/b0d892e1-0169-4b7f-8119-009d39b3570a/metadata HTTP/1.1 Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 57 Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHpVAY5jNQmoxw38poc4ogLjBkSekRmMMFHoqOAGHGuX4zYn56dwjqlLNdN6n8p-IzrbNOt3engcBNfXxxlYG2CPXGn8Ky03kmfy44Ca_Ck7ZxNU0_kLeUNCAF8laKcY4Q2AnTkcNinWcYwOW1x7qZVvcSOhYkVUrh0NjuVGOK480Q Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 147ae0f4624c4fb6a9219abe66de5892 Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_147ae0f4624c4fb6a9219abe66de5892", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 147ae0f4624c4fb6a9219abe66de5892 Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesMetadataNegativeTestJSON-1763391174-project Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 58e71468e29b4bae9bc7c06030a5d90c Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174-project Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'image_id': 'b0d892e1-0169-4b7f-8119-009d39b3570a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b0d892e1-0169-4b7f-8119-009d39b3570a Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 14:40:53.432254 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b0d892e1-0169-4b7f-8119-009d39b3570a could not be found. Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b9e28f66-b294-44dd-96e2-92f470aead61 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:53.435889 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b9e28f66-b294-44dd-96e2-92f470aead61 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] 10.222.0.50 "PUT /compute/v2.1/images/b0d892e1-0169-4b7f-8119-009d39b3570a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.083244 Aug 09 14:40:53.438573 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1247/2562] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:40:53 2022] PUT /compute/v2.1/images/b0d892e1-0169-4b7f-8119-009d39b3570a/metadata => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:40:53.445304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5404dbcd-8e42-4420-82a5-1e22ffba3356 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:53.446084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5404dbcd-8e42-4420-82a5-1e22ffba3356 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:53.454636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5404dbcd-8e42-4420-82a5-1e22ffba3356 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:53.455296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5404dbcd-8e42-4420-82a5-1e22ffba3356 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:53.455777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5404dbcd-8e42-4420-82a5-1e22ffba3356 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:53.457058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5404dbcd-8e42-4420-82a5-1e22ffba3356 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:53.457597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5404dbcd-8e42-4420-82a5-1e22ffba3356 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:53.458159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5404dbcd-8e42-4420-82a5-1e22ffba3356 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:53.560246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4a443e56-a58b-4802-82bc-f9d8455a364c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:53.573989 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a443e56-a58b-4802-82bc-f9d8455a364c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1328 microversion: 2.1 time: 0.527165 Aug 09 14:40:53.575249 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1316/2563] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:53 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1328 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:53.597496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36551063-af55-44fc-8ae1-95cebe08a1f9 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] Calling method '.version_select at 0x7f41dd72fdc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:53.766689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG neutronclient.v2_0.client [None req-36551063-af55-44fc-8ae1-95cebe08a1f9 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d27d746b-db12-4f1b-8ad7-a287eadfe166 could not be found", "detail": ""}} {{(pid=119407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:40:53.767657 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-36551063-af55-44fc-8ae1-95cebe08a1f9 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] HTTP exception thrown: Floating IP not found for ID d27d746b-db12-4f1b-8ad7-a287eadfe166 Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36551063-af55-44fc-8ae1-95cebe08a1f9 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] Request method failure captured: Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/os-floating-ips/d27d746b-db12-4f1b-8ad7-a287eadfe166 HTTP/1.1 Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nHxwkuxqfQqhvt1lmX8tE39V_7zpV6eE32Pb6JLDtpIuU-Aj1dR8bQoPyWp3Q2LQp2bH7LRXADe6Du2zSOrQhAfjWXqIgv0Hqf65LsGF3W7L5toSA5VnZKkqmmCwwYNuvn7CinaX3nxq3ttZQNfzqI_qTYbO95SjQdq9_MOq8oHiB0 Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: c063901a6a63417285733223542b276c Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-609526583 Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c063901a6a63417285733223542b276c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c063901a6a63417285733223542b276c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c063901a6a63417285733223542b276c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c063901a6a63417285733223542b276c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-609526583 Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: c063901a6a63417285733223542b276c Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-609526583 Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FloatingIPsNegativeTestJSON-609526583-project Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: b26faae2d2fb4d6aa6106b2bf099d55e Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-609526583-project Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: exception: Floating IP not found for ID d27d746b-db12-4f1b-8ad7-a287eadfe166 Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'd27d746b-db12-4f1b-8ad7-a287eadfe166'} Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d27d746b-db12-4f1b-8ad7-a287eadfe166 could not be found Aug 09 14:40:53.770228 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8b14b07c-f7e0-4b6a-b718-b295f8ebec17'] Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d27d746b-db12-4f1b-8ad7-a287eadfe166. Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d27d746b-db12-4f1b-8ad7-a287eadfe166 Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d27d746b-db12-4f1b-8ad7-a287eadfe166 Aug 09 14:40:53.774421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.779341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36551063-af55-44fc-8ae1-95cebe08a1f9 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] Returning 404 to user: Floating IP not found for ID d27d746b-db12-4f1b-8ad7-a287eadfe166 {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:53.780431 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36551063-af55-44fc-8ae1-95cebe08a1f9 tempest-FloatingIPsNegativeTestJSON-609526583 tempest-FloatingIPsNegativeTestJSON-609526583-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/d27d746b-db12-4f1b-8ad7-a287eadfe166" status: 404 len: 111 microversion: 2.1 time: 0.204050 Aug 09 14:40:53.781511 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1317/2564] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:40:53 2022] DELETE /compute/v2.1/os-floating-ips/d27d746b-db12-4f1b-8ad7-a287eadfe166 => generated 111 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:40:53.796663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-924b9d10-d3c4-415f-b107-2a6b0db02abc tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Action: 'update', calling method: .version_select at 0x7f41dd7ef790>, body: {"meta": {"os_distro": "alt"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:53.834131 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-924b9d10-d3c4-415f-b107-2a6b0db02abc tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] HTTP exception thrown: Image not found. Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-924b9d10-d3c4-415f-b107-2a6b0db02abc tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Request method failure captured: Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/images/91684d80-9249-45ff-8209-c48807ec1a6b/metadata/os_distro HTTP/1.1 Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 30 Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nHpVAY5jNQmoxw38poc4ogLjBkSekRmMMFHoqOAGHGuX4zYn56dwjqlLNdN6n8p-IzrbNOt3engcBNfXxxlYG2CPXGn8Ky03kmfy44Ca_Ck7ZxNU0_kLeUNCAF8laKcY4Q2AnTkcNinWcYwOW1x7qZVvcSOhYkVUrh0NjuVGOK480Q Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 147ae0f4624c4fb6a9219abe66de5892 Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_147ae0f4624c4fb6a9219abe66de5892", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 147ae0f4624c4fb6a9219abe66de5892 Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesMetadataNegativeTestJSON-1763391174-project Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 58e71468e29b4bae9bc7c06030a5d90c Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174-project Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: {"meta": {"os_distro": "alt"}} Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: exception: Image not found. Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'image_id': '91684d80-9249-45ff-8209-c48807ec1a6b', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 91684d80-9249-45ff-8209-c48807ec1a6b Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 14:40:53.836428 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 91684d80-9249-45ff-8209-c48807ec1a6b could not be found. Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-924b9d10-d3c4-415f-b107-2a6b0db02abc tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Returning 404 to user: Image not found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:53.839910 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-924b9d10-d3c4-415f-b107-2a6b0db02abc tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] 10.222.0.50 "PUT /compute/v2.1/images/91684d80-9249-45ff-8209-c48807ec1a6b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.055187 Aug 09 14:40:53.846857 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1318/2565] 10.222.0.50 () {60 vars in 1310 bytes} [Tue Aug 9 14:40:53 2022] PUT /compute/v2.1/images/91684d80-9249-45ff-8209-c48807ec1a6b/metadata/os_distro => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:40:53.851270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-295ecada-cc47-484d-a461-d0777200edd5 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Action: 'create', calling method: .version_select at 0x7f41dd7ef0d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:53.892232 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-295ecada-cc47-484d-a461-d0777200edd5 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] HTTP exception thrown: Image not found. Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-295ecada-cc47-484d-a461-d0777200edd5 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Request method failure captured: Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/images/88dc1ce7-da81-4582-b00f-a48e12f388a8/metadata HTTP/1.1 Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 57 Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nHpVAY5jNQmoxw38poc4ogLjBkSekRmMMFHoqOAGHGuX4zYn56dwjqlLNdN6n8p-IzrbNOt3engcBNfXxxlYG2CPXGn8Ky03kmfy44Ca_Ck7ZxNU0_kLeUNCAF8laKcY4Q2AnTkcNinWcYwOW1x7qZVvcSOhYkVUrh0NjuVGOK480Q Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 147ae0f4624c4fb6a9219abe66de5892 Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_147ae0f4624c4fb6a9219abe66de5892", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/147ae0f4624c4fb6a9219abe66de5892"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 147ae0f4624c4fb6a9219abe66de5892 Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174 Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesMetadataNegativeTestJSON-1763391174-project Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 58e71468e29b4bae9bc7c06030a5d90c Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1763391174-project Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: exception: Image not found. Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'image_id': '88dc1ce7-da81-4582-b00f-a48e12f388a8', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 88dc1ce7-da81-4582-b00f-a48e12f388a8 Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 14:40:53.894388 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 88dc1ce7-da81-4582-b00f-a48e12f388a8 could not be found. Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-295ecada-cc47-484d-a461-d0777200edd5 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] Returning 404 to user: Image not found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-295ecada-cc47-484d-a461-d0777200edd5 tempest-ImagesMetadataNegativeTestJSON-1763391174 tempest-ImagesMetadataNegativeTestJSON-1763391174-project] 10.222.0.50 "POST /compute/v2.1/images/88dc1ce7-da81-4582-b00f-a48e12f388a8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049708 Aug 09 14:40:53.897770 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1319/2566] 10.222.0.50 () {60 vars in 1281 bytes} [Tue Aug 9 14:40:53 2022] POST /compute/v2.1/images/88dc1ce7-da81-4582-b00f-a48e12f388a8/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:40:54.071911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-146c08a8-e852-44d0-a93e-4def99562132 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dd7ef040>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:54.155312 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-146c08a8-e852-44d0-a93e-4def99562132 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 200 len: 1424 microversion: 2.1 time: 0.091534 Aug 09 14:40:54.155964 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1320/2567] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:40:54 2022] GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:54.165811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ac4a9a3-8e25-4d84-a59f-36c38a8c5959 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:54.171576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ac4a9a3-8e25-4d84-a59f-36c38a8c5959 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:54.187707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ac4a9a3-8e25-4d84-a59f-36c38a8c5959 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:54.191834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ac4a9a3-8e25-4d84-a59f-36c38a8c5959 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:54.192516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ac4a9a3-8e25-4d84-a59f-36c38a8c5959 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:54.193412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ac4a9a3-8e25-4d84-a59f-36c38a8c5959 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:54.194079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ac4a9a3-8e25-4d84-a59f-36c38a8c5959 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:54.194658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ac4a9a3-8e25-4d84-a59f-36c38a8c5959 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:54.531207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5404dbcd-8e42-4420-82a5-1e22ffba3356 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:54.540535 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5404dbcd-8e42-4420-82a5-1e22ffba3356 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1317 microversion: 2.1 time: 1.103197 Aug 09 14:40:54.547058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ac4a9a3-8e25-4d84-a59f-36c38a8c5959 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:54.551509 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1248/2568] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:53 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1317 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:54.567359 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ac4a9a3-8e25-4d84-a59f-36c38a8c5959 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1274 microversion: 2.1 time: 0.409930 Aug 09 14:40:54.570913 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1321/2569] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:54 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1274 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:54.573321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b6f28b50-a926-4b7c-81ee-9cd71211f3bf req-6789211b-b282-457d-bc57-5c76279e9cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1282c4bf-25e4-40f6-8d30-ad3cd97640f6", "name": "network-vif-plugged", "status": "completed", "tag": "9e22291a-3296-424f-9afc-553476619095"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:54.597882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd1f1622-f359-44e1-9e71-828f8760776e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:54.598819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd1f1622-f359-44e1-9e71-828f8760776e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:54.603654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b6f28b50-a926-4b7c-81ee-9cd71211f3bf req-6789211b-b282-457d-bc57-5c76279e9cfb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:54.610203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b6f28b50-a926-4b7c-81ee-9cd71211f3bf req-6789211b-b282-457d-bc57-5c76279e9cfb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:54.610897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b6f28b50-a926-4b7c-81ee-9cd71211f3bf req-6789211b-b282-457d-bc57-5c76279e9cfb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:54.616657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd1f1622-f359-44e1-9e71-828f8760776e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:54.617577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd1f1622-f359-44e1-9e71-828f8760776e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:54.619444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd1f1622-f359-44e1-9e71-828f8760776e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:54.621359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd1f1622-f359-44e1-9e71-828f8760776e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:54.621988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd1f1622-f359-44e1-9e71-828f8760776e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:54.625204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd1f1622-f359-44e1-9e71-828f8760776e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:54.657301 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b6f28b50-a926-4b7c-81ee-9cd71211f3bf req-6789211b-b282-457d-bc57-5c76279e9cfb service nova] Creating event network-vif-plugged:9e22291a-3296-424f-9afc-553476619095 for instance 1282c4bf-25e4-40f6-8d30-ad3cd97640f6 on n-h1-844626-8 Aug 09 14:40:54.672219 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b6f28b50-a926-4b7c-81ee-9cd71211f3bf req-6789211b-b282-457d-bc57-5c76279e9cfb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117071 Aug 09 14:40:54.675894 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1249/2570] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:40:55.172544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ba1ae5c0-5b6c-4ba0-989c-c5c4da2643be tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dd8c7820>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:55.263291 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ba1ae5c0-5b6c-4ba0-989c-c5c4da2643be tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 200 len: 1424 microversion: 2.1 time: 0.095315 Aug 09 14:40:55.270287 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1250/2571] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:40:55 2022] GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 1424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:55.409102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd1f1622-f359-44e1-9e71-828f8760776e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:55.423757 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd1f1622-f359-44e1-9e71-828f8760776e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1507 microversion: 2.1 time: 0.829968 Aug 09 14:40:55.425214 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1322/2572] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:54 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1507 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:40:55.448520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-97defd55-e074-458a-9046-104e116673ca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:55.449662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-97defd55-e074-458a-9046-104e116673ca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:55.467121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97defd55-e074-458a-9046-104e116673ca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:55.467884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97defd55-e074-458a-9046-104e116673ca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:55.468554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97defd55-e074-458a-9046-104e116673ca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:55.469523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97defd55-e074-458a-9046-104e116673ca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:55.470197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97defd55-e074-458a-9046-104e116673ca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:55.470848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97defd55-e074-458a-9046-104e116673ca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:55.575701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8a78b8eb-d511-4040-a4f2-dd0a39b7caf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:55.576466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8a78b8eb-d511-4040-a4f2-dd0a39b7caf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:55.587965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a78b8eb-d511-4040-a4f2-dd0a39b7caf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:55.595775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a78b8eb-d511-4040-a4f2-dd0a39b7caf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:55.596543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a78b8eb-d511-4040-a4f2-dd0a39b7caf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:55.597496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a78b8eb-d511-4040-a4f2-dd0a39b7caf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:55.598153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a78b8eb-d511-4040-a4f2-dd0a39b7caf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:55.598803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a78b8eb-d511-4040-a4f2-dd0a39b7caf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:55.991079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-97defd55-e074-458a-9046-104e116673ca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:56.008318 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-97defd55-e074-458a-9046-104e116673ca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1507 microversion: 2.1 time: 0.564266 Aug 09 14:40:56.014417 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1251/2573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:55 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1507 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:56.023156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d1136412-85f0-4993-b641-0e485d0e1948 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:56.024174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d1136412-85f0-4993-b641-0e485d0e1948 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:56.038947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1136412-85f0-4993-b641-0e485d0e1948 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:56.042932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1136412-85f0-4993-b641-0e485d0e1948 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:56.043871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1136412-85f0-4993-b641-0e485d0e1948 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:56.044963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1136412-85f0-4993-b641-0e485d0e1948 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:56.048579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1136412-85f0-4993-b641-0e485d0e1948 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:56.049981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1136412-85f0-4993-b641-0e485d0e1948 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:56.239609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8a78b8eb-d511-4040-a4f2-dd0a39b7caf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:56.260562 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8a78b8eb-d511-4040-a4f2-dd0a39b7caf3 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1317 microversion: 2.1 time: 0.686358 Aug 09 14:40:56.279555 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1323/2574] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:55 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:40:56.293280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a50ae02-b95b-4492-8302-cf1831b8cbe0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:56.300301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7a50ae02-b95b-4492-8302-cf1831b8cbe0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:56.326414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a50ae02-b95b-4492-8302-cf1831b8cbe0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:56.327323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a50ae02-b95b-4492-8302-cf1831b8cbe0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:56.328191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a50ae02-b95b-4492-8302-cf1831b8cbe0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:56.330648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a50ae02-b95b-4492-8302-cf1831b8cbe0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:56.331494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a50ae02-b95b-4492-8302-cf1831b8cbe0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:56.332800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a50ae02-b95b-4492-8302-cf1831b8cbe0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:56.405122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d1136412-85f0-4993-b641-0e485d0e1948 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:56.408453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7a50ae02-b95b-4492-8302-cf1831b8cbe0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:40:56.424573 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d1136412-85f0-4993-b641-0e485d0e1948 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1280 microversion: 2.1 time: 0.407315 Aug 09 14:40:56.428477 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1252/2575] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:56 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1280 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:56.476263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2fe9df43-57b0-4bce-9189-9bdb7e6123ee tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41ddc03af0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:56.695655 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2fe9df43-57b0-4bce-9189-9bdb7e6123ee tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 200 len: 1424 microversion: 2.1 time: 0.242957 Aug 09 14:40:56.707804 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1253/2576] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:40:56 2022] GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 1424 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:56.804682 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a50ae02-b95b-4492-8302-cf1831b8cbe0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 204 len: 0 microversion: 2.1 time: 0.522975 Aug 09 14:40:56.809141 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1324/2577] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:40:56 2022] DELETE /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:40:56.818135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e75af4ef-c1fb-452d-bed2-0afdd15f5f6f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:56.819364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e75af4ef-c1fb-452d-bed2-0afdd15f5f6f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:56.845513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e75af4ef-c1fb-452d-bed2-0afdd15f5f6f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:56.846140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e75af4ef-c1fb-452d-bed2-0afdd15f5f6f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:56.851372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e75af4ef-c1fb-452d-bed2-0afdd15f5f6f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:56.855265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e75af4ef-c1fb-452d-bed2-0afdd15f5f6f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:56.858360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e75af4ef-c1fb-452d-bed2-0afdd15f5f6f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:56.862031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e75af4ef-c1fb-452d-bed2-0afdd15f5f6f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:57.290697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3157fc4f-f166-4a68-a2b7-709b915b7d33 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:57.291599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3157fc4f-f166-4a68-a2b7-709b915b7d33 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:57.296393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e75af4ef-c1fb-452d-bed2-0afdd15f5f6f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:57.298968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3157fc4f-f166-4a68-a2b7-709b915b7d33 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:57.299771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3157fc4f-f166-4a68-a2b7-709b915b7d33 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:57.300534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3157fc4f-f166-4a68-a2b7-709b915b7d33 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:57.301609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3157fc4f-f166-4a68-a2b7-709b915b7d33 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:57.302209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3157fc4f-f166-4a68-a2b7-709b915b7d33 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:57.302783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3157fc4f-f166-4a68-a2b7-709b915b7d33 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:57.306622 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e75af4ef-c1fb-452d-bed2-0afdd15f5f6f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1513 microversion: 2.1 time: 0.493798 Aug 09 14:40:57.318598 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1254/2578] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:56 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1513 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:57.449288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec7c0da4-d479-4b8d-b9ed-5ca5aea013eb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:57.449954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ec7c0da4-d479-4b8d-b9ed-5ca5aea013eb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:57.463544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7c0da4-d479-4b8d-b9ed-5ca5aea013eb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:57.464456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7c0da4-d479-4b8d-b9ed-5ca5aea013eb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:57.465045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7c0da4-d479-4b8d-b9ed-5ca5aea013eb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:57.465907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7c0da4-d479-4b8d-b9ed-5ca5aea013eb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:57.466572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7c0da4-d479-4b8d-b9ed-5ca5aea013eb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:57.474249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec7c0da4-d479-4b8d-b9ed-5ca5aea013eb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:57.633761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3157fc4f-f166-4a68-a2b7-709b915b7d33 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:57.647146 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3157fc4f-f166-4a68-a2b7-709b915b7d33 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1507 microversion: 2.1 time: 0.364727 Aug 09 14:40:57.649005 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1325/2579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:57 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1507 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:40:57.676394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-35e2313c-68db-447b-bec8-50e5e48ce0db tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:57.682595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-35e2313c-68db-447b-bec8-50e5e48ce0db tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:57.706573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35e2313c-68db-447b-bec8-50e5e48ce0db tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:57.707602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35e2313c-68db-447b-bec8-50e5e48ce0db tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:57.708241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35e2313c-68db-447b-bec8-50e5e48ce0db tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:57.711868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35e2313c-68db-447b-bec8-50e5e48ce0db tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:57.712529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35e2313c-68db-447b-bec8-50e5e48ce0db tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:57.719883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35e2313c-68db-447b-bec8-50e5e48ce0db tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:58.442191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ec7c0da4-d479-4b8d-b9ed-5ca5aea013eb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:58.457643 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec7c0da4-d479-4b8d-b9ed-5ca5aea013eb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1322 microversion: 2.1 time: 1.011964 Aug 09 14:40:58.475929 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1255/2580] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:57 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1322 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:58.491860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4071d9d-2804-4158-b582-0a28e05da0be tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dd905820>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:58.558726 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4071d9d-2804-4158-b582-0a28e05da0be tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 200 len: 1433 microversion: 2.1 time: 0.080123 Aug 09 14:40:58.570012 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1256/2581] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:40:58 2022] GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 1433 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:58.582128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-039d4f2e-c403-4fd2-9f65-017723442e58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:58.582798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-039d4f2e-c403-4fd2-9f65-017723442e58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:58.599075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-039d4f2e-c403-4fd2-9f65-017723442e58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:58.602012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-039d4f2e-c403-4fd2-9f65-017723442e58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:58.602717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-039d4f2e-c403-4fd2-9f65-017723442e58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:58.603613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-039d4f2e-c403-4fd2-9f65-017723442e58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:58.605943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-039d4f2e-c403-4fd2-9f65-017723442e58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:58.606535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-039d4f2e-c403-4fd2-9f65-017723442e58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:58.942683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-35e2313c-68db-447b-bec8-50e5e48ce0db tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:58.955630 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-35e2313c-68db-447b-bec8-50e5e48ce0db tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1507 microversion: 2.1 time: 1.284934 Aug 09 14:40:58.968713 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1326/2582] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:57 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1507 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:58.983986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b230451f-6665-4240-bb7c-5586c941992e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dd6c6310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:59.053427 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b230451f-6665-4240-bb7c-5586c941992e tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 200 len: 1433 microversion: 2.1 time: 0.083201 Aug 09 14:40:59.054536 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1327/2583] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:40:58 2022] GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 1433 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:59.059341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf8a177f-717c-41e7-a5a3-ccceb4ff9f49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:59.060075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cf8a177f-717c-41e7-a5a3-ccceb4ff9f49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:59.066802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf8a177f-717c-41e7-a5a3-ccceb4ff9f49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.067588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf8a177f-717c-41e7-a5a3-ccceb4ff9f49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.068244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf8a177f-717c-41e7-a5a3-ccceb4ff9f49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.069218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf8a177f-717c-41e7-a5a3-ccceb4ff9f49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.069877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf8a177f-717c-41e7-a5a3-ccceb4ff9f49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.070535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf8a177f-717c-41e7-a5a3-ccceb4ff9f49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.086443 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-cf8a177f-717c-41e7-a5a3-ccceb4ff9f49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf8a177f-717c-41e7-a5a3-ccceb4ff9f49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d HTTP/1.1 Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '7a2bdaee-7506-41d7-89d8-033540a2613d'} Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:40:59.088525 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:40:59.091986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:40:59.091986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.091986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:59.091986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.091986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:59.091986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:59.091986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:59.091986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:59.091986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:59.091986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:40:59.091986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.093382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-039d4f2e-c403-4fd2-9f65-017723442e58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:59.094419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf8a177f-717c-41e7-a5a3-ccceb4ff9f49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 404 to user: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:59.095497 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf8a177f-717c-41e7-a5a3-ccceb4ff9f49 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 404 len: 111 microversion: 2.1 time: 0.039686 Aug 09 14:40:59.096287 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1328/2584] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:40:59 2022] DELETE /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:40:59.101749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de5ee84f-aee8-4f27-a6ae-360d7a104add tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:40:59.103527 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-039d4f2e-c403-4fd2-9f65-017723442e58 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1513 microversion: 2.1 time: 0.532123 Aug 09 14:40:59.105078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de5ee84f-aee8-4f27-a6ae-360d7a104add tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:59.111482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de5ee84f-aee8-4f27-a6ae-360d7a104add tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.112201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de5ee84f-aee8-4f27-a6ae-360d7a104add tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.112825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de5ee84f-aee8-4f27-a6ae-360d7a104add tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.113726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de5ee84f-aee8-4f27-a6ae-360d7a104add tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.114635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de5ee84f-aee8-4f27-a6ae-360d7a104add tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.115291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de5ee84f-aee8-4f27-a6ae-360d7a104add tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.118012 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1257/2585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:58 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1513 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:59.136007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e9b34c5-6963-4399-a158-47df340b9dcf tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:59.137777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e9b34c5-6963-4399-a158-47df340b9dcf tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:59.156932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e9b34c5-6963-4399-a158-47df340b9dcf tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.157556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e9b34c5-6963-4399-a158-47df340b9dcf tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.165995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e9b34c5-6963-4399-a158-47df340b9dcf tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.167354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e9b34c5-6963-4399-a158-47df340b9dcf tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.167919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e9b34c5-6963-4399-a158-47df340b9dcf tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.168437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e9b34c5-6963-4399-a158-47df340b9dcf tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.222281 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de5ee84f-aee8-4f27-a6ae-360d7a104add tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "PUT /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1079 microversion: 2.1 time: 0.123521 Aug 09 14:40:59.224255 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1329/2586] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 9 14:40:59 2022] PUT /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1079 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:59.232212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e3d4aab5-c2b7-444a-8d3d-2ed29ee6face tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:59.233048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e3d4aab5-c2b7-444a-8d3d-2ed29ee6face tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 7a2bdaee-7506-41d7-89d8-033540a2613d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:59.252061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3d4aab5-c2b7-444a-8d3d-2ed29ee6face tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.253291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3d4aab5-c2b7-444a-8d3d-2ed29ee6face tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.253733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3d4aab5-c2b7-444a-8d3d-2ed29ee6face tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.254436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3d4aab5-c2b7-444a-8d3d-2ed29ee6face tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.254883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3d4aab5-c2b7-444a-8d3d-2ed29ee6face tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.255337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3d4aab5-c2b7-444a-8d3d-2ed29ee6face tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.281381 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e3d4aab5-c2b7-444a-8d3d-2ed29ee6face tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e3d4aab5-c2b7-444a-8d3d-2ed29ee6face tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d HTTP/1.1 Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '7a2bdaee-7506-41d7-89d8-033540a2613d'} Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:59.282166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.285926 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:59.285926 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:59.285926 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:59.285926 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:59.285926 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:59.285926 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. Aug 09 14:40:59.285926 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.285926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e3d4aab5-c2b7-444a-8d3d-2ed29ee6face tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 404 to user: Instance 7a2bdaee-7506-41d7-89d8-033540a2613d could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:59.285926 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e3d4aab5-c2b7-444a-8d3d-2ed29ee6face tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d" status: 404 len: 111 microversion: 2.1 time: 0.058164 Aug 09 14:40:59.285926 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1330/2587] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:59 2022] GET /compute/v2.1/servers/7a2bdaee-7506-41d7-89d8-033540a2613d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:40:59.290442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-01f3db3e-c5c1-483f-aefe-9eb372b6e2ba tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:59.291318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01f3db3e-c5c1-483f-aefe-9eb372b6e2ba tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:59.298498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01f3db3e-c5c1-483f-aefe-9eb372b6e2ba tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.298998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01f3db3e-c5c1-483f-aefe-9eb372b6e2ba tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.299877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01f3db3e-c5c1-483f-aefe-9eb372b6e2ba tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.301093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01f3db3e-c5c1-483f-aefe-9eb372b6e2ba tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.301578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01f3db3e-c5c1-483f-aefe-9eb372b6e2ba tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.301998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01f3db3e-c5c1-483f-aefe-9eb372b6e2ba tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.729827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e9b34c5-6963-4399-a158-47df340b9dcf tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:59.741405 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e9b34c5-6963-4399-a158-47df340b9dcf tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1467 microversion: 2.1 time: 0.621917 Aug 09 14:40:59.758453 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1258/2588] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:59 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1467 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:59.784754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b8ab377-f104-4900-92f2-83cd3bdb7bb0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:59.786802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-01f3db3e-c5c1-483f-aefe-9eb372b6e2ba tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:40:59.787357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b8ab377-f104-4900-92f2-83cd3bdb7bb0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:59.798996 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-01f3db3e-c5c1-483f-aefe-9eb372b6e2ba tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1505 microversion: 2.1 time: 0.513436 Aug 09 14:40:59.799554 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1331/2589] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:59 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:40:59.807045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22e5f88e-7856-4181-a9cb-ce57795e55dc tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:40:59.808061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22e5f88e-7856-4181-a9cb-ce57795e55dc tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:40:59.808281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b8ab377-f104-4900-92f2-83cd3bdb7bb0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.808810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b8ab377-f104-4900-92f2-83cd3bdb7bb0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.809254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b8ab377-f104-4900-92f2-83cd3bdb7bb0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.809971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b8ab377-f104-4900-92f2-83cd3bdb7bb0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.810427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b8ab377-f104-4900-92f2-83cd3bdb7bb0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.810853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b8ab377-f104-4900-92f2-83cd3bdb7bb0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.825448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22e5f88e-7856-4181-a9cb-ce57795e55dc tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.826021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22e5f88e-7856-4181-a9cb-ce57795e55dc tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.826658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22e5f88e-7856-4181-a9cb-ce57795e55dc tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.827444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22e5f88e-7856-4181-a9cb-ce57795e55dc tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:40:59.827906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22e5f88e-7856-4181-a9cb-ce57795e55dc tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:40:59.828402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22e5f88e-7856-4181-a9cb-ce57795e55dc tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:40:59.869854 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4b8ab377-f104-4900-92f2-83cd3bdb7bb0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b8ab377-f104-4900-92f2-83cd3bdb7bb0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 HTTP/1.1 Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '9bd1379b-b2dc-4866-9a3f-d4d03c495a25'} Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:40:59.891978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:40:59.895811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:40:59.895811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.895811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:40:59.895811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.895811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:40:59.895811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:40:59.895811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:40:59.895811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:40:59.895811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:40:59.895811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:40:59.895811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:40:59.898053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b8ab377-f104-4900-92f2-83cd3bdb7bb0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 404 to user: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:40:59.899304 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b8ab377-f104-4900-92f2-83cd3bdb7bb0 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 404 len: 111 microversion: 2.1 time: 0.138807 Aug 09 14:40:59.909987 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1259/2590] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:40:59 2022] DELETE /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:40:59.928247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f83ef550-ca95-4e8c-b190-73e69533e4de tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dde38040>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:00.041232 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f83ef550-ca95-4e8c-b190-73e69533e4de tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/f0e08d35-6013-4ff5-9f41-f40d5739b250" status: 200 len: 784 microversion: 2.1 time: 0.129875 Aug 09 14:41:00.042058 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1260/2591] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:40:59 2022] GET /compute/v2.1/images/f0e08d35-6013-4ff5-9f41-f40d5739b250 => generated 784 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:00.058395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e0749a4-cd08-42ac-8342-f9b35583baa2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:00.059015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6e0749a4-cd08-42ac-8342-f9b35583baa2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:00.078566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e0749a4-cd08-42ac-8342-f9b35583baa2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:00.079075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e0749a4-cd08-42ac-8342-f9b35583baa2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:00.079542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e0749a4-cd08-42ac-8342-f9b35583baa2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:00.080256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e0749a4-cd08-42ac-8342-f9b35583baa2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:00.080702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e0749a4-cd08-42ac-8342-f9b35583baa2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:00.081135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e0749a4-cd08-42ac-8342-f9b35583baa2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:00.344293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22e5f88e-7856-4181-a9cb-ce57795e55dc tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:00.352934 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22e5f88e-7856-4181-a9cb-ce57795e55dc tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1322 microversion: 2.1 time: 0.552302 Aug 09 14:41:00.353530 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1332/2592] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:40:59 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:00.369628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8539ca82-dfb6-442f-9cc1-7663fe917fad tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:00.376522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8539ca82-dfb6-442f-9cc1-7663fe917fad tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: 9bd1379b-b2dc-4866-9a3f-d4d03c495a25] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:00.389082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8539ca82-dfb6-442f-9cc1-7663fe917fad tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:00.389789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8539ca82-dfb6-442f-9cc1-7663fe917fad tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:00.390300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8539ca82-dfb6-442f-9cc1-7663fe917fad tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:00.390681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6e0749a4-cd08-42ac-8342-f9b35583baa2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:00.391208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8539ca82-dfb6-442f-9cc1-7663fe917fad tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:00.392008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8539ca82-dfb6-442f-9cc1-7663fe917fad tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:00.392505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8539ca82-dfb6-442f-9cc1-7663fe917fad tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:00.398321 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6e0749a4-cd08-42ac-8342-f9b35583baa2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1505 microversion: 2.1 time: 0.355277 Aug 09 14:41:00.399040 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1261/2593] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:00 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:00.404682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-05a167c1-fad7-462d-a46c-57983335a0a2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:00.426249 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-8539ca82-dfb6-442f-9cc1-7663fe917fad tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8539ca82-dfb6-442f-9cc1-7663fe917fad tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 HTTP/1.1 Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '9bd1379b-b2dc-4866-9a3f-d4d03c495a25'} Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:00.427844 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:00.431566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:00.431566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:00.431566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:00.431566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:00.431566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:00.431566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. Aug 09 14:41:00.431566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:00.431566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8539ca82-dfb6-442f-9cc1-7663fe917fad tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 404 to user: Instance 9bd1379b-b2dc-4866-9a3f-d4d03c495a25 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:00.431566 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8539ca82-dfb6-442f-9cc1-7663fe917fad tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25" status: 404 len: 111 microversion: 2.1 time: 0.069935 Aug 09 14:41:00.431566 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1333/2594] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:00 2022] GET /compute/v2.1/servers/9bd1379b-b2dc-4866-9a3f-d4d03c495a25 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:41:00.447006 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-05a167c1-fad7-462d-a46c-57983335a0a2 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019555 Aug 09 14:41:00.452018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1685514664", "imageRef": "b8126a00-ba4b-445d-9b01-37576000f12b", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cb3d6fa6-9a72-4274-9e47-14748a501dae"}], "security_groups": [{"name": "tempest-securitygroup--1527060726"}], "key_name": "tempest-keypair-1666140331", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:00.453836 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1262/2595] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:41:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:00.459058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:00.459943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:00.472949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:00.479212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:00.480008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:00.482148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:00.482837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:00.483650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:00.565712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:00.566199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:00.568412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:00.568878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lazy-loading 'fault' on Instance uuid ea1bd74c-40fa-4132-84a9-c44b5a28db13 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:41:00.655860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:00.677552 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9fc4f9c-bb48-4430-8d95-e9b80e00d95a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 200 len: 1318 microversion: 2.1 time: 0.222177 Aug 09 14:41:00.680220 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1263/2596] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:00 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:00.692937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d8fc6d28-d138-4157-9e01-a7d89220e62a req-93c88992-7aa9-4653-a33a-e4687b8776e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1bd74c-40fa-4132-84a9-c44b5a28db13", "name": "network-vif-deleted", "tag": "805c398a-bd11-4bab-9aa9-cb01d6d0dcd8"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:00.721665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d8fc6d28-d138-4157-9e01-a7d89220e62a req-93c88992-7aa9-4653-a33a-e4687b8776e7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:00.722811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d8fc6d28-d138-4157-9e01-a7d89220e62a req-93c88992-7aa9-4653-a33a-e4687b8776e7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:00.724450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d8fc6d28-d138-4157-9e01-a7d89220e62a req-93c88992-7aa9-4653-a33a-e4687b8776e7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:00.740144 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d8fc6d28-d138-4157-9e01-a7d89220e62a req-93c88992-7aa9-4653-a33a-e4687b8776e7 service nova] Creating event network-vif-deleted:805c398a-bd11-4bab-9aa9-cb01d6d0dcd8 for instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 on n-h2-844626-8 Aug 09 14:41:00.751690 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d8fc6d28-d138-4157-9e01-a7d89220e62a req-93c88992-7aa9-4653-a33a-e4687b8776e7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067792 Aug 09 14:41:00.752464 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1264/2597] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:00.760265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9d9f915b-5f2e-4516-8f96-a7cea096539e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:00.763404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d9f915b-5f2e-4516-8f96-a7cea096539e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:00.771246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d9f915b-5f2e-4516-8f96-a7cea096539e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:00.772000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d9f915b-5f2e-4516-8f96-a7cea096539e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:00.772618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d9f915b-5f2e-4516-8f96-a7cea096539e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:00.773822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d9f915b-5f2e-4516-8f96-a7cea096539e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:00.774456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d9f915b-5f2e-4516-8f96-a7cea096539e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:00.775109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d9f915b-5f2e-4516-8f96-a7cea096539e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:00.865066 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9d9f915b-5f2e-4516-8f96-a7cea096539e tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "PUT /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1081 microversion: 2.1 time: 0.111211 Aug 09 14:41:00.875298 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1265/2598] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 9 14:41:00 2022] PUT /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1081 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:00.875298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa04937c-f74e-4a99-81c9-1fd658f75dd4 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41ddeaa700>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:00.912710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] validate_networks() for [('cb3d6fa6-9a72-4274-9e47-14748a501dae', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:41:01.701438 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa04937c-f74e-4a99-81c9-1fd658f75dd4 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "DELETE /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 204 len: 0 microversion: 2.1 time: 0.834056 Aug 09 14:41:01.706028 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1266/2599] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:00 2022] DELETE /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:41:01.712719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4edb491-a868-4bec-9848-b0cf0452e1d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:01.714063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4edb491-a868-4bec-9848-b0cf0452e1d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:01.732089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4edb491-a868-4bec-9848-b0cf0452e1d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:01.733959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4edb491-a868-4bec-9848-b0cf0452e1d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:01.735810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4edb491-a868-4bec-9848-b0cf0452e1d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:01.738787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4edb491-a868-4bec-9848-b0cf0452e1d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:01.739375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4edb491-a868-4bec-9848-b0cf0452e1d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:01.741472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4edb491-a868-4bec-9848-b0cf0452e1d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:01.861095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:41:01.861664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:41:01.862256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:41:01.863067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:41:01.863704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:41:01.885612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:01.888559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:01.889145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:01.890047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:01.891832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:01.892546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:01.932662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Getting quotas for project 320d96eea4cd4bcf83a3e69daf2f77a3. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:41:01.941376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Getting quotas for user a6ddc08c6cfc44fa8ec90cd2752c14ef and project 320d96eea4cd4bcf83a3e69daf2f77a3. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:41:01.960322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:41:01.962817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b8126a00-ba4b-445d-9b01-37576000f12b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:41:02.031181 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79969d21-d0b4-4d38-92a8-f016df0340a1 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.590878 Aug 09 14:41:02.032056 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1334/2600] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:41:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:41:02.170428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:02.214807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4edb491-a868-4bec-9848-b0cf0452e1d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:02.225720 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4edb491-a868-4bec-9848-b0cf0452e1d8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1507 microversion: 2.1 time: 0.518183 Aug 09 14:41:02.226381 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1267/2601] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:01 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1507 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:02.245992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99ec3ca5-72f3-46ca-a4b9-c0e062317403 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:02.246613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-99ec3ca5-72f3-46ca-a4b9-c0e062317403 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:02.258901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99ec3ca5-72f3-46ca-a4b9-c0e062317403 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:02.259430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99ec3ca5-72f3-46ca-a4b9-c0e062317403 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:02.259866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99ec3ca5-72f3-46ca-a4b9-c0e062317403 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:02.260573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99ec3ca5-72f3-46ca-a4b9-c0e062317403 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:02.261131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99ec3ca5-72f3-46ca-a4b9-c0e062317403 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:02.261438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99ec3ca5-72f3-46ca-a4b9-c0e062317403 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:02.283427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-679a13a4-ee7b-4511-a490-732c3502f145 req-3d264f1e-1d9b-4e00-8819-19b625133b65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5", "tag": "b8216191-4500-459f-924a-a1d595ec3b9a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:02.312517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-679a13a4-ee7b-4511-a490-732c3502f145 req-3d264f1e-1d9b-4e00-8819-19b625133b65 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:02.313409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-679a13a4-ee7b-4511-a490-732c3502f145 req-3d264f1e-1d9b-4e00-8819-19b625133b65 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:02.313864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-679a13a4-ee7b-4511-a490-732c3502f145 req-3d264f1e-1d9b-4e00-8819-19b625133b65 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:02.329640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:02.341010 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-679a13a4-ee7b-4511-a490-732c3502f145 req-3d264f1e-1d9b-4e00-8819-19b625133b65 service nova] Creating event network-changed:b8216191-4500-459f-924a-a1d595ec3b9a for instance 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 on n-h2-844626-8 Aug 09 14:41:02.352020 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-679a13a4-ee7b-4511-a490-732c3502f145 req-3d264f1e-1d9b-4e00-8819-19b625133b65 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317459 Aug 09 14:41:02.358235 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1335/2602] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:02.364513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efe1c660-d028-4f4d-9900-78d96f58540d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:02.365448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-efe1c660-d028-4f4d-9900-78d96f58540d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:02.375946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efe1c660-d028-4f4d-9900-78d96f58540d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:02.377579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efe1c660-d028-4f4d-9900-78d96f58540d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:02.378245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efe1c660-d028-4f4d-9900-78d96f58540d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:02.379303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efe1c660-d028-4f4d-9900-78d96f58540d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:02.380043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efe1c660-d028-4f4d-9900-78d96f58540d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:02.380757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efe1c660-d028-4f4d-9900-78d96f58540d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:02.401913 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-efe1c660-d028-4f4d-9900-78d96f58540d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efe1c660-d028-4f4d-9900-78d96f58540d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 HTTP/1.1 Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'ea1bd74c-40fa-4132-84a9-c44b5a28db13'} Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:02.404588 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:02.408394 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:02.408394 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:02.408394 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:02.408394 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:02.408394 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:41:02.408394 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:02.408394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efe1c660-d028-4f4d-9900-78d96f58540d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:02.409574 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-efe1c660-d028-4f4d-9900-78d96f58540d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 404 len: 111 microversion: 2.1 time: 0.049855 Aug 09 14:41:02.413686 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1336/2603] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:02 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:41:02.425115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9e746ed-da80-45ab-85a3-4f406b752450 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dcb1b550>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:02.499688 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e9e746ed-da80-45ab-85a3-4f406b752450 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] HTTP exception thrown: Image not found. Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9e746ed-da80-45ab-85a3-4f406b752450 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Request method failure captured: Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 HTTP/1.1 Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nHGdpcL1DU37lrGh19mPCZdrTEivuEVEodErVadIVPa_2bjtxWaWNe4Ttv464Ey2SRYoNQG89wzNwrif8YIEhXji-RV42hQ1tnam3zKk1FU3psugsTwteARTW03O5oq5VjD0CQXpLCj5M2Io6B_6BMvReodzv7GpI88_SEY-VhXK5U Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 0054032608084cdc8ef35d7638e13615 Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesOneServerTestJSON-1803809503 Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0054032608084cdc8ef35d7638e13615", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0054032608084cdc8ef35d7638e13615"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0054032608084cdc8ef35d7638e13615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0054032608084cdc8ef35d7638e13615"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesOneServerTestJSON-1803809503 Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 0054032608084cdc8ef35d7638e13615 Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1803809503 Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesOneServerTestJSON-1803809503-project Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 9f5334b328ca4a32ab7b5b258249bcb9 Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesOneServerTestJSON-1803809503-project Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: exception: Image not found. Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3d55d2f0-3faf-4098-a53d-1c91da0d12e3'} Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3d55d2f0-3faf-4098-a53d-1c91da0d12e3 Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 14:41:02.505240 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3d55d2f0-3faf-4098-a53d-1c91da0d12e3 could not be found. Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:41:02.509198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:02.516921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9e746ed-da80-45ab-85a3-4f406b752450 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Returning 404 to user: Image not found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:02.518469 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e9e746ed-da80-45ab-85a3-4f406b752450 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 404 len: 62 microversion: 2.1 time: 0.103641 Aug 09 14:41:02.519970 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1337/2604] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:41:02 2022] GET /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:41:02.527367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-71357020-2d0c-4c27-9be1-885a1bb65c5f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:02.528309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-71357020-2d0c-4c27-9be1-885a1bb65c5f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:02.736386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=10 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:02.766413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-71357020-2d0c-4c27-9be1-885a1bb65c5f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:02.773563 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-71357020-2d0c-4c27-9be1-885a1bb65c5f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1246 microversion: 2.1 time: 0.252133 Aug 09 14:41:02.774132 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1338/2605] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:02 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1246 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:02.786117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9df1c88-d26c-4ce7-8823-f196ce69ce97 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:02.787894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e9df1c88-d26c-4ce7-8823-f196ce69ce97 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:02.798083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9df1c88-d26c-4ce7-8823-f196ce69ce97 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:02.799166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9df1c88-d26c-4ce7-8823-f196ce69ce97 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:02.800034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9df1c88-d26c-4ce7-8823-f196ce69ce97 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:02.801366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9df1c88-d26c-4ce7-8823-f196ce69ce97 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:02.802309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9df1c88-d26c-4ce7-8823-f196ce69ce97 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:02.803236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9df1c88-d26c-4ce7-8823-f196ce69ce97 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:02.895104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-99ec3ca5-72f3-46ca-a4b9-c0e062317403 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:02.903333 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-99ec3ca5-72f3-46ca-a4b9-c0e062317403 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1322 microversion: 2.1 time: 0.662981 Aug 09 14:41:02.917938 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1268/2606] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:02 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1322 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:02.922945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf783063-840f-48ba-8fed-0f71f58741e7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '.version_select at 0x7f41ddaea5e0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:02.966984 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf783063-840f-48ba-8fed-0f71f58741e7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-key-1720558121" status: 202 len: 0 microversion: 2.1 time: 0.047822 Aug 09 14:41:02.968218 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1269/2607] 10.222.0.50 () {58 vars in 1209 bytes} [Tue Aug 9 14:41:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1720558121 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:41:02.973128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52b735ca-08c4-41c7-aee8-5bb76ab7b8e8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-788448946"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:02.977960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52b735ca-08c4-41c7-aee8-5bb76ab7b8e8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:02.993908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52b735ca-08c4-41c7-aee8-5bb76ab7b8e8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:02.994429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52b735ca-08c4-41c7-aee8-5bb76ab7b8e8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:02.995038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52b735ca-08c4-41c7-aee8-5bb76ab7b8e8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:02.995924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52b735ca-08c4-41c7-aee8-5bb76ab7b8e8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:02.996549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52b735ca-08c4-41c7-aee8-5bb76ab7b8e8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:02.997133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52b735ca-08c4-41c7-aee8-5bb76ab7b8e8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:03.300041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:03.370384 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52b735ca-08c4-41c7-aee8-5bb76ab7b8e8 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "POST /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092/action" status: 202 len: 0 microversion: 2.1 time: 0.400663 Aug 09 14:41:03.375544 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1270/2608] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:41:02 2022] POST /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 14:41:03.381186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1a7f99ca-4595-4319-b239-3249724398cc req-2a49ec23-62ef-48b8-9be9-10f2d0959d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f61de9f-77ce-4797-a4cf-6005d3c64092", "name": "network-vif-unplugged", "status": "completed", "tag": "f033813f-a028-456e-9341-0cb54066aa57"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:03.409272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1a7f99ca-4595-4319-b239-3249724398cc req-2a49ec23-62ef-48b8-9be9-10f2d0959d1f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:03.409782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1a7f99ca-4595-4319-b239-3249724398cc req-2a49ec23-62ef-48b8-9be9-10f2d0959d1f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:03.410215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1a7f99ca-4595-4319-b239-3249724398cc req-2a49ec23-62ef-48b8-9be9-10f2d0959d1f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:03.433812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e9df1c88-d26c-4ce7-8823-f196ce69ce97 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:03.442160 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1a7f99ca-4595-4319-b239-3249724398cc req-2a49ec23-62ef-48b8-9be9-10f2d0959d1f service nova] Creating event network-vif-unplugged:f033813f-a028-456e-9341-0cb54066aa57 for instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 on n-h1-844626-8 Aug 09 14:41:03.447263 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e9df1c88-d26c-4ce7-8823-f196ce69ce97 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1507 microversion: 2.1 time: 0.666714 Aug 09 14:41:03.448350 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1339/2609] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:02 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1507 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:03.462685 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1a7f99ca-4595-4319-b239-3249724398cc req-2a49ec23-62ef-48b8-9be9-10f2d0959d1f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085468 Aug 09 14:41:03.463602 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1271/2610] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:03.470625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7ff6bbd5-3f98-488d-ae8c-9a7736f78ca9 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dd929550>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:03.472866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-239395938", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "7d4b5e6e-1097-46ba-bb21-ff9e1560d087"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:03.576906 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7ff6bbd5-3f98-488d-ae8c-9a7736f78ca9 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41" status: 200 len: 1428 microversion: 2.1 time: 0.111784 Aug 09 14:41:03.578054 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1272/2611] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:41:03 2022] GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41 => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:03.590737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-69c9474f-913e-4c79-8d86-73e5621b132d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:03.593339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-69c9474f-913e-4c79-8d86-73e5621b132d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:03.602176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] validate_networks() for [('7d4b5e6e-1097-46ba-bb21-ff9e1560d087', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:41:03.603810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69c9474f-913e-4c79-8d86-73e5621b132d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:03.605375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69c9474f-913e-4c79-8d86-73e5621b132d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:03.606039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69c9474f-913e-4c79-8d86-73e5621b132d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:03.607001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69c9474f-913e-4c79-8d86-73e5621b132d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:03.607691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69c9474f-913e-4c79-8d86-73e5621b132d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:03.608293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69c9474f-913e-4c79-8d86-73e5621b132d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:03.692424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-69c9474f-913e-4c79-8d86-73e5621b132d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:41:03.881568 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-69c9474f-913e-4c79-8d86-73e5621b132d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 204 len: 0 microversion: 2.1 time: 0.302291 Aug 09 14:41:03.884733 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1273/2612] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:41:03 2022] DELETE /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:41:03.904132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b659a5b8-dd54-48e6-ae67-0c3886a89c0e tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:03.908186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b659a5b8-dd54-48e6-ae67-0c3886a89c0e tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:03.940584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b659a5b8-dd54-48e6-ae67-0c3886a89c0e tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:03.941478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b659a5b8-dd54-48e6-ae67-0c3886a89c0e tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:03.942129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b659a5b8-dd54-48e6-ae67-0c3886a89c0e tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:03.943075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b659a5b8-dd54-48e6-ae67-0c3886a89c0e tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:03.943752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b659a5b8-dd54-48e6-ae67-0c3886a89c0e tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:03.944373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b659a5b8-dd54-48e6-ae67-0c3886a89c0e tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:04.077853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b659a5b8-dd54-48e6-ae67-0c3886a89c0e tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:04.086525 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b659a5b8-dd54-48e6-ae67-0c3886a89c0e tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1306 microversion: 2.1 time: 0.200451 Aug 09 14:41:04.100772 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1274/2613] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:03 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1306 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:04.106480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9db3f299-13ea-4d64-9e39-2326e79d4eb2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:04.107233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9db3f299-13ea-4d64-9e39-2326e79d4eb2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:04.122050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9db3f299-13ea-4d64-9e39-2326e79d4eb2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:04.123773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9db3f299-13ea-4d64-9e39-2326e79d4eb2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:04.124419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9db3f299-13ea-4d64-9e39-2326e79d4eb2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:04.125349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9db3f299-13ea-4d64-9e39-2326e79d4eb2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:04.126020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9db3f299-13ea-4d64-9e39-2326e79d4eb2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:04.126650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9db3f299-13ea-4d64-9e39-2326e79d4eb2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:04.170650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9db3f299-13ea-4d64-9e39-2326e79d4eb2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:41:04.266105 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.compute.api [None req-9db3f299-13ea-4d64-9e39-2326e79d4eb2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Instance is already in deleting state, ignoring this request Aug 09 14:41:04.268727 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9db3f299-13ea-4d64-9e39-2326e79d4eb2 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 204 len: 0 microversion: 2.1 time: 0.165044 Aug 09 14:41:04.269686 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1275/2614] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:41:04 2022] DELETE /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:41:04.279992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4acc8878-8ef6-4a8b-9b97-04b999416eef tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:04.281441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4acc8878-8ef6-4a8b-9b97-04b999416eef tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:04.302151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4acc8878-8ef6-4a8b-9b97-04b999416eef tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:04.302650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4acc8878-8ef6-4a8b-9b97-04b999416eef tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:04.303994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4acc8878-8ef6-4a8b-9b97-04b999416eef tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:04.305853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4acc8878-8ef6-4a8b-9b97-04b999416eef tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:04.307008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4acc8878-8ef6-4a8b-9b97-04b999416eef tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:04.308984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4acc8878-8ef6-4a8b-9b97-04b999416eef tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:04.986157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4acc8878-8ef6-4a8b-9b97-04b999416eef tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:05.001016 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4acc8878-8ef6-4a8b-9b97-04b999416eef tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1322 microversion: 2.1 time: 0.728416 Aug 09 14:41:05.037394 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1276/2615] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:04 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1322 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:05.054835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-38b9e37c-859f-4242-acd8-1e9bb3cf8786 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:05.060049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-38b9e37c-859f-4242-acd8-1e9bb3cf8786 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:05.095269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38b9e37c-859f-4242-acd8-1e9bb3cf8786 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:05.095824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38b9e37c-859f-4242-acd8-1e9bb3cf8786 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:05.096256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38b9e37c-859f-4242-acd8-1e9bb3cf8786 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:05.097027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38b9e37c-859f-4242-acd8-1e9bb3cf8786 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:05.097501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38b9e37c-859f-4242-acd8-1e9bb3cf8786 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:05.097981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38b9e37c-859f-4242-acd8-1e9bb3cf8786 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:05.351685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:41:05.352261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:41:05.352716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:41:05.353362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:41:05.354106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:41:05.376830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:05.377312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:05.377748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:05.378481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:05.378920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:05.390782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:05.479653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:41:05.496803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for user 03bdf5ec21854ec8b6561a121ce1f1ef and project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:41:05.543588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:41:05.546208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:41:05.653330 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a1667be2-a985-4dbb-b2e5-403d5288d366 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.185452 Aug 09 14:41:05.654361 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1340/2616] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:41:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:41:05.667525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7791d8b9-90b6-4716-bf5f-68750d361265 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dd839d30>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:05.772818 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7791d8b9-90b6-4716-bf5f-68750d361265 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41" status: 200 len: 1428 microversion: 2.1 time: 0.115858 Aug 09 14:41:05.773899 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1341/2617] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:41:05 2022] GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41 => generated 1428 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:05.796676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-988685e5-c12a-4c6e-b2c5-1d7aa1e70f09 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:05.797802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-988685e5-c12a-4c6e-b2c5-1d7aa1e70f09 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:05.825405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988685e5-c12a-4c6e-b2c5-1d7aa1e70f09 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:05.835436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988685e5-c12a-4c6e-b2c5-1d7aa1e70f09 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:05.839880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988685e5-c12a-4c6e-b2c5-1d7aa1e70f09 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:05.840966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988685e5-c12a-4c6e-b2c5-1d7aa1e70f09 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:05.847945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988685e5-c12a-4c6e-b2c5-1d7aa1e70f09 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:05.848711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988685e5-c12a-4c6e-b2c5-1d7aa1e70f09 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:06.619807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-988685e5-c12a-4c6e-b2c5-1d7aa1e70f09 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:06.629641 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-988685e5-c12a-4c6e-b2c5-1d7aa1e70f09 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1304 microversion: 2.1 time: 0.853776 Aug 09 14:41:06.651429 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1342/2618] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:05 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1304 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:06.685243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-617cfec1-1d03-4d5c-b688-87717b71da2a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:06.685871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-617cfec1-1d03-4d5c-b688-87717b71da2a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:06.686362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-38b9e37c-859f-4242-acd8-1e9bb3cf8786 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:06.694761 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-38b9e37c-859f-4242-acd8-1e9bb3cf8786 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1513 microversion: 2.1 time: 1.655941 Aug 09 14:41:06.703237 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1277/2619] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:05 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1513 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:06.720708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fb2a8a28-8200-4207-a14d-977244561fe2 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:06.721682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fb2a8a28-8200-4207-a14d-977244561fe2 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:06.738003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb2a8a28-8200-4207-a14d-977244561fe2 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:06.739741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb2a8a28-8200-4207-a14d-977244561fe2 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:06.742097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb2a8a28-8200-4207-a14d-977244561fe2 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:06.743633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb2a8a28-8200-4207-a14d-977244561fe2 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:06.744791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb2a8a28-8200-4207-a14d-977244561fe2 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:06.746498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb2a8a28-8200-4207-a14d-977244561fe2 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:07.192981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-617cfec1-1d03-4d5c-b688-87717b71da2a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:07.202672 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-617cfec1-1d03-4d5c-b688-87717b71da2a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1208 microversion: 2.1 time: 0.556670 Aug 09 14:41:07.217654 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1343/2620] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:06 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1208 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:07.243040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60703621-b45f-4bba-909c-fa60c228ec8f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:07.248185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-60703621-b45f-4bba-909c-fa60c228ec8f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:07.258843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60703621-b45f-4bba-909c-fa60c228ec8f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:07.259790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60703621-b45f-4bba-909c-fa60c228ec8f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:07.260440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60703621-b45f-4bba-909c-fa60c228ec8f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:07.261369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60703621-b45f-4bba-909c-fa60c228ec8f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:07.262280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60703621-b45f-4bba-909c-fa60c228ec8f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:07.263033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60703621-b45f-4bba-909c-fa60c228ec8f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:07.313598 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-60703621-b45f-4bba-909c-fa60c228ec8f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60703621-b45f-4bba-909c-fa60c228ec8f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d HTTP/1.1 Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'ff8a0577-e7e0-414e-b847-d01ecbd5eb4d'} Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:41:07.315862 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60703621-b45f-4bba-909c-fa60c228ec8f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 404 to user: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:07.319736 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60703621-b45f-4bba-909c-fa60c228ec8f tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 404 len: 111 microversion: 2.1 time: 0.088009 Aug 09 14:41:07.336837 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1344/2621] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:41:07 2022] DELETE /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:41:07.349095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f475cea4-df35-46ef-9c6e-cc4485f20961 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dd7fca60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:07.474307 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f475cea4-df35-46ef-9c6e-cc4485f20961 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41" status: 200 len: 1428 microversion: 2.1 time: 0.135828 Aug 09 14:41:07.475041 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1345/2622] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:41:07 2022] GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41 => generated 1428 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:07.507444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6510cc07-bc0b-4be7-b65a-4203a0c884d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:07.508188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6510cc07-bc0b-4be7-b65a-4203a0c884d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] [instance: ff8a0577-e7e0-414e-b847-d01ecbd5eb4d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:07.530569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6510cc07-bc0b-4be7-b65a-4203a0c884d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:07.530986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6510cc07-bc0b-4be7-b65a-4203a0c884d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:07.531481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6510cc07-bc0b-4be7-b65a-4203a0c884d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:07.532203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6510cc07-bc0b-4be7-b65a-4203a0c884d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:07.532755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6510cc07-bc0b-4be7-b65a-4203a0c884d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:07.539154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6510cc07-bc0b-4be7-b65a-4203a0c884d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:07.576051 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-6510cc07-bc0b-4be7-b65a-4203a0c884d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] HTTP exception thrown: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6510cc07-bc0b-4be7-b65a-4203a0c884d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Request method failure captured: Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d HTTP/1.1 Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nBF67GTS4VFWUFzJlWbG1uA_ikkwqAGaEy7iNErxbZ_gxxsGy-o49IPeH2n-cacI1dMxPDqTbB6pb86XaqemQ8-40ssPf2MW0kuimrOVQm61MeAMwa4wZuZ-Zj7NHgIjeTKyF-KP_Qzd1BWhHw8YAfOTOv1WKBIRGaKumzz_qk9Bss Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_5ee97f231f894a7b8f401cce82b7026e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/5ee97f231f894a7b8f401cce82b7026e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 5ee97f231f894a7b8f401cce82b7026e Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-281630838 Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 788fc5ec92a2482db1b27657c4f6b426 Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeNegativeTest-281630838-project Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'ff8a0577-e7e0-414e-b847-d01ecbd5eb4d'} Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:07.578145 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:07.582051 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:07.582051 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:07.582051 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:07.582051 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:07.582051 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:07.582051 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. Aug 09 14:41:07.582051 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:07.582051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6510cc07-bc0b-4be7-b65a-4203a0c884d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] Returning 404 to user: Instance ff8a0577-e7e0-414e-b847-d01ecbd5eb4d could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:07.582051 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6510cc07-bc0b-4be7-b65a-4203a0c884d4 tempest-AttachVolumeNegativeTest-281630838 tempest-AttachVolumeNegativeTest-281630838-project] 10.222.0.50 "GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d" status: 404 len: 111 microversion: 2.1 time: 0.092513 Aug 09 14:41:07.587580 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1346/2623] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:07 2022] GET /compute/v2.1/servers/ff8a0577-e7e0-414e-b847-d01ecbd5eb4d => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:41:07.661427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8c864bc3-f10d-441a-a6e4-e8573aeb3e00 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:07.662128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8c864bc3-f10d-441a-a6e4-e8573aeb3e00 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:07.669719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:07.684063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c864bc3-f10d-441a-a6e4-e8573aeb3e00 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:07.685084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c864bc3-f10d-441a-a6e4-e8573aeb3e00 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:07.685738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c864bc3-f10d-441a-a6e4-e8573aeb3e00 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:07.686767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c864bc3-f10d-441a-a6e4-e8573aeb3e00 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:07.689753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c864bc3-f10d-441a-a6e4-e8573aeb3e00 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:07.692515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c864bc3-f10d-441a-a6e4-e8573aeb3e00 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:07.733554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fb2a8a28-8200-4207-a14d-977244561fe2 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:07.744042 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fb2a8a28-8200-4207-a14d-977244561fe2 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1322 microversion: 2.1 time: 1.039114 Aug 09 14:41:07.758452 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1278/2624] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:06 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1322 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:07.763762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e7a19ebb-dbb4-49db-91d6-3ad25acab0f8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:07.764660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e7a19ebb-dbb4-49db-91d6-3ad25acab0f8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:07.773871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7a19ebb-dbb4-49db-91d6-3ad25acab0f8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:07.774624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7a19ebb-dbb4-49db-91d6-3ad25acab0f8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:07.775264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7a19ebb-dbb4-49db-91d6-3ad25acab0f8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:07.776138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7a19ebb-dbb4-49db-91d6-3ad25acab0f8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:07.776742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7a19ebb-dbb4-49db-91d6-3ad25acab0f8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:07.777320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7a19ebb-dbb4-49db-91d6-3ad25acab0f8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:07.813517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8c864bc3-f10d-441a-a6e4-e8573aeb3e00 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:07.827065 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8c864bc3-f10d-441a-a6e4-e8573aeb3e00 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1304 microversion: 2.1 time: 0.171509 Aug 09 14:41:07.830787 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1347/2625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:07 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1304 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:08.240890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9cd6bad6-9b14-47be-9543-2f64d236fa19 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:08.241599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9cd6bad6-9b14-47be-9543-2f64d236fa19 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:08.256049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cd6bad6-9b14-47be-9543-2f64d236fa19 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:08.256771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cd6bad6-9b14-47be-9543-2f64d236fa19 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:08.257369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cd6bad6-9b14-47be-9543-2f64d236fa19 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:08.258310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cd6bad6-9b14-47be-9543-2f64d236fa19 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:08.259069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cd6bad6-9b14-47be-9543-2f64d236fa19 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:08.260489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cd6bad6-9b14-47be-9543-2f64d236fa19 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:08.399677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e7a19ebb-dbb4-49db-91d6-3ad25acab0f8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74c10f0e3a40477f86dfd6cdd03fe0f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a61c381646364214a62210a2d8672314', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:08.418081 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e7a19ebb-dbb4-49db-91d6-3ad25acab0f8 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 200 len: 1513 microversion: 2.1 time: 0.655923 Aug 09 14:41:08.435478 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1279/2626] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:07 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 1513 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:08.491544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d808b77-ce84-42f6-8def-a8aaf4c79f02 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41de9b7790>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:08.504049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9cd6bad6-9b14-47be-9543-2f64d236fa19 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:08.512776 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9cd6bad6-9b14-47be-9543-2f64d236fa19 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1268 microversion: 2.1 time: 0.276384 Aug 09 14:41:08.513554 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1348/2627] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:08 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1268 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:41:08.693948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-35b89741-fe85-4c47-9976-f2155c8bcbec req-b5da3df3-f928-4392-937a-aa731eed73bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1282c4bf-25e4-40f6-8d30-ad3cd97640f6", "name": "network-vif-deleted", "tag": "9e22291a-3296-424f-9afc-553476619095"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:08.704133 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d808b77-ce84-42f6-8def-a8aaf4c79f02 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41" status: 200 len: 1428 microversion: 2.1 time: 0.203238 Aug 09 14:41:08.706001 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1280/2628] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:41:08 2022] GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41 => generated 1428 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:08.749408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-35b89741-fe85-4c47-9976-f2155c8bcbec req-b5da3df3-f928-4392-937a-aa731eed73bd service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:08.750595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-35b89741-fe85-4c47-9976-f2155c8bcbec req-b5da3df3-f928-4392-937a-aa731eed73bd service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:08.751305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-35b89741-fe85-4c47-9976-f2155c8bcbec req-b5da3df3-f928-4392-937a-aa731eed73bd service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:08.790242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ab926fdb-3995-40cc-a6c8-1c4194e4b315 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:08.791066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ab926fdb-3995-40cc-a6c8-1c4194e4b315 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:08.805199 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-35b89741-fe85-4c47-9976-f2155c8bcbec req-b5da3df3-f928-4392-937a-aa731eed73bd service nova] Creating event network-vif-deleted:9e22291a-3296-424f-9afc-553476619095 for instance 1282c4bf-25e4-40f6-8d30-ad3cd97640f6 on n-h1-844626-8 Aug 09 14:41:08.829607 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-35b89741-fe85-4c47-9976-f2155c8bcbec req-b5da3df3-f928-4392-937a-aa731eed73bd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134528 Aug 09 14:41:08.830821 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1349/2629] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:08.846363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab926fdb-3995-40cc-a6c8-1c4194e4b315 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:08.849567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab926fdb-3995-40cc-a6c8-1c4194e4b315 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:08.851605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab926fdb-3995-40cc-a6c8-1c4194e4b315 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:08.852842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1fe625f-9cbe-4fbb-8779-c184ffffe9cd tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:08.853467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1fe625f-9cbe-4fbb-8779-c184ffffe9cd tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:08.856083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab926fdb-3995-40cc-a6c8-1c4194e4b315 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:08.858463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab926fdb-3995-40cc-a6c8-1c4194e4b315 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:08.859466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab926fdb-3995-40cc-a6c8-1c4194e4b315 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:08.876998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1fe625f-9cbe-4fbb-8779-c184ffffe9cd tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:08.883872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1fe625f-9cbe-4fbb-8779-c184ffffe9cd tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:08.884779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1fe625f-9cbe-4fbb-8779-c184ffffe9cd tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:08.886899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1fe625f-9cbe-4fbb-8779-c184ffffe9cd tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:08.887432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1fe625f-9cbe-4fbb-8779-c184ffffe9cd tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:08.887880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1fe625f-9cbe-4fbb-8779-c184ffffe9cd tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:09.492851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ab926fdb-3995-40cc-a6c8-1c4194e4b315 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:09.503608 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ab926fdb-3995-40cc-a6c8-1c4194e4b315 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1322 microversion: 2.1 time: 0.740506 Aug 09 14:41:09.505222 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1281/2630] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:08 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1322 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:09.522174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81016d82-b07f-4dde-8a41-d2a9bbfe3163 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:09.523704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81016d82-b07f-4dde-8a41-d2a9bbfe3163 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 1282c4bf-25e4-40f6-8d30-ad3cd97640f6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:09.550071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1fe625f-9cbe-4fbb-8779-c184ffffe9cd tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:09.554918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81016d82-b07f-4dde-8a41-d2a9bbfe3163 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:09.556457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81016d82-b07f-4dde-8a41-d2a9bbfe3163 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:09.559743 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1fe625f-9cbe-4fbb-8779-c184ffffe9cd tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1372 microversion: 2.1 time: 0.713164 Aug 09 14:41:09.560813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81016d82-b07f-4dde-8a41-d2a9bbfe3163 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:09.574141 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1350/2631] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:08 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1372 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:41:09.575813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-46f8ed74-f82d-4394-84f9-ebc6e10e7e09 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:09.577028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-46f8ed74-f82d-4394-84f9-ebc6e10e7e09 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:09.578764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81016d82-b07f-4dde-8a41-d2a9bbfe3163 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:09.582035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81016d82-b07f-4dde-8a41-d2a9bbfe3163 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:09.584257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81016d82-b07f-4dde-8a41-d2a9bbfe3163 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:09.605887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46f8ed74-f82d-4394-84f9-ebc6e10e7e09 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:09.608954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46f8ed74-f82d-4394-84f9-ebc6e10e7e09 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:09.617496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46f8ed74-f82d-4394-84f9-ebc6e10e7e09 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:09.618531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46f8ed74-f82d-4394-84f9-ebc6e10e7e09 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:09.619187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46f8ed74-f82d-4394-84f9-ebc6e10e7e09 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:09.622282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46f8ed74-f82d-4394-84f9-ebc6e10e7e09 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:09.646784 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-81016d82-b07f-4dde-8a41-d2a9bbfe3163 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] HTTP exception thrown: Instance 1282c4bf-25e4-40f6-8d30-ad3cd97640f6 could not be found. Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81016d82-b07f-4dde-8a41-d2a9bbfe3163 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Request method failure captured: Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 HTTP/1.1 Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nFtiNqTg8oC9UTkE3HoAE2ZbxCJRq_Lbt7nsgZGIQx9QRVB4OGUWAOhB4NuEbz-ziu60DB6JHdUBjOqN9BwoeKUfZi3dl6l1tkLx3YCCUvqUNTR9MPOSxgcmPXrUPHqipmrT1nxpcfO2_OEC8rycD5RZx-CnD6A1sa1u_NDBbZHzkQ Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a61c381646364214a62210a2d8672314 Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a61c381646364214a62210a2d8672314", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a61c381646364214a62210a2d8672314"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a61c381646364214a62210a2d8672314"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a61c381646364214a62210a2d8672314"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a61c381646364214a62210a2d8672314 Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerDiskConfigTestJSON-1468044355-project Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 74c10f0e3a40477f86dfd6cdd03fe0f6 Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerDiskConfigTestJSON-1468044355-project Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 1282c4bf-25e4-40f6-8d30-ad3cd97640f6 could not be found. Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '1282c4bf-25e4-40f6-8d30-ad3cd97640f6'} Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1282c4bf-25e4-40f6-8d30-ad3cd97640f6 could not be found. Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1282c4bf-25e4-40f6-8d30-ad3cd97640f6 could not be found. Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:09.665011 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.670089 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:09.670089 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:09.670089 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:09.670089 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:09.670089 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:09.670089 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1282c4bf-25e4-40f6-8d30-ad3cd97640f6 could not be found. Aug 09 14:41:09.670089 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.671639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81016d82-b07f-4dde-8a41-d2a9bbfe3163 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Returning 404 to user: Instance 1282c4bf-25e4-40f6-8d30-ad3cd97640f6 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:09.673682 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81016d82-b07f-4dde-8a41-d2a9bbfe3163 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6" status: 404 len: 111 microversion: 2.1 time: 0.167143 Aug 09 14:41:09.678072 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1282/2632] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:09 2022] GET /compute/v2.1/servers/1282c4bf-25e4-40f6-8d30-ad3cd97640f6 => generated 111 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:41:09.691757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1082a93-e851-4258-b955-ee49673c886b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:09.699716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1082a93-e851-4258-b955-ee49673c886b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:09.703135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:09.719909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1082a93-e851-4258-b955-ee49673c886b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:09.735854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1082a93-e851-4258-b955-ee49673c886b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:09.736464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1082a93-e851-4258-b955-ee49673c886b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:09.737342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1082a93-e851-4258-b955-ee49673c886b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:09.737949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1082a93-e851-4258-b955-ee49673c886b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:09.738493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1082a93-e851-4258-b955-ee49673c886b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:09.789495 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b1082a93-e851-4258-b955-ee49673c886b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] HTTP exception thrown: Instance dfa434a0-4d01-432e-b168-597c787c0d84 could not be found. Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1082a93-e851-4258-b955-ee49673c886b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Request method failure captured: Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 HTTP/1.1 Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nFtiNqTg8oC9UTkE3HoAE2ZbxCJRq_Lbt7nsgZGIQx9QRVB4OGUWAOhB4NuEbz-ziu60DB6JHdUBjOqN9BwoeKUfZi3dl6l1tkLx3YCCUvqUNTR9MPOSxgcmPXrUPHqipmrT1nxpcfO2_OEC8rycD5RZx-CnD6A1sa1u_NDBbZHzkQ Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a61c381646364214a62210a2d8672314 Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a61c381646364214a62210a2d8672314", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a61c381646364214a62210a2d8672314"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a61c381646364214a62210a2d8672314"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a61c381646364214a62210a2d8672314"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a61c381646364214a62210a2d8672314 Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerDiskConfigTestJSON-1468044355-project Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 74c10f0e3a40477f86dfd6cdd03fe0f6 Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerDiskConfigTestJSON-1468044355-project Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance dfa434a0-4d01-432e-b168-597c787c0d84 could not be found. Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'dfa434a0-4d01-432e-b168-597c787c0d84'} Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa434a0-4d01-432e-b168-597c787c0d84 could not be found. Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:41:09.798757 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:41:09.803550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa434a0-4d01-432e-b168-597c787c0d84 could not be found. Aug 09 14:41:09.803550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.803550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:09.803550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.803550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:09.803550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:09.803550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:09.803550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:09.803550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:09.803550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa434a0-4d01-432e-b168-597c787c0d84 could not be found. Aug 09 14:41:09.803550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.804398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-46f8ed74-f82d-4394-84f9-ebc6e10e7e09 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:09.809250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1082a93-e851-4258-b955-ee49673c886b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Returning 404 to user: Instance dfa434a0-4d01-432e-b168-597c787c0d84 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:09.812606 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b1082a93-e851-4258-b955-ee49673c886b tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 404 len: 111 microversion: 2.1 time: 0.128822 Aug 09 14:41:09.815211 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1283/2633] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:41:09 2022] DELETE /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:41:09.817275 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-46f8ed74-f82d-4394-84f9-ebc6e10e7e09 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1266 microversion: 2.1 time: 0.248941 Aug 09 14:41:09.833632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c515873-4da6-482f-aa94-24cbff33ebd4 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41e7591ca0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:09.836178 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1351/2634] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:09 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:09.846320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9b49d04-04a9-4f21-b852-ca29b1c2075d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:09.846957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a9b49d04-04a9-4f21-b852-ca29b1c2075d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: dfa434a0-4d01-432e-b168-597c787c0d84] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:09.874799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9b49d04-04a9-4f21-b852-ca29b1c2075d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:09.879510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9b49d04-04a9-4f21-b852-ca29b1c2075d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:09.880776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9b49d04-04a9-4f21-b852-ca29b1c2075d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:09.893663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9b49d04-04a9-4f21-b852-ca29b1c2075d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:09.894509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9b49d04-04a9-4f21-b852-ca29b1c2075d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:09.895152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9b49d04-04a9-4f21-b852-ca29b1c2075d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:09.941687 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-a9b49d04-04a9-4f21-b852-ca29b1c2075d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] HTTP exception thrown: Instance dfa434a0-4d01-432e-b168-597c787c0d84 could not be found. Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9b49d04-04a9-4f21-b852-ca29b1c2075d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Request method failure captured: Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 HTTP/1.1 Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nFtiNqTg8oC9UTkE3HoAE2ZbxCJRq_Lbt7nsgZGIQx9QRVB4OGUWAOhB4NuEbz-ziu60DB6JHdUBjOqN9BwoeKUfZi3dl6l1tkLx3YCCUvqUNTR9MPOSxgcmPXrUPHqipmrT1nxpcfO2_OEC8rycD5RZx-CnD6A1sa1u_NDBbZHzkQ Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: a61c381646364214a62210a2d8672314 Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a61c381646364214a62210a2d8672314", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a61c381646364214a62210a2d8672314"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a61c381646364214a62210a2d8672314"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a61c381646364214a62210a2d8672314"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: a61c381646364214a62210a2d8672314 Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerDiskConfigTestJSON-1468044355-project Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 74c10f0e3a40477f86dfd6cdd03fe0f6 Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerDiskConfigTestJSON-1468044355-project Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance dfa434a0-4d01-432e-b168-597c787c0d84 could not be found. Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'dfa434a0-4d01-432e-b168-597c787c0d84'} Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfa434a0-4d01-432e-b168-597c787c0d84 could not be found. Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfa434a0-4d01-432e-b168-597c787c0d84 could not be found. Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:09.951748 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.956599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:09.956599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:09.956599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:09.956599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:09.956599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:09.956599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfa434a0-4d01-432e-b168-597c787c0d84 could not be found. Aug 09 14:41:09.956599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:09.959054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9b49d04-04a9-4f21-b852-ca29b1c2075d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Returning 404 to user: Instance dfa434a0-4d01-432e-b168-597c787c0d84 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:09.963545 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a9b49d04-04a9-4f21-b852-ca29b1c2075d tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84" status: 404 len: 111 microversion: 2.1 time: 0.123954 Aug 09 14:41:09.966613 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1352/2635] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:09 2022] GET /compute/v2.1/servers/dfa434a0-4d01-432e-b168-597c787c0d84 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:41:09.984243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d5fe007b-b8cd-4de0-a743-f0b82fce58a6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:09.985405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d5fe007b-b8cd-4de0-a743-f0b82fce58a6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:10.009922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5fe007b-b8cd-4de0-a743-f0b82fce58a6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:10.010459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5fe007b-b8cd-4de0-a743-f0b82fce58a6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:10.010913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5fe007b-b8cd-4de0-a743-f0b82fce58a6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:10.013789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5fe007b-b8cd-4de0-a743-f0b82fce58a6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:10.014339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5fe007b-b8cd-4de0-a743-f0b82fce58a6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:10.014788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5fe007b-b8cd-4de0-a743-f0b82fce58a6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:10.057379 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-d5fe007b-b8cd-4de0-a743-f0b82fce58a6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] HTTP exception thrown: Instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 could not be found. Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d5fe007b-b8cd-4de0-a743-f0b82fce58a6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Request method failure captured: Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 HTTP/1.1 Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nFtiNqTg8oC9UTkE3HoAE2ZbxCJRq_Lbt7nsgZGIQx9QRVB4OGUWAOhB4NuEbz-ziu60DB6JHdUBjOqN9BwoeKUfZi3dl6l1tkLx3YCCUvqUNTR9MPOSxgcmPXrUPHqipmrT1nxpcfO2_OEC8rycD5RZx-CnD6A1sa1u_NDBbZHzkQ Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: a61c381646364214a62210a2d8672314 Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a61c381646364214a62210a2d8672314", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a61c381646364214a62210a2d8672314"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a61c381646364214a62210a2d8672314"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a61c381646364214a62210a2d8672314"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: a61c381646364214a62210a2d8672314 Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerDiskConfigTestJSON-1468044355-project Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 74c10f0e3a40477f86dfd6cdd03fe0f6 Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerDiskConfigTestJSON-1468044355-project Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 could not be found. Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '74c528e1-bc7a-4791-9a0f-de8414ea9077'} Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 could not be found. Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:41:10.060297 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 could not be found. Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 could not be found. Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d5fe007b-b8cd-4de0-a743-f0b82fce58a6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Returning 404 to user: Instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:10.063929 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d5fe007b-b8cd-4de0-a743-f0b82fce58a6 tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "DELETE /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 404 len: 111 microversion: 2.1 time: 0.094161 Aug 09 14:41:10.067494 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1353/2636] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:41:09 2022] DELETE /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:41:10.077309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-880a127b-1a0c-4d93-b44d-a41efd411b0a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:10.077977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-880a127b-1a0c-4d93-b44d-a41efd411b0a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] [instance: 74c528e1-bc7a-4791-9a0f-de8414ea9077] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:10.085884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-880a127b-1a0c-4d93-b44d-a41efd411b0a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:10.086510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-880a127b-1a0c-4d93-b44d-a41efd411b0a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:10.086794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-880a127b-1a0c-4d93-b44d-a41efd411b0a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:10.087770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-880a127b-1a0c-4d93-b44d-a41efd411b0a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:10.088672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-880a127b-1a0c-4d93-b44d-a41efd411b0a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:10.089234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-880a127b-1a0c-4d93-b44d-a41efd411b0a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:10.112591 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-880a127b-1a0c-4d93-b44d-a41efd411b0a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] HTTP exception thrown: Instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 could not be found. Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-880a127b-1a0c-4d93-b44d-a41efd411b0a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Request method failure captured: Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 HTTP/1.1 Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nFtiNqTg8oC9UTkE3HoAE2ZbxCJRq_Lbt7nsgZGIQx9QRVB4OGUWAOhB4NuEbz-ziu60DB6JHdUBjOqN9BwoeKUfZi3dl6l1tkLx3YCCUvqUNTR9MPOSxgcmPXrUPHqipmrT1nxpcfO2_OEC8rycD5RZx-CnD6A1sa1u_NDBbZHzkQ Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: a61c381646364214a62210a2d8672314 Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a61c381646364214a62210a2d8672314", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a61c381646364214a62210a2d8672314"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a61c381646364214a62210a2d8672314"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a61c381646364214a62210a2d8672314"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: a61c381646364214a62210a2d8672314 Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1468044355 Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerDiskConfigTestJSON-1468044355-project Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 74c10f0e3a40477f86dfd6cdd03fe0f6 Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerDiskConfigTestJSON-1468044355-project Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 could not be found. Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '74c528e1-bc7a-4791-9a0f-de8414ea9077'} Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 could not be found. Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 could not be found. Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:10.114637 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:10.119555 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:10.119555 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:10.119555 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:10.119555 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:10.119555 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:10.119555 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 could not be found. Aug 09 14:41:10.119555 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:10.121922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-880a127b-1a0c-4d93-b44d-a41efd411b0a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] Returning 404 to user: Instance 74c528e1-bc7a-4791-9a0f-de8414ea9077 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:10.123459 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-880a127b-1a0c-4d93-b44d-a41efd411b0a tempest-ServerDiskConfigTestJSON-1468044355 tempest-ServerDiskConfigTestJSON-1468044355-project] 10.222.0.50 "GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077" status: 404 len: 111 microversion: 2.1 time: 0.054954 Aug 09 14:41:10.128743 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1354/2637] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:10 2022] GET /compute/v2.1/servers/74c528e1-bc7a-4791-9a0f-de8414ea9077 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:41:10.526008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5a773a7-6691-4ee5-9c8e-e67279082aa3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:10.526908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5a773a7-6691-4ee5-9c8e-e67279082aa3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:10.539510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a773a7-6691-4ee5-9c8e-e67279082aa3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:10.540407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a773a7-6691-4ee5-9c8e-e67279082aa3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:10.545426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a773a7-6691-4ee5-9c8e-e67279082aa3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:10.547037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a773a7-6691-4ee5-9c8e-e67279082aa3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:10.547702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a773a7-6691-4ee5-9c8e-e67279082aa3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:10.549777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5a773a7-6691-4ee5-9c8e-e67279082aa3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:11.463296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5a773a7-6691-4ee5-9c8e-e67279082aa3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:11.475648 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5a773a7-6691-4ee5-9c8e-e67279082aa3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1322 microversion: 2.1 time: 0.954216 Aug 09 14:41:11.503122 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1355/2638] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:10 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1322 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:11.508534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-77970172-52c6-48bb-8aa9-612c48637bef tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:11.509810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-77970172-52c6-48bb-8aa9-612c48637bef tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:11.537391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77970172-52c6-48bb-8aa9-612c48637bef tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:11.538295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77970172-52c6-48bb-8aa9-612c48637bef tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:11.539181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77970172-52c6-48bb-8aa9-612c48637bef tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:11.540250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77970172-52c6-48bb-8aa9-612c48637bef tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:11.541137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77970172-52c6-48bb-8aa9-612c48637bef tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:11.542134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77970172-52c6-48bb-8aa9-612c48637bef tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:12.369143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-77970172-52c6-48bb-8aa9-612c48637bef tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:12.385213 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-77970172-52c6-48bb-8aa9-612c48637bef tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1372 microversion: 2.1 time: 0.880567 Aug 09 14:41:12.390685 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1356/2639] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:11 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1372 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:12.398482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d75cf712-3a08-4167-b161-dd164ebd71c9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:12.402871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d75cf712-3a08-4167-b161-dd164ebd71c9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:12.424554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d75cf712-3a08-4167-b161-dd164ebd71c9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:12.425049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d75cf712-3a08-4167-b161-dd164ebd71c9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:12.425860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d75cf712-3a08-4167-b161-dd164ebd71c9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:12.426740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d75cf712-3a08-4167-b161-dd164ebd71c9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:12.427553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d75cf712-3a08-4167-b161-dd164ebd71c9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:12.431368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d75cf712-3a08-4167-b161-dd164ebd71c9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:12.676347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d75cf712-3a08-4167-b161-dd164ebd71c9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:12.694462 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d75cf712-3a08-4167-b161-dd164ebd71c9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1266 microversion: 2.1 time: 0.301905 Aug 09 14:41:12.704162 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1357/2640] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:12 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:12.727863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eda4c786-9013-42a0-851a-7c7d3e10adc8 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:12.730028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eda4c786-9013-42a0-851a-7c7d3e10adc8 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:12.753217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eda4c786-9013-42a0-851a-7c7d3e10adc8 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:12.753787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eda4c786-9013-42a0-851a-7c7d3e10adc8 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:12.754288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eda4c786-9013-42a0-851a-7c7d3e10adc8 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:12.761592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eda4c786-9013-42a0-851a-7c7d3e10adc8 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:12.762192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eda4c786-9013-42a0-851a-7c7d3e10adc8 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:12.762710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eda4c786-9013-42a0-851a-7c7d3e10adc8 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:14.273920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eda4c786-9013-42a0-851a-7c7d3e10adc8 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:14.288217 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eda4c786-9013-42a0-851a-7c7d3e10adc8 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1322 microversion: 2.1 time: 1.581240 Aug 09 14:41:14.305910 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1358/2641] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:12 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1322 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:14.319048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d66b54e5-d668-4a39-99b1-b51f8541bf10 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:14.320873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d66b54e5-d668-4a39-99b1-b51f8541bf10 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:14.335998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d66b54e5-d668-4a39-99b1-b51f8541bf10 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:14.340198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d66b54e5-d668-4a39-99b1-b51f8541bf10 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:14.340864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d66b54e5-d668-4a39-99b1-b51f8541bf10 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:14.341767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d66b54e5-d668-4a39-99b1-b51f8541bf10 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:14.342364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d66b54e5-d668-4a39-99b1-b51f8541bf10 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:14.342936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d66b54e5-d668-4a39-99b1-b51f8541bf10 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:14.968704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d66b54e5-d668-4a39-99b1-b51f8541bf10 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:14.985988 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d66b54e5-d668-4a39-99b1-b51f8541bf10 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1372 microversion: 2.1 time: 0.677259 Aug 09 14:41:15.007124 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1359/2642] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:14 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1372 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:15.007124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-39069e7e-3ad8-400d-9f6b-77daa595a672 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:15.007124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-39069e7e-3ad8-400d-9f6b-77daa595a672 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:15.021969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39069e7e-3ad8-400d-9f6b-77daa595a672 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:15.022972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39069e7e-3ad8-400d-9f6b-77daa595a672 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:15.023704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39069e7e-3ad8-400d-9f6b-77daa595a672 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:15.024507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39069e7e-3ad8-400d-9f6b-77daa595a672 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:15.025196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39069e7e-3ad8-400d-9f6b-77daa595a672 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:15.032927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39069e7e-3ad8-400d-9f6b-77daa595a672 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:15.437419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:15.604079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-39069e7e-3ad8-400d-9f6b-77daa595a672 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:15.620694 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-39069e7e-3ad8-400d-9f6b-77daa595a672 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1308 microversion: 2.1 time: 0.630004 Aug 09 14:41:15.621582 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1360/2643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:14 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1308 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:15.632588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b108fb1e-cca8-41cb-bacd-fd87ecd90d54 req-3f16ec4e-0c2b-4b7e-b0ad-03b7b8b03b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f61de9f-77ce-4797-a4cf-6005d3c64092", "name": "network-vif-plugged", "status": "completed", "tag": "f033813f-a028-456e-9341-0cb54066aa57"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:15.667648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b108fb1e-cca8-41cb-bacd-fd87ecd90d54 req-3f16ec4e-0c2b-4b7e-b0ad-03b7b8b03b1c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:15.672260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b108fb1e-cca8-41cb-bacd-fd87ecd90d54 req-3f16ec4e-0c2b-4b7e-b0ad-03b7b8b03b1c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:15.672979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b108fb1e-cca8-41cb-bacd-fd87ecd90d54 req-3f16ec4e-0c2b-4b7e-b0ad-03b7b8b03b1c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:15.718176 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b108fb1e-cca8-41cb-bacd-fd87ecd90d54 req-3f16ec4e-0c2b-4b7e-b0ad-03b7b8b03b1c service nova] Creating event network-vif-plugged:f033813f-a028-456e-9341-0cb54066aa57 for instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 on n-h1-844626-8 Aug 09 14:41:15.747302 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b108fb1e-cca8-41cb-bacd-fd87ecd90d54 req-3f16ec4e-0c2b-4b7e-b0ad-03b7b8b03b1c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124182 Aug 09 14:41:15.757322 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1361/2644] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:15.778811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-fa3551e6-b287-4bed-81ff-20948b36b8a0 req-da60d197-5d61-42de-a823-f4d92015dfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40892bf1-16b7-466e-8518-9cf8be282cb7", "tag": "7edc31a2-a874-4936-b752-ab4c8952a0d0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:15.800046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fa3551e6-b287-4bed-81ff-20948b36b8a0 req-da60d197-5d61-42de-a823-f4d92015dfc4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:15.809333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fa3551e6-b287-4bed-81ff-20948b36b8a0 req-da60d197-5d61-42de-a823-f4d92015dfc4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:15.810135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fa3551e6-b287-4bed-81ff-20948b36b8a0 req-da60d197-5d61-42de-a823-f4d92015dfc4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:15.845637 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-fa3551e6-b287-4bed-81ff-20948b36b8a0 req-da60d197-5d61-42de-a823-f4d92015dfc4 service nova] Creating event network-changed:7edc31a2-a874-4936-b752-ab4c8952a0d0 for instance 40892bf1-16b7-466e-8518-9cf8be282cb7 on n-h2-844626-8 Aug 09 14:41:15.861971 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-fa3551e6-b287-4bed-81ff-20948b36b8a0 req-da60d197-5d61-42de-a823-f4d92015dfc4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100701 Aug 09 14:41:15.866064 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1362/2645] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:15.881588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d9ea400f-f56a-4cd8-9d50-f353cb0de078 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:15.884740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d9ea400f-f56a-4cd8-9d50-f353cb0de078 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:15.913584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9ea400f-f56a-4cd8-9d50-f353cb0de078 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:15.914149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9ea400f-f56a-4cd8-9d50-f353cb0de078 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:15.914594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9ea400f-f56a-4cd8-9d50-f353cb0de078 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:15.915817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9ea400f-f56a-4cd8-9d50-f353cb0de078 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:15.916798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9ea400f-f56a-4cd8-9d50-f353cb0de078 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:15.917427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9ea400f-f56a-4cd8-9d50-f353cb0de078 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:16.767439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d9ea400f-f56a-4cd8-9d50-f353cb0de078 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:16.782771 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d9ea400f-f56a-4cd8-9d50-f353cb0de078 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1322 microversion: 2.1 time: 0.915401 Aug 09 14:41:16.798139 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1363/2646] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:15 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1322 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:16.822812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60b81289-b7ae-4453-b2b6-c7cea6a5e690 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:16.836606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-60b81289-b7ae-4453-b2b6-c7cea6a5e690 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:16.864678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60b81289-b7ae-4453-b2b6-c7cea6a5e690 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:16.865501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60b81289-b7ae-4453-b2b6-c7cea6a5e690 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:16.866137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60b81289-b7ae-4453-b2b6-c7cea6a5e690 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:16.867186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60b81289-b7ae-4453-b2b6-c7cea6a5e690 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:16.867834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60b81289-b7ae-4453-b2b6-c7cea6a5e690 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:16.868440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60b81289-b7ae-4453-b2b6-c7cea6a5e690 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:16.883322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:17.199736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=18 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:17.345632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60b81289-b7ae-4453-b2b6-c7cea6a5e690 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:17.357527 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60b81289-b7ae-4453-b2b6-c7cea6a5e690 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1372 microversion: 2.1 time: 0.538837 Aug 09 14:41:17.378938 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1364/2647] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:16 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1372 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:17.392323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82fc73ee-1ab2-4460-b85e-a7dcf01809b6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:17.393411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82fc73ee-1ab2-4460-b85e-a7dcf01809b6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:17.408510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82fc73ee-1ab2-4460-b85e-a7dcf01809b6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:17.411251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82fc73ee-1ab2-4460-b85e-a7dcf01809b6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:17.411932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82fc73ee-1ab2-4460-b85e-a7dcf01809b6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:17.412919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82fc73ee-1ab2-4460-b85e-a7dcf01809b6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:17.415369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82fc73ee-1ab2-4460-b85e-a7dcf01809b6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:17.416044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82fc73ee-1ab2-4460-b85e-a7dcf01809b6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:18.013527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-82fc73ee-1ab2-4460-b85e-a7dcf01809b6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:18.021745 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82fc73ee-1ab2-4460-b85e-a7dcf01809b6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1308 microversion: 2.1 time: 0.641284 Aug 09 14:41:18.022334 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1365/2648] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:17 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1308 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:18.050353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-222900d5-19a0-4f4c-aaa5-4154ad7c8b65 req-41c7212f-f98a-401b-8432-d1310950fcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5", "name": "network-vif-plugged", "status": "completed", "tag": "b8216191-4500-459f-924a-a1d595ec3b9a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:18.073592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-222900d5-19a0-4f4c-aaa5-4154ad7c8b65 req-41c7212f-f98a-401b-8432-d1310950fcd0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:18.074167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-222900d5-19a0-4f4c-aaa5-4154ad7c8b65 req-41c7212f-f98a-401b-8432-d1310950fcd0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:18.074591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-222900d5-19a0-4f4c-aaa5-4154ad7c8b65 req-41c7212f-f98a-401b-8432-d1310950fcd0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:18.149590 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-222900d5-19a0-4f4c-aaa5-4154ad7c8b65 req-41c7212f-f98a-401b-8432-d1310950fcd0 service nova] Creating event network-vif-plugged:b8216191-4500-459f-924a-a1d595ec3b9a for instance 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 on n-h2-844626-8 Aug 09 14:41:18.162763 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-222900d5-19a0-4f4c-aaa5-4154ad7c8b65 req-41c7212f-f98a-401b-8432-d1310950fcd0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131338 Aug 09 14:41:18.166559 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1366/2649] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:18.198124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5deb7a7-10c5-4c35-b66e-01e2d844eaaa tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:18.199285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5deb7a7-10c5-4c35-b66e-01e2d844eaaa tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:18.233692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5deb7a7-10c5-4c35-b66e-01e2d844eaaa tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:18.239077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5deb7a7-10c5-4c35-b66e-01e2d844eaaa tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:18.239736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5deb7a7-10c5-4c35-b66e-01e2d844eaaa tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:18.245467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5deb7a7-10c5-4c35-b66e-01e2d844eaaa tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:18.246722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5deb7a7-10c5-4c35-b66e-01e2d844eaaa tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:18.253231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5deb7a7-10c5-4c35-b66e-01e2d844eaaa tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:19.745853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=71,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:19.754689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5deb7a7-10c5-4c35-b66e-01e2d844eaaa tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:19.766004 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5deb7a7-10c5-4c35-b66e-01e2d844eaaa tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1322 microversion: 2.1 time: 1.596822 Aug 09 14:41:19.786019 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1367/2650] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:18 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1322 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:19.796608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0788310d-f681-44d8-ac1a-75c91a251683 req-1e0f6a4e-240b-486c-b27a-e249496d0a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92d98e16-7a40-4281-a9f5-fbe5fe968056", "tag": "6861dcfc-b313-4e9f-a048-edba9a4a7880"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:19.822294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0788310d-f681-44d8-ac1a-75c91a251683 req-1e0f6a4e-240b-486c-b27a-e249496d0a89 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:19.827770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0788310d-f681-44d8-ac1a-75c91a251683 req-1e0f6a4e-240b-486c-b27a-e249496d0a89 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:19.828469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0788310d-f681-44d8-ac1a-75c91a251683 req-1e0f6a4e-240b-486c-b27a-e249496d0a89 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:19.867725 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0788310d-f681-44d8-ac1a-75c91a251683 req-1e0f6a4e-240b-486c-b27a-e249496d0a89 service nova] Creating event network-changed:6861dcfc-b313-4e9f-a048-edba9a4a7880 for instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 on n-h1-844626-8 Aug 09 14:41:19.878562 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0788310d-f681-44d8-ac1a-75c91a251683 req-1e0f6a4e-240b-486c-b27a-e249496d0a89 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090560 Aug 09 14:41:19.879215 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1368/2651] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:19.894758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07dfffa5-4e89-4701-af49-c287ecfadf74 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:19.895490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07dfffa5-4e89-4701-af49-c287ecfadf74 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:19.926050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07dfffa5-4e89-4701-af49-c287ecfadf74 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:19.926507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07dfffa5-4e89-4701-af49-c287ecfadf74 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:19.926934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07dfffa5-4e89-4701-af49-c287ecfadf74 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:19.928359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07dfffa5-4e89-4701-af49-c287ecfadf74 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:19.931358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07dfffa5-4e89-4701-af49-c287ecfadf74 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:19.931959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07dfffa5-4e89-4701-af49-c287ecfadf74 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:20.749653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07dfffa5-4e89-4701-af49-c287ecfadf74 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:20.768558 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07dfffa5-4e89-4701-af49-c287ecfadf74 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1372 microversion: 2.1 time: 0.870944 Aug 09 14:41:20.782691 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1369/2652] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:19 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1372 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:20.800351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8647e7eb-4b38-4b98-abe0-0202d400adf3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:20.801297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8647e7eb-4b38-4b98-abe0-0202d400adf3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:20.815301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8647e7eb-4b38-4b98-abe0-0202d400adf3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:20.819650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8647e7eb-4b38-4b98-abe0-0202d400adf3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:20.820420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8647e7eb-4b38-4b98-abe0-0202d400adf3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:20.821358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8647e7eb-4b38-4b98-abe0-0202d400adf3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:20.823284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8647e7eb-4b38-4b98-abe0-0202d400adf3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:20.824316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8647e7eb-4b38-4b98-abe0-0202d400adf3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:22.159272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8647e7eb-4b38-4b98-abe0-0202d400adf3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:22.192830 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8647e7eb-4b38-4b98-abe0-0202d400adf3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1308 microversion: 2.1 time: 1.390871 Aug 09 14:41:22.196647 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1370/2653] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:20 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1308 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:22.207393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bcf365b9-cbb1-478a-a119-ec9e090935b0 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:22.208544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bcf365b9-cbb1-478a-a119-ec9e090935b0 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:22.233440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcf365b9-cbb1-478a-a119-ec9e090935b0 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:22.235698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcf365b9-cbb1-478a-a119-ec9e090935b0 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:22.236384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcf365b9-cbb1-478a-a119-ec9e090935b0 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:22.239379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcf365b9-cbb1-478a-a119-ec9e090935b0 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:22.240204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcf365b9-cbb1-478a-a119-ec9e090935b0 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:22.240989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcf365b9-cbb1-478a-a119-ec9e090935b0 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:23.557205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bcf365b9-cbb1-478a-a119-ec9e090935b0 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:23.587421 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bcf365b9-cbb1-478a-a119-ec9e090935b0 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1472 microversion: 2.1 time: 1.381402 Aug 09 14:41:23.588850 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1371/2654] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:22 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1472 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:23.612474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9412adba-4d4d-43d0-a8ae-1b6f4854f892 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:23.615896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9412adba-4d4d-43d0-a8ae-1b6f4854f892 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:23.650072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9412adba-4d4d-43d0-a8ae-1b6f4854f892 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:23.650756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9412adba-4d4d-43d0-a8ae-1b6f4854f892 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:23.651466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9412adba-4d4d-43d0-a8ae-1b6f4854f892 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:23.656650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9412adba-4d4d-43d0-a8ae-1b6f4854f892 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:23.660373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9412adba-4d4d-43d0-a8ae-1b6f4854f892 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:23.660819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9412adba-4d4d-43d0-a8ae-1b6f4854f892 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:24.141426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9412adba-4d4d-43d0-a8ae-1b6f4854f892 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:24.157236 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9412adba-4d4d-43d0-a8ae-1b6f4854f892 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1372 microversion: 2.1 time: 0.566984 Aug 09 14:41:24.159249 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1372/2655] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:23 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1372 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:24.468893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1294713037", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "2885fc04-1f81-4377-a25b-f064edeb4235"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:26.517928 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c515873-4da6-482f-aa94-24cbff33ebd4 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41" status: 200 len: 1428 microversion: 2.1 time: 16.700565 Aug 09 14:41:26.518960 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1284/2656] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:41:09 2022] GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41 => generated 1428 bytes in 16703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:26.548443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1810621-89e6-4b56-9557-e942cbf282e0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:26.549968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1810621-89e6-4b56-9557-e942cbf282e0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:26.560762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] validate_networks() for [('2885fc04-1f81-4377-a25b-f064edeb4235', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:41:26.563517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1810621-89e6-4b56-9557-e942cbf282e0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:26.564043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1810621-89e6-4b56-9557-e942cbf282e0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:26.565501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1810621-89e6-4b56-9557-e942cbf282e0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:26.566432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1810621-89e6-4b56-9557-e942cbf282e0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:26.567047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1810621-89e6-4b56-9557-e942cbf282e0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:26.567859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1810621-89e6-4b56-9557-e942cbf282e0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:27.306602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e1810621-89e6-4b56-9557-e942cbf282e0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:27.325584 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1810621-89e6-4b56-9557-e942cbf282e0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1308 microversion: 2.1 time: 0.796910 Aug 09 14:41:27.327746 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1285/2657] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:26 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1308 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:27.941186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c728e73-bb1f-408c-91b7-aa828d2a8168 tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:27.941863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c728e73-bb1f-408c-91b7-aa828d2a8168 tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] [instance: 392eda28-a4e4-497f-ab0b-8f7ee398241a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:27.956254 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-7c728e73-bb1f-408c-91b7-aa828d2a8168 tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] HTTP exception thrown: Instance 392eda28-a4e4-497f-ab0b-8f7ee398241a could not be found. Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c728e73-bb1f-408c-91b7-aa828d2a8168 tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Request method failure captured: Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/392eda28-a4e4-497f-ab0b-8f7ee398241a/action HTTP/1.1 Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 15 Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHpGo64SK4o-fXzd-KrLvOaOX4W_jtEwwsOZkVM_l22-eRiGvhn-IGgiM04B5a2uigRtC9EKAe4TRYrzZQ6yRAWPeDjb3L7AYbaX-gc_8l0nHC2-Kp6akWXGKtPJV1XiDtcwXUbmyhPZsb_DS6g9eSOpYKlT9Valr_UFJQ1BnvA4lY Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 097f5ab20186492e86c8f05e6db3c665 Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_097f5ab20186492e86c8f05e6db3c665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 097f5ab20186492e86c8f05e6db3c665 Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersAdminNegativeTestJSON-57299721-project-admin Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e58ca45ec9914ebfb1a9793400c9b024 Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-57299721-project-admin Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: {"migrate": {}} Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 392eda28-a4e4-497f-ab0b-8f7ee398241a could not be found. Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '392eda28-a4e4-497f-ab0b-8f7ee398241a', 'body': {'migrate': {}}} Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 392eda28-a4e4-497f-ab0b-8f7ee398241a could not be found. Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 392eda28-a4e4-497f-ab0b-8f7ee398241a could not be found. Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:27.958558 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:27.963511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:27.963511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:27.963511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:27.963511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:27.963511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 392eda28-a4e4-497f-ab0b-8f7ee398241a could not be found. Aug 09 14:41:27.963511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:27.963511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c728e73-bb1f-408c-91b7-aa828d2a8168 tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Returning 404 to user: Instance 392eda28-a4e4-497f-ab0b-8f7ee398241a could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:27.963511 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c728e73-bb1f-408c-91b7-aa828d2a8168 tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/392eda28-a4e4-497f-ab0b-8f7ee398241a/action" status: 404 len: 111 microversion: 2.1 time: 0.631097 Aug 09 14:41:27.963511 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1286/2658] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:41:27 2022] POST /compute/v2.1/servers/392eda28-a4e4-497f-ab0b-8f7ee398241a/action => generated 111 bytes in 632 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:41:27.969353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c2e66d0-0d85-4fd8-aef5-99ec97df3d28 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:27.969967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6c2e66d0-0d85-4fd8-aef5-99ec97df3d28 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:27.988604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c2e66d0-0d85-4fd8-aef5-99ec97df3d28 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:27.989107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c2e66d0-0d85-4fd8-aef5-99ec97df3d28 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:27.989538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c2e66d0-0d85-4fd8-aef5-99ec97df3d28 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:27.990247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c2e66d0-0d85-4fd8-aef5-99ec97df3d28 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:27.990685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c2e66d0-0d85-4fd8-aef5-99ec97df3d28 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:27.991133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c2e66d0-0d85-4fd8-aef5-99ec97df3d28 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:28.396716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:41:28.397232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:41:28.397901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:41:28.398480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:41:28.398998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:41:28.428236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:28.429902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:28.438807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:28.439841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:28.440806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:28.440908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:28.515239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Getting quotas for project 426fbb89ba614432b3a0cb87e0e4cd69. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:41:28.522160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Getting quotas for user d1d53fbb760a4b9282197668b9296c38 and project 426fbb89ba614432b3a0cb87e0e4cd69. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:41:28.543438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:41:28.556912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:41:28.587782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6c2e66d0-0d85-4fd8-aef5-99ec97df3d28 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:28.602432 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6c2e66d0-0d85-4fd8-aef5-99ec97df3d28 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1372 microversion: 2.1 time: 0.639556 Aug 09 14:41:28.617421 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1287/2659] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:27 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1372 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:28.638468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0afee8a-6826-4586-b9a1-5cac978ec8a5 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41e7592c10>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:28.707190 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4b257645-d9a8-4f4e-8f8e-89fe430b7f6d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.540867 Aug 09 14:41:28.716056 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1373/2660] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:41:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 4549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:41:28.723480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1313376037", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:28.743393 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0afee8a-6826-4586-b9a1-5cac978ec8a5 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41" status: 200 len: 1428 microversion: 2.1 time: 0.124810 Aug 09 14:41:28.752642 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1288/2661] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:41:28 2022] GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41 => generated 1428 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:28.765119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7e75c331-49a5-401c-bf03-18d7fea4bd99 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:28.776727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7e75c331-49a5-401c-bf03-18d7fea4bd99 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:28.798788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e75c331-49a5-401c-bf03-18d7fea4bd99 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:28.807838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e75c331-49a5-401c-bf03-18d7fea4bd99 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:28.808422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e75c331-49a5-401c-bf03-18d7fea4bd99 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:28.809770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e75c331-49a5-401c-bf03-18d7fea4bd99 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:28.811375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e75c331-49a5-401c-bf03-18d7fea4bd99 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:28.816044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e75c331-49a5-401c-bf03-18d7fea4bd99 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:28.847011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:41:29.435542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:41:29.436223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:41:29.436638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:41:29.437149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:41:29.437650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:41:29.457529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:29.459191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:29.461733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:29.463894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:29.465945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:29.466705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:29.532250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7e75c331-49a5-401c-bf03-18d7fea4bd99 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:29.551212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Getting quotas for project decdc7f4b385405dbd589e276b8bd7be. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:41:29.554402 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7e75c331-49a5-401c-bf03-18d7fea4bd99 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1308 microversion: 2.1 time: 0.795279 Aug 09 14:41:29.556001 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1289/2662] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:28 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1308 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:29.573985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Getting quotas for user c1592bdd654b42e99c97a9ae2414df80 and project decdc7f4b385405dbd589e276b8bd7be. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:41:29.575402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81e6df99-056b-4a63-a441-6170d359336f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:29.576756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81e6df99-056b-4a63-a441-6170d359336f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:29.591553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:41:29.594199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:41:29.652466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-81e6df99-056b-4a63-a441-6170d359336f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:29.660314 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81e6df99-056b-4a63-a441-6170d359336f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 200 len: 1208 microversion: 2.1 time: 0.103117 Aug 09 14:41:29.662350 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1290/2663] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:29 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 1208 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:29.671397 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-00873787-5790-496a-9926-d9100e16f30f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.951543 Aug 09 14:41:29.678567 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1374/2664] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:41:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:41:29.686379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4b2bd2b-2947-4c07-af00-c1bd2faf1c3d tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:29.689611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4b2bd2b-2947-4c07-af00-c1bd2faf1c3d tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:29.696073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eeacde4a-8b48-46bf-a9b5-ed914ffef741 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:29.696982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eeacde4a-8b48-46bf-a9b5-ed914ffef741 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:29.717093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4b2bd2b-2947-4c07-af00-c1bd2faf1c3d tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:29.717408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4b2bd2b-2947-4c07-af00-c1bd2faf1c3d tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:29.740179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4b2bd2b-2947-4c07-af00-c1bd2faf1c3d tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:29.742023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4b2bd2b-2947-4c07-af00-c1bd2faf1c3d tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:29.745595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4b2bd2b-2947-4c07-af00-c1bd2faf1c3d tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:29.746779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4b2bd2b-2947-4c07-af00-c1bd2faf1c3d tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:29.798869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eeacde4a-8b48-46bf-a9b5-ed914ffef741 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:29.809202 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eeacde4a-8b48-46bf-a9b5-ed914ffef741 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 200 len: 1222 microversion: 2.1 time: 0.128576 Aug 09 14:41:29.809796 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1375/2665] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:29 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 1222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:29.814723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b782d9f4-4538-4d17-9657-09bbf06c7057 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dd666a60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:29.899065 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b782d9f4-4538-4d17-9657-09bbf06c7057 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41" status: 200 len: 1437 microversion: 2.1 time: 0.087988 Aug 09 14:41:29.907464 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1376/2666] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:41:29 2022] GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41 => generated 1437 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:29.913309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a4030bf2-0a51-4045-b01d-b4b7556177aa tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dd804550>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:29.995295 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a4030bf2-0a51-4045-b01d-b4b7556177aa tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41" status: 200 len: 1437 microversion: 2.1 time: 0.085539 Aug 09 14:41:29.995908 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1377/2667] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:41:29 2022] GET /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41 => generated 1437 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:30.032987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-01764fc4-9abf-4739-8594-1458ed07b687 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:30.033924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01764fc4-9abf-4739-8594-1458ed07b687 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:30.059944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01764fc4-9abf-4739-8594-1458ed07b687 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:30.068124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01764fc4-9abf-4739-8594-1458ed07b687 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:30.068743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01764fc4-9abf-4739-8594-1458ed07b687 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:30.069521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01764fc4-9abf-4739-8594-1458ed07b687 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:30.070059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01764fc4-9abf-4739-8594-1458ed07b687 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:30.070499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01764fc4-9abf-4739-8594-1458ed07b687 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:30.526007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4b2bd2b-2947-4c07-af00-c1bd2faf1c3d tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:30.556790 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4b2bd2b-2947-4c07-af00-c1bd2faf1c3d tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1372 microversion: 2.1 time: 0.893327 Aug 09 14:41:30.557574 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1291/2668] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:29 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1372 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:30.577197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2d77f73f-a2f5-4ff9-98cd-2296783b0e06 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:30.578234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2d77f73f-a2f5-4ff9-98cd-2296783b0e06 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:30.594295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d77f73f-a2f5-4ff9-98cd-2296783b0e06 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:30.595378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d77f73f-a2f5-4ff9-98cd-2296783b0e06 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:30.598353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d77f73f-a2f5-4ff9-98cd-2296783b0e06 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:30.599685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d77f73f-a2f5-4ff9-98cd-2296783b0e06 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:30.601544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d77f73f-a2f5-4ff9-98cd-2296783b0e06 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:30.603050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d77f73f-a2f5-4ff9-98cd-2296783b0e06 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:31.130121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-01764fc4-9abf-4739-8594-1458ed07b687 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:31.142479 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-01764fc4-9abf-4739-8594-1458ed07b687 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1467 microversion: 2.1 time: 1.137215 Aug 09 14:41:31.145745 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1378/2669] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:30 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1467 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:31.157846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6a3e92c6-3653-41d3-b709-6a840f79c44a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:31.159116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6a3e92c6-3653-41d3-b709-6a840f79c44a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:31.173985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a3e92c6-3653-41d3-b709-6a840f79c44a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:31.176196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a3e92c6-3653-41d3-b709-6a840f79c44a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:31.178341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a3e92c6-3653-41d3-b709-6a840f79c44a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:31.180553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a3e92c6-3653-41d3-b709-6a840f79c44a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:31.182289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a3e92c6-3653-41d3-b709-6a840f79c44a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:31.189306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a3e92c6-3653-41d3-b709-6a840f79c44a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:31.334714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2d77f73f-a2f5-4ff9-98cd-2296783b0e06 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:31.356829 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2d77f73f-a2f5-4ff9-98cd-2296783b0e06 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1308 microversion: 2.1 time: 0.784060 Aug 09 14:41:31.364654 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1292/2670] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:30 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1308 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:41:31.371201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ce8d012-9c28-4b8c-b274-3bf06ccd3da3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:31.375358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ce8d012-9c28-4b8c-b274-3bf06ccd3da3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:31.377312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6a3e92c6-3653-41d3-b709-6a840f79c44a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:31.384286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce8d012-9c28-4b8c-b274-3bf06ccd3da3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:31.385467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce8d012-9c28-4b8c-b274-3bf06ccd3da3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:31.386142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce8d012-9c28-4b8c-b274-3bf06ccd3da3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:31.387188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce8d012-9c28-4b8c-b274-3bf06ccd3da3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:31.388431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce8d012-9c28-4b8c-b274-3bf06ccd3da3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:31.390242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ce8d012-9c28-4b8c-b274-3bf06ccd3da3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:31.392662 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6a3e92c6-3653-41d3-b709-6a840f79c44a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 200 len: 1266 microversion: 2.1 time: 0.245073 Aug 09 14:41:31.393358 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1379/2671] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:31 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:31.399259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60d35609-8e3f-467f-a957-ba9bd2fdc00c tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41de516ee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:31.552338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ce8d012-9c28-4b8c-b274-3bf06ccd3da3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:31.572679 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ce8d012-9c28-4b8c-b274-3bf06ccd3da3 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 200 len: 1274 microversion: 2.1 time: 0.206328 Aug 09 14:41:31.579171 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1293/2672] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:31 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 1274 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:31.603406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19d7e8a1-269d-4ce9-bfc7-ab8b101f9833 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:31.611931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-19d7e8a1-269d-4ce9-bfc7-ab8b101f9833 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:31.619647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19d7e8a1-269d-4ce9-bfc7-ab8b101f9833 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:31.627909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19d7e8a1-269d-4ce9-bfc7-ab8b101f9833 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:31.628659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19d7e8a1-269d-4ce9-bfc7-ab8b101f9833 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:31.630745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19d7e8a1-269d-4ce9-bfc7-ab8b101f9833 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:31.631428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19d7e8a1-269d-4ce9-bfc7-ab8b101f9833 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:31.632004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19d7e8a1-269d-4ce9-bfc7-ab8b101f9833 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:32.113775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-19d7e8a1-269d-4ce9-bfc7-ab8b101f9833 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:32.126942 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-19d7e8a1-269d-4ce9-bfc7-ab8b101f9833 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1372 microversion: 2.1 time: 0.540897 Aug 09 14:41:32.128868 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1294/2673] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:31 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1372 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:32.590755 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60d35609-8e3f-467f-a957-ba9bd2fdc00c tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "DELETE /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41" status: 204 len: 0 microversion: 2.1 time: 1.196010 Aug 09 14:41:32.596295 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1380/2674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:31 2022] DELETE /compute/v2.1/images/479eef8e-c60a-45df-810a-a2810309bf41 => generated 0 bytes in 1198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:41:32.606105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b198b81d-cb1b-4ac1-a63b-7f584b80104a req-165ca222-01b0-4446-a76b-2fe950f586a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d98e16-7a40-4281-a9f5-fbe5fe968056", "name": "network-vif-plugged", "status": "completed", "tag": "6861dcfc-b313-4e9f-a048-edba9a4a7880"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:32.654094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b198b81d-cb1b-4ac1-a63b-7f584b80104a req-165ca222-01b0-4446-a76b-2fe950f586a4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:32.661115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b198b81d-cb1b-4ac1-a63b-7f584b80104a req-165ca222-01b0-4446-a76b-2fe950f586a4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:32.663784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b198b81d-cb1b-4ac1-a63b-7f584b80104a req-165ca222-01b0-4446-a76b-2fe950f586a4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:32.710701 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b198b81d-cb1b-4ac1-a63b-7f584b80104a req-165ca222-01b0-4446-a76b-2fe950f586a4 service nova] Creating event network-vif-plugged:6861dcfc-b313-4e9f-a048-edba9a4a7880 for instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 on n-h1-844626-8 Aug 09 14:41:32.725381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-51cfd245-5bbf-4b24-ad42-24298d0b39a7 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] Action: 'create', calling method: .version_select at 0x7f41e75c8700>, body: {"pool": null} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:32.726243 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b198b81d-cb1b-4ac1-a63b-7f584b80104a req-165ca222-01b0-4446-a76b-2fe950f586a4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127759 Aug 09 14:41:32.729048 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1381/2675] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:32.739737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1f37a2b7-557b-4704-ae18-a875ccd3d042 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:32.742648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1f37a2b7-557b-4704-ae18-a875ccd3d042 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:32.772243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f37a2b7-557b-4704-ae18-a875ccd3d042 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:32.773551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f37a2b7-557b-4704-ae18-a875ccd3d042 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:32.777307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f37a2b7-557b-4704-ae18-a875ccd3d042 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:32.778453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f37a2b7-557b-4704-ae18-a875ccd3d042 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:32.781034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f37a2b7-557b-4704-ae18-a875ccd3d042 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:32.785810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f37a2b7-557b-4704-ae18-a875ccd3d042 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:34.046321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1f37a2b7-557b-4704-ae18-a875ccd3d042 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:34.060911 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1f37a2b7-557b-4704-ae18-a875ccd3d042 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1308 microversion: 2.1 time: 1.330511 Aug 09 14:41:34.061520 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1382/2676] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:32 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1308 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:34.066886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1a7f5f4-a638-47fe-8079-d08b1164da01 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:34.075977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1a7f5f4-a638-47fe-8079-d08b1164da01 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:34.102875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1a7f5f4-a638-47fe-8079-d08b1164da01 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:34.107632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1a7f5f4-a638-47fe-8079-d08b1164da01 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:34.108142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1a7f5f4-a638-47fe-8079-d08b1164da01 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:34.108915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1a7f5f4-a638-47fe-8079-d08b1164da01 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:34.109387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1a7f5f4-a638-47fe-8079-d08b1164da01 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:34.109814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1a7f5f4-a638-47fe-8079-d08b1164da01 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:34.249916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1a7f5f4-a638-47fe-8079-d08b1164da01 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:34.266846 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1a7f5f4-a638-47fe-8079-d08b1164da01 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 200 len: 1266 microversion: 2.1 time: 0.204044 Aug 09 14:41:34.268586 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1383/2677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:34 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:34.287672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d549c354-9183-4604-8e7f-503cc89d14e7 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:34.294515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d549c354-9183-4604-8e7f-503cc89d14e7 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:34.316431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d549c354-9183-4604-8e7f-503cc89d14e7 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:34.319452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d549c354-9183-4604-8e7f-503cc89d14e7 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:34.323065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d549c354-9183-4604-8e7f-503cc89d14e7 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:34.326023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d549c354-9183-4604-8e7f-503cc89d14e7 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:34.327440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d549c354-9183-4604-8e7f-503cc89d14e7 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:34.330517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d549c354-9183-4604-8e7f-503cc89d14e7 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:35.162255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d549c354-9183-4604-8e7f-503cc89d14e7 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:35.181841 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d549c354-9183-4604-8e7f-503cc89d14e7 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 200 len: 1322 microversion: 2.1 time: 0.903789 Aug 09 14:41:35.195666 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1384/2678] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:34 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 1322 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:35.204416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c339de95-28d0-4a53-8954-bd419421899f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '.version_select at 0x7f41dd7fc040>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:35.238335 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-c339de95-28d0-4a53-8954-bd419421899f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] HTTP exception thrown: Image not found. Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c339de95-28d0-4a53-8954-bd419421899f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Request method failure captured: Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 HTTP/1.1 Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nHGdpcL1DU37lrGh19mPCZdrTEivuEVEodErVadIVPa_2bjtxWaWNe4Ttv464Ey2SRYoNQG89wzNwrif8YIEhXji-RV42hQ1tnam3zKk1FU3psugsTwteARTW03O5oq5VjD0CQXpLCj5M2Io6B_6BMvReodzv7GpI88_SEY-VhXK5U Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 0054032608084cdc8ef35d7638e13615 Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesOneServerTestJSON-1803809503 Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0054032608084cdc8ef35d7638e13615", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0054032608084cdc8ef35d7638e13615"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0054032608084cdc8ef35d7638e13615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0054032608084cdc8ef35d7638e13615"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesOneServerTestJSON-1803809503 Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 0054032608084cdc8ef35d7638e13615 Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1803809503 Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesOneServerTestJSON-1803809503-project Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 9f5334b328ca4a32ab7b5b258249bcb9 Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesOneServerTestJSON-1803809503-project Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: exception: Image not found. Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3d55d2f0-3faf-4098-a53d-1c91da0d12e3'} Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 3d55d2f0-3faf-4098-a53d-1c91da0d12e3 to delete Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3d55d2f0-3faf-4098-a53d-1c91da0d12e3 could not be found. Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:35.240631 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:41:35.245619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:35.253078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c339de95-28d0-4a53-8954-bd419421899f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Returning 404 to user: Image not found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:35.254227 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c339de95-28d0-4a53-8954-bd419421899f tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "DELETE /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3" status: 404 len: 62 microversion: 2.1 time: 0.057264 Aug 09 14:41:35.255665 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1385/2679] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:35 2022] DELETE /compute/v2.1/images/3d55d2f0-3faf-4098-a53d-1c91da0d12e3 => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:41:35.261641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49ab5000-ff66-4a9a-9016-ad23ef278ec9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:35.262487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49ab5000-ff66-4a9a-9016-ad23ef278ec9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:35.270040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:35.271828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ab5000-ff66-4a9a-9016-ad23ef278ec9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:35.272480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ab5000-ff66-4a9a-9016-ad23ef278ec9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:35.273178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ab5000-ff66-4a9a-9016-ad23ef278ec9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:35.274160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ab5000-ff66-4a9a-9016-ad23ef278ec9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:35.274919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ab5000-ff66-4a9a-9016-ad23ef278ec9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:35.275783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ab5000-ff66-4a9a-9016-ad23ef278ec9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:35.789734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-49ab5000-ff66-4a9a-9016-ad23ef278ec9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:35.806772 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49ab5000-ff66-4a9a-9016-ad23ef278ec9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1372 microversion: 2.1 time: 0.548962 Aug 09 14:41:35.807437 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1386/2680] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:35 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1372 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:35.844666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-28dbb5f6-0405-4c0e-846c-e70928227551 req-f923e663-4de4-49eb-abf6-c22eef47de46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40892bf1-16b7-466e-8518-9cf8be282cb7", "name": "network-vif-plugged", "status": "completed", "tag": "7edc31a2-a874-4936-b752-ab4c8952a0d0"}, {"server_uuid": "6f61de9f-77ce-4797-a4cf-6005d3c64092", "name": "network-vif-unplugged", "status": "completed", "tag": "f033813f-a028-456e-9341-0cb54066aa57"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:35.883333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-28dbb5f6-0405-4c0e-846c-e70928227551 req-f923e663-4de4-49eb-abf6-c22eef47de46 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:35.883821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-28dbb5f6-0405-4c0e-846c-e70928227551 req-f923e663-4de4-49eb-abf6-c22eef47de46 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:35.884256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-28dbb5f6-0405-4c0e-846c-e70928227551 req-f923e663-4de4-49eb-abf6-c22eef47de46 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:35.906394 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-28dbb5f6-0405-4c0e-846c-e70928227551 req-f923e663-4de4-49eb-abf6-c22eef47de46 service nova] Creating event network-vif-plugged:7edc31a2-a874-4936-b752-ab4c8952a0d0 for instance 40892bf1-16b7-466e-8518-9cf8be282cb7 on n-h2-844626-8 Aug 09 14:41:35.912398 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-28dbb5f6-0405-4c0e-846c-e70928227551 req-f923e663-4de4-49eb-abf6-c22eef47de46 service nova] Creating event network-vif-unplugged:f033813f-a028-456e-9341-0cb54066aa57 for instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 on n-h1-844626-8 Aug 09 14:41:35.931739 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-28dbb5f6-0405-4c0e-846c-e70928227551 req-f923e663-4de4-49eb-abf6-c22eef47de46 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.114295 Aug 09 14:41:35.932642 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1387/2681] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:35.946385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-eb952f7c-1e3f-4508-b89f-716cd350ccb8 req-70229d27-1a5f-4a11-baab-7c4c4244fbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42339b60-9160-4247-8616-42ecd01fd14b", "tag": "029caebb-3d82-4f57-a3bf-db3e9d7ebf39"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:35.962382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eb952f7c-1e3f-4508-b89f-716cd350ccb8 req-70229d27-1a5f-4a11-baab-7c4c4244fbf1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:35.962940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eb952f7c-1e3f-4508-b89f-716cd350ccb8 req-70229d27-1a5f-4a11-baab-7c4c4244fbf1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:35.963639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eb952f7c-1e3f-4508-b89f-716cd350ccb8 req-70229d27-1a5f-4a11-baab-7c4c4244fbf1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:35.991877 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-eb952f7c-1e3f-4508-b89f-716cd350ccb8 req-70229d27-1a5f-4a11-baab-7c4c4244fbf1 service nova] Creating event network-changed:029caebb-3d82-4f57-a3bf-db3e9d7ebf39 for instance 42339b60-9160-4247-8616-42ecd01fd14b on n-h1-844626-8 Aug 09 14:41:35.999932 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-eb952f7c-1e3f-4508-b89f-716cd350ccb8 req-70229d27-1a5f-4a11-baab-7c4c4244fbf1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064620 Aug 09 14:41:36.001293 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1388/2682] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:36.011776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4234af8-56d1-43e3-a26d-cb603223a823 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:36.012866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4234af8-56d1-43e3-a26d-cb603223a823 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:36.019788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4234af8-56d1-43e3-a26d-cb603223a823 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:36.020576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4234af8-56d1-43e3-a26d-cb603223a823 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:36.021315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4234af8-56d1-43e3-a26d-cb603223a823 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:36.022235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4234af8-56d1-43e3-a26d-cb603223a823 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:36.023483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4234af8-56d1-43e3-a26d-cb603223a823 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:36.024120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4234af8-56d1-43e3-a26d-cb603223a823 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:36.624015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d4234af8-56d1-43e3-a26d-cb603223a823 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:36.636812 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4234af8-56d1-43e3-a26d-cb603223a823 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1488 microversion: 2.1 time: 0.634045 Aug 09 14:41:36.644307 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1389/2683] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:36 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1488 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:36.671673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-013c521b-c76c-4c57-b3f2-2c9e3c00fec1 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:36.672936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-013c521b-c76c-4c57-b3f2-2c9e3c00fec1 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:36.687678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-013c521b-c76c-4c57-b3f2-2c9e3c00fec1 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:36.690248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-013c521b-c76c-4c57-b3f2-2c9e3c00fec1 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:36.690842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-013c521b-c76c-4c57-b3f2-2c9e3c00fec1 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:36.691949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-013c521b-c76c-4c57-b3f2-2c9e3c00fec1 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:36.693535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-013c521b-c76c-4c57-b3f2-2c9e3c00fec1 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:36.695400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-013c521b-c76c-4c57-b3f2-2c9e3c00fec1 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:36.751776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:36.786315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-013c521b-c76c-4c57-b3f2-2c9e3c00fec1 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:41:36.906283 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-013c521b-c76c-4c57-b3f2-2c9e3c00fec1 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 204 len: 0 microversion: 2.1 time: 0.259990 Aug 09 14:41:36.907337 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1390/2684] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:41:36 2022] DELETE /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:41:36.914405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aa961057-9ca3-4f90-843c-a83130ea5c26 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:36.915306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aa961057-9ca3-4f90-843c-a83130ea5c26 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:36.922201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa961057-9ca3-4f90-843c-a83130ea5c26 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:36.923108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa961057-9ca3-4f90-843c-a83130ea5c26 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:36.923648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa961057-9ca3-4f90-843c-a83130ea5c26 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:36.924450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa961057-9ca3-4f90-843c-a83130ea5c26 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:36.924992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa961057-9ca3-4f90-843c-a83130ea5c26 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:36.925501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa961057-9ca3-4f90-843c-a83130ea5c26 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:37.518076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aa961057-9ca3-4f90-843c-a83130ea5c26 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:37.527533 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aa961057-9ca3-4f90-843c-a83130ea5c26 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 200 len: 1308 microversion: 2.1 time: 0.618370 Aug 09 14:41:37.528105 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1391/2685] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:36 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 1308 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:37.546429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c813b627-7bc8-4ff6-bda6-95744c131e9f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:37.547327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c813b627-7bc8-4ff6-bda6-95744c131e9f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:37.554787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c813b627-7bc8-4ff6-bda6-95744c131e9f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:37.556107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c813b627-7bc8-4ff6-bda6-95744c131e9f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:37.556586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c813b627-7bc8-4ff6-bda6-95744c131e9f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:37.557605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c813b627-7bc8-4ff6-bda6-95744c131e9f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:37.558401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c813b627-7bc8-4ff6-bda6-95744c131e9f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:37.558802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c813b627-7bc8-4ff6-bda6-95744c131e9f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:37.931895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c813b627-7bc8-4ff6-bda6-95744c131e9f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:37.942969 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c813b627-7bc8-4ff6-bda6-95744c131e9f tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 200 len: 1322 microversion: 2.1 time: 0.397853 Aug 09 14:41:37.942969 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1392/2686] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:37 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:37.947130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c3d054d9-c30b-4ae5-aea4-62395a591ef8 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:37.947763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c3d054d9-c30b-4ae5-aea4-62395a591ef8 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:37.954516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3d054d9-c30b-4ae5-aea4-62395a591ef8 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:37.954979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3d054d9-c30b-4ae5-aea4-62395a591ef8 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:37.955518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3d054d9-c30b-4ae5-aea4-62395a591ef8 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:37.956576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3d054d9-c30b-4ae5-aea4-62395a591ef8 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:37.957031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3d054d9-c30b-4ae5-aea4-62395a591ef8 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:37.957457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3d054d9-c30b-4ae5-aea4-62395a591ef8 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:38.333124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c3d054d9-c30b-4ae5-aea4-62395a591ef8 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:38.341474 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c3d054d9-c30b-4ae5-aea4-62395a591ef8 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1558 microversion: 2.1 time: 0.398851 Aug 09 14:41:38.343879 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1393/2687] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:37 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1558 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:38.350768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-239395938", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "7d4b5e6e-1097-46ba-bb21-ff9e1560d087"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:38.466663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] validate_networks() for [('7d4b5e6e-1097-46ba-bb21-ff9e1560d087', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:41:38.605919 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-51cfd245-5bbf-4b24-ad42-24298d0b39a7 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.475497 Aug 09 14:41:38.606982 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1295/2688] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 9 14:41:32 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:38.613908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c86e4a05-9a36-4ee5-b8dc-1e5da8041848 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:38.621484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c86e4a05-9a36-4ee5-b8dc-1e5da8041848 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:38.640109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c86e4a05-9a36-4ee5-b8dc-1e5da8041848 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:38.643862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c86e4a05-9a36-4ee5-b8dc-1e5da8041848 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:38.648712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c86e4a05-9a36-4ee5-b8dc-1e5da8041848 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:38.650719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c86e4a05-9a36-4ee5-b8dc-1e5da8041848 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:38.651437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c86e4a05-9a36-4ee5-b8dc-1e5da8041848 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:38.652078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c86e4a05-9a36-4ee5-b8dc-1e5da8041848 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:39.052921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c86e4a05-9a36-4ee5-b8dc-1e5da8041848 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:39.062512 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c86e4a05-9a36-4ee5-b8dc-1e5da8041848 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1473 microversion: 2.1 time: 0.453061 Aug 09 14:41:39.080726 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1296/2689] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:38 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1473 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:39.092185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-3e2fbf72-bcaa-4cce-a11f-1642db087194 req-183be101-5497-4a81-946c-d45284159703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e3bd4a-f659-481c-bdeb-dfd8b8642d34", "tag": "f1456a38-c035-49d9-bc56-a6e3427ec464"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:39.114802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3e2fbf72-bcaa-4cce-a11f-1642db087194 req-183be101-5497-4a81-946c-d45284159703 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:39.117046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3e2fbf72-bcaa-4cce-a11f-1642db087194 req-183be101-5497-4a81-946c-d45284159703 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:39.119457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3e2fbf72-bcaa-4cce-a11f-1642db087194 req-183be101-5497-4a81-946c-d45284159703 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:39.144975 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3e2fbf72-bcaa-4cce-a11f-1642db087194 req-183be101-5497-4a81-946c-d45284159703 service nova] Creating event network-changed:f1456a38-c035-49d9-bc56-a6e3427ec464 for instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 on n-h1-844626-8 Aug 09 14:41:39.157223 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-3e2fbf72-bcaa-4cce-a11f-1642db087194 req-183be101-5497-4a81-946c-d45284159703 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074714 Aug 09 14:41:39.160507 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1297/2690] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:39.169932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9acc4f7b-d4c5-445e-a2e0-46acdf614cba tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:39.175633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9acc4f7b-d4c5-445e-a2e0-46acdf614cba tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:39.191266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acc4f7b-d4c5-445e-a2e0-46acdf614cba tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:39.192011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acc4f7b-d4c5-445e-a2e0-46acdf614cba tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:39.193039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acc4f7b-d4c5-445e-a2e0-46acdf614cba tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:39.195017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acc4f7b-d4c5-445e-a2e0-46acdf614cba tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:39.196348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acc4f7b-d4c5-445e-a2e0-46acdf614cba tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:39.196795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acc4f7b-d4c5-445e-a2e0-46acdf614cba tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:39.382569 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9acc4f7b-d4c5-445e-a2e0-46acdf614cba tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.220605 Aug 09 14:41:39.383209 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1298/2691] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:41:39 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:39.387870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-89b67c3e-2929-4d65-a751-87dfb9248385 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:39.388471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-89b67c3e-2929-4d65-a751-87dfb9248385 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:39.400703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89b67c3e-2929-4d65-a751-87dfb9248385 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:39.401203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89b67c3e-2929-4d65-a751-87dfb9248385 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:39.401641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89b67c3e-2929-4d65-a751-87dfb9248385 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:39.406613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89b67c3e-2929-4d65-a751-87dfb9248385 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:39.407358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89b67c3e-2929-4d65-a751-87dfb9248385 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:39.407935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89b67c3e-2929-4d65-a751-87dfb9248385 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:39.500077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:39.656782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:39.803064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=14 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:40.291247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-89b67c3e-2929-4d65-a751-87dfb9248385 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:40.302886 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-89b67c3e-2929-4d65-a751-87dfb9248385 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 200 len: 1308 microversion: 2.1 time: 0.915677 Aug 09 14:41:40.304981 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1299/2692] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:39 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 1308 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:40.314221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8a8e0047-235a-49fc-9ae8-e5c85800e3b2 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] Action: 'create', calling method: .version_select at 0x7f41de236700>, body: {"pool": null} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:40.409416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:41:40.410605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:41:40.411291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:41:40.411850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:41:40.412405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:41:40.431560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:40.432766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:40.433349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:40.435387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:40.437521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:40.441121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:40.469438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:41:40.480498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for user 03bdf5ec21854ec8b6561a121ce1f1ef and project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:41:40.505208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:41:40.507814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:41:40.655994 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bca47b97-4fe2-4e2b-87f6-298bbf25a79d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.308968 Aug 09 14:41:40.658181 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1394/2693] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:41:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:41:40.666295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67322dfd-bb3a-45da-898a-9039a14af823 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:40.667654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-67322dfd-bb3a-45da-898a-9039a14af823 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:40.682851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67322dfd-bb3a-45da-898a-9039a14af823 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:40.685228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67322dfd-bb3a-45da-898a-9039a14af823 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:40.685994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67322dfd-bb3a-45da-898a-9039a14af823 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:40.686958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67322dfd-bb3a-45da-898a-9039a14af823 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:40.694088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67322dfd-bb3a-45da-898a-9039a14af823 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:40.695846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67322dfd-bb3a-45da-898a-9039a14af823 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:41.261184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-67322dfd-bb3a-45da-898a-9039a14af823 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:41.274949 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67322dfd-bb3a-45da-898a-9039a14af823 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 200 len: 1322 microversion: 2.1 time: 0.611653 Aug 09 14:41:41.276215 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1395/2694] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:40 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 1322 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:41.288446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:41.291565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:41.312860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:41.315072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:41.317312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:41.318484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:41.319580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:41.322908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:41.438498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:41.440660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:41.441155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:41.441627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lazy-loading 'fault' on Instance uuid 6f61de9f-77ce-4797-a4cf-6005d3c64092 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:41:41.537646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5334b328ca4a32ab7b5b258249bcb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0054032608084cdc8ef35d7638e13615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:41.560603 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-357f4d3d-cc6c-4461-be70-cba913ad0475 tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 200 len: 1307 microversion: 2.1 time: 0.280196 Aug 09 14:41:41.563701 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1396/2695] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:41 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 1307 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:41.577161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b96f8259-6e34-49fb-9494-581f33045319 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:41.578150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b96f8259-6e34-49fb-9494-581f33045319 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:41.723397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b96f8259-6e34-49fb-9494-581f33045319 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:41.772554 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b96f8259-6e34-49fb-9494-581f33045319 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1208 microversion: 2.1 time: 0.182296 Aug 09 14:41:41.777734 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1397/2696] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:41 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1208 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:41.809475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-da0c7c31-d6fa-4acc-a708-364b257356bc req-75141580-78de-49fb-a541-ea312bad8d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f61de9f-77ce-4797-a4cf-6005d3c64092", "name": "network-vif-deleted", "tag": "f033813f-a028-456e-9341-0cb54066aa57"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:41.863681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-da0c7c31-d6fa-4acc-a708-364b257356bc req-75141580-78de-49fb-a541-ea312bad8d2a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:41.864187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-da0c7c31-d6fa-4acc-a708-364b257356bc req-75141580-78de-49fb-a541-ea312bad8d2a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:41.864626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-da0c7c31-d6fa-4acc-a708-364b257356bc req-75141580-78de-49fb-a541-ea312bad8d2a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:41.887631 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-da0c7c31-d6fa-4acc-a708-364b257356bc req-75141580-78de-49fb-a541-ea312bad8d2a service nova] Creating event network-vif-deleted:f033813f-a028-456e-9341-0cb54066aa57 for instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 on n-h1-844626-8 Aug 09 14:41:41.905351 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-da0c7c31-d6fa-4acc-a708-364b257356bc req-75141580-78de-49fb-a541-ea312bad8d2a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126118 Aug 09 14:41:41.906496 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1398/2697] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:41.914911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1adee05e-6588-4bd2-817a-e9b29efefcb3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:41.916145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1adee05e-6588-4bd2-817a-e9b29efefcb3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:41.925183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1adee05e-6588-4bd2-817a-e9b29efefcb3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:41.925990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1adee05e-6588-4bd2-817a-e9b29efefcb3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:41.926584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1adee05e-6588-4bd2-817a-e9b29efefcb3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:41.927525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1adee05e-6588-4bd2-817a-e9b29efefcb3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:41.928120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1adee05e-6588-4bd2-817a-e9b29efefcb3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:41.928760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1adee05e-6588-4bd2-817a-e9b29efefcb3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:42.530123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1adee05e-6588-4bd2-817a-e9b29efefcb3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:42.562928 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1adee05e-6588-4bd2-817a-e9b29efefcb3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 200 len: 1308 microversion: 2.1 time: 0.651569 Aug 09 14:41:42.579930 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1399/2698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:41 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 1308 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:42.884050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9f6cb690-f1e5-463a-8317-69e52c84f786 req-10b02d1d-a397-4eb9-ae4c-e60297d69d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42339b60-9160-4247-8616-42ecd01fd14b", "name": "network-vif-plugged", "status": "completed", "tag": "029caebb-3d82-4f57-a3bf-db3e9d7ebf39"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:42.904757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9f6cb690-f1e5-463a-8317-69e52c84f786 req-10b02d1d-a397-4eb9-ae4c-e60297d69d6b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:42.905444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9f6cb690-f1e5-463a-8317-69e52c84f786 req-10b02d1d-a397-4eb9-ae4c-e60297d69d6b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:42.906062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9f6cb690-f1e5-463a-8317-69e52c84f786 req-10b02d1d-a397-4eb9-ae4c-e60297d69d6b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:42.921403 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9f6cb690-f1e5-463a-8317-69e52c84f786 req-10b02d1d-a397-4eb9-ae4c-e60297d69d6b service nova] Creating event network-vif-plugged:029caebb-3d82-4f57-a3bf-db3e9d7ebf39 for instance 42339b60-9160-4247-8616-42ecd01fd14b on n-h1-844626-8 Aug 09 14:41:42.926439 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9f6cb690-f1e5-463a-8317-69e52c84f786 req-10b02d1d-a397-4eb9-ae4c-e60297d69d6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.344806 Aug 09 14:41:42.927163 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1400/2699] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:42.936081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd4658bd-ed9e-4719-be1c-347c89ece256 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:42.936879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd4658bd-ed9e-4719-be1c-347c89ece256 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:42.945440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd4658bd-ed9e-4719-be1c-347c89ece256 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:42.946149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd4658bd-ed9e-4719-be1c-347c89ece256 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:42.946774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd4658bd-ed9e-4719-be1c-347c89ece256 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:42.947715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd4658bd-ed9e-4719-be1c-347c89ece256 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:42.948345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd4658bd-ed9e-4719-be1c-347c89ece256 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:42.948940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd4658bd-ed9e-4719-be1c-347c89ece256 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:43.393944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd4658bd-ed9e-4719-be1c-347c89ece256 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:43.408497 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd4658bd-ed9e-4719-be1c-347c89ece256 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 200 len: 1322 microversion: 2.1 time: 0.477194 Aug 09 14:41:43.409141 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1401/2700] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:42 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:43.428005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d884f3a9-9707-434b-8aa3-7d2689f4200a tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:43.429520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d884f3a9-9707-434b-8aa3-7d2689f4200a tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] [instance: 6f61de9f-77ce-4797-a4cf-6005d3c64092] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:43.453251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d884f3a9-9707-434b-8aa3-7d2689f4200a tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:43.454053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d884f3a9-9707-434b-8aa3-7d2689f4200a tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:43.455725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d884f3a9-9707-434b-8aa3-7d2689f4200a tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:43.457669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d884f3a9-9707-434b-8aa3-7d2689f4200a tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:43.458352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d884f3a9-9707-434b-8aa3-7d2689f4200a tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:43.458963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d884f3a9-9707-434b-8aa3-7d2689f4200a tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:43.485855 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-d884f3a9-9707-434b-8aa3-7d2689f4200a tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] HTTP exception thrown: Instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 could not be found. Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d884f3a9-9707-434b-8aa3-7d2689f4200a tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Request method failure captured: Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 HTTP/1.1 Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nHGdpcL1DU37lrGh19mPCZdrTEivuEVEodErVadIVPa_2bjtxWaWNe4Ttv464Ey2SRYoNQG89wzNwrif8YIEhXji-RV42hQ1tnam3zKk1FU3psugsTwteARTW03O5oq5VjD0CQXpLCj5M2Io6B_6BMvReodzv7GpI88_SEY-VhXK5U Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 0054032608084cdc8ef35d7638e13615 Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesOneServerTestJSON-1803809503 Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0054032608084cdc8ef35d7638e13615", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0054032608084cdc8ef35d7638e13615"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0054032608084cdc8ef35d7638e13615"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0054032608084cdc8ef35d7638e13615"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesOneServerTestJSON-1803809503 Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 0054032608084cdc8ef35d7638e13615 Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1803809503 Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesOneServerTestJSON-1803809503-project Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 9f5334b328ca4a32ab7b5b258249bcb9 Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesOneServerTestJSON-1803809503-project Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 could not be found. Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '6f61de9f-77ce-4797-a4cf-6005d3c64092'} Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 could not be found. Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 could not be found. Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:43.490562 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:43.496426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:43.496426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:43.496426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:43.496426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:43.496426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:43.496426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 could not be found. Aug 09 14:41:43.496426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:43.498048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d884f3a9-9707-434b-8aa3-7d2689f4200a tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] Returning 404 to user: Instance 6f61de9f-77ce-4797-a4cf-6005d3c64092 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:43.499562 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d884f3a9-9707-434b-8aa3-7d2689f4200a tempest-ImagesOneServerTestJSON-1803809503 tempest-ImagesOneServerTestJSON-1803809503-project] 10.222.0.50 "GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092" status: 404 len: 111 microversion: 2.1 time: 0.087445 Aug 09 14:41:43.503101 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1402/2701] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:43 2022] GET /compute/v2.1/servers/6f61de9f-77ce-4797-a4cf-6005d3c64092 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:41:43.521499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-76fadb0f-ab6c-4328-b8e4-cb3d78681476 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:43.522130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-76fadb0f-ab6c-4328-b8e4-cb3d78681476 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:43.543110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76fadb0f-ab6c-4328-b8e4-cb3d78681476 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:43.543593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76fadb0f-ab6c-4328-b8e4-cb3d78681476 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:43.544027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76fadb0f-ab6c-4328-b8e4-cb3d78681476 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:43.544732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76fadb0f-ab6c-4328-b8e4-cb3d78681476 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:43.545181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76fadb0f-ab6c-4328-b8e4-cb3d78681476 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:43.545605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76fadb0f-ab6c-4328-b8e4-cb3d78681476 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:43.706345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-76fadb0f-ab6c-4328-b8e4-cb3d78681476 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:43.719035 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-76fadb0f-ab6c-4328-b8e4-cb3d78681476 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1266 microversion: 2.1 time: 0.207691 Aug 09 14:41:43.720137 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1403/2702] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:43 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:43.728304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ffb387d3-9494-46c1-ab93-1580033f5c7a req-eea3e64a-1329-4a13-98da-a87d73b001c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40892bf1-16b7-466e-8518-9cf8be282cb7", "tag": "7edc31a2-a874-4936-b752-ab4c8952a0d0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:43.758838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ffb387d3-9494-46c1-ab93-1580033f5c7a req-eea3e64a-1329-4a13-98da-a87d73b001c6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:43.760743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ffb387d3-9494-46c1-ab93-1580033f5c7a req-eea3e64a-1329-4a13-98da-a87d73b001c6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:43.763779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ffb387d3-9494-46c1-ab93-1580033f5c7a req-eea3e64a-1329-4a13-98da-a87d73b001c6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:43.794026 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ffb387d3-9494-46c1-ab93-1580033f5c7a req-eea3e64a-1329-4a13-98da-a87d73b001c6 service nova] Creating event network-changed:7edc31a2-a874-4936-b752-ab4c8952a0d0 for instance 40892bf1-16b7-466e-8518-9cf8be282cb7 on n-h2-844626-8 Aug 09 14:41:43.804840 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ffb387d3-9494-46c1-ab93-1580033f5c7a req-eea3e64a-1329-4a13-98da-a87d73b001c6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081543 Aug 09 14:41:43.808395 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1404/2703] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:44.139339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-2050572131", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "e2f768fd-d567-4b0e-b9ce-0f7fb6e03bf7"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:44.244276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] validate_networks() for [('e2f768fd-d567-4b0e-b9ce-0f7fb6e03bf7', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:41:44.787831 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8a8e0047-235a-49fc-9ae8-e5c85800e3b2 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.480006 Aug 09 14:41:44.795475 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1300/2704] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 9 14:41:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:44.795475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44dde037-334c-4aa2-b799-657f22f5ccf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:44.795475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44dde037-334c-4aa2-b799-657f22f5ccf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:44.813150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44dde037-334c-4aa2-b799-657f22f5ccf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:44.813659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44dde037-334c-4aa2-b799-657f22f5ccf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:44.816404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44dde037-334c-4aa2-b799-657f22f5ccf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:44.817215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44dde037-334c-4aa2-b799-657f22f5ccf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:44.834172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44dde037-334c-4aa2-b799-657f22f5ccf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:44.834636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44dde037-334c-4aa2-b799-657f22f5ccf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:45.708349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-44dde037-334c-4aa2-b799-657f22f5ccf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:45.720924 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44dde037-334c-4aa2-b799-657f22f5ccf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 200 len: 1308 microversion: 2.1 time: 0.930988 Aug 09 14:41:45.738768 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1301/2705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:44 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 1308 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:45.757479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f6b59ab-f14c-42cd-870d-fdd6dad90cc9 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:45.758091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f6b59ab-f14c-42cd-870d-fdd6dad90cc9 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:45.764574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f6b59ab-f14c-42cd-870d-fdd6dad90cc9 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:45.765290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f6b59ab-f14c-42cd-870d-fdd6dad90cc9 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:45.765879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f6b59ab-f14c-42cd-870d-fdd6dad90cc9 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:45.766724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f6b59ab-f14c-42cd-870d-fdd6dad90cc9 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:45.773999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f6b59ab-f14c-42cd-870d-fdd6dad90cc9 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:45.774452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f6b59ab-f14c-42cd-870d-fdd6dad90cc9 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:45.998999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:41:46.000282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:41:46.002009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:41:46.002575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:41:46.003447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:41:46.041759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:46.042418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:46.043231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:46.044646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:46.045277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:46.046332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:46.058620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f6b59ab-f14c-42cd-870d-fdd6dad90cc9 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:46.071516 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f6b59ab-f14c-42cd-870d-fdd6dad90cc9 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 200 len: 1471 microversion: 2.1 time: 0.329107 Aug 09 14:41:46.073743 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1302/2706] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:45 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 1471 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:46.086604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bfa24638-ed95-4fa2-acd2-40a8fbea8084 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:46.087402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bfa24638-ed95-4fa2-acd2-40a8fbea8084 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:46.102041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfa24638-ed95-4fa2-acd2-40a8fbea8084 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:46.103010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfa24638-ed95-4fa2-acd2-40a8fbea8084 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:46.104947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfa24638-ed95-4fa2-acd2-40a8fbea8084 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:46.106162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfa24638-ed95-4fa2-acd2-40a8fbea8084 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:46.106621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfa24638-ed95-4fa2-acd2-40a8fbea8084 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:46.107039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfa24638-ed95-4fa2-acd2-40a8fbea8084 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:46.109479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Getting quotas for project c8e47994651049909de94dd63a67dbfc. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:41:46.118349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Getting quotas for user 3dc328a5959f4a37aa6bda2e6610ffd4 and project c8e47994651049909de94dd63a67dbfc. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:41:46.132380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Going to run 3 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:41:46.134972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: d3076ab8-1d52-4251-b6df-e16f82ff0a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:41:46.185360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 243e6add-76f2-406c-b10d-5d261cdd308a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=d3076ab8-1d52-4251-b6df-e16f82ff0a42,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:41:46.237792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=243e6add-76f2-406c-b10d-5d261cdd308a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:41:46.384201 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f7612e3a-6876-4c14-b3fd-f6d1b238d901 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.563235 Aug 09 14:41:46.384926 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1405/2707] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:41:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:41:46.392603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b126b6f4-9423-4f8d-bc24-fa945b26754e tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] Action: 'create', calling method: .version_select at 0x7f41dd666a60>, body: {"pool": null} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:46.406925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bfa24638-ed95-4fa2-acd2-40a8fbea8084 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:46.415357 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bfa24638-ed95-4fa2-acd2-40a8fbea8084 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1308 microversion: 2.1 time: 0.340333 Aug 09 14:41:46.446772 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1303/2708] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:46 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1308 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:46.453204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7559344c-969a-455c-a242-19652088bdad tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:46.454412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7559344c-969a-455c-a242-19652088bdad tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:46.462766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7559344c-969a-455c-a242-19652088bdad tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:46.464187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7559344c-969a-455c-a242-19652088bdad tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:46.464990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7559344c-969a-455c-a242-19652088bdad tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:46.466439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7559344c-969a-455c-a242-19652088bdad tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:46.468152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7559344c-969a-455c-a242-19652088bdad tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:46.468749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7559344c-969a-455c-a242-19652088bdad tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:46.496252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-7559344c-969a-455c-a242-19652088bdad tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lazy-loading 'flavor' on Instance uuid 42339b60-9160-4247-8616-42ecd01fd14b {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:41:46.646065 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7559344c-969a-455c-a242-19652088bdad tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b/action" status: 202 len: 0 microversion: 2.1 time: 0.197530 Aug 09 14:41:46.649236 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1304/2709] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:41:46 2022] POST /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:41:46.656845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b35ece4-23da-442e-ab31-b47f8f263cfb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:46.666304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9b35ece4-23da-442e-ab31-b47f8f263cfb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:46.667728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b35ece4-23da-442e-ab31-b47f8f263cfb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Searching by: {'deleted': False, 'project_id': 'c8e47994651049909de94dd63a67dbfc'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:41:46.712365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b35ece4-23da-442e-ab31-b47f8f263cfb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:46.718031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b35ece4-23da-442e-ab31-b47f8f263cfb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:46.720414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b35ece4-23da-442e-ab31-b47f8f263cfb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:46.723489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b35ece4-23da-442e-ab31-b47f8f263cfb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:46.725324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b35ece4-23da-442e-ab31-b47f8f263cfb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:46.727685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b35ece4-23da-442e-ab31-b47f8f263cfb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:46.775123 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b35ece4-23da-442e-ab31-b47f8f263cfb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.123245 Aug 09 14:41:46.780335 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1305/2710] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 14:41:46 2022] GET /compute/v2.1/servers => generated 1018 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:46.793030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8d94e5bf-3e42-4ed6-9f72-452861d49a4d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:46.794170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8d94e5bf-3e42-4ed6-9f72-452861d49a4d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:46.801712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d94e5bf-3e42-4ed6-9f72-452861d49a4d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:46.802604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d94e5bf-3e42-4ed6-9f72-452861d49a4d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:46.803139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d94e5bf-3e42-4ed6-9f72-452861d49a4d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:46.803953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d94e5bf-3e42-4ed6-9f72-452861d49a4d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:46.804619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d94e5bf-3e42-4ed6-9f72-452861d49a4d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:46.805249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8d94e5bf-3e42-4ed6-9f72-452861d49a4d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:46.835854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:48.219430 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8d94e5bf-3e42-4ed6-9f72-452861d49a4d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 200 len: 1630 microversion: 2.1 time: 1.437829 Aug 09 14:41:48.223518 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1306/2711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:46 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 1630 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:48.235515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c60ec279-472a-4f83-8836-336c7559be3a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:48.246814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c60ec279-472a-4f83-8836-336c7559be3a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:48.263993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c60ec279-472a-4f83-8836-336c7559be3a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:48.271833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c60ec279-472a-4f83-8836-336c7559be3a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:48.272314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c60ec279-472a-4f83-8836-336c7559be3a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:48.273266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c60ec279-472a-4f83-8836-336c7559be3a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:48.273653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c60ec279-472a-4f83-8836-336c7559be3a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:48.274070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c60ec279-472a-4f83-8836-336c7559be3a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:48.712579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c60ec279-472a-4f83-8836-336c7559be3a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:48.720852 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c60ec279-472a-4f83-8836-336c7559be3a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 200 len: 1308 microversion: 2.1 time: 0.496184 Aug 09 14:41:48.728525 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1307/2712] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:48 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 1308 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:48.753151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-efdaddd6-e9e5-42a2-9db6-e485787e7b67 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:48.754185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-efdaddd6-e9e5-42a2-9db6-e485787e7b67 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:48.769031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efdaddd6-e9e5-42a2-9db6-e485787e7b67 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:48.771765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efdaddd6-e9e5-42a2-9db6-e485787e7b67 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:48.773640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efdaddd6-e9e5-42a2-9db6-e485787e7b67 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:48.776109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efdaddd6-e9e5-42a2-9db6-e485787e7b67 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:48.777962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efdaddd6-e9e5-42a2-9db6-e485787e7b67 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:48.783773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efdaddd6-e9e5-42a2-9db6-e485787e7b67 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:49.098557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-efdaddd6-e9e5-42a2-9db6-e485787e7b67 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:49.140183 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-efdaddd6-e9e5-42a2-9db6-e485787e7b67 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 200 len: 1227 microversion: 2.1 time: 0.398607 Aug 09 14:41:49.143866 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1308/2713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:48 2022] GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 1227 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:49.150268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a164de8-9fc0-47fa-8c94-78af7ef17a07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:49.151433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a164de8-9fc0-47fa-8c94-78af7ef17a07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:49.201405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a164de8-9fc0-47fa-8c94-78af7ef17a07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:49.201894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a164de8-9fc0-47fa-8c94-78af7ef17a07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:49.202790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a164de8-9fc0-47fa-8c94-78af7ef17a07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:49.209965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a164de8-9fc0-47fa-8c94-78af7ef17a07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:49.211813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a164de8-9fc0-47fa-8c94-78af7ef17a07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:49.212536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a164de8-9fc0-47fa-8c94-78af7ef17a07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:49.662029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a164de8-9fc0-47fa-8c94-78af7ef17a07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:49.674919 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a164de8-9fc0-47fa-8c94-78af7ef17a07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1308 microversion: 2.1 time: 0.529670 Aug 09 14:41:49.685823 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1309/2714] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:49 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1308 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:49.707578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f8a38cd2-ecc5-4b3f-bb89-95344c0a9662 req-bfe1090a-af63-4778-a0d1-98fe2702b2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39095b44-f6d1-4065-a3cb-d6c051168846", "tag": "31cc8b77-0b03-4929-870b-00a100a52491"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:49.750129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f8a38cd2-ecc5-4b3f-bb89-95344c0a9662 req-bfe1090a-af63-4778-a0d1-98fe2702b2f6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:49.750721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f8a38cd2-ecc5-4b3f-bb89-95344c0a9662 req-bfe1090a-af63-4778-a0d1-98fe2702b2f6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:49.751190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f8a38cd2-ecc5-4b3f-bb89-95344c0a9662 req-bfe1090a-af63-4778-a0d1-98fe2702b2f6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:49.789862 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f8a38cd2-ecc5-4b3f-bb89-95344c0a9662 req-bfe1090a-af63-4778-a0d1-98fe2702b2f6 service nova] Creating event network-changed:31cc8b77-0b03-4929-870b-00a100a52491 for instance 39095b44-f6d1-4065-a3cb-d6c051168846 on n-h2-844626-8 Aug 09 14:41:49.812661 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f8a38cd2-ecc5-4b3f-bb89-95344c0a9662 req-bfe1090a-af63-4778-a0d1-98fe2702b2f6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113534 Aug 09 14:41:49.816221 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1310/2715] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:49.845814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c293980d-e96e-447c-af1e-4ffb3c8abd92 req-4b511fa2-89fc-4d24-8a2e-557fa131905f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e3bd4a-f659-481c-bdeb-dfd8b8642d34", "name": "network-vif-plugged", "status": "completed", "tag": "f1456a38-c035-49d9-bc56-a6e3427ec464"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:49.878113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=49 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:49.888397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c293980d-e96e-447c-af1e-4ffb3c8abd92 req-4b511fa2-89fc-4d24-8a2e-557fa131905f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:49.892678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c293980d-e96e-447c-af1e-4ffb3c8abd92 req-4b511fa2-89fc-4d24-8a2e-557fa131905f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:49.898348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c293980d-e96e-447c-af1e-4ffb3c8abd92 req-4b511fa2-89fc-4d24-8a2e-557fa131905f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:49.937305 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-c293980d-e96e-447c-af1e-4ffb3c8abd92 req-4b511fa2-89fc-4d24-8a2e-557fa131905f service nova] Creating event network-vif-plugged:f1456a38-c035-49d9-bc56-a6e3427ec464 for instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 on n-h1-844626-8 Aug 09 14:41:49.966106 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c293980d-e96e-447c-af1e-4ffb3c8abd92 req-4b511fa2-89fc-4d24-8a2e-557fa131905f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145247 Aug 09 14:41:49.972562 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1311/2716] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:49.987658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-83408b4f-69db-482f-ab76-0f62084200de tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:49.999726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-83408b4f-69db-482f-ab76-0f62084200de tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:50.027832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83408b4f-69db-482f-ab76-0f62084200de tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:50.029611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83408b4f-69db-482f-ab76-0f62084200de tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:50.033285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83408b4f-69db-482f-ab76-0f62084200de tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:50.037234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83408b4f-69db-482f-ab76-0f62084200de tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:50.039720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83408b4f-69db-482f-ab76-0f62084200de tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:50.041467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83408b4f-69db-482f-ab76-0f62084200de tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:50.534189 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-83408b4f-69db-482f-ab76-0f62084200de tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 200 len: 1613 microversion: 2.1 time: 0.559828 Aug 09 14:41:50.537517 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1312/2717] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:49 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 1613 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:50.554881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5fdc4f9-267c-448a-be83-26976f7e0f9b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:50.556308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c5fdc4f9-267c-448a-be83-26976f7e0f9b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:50.570938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5fdc4f9-267c-448a-be83-26976f7e0f9b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:50.577168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5fdc4f9-267c-448a-be83-26976f7e0f9b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:50.577737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5fdc4f9-267c-448a-be83-26976f7e0f9b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:50.580127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5fdc4f9-267c-448a-be83-26976f7e0f9b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:50.580615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5fdc4f9-267c-448a-be83-26976f7e0f9b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:50.581050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5fdc4f9-267c-448a-be83-26976f7e0f9b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:50.952014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5fdc4f9-267c-448a-be83-26976f7e0f9b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:50.966616 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c5fdc4f9-267c-448a-be83-26976f7e0f9b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 200 len: 1308 microversion: 2.1 time: 0.426794 Aug 09 14:41:50.967571 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1313/2718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:50 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:50.974008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d4a733e9-93ac-482d-bb29-32deecfabcea tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:50.980756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d4a733e9-93ac-482d-bb29-32deecfabcea tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:50.990075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4a733e9-93ac-482d-bb29-32deecfabcea tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:50.990813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4a733e9-93ac-482d-bb29-32deecfabcea tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:50.991561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4a733e9-93ac-482d-bb29-32deecfabcea tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:50.992539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4a733e9-93ac-482d-bb29-32deecfabcea tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:50.993191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4a733e9-93ac-482d-bb29-32deecfabcea tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:50.993774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4a733e9-93ac-482d-bb29-32deecfabcea tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:51.002043 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b126b6f4-9423-4f8d-bc24-fa945b26754e tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.615005 Aug 09 14:41:51.005926 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1406/2719] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 9 14:41:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:51.048905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5bf36119-99b2-41ea-a333-76f04c37207d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:51.049594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5bf36119-99b2-41ea-a333-76f04c37207d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:51.072631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bf36119-99b2-41ea-a333-76f04c37207d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:51.073436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bf36119-99b2-41ea-a333-76f04c37207d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:51.075240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bf36119-99b2-41ea-a333-76f04c37207d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:51.083999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bf36119-99b2-41ea-a333-76f04c37207d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:51.084768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bf36119-99b2-41ea-a333-76f04c37207d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:51.085362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bf36119-99b2-41ea-a333-76f04c37207d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:51.112096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d4a733e9-93ac-482d-bb29-32deecfabcea tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:51.121318 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d4a733e9-93ac-482d-bb29-32deecfabcea tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 200 len: 1281 microversion: 2.1 time: 0.150956 Aug 09 14:41:51.127035 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1314/2720] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:50 2022] GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:51.140827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4fa918a7-66e6-43fc-8ee9-9e03459de5d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:51.143879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4fa918a7-66e6-43fc-8ee9-9e03459de5d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:51.160653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fa918a7-66e6-43fc-8ee9-9e03459de5d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:51.161461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fa918a7-66e6-43fc-8ee9-9e03459de5d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:51.162180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fa918a7-66e6-43fc-8ee9-9e03459de5d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:51.163243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fa918a7-66e6-43fc-8ee9-9e03459de5d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:51.163891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fa918a7-66e6-43fc-8ee9-9e03459de5d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:51.165111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fa918a7-66e6-43fc-8ee9-9e03459de5d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:51.182292 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-5bf36119-99b2-41ea-a333-76f04c37207d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] HTTP exception thrown: Cannot 'migrate' instance 42339b60-9160-4247-8616-42ecd01fd14b while it is in vm_state suspended Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5bf36119-99b2-41ea-a333-76f04c37207d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Request method failure captured: Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b/action HTTP/1.1 Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 15 Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nHpGo64SK4o-fXzd-KrLvOaOX4W_jtEwwsOZkVM_l22-eRiGvhn-IGgiM04B5a2uigRtC9EKAe4TRYrzZQ6yRAWPeDjb3L7AYbaX-gc_8l0nHC2-Kp6akWXGKtPJV1XiDtcwXUbmyhPZsb_DS6g9eSOpYKlT9Valr_UFJQ1BnvA4lY Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 097f5ab20186492e86c8f05e6db3c665 Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_097f5ab20186492e86c8f05e6db3c665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 097f5ab20186492e86c8f05e6db3c665 Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersAdminNegativeTestJSON-57299721-project-admin Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e58ca45ec9914ebfb1a9793400c9b024 Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-57299721-project-admin Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: {"migrate": {}} Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: exception: Cannot 'migrate' instance 42339b60-9160-4247-8616-42ecd01fd14b while it is in vm_state suspended Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '42339b60-9160-4247-8616-42ecd01fd14b', 'body': {'migrate': {}}} Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 42339b60-9160-4247-8616-42ecd01fd14b in vm_state suspended. Cannot resize while the instance is in this state. Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:51.184784 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 42339b60-9160-4247-8616-42ecd01fd14b while it is in vm_state suspended Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 42339b60-9160-4247-8616-42ecd01fd14b while it is in vm_state suspended Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5bf36119-99b2-41ea-a333-76f04c37207d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Returning 409 to user: Cannot 'migrate' instance 42339b60-9160-4247-8616-42ecd01fd14b while it is in vm_state suspended {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5bf36119-99b2-41ea-a333-76f04c37207d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b/action" status: 409 len: 148 microversion: 2.1 time: 0.178990 Aug 09 14:41:51.194149 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1407/2721] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:41:51 2022] POST /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b/action => generated 148 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:41:51.200438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-716ae321-6b7c-4963-a0a1-04c69add320a tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] Action: 'create', calling method: .version_select at 0x7f41dd830d30>, body: {"pool": null} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:52.042210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4fa918a7-66e6-43fc-8ee9-9e03459de5d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:52.062260 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4fa918a7-66e6-43fc-8ee9-9e03459de5d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1308 microversion: 2.1 time: 0.930497 Aug 09 14:41:52.070424 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1315/2722] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:51 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1308 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:52.085548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85917f0d-46f2-4b0c-829a-e802800a4b9a tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85917f0d-46f2-4b0c-829a-e802800a4b9a tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Request method failure captured: Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5/action HTTP/1.1 Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 39 Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHpGo64SK4o-fXzd-KrLvOaOX4W_jtEwwsOZkVM_l22-eRiGvhn-IGgiM04B5a2uigRtC9EKAe4TRYrzZQ6yRAWPeDjb3L7AYbaX-gc_8l0nHC2-Kp6akWXGKtPJV1XiDtcwXUbmyhPZsb_DS6g9eSOpYKlT9Valr_UFJQ1BnvA4lY Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 097f5ab20186492e86c8f05e6db3c665 Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_097f5ab20186492e86c8f05e6db3c665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 097f5ab20186492e86c8f05e6db3c665 Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersAdminNegativeTestJSON-57299721-project-admin Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e58ca45ec9914ebfb1a9793400c9b024 Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-57299721-project-admin Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: {"os-resetState": {"state": "invalid"}} Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'invalid' Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:41:52.096561 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:41:52.102521 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 09 14:41:52.102521 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.102521 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:52.102521 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.102521 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:52.102521 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:52.102521 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:52.102521 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:41:52.102521 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:41:52.102521 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 09 14:41:52.102521 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.102521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85917f0d-46f2-4b0c-829a-e802800a4b9a tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:52.106145 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-85917f0d-46f2-4b0c-829a-e802800a4b9a tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5/action" status: 400 len: 144 microversion: 2.1 time: 0.034174 Aug 09 14:41:52.108153 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1316/2723] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:41:52 2022] POST /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5/action => generated 144 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:41:52.121052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13da046e-7d9d-46a3-8171-b6226d18e7bc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:52.121983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-13da046e-7d9d-46a3-8171-b6226d18e7bc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:52.134403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13da046e-7d9d-46a3-8171-b6226d18e7bc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:52.134995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13da046e-7d9d-46a3-8171-b6226d18e7bc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:52.135536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13da046e-7d9d-46a3-8171-b6226d18e7bc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:52.137713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13da046e-7d9d-46a3-8171-b6226d18e7bc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:52.139388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13da046e-7d9d-46a3-8171-b6226d18e7bc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:52.139939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13da046e-7d9d-46a3-8171-b6226d18e7bc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:52.664281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-13da046e-7d9d-46a3-8171-b6226d18e7bc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:52.677364 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-13da046e-7d9d-46a3-8171-b6226d18e7bc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 200 len: 1489 microversion: 2.1 time: 0.565671 Aug 09 14:41:52.679979 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1317/2724] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:52 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 1489 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:52.704369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32e5c387-4e5f-4b85-8ee6-b0dc59ec6542 tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32e5c387-4e5f-4b85-8ee6-b0dc59ec6542 tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Request method failure captured: Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5/action HTTP/1.1 Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 31 Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHpGo64SK4o-fXzd-KrLvOaOX4W_jtEwwsOZkVM_l22-eRiGvhn-IGgiM04B5a2uigRtC9EKAe4TRYrzZQ6yRAWPeDjb3L7AYbaX-gc_8l0nHC2-Kp6akWXGKtPJV1XiDtcwXUbmyhPZsb_DS6g9eSOpYKlT9Valr_UFJQ1BnvA4lY Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 097f5ab20186492e86c8f05e6db3c665 Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_097f5ab20186492e86c8f05e6db3c665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 097f5ab20186492e86c8f05e6db3c665 Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersAdminNegativeTestJSON-57299721-project-admin Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e58ca45ec9914ebfb1a9793400c9b024 Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-57299721-project-admin Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: {"os-resetState": {"state": 1}} Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5', 'body': {'os-resetState': {'state': 1}}} Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 1 Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 09 14:41:52.710279 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.715553 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:52.715553 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.715553 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:52.715553 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:52.715553 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:52.715553 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:41:52.715553 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:41:52.715553 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 09 14:41:52.715553 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:52.719213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32e5c387-4e5f-4b85-8ee6-b0dc59ec6542 tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:52.720478 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32e5c387-4e5f-4b85-8ee6-b0dc59ec6542 tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5/action" status: 400 len: 120 microversion: 2.1 time: 0.023708 Aug 09 14:41:52.721768 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1318/2725] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:41:52 2022] POST /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5/action => generated 120 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:41:52.729532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0c53762-fa11-4690-b3f2-9b2ed4820ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:52.733110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0c53762-fa11-4690-b3f2-9b2ed4820ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:52.752190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c53762-fa11-4690-b3f2-9b2ed4820ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:52.753068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c53762-fa11-4690-b3f2-9b2ed4820ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:52.753877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c53762-fa11-4690-b3f2-9b2ed4820ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:52.755655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c53762-fa11-4690-b3f2-9b2ed4820ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:52.756411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c53762-fa11-4690-b3f2-9b2ed4820ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:52.757153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c53762-fa11-4690-b3f2-9b2ed4820ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:52.902535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0c53762-fa11-4690-b3f2-9b2ed4820ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:52.926591 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0c53762-fa11-4690-b3f2-9b2ed4820ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 200 len: 1281 microversion: 2.1 time: 0.203061 Aug 09 14:41:52.927699 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1319/2726] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:52 2022] GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 1281 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:52.948484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dfdcb188-4de9-401b-9803-5625d317d9eb tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:52.950486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dfdcb188-4de9-401b-9803-5625d317d9eb tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:52.958410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfdcb188-4de9-401b-9803-5625d317d9eb tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:52.959234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfdcb188-4de9-401b-9803-5625d317d9eb tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:52.959702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfdcb188-4de9-401b-9803-5625d317d9eb tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:52.961037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfdcb188-4de9-401b-9803-5625d317d9eb tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:52.961636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfdcb188-4de9-401b-9803-5625d317d9eb tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:52.962192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfdcb188-4de9-401b-9803-5625d317d9eb tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:53.049922 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dfdcb188-4de9-401b-9803-5625d317d9eb tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "POST /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34/action" status: 202 len: 0 microversion: 2.1 time: 0.108180 Aug 09 14:41:53.066712 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1320/2727] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:41:52 2022] POST /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:41:53.066712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd127a57-34f4-4cb0-b0bb-363b569e2f7d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:53.066712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd127a57-34f4-4cb0-b0bb-363b569e2f7d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Failed to fetch instance by id 999 {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 14:41:53.066712 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-fd127a57-34f4-4cb0-b0bb-363b569e2f7d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd127a57-34f4-4cb0-b0bb-363b569e2f7d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Request method failure captured: Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 37 Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHpGo64SK4o-fXzd-KrLvOaOX4W_jtEwwsOZkVM_l22-eRiGvhn-IGgiM04B5a2uigRtC9EKAe4TRYrzZQ6yRAWPeDjb3L7AYbaX-gc_8l0nHC2-Kp6akWXGKtPJV1XiDtcwXUbmyhPZsb_DS6g9eSOpYKlT9Valr_UFJQ1BnvA4lY Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 097f5ab20186492e86c8f05e6db3c665 Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_097f5ab20186492e86c8f05e6db3c665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/097f5ab20186492e86c8f05e6db3c665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 097f5ab20186492e86c8f05e6db3c665 Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-57299721 Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersAdminNegativeTestJSON-57299721-project-admin Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e58ca45ec9914ebfb1a9793400c9b024 Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-57299721-project-admin Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: {"os-resetState": {"state": "error"}} Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 999 could not be found. Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:41:53.078734 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:41:53.083615 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:41:53.083615 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 09 14:41:53.083615 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:41:53.084739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd127a57-34f4-4cb0-b0bb-363b569e2f7d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:41:53.085606 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd127a57-34f4-4cb0-b0bb-363b569e2f7d tempest-ServersAdminNegativeTestJSON-57299721 tempest-ServersAdminNegativeTestJSON-57299721-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.027826 Aug 09 14:41:53.086248 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1321/2728] 10.222.0.50 () {60 vars in 1179 bytes} [Tue Aug 9 14:41:53 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:41:53.094879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b568e71-6967-460c-bc41-502c6ca32761 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:53.095625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b568e71-6967-460c-bc41-502c6ca32761 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:53.115585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b568e71-6967-460c-bc41-502c6ca32761 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:53.117376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b568e71-6967-460c-bc41-502c6ca32761 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:53.118332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b568e71-6967-460c-bc41-502c6ca32761 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:53.123769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b568e71-6967-460c-bc41-502c6ca32761 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:53.126079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b568e71-6967-460c-bc41-502c6ca32761 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:53.127989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b568e71-6967-460c-bc41-502c6ca32761 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:53.664389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2b568e71-6967-460c-bc41-502c6ca32761 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:53.678067 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b568e71-6967-460c-bc41-502c6ca32761 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 200 len: 1494 microversion: 2.1 time: 0.589867 Aug 09 14:41:53.680034 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1322/2729] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:53 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 1494 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:53.687706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8de4f04e-9a71-4977-8719-0304c7fdf22d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:53.688596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8de4f04e-9a71-4977-8719-0304c7fdf22d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:53.699117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8de4f04e-9a71-4977-8719-0304c7fdf22d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:53.699949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8de4f04e-9a71-4977-8719-0304c7fdf22d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:53.700756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8de4f04e-9a71-4977-8719-0304c7fdf22d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:53.701725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8de4f04e-9a71-4977-8719-0304c7fdf22d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:53.703375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8de4f04e-9a71-4977-8719-0304c7fdf22d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:53.704058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8de4f04e-9a71-4977-8719-0304c7fdf22d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:53.967025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8de4f04e-9a71-4977-8719-0304c7fdf22d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:53.987818 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8de4f04e-9a71-4977-8719-0304c7fdf22d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1308 microversion: 2.1 time: 0.299955 Aug 09 14:41:53.989825 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1323/2730] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:53 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:54.008018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb37262c-f38b-4c25-9d36-7a1ce50a5728 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:54.009779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bb37262c-f38b-4c25-9d36-7a1ce50a5728 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:54.029498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb37262c-f38b-4c25-9d36-7a1ce50a5728 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:54.030934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb37262c-f38b-4c25-9d36-7a1ce50a5728 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:54.031760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb37262c-f38b-4c25-9d36-7a1ce50a5728 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:54.033718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb37262c-f38b-4c25-9d36-7a1ce50a5728 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:54.036815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb37262c-f38b-4c25-9d36-7a1ce50a5728 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:54.038243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb37262c-f38b-4c25-9d36-7a1ce50a5728 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:54.189868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bb37262c-f38b-4c25-9d36-7a1ce50a5728 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:41:54.317333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:54.378380 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb37262c-f38b-4c25-9d36-7a1ce50a5728 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "DELETE /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 204 len: 0 microversion: 2.1 time: 0.385776 Aug 09 14:41:54.379024 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1324/2731] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:41:53 2022] DELETE /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:41:54.384670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4c65138-54cb-4d46-94b5-bb5feb3a21a9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:54.387274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4c65138-54cb-4d46-94b5-bb5feb3a21a9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:54.406758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c65138-54cb-4d46-94b5-bb5feb3a21a9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:54.412933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c65138-54cb-4d46-94b5-bb5feb3a21a9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:54.413489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c65138-54cb-4d46-94b5-bb5feb3a21a9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:54.414249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c65138-54cb-4d46-94b5-bb5feb3a21a9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:54.414729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c65138-54cb-4d46-94b5-bb5feb3a21a9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:54.415229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c65138-54cb-4d46-94b5-bb5feb3a21a9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:54.973302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4c65138-54cb-4d46-94b5-bb5feb3a21a9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:54.983009 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4c65138-54cb-4d46-94b5-bb5feb3a21a9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 200 len: 1323 microversion: 2.1 time: 0.602697 Aug 09 14:41:54.992587 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1325/2732] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:54 2022] GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 1323 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:54.999109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3e2cd041-f947-432f-be35-94e10f16bb21 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:54.999722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3e2cd041-f947-432f-be35-94e10f16bb21 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:55.008230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e2cd041-f947-432f-be35-94e10f16bb21 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:55.009008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e2cd041-f947-432f-be35-94e10f16bb21 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:55.009633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e2cd041-f947-432f-be35-94e10f16bb21 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:55.011036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e2cd041-f947-432f-be35-94e10f16bb21 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:55.011683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e2cd041-f947-432f-be35-94e10f16bb21 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:55.012289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e2cd041-f947-432f-be35-94e10f16bb21 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:55.192336 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-716ae321-6b7c-4963-a0a1-04c69add320a tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.002738 Aug 09 14:41:55.193002 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1408/2733] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 9 14:41:51 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:55.203766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-50bcc541-ab75-4c17-95fa-7c0f47bab0a7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:55.204374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-50bcc541-ab75-4c17-95fa-7c0f47bab0a7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:55.216371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50bcc541-ab75-4c17-95fa-7c0f47bab0a7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:55.216844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50bcc541-ab75-4c17-95fa-7c0f47bab0a7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:55.217279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50bcc541-ab75-4c17-95fa-7c0f47bab0a7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:55.217971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50bcc541-ab75-4c17-95fa-7c0f47bab0a7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:55.218423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50bcc541-ab75-4c17-95fa-7c0f47bab0a7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:55.218839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50bcc541-ab75-4c17-95fa-7c0f47bab0a7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:55.229608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3e2cd041-f947-432f-be35-94e10f16bb21 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:55.242508 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3e2cd041-f947-432f-be35-94e10f16bb21 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 200 len: 1468 microversion: 2.1 time: 0.247325 Aug 09 14:41:55.258778 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1326/2734] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:54 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 1468 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:55.266392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ad7cd047-2f92-4216-a5fe-4500143206f5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:55.267360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ad7cd047-2f92-4216-a5fe-4500143206f5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:55.279966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad7cd047-2f92-4216-a5fe-4500143206f5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:55.280492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad7cd047-2f92-4216-a5fe-4500143206f5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:55.280924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad7cd047-2f92-4216-a5fe-4500143206f5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:55.283628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad7cd047-2f92-4216-a5fe-4500143206f5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:55.287339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad7cd047-2f92-4216-a5fe-4500143206f5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:55.288313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad7cd047-2f92-4216-a5fe-4500143206f5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:55.752403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-50bcc541-ab75-4c17-95fa-7c0f47bab0a7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:55.759870 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50bcc541-ab75-4c17-95fa-7c0f47bab0a7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 200 len: 1474 microversion: 2.1 time: 0.565841 Aug 09 14:41:55.767135 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1409/2735] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:55 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 1474 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:55.773466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-83f8306a-f59a-4248-b355-fbe2fe840fe5 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] Calling method '.version_select at 0x7f41dd78ae50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:56.089709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:56.127315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=14 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:56.135167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ad7cd047-2f92-4216-a5fe-4500143206f5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:56.152728 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ad7cd047-2f92-4216-a5fe-4500143206f5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1308 microversion: 2.1 time: 0.891503 Aug 09 14:41:56.170094 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1327/2736] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:55 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1308 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:56.181502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-900768b5-a8c9-46b6-8322-69b58019f5f2 req-94a97729-6d84-41dd-b471-cdb627fca9ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3076ab8-1d52-4251-b6df-e16f82ff0a42", "tag": "19e764c7-5d3a-4562-8043-e5dac6bcd9f3"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:56.206715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-900768b5-a8c9-46b6-8322-69b58019f5f2 req-94a97729-6d84-41dd-b471-cdb627fca9ba service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:56.207311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-900768b5-a8c9-46b6-8322-69b58019f5f2 req-94a97729-6d84-41dd-b471-cdb627fca9ba service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:56.207776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-900768b5-a8c9-46b6-8322-69b58019f5f2 req-94a97729-6d84-41dd-b471-cdb627fca9ba service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:56.241102 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-900768b5-a8c9-46b6-8322-69b58019f5f2 req-94a97729-6d84-41dd-b471-cdb627fca9ba service nova] Creating event network-changed:19e764c7-5d3a-4562-8043-e5dac6bcd9f3 for instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 on n-h2-844626-8 Aug 09 14:41:56.267966 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-900768b5-a8c9-46b6-8322-69b58019f5f2 req-94a97729-6d84-41dd-b471-cdb627fca9ba service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089766 Aug 09 14:41:56.268678 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1328/2737] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:56.284931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ae429efb-5c3f-48fa-86b6-ff5ee2478899 req-d0336de1-1bfb-4ab3-b547-ebc8e226ef34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39095b44-f6d1-4065-a3cb-d6c051168846", "name": "network-vif-plugged", "status": "completed", "tag": "31cc8b77-0b03-4929-870b-00a100a52491"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:56.314359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ae429efb-5c3f-48fa-86b6-ff5ee2478899 req-d0336de1-1bfb-4ab3-b547-ebc8e226ef34 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:56.314935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ae429efb-5c3f-48fa-86b6-ff5ee2478899 req-d0336de1-1bfb-4ab3-b547-ebc8e226ef34 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:56.315400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ae429efb-5c3f-48fa-86b6-ff5ee2478899 req-d0336de1-1bfb-4ab3-b547-ebc8e226ef34 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:56.358318 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-83f8306a-f59a-4248-b355-fbe2fe840fe5 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips/5112846d-da61-4702-9487-22f5ad322f0a" status: 200 len: 141 microversion: 2.1 time: 0.594139 Aug 09 14:41:56.359038 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1410/2738] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 9 14:41:55 2022] GET /compute/v2.1/os-floating-ips/5112846d-da61-4702-9487-22f5ad322f0a => generated 141 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:56.367269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-71d3c18e-3e9f-4a33-8341-fb14a1308d79 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-368645733"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:56.369877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-71d3c18e-3e9f-4a33-8341-fb14a1308d79 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:56.371368 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ae429efb-5c3f-48fa-86b6-ff5ee2478899 req-d0336de1-1bfb-4ab3-b547-ebc8e226ef34 service nova] Creating event network-vif-plugged:31cc8b77-0b03-4929-870b-00a100a52491 for instance 39095b44-f6d1-4065-a3cb-d6c051168846 on n-h2-844626-8 Aug 09 14:41:56.391413 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ae429efb-5c3f-48fa-86b6-ff5ee2478899 req-d0336de1-1bfb-4ab3-b547-ebc8e226ef34 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104890 Aug 09 14:41:56.396824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71d3c18e-3e9f-4a33-8341-fb14a1308d79 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:56.397421 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1329/2739] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:56.401494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71d3c18e-3e9f-4a33-8341-fb14a1308d79 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:56.402192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71d3c18e-3e9f-4a33-8341-fb14a1308d79 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:56.407159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71d3c18e-3e9f-4a33-8341-fb14a1308d79 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:56.408463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71d3c18e-3e9f-4a33-8341-fb14a1308d79 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:56.409587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71d3c18e-3e9f-4a33-8341-fb14a1308d79 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:56.420038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44262e9a-fe78-4e4f-b306-80bba4437ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:56.421242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44262e9a-fe78-4e4f-b306-80bba4437ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:56.440398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44262e9a-fe78-4e4f-b306-80bba4437ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:56.441371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44262e9a-fe78-4e4f-b306-80bba4437ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:56.447609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44262e9a-fe78-4e4f-b306-80bba4437ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:56.450665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44262e9a-fe78-4e4f-b306-80bba4437ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:56.451586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44262e9a-fe78-4e4f-b306-80bba4437ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:56.458068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44262e9a-fe78-4e4f-b306-80bba4437ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:56.756491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:56.918444 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-71d3c18e-3e9f-4a33-8341-fb14a1308d79 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "POST /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34/action" status: 202 len: 0 microversion: 2.1 time: 0.545486 Aug 09 14:41:56.930855 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1411/2740] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:41:56 2022] POST /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 14:41:56.938353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ac8668c-2de3-4dd7-a2b0-2306beed1d1a tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:56.945149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ac8668c-2de3-4dd7-a2b0-2306beed1d1a tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:56.961301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ac8668c-2de3-4dd7-a2b0-2306beed1d1a tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:56.962146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ac8668c-2de3-4dd7-a2b0-2306beed1d1a tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:56.963106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ac8668c-2de3-4dd7-a2b0-2306beed1d1a tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:56.964346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ac8668c-2de3-4dd7-a2b0-2306beed1d1a tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:56.965453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ac8668c-2de3-4dd7-a2b0-2306beed1d1a tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:56.969231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ac8668c-2de3-4dd7-a2b0-2306beed1d1a tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:56.976289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:57.827895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-44262e9a-fe78-4e4f-b306-80bba4437ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:57.839118 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44262e9a-fe78-4e4f-b306-80bba4437ee2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 200 len: 1323 microversion: 2.1 time: 1.440039 Aug 09 14:41:57.842208 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1330/2741] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:56 2022] GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 1323 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:57.852655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7476fad0-12b4-40af-b06f-aec42ccf4a06 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] Calling method '.version_select at 0x7f41ddfaa0d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:57.858049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ac8668c-2de3-4dd7-a2b0-2306beed1d1a tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:57.873844 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ac8668c-2de3-4dd7-a2b0-2306beed1d1a tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 200 len: 1468 microversion: 2.1 time: 0.940667 Aug 09 14:41:57.874459 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1412/2742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:56 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 1468 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:57.886049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3dac62b1-d430-47c8-a2e2-29c645b4a868 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd6eff70>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:57.981127 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3dac62b1-d430-47c8-a2e2-29c645b4a868 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.104662 Aug 09 14:41:57.987882 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1413/2743] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:41:57 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:58.006109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07785355-2c1a-4101-be31-e4f7ba7724ff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:58.009722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07785355-2c1a-4101-be31-e4f7ba7724ff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:58.026992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07785355-2c1a-4101-be31-e4f7ba7724ff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:58.027511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07785355-2c1a-4101-be31-e4f7ba7724ff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:58.029948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07785355-2c1a-4101-be31-e4f7ba7724ff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:58.031043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07785355-2c1a-4101-be31-e4f7ba7724ff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:58.031739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07785355-2c1a-4101-be31-e4f7ba7724ff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:58.032197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07785355-2c1a-4101-be31-e4f7ba7724ff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:58.585006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07785355-2c1a-4101-be31-e4f7ba7724ff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:58.602331 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07785355-2c1a-4101-be31-e4f7ba7724ff tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1308 microversion: 2.1 time: 0.612719 Aug 09 14:41:58.602933 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1414/2744] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:57 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1308 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:41:58.622934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ad084d34-3d3e-4af4-9128-d9268309820d req-ddcc35e3-caa2-4a35-9e89-8355796e8375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6087e9ac-3786-4f17-8643-e76c04805347", "tag": "e24c9d90-e1c7-4877-a50f-59327870c3a9"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:58.651482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ad084d34-3d3e-4af4-9128-d9268309820d req-ddcc35e3-caa2-4a35-9e89-8355796e8375 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:58.651965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ad084d34-3d3e-4af4-9128-d9268309820d req-ddcc35e3-caa2-4a35-9e89-8355796e8375 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:58.652390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ad084d34-3d3e-4af4-9128-d9268309820d req-ddcc35e3-caa2-4a35-9e89-8355796e8375 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:58.669234 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ad084d34-3d3e-4af4-9128-d9268309820d req-ddcc35e3-caa2-4a35-9e89-8355796e8375 service nova] Creating event network-changed:e24c9d90-e1c7-4877-a50f-59327870c3a9 for instance 6087e9ac-3786-4f17-8643-e76c04805347 on n-h2-844626-8 Aug 09 14:41:58.681113 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ad084d34-3d3e-4af4-9128-d9268309820d req-ddcc35e3-caa2-4a35-9e89-8355796e8375 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063034 Aug 09 14:41:58.682047 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1415/2745] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:58.690342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-4a05d557-13e8-4c60-b8d1-749d9ed8c9d0 req-332bbc74-3b38-4a21-8b7e-370157b580dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243e6add-76f2-406c-b10d-5d261cdd308a", "tag": "fc869650-5ef2-45a9-ae8d-d8e838fcaecb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:41:58.705769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4a05d557-13e8-4c60-b8d1-749d9ed8c9d0 req-332bbc74-3b38-4a21-8b7e-370157b580dc service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:58.705769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4a05d557-13e8-4c60-b8d1-749d9ed8c9d0 req-332bbc74-3b38-4a21-8b7e-370157b580dc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:58.706012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4a05d557-13e8-4c60-b8d1-749d9ed8c9d0 req-332bbc74-3b38-4a21-8b7e-370157b580dc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:58.748029 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-4a05d557-13e8-4c60-b8d1-749d9ed8c9d0 req-332bbc74-3b38-4a21-8b7e-370157b580dc service nova] Creating event network-changed:fc869650-5ef2-45a9-ae8d-d8e838fcaecb for instance 243e6add-76f2-406c-b10d-5d261cdd308a on n-h1-844626-8 Aug 09 14:41:58.760705 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-4a05d557-13e8-4c60-b8d1-749d9ed8c9d0 req-332bbc74-3b38-4a21-8b7e-370157b580dc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077135 Aug 09 14:41:58.763536 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1416/2746] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:41:58.862928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f197ddd4-1c05-4a25-9a7d-a9a4eec8c268 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:58.864373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f197ddd4-1c05-4a25-9a7d-a9a4eec8c268 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:58.868517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=12 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:41:58.882693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f197ddd4-1c05-4a25-9a7d-a9a4eec8c268 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:58.885078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f197ddd4-1c05-4a25-9a7d-a9a4eec8c268 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:58.886438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f197ddd4-1c05-4a25-9a7d-a9a4eec8c268 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:58.889472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f197ddd4-1c05-4a25-9a7d-a9a4eec8c268 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:58.890146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f197ddd4-1c05-4a25-9a7d-a9a4eec8c268 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:58.892439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f197ddd4-1c05-4a25-9a7d-a9a4eec8c268 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:59.350084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f197ddd4-1c05-4a25-9a7d-a9a4eec8c268 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:59.358340 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f197ddd4-1c05-4a25-9a7d-a9a4eec8c268 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 200 len: 1323 microversion: 2.1 time: 0.500339 Aug 09 14:41:59.358965 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1417/2747] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:58 2022] GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 1323 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:41:59.379419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:41:59.382445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:41:59.391606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:59.392602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:59.393339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:59.394190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:59.394769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:59.395530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:59.437911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:41:59.438400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:41:59.438926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:41:59.439666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lazy-loading 'fault' on Instance uuid 42339b60-9160-4247-8616-42ecd01fd14b {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:41:59.604356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:41:59.612315 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2fa0c77f-4717-46f5-a706-dc0845fded65 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 200 len: 1312 microversion: 2.1 time: 0.241351 Aug 09 14:41:59.618094 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1418/2748] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:41:59 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:00.270724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-8135485", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "c0f37d1b-2427-4789-90ef-2da67d3617fc"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:00.352818 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7476fad0-12b4-40af-b06f-aec42ccf4a06 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/5112846d-da61-4702-9487-22f5ad322f0a" status: 202 len: 0 microversion: 2.1 time: 2.508328 Aug 09 14:42:00.353428 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1331/2749] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:41:57 2022] DELETE /compute/v2.1/os-floating-ips/5112846d-da61-4702-9487-22f5ad322f0a => generated 0 bytes in 2510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:42:00.362864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9223e48e-6648-4684-9561-b05633dd00a1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41e758aa60>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:00.428007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] validate_networks() for [('c0f37d1b-2427-4789-90ef-2da67d3617fc', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:42:00.462255 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9223e48e-6648-4684-9561-b05633dd00a1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.107549 Aug 09 14:42:00.469609 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1332/2750] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:00 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:00.487513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0e97f7f2-0b31-46fd-b9df-e5b9d4e21759 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:00.488100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0e97f7f2-0b31-46fd-b9df-e5b9d4e21759 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:00.520728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e97f7f2-0b31-46fd-b9df-e5b9d4e21759 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:00.521074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e97f7f2-0b31-46fd-b9df-e5b9d4e21759 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:00.524560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e97f7f2-0b31-46fd-b9df-e5b9d4e21759 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:00.531307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e97f7f2-0b31-46fd-b9df-e5b9d4e21759 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:00.531939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e97f7f2-0b31-46fd-b9df-e5b9d4e21759 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:00.532581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e97f7f2-0b31-46fd-b9df-e5b9d4e21759 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:00.875960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0e97f7f2-0b31-46fd-b9df-e5b9d4e21759 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:00.885612 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0e97f7f2-0b31-46fd-b9df-e5b9d4e21759 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1487 microversion: 2.1 time: 0.414535 Aug 09 14:42:00.886901 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1333/2751] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:00 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1487 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:00.892833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8253506f-2bd3-4ff1-bdbb-2e4a275916a5 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] Calling method '.version_select at 0x7f41e758aaf0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:01.345769 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8253506f-2bd3-4ff1-bdbb-2e4a275916a5 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.457491 Aug 09 14:42:01.346547 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1334/2752] 10.222.0.50 () {58 vars in 1164 bytes} [Tue Aug 9 14:42:00 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:01.356598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8e61ba6-cfce-4f86-9aa4-7bee4c524b28 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:01.357309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b8e61ba6-cfce-4f86-9aa4-7bee4c524b28 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:01.364368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e61ba6-cfce-4f86-9aa4-7bee4c524b28 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:01.372345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e61ba6-cfce-4f86-9aa4-7bee4c524b28 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:01.372869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e61ba6-cfce-4f86-9aa4-7bee4c524b28 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:01.374019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e61ba6-cfce-4f86-9aa4-7bee4c524b28 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:01.374897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e61ba6-cfce-4f86-9aa4-7bee4c524b28 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:01.375593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e61ba6-cfce-4f86-9aa4-7bee4c524b28 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:02.068383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:42:02.068957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:42:02.069682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:42:02.069682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:42:02.070076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:42:02.093488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:02.093975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:02.094415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:02.095164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:02.095616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:02.096038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:02.176801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Getting quotas for project 8e0b1ade12f4484b83dd4bce24fd7859. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:02.188443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Getting quotas for user e05667f82c43484bb250236739c08959 and project 8e0b1ade12f4484b83dd4bce24fd7859. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:02.276303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:42:02.278662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:42:02.492633 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9201ed58-1365-450f-abe8-8afabda23bd3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.861894 Aug 09 14:42:02.495659 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1419/2753] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:41:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:42:02.524386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fd76da21-6c2e-467a-b63b-d6ba2fd80973 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:02.526261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fd76da21-6c2e-467a-b63b-d6ba2fd80973 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 42339b60-9160-4247-8616-42ecd01fd14b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:02.537116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd76da21-6c2e-467a-b63b-d6ba2fd80973 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:02.539668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd76da21-6c2e-467a-b63b-d6ba2fd80973 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:02.541435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd76da21-6c2e-467a-b63b-d6ba2fd80973 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:02.542337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd76da21-6c2e-467a-b63b-d6ba2fd80973 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:02.549833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd76da21-6c2e-467a-b63b-d6ba2fd80973 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:02.550283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd76da21-6c2e-467a-b63b-d6ba2fd80973 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:02.577692 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-fd76da21-6c2e-467a-b63b-d6ba2fd80973 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] HTTP exception thrown: Instance 42339b60-9160-4247-8616-42ecd01fd14b could not be found. Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fd76da21-6c2e-467a-b63b-d6ba2fd80973 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Request method failure captured: Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b HTTP/1.1 Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nHoRm34QgUR5g8Vosv42BV5Y3JkQumZSXF0U88WOL4dzVqu831g77fPwoilIO0dsojD8iCenQmvquN23-M40ikjP_hiNIgZ0Q4ZggLdSPeYaoMlbT8VAAJDK4cEeM3pwL_j-Q0AiUMVTIdI8AW4Y8-d9HygrmxKMDXe9fJiX5y9aYE Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: decdc7f4b385405dbd589e276b8bd7be Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-638048335 Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_decdc7f4b385405dbd589e276b8bd7be", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/decdc7f4b385405dbd589e276b8bd7be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/decdc7f4b385405dbd589e276b8bd7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/decdc7f4b385405dbd589e276b8bd7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-638048335 Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: decdc7f4b385405dbd589e276b8bd7be Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-638048335 Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersAdminNegativeTestJSON-638048335-project Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: c1592bdd654b42e99c97a9ae2414df80 Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-638048335-project Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 42339b60-9160-4247-8616-42ecd01fd14b could not be found. Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '42339b60-9160-4247-8616-42ecd01fd14b'} Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42339b60-9160-4247-8616-42ecd01fd14b could not be found. Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42339b60-9160-4247-8616-42ecd01fd14b could not be found. Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:02.581609 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:02.586337 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:02.586337 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:02.586337 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:02.586337 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:02.586337 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:02.586337 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:02.586337 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42339b60-9160-4247-8616-42ecd01fd14b could not be found. Aug 09 14:42:02.586337 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:02.588634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fd76da21-6c2e-467a-b63b-d6ba2fd80973 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Returning 404 to user: Instance 42339b60-9160-4247-8616-42ecd01fd14b could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:02.596689 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fd76da21-6c2e-467a-b63b-d6ba2fd80973 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b" status: 404 len: 111 microversion: 2.1 time: 0.086835 Aug 09 14:42:02.621675 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1420/2754] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:02 2022] GET /compute/v2.1/servers/42339b60-9160-4247-8616-42ecd01fd14b => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:42:02.641020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-915485a8-dd4d-4c52-8ef6-9fcc931f8b57 req-7663aa2f-8f3a-40d2-86b1-f0d3d0e9d245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42339b60-9160-4247-8616-42ecd01fd14b", "name": "network-vif-deleted", "tag": "029caebb-3d82-4f57-a3bf-db3e9d7ebf39"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:02.668842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8e61ba6-cfce-4f86-9aa4-7bee4c524b28 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:02.689321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-915485a8-dd4d-4c52-8ef6-9fcc931f8b57 req-7663aa2f-8f3a-40d2-86b1-f0d3d0e9d245 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:02.690428 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8e61ba6-cfce-4f86-9aa4-7bee4c524b28 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 200 len: 1323 microversion: 2.1 time: 1.342312 Aug 09 14:42:02.694677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-915485a8-dd4d-4c52-8ef6-9fcc931f8b57 req-7663aa2f-8f3a-40d2-86b1-f0d3d0e9d245 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:02.694913 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1335/2755] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:01 2022] GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 1323 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:02.699594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-915485a8-dd4d-4c52-8ef6-9fcc931f8b57 req-7663aa2f-8f3a-40d2-86b1-f0d3d0e9d245 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:02.701849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57630726-f081-4a3a-9e27-21edeb19a1d8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:02.702483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57630726-f081-4a3a-9e27-21edeb19a1d8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:02.747227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57630726-f081-4a3a-9e27-21edeb19a1d8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:02.747737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57630726-f081-4a3a-9e27-21edeb19a1d8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:02.748181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57630726-f081-4a3a-9e27-21edeb19a1d8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:02.748908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57630726-f081-4a3a-9e27-21edeb19a1d8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:02.758218 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-915485a8-dd4d-4c52-8ef6-9fcc931f8b57 req-7663aa2f-8f3a-40d2-86b1-f0d3d0e9d245 service nova] Creating event network-vif-deleted:029caebb-3d82-4f57-a3bf-db3e9d7ebf39 for instance 42339b60-9160-4247-8616-42ecd01fd14b on n-h1-844626-8 Aug 09 14:42:02.759950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57630726-f081-4a3a-9e27-21edeb19a1d8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:02.760410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57630726-f081-4a3a-9e27-21edeb19a1d8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:02.765723 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-915485a8-dd4d-4c52-8ef6-9fcc931f8b57 req-7663aa2f-8f3a-40d2-86b1-f0d3d0e9d245 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141712 Aug 09 14:42:02.766379 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1421/2756] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:02.782149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bbf52f56-59bf-4788-9070-3c486558a073 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] Calling method '.version_select at 0x7f41e7528700>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:03.312903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-57630726-f081-4a3a-9e27-21edeb19a1d8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:03.350392 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57630726-f081-4a3a-9e27-21edeb19a1d8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1488 microversion: 2.1 time: 0.651956 Aug 09 14:42:03.352782 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1336/2757] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:02 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1488 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:03.353545 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bbf52f56-59bf-4788-9070-3c486558a073 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] 10.222.0.50 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.585896 Aug 09 14:42:03.362794 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1422/2758] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 9 14:42:02 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:03.367555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b83257ad-b78f-47c4-a5b3-a9bd76026a90 req-bb441f32-f38c-4355-b092-004d2d60f044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3076ab8-1d52-4251-b6df-e16f82ff0a42", "name": "network-vif-plugged", "status": "completed", "tag": "19e764c7-5d3a-4562-8043-e5dac6bcd9f3"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:03.376388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e536e0e4-2df9-4b77-83bc-5bae5a0dacf3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41e75515e0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:03.387625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b83257ad-b78f-47c4-a5b3-a9bd76026a90 req-bb441f32-f38c-4355-b092-004d2d60f044 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:03.388114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b83257ad-b78f-47c4-a5b3-a9bd76026a90 req-bb441f32-f38c-4355-b092-004d2d60f044 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:03.388549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b83257ad-b78f-47c4-a5b3-a9bd76026a90 req-bb441f32-f38c-4355-b092-004d2d60f044 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:03.449728 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b83257ad-b78f-47c4-a5b3-a9bd76026a90 req-bb441f32-f38c-4355-b092-004d2d60f044 service nova] Creating event network-vif-plugged:19e764c7-5d3a-4562-8043-e5dac6bcd9f3 for instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 on n-h2-844626-8 Aug 09 14:42:03.465992 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e536e0e4-2df9-4b77-83bc-5bae5a0dacf3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.099952 Aug 09 14:42:03.466612 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1337/2759] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:03 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:03.467822 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b83257ad-b78f-47c4-a5b3-a9bd76026a90 req-bb441f32-f38c-4355-b092-004d2d60f044 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100902 Aug 09 14:42:03.471554 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1423/2760] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:03.478039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-65a88426-0a83-44d1-84d6-84f0978c45f5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:03.480907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dbf8b998-33f6-480e-8b7c-8200582cc590 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:03.481998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-65a88426-0a83-44d1-84d6-84f0978c45f5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:03.488261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dbf8b998-33f6-480e-8b7c-8200582cc590 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:03.507831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbf8b998-33f6-480e-8b7c-8200582cc590 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:03.513360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbf8b998-33f6-480e-8b7c-8200582cc590 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:03.515918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbf8b998-33f6-480e-8b7c-8200582cc590 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:03.517065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbf8b998-33f6-480e-8b7c-8200582cc590 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:03.517565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbf8b998-33f6-480e-8b7c-8200582cc590 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:03.518537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbf8b998-33f6-480e-8b7c-8200582cc590 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:03.534437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65a88426-0a83-44d1-84d6-84f0978c45f5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:03.535557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65a88426-0a83-44d1-84d6-84f0978c45f5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:03.536308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65a88426-0a83-44d1-84d6-84f0978c45f5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:03.539992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65a88426-0a83-44d1-84d6-84f0978c45f5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:03.541563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65a88426-0a83-44d1-84d6-84f0978c45f5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:03.542882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-65a88426-0a83-44d1-84d6-84f0978c45f5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:03.570455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dbf8b998-33f6-480e-8b7c-8200582cc590 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:42:03.729214 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dbf8b998-33f6-480e-8b7c-8200582cc590 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 204 len: 0 microversion: 2.1 time: 0.255670 Aug 09 14:42:03.729818 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1424/2761] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:42:03 2022] DELETE /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:03.740127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5de74410-bb25-4a7c-b213-95d6d199858d tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] Calling method '.version_select at 0x7f41dde60ee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:03.800434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-65a88426-0a83-44d1-84d6-84f0978c45f5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:03.811759 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-65a88426-0a83-44d1-84d6-84f0978c45f5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1226 microversion: 2.1 time: 0.342761 Aug 09 14:42:03.816075 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1338/2762] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:03 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1226 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:03.827468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1bea7c92-6795-4221-b714-1ef03f114edf tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:03.828432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1bea7c92-6795-4221-b714-1ef03f114edf tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:03.838158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bea7c92-6795-4221-b714-1ef03f114edf tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:03.841940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bea7c92-6795-4221-b714-1ef03f114edf tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:03.845853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bea7c92-6795-4221-b714-1ef03f114edf tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:03.848177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bea7c92-6795-4221-b714-1ef03f114edf tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:03.848952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bea7c92-6795-4221-b714-1ef03f114edf tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:03.849951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bea7c92-6795-4221-b714-1ef03f114edf tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:04.170233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1bea7c92-6795-4221-b714-1ef03f114edf tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:04.181686 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1bea7c92-6795-4221-b714-1ef03f114edf tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1487 microversion: 2.1 time: 0.361977 Aug 09 14:42:04.182556 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1339/2763] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:03 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1487 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:04.189537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d1a82ef0-5602-4f31-8866-fc03d5fa42d2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:04.191432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d1a82ef0-5602-4f31-8866-fc03d5fa42d2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:04.217026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1a82ef0-5602-4f31-8866-fc03d5fa42d2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:04.217776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1a82ef0-5602-4f31-8866-fc03d5fa42d2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:04.218442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1a82ef0-5602-4f31-8866-fc03d5fa42d2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:04.219370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1a82ef0-5602-4f31-8866-fc03d5fa42d2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:04.219829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1a82ef0-5602-4f31-8866-fc03d5fa42d2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:04.220457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1a82ef0-5602-4f31-8866-fc03d5fa42d2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:04.697153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d1a82ef0-5602-4f31-8866-fc03d5fa42d2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:04.719225 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d1a82ef0-5602-4f31-8866-fc03d5fa42d2 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 200 len: 1323 microversion: 2.1 time: 0.534624 Aug 09 14:42:04.727782 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1340/2764] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:04 2022] GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 1323 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:04.733589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4c586d5-6353-495b-8ed9-2e95ca2ecafb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:04.734202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4c586d5-6353-495b-8ed9-2e95ca2ecafb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:04.769119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c586d5-6353-495b-8ed9-2e95ca2ecafb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:04.773743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c586d5-6353-495b-8ed9-2e95ca2ecafb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:04.774284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c586d5-6353-495b-8ed9-2e95ca2ecafb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:04.775116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c586d5-6353-495b-8ed9-2e95ca2ecafb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:04.775585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c586d5-6353-495b-8ed9-2e95ca2ecafb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:04.776016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4c586d5-6353-495b-8ed9-2e95ca2ecafb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:05.305079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4c586d5-6353-495b-8ed9-2e95ca2ecafb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:05.318296 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4c586d5-6353-495b-8ed9-2e95ca2ecafb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1478 microversion: 2.1 time: 0.589105 Aug 09 14:42:05.320290 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1341/2765] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:04 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1478 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:05.325724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-74eb3fa2-2136-4186-aa63-781ba73ab28d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:05.326465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-74eb3fa2-2136-4186-aa63-781ba73ab28d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:05.334154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74eb3fa2-2136-4186-aa63-781ba73ab28d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:05.334937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74eb3fa2-2136-4186-aa63-781ba73ab28d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:05.335591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74eb3fa2-2136-4186-aa63-781ba73ab28d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:05.336850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74eb3fa2-2136-4186-aa63-781ba73ab28d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:05.337633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74eb3fa2-2136-4186-aa63-781ba73ab28d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:05.338597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-74eb3fa2-2136-4186-aa63-781ba73ab28d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:05.369940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-74eb3fa2-2136-4186-aa63-781ba73ab28d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:42:05.528976 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-74eb3fa2-2136-4186-aa63-781ba73ab28d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 204 len: 0 microversion: 2.1 time: 0.206759 Aug 09 14:42:05.533264 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1342/2766] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:42:05 2022] DELETE /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:05.537658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-abb246d0-7fac-42d4-80a1-39f1565f862b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41e75a68b0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:05.596905 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-abb246d0-7fac-42d4-80a1-39f1565f862b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.064815 Aug 09 14:42:05.597505 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1343/2767] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:05 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:05.605204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-decf0c6f-fde0-44c9-8a9e-63a7e0d373f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:05.605204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-decf0c6f-fde0-44c9-8a9e-63a7e0d373f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:05.615250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-decf0c6f-fde0-44c9-8a9e-63a7e0d373f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:05.615817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-decf0c6f-fde0-44c9-8a9e-63a7e0d373f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:05.622670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-decf0c6f-fde0-44c9-8a9e-63a7e0d373f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:05.623491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-decf0c6f-fde0-44c9-8a9e-63a7e0d373f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:05.623963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-decf0c6f-fde0-44c9-8a9e-63a7e0d373f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:05.627371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-decf0c6f-fde0-44c9-8a9e-63a7e0d373f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:05.644986 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5de74410-bb25-4a7c-b213-95d6d199858d tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/3fcd55f0-bdab-4dfc-8227-b5a23404b6c2" status: 202 len: 0 microversion: 2.1 time: 1.913124 Aug 09 14:42:05.646070 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1425/2768] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:42:03 2022] DELETE /compute/v2.1/os-floating-ips/3fcd55f0-bdab-4dfc-8227-b5a23404b6c2 => generated 0 bytes in 1916 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:42:05.651728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4db6eab4-88b2-4c14-b459-f5121d7cbcc8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:05.653119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4db6eab4-88b2-4c14-b459-f5121d7cbcc8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:05.666558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4db6eab4-88b2-4c14-b459-f5121d7cbcc8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:05.669204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4db6eab4-88b2-4c14-b459-f5121d7cbcc8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:05.669745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4db6eab4-88b2-4c14-b459-f5121d7cbcc8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:05.670558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4db6eab4-88b2-4c14-b459-f5121d7cbcc8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:05.671134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4db6eab4-88b2-4c14-b459-f5121d7cbcc8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:05.671779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4db6eab4-88b2-4c14-b459-f5121d7cbcc8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:05.716164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-decf0c6f-fde0-44c9-8a9e-63a7e0d373f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:05.728772 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-decf0c6f-fde0-44c9-8a9e-63a7e0d373f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1280 microversion: 2.1 time: 0.129511 Aug 09 14:42:05.729803 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1344/2769] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:05 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1280 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:05.734813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-a5711f69-6daf-46eb-81ce-35044a17dbae req-a1aa3cd0-5dcb-469b-85ff-11e8430bdceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e3bd4a-f659-481c-bdeb-dfd8b8642d34", "name": "network-vif-plugged", "status": "completed", "tag": "f1456a38-c035-49d9-bc56-a6e3427ec464"}, {"server_uuid": "243e6add-76f2-406c-b10d-5d261cdd308a", "name": "network-vif-plugged", "status": "completed", "tag": "fc869650-5ef2-45a9-ae8d-d8e838fcaecb"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:05.753141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a5711f69-6daf-46eb-81ce-35044a17dbae req-a1aa3cd0-5dcb-469b-85ff-11e8430bdceb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:05.754585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a5711f69-6daf-46eb-81ce-35044a17dbae req-a1aa3cd0-5dcb-469b-85ff-11e8430bdceb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:05.754585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a5711f69-6daf-46eb-81ce-35044a17dbae req-a1aa3cd0-5dcb-469b-85ff-11e8430bdceb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:05.778429 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-a5711f69-6daf-46eb-81ce-35044a17dbae req-a1aa3cd0-5dcb-469b-85ff-11e8430bdceb service nova] Creating event network-vif-plugged:f1456a38-c035-49d9-bc56-a6e3427ec464 for instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 on n-h1-844626-8 Aug 09 14:42:05.779649 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-a5711f69-6daf-46eb-81ce-35044a17dbae req-a1aa3cd0-5dcb-469b-85ff-11e8430bdceb service nova] Creating event network-vif-plugged:fc869650-5ef2-45a9-ae8d-d8e838fcaecb for instance 243e6add-76f2-406c-b10d-5d261cdd308a on n-h1-844626-8 Aug 09 14:42:05.788091 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-a5711f69-6daf-46eb-81ce-35044a17dbae req-a1aa3cd0-5dcb-469b-85ff-11e8430bdceb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056792 Aug 09 14:42:05.789265 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1345/2770] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:05.796512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3414446-d4be-4a90-9b66-1be85b94b027 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] Calling method '.version_select at 0x7f41e758aa60>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:06.189273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4db6eab4-88b2-4c14-b459-f5121d7cbcc8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:06.208615 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4db6eab4-88b2-4c14-b459-f5121d7cbcc8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1493 microversion: 2.1 time: 0.561095 Aug 09 14:42:06.226315 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1426/2771] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:05 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1493 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:06.253101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c9a85aa-8c1e-4fe0-a537-c9839898fe71 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:06.253863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c9a85aa-8c1e-4fe0-a537-c9839898fe71 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:06.288738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c9a85aa-8c1e-4fe0-a537-c9839898fe71 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:06.289588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c9a85aa-8c1e-4fe0-a537-c9839898fe71 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:06.290501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c9a85aa-8c1e-4fe0-a537-c9839898fe71 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:06.293593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c9a85aa-8c1e-4fe0-a537-c9839898fe71 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:06.294261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c9a85aa-8c1e-4fe0-a537-c9839898fe71 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:06.297334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c9a85aa-8c1e-4fe0-a537-c9839898fe71 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:06.898967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c9a85aa-8c1e-4fe0-a537-c9839898fe71 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:06.916118 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c9a85aa-8c1e-4fe0-a537-c9839898fe71 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 200 len: 1323 microversion: 2.1 time: 0.688587 Aug 09 14:42:06.917441 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1427/2772] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:06 2022] GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 1323 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:06.938087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a60ac39b-fc25-4b63-9a7c-a505c6753eeb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:06.940795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a60ac39b-fc25-4b63-9a7c-a505c6753eeb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:06.948983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a60ac39b-fc25-4b63-9a7c-a505c6753eeb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:06.950055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a60ac39b-fc25-4b63-9a7c-a505c6753eeb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:06.950645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a60ac39b-fc25-4b63-9a7c-a505c6753eeb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:06.951480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a60ac39b-fc25-4b63-9a7c-a505c6753eeb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:06.952035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a60ac39b-fc25-4b63-9a7c-a505c6753eeb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:06.952572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a60ac39b-fc25-4b63-9a7c-a505c6753eeb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:07.373369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a60ac39b-fc25-4b63-9a7c-a505c6753eeb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:07.388085 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a60ac39b-fc25-4b63-9a7c-a505c6753eeb tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1478 microversion: 2.1 time: 0.469084 Aug 09 14:42:07.390099 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1428/2773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:06 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1478 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:07.432270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b53a6155-4528-4d1b-9c09-034814ec92ec tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd666a60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:07.536368 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b53a6155-4528-4d1b-9c09-034814ec92ec tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.144617 Aug 09 14:42:07.544483 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1429/2774] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:07 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:07.548113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b64f793f-a233-4f08-8c96-ee6ad214e9dc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:07.549613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b64f793f-a233-4f08-8c96-ee6ad214e9dc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:07.563552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b64f793f-a233-4f08-8c96-ee6ad214e9dc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:07.564979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b64f793f-a233-4f08-8c96-ee6ad214e9dc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:07.565664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b64f793f-a233-4f08-8c96-ee6ad214e9dc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:07.568048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b64f793f-a233-4f08-8c96-ee6ad214e9dc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:07.568336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b64f793f-a233-4f08-8c96-ee6ad214e9dc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:07.571547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b64f793f-a233-4f08-8c96-ee6ad214e9dc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:08.509475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b64f793f-a233-4f08-8c96-ee6ad214e9dc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:08.534877 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b64f793f-a233-4f08-8c96-ee6ad214e9dc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1322 microversion: 2.1 time: 0.994869 Aug 09 14:42:08.536707 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1430/2775] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:07 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1322 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:08.553765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-51e8eb02-b82d-4924-be2c-5492eca6bb8a req-5dcfc339-56b1-4ba5-a221-c19e051dfe79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12bc6eac-f858-4da3-879e-9d234ce4e726", "tag": "a7053005-565b-4982-9441-02182697f575"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:08.580219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-51e8eb02-b82d-4924-be2c-5492eca6bb8a req-5dcfc339-56b1-4ba5-a221-c19e051dfe79 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:08.581530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-51e8eb02-b82d-4924-be2c-5492eca6bb8a req-5dcfc339-56b1-4ba5-a221-c19e051dfe79 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:08.582409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-51e8eb02-b82d-4924-be2c-5492eca6bb8a req-5dcfc339-56b1-4ba5-a221-c19e051dfe79 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:08.602027 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-51e8eb02-b82d-4924-be2c-5492eca6bb8a req-5dcfc339-56b1-4ba5-a221-c19e051dfe79 service nova] Creating event network-changed:a7053005-565b-4982-9441-02182697f575 for instance 12bc6eac-f858-4da3-879e-9d234ce4e726 on n-h1-844626-8 Aug 09 14:42:08.607985 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-51e8eb02-b82d-4924-be2c-5492eca6bb8a req-5dcfc339-56b1-4ba5-a221-c19e051dfe79 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069286 Aug 09 14:42:08.609112 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1431/2776] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:08.615477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d46627d8-a61f-4d95-97bd-26faabbfee2b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:08.616517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d46627d8-a61f-4d95-97bd-26faabbfee2b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:08.646975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d46627d8-a61f-4d95-97bd-26faabbfee2b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:08.647641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d46627d8-a61f-4d95-97bd-26faabbfee2b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:08.648155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d46627d8-a61f-4d95-97bd-26faabbfee2b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:08.649192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d46627d8-a61f-4d95-97bd-26faabbfee2b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:08.650876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d46627d8-a61f-4d95-97bd-26faabbfee2b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:08.651428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d46627d8-a61f-4d95-97bd-26faabbfee2b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:08.715417 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3414446-d4be-4a90-9b66-1be85b94b027 tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/a1178855-363d-40b1-8597-757d17111297" status: 202 len: 0 microversion: 2.1 time: 2.924171 Aug 09 14:42:08.716267 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1346/2777] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:42:05 2022] DELETE /compute/v2.1/os-floating-ips/a1178855-363d-40b1-8597-757d17111297 => generated 0 bytes in 2926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:42:08.721520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-2e38bfe7-45da-46de-840b-8455f6831fcd req-d990a9cd-cb94-4aa0-850b-1005e5b74109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6087e9ac-3786-4f17-8643-e76c04805347", "name": "network-vif-plugged", "status": "completed", "tag": "e24c9d90-e1c7-4877-a50f-59327870c3a9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:08.744200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2e38bfe7-45da-46de-840b-8455f6831fcd req-d990a9cd-cb94-4aa0-850b-1005e5b74109 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:08.745187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2e38bfe7-45da-46de-840b-8455f6831fcd req-d990a9cd-cb94-4aa0-850b-1005e5b74109 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:08.745859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2e38bfe7-45da-46de-840b-8455f6831fcd req-d990a9cd-cb94-4aa0-850b-1005e5b74109 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:08.772963 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-2e38bfe7-45da-46de-840b-8455f6831fcd req-d990a9cd-cb94-4aa0-850b-1005e5b74109 service nova] Creating event network-vif-plugged:e24c9d90-e1c7-4877-a50f-59327870c3a9 for instance 6087e9ac-3786-4f17-8643-e76c04805347 on n-h2-844626-8 Aug 09 14:42:08.810113 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-2e38bfe7-45da-46de-840b-8455f6831fcd req-d990a9cd-cb94-4aa0-850b-1005e5b74109 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088036 Aug 09 14:42:08.818110 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1347/2778] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:08.824715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b7e955bd-cb35-4bdb-b597-0eb9a21115e9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:08.826607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b7e955bd-cb35-4bdb-b597-0eb9a21115e9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:08.834104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7e955bd-cb35-4bdb-b597-0eb9a21115e9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:08.835229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7e955bd-cb35-4bdb-b597-0eb9a21115e9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:08.836013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7e955bd-cb35-4bdb-b597-0eb9a21115e9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:08.837152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7e955bd-cb35-4bdb-b597-0eb9a21115e9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:08.837809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7e955bd-cb35-4bdb-b597-0eb9a21115e9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:08.838419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7e955bd-cb35-4bdb-b597-0eb9a21115e9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:08.867650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:09.015694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d46627d8-a61f-4d95-97bd-26faabbfee2b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:09.025127 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d46627d8-a61f-4d95-97bd-26faabbfee2b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1493 microversion: 2.1 time: 0.414665 Aug 09 14:42:09.025726 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1432/2779] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:08 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1493 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:09.038866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-97a996ee-655f-46f3-971f-f751cfebe717 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:09.039842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-97a996ee-655f-46f3-971f-f751cfebe717 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:09.054137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a996ee-655f-46f3-971f-f751cfebe717 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:09.054641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a996ee-655f-46f3-971f-f751cfebe717 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:09.058929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a996ee-655f-46f3-971f-f751cfebe717 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:09.059926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a996ee-655f-46f3-971f-f751cfebe717 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:09.060610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a996ee-655f-46f3-971f-f751cfebe717 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:09.061203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a996ee-655f-46f3-971f-f751cfebe717 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:09.247503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-97a996ee-655f-46f3-971f-f751cfebe717 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:09.259169 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-97a996ee-655f-46f3-971f-f751cfebe717 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1436 microversion: 2.1 time: 0.230061 Aug 09 14:42:09.264671 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1433/2780] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:09 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1436 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:09.269578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c18e9c5-90b5-4eb1-9442-99d2c2eb9f68 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41de5169d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:09.347196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b7e955bd-cb35-4bdb-b597-0eb9a21115e9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:09.360652 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b7e955bd-cb35-4bdb-b597-0eb9a21115e9 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 200 len: 1323 microversion: 2.1 time: 0.540687 Aug 09 14:42:09.361566 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1348/2781] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:08 2022] GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 1323 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:09.370087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1fc5a095-4442-461b-b6d6-47a1ca4f109a tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] Calling method '.version_select at 0x7f41e75a8a60>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:09.449271 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6c18e9c5-90b5-4eb1-9442-99d2c2eb9f68 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.182831 Aug 09 14:42:09.450073 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1434/2782] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:09 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:09.471959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-15e87870-ff86-4fe2-b7e9-0c02a74cbc27 req-0d28d5cf-eda1-44a8-bd46-73dc49b1766d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5", "name": "network-vif-deleted", "tag": "b8216191-4500-459f-924a-a1d595ec3b9a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:09.526754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-15e87870-ff86-4fe2-b7e9-0c02a74cbc27 req-0d28d5cf-eda1-44a8-bd46-73dc49b1766d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:09.527495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-15e87870-ff86-4fe2-b7e9-0c02a74cbc27 req-0d28d5cf-eda1-44a8-bd46-73dc49b1766d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:09.527686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-15e87870-ff86-4fe2-b7e9-0c02a74cbc27 req-0d28d5cf-eda1-44a8-bd46-73dc49b1766d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:09.592318 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-15e87870-ff86-4fe2-b7e9-0c02a74cbc27 req-0d28d5cf-eda1-44a8-bd46-73dc49b1766d service nova] Creating event network-vif-deleted:b8216191-4500-459f-924a-a1d595ec3b9a for instance 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 on n-h2-844626-8 Aug 09 14:42:09.604850 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-15e87870-ff86-4fe2-b7e9-0c02a74cbc27 req-0d28d5cf-eda1-44a8-bd46-73dc49b1766d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140149 Aug 09 14:42:09.614649 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1435/2783] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:09.632791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-255e2aff-7b03-4b0c-91bf-7a9f0114de2b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:09.636530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-255e2aff-7b03-4b0c-91bf-7a9f0114de2b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:09.667679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-255e2aff-7b03-4b0c-91bf-7a9f0114de2b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:09.671759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-255e2aff-7b03-4b0c-91bf-7a9f0114de2b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:09.672632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-255e2aff-7b03-4b0c-91bf-7a9f0114de2b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:09.673932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-255e2aff-7b03-4b0c-91bf-7a9f0114de2b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:09.674544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-255e2aff-7b03-4b0c-91bf-7a9f0114de2b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:09.676608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-255e2aff-7b03-4b0c-91bf-7a9f0114de2b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:10.208187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-255e2aff-7b03-4b0c-91bf-7a9f0114de2b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:10.217491 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-255e2aff-7b03-4b0c-91bf-7a9f0114de2b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1322 microversion: 2.1 time: 0.600896 Aug 09 14:42:10.218095 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1436/2784] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:09 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:10.229210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:10.282793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:10.330642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:10.339984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:10.348046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:10.352664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:10.353194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:10.353653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:10.387890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:10.474881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:10.476324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:10.481629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:10.482398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lazy-loading 'fault' on Instance uuid 39095b44-f6d1-4065-a3cb-d6c051168846 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:42:10.621804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:10.647347 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba15ca8a-715b-4c1a-a8b1-b86430d514b7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 200 len: 1298 microversion: 2.1 time: 0.428038 Aug 09 14:42:10.700769 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1437/2785] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:10 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 1298 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:10.721152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:10.724737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:10.756379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:10.757376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:10.758864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:10.759990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:10.769389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:10.770163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:10.841282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:10.842466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:10.843127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:10.843893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lazy-loading 'fault' on Instance uuid 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:42:10.932128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1592bdd654b42e99c97a9ae2414df80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'decdc7f4b385405dbd589e276b8bd7be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:10.945298 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df34c312-66f4-408d-bfa0-8aed8a0320f4 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 200 len: 1312 microversion: 2.1 time: 0.242581 Aug 09 14:42:10.947768 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1438/2786] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:10 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:10.968415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f92d3d45-0ec5-4904-8788-4298c4e12026 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:10.969043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f92d3d45-0ec5-4904-8788-4298c4e12026 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:10.989046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f92d3d45-0ec5-4904-8788-4298c4e12026 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:10.989545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f92d3d45-0ec5-4904-8788-4298c4e12026 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:10.989984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f92d3d45-0ec5-4904-8788-4298c4e12026 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:10.990869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f92d3d45-0ec5-4904-8788-4298c4e12026 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:10.991422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f92d3d45-0ec5-4904-8788-4298c4e12026 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:10.991853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f92d3d45-0ec5-4904-8788-4298c4e12026 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:11.249366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f92d3d45-0ec5-4904-8788-4298c4e12026 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:11.280708 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f92d3d45-0ec5-4904-8788-4298c4e12026 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 200 len: 1517 microversion: 2.1 time: 0.321440 Aug 09 14:42:11.284264 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1439/2787] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:10 2022] GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 1517 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:11.299204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-61f1128d-df5c-44a0-81fe-bf4e327132fa tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd8301f0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:11.373072 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-61f1128d-df5c-44a0-81fe-bf4e327132fa tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.087591 Aug 09 14:42:11.379233 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1440/2788] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:11 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:11.386109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a6e45d68-272c-4d73-8134-ccef6e81bb98 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:11.386725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a6e45d68-272c-4d73-8134-ccef6e81bb98 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:11.395371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6e45d68-272c-4d73-8134-ccef6e81bb98 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:11.396220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6e45d68-272c-4d73-8134-ccef6e81bb98 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:11.396671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6e45d68-272c-4d73-8134-ccef6e81bb98 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:11.397437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6e45d68-272c-4d73-8134-ccef6e81bb98 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:11.397898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6e45d68-272c-4d73-8134-ccef6e81bb98 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:11.398357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6e45d68-272c-4d73-8134-ccef6e81bb98 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:11.441720 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1fc5a095-4442-461b-b6d6-47a1ca4f109a tempest-FloatingIPDetailsTestJSON-391976708 tempest-FloatingIPDetailsTestJSON-391976708-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/4412f7f1-dbad-42e4-bbcb-e6312b253925" status: 202 len: 0 microversion: 2.1 time: 2.078432 Aug 09 14:42:11.442561 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1349/2789] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:42:09 2022] DELETE /compute/v2.1/os-floating-ips/4412f7f1-dbad-42e4-bbcb-e6312b253925 => generated 0 bytes in 2080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:42:11.449609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6647b494-ff2f-4c92-bb33-58f58d31dbce tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:11.451582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6647b494-ff2f-4c92-bb33-58f58d31dbce tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 243e6add-76f2-406c-b10d-5d261cdd308a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:11.461001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6647b494-ff2f-4c92-bb33-58f58d31dbce tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:11.461984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6647b494-ff2f-4c92-bb33-58f58d31dbce tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:11.462687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6647b494-ff2f-4c92-bb33-58f58d31dbce tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:11.463720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6647b494-ff2f-4c92-bb33-58f58d31dbce tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:11.464462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6647b494-ff2f-4c92-bb33-58f58d31dbce tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:11.465136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6647b494-ff2f-4c92-bb33-58f58d31dbce tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:11.617974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a6e45d68-272c-4d73-8134-ccef6e81bb98 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:11.632192 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a6e45d68-272c-4d73-8134-ccef6e81bb98 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1322 microversion: 2.1 time: 0.256008 Aug 09 14:42:11.632902 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1441/2790] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:11 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:11.672220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0b503d4-c622-4a3c-8048-714b5da86532 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:11.672865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b0b503d4-c622-4a3c-8048-714b5da86532 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:11.684140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0b503d4-c622-4a3c-8048-714b5da86532 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:11.684323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0b503d4-c622-4a3c-8048-714b5da86532 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:11.684756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0b503d4-c622-4a3c-8048-714b5da86532 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:11.685489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0b503d4-c622-4a3c-8048-714b5da86532 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:11.685921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0b503d4-c622-4a3c-8048-714b5da86532 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:11.689794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0b503d4-c622-4a3c-8048-714b5da86532 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:11.720879 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-b0b503d4-c622-4a3c-8048-714b5da86532 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0b503d4-c622-4a3c-8048-714b5da86532 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 HTTP/1.1 Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '39095b44-f6d1-4065-a3cb-d6c051168846'} Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:11.726480 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:11.730386 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:11.730386 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:11.730386 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:11.730386 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:11.730386 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:42:11.730386 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:11.735129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0b503d4-c622-4a3c-8048-714b5da86532 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:11.736401 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b0b503d4-c622-4a3c-8048-714b5da86532 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 404 len: 111 microversion: 2.1 time: 0.069967 Aug 09 14:42:11.738946 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1442/2791] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:11 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:42:11.748132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b2c05de4-485f-4138-b75b-02cc18f62677 req-fa6f32c7-283a-4aa2-a3e6-4c143852d018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39095b44-f6d1-4065-a3cb-d6c051168846", "name": "network-vif-deleted", "tag": "31cc8b77-0b03-4929-870b-00a100a52491"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:11.783183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b2c05de4-485f-4138-b75b-02cc18f62677 req-fa6f32c7-283a-4aa2-a3e6-4c143852d018 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:11.786572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6647b494-ff2f-4c92-bb33-58f58d31dbce tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:11.787532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b2c05de4-485f-4138-b75b-02cc18f62677 req-fa6f32c7-283a-4aa2-a3e6-4c143852d018 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:11.793310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b2c05de4-485f-4138-b75b-02cc18f62677 req-fa6f32c7-283a-4aa2-a3e6-4c143852d018 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:11.804661 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6647b494-ff2f-4c92-bb33-58f58d31dbce tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/243e6add-76f2-406c-b10d-5d261cdd308a" status: 200 len: 1517 microversion: 2.1 time: 0.355234 Aug 09 14:42:11.805372 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1350/2792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:11 2022] GET /compute/v2.1/servers/243e6add-76f2-406c-b10d-5d261cdd308a => generated 1517 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:11.827878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a2ec091-c75a-42a2-bfe5-47bb2cc5531a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:11.828780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a2ec091-c75a-42a2-bfe5-47bb2cc5531a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:11.832824 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b2c05de4-485f-4138-b75b-02cc18f62677 req-fa6f32c7-283a-4aa2-a3e6-4c143852d018 service nova] Creating event network-vif-deleted:31cc8b77-0b03-4929-870b-00a100a52491 for instance 39095b44-f6d1-4065-a3cb-d6c051168846 on n-h2-844626-8 Aug 09 14:42:11.837785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a2ec091-c75a-42a2-bfe5-47bb2cc5531a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:11.843209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a2ec091-c75a-42a2-bfe5-47bb2cc5531a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:11.846983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a2ec091-c75a-42a2-bfe5-47bb2cc5531a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:11.848187 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b2c05de4-485f-4138-b75b-02cc18f62677 req-fa6f32c7-283a-4aa2-a3e6-4c143852d018 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107615 Aug 09 14:42:11.849198 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1443/2793] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:11.850643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a2ec091-c75a-42a2-bfe5-47bb2cc5531a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:11.853275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a2ec091-c75a-42a2-bfe5-47bb2cc5531a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:11.855138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a2ec091-c75a-42a2-bfe5-47bb2cc5531a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:11.860590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06850a1f-874c-4734-928a-5d224559cafc tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:11.862228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06850a1f-874c-4734-928a-5d224559cafc tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: d3076ab8-1d52-4251-b6df-e16f82ff0a42] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:11.882028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06850a1f-874c-4734-928a-5d224559cafc tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:11.882868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06850a1f-874c-4734-928a-5d224559cafc tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:11.883517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06850a1f-874c-4734-928a-5d224559cafc tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:11.884413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06850a1f-874c-4734-928a-5d224559cafc tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:11.885036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06850a1f-874c-4734-928a-5d224559cafc tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:11.885641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06850a1f-874c-4734-928a-5d224559cafc tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:11.911572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a2ec091-c75a-42a2-bfe5-47bb2cc5531a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:42:12.144271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:12.149830 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a2ec091-c75a-42a2-bfe5-47bb2cc5531a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 204 len: 0 microversion: 2.1 time: 0.342971 Aug 09 14:42:12.153572 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1351/2794] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:42:11 2022] DELETE /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:12.158980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82ee5345-0ca0-4e05-9f6b-9112d92a72e1 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:12.160039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-82ee5345-0ca0-4e05-9f6b-9112d92a72e1 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] [instance: 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:12.171901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82ee5345-0ca0-4e05-9f6b-9112d92a72e1 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:12.173274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82ee5345-0ca0-4e05-9f6b-9112d92a72e1 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:12.174125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82ee5345-0ca0-4e05-9f6b-9112d92a72e1 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:12.175324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82ee5345-0ca0-4e05-9f6b-9112d92a72e1 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:12.176147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82ee5345-0ca0-4e05-9f6b-9112d92a72e1 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:12.176754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82ee5345-0ca0-4e05-9f6b-9112d92a72e1 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:12.196262 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-82ee5345-0ca0-4e05-9f6b-9112d92a72e1 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] HTTP exception thrown: Instance 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 could not be found. Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82ee5345-0ca0-4e05-9f6b-9112d92a72e1 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Request method failure captured: Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 HTTP/1.1 Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHoRm34QgUR5g8Vosv42BV5Y3JkQumZSXF0U88WOL4dzVqu831g77fPwoilIO0dsojD8iCenQmvquN23-M40ikjP_hiNIgZ0Q4ZggLdSPeYaoMlbT8VAAJDK4cEeM3pwL_j-Q0AiUMVTIdI8AW4Y8-d9HygrmxKMDXe9fJiX5y9aYE Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: decdc7f4b385405dbd589e276b8bd7be Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-638048335 Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_decdc7f4b385405dbd589e276b8bd7be", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/decdc7f4b385405dbd589e276b8bd7be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/decdc7f4b385405dbd589e276b8bd7be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/decdc7f4b385405dbd589e276b8bd7be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-638048335 Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: decdc7f4b385405dbd589e276b8bd7be Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-638048335 Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersAdminNegativeTestJSON-638048335-project Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: c1592bdd654b42e99c97a9ae2414df80 Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-638048335-project Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 could not be found. Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5'} Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 could not be found. Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 could not be found. Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:12.198730 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:12.204573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:12.204573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:12.204573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:12.204573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:12.204573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:12.204573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:12.204573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 could not be found. Aug 09 14:42:12.204573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:12.204573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82ee5345-0ca0-4e05-9f6b-9112d92a72e1 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] Returning 404 to user: Instance 7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:12.204573 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-82ee5345-0ca0-4e05-9f6b-9112d92a72e1 tempest-ServersAdminNegativeTestJSON-638048335 tempest-ServersAdminNegativeTestJSON-638048335-project] 10.222.0.50 "GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5" status: 404 len: 111 microversion: 2.1 time: 0.050950 Aug 09 14:42:12.213678 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1352/2795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:12 2022] GET /compute/v2.1/servers/7d5c09c2-6e27-43ca-86ce-8cb0fb35b8d5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:42:12.229817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b63e8e1f-e5d8-46a0-a9c5-472452eda03e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:12.230515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b63e8e1f-e5d8-46a0-a9c5-472452eda03e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:12.231476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:12.237180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-06850a1f-874c-4734-928a-5d224559cafc tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:12.251491 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06850a1f-874c-4734-928a-5d224559cafc tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42" status: 200 len: 1516 microversion: 2.1 time: 0.400734 Aug 09 14:42:12.257256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b63e8e1f-e5d8-46a0-a9c5-472452eda03e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:12.267076 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1444/2796] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:11 2022] GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42 => generated 1516 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:12.276983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b63e8e1f-e5d8-46a0-a9c5-472452eda03e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:12.277530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b63e8e1f-e5d8-46a0-a9c5-472452eda03e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:12.278284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b63e8e1f-e5d8-46a0-a9c5-472452eda03e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:12.278751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b63e8e1f-e5d8-46a0-a9c5-472452eda03e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:12.279200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b63e8e1f-e5d8-46a0-a9c5-472452eda03e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:12.280947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-504a9944-c57c-40ce-a9b2-66f8890242d4 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:12.281464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-504a9944-c57c-40ce-a9b2-66f8890242d4 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: d3076ab8-1d52-4251-b6df-e16f82ff0a42] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:12.304397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-504a9944-c57c-40ce-a9b2-66f8890242d4 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:12.304931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-504a9944-c57c-40ce-a9b2-66f8890242d4 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:12.305368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-504a9944-c57c-40ce-a9b2-66f8890242d4 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:12.306080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-504a9944-c57c-40ce-a9b2-66f8890242d4 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:12.306528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-504a9944-c57c-40ce-a9b2-66f8890242d4 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:12.306979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-504a9944-c57c-40ce-a9b2-66f8890242d4 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:12.420715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-504a9944-c57c-40ce-a9b2-66f8890242d4 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: d3076ab8-1d52-4251-b6df-e16f82ff0a42] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:42:12.557446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b63e8e1f-e5d8-46a0-a9c5-472452eda03e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:12.574005 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b63e8e1f-e5d8-46a0-a9c5-472452eda03e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1494 microversion: 2.1 time: 0.357534 Aug 09 14:42:12.577913 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1353/2797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:12 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1494 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:12.598954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8e364d2-ae66-4a4d-a8c5-7b0ffc255893 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddd80280>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:12.637385 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-504a9944-c57c-40ce-a9b2-66f8890242d4 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42" status: 204 len: 0 microversion: 2.1 time: 0.365198 Aug 09 14:42:12.640858 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1445/2798] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:42:12 2022] DELETE /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:12.654291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1f7c65b0-54a8-4651-82e0-50cced8dee7f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:12.655346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1f7c65b0-54a8-4651-82e0-50cced8dee7f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: d3076ab8-1d52-4251-b6df-e16f82ff0a42] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:12.663688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f7c65b0-54a8-4651-82e0-50cced8dee7f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:12.670612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f7c65b0-54a8-4651-82e0-50cced8dee7f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:12.671745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f7c65b0-54a8-4651-82e0-50cced8dee7f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:12.677275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f7c65b0-54a8-4651-82e0-50cced8dee7f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:12.678504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f7c65b0-54a8-4651-82e0-50cced8dee7f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:12.679206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f7c65b0-54a8-4651-82e0-50cced8dee7f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:12.767619 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8e364d2-ae66-4a4d-a8c5-7b0ffc255893 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.187213 Aug 09 14:42:12.768563 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1354/2799] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:12 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:12.776221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a79e00a-07a0-4102-bed9-51ad917799cc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:12.780849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a79e00a-07a0-4102-bed9-51ad917799cc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:12.797757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a79e00a-07a0-4102-bed9-51ad917799cc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:12.799780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a79e00a-07a0-4102-bed9-51ad917799cc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:12.800810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a79e00a-07a0-4102-bed9-51ad917799cc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:12.801802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a79e00a-07a0-4102-bed9-51ad917799cc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:12.808954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a79e00a-07a0-4102-bed9-51ad917799cc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:12.811398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a79e00a-07a0-4102-bed9-51ad917799cc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:12.996228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1f7c65b0-54a8-4651-82e0-50cced8dee7f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:13.005176 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1f7c65b0-54a8-4651-82e0-50cced8dee7f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42" status: 200 len: 1522 microversion: 2.1 time: 0.359412 Aug 09 14:42:13.041438 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1446/2800] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:12 2022] GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:13.093709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a79e00a-07a0-4102-bed9-51ad917799cc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:13.108078 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a79e00a-07a0-4102-bed9-51ad917799cc tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1322 microversion: 2.1 time: 0.338277 Aug 09 14:42:13.121200 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1355/2801] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:12 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:13.600478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c6a1c155-4967-4479-843d-285281604908 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:13.601134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c6a1c155-4967-4479-843d-285281604908 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:13.610476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6a1c155-4967-4479-843d-285281604908 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:13.610977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6a1c155-4967-4479-843d-285281604908 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:13.611437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6a1c155-4967-4479-843d-285281604908 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:13.612446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6a1c155-4967-4479-843d-285281604908 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:13.612908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6a1c155-4967-4479-843d-285281604908 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:13.613334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6a1c155-4967-4479-843d-285281604908 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:13.800083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7dfb1322-be95-4e43-a598-924e18086351 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddd4ddc0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:13.822968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c6a1c155-4967-4479-843d-285281604908 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:13.832859 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c6a1c155-4967-4479-843d-285281604908 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1494 microversion: 2.1 time: 0.237391 Aug 09 14:42:13.849168 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1447/2802] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:13 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1494 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:42:14.036596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f22b6579-f02a-4bc2-b242-10871275bc1b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:14.036596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f22b6579-f02a-4bc2-b242-10871275bc1b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: d3076ab8-1d52-4251-b6df-e16f82ff0a42] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:14.044109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f22b6579-f02a-4bc2-b242-10871275bc1b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:14.044791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f22b6579-f02a-4bc2-b242-10871275bc1b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:14.045524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f22b6579-f02a-4bc2-b242-10871275bc1b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:14.046411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f22b6579-f02a-4bc2-b242-10871275bc1b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:14.047025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f22b6579-f02a-4bc2-b242-10871275bc1b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:14.047716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f22b6579-f02a-4bc2-b242-10871275bc1b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:14.186452 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7dfb1322-be95-4e43-a598-924e18086351 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.394212 Aug 09 14:42:14.195626 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1356/2803] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:13 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:42:14.214121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9815516d-8fa7-40d5-aa0e-741b4dd3a78e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:14.215131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9815516d-8fa7-40d5-aa0e-741b4dd3a78e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:14.230321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9815516d-8fa7-40d5-aa0e-741b4dd3a78e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:14.237510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9815516d-8fa7-40d5-aa0e-741b4dd3a78e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:14.239029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9815516d-8fa7-40d5-aa0e-741b4dd3a78e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:14.240457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9815516d-8fa7-40d5-aa0e-741b4dd3a78e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:14.245009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9815516d-8fa7-40d5-aa0e-741b4dd3a78e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:14.250011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9815516d-8fa7-40d5-aa0e-741b4dd3a78e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:14.633317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f22b6579-f02a-4bc2-b242-10871275bc1b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:14.641671 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f22b6579-f02a-4bc2-b242-10871275bc1b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42" status: 200 len: 1522 microversion: 2.1 time: 0.618262 Aug 09 14:42:14.647995 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1448/2804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:14 2022] GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42 => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:14.663334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-e26f0f78-52e2-471b-a65b-712b10927bd0 req-5aabff93-2ff1-45e5-9722-71691223cc2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bc6eac-f858-4da3-879e-9d234ce4e726", "name": "network-vif-plugged", "status": "completed", "tag": "a7053005-565b-4982-9441-02182697f575"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:14.689262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e26f0f78-52e2-471b-a65b-712b10927bd0 req-5aabff93-2ff1-45e5-9722-71691223cc2b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:14.690182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e26f0f78-52e2-471b-a65b-712b10927bd0 req-5aabff93-2ff1-45e5-9722-71691223cc2b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:14.690781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e26f0f78-52e2-471b-a65b-712b10927bd0 req-5aabff93-2ff1-45e5-9722-71691223cc2b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:14.717953 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-e26f0f78-52e2-471b-a65b-712b10927bd0 req-5aabff93-2ff1-45e5-9722-71691223cc2b service nova] Creating event network-vif-plugged:a7053005-565b-4982-9441-02182697f575 for instance 12bc6eac-f858-4da3-879e-9d234ce4e726 on n-h1-844626-8 Aug 09 14:42:14.738604 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-e26f0f78-52e2-471b-a65b-712b10927bd0 req-5aabff93-2ff1-45e5-9722-71691223cc2b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089173 Aug 09 14:42:14.742911 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1449/2805] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:14.803953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9815516d-8fa7-40d5-aa0e-741b4dd3a78e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:14.817909 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9815516d-8fa7-40d5-aa0e-741b4dd3a78e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1322 microversion: 2.1 time: 0.620311 Aug 09 14:42:14.820204 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1357/2806] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:14 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1322 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:14.855741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4976425c-0727-4d15-8727-78d60041c4f6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:14.858321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4976425c-0727-4d15-8727-78d60041c4f6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:14.867581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4976425c-0727-4d15-8727-78d60041c4f6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:14.868334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4976425c-0727-4d15-8727-78d60041c4f6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:14.869605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4976425c-0727-4d15-8727-78d60041c4f6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:14.871385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4976425c-0727-4d15-8727-78d60041c4f6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:14.874067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4976425c-0727-4d15-8727-78d60041c4f6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:14.875804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4976425c-0727-4d15-8727-78d60041c4f6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:15.202349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2bc509f2-b9c2-4139-8439-f584779308c2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddfaa430>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:15.276721 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2bc509f2-b9c2-4139-8439-f584779308c2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.078678 Aug 09 14:42:15.285347 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1358/2807] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:15 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:15.437103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4976425c-0727-4d15-8727-78d60041c4f6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:15.449531 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4976425c-0727-4d15-8727-78d60041c4f6 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1494 microversion: 2.1 time: 0.596761 Aug 09 14:42:15.450916 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1450/2808] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:14 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1494 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:15.605528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-264cc234-8c2b-425b-9a9b-d3061d963557 req-80e4efa9-413b-4427-b2b6-ab3d9b518395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d98e16-7a40-4281-a9f5-fbe5fe968056", "name": "network-vif-deleted", "tag": "6861dcfc-b313-4e9f-a048-edba9a4a7880"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:15.633342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-264cc234-8c2b-425b-9a9b-d3061d963557 req-80e4efa9-413b-4427-b2b6-ab3d9b518395 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:15.635694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-264cc234-8c2b-425b-9a9b-d3061d963557 req-80e4efa9-413b-4427-b2b6-ab3d9b518395 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:15.636627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-264cc234-8c2b-425b-9a9b-d3061d963557 req-80e4efa9-413b-4427-b2b6-ab3d9b518395 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:15.662676 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-264cc234-8c2b-425b-9a9b-d3061d963557 req-80e4efa9-413b-4427-b2b6-ab3d9b518395 service nova] Creating event network-vif-deleted:6861dcfc-b313-4e9f-a048-edba9a4a7880 for instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 on n-h1-844626-8 Aug 09 14:42:15.670799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c86da748-34c3-4369-80bc-f518c283a07e tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:15.671386 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-264cc234-8c2b-425b-9a9b-d3061d963557 req-80e4efa9-413b-4427-b2b6-ab3d9b518395 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070446 Aug 09 14:42:15.672161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c86da748-34c3-4369-80bc-f518c283a07e tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: d3076ab8-1d52-4251-b6df-e16f82ff0a42] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:15.672970 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1359/2809] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:42:15.696364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c86da748-34c3-4369-80bc-f518c283a07e tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:15.697793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c86da748-34c3-4369-80bc-f518c283a07e tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:15.699424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c86da748-34c3-4369-80bc-f518c283a07e tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:15.701173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c86da748-34c3-4369-80bc-f518c283a07e tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:15.702150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c86da748-34c3-4369-80bc-f518c283a07e tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:15.704380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c86da748-34c3-4369-80bc-f518c283a07e tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:15.843574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8aa9bc12-99c0-4fff-9e4d-412c02bb5667 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:15.845735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8aa9bc12-99c0-4fff-9e4d-412c02bb5667 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:15.863892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8aa9bc12-99c0-4fff-9e4d-412c02bb5667 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:15.870367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8aa9bc12-99c0-4fff-9e4d-412c02bb5667 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:15.872610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8aa9bc12-99c0-4fff-9e4d-412c02bb5667 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:15.875325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8aa9bc12-99c0-4fff-9e4d-412c02bb5667 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:15.877477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8aa9bc12-99c0-4fff-9e4d-412c02bb5667 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:15.880384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8aa9bc12-99c0-4fff-9e4d-412c02bb5667 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:16.016212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c86da748-34c3-4369-80bc-f518c283a07e tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:16.034750 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c86da748-34c3-4369-80bc-f518c283a07e tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42" status: 200 len: 1480 microversion: 2.1 time: 0.369953 Aug 09 14:42:16.041169 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1451/2810] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:15 2022] GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42 => generated 1480 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:16.065646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-512f4995-ed12-40c3-82fd-c90e82a1631a req-8f2f7dcc-7357-4a62-940d-ca912045bb04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3076ab8-1d52-4251-b6df-e16f82ff0a42", "name": "network-vif-deleted", "tag": "19e764c7-5d3a-4562-8043-e5dac6bcd9f3"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:16.135952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-512f4995-ed12-40c3-82fd-c90e82a1631a req-8f2f7dcc-7357-4a62-940d-ca912045bb04 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:16.141602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-512f4995-ed12-40c3-82fd-c90e82a1631a req-8f2f7dcc-7357-4a62-940d-ca912045bb04 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:16.147612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-512f4995-ed12-40c3-82fd-c90e82a1631a req-8f2f7dcc-7357-4a62-940d-ca912045bb04 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:16.231645 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-512f4995-ed12-40c3-82fd-c90e82a1631a req-8f2f7dcc-7357-4a62-940d-ca912045bb04 service nova] Creating event network-vif-deleted:19e764c7-5d3a-4562-8043-e5dac6bcd9f3 for instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 on n-h2-844626-8 Aug 09 14:42:16.261691 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-512f4995-ed12-40c3-82fd-c90e82a1631a req-8f2f7dcc-7357-4a62-940d-ca912045bb04 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216769 Aug 09 14:42:16.269929 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1452/2811] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:16.298471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c351c95-5fe8-4582-ac8d-d6a6b8a16127 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd665040>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:16.498003 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6c351c95-5fe8-4582-ac8d-d6a6b8a16127 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.209121 Aug 09 14:42:16.498711 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1453/2812] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:16 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:16.516355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8aa9bc12-99c0-4fff-9e4d-412c02bb5667 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:16.521856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:16.532395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:16.554735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:16.571440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:16.576434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:16.577502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:16.588358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:16.596866 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8aa9bc12-99c0-4fff-9e4d-412c02bb5667 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1322 microversion: 2.1 time: 0.755560 Aug 09 14:42:16.601160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:16.603274 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1360/2813] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:15 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1322 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:42:16.734293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:16.737069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:16.737717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:16.738492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lazy-loading 'fault' on Instance uuid 92d98e16-7a40-4281-a9f5-fbe5fe968056 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:42:16.963111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:16.982905 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-11221e49-fecd-4185-b93e-5a8e6fd953c5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 200 len: 1298 microversion: 2.1 time: 0.481289 Aug 09 14:42:16.984374 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1454/2814] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:16 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 1298 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:17.072053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-409035b2-84f4-48c4-8dc9-8ff315dfb19b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:17.074044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-409035b2-84f4-48c4-8dc9-8ff315dfb19b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: d3076ab8-1d52-4251-b6df-e16f82ff0a42] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:17.096706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409035b2-84f4-48c4-8dc9-8ff315dfb19b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:17.103585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409035b2-84f4-48c4-8dc9-8ff315dfb19b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:17.104614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409035b2-84f4-48c4-8dc9-8ff315dfb19b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:17.105822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409035b2-84f4-48c4-8dc9-8ff315dfb19b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:17.106613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409035b2-84f4-48c4-8dc9-8ff315dfb19b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:17.107384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409035b2-84f4-48c4-8dc9-8ff315dfb19b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:17.172871 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-409035b2-84f4-48c4-8dc9-8ff315dfb19b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] HTTP exception thrown: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-409035b2-84f4-48c4-8dc9-8ff315dfb19b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Request method failure captured: Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42 HTTP/1.1 Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nInn7VPAp4fGxdXjRIh34FuxDlpXQ0xWDhVqMTn1d1kc8eMnJrQRIeg92JJmmUiDXDN2XbXQltPN63OUXQeb13qdWJhJBByJx8Hd5wzYHO5kBDn9zMNvaOcRSj4_3rOVajnas8QNHjxsxgoHhFdHzxuCsKhw_2O6Dw7YIo8zS65Nqs Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8e47994651049909de94dd63a67dbfc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3dc328a5959f4a37aa6bda2e6610ffd4 Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'd3076ab8-1d52-4251-b6df-e16f82ff0a42'} Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:17.183862 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:17.192776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:17.192776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:17.192776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:17.192776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:17.192776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:17.192776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:17.192776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:17.192776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:17.192776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-409035b2-84f4-48c4-8dc9-8ff315dfb19b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Returning 404 to user: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:17.192776 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-409035b2-84f4-48c4-8dc9-8ff315dfb19b tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42" status: 404 len: 111 microversion: 2.1 time: 0.132262 Aug 09 14:42:17.197451 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1361/2815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:17 2022] GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:42:17.210055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27bb0f84-93a4-4f76-85ed-ae2b35b4eb32 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:17.244358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-27bb0f84-93a4-4f76-85ed-ae2b35b4eb32 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:17.249213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-27bb0f84-93a4-4f76-85ed-ae2b35b4eb32 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c8e47994651049909de94dd63a67dbfc'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:42:17.276310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27bb0f84-93a4-4f76-85ed-ae2b35b4eb32 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:17.279559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27bb0f84-93a4-4f76-85ed-ae2b35b4eb32 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:17.280521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27bb0f84-93a4-4f76-85ed-ae2b35b4eb32 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:17.285284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27bb0f84-93a4-4f76-85ed-ae2b35b4eb32 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:17.286550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27bb0f84-93a4-4f76-85ed-ae2b35b4eb32 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:17.287643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27bb0f84-93a4-4f76-85ed-ae2b35b4eb32 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:17.459979 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-27bb0f84-93a4-4f76-85ed-ae2b35b4eb32 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.260249 Aug 09 14:42:17.461465 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1455/2816] 10.222.0.50 () {58 vars in 1230 bytes} [Tue Aug 9 14:42:17 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:17.486994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c20a0b95-adcb-464d-9111-67b6cf27185f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c20a0b95-adcb-464d-9111-67b6cf27185f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Request method failure captured: Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nInn7VPAp4fGxdXjRIh34FuxDlpXQ0xWDhVqMTn1d1kc8eMnJrQRIeg92JJmmUiDXDN2XbXQltPN63OUXQeb13qdWJhJBByJx8Hd5wzYHO5kBDn9zMNvaOcRSj4_3rOVajnas8QNHjxsxgoHhFdHzxuCsKhw_2O6Dw7YIo8zS65Nqs Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8e47994651049909de94dd63a67dbfc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3dc328a5959f4a37aa6bda2e6610ffd4 Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: action_args: {} Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 09 14:42:17.502486 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 09 14:42:17.511532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:17.524740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e3c249f-d6dc-47f4-b352-6e2bf4aa9e6a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd830d30>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:17.532976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c20a0b95-adcb-464d-9111-67b6cf27185f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:17.535867 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c20a0b95-adcb-464d-9111-67b6cf27185f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.057308 Aug 09 14:42:17.550285 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1362/2817] 10.222.0.50 () {58 vars in 1182 bytes} [Tue Aug 9 14:42:17 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:42:17.581400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-72bbc65b-008c-49c7-80c2-b4710089d7ba tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:17.603154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-72bbc65b-008c-49c7-80c2-b4710089d7ba tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:17.606122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-72bbc65b-008c-49c7-80c2-b4710089d7ba tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Searching by: {'deleted': False, 'project_id': 'c8e47994651049909de94dd63a67dbfc'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:42:17.648939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72bbc65b-008c-49c7-80c2-b4710089d7ba tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:17.652015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72bbc65b-008c-49c7-80c2-b4710089d7ba tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:17.659121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72bbc65b-008c-49c7-80c2-b4710089d7ba tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:17.666183 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e3c249f-d6dc-47f4-b352-6e2bf4aa9e6a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.150078 Aug 09 14:42:17.666891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72bbc65b-008c-49c7-80c2-b4710089d7ba tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:17.672133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72bbc65b-008c-49c7-80c2-b4710089d7ba tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:17.673170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72bbc65b-008c-49c7-80c2-b4710089d7ba tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:17.681626 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1456/2818] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:17 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:17.688196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8186bb10-111f-4390-a740-9481c4b2e399 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:17.689081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8186bb10-111f-4390-a740-9481c4b2e399 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:17.697051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:17.699705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8186bb10-111f-4390-a740-9481c4b2e399 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:17.702285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8186bb10-111f-4390-a740-9481c4b2e399 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:17.702961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8186bb10-111f-4390-a740-9481c4b2e399 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:17.704412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8186bb10-111f-4390-a740-9481c4b2e399 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:17.705083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8186bb10-111f-4390-a740-9481c4b2e399 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:17.706311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8186bb10-111f-4390-a740-9481c4b2e399 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:17.741537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:17.760784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-72bbc65b-008c-49c7-80c2-b4710089d7ba tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:42:17.881990 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-72bbc65b-008c-49c7-80c2-b4710089d7ba tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.325732 Aug 09 14:42:17.882900 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1363/2819] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 14:42:17 2022] GET /compute/v2.1/servers => generated 683 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:17.909049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8b54817a-00de-4eb1-b2c0-47ccaae75529 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:17.924112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8b54817a-00de-4eb1-b2c0-47ccaae75529 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:17.925115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.compute.servers [None req-8b54817a-00de-4eb1-b2c0-47ccaae75529 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Removing options 'limit' from query {{(pid=119406) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 09 14:42:17.927363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8b54817a-00de-4eb1-b2c0-47ccaae75529 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Searching by: {'deleted': False, 'project_id': 'c8e47994651049909de94dd63a67dbfc'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:42:17.939867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b54817a-00de-4eb1-b2c0-47ccaae75529 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:17.943391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b54817a-00de-4eb1-b2c0-47ccaae75529 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:17.944879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b54817a-00de-4eb1-b2c0-47ccaae75529 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:17.946817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b54817a-00de-4eb1-b2c0-47ccaae75529 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:17.947438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b54817a-00de-4eb1-b2c0-47ccaae75529 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:17.949300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b54817a-00de-4eb1-b2c0-47ccaae75529 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:17.960894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8186bb10-111f-4390-a740-9481c4b2e399 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:17.981924 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8186bb10-111f-4390-a740-9481c4b2e399 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1518 microversion: 2.1 time: 0.293302 Aug 09 14:42:17.983123 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1457/2820] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:17 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1518 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:18.011353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c71991e4-a5e4-430c-9b99-dc9ec58d6e98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:18.012363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c71991e4-a5e4-430c-9b99-dc9ec58d6e98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:18.049237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-8b54817a-00de-4eb1-b2c0-47ccaae75529 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:42:18.050619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71991e4-a5e4-430c-9b99-dc9ec58d6e98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:18.053658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71991e4-a5e4-430c-9b99-dc9ec58d6e98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:18.054413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71991e4-a5e4-430c-9b99-dc9ec58d6e98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:18.056842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71991e4-a5e4-430c-9b99-dc9ec58d6e98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:18.057544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71991e4-a5e4-430c-9b99-dc9ec58d6e98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:18.059068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71991e4-a5e4-430c-9b99-dc9ec58d6e98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:18.097780 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-c71991e4-a5e4-430c-9b99-dc9ec58d6e98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c71991e4-a5e4-430c-9b99-dc9ec58d6e98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 HTTP/1.1 Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '92d98e16-7a40-4281-a9f5-fbe5fe968056'} Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.114987 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:18.126167 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:18.126167 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:18.126167 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:18.126167 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:18.126167 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:42:18.126167 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.126167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c71991e4-a5e4-430c-9b99-dc9ec58d6e98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:18.126167 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c71991e4-a5e4-430c-9b99-dc9ec58d6e98 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 404 len: 111 microversion: 2.1 time: 0.106236 Aug 09 14:42:18.126167 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1458/2821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:18 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:42:18.138351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4c3aff5d-f771-4961-a512-5be78acf43d5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:18.138987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4c3aff5d-f771-4961-a512-5be78acf43d5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:18.164076 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8b54817a-00de-4eb1-b2c0-47ccaae75529 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.267499 Aug 09 14:42:18.166232 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1364/2822] 10.222.0.50 () {58 vars in 1144 bytes} [Tue Aug 9 14:42:17 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:18.169495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c3aff5d-f771-4961-a512-5be78acf43d5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:18.169995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c3aff5d-f771-4961-a512-5be78acf43d5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:18.178461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c3aff5d-f771-4961-a512-5be78acf43d5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:18.179540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c3aff5d-f771-4961-a512-5be78acf43d5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:18.180034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c3aff5d-f771-4961-a512-5be78acf43d5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:18.182650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c3aff5d-f771-4961-a512-5be78acf43d5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:18.194220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f476e23-86ca-4e3a-bac2-8a5f217bf9f3 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f476e23-86ca-4e3a-bac2-8a5f217bf9f3 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Request method failure captured: Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nInn7VPAp4fGxdXjRIh34FuxDlpXQ0xWDhVqMTn1d1kc8eMnJrQRIeg92JJmmUiDXDN2XbXQltPN63OUXQeb13qdWJhJBByJx8Hd5wzYHO5kBDn9zMNvaOcRSj4_3rOVajnas8QNHjxsxgoHhFdHzxuCsKhw_2O6Dw7YIo8zS65Nqs Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8e47994651049909de94dd63a67dbfc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3dc328a5959f4a37aa6bda2e6610ffd4 Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: action_args: {} Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi '-1' Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 09 14:42:18.204922 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 09 14:42:18.213179 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.219105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f476e23-86ca-4e3a-bac2-8a5f217bf9f3 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:18.220321 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f476e23-86ca-4e3a-bac2-8a5f217bf9f3 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.040935 Aug 09 14:42:18.222470 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1365/2823] 10.222.0.50 () {58 vars in 1142 bytes} [Tue Aug 9 14:42:18 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:42:18.241560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04bdd021-614f-4626-929a-5db224f03354 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04bdd021-614f-4626-929a-5db224f03354 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Request method failure captured: Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nInn7VPAp4fGxdXjRIh34FuxDlpXQ0xWDhVqMTn1d1kc8eMnJrQRIeg92JJmmUiDXDN2XbXQltPN63OUXQeb13qdWJhJBByJx8Hd5wzYHO5kBDn9zMNvaOcRSj4_3rOVajnas8QNHjxsxgoHhFdHzxuCsKhw_2O6Dw7YIo8zS65Nqs Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8e47994651049909de94dd63a67dbfc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3dc328a5959f4a37aa6bda2e6610ffd4 Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: action_args: {} Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'testing' Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 09 14:42:18.254925 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 09 14:42:18.259724 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.261705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04bdd021-614f-4626-929a-5db224f03354 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:18.263542 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-04bdd021-614f-4626-929a-5db224f03354 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.031836 Aug 09 14:42:18.272866 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1366/2824] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:42:18 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:42:18.301389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d5c68d0-7311-47b9-9cb9-a810da494406 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:18.324836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d5c68d0-7311-47b9-9cb9-a810da494406 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:18.326899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3d5c68d0-7311-47b9-9cb9-a810da494406 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c8e47994651049909de94dd63a67dbfc'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:42:18.347648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.compute.servers [None req-3d5c68d0-7311-47b9-9cb9-a810da494406 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Flavor 'non_existing_flavor' could not be found {{(pid=119406) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 09 14:42:18.350001 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d5c68d0-7311-47b9-9cb9-a810da494406 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.074933 Aug 09 14:42:18.351267 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1367/2825] 10.222.0.50 () {58 vars in 1178 bytes} [Tue Aug 9 14:42:18 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:18.399367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ad258e3-a339-4959-9685-4980f99da90f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:18.444052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ad258e3-a339-4959-9685-4980f99da90f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:18.447341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ad258e3-a339-4959-9685-4980f99da90f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c8e47994651049909de94dd63a67dbfc'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:42:18.464168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:18.474024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ad258e3-a339-4959-9685-4980f99da90f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:18.475615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ad258e3-a339-4959-9685-4980f99da90f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:18.478552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ad258e3-a339-4959-9685-4980f99da90f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:18.481693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ad258e3-a339-4959-9685-4980f99da90f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:18.483484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ad258e3-a339-4959-9685-4980f99da90f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:18.485996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ad258e3-a339-4959-9685-4980f99da90f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:18.578236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4c3aff5d-f771-4961-a512-5be78acf43d5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:18.590286 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4c3aff5d-f771-4961-a512-5be78acf43d5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1518 microversion: 2.1 time: 0.463911 Aug 09 14:42:18.591461 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1459/2826] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:18 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1518 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:18.617807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42e1e598-9b0e-474c-9d8a-38f964e7c617 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-671716087", "metadata": {"": ""}}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42e1e598-9b0e-474c-9d8a-38f964e7c617 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action HTTP/1.1 Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 106 Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-671716087", "metadata": {"": ""}}} Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '12bc6eac-f858-4da3-879e-9d234ce4e726', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-671716087', 'metadata': {'': ''}}}} Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'': ''} Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:18.630924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:42:18.634864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:18.639146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42e1e598-9b0e-474c-9d8a-38f964e7c617 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:18.640835 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-42e1e598-9b0e-474c-9d8a-38f964e7c617 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action" status: 400 len: 170 microversion: 2.1 time: 0.029356 Aug 09 14:42:18.644173 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1460/2827] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Aug 9 14:42:18 2022] POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action => generated 170 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:42:18.653947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b4cca00-acfb-4448-b766-0d1d8ada1971 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:18.658196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b4cca00-acfb-4448-b766-0d1d8ada1971 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:18.675372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b4cca00-acfb-4448-b766-0d1d8ada1971 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:18.676489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b4cca00-acfb-4448-b766-0d1d8ada1971 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:18.679475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b4cca00-acfb-4448-b766-0d1d8ada1971 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:18.681434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b4cca00-acfb-4448-b766-0d1d8ada1971 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:18.681918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b4cca00-acfb-4448-b766-0d1d8ada1971 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:18.683257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b4cca00-acfb-4448-b766-0d1d8ada1971 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:18.888368 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ad258e3-a339-4959-9685-4980f99da90f tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.510822 Aug 09 14:42:18.888368 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1368/2828] 10.222.0.50 () {58 vars in 1174 bytes} [Tue Aug 9 14:42:18 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:18.907303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-275539328", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "7d4b5e6e-1097-46ba-bb21-ff9e1560d087"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:19.137499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] validate_networks() for [('7d4b5e6e-1097-46ba-bb21-ff9e1560d087', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:42:19.851280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b4cca00-acfb-4448-b766-0d1d8ada1971 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:19.866600 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b4cca00-acfb-4448-b766-0d1d8ada1971 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1518 microversion: 2.1 time: 1.216350 Aug 09 14:42:19.868051 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1461/2829] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:18 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1518 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:19.877493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7416a54-9032-4d9c-b602-f6114c9bdeea tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dde608b0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:20.048067 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7416a54-9032-4d9c-b602-f6114c9bdeea tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.168064 Aug 09 14:42:20.051567 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1462/2830] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:19 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:20.077304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-010fca6b-38f1-4f5b-9325-45fc11f9af21 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:20.098383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-010fca6b-38f1-4f5b-9325-45fc11f9af21 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:20.099916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-010fca6b-38f1-4f5b-9325-45fc11f9af21 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c8e47994651049909de94dd63a67dbfc'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:42:20.110163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-010fca6b-38f1-4f5b-9325-45fc11f9af21 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:20.111211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-010fca6b-38f1-4f5b-9325-45fc11f9af21 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:20.112329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-010fca6b-38f1-4f5b-9325-45fc11f9af21 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:20.113663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-010fca6b-38f1-4f5b-9325-45fc11f9af21 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:20.114545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-010fca6b-38f1-4f5b-9325-45fc11f9af21 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:20.115507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-010fca6b-38f1-4f5b-9325-45fc11f9af21 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:20.348647 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-010fca6b-38f1-4f5b-9325-45fc11f9af21 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.293122 Aug 09 14:42:20.354308 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1463/2831] 10.222.0.50 () {58 vars in 1184 bytes} [Tue Aug 9 14:42:20 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:21.239510 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8b4f0b1d-5ab1-403d-b009-a44a41bf5d14 tempest-TenantUsagesNegativeTestJSON-80992194 tempest-TenantUsagesNegativeTestJSON-80992194-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-08T14%3A42%3A19.763462&end=2022-08-10T14%3A42%3A19.763462" status: 404 len: 112 microversion: - time: 0.872384 Aug 09 14:42:21.240542 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1464/2832] 10.222.0.50 () {58 vars in 1316 bytes} [Tue Aug 9 14:42:20 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-08T14%3A42%3A19.763462&end=2022-08-10T14%3A42%3A19.763462 => generated 112 bytes in 876 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 14:42:21.245685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ea9aa20-e5c4-4890-ad2d-104e1db3df1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:21.248531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ea9aa20-e5c4-4890-ad2d-104e1db3df1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:21.265588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ea9aa20-e5c4-4890-ad2d-104e1db3df1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:21.266073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ea9aa20-e5c4-4890-ad2d-104e1db3df1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:21.266505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ea9aa20-e5c4-4890-ad2d-104e1db3df1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:21.268758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ea9aa20-e5c4-4890-ad2d-104e1db3df1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:21.269225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ea9aa20-e5c4-4890-ad2d-104e1db3df1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:21.271389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ea9aa20-e5c4-4890-ad2d-104e1db3df1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:21.607263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ea9aa20-e5c4-4890-ad2d-104e1db3df1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:21.615403 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ea9aa20-e5c4-4890-ad2d-104e1db3df1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1518 microversion: 2.1 time: 0.374067 Aug 09 14:42:21.624902 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1465/2833] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:21 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1518 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:21.635801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:21.646922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:21.648272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Searching by: {'deleted': False, 'project_id': 'c8e47994651049909de94dd63a67dbfc'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:42:21.653584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:21.654362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:21.655018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:21.656135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:21.656795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:21.657447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:21.686811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:42:21.687570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:42:21.688910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:42:21.689635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:42:21.690581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:42:21.695509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:42:21.720786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:21.721731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:21.724670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:21.729801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:21.732811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:21.733856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:21.737886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:21.746271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:21.746749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:21.747249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:21.779982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:21.818722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for user 03bdf5ec21854ec8b6561a121ce1f1ef and project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:21.884082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:42:21.897217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:42:22.045857 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b06b7ec-a031-4992-8e69-e76b1d05ce50 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 3027 microversion: 2.1 time: 0.419452 Aug 09 14:42:22.060054 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1466/2834] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:42:21 2022] GET /compute/v2.1/servers/detail => generated 3027 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:22.064776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-766ac44a-79ae-4dba-85d6-6aaca7047c42 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41de516dc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:22.116522 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-239d4b53-e218-4cc0-9fd8-37531047b835 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.235673 Aug 09 14:42:22.127996 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1369/2835] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:42:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:42:22.135045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8313bd65-62f5-4b9f-a372-e9fa96aaf599 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea04e242-1dec-42c9-a16f-736c09e9aaa4"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:22.137740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8313bd65-62f5-4b9f-a372-e9fa96aaf599 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:22.145576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8313bd65-62f5-4b9f-a372-e9fa96aaf599 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:22.146305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8313bd65-62f5-4b9f-a372-e9fa96aaf599 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:22.146965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8313bd65-62f5-4b9f-a372-e9fa96aaf599 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:22.148261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8313bd65-62f5-4b9f-a372-e9fa96aaf599 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:22.149077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8313bd65-62f5-4b9f-a372-e9fa96aaf599 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:22.149680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8313bd65-62f5-4b9f-a372-e9fa96aaf599 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:22.159707 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-766ac44a-79ae-4dba-85d6-6aaca7047c42 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1413 microversion: 2.1 time: 0.100034 Aug 09 14:42:22.160328 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1467/2836] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:22 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:22.170982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6b63c4a9-e6a4-4c4b-a276-406fe56a240e tempest-TenantUsagesNegativeTestJSON-80992194 tempest-TenantUsagesNegativeTestJSON-80992194-project-admin] Calling method '.version_select at 0x7f41dd640f70>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:22.219258 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-6b63c4a9-e6a4-4c4b-a276-406fe56a240e tempest-TenantUsagesNegativeTestJSON-80992194 tempest-TenantUsagesNegativeTestJSON-80992194-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6b63c4a9-e6a4-4c4b-a276-406fe56a240e tempest-TenantUsagesNegativeTestJSON-80992194 tempest-TenantUsagesNegativeTestJSON-80992194-project-admin] Request method failure captured: Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-simple-tenant-usage/cb288b5cf35e438c9d64d80ea9f8ec8c?start=2022-08-10T14%3A42%3A19.763462&end=2022-08-08T14%3A42%3A19.763462 HTTP/1.1 Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nJLu1aFqvi4pDlPolnc9mBnK4IGB457cYYEEIdfY1EfB6Ab119N7Pqk9i4wBy_gAAUucPJn7p77AFuQ9ALO7ktV-cVqLNWMU1O0j7vImKCmd0F2ok_DuQV2NSo0mDTpVDKITL3p_AxlmtJNrczA06FWttWLGLymffpXUvCw8UPipxg Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 106871d2f11b4cef9b646a3ad86e3de4 Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-80992194 Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_106871d2f11b4cef9b646a3ad86e3de4", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/106871d2f11b4cef9b646a3ad86e3de4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/106871d2f11b4cef9b646a3ad86e3de4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/106871d2f11b4cef9b646a3ad86e3de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-80992194 Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 106871d2f11b4cef9b646a3ad86e3de4 Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-80992194 Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TenantUsagesNegativeTestJSON-80992194-project-admin Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 542fe88fb8264ea89186ef13e2e1d790 Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-80992194-project-admin Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid start time. The start time cannot occur after the end time. Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'cb288b5cf35e438c9d64d80ea9f8ec8c'} Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 09 14:42:22.244473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:22.250692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6b63c4a9-e6a4-4c4b-a276-406fe56a240e tempest-TenantUsagesNegativeTestJSON-80992194 tempest-TenantUsagesNegativeTestJSON-80992194-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:22.250692 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6b63c4a9-e6a4-4c4b-a276-406fe56a240e tempest-TenantUsagesNegativeTestJSON-80992194 tempest-TenantUsagesNegativeTestJSON-80992194-project-admin] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage/cb288b5cf35e438c9d64d80ea9f8ec8c?start=2022-08-10T14%3A42%3A19.763462&end=2022-08-08T14%3A42%3A19.763462" status: 400 len: 111 microversion: 2.1 time: 0.083090 Aug 09 14:42:22.250692 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1468/2837] 10.222.0.50 () {58 vars in 1412 bytes} [Tue Aug 9 14:42:22 2022] GET /compute/v2.1/os-simple-tenant-usage/cb288b5cf35e438c9d64d80ea9f8ec8c?start=2022-08-10T14%3A42%3A19.763462&end=2022-08-08T14%3A42%3A19.763462 => generated 111 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:42:22.299223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4fd8e57a-7fbb-429b-82a5-6ea5a8d14b06 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-792904730", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4fd8e57a-7fbb-429b-82a5-6ea5a8d14b06 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action HTTP/1.1 Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 618 Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-792904730", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '12bc6eac-f858-4da3-879e-9d234ce4e726', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-792904730', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:42:22.315891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 09 14:42:22.321596 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:22.328424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4fd8e57a-7fbb-429b-82a5-6ea5a8d14b06 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:22.328424 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4fd8e57a-7fbb-429b-82a5-6ea5a8d14b06 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action" status: 400 len: 938 microversion: 2.1 time: 0.069033 Aug 09 14:42:22.333455 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1469/2838] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Aug 9 14:42:22 2022] POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action => generated 938 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:42:22.345328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c045374b-57cf-491c-9e03-85d72389c6e8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:22.375734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c045374b-57cf-491c-9e03-85d72389c6e8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:22.377435 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c045374b-57cf-491c-9e03-85d72389c6e8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.042222 Aug 09 14:42:22.378562 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1470/2839] 10.222.0.50 () {58 vars in 1178 bytes} [Tue Aug 9 14:42:22 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:22.410647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da54c4b6-9f93-4e56-9326-1253be5b6820 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:22.412211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da54c4b6-9f93-4e56-9326-1253be5b6820 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:22.628022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-da54c4b6-9f93-4e56-9326-1253be5b6820 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:22.637085 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da54c4b6-9f93-4e56-9326-1253be5b6820 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1208 microversion: 2.1 time: 0.245521 Aug 09 14:42:22.638857 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1471/2840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:22 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1208 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:23.098172 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8313bd65-62f5-4b9f-a372-e9fa96aaf599 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "POST /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.966193 Aug 09 14:42:23.103255 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1370/2841] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 14:42:22 2022] POST /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7/os-volume_attachments => generated 194 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:23.126454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b948e9fb-5b54-485b-ad2d-2e4f79c464cf tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:23.131046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b948e9fb-5b54-485b-ad2d-2e4f79c464cf tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:23.153981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b948e9fb-5b54-485b-ad2d-2e4f79c464cf tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:23.155210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b948e9fb-5b54-485b-ad2d-2e4f79c464cf tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:23.156705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b948e9fb-5b54-485b-ad2d-2e4f79c464cf tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:23.158887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b948e9fb-5b54-485b-ad2d-2e4f79c464cf tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:23.160564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b948e9fb-5b54-485b-ad2d-2e4f79c464cf tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:23.161502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b948e9fb-5b54-485b-ad2d-2e4f79c464cf tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:23.268543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-961653b8-cda9-4b4f-9857-9cb132e17c60 tempest-TenantUsagesNegativeTestJSON-1062848969 tempest-TenantUsagesNegativeTestJSON-1062848969-project] Calling method '.version_select at 0x7f41dd3f3820>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:23.299139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-961653b8-cda9-4b4f-9857-9cb132e17c60 tempest-TenantUsagesNegativeTestJSON-1062848969 tempest-TenantUsagesNegativeTestJSON-1062848969-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'c3200e73e5fa4c4f8f545e34a7b8d600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb288b5cf35e438c9d64d80ea9f8ec8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-961653b8-cda9-4b4f-9857-9cb132e17c60 tempest-TenantUsagesNegativeTestJSON-1062848969 tempest-TenantUsagesNegativeTestJSON-1062848969-project] Request method failure captured: Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-08T14%3A42%3A19.763462&end=2022-08-10T14%3A42%3A19.763462&detailed=1 HTTP/1.1 Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nJJWvRx-Xnc18HDhkJuEZI__YQkcecsGJ2aRdaJ2gKEV0PmZfj2SYiNgo2Z3HlxWP1s3zV9OYlKfF5ArZqYiOm0qsDGxg3OR4I9XyqLrPo20J7hpv8aTYoZIa0Ypy8pvzsxbAQG7Ajs96UfamZUD6f4E_-TFEikZAPoZsISLswgouY Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: cb288b5cf35e438c9d64d80ea9f8ec8c Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1062848969 Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cb288b5cf35e438c9d64d80ea9f8ec8c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cb288b5cf35e438c9d64d80ea9f8ec8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb288b5cf35e438c9d64d80ea9f8ec8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb288b5cf35e438c9d64d80ea9f8ec8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1062848969 Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: cb288b5cf35e438c9d64d80ea9f8ec8c Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1062848969 Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TenantUsagesNegativeTestJSON-1062848969-project Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: c3200e73e5fa4c4f8f545e34a7b8d600 Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1062848969-project Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: action_args: {} Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise self.value Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 09 14:42:23.309955 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 09 14:42:23.314532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 09 14:42:23.314532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 09 14:42:23.314532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.314532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:23.314532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.314532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:23.314532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:23.314532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:23.314532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 09 14:42:23.314532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 09 14:42:23.314532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 09 14:42:23.314532 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.330366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-961653b8-cda9-4b4f-9857-9cb132e17c60 tempest-TenantUsagesNegativeTestJSON-1062848969 tempest-TenantUsagesNegativeTestJSON-1062848969-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:23.332468 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-961653b8-cda9-4b4f-9857-9cb132e17c60 tempest-TenantUsagesNegativeTestJSON-1062848969 tempest-TenantUsagesNegativeTestJSON-1062848969-project] 10.222.0.50 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-08T14%3A42%3A19.763462&end=2022-08-10T14%3A42%3A19.763462&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.691826 Aug 09 14:42:23.333235 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1472/2842] 10.222.0.50 () {58 vars in 1335 bytes} [Tue Aug 9 14:42:22 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-08T14%3A42%3A19.763462&end=2022-08-10T14%3A42%3A19.763462&detailed=1 => generated 123 bytes in 694 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:42:23.366118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e31eb190-bef1-4ea7-ae68-07a267046488 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:23.403585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e31eb190-bef1-4ea7-ae68-07a267046488 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:23.404668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e31eb190-bef1-4ea7-ae68-07a267046488 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Searching by: {'deleted': False, 'project_id': 'c8e47994651049909de94dd63a67dbfc'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:42:23.415681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e31eb190-bef1-4ea7-ae68-07a267046488 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:23.416495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e31eb190-bef1-4ea7-ae68-07a267046488 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:23.417209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e31eb190-bef1-4ea7-ae68-07a267046488 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:23.418723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e31eb190-bef1-4ea7-ae68-07a267046488 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:23.419786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e31eb190-bef1-4ea7-ae68-07a267046488 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:23.420493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e31eb190-bef1-4ea7-ae68-07a267046488 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:23.471768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-e31eb190-bef1-4ea7-ae68-07a267046488 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:42:23.566609 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e31eb190-bef1-4ea7-ae68-07a267046488 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.231800 Aug 09 14:42:23.567989 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1473/2843] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 14:42:23 2022] GET /compute/v2.1/servers => generated 683 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:23.633671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b948e9fb-5b54-485b-ad2d-2e4f79c464cf tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:23.646299 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b948e9fb-5b54-485b-ad2d-2e4f79c464cf tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1518 microversion: 2.1 time: 0.538898 Aug 09 14:42:23.652020 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1371/2844] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:23 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1518 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:23.657169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-96ef0fa1-d73b-4354-9bd6-11696d5da2e5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41e74f8c10>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:23.698325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a2932c4-2654-4f3e-be30-8609fb8085f1 tempest-ListImageFiltersNegativeTestJSON-815488890 tempest-ListImageFiltersNegativeTestJSON-815488890-project] Calling method '.version_select at 0x7f41dd425040>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:23.755529 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-0a2932c4-2654-4f3e-be30-8609fb8085f1 tempest-ListImageFiltersNegativeTestJSON-815488890 tempest-ListImageFiltersNegativeTestJSON-815488890-project] HTTP exception thrown: Image not found. Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a2932c4-2654-4f3e-be30-8609fb8085f1 tempest-ListImageFiltersNegativeTestJSON-815488890 tempest-ListImageFiltersNegativeTestJSON-815488890-project] Request method failure captured: Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/images/a0f27e91-bda7-490d-9d2f-1ea706b85fa9 HTTP/1.1 Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nJOQss3xVtH-DK98eksNNGZ5qf705Q7nkzGAEhcc12ahHtdCuCEpocfMZKKewmVdgsqdT9Fx4nHZ1OTGqJzDt4twazaQu9noSIjH9KKpqEzhcispHVCtLLnP8yGnbCJnz1iQqmECgCZ6K9Jf3MQj2NPVvYh1_iEkCO9cvjTxb1fRO0 Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 474b1dfd6ea14bf199eb3cf691063994 Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-815488890 Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_474b1dfd6ea14bf199eb3cf691063994", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/474b1dfd6ea14bf199eb3cf691063994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/474b1dfd6ea14bf199eb3cf691063994"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/474b1dfd6ea14bf199eb3cf691063994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-815488890 Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 474b1dfd6ea14bf199eb3cf691063994 Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-815488890 Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ListImageFiltersNegativeTestJSON-815488890-project Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: ba09bf50f9974784b37675dd9352392a Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-815488890-project Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: exception: Image not found. Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'a0f27e91-bda7-490d-9d2f-1ea706b85fa9'} Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a0f27e91-bda7-490d-9d2f-1ea706b85fa9 Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 14:42:23.760003 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a0f27e91-bda7-490d-9d2f-1ea706b85fa9 could not be found. Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:42:23.764495 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.768875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a2932c4-2654-4f3e-be30-8609fb8085f1 tempest-ListImageFiltersNegativeTestJSON-815488890 tempest-ListImageFiltersNegativeTestJSON-815488890-project] Returning 404 to user: Image not found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:23.774519 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0a2932c4-2654-4f3e-be30-8609fb8085f1 tempest-ListImageFiltersNegativeTestJSON-815488890 tempest-ListImageFiltersNegativeTestJSON-815488890-project] 10.222.0.50 "GET /compute/v2.1/images/a0f27e91-bda7-490d-9d2f-1ea706b85fa9" status: 404 len: 62 microversion: 2.1 time: 0.202131 Aug 09 14:42:23.780131 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1474/2845] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:23 2022] GET /compute/v2.1/images/a0f27e91-bda7-490d-9d2f-1ea706b85fa9 => generated 62 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:42:23.806090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-191c283f-b851-4c85-8b55-8ed2564eae5c tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:23.807667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-191c283f-b851-4c85-8b55-8ed2564eae5c tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: d3076ab8-1d52-4251-b6df-e16f82ff0a42] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:23.814505 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-96ef0fa1-d73b-4354-9bd6-11696d5da2e5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1422 microversion: 2.1 time: 0.160981 Aug 09 14:42:23.816442 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1372/2846] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:23 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1422 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:23.834009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-191c283f-b851-4c85-8b55-8ed2564eae5c tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:23.837140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-191c283f-b851-4c85-8b55-8ed2564eae5c tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:23.838111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-191c283f-b851-4c85-8b55-8ed2564eae5c tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:23.840466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-191c283f-b851-4c85-8b55-8ed2564eae5c tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:23.841235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7db9c5e-c41b-4414-ba55-7f9e1d630170 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:23.844041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-191c283f-b851-4c85-8b55-8ed2564eae5c tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:23.845064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-191c283f-b851-4c85-8b55-8ed2564eae5c tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:23.845788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7db9c5e-c41b-4414-ba55-7f9e1d630170 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:23.879706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7db9c5e-c41b-4414-ba55-7f9e1d630170 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:23.880239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7db9c5e-c41b-4414-ba55-7f9e1d630170 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:23.884206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7db9c5e-c41b-4414-ba55-7f9e1d630170 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:23.886837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7db9c5e-c41b-4414-ba55-7f9e1d630170 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:23.889602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7db9c5e-c41b-4414-ba55-7f9e1d630170 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:23.890694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7db9c5e-c41b-4414-ba55-7f9e1d630170 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:23.901232 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-191c283f-b851-4c85-8b55-8ed2564eae5c tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] HTTP exception thrown: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-191c283f-b851-4c85-8b55-8ed2564eae5c tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Request method failure captured: Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42 HTTP/1.1 Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nInn7VPAp4fGxdXjRIh34FuxDlpXQ0xWDhVqMTn1d1kc8eMnJrQRIeg92JJmmUiDXDN2XbXQltPN63OUXQeb13qdWJhJBByJx8Hd5wzYHO5kBDn9zMNvaOcRSj4_3rOVajnas8QNHjxsxgoHhFdHzxuCsKhw_2O6Dw7YIo8zS65Nqs Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8e47994651049909de94dd63a67dbfc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 3dc328a5959f4a37aa6bda2e6610ffd4 Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'd3076ab8-1d52-4251-b6df-e16f82ff0a42'} Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:42:23.908367 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:42:23.919810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:23.919810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.919810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:23.919810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.919810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:23.919810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:23.919810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:23.919810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:23.919810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:23.919810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:23.919810 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:23.926452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-191c283f-b851-4c85-8b55-8ed2564eae5c tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Returning 404 to user: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:23.928447 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-191c283f-b851-4c85-8b55-8ed2564eae5c tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42" status: 404 len: 111 microversion: 2.1 time: 0.146669 Aug 09 14:42:23.932827 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1475/2847] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:42:23 2022] DELETE /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:42:23.949198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7068e211-4300-41a4-a67b-bf8b1802c646 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:23.954406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7068e211-4300-41a4-a67b-bf8b1802c646 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:23.979490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7068e211-4300-41a4-a67b-bf8b1802c646 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:23.980051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7068e211-4300-41a4-a67b-bf8b1802c646 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:23.980487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7068e211-4300-41a4-a67b-bf8b1802c646 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:23.982570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7068e211-4300-41a4-a67b-bf8b1802c646 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:23.983040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7068e211-4300-41a4-a67b-bf8b1802c646 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:23.983492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7068e211-4300-41a4-a67b-bf8b1802c646 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:24.770385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7db9c5e-c41b-4414-ba55-7f9e1d630170 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:24.786898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:24.795990 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7db9c5e-c41b-4414-ba55-7f9e1d630170 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1260 microversion: 2.1 time: 0.975460 Aug 09 14:42:24.797421 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1373/2848] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:23 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1260 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:24.808464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-69d88ac7-0e8b-49f5-bb77-9659e6459abf tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41de4d60d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:24.904106 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-69d88ac7-0e8b-49f5-bb77-9659e6459abf tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 200 len: 1422 microversion: 2.1 time: 0.104625 Aug 09 14:42:24.905507 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1374/2849] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:24 2022] GET /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 1422 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:24.922120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2306d72-e4ce-4574-a239-a6d6c2db83bf tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:24.922711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c2306d72-e4ce-4574-a239-a6d6c2db83bf tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 243e6add-76f2-406c-b10d-5d261cdd308a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:24.930902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2306d72-e4ce-4574-a239-a6d6c2db83bf tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:24.936231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2306d72-e4ce-4574-a239-a6d6c2db83bf tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:24.936769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2306d72-e4ce-4574-a239-a6d6c2db83bf tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:24.937578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2306d72-e4ce-4574-a239-a6d6c2db83bf tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:24.938103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2306d72-e4ce-4574-a239-a6d6c2db83bf tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:24.938589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2306d72-e4ce-4574-a239-a6d6c2db83bf tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:24.992642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c2306d72-e4ce-4574-a239-a6d6c2db83bf tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 243e6add-76f2-406c-b10d-5d261cdd308a] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:42:25.182451 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2306d72-e4ce-4574-a239-a6d6c2db83bf tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "DELETE /compute/v2.1/servers/243e6add-76f2-406c-b10d-5d261cdd308a" status: 204 len: 0 microversion: 2.1 time: 0.273167 Aug 09 14:42:25.183276 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1375/2850] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:42:24 2022] DELETE /compute/v2.1/servers/243e6add-76f2-406c-b10d-5d261cdd308a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:25.192286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ae1812a-469e-49c2-bf78-691f5f51ff7a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddeb5160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:25.332920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7068e211-4300-41a4-a67b-bf8b1802c646 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:25.347071 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7068e211-4300-41a4-a67b-bf8b1802c646 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1518 microversion: 2.1 time: 1.407770 Aug 09 14:42:25.365591 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1476/2851] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:23 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1518 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:25.376913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-167d86c8-0123-4eef-8d97-7820e7835cec tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:25.377420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-167d86c8-0123-4eef-8d97-7820e7835cec tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:25.389961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-167d86c8-0123-4eef-8d97-7820e7835cec tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:25.390463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-167d86c8-0123-4eef-8d97-7820e7835cec tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:25.393230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-167d86c8-0123-4eef-8d97-7820e7835cec tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:25.395968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-167d86c8-0123-4eef-8d97-7820e7835cec tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:25.396519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-167d86c8-0123-4eef-8d97-7820e7835cec tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:25.396953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-167d86c8-0123-4eef-8d97-7820e7835cec tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:25.460485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-167d86c8-0123-4eef-8d97-7820e7835cec tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:42:25.668709 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-167d86c8-0123-4eef-8d97-7820e7835cec tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 204 len: 0 microversion: 2.1 time: 0.298944 Aug 09 14:42:25.676582 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1477/2852] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:42:25 2022] DELETE /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:25.684643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b405acb-0fe5-4607-ad78-268efbbb33b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b405acb-0fe5-4607-ad78-268efbbb33b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action HTTP/1.1 Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 285 Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '12bc6eac-f858-4da3-879e-9d234ce4e726', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:25.702867 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b405acb-0fe5-4607-ad78-268efbbb33b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b405acb-0fe5-4607-ad78-268efbbb33b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action" status: 400 len: 619 microversion: 2.1 time: 0.024376 Aug 09 14:42:25.706047 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1478/2853] 10.222.0.50 () {60 vars in 1279 bytes} [Tue Aug 9 14:42:25 2022] POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:42:25.732189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8f599a32-7b52-4c7d-b1b1-b8ecc703b063 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:25.732921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8f599a32-7b52-4c7d-b1b1-b8ecc703b063 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: d3076ab8-1d52-4251-b6df-e16f82ff0a42] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:25.748935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f599a32-7b52-4c7d-b1b1-b8ecc703b063 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:25.752101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f599a32-7b52-4c7d-b1b1-b8ecc703b063 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:25.753119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f599a32-7b52-4c7d-b1b1-b8ecc703b063 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:25.756380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f599a32-7b52-4c7d-b1b1-b8ecc703b063 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:25.757251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f599a32-7b52-4c7d-b1b1-b8ecc703b063 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:25.759736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f599a32-7b52-4c7d-b1b1-b8ecc703b063 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:25.791478 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-8f599a32-7b52-4c7d-b1b1-b8ecc703b063 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] HTTP exception thrown: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8f599a32-7b52-4c7d-b1b1-b8ecc703b063 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Request method failure captured: Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42 HTTP/1.1 Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nInn7VPAp4fGxdXjRIh34FuxDlpXQ0xWDhVqMTn1d1kc8eMnJrQRIeg92JJmmUiDXDN2XbXQltPN63OUXQeb13qdWJhJBByJx8Hd5wzYHO5kBDn9zMNvaOcRSj4_3rOVajnas8QNHjxsxgoHhFdHzxuCsKhw_2O6Dw7YIo8zS65Nqs Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8e47994651049909de94dd63a67dbfc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 3dc328a5959f4a37aa6bda2e6610ffd4 Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'd3076ab8-1d52-4251-b6df-e16f82ff0a42'} Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:25.793351 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:25.797937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:25.797937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:25.797937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:25.797937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:25.797937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:25.797937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:25.797937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. Aug 09 14:42:25.797937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:25.801027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8f599a32-7b52-4c7d-b1b1-b8ecc703b063 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Returning 404 to user: Instance d3076ab8-1d52-4251-b6df-e16f82ff0a42 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:25.805339 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8f599a32-7b52-4c7d-b1b1-b8ecc703b063 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42" status: 404 len: 111 microversion: 2.1 time: 0.087617 Aug 09 14:42:25.806454 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1479/2854] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:25 2022] GET /compute/v2.1/servers/d3076ab8-1d52-4251-b6df-e16f82ff0a42 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:42:25.817023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7849ac3c-ca22-407c-99d3-9ba33a66f250 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:25.819372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7849ac3c-ca22-407c-99d3-9ba33a66f250 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:25.828976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7849ac3c-ca22-407c-99d3-9ba33a66f250 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:25.829760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7849ac3c-ca22-407c-99d3-9ba33a66f250 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:25.830407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7849ac3c-ca22-407c-99d3-9ba33a66f250 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:25.831918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7849ac3c-ca22-407c-99d3-9ba33a66f250 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:25.832543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7849ac3c-ca22-407c-99d3-9ba33a66f250 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:25.834599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7849ac3c-ca22-407c-99d3-9ba33a66f250 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:26.423590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7849ac3c-ca22-407c-99d3-9ba33a66f250 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:26.434617 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ae1812a-469e-49c2-bf78-691f5f51ff7a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 204 len: 0 microversion: 2.1 time: 1.249816 Aug 09 14:42:26.436525 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1376/2855] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:25 2022] DELETE /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 0 bytes in 1253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:26.442013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-805d70d0-b5f1-4399-b65d-c347b423a4eb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:26.442818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-805d70d0-b5f1-4399-b65d-c347b423a4eb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 243e6add-76f2-406c-b10d-5d261cdd308a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:26.444109 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7849ac3c-ca22-407c-99d3-9ba33a66f250 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1518 microversion: 2.1 time: 0.636022 Aug 09 14:42:26.445203 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1480/2856] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:25 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1518 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:26.458891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-805d70d0-b5f1-4399-b65d-c347b423a4eb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:26.460569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-805d70d0-b5f1-4399-b65d-c347b423a4eb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:26.461403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-805d70d0-b5f1-4399-b65d-c347b423a4eb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:26.464098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-805d70d0-b5f1-4399-b65d-c347b423a4eb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:26.464645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-805d70d0-b5f1-4399-b65d-c347b423a4eb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:26.465825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-805d70d0-b5f1-4399-b65d-c347b423a4eb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:26.466809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-564f23e0-45c3-4c82-b5bf-5ec3fe1764b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:26.467473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-564f23e0-45c3-4c82-b5bf-5ec3fe1764b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:26.486418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-564f23e0-45c3-4c82-b5bf-5ec3fe1764b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:26.486823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-564f23e0-45c3-4c82-b5bf-5ec3fe1764b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:26.487295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-564f23e0-45c3-4c82-b5bf-5ec3fe1764b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:26.491165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-564f23e0-45c3-4c82-b5bf-5ec3fe1764b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:26.491802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-564f23e0-45c3-4c82-b5bf-5ec3fe1764b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:26.492434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-564f23e0-45c3-4c82-b5bf-5ec3fe1764b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:26.750516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-564f23e0-45c3-4c82-b5bf-5ec3fe1764b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:26.759913 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-564f23e0-45c3-4c82-b5bf-5ec3fe1764b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1266 microversion: 2.1 time: 0.313417 Aug 09 14:42:26.760508 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1481/2857] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:26 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:26.781696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-920b458c-4f78-4a28-ae36-036c9d3f4bb7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:26.782333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-920b458c-4f78-4a28-ae36-036c9d3f4bb7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:26.792641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-920b458c-4f78-4a28-ae36-036c9d3f4bb7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:26.793262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-920b458c-4f78-4a28-ae36-036c9d3f4bb7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:26.793609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-920b458c-4f78-4a28-ae36-036c9d3f4bb7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:26.794503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-920b458c-4f78-4a28-ae36-036c9d3f4bb7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:26.795325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-920b458c-4f78-4a28-ae36-036c9d3f4bb7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:26.796067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-920b458c-4f78-4a28-ae36-036c9d3f4bb7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:26.857092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-920b458c-4f78-4a28-ae36-036c9d3f4bb7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:42:26.916464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-805d70d0-b5f1-4399-b65d-c347b423a4eb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:26.935058 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-805d70d0-b5f1-4399-b65d-c347b423a4eb tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/243e6add-76f2-406c-b10d-5d261cdd308a" status: 200 len: 1523 microversion: 2.1 time: 0.494970 Aug 09 14:42:26.972543 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1377/2858] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:26 2022] GET /compute/v2.1/servers/243e6add-76f2-406c-b10d-5d261cdd308a => generated 1523 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:26.988080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55e69b0d-9399-4555-ac63-3f43c78c1590 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:26.991991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55e69b0d-9399-4555-ac63-3f43c78c1590 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:27.025754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55e69b0d-9399-4555-ac63-3f43c78c1590 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:27.027666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55e69b0d-9399-4555-ac63-3f43c78c1590 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:27.028924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55e69b0d-9399-4555-ac63-3f43c78c1590 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:27.035716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55e69b0d-9399-4555-ac63-3f43c78c1590 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:27.037175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55e69b0d-9399-4555-ac63-3f43c78c1590 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:27.038426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55e69b0d-9399-4555-ac63-3f43c78c1590 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:27.153176 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-920b458c-4f78-4a28-ae36-036c9d3f4bb7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 204 len: 0 microversion: 2.1 time: 0.384965 Aug 09 14:42:27.154057 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1482/2859] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:42:26 2022] DELETE /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:27.495403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee19fd44-3a96-4ff6-8d86-49cb7465aa16 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Action: 'create', calling method: .version_select at 0x7f41dd3b0790>, body: {"keypair": {"name": "tempest-keypair-46691516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhOscEE6QoxkQ9Hpi6nMDWIwndCCAJ5BJeE/K+HFxFHwyy17pPSNO6ZNuhwOHUWs/cz1FemlgU/AoZoxUt31RzTccF+6lfhqm+dWNCmuEdfRMZXxsyR8edA4uA2oljOoA=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:27.516891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ee19fd44-3a96-4ff6-8d86-49cb7465aa16 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:27.526774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ee19fd44-3a96-4ff6-8d86-49cb7465aa16 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for user bf63fbe4a4c247878b9daa24ec69f9b6 and project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:27.532042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-55e69b0d-9399-4555-ac63-3f43c78c1590 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:27.541071 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-55e69b0d-9399-4555-ac63-3f43c78c1590 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1518 microversion: 2.1 time: 0.566129 Aug 09 14:42:27.542514 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1378/2860] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:26 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1518 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:27.573631 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee19fd44-3a96-4ff6-8d86-49cb7465aa16 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.2 time: 0.418201 Aug 09 14:42:27.574256 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1483/2861] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 9 14:42:27 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 420 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 14:42:27.584210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1040402498", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "2885fc04-1f81-4377-a25b-f064edeb4235"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:27.621658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-266c51ab-df67-45bd-8cb6-ba8c589a5f64 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:27.632959 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-266c51ab-df67-45bd-8cb6-ba8c589a5f64 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.089211 Aug 09 14:42:27.647296 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1379/2862] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:42:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:27.654865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-480e5967-94be-416a-8506-d4a93d9ff11e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1792277874"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:27.658277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-480e5967-94be-416a-8506-d4a93d9ff11e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:27.667186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-480e5967-94be-416a-8506-d4a93d9ff11e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:27.669313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-480e5967-94be-416a-8506-d4a93d9ff11e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:27.669745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-480e5967-94be-416a-8506-d4a93d9ff11e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:27.670756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-480e5967-94be-416a-8506-d4a93d9ff11e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:27.671379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-480e5967-94be-416a-8506-d4a93d9ff11e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:27.671945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-480e5967-94be-416a-8506-d4a93d9ff11e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:27.689912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] validate_networks() for [('2885fc04-1f81-4377-a25b-f064edeb4235', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:42:28.025418 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-480e5967-94be-416a-8506-d4a93d9ff11e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action" status: 202 len: 0 microversion: 2.1 time: 0.370854 Aug 09 14:42:28.025418 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1380/2863] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:42:27 2022] POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 14:42:28.040101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67390074-6749-4f0b-8102-4feb58e7bfae tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41dd3941f0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:28.053608 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-67390074-6749-4f0b-8102-4feb58e7bfae tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-46691516" status: 200 len: 511 microversion: 2.2 time: 0.024835 Aug 09 14:42:28.054847 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1381/2864] 10.222.0.50 () {60 vars in 1252 bytes} [Tue Aug 9 14:42:28 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-46691516 => generated 511 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:28.076693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f6d331e-567f-4254-92ba-c11150079f46 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:28.131628 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3f6d331e-567f-4254-92ba-c11150079f46 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.074673 Aug 09 14:42:28.146219 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1382/2865] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 14:42:28 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:28.160823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c782b9dc-2ccc-4753-9153-e08192f471ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:28.161580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c782b9dc-2ccc-4753-9153-e08192f471ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:28.177923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c782b9dc-2ccc-4753-9153-e08192f471ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:28.184350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c782b9dc-2ccc-4753-9153-e08192f471ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:28.184946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c782b9dc-2ccc-4753-9153-e08192f471ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:28.185695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c782b9dc-2ccc-4753-9153-e08192f471ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:28.186149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c782b9dc-2ccc-4753-9153-e08192f471ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:28.186564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c782b9dc-2ccc-4753-9153-e08192f471ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:28.573594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c782b9dc-2ccc-4753-9153-e08192f471ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:28.620434 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c782b9dc-2ccc-4753-9153-e08192f471ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1308 microversion: 2.1 time: 0.470226 Aug 09 14:42:28.629695 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1383/2866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:28 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1308 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:28.643846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ae15511-582f-4ee6-bf5e-5d7eca5120f8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:28.644723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ae15511-582f-4ee6-bf5e-5d7eca5120f8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 243e6add-76f2-406c-b10d-5d261cdd308a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:28.690849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ae15511-582f-4ee6-bf5e-5d7eca5120f8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:28.691366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ae15511-582f-4ee6-bf5e-5d7eca5120f8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:28.691805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ae15511-582f-4ee6-bf5e-5d7eca5120f8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:28.692516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ae15511-582f-4ee6-bf5e-5d7eca5120f8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:28.692969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ae15511-582f-4ee6-bf5e-5d7eca5120f8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:28.693454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ae15511-582f-4ee6-bf5e-5d7eca5120f8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:29.098143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:42:29.099109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:42:29.099935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:42:29.101864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:42:29.102746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:42:29.123885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:29.126404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:29.127490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:29.128592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:29.130677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:29.132133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:29.185033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Getting quotas for project 426fbb89ba614432b3a0cb87e0e4cd69. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:29.202271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Getting quotas for user d1d53fbb760a4b9282197668b9296c38 and project 426fbb89ba614432b3a0cb87e0e4cd69. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:29.240515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:42:29.242899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:42:29.335148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ae15511-582f-4ee6-bf5e-5d7eca5120f8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3dc328a5959f4a37aa6bda2e6610ffd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8e47994651049909de94dd63a67dbfc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:29.349631 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ae15511-582f-4ee6-bf5e-5d7eca5120f8 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/243e6add-76f2-406c-b10d-5d261cdd308a" status: 200 len: 1523 microversion: 2.1 time: 0.717398 Aug 09 14:42:29.370114 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1384/2867] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:28 2022] GET /compute/v2.1/servers/243e6add-76f2-406c-b10d-5d261cdd308a => generated 1523 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:29.378232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7da8a996-10f3-438e-850a-32db5cb79746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-891308080"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:29.383751 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba734f1f-cfd3-4f82-a68e-8e28a472e547 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.806978 Aug 09 14:42:29.394734 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1484/2868] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:42:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:42:29.395662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7da8a996-10f3-438e-850a-32db5cb79746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:29.431347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c9bebfdf-1991-4f96-b0d2-114ed5aab6ac tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41dd3b00d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:29.438631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7da8a996-10f3-438e-850a-32db5cb79746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:29.440663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7da8a996-10f3-438e-850a-32db5cb79746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:29.442889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7da8a996-10f3-438e-850a-32db5cb79746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:29.448882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7da8a996-10f3-438e-850a-32db5cb79746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:29.450698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7da8a996-10f3-438e-850a-32db5cb79746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:29.452243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7da8a996-10f3-438e-850a-32db5cb79746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:29.519040 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c9bebfdf-1991-4f96-b0d2-114ed5aab6ac tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46691516" status: 204 len: 0 microversion: 2.2 time: 0.108931 Aug 09 14:42:29.529829 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1485/2869] 10.222.0.50 () {60 vars in 1255 bytes} [Tue Aug 9 14:42:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46691516 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:29.546869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b779285d-5bf5-4283-8b69-49df75bc9b38 req-1eea07bd-90c6-4064-88e5-900dd6bd8954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e3bd4a-f659-481c-bdeb-dfd8b8642d34", "name": "network-vif-unplugged", "status": "completed", "tag": "f1456a38-c035-49d9-bc56-a6e3427ec464"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:29.602097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b779285d-5bf5-4283-8b69-49df75bc9b38 req-1eea07bd-90c6-4064-88e5-900dd6bd8954 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:29.604495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b779285d-5bf5-4283-8b69-49df75bc9b38 req-1eea07bd-90c6-4064-88e5-900dd6bd8954 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:29.605685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b779285d-5bf5-4283-8b69-49df75bc9b38 req-1eea07bd-90c6-4064-88e5-900dd6bd8954 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:29.614582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:29.614824 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-7da8a996-10f3-438e-850a-32db5cb79746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] HTTP exception thrown: Cannot 'createImage' instance 12bc6eac-f858-4da3-879e-9d234ce4e726 while it is in task_state image_snapshot Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7da8a996-10f3-438e-850a-32db5cb79746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action HTTP/1.1 Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 84 Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-891308080"}} Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: exception: Cannot 'createImage' instance 12bc6eac-f858-4da3-879e-9d234ce4e726 while it is in task_state image_snapshot Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '12bc6eac-f858-4da3-879e-9d234ce4e726', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-891308080'}}} Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 14:42:29.617604 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 12bc6eac-f858-4da3-879e-9d234ce4e726 while it is in task_state image_snapshot Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 12bc6eac-f858-4da3-879e-9d234ce4e726 while it is in task_state image_snapshot Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7da8a996-10f3-438e-850a-32db5cb79746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 409 to user: Cannot 'createImage' instance 12bc6eac-f858-4da3-879e-9d234ce4e726 while it is in task_state image_snapshot {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7da8a996-10f3-438e-850a-32db5cb79746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action" status: 409 len: 159 microversion: 2.1 time: 0.248141 Aug 09 14:42:29.621694 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1385/2870] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:42:29 2022] POST /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726/action => generated 159 bytes in 250 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:42:29.626080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-351eb657-2d16-46fb-b89c-5c0e319ff566 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:29.638444 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-351eb657-2d16-46fb-b89c-5c0e319ff566 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016022 Aug 09 14:42:29.638950 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1386/2871] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:42:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:29.652323 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b779285d-5bf5-4283-8b69-49df75bc9b38 req-1eea07bd-90c6-4064-88e5-900dd6bd8954 service nova] Creating event network-vif-unplugged:f1456a38-c035-49d9-bc56-a6e3427ec464 for instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 on n-h1-844626-8 Aug 09 14:42:29.665878 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b779285d-5bf5-4283-8b69-49df75bc9b38 req-1eea07bd-90c6-4064-88e5-900dd6bd8954 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133846 Aug 09 14:42:29.674649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-718f6a68-b05e-4d9f-ac90-93c08fd3c97e req-b29d6aa9-965c-4fe6-93b3-5919f2542924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6087e9ac-3786-4f17-8643-e76c04805347", "name": "network-vif-deleted", "tag": "e24c9d90-e1c7-4877-a50f-59327870c3a9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:29.681474 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1486/2872] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:29.695326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d7d7d053-b43d-4800-9be3-f677a6614bd9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:29.696224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d7d7d053-b43d-4800-9be3-f677a6614bd9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:29.702189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-718f6a68-b05e-4d9f-ac90-93c08fd3c97e req-b29d6aa9-965c-4fe6-93b3-5919f2542924 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:29.703356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-718f6a68-b05e-4d9f-ac90-93c08fd3c97e req-b29d6aa9-965c-4fe6-93b3-5919f2542924 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:29.712180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-718f6a68-b05e-4d9f-ac90-93c08fd3c97e req-b29d6aa9-965c-4fe6-93b3-5919f2542924 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:29.754048 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-718f6a68-b05e-4d9f-ac90-93c08fd3c97e req-b29d6aa9-965c-4fe6-93b3-5919f2542924 service nova] Creating event network-vif-deleted:e24c9d90-e1c7-4877-a50f-59327870c3a9 for instance 6087e9ac-3786-4f17-8643-e76c04805347 on n-h2-844626-8 Aug 09 14:42:29.789919 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-718f6a68-b05e-4d9f-ac90-93c08fd3c97e req-b29d6aa9-965c-4fe6-93b3-5919f2542924 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126714 Aug 09 14:42:29.792310 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1387/2873] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:29.803765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c776af00-067a-459b-b730-37dbd695f6d9 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Action: 'create', calling method: .version_select at 0x7f41e755f280>, body: {"keypair": {"name": "tempest-keypair-171957949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoYCYKRPuxzij+6WC3IhIUqomFzh3LIi//3Pt1B4KiFRh8xaA7tarS39fp2KzmDcFwxmKLKr2g/+/x9vms+dWyX/iJUkEtpcaDVKxNBvefRm7K9ZOb9Ta6XGx2yYbEd+g=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:29.852031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-c776af00-067a-459b-b730-37dbd695f6d9 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:29.865886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-c776af00-067a-459b-b730-37dbd695f6d9 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for user bf63fbe4a4c247878b9daa24ec69f9b6 and project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:29.924022 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c776af00-067a-459b-b730-37dbd695f6d9 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.128166 Aug 09 14:42:29.924991 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1388/2874] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 9 14:42:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 14:42:29.932139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-65725eb8-9071-4c6d-ae97-690388377ca8 req-0efe6eae-26b1-47ce-8760-6a4cbcb8a896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243e6add-76f2-406c-b10d-5d261cdd308a", "name": "network-vif-deleted", "tag": "fc869650-5ef2-45a9-ae8d-d8e838fcaecb"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:29.944314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-65725eb8-9071-4c6d-ae97-690388377ca8 req-0efe6eae-26b1-47ce-8760-6a4cbcb8a896 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:29.945172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-65725eb8-9071-4c6d-ae97-690388377ca8 req-0efe6eae-26b1-47ce-8760-6a4cbcb8a896 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:29.946063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-65725eb8-9071-4c6d-ae97-690388377ca8 req-0efe6eae-26b1-47ce-8760-6a4cbcb8a896 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:29.962161 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-65725eb8-9071-4c6d-ae97-690388377ca8 req-0efe6eae-26b1-47ce-8760-6a4cbcb8a896 service nova] Creating event network-vif-deleted:fc869650-5ef2-45a9-ae8d-d8e838fcaecb for instance 243e6add-76f2-406c-b10d-5d261cdd308a on n-h1-844626-8 Aug 09 14:42:29.968292 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-65725eb8-9071-4c6d-ae97-690388377ca8 req-0efe6eae-26b1-47ce-8760-6a4cbcb8a896 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041845 Aug 09 14:42:29.969327 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1389/2875] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:29.981581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a76312f-9f1a-435e-a87b-6de4fdf5a939 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '.version_select at 0x7f41dd3bc940>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:30.200976 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a76312f-9f1a-435e-a87b-6de4fdf5a939 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "DELETE /compute/v2.1/images/f1debcf7-a8ce-435d-8ff1-23d0c8dddf6e" status: 204 len: 0 microversion: 2.1 time: 0.224587 Aug 09 14:42:30.202228 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1390/2876] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:29 2022] DELETE /compute/v2.1/images/f1debcf7-a8ce-435d-8ff1-23d0c8dddf6e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:30.208441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e77ac7c4-f1e1-418f-9646-3e2f25c12018 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:30.209562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e77ac7c4-f1e1-418f-9646-3e2f25c12018 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:30.217327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e77ac7c4-f1e1-418f-9646-3e2f25c12018 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:30.218127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e77ac7c4-f1e1-418f-9646-3e2f25c12018 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:30.218705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e77ac7c4-f1e1-418f-9646-3e2f25c12018 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:30.219898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e77ac7c4-f1e1-418f-9646-3e2f25c12018 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:30.220510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e77ac7c4-f1e1-418f-9646-3e2f25c12018 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:30.222684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e77ac7c4-f1e1-418f-9646-3e2f25c12018 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:30.657244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d7d7d053-b43d-4800-9be3-f677a6614bd9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:30.673528 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d7d7d053-b43d-4800-9be3-f677a6614bd9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1208 microversion: 2.1 time: 0.989947 Aug 09 14:42:30.674111 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1487/2877] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:29 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1208 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:30.689737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-895a058c-5848-4142-ad1c-bcd95dc7c521 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:30.705741 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-895a058c-5848-4142-ad1c-bcd95dc7c521 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026924 Aug 09 14:42:30.707505 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1488/2878] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:42:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:30.720028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81745042-6012-4a7f-8ae7-205b5b466ae4 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41dd402f70>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:30.752794 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81745042-6012-4a7f-8ae7-205b5b466ae4 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-171957949" status: 204 len: 0 microversion: 2.2 time: 0.044048 Aug 09 14:42:30.753857 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1489/2879] 10.222.0.50 () {60 vars in 1258 bytes} [Tue Aug 9 14:42:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-171957949 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:30.763651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-adea281d-e375-489c-87fb-e12916c2c746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:30.764589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-adea281d-e375-489c-87fb-e12916c2c746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:30.776963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adea281d-e375-489c-87fb-e12916c2c746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:30.777714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adea281d-e375-489c-87fb-e12916c2c746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:30.778320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adea281d-e375-489c-87fb-e12916c2c746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:30.779492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adea281d-e375-489c-87fb-e12916c2c746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:30.780163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adea281d-e375-489c-87fb-e12916c2c746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:30.780929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adea281d-e375-489c-87fb-e12916c2c746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:31.229837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e77ac7c4-f1e1-418f-9646-3e2f25c12018 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:31.244255 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e77ac7c4-f1e1-418f-9646-3e2f25c12018 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1308 microversion: 2.1 time: 1.040288 Aug 09 14:42:31.255112 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1391/2880] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:30 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1308 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:31.260561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac54c356-40cf-4194-a881-72952453bc9a tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:31.261171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ac54c356-40cf-4194-a881-72952453bc9a tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 243e6add-76f2-406c-b10d-5d261cdd308a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:31.271033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac54c356-40cf-4194-a881-72952453bc9a tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:31.271638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac54c356-40cf-4194-a881-72952453bc9a tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:31.272066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac54c356-40cf-4194-a881-72952453bc9a tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:31.272775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac54c356-40cf-4194-a881-72952453bc9a tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:31.273218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac54c356-40cf-4194-a881-72952453bc9a tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:31.273632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac54c356-40cf-4194-a881-72952453bc9a tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:31.313890 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ac54c356-40cf-4194-a881-72952453bc9a tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] HTTP exception thrown: Instance 243e6add-76f2-406c-b10d-5d261cdd308a could not be found. Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac54c356-40cf-4194-a881-72952453bc9a tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Request method failure captured: Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/243e6add-76f2-406c-b10d-5d261cdd308a HTTP/1.1 Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nInn7VPAp4fGxdXjRIh34FuxDlpXQ0xWDhVqMTn1d1kc8eMnJrQRIeg92JJmmUiDXDN2XbXQltPN63OUXQeb13qdWJhJBByJx8Hd5wzYHO5kBDn9zMNvaOcRSj4_3rOVajnas8QNHjxsxgoHhFdHzxuCsKhw_2O6Dw7YIo8zS65Nqs Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8e47994651049909de94dd63a67dbfc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3dc328a5959f4a37aa6bda2e6610ffd4 Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 243e6add-76f2-406c-b10d-5d261cdd308a could not be found. Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '243e6add-76f2-406c-b10d-5d261cdd308a'} Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243e6add-76f2-406c-b10d-5d261cdd308a could not be found. Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243e6add-76f2-406c-b10d-5d261cdd308a could not be found. Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:31.315590 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:31.321163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:31.321163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:31.321163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:31.321163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:31.321163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:31.321163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:31.321163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243e6add-76f2-406c-b10d-5d261cdd308a could not be found. Aug 09 14:42:31.321163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:31.321163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac54c356-40cf-4194-a881-72952453bc9a tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Returning 404 to user: Instance 243e6add-76f2-406c-b10d-5d261cdd308a could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:31.321163 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ac54c356-40cf-4194-a881-72952453bc9a tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/243e6add-76f2-406c-b10d-5d261cdd308a" status: 404 len: 111 microversion: 2.1 time: 0.070879 Aug 09 14:42:31.321163 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1392/2881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:31 2022] GET /compute/v2.1/servers/243e6add-76f2-406c-b10d-5d261cdd308a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:42:31.355231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7f7255c4-1bf0-4163-be66-70f69d1b306a tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:31.366774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-adea281d-e375-489c-87fb-e12916c2c746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:31.380372 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-adea281d-e375-489c-87fb-e12916c2c746 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1536 microversion: 2.1 time: 0.625081 Aug 09 14:42:31.381447 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1490/2882] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:30 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1536 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:31.393526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96c73cc0-2424-4bf5-9e89-1ce0f0c8b2a9 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Action: 'create', calling method: .version_select at 0x7f41dd640160>, body: {"keypair": {"name": "tempest-keypair-628123249", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:31.438928 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7f7255c4-1bf0-4163-be66-70f69d1b306a tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.097455 Aug 09 14:42:31.442078 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1393/2883] 10.222.0.50 () {58 vars in 1165 bytes} [Tue Aug 9 14:42:31 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:31.454262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4111eec-1d19-4b03-a254-da1c8e14cf49 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:31.463052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b4111eec-1d19-4b03-a254-da1c8e14cf49 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] [instance: 6087e9ac-3786-4f17-8643-e76c04805347] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:31.468394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-96c73cc0-2424-4bf5-9e89-1ce0f0c8b2a9 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:31.481353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4111eec-1d19-4b03-a254-da1c8e14cf49 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:31.481999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4111eec-1d19-4b03-a254-da1c8e14cf49 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:31.484691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4111eec-1d19-4b03-a254-da1c8e14cf49 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:31.487430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4111eec-1d19-4b03-a254-da1c8e14cf49 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:31.487822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-96c73cc0-2424-4bf5-9e89-1ce0f0c8b2a9 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for user bf63fbe4a4c247878b9daa24ec69f9b6 and project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:31.489491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4111eec-1d19-4b03-a254-da1c8e14cf49 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:31.490247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4111eec-1d19-4b03-a254-da1c8e14cf49 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:31.497459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:31.537793 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b4111eec-1d19-4b03-a254-da1c8e14cf49 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] HTTP exception thrown: Instance 6087e9ac-3786-4f17-8643-e76c04805347 could not be found. Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4111eec-1d19-4b03-a254-da1c8e14cf49 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Request method failure captured: Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 HTTP/1.1 Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nInn7VPAp4fGxdXjRIh34FuxDlpXQ0xWDhVqMTn1d1kc8eMnJrQRIeg92JJmmUiDXDN2XbXQltPN63OUXQeb13qdWJhJBByJx8Hd5wzYHO5kBDn9zMNvaOcRSj4_3rOVajnas8QNHjxsxgoHhFdHzxuCsKhw_2O6Dw7YIo8zS65Nqs Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8e47994651049909de94dd63a67dbfc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8e47994651049909de94dd63a67dbfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: c8e47994651049909de94dd63a67dbfc Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1440637892 Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3dc328a5959f4a37aa6bda2e6610ffd4 Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ListServersNegativeTestJSON-1440637892-project Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 6087e9ac-3786-4f17-8643-e76c04805347 could not be found. Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '6087e9ac-3786-4f17-8643-e76c04805347'} Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6087e9ac-3786-4f17-8643-e76c04805347 could not be found. Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6087e9ac-3786-4f17-8643-e76c04805347 could not be found. Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:31.539781 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:31.545010 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:31.545010 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:31.545010 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:31.545010 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:31.545010 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:31.545010 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:31.545010 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6087e9ac-3786-4f17-8643-e76c04805347 could not be found. Aug 09 14:42:31.545010 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:31.545010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4111eec-1d19-4b03-a254-da1c8e14cf49 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] Returning 404 to user: Instance 6087e9ac-3786-4f17-8643-e76c04805347 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:31.549791 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b4111eec-1d19-4b03-a254-da1c8e14cf49 tempest-ListServersNegativeTestJSON-1440637892 tempest-ListServersNegativeTestJSON-1440637892-project] 10.222.0.50 "GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347" status: 404 len: 111 microversion: 2.1 time: 0.101759 Aug 09 14:42:31.549791 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1394/2884] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:31 2022] GET /compute/v2.1/servers/6087e9ac-3786-4f17-8643-e76c04805347 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:42:31.557688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-512b36f7-b4ce-45dd-8c47-bfe696c18250 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:31.560195 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-96c73cc0-2424-4bf5-9e89-1ce0f0c8b2a9 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.177382 Aug 09 14:42:31.567883 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1491/2885] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 9 14:42:31 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 14:42:31.575536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c6bd7692-eac9-4934-a03c-b50080e6b493 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41dd374c10>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:31.578298 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-512b36f7-b4ce-45dd-8c47-bfe696c18250 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030118 Aug 09 14:42:31.578927 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1395/2886] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:42:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:31.591816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c870cc0d-d775-4703-a28e-abfa055a05e1 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:31.613741 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c6bd7692-eac9-4934-a03c-b50080e6b493 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-628123249" status: 204 len: 0 microversion: 2.2 time: 0.044350 Aug 09 14:42:31.614352 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1492/2887] 10.222.0.50 () {60 vars in 1258 bytes} [Tue Aug 9 14:42:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-628123249 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:31.626901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0645f149-5ed5-41f8-97a3-3504ff59d209 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Action: 'create', calling method: .version_select at 0x7f41dd2d15e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-101329424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc0+jDD6GMlBLEeKd2nxsodKYutQBm756dAYFIdxZlCMuWA+ooIaVNdGRGn4FMk4voOEHJMLu0FxaF3K+WL/mLJaRiVC+rn98+0IsdoKEB+xAaGqMp/ll03Fqu4s1nW+A=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:31.650536 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c870cc0d-d775-4703-a28e-abfa055a05e1 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.063577 Aug 09 14:42:31.652127 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1396/2888] 10.222.0.50 () {58 vars in 1169 bytes} [Tue Aug 9 14:42:31 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:31.667678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5bc72bc5-eb27-4ebc-a915-9c74879906be tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:31.681456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0645f149-5ed5-41f8-97a3-3504ff59d209 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:31.692928 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5bc72bc5-eb27-4ebc-a915-9c74879906be tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.029407 Aug 09 14:42:31.697016 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1397/2889] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 14:42:31 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:42:31.697181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0645f149-5ed5-41f8-97a3-3504ff59d209 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for user bf63fbe4a4c247878b9daa24ec69f9b6 and project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:31.718851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d9f2b6aa-0825-4905-81f6-5cf86bbc95b1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:31.721069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d9f2b6aa-0825-4905-81f6-5cf86bbc95b1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:31.734207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9f2b6aa-0825-4905-81f6-5cf86bbc95b1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:31.734723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9f2b6aa-0825-4905-81f6-5cf86bbc95b1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:31.735431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9f2b6aa-0825-4905-81f6-5cf86bbc95b1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:31.744146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9f2b6aa-0825-4905-81f6-5cf86bbc95b1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:31.744812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9f2b6aa-0825-4905-81f6-5cf86bbc95b1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:31.745688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9f2b6aa-0825-4905-81f6-5cf86bbc95b1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:31.749369 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0645f149-5ed5-41f8-97a3-3504ff59d209 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.126952 Aug 09 14:42:31.751399 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1493/2890] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 9 14:42:31 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 09 14:42:31.773891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-74c2f873-6330-45f0-9917-9c4196af2a03 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:31.796862 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-74c2f873-6330-45f0-9917-9c4196af2a03 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041683 Aug 09 14:42:31.797885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:31.798726 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1494/2891] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:42:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:31.810826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d1878dd-f4c5-40bb-b724-58e34781ff8b tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Action: 'create', calling method: .version_select at 0x7f41dd2d14c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1064547340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIojtbCqdXJAWW2syoumUTBg8SEkBALqvYy7ugk15Wgzfsv9wJHezYeRgJ3FgB4Ira3TIf95BYev4CCc6ob8GHmYc2p/snNegUAOQA00OnFbixKnk2qyXttfwPfR7fEDNQ=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:31.840331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3d1878dd-f4c5-40bb-b724-58e34781ff8b tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:31.845405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d9f2b6aa-0825-4905-81f6-5cf86bbc95b1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:31.849170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3d1878dd-f4c5-40bb-b724-58e34781ff8b tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for user bf63fbe4a4c247878b9daa24ec69f9b6 and project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:31.853111 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d9f2b6aa-0825-4905-81f6-5cf86bbc95b1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1278 microversion: 2.1 time: 0.154474 Aug 09 14:42:31.854771 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1398/2892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:31 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:31.859601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-90708970-6fda-4c00-9b99-2216f1e6afb8 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:31.903742 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-90708970-6fda-4c00-9b99-2216f1e6afb8 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.047542 Aug 09 14:42:31.915550 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1399/2893] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 9 14:42:31 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:31.921272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-08437fda-c785-4668-b0e4-b5a7de8b2edd req-76e980b9-2771-4bdc-8e5d-8d8bbeebe1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3", "tag": "a8dcb400-6f00-4747-896a-67f9b2a9657e"}, {"server_uuid": "d9e3bd4a-f659-481c-bdeb-dfd8b8642d34", "name": "network-vif-deleted", "tag": "f1456a38-c035-49d9-bc56-a6e3427ec464"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:31.932421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-08437fda-c785-4668-b0e4-b5a7de8b2edd req-76e980b9-2771-4bdc-8e5d-8d8bbeebe1d0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:31.933066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-08437fda-c785-4668-b0e4-b5a7de8b2edd req-76e980b9-2771-4bdc-8e5d-8d8bbeebe1d0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:31.933666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-08437fda-c785-4668-b0e4-b5a7de8b2edd req-76e980b9-2771-4bdc-8e5d-8d8bbeebe1d0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:31.947172 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3d1878dd-f4c5-40bb-b724-58e34781ff8b tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.144587 Aug 09 14:42:31.948319 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-08437fda-c785-4668-b0e4-b5a7de8b2edd req-76e980b9-2771-4bdc-8e5d-8d8bbeebe1d0 service nova] Creating event network-changed:a8dcb400-6f00-4747-896a-67f9b2a9657e for instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 on n-h2-844626-8 Aug 09 14:42:31.948989 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-08437fda-c785-4668-b0e4-b5a7de8b2edd req-76e980b9-2771-4bdc-8e5d-8d8bbeebe1d0 service nova] Creating event network-vif-deleted:f1456a38-c035-49d9-bc56-a6e3427ec464 for instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 on n-h1-844626-8 Aug 09 14:42:31.957756 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-08437fda-c785-4668-b0e4-b5a7de8b2edd req-76e980b9-2771-4bdc-8e5d-8d8bbeebe1d0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040316 Aug 09 14:42:31.958375 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1495/2894] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 9 14:42:31 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 14:42:31.959226 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1400/2895] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:31.964395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-98037979-e421-4b0f-8c57-782a8b5b6fac tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:31.964658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ebea934-cd83-486a-90e6-f35d2f3a7f98 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Action: 'create', calling method: .version_select at 0x7f41dd394af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1532094346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBHb95xP6AR6Kn0TA2ixHXSfp/YTZLIUxWDeGeIQD8vLRL1IgZPTwQjZ+7ulEwl3kL4syy9KuoCyKsLWrxAMZZgbSQTexwi14mNMtba9F6ymZawROEo4D3tMCgPLtQM+w=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:31.980669 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-98037979-e421-4b0f-8c57-782a8b5b6fac tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019258 Aug 09 14:42:31.983128 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1496/2896] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:42:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:31.990356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-5ebea934-cd83-486a-90e6-f35d2f3a7f98 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:31.996149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2282e92-c46c-4b62-8774-27c132d19ca0 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:31.996956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-5ebea934-cd83-486a-90e6-f35d2f3a7f98 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for user bf63fbe4a4c247878b9daa24ec69f9b6 and project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:32.025993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:32.034921 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2282e92-c46c-4b62-8774-27c132d19ca0 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.043195 Aug 09 14:42:32.039130 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1497/2897] 10.222.0.50 () {58 vars in 1144 bytes} [Tue Aug 9 14:42:31 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:32.052159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e51419d-d6bb-4aa4-b451-eeae2d26cbc7 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.057035 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ebea934-cd83-486a-90e6-f35d2f3a7f98 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.095119 Aug 09 14:42:32.059625 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1401/2898] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 9 14:42:31 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 14:42:32.061741 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e51419d-d6bb-4aa4-b451-eeae2d26cbc7 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013559 Aug 09 14:42:32.062462 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1498/2899] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:32.075280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f029db45-80f2-4fc8-af11-65c1c56dd3d9 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.085574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de297efe-98bf-477d-91a2-133f0018a202 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41e754d9d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.090757 n-d-844626-8 devstack@n-api.service[119406]: WARNING oslo_db.sqlalchemy.utils [None req-de297efe-98bf-477d-91a2-133f0018a202 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 09 14:42:32.099235 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-de297efe-98bf-477d-91a2-133f0018a202 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.031721 Aug 09 14:42:32.107012 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f029db45-80f2-4fc8-af11-65c1c56dd3d9 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.034131 Aug 09 14:42:32.107012 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1499/2900] 10.222.0.50 () {58 vars in 1148 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:32.108490 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1402/2901] 10.222.0.50 () {60 vars in 1177 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:32.122596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2fb69a6-f430-4cda-a5c0-5a5b568c3dd2 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41dd640160>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.123356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fdefbc0f-651e-4a48-a3ea-25da5998781e tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.155551 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fdefbc0f-651e-4a48-a3ea-25da5998781e tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.037164 Aug 09 14:42:32.157736 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d2fb69a6-f430-4cda-a5c0-5a5b568c3dd2 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1532094346" status: 204 len: 0 microversion: 2.2 time: 0.048536 Aug 09 14:42:32.159227 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1500/2902] 10.222.0.50 () {60 vars in 1321 bytes} [Tue Aug 9 14:42:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1532094346 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:32.167496 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1403/2903] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:32.175382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-12de0ee1-396c-45be-a51e-6b53903b5cb0 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41dd38bb80>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.178525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8cfa41fc-70c2-4008-85f9-02d4bd28f339 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.199280 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8cfa41fc-70c2-4008-85f9-02d4bd28f339 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025317 Aug 09 14:42:32.200148 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1404/2904] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:32.211839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f035b699-6ddc-47e5-bc62-b984dfeb26b5 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.225769 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-12de0ee1-396c-45be-a51e-6b53903b5cb0 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1064547340" status: 204 len: 0 microversion: 2.2 time: 0.061379 Aug 09 14:42:32.226377 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1501/2905] 10.222.0.50 () {60 vars in 1321 bytes} [Tue Aug 9 14:42:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1064547340 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:32.235057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-daac5f44-2041-4ed1-b856-24ad193ceb7f tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41dd3f3af0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.235753 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f035b699-6ddc-47e5-bc62-b984dfeb26b5 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.027223 Aug 09 14:42:32.236908 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1405/2906] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:42:32.256621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f10c2a99-4e4d-4fc6-8503-6b036b6a9681 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.280263 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-daac5f44-2041-4ed1-b856-24ad193ceb7f tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-101329424" status: 204 len: 0 microversion: 2.2 time: 0.049345 Aug 09 14:42:32.281120 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1502/2907] 10.222.0.50 () {60 vars in 1318 bytes} [Tue Aug 9 14:42:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-101329424 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:32.286014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f62f5a17-694b-474b-8efc-457999e57361 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.290446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f62f5a17-694b-474b-8efc-457999e57361 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:32.302144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f62f5a17-694b-474b-8efc-457999e57361 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:32.302662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f62f5a17-694b-474b-8efc-457999e57361 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:32.303140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f62f5a17-694b-474b-8efc-457999e57361 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:32.303848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f62f5a17-694b-474b-8efc-457999e57361 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:32.304292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f62f5a17-694b-474b-8efc-457999e57361 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:32.304709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f62f5a17-694b-474b-8efc-457999e57361 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:32.309689 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f10c2a99-4e4d-4fc6-8503-6b036b6a9681 tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058746 Aug 09 14:42:32.319749 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1406/2908] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:32.330587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f36077b4-c0f1-48d1-9497-5df667b06801 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Action: 'create', calling method: .version_select at 0x7f41dd34b430>, body: {"keypair": {"name": "tempest-keypair-527248318", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOAjc7/shsSE/vjRIxGK8tBPieYdk/t5FdG4aMDxliY12AbGPvhS9Rg7usGcyVYmWqUTw8Mjjutj1nhClcd1mX3gf/1Txpaq9ou49EKIO45on+kBvdVP2HgY206QyzLZw=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:32.374698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f36077b4-c0f1-48d1-9497-5df667b06801 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:32.385230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f36077b4-c0f1-48d1-9497-5df667b06801 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for user bf63fbe4a4c247878b9daa24ec69f9b6 and project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:32.430771 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f36077b4-c0f1-48d1-9497-5df667b06801 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.109790 Aug 09 14:42:32.431616 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1407/2909] 10.222.0.50 () {62 vars in 1199 bytes} [Tue Aug 9 14:42:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 09 14:42:32.441854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3098d9cd-b6f5-4b11-9301-a669ec1ad28a tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.451910 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3098d9cd-b6f5-4b11-9301-a669ec1ad28a tempest-FlavorsV2TestJSON-1206703904 tempest-FlavorsV2TestJSON-1206703904-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019446 Aug 09 14:42:32.453707 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1408/2910] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:32.466158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d1f7527-f00c-4d0f-8731-7f3721a0d588 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.467172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4d1f7527-f00c-4d0f-8731-7f3721a0d588 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:32.476866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d1f7527-f00c-4d0f-8731-7f3721a0d588 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:32.478488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d1f7527-f00c-4d0f-8731-7f3721a0d588 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:32.479294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d1f7527-f00c-4d0f-8731-7f3721a0d588 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:32.480303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d1f7527-f00c-4d0f-8731-7f3721a0d588 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:32.480998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d1f7527-f00c-4d0f-8731-7f3721a0d588 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:32.482305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d1f7527-f00c-4d0f-8731-7f3721a0d588 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:32.770310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f62f5a17-694b-474b-8efc-457999e57361 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:32.772025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d1f7527-f00c-4d0f-8731-7f3721a0d588 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:32.783476 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4d1f7527-f00c-4d0f-8731-7f3721a0d588 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1531 microversion: 2.1 time: 0.327523 Aug 09 14:42:32.785364 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1409/2911] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1531 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:32.792184 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f62f5a17-694b-474b-8efc-457999e57361 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1308 microversion: 2.1 time: 0.509125 Aug 09 14:42:32.797266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4641add2-4d67-4914-9146-c8496740a49b tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41e757e280>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.798372 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1503/2912] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1308 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:32.815288 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4641add2-4d67-4914-9146-c8496740a49b tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-527248318" status: 200 len: 512 microversion: 2.2 time: 0.028127 Aug 09 14:42:32.816861 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1410/2913] 10.222.0.50 () {60 vars in 1255 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-527248318 => generated 512 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:32.830648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bcfed872-21ca-435c-a281-cc3fd830e640 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41dee8b5e0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.836020 n-d-844626-8 devstack@n-api.service[119407]: WARNING oslo_db.sqlalchemy.utils [None req-bcfed872-21ca-435c-a281-cc3fd830e640 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 09 14:42:32.842622 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bcfed872-21ca-435c-a281-cc3fd830e640 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.018573 Aug 09 14:42:32.844157 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1504/2914] 10.222.0.50 () {60 vars in 1177 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:32.854566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34b6d91a-1d58-4ca3-b885-1778679b25fe tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41e74f8b80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.887961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c6cbe20b-2900-48af-81b3-606bf57ce3b9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:32.889183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c6cbe20b-2900-48af-81b3-606bf57ce3b9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:32.904069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6cbe20b-2900-48af-81b3-606bf57ce3b9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:32.904648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6cbe20b-2900-48af-81b3-606bf57ce3b9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:32.905153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6cbe20b-2900-48af-81b3-606bf57ce3b9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:32.905938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6cbe20b-2900-48af-81b3-606bf57ce3b9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:32.906461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6cbe20b-2900-48af-81b3-606bf57ce3b9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:32.906956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6cbe20b-2900-48af-81b3-606bf57ce3b9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:32.930586 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34b6d91a-1d58-4ca3-b885-1778679b25fe tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-527248318" status: 204 len: 0 microversion: 2.2 time: 0.079516 Aug 09 14:42:32.931669 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1411/2915] 10.222.0.50 () {60 vars in 1258 bytes} [Tue Aug 9 14:42:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-527248318 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:32.944330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e0f846a-fc41-41ab-a382-6d0b3010765a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Action: 'create', calling method: .version_select at 0x7f41dd347310>, body: {"keypair": {"name": "tempest-keypair-2073922031", "type": "x509"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:32.983808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-5e0f846a-fc41-41ab-a382-6d0b3010765a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:32.990124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-5e0f846a-fc41-41ab-a382-6d0b3010765a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for user bf63fbe4a4c247878b9daa24ec69f9b6 and project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:33.016039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.processutils [None req-5e0f846a-fc41-41ab-a382-6d0b3010765a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp0rqn3t27/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp0rqn3t27/temp.key -subj /CN=bf63fbe4a4c247878b9daa24ec69f9b6 -extensions v3_req_client {{(pid=119406) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 09 14:42:33.075710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c6cbe20b-2900-48af-81b3-606bf57ce3b9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:33.089366 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c6cbe20b-2900-48af-81b3-606bf57ce3b9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1266 microversion: 2.1 time: 0.218023 Aug 09 14:42:33.105326 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1505/2916] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:32 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:33.472348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.processutils [None req-5e0f846a-fc41-41ab-a382-6d0b3010765a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp0rqn3t27/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp0rqn3t27/temp.key -subj /CN=bf63fbe4a4c247878b9daa24ec69f9b6 -extensions v3_req_client" returned: 0 in 0.456s {{(pid=119406) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 09 14:42:33.474547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.processutils [None req-5e0f846a-fc41-41ab-a382-6d0b3010765a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp0rqn3t27/temp.key -password pass: {{(pid=119406) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 09 14:42:33.518679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.processutils [None req-5e0f846a-fc41-41ab-a382-6d0b3010765a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp0rqn3t27/temp.key -password pass:" returned: 0 in 0.042s {{(pid=119406) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 09 14:42:33.588820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-5e0f846a-fc41-41ab-a382-6d0b3010765a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:33.595240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-5e0f846a-fc41-41ab-a382-6d0b3010765a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Getting quotas for user bf63fbe4a4c247878b9daa24ec69f9b6 and project 0ded95a9b4354b06aa7ca84c1d876364. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:33.617578 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5e0f846a-fc41-41ab-a382-6d0b3010765a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.679958 Aug 09 14:42:33.618551 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1412/2917] 10.222.0.50 () {62 vars in 1198 bytes} [Tue Aug 9 14:42:32 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 682 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:33.629926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-25e1b268-e4ea-4d36-a962-9a70d6c3bc46 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41dd665a60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:33.645880 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-25e1b268-e4ea-4d36-a962-9a70d6c3bc46 tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-2073922031" status: 200 len: 1534 microversion: 2.2 time: 0.020692 Aug 09 14:42:33.648318 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1506/2918] 10.222.0.50 () {60 vars in 1258 bytes} [Tue Aug 9 14:42:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2073922031 => generated 1534 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:33.660455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3aba9f6d-cc00-42a1-9424-d89f8c5c718a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41e74f8b80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:33.668095 n-d-844626-8 devstack@n-api.service[119406]: WARNING oslo_db.sqlalchemy.utils [None req-3aba9f6d-cc00-42a1-9424-d89f8c5c718a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 09 14:42:33.678131 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3aba9f6d-cc00-42a1-9424-d89f8c5c718a tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.022708 Aug 09 14:42:33.680318 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1413/2919] 10.222.0.50 () {60 vars in 1177 bytes} [Tue Aug 9 14:42:33 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:42:33.692437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70ba19a0-96ee-48a2-ba83-5fca208c311c tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] Calling method '.version_select at 0x7f41dd388c10>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:33.717690 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70ba19a0-96ee-48a2-ba83-5fca208c311c tempest-KeyPairsV22TestJSON-619691687 tempest-KeyPairsV22TestJSON-619691687-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073922031" status: 204 len: 0 microversion: 2.2 time: 0.030931 Aug 09 14:42:33.718581 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1507/2920] 10.222.0.50 () {60 vars in 1261 bytes} [Tue Aug 9 14:42:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073922031 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:33.809294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9214c053-ef37-4e8f-9db7-d26f5aaff239 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:33.810086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9214c053-ef37-4e8f-9db7-d26f5aaff239 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:33.816176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1353aa1b-d2b4-4610-b19d-9d80cfda095e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:33.817041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1353aa1b-d2b4-4610-b19d-9d80cfda095e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:33.818179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9214c053-ef37-4e8f-9db7-d26f5aaff239 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:33.819864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9214c053-ef37-4e8f-9db7-d26f5aaff239 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:33.820181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9214c053-ef37-4e8f-9db7-d26f5aaff239 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:33.821060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9214c053-ef37-4e8f-9db7-d26f5aaff239 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:33.821644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9214c053-ef37-4e8f-9db7-d26f5aaff239 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:33.822161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9214c053-ef37-4e8f-9db7-d26f5aaff239 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:33.844999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1353aa1b-d2b4-4610-b19d-9d80cfda095e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:33.845526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1353aa1b-d2b4-4610-b19d-9d80cfda095e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:33.846812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1353aa1b-d2b4-4610-b19d-9d80cfda095e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:33.853899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1353aa1b-d2b4-4610-b19d-9d80cfda095e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:33.854397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1353aa1b-d2b4-4610-b19d-9d80cfda095e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:33.854856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1353aa1b-d2b4-4610-b19d-9d80cfda095e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:34.401537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9214c053-ef37-4e8f-9db7-d26f5aaff239 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:34.414936 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9214c053-ef37-4e8f-9db7-d26f5aaff239 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1518 microversion: 2.1 time: 0.611448 Aug 09 14:42:34.420189 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1414/2921] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:33 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1518 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:34.432809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1353aa1b-d2b4-4610-b19d-9d80cfda095e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:34.440357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae534b87-f959-485b-abc3-5a3de2d041ed tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:34.441561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae534b87-f959-485b-abc3-5a3de2d041ed tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:34.453767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae534b87-f959-485b-abc3-5a3de2d041ed tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:34.455202 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1353aa1b-d2b4-4610-b19d-9d80cfda095e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1308 microversion: 2.1 time: 0.642703 Aug 09 14:42:34.455839 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1508/2922] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:33 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1308 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:34.459845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae534b87-f959-485b-abc3-5a3de2d041ed tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:34.460784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae534b87-f959-485b-abc3-5a3de2d041ed tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:34.462070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae534b87-f959-485b-abc3-5a3de2d041ed tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:34.463241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae534b87-f959-485b-abc3-5a3de2d041ed tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:34.463941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae534b87-f959-485b-abc3-5a3de2d041ed tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:34.469381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-846325be-7cc7-4146-9f61-8bf6329035a0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:34.473584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-846325be-7cc7-4146-9f61-8bf6329035a0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:34.501530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-846325be-7cc7-4146-9f61-8bf6329035a0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:34.503666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-846325be-7cc7-4146-9f61-8bf6329035a0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:34.505121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-846325be-7cc7-4146-9f61-8bf6329035a0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:34.507829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-846325be-7cc7-4146-9f61-8bf6329035a0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:34.509219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-846325be-7cc7-4146-9f61-8bf6329035a0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:34.511983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-846325be-7cc7-4146-9f61-8bf6329035a0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:34.583173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-846325be-7cc7-4146-9f61-8bf6329035a0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:42:34.772772 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-846325be-7cc7-4146-9f61-8bf6329035a0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "DELETE /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 204 len: 0 microversion: 2.1 time: 0.314179 Aug 09 14:42:34.775409 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1509/2923] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:42:34 2022] DELETE /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:34.797649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7bb2e848-7bbf-40b6-9517-a9c0acb90fe3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:34.802080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7bb2e848-7bbf-40b6-9517-a9c0acb90fe3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:34.824280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb2e848-7bbf-40b6-9517-a9c0acb90fe3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:34.824962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb2e848-7bbf-40b6-9517-a9c0acb90fe3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:34.825189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb2e848-7bbf-40b6-9517-a9c0acb90fe3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:34.827988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb2e848-7bbf-40b6-9517-a9c0acb90fe3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:34.829908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb2e848-7bbf-40b6-9517-a9c0acb90fe3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:34.831223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb2e848-7bbf-40b6-9517-a9c0acb90fe3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:35.121110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ae534b87-f959-485b-abc3-5a3de2d041ed tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:35.125501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:35.132035 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae534b87-f959-485b-abc3-5a3de2d041ed tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1308 microversion: 2.1 time: 0.710147 Aug 09 14:42:35.133018 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1415/2924] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:34 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1308 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:35.138989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e278896c-5847-4518-9ae4-194b6d5ecfa9 req-83bd8dd1-feea-4051-b8ef-7bb812973a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bc6eac-f858-4da3-879e-9d234ce4e726", "name": "network-vif-plugged", "status": "completed", "tag": "a7053005-565b-4982-9441-02182697f575"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:35.152303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e278896c-5847-4518-9ae4-194b6d5ecfa9 req-83bd8dd1-feea-4051-b8ef-7bb812973a9a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:35.153123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e278896c-5847-4518-9ae4-194b6d5ecfa9 req-83bd8dd1-feea-4051-b8ef-7bb812973a9a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:35.154031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e278896c-5847-4518-9ae4-194b6d5ecfa9 req-83bd8dd1-feea-4051-b8ef-7bb812973a9a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:35.167882 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e278896c-5847-4518-9ae4-194b6d5ecfa9 req-83bd8dd1-feea-4051-b8ef-7bb812973a9a service nova] Creating event network-vif-plugged:a7053005-565b-4982-9441-02182697f575 for instance 12bc6eac-f858-4da3-879e-9d234ce4e726 on n-h1-844626-8 Aug 09 14:42:35.173896 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e278896c-5847-4518-9ae4-194b6d5ecfa9 req-83bd8dd1-feea-4051-b8ef-7bb812973a9a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039520 Aug 09 14:42:35.174958 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1416/2925] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:35.296577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7bb2e848-7bbf-40b6-9517-a9c0acb90fe3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:35.306704 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7bb2e848-7bbf-40b6-9517-a9c0acb90fe3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1524 microversion: 2.1 time: 0.523383 Aug 09 14:42:35.307583 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1510/2926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:34 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1524 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:35.340132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f47cdf45-37f0-410b-8a28-38620b7d3d93 tempest-FlavorsV2NegativeTest-1201774711 tempest-FlavorsV2NegativeTest-1201774711-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:35.350254 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f47cdf45-37f0-410b-8a28-38620b7d3d93 tempest-FlavorsV2NegativeTest-1201774711 tempest-FlavorsV2NegativeTest-1201774711-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.173860 Aug 09 14:42:35.351164 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1417/2927] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:42:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:35.477446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dbc6e0aa-2fb4-4784-b7af-41f02cc2c1d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:35.478289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dbc6e0aa-2fb4-4784-b7af-41f02cc2c1d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:35.489209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbc6e0aa-2fb4-4784-b7af-41f02cc2c1d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:35.489977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbc6e0aa-2fb4-4784-b7af-41f02cc2c1d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:35.490612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbc6e0aa-2fb4-4784-b7af-41f02cc2c1d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:35.491500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbc6e0aa-2fb4-4784-b7af-41f02cc2c1d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:35.492153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbc6e0aa-2fb4-4784-b7af-41f02cc2c1d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:35.492727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbc6e0aa-2fb4-4784-b7af-41f02cc2c1d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:35.693896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dbc6e0aa-2fb4-4784-b7af-41f02cc2c1d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:35.704627 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dbc6e0aa-2fb4-4784-b7af-41f02cc2c1d5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1308 microversion: 2.1 time: 0.230739 Aug 09 14:42:35.705830 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1511/2928] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:35 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1308 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:35.746526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8f1a723e-b5d4-4acd-a01e-99d0f667a515 req-297a4eb8-2b20-4e17-a48c-eaada0de85b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99173f66-b303-416e-b3ba-71109d2fc9f8", "tag": "af76a083-7c14-4aa2-856b-8763fd515266"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:35.760302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8f1a723e-b5d4-4acd-a01e-99d0f667a515 req-297a4eb8-2b20-4e17-a48c-eaada0de85b8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:35.761139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8f1a723e-b5d4-4acd-a01e-99d0f667a515 req-297a4eb8-2b20-4e17-a48c-eaada0de85b8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:35.762025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8f1a723e-b5d4-4acd-a01e-99d0f667a515 req-297a4eb8-2b20-4e17-a48c-eaada0de85b8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:35.775055 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8f1a723e-b5d4-4acd-a01e-99d0f667a515 req-297a4eb8-2b20-4e17-a48c-eaada0de85b8 service nova] Creating event network-changed:af76a083-7c14-4aa2-856b-8763fd515266 for instance 99173f66-b303-416e-b3ba-71109d2fc9f8 on n-h1-844626-8 Aug 09 14:42:35.780638 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8f1a723e-b5d4-4acd-a01e-99d0f667a515 req-297a4eb8-2b20-4e17-a48c-eaada0de85b8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040045 Aug 09 14:42:35.781525 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1418/2929] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:36.155026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-daedaa8e-1bb1-44b9-ae00-53df64b9922d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:36.155646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-daedaa8e-1bb1-44b9-ae00-53df64b9922d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:36.193722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daedaa8e-1bb1-44b9-ae00-53df64b9922d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:36.200508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daedaa8e-1bb1-44b9-ae00-53df64b9922d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:36.201322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daedaa8e-1bb1-44b9-ae00-53df64b9922d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:36.206787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daedaa8e-1bb1-44b9-ae00-53df64b9922d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:36.208821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daedaa8e-1bb1-44b9-ae00-53df64b9922d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:36.209685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-daedaa8e-1bb1-44b9-ae00-53df64b9922d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:36.334116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-45140e35-fa99-4360-911d-cdc6f57dca1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:36.335493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-45140e35-fa99-4360-911d-cdc6f57dca1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:36.349581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45140e35-fa99-4360-911d-cdc6f57dca1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:36.351827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45140e35-fa99-4360-911d-cdc6f57dca1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:36.352437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45140e35-fa99-4360-911d-cdc6f57dca1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:36.354471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45140e35-fa99-4360-911d-cdc6f57dca1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:36.356714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45140e35-fa99-4360-911d-cdc6f57dca1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:36.359276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45140e35-fa99-4360-911d-cdc6f57dca1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:36.770861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-daedaa8e-1bb1-44b9-ae00-53df64b9922d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:36.782392 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-daedaa8e-1bb1-44b9-ae00-53df64b9922d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1308 microversion: 2.1 time: 0.632850 Aug 09 14:42:36.791197 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1512/2930] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:36 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1308 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:36.797887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33cdabdf-6667-4854-b251-bb2240e45aa6 tempest-FlavorsV2NegativeTest-1201774711 tempest-FlavorsV2NegativeTest-1201774711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-485860104", "imageRef": "bd4d8b76-e070-4cba-9b8c-15c174ff6159", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:36.856181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45140e35-fa99-4360-911d-cdc6f57dca1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:36.865547 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-45140e35-fa99-4360-911d-cdc6f57dca1f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1524 microversion: 2.1 time: 0.537607 Aug 09 14:42:36.869794 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1419/2931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:36 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1524 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:36.875510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f3ee5bd-7c85-4e1c-8b29-b7d95d2a2ee9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:36.882541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6f3ee5bd-7c85-4e1c-8b29-b7d95d2a2ee9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:36.900738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-33cdabdf-6667-4854-b251-bb2240e45aa6 tempest-FlavorsV2NegativeTest-1201774711 tempest-FlavorsV2NegativeTest-1201774711-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:42:36.901585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f3ee5bd-7c85-4e1c-8b29-b7d95d2a2ee9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:36.902282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f3ee5bd-7c85-4e1c-8b29-b7d95d2a2ee9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:36.902916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f3ee5bd-7c85-4e1c-8b29-b7d95d2a2ee9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:36.903837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f3ee5bd-7c85-4e1c-8b29-b7d95d2a2ee9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:36.904440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f3ee5bd-7c85-4e1c-8b29-b7d95d2a2ee9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:36.905020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f3ee5bd-7c85-4e1c-8b29-b7d95d2a2ee9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:37.710113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f3ee5bd-7c85-4e1c-8b29-b7d95d2a2ee9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:37.730043 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f3ee5bd-7c85-4e1c-8b29-b7d95d2a2ee9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1308 microversion: 2.1 time: 0.847964 Aug 09 14:42:37.733677 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1420/2932] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:36 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1308 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:37.739614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-cf625498-a6b1-4a1c-af4d-7d21d9c456b7 req-3b439374-ddf3-41c7-b7cf-381ba58ede25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3", "name": "network-vif-plugged", "status": "completed", "tag": "a8dcb400-6f00-4747-896a-67f9b2a9657e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:37.768506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cf625498-a6b1-4a1c-af4d-7d21d9c456b7 req-3b439374-ddf3-41c7-b7cf-381ba58ede25 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:37.769236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cf625498-a6b1-4a1c-af4d-7d21d9c456b7 req-3b439374-ddf3-41c7-b7cf-381ba58ede25 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:37.769734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cf625498-a6b1-4a1c-af4d-7d21d9c456b7 req-3b439374-ddf3-41c7-b7cf-381ba58ede25 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:37.784495 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-cf625498-a6b1-4a1c-af4d-7d21d9c456b7 req-3b439374-ddf3-41c7-b7cf-381ba58ede25 service nova] Creating event network-vif-plugged:a8dcb400-6f00-4747-896a-67f9b2a9657e for instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 on n-h2-844626-8 Aug 09 14:42:37.792356 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-cf625498-a6b1-4a1c-af4d-7d21d9c456b7 req-3b439374-ddf3-41c7-b7cf-381ba58ede25 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057118 Aug 09 14:42:37.793577 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1421/2933] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:37.812811 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-33cdabdf-6667-4854-b251-bb2240e45aa6 tempest-FlavorsV2NegativeTest-1201774711 tempest-FlavorsV2NegativeTest-1201774711-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33cdabdf-6667-4854-b251-bb2240e45aa6 tempest-FlavorsV2NegativeTest-1201774711 tempest-FlavorsV2NegativeTest-1201774711-project] Request method failure captured: Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 142 Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nJav01IJ0ZvDPGNn2Ft2cTpjQDAElFBwEbreLPzQbssB0xIlJOh6_gI775jxxN8r9khVS66L6F3w-701Ku2aLiGUHJxncq0MfrdWoHsXatBYJiRdX47kvtBB6qaDmLWMlak4fFDNOAwmTs4l0qnhwzisiJPAivD_nvWo8zoF43Tm2U Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f2f5055617d9494a83488fea8896de2f Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-FlavorsV2NegativeTest-1201774711 Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f2f5055617d9494a83488fea8896de2f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f2f5055617d9494a83488fea8896de2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f2f5055617d9494a83488fea8896de2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f2f5055617d9494a83488fea8896de2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-FlavorsV2NegativeTest-1201774711 Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f2f5055617d9494a83488fea8896de2f Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1201774711 Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-FlavorsV2NegativeTest-1201774711-project Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 91f200874608401683471b2b9c913258 Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-FlavorsV2NegativeTest-1201774711-project Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-485860104", "imageRef": "bd4d8b76-e070-4cba-9b8c-15c174ff6159", "flavorRef": "452"}} Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: exception: Flavor's memory is too small for requested image. Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-485860104', 'imageRef': 'bd4d8b76-e070-4cba-9b8c-15c174ff6159', 'flavorRef': '452'}}} Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:42:37.814638 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 09 14:42:37.819358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:37.821355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33cdabdf-6667-4854-b251-bb2240e45aa6 tempest-FlavorsV2NegativeTest-1201774711 tempest-FlavorsV2NegativeTest-1201774711-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:37.822382 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-33cdabdf-6667-4854-b251-bb2240e45aa6 tempest-FlavorsV2NegativeTest-1201774711 tempest-FlavorsV2NegativeTest-1201774711-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.035934 Aug 09 14:42:37.823150 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1513/2934] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:42:36 2022] POST /compute/v2.1/servers => generated 93 bytes in 1037 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:42:37.843543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1930c828-1af5-401d-89e4-798aceb2c6e7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:37.845640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1930c828-1af5-401d-89e4-798aceb2c6e7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:37.864640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1930c828-1af5-401d-89e4-798aceb2c6e7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:37.865481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1930c828-1af5-401d-89e4-798aceb2c6e7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:37.866384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1930c828-1af5-401d-89e4-798aceb2c6e7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:37.867203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1930c828-1af5-401d-89e4-798aceb2c6e7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:37.874601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1930c828-1af5-401d-89e4-798aceb2c6e7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:37.875052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1930c828-1af5-401d-89e4-798aceb2c6e7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:38.197244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e48e4f96-cd11-4eb3-9c1c-dd458a5cdab7 tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] Calling method '.version_select at 0x7f41e74f8af0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:38.224583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e48e4f96-cd11-4eb3-9c1c-dd458a5cdab7 tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:38.225370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e48e4f96-cd11-4eb3-9c1c-dd458a5cdab7 tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:38.227222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e48e4f96-cd11-4eb3-9c1c-dd458a5cdab7 tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:38.229059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e48e4f96-cd11-4eb3-9c1c-dd458a5cdab7 tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:38.229684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e48e4f96-cd11-4eb3-9c1c-dd458a5cdab7 tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:38.231894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e48e4f96-cd11-4eb3-9c1c-dd458a5cdab7 tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:38.314969 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e48e4f96-cd11-4eb3-9c1c-dd458a5cdab7 tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] 10.222.0.50 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.516612 Aug 09 14:42:38.323662 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1422/2935] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 9 14:42:37 2022] GET /compute/v2.1/limits => generated 511 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:38.342461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4ecc46f-d1a2-4a4c-b10a-05e2ea2a0478 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:38.349985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b4ecc46f-d1a2-4a4c-b10a-05e2ea2a0478 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:38.366498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4ecc46f-d1a2-4a4c-b10a-05e2ea2a0478 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:38.367341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4ecc46f-d1a2-4a4c-b10a-05e2ea2a0478 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:38.367961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4ecc46f-d1a2-4a4c-b10a-05e2ea2a0478 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:38.369004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4ecc46f-d1a2-4a4c-b10a-05e2ea2a0478 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:38.370962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4ecc46f-d1a2-4a4c-b10a-05e2ea2a0478 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:38.371885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4ecc46f-d1a2-4a4c-b10a-05e2ea2a0478 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:38.389688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1930c828-1af5-401d-89e4-798aceb2c6e7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:38.410348 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1930c828-1af5-401d-89e4-798aceb2c6e7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1308 microversion: 2.1 time: 0.585821 Aug 09 14:42:38.419618 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1514/2936] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:37 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1308 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:38.509930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-de4ff908-0085-47a2-b7cb-e9144f614356 req-4ab7f868-f922-4af0-870f-357aa3fe6dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bc6eac-f858-4da3-879e-9d234ce4e726", "name": "network-vif-deleted", "tag": "a7053005-565b-4982-9441-02182697f575"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:38.531249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-de4ff908-0085-47a2-b7cb-e9144f614356 req-4ab7f868-f922-4af0-870f-357aa3fe6dc8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:38.537604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-de4ff908-0085-47a2-b7cb-e9144f614356 req-4ab7f868-f922-4af0-870f-357aa3fe6dc8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:38.538290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-de4ff908-0085-47a2-b7cb-e9144f614356 req-4ab7f868-f922-4af0-870f-357aa3fe6dc8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:38.580053 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-de4ff908-0085-47a2-b7cb-e9144f614356 req-4ab7f868-f922-4af0-870f-357aa3fe6dc8 service nova] Creating event network-vif-deleted:a7053005-565b-4982-9441-02182697f575 for instance 12bc6eac-f858-4da3-879e-9d234ce4e726 on n-h1-844626-8 Aug 09 14:42:38.589828 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-de4ff908-0085-47a2-b7cb-e9144f614356 req-4ab7f868-f922-4af0-870f-357aa3fe6dc8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087640 Aug 09 14:42:38.598569 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1515/2937] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 09 14:42:38.691621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b4ecc46f-d1a2-4a4c-b10a-05e2ea2a0478 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:38.699942 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b4ecc46f-d1a2-4a4c-b10a-05e2ea2a0478 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 200 len: 1482 microversion: 2.1 time: 0.374985 Aug 09 14:42:38.700791 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1423/2938] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:38 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 1482 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:38.737372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e2c6b96-eda9-422c-b6ae-9fd7b5033f4c tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1856051162", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:38.755768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0cc23373-79bd-45ea-94a6-371da566e60e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:38.756381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0cc23373-79bd-45ea-94a6-371da566e60e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:38.769432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cc23373-79bd-45ea-94a6-371da566e60e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:38.770151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cc23373-79bd-45ea-94a6-371da566e60e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:38.770743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cc23373-79bd-45ea-94a6-371da566e60e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:38.771705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cc23373-79bd-45ea-94a6-371da566e60e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:38.774386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cc23373-79bd-45ea-94a6-371da566e60e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:38.775007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cc23373-79bd-45ea-94a6-371da566e60e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:38.856510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-2e2c6b96-eda9-422c-b6ae-9fd7b5033f4c tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:42:39.157556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=10 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:39.287180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0cc23373-79bd-45ea-94a6-371da566e60e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:39.298831 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0cc23373-79bd-45ea-94a6-371da566e60e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1308 microversion: 2.1 time: 0.546799 Aug 09 14:42:39.301693 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1424/2939] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:38 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1308 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:42:39.307872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-247d567b-b538-4abc-a8b5-2db838758c81 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:39.310637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-247d567b-b538-4abc-a8b5-2db838758c81 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:39.320033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247d567b-b538-4abc-a8b5-2db838758c81 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:39.320676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247d567b-b538-4abc-a8b5-2db838758c81 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:39.321242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247d567b-b538-4abc-a8b5-2db838758c81 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:39.322223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247d567b-b538-4abc-a8b5-2db838758c81 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:39.322759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247d567b-b538-4abc-a8b5-2db838758c81 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:39.326701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247d567b-b538-4abc-a8b5-2db838758c81 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:39.404424 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-247d567b-b538-4abc-a8b5-2db838758c81 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101416 Aug 09 14:42:39.405705 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1425/2940] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:42:39 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:39.420751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a72e9933-2f46-405b-aa98-0fd1cdea68fc tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:39.421492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a72e9933-2f46-405b-aa98-0fd1cdea68fc tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:39.428457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a72e9933-2f46-405b-aa98-0fd1cdea68fc tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:39.433056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a72e9933-2f46-405b-aa98-0fd1cdea68fc tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:39.433871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a72e9933-2f46-405b-aa98-0fd1cdea68fc tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:39.435844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a72e9933-2f46-405b-aa98-0fd1cdea68fc tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:39.436588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a72e9933-2f46-405b-aa98-0fd1cdea68fc tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:39.437382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a72e9933-2f46-405b-aa98-0fd1cdea68fc tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:39.438474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-2e2c6b96-eda9-422c-b6ae-9fd7b5033f4c tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] Getting quotas for project 519fed965ae94827878d6ff64be30eba. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:39.444983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-2e2c6b96-eda9-422c-b6ae-9fd7b5033f4c tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] Getting quotas for user 619a18a1170747faa95c2c90370826c6 and project 519fed965ae94827878d6ff64be30eba. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:39.461455 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-2e2c6b96-eda9-422c-b6ae-9fd7b5033f4c tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e2c6b96-eda9-422c-b6ae-9fd7b5033f4c tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] Request method failure captured: Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 1752 Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nJdJHavfYbqeeB9VARJ_KQNHBYDJZ-ROOBcsHdhqdv9MMQikDCtdYgcyiKSGl6LoVpkuTyMi-Is7i_nMqIpwmMHOJri6LRywYyvbrYcZojFC-eIGvkoFd2yNI-lvLgmeL41qYhvrM1bRs5QyoTQviB66wklVCT2QZVBOYszehiMqWY Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 519fed965ae94827878d6ff64be30eba Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1571514455 Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_519fed965ae94827878d6ff64be30eba", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/519fed965ae94827878d6ff64be30eba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/519fed965ae94827878d6ff64be30eba"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/519fed965ae94827878d6ff64be30eba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1571514455 Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 519fed965ae94827878d6ff64be30eba Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1571514455 Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 619a18a1170747faa95c2c90370826c6 Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1856051162", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:42:39.466108 n-d-844626-8 devstack@n-api.service[119407]: exception: Maximum number of metadata items exceeds 128 Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1856051162', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:39.468407 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e2c6b96-eda9-422c-b6ae-9fd7b5033f4c tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e2c6b96-eda9-422c-b6ae-9fd7b5033f4c tempest-AbsoluteLimitsNegativeTestJSON-1571514455 tempest-AbsoluteLimitsNegativeTestJSON-1571514455-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.736308 Aug 09 14:42:39.473892 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1516/2941] 10.222.0.50 () {60 vars in 1148 bytes} [Tue Aug 9 14:42:38 2022] POST /compute/v2.1/servers => generated 87 bytes in 738 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:42:39.486722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2ff047a-aee8-4ea2-b1c7-2f12f63471e0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:39.487718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c2ff047a-aee8-4ea2-b1c7-2f12f63471e0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:39.494076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:39.502279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2ff047a-aee8-4ea2-b1c7-2f12f63471e0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:39.502853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2ff047a-aee8-4ea2-b1c7-2f12f63471e0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:39.503482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2ff047a-aee8-4ea2-b1c7-2f12f63471e0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:39.504282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2ff047a-aee8-4ea2-b1c7-2f12f63471e0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:39.504840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2ff047a-aee8-4ea2-b1c7-2f12f63471e0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:39.505407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2ff047a-aee8-4ea2-b1c7-2f12f63471e0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:39.605857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-a72e9933-2f46-405b-aa98-0fd1cdea68fc tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lazy-loading 'services' on Instance uuid 40892bf1-16b7-466e-8518-9cf8be282cb7 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:42:39.739763 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a72e9933-2f46-405b-aa98-0fd1cdea68fc tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "DELETE /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7/os-volume_attachments/ea04e242-1dec-42c9-a16f-736c09e9aaa4" status: 202 len: 0 microversion: 2.1 time: 0.326345 Aug 09 14:42:39.740795 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1426/2942] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 14:42:39 2022] DELETE /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7/os-volume_attachments/ea04e242-1dec-42c9-a16f-736c09e9aaa4 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 14:42:39.761078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d07099c7-e4cb-4051-8ef2-21ba7d0da9f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:39.765056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2ff047a-aee8-4ea2-b1c7-2f12f63471e0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:39.768949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d07099c7-e4cb-4051-8ef2-21ba7d0da9f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:39.780340 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2ff047a-aee8-4ea2-b1c7-2f12f63471e0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1308 microversion: 2.1 time: 0.299054 Aug 09 14:42:39.781448 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1517/2943] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:39 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1308 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:39.787704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d07099c7-e4cb-4051-8ef2-21ba7d0da9f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:39.789043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d07099c7-e4cb-4051-8ef2-21ba7d0da9f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:39.789905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d07099c7-e4cb-4051-8ef2-21ba7d0da9f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:39.796506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d07099c7-e4cb-4051-8ef2-21ba7d0da9f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:39.797034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d07099c7-e4cb-4051-8ef2-21ba7d0da9f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:39.797469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d07099c7-e4cb-4051-8ef2-21ba7d0da9f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:39.827323 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-d07099c7-e4cb-4051-8ef2-21ba7d0da9f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] HTTP exception thrown: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d07099c7-e4cb-4051-8ef2-21ba7d0da9f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 HTTP/1.1 Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '12bc6eac-f858-4da3-879e-9d234ce4e726'} Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:39.831253 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:39.835330 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:39.835330 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:39.835330 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:39.835330 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:39.835330 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:39.835330 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:39.835330 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:42:39.835330 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:39.835330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d07099c7-e4cb-4051-8ef2-21ba7d0da9f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 404 to user: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:39.835330 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d07099c7-e4cb-4051-8ef2-21ba7d0da9f8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 404 len: 111 microversion: 2.1 time: 0.088845 Aug 09 14:42:39.840041 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1427/2944] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:39 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:42:39.849247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ee438cb-daa5-4830-bbda-6836cb72a007 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Action: 'create', calling method: .version_select at 0x7f41dd38b550>, body: {"keypair": {"name": "tempest-keypair-98728551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ+Iqfqc1b3wjorCCyhwDEi/xl/8k19mZ6Zo2AqrejDmMh52CynaPOsyv8P8/SVU33EVVGmS7yPzw4os4TYD/YwquNskkf1nKHUNcO3RbtxiqIQuBDnfhodpyTsfcy8QA=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:39.883481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-6ee438cb-daa5-4830-bbda-6836cb72a007 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Getting quotas for project 8e0b1ade12f4484b83dd4bce24fd7859. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:39.891817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-6ee438cb-daa5-4830-bbda-6836cb72a007 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Getting quotas for user e05667f82c43484bb250236739c08959 and project 8e0b1ade12f4484b83dd4bce24fd7859. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:39.938593 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ee438cb-daa5-4830-bbda-6836cb72a007 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.092738 Aug 09 14:42:39.940846 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1518/2945] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:42:39 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:40.322402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c47c48a2-16fe-4551-a2c4-11c321654b80 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:40.323464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c47c48a2-16fe-4551-a2c4-11c321654b80 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:40.339551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c47c48a2-16fe-4551-a2c4-11c321654b80 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:40.343042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c47c48a2-16fe-4551-a2c4-11c321654b80 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:40.345218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c47c48a2-16fe-4551-a2c4-11c321654b80 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:40.346776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c47c48a2-16fe-4551-a2c4-11c321654b80 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:40.350017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c47c48a2-16fe-4551-a2c4-11c321654b80 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:40.354921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c47c48a2-16fe-4551-a2c4-11c321654b80 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:40.803570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-788a74f2-e944-4332-ab98-4ed31f039f7f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:40.804553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-788a74f2-e944-4332-ab98-4ed31f039f7f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:40.821245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-788a74f2-e944-4332-ab98-4ed31f039f7f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:40.824198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-788a74f2-e944-4332-ab98-4ed31f039f7f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:40.825884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-788a74f2-e944-4332-ab98-4ed31f039f7f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:40.828226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-788a74f2-e944-4332-ab98-4ed31f039f7f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:40.829853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-788a74f2-e944-4332-ab98-4ed31f039f7f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:40.830451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-788a74f2-e944-4332-ab98-4ed31f039f7f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:40.847520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c47c48a2-16fe-4551-a2c4-11c321654b80 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:40.857909 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c47c48a2-16fe-4551-a2c4-11c321654b80 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1308 microversion: 2.1 time: 0.539597 Aug 09 14:42:40.875704 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1428/2946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:40 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1308 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:41.404859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-788a74f2-e944-4332-ab98-4ed31f039f7f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:41.417882 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-788a74f2-e944-4332-ab98-4ed31f039f7f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1308 microversion: 2.1 time: 0.618473 Aug 09 14:42:41.420318 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1519/2947] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:40 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1308 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:41.883051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-35c7d026-d0dd-46ea-bf60-2bc33e0612b8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:41.884572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-35c7d026-d0dd-46ea-bf60-2bc33e0612b8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:41.898718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35c7d026-d0dd-46ea-bf60-2bc33e0612b8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:41.901007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35c7d026-d0dd-46ea-bf60-2bc33e0612b8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:41.904401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35c7d026-d0dd-46ea-bf60-2bc33e0612b8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:41.905736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35c7d026-d0dd-46ea-bf60-2bc33e0612b8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:41.906204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35c7d026-d0dd-46ea-bf60-2bc33e0612b8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:41.906625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35c7d026-d0dd-46ea-bf60-2bc33e0612b8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:42.139039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-35c7d026-d0dd-46ea-bf60-2bc33e0612b8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:42.149868 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-35c7d026-d0dd-46ea-bf60-2bc33e0612b8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1487 microversion: 2.1 time: 0.270828 Aug 09 14:42:42.150794 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1429/2948] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:41 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1487 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:42.172905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-18d6452b-9ffe-4c2b-af04-c1eceefdaa93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:42.176021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-18d6452b-9ffe-4c2b-af04-c1eceefdaa93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:42.190425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18d6452b-9ffe-4c2b-af04-c1eceefdaa93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:42.190914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18d6452b-9ffe-4c2b-af04-c1eceefdaa93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:42.194592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18d6452b-9ffe-4c2b-af04-c1eceefdaa93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:42.197117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18d6452b-9ffe-4c2b-af04-c1eceefdaa93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:42.198334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18d6452b-9ffe-4c2b-af04-c1eceefdaa93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:42.200187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18d6452b-9ffe-4c2b-af04-c1eceefdaa93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:42.293873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-88615d71-c95a-4e9b-a18a-f7745f76d901 req-e2b6e508-c6c9-4c64-90a9-1801e55fbd0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99173f66-b303-416e-b3ba-71109d2fc9f8", "name": "network-vif-plugged", "status": "completed", "tag": "af76a083-7c14-4aa2-856b-8763fd515266"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:42.322204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-88615d71-c95a-4e9b-a18a-f7745f76d901 req-e2b6e508-c6c9-4c64-90a9-1801e55fbd0c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:42.326418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-88615d71-c95a-4e9b-a18a-f7745f76d901 req-e2b6e508-c6c9-4c64-90a9-1801e55fbd0c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:42.327630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-88615d71-c95a-4e9b-a18a-f7745f76d901 req-e2b6e508-c6c9-4c64-90a9-1801e55fbd0c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:42.344768 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-18d6452b-9ffe-4c2b-af04-c1eceefdaa93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "PUT /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1082 microversion: 2.1 time: 0.177378 Aug 09 14:42:42.345624 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1520/2949] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 9 14:42:42 2022] PUT /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1082 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:42.362625 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-88615d71-c95a-4e9b-a18a-f7745f76d901 req-e2b6e508-c6c9-4c64-90a9-1801e55fbd0c service nova] Creating event network-vif-plugged:af76a083-7c14-4aa2-856b-8763fd515266 for instance 99173f66-b303-416e-b3ba-71109d2fc9f8 on n-h1-844626-8 Aug 09 14:42:42.367248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1e1a9457-29a3-4c3f-a8ac-b9f4432f5c12 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:42.368120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1e1a9457-29a3-4c3f-a8ac-b9f4432f5c12 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:42.378041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e1a9457-29a3-4c3f-a8ac-b9f4432f5c12 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:42.378839 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-88615d71-c95a-4e9b-a18a-f7745f76d901 req-e2b6e508-c6c9-4c64-90a9-1801e55fbd0c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089865 Aug 09 14:42:42.379398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e1a9457-29a3-4c3f-a8ac-b9f4432f5c12 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:42.380492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e1a9457-29a3-4c3f-a8ac-b9f4432f5c12 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:42.383714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e1a9457-29a3-4c3f-a8ac-b9f4432f5c12 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:42.384693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e1a9457-29a3-4c3f-a8ac-b9f4432f5c12 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:42.386249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e1a9457-29a3-4c3f-a8ac-b9f4432f5c12 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:42.386364 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1430/2950] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:42.439679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e636aed7-2283-4218-b886-e15e94600869 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:42.440369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e636aed7-2283-4218-b886-e15e94600869 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:42.450703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e636aed7-2283-4218-b886-e15e94600869 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:42.452391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e636aed7-2283-4218-b886-e15e94600869 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:42.457588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e636aed7-2283-4218-b886-e15e94600869 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:42.458776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e636aed7-2283-4218-b886-e15e94600869 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:42.459422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e636aed7-2283-4218-b886-e15e94600869 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:42.460145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e636aed7-2283-4218-b886-e15e94600869 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:42.671039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e1a9457-29a3-4c3f-a8ac-b9f4432f5c12 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:42.683288 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1e1a9457-29a3-4c3f-a8ac-b9f4432f5c12 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1508 microversion: 2.1 time: 0.322104 Aug 09 14:42:42.685047 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1521/2951] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:42 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:42.704720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75f7c440-9a13-4663-aa30-51cf8d9b16f4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:42.705332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75f7c440-9a13-4663-aa30-51cf8d9b16f4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:42.712311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75f7c440-9a13-4663-aa30-51cf8d9b16f4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:42.713040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75f7c440-9a13-4663-aa30-51cf8d9b16f4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:42.713651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75f7c440-9a13-4663-aa30-51cf8d9b16f4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:42.714555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75f7c440-9a13-4663-aa30-51cf8d9b16f4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:42.715397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75f7c440-9a13-4663-aa30-51cf8d9b16f4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:42.716020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75f7c440-9a13-4663-aa30-51cf8d9b16f4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:42.745262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e636aed7-2283-4218-b886-e15e94600869 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:42.755841 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e636aed7-2283-4218-b886-e15e94600869 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1308 microversion: 2.1 time: 0.320252 Aug 09 14:42:42.767109 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1431/2952] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:42 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:42.929142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-75f7c440-9a13-4663-aa30-51cf8d9b16f4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:42.934566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:42.943711 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75f7c440-9a13-4663-aa30-51cf8d9b16f4 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1508 microversion: 2.1 time: 0.242578 Aug 09 14:42:42.944306 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1522/2953] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:42 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:42.966746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73479b3b-30e7-4429-a495-fac08f024d2f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:42.968739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-73479b3b-30e7-4429-a495-fac08f024d2f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:42.974061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1159378891", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:42.977608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73479b3b-30e7-4429-a495-fac08f024d2f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:42.979586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73479b3b-30e7-4429-a495-fac08f024d2f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:42.980247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73479b3b-30e7-4429-a495-fac08f024d2f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:42.981206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73479b3b-30e7-4429-a495-fac08f024d2f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:42.981933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73479b3b-30e7-4429-a495-fac08f024d2f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:42.982707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73479b3b-30e7-4429-a495-fac08f024d2f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:43.015343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-73479b3b-30e7-4429-a495-fac08f024d2f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:42:43.049760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] validate_networks() for [('c0f37d1b-2427-4789-90ef-2da67d3617fc', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:42:43.131926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:43.174597 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-73479b3b-30e7-4429-a495-fac08f024d2f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 204 len: 0 microversion: 2.1 time: 0.212892 Aug 09 14:42:43.175233 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1432/2954] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:42:42 2022] DELETE /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:43.198243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c6e679ae-446e-4ace-a911-ec01b2ffbd34 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:43.199004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6e679ae-446e-4ace-a911-ec01b2ffbd34 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:43.208301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6e679ae-446e-4ace-a911-ec01b2ffbd34 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:43.209235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6e679ae-446e-4ace-a911-ec01b2ffbd34 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:43.210020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6e679ae-446e-4ace-a911-ec01b2ffbd34 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:43.210910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6e679ae-446e-4ace-a911-ec01b2ffbd34 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:43.211637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6e679ae-446e-4ace-a911-ec01b2ffbd34 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:43.212065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6e679ae-446e-4ace-a911-ec01b2ffbd34 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:43.532244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c6e679ae-446e-4ace-a911-ec01b2ffbd34 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:43.549476 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c6e679ae-446e-4ace-a911-ec01b2ffbd34 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1514 microversion: 2.1 time: 0.357931 Aug 09 14:42:43.550088 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1433/2955] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:43 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1514 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:43.778079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a2895575-8ebb-4083-8c39-d9d59aecd9ae tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:43.778682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a2895575-8ebb-4083-8c39-d9d59aecd9ae tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:43.788783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2895575-8ebb-4083-8c39-d9d59aecd9ae tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:43.789909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2895575-8ebb-4083-8c39-d9d59aecd9ae tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:43.792693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2895575-8ebb-4083-8c39-d9d59aecd9ae tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:43.793634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2895575-8ebb-4083-8c39-d9d59aecd9ae tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:43.794254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2895575-8ebb-4083-8c39-d9d59aecd9ae tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:43.795115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2895575-8ebb-4083-8c39-d9d59aecd9ae tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:44.461519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:42:44.465685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:42:44.468671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:42:44.470808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:42:44.473511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:42:44.486502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=37 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:44.501696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:44.502187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:44.502620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:44.508063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:44.508914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:44.512526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:44.549669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a2895575-8ebb-4083-8c39-d9d59aecd9ae tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:44.559384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Getting quotas for project 8e0b1ade12f4484b83dd4bce24fd7859. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:44.563648 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a2895575-8ebb-4083-8c39-d9d59aecd9ae tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1308 microversion: 2.1 time: 0.789566 Aug 09 14:42:44.564945 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1434/2956] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:43 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1308 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:42:44.570878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9f62573-dd60-4910-a665-fe8241200af9 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Calling method '.version_select at 0x7f41ddeb5160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:44.572025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Getting quotas for user e05667f82c43484bb250236739c08959 and project 8e0b1ade12f4484b83dd4bce24fd7859. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:44.653134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:42:44.656234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:42:44.669513 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c9f62573-dd60-4910-a665-fe8241200af9 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28" status: 200 len: 635 microversion: 2.1 time: 0.102967 Aug 09 14:42:44.671409 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1435/2957] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:42:44 2022] GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28 => generated 635 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:44.773118 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe4b36e2-aa09-4b92-b0f2-b54b703b94b9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.802501 Aug 09 14:42:44.774827 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1523/2958] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:42:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:42:44.782882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aad2f197-1881-42f3-9322-f50d36841632 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:44.784448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aad2f197-1881-42f3-9322-f50d36841632 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:44.798779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aad2f197-1881-42f3-9322-f50d36841632 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:44.800051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aad2f197-1881-42f3-9322-f50d36841632 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:44.801233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aad2f197-1881-42f3-9322-f50d36841632 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:44.804864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aad2f197-1881-42f3-9322-f50d36841632 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:44.805463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aad2f197-1881-42f3-9322-f50d36841632 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:44.807655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aad2f197-1881-42f3-9322-f50d36841632 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:45.050558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60a2aefd-178e-4eec-b975-e725d5e2e195 tempest-PortsAdminExtendedAttrsTestJSON-1837820811 tempest-PortsAdminExtendedAttrsTestJSON-1837820811-project-admin] Calling method '.version_select at 0x7f41dd2f3550>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:45.051940 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:42:45.051940 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:42:45.053407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60a2aefd-178e-4eec-b975-e725d5e2e195 tempest-PortsAdminExtendedAttrsTestJSON-1837820811 tempest-PortsAdminExtendedAttrsTestJSON-1837820811-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:45.054010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60a2aefd-178e-4eec-b975-e725d5e2e195 tempest-PortsAdminExtendedAttrsTestJSON-1837820811 tempest-PortsAdminExtendedAttrsTestJSON-1837820811-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:45.054556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60a2aefd-178e-4eec-b975-e725d5e2e195 tempest-PortsAdminExtendedAttrsTestJSON-1837820811 tempest-PortsAdminExtendedAttrsTestJSON-1837820811-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:45.073180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:45.126230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60a2aefd-178e-4eec-b975-e725d5e2e195 tempest-PortsAdminExtendedAttrsTestJSON-1837820811 tempest-PortsAdminExtendedAttrsTestJSON-1837820811-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:45.126928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60a2aefd-178e-4eec-b975-e725d5e2e195 tempest-PortsAdminExtendedAttrsTestJSON-1837820811 tempest-PortsAdminExtendedAttrsTestJSON-1837820811-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:45.127775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60a2aefd-178e-4eec-b975-e725d5e2e195 tempest-PortsAdminExtendedAttrsTestJSON-1837820811 tempest-PortsAdminExtendedAttrsTestJSON-1837820811-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:45.150930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60a2aefd-178e-4eec-b975-e725d5e2e195 tempest-PortsAdminExtendedAttrsTestJSON-1837820811 tempest-PortsAdminExtendedAttrsTestJSON-1837820811-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:45.152822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60a2aefd-178e-4eec-b975-e725d5e2e195 tempest-PortsAdminExtendedAttrsTestJSON-1837820811 tempest-PortsAdminExtendedAttrsTestJSON-1837820811-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:45.153439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60a2aefd-178e-4eec-b975-e725d5e2e195 tempest-PortsAdminExtendedAttrsTestJSON-1837820811 tempest-PortsAdminExtendedAttrsTestJSON-1837820811-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:45.168244 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60a2aefd-178e-4eec-b975-e725d5e2e195 tempest-PortsAdminExtendedAttrsTestJSON-1837820811 tempest-PortsAdminExtendedAttrsTestJSON-1837820811-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.494520 Aug 09 14:42:45.178059 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1436/2959] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:42:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:45.196189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cda091f7-df0e-4b58-a79d-889d2186d055 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Action: 'update_all', calling method: .version_select at 0x7f41dd308430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:45.290528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-cda091f7-df0e-4b58-a79d-889d2186d055 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:45.300278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-cda091f7-df0e-4b58-a79d-889d2186d055 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for user cc213a6bb1bf4e62a3a96799a90e848f and project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:45.358406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aad2f197-1881-42f3-9322-f50d36841632 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:45.372071 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aad2f197-1881-42f3-9322-f50d36841632 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1514 microversion: 2.1 time: 0.595463 Aug 09 14:42:45.376775 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1524/2960] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:44 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1514 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:45.390959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-90c4ee7b-42ae-49a4-863d-01846a8a0792 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:45.391708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-90c4ee7b-42ae-49a4-863d-01846a8a0792 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:45.608207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-90c4ee7b-42ae-49a4-863d-01846a8a0792 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:45.616099 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-90c4ee7b-42ae-49a4-863d-01846a8a0792 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1225 microversion: 2.1 time: 0.237629 Aug 09 14:42:45.620823 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1525/2961] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:45 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1225 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:45.625615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f9d077d-21c4-4387-9a14-7e991f62b509 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:45.626221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f9d077d-21c4-4387-9a14-7e991f62b509 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:45.655746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f9d077d-21c4-4387-9a14-7e991f62b509 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:45.656610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f9d077d-21c4-4387-9a14-7e991f62b509 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:45.657202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f9d077d-21c4-4387-9a14-7e991f62b509 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:45.658104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f9d077d-21c4-4387-9a14-7e991f62b509 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:45.658716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f9d077d-21c4-4387-9a14-7e991f62b509 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:45.659349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f9d077d-21c4-4387-9a14-7e991f62b509 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:45.728469 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cda091f7-df0e-4b58-a79d-889d2186d055 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 61 microversion: 2.1 time: 0.548180 Aug 09 14:42:45.729564 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1437/2962] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:42:45 2022] PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 61 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:45.739712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9222cf1d-e4af-4505-879f-822fd942c3aa tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Calling method '.version_select at 0x7f41dd3bc9d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:46.124045 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9222cf1d-e4af-4505-879f-822fd942c3aa tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "DELETE /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.389382 Aug 09 14:42:46.124819 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1438/2963] 10.222.0.50 () {58 vars in 1296 bytes} [Tue Aug 9 14:42:45 2022] DELETE /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata/os_version => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:42:46.130529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2f9d077d-21c4-4387-9a14-7e991f62b509 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:46.133815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e07381f-a6a5-46eb-9a44-9c9087aad494 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Calling method '.version_select at 0x7f41e74f8ee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:46.139568 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f9d077d-21c4-4387-9a14-7e991f62b509 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1489 microversion: 2.1 time: 0.517608 Aug 09 14:42:46.155060 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1526/2964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:45 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1489 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:46.166237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ff30046d-b958-4256-b6a3-675f9d8524a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:46.174731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff30046d-b958-4256-b6a3-675f9d8524a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:46.176977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff30046d-b958-4256-b6a3-675f9d8524a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:46.177637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff30046d-b958-4256-b6a3-675f9d8524a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:46.208901 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6e07381f-a6a5-46eb-9a44-9c9087aad494 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 37 microversion: 2.1 time: 0.078631 Aug 09 14:42:46.209981 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1439/2965] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 9 14:42:46 2022] GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 37 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:46.222210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f6d2b03-db6d-4329-a0cd-27c4a551a85f tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Action: 'update_all', calling method: .version_select at 0x7f41dd3080d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:46.294381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ff30046d-b958-4256-b6a3-675f9d8524a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Going to try to stop instance {{(pid=119407) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 14:42:46.327994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9f6d2b03-db6d-4329-a0cd-27c4a551a85f tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:46.340556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9f6d2b03-db6d-4329-a0cd-27c4a551a85f tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for user cc213a6bb1bf4e62a3a96799a90e848f and project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:46.443644 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ff30046d-b958-4256-b6a3-675f9d8524a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "POST /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8/action" status: 202 len: 0 microversion: 2.1 time: 0.285182 Aug 09 14:42:46.444559 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1527/2966] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:42:46 2022] POST /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:42:46.461517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e48fa582-0e98-472e-809d-990602953c97 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:46.466352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e48fa582-0e98-472e-809d-990602953c97 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:46.489826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e48fa582-0e98-472e-809d-990602953c97 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:46.490615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e48fa582-0e98-472e-809d-990602953c97 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:46.497399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e48fa582-0e98-472e-809d-990602953c97 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:46.499455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e48fa582-0e98-472e-809d-990602953c97 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:46.500133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e48fa582-0e98-472e-809d-990602953c97 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:46.500955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e48fa582-0e98-472e-809d-990602953c97 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:46.840776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e48fa582-0e98-472e-809d-990602953c97 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:46.851478 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e48fa582-0e98-472e-809d-990602953c97 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 200 len: 1472 microversion: 2.1 time: 0.400338 Aug 09 14:42:46.852079 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1528/2967] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:46 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 1472 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:46.869487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34a54d7e-0017-413f-828f-1fb81aad70b2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:46.870172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34a54d7e-0017-413f-828f-1fb81aad70b2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:46.886517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34a54d7e-0017-413f-828f-1fb81aad70b2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:46.888145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34a54d7e-0017-413f-828f-1fb81aad70b2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:46.889028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34a54d7e-0017-413f-828f-1fb81aad70b2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:46.889847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34a54d7e-0017-413f-828f-1fb81aad70b2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:46.890681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34a54d7e-0017-413f-828f-1fb81aad70b2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:46.891575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34a54d7e-0017-413f-828f-1fb81aad70b2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:46.958717 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f6d2b03-db6d-4329-a0cd-27c4a551a85f tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 61 microversion: 2.1 time: 0.733874 Aug 09 14:42:46.963071 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1440/2968] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:42:46 2022] PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 61 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:46.976158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-135546fd-b7c1-492f-b671-15b3bc99b73e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:46.977484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-135546fd-b7c1-492f-b671-15b3bc99b73e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:46.987273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-135546fd-b7c1-492f-b671-15b3bc99b73e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:46.988204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-135546fd-b7c1-492f-b671-15b3bc99b73e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:46.989409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-135546fd-b7c1-492f-b671-15b3bc99b73e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:46.990413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-135546fd-b7c1-492f-b671-15b3bc99b73e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:46.992490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-135546fd-b7c1-492f-b671-15b3bc99b73e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:46.994320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-135546fd-b7c1-492f-b671-15b3bc99b73e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:47.160006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-135546fd-b7c1-492f-b671-15b3bc99b73e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:47.169867 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-135546fd-b7c1-492f-b671-15b3bc99b73e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1283 microversion: 2.1 time: 0.205200 Aug 09 14:42:47.182983 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1441/2969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:46 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1283 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:47.193344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-80d03593-f48d-4a3d-a498-4f4e0fad8558 req-49f36a01-f54c-4b7d-af69-412c68c2e4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3", "name": "network-vif-deleted", "tag": "a8dcb400-6f00-4747-896a-67f9b2a9657e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:47.206002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-80d03593-f48d-4a3d-a498-4f4e0fad8558 req-49f36a01-f54c-4b7d-af69-412c68c2e4b0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:47.206712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-80d03593-f48d-4a3d-a498-4f4e0fad8558 req-49f36a01-f54c-4b7d-af69-412c68c2e4b0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:47.207304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-80d03593-f48d-4a3d-a498-4f4e0fad8558 req-49f36a01-f54c-4b7d-af69-412c68c2e4b0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:47.219120 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-80d03593-f48d-4a3d-a498-4f4e0fad8558 req-49f36a01-f54c-4b7d-af69-412c68c2e4b0 service nova] Creating event network-vif-deleted:a8dcb400-6f00-4747-896a-67f9b2a9657e for instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 on n-h2-844626-8 Aug 09 14:42:47.225267 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-80d03593-f48d-4a3d-a498-4f4e0fad8558 req-49f36a01-f54c-4b7d-af69-412c68c2e4b0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040366 Aug 09 14:42:47.226332 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1442/2970] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:47.234145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0dd752e6-921f-4af2-b6ba-bea128de5765 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Calling method '.version_select at 0x7f41dd3474c0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:47.298554 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0dd752e6-921f-4af2-b6ba-bea128de5765 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.069897 Aug 09 14:42:47.299472 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1443/2971] 10.222.0.50 () {58 vars in 1290 bytes} [Tue Aug 9 14:42:47 2022] GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata/os_distro => generated 33 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:47.320733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-58a0870b-59c8-4c0f-91d9-21a666e826b1 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Action: 'update_all', calling method: .version_select at 0x7f41e7551af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:47.394930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-58a0870b-59c8-4c0f-91d9-21a666e826b1 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:47.403543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-58a0870b-59c8-4c0f-91d9-21a666e826b1 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for user cc213a6bb1bf4e62a3a96799a90e848f and project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:47.410502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-34a54d7e-0017-413f-828f-1fb81aad70b2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:47.419969 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34a54d7e-0017-413f-828f-1fb81aad70b2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1499 microversion: 2.1 time: 0.562739 Aug 09 14:42:47.420566 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1529/2972] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:46 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1499 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:47.629333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa3d07dc-62ae-4663-ade8-f53359f42dd9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:47.632439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa3d07dc-62ae-4663-ade8-f53359f42dd9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:47.649483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa3d07dc-62ae-4663-ade8-f53359f42dd9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:47.650236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa3d07dc-62ae-4663-ade8-f53359f42dd9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:47.650875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa3d07dc-62ae-4663-ade8-f53359f42dd9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:47.651837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa3d07dc-62ae-4663-ade8-f53359f42dd9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:47.652525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa3d07dc-62ae-4663-ade8-f53359f42dd9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:47.653174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa3d07dc-62ae-4663-ade8-f53359f42dd9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:47.673119 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-58a0870b-59c8-4c0f-91d9-21a666e826b1 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 61 microversion: 2.1 time: 0.365160 Aug 09 14:42:47.673874 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1444/2973] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:42:47 2022] PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 61 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:47.689101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2fab8670-23e3-4233-943d-b92e405fffae tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Calling method '.version_select at 0x7f41e754d310>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:47.706418 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa3d07dc-62ae-4663-ade8-f53359f42dd9 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081041 Aug 09 14:42:47.708001 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1530/2974] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:42:47 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 14:42:47.745289 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2fab8670-23e3-4233-943d-b92e405fffae tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 61 microversion: 2.1 time: 0.065423 Aug 09 14:42:47.745900 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1445/2975] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 9 14:42:47 2022] GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 61 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 14:42:47.758531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-232fd5fa-1de3-4e50-8471-1c0f5c16c31b tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Action: 'update_all', calling method: .version_select at 0x7f41dd3b0ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:47.816631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa463016-3f4c-4e22-8584-c459c33b9a4f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:47.819806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa463016-3f4c-4e22-8584-c459c33b9a4f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:47.828625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa463016-3f4c-4e22-8584-c459c33b9a4f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:47.829274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa463016-3f4c-4e22-8584-c459c33b9a4f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:47.829714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa463016-3f4c-4e22-8584-c459c33b9a4f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:47.830420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa463016-3f4c-4e22-8584-c459c33b9a4f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:47.830872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa463016-3f4c-4e22-8584-c459c33b9a4f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:47.831506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa463016-3f4c-4e22-8584-c459c33b9a4f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:47.833802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-232fd5fa-1de3-4e50-8471-1c0f5c16c31b tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:47.840036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-232fd5fa-1de3-4e50-8471-1c0f5c16c31b tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for user cc213a6bb1bf4e62a3a96799a90e848f and project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:47.874527 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa463016-3f4c-4e22-8584-c459c33b9a4f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057205 Aug 09 14:42:47.874527 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1446/2976] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:42:47 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 14:42:47.888543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36a9c9b3-6f5c-4077-9528-558930b52344 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:47.889744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-36a9c9b3-6f5c-4077-9528-558930b52344 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:47.925014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a9c9b3-6f5c-4077-9528-558930b52344 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:47.926334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a9c9b3-6f5c-4077-9528-558930b52344 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:47.926718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a9c9b3-6f5c-4077-9528-558930b52344 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:47.929799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a9c9b3-6f5c-4077-9528-558930b52344 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:47.930227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a9c9b3-6f5c-4077-9528-558930b52344 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:47.930655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a9c9b3-6f5c-4077-9528-558930b52344 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:47.962505 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-36a9c9b3-6f5c-4077-9528-558930b52344 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36a9c9b3-6f5c-4077-9528-558930b52344 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 HTTP/1.1 Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3'} Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:47.964518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:47.969794 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:47.969794 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:47.969794 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:47.969794 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:47.969794 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:42:47.969794 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:42:47.969794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36a9c9b3-6f5c-4077-9528-558930b52344 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:47.971069 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36a9c9b3-6f5c-4077-9528-558930b52344 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 404 len: 111 microversion: 2.1 time: 0.100184 Aug 09 14:42:47.972125 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1447/2977] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:47 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:42:47.981908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4354edb9-9502-4f91-b13a-5be399060b4b tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:47.982559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4354edb9-9502-4f91-b13a-5be399060b4b tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:47.990671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4354edb9-9502-4f91-b13a-5be399060b4b tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:47.991358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4354edb9-9502-4f91-b13a-5be399060b4b tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:47.992356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4354edb9-9502-4f91-b13a-5be399060b4b tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:47.993361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4354edb9-9502-4f91-b13a-5be399060b4b tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:47.994076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4354edb9-9502-4f91-b13a-5be399060b4b tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:47.994666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4354edb9-9502-4f91-b13a-5be399060b4b tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:48.023723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4354edb9-9502-4f91-b13a-5be399060b4b tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:42:48.079262 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-232fd5fa-1de3-4e50-8471-1c0f5c16c31b tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 61 microversion: 2.1 time: 0.325864 Aug 09 14:42:48.084650 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1531/2978] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:42:47 2022] PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 61 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:48.090674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da3a605d-9a90-4355-9c15-73c010f24171 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Action: 'update_all', calling method: .version_select at 0x7f41dd3b0820>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:48.149253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-da3a605d-9a90-4355-9c15-73c010f24171 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:48.158172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-da3a605d-9a90-4355-9c15-73c010f24171 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for user cc213a6bb1bf4e62a3a96799a90e848f and project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:48.168340 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4354edb9-9502-4f91-b13a-5be399060b4b tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "DELETE /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 204 len: 0 microversion: 2.1 time: 0.194803 Aug 09 14:42:48.170436 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1448/2979] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:42:47 2022] DELETE /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:42:48.182625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ee4317f-7641-4360-8820-5946926e9453 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:48.185350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ee4317f-7641-4360-8820-5946926e9453 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:48.200643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee4317f-7641-4360-8820-5946926e9453 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:48.203645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee4317f-7641-4360-8820-5946926e9453 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:48.205102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee4317f-7641-4360-8820-5946926e9453 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:48.207395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee4317f-7641-4360-8820-5946926e9453 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:48.210907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee4317f-7641-4360-8820-5946926e9453 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:48.211517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee4317f-7641-4360-8820-5946926e9453 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:48.275894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:48.551724 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da3a605d-9a90-4355-9c15-73c010f24171 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 64 microversion: 2.1 time: 0.465898 Aug 09 14:42:48.552823 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1532/2980] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:42:48 2022] PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 64 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:48.563905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9650a56d-8275-413c-a531-26ab0c6b5aad tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:48.564897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9650a56d-8275-413c-a531-26ab0c6b5aad tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:48.573462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9650a56d-8275-413c-a531-26ab0c6b5aad tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:48.574216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9650a56d-8275-413c-a531-26ab0c6b5aad tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:48.574906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9650a56d-8275-413c-a531-26ab0c6b5aad tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:48.575777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9650a56d-8275-413c-a531-26ab0c6b5aad tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:48.576390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9650a56d-8275-413c-a531-26ab0c6b5aad tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:48.576999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9650a56d-8275-413c-a531-26ab0c6b5aad tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:48.757708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9650a56d-8275-413c-a531-26ab0c6b5aad tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:48.770041 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9650a56d-8275-413c-a531-26ab0c6b5aad tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1283 microversion: 2.1 time: 0.210331 Aug 09 14:42:48.783546 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1533/2981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:48 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1283 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:48.792803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1180731334", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "7d4b5e6e-1097-46ba-bb21-ff9e1560d087"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:48.874842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] validate_networks() for [('7d4b5e6e-1097-46ba-bb21-ff9e1560d087', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:42:48.930273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ee4317f-7641-4360-8820-5946926e9453 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:48.940398 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ee4317f-7641-4360-8820-5946926e9453 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1682 microversion: 2.1 time: 0.764849 Aug 09 14:42:48.942020 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1449/2982] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:48 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1682 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:42:48.948229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39c1d291-c049-4fcb-84a9-1f4be4d480e1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:48.952169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39c1d291-c049-4fcb-84a9-1f4be4d480e1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:48.963005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39c1d291-c049-4fcb-84a9-1f4be4d480e1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:48.965202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39c1d291-c049-4fcb-84a9-1f4be4d480e1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:48.965794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39c1d291-c049-4fcb-84a9-1f4be4d480e1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:48.966660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39c1d291-c049-4fcb-84a9-1f4be4d480e1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:48.967428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39c1d291-c049-4fcb-84a9-1f4be4d480e1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:48.968018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39c1d291-c049-4fcb-84a9-1f4be4d480e1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:49.890500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-39c1d291-c049-4fcb-84a9-1f4be4d480e1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:49.907643 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39c1d291-c049-4fcb-84a9-1f4be4d480e1 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1499 microversion: 2.1 time: 0.964273 Aug 09 14:42:49.908255 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1450/2983] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:48 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1499 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:49.927305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9749cdbb-b49e-4909-a91f-25e1a6b479a2 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Calling method '.version_select at 0x7f41dd394160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:49.973828 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9749cdbb-b49e-4909-a91f-25e1a6b479a2 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 64 microversion: 2.1 time: 0.050839 Aug 09 14:42:49.975234 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1451/2984] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 9 14:42:49 2022] GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 64 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:49.988363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d68c39d-412d-4bfe-974e-70a4d626690b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:49.994029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d68c39d-412d-4bfe-974e-70a4d626690b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:50.006029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d68c39d-412d-4bfe-974e-70a4d626690b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:50.008651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d68c39d-412d-4bfe-974e-70a4d626690b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:50.009777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d68c39d-412d-4bfe-974e-70a4d626690b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:50.012378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d68c39d-412d-4bfe-974e-70a4d626690b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:50.014533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d68c39d-412d-4bfe-974e-70a4d626690b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:50.015010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d68c39d-412d-4bfe-974e-70a4d626690b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:50.190901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6d68c39d-412d-4bfe-974e-70a4d626690b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:50.202265 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d68c39d-412d-4bfe-974e-70a4d626690b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1283 microversion: 2.1 time: 0.222945 Aug 09 14:42:50.217834 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1452/2985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:49 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1283 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:50.235018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-791232f4-ccd4-4106-887c-e65979558a7f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:50.235922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-791232f4-ccd4-4106-887c-e65979558a7f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:50.248172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-791232f4-ccd4-4106-887c-e65979558a7f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:50.248939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-791232f4-ccd4-4106-887c-e65979558a7f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:50.249518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-791232f4-ccd4-4106-887c-e65979558a7f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:50.250382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-791232f4-ccd4-4106-887c-e65979558a7f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:50.250975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-791232f4-ccd4-4106-887c-e65979558a7f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:50.251702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-791232f4-ccd4-4106-887c-e65979558a7f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:51.512982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-791232f4-ccd4-4106-887c-e65979558a7f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:51.521757 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-791232f4-ccd4-4106-887c-e65979558a7f tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1682 microversion: 2.1 time: 1.302212 Aug 09 14:42:51.531682 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1453/2986] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:50 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1682 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:51.545696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e606a4fe-06cf-4e1a-8a45-5ae982d8aaa3 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Action: 'update_all', calling method: .version_select at 0x7f41de750e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:51.623403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:42:51.623818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:42:51.626362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:42:51.626786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:42:51.627214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:42:51.647810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=41 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:51.649671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-e606a4fe-06cf-4e1a-8a45-5ae982d8aaa3 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:51.659447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-e606a4fe-06cf-4e1a-8a45-5ae982d8aaa3 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for user cc213a6bb1bf4e62a3a96799a90e848f and project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:51.662743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:51.663257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:51.664686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:51.665896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:51.666615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:51.667363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:51.689829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:51.696087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Getting quotas for user 03bdf5ec21854ec8b6561a121ce1f1ef and project 17959424b3fd4f8e8eae1df6453a1f60. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:51.721306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:42:51.726904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:42:51.799223 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70fb1ac1-a2f9-4d4c-ab28-b27fbb4f51e5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.014131 Aug 09 14:42:51.800460 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1534/2987] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:42:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:42:51.805888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8d65897-431a-43e2-8fb9-6f346acb5dca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:51.806781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c8d65897-431a-43e2-8fb9-6f346acb5dca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:51.815492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d65897-431a-43e2-8fb9-6f346acb5dca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:51.816224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d65897-431a-43e2-8fb9-6f346acb5dca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:51.816925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d65897-431a-43e2-8fb9-6f346acb5dca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:51.817915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d65897-431a-43e2-8fb9-6f346acb5dca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:51.818874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d65897-431a-43e2-8fb9-6f346acb5dca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:51.819726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8d65897-431a-43e2-8fb9-6f346acb5dca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:52.083034 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e606a4fe-06cf-4e1a-8a45-5ae982d8aaa3 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 61 microversion: 2.1 time: 0.550218 Aug 09 14:42:52.088366 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1454/2988] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:42:51 2022] PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 61 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:52.089721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c82cb63d-484c-4185-94d3-980e08d0cebe tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:52.090335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c82cb63d-484c-4185-94d3-980e08d0cebe tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:52.099290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c82cb63d-484c-4185-94d3-980e08d0cebe tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:52.099783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c82cb63d-484c-4185-94d3-980e08d0cebe tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:52.100210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c82cb63d-484c-4185-94d3-980e08d0cebe tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:52.101157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c82cb63d-484c-4185-94d3-980e08d0cebe tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:52.101601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c82cb63d-484c-4185-94d3-980e08d0cebe tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:52.102376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c82cb63d-484c-4185-94d3-980e08d0cebe tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:52.885019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c8d65897-431a-43e2-8fb9-6f346acb5dca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:52.898490 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8d65897-431a-43e2-8fb9-6f346acb5dca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1499 microversion: 2.1 time: 1.096581 Aug 09 14:42:52.899809 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1535/2989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:51 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1499 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:52.905187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1bf44238-c11f-4581-a729-bd563065475d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:52.905859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1bf44238-c11f-4581-a729-bd563065475d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:52.912448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bf44238-c11f-4581-a729-bd563065475d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:52.913020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bf44238-c11f-4581-a729-bd563065475d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:52.913542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bf44238-c11f-4581-a729-bd563065475d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:52.914960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bf44238-c11f-4581-a729-bd563065475d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:52.915138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bf44238-c11f-4581-a729-bd563065475d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:52.915621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bf44238-c11f-4581-a729-bd563065475d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:53.104465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1bf44238-c11f-4581-a729-bd563065475d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:53.117322 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1bf44238-c11f-4581-a729-bd563065475d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1261 microversion: 2.1 time: 0.216218 Aug 09 14:42:53.120273 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1536/2990] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:52 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1261 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:53.130305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c82cb63d-484c-4185-94d3-980e08d0cebe tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:53.140063 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c82cb63d-484c-4185-94d3-980e08d0cebe tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1325 microversion: 2.1 time: 1.055291 Aug 09 14:42:53.140559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c394072d-de33-477b-96f5-471dbb16bd04 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Action: 'update', calling method: .version_select at 0x7f41dd40be50>, body: {"meta": {"os_version": "alt"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:53.141761 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1455/2991] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:52 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1325 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:53.170850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cbc27cc8-fb17-483a-a681-d42ee05188a4 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:53.177655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cbc27cc8-fb17-483a-a681-d42ee05188a4 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:53.187853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbc27cc8-fb17-483a-a681-d42ee05188a4 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:53.188430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbc27cc8-fb17-483a-a681-d42ee05188a4 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:53.189083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbc27cc8-fb17-483a-a681-d42ee05188a4 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:53.190535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbc27cc8-fb17-483a-a681-d42ee05188a4 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:53.191231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbc27cc8-fb17-483a-a681-d42ee05188a4 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:53.191790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbc27cc8-fb17-483a-a681-d42ee05188a4 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:53.251923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c394072d-de33-477b-96f5-471dbb16bd04 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:53.259779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c394072d-de33-477b-96f5-471dbb16bd04 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for user cc213a6bb1bf4e62a3a96799a90e848f and project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:53.606586 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c394072d-de33-477b-96f5-471dbb16bd04 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.484840 Aug 09 14:42:53.607211 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1537/2992] 10.222.0.50 () {60 vars in 1313 bytes} [Tue Aug 9 14:42:53 2022] PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata/os_version => generated 31 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:53.617230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a326002-a9aa-4a4b-ac3a-7b67b2899154 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Calling method '.version_select at 0x7f41dd425700>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:53.664847 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a326002-a9aa-4a4b-ac3a-7b67b2899154 tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 58 microversion: 2.1 time: 0.051763 Aug 09 14:42:53.666065 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1538/2993] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 9 14:42:53 2022] GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 58 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 14:42:53.678664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c122492f-5344-4941-81c1-76906a3c8e8f tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Action: 'update_all', calling method: .version_select at 0x7f41dd22ca60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:53.731031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:53.751825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c122492f-5344-4941-81c1-76906a3c8e8f tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:53.758774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c122492f-5344-4941-81c1-76906a3c8e8f tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for user cc213a6bb1bf4e62a3a96799a90e848f and project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:53.971243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cbc27cc8-fb17-483a-a681-d42ee05188a4 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:54.005241 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cbc27cc8-fb17-483a-a681-d42ee05188a4 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1682 microversion: 2.1 time: 0.859925 Aug 09 14:42:54.008384 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1456/2994] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:53 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1682 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:54.056304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1152c425-7c8c-4273-b30a-8a6e1c161f92 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:54.059743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1152c425-7c8c-4273-b30a-8a6e1c161f92 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:54.076756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1152c425-7c8c-4273-b30a-8a6e1c161f92 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:54.081442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1152c425-7c8c-4273-b30a-8a6e1c161f92 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:54.082221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1152c425-7c8c-4273-b30a-8a6e1c161f92 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:54.083587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1152c425-7c8c-4273-b30a-8a6e1c161f92 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:54.084054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1152c425-7c8c-4273-b30a-8a6e1c161f92 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:54.084469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1152c425-7c8c-4273-b30a-8a6e1c161f92 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:54.086308 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c122492f-5344-4941-81c1-76906a3c8e8f tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 61 microversion: 2.1 time: 0.412034 Aug 09 14:42:54.086921 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1539/2995] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:42:53 2022] PUT /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 61 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:54.101467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-553b25a1-5a60-4039-aec3-e629292687ee tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Action: 'create', calling method: .version_select at 0x7f41dd6ef4c0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:54.179311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-553b25a1-5a60-4039-aec3-e629292687ee tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:42:54.186288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-553b25a1-5a60-4039-aec3-e629292687ee tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Getting quotas for user cc213a6bb1bf4e62a3a96799a90e848f and project e7f25b2f694f4149b787b7eddf1010e4. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:42:54.617360 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-553b25a1-5a60-4039-aec3-e629292687ee tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "POST /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 85 microversion: 2.1 time: 0.523941 Aug 09 14:42:54.618158 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1540/2996] 10.222.0.50 () {60 vars in 1281 bytes} [Tue Aug 9 14:42:54 2022] POST /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 85 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:54.623532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-17e3840d-10a4-4610-87e8-3377d6bfd576 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:54.624473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-17e3840d-10a4-4610-87e8-3377d6bfd576 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:54.631023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17e3840d-10a4-4610-87e8-3377d6bfd576 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:54.631683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17e3840d-10a4-4610-87e8-3377d6bfd576 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:54.632218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17e3840d-10a4-4610-87e8-3377d6bfd576 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:54.633033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17e3840d-10a4-4610-87e8-3377d6bfd576 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:54.633584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17e3840d-10a4-4610-87e8-3377d6bfd576 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:54.634118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17e3840d-10a4-4610-87e8-3377d6bfd576 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:55.120697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-17e3840d-10a4-4610-87e8-3377d6bfd576 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:55.128685 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-17e3840d-10a4-4610-87e8-3377d6bfd576 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1267 microversion: 2.1 time: 0.509143 Aug 09 14:42:55.129652 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1541/2997] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:54 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1267 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:55.134566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8c8d73af-bad5-41be-92fe-f1582fdb4a7a tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:55.135206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8c8d73af-bad5-41be-92fe-f1582fdb4a7a tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:55.141536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c8d73af-bad5-41be-92fe-f1582fdb4a7a tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:55.142175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c8d73af-bad5-41be-92fe-f1582fdb4a7a tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:55.143117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c8d73af-bad5-41be-92fe-f1582fdb4a7a tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:55.144052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c8d73af-bad5-41be-92fe-f1582fdb4a7a tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:55.144507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c8d73af-bad5-41be-92fe-f1582fdb4a7a tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:55.144889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c8d73af-bad5-41be-92fe-f1582fdb4a7a tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:55.565188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1152c425-7c8c-4273-b30a-8a6e1c161f92 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:55.576353 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1152c425-7c8c-4273-b30a-8a6e1c161f92 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1499 microversion: 2.1 time: 1.566568 Aug 09 14:42:55.580106 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1457/2998] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:54 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1499 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:55.589718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-966436d2-204d-4cf2-b479-9506f212563e tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] Calling method '.version_select at 0x7f41dd2844c0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:55.694042 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-966436d2-204d-4cf2-b479-9506f212563e tempest-ImagesMetadataTestJSON-1735011389 tempest-ImagesMetadataTestJSON-1735011389-project] 10.222.0.50 "GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata" status: 200 len: 85 microversion: 2.1 time: 0.112659 Aug 09 14:42:55.694608 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1458/2999] 10.222.0.50 () {58 vars in 1260 bytes} [Tue Aug 9 14:42:55 2022] GET /compute/v2.1/images/df2118e8-7a5a-4196-8bf1-bd5e98b0cd28/metadata => generated 85 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:42:55.699359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:55.702596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:55.723564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:55.724132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:55.724567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:55.725273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:55.725722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:55.726138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:55.803145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:55.803887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:55.804459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:55.805166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lazy-loading 'fault' on Instance uuid 40892bf1-16b7-466e-8518-9cf8be282cb7 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:42:55.912617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8c8d73af-bad5-41be-92fe-f1582fdb4a7a tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:55.927800 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8c8d73af-bad5-41be-92fe-f1582fdb4a7a tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1325 microversion: 2.1 time: 0.795608 Aug 09 14:42:55.929413 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1542/3000] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:55 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1325 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:55.941386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5096c8d8-1926-48c3-ba2a-f4f83d952702 req-7fc0a9f7-8b71-4d22-b36a-9ba518782612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40892bf1-16b7-466e-8518-9cf8be282cb7", "name": "network-vif-deleted", "tag": "7edc31a2-a874-4936-b752-ab4c8952a0d0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:55.988717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5096c8d8-1926-48c3-ba2a-f4f83d952702 req-7fc0a9f7-8b71-4d22-b36a-9ba518782612 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:55.989223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5096c8d8-1926-48c3-ba2a-f4f83d952702 req-7fc0a9f7-8b71-4d22-b36a-9ba518782612 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:55.989842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5096c8d8-1926-48c3-ba2a-f4f83d952702 req-7fc0a9f7-8b71-4d22-b36a-9ba518782612 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:56.000445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6ddc08c6cfc44fa8ec90cd2752c14ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '320d96eea4cd4bcf83a3e69daf2f77a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:56.026713 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c72b86d-23a0-4733-8fdd-56804cc7b773 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 200 len: 1332 microversion: 2.1 time: 0.330811 Aug 09 14:42:56.042924 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1459/3001] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:55 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 1332 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:56.068849 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5096c8d8-1926-48c3-ba2a-f4f83d952702 req-7fc0a9f7-8b71-4d22-b36a-9ba518782612 service nova] Creating event network-vif-deleted:7edc31a2-a874-4936-b752-ab4c8952a0d0 for instance 40892bf1-16b7-466e-8518-9cf8be282cb7 on n-h2-844626-8 Aug 09 14:42:56.087217 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5096c8d8-1926-48c3-ba2a-f4f83d952702 req-7fc0a9f7-8b71-4d22-b36a-9ba518782612 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153399 Aug 09 14:42:56.091765 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1543/3002] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:42:56.150498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03b7ef75-099d-4996-b5d4-3548ec2b3775 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:56.152361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03b7ef75-099d-4996-b5d4-3548ec2b3775 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:56.179050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03b7ef75-099d-4996-b5d4-3548ec2b3775 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:56.182914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03b7ef75-099d-4996-b5d4-3548ec2b3775 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:56.183639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03b7ef75-099d-4996-b5d4-3548ec2b3775 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:56.186666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03b7ef75-099d-4996-b5d4-3548ec2b3775 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:56.189424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03b7ef75-099d-4996-b5d4-3548ec2b3775 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:56.190539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03b7ef75-099d-4996-b5d4-3548ec2b3775 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:56.501667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-03b7ef75-099d-4996-b5d4-3548ec2b3775 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:56.517969 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03b7ef75-099d-4996-b5d4-3548ec2b3775 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1267 microversion: 2.1 time: 0.370011 Aug 09 14:42:56.519713 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1460/3003] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:56 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1267 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:56.602044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1e4946ef-ba34-4b68-9571-a43e19ec75d5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:56.602825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1e4946ef-ba34-4b68-9571-a43e19ec75d5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:56.617097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e4946ef-ba34-4b68-9571-a43e19ec75d5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:56.617865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e4946ef-ba34-4b68-9571-a43e19ec75d5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:56.618456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e4946ef-ba34-4b68-9571-a43e19ec75d5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:56.619404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e4946ef-ba34-4b68-9571-a43e19ec75d5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:56.620092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e4946ef-ba34-4b68-9571-a43e19ec75d5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:56.620659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e4946ef-ba34-4b68-9571-a43e19ec75d5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:56.948826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e69d269d-0480-44b5-b43e-9a84e0e487d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:56.950137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e69d269d-0480-44b5-b43e-9a84e0e487d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:56.970307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e69d269d-0480-44b5-b43e-9a84e0e487d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:56.972145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e69d269d-0480-44b5-b43e-9a84e0e487d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:56.973419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e69d269d-0480-44b5-b43e-9a84e0e487d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:56.976013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e69d269d-0480-44b5-b43e-9a84e0e487d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:56.976887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e69d269d-0480-44b5-b43e-9a84e0e487d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:56.977903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e69d269d-0480-44b5-b43e-9a84e0e487d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:57.258204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e4946ef-ba34-4b68-9571-a43e19ec75d5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:57.276171 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1e4946ef-ba34-4b68-9571-a43e19ec75d5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1499 microversion: 2.1 time: 0.678954 Aug 09 14:42:57.276871 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1544/3004] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:56 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1499 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:57.298892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9975fb20-82ff-41d3-86c4-259f94ca9086 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:57.299532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9975fb20-82ff-41d3-86c4-259f94ca9086 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:57.319289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9975fb20-82ff-41d3-86c4-259f94ca9086 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:57.319771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9975fb20-82ff-41d3-86c4-259f94ca9086 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:57.320195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9975fb20-82ff-41d3-86c4-259f94ca9086 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:57.320902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9975fb20-82ff-41d3-86c4-259f94ca9086 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:57.321339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9975fb20-82ff-41d3-86c4-259f94ca9086 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:57.321754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9975fb20-82ff-41d3-86c4-259f94ca9086 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:57.356301 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-9975fb20-82ff-41d3-86c4-259f94ca9086 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] HTTP exception thrown: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9975fb20-82ff-41d3-86c4-259f94ca9086 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Request method failure captured: Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 HTTP/1.1 Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nHEkxvMmOh3wtJ6nj6vEmpHTcqw5WEUjVN6DYtUtsrJzKtn-UT9_On8zdVQ1p3352mHq2IJqFiyO4uwyZoXixbyXnCesOgBsnm9eFu0F4SnmFWzv83cDMkP8TLgHH7egUTHO_TzBPYPONJZP83Pvlu2rqXBxEw83VqHe3QzQytndvY Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 320d96eea4cd4bcf83a3e69daf2f77a3 Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-140740215 Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_320d96eea4cd4bcf83a3e69daf2f77a3", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/320d96eea4cd4bcf83a3e69daf2f77a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/320d96eea4cd4bcf83a3e69daf2f77a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/320d96eea4cd4bcf83a3e69daf2f77a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-140740215 Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 320d96eea4cd4bcf83a3e69daf2f77a3 Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-140740215 Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachSCSIVolumeTestJSON-140740215-project Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: a6ddc08c6cfc44fa8ec90cd2752c14ef Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-140740215-project Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '40892bf1-16b7-466e-8518-9cf8be282cb7'} Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:42:57.360604 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:57.365619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:42:57.365619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:42:57.365619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:42:57.365619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:42:57.365619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:42:57.365619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:42:57.365619 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:42:57.367148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9975fb20-82ff-41d3-86c4-259f94ca9086 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Returning 404 to user: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:42:57.368264 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9975fb20-82ff-41d3-86c4-259f94ca9086 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 404 len: 111 microversion: 2.1 time: 0.090434 Aug 09 14:42:57.369021 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1545/3005] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:57 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:42:57.383611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28ff6e96-05ce-4395-9bd9-6fc8f5bf6e5a tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '.version_select at 0x7f41dd33e430>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:57.434382 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28ff6e96-05ce-4395-9bd9-6fc8f5bf6e5a tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666140331" status: 202 len: 0 microversion: 2.1 time: 0.054574 Aug 09 14:42:57.435286 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1546/3006] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 14:42:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1666140331 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:42:57.543136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-525ffe6f-d512-4f77-8b8e-cb8f8ca23179 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:57.546451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-525ffe6f-d512-4f77-8b8e-cb8f8ca23179 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:57.565100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-525ffe6f-d512-4f77-8b8e-cb8f8ca23179 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:57.565593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-525ffe6f-d512-4f77-8b8e-cb8f8ca23179 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:57.566012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-525ffe6f-d512-4f77-8b8e-cb8f8ca23179 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:57.566710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-525ffe6f-d512-4f77-8b8e-cb8f8ca23179 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:57.571251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-525ffe6f-d512-4f77-8b8e-cb8f8ca23179 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:57.571846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-525ffe6f-d512-4f77-8b8e-cb8f8ca23179 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:57.894857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e69d269d-0480-44b5-b43e-9a84e0e487d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:57.925788 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e69d269d-0480-44b5-b43e-9a84e0e487d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1325 microversion: 2.1 time: 0.980726 Aug 09 14:42:57.926428 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1461/3007] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:56 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1325 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:42:58.228458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-353bf977-29a1-4818-8831-9d357f374171 req-0aec627f-b04f-4629-8feb-3fd559ca81dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ac156d-8758-4204-95db-6b33a7655dcc", "tag": "1744c9b6-d893-46c3-8f49-4b748b348e86"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:42:58.241937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-353bf977-29a1-4818-8831-9d357f374171 req-0aec627f-b04f-4629-8feb-3fd559ca81dc service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:58.242717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-353bf977-29a1-4818-8831-9d357f374171 req-0aec627f-b04f-4629-8feb-3fd559ca81dc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:58.243414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-353bf977-29a1-4818-8831-9d357f374171 req-0aec627f-b04f-4629-8feb-3fd559ca81dc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:58.252471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:42:58.265697 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-353bf977-29a1-4818-8831-9d357f374171 req-0aec627f-b04f-4629-8feb-3fd559ca81dc service nova] Creating event network-changed:1744c9b6-d893-46c3-8f49-4b748b348e86 for instance 44ac156d-8758-4204-95db-6b33a7655dcc on n-h1-844626-8 Aug 09 14:42:58.271990 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-353bf977-29a1-4818-8831-9d357f374171 req-0aec627f-b04f-4629-8feb-3fd559ca81dc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047220 Aug 09 14:42:58.272941 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1462/3008] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:42:58.300667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0aeec57e-2922-4443-a89c-7adf8998d7ea tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:58.301379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0aeec57e-2922-4443-a89c-7adf8998d7ea tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:58.317145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aeec57e-2922-4443-a89c-7adf8998d7ea tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:58.320841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aeec57e-2922-4443-a89c-7adf8998d7ea tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:58.321286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aeec57e-2922-4443-a89c-7adf8998d7ea tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:58.322026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aeec57e-2922-4443-a89c-7adf8998d7ea tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:58.322469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aeec57e-2922-4443-a89c-7adf8998d7ea tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:58.328041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aeec57e-2922-4443-a89c-7adf8998d7ea tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:58.607017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-525ffe6f-d512-4f77-8b8e-cb8f8ca23179 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:58.617890 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-525ffe6f-d512-4f77-8b8e-cb8f8ca23179 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1309 microversion: 2.1 time: 1.077546 Aug 09 14:42:58.627501 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1547/3009] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:57 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1309 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:42:58.946931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4af3071f-8c00-4d2d-85aa-7bc2a94ef855 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:58.947608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4af3071f-8c00-4d2d-85aa-7bc2a94ef855 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:58.954937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4af3071f-8c00-4d2d-85aa-7bc2a94ef855 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:58.955761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4af3071f-8c00-4d2d-85aa-7bc2a94ef855 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:58.956365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4af3071f-8c00-4d2d-85aa-7bc2a94ef855 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:58.957281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4af3071f-8c00-4d2d-85aa-7bc2a94ef855 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:58.957907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4af3071f-8c00-4d2d-85aa-7bc2a94ef855 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:58.963953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4af3071f-8c00-4d2d-85aa-7bc2a94ef855 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:59.620592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0aeec57e-2922-4443-a89c-7adf8998d7ea tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:59.634300 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0aeec57e-2922-4443-a89c-7adf8998d7ea tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1499 microversion: 2.1 time: 1.339800 Aug 09 14:42:59.644379 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1463/3010] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:58 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1499 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:42:59.662879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c30cf539-2e3e-4a64-876a-5cd8d3a7c1bd tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:42:59.664897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c30cf539-2e3e-4a64-876a-5cd8d3a7c1bd tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:42:59.673473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c30cf539-2e3e-4a64-876a-5cd8d3a7c1bd tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:59.674672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c30cf539-2e3e-4a64-876a-5cd8d3a7c1bd tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:59.675360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c30cf539-2e3e-4a64-876a-5cd8d3a7c1bd tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:59.676352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c30cf539-2e3e-4a64-876a-5cd8d3a7c1bd tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:42:59.677025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c30cf539-2e3e-4a64-876a-5cd8d3a7c1bd tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:42:59.677593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c30cf539-2e3e-4a64-876a-5cd8d3a7c1bd tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:42:59.941162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4af3071f-8c00-4d2d-85aa-7bc2a94ef855 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:42:59.950710 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4af3071f-8c00-4d2d-85aa-7bc2a94ef855 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1325 microversion: 2.1 time: 1.008322 Aug 09 14:42:59.951914 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1548/3011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:58 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1325 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:43:00.508919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c30cf539-2e3e-4a64-876a-5cd8d3a7c1bd tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:00.522964 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c30cf539-2e3e-4a64-876a-5cd8d3a7c1bd tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1309 microversion: 2.1 time: 0.877187 Aug 09 14:43:00.524323 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1464/3012] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:42:59 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1309 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:00.673853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6839be08-7396-4d1d-a559-6fc469d179a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:00.674719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6839be08-7396-4d1d-a559-6fc469d179a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:00.705076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6839be08-7396-4d1d-a559-6fc469d179a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:00.706124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6839be08-7396-4d1d-a559-6fc469d179a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:00.707920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6839be08-7396-4d1d-a559-6fc469d179a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:00.709022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6839be08-7396-4d1d-a559-6fc469d179a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:00.711505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6839be08-7396-4d1d-a559-6fc469d179a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:00.712535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6839be08-7396-4d1d-a559-6fc469d179a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:00.822699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:00.972467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-534f0941-5a78-40dc-8bed-f5d7f210a4c9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:00.974306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-534f0941-5a78-40dc-8bed-f5d7f210a4c9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:00.982566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-534f0941-5a78-40dc-8bed-f5d7f210a4c9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:00.994963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-534f0941-5a78-40dc-8bed-f5d7f210a4c9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:00.995709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-534f0941-5a78-40dc-8bed-f5d7f210a4c9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:00.997172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-534f0941-5a78-40dc-8bed-f5d7f210a4c9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:00.997736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-534f0941-5a78-40dc-8bed-f5d7f210a4c9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:00.998387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-534f0941-5a78-40dc-8bed-f5d7f210a4c9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:01.593365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6839be08-7396-4d1d-a559-6fc469d179a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:01.597922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-534f0941-5a78-40dc-8bed-f5d7f210a4c9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:01.605937 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-534f0941-5a78-40dc-8bed-f5d7f210a4c9 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1325 microversion: 2.1 time: 0.637254 Aug 09 14:43:01.610281 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6839be08-7396-4d1d-a559-6fc469d179a6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1499 microversion: 2.1 time: 0.937469 Aug 09 14:43:01.610822 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1465/3013] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:00 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1325 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:01.624629 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1549/3014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:00 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1499 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:01.628176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f6b89bcf-0187-4aa1-85ef-1794df5c007f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:01.629368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f6b89bcf-0187-4aa1-85ef-1794df5c007f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:01.642231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b89bcf-0187-4aa1-85ef-1794df5c007f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:01.643364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b89bcf-0187-4aa1-85ef-1794df5c007f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:01.644844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b89bcf-0187-4aa1-85ef-1794df5c007f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:01.646216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b89bcf-0187-4aa1-85ef-1794df5c007f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:01.650090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b89bcf-0187-4aa1-85ef-1794df5c007f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:01.650788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f6b89bcf-0187-4aa1-85ef-1794df5c007f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:01.697255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:01.839617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ad1477fd-6a1a-409b-9690-86e59da3eba2 req-dd78b9ee-603e-4e64-9ff0-236ee3792432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03fa714c-48d4-4831-852f-547a2228111f", "tag": "c039a019-677e-4fb4-97cd-fa615c031578"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:01.854840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:01.869834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ad1477fd-6a1a-409b-9690-86e59da3eba2 req-dd78b9ee-603e-4e64-9ff0-236ee3792432 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:01.873288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ad1477fd-6a1a-409b-9690-86e59da3eba2 req-dd78b9ee-603e-4e64-9ff0-236ee3792432 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:01.873930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ad1477fd-6a1a-409b-9690-86e59da3eba2 req-dd78b9ee-603e-4e64-9ff0-236ee3792432 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:01.906234 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ad1477fd-6a1a-409b-9690-86e59da3eba2 req-dd78b9ee-603e-4e64-9ff0-236ee3792432 service nova] Creating event network-changed:c039a019-677e-4fb4-97cd-fa615c031578 for instance 03fa714c-48d4-4831-852f-547a2228111f on n-h2-844626-8 Aug 09 14:43:01.927927 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ad1477fd-6a1a-409b-9690-86e59da3eba2 req-dd78b9ee-603e-4e64-9ff0-236ee3792432 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094195 Aug 09 14:43:01.928638 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1550/3015] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:43:02.122135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f6b89bcf-0187-4aa1-85ef-1794df5c007f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:02.135640 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f6b89bcf-0187-4aa1-85ef-1794df5c007f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1309 microversion: 2.1 time: 0.523319 Aug 09 14:43:02.136425 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1466/3016] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:01 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1309 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:02.302617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85de38d2-3fcf-48a7-bd9e-ad7510a45b7a tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] Action: 'create', calling method: .version_select at 0x7f41dd329670>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:02.372835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-85de38d2-3fcf-48a7-bd9e-ad7510a45b7a tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] Getting quotas for project 1211fab98fd34fbd9799500370184290. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:02.404884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-85de38d2-3fcf-48a7-bd9e-ad7510a45b7a tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] Getting quotas for user 8b2cc2f28043432892a6a59135b14cee and project 1211fab98fd34fbd9799500370184290. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:02.546754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-85de38d2-3fcf-48a7-bd9e-ad7510a45b7a tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] Getting quotas for project 1211fab98fd34fbd9799500370184290. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:02.566066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-85de38d2-3fcf-48a7-bd9e-ad7510a45b7a tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] Getting quotas for user 8b2cc2f28043432892a6a59135b14cee and project 1211fab98fd34fbd9799500370184290. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:02.607959 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85de38d2-3fcf-48a7-bd9e-ad7510a45b7a tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.676509 Aug 09 14:43:02.615544 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1551/3017] 10.222.0.50 () {62 vars in 1214 bytes} [Tue Aug 9 14:43:01 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:43:02.620522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9fcdc5f6-62d6-471c-ad6b-c353cc0b5b19 tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:02.635434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14b2ba8b-819c-438e-bd4c-af3604df877b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:02.638629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14b2ba8b-819c-438e-bd4c-af3604df877b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:02.653078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14b2ba8b-819c-438e-bd4c-af3604df877b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:02.655713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14b2ba8b-819c-438e-bd4c-af3604df877b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:02.656929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14b2ba8b-819c-438e-bd4c-af3604df877b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:02.657694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14b2ba8b-819c-438e-bd4c-af3604df877b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:02.659357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14b2ba8b-819c-438e-bd4c-af3604df877b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:02.660192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14b2ba8b-819c-438e-bd4c-af3604df877b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:02.665586 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9fcdc5f6-62d6-471c-ad6b-c353cc0b5b19 tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.049045 Aug 09 14:43:02.667234 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1467/3018] 10.222.0.50 () {60 vars in 1193 bytes} [Tue Aug 9 14:43:02 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 14:43:02.681982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-20adae1a-c1ba-4e66-b281-e57d88aed882 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:02.682651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-20adae1a-c1ba-4e66-b281-e57d88aed882 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:02.697821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20adae1a-c1ba-4e66-b281-e57d88aed882 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:02.698396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20adae1a-c1ba-4e66-b281-e57d88aed882 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:02.698815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20adae1a-c1ba-4e66-b281-e57d88aed882 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:02.699623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20adae1a-c1ba-4e66-b281-e57d88aed882 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:02.703898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20adae1a-c1ba-4e66-b281-e57d88aed882 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:02.704708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20adae1a-c1ba-4e66-b281-e57d88aed882 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:03.201180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14b2ba8b-819c-438e-bd4c-af3604df877b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:03.201387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-20adae1a-c1ba-4e66-b281-e57d88aed882 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:03.212613 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14b2ba8b-819c-438e-bd4c-af3604df877b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1325 microversion: 2.1 time: 0.585358 Aug 09 14:43:03.223886 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1552/3019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:02 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1325 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:43:03.244025 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-20adae1a-c1ba-4e66-b281-e57d88aed882 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1499 microversion: 2.1 time: 0.575378 Aug 09 14:43:03.259273 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1468/3020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:02 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1499 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:03.265370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6dcdf794-05c5-42dd-9514-d25881b13a0c tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:03.311969 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6dcdf794-05c5-42dd-9514-d25881b13a0c tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/57520ca8-d71e-4ff1-841f-3a9490672985" status: 200 len: 235 microversion: 2.64 time: 0.048845 Aug 09 14:43:03.318690 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1469/3021] 10.222.0.50 () {60 vars in 1304 bytes} [Tue Aug 9 14:43:03 2022] GET /compute/v2.1/os-server-groups/57520ca8-d71e-4ff1-841f-3a9490672985 => generated 235 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:43:03.342467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-359ad04a-09e0-424e-97aa-03a34f1ac233 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:03.344734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-359ad04a-09e0-424e-97aa-03a34f1ac233 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:03.349500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:03.361597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-359ad04a-09e0-424e-97aa-03a34f1ac233 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:03.362107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-359ad04a-09e0-424e-97aa-03a34f1ac233 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:03.362552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-359ad04a-09e0-424e-97aa-03a34f1ac233 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:03.366664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-359ad04a-09e0-424e-97aa-03a34f1ac233 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:03.369178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-359ad04a-09e0-424e-97aa-03a34f1ac233 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:03.370511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-359ad04a-09e0-424e-97aa-03a34f1ac233 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:03.579711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc75b401-6855-4330-aaba-8c53eff0ceb6 tempest-AZV2TestJSON-2118760920 tempest-AZV2TestJSON-2118760920-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:03.581805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc75b401-6855-4330-aaba-8c53eff0ceb6 tempest-AZV2TestJSON-2118760920 tempest-AZV2TestJSON-2118760920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:03.582457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc75b401-6855-4330-aaba-8c53eff0ceb6 tempest-AZV2TestJSON-2118760920 tempest-AZV2TestJSON-2118760920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:03.584402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc75b401-6855-4330-aaba-8c53eff0ceb6 tempest-AZV2TestJSON-2118760920 tempest-AZV2TestJSON-2118760920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:03.586619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc75b401-6855-4330-aaba-8c53eff0ceb6 tempest-AZV2TestJSON-2118760920 tempest-AZV2TestJSON-2118760920-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:03.588895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc75b401-6855-4330-aaba-8c53eff0ceb6 tempest-AZV2TestJSON-2118760920 tempest-AZV2TestJSON-2118760920-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:03.592761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc75b401-6855-4330-aaba-8c53eff0ceb6 tempest-AZV2TestJSON-2118760920 tempest-AZV2TestJSON-2118760920-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:03.689933 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc75b401-6855-4330-aaba-8c53eff0ceb6 tempest-AZV2TestJSON-2118760920 tempest-AZV2TestJSON-2118760920-project] 10.222.0.50 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.453377 Aug 09 14:43:03.696767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-359ad04a-09e0-424e-97aa-03a34f1ac233 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:03.697382 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1553/3022] 10.222.0.50 () {58 vars in 1164 bytes} [Tue Aug 9 14:43:03 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:43:03.713253 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-359ad04a-09e0-424e-97aa-03a34f1ac233 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1309 microversion: 2.1 time: 0.387259 Aug 09 14:43:03.715866 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1470/3023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:03 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1309 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:03.722952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-647f8097-5bd1-4d78-a393-34a3fc0ba291 req-323d45c3-ea03-4ec6-9ea6-fd180d679049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ac156d-8758-4204-95db-6b33a7655dcc", "name": "network-vif-plugged", "status": "completed", "tag": "1744c9b6-d893-46c3-8f49-4b748b348e86"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:03.724142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ae91c1f-2581-4570-a35d-37243fa6143f tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:03.763195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-647f8097-5bd1-4d78-a393-34a3fc0ba291 req-323d45c3-ea03-4ec6-9ea6-fd180d679049 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:03.770268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-647f8097-5bd1-4d78-a393-34a3fc0ba291 req-323d45c3-ea03-4ec6-9ea6-fd180d679049 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:03.773187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-647f8097-5bd1-4d78-a393-34a3fc0ba291 req-323d45c3-ea03-4ec6-9ea6-fd180d679049 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:03.799821 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-647f8097-5bd1-4d78-a393-34a3fc0ba291 req-323d45c3-ea03-4ec6-9ea6-fd180d679049 service nova] Creating event network-vif-plugged:1744c9b6-d893-46c3-8f49-4b748b348e86 for instance 44ac156d-8758-4204-95db-6b33a7655dcc on n-h1-844626-8 Aug 09 14:43:03.807918 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ae91c1f-2581-4570-a35d-37243fa6143f tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/57520ca8-d71e-4ff1-841f-3a9490672985" status: 204 len: 0 microversion: 2.64 time: 0.107414 Aug 09 14:43:03.808993 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1554/3024] 10.222.0.50 () {60 vars in 1307 bytes} [Tue Aug 9 14:43:03 2022] DELETE /compute/v2.1/os-server-groups/57520ca8-d71e-4ff1-841f-3a9490672985 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:43:03.815189 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-647f8097-5bd1-4d78-a393-34a3fc0ba291 req-323d45c3-ea03-4ec6-9ea6-fd180d679049 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091875 Aug 09 14:43:03.820590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-870d40a3-c1b7-442e-8715-853872553574 tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:03.823920 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1471/3025] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:03.836975 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-870d40a3-c1b7-442e-8715-853872553574 tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] HTTP exception thrown: Instance group 57520ca8-d71e-4ff1-841f-3a9490672985 could not be found. Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-870d40a3-c1b7-442e-8715-853872553574 tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] Request method failure captured: Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/os-server-groups/57520ca8-d71e-4ff1-841f-3a9490672985 HTTP/1.1 Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nJ17AmbTVQDWLGSn0DvaH7OIx7r5QnK0IMBzpftoaV1BN0hvl1xpbZwuZjLpiMPOx05-0BooB8ks4HJdXq7YwRcbu-SPyJFLDtKjnq2ghIp4xzFO8NC2_XKr0DOOJBpvK3rpoB8C_LMoFqwouB2nx6sABxduDkSaXgR_vYcgkpzEiI Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.64 Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 1211fab98fd34fbd9799500370184290 Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerGroup264TestJSON-1387740441 Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1211fab98fd34fbd9799500370184290", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1211fab98fd34fbd9799500370184290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1211fab98fd34fbd9799500370184290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1211fab98fd34fbd9799500370184290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerGroup264TestJSON-1387740441 Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 1211fab98fd34fbd9799500370184290 Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1387740441 Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerGroup264TestJSON-1387740441-project Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 8b2cc2f28043432892a6a59135b14cee Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerGroup264TestJSON-1387740441-project Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance group 57520ca8-d71e-4ff1-841f-3a9490672985 could not be found. Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '57520ca8-d71e-4ff1-841f-3a9490672985'} Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 57520ca8-d71e-4ff1-841f-3a9490672985 could not be found. Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 57520ca8-d71e-4ff1-841f-3a9490672985 could not be found. Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:03.854951 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:03.860017 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:03.860017 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:03.860017 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:03.860017 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:03.860017 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 57520ca8-d71e-4ff1-841f-3a9490672985 could not be found. Aug 09 14:43:03.860017 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:03.863371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-870d40a3-c1b7-442e-8715-853872553574 tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] Returning 404 to user: Instance group 57520ca8-d71e-4ff1-841f-3a9490672985 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:03.864310 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-870d40a3-c1b7-442e-8715-853872553574 tempest-ServerGroup264TestJSON-1387740441 tempest-ServerGroup264TestJSON-1387740441-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/57520ca8-d71e-4ff1-841f-3a9490672985" status: 404 len: 117 microversion: 2.64 time: 0.048674 Aug 09 14:43:03.869125 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1555/3026] 10.222.0.50 () {60 vars in 1307 bytes} [Tue Aug 9 14:43:03 2022] DELETE /compute/v2.1/os-server-groups/57520ca8-d71e-4ff1-841f-3a9490672985 => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:43:04.049407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9448bb36-5c52-4416-a4ed-8d9614459b50 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41dd27f9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2086413879", "description": "tempest-description-2114533009"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:04.237042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bbc6415f-c5d3-49fb-986a-95d1193a095e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:04.237685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bbc6415f-c5d3-49fb-986a-95d1193a095e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:04.261396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbc6415f-c5d3-49fb-986a-95d1193a095e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:04.261900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbc6415f-c5d3-49fb-986a-95d1193a095e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:04.262343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbc6415f-c5d3-49fb-986a-95d1193a095e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:04.263075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbc6415f-c5d3-49fb-986a-95d1193a095e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:04.263553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbc6415f-c5d3-49fb-986a-95d1193a095e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:04.271241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbc6415f-c5d3-49fb-986a-95d1193a095e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:06.001652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bbc6415f-c5d3-49fb-986a-95d1193a095e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:06.036748 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bbc6415f-c5d3-49fb-986a-95d1193a095e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1325 microversion: 2.1 time: 1.805298 Aug 09 14:43:06.043841 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1556/3027] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:04 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1325 bytes in 1813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:06.058433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b58a5cff-c056-4a0c-a1a8-a13b6cf5c7bd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:06.061244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b58a5cff-c056-4a0c-a1a8-a13b6cf5c7bd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:06.101632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b58a5cff-c056-4a0c-a1a8-a13b6cf5c7bd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:06.107967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b58a5cff-c056-4a0c-a1a8-a13b6cf5c7bd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:06.113478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b58a5cff-c056-4a0c-a1a8-a13b6cf5c7bd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:06.119573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b58a5cff-c056-4a0c-a1a8-a13b6cf5c7bd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:06.122205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b58a5cff-c056-4a0c-a1a8-a13b6cf5c7bd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:06.125994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b58a5cff-c056-4a0c-a1a8-a13b6cf5c7bd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:06.405296 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9448bb36-5c52-4416-a4ed-8d9614459b50 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 2.465952 Aug 09 14:43:06.416848 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1472/3028] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:43:03 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 2478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:06.422883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2271b5d5-9a8d-41a9-b1b4-bba4296cef44 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:06.425645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2271b5d5-9a8d-41a9-b1b4-bba4296cef44 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:06.441406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2271b5d5-9a8d-41a9-b1b4-bba4296cef44 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:06.445074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2271b5d5-9a8d-41a9-b1b4-bba4296cef44 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:06.445831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2271b5d5-9a8d-41a9-b1b4-bba4296cef44 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:06.446786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2271b5d5-9a8d-41a9-b1b4-bba4296cef44 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:06.448559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2271b5d5-9a8d-41a9-b1b4-bba4296cef44 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:06.449248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2271b5d5-9a8d-41a9-b1b4-bba4296cef44 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:07.190221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b58a5cff-c056-4a0c-a1a8-a13b6cf5c7bd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:07.208895 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b58a5cff-c056-4a0c-a1a8-a13b6cf5c7bd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1499 microversion: 2.1 time: 1.163362 Aug 09 14:43:07.231777 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1557/3029] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:06 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1499 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:07.250841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5843f4f-b9b6-41ba-9f84-d83c865fd8c2 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41dd6ef4c0>, body: {"security_group_rule": {"parent_group_id": "d17f5dbe-0ebd-443d-8e4b-73e976079916", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:07.332076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2271b5d5-9a8d-41a9-b1b4-bba4296cef44 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:07.340913 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2271b5d5-9a8d-41a9-b1b4-bba4296cef44 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1309 microversion: 2.1 time: 0.921999 Aug 09 14:43:07.345651 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1473/3030] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:06 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1309 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:07.361278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33b47030-bbc9-4760-9b10-69a5ef328e46 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:07.362236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-33b47030-bbc9-4760-9b10-69a5ef328e46 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:07.396192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b47030-bbc9-4760-9b10-69a5ef328e46 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:07.400891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b47030-bbc9-4760-9b10-69a5ef328e46 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:07.402522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b47030-bbc9-4760-9b10-69a5ef328e46 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:07.404397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b47030-bbc9-4760-9b10-69a5ef328e46 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:07.405208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b47030-bbc9-4760-9b10-69a5ef328e46 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:07.406573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33b47030-bbc9-4760-9b10-69a5ef328e46 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:08.209661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-33b47030-bbc9-4760-9b10-69a5ef328e46 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:08.222044 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-33b47030-bbc9-4760-9b10-69a5ef328e46 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1521 microversion: 2.1 time: 0.870902 Aug 09 14:43:08.222700 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1474/3031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:07 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1521 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:08.241955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4366c44c-17df-486f-b795-5fb0314793e5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:08.242679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4366c44c-17df-486f-b795-5fb0314793e5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:08.258616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4366c44c-17df-486f-b795-5fb0314793e5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:08.259651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4366c44c-17df-486f-b795-5fb0314793e5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:08.267937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4366c44c-17df-486f-b795-5fb0314793e5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:08.268972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4366c44c-17df-486f-b795-5fb0314793e5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:08.269616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4366c44c-17df-486f-b795-5fb0314793e5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:08.270220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4366c44c-17df-486f-b795-5fb0314793e5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:08.860437 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c5843f4f-b9b6-41ba-9f84-d83c865fd8c2 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.626374 Aug 09 14:43:08.861390 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1558/3032] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:43:07 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:08.873174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-116275b3-55a4-47f6-8d85-b35d72b04af6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:08.873728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-116275b3-55a4-47f6-8d85-b35d72b04af6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:08.883825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-116275b3-55a4-47f6-8d85-b35d72b04af6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:08.884510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-116275b3-55a4-47f6-8d85-b35d72b04af6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:08.885140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-116275b3-55a4-47f6-8d85-b35d72b04af6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:08.887645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-116275b3-55a4-47f6-8d85-b35d72b04af6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:08.888276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-116275b3-55a4-47f6-8d85-b35d72b04af6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:08.893538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-116275b3-55a4-47f6-8d85-b35d72b04af6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:09.235821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4366c44c-17df-486f-b795-5fb0314793e5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:09.247189 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4366c44c-17df-486f-b795-5fb0314793e5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1499 microversion: 2.1 time: 1.011594 Aug 09 14:43:09.250729 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1475/3033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:08 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1499 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:09.263215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1fb4eba-da4f-4065-b159-c37bc586a5d3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:09.264255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f1fb4eba-da4f-4065-b159-c37bc586a5d3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:09.276809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1fb4eba-da4f-4065-b159-c37bc586a5d3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:09.277843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1fb4eba-da4f-4065-b159-c37bc586a5d3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:09.285331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1fb4eba-da4f-4065-b159-c37bc586a5d3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:09.286852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1fb4eba-da4f-4065-b159-c37bc586a5d3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:09.287670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1fb4eba-da4f-4065-b159-c37bc586a5d3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:09.291593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1fb4eba-da4f-4065-b159-c37bc586a5d3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:09.678458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-116275b3-55a4-47f6-8d85-b35d72b04af6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:09.688095 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-116275b3-55a4-47f6-8d85-b35d72b04af6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1521 microversion: 2.1 time: 0.825524 Aug 09 14:43:09.688680 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1559/3034] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:08 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1521 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:09.719474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b85e0b3-9c3c-4822-9859-1e00b5ddb24c tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41dd182ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-434358916", "description": "tempest-description-460038280"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:10.192024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f1fb4eba-da4f-4065-b159-c37bc586a5d3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:10.202102 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f1fb4eba-da4f-4065-b159-c37bc586a5d3 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1309 microversion: 2.1 time: 0.949705 Aug 09 14:43:10.203422 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1476/3035] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:09 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1309 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:10.221155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ea132981-1eac-4ae7-9128-d14b5e3d4af1 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1888956129"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:10.225300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ea132981-1eac-4ae7-9128-d14b5e3d4af1 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:10.244720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea132981-1eac-4ae7-9128-d14b5e3d4af1 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:10.245247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea132981-1eac-4ae7-9128-d14b5e3d4af1 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:10.245247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea132981-1eac-4ae7-9128-d14b5e3d4af1 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:10.245932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea132981-1eac-4ae7-9128-d14b5e3d4af1 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:10.246390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea132981-1eac-4ae7-9128-d14b5e3d4af1 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:10.246820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ea132981-1eac-4ae7-9128-d14b5e3d4af1 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:10.718577 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ea132981-1eac-4ae7-9128-d14b5e3d4af1 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "POST /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc/action" status: 202 len: 0 microversion: 2.1 time: 0.513631 Aug 09 14:43:10.725720 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1477/3036] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:43:10 2022] POST /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 14:43:10.731668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7cd2ae3-2458-4a92-a1e6-2cb1ce0c49fa tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:10.735766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7cd2ae3-2458-4a92-a1e6-2cb1ce0c49fa tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:10.755395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7cd2ae3-2458-4a92-a1e6-2cb1ce0c49fa tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:10.756188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7cd2ae3-2458-4a92-a1e6-2cb1ce0c49fa tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:10.756787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7cd2ae3-2458-4a92-a1e6-2cb1ce0c49fa tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:10.757690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7cd2ae3-2458-4a92-a1e6-2cb1ce0c49fa tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:10.758339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7cd2ae3-2458-4a92-a1e6-2cb1ce0c49fa tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:10.758864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7cd2ae3-2458-4a92-a1e6-2cb1ce0c49fa tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:10.794645 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-a7cd2ae3-2458-4a92-a1e6-2cb1ce0c49fa tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] HTTP exception thrown: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7cd2ae3-2458-4a92-a1e6-2cb1ce0c49fa tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Request method failure captured: Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 HTTP/1.1 Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nHEkxvMmOh3wtJ6nj6vEmpHTcqw5WEUjVN6DYtUtsrJzKtn-UT9_On8zdVQ1p3352mHq2IJqFiyO4uwyZoXixbyXnCesOgBsnm9eFu0F4SnmFWzv83cDMkP8TLgHH7egUTHO_TzBPYPONJZP83Pvlu2rqXBxEw83VqHe3QzQytndvY Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 320d96eea4cd4bcf83a3e69daf2f77a3 Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-140740215 Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_320d96eea4cd4bcf83a3e69daf2f77a3", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/320d96eea4cd4bcf83a3e69daf2f77a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/320d96eea4cd4bcf83a3e69daf2f77a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/320d96eea4cd4bcf83a3e69daf2f77a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-140740215 Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 320d96eea4cd4bcf83a3e69daf2f77a3 Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-140740215 Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AttachSCSIVolumeTestJSON-140740215-project Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: a6ddc08c6cfc44fa8ec90cd2752c14ef Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-140740215-project Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '40892bf1-16b7-466e-8518-9cf8be282cb7'} Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:10.796626 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:10.801622 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:43:10.801622 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:10.801622 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:10.801622 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:10.801622 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:10.801622 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:10.801622 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:10.801622 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:10.801622 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:10.801622 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:43:10.801622 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:10.801622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7cd2ae3-2458-4a92-a1e6-2cb1ce0c49fa tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Returning 404 to user: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:10.802900 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7cd2ae3-2458-4a92-a1e6-2cb1ce0c49fa tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "DELETE /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 404 len: 111 microversion: 2.1 time: 0.075315 Aug 09 14:43:10.809415 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1478/3037] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:10 2022] DELETE /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:10.818621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b142dcc4-8e32-41f2-ab17-d19507b7117d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:10.819849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b142dcc4-8e32-41f2-ab17-d19507b7117d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:10.829742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b142dcc4-8e32-41f2-ab17-d19507b7117d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:10.839855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b142dcc4-8e32-41f2-ab17-d19507b7117d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:10.840479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b142dcc4-8e32-41f2-ab17-d19507b7117d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:10.841335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b142dcc4-8e32-41f2-ab17-d19507b7117d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:10.841889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b142dcc4-8e32-41f2-ab17-d19507b7117d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:10.842495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b142dcc4-8e32-41f2-ab17-d19507b7117d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:11.460870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b142dcc4-8e32-41f2-ab17-d19507b7117d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:11.469160 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b142dcc4-8e32-41f2-ab17-d19507b7117d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1499 microversion: 2.1 time: 0.658470 Aug 09 14:43:11.479971 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1479/3038] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:10 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1499 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:11.485132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-65c86342-fa2d-4958-aae3-0b7d6ef55f35 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '.version_select at 0x7f41e758ab80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:11.613083 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b85e0b3-9c3c-4822-9859-1e00b5ddb24c tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.919875 Aug 09 14:43:11.618332 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1560/3039] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:43:09 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:11.639992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f933895-2673-449e-9c82-451728d81d57 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:11.641958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7f933895-2673-449e-9c82-451728d81d57 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] [instance: 40892bf1-16b7-466e-8518-9cf8be282cb7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:11.669579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f933895-2673-449e-9c82-451728d81d57 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:11.671289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f933895-2673-449e-9c82-451728d81d57 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:11.673723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f933895-2673-449e-9c82-451728d81d57 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:11.682261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f933895-2673-449e-9c82-451728d81d57 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:11.683168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f933895-2673-449e-9c82-451728d81d57 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:11.683812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f933895-2673-449e-9c82-451728d81d57 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:11.714848 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-7f933895-2673-449e-9c82-451728d81d57 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] HTTP exception thrown: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f933895-2673-449e-9c82-451728d81d57 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Request method failure captured: Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 HTTP/1.1 Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nHEkxvMmOh3wtJ6nj6vEmpHTcqw5WEUjVN6DYtUtsrJzKtn-UT9_On8zdVQ1p3352mHq2IJqFiyO4uwyZoXixbyXnCesOgBsnm9eFu0F4SnmFWzv83cDMkP8TLgHH7egUTHO_TzBPYPONJZP83Pvlu2rqXBxEw83VqHe3QzQytndvY Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 320d96eea4cd4bcf83a3e69daf2f77a3 Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-140740215 Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_320d96eea4cd4bcf83a3e69daf2f77a3", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/320d96eea4cd4bcf83a3e69daf2f77a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/320d96eea4cd4bcf83a3e69daf2f77a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/320d96eea4cd4bcf83a3e69daf2f77a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-140740215 Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 320d96eea4cd4bcf83a3e69daf2f77a3 Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-140740215 Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachSCSIVolumeTestJSON-140740215-project Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: a6ddc08c6cfc44fa8ec90cd2752c14ef Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-140740215-project Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '40892bf1-16b7-466e-8518-9cf8be282cb7'} Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:11.717317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:11.723513 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:11.723513 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:11.723513 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:11.723513 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:11.723513 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:11.723513 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. Aug 09 14:43:11.723513 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:11.727844 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-65c86342-fa2d-4958-aae3-0b7d6ef55f35 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "DELETE /compute/v2.1/images/8115f439-e836-4dd1-acc7-b3d5bcd0db6d" status: 204 len: 0 microversion: 2.1 time: 0.241328 Aug 09 14:43:11.727844 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1480/3040] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:11 2022] DELETE /compute/v2.1/images/8115f439-e836-4dd1-acc7-b3d5bcd0db6d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:43:11.728064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f933895-2673-449e-9c82-451728d81d57 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] Returning 404 to user: Instance 40892bf1-16b7-466e-8518-9cf8be282cb7 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:11.728064 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7f933895-2673-449e-9c82-451728d81d57 tempest-AttachSCSIVolumeTestJSON-140740215 tempest-AttachSCSIVolumeTestJSON-140740215-project] 10.222.0.50 "GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7" status: 404 len: 111 microversion: 2.1 time: 0.107936 Aug 09 14:43:11.728660 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1561/3041] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:11 2022] GET /compute/v2.1/servers/40892bf1-16b7-466e-8518-9cf8be282cb7 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:11.730266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8bdb4d89-d490-414c-b349-682a4edefbf2 req-aa24b9fa-53f0-48a2-9ae4-adbab8bce918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03fa714c-48d4-4831-852f-547a2228111f", "name": "network-vif-plugged", "status": "completed", "tag": "c039a019-677e-4fb4-97cd-fa615c031578"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:11.737516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-716d1a94-7eac-439b-9d00-8445c29d4d59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:11.743292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-716d1a94-7eac-439b-9d00-8445c29d4d59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:11.752854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-716d1a94-7eac-439b-9d00-8445c29d4d59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:11.753775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-716d1a94-7eac-439b-9d00-8445c29d4d59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:11.754571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-716d1a94-7eac-439b-9d00-8445c29d4d59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:11.755565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-716d1a94-7eac-439b-9d00-8445c29d4d59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:11.756174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-716d1a94-7eac-439b-9d00-8445c29d4d59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:11.756750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-716d1a94-7eac-439b-9d00-8445c29d4d59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:11.757740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8bdb4d89-d490-414c-b349-682a4edefbf2 req-aa24b9fa-53f0-48a2-9ae4-adbab8bce918 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:11.758234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8bdb4d89-d490-414c-b349-682a4edefbf2 req-aa24b9fa-53f0-48a2-9ae4-adbab8bce918 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:11.758666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8bdb4d89-d490-414c-b349-682a4edefbf2 req-aa24b9fa-53f0-48a2-9ae4-adbab8bce918 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:11.792570 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8bdb4d89-d490-414c-b349-682a4edefbf2 req-aa24b9fa-53f0-48a2-9ae4-adbab8bce918 service nova] Creating event network-vif-plugged:c039a019-677e-4fb4-97cd-fa615c031578 for instance 03fa714c-48d4-4831-852f-547a2228111f on n-h2-844626-8 Aug 09 14:43:11.805875 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8bdb4d89-d490-414c-b349-682a4edefbf2 req-aa24b9fa-53f0-48a2-9ae4-adbab8bce918 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080506 Aug 09 14:43:11.811422 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1481/3042] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:11.830526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-29cd6cbc-eea2-4685-99c1-7d8ca854e8e3 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41e7591dc0>, body: {"security_group_rule": {"parent_group_id": "8c94e9ac-6ab9-4cce-b54a-1e3e0c1639f6", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:12.422296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-716d1a94-7eac-439b-9d00-8445c29d4d59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:12.486508 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-716d1a94-7eac-439b-9d00-8445c29d4d59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1309 microversion: 2.1 time: 0.741988 Aug 09 14:43:12.488522 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1562/3043] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:11 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1309 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:12.504873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78a8c3a8-31dd-483b-85d8-1cca6f5a9af3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '.version_select at 0x7f41dd1c9280>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:12.557603 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-78a8c3a8-31dd-483b-85d8-1cca6f5a9af3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] HTTP exception thrown: Image not found. Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78a8c3a8-31dd-483b-85d8-1cca6f5a9af3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/images/8115f439-e836-4dd1-acc7-b3d5bcd0db6d HTTP/1.1 Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: exception: Image not found. Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '8115f439-e836-4dd1-acc7-b3d5bcd0db6d'} Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8115f439-e836-4dd1-acc7-b3d5bcd0db6d Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 14:43:12.560112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8115f439-e836-4dd1-acc7-b3d5bcd0db6d could not be found. Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:12.564183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78a8c3a8-31dd-483b-85d8-1cca6f5a9af3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 404 to user: Image not found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:12.567626 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78a8c3a8-31dd-483b-85d8-1cca6f5a9af3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/images/8115f439-e836-4dd1-acc7-b3d5bcd0db6d" status: 404 len: 62 microversion: 2.1 time: 0.069687 Aug 09 14:43:12.568946 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1563/3044] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:12 2022] GET /compute/v2.1/images/8115f439-e836-4dd1-acc7-b3d5bcd0db6d => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:43:12.576688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ed1532e-cd05-44d0-9452-173d71329e6f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:12.577725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ed1532e-cd05-44d0-9452-173d71329e6f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:12.587272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed1532e-cd05-44d0-9452-173d71329e6f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:12.587774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed1532e-cd05-44d0-9452-173d71329e6f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:12.588408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed1532e-cd05-44d0-9452-173d71329e6f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:12.589447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed1532e-cd05-44d0-9452-173d71329e6f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:12.590055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed1532e-cd05-44d0-9452-173d71329e6f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:12.590634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed1532e-cd05-44d0-9452-173d71329e6f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:12.591420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=41 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:13.012733 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-29cd6cbc-eea2-4685-99c1-7d8ca854e8e3 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.194201 Aug 09 14:43:13.013877 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1482/3045] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:43:11 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:13.029098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c60b277e-7ad6-4bb4-a37e-6265ff14e749 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:13.030279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c60b277e-7ad6-4bb4-a37e-6265ff14e749 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:13.044507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c60b277e-7ad6-4bb4-a37e-6265ff14e749 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:13.045228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c60b277e-7ad6-4bb4-a37e-6265ff14e749 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:13.046070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c60b277e-7ad6-4bb4-a37e-6265ff14e749 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:13.047012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c60b277e-7ad6-4bb4-a37e-6265ff14e749 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:13.047623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c60b277e-7ad6-4bb4-a37e-6265ff14e749 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:13.048186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c60b277e-7ad6-4bb4-a37e-6265ff14e749 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:13.210141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ed1532e-cd05-44d0-9452-173d71329e6f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:13.225982 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ed1532e-cd05-44d0-9452-173d71329e6f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 200 len: 1476 microversion: 2.1 time: 0.655620 Aug 09 14:43:13.241788 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1564/3046] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:12 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 1476 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:13.249086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ce2d5747-d3a3-42b5-9ece-82f2189ca1b1 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41dd182280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-338491901", "description": "tempest-description-590829284"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:13.571805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c60b277e-7ad6-4bb4-a37e-6265ff14e749 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:13.613154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:13.613556 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c60b277e-7ad6-4bb4-a37e-6265ff14e749 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1539 microversion: 2.1 time: 0.597661 Aug 09 14:43:13.632594 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1483/3047] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:13 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1539 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:13.652016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b12a020-0423-4b8c-933b-df2659388384 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-50041830"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:13.659512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b12a020-0423-4b8c-933b-df2659388384 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:13.683759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b12a020-0423-4b8c-933b-df2659388384 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:13.685409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b12a020-0423-4b8c-933b-df2659388384 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:13.686201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b12a020-0423-4b8c-933b-df2659388384 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:13.690259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b12a020-0423-4b8c-933b-df2659388384 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:13.690958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b12a020-0423-4b8c-933b-df2659388384 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:13.693580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b12a020-0423-4b8c-933b-df2659388384 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:14.004020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:14.162411 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b12a020-0423-4b8c-933b-df2659388384 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "POST /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8/action" status: 202 len: 0 microversion: 2.1 time: 0.513754 Aug 09 14:43:14.165785 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1484/3048] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:43:13 2022] POST /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 14:43:14.173755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c498c48d-38f2-4879-929b-c8a7c1e81d71 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:14.174493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c498c48d-38f2-4879-929b-c8a7c1e81d71 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:14.207725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c498c48d-38f2-4879-929b-c8a7c1e81d71 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:14.213362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c498c48d-38f2-4879-929b-c8a7c1e81d71 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:14.215494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c498c48d-38f2-4879-929b-c8a7c1e81d71 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:14.219818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c498c48d-38f2-4879-929b-c8a7c1e81d71 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:14.221551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c498c48d-38f2-4879-929b-c8a7c1e81d71 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:14.222051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c498c48d-38f2-4879-929b-c8a7c1e81d71 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:15.281810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c498c48d-38f2-4879-929b-c8a7c1e81d71 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:15.299585 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c498c48d-38f2-4879-929b-c8a7c1e81d71 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1488 microversion: 2.1 time: 1.132380 Aug 09 14:43:15.308464 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1485/3049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:14 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1488 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:15.319646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cb9150c4-1f82-491e-b978-e804cdc7dcef tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd347820>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:15.339386 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ce2d5747-d3a3-42b5-9ece-82f2189ca1b1 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 2.097920 Aug 09 14:43:15.341531 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1565/3050] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:43:13 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:15.346817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-839c1385-d26a-40bd-9b0d-aa92091968f7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:15.347461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-839c1385-d26a-40bd-9b0d-aa92091968f7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:15.361245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-839c1385-d26a-40bd-9b0d-aa92091968f7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:15.364587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-839c1385-d26a-40bd-9b0d-aa92091968f7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:15.366574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-839c1385-d26a-40bd-9b0d-aa92091968f7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:15.369763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-839c1385-d26a-40bd-9b0d-aa92091968f7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:15.370549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-839c1385-d26a-40bd-9b0d-aa92091968f7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:15.372916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-839c1385-d26a-40bd-9b0d-aa92091968f7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:15.423823 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cb9150c4-1f82-491e-b978-e804cdc7dcef tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.113526 Aug 09 14:43:15.425291 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1486/3051] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:15 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:15.430890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-20e1c8d4-7d8d-439c-bce6-6b7f8d0e450d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1573401170"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:15.434284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-20e1c8d4-7d8d-439c-bce6-6b7f8d0e450d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:15.443361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20e1c8d4-7d8d-439c-bce6-6b7f8d0e450d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:15.445018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20e1c8d4-7d8d-439c-bce6-6b7f8d0e450d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:15.446481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20e1c8d4-7d8d-439c-bce6-6b7f8d0e450d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:15.449255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20e1c8d4-7d8d-439c-bce6-6b7f8d0e450d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:15.450579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20e1c8d4-7d8d-439c-bce6-6b7f8d0e450d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:15.451331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20e1c8d4-7d8d-439c-bce6-6b7f8d0e450d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:15.595585 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-20e1c8d4-7d8d-439c-bce6-6b7f8d0e450d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "PUT /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1073 microversion: 2.1 time: 0.168741 Aug 09 14:43:15.596291 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1487/3052] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 9 14:43:15 2022] PUT /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1073 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:15.608436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fb1f8fda-01aa-4cf8-9f73-b160a9cab84f tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41e755f1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1730018200", "description": "tempest-description-2012636976"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:16.142824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-839c1385-d26a-40bd-9b0d-aa92091968f7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:16.152899 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-839c1385-d26a-40bd-9b0d-aa92091968f7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1521 microversion: 2.1 time: 0.810214 Aug 09 14:43:16.154571 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1566/3053] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:15 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1521 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:16.160824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c184e854-a808-4b27-aeb9-2b83699bb69d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:16.161965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c184e854-a808-4b27-aeb9-2b83699bb69d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:16.174654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c184e854-a808-4b27-aeb9-2b83699bb69d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:16.175592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c184e854-a808-4b27-aeb9-2b83699bb69d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:16.176115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c184e854-a808-4b27-aeb9-2b83699bb69d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:16.177006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c184e854-a808-4b27-aeb9-2b83699bb69d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:16.177865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c184e854-a808-4b27-aeb9-2b83699bb69d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:16.178481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c184e854-a808-4b27-aeb9-2b83699bb69d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:16.745751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c184e854-a808-4b27-aeb9-2b83699bb69d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:16.792069 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c184e854-a808-4b27-aeb9-2b83699bb69d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1499 microversion: 2.1 time: 0.633157 Aug 09 14:43:16.797691 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1567/3054] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:16 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1499 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:16.833440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a1110aa-d288-4fd5-8bec-2f24f131f32f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:16.840141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0a1110aa-d288-4fd5-8bec-2f24f131f32f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:16.854309 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fb1f8fda-01aa-4cf8-9f73-b160a9cab84f tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.254056 Aug 09 14:43:16.855532 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1488/3055] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:43:15 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:16.861111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-05e73d80-85b7-43ed-89ba-7bc221e16af0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddd80160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:16.866644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a1110aa-d288-4fd5-8bec-2f24f131f32f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:16.868494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a1110aa-d288-4fd5-8bec-2f24f131f32f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:16.870838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a1110aa-d288-4fd5-8bec-2f24f131f32f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:16.871915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a1110aa-d288-4fd5-8bec-2f24f131f32f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:16.875912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a1110aa-d288-4fd5-8bec-2f24f131f32f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:16.876668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a1110aa-d288-4fd5-8bec-2f24f131f32f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:16.941867 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-05e73d80-85b7-43ed-89ba-7bc221e16af0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.085057 Aug 09 14:43:16.942515 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1489/3056] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:16 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:16.944657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0a1110aa-d288-4fd5-8bec-2f24f131f32f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:43:16.973131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7065a976-00a3-4dbb-a55f-d0d6b2acf00a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:16.996993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7065a976-00a3-4dbb-a55f-d0d6b2acf00a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:17.005854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7065a976-00a3-4dbb-a55f-d0d6b2acf00a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:17.009836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7065a976-00a3-4dbb-a55f-d0d6b2acf00a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:17.010588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7065a976-00a3-4dbb-a55f-d0d6b2acf00a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:17.013828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7065a976-00a3-4dbb-a55f-d0d6b2acf00a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:17.014509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7065a976-00a3-4dbb-a55f-d0d6b2acf00a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:17.016116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7065a976-00a3-4dbb-a55f-d0d6b2acf00a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:17.151203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:17.171169 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0a1110aa-d288-4fd5-8bec-2f24f131f32f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "DELETE /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 204 len: 0 microversion: 2.1 time: 0.364612 Aug 09 14:43:17.171169 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1568/3057] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:16 2022] DELETE /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:43:17.181279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc70c76a-ce98-4204-8380-9e52554dd8a6 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41dd6efa60>, body: {"security_group_rule": {"parent_group_id": "90dd4171-6404-4dfa-90a1-3b6eeb1e785d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "55a89948-8fb1-4f25-b020-84a766f88e68"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:17.698244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7065a976-00a3-4dbb-a55f-d0d6b2acf00a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:17.736979 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7065a976-00a3-4dbb-a55f-d0d6b2acf00a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1499 microversion: 2.1 time: 0.793370 Aug 09 14:43:17.743443 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1490/3058] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:16 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1499 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:17.752317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d79fb13d-26f7-41c5-bdb9-dd6b9ae53f83 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:17.753346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d79fb13d-26f7-41c5-bdb9-dd6b9ae53f83 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:17.772488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d79fb13d-26f7-41c5-bdb9-dd6b9ae53f83 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:17.773690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d79fb13d-26f7-41c5-bdb9-dd6b9ae53f83 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:17.774847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d79fb13d-26f7-41c5-bdb9-dd6b9ae53f83 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:17.779681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d79fb13d-26f7-41c5-bdb9-dd6b9ae53f83 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:17.782104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d79fb13d-26f7-41c5-bdb9-dd6b9ae53f83 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:17.782887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d79fb13d-26f7-41c5-bdb9-dd6b9ae53f83 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:18.316441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d79fb13d-26f7-41c5-bdb9-dd6b9ae53f83 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:18.354908 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d79fb13d-26f7-41c5-bdb9-dd6b9ae53f83 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1527 microversion: 2.1 time: 0.600419 Aug 09 14:43:18.356433 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1491/3059] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:17 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1527 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:18.368857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-dbf45bce-9bc8-493d-87ef-df63267d2f9e req-702b7e3a-cea9-40ca-8ff7-5de238908a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ac156d-8758-4204-95db-6b33a7655dcc", "name": "network-vif-plugged", "status": "completed", "tag": "1744c9b6-d893-46c3-8f49-4b748b348e86"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:18.388358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dbf45bce-9bc8-493d-87ef-df63267d2f9e req-702b7e3a-cea9-40ca-8ff7-5de238908a02 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:18.389201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dbf45bce-9bc8-493d-87ef-df63267d2f9e req-702b7e3a-cea9-40ca-8ff7-5de238908a02 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:18.389845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dbf45bce-9bc8-493d-87ef-df63267d2f9e req-702b7e3a-cea9-40ca-8ff7-5de238908a02 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:18.404878 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-dbf45bce-9bc8-493d-87ef-df63267d2f9e req-702b7e3a-cea9-40ca-8ff7-5de238908a02 service nova] Creating event network-vif-plugged:1744c9b6-d893-46c3-8f49-4b748b348e86 for instance 44ac156d-8758-4204-95db-6b33a7655dcc on n-h1-844626-8 Aug 09 14:43:18.411271 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-dbf45bce-9bc8-493d-87ef-df63267d2f9e req-702b7e3a-cea9-40ca-8ff7-5de238908a02 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052082 Aug 09 14:43:18.412740 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1492/3060] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:18.436725 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc70c76a-ce98-4204-8380-9e52554dd8a6 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.269669 Aug 09 14:43:18.438275 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1569/3061] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:43:17 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:18.444588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9ac5ea7-7e34-4c30-9a99-c929dee675ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:18.464281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9ac5ea7-7e34-4c30-9a99-c929dee675ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:18.464707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9ac5ea7-7e34-4c30-9a99-c929dee675ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:18.465150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9ac5ea7-7e34-4c30-9a99-c929dee675ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:18.526473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a9ac5ea7-7e34-4c30-9a99-c929dee675ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Going to try to stop instance {{(pid=119407) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 14:43:18.644527 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a9ac5ea7-7e34-4c30-9a99-c929dee675ee tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "POST /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f/action" status: 202 len: 0 microversion: 2.1 time: 0.204110 Aug 09 14:43:18.650415 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1570/3062] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:43:18 2022] POST /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:18.662026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a897065d-2c61-4e26-9f10-aea3ffeb966a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd388c10>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:18.749333 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a897065d-2c61-4e26-9f10-aea3ffeb966a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.095646 Aug 09 14:43:18.758088 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1571/3063] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:18 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:18.770048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78c68d1a-b211-4da0-822d-7d55d3a75742 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41dd38b3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-218799752", "description": "tempest-description-646158816"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:18.880175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19e70fc6-aa03-42fd-810b-1f0498909feb tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Action: 'create', calling method: .version_select at 0x7f41dd394af0>, body: {"keypair": {"name": "tempest-keypair-1480517280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpFhqie4+mkIGUf7+I1kAtetPyMChgAxP2TgP9sttFGzSRaoPeXup9aycdwGEomX2ty2unRP2FhF1uZVD397G54VxH9FipakCO5wIUChk18IEaTUCp/NjVXj3ZyznjaGw=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:18.917942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-19e70fc6-aa03-42fd-810b-1f0498909feb tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Getting quotas for project 46e7f336a89344d4b290ca53afb88a67. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:18.935979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-19e70fc6-aa03-42fd-810b-1f0498909feb tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Getting quotas for user 7e06d9e017984792867874887aa80991 and project 46e7f336a89344d4b290ca53afb88a67. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:18.988505 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-19e70fc6-aa03-42fd-810b-1f0498909feb tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.573786 Aug 09 14:43:18.997688 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1493/3064] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:43:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:19.003475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94cbd518-8611-4865-81e8-468f451a89d0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:19.004740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-94cbd518-8611-4865-81e8-468f451a89d0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:19.015147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94cbd518-8611-4865-81e8-468f451a89d0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:19.015983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94cbd518-8611-4865-81e8-468f451a89d0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:19.016731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94cbd518-8611-4865-81e8-468f451a89d0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:19.017858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94cbd518-8611-4865-81e8-468f451a89d0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:19.018550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94cbd518-8611-4865-81e8-468f451a89d0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:19.019280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94cbd518-8611-4865-81e8-468f451a89d0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:20.055721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-94cbd518-8611-4865-81e8-468f451a89d0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:20.072055 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-94cbd518-8611-4865-81e8-468f451a89d0 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1509 microversion: 2.1 time: 1.072789 Aug 09 14:43:20.073236 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1494/3065] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:18 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1509 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:20.077943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c6af100d-367c-4cba-b949-1f43fbfe4ca0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:20.079007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6af100d-367c-4cba-b949-1f43fbfe4ca0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:20.095675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6af100d-367c-4cba-b949-1f43fbfe4ca0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:20.096645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6af100d-367c-4cba-b949-1f43fbfe4ca0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:20.107834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6af100d-367c-4cba-b949-1f43fbfe4ca0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:20.108912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6af100d-367c-4cba-b949-1f43fbfe4ca0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:20.109531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6af100d-367c-4cba-b949-1f43fbfe4ca0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:20.110121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6af100d-367c-4cba-b949-1f43fbfe4ca0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:20.735438 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78c68d1a-b211-4da0-822d-7d55d3a75742 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.975891 Aug 09 14:43:20.743313 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1572/3066] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:43:18 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:20.743313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3fa90c76-951b-4f40-9073-5df4bb217ee7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd38b4c0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:20.843132 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3fa90c76-951b-4f40-9073-5df4bb217ee7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.105264 Aug 09 14:43:20.851620 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1573/3067] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:20 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:20.871235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96584032-7a47-4dd0-8e08-af6d00461011 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41dd2d30d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1462382008", "description": "tempest-description-975587047"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:21.002648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c6af100d-367c-4cba-b949-1f43fbfe4ca0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:21.022065 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c6af100d-367c-4cba-b949-1f43fbfe4ca0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1527 microversion: 2.1 time: 0.936642 Aug 09 14:43:21.032038 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1495/3068] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:20 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1527 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:21.044411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-4bba22d0-7e32-4836-a562-27a5bff78b80 req-10d1fc21-c500-44cf-9a1e-bc7f48a1de41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99173f66-b303-416e-b3ba-71109d2fc9f8", "name": "network-vif-plugged", "status": "completed", "tag": "af76a083-7c14-4aa2-856b-8763fd515266"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:21.091506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4bba22d0-7e32-4836-a562-27a5bff78b80 req-10d1fc21-c500-44cf-9a1e-bc7f48a1de41 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:21.094712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4bba22d0-7e32-4836-a562-27a5bff78b80 req-10d1fc21-c500-44cf-9a1e-bc7f48a1de41 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:21.097246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4bba22d0-7e32-4836-a562-27a5bff78b80 req-10d1fc21-c500-44cf-9a1e-bc7f48a1de41 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:21.133006 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4bba22d0-7e32-4836-a562-27a5bff78b80 req-10d1fc21-c500-44cf-9a1e-bc7f48a1de41 service nova] Creating event network-vif-plugged:af76a083-7c14-4aa2-856b-8763fd515266 for instance 99173f66-b303-416e-b3ba-71109d2fc9f8 on n-h1-844626-8 Aug 09 14:43:21.144435 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-4bba22d0-7e32-4836-a562-27a5bff78b80 req-10d1fc21-c500-44cf-9a1e-bc7f48a1de41 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108866 Aug 09 14:43:21.146251 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1496/3069] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:21.158857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-25db9669-8531-4c68-85f3-85ae98fe7ef8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:21.159816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-25db9669-8531-4c68-85f3-85ae98fe7ef8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:21.195065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25db9669-8531-4c68-85f3-85ae98fe7ef8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:21.195594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25db9669-8531-4c68-85f3-85ae98fe7ef8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:21.196025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25db9669-8531-4c68-85f3-85ae98fe7ef8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:21.204386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25db9669-8531-4c68-85f3-85ae98fe7ef8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:21.205135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25db9669-8531-4c68-85f3-85ae98fe7ef8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:21.205663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25db9669-8531-4c68-85f3-85ae98fe7ef8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:21.931042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-25db9669-8531-4c68-85f3-85ae98fe7ef8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:21.939196 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-25db9669-8531-4c68-85f3-85ae98fe7ef8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1509 microversion: 2.1 time: 0.789749 Aug 09 14:43:21.945773 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1497/3070] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:21 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1509 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:21.950626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34bfcafb-2464-4731-9e43-d61d807c12ca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddf109d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:22.089582 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34bfcafb-2464-4731-9e43-d61d807c12ca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.142485 Aug 09 14:43:22.099765 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1498/3071] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:21 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:22.106228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-740d09d7-4f34-451b-b205-7df36cda6655 req-58ba4874-fc3b-4c3e-b8d1-18512ae2f2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ac156d-8758-4204-95db-6b33a7655dcc", "name": "network-vif-deleted", "tag": "1744c9b6-d893-46c3-8f49-4b748b348e86"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:22.124269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-740d09d7-4f34-451b-b205-7df36cda6655 req-58ba4874-fc3b-4c3e-b8d1-18512ae2f2ac service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:22.125579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-740d09d7-4f34-451b-b205-7df36cda6655 req-58ba4874-fc3b-4c3e-b8d1-18512ae2f2ac service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:22.126333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-740d09d7-4f34-451b-b205-7df36cda6655 req-58ba4874-fc3b-4c3e-b8d1-18512ae2f2ac service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:22.142495 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-96584032-7a47-4dd0-8e08-af6d00461011 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.286166 Aug 09 14:43:22.143430 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1574/3072] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:43:20 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:22.144359 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-740d09d7-4f34-451b-b205-7df36cda6655 req-58ba4874-fc3b-4c3e-b8d1-18512ae2f2ac service nova] Creating event network-vif-deleted:1744c9b6-d893-46c3-8f49-4b748b348e86 for instance 44ac156d-8758-4204-95db-6b33a7655dcc on n-h1-844626-8 Aug 09 14:43:22.148529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e61b1a02-456a-4537-be50-b754add75b2c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:22.149592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e61b1a02-456a-4537-be50-b754add75b2c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:22.150224 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-740d09d7-4f34-451b-b205-7df36cda6655 req-58ba4874-fc3b-4c3e-b8d1-18512ae2f2ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048259 Aug 09 14:43:22.151133 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1499/3073] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:22.158045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-188c6691-d027-4a90-9ece-326da9cc913f tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41e75a6160>, body: {"security_group_rule": {"parent_group_id": "e60e2064-1973-4f1b-a804-a757959a568c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2ee95e82-c662-4002-a239-f06291714b8a"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:22.211643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e61b1a02-456a-4537-be50-b754add75b2c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:22.212182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e61b1a02-456a-4537-be50-b754add75b2c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:22.213019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e61b1a02-456a-4537-be50-b754add75b2c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:22.215139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e61b1a02-456a-4537-be50-b754add75b2c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:22.215850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e61b1a02-456a-4537-be50-b754add75b2c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:22.216556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e61b1a02-456a-4537-be50-b754add75b2c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:22.544631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e61b1a02-456a-4537-be50-b754add75b2c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:22.554626 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e61b1a02-456a-4537-be50-b754add75b2c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 200 len: 1310 microversion: 2.1 time: 0.408257 Aug 09 14:43:22.557562 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1575/3074] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:22 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 1310 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:22.964837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e2887bb-8e81-4679-8e8f-b40675106dc9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:22.965978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e2887bb-8e81-4679-8e8f-b40675106dc9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:22.994262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e2887bb-8e81-4679-8e8f-b40675106dc9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:23.012356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e2887bb-8e81-4679-8e8f-b40675106dc9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:23.034389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e2887bb-8e81-4679-8e8f-b40675106dc9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:23.039659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e2887bb-8e81-4679-8e8f-b40675106dc9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:23.040863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e2887bb-8e81-4679-8e8f-b40675106dc9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:23.044736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e2887bb-8e81-4679-8e8f-b40675106dc9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:23.861077 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-188c6691-d027-4a90-9ece-326da9cc913f tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.708109 Aug 09 14:43:23.862685 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1500/3075] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:43:22 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:23.874564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91103999-5b9d-42f4-91d1-020be9f11f21 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41e75928b0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:23.888639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5e2887bb-8e81-4679-8e8f-b40675106dc9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:23.909853 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e2887bb-8e81-4679-8e8f-b40675106dc9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1509 microversion: 2.1 time: 0.948865 Aug 09 14:43:23.912380 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1576/3076] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:22 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1509 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:23.918480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f23f28f-c631-4009-b9c0-80eeea28076f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:23.926464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f23f28f-c631-4009-b9c0-80eeea28076f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:23.939747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f23f28f-c631-4009-b9c0-80eeea28076f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:23.942986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f23f28f-c631-4009-b9c0-80eeea28076f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:23.947131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f23f28f-c631-4009-b9c0-80eeea28076f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:23.948038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f23f28f-c631-4009-b9c0-80eeea28076f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:23.953348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f23f28f-c631-4009-b9c0-80eeea28076f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:23.956306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f23f28f-c631-4009-b9c0-80eeea28076f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:23.976415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:24.000779 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91103999-5b9d-42f4-91d1-020be9f11f21 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.116659 Aug 09 14:43:24.001861 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1501/3077] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:23 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:24.012100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7aba467f-592c-455a-9071-a7bff27b8057 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Calling method '.version_select at 0x7f41ddf109d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:24.018391 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-9f23f28f-c631-4009-b9c0-80eeea28076f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] HTTP exception thrown: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f23f28f-c631-4009-b9c0-80eeea28076f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc HTTP/1.1 Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '44ac156d-8758-4204-95db-6b33a7655dcc'} Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:24.027178 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:24.031928 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:24.031928 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:24.031928 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:24.031928 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:24.031928 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:24.031928 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:24.031928 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:24.031928 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:24.031928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f23f28f-c631-4009-b9c0-80eeea28076f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 404 to user: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:24.031928 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9f23f28f-c631-4009-b9c0-80eeea28076f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 404 len: 111 microversion: 2.1 time: 0.114969 Aug 09 14:43:24.031928 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1577/3078] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:23 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:24.367285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1319724220", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:24.541969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] validate_networks() for [('c0f37d1b-2427-4789-90ef-2da67d3617fc', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:43:25.114914 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7aba467f-592c-455a-9071-a7bff27b8057 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/2ee95e82-c662-4002-a239-f06291714b8a" status: 202 len: 0 microversion: 2.1 time: 1.111651 Aug 09 14:43:25.116181 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1502/3079] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:43:24 2022] DELETE /compute/v2.1/os-security-groups/2ee95e82-c662-4002-a239-f06291714b8a => generated 0 bytes in 1114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:25.124585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f315ccb8-046f-4dc8-970b-7e7de4bf78ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:25.125757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f315ccb8-046f-4dc8-970b-7e7de4bf78ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:25.157793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f315ccb8-046f-4dc8-970b-7e7de4bf78ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:25.158927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f315ccb8-046f-4dc8-970b-7e7de4bf78ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:25.159824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f315ccb8-046f-4dc8-970b-7e7de4bf78ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:25.160930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f315ccb8-046f-4dc8-970b-7e7de4bf78ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:25.171924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f315ccb8-046f-4dc8-970b-7e7de4bf78ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:25.172763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f315ccb8-046f-4dc8-970b-7e7de4bf78ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:25.636164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f315ccb8-046f-4dc8-970b-7e7de4bf78ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:25.645838 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f315ccb8-046f-4dc8-970b-7e7de4bf78ef tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1509 microversion: 2.1 time: 0.528321 Aug 09 14:43:25.649274 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1503/3080] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:25 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1509 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:25.654121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e544088f-8931-4e54-bf86-b8106278a56f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41e75929d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:25.767392 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e544088f-8931-4e54-bf86-b8106278a56f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.116734 Aug 09 14:43:25.767847 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1504/3081] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:25 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:25.778225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e49773f3-a45a-47cb-aa96-11ce6e7d52d3 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Calling method '.version_select at 0x7f41dd347670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:26.135793 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e49773f3-a45a-47cb-aa96-11ce6e7d52d3 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/e60e2064-1973-4f1b-a804-a757959a568c" status: 200 len: 246 microversion: 2.1 time: 0.366648 Aug 09 14:43:26.137609 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1505/3082] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:43:25 2022] GET /compute/v2.1/os-security-groups/e60e2064-1973-4f1b-a804-a757959a568c => generated 246 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:26.152554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-431fd790-ad6c-44f1-a194-59a4258930c4 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41e7551c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-453963720", "description": "tempest-description-574619581"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:26.271463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:43:26.272405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:43:26.273061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:43:26.273808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:43:26.274394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:43:26.290694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:26.302012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:26.302720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:26.304000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:26.308159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:26.308825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:26.353595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Getting quotas for project 8e0b1ade12f4484b83dd4bce24fd7859. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:26.360007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Getting quotas for user e05667f82c43484bb250236739c08959 and project 8e0b1ade12f4484b83dd4bce24fd7859. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:26.394724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:43:26.397268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:43:26.479614 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a5aff85-d7a0-4d4c-a9ef-dfa31bd1499e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.116891 Aug 09 14:43:26.488810 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1578/3083] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:43:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:43:26.500556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6692c4cf-ea2a-4914-83c3-571e44be8da5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:26.501613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6692c4cf-ea2a-4914-83c3-571e44be8da5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:26.688726 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-431fd790-ad6c-44f1-a194-59a4258930c4 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.539533 Aug 09 14:43:26.690769 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1506/3084] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:43:26 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:43:26.696163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e4e78651-e409-4545-ad11-952068bd8645 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:26.698647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e4e78651-e409-4545-ad11-952068bd8645 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:26.708652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6692c4cf-ea2a-4914-83c3-571e44be8da5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:26.730883 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6692c4cf-ea2a-4914-83c3-571e44be8da5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1225 microversion: 2.1 time: 0.233639 Aug 09 14:43:26.731710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4e78651-e409-4545-ad11-952068bd8645 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:26.732307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4e78651-e409-4545-ad11-952068bd8645 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:26.732889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4e78651-e409-4545-ad11-952068bd8645 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:26.733611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4e78651-e409-4545-ad11-952068bd8645 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:26.734111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4e78651-e409-4545-ad11-952068bd8645 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:26.734576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4e78651-e409-4545-ad11-952068bd8645 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:26.735193 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1579/3085] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:26 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1225 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:26.785983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-070d0a19-964b-41a6-9825-4abb0e4f59dd tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41dd68b670>, body: {"security_group_rule": {"parent_group_id": "6a9ea922-9f95-4269-b976-88b6891a96e4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:27.673211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e4e78651-e409-4545-ad11-952068bd8645 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:27.692878 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e4e78651-e409-4545-ad11-952068bd8645 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1509 microversion: 2.1 time: 0.999354 Aug 09 14:43:27.694696 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1507/3086] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:26 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1509 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:27.711483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39c3114b-c0d7-46e4-a687-4e3f77a227ca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41e754dc10>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:27.795657 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39c3114b-c0d7-46e4-a687-4e3f77a227ca tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.098430 Aug 09 14:43:27.799423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1508/3087] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:27 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:27.807845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31b43318-8dca-4362-a145-02725dd690d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:27.808897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31b43318-8dca-4362-a145-02725dd690d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:27.817931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b43318-8dca-4362-a145-02725dd690d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:27.818878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b43318-8dca-4362-a145-02725dd690d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:27.819517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b43318-8dca-4362-a145-02725dd690d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:27.820451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b43318-8dca-4362-a145-02725dd690d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:27.821082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b43318-8dca-4362-a145-02725dd690d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:27.821730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b43318-8dca-4362-a145-02725dd690d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:28.214466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-31b43318-8dca-4362-a145-02725dd690d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:28.226347 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31b43318-8dca-4362-a145-02725dd690d0 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1221 microversion: 2.1 time: 0.425055 Aug 09 14:43:28.229618 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1509/3088] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:27 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1221 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:28.367181 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-070d0a19-964b-41a6-9825-4abb0e4f59dd tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.611521 Aug 09 14:43:28.367786 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1580/3089] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:43:26 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:28.388980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee86ba11-d147-4330-bc97-7ec015000652 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Action: 'create', calling method: .version_select at 0x7f41dd284dc0>, body: {"security_group_rule": {"parent_group_id": "6a9ea922-9f95-4269-b976-88b6891a96e4", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:28.549219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1691480730", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2c7bddb9-85de-4e4d-9d91-f200b39f1b96"}], "security_groups": [{"name": "tempest-securitygroup--816466973"}], "key_name": "tempest-keypair-1480517280", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:28.952109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:29.051836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] validate_networks() for [('2c7bddb9-85de-4e4d-9d91-f200b39f1b96', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:43:29.711814 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee86ba11-d147-4330-bc97-7ec015000652 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.334410 Aug 09 14:43:29.713980 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1510/3090] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:43:28 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:29.728358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc6839eb-3b56-4ae4-b3f7-2d96b1f284de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:29.729279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc6839eb-3b56-4ae4-b3f7-2d96b1f284de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:29.749749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc6839eb-3b56-4ae4-b3f7-2d96b1f284de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:29.752670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc6839eb-3b56-4ae4-b3f7-2d96b1f284de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:29.755645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc6839eb-3b56-4ae4-b3f7-2d96b1f284de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:29.757276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc6839eb-3b56-4ae4-b3f7-2d96b1f284de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:29.757907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc6839eb-3b56-4ae4-b3f7-2d96b1f284de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:29.758498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc6839eb-3b56-4ae4-b3f7-2d96b1f284de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:30.236571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bc6839eb-3b56-4ae4-b3f7-2d96b1f284de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:30.253818 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc6839eb-3b56-4ae4-b3f7-2d96b1f284de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1509 microversion: 2.1 time: 0.530526 Aug 09 14:43:30.255881 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1511/3091] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:29 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1509 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:30.270710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee8cfb51-1303-489e-90cf-fa9019137247 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41e754de50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:30.362172 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee8cfb51-1303-489e-90cf-fa9019137247 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.104060 Aug 09 14:43:30.363192 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1512/3092] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:30 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:30.383866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e663d089-0932-406f-b0e9-cf952f7b3a67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:30.384765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e663d089-0932-406f-b0e9-cf952f7b3a67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:30.404119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e663d089-0932-406f-b0e9-cf952f7b3a67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:30.408376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e663d089-0932-406f-b0e9-cf952f7b3a67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:30.409837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e663d089-0932-406f-b0e9-cf952f7b3a67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:30.415535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e663d089-0932-406f-b0e9-cf952f7b3a67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:30.419736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e663d089-0932-406f-b0e9-cf952f7b3a67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:30.420823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e663d089-0932-406f-b0e9-cf952f7b3a67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:30.423951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Getting quotas for project 46e7f336a89344d4b290ca53afb88a67. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:30.432649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Getting quotas for user 7e06d9e017984792867874887aa80991 and project 46e7f336a89344d4b290ca53afb88a67. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:30.456024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:43:30.462188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:43:30.463008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:43:30.463928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:43:30.465638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:43:30.486893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:30.487870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:30.488654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:30.493816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:30.495346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:30.496243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:30.577417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Getting quotas for project 46e7f336a89344d4b290ca53afb88a67. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:30.587454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Getting quotas for user 7e06d9e017984792867874887aa80991 and project 46e7f336a89344d4b290ca53afb88a67. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:30.621164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:43:30.624175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:43:30.727763 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3fe9eac7-4dbd-4ca1-83d1-b65bfaf842ac tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.188622 Aug 09 14:43:30.737654 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1581/3093] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:43:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 2199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:43:30.744674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e663d089-0932-406f-b0e9-cf952f7b3a67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:30.755012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91770892-7eba-45f2-80e3-bac95266a1a2 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Calling method '.version_select at 0x7f41dd182280>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:30.758262 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e663d089-0932-406f-b0e9-cf952f7b3a67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1283 microversion: 2.1 time: 0.386354 Aug 09 14:43:30.776205 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1513/3094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:30 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1283 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:30.796861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc6982d0-5fa1-4c1e-a057-3872ad9aa479 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:30.797836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc6982d0-5fa1-4c1e-a057-3872ad9aa479 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:30.999475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bc6982d0-5fa1-4c1e-a057-3872ad9aa479 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:31.017573 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc6982d0-5fa1-4c1e-a057-3872ad9aa479 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1270 microversion: 2.1 time: 0.235747 Aug 09 14:43:31.027200 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1514/3095] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:30 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1270 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:31.064096 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91770892-7eba-45f2-80e3-bac95266a1a2 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/6a9ea922-9f95-4269-b976-88b6891a96e4" status: 200 len: 663 microversion: 2.1 time: 0.325207 Aug 09 14:43:31.073628 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1582/3096] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:43:30 2022] GET /compute/v2.1/os-security-groups/6a9ea922-9f95-4269-b976-88b6891a96e4 => generated 663 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:31.078070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37f57351-a269-4240-9758-6b5b956cd517 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Calling method '.version_select at 0x7f41ddfaaee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:31.287189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d0d533a-38a2-4dca-bf76-cffc6d6fd9b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:31.287807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1d0d533a-38a2-4dca-bf76-cffc6d6fd9b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:31.302473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d0d533a-38a2-4dca-bf76-cffc6d6fd9b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:31.303039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d0d533a-38a2-4dca-bf76-cffc6d6fd9b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:31.307440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d0d533a-38a2-4dca-bf76-cffc6d6fd9b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:31.314452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d0d533a-38a2-4dca-bf76-cffc6d6fd9b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:31.315415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d0d533a-38a2-4dca-bf76-cffc6d6fd9b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:31.316019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d0d533a-38a2-4dca-bf76-cffc6d6fd9b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:32.736318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d0d533a-38a2-4dca-bf76-cffc6d6fd9b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:32.752675 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37f57351-a269-4240-9758-6b5b956cd517 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/dc839b71-78e9-4a38-8c38-321711c427a8" status: 202 len: 0 microversion: 2.1 time: 1.678750 Aug 09 14:43:32.761414 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1515/3097] 10.222.0.50 () {58 vars in 1287 bytes} [Tue Aug 9 14:43:31 2022] DELETE /compute/v2.1/os-security-group-rules/dc839b71-78e9-4a38-8c38-321711c427a8 => generated 0 bytes in 1688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:32.767616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7aa1e85-b80e-416e-968e-18ef299ef847 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd929c10>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:32.797780 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1d0d533a-38a2-4dca-bf76-cffc6d6fd9b5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1509 microversion: 2.1 time: 1.514795 Aug 09 14:43:32.812098 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1583/3098] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:31 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1509 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:32.828098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf3e5115-9a63-43de-ba64-bad89a1964d6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:32.830098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf3e5115-9a63-43de-ba64-bad89a1964d6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:32.840575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf3e5115-9a63-43de-ba64-bad89a1964d6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:32.841353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf3e5115-9a63-43de-ba64-bad89a1964d6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:32.844606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf3e5115-9a63-43de-ba64-bad89a1964d6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:32.845630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf3e5115-9a63-43de-ba64-bad89a1964d6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:32.846238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf3e5115-9a63-43de-ba64-bad89a1964d6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:32.846819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf3e5115-9a63-43de-ba64-bad89a1964d6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:32.940290 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7aa1e85-b80e-416e-968e-18ef299ef847 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.177269 Aug 09 14:43:32.941348 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1516/3099] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:32 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:32.953799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-247645c9-59ef-441d-bd96-1a70567972e3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:32.958109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-247645c9-59ef-441d-bd96-1a70567972e3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:32.975956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247645c9-59ef-441d-bd96-1a70567972e3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:32.976442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247645c9-59ef-441d-bd96-1a70567972e3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:32.979677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247645c9-59ef-441d-bd96-1a70567972e3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:32.985454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247645c9-59ef-441d-bd96-1a70567972e3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:32.986332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247645c9-59ef-441d-bd96-1a70567972e3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:32.987230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-247645c9-59ef-441d-bd96-1a70567972e3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:33.274380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-247645c9-59ef-441d-bd96-1a70567972e3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:33.283733 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-247645c9-59ef-441d-bd96-1a70567972e3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1340 microversion: 2.1 time: 0.339522 Aug 09 14:43:33.293542 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1517/3100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:32 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1340 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:33.317596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d4a939bc-fedf-47cb-b7c1-499c0ab54ead tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Calling method '.version_select at 0x7f41dd929160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:33.436309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bf3e5115-9a63-43de-ba64-bad89a1964d6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:33.446969 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf3e5115-9a63-43de-ba64-bad89a1964d6 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1325 microversion: 2.1 time: 0.633621 Aug 09 14:43:33.466290 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1584/3101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:32 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1325 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:33.825558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d25fe99f-b258-402e-b472-176580bb58d7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:33.826929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d25fe99f-b258-402e-b472-176580bb58d7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:33.836710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d25fe99f-b258-402e-b472-176580bb58d7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:33.844302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d25fe99f-b258-402e-b472-176580bb58d7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:33.845065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d25fe99f-b258-402e-b472-176580bb58d7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:33.848518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d25fe99f-b258-402e-b472-176580bb58d7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:33.851637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d25fe99f-b258-402e-b472-176580bb58d7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:33.855067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d25fe99f-b258-402e-b472-176580bb58d7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:34.551558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d25fe99f-b258-402e-b472-176580bb58d7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:34.618885 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d25fe99f-b258-402e-b472-176580bb58d7 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1509 microversion: 2.1 time: 0.796003 Aug 09 14:43:34.639301 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1585/3102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:33 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1509 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:43:34.650658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f058cc37-c7f0-4e71-88d7-32204e282e59 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd1f81f0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:34.748843 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f058cc37-c7f0-4e71-88d7-32204e282e59 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.108077 Aug 09 14:43:34.749703 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1586/3103] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:34 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:34.767763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed3ee9a0-6cce-43ab-9d8c-48b480e2fee6 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:34.768648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed3ee9a0-6cce-43ab-9d8c-48b480e2fee6 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:34.789788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed3ee9a0-6cce-43ab-9d8c-48b480e2fee6 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:34.790674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed3ee9a0-6cce-43ab-9d8c-48b480e2fee6 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:34.792673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed3ee9a0-6cce-43ab-9d8c-48b480e2fee6 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:34.793573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed3ee9a0-6cce-43ab-9d8c-48b480e2fee6 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:34.794968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed3ee9a0-6cce-43ab-9d8c-48b480e2fee6 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:34.796297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed3ee9a0-6cce-43ab-9d8c-48b480e2fee6 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:34.943040 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d4a939bc-fedf-47cb-b7c1-499c0ab54ead tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/6a9ea922-9f95-4269-b976-88b6891a96e4" status: 202 len: 0 microversion: 2.1 time: 1.648193 Aug 09 14:43:34.946621 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1518/3104] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:43:33 2022] DELETE /compute/v2.1/os-security-groups/6a9ea922-9f95-4269-b976-88b6891a96e4 => generated 0 bytes in 1652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:34.951908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-883d04aa-c933-4aab-bd57-5dfc2941e024 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:34.952725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-883d04aa-c933-4aab-bd57-5dfc2941e024 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:34.966510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:34.974055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-883d04aa-c933-4aab-bd57-5dfc2941e024 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:34.979322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-883d04aa-c933-4aab-bd57-5dfc2941e024 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:34.984980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-883d04aa-c933-4aab-bd57-5dfc2941e024 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:34.986463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-883d04aa-c933-4aab-bd57-5dfc2941e024 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:34.987120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-883d04aa-c933-4aab-bd57-5dfc2941e024 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:34.987739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-883d04aa-c933-4aab-bd57-5dfc2941e024 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:35.819132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed3ee9a0-6cce-43ab-9d8c-48b480e2fee6 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:35.829631 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed3ee9a0-6cce-43ab-9d8c-48b480e2fee6 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1328 microversion: 2.1 time: 1.068161 Aug 09 14:43:35.846743 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1587/3105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:34 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1328 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:35.851464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c4257ddf-b026-456b-86e1-475b62c0f6fc tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Calling method '.version_select at 0x7f41dd169af0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:35.979469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-883d04aa-c933-4aab-bd57-5dfc2941e024 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:35.982934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:35.986732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG neutronclient.v2_0.client [None req-c4257ddf-b026-456b-86e1-475b62c0f6fc tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2ee95e82-c662-4002-a239-f06291714b8a does not exist", "detail": ""}} {{(pid=119407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:43:35.987576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.security_group_api [None req-c4257ddf-b026-456b-86e1-475b62c0f6fc tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Neutron security group 2ee95e82-c662-4002-a239-f06291714b8a not found {{(pid=119407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:43:35.988239 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-c4257ddf-b026-456b-86e1-475b62c0f6fc tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] HTTP exception thrown: Security group 2ee95e82-c662-4002-a239-f06291714b8a does not exist Aug 09 14:43:35.988239 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-305be825-f50a-4e84-963a-c9ec807f1576'] Aug 09 14:43:35.991197 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-883d04aa-c933-4aab-bd57-5dfc2941e024 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1325 microversion: 2.1 time: 1.040754 Aug 09 14:43:36.004303 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1519/3106] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:34 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1325 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c4257ddf-b026-456b-86e1-475b62c0f6fc tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Request method failure captured: Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/os-security-groups/2ee95e82-c662-4002-a239-f06291714b8a HTTP/1.1 Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nJ3VP2UHZgzH6RhzHFXzjUhQ2b1cMrhEPCZK11TyowkgYivEksURdSn6jJu1rZEK5844n-Ixypcj4UwKDm-yg-FFpFWpSkSe0b5CV9e_XesdHo-lYCweI-DXv598Ae0Bgtae10mIlj9HvBwEzoNTnnvRDH7Be3RvXSoKDJS3u-lVxw Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 2b18311f75e74f38ae71a1fab493261c Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-547327891 Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_2b18311f75e74f38ae71a1fab493261c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/2b18311f75e74f38ae71a1fab493261c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b18311f75e74f38ae71a1fab493261c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/2b18311f75e74f38ae71a1fab493261c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupRulesTestJSON-547327891 Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 2b18311f75e74f38ae71a1fab493261c Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-547327891 Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupRulesTestJSON-547327891-project Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 3c645a322529436bbe63935c7a973dda Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupRulesTestJSON-547327891-project Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: exception: Security group 2ee95e82-c662-4002-a239-f06291714b8a does not exist Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-305be825-f50a-4e84-963a-c9ec807f1576'] Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '2ee95e82-c662-4002-a239-f06291714b8a'} Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:43:36.010047 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2ee95e82-c662-4002-a239-f06291714b8a does not exist Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-305be825-f50a-4e84-963a-c9ec807f1576'] Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2ee95e82-c662-4002-a239-f06291714b8a does not exist Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-305be825-f50a-4e84-963a-c9ec807f1576'] Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2ee95e82-c662-4002-a239-f06291714b8a does not exist Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-305be825-f50a-4e84-963a-c9ec807f1576'] Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2ee95e82-c662-4002-a239-f06291714b8a does not exist Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-305be825-f50a-4e84-963a-c9ec807f1576'] Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c4257ddf-b026-456b-86e1-475b62c0f6fc tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Returning 404 to user: Security group 2ee95e82-c662-4002-a239-f06291714b8a does not exist Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-305be825-f50a-4e84-963a-c9ec807f1576'] {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:36.014036 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c4257ddf-b026-456b-86e1-475b62c0f6fc tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/2ee95e82-c662-4002-a239-f06291714b8a" status: 404 len: 194 microversion: 2.1 time: 0.165271 Aug 09 14:43:36.018193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7f226307-9fe3-42b7-8857-6a7892f134cc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:36.018193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7f226307-9fe3-42b7-8857-6a7892f134cc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:36.019688 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1588/3107] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:43:35 2022] DELETE /compute/v2.1/os-security-groups/2ee95e82-c662-4002-a239-f06291714b8a => generated 194 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:36.034384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f226307-9fe3-42b7-8857-6a7892f134cc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:36.034980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f226307-9fe3-42b7-8857-6a7892f134cc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:36.035683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f226307-9fe3-42b7-8857-6a7892f134cc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:36.036549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f226307-9fe3-42b7-8857-6a7892f134cc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:36.037232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f226307-9fe3-42b7-8857-6a7892f134cc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:36.037636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f226307-9fe3-42b7-8857-6a7892f134cc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:36.038970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-357efdda-68d6-4799-92de-5d80ffc80844 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd22c670>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:36.146606 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-357efdda-68d6-4799-92de-5d80ffc80844 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.124747 Aug 09 14:43:36.147531 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1589/3108] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:36 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:36.159049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33ac00ff-8985-4958-a71e-237e2d84a3fa tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Calling method '.version_select at 0x7f41dd169430>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:36.660746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7f226307-9fe3-42b7-8857-6a7892f134cc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:36.677506 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7f226307-9fe3-42b7-8857-6a7892f134cc tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1509 microversion: 2.1 time: 0.682180 Aug 09 14:43:36.682406 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1520/3109] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:35 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1509 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:36.855335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-812b13ce-a0ac-4d32-8043-d4461d63fc94 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:36.856422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-812b13ce-a0ac-4d32-8043-d4461d63fc94 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:36.881970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-812b13ce-a0ac-4d32-8043-d4461d63fc94 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:36.890115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-812b13ce-a0ac-4d32-8043-d4461d63fc94 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:36.893041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-812b13ce-a0ac-4d32-8043-d4461d63fc94 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:36.898889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-812b13ce-a0ac-4d32-8043-d4461d63fc94 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:36.901564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-812b13ce-a0ac-4d32-8043-d4461d63fc94 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:36.902761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-812b13ce-a0ac-4d32-8043-d4461d63fc94 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:37.195754 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-33ac00ff-8985-4958-a71e-237e2d84a3fa tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/e60e2064-1973-4f1b-a804-a757959a568c" status: 202 len: 0 microversion: 2.1 time: 1.047073 Aug 09 14:43:37.196655 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1590/3110] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:43:36 2022] DELETE /compute/v2.1/os-security-groups/e60e2064-1973-4f1b-a804-a757959a568c => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:37.208655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-bc254de2-79d4-4fde-89d1-9c1d57b5a306 req-deb75a7f-3828-4d7e-a537-404485446252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "474888b4-0058-40eb-9a4d-f723520472a0", "tag": "b8dbdfa5-3258-4e23-a6ca-1c11d5083a07"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:37.243534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bc254de2-79d4-4fde-89d1-9c1d57b5a306 req-deb75a7f-3828-4d7e-a537-404485446252 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:37.244142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bc254de2-79d4-4fde-89d1-9c1d57b5a306 req-deb75a7f-3828-4d7e-a537-404485446252 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:37.244585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bc254de2-79d4-4fde-89d1-9c1d57b5a306 req-deb75a7f-3828-4d7e-a537-404485446252 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:37.262641 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-bc254de2-79d4-4fde-89d1-9c1d57b5a306 req-deb75a7f-3828-4d7e-a537-404485446252 service nova] Creating event network-changed:b8dbdfa5-3258-4e23-a6ca-1c11d5083a07 for instance 474888b4-0058-40eb-9a4d-f723520472a0 on n-h1-844626-8 Aug 09 14:43:37.274800 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-bc254de2-79d4-4fde-89d1-9c1d57b5a306 req-deb75a7f-3828-4d7e-a537-404485446252 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076900 Aug 09 14:43:37.282533 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1591/3111] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:37.295878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d927b3ec-33e4-480a-b384-2eac51321c5e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:37.296675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d927b3ec-33e4-480a-b384-2eac51321c5e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:37.310188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d927b3ec-33e4-480a-b384-2eac51321c5e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:37.310760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d927b3ec-33e4-480a-b384-2eac51321c5e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:37.311506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d927b3ec-33e4-480a-b384-2eac51321c5e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:37.312902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d927b3ec-33e4-480a-b384-2eac51321c5e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:37.313539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d927b3ec-33e4-480a-b384-2eac51321c5e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:37.326568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d927b3ec-33e4-480a-b384-2eac51321c5e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:38.192845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-812b13ce-a0ac-4d32-8043-d4461d63fc94 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:38.209952 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-812b13ce-a0ac-4d32-8043-d4461d63fc94 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1395 microversion: 2.1 time: 1.359657 Aug 09 14:43:38.211134 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1521/3112] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:36 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1395 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:43:38.216014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33450f4b-3d7d-48a8-96a7-b675969edc54 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41e7592550>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:38.313807 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-33450f4b-3d7d-48a8-96a7-b675969edc54 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.101332 Aug 09 14:43:38.316261 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1522/3113] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:38 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:38.338830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa3aeb38-4f50-4916-b406-f7353cb99280 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Calling method '.version_select at 0x7f41dd394af0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:38.401193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d927b3ec-33e4-480a-b384-2eac51321c5e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:38.416562 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d927b3ec-33e4-480a-b384-2eac51321c5e tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1325 microversion: 2.1 time: 1.132473 Aug 09 14:43:38.417159 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1592/3114] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:37 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1325 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:38.422900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d6611dfc-0d3c-4535-b192-141f1e95001f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:38.423575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d6611dfc-0d3c-4535-b192-141f1e95001f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:38.431188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6611dfc-0d3c-4535-b192-141f1e95001f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:38.431614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6611dfc-0d3c-4535-b192-141f1e95001f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:38.432104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6611dfc-0d3c-4535-b192-141f1e95001f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:38.432979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6611dfc-0d3c-4535-b192-141f1e95001f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:38.433658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6611dfc-0d3c-4535-b192-141f1e95001f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:38.434237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6611dfc-0d3c-4535-b192-141f1e95001f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:39.341105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d6611dfc-0d3c-4535-b192-141f1e95001f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:39.354202 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d6611dfc-0d3c-4535-b192-141f1e95001f tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1509 microversion: 2.1 time: 0.932445 Aug 09 14:43:39.355012 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1593/3115] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:38 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1509 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:39.369450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f26b9c82-99a6-4fc0-96da-e0d332a3bf8b tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:39.370564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f26b9c82-99a6-4fc0-96da-e0d332a3bf8b tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:39.380757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f26b9c82-99a6-4fc0-96da-e0d332a3bf8b tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:39.381229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f26b9c82-99a6-4fc0-96da-e0d332a3bf8b tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:39.402688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f26b9c82-99a6-4fc0-96da-e0d332a3bf8b tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:39.402688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f26b9c82-99a6-4fc0-96da-e0d332a3bf8b tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:39.402688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f26b9c82-99a6-4fc0-96da-e0d332a3bf8b tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:39.402688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f26b9c82-99a6-4fc0-96da-e0d332a3bf8b tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:40.001462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f26b9c82-99a6-4fc0-96da-e0d332a3bf8b tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:40.021156 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f26b9c82-99a6-4fc0-96da-e0d332a3bf8b tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1395 microversion: 2.1 time: 0.662826 Aug 09 14:43:40.037696 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1594/3116] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:39 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1395 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:40.048973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-058d01aa-1516-451c-bcd0-02114ce41c0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd32d790>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:40.126152 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-058d01aa-1516-451c-bcd0-02114ce41c0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1412 microversion: 2.1 time: 0.086229 Aug 09 14:43:40.127580 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1595/3117] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:40 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:40.152100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-988e26da-4c1e-4029-9d4f-732d761e806c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:40.154855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-988e26da-4c1e-4029-9d4f-732d761e806c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:40.170206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988e26da-4c1e-4029-9d4f-732d761e806c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:40.170943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988e26da-4c1e-4029-9d4f-732d761e806c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:40.171598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988e26da-4c1e-4029-9d4f-732d761e806c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:40.172756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988e26da-4c1e-4029-9d4f-732d761e806c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:40.173349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988e26da-4c1e-4029-9d4f-732d761e806c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:40.174007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988e26da-4c1e-4029-9d4f-732d761e806c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:40.232133 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa3aeb38-4f50-4916-b406-f7353cb99280 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/55a89948-8fb1-4f25-b020-84a766f88e68" status: 202 len: 0 microversion: 2.1 time: 1.910454 Aug 09 14:43:40.238431 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1523/3118] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:43:38 2022] DELETE /compute/v2.1/os-security-groups/55a89948-8fb1-4f25-b020-84a766f88e68 => generated 0 bytes in 1922 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:40.414004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a4387f2-ee4d-4aa5-b976-5368e5004628 tempest-ListImagesTestJSON-1677343128 tempest-ListImagesTestJSON-1677343128-project] Calling method '.version_select at 0x7f41dd394a60>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:40.467432 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a4387f2-ee4d-4aa5-b976-5368e5004628 tempest-ListImagesTestJSON-1677343128 tempest-ListImagesTestJSON-1677343128-project] 10.222.0.50 "GET /compute/v2.1/images/f0e08d35-6013-4ff5-9f41-f40d5739b250" status: 200 len: 784 microversion: 2.1 time: 0.226498 Aug 09 14:43:40.468725 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1524/3119] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:40 2022] GET /compute/v2.1/images/f0e08d35-6013-4ff5-9f41-f40d5739b250 => generated 784 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:40.474281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a7431cd-9893-4621-8dbc-564b535ffff4 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Calling method '.version_select at 0x7f41ddf24430>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:40.518297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:40.593176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-988e26da-4c1e-4029-9d4f-732d761e806c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:40.601823 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-988e26da-4c1e-4029-9d4f-732d761e806c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1325 microversion: 2.1 time: 0.471914 Aug 09 14:43:40.615462 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1596/3120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:40 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1325 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:40.620774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aba2a638-058c-4451-9955-51cb5519593c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:40.627001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aba2a638-058c-4451-9955-51cb5519593c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:40.629264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=18 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:40.635795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba2a638-058c-4451-9955-51cb5519593c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:40.636284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba2a638-058c-4451-9955-51cb5519593c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:40.636716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba2a638-058c-4451-9955-51cb5519593c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:40.637434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba2a638-058c-4451-9955-51cb5519593c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:40.637864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba2a638-058c-4451-9955-51cb5519593c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:40.638460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba2a638-058c-4451-9955-51cb5519593c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:41.016773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:41.178574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aba2a638-058c-4451-9955-51cb5519593c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:41.189013 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aba2a638-058c-4451-9955-51cb5519593c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1509 microversion: 2.1 time: 0.571893 Aug 09 14:43:41.189537 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1597/3121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:40 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1509 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:41.210685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d5cf6904-f72b-47fb-b296-e1a8ab370a6f tempest-ListImagesTestJSON-1677343128 tempest-ListImagesTestJSON-1677343128-project] Calling method '.version_select at 0x7f41dd349ca0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:41.345209 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a7431cd-9893-4621-8dbc-564b535ffff4 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/90dd4171-6404-4dfa-90a1-3b6eeb1e785d" status: 202 len: 0 microversion: 2.1 time: 0.874337 Aug 09 14:43:41.351463 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1525/3122] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:43:40 2022] DELETE /compute/v2.1/os-security-groups/90dd4171-6404-4dfa-90a1-3b6eeb1e785d => generated 0 bytes in 882 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:41.368603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2dcf1e18-657b-4526-a0dd-e266f8f16cc3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:41.371650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2dcf1e18-657b-4526-a0dd-e266f8f16cc3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:41.384257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dcf1e18-657b-4526-a0dd-e266f8f16cc3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:41.385015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dcf1e18-657b-4526-a0dd-e266f8f16cc3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:41.386976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dcf1e18-657b-4526-a0dd-e266f8f16cc3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:41.388024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dcf1e18-657b-4526-a0dd-e266f8f16cc3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:41.388759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dcf1e18-657b-4526-a0dd-e266f8f16cc3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:41.390130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dcf1e18-657b-4526-a0dd-e266f8f16cc3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:41.400251 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d5cf6904-f72b-47fb-b296-e1a8ab370a6f tempest-ListImagesTestJSON-1677343128 tempest-ListImagesTestJSON-1677343128-project] 10.222.0.50 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.209477 Aug 09 14:43:41.401260 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1598/3123] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 9 14:43:41 2022] GET /compute/v2.1/images => generated 445 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:41.420957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-97ce229d-e206-4d6b-b356-aee3d45a87e9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd39d280>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:41.492942 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-97ce229d-e206-4d6b-b356-aee3d45a87e9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1421 microversion: 2.1 time: 0.084272 Aug 09 14:43:41.494390 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1599/3124] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:41 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1421 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:41.499217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3f3eb845-4839-481c-b294-5cde383102ab req-f8a72855-5ac5-4742-af34-e4196f9c4a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a2a79d-0cb7-4f9f-9b23-13b4b566c043", "tag": "75d75b68-e994-4644-9c35-1692aa641cb5"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:41.510819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3f3eb845-4839-481c-b294-5cde383102ab req-f8a72855-5ac5-4742-af34-e4196f9c4a10 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:41.511336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3f3eb845-4839-481c-b294-5cde383102ab req-f8a72855-5ac5-4742-af34-e4196f9c4a10 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:41.511767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3f3eb845-4839-481c-b294-5cde383102ab req-f8a72855-5ac5-4742-af34-e4196f9c4a10 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:41.525796 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3f3eb845-4839-481c-b294-5cde383102ab req-f8a72855-5ac5-4742-af34-e4196f9c4a10 service nova] Creating event network-changed:75d75b68-e994-4644-9c35-1692aa641cb5 for instance e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 on n-h2-844626-8 Aug 09 14:43:41.531650 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3f3eb845-4839-481c-b294-5cde383102ab req-f8a72855-5ac5-4742-af34-e4196f9c4a10 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035645 Aug 09 14:43:41.532717 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1600/3125] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:41.538352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-589c13e4-cda2-4c47-beee-8af081e2b08b tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Calling method '.version_select at 0x7f41dcac3af0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:42.316266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2dcf1e18-657b-4526-a0dd-e266f8f16cc3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:42.329059 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2dcf1e18-657b-4526-a0dd-e266f8f16cc3 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1395 microversion: 2.1 time: 0.975404 Aug 09 14:43:42.343656 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1526/3126] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:41 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1395 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:42.350335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1279c57-1b72-43e5-8f2a-45569c34e6d4 tempest-ListImagesTestJSON-1677343128 tempest-ListImagesTestJSON-1677343128-project] Calling method '.version_select at 0x7f41dddeaf70>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:42.430325 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1279c57-1b72-43e5-8f2a-45569c34e6d4 tempest-ListImagesTestJSON-1677343128 tempest-ListImagesTestJSON-1677343128-project] 10.222.0.50 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.085042 Aug 09 14:43:42.441864 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1527/3127] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:43:42 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:42.447771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fc0dbf1-ad13-454a-90fb-961030d6b8e9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41e758aaf0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:42.522250 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fc0dbf1-ad13-454a-90fb-961030d6b8e9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 200 len: 1421 microversion: 2.1 time: 0.079024 Aug 09 14:43:42.527218 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1528/3128] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:43:42 2022] GET /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:42.539294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5a643c5-f4d3-4f8f-8333-5d9433bd9a97 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:42.544522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5a643c5-f4d3-4f8f-8333-5d9433bd9a97 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:42.560026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a643c5-f4d3-4f8f-8333-5d9433bd9a97 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:42.560871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a643c5-f4d3-4f8f-8333-5d9433bd9a97 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:42.561847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a643c5-f4d3-4f8f-8333-5d9433bd9a97 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:42.562742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a643c5-f4d3-4f8f-8333-5d9433bd9a97 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:42.564257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a643c5-f4d3-4f8f-8333-5d9433bd9a97 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:42.564973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5a643c5-f4d3-4f8f-8333-5d9433bd9a97 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:42.958126 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-589c13e4-cda2-4c47-beee-8af081e2b08b tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/8c94e9ac-6ab9-4cce-b54a-1e3e0c1639f6" status: 202 len: 0 microversion: 2.1 time: 1.424154 Aug 09 14:43:42.959053 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1601/3129] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:43:41 2022] DELETE /compute/v2.1/os-security-groups/8c94e9ac-6ab9-4cce-b54a-1e3e0c1639f6 => generated 0 bytes in 1426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:43.080198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f5a643c5-f4d3-4f8f-8333-5d9433bd9a97 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:43.089744 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5a643c5-f4d3-4f8f-8333-5d9433bd9a97 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1325 microversion: 2.1 time: 0.561131 Aug 09 14:43:43.095392 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1529/3130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:42 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1325 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:43.101000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-541280ec-f74f-4f29-883d-f0ea08ec9e56 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:43.109814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-541280ec-f74f-4f29-883d-f0ea08ec9e56 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:43.123269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-541280ec-f74f-4f29-883d-f0ea08ec9e56 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:43.123838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-541280ec-f74f-4f29-883d-f0ea08ec9e56 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:43.124292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-541280ec-f74f-4f29-883d-f0ea08ec9e56 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:43.127952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-541280ec-f74f-4f29-883d-f0ea08ec9e56 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:43.128782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-541280ec-f74f-4f29-883d-f0ea08ec9e56 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:43.131239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-541280ec-f74f-4f29-883d-f0ea08ec9e56 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:43.352087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1425048736", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:43.430978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] validate_networks() for [('e0c09af2-a7fb-4eb6-aac5-00280efe005a', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:43:43.432697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-541280ec-f74f-4f29-883d-f0ea08ec9e56 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:43.441952 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-541280ec-f74f-4f29-883d-f0ea08ec9e56 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1509 microversion: 2.1 time: 0.344981 Aug 09 14:43:43.442961 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1530/3131] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:43 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1509 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:43.448398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33e781d0-0617-48f8-98f8-7cbec83aa581 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41e758af70>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:44.062813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:43:44.063517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:43:44.063988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:43:44.065021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:43:44.065503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:43:44.094864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:44.097607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:44.099045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:44.101683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:44.102499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:44.104706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:44.140756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Getting quotas for project 6b15c3b0febc415b86ab4c16a7ccefcc. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:44.149270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Getting quotas for user 5d4f8f2897724d5c8df394925cb7821c and project 6b15c3b0febc415b86ab4c16a7ccefcc. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:44.168129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:43:44.171287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:43:44.237308 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-abe304b1-a984-4ce6-bd00-988d04823644 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.276813 Aug 09 14:43:44.238976 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1602/3132] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:43:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:43:44.247477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-26cdd9a6-293b-4e15-b278-c3f0c2116d18 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] Calling method '.version_select at 0x7f41dd2e4a60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:44.329443 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-33e781d0-0617-48f8-98f8-7cbec83aa581 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 204 len: 0 microversion: 2.1 time: 0.885082 Aug 09 14:43:44.330222 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1531/3133] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:43 2022] DELETE /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 0 bytes in 887 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:43:44.336567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8926a7d-941c-4ea3-9b5d-551ef83dd155 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:44.337244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8926a7d-941c-4ea3-9b5d-551ef83dd155 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:44.366861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8926a7d-941c-4ea3-9b5d-551ef83dd155 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:44.367504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8926a7d-941c-4ea3-9b5d-551ef83dd155 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:44.367952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8926a7d-941c-4ea3-9b5d-551ef83dd155 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:44.368673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8926a7d-941c-4ea3-9b5d-551ef83dd155 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:44.369166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8926a7d-941c-4ea3-9b5d-551ef83dd155 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:44.369668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8926a7d-941c-4ea3-9b5d-551ef83dd155 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:45.079741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8926a7d-941c-4ea3-9b5d-551ef83dd155 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:45.085047 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-26cdd9a6-293b-4e15-b278-c3f0c2116d18 tempest-SecurityGroupRulesTestJSON-547327891 tempest-SecurityGroupRulesTestJSON-547327891-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/d17f5dbe-0ebd-443d-8e4b-73e976079916" status: 202 len: 0 microversion: 2.1 time: 0.844723 Aug 09 14:43:45.086633 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1603/3134] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:43:44 2022] DELETE /compute/v2.1/os-security-groups/d17f5dbe-0ebd-443d-8e4b-73e976079916 => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:45.092245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22ae964f-d755-47ac-a2ef-e6f3cda2c13f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:45.093532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22ae964f-d755-47ac-a2ef-e6f3cda2c13f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:45.099924 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e8926a7d-941c-4ea3-9b5d-551ef83dd155 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1395 microversion: 2.1 time: 0.763859 Aug 09 14:43:45.101231 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1532/3135] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:44 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1395 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:45.110289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ae964f-d755-47ac-a2ef-e6f3cda2c13f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:45.110779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ae964f-d755-47ac-a2ef-e6f3cda2c13f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:45.118607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ae964f-d755-47ac-a2ef-e6f3cda2c13f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:45.121943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ae964f-d755-47ac-a2ef-e6f3cda2c13f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:45.122609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ae964f-d755-47ac-a2ef-e6f3cda2c13f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:45.123052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ae964f-d755-47ac-a2ef-e6f3cda2c13f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:45.123671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae4717a6-3c75-41a6-8421-c495a21e5bf3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:45.130671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae4717a6-3c75-41a6-8421-c495a21e5bf3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:45.315712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ae4717a6-3c75-41a6-8421-c495a21e5bf3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:45.328711 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae4717a6-3c75-41a6-8421-c495a21e5bf3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1223 microversion: 2.1 time: 0.212570 Aug 09 14:43:45.351472 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1533/3136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:45 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1223 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:45.376406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f42530fc-17dc-40a4-bbff-ecea7594fab6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:45.376914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f42530fc-17dc-40a4-bbff-ecea7594fab6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:45.396517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f42530fc-17dc-40a4-bbff-ecea7594fab6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:45.397078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f42530fc-17dc-40a4-bbff-ecea7594fab6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:45.397532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f42530fc-17dc-40a4-bbff-ecea7594fab6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:45.398376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f42530fc-17dc-40a4-bbff-ecea7594fab6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:45.398839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f42530fc-17dc-40a4-bbff-ecea7594fab6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:45.401118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f42530fc-17dc-40a4-bbff-ecea7594fab6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:45.467113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f42530fc-17dc-40a4-bbff-ecea7594fab6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:43:45.641263 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f42530fc-17dc-40a4-bbff-ecea7594fab6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 204 len: 0 microversion: 2.1 time: 0.286885 Aug 09 14:43:45.642829 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1534/3137] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:45 2022] DELETE /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:43:45.657320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fb12a3d2-8198-45b3-bbe7-f7e577043c93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:45.658354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fb12a3d2-8198-45b3-bbe7-f7e577043c93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:45.672571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb12a3d2-8198-45b3-bbe7-f7e577043c93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:45.675340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb12a3d2-8198-45b3-bbe7-f7e577043c93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:45.678478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb12a3d2-8198-45b3-bbe7-f7e577043c93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:45.681108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb12a3d2-8198-45b3-bbe7-f7e577043c93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:45.685532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb12a3d2-8198-45b3-bbe7-f7e577043c93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:45.686906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb12a3d2-8198-45b3-bbe7-f7e577043c93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:45.707227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22ae964f-d755-47ac-a2ef-e6f3cda2c13f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:45.716656 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22ae964f-d755-47ac-a2ef-e6f3cda2c13f tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1325 microversion: 2.1 time: 0.628545 Aug 09 14:43:45.733464 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1604/3138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:45 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1325 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:45.738728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-969f48fa-6a5b-47df-96ed-acfb976982d4 req-010bb559-b529-4dae-97d6-d2716d2d8295 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474888b4-0058-40eb-9a4d-f723520472a0", "name": "network-vif-plugged", "status": "completed", "tag": "b8dbdfa5-3258-4e23-a6ca-1c11d5083a07"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:45.766630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-969f48fa-6a5b-47df-96ed-acfb976982d4 req-010bb559-b529-4dae-97d6-d2716d2d8295 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:45.769122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-969f48fa-6a5b-47df-96ed-acfb976982d4 req-010bb559-b529-4dae-97d6-d2716d2d8295 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:45.769679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-969f48fa-6a5b-47df-96ed-acfb976982d4 req-010bb559-b529-4dae-97d6-d2716d2d8295 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:45.791787 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-969f48fa-6a5b-47df-96ed-acfb976982d4 req-010bb559-b529-4dae-97d6-d2716d2d8295 service nova] Creating event network-vif-plugged:b8dbdfa5-3258-4e23-a6ca-1c11d5083a07 for instance 474888b4-0058-40eb-9a4d-f723520472a0 on n-h1-844626-8 Aug 09 14:43:45.805125 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-969f48fa-6a5b-47df-96ed-acfb976982d4 req-010bb559-b529-4dae-97d6-d2716d2d8295 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070075 Aug 09 14:43:45.808155 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1605/3139] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:45.982829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fb12a3d2-8198-45b3-bbe7-f7e577043c93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:45.993381 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fb12a3d2-8198-45b3-bbe7-f7e577043c93 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1486 microversion: 2.1 time: 0.345490 Aug 09 14:43:45.995870 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1535/3140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:45 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1486 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:46.006750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2066954096", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "2885fc04-1f81-4377-a25b-f064edeb4235"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:46.082867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-490f0051-dc30-485b-a49b-33c16d0b2730 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Action: 'create', calling method: .version_select at 0x7f41dd32d9d0>, body: {"keypair": {"name": "tempest-keypair-2091190410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqacj4lQRLiHCJNARz9mj41N07b+b8KXOiy4bSdh9g/53T+z8E2/CGquCL74rmpt73143H2lSTtV2z78013+lO3wch+Wzjp6BoLhRrkMBOuoHDfnRzsgJdRIVuZu9Wchg=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:46.100512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:46.106584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] validate_networks() for [('2885fc04-1f81-4377-a25b-f064edeb4235', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:43:46.114428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-490f0051-dc30-485b-a49b-33c16d0b2730 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Getting quotas for project a0fd94de24324ac9a76ec0b7bb64d0a9. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:46.123587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-490f0051-dc30-485b-a49b-33c16d0b2730 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Getting quotas for user aea6926e574b4344a6e1f303e5888e1d and project a0fd94de24324ac9a76ec0b7bb64d0a9. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:46.160881 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-490f0051-dc30-485b-a49b-33c16d0b2730 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.322040 Aug 09 14:43:46.163352 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1606/3141] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:43:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:46.169502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89034867-b83c-45ab-9b24-cf3f985f000b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2088076156"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:46.173566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-89034867-b83c-45ab-9b24-cf3f985f000b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:46.182559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89034867-b83c-45ab-9b24-cf3f985f000b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:46.183106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89034867-b83c-45ab-9b24-cf3f985f000b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:46.183631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89034867-b83c-45ab-9b24-cf3f985f000b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:46.184935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89034867-b83c-45ab-9b24-cf3f985f000b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:46.185471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89034867-b83c-45ab-9b24-cf3f985f000b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:46.186166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89034867-b83c-45ab-9b24-cf3f985f000b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:46.273708 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-89034867-b83c-45ab-9b24-cf3f985f000b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "PUT /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1059 microversion: 2.1 time: 0.108566 Aug 09 14:43:46.274588 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1607/3142] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 9 14:43:46 2022] PUT /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1059 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:46.296858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d324b6dc-88de-4234-96f5-2bb291d06c34 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:46.297797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d324b6dc-88de-4234-96f5-2bb291d06c34 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:46.331603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d324b6dc-88de-4234-96f5-2bb291d06c34 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:46.332497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d324b6dc-88de-4234-96f5-2bb291d06c34 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:46.336041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d324b6dc-88de-4234-96f5-2bb291d06c34 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:46.336797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d324b6dc-88de-4234-96f5-2bb291d06c34 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:46.338060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d324b6dc-88de-4234-96f5-2bb291d06c34 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:46.339368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d324b6dc-88de-4234-96f5-2bb291d06c34 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:46.646558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d324b6dc-88de-4234-96f5-2bb291d06c34 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:46.657204 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d324b6dc-88de-4234-96f5-2bb291d06c34 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1395 microversion: 2.1 time: 0.381393 Aug 09 14:43:46.658148 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1608/3143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:46 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1395 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:46.665341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc1b961b-996c-4e3d-9d06-aa7fea997405 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Calling method '.version_select at 0x7f41dd3c6670>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:46.675767 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc1b961b-996c-4e3d-9d06-aa7fea997405 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs/tempest-keypair-2091190410" status: 200 len: 498 microversion: 2.1 time: 0.014774 Aug 09 14:43:46.676688 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1609/3144] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 9 14:43:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2091190410 => generated 498 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:46.681628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4b8a895-6569-4ec8-a014-99b8ac3d551e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:46.687804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e4b8a895-6569-4ec8-a014-99b8ac3d551e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:46.694736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4b8a895-6569-4ec8-a014-99b8ac3d551e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:46.695621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4b8a895-6569-4ec8-a014-99b8ac3d551e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:46.697152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4b8a895-6569-4ec8-a014-99b8ac3d551e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:46.699933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4b8a895-6569-4ec8-a014-99b8ac3d551e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:46.700662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4b8a895-6569-4ec8-a014-99b8ac3d551e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:46.701303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4b8a895-6569-4ec8-a014-99b8ac3d551e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:46.874549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:43:46.875358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:43:46.876079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:43:46.876705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:43:46.878227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:43:46.894272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:46.895122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:46.895796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:46.896794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:46.897477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:46.898970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:46.912591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e4b8a895-6569-4ec8-a014-99b8ac3d551e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:46.921037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Getting quotas for project 426fbb89ba614432b3a0cb87e0e4cd69. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:46.923897 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4b8a895-6569-4ec8-a014-99b8ac3d551e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1486 microversion: 2.1 time: 0.245869 Aug 09 14:43:46.927919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Getting quotas for user d1d53fbb760a4b9282197668b9296c38 and project 426fbb89ba614432b3a0cb87e0e4cd69. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:46.942391 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1610/3145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:46 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1486 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:46.947439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-922fdbe2-2ba0-428c-bc71-511d981353d3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:46.948235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-922fdbe2-2ba0-428c-bc71-511d981353d3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:46.956404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-922fdbe2-2ba0-428c-bc71-511d981353d3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:46.956715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:43:46.956965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-922fdbe2-2ba0-428c-bc71-511d981353d3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:46.957559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-922fdbe2-2ba0-428c-bc71-511d981353d3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:46.959325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-922fdbe2-2ba0-428c-bc71-511d981353d3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:46.959798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-922fdbe2-2ba0-428c-bc71-511d981353d3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:46.960226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-922fdbe2-2ba0-428c-bc71-511d981353d3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:46.961063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:43:47.051686 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-742890a5-a32c-4b29-aef9-dc03823563d2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049568 Aug 09 14:43:47.066394 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1536/3146] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:43:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:43:47.087765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-83195efa-fb32-4350-84b4-e5ef9e8f191c tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Calling method '.version_select at 0x7f41dd347430>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:47.111047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-922fdbe2-2ba0-428c-bc71-511d981353d3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:47.115971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:47.121166 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-922fdbe2-2ba0-428c-bc71-511d981353d3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1275 microversion: 2.1 time: 0.177627 Aug 09 14:43:47.121784 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-83195efa-fb32-4350-84b4-e5ef9e8f191c tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091190410" status: 202 len: 0 microversion: 2.1 time: 0.043536 Aug 09 14:43:47.122386 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1537/3148] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 14:43:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091190410 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:47.122535 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1611/3147] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:46 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1275 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:47.128419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8595f78a-8d8d-44a3-9480-c5db883430ac tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:47.129920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8595f78a-8d8d-44a3-9480-c5db883430ac tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:47.138690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb365ce7-5c7b-41b9-a13e-adb95002ab59 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:47.139406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eb365ce7-5c7b-41b9-a13e-adb95002ab59 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:47.142795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8595f78a-8d8d-44a3-9480-c5db883430ac tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:47.143745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8595f78a-8d8d-44a3-9480-c5db883430ac tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:47.148520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb365ce7-5c7b-41b9-a13e-adb95002ab59 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:47.149021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb365ce7-5c7b-41b9-a13e-adb95002ab59 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:47.149463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb365ce7-5c7b-41b9-a13e-adb95002ab59 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:47.149604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8595f78a-8d8d-44a3-9480-c5db883430ac tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:47.150481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8595f78a-8d8d-44a3-9480-c5db883430ac tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:47.150818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb365ce7-5c7b-41b9-a13e-adb95002ab59 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:47.151291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8595f78a-8d8d-44a3-9480-c5db883430ac tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:47.151665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb365ce7-5c7b-41b9-a13e-adb95002ab59 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:47.152047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8595f78a-8d8d-44a3-9480-c5db883430ac tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:47.152177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb365ce7-5c7b-41b9-a13e-adb95002ab59 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:47.498855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8595f78a-8d8d-44a3-9480-c5db883430ac tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:47.513175 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8595f78a-8d8d-44a3-9480-c5db883430ac tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1486 microversion: 2.1 time: 0.389245 Aug 09 14:43:47.518617 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1612/3149] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:47 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1486 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:47.528762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c5d19e0-c65b-4a15-bf87-f1bedb9e8f67 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:47.529500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5c5d19e0-c65b-4a15-bf87-f1bedb9e8f67 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:47.606338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb365ce7-5c7b-41b9-a13e-adb95002ab59 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:47.615258 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb365ce7-5c7b-41b9-a13e-adb95002ab59 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1325 microversion: 2.1 time: 0.491748 Aug 09 14:43:47.631981 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1538/3150] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:47 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1325 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:47.645369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d850d9f6-0a65-4cc8-b396-b66c5e867303 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Action: 'create', calling method: .version_select at 0x7f41ddf249d0>, body: {"keypair": {"name": "tempest-keypair-203168302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkqvmNzj2TVANtdvDOi8m536wWs3YhdsJY07riRxmAMCkLh92hppH7QxYwRO2vzdoQF6tDETb7u+P/dmHE1ZXONo7MXtUwX0akoeD4bMUXdHPLgrEU9L0IAkEGel0v9qA=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:47.704115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c5d19e0-c65b-4a15-bf87-f1bedb9e8f67 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:47.713551 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c5d19e0-c65b-4a15-bf87-f1bedb9e8f67 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1208 microversion: 2.1 time: 0.193446 Aug 09 14:43:47.714278 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1613/3151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:47 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1208 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:47.729112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d850d9f6-0a65-4cc8-b396-b66c5e867303 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Getting quotas for project a0fd94de24324ac9a76ec0b7bb64d0a9. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:47.735041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d850d9f6-0a65-4cc8-b396-b66c5e867303 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Getting quotas for user aea6926e574b4344a6e1f303e5888e1d and project a0fd94de24324ac9a76ec0b7bb64d0a9. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:47.740969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b6f4f942-27cc-4ef7-bd1c-be3f804bcc29 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:47.741573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b6f4f942-27cc-4ef7-bd1c-be3f804bcc29 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:47.754626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6f4f942-27cc-4ef7-bd1c-be3f804bcc29 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:47.759932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6f4f942-27cc-4ef7-bd1c-be3f804bcc29 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:47.760858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6f4f942-27cc-4ef7-bd1c-be3f804bcc29 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:47.765353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6f4f942-27cc-4ef7-bd1c-be3f804bcc29 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:47.766337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6f4f942-27cc-4ef7-bd1c-be3f804bcc29 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:47.768371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6f4f942-27cc-4ef7-bd1c-be3f804bcc29 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:47.769783 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d850d9f6-0a65-4cc8-b396-b66c5e867303 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.134588 Aug 09 14:43:47.774082 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1539/3152] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:43:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:47.782161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32be7365-7661-45d1-98b8-4ae215c6df64 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:47.791714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-32be7365-7661-45d1-98b8-4ae215c6df64 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:47.802870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32be7365-7661-45d1-98b8-4ae215c6df64 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:47.804009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32be7365-7661-45d1-98b8-4ae215c6df64 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:47.804762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32be7365-7661-45d1-98b8-4ae215c6df64 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:47.805861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32be7365-7661-45d1-98b8-4ae215c6df64 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:47.806522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32be7365-7661-45d1-98b8-4ae215c6df64 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:47.807164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-32be7365-7661-45d1-98b8-4ae215c6df64 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:47.814269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b6f4f942-27cc-4ef7-bd1c-be3f804bcc29 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:43:47.936534 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b6f4f942-27cc-4ef7-bd1c-be3f804bcc29 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 204 len: 0 microversion: 2.1 time: 0.205709 Aug 09 14:43:47.945323 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1614/3153] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:47 2022] DELETE /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:43:47.955165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-77f2314f-7fba-4fbd-81f1-bc8549b85903 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Calling method '.version_select at 0x7f41dd3498b0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:47.976893 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-77f2314f-7fba-4fbd-81f1-bc8549b85903 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203168302" status: 202 len: 0 microversion: 2.1 time: 0.027782 Aug 09 14:43:47.977979 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1615/3154] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 9 14:43:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203168302 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:47.985481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-1b8f0477-0f54-4288-ba68-37305806c02a req-4b6dc117-df6f-43dd-ba24-a0631b6e84b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99173f66-b303-416e-b3ba-71109d2fc9f8", "name": "network-vif-unplugged", "status": "completed", "tag": "af76a083-7c14-4aa2-856b-8763fd515266"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:48.005159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1b8f0477-0f54-4288-ba68-37305806c02a req-4b6dc117-df6f-43dd-ba24-a0631b6e84b5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:48.005880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1b8f0477-0f54-4288-ba68-37305806c02a req-4b6dc117-df6f-43dd-ba24-a0631b6e84b5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:48.006536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1b8f0477-0f54-4288-ba68-37305806c02a req-4b6dc117-df6f-43dd-ba24-a0631b6e84b5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:48.021395 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1b8f0477-0f54-4288-ba68-37305806c02a req-4b6dc117-df6f-43dd-ba24-a0631b6e84b5 service nova] Creating event network-vif-unplugged:af76a083-7c14-4aa2-856b-8763fd515266 for instance 99173f66-b303-416e-b3ba-71109d2fc9f8 on n-h1-844626-8 Aug 09 14:43:48.028492 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-1b8f0477-0f54-4288-ba68-37305806c02a req-4b6dc117-df6f-43dd-ba24-a0631b6e84b5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048844 Aug 09 14:43:48.029825 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1616/3155] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:48.042029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-165b7c9d-4b99-448a-b74e-8b2daf87dae8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:48.042741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-165b7c9d-4b99-448a-b74e-8b2daf87dae8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:48.049640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-165b7c9d-4b99-448a-b74e-8b2daf87dae8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:48.050120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-165b7c9d-4b99-448a-b74e-8b2daf87dae8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:48.050579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-165b7c9d-4b99-448a-b74e-8b2daf87dae8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:48.051323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-165b7c9d-4b99-448a-b74e-8b2daf87dae8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:48.052016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-165b7c9d-4b99-448a-b74e-8b2daf87dae8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:48.052647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-165b7c9d-4b99-448a-b74e-8b2daf87dae8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:48.125077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-32be7365-7661-45d1-98b8-4ae215c6df64 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:48.139638 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32be7365-7661-45d1-98b8-4ae215c6df64 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1395 microversion: 2.1 time: 0.363336 Aug 09 14:43:48.142421 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1540/3156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:47 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1395 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:48.150601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06de532a-d6a4-42ae-9ea8-8751b1629784 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Action: 'create', calling method: .version_select at 0x7f41ddf245e0>, body: {"keypair": {"name": "tempest-keypair-1114007982", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:48.168640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-06de532a-d6a4-42ae-9ea8-8751b1629784 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Getting quotas for project a0fd94de24324ac9a76ec0b7bb64d0a9. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:48.174541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-06de532a-d6a4-42ae-9ea8-8751b1629784 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Getting quotas for user aea6926e574b4344a6e1f303e5888e1d and project a0fd94de24324ac9a76ec0b7bb64d0a9. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:48.208665 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-06de532a-d6a4-42ae-9ea8-8751b1629784 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.061940 Aug 09 14:43:48.210372 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1541/3157] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:43:48 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:48.217396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-54e3bda5-d992-4254-9c7e-8f48dd75e3cb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:48.218481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-54e3bda5-d992-4254-9c7e-8f48dd75e3cb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:48.226210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54e3bda5-d992-4254-9c7e-8f48dd75e3cb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:48.226995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54e3bda5-d992-4254-9c7e-8f48dd75e3cb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:48.227710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54e3bda5-d992-4254-9c7e-8f48dd75e3cb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:48.228655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54e3bda5-d992-4254-9c7e-8f48dd75e3cb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:48.229409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54e3bda5-d992-4254-9c7e-8f48dd75e3cb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:48.230050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54e3bda5-d992-4254-9c7e-8f48dd75e3cb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:48.362738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-54e3bda5-d992-4254-9c7e-8f48dd75e3cb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:48.387537 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-54e3bda5-d992-4254-9c7e-8f48dd75e3cb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1281 microversion: 2.1 time: 0.174996 Aug 09 14:43:48.388170 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1542/3158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:48 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1281 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:48.412487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d4a727c-feea-46a7-9f8a-566bbf8c361f tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Calling method '.version_select at 0x7f41ddf10280>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:48.414849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-165b7c9d-4b99-448a-b74e-8b2daf87dae8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:48.429030 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-165b7c9d-4b99-448a-b74e-8b2daf87dae8 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1492 microversion: 2.1 time: 0.390913 Aug 09 14:43:48.430116 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1617/3159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:48 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1492 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:48.457972 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d4a727c-feea-46a7-9f8a-566bbf8c361f tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114007982" status: 202 len: 0 microversion: 2.1 time: 0.068635 Aug 09 14:43:48.460163 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1543/3160] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 14:43:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1114007982 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:48.473695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64e6a068-ed8c-4939-b938-0c8a738c09fa tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Action: 'create', calling method: .version_select at 0x7f41dd68bf70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1512635791", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpK24aU7Q6KkqqgXLnMEFGjItTtGp51Ng2Vf5hIfcuHwiP1OGiQ3GvIbB5h1CB1g9siTxA36kMGj2ve63YAONURw68k+dpdVhGg/dBcxgjtfKOnQtvHv7N707BtIpvS/g=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:48.508705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-64e6a068-ed8c-4939-b938-0c8a738c09fa tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Getting quotas for project a0fd94de24324ac9a76ec0b7bb64d0a9. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:48.527743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-64e6a068-ed8c-4939-b938-0c8a738c09fa tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Getting quotas for user aea6926e574b4344a6e1f303e5888e1d and project a0fd94de24324ac9a76ec0b7bb64d0a9. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:48.578389 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-64e6a068-ed8c-4939-b938-0c8a738c09fa tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.107873 Aug 09 14:43:48.579857 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1618/3161] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:43:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:48.593534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b728ca8-ddce-4f13-b3df-666efb9eaf96 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Action: 'create', calling method: .version_select at 0x7f41dd347310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-945692994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq845cHgqEixjX5NcuIG5ypSENJUHclchgw/a1RT3NCPulQaFAvB7mTLGa4czSTjE/yAViQkq7fYDe9qONJEBPBOWF5npICUReahIdEpH0KnRxvIBHraMFVwNbG2bsbzg=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:48.629555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9b728ca8-ddce-4f13-b3df-666efb9eaf96 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Getting quotas for project a0fd94de24324ac9a76ec0b7bb64d0a9. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:48.638313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9b728ca8-ddce-4f13-b3df-666efb9eaf96 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Getting quotas for user aea6926e574b4344a6e1f303e5888e1d and project a0fd94de24324ac9a76ec0b7bb64d0a9. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:48.646122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-98828de4-ac6b-4504-b81d-fb319b73d4d3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:48.647075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-98828de4-ac6b-4504-b81d-fb319b73d4d3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:48.656883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98828de4-ac6b-4504-b81d-fb319b73d4d3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:48.657806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98828de4-ac6b-4504-b81d-fb319b73d4d3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:48.658504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98828de4-ac6b-4504-b81d-fb319b73d4d3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:48.659807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98828de4-ac6b-4504-b81d-fb319b73d4d3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:48.660572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98828de4-ac6b-4504-b81d-fb319b73d4d3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:48.661276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98828de4-ac6b-4504-b81d-fb319b73d4d3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:48.697486 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b728ca8-ddce-4f13-b3df-666efb9eaf96 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.108537 Aug 09 14:43:48.699705 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1544/3162] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:43:48 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:48.713798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9f19f9d-2910-4aec-a6d2-82ecf1c7e257 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Action: 'create', calling method: .version_select at 0x7f41e758a670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-205986523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAR0FKrULRmIoDa4Lwj+SCLcMRimGV/MC5z2RK8kbX5B/N7ImylCFEYAf4aQR+wcn34a5nZDGRUejRFZ39tRV5119ANVRQ7JINHzwFv3EuGW+WEHPv5bQZGhXNBhPyPqvw=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:48.740873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-a9f19f9d-2910-4aec-a6d2-82ecf1c7e257 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Getting quotas for project a0fd94de24324ac9a76ec0b7bb64d0a9. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:43:48.747591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-a9f19f9d-2910-4aec-a6d2-82ecf1c7e257 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Getting quotas for user aea6926e574b4344a6e1f303e5888e1d and project a0fd94de24324ac9a76ec0b7bb64d0a9. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:43:48.751523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:48.789545 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9f19f9d-2910-4aec-a6d2-82ecf1c7e257 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.079609 Aug 09 14:43:48.791802 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1545/3163] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:43:48 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:48.805114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-4876d88e-089a-4bb1-949b-e9b0d923b484 req-235f0933-c3d8-4333-8a36-a706d4c5a4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99173f66-b303-416e-b3ba-71109d2fc9f8", "name": "network-vif-deleted", "tag": "af76a083-7c14-4aa2-856b-8763fd515266"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:48.820806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4876d88e-089a-4bb1-949b-e9b0d923b484 req-235f0933-c3d8-4333-8a36-a706d4c5a4ad service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:48.822309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4876d88e-089a-4bb1-949b-e9b0d923b484 req-235f0933-c3d8-4333-8a36-a706d4c5a4ad service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:48.823113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4876d88e-089a-4bb1-949b-e9b0d923b484 req-235f0933-c3d8-4333-8a36-a706d4c5a4ad service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:48.844274 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4876d88e-089a-4bb1-949b-e9b0d923b484 req-235f0933-c3d8-4333-8a36-a706d4c5a4ad service nova] Creating event network-vif-deleted:af76a083-7c14-4aa2-856b-8763fd515266 for instance 99173f66-b303-416e-b3ba-71109d2fc9f8 on n-h1-844626-8 Aug 09 14:43:48.861882 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-4876d88e-089a-4bb1-949b-e9b0d923b484 req-235f0933-c3d8-4333-8a36-a706d4c5a4ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068113 Aug 09 14:43:48.863935 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1546/3164] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:48.871624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9fb69b91-bf3b-426c-9fd4-dd65eb1d2341 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:48.872932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9fb69b91-bf3b-426c-9fd4-dd65eb1d2341 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:48.885786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb69b91-bf3b-426c-9fd4-dd65eb1d2341 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:48.887327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb69b91-bf3b-426c-9fd4-dd65eb1d2341 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:48.888077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb69b91-bf3b-426c-9fd4-dd65eb1d2341 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:48.889231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb69b91-bf3b-426c-9fd4-dd65eb1d2341 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:48.890072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb69b91-bf3b-426c-9fd4-dd65eb1d2341 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:48.890868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb69b91-bf3b-426c-9fd4-dd65eb1d2341 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:48.961266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-98828de4-ac6b-4504-b81d-fb319b73d4d3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:48.983951 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-98828de4-ac6b-4504-b81d-fb319b73d4d3 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1325 microversion: 2.1 time: 0.342670 Aug 09 14:43:48.989334 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1619/3165] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:48 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:43:49.000229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-691a9889-2595-4b07-813f-bc85138a1b4b tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Calling method '.version_select at 0x7f41dd361550>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:49.006623 n-d-844626-8 devstack@n-api.service[119407]: WARNING oslo_db.sqlalchemy.utils [None req-691a9889-2595-4b07-813f-bc85138a1b4b tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 09 14:43:49.014204 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-691a9889-2595-4b07-813f-bc85138a1b4b tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.023721 Aug 09 14:43:49.015071 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1620/3166] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:43:48 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:49.030015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7b750da-d4a7-44c1-945a-cf86016f6afa tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Calling method '.version_select at 0x7f41dd3c6dc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:49.045809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9fb69b91-bf3b-426c-9fd4-dd65eb1d2341 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:49.056645 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7b750da-d4a7-44c1-945a-cf86016f6afa tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-205986523" status: 202 len: 0 microversion: 2.1 time: 0.032222 Aug 09 14:43:49.057166 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9fb69b91-bf3b-426c-9fd4-dd65eb1d2341 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1204 microversion: 2.1 time: 0.191328 Aug 09 14:43:49.057927 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1621/3167] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:43:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-205986523 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:49.066768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1af6cb69-77e9-4aea-ba21-7b8a346033e7 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Calling method '.version_select at 0x7f41dd32d310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:49.071516 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1547/3168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:48 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1204 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:49.098343 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1af6cb69-77e9-4aea-ba21-7b8a346033e7 tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-945692994" status: 202 len: 0 microversion: 2.1 time: 0.035912 Aug 09 14:43:49.099633 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1622/3169] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:43:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-945692994 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:49.109741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aebe7d60-b273-4526-9710-5a50f431065b tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] Calling method '.version_select at 0x7f41e74f3ca0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:49.134233 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aebe7d60-b273-4526-9710-5a50f431065b tempest-KeyPairsV2TestJSON-1488264650 tempest-KeyPairsV2TestJSON-1488264650-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1512635791" status: 202 len: 0 microversion: 2.1 time: 0.029872 Aug 09 14:43:49.135393 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1548/3170] 10.222.0.50 () {58 vars in 1278 bytes} [Tue Aug 9 14:43:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1512635791 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 14:43:49.170948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2680080f-d426-4671-a30b-c9bc851f67dc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:49.181706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2680080f-d426-4671-a30b-c9bc851f67dc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:49.193836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2680080f-d426-4671-a30b-c9bc851f67dc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:49.194577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2680080f-d426-4671-a30b-c9bc851f67dc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:49.195605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2680080f-d426-4671-a30b-c9bc851f67dc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:49.196548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2680080f-d426-4671-a30b-c9bc851f67dc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:49.197208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2680080f-d426-4671-a30b-c9bc851f67dc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:49.197831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2680080f-d426-4671-a30b-c9bc851f67dc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:49.409367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dbda1e8c-1353-40c7-86f6-439f40e888d2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:49.410028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dbda1e8c-1353-40c7-86f6-439f40e888d2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:49.418995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbda1e8c-1353-40c7-86f6-439f40e888d2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:49.425729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbda1e8c-1353-40c7-86f6-439f40e888d2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:49.426398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbda1e8c-1353-40c7-86f6-439f40e888d2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:49.427409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbda1e8c-1353-40c7-86f6-439f40e888d2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:49.427991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbda1e8c-1353-40c7-86f6-439f40e888d2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:49.428517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbda1e8c-1353-40c7-86f6-439f40e888d2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:49.553500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2680080f-d426-4671-a30b-c9bc851f67dc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:49.563433 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2680080f-d426-4671-a30b-c9bc851f67dc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1395 microversion: 2.1 time: 0.398791 Aug 09 14:43:49.564033 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1623/3171] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:49 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1395 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:49.584005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d28c3bb2-7ab9-4ab4-8a9c-d59ee9f1d919 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:49.584616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d28c3bb2-7ab9-4ab4-8a9c-d59ee9f1d919 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:49.627623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d28c3bb2-7ab9-4ab4-8a9c-d59ee9f1d919 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:49.628986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d28c3bb2-7ab9-4ab4-8a9c-d59ee9f1d919 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:49.631428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d28c3bb2-7ab9-4ab4-8a9c-d59ee9f1d919 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:49.633817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d28c3bb2-7ab9-4ab4-8a9c-d59ee9f1d919 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:49.636171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d28c3bb2-7ab9-4ab4-8a9c-d59ee9f1d919 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:49.637162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d28c3bb2-7ab9-4ab4-8a9c-d59ee9f1d919 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:49.744014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dbda1e8c-1353-40c7-86f6-439f40e888d2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:49.755885 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dbda1e8c-1353-40c7-86f6-439f40e888d2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1281 microversion: 2.1 time: 0.350321 Aug 09 14:43:49.759410 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1549/3172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:49 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1281 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:50.007952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e92f107f-fa23-4f83-b45b-7af08559f685 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:50.009605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e92f107f-fa23-4f83-b45b-7af08559f685 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:50.029186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d28c3bb2-7ab9-4ab4-8a9c-d59ee9f1d919 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:50.036370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e92f107f-fa23-4f83-b45b-7af08559f685 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:50.037143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e92f107f-fa23-4f83-b45b-7af08559f685 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:50.038289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e92f107f-fa23-4f83-b45b-7af08559f685 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:50.039325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e92f107f-fa23-4f83-b45b-7af08559f685 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:50.041342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e92f107f-fa23-4f83-b45b-7af08559f685 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:50.045060 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d28c3bb2-7ab9-4ab4-8a9c-d59ee9f1d919 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1492 microversion: 2.1 time: 0.478508 Aug 09 14:43:50.045823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e92f107f-fa23-4f83-b45b-7af08559f685 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:50.055462 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1624/3173] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:49 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1492 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:50.068873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ed621ac2-adbc-4723-a40d-08523ef6a077 req-724afa3c-3ec4-47c9-83e0-d3eea97c1a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a2a79d-0cb7-4f9f-9b23-13b4b566c043", "name": "network-vif-plugged", "status": "completed", "tag": "75d75b68-e994-4644-9c35-1692aa641cb5"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:50.079221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ed621ac2-adbc-4723-a40d-08523ef6a077 req-724afa3c-3ec4-47c9-83e0-d3eea97c1a08 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:50.083721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ed621ac2-adbc-4723-a40d-08523ef6a077 req-724afa3c-3ec4-47c9-83e0-d3eea97c1a08 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:50.084375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ed621ac2-adbc-4723-a40d-08523ef6a077 req-724afa3c-3ec4-47c9-83e0-d3eea97c1a08 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:50.101488 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ed621ac2-adbc-4723-a40d-08523ef6a077 req-724afa3c-3ec4-47c9-83e0-d3eea97c1a08 service nova] Creating event network-vif-plugged:75d75b68-e994-4644-9c35-1692aa641cb5 for instance e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 on n-h2-844626-8 Aug 09 14:43:50.108498 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ed621ac2-adbc-4723-a40d-08523ef6a077 req-724afa3c-3ec4-47c9-83e0-d3eea97c1a08 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044256 Aug 09 14:43:50.109554 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1625/3174] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:50.116871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-541e1094-cf4f-4a60-a6de-b83a3b7077fc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:50.119770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-541e1094-cf4f-4a60-a6de-b83a3b7077fc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:50.128041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-541e1094-cf4f-4a60-a6de-b83a3b7077fc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:50.128559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-541e1094-cf4f-4a60-a6de-b83a3b7077fc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:50.129395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-541e1094-cf4f-4a60-a6de-b83a3b7077fc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:50.130441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-541e1094-cf4f-4a60-a6de-b83a3b7077fc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:50.131189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-541e1094-cf4f-4a60-a6de-b83a3b7077fc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:50.131721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-541e1094-cf4f-4a60-a6de-b83a3b7077fc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:50.258283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-541e1094-cf4f-4a60-a6de-b83a3b7077fc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:50.272177 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-541e1094-cf4f-4a60-a6de-b83a3b7077fc tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1260 microversion: 2.1 time: 0.161096 Aug 09 14:43:50.273356 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1626/3175] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:50 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:50.398112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e92f107f-fa23-4f83-b45b-7af08559f685 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:50.406830 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e92f107f-fa23-4f83-b45b-7af08559f685 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1521 microversion: 2.1 time: 0.403637 Aug 09 14:43:50.411411 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1550/3176] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:50 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:43:50.447228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1a5af31b-8894-4180-88bf-ffef1628bce4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:50.448615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1a5af31b-8894-4180-88bf-ffef1628bce4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:50.496395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a5af31b-8894-4180-88bf-ffef1628bce4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:50.499368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a5af31b-8894-4180-88bf-ffef1628bce4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:50.500121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a5af31b-8894-4180-88bf-ffef1628bce4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:50.501852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a5af31b-8894-4180-88bf-ffef1628bce4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:50.502623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a5af31b-8894-4180-88bf-ffef1628bce4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:50.503250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a5af31b-8894-4180-88bf-ffef1628bce4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:50.541491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1a5af31b-8894-4180-88bf-ffef1628bce4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:43:50.589985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fedbd227-2303-4c78-ac93-035fbf1439b0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:50.591309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fedbd227-2303-4c78-ac93-035fbf1439b0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:50.604950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fedbd227-2303-4c78-ac93-035fbf1439b0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:50.606725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fedbd227-2303-4c78-ac93-035fbf1439b0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:50.607488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fedbd227-2303-4c78-ac93-035fbf1439b0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:50.608483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fedbd227-2303-4c78-ac93-035fbf1439b0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:50.610058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fedbd227-2303-4c78-ac93-035fbf1439b0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:50.610739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fedbd227-2303-4c78-ac93-035fbf1439b0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:50.618414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:50.672266 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1a5af31b-8894-4180-88bf-ffef1628bce4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "DELETE /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 204 len: 0 microversion: 2.1 time: 0.236951 Aug 09 14:43:50.672814 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1627/3177] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:50 2022] DELETE /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:43:50.681323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9fa9ab9a-50fe-475b-a67c-7b46ec6778c7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:50.682127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9fa9ab9a-50fe-475b-a67c-7b46ec6778c7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:50.693730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9fa9ab9a-50fe-475b-a67c-7b46ec6778c7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:50.707461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9fa9ab9a-50fe-475b-a67c-7b46ec6778c7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:50.708260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9fa9ab9a-50fe-475b-a67c-7b46ec6778c7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:50.708950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9fa9ab9a-50fe-475b-a67c-7b46ec6778c7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:50.709701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9fa9ab9a-50fe-475b-a67c-7b46ec6778c7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:50.710034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9fa9ab9a-50fe-475b-a67c-7b46ec6778c7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:51.425188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fedbd227-2303-4c78-ac93-035fbf1439b0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:51.436159 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fedbd227-2303-4c78-ac93-035fbf1439b0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1395 microversion: 2.1 time: 0.852813 Aug 09 14:43:51.438851 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1551/3178] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:50 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1395 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:43:51.445355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bcfd2b4f-447c-4015-8cac-2d5094b4f7ce tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:51.446396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bcfd2b4f-447c-4015-8cac-2d5094b4f7ce tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:51.454682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9fa9ab9a-50fe-475b-a67c-7b46ec6778c7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:51.458741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfd2b4f-447c-4015-8cac-2d5094b4f7ce tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:51.459553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfd2b4f-447c-4015-8cac-2d5094b4f7ce tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:51.460203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfd2b4f-447c-4015-8cac-2d5094b4f7ce tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:51.461345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfd2b4f-447c-4015-8cac-2d5094b4f7ce tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:51.461711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfd2b4f-447c-4015-8cac-2d5094b4f7ce tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:51.462146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfd2b4f-447c-4015-8cac-2d5094b4f7ce tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:51.469172 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9fa9ab9a-50fe-475b-a67c-7b46ec6778c7 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1527 microversion: 2.1 time: 0.785922 Aug 09 14:43:51.470155 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1628/3179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:50 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1527 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:43:51.480354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b231e4db-9750-4846-9978-2d265cc2800c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:51.481249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b231e4db-9750-4846-9978-2d265cc2800c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:51.490253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b231e4db-9750-4846-9978-2d265cc2800c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:51.493408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b231e4db-9750-4846-9978-2d265cc2800c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:51.498330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b231e4db-9750-4846-9978-2d265cc2800c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:51.499104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b231e4db-9750-4846-9978-2d265cc2800c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:51.499839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b231e4db-9750-4846-9978-2d265cc2800c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:51.500265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b231e4db-9750-4846-9978-2d265cc2800c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:51.621259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b231e4db-9750-4846-9978-2d265cc2800c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:51.634477 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b231e4db-9750-4846-9978-2d265cc2800c tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 200 len: 1450 microversion: 2.1 time: 0.162973 Aug 09 14:43:51.635072 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1629/3180] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:51 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 1450 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:51.649108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44c3e24f-432b-4a2e-9216-bc834bc9158e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:51.649725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44c3e24f-432b-4a2e-9216-bc834bc9158e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:51.663967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44c3e24f-432b-4a2e-9216-bc834bc9158e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:51.664752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44c3e24f-432b-4a2e-9216-bc834bc9158e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:51.665328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44c3e24f-432b-4a2e-9216-bc834bc9158e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:51.666253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44c3e24f-432b-4a2e-9216-bc834bc9158e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:51.666851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44c3e24f-432b-4a2e-9216-bc834bc9158e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:51.667536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44c3e24f-432b-4a2e-9216-bc834bc9158e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:51.726512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bcfd2b4f-447c-4015-8cac-2d5094b4f7ce tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:51.735404 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bcfd2b4f-447c-4015-8cac-2d5094b4f7ce tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1323 microversion: 2.1 time: 0.295863 Aug 09 14:43:51.736047 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1552/3181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:51 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1323 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:51.742615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-4ac2c1ab-f4b1-4742-ac72-4783dd3908e0 req-e65968bb-e823-4339-a422-ec69cadf6b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03fa714c-48d4-4831-852f-547a2228111f", "name": "network-vif-deleted", "tag": "c039a019-677e-4fb4-97cd-fa615c031578"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:51.747464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-44c3e24f-432b-4a2e-9216-bc834bc9158e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:51.755019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4ac2c1ab-f4b1-4742-ac72-4783dd3908e0 req-e65968bb-e823-4339-a422-ec69cadf6b21 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:51.755574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4ac2c1ab-f4b1-4742-ac72-4783dd3908e0 req-e65968bb-e823-4339-a422-ec69cadf6b21 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:51.756055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4ac2c1ab-f4b1-4742-ac72-4783dd3908e0 req-e65968bb-e823-4339-a422-ec69cadf6b21 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:51.756701 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44c3e24f-432b-4a2e-9216-bc834bc9158e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1266 microversion: 2.1 time: 0.111192 Aug 09 14:43:51.757472 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1630/3182] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:51 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:51.770483 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4ac2c1ab-f4b1-4742-ac72-4783dd3908e0 req-e65968bb-e823-4339-a422-ec69cadf6b21 service nova] Creating event network-vif-deleted:c039a019-677e-4fb4-97cd-fa615c031578 for instance 03fa714c-48d4-4831-852f-547a2228111f on n-h2-844626-8 Aug 09 14:43:51.776007 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-4ac2c1ab-f4b1-4742-ac72-4783dd3908e0 req-e65968bb-e823-4339-a422-ec69cadf6b21 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038465 Aug 09 14:43:51.776644 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1553/3183] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:52.473566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0658ea03-ca06-4b39-98bc-18f1cfa22e10 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:52.474292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0658ea03-ca06-4b39-98bc-18f1cfa22e10 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:52.488130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0658ea03-ca06-4b39-98bc-18f1cfa22e10 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:52.490186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0658ea03-ca06-4b39-98bc-18f1cfa22e10 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:52.492211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0658ea03-ca06-4b39-98bc-18f1cfa22e10 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:52.494554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0658ea03-ca06-4b39-98bc-18f1cfa22e10 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:52.495289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0658ea03-ca06-4b39-98bc-18f1cfa22e10 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:52.497199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d4e374b-e26f-462d-a9d3-29a0883bf5b5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:52.497986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0658ea03-ca06-4b39-98bc-18f1cfa22e10 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:52.498121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d4e374b-e26f-462d-a9d3-29a0883bf5b5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:52.513283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d4e374b-e26f-462d-a9d3-29a0883bf5b5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:52.516794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d4e374b-e26f-462d-a9d3-29a0883bf5b5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:52.520196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d4e374b-e26f-462d-a9d3-29a0883bf5b5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:52.521038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d4e374b-e26f-462d-a9d3-29a0883bf5b5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:52.525596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d4e374b-e26f-462d-a9d3-29a0883bf5b5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:52.526807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d4e374b-e26f-462d-a9d3-29a0883bf5b5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:52.965879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d4e374b-e26f-462d-a9d3-29a0883bf5b5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:52.973584 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d4e374b-e26f-462d-a9d3-29a0883bf5b5 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1527 microversion: 2.1 time: 0.481380 Aug 09 14:43:52.992735 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1554/3184] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:52 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1527 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:52.999263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55524f25-b4d9-4f77-ab24-28b88c5bcc26 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:53.005940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55524f25-b4d9-4f77-ab24-28b88c5bcc26 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:53.009239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0658ea03-ca06-4b39-98bc-18f1cfa22e10 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:53.021633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55524f25-b4d9-4f77-ab24-28b88c5bcc26 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:53.022660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55524f25-b4d9-4f77-ab24-28b88c5bcc26 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:53.023293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55524f25-b4d9-4f77-ab24-28b88c5bcc26 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:53.024206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55524f25-b4d9-4f77-ab24-28b88c5bcc26 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:53.024820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55524f25-b4d9-4f77-ab24-28b88c5bcc26 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:53.025401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55524f25-b4d9-4f77-ab24-28b88c5bcc26 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:53.033997 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0658ea03-ca06-4b39-98bc-18f1cfa22e10 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1577 microversion: 2.1 time: 0.567831 Aug 09 14:43:53.036302 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1631/3185] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:52 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1577 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:53.054931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2ab9f9e-ba3e-4b2c-b11f-cdab6f8e5e2d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:53.056219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d2ab9f9e-ba3e-4b2c-b11f-cdab6f8e5e2d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:53.071117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2ab9f9e-ba3e-4b2c-b11f-cdab6f8e5e2d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:53.073589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2ab9f9e-ba3e-4b2c-b11f-cdab6f8e5e2d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:53.074037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2ab9f9e-ba3e-4b2c-b11f-cdab6f8e5e2d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:53.074464 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-55524f25-b4d9-4f77-ab24-28b88c5bcc26 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:53.075677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2ab9f9e-ba3e-4b2c-b11f-cdab6f8e5e2d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:53.076142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2ab9f9e-ba3e-4b2c-b11f-cdab6f8e5e2d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:53.076574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2ab9f9e-ba3e-4b2c-b11f-cdab6f8e5e2d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55524f25-b4d9-4f77-ab24-28b88c5bcc26 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f HTTP/1.1 Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '03fa714c-48d4-4831-852f-547a2228111f'} Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:53.076953 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:53.083051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:53.083051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:53.083051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:53.083051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:53.083051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:53.083051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:53.084662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55524f25-b4d9-4f77-ab24-28b88c5bcc26 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:53.087217 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-55524f25-b4d9-4f77-ab24-28b88c5bcc26 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 404 len: 111 microversion: 2.1 time: 0.093118 Aug 09 14:43:53.093648 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1555/3186] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:52 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:53.098840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-badbb23f-46cf-48b0-b04c-cdd737946223 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:53.103432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-badbb23f-46cf-48b0-b04c-cdd737946223 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:53.119863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-badbb23f-46cf-48b0-b04c-cdd737946223 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:53.120931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-badbb23f-46cf-48b0-b04c-cdd737946223 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:53.122124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-badbb23f-46cf-48b0-b04c-cdd737946223 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:53.123504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-badbb23f-46cf-48b0-b04c-cdd737946223 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:53.124306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-badbb23f-46cf-48b0-b04c-cdd737946223 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:53.124964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-badbb23f-46cf-48b0-b04c-cdd737946223 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:53.127830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:53.786592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d2ab9f9e-ba3e-4b2c-b11f-cdab6f8e5e2d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:53.801657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-badbb23f-46cf-48b0-b04c-cdd737946223 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:53.810181 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d2ab9f9e-ba3e-4b2c-b11f-cdab6f8e5e2d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1323 microversion: 2.1 time: 0.770972 Aug 09 14:43:53.810930 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1632/3187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:53 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1323 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:53.827912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f04a0138-45cd-47c3-8e47-eb7d8552e2bc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:53.827912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f04a0138-45cd-47c3-8e47-eb7d8552e2bc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:53.833099 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-badbb23f-46cf-48b0-b04c-cdd737946223 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1308 microversion: 2.1 time: 0.737972 Aug 09 14:43:53.834015 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1556/3188] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:53 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1308 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:53.845100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04a0138-45cd-47c3-8e47-eb7d8552e2bc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:53.845600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04a0138-45cd-47c3-8e47-eb7d8552e2bc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:53.846038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04a0138-45cd-47c3-8e47-eb7d8552e2bc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:53.846747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04a0138-45cd-47c3-8e47-eb7d8552e2bc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:53.847241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04a0138-45cd-47c3-8e47-eb7d8552e2bc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:53.848144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f75b707-a4e6-44a5-a062-81c7ee0440a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:53.848834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f75b707-a4e6-44a5-a062-81c7ee0440a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:53.850926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f04a0138-45cd-47c3-8e47-eb7d8552e2bc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:53.855219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f75b707-a4e6-44a5-a062-81c7ee0440a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:53.855710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f75b707-a4e6-44a5-a062-81c7ee0440a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:53.856146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f75b707-a4e6-44a5-a062-81c7ee0440a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:53.856840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f75b707-a4e6-44a5-a062-81c7ee0440a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:53.861308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f75b707-a4e6-44a5-a062-81c7ee0440a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:53.867276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f75b707-a4e6-44a5-a062-81c7ee0440a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:53.905930 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-0f75b707-a4e6-44a5-a062-81c7ee0440a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f75b707-a4e6-44a5-a062-81c7ee0440a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f HTTP/1.1 Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '03fa714c-48d4-4831-852f-547a2228111f'} Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:53.911344 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:53.916517 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:53.916517 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:53.916517 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:53.916517 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:53.916517 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:53.916517 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:53.916517 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:53.916517 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:53.916517 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:53.916517 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:53.921552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f75b707-a4e6-44a5-a062-81c7ee0440a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:53.922621 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f75b707-a4e6-44a5-a062-81c7ee0440a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 404 len: 111 microversion: 2.1 time: 0.087492 Aug 09 14:43:53.923403 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1557/3189] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:53 2022] DELETE /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:53.932670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-abbf7ee8-63b3-4061-8be0-ca98d541b96b req-3d045bb4-715e-4839-b988-0c4007a5b29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c707b9-a4e0-4d5a-98f4-a8c8f9d82920", "tag": "8e65bee5-f93d-4d11-9c50-0909cf992d51"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:53.953026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-abbf7ee8-63b3-4061-8be0-ca98d541b96b req-3d045bb4-715e-4839-b988-0c4007a5b29e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:53.953847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-abbf7ee8-63b3-4061-8be0-ca98d541b96b req-3d045bb4-715e-4839-b988-0c4007a5b29e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:53.954450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-abbf7ee8-63b3-4061-8be0-ca98d541b96b req-3d045bb4-715e-4839-b988-0c4007a5b29e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:53.968336 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-abbf7ee8-63b3-4061-8be0-ca98d541b96b req-3d045bb4-715e-4839-b988-0c4007a5b29e service nova] Creating event network-changed:8e65bee5-f93d-4d11-9c50-0909cf992d51 for instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 on n-h1-844626-8 Aug 09 14:43:53.974347 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-abbf7ee8-63b3-4061-8be0-ca98d541b96b req-3d045bb4-715e-4839-b988-0c4007a5b29e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049408 Aug 09 14:43:53.975355 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1558/3190] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:53.983906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-93404570-d20f-48a1-a1b1-54f2e8ae5072 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:53.989034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-93404570-d20f-48a1-a1b1-54f2e8ae5072 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 03fa714c-48d4-4831-852f-547a2228111f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:54.003005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93404570-d20f-48a1-a1b1-54f2e8ae5072 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.004084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93404570-d20f-48a1-a1b1-54f2e8ae5072 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.004848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93404570-d20f-48a1-a1b1-54f2e8ae5072 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.005804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93404570-d20f-48a1-a1b1-54f2e8ae5072 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.010226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93404570-d20f-48a1-a1b1-54f2e8ae5072 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.011044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93404570-d20f-48a1-a1b1-54f2e8ae5072 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.037115 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-93404570-d20f-48a1-a1b1-54f2e8ae5072 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-93404570-d20f-48a1-a1b1-54f2e8ae5072 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f HTTP/1.1 Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '03fa714c-48d4-4831-852f-547a2228111f'} Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.041982 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.046810 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.046810 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.046810 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:54.046810 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:54.046810 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. Aug 09 14:43:54.046810 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.049264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-93404570-d20f-48a1-a1b1-54f2e8ae5072 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 03fa714c-48d4-4831-852f-547a2228111f could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:54.051353 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-93404570-d20f-48a1-a1b1-54f2e8ae5072 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f" status: 404 len: 111 microversion: 2.1 time: 0.074258 Aug 09 14:43:54.052191 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1559/3191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:53 2022] GET /compute/v2.1/servers/03fa714c-48d4-4831-852f-547a2228111f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:54.073232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34d1f21f-0d70-439c-b116-d5f7aabc132b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:54.074038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34d1f21f-0d70-439c-b116-d5f7aabc132b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:54.081095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34d1f21f-0d70-439c-b116-d5f7aabc132b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.081899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34d1f21f-0d70-439c-b116-d5f7aabc132b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.082506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34d1f21f-0d70-439c-b116-d5f7aabc132b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.083476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34d1f21f-0d70-439c-b116-d5f7aabc132b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.084978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34d1f21f-0d70-439c-b116-d5f7aabc132b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.085737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34d1f21f-0d70-439c-b116-d5f7aabc132b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.116439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:54.463994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34d1f21f-0d70-439c-b116-d5f7aabc132b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:54.473538 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34d1f21f-0d70-439c-b116-d5f7aabc132b tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1485 microversion: 2.1 time: 0.409203 Aug 09 14:43:54.474135 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1560/3192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:54 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1485 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:54.493555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1f4ea73-67d1-4a45-a34c-596dd3994cf9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:54.494267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1f4ea73-67d1-4a45-a34c-596dd3994cf9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:54.508734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1f4ea73-67d1-4a45-a34c-596dd3994cf9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.509234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1f4ea73-67d1-4a45-a34c-596dd3994cf9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.513270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1f4ea73-67d1-4a45-a34c-596dd3994cf9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.514853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1f4ea73-67d1-4a45-a34c-596dd3994cf9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.517712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1f4ea73-67d1-4a45-a34c-596dd3994cf9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.522214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1f4ea73-67d1-4a45-a34c-596dd3994cf9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.564710 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-e1f4ea73-67d1-4a45-a34c-596dd3994cf9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1f4ea73-67d1-4a45-a34c-596dd3994cf9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 HTTP/1.1 Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3'} Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:54.567247 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:43:54.571550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.571550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.571550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.571550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.571550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.571550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.571550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:54.571550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:54.571550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:43:54.571550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.571550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1f4ea73-67d1-4a45-a34c-596dd3994cf9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:54.571550 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1f4ea73-67d1-4a45-a34c-596dd3994cf9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 404 len: 111 microversion: 2.1 time: 0.079952 Aug 09 14:43:54.572449 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1561/3193] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:54 2022] DELETE /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:54.577954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85553509-221f-4114-9f5b-babeb7addda5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:54.578660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-85553509-221f-4114-9f5b-babeb7addda5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:54.585574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85553509-221f-4114-9f5b-babeb7addda5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.586204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85553509-221f-4114-9f5b-babeb7addda5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.586639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85553509-221f-4114-9f5b-babeb7addda5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.587384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85553509-221f-4114-9f5b-babeb7addda5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.588174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85553509-221f-4114-9f5b-babeb7addda5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.588313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85553509-221f-4114-9f5b-babeb7addda5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.610474 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-85553509-221f-4114-9f5b-babeb7addda5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85553509-221f-4114-9f5b-babeb7addda5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 HTTP/1.1 Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3'} Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.612148 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.621157 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.621157 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.621157 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:54.621157 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:54.621157 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. Aug 09 14:43:54.621157 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.621157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85553509-221f-4114-9f5b-babeb7addda5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:54.621157 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-85553509-221f-4114-9f5b-babeb7addda5 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3" status: 404 len: 111 microversion: 2.1 time: 0.040065 Aug 09 14:43:54.621157 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1562/3194] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:54 2022] GET /compute/v2.1/servers/3f3a3ebc-51e6-42ce-9d34-95c7e1d296d3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:54.628805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3cc9739-cb5f-4d1b-9ddd-ad71eb57da55 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:54.628805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3cc9739-cb5f-4d1b-9ddd-ad71eb57da55 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:54.631287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3cc9739-cb5f-4d1b-9ddd-ad71eb57da55 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.631996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3cc9739-cb5f-4d1b-9ddd-ad71eb57da55 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.632599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3cc9739-cb5f-4d1b-9ddd-ad71eb57da55 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.633629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3cc9739-cb5f-4d1b-9ddd-ad71eb57da55 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.634085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3cc9739-cb5f-4d1b-9ddd-ad71eb57da55 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.634671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3cc9739-cb5f-4d1b-9ddd-ad71eb57da55 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.665614 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b3cc9739-cb5f-4d1b-9ddd-ad71eb57da55 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3cc9739-cb5f-4d1b-9ddd-ad71eb57da55 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 HTTP/1.1 Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '39095b44-f6d1-4065-a3cb-d6c051168846'} Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:54.667357 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:43:54.673009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.673009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.673009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.673009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.673009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.673009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.673009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:54.673009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:54.673009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:43:54.673009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.673009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3cc9739-cb5f-4d1b-9ddd-ad71eb57da55 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:54.673009 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3cc9739-cb5f-4d1b-9ddd-ad71eb57da55 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 404 len: 111 microversion: 2.1 time: 0.051710 Aug 09 14:43:54.676103 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1563/3195] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:54 2022] DELETE /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:54.683853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b848036d-d45e-45dd-b974-13076548dd46 req-654642e4-a656-48c3-9aa1-fb5db2d424d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474888b4-0058-40eb-9a4d-f723520472a0", "name": "network-vif-deleted", "tag": "b8dbdfa5-3258-4e23-a6ca-1c11d5083a07"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:54.696307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b848036d-d45e-45dd-b974-13076548dd46 req-654642e4-a656-48c3-9aa1-fb5db2d424d6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.696930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b848036d-d45e-45dd-b974-13076548dd46 req-654642e4-a656-48c3-9aa1-fb5db2d424d6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.697377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b848036d-d45e-45dd-b974-13076548dd46 req-654642e4-a656-48c3-9aa1-fb5db2d424d6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.717824 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b848036d-d45e-45dd-b974-13076548dd46 req-654642e4-a656-48c3-9aa1-fb5db2d424d6 service nova] Creating event network-vif-deleted:b8dbdfa5-3258-4e23-a6ca-1c11d5083a07 for instance 474888b4-0058-40eb-9a4d-f723520472a0 on n-h1-844626-8 Aug 09 14:43:54.723575 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b848036d-d45e-45dd-b974-13076548dd46 req-654642e4-a656-48c3-9aa1-fb5db2d424d6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043212 Aug 09 14:43:54.724549 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1564/3196] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:54.731703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de8c3e7d-2a7b-413b-a172-2b26a2b8b88d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:54.732463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-de8c3e7d-2a7b-413b-a172-2b26a2b8b88d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 39095b44-f6d1-4065-a3cb-d6c051168846] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:54.734248 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f04a0138-45cd-47c3-8e47-eb7d8552e2bc tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.917265 Aug 09 14:43:54.735618 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1633/3197] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:43:53 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043/os-interface => generated 285 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:54.748895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de8c3e7d-2a7b-413b-a172-2b26a2b8b88d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.749466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de8c3e7d-2a7b-413b-a172-2b26a2b8b88d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.750027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de8c3e7d-2a7b-413b-a172-2b26a2b8b88d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.750737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de8c3e7d-2a7b-413b-a172-2b26a2b8b88d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.751313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de8c3e7d-2a7b-413b-a172-2b26a2b8b88d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.751748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de8c3e7d-2a7b-413b-a172-2b26a2b8b88d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.774458 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-de8c3e7d-2a7b-413b-a172-2b26a2b8b88d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de8c3e7d-2a7b-413b-a172-2b26a2b8b88d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 HTTP/1.1 Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '39095b44-f6d1-4065-a3cb-d6c051168846'} Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.776597 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.781320 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.781320 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.781320 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:54.781320 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:54.781320 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. Aug 09 14:43:54.781320 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.783150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de8c3e7d-2a7b-413b-a172-2b26a2b8b88d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 39095b44-f6d1-4065-a3cb-d6c051168846 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:54.785341 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-de8c3e7d-2a7b-413b-a172-2b26a2b8b88d tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846" status: 404 len: 111 microversion: 2.1 time: 0.059633 Aug 09 14:43:54.789960 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1565/3198] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:54 2022] GET /compute/v2.1/servers/39095b44-f6d1-4065-a3cb-d6c051168846 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:54.799185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ef46e3a-9921-4eac-9b1f-713e36fe3f35 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:54.799734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9ef46e3a-9921-4eac-9b1f-713e36fe3f35 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:54.809817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ef46e3a-9921-4eac-9b1f-713e36fe3f35 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.810328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ef46e3a-9921-4eac-9b1f-713e36fe3f35 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.810799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ef46e3a-9921-4eac-9b1f-713e36fe3f35 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.811593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ef46e3a-9921-4eac-9b1f-713e36fe3f35 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.814371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ef46e3a-9921-4eac-9b1f-713e36fe3f35 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.815052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ef46e3a-9921-4eac-9b1f-713e36fe3f35 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.832682 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-9ef46e3a-9921-4eac-9b1f-713e36fe3f35 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ef46e3a-9921-4eac-9b1f-713e36fe3f35 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 HTTP/1.1 Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '92d98e16-7a40-4281-a9f5-fbe5fe968056'} Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:54.834941 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:43:54.840477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.840477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.840477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.840477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.840477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.840477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.840477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:54.840477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:54.840477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:43:54.840477 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.841250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e2544083-d989-4386-b5d4-c146a9cc9778 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:54.841250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e2544083-d989-4386-b5d4-c146a9cc9778 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:54.842929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ef46e3a-9921-4eac-9b1f-713e36fe3f35 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:54.844235 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ef46e3a-9921-4eac-9b1f-713e36fe3f35 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 404 len: 111 microversion: 2.1 time: 0.052418 Aug 09 14:43:54.845531 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1634/3199] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:54 2022] DELETE /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:54.855877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-54f9c6c0-8705-463c-8249-9bbe13bb3c59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:54.857820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2544083-d989-4386-b5d4-c146a9cc9778 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.858548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2544083-d989-4386-b5d4-c146a9cc9778 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.859733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2544083-d989-4386-b5d4-c146a9cc9778 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.860218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-54f9c6c0-8705-463c-8249-9bbe13bb3c59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 92d98e16-7a40-4281-a9f5-fbe5fe968056] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:54.860573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2544083-d989-4386-b5d4-c146a9cc9778 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.861273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2544083-d989-4386-b5d4-c146a9cc9778 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.861918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2544083-d989-4386-b5d4-c146a9cc9778 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.876115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54f9c6c0-8705-463c-8249-9bbe13bb3c59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.877416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54f9c6c0-8705-463c-8249-9bbe13bb3c59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.878188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54f9c6c0-8705-463c-8249-9bbe13bb3c59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.879277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54f9c6c0-8705-463c-8249-9bbe13bb3c59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.879936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54f9c6c0-8705-463c-8249-9bbe13bb3c59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.880547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54f9c6c0-8705-463c-8249-9bbe13bb3c59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.901938 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-54f9c6c0-8705-463c-8249-9bbe13bb3c59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-54f9c6c0-8705-463c-8249-9bbe13bb3c59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 HTTP/1.1 Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '92d98e16-7a40-4281-a9f5-fbe5fe968056'} Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.904293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:54.910195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:54.910195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:54.910195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:54.910195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:54.910195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. Aug 09 14:43:54.910195 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:54.925890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-54f9c6c0-8705-463c-8249-9bbe13bb3c59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 92d98e16-7a40-4281-a9f5-fbe5fe968056 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:54.930424 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-54f9c6c0-8705-463c-8249-9bbe13bb3c59 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056" status: 404 len: 111 microversion: 2.1 time: 0.078227 Aug 09 14:43:54.931447 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1635/3200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:54 2022] GET /compute/v2.1/servers/92d98e16-7a40-4281-a9f5-fbe5fe968056 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:54.948438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a7a904e-1be8-4e15-939e-59b2aa0d0cab tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:54.949065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a7a904e-1be8-4e15-939e-59b2aa0d0cab tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:54.959929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:54.968259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a7a904e-1be8-4e15-939e-59b2aa0d0cab tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.969440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a7a904e-1be8-4e15-939e-59b2aa0d0cab tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.970043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a7a904e-1be8-4e15-939e-59b2aa0d0cab tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:54.970982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a7a904e-1be8-4e15-939e-59b2aa0d0cab tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:54.972138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a7a904e-1be8-4e15-939e-59b2aa0d0cab tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:54.972788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a7a904e-1be8-4e15-939e-59b2aa0d0cab tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.355028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2a7a904e-1be8-4e15-939e-59b2aa0d0cab tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:55.377500 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a7a904e-1be8-4e15-939e-59b2aa0d0cab tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1308 microversion: 2.1 time: 0.435564 Aug 09 14:43:55.378281 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1636/3201] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:54 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1308 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:55.396087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-065ee177-d84a-4421-ad5a-4cd6656d176a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:55.396681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-065ee177-d84a-4421-ad5a-4cd6656d176a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:55.411496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-065ee177-d84a-4421-ad5a-4cd6656d176a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.418678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-065ee177-d84a-4421-ad5a-4cd6656d176a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.419282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-065ee177-d84a-4421-ad5a-4cd6656d176a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.420546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-065ee177-d84a-4421-ad5a-4cd6656d176a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.421048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-065ee177-d84a-4421-ad5a-4cd6656d176a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.421480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-065ee177-d84a-4421-ad5a-4cd6656d176a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.474146 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-065ee177-d84a-4421-ad5a-4cd6656d176a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-065ee177-d84a-4421-ad5a-4cd6656d176a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 HTTP/1.1 Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'ea1bd74c-40fa-4132-84a9-c44b5a28db13'} Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:55.475774 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-065ee177-d84a-4421-ad5a-4cd6656d176a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-065ee177-d84a-4421-ad5a-4cd6656d176a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 404 len: 111 microversion: 2.1 time: 0.096828 Aug 09 14:43:55.481198 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1637/3202] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:55 2022] DELETE /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:55.498605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5121a187-2cac-4f29-8ce6-517d90bc11a2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:55.499251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5121a187-2cac-4f29-8ce6-517d90bc11a2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: ea1bd74c-40fa-4132-84a9-c44b5a28db13] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:55.507149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5121a187-2cac-4f29-8ce6-517d90bc11a2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.507869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5121a187-2cac-4f29-8ce6-517d90bc11a2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.508481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5121a187-2cac-4f29-8ce6-517d90bc11a2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.509383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5121a187-2cac-4f29-8ce6-517d90bc11a2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.510162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5121a187-2cac-4f29-8ce6-517d90bc11a2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.510730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5121a187-2cac-4f29-8ce6-517d90bc11a2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.528328 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-5121a187-2cac-4f29-8ce6-517d90bc11a2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5121a187-2cac-4f29-8ce6-517d90bc11a2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 HTTP/1.1 Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'ea1bd74c-40fa-4132-84a9-c44b5a28db13'} Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.530166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.535027 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:55.535027 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:55.535027 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:55.535027 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:55.535027 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. Aug 09 14:43:55.535027 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.536937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5121a187-2cac-4f29-8ce6-517d90bc11a2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance ea1bd74c-40fa-4132-84a9-c44b5a28db13 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:55.538344 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5121a187-2cac-4f29-8ce6-517d90bc11a2 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13" status: 404 len: 111 microversion: 2.1 time: 0.052015 Aug 09 14:43:55.539460 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1638/3203] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:55 2022] GET /compute/v2.1/servers/ea1bd74c-40fa-4132-84a9-c44b5a28db13 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:43:55.547548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:55.548213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:55.555754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.556355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.556989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.558184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.558739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.559436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.582538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e2544083-d989-4386-b5d4-c146a9cc9778 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:55.595964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.596847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.597207 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e2544083-d989-4386-b5d4-c146a9cc9778 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1323 microversion: 2.1 time: 0.757761 Aug 09 14:43:55.598191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.598399 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1566/3204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:54 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1323 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:55.599104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lazy-loading 'fault' on Instance uuid 474888b4-0058-40eb-9a4d-f723520472a0 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:43:55.603528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cda52f28-57c8-46a2-a471-c4c2947bc05a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:55.604025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cda52f28-57c8-46a2-a471-c4c2947bc05a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:55.621093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cda52f28-57c8-46a2-a471-c4c2947bc05a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.622418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cda52f28-57c8-46a2-a471-c4c2947bc05a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.622912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cda52f28-57c8-46a2-a471-c4c2947bc05a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.623674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cda52f28-57c8-46a2-a471-c4c2947bc05a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.624290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cda52f28-57c8-46a2-a471-c4c2947bc05a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.624806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cda52f28-57c8-46a2-a471-c4c2947bc05a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.644621 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-cda52f28-57c8-46a2-a471-c4c2947bc05a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cda52f28-57c8-46a2-a471-c4c2947bc05a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 HTTP/1.1 Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '6e2b61a3-4691-42de-be5c-4e13b1665984'} Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:55.646429 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cda52f28-57c8-46a2-a471-c4c2947bc05a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cda52f28-57c8-46a2-a471-c4c2947bc05a tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 404 len: 111 microversion: 2.1 time: 0.048675 Aug 09 14:43:55.650391 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1567/3205] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:55 2022] DELETE /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:55.658720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe10737e-bcef-49b2-998f-2350bd37dc3e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:55.659456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fe10737e-bcef-49b2-998f-2350bd37dc3e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 6e2b61a3-4691-42de-be5c-4e13b1665984] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:55.671587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe10737e-bcef-49b2-998f-2350bd37dc3e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.672104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe10737e-bcef-49b2-998f-2350bd37dc3e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.672558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe10737e-bcef-49b2-998f-2350bd37dc3e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.673296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe10737e-bcef-49b2-998f-2350bd37dc3e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.673756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe10737e-bcef-49b2-998f-2350bd37dc3e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.674263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe10737e-bcef-49b2-998f-2350bd37dc3e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.692743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e05667f82c43484bb250236739c08959', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e0b1ade12f4484b83dd4bce24fd7859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:55.698575 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-fe10737e-bcef-49b2-998f-2350bd37dc3e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe10737e-bcef-49b2-998f-2350bd37dc3e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 HTTP/1.1 Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '6e2b61a3-4691-42de-be5c-4e13b1665984'} Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.700701 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.704761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:55.704761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:55.704761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:55.704761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:55.704761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. Aug 09 14:43:55.704761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.704761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe10737e-bcef-49b2-998f-2350bd37dc3e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 6e2b61a3-4691-42de-be5c-4e13b1665984 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:55.704761 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fe10737e-bcef-49b2-998f-2350bd37dc3e tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984" status: 404 len: 111 microversion: 2.1 time: 0.049003 Aug 09 14:43:55.704761 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1568/3206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:55 2022] GET /compute/v2.1/servers/6e2b61a3-4691-42de-be5c-4e13b1665984 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:43:55.711843 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6df7ed4e-793f-4c9f-b746-861644ad1fb8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 200 len: 1315 microversion: 2.1 time: 0.169705 Aug 09 14:43:55.712866 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1639/3207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:55 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:55.713466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07b88146-2fa1-4dfa-b298-f9e4b2cd1e07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:55.714139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07b88146-2fa1-4dfa-b298-f9e4b2cd1e07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 14b01446-ea34-46ad-970b-363da106d2e6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:55.721850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b88146-2fa1-4dfa-b298-f9e4b2cd1e07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.722830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b88146-2fa1-4dfa-b298-f9e4b2cd1e07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.722959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b88146-2fa1-4dfa-b298-f9e4b2cd1e07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.723786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b88146-2fa1-4dfa-b298-f9e4b2cd1e07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.724259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b88146-2fa1-4dfa-b298-f9e4b2cd1e07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.725074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b88146-2fa1-4dfa-b298-f9e4b2cd1e07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.741454 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-07b88146-2fa1-4dfa-b298-f9e4b2cd1e07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07b88146-2fa1-4dfa-b298-f9e4b2cd1e07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6 HTTP/1.1 Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '14b01446-ea34-46ad-970b-363da106d2e6'} Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:55.743243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07b88146-2fa1-4dfa-b298-f9e4b2cd1e07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07b88146-2fa1-4dfa-b298-f9e4b2cd1e07 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6" status: 404 len: 111 microversion: 2.1 time: 0.037540 Aug 09 14:43:55.749286 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1569/3208] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:55 2022] DELETE /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:43:55.757041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cd855f6b-b48e-4263-924a-9de39067ceca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:55.762492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cd855f6b-b48e-4263-924a-9de39067ceca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 14b01446-ea34-46ad-970b-363da106d2e6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:55.776856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd855f6b-b48e-4263-924a-9de39067ceca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.777618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd855f6b-b48e-4263-924a-9de39067ceca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.778195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd855f6b-b48e-4263-924a-9de39067ceca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.778956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd855f6b-b48e-4263-924a-9de39067ceca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.779657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd855f6b-b48e-4263-924a-9de39067ceca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.780309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd855f6b-b48e-4263-924a-9de39067ceca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.802022 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-cd855f6b-b48e-4263-924a-9de39067ceca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cd855f6b-b48e-4263-924a-9de39067ceca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6 HTTP/1.1 Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '14b01446-ea34-46ad-970b-363da106d2e6'} Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.804843 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:55.811001 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:55.811001 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:55.811001 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:55.811001 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:55.811001 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. Aug 09 14:43:55.811001 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:43:55.811001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cd855f6b-b48e-4263-924a-9de39067ceca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 14b01446-ea34-46ad-970b-363da106d2e6 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:55.811001 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cd855f6b-b48e-4263-924a-9de39067ceca tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6" status: 404 len: 111 microversion: 2.1 time: 0.053708 Aug 09 14:43:55.811001 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1640/3209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:55 2022] GET /compute/v2.1/servers/14b01446-ea34-46ad-970b-363da106d2e6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:55.820462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-090341c9-1a5e-4b75-9e75-8242d24efcec tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:55.821029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-090341c9-1a5e-4b75-9e75-8242d24efcec tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:55.831196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-090341c9-1a5e-4b75-9e75-8242d24efcec tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.831786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-090341c9-1a5e-4b75-9e75-8242d24efcec tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.832229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-090341c9-1a5e-4b75-9e75-8242d24efcec tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.833013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-090341c9-1a5e-4b75-9e75-8242d24efcec tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:55.833470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-090341c9-1a5e-4b75-9e75-8242d24efcec tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:55.833902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-090341c9-1a5e-4b75-9e75-8242d24efcec tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:55.870845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-090341c9-1a5e-4b75-9e75-8242d24efcec tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:43:56.050507 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-090341c9-1a5e-4b75-9e75-8242d24efcec tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 204 len: 0 microversion: 2.1 time: 0.235080 Aug 09 14:43:56.054434 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1570/3210] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:55 2022] DELETE /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:43:56.060620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e6b36a6-5d05-4732-a774-8ee1e7c468de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:56.061277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9e6b36a6-5d05-4732-a774-8ee1e7c468de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:56.069427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6b36a6-5d05-4732-a774-8ee1e7c468de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:56.070566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6b36a6-5d05-4732-a774-8ee1e7c468de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:56.071524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6b36a6-5d05-4732-a774-8ee1e7c468de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:56.072737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6b36a6-5d05-4732-a774-8ee1e7c468de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:56.073459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6b36a6-5d05-4732-a774-8ee1e7c468de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:56.074057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6b36a6-5d05-4732-a774-8ee1e7c468de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:56.399035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-10f2ab66-17a0-4f81-a657-4a5278cc696b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:56.399975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-10f2ab66-17a0-4f81-a657-4a5278cc696b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:56.413062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10f2ab66-17a0-4f81-a657-4a5278cc696b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:56.413876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10f2ab66-17a0-4f81-a657-4a5278cc696b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:56.415895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10f2ab66-17a0-4f81-a657-4a5278cc696b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:56.416862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10f2ab66-17a0-4f81-a657-4a5278cc696b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:56.418777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10f2ab66-17a0-4f81-a657-4a5278cc696b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:56.422327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10f2ab66-17a0-4f81-a657-4a5278cc696b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:56.452821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9e6b36a6-5d05-4732-a774-8ee1e7c468de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:56.470321 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e6b36a6-5d05-4732-a774-8ee1e7c468de tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1477 microversion: 2.1 time: 0.412993 Aug 09 14:43:56.475272 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1641/3211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:56 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1477 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:56.623025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ee34e14-9138-43f4-9d65-fc2683710393 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:56.623601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ee34e14-9138-43f4-9d65-fc2683710393 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:56.630862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ee34e14-9138-43f4-9d65-fc2683710393 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:56.631385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ee34e14-9138-43f4-9d65-fc2683710393 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:56.640156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ee34e14-9138-43f4-9d65-fc2683710393 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:56.641834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ee34e14-9138-43f4-9d65-fc2683710393 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:56.642471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ee34e14-9138-43f4-9d65-fc2683710393 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:56.643252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ee34e14-9138-43f4-9d65-fc2683710393 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:56.814329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-10f2ab66-17a0-4f81-a657-4a5278cc696b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:56.824674 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-10f2ab66-17a0-4f81-a657-4a5278cc696b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1308 microversion: 2.1 time: 0.429980 Aug 09 14:43:56.828213 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1571/3212] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:56 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1308 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:56.842953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5d39364-bc82-489c-bc0e-c79b0bd67c68 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:56.843667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c5d39364-bc82-489c-bc0e-c79b0bd67c68 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 474888b4-0058-40eb-9a4d-f723520472a0] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:56.853464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5d39364-bc82-489c-bc0e-c79b0bd67c68 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:56.853979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5d39364-bc82-489c-bc0e-c79b0bd67c68 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:56.854426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5d39364-bc82-489c-bc0e-c79b0bd67c68 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:56.863031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5d39364-bc82-489c-bc0e-c79b0bd67c68 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:56.865352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5d39364-bc82-489c-bc0e-c79b0bd67c68 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:56.865921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5d39364-bc82-489c-bc0e-c79b0bd67c68 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:56.893763 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-c5d39364-bc82-489c-bc0e-c79b0bd67c68 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] HTTP exception thrown: Instance 474888b4-0058-40eb-9a4d-f723520472a0 could not be found. Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5d39364-bc82-489c-bc0e-c79b0bd67c68 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 HTTP/1.1 Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 474888b4-0058-40eb-9a4d-f723520472a0 could not be found. Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '474888b4-0058-40eb-9a4d-f723520472a0'} Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 474888b4-0058-40eb-9a4d-f723520472a0 could not be found. Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 474888b4-0058-40eb-9a4d-f723520472a0 could not be found. Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:56.897422 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:56.902822 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:56.902822 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:56.902822 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:56.902822 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:56.902822 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:56.902822 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:56.902822 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 474888b4-0058-40eb-9a4d-f723520472a0 could not be found. Aug 09 14:43:56.902822 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:56.902822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5d39364-bc82-489c-bc0e-c79b0bd67c68 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 404 to user: Instance 474888b4-0058-40eb-9a4d-f723520472a0 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:56.902822 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c5d39364-bc82-489c-bc0e-c79b0bd67c68 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0" status: 404 len: 111 microversion: 2.1 time: 0.069349 Aug 09 14:43:56.902822 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1572/3213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:56 2022] GET /compute/v2.1/servers/474888b4-0058-40eb-9a4d-f723520472a0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:56.912811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c3fa0df-2b41-4680-8c57-5b0e60472d26 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '.version_select at 0x7f41e7592700>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:56.920518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:56.944463 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-8c3fa0df-2b41-4680-8c57-5b0e60472d26 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] HTTP exception thrown: Image not found. Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c3fa0df-2b41-4680-8c57-5b0e60472d26 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/images/8115f439-e836-4dd1-acc7-b3d5bcd0db6d HTTP/1.1 Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '8115f439-e836-4dd1-acc7-b3d5bcd0db6d'} Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8115f439-e836-4dd1-acc7-b3d5bcd0db6d to delete Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8115f439-e836-4dd1-acc7-b3d5bcd0db6d could not be found. Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:56.947236 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:56.952256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c3fa0df-2b41-4680-8c57-5b0e60472d26 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:56.954522 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c3fa0df-2b41-4680-8c57-5b0e60472d26 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "DELETE /compute/v2.1/images/8115f439-e836-4dd1-acc7-b3d5bcd0db6d" status: 404 len: 62 microversion: 2.1 time: 0.046503 Aug 09 14:43:56.959305 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1573/3214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:56 2022] DELETE /compute/v2.1/images/8115f439-e836-4dd1-acc7-b3d5bcd0db6d => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:43:56.965877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7a587499-5363-4432-9ff4-8f7897be756c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:56.967020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7a587499-5363-4432-9ff4-8f7897be756c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:56.975631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a587499-5363-4432-9ff4-8f7897be756c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:56.976229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a587499-5363-4432-9ff4-8f7897be756c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:56.977445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a587499-5363-4432-9ff4-8f7897be756c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:56.978373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a587499-5363-4432-9ff4-8f7897be756c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:56.978994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a587499-5363-4432-9ff4-8f7897be756c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:56.980014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a587499-5363-4432-9ff4-8f7897be756c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:56.996809 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-7a587499-5363-4432-9ff4-8f7897be756c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] HTTP exception thrown: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7a587499-5363-4432-9ff4-8f7897be756c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc HTTP/1.1 Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '44ac156d-8758-4204-95db-6b33a7655dcc'} Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:57.001690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:57.005703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:57.005703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:57.005703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:57.005703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:57.005703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:57.005703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:57.005703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:57.005703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:57.005703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:57.005703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:57.005703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:57.011384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7a587499-5363-4432-9ff4-8f7897be756c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 404 to user: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:57.012659 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7a587499-5363-4432-9ff4-8f7897be756c tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "DELETE /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 404 len: 111 microversion: 2.1 time: 0.052076 Aug 09 14:43:57.018961 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1574/3215] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:43:56 2022] DELETE /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:57.029528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f951f606-df6c-4693-8574-7addb3eee3aa tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:57.043613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f951f606-df6c-4693-8574-7addb3eee3aa tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 44ac156d-8758-4204-95db-6b33a7655dcc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:57.057429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f951f606-df6c-4693-8574-7addb3eee3aa tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:57.058433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f951f606-df6c-4693-8574-7addb3eee3aa tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:57.059221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f951f606-df6c-4693-8574-7addb3eee3aa tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:57.060225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f951f606-df6c-4693-8574-7addb3eee3aa tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:57.060918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f951f606-df6c-4693-8574-7addb3eee3aa tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:57.062069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f951f606-df6c-4693-8574-7addb3eee3aa tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:57.092630 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-f951f606-df6c-4693-8574-7addb3eee3aa tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] HTTP exception thrown: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f951f606-df6c-4693-8574-7addb3eee3aa tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc HTTP/1.1 Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '44ac156d-8758-4204-95db-6b33a7655dcc'} Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:57.095772 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:43:57.102333 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:57.102333 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:43:57.102333 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:43:57.102333 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:43:57.102333 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:43:57.102333 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:43:57.102333 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. Aug 09 14:43:57.102333 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:43:57.106007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f951f606-df6c-4693-8574-7addb3eee3aa tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 404 to user: Instance 44ac156d-8758-4204-95db-6b33a7655dcc could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:43:57.107966 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f951f606-df6c-4693-8574-7addb3eee3aa tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc" status: 404 len: 111 microversion: 2.1 time: 0.084770 Aug 09 14:43:57.114475 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1575/3216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:57 2022] GET /compute/v2.1/servers/44ac156d-8758-4204-95db-6b33a7655dcc => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:43:57.122907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d7f775e8-9eb3-40ad-926a-eeadbd1862ea req-6aaf0a9f-2a45-4e29-a6a4-bfa824028011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65b708eb-9c45-4e12-8917-50a349e7f0f4", "tag": "a835f71e-30b9-4171-aeed-864546a009c0"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:57.136766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d7f775e8-9eb3-40ad-926a-eeadbd1862ea req-6aaf0a9f-2a45-4e29-a6a4-bfa824028011 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:57.137634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d7f775e8-9eb3-40ad-926a-eeadbd1862ea req-6aaf0a9f-2a45-4e29-a6a4-bfa824028011 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:57.138362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d7f775e8-9eb3-40ad-926a-eeadbd1862ea req-6aaf0a9f-2a45-4e29-a6a4-bfa824028011 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:57.153963 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d7f775e8-9eb3-40ad-926a-eeadbd1862ea req-6aaf0a9f-2a45-4e29-a6a4-bfa824028011 service nova] Creating event network-changed:a835f71e-30b9-4171-aeed-864546a009c0 for instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 on n-h2-844626-8 Aug 09 14:43:57.162200 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d7f775e8-9eb3-40ad-926a-eeadbd1862ea req-6aaf0a9f-2a45-4e29-a6a4-bfa824028011 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044877 Aug 09 14:43:57.163738 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1576/3217] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:57.170830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88a5371f-2ba9-4735-ab00-28483e1bd0de tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '.version_select at 0x7f41dd347b80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:57.204814 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88a5371f-2ba9-4735-ab00-28483e1bd0de tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-98728551" status: 202 len: 0 microversion: 2.1 time: 0.038734 Aug 09 14:43:57.209293 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1577/3218] 10.222.0.50 () {58 vars in 1215 bytes} [Tue Aug 9 14:43:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-98728551 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:43:57.498228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37e0c60a-3fa1-4937-b85d-ce478acf60a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:57.499173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37e0c60a-3fa1-4937-b85d-ce478acf60a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:57.527432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37e0c60a-3fa1-4937-b85d-ce478acf60a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:57.528286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37e0c60a-3fa1-4937-b85d-ce478acf60a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:57.529047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37e0c60a-3fa1-4937-b85d-ce478acf60a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:57.530636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37e0c60a-3fa1-4937-b85d-ce478acf60a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:57.531021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37e0c60a-3fa1-4937-b85d-ce478acf60a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:57.531732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37e0c60a-3fa1-4937-b85d-ce478acf60a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:57.718913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ee34e14-9138-43f4-9d65-fc2683710393 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:57.736164 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ee34e14-9138-43f4-9d65-fc2683710393 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1323 microversion: 2.1 time: 1.122000 Aug 09 14:43:57.736839 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1642/3219] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:56 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1323 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:43:57.851727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ce7e3564-009b-4b39-81de-88f7edd5d513 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:57.853390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ce7e3564-009b-4b39-81de-88f7edd5d513 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:57.870412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce7e3564-009b-4b39-81de-88f7edd5d513 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:57.871365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce7e3564-009b-4b39-81de-88f7edd5d513 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:57.872150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce7e3564-009b-4b39-81de-88f7edd5d513 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:57.873087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce7e3564-009b-4b39-81de-88f7edd5d513 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:57.874240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce7e3564-009b-4b39-81de-88f7edd5d513 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:57.875425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce7e3564-009b-4b39-81de-88f7edd5d513 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:58.428668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-37e0c60a-3fa1-4937-b85d-ce478acf60a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:58.438884 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37e0c60a-3fa1-4937-b85d-ce478acf60a9 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1477 microversion: 2.1 time: 0.946228 Aug 09 14:43:58.442330 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1578/3220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:57 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1477 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:43:58.545720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=16 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:58.709382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce7e3564-009b-4b39-81de-88f7edd5d513 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:58.717777 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ce7e3564-009b-4b39-81de-88f7edd5d513 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1308 microversion: 2.1 time: 0.873704 Aug 09 14:43:58.723142 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1643/3221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:57 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1308 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:58.759762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bcc62e7-9bf5-487f-9c0c-abb61cd3953a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:58.761386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8bcc62e7-9bf5-487f-9c0c-abb61cd3953a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:58.769485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=24 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:58.773231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bcc62e7-9bf5-487f-9c0c-abb61cd3953a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:58.773848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bcc62e7-9bf5-487f-9c0c-abb61cd3953a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:58.774379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bcc62e7-9bf5-487f-9c0c-abb61cd3953a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:58.775222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bcc62e7-9bf5-487f-9c0c-abb61cd3953a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:58.775974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bcc62e7-9bf5-487f-9c0c-abb61cd3953a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:58.776492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bcc62e7-9bf5-487f-9c0c-abb61cd3953a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:58.830240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:43:59.127675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-18f78b81-6960-4623-994f-6c2089835a65 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:59.128291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-18f78b81-6960-4623-994f-6c2089835a65 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:43:59.142689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18f78b81-6960-4623-994f-6c2089835a65 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:59.143248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18f78b81-6960-4623-994f-6c2089835a65 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:59.143640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18f78b81-6960-4623-994f-6c2089835a65 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:59.144530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18f78b81-6960-4623-994f-6c2089835a65 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:59.145150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18f78b81-6960-4623-994f-6c2089835a65 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:59.145733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18f78b81-6960-4623-994f-6c2089835a65 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:59.819731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8bcc62e7-9bf5-487f-9c0c-abb61cd3953a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:43:59.860443 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8bcc62e7-9bf5-487f-9c0c-abb61cd3953a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1323 microversion: 2.1 time: 1.104095 Aug 09 14:43:59.862301 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1579/3222] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:58 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1323 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:43:59.874589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0e31797c-b117-46c5-9e96-77033fcd72af req-c89809c8-c9d5-4da9-9434-3e2cf086fb37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a2a79d-0cb7-4f9f-9b23-13b4b566c043", "tag": "75d75b68-e994-4644-9c35-1692aa641cb5"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:43:59.897577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0e31797c-b117-46c5-9e96-77033fcd72af req-c89809c8-c9d5-4da9-9434-3e2cf086fb37 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:43:59.898181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0e31797c-b117-46c5-9e96-77033fcd72af req-c89809c8-c9d5-4da9-9434-3e2cf086fb37 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:43:59.898983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0e31797c-b117-46c5-9e96-77033fcd72af req-c89809c8-c9d5-4da9-9434-3e2cf086fb37 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:43:59.959395 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0e31797c-b117-46c5-9e96-77033fcd72af req-c89809c8-c9d5-4da9-9434-3e2cf086fb37 service nova] Creating event network-changed:75d75b68-e994-4644-9c35-1692aa641cb5 for instance e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 on n-h2-844626-8 Aug 09 14:43:59.968870 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0e31797c-b117-46c5-9e96-77033fcd72af req-c89809c8-c9d5-4da9-9434-3e2cf086fb37 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104746 Aug 09 14:43:59.970097 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1580/3223] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:43:59.978973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef50091c-3b52-42cf-b591-01369dabd428 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:43:59.979989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef50091c-3b52-42cf-b591-01369dabd428 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:00.003525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef50091c-3b52-42cf-b591-01369dabd428 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:00.004341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef50091c-3b52-42cf-b591-01369dabd428 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:00.005045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef50091c-3b52-42cf-b591-01369dabd428 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:00.006325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef50091c-3b52-42cf-b591-01369dabd428 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:00.007359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef50091c-3b52-42cf-b591-01369dabd428 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:00.008175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef50091c-3b52-42cf-b591-01369dabd428 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:00.156901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-18f78b81-6960-4623-994f-6c2089835a65 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:00.170883 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-18f78b81-6960-4623-994f-6c2089835a65 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1577 microversion: 2.1 time: 1.047049 Aug 09 14:44:00.182216 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1644/3224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:59 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1577 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:00.198105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef50091c-3b52-42cf-b591-01369dabd428 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03bdf5ec21854ec8b6561a121ce1f1ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17959424b3fd4f8e8eae1df6453a1f60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:00.215591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c5aa5bf-db6b-48d2-8101-67e235ed6cc2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:00.216236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c5aa5bf-db6b-48d2-8101-67e235ed6cc2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:00.218888 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef50091c-3b52-42cf-b591-01369dabd428 tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 200 len: 1435 microversion: 2.1 time: 0.246366 Aug 09 14:44:00.220175 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1581/3225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:43:59 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 1435 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:00.229007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c5aa5bf-db6b-48d2-8101-67e235ed6cc2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:00.230715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c5aa5bf-db6b-48d2-8101-67e235ed6cc2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:00.231420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c5aa5bf-db6b-48d2-8101-67e235ed6cc2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:00.232496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c5aa5bf-db6b-48d2-8101-67e235ed6cc2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:00.233195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c5aa5bf-db6b-48d2-8101-67e235ed6cc2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:00.234314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c5aa5bf-db6b-48d2-8101-67e235ed6cc2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:00.288781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ac500163-6cdd-40f0-939f-3de4eddd3e2f req-59d678ce-4a9c-4cb8-ab5d-e43546f50f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d64f29-b786-4bf3-88ba-02cf6e5f932d", "name": "network-vif-deleted", "tag": "9e00268d-9ded-4c06-baf8-124ec50e8424"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:00.310235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ac500163-6cdd-40f0-939f-3de4eddd3e2f req-59d678ce-4a9c-4cb8-ab5d-e43546f50f8f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:00.311496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ac500163-6cdd-40f0-939f-3de4eddd3e2f req-59d678ce-4a9c-4cb8-ab5d-e43546f50f8f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:00.312367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ac500163-6cdd-40f0-939f-3de4eddd3e2f req-59d678ce-4a9c-4cb8-ab5d-e43546f50f8f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:00.345718 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ac500163-6cdd-40f0-939f-3de4eddd3e2f req-59d678ce-4a9c-4cb8-ab5d-e43546f50f8f service nova] Creating event network-vif-deleted:9e00268d-9ded-4c06-baf8-124ec50e8424 for instance 71d64f29-b786-4bf3-88ba-02cf6e5f932d on n-h2-844626-8 Aug 09 14:44:00.355593 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ac500163-6cdd-40f0-939f-3de4eddd3e2f req-59d678ce-4a9c-4cb8-ab5d-e43546f50f8f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070829 Aug 09 14:44:00.356458 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1582/3226] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:44:00.678760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c5aa5bf-db6b-48d2-8101-67e235ed6cc2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:00.689242 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c5aa5bf-db6b-48d2-8101-67e235ed6cc2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1308 microversion: 2.1 time: 0.505035 Aug 09 14:44:00.689850 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1645/3227] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:00 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1308 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:00.886791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e4d244ac-4820-48c0-8ccc-ecfb3f7f2caa tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:00.887565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e4d244ac-4820-48c0-8ccc-ecfb3f7f2caa tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:00.898085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4d244ac-4820-48c0-8ccc-ecfb3f7f2caa tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:00.900723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4d244ac-4820-48c0-8ccc-ecfb3f7f2caa tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:00.901179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4d244ac-4820-48c0-8ccc-ecfb3f7f2caa tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:00.901928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4d244ac-4820-48c0-8ccc-ecfb3f7f2caa tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:00.902398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4d244ac-4820-48c0-8ccc-ecfb3f7f2caa tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:00.902822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4d244ac-4820-48c0-8ccc-ecfb3f7f2caa tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:01.244630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4349596c-9e94-4bbc-ab00-1e01229ed99b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:01.245315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4349596c-9e94-4bbc-ab00-1e01229ed99b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] [instance: 71d64f29-b786-4bf3-88ba-02cf6e5f932d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:01.262734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4349596c-9e94-4bbc-ab00-1e01229ed99b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:01.263125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4349596c-9e94-4bbc-ab00-1e01229ed99b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:01.263541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4349596c-9e94-4bbc-ab00-1e01229ed99b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:01.264240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4349596c-9e94-4bbc-ab00-1e01229ed99b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:01.264678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4349596c-9e94-4bbc-ab00-1e01229ed99b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:01.265268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4349596c-9e94-4bbc-ab00-1e01229ed99b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:01.292777 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-4349596c-9e94-4bbc-ab00-1e01229ed99b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] HTTP exception thrown: Instance 71d64f29-b786-4bf3-88ba-02cf6e5f932d could not be found. Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4349596c-9e94-4bbc-ab00-1e01229ed99b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Request method failure captured: Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d HTTP/1.1 Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nGYwzwyxWNxS_MVO7W5A2NxC89k25EFuEObnHeS14yrUPpgcvGi4NiAv1JoBcUksdfwv4zKZ9N_JmV1uxvmloIJaTdazTRBMpUUXzboW8457AoY4ImEsYzNwNg1I0twAzFOLIqU0oFuaMtYPQchVlmv6gY1ODuYMnPhcXXBlvcfeWw Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestJSON-588745250 Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_17959424b3fd4f8e8eae1df6453a1f60", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/17959424b3fd4f8e8eae1df6453a1f60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestJSON-588745250 Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 17959424b3fd4f8e8eae1df6453a1f60 Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestJSON-588745250 Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestJSON-588745250-project Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 03bdf5ec21854ec8b6561a121ce1f1ef Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestJSON-588745250-project Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 71d64f29-b786-4bf3-88ba-02cf6e5f932d could not be found. Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '71d64f29-b786-4bf3-88ba-02cf6e5f932d'} Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71d64f29-b786-4bf3-88ba-02cf6e5f932d could not be found. Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71d64f29-b786-4bf3-88ba-02cf6e5f932d could not be found. Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:01.294385 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:01.303649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:01.303649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:01.303649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:01.303649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:01.303649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71d64f29-b786-4bf3-88ba-02cf6e5f932d could not be found. Aug 09 14:44:01.303649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:01.303649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4349596c-9e94-4bbc-ab00-1e01229ed99b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] Returning 404 to user: Instance 71d64f29-b786-4bf3-88ba-02cf6e5f932d could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:01.303649 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4349596c-9e94-4bbc-ab00-1e01229ed99b tempest-ServersTestJSON-588745250 tempest-ServersTestJSON-588745250-project] 10.222.0.50 "GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d" status: 404 len: 111 microversion: 2.1 time: 0.055392 Aug 09 14:44:01.303649 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1646/3228] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:01 2022] GET /compute/v2.1/servers/71d64f29-b786-4bf3-88ba-02cf6e5f932d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:44:01.712409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ead5eede-4411-411d-b6c8-909380567f2f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:01.713024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ead5eede-4411-411d-b6c8-909380567f2f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:01.719828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ead5eede-4411-411d-b6c8-909380567f2f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:01.720494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ead5eede-4411-411d-b6c8-909380567f2f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:01.720765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ead5eede-4411-411d-b6c8-909380567f2f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:01.721464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ead5eede-4411-411d-b6c8-909380567f2f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:01.721908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ead5eede-4411-411d-b6c8-909380567f2f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:01.722388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ead5eede-4411-411d-b6c8-909380567f2f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:02.111052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e4d244ac-4820-48c0-8ccc-ecfb3f7f2caa tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:02.121389 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e4d244ac-4820-48c0-8ccc-ecfb3f7f2caa tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1323 microversion: 2.1 time: 1.239657 Aug 09 14:44:02.136370 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1583/3229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:00 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1323 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:02.142319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0c278f70-208d-4de0-8d85-33d1523519ce req-12a2e57a-9999-4b91-a08a-b337ff9a37c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c707b9-a4e0-4d5a-98f4-a8c8f9d82920", "name": "network-vif-plugged", "status": "completed", "tag": "8e65bee5-f93d-4d11-9c50-0909cf992d51"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:02.154560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0c278f70-208d-4de0-8d85-33d1523519ce req-12a2e57a-9999-4b91-a08a-b337ff9a37c3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:02.155381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0c278f70-208d-4de0-8d85-33d1523519ce req-12a2e57a-9999-4b91-a08a-b337ff9a37c3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:02.156224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0c278f70-208d-4de0-8d85-33d1523519ce req-12a2e57a-9999-4b91-a08a-b337ff9a37c3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:02.171691 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0c278f70-208d-4de0-8d85-33d1523519ce req-12a2e57a-9999-4b91-a08a-b337ff9a37c3 service nova] Creating event network-vif-plugged:8e65bee5-f93d-4d11-9c50-0909cf992d51 for instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 on n-h1-844626-8 Aug 09 14:44:02.178173 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0c278f70-208d-4de0-8d85-33d1523519ce req-12a2e57a-9999-4b91-a08a-b337ff9a37c3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040000 Aug 09 14:44:02.179423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1584/3230] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:02.185260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-352e464d-0ef4-4629-96e0-91ae182868a4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '.version_select at 0x7f41dd27f0d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:02.215718 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-352e464d-0ef4-4629-96e0-91ae182868a4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] HTTP exception thrown: Image not found. Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-352e464d-0ef4-4629-96e0-91ae182868a4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/images/f1debcf7-a8ce-435d-8ff1-23d0c8dddf6e HTTP/1.1 Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'f1debcf7-a8ce-435d-8ff1-23d0c8dddf6e'} Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f1debcf7-a8ce-435d-8ff1-23d0c8dddf6e to delete Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f1debcf7-a8ce-435d-8ff1-23d0c8dddf6e could not be found. Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:02.218312 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:44:02.223409 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.226344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-352e464d-0ef4-4629-96e0-91ae182868a4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:02.227903 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-352e464d-0ef4-4629-96e0-91ae182868a4 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "DELETE /compute/v2.1/images/f1debcf7-a8ce-435d-8ff1-23d0c8dddf6e" status: 404 len: 62 microversion: 2.1 time: 0.046870 Aug 09 14:44:02.229162 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1585/3231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:02 2022] DELETE /compute/v2.1/images/f1debcf7-a8ce-435d-8ff1-23d0c8dddf6e => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:44:02.240129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2424d986-7e77-43bc-84e1-0267cd0d3d67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:02.242044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2424d986-7e77-43bc-84e1-0267cd0d3d67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:02.257903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2424d986-7e77-43bc-84e1-0267cd0d3d67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:02.259326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2424d986-7e77-43bc-84e1-0267cd0d3d67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:02.260178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2424d986-7e77-43bc-84e1-0267cd0d3d67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:02.261294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2424d986-7e77-43bc-84e1-0267cd0d3d67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:02.264145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2424d986-7e77-43bc-84e1-0267cd0d3d67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:02.269389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2424d986-7e77-43bc-84e1-0267cd0d3d67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:02.290334 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-2424d986-7e77-43bc-84e1-0267cd0d3d67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] HTTP exception thrown: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2424d986-7e77-43bc-84e1-0267cd0d3d67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 HTTP/1.1 Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '12bc6eac-f858-4da3-879e-9d234ce4e726'} Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:44:02.292194 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2424d986-7e77-43bc-84e1-0267cd0d3d67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 404 to user: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:02.296759 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2424d986-7e77-43bc-84e1-0267cd0d3d67 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "DELETE /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 404 len: 111 microversion: 2.1 time: 0.060201 Aug 09 14:44:02.298047 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1586/3232] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:44:02 2022] DELETE /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:44:02.304295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-98a9cebe-05c4-4a87-a676-6281fb2919e8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:02.305281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-98a9cebe-05c4-4a87-a676-6281fb2919e8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] [instance: 12bc6eac-f858-4da3-879e-9d234ce4e726] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:02.313329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a9cebe-05c4-4a87-a676-6281fb2919e8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:02.314278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a9cebe-05c4-4a87-a676-6281fb2919e8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:02.314939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a9cebe-05c4-4a87-a676-6281fb2919e8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:02.316204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a9cebe-05c4-4a87-a676-6281fb2919e8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:02.317272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a9cebe-05c4-4a87-a676-6281fb2919e8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:02.317940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a9cebe-05c4-4a87-a676-6281fb2919e8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:02.339220 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-98a9cebe-05c4-4a87-a676-6281fb2919e8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] HTTP exception thrown: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-98a9cebe-05c4-4a87-a676-6281fb2919e8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Request method failure captured: Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 HTTP/1.1 Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nI2nR3REYlgB31oVRzNR8WWiLbMoLZrEt3TxcuzuGFgCdFT7xfmriPHI_Y3-P-UdtYwwG60Q9PGC-fcj5WZPif-FRIXfq24P7wHisvJGF8w8CeZQcZpppMaugqLgm0GOmHiVECBCS5I2dgW0IO3Kw2lf1xoKiPgdeiR2cPId9455CU Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8e0b1ade12f4484b83dd4bce24fd7859", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8e0b1ade12f4484b83dd4bce24fd7859"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 8e0b1ade12f4484b83dd4bce24fd7859 Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974 Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e05667f82c43484bb250236739c08959 Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2001085974-project Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '12bc6eac-f858-4da3-879e-9d234ce4e726'} Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.341392 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:02.346466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.346466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:02.346466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:02.346466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:02.346466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:02.346466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:02.346466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. Aug 09 14:44:02.346466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:02.348341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-98a9cebe-05c4-4a87-a676-6281fb2919e8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] Returning 404 to user: Instance 12bc6eac-f858-4da3-879e-9d234ce4e726 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:02.349547 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-98a9cebe-05c4-4a87-a676-6281fb2919e8 tempest-ImagesOneServerNegativeTestJSON-2001085974 tempest-ImagesOneServerNegativeTestJSON-2001085974-project] 10.222.0.50 "GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726" status: 404 len: 111 microversion: 2.1 time: 0.050205 Aug 09 14:44:02.350359 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1587/3233] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:02 2022] GET /compute/v2.1/servers/12bc6eac-f858-4da3-879e-9d234ce4e726 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:44:02.360617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ead5eede-4411-411d-b6c8-909380567f2f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:02.375747 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ead5eede-4411-411d-b6c8-909380567f2f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1308 microversion: 2.1 time: 0.666223 Aug 09 14:44:02.382111 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1647/3234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:01 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1308 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:03.142876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06461e79-b175-46a2-9071-3fb96818fdfd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:03.143544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-06461e79-b175-46a2-9071-3fb96818fdfd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:03.152492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06461e79-b175-46a2-9071-3fb96818fdfd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:03.153652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06461e79-b175-46a2-9071-3fb96818fdfd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:03.154369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06461e79-b175-46a2-9071-3fb96818fdfd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:03.155069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06461e79-b175-46a2-9071-3fb96818fdfd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:03.155917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06461e79-b175-46a2-9071-3fb96818fdfd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:03.156343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06461e79-b175-46a2-9071-3fb96818fdfd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:03.399312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0d1fdac-b8ec-47d2-a845-4f3fe9a7050c tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:03.400101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0d1fdac-b8ec-47d2-a845-4f3fe9a7050c tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:03.426700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0d1fdac-b8ec-47d2-a845-4f3fe9a7050c tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:03.427202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0d1fdac-b8ec-47d2-a845-4f3fe9a7050c tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:03.428662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0d1fdac-b8ec-47d2-a845-4f3fe9a7050c tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:03.430481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0d1fdac-b8ec-47d2-a845-4f3fe9a7050c tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:03.431142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0d1fdac-b8ec-47d2-a845-4f3fe9a7050c tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:03.431566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0d1fdac-b8ec-47d2-a845-4f3fe9a7050c tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:03.566022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-06461e79-b175-46a2-9071-3fb96818fdfd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:03.574497 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-06461e79-b175-46a2-9071-3fb96818fdfd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1323 microversion: 2.1 time: 0.435729 Aug 09 14:44:03.592092 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1588/3235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:03 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1323 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:03.926302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0d1fdac-b8ec-47d2-a845-4f3fe9a7050c tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:03.939777 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0d1fdac-b8ec-47d2-a845-4f3fe9a7050c tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1308 microversion: 2.1 time: 0.546278 Aug 09 14:44:03.941034 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1648/3236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:03 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1308 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:44:04.599632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-00c3ec5f-d39d-48a8-a615-2041f18ce75d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:04.600934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-00c3ec5f-d39d-48a8-a615-2041f18ce75d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:04.608550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00c3ec5f-d39d-48a8-a615-2041f18ce75d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:04.609431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00c3ec5f-d39d-48a8-a615-2041f18ce75d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:04.610137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00c3ec5f-d39d-48a8-a615-2041f18ce75d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:04.611123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00c3ec5f-d39d-48a8-a615-2041f18ce75d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:04.611889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00c3ec5f-d39d-48a8-a615-2041f18ce75d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:04.612863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00c3ec5f-d39d-48a8-a615-2041f18ce75d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:04.963975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05fd419c-0bfa-4013-8e2c-80c90662a4cd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:04.965707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05fd419c-0bfa-4013-8e2c-80c90662a4cd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:04.972516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05fd419c-0bfa-4013-8e2c-80c90662a4cd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:04.973926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05fd419c-0bfa-4013-8e2c-80c90662a4cd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:04.976868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05fd419c-0bfa-4013-8e2c-80c90662a4cd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:04.977837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05fd419c-0bfa-4013-8e2c-80c90662a4cd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:04.978523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05fd419c-0bfa-4013-8e2c-80c90662a4cd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:04.979195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05fd419c-0bfa-4013-8e2c-80c90662a4cd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:05.202264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-00c3ec5f-d39d-48a8-a615-2041f18ce75d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:05.218612 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-00c3ec5f-d39d-48a8-a615-2041f18ce75d tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1518 microversion: 2.1 time: 0.623025 Aug 09 14:44:05.221383 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1589/3237] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:04 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1518 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:05.229606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8287247b-20bc-47ba-bba4-27f2d0897c33 req-7eaa6253-a714-4a6a-9384-18d611e556c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b708eb-9c45-4e12-8917-50a349e7f0f4", "name": "network-vif-plugged", "status": "completed", "tag": "a835f71e-30b9-4171-aeed-864546a009c0"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:05.257009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:05.260998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8287247b-20bc-47ba-bba4-27f2d0897c33 req-7eaa6253-a714-4a6a-9384-18d611e556c2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:05.261949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8287247b-20bc-47ba-bba4-27f2d0897c33 req-7eaa6253-a714-4a6a-9384-18d611e556c2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:05.262556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8287247b-20bc-47ba-bba4-27f2d0897c33 req-7eaa6253-a714-4a6a-9384-18d611e556c2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:05.317764 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8287247b-20bc-47ba-bba4-27f2d0897c33 req-7eaa6253-a714-4a6a-9384-18d611e556c2 service nova] Creating event network-vif-plugged:a835f71e-30b9-4171-aeed-864546a009c0 for instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 on n-h2-844626-8 Aug 09 14:44:05.333002 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8287247b-20bc-47ba-bba4-27f2d0897c33 req-7eaa6253-a714-4a6a-9384-18d611e556c2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109701 Aug 09 14:44:05.334095 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1590/3238] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:05.340295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44b7bc70-7aac-476e-9e8c-195675df09ec tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:05.357037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44b7bc70-7aac-476e-9e8c-195675df09ec tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:05.388741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44b7bc70-7aac-476e-9e8c-195675df09ec tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:05.389680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44b7bc70-7aac-476e-9e8c-195675df09ec tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:05.390346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44b7bc70-7aac-476e-9e8c-195675df09ec tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:05.391390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44b7bc70-7aac-476e-9e8c-195675df09ec tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:05.392291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44b7bc70-7aac-476e-9e8c-195675df09ec tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:05.393022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44b7bc70-7aac-476e-9e8c-195675df09ec tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:05.442969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-44b7bc70-7aac-476e-9e8c-195675df09ec tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lazy-loading 'flavor' on Instance uuid 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:44:05.541826 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44b7bc70-7aac-476e-9e8c-195675df09ec tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "POST /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920/action" status: 200 len: 32 microversion: 2.1 time: 0.206010 Aug 09 14:44:05.542983 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1591/3239] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:44:05 2022] POST /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:44:05.564487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05fd419c-0bfa-4013-8e2c-80c90662a4cd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:05.583989 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05fd419c-0bfa-4013-8e2c-80c90662a4cd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1308 microversion: 2.1 time: 0.622984 Aug 09 14:44:05.587544 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1649/3240] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:04 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1308 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:05.593223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-431b0f84-59b0-4872-95f8-41d705b18b2f tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:05.594247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-431b0f84-59b0-4872-95f8-41d705b18b2f tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:05.606351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-431b0f84-59b0-4872-95f8-41d705b18b2f tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:05.608627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-431b0f84-59b0-4872-95f8-41d705b18b2f tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:05.609816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-431b0f84-59b0-4872-95f8-41d705b18b2f tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:05.610892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-431b0f84-59b0-4872-95f8-41d705b18b2f tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:05.611760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-431b0f84-59b0-4872-95f8-41d705b18b2f tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:05.612760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-431b0f84-59b0-4872-95f8-41d705b18b2f tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:06.187930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-431b0f84-59b0-4872-95f8-41d705b18b2f tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:06.210941 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-431b0f84-59b0-4872-95f8-41d705b18b2f tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 0.631985 Aug 09 14:44:06.214241 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1592/3241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:05 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:06.610497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05ccb3e1-dc63-4ff5-ae1a-4466398d0c60 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:06.611775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05ccb3e1-dc63-4ff5-ae1a-4466398d0c60 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:06.626936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05ccb3e1-dc63-4ff5-ae1a-4466398d0c60 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:06.627991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05ccb3e1-dc63-4ff5-ae1a-4466398d0c60 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:06.630279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05ccb3e1-dc63-4ff5-ae1a-4466398d0c60 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:06.631962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05ccb3e1-dc63-4ff5-ae1a-4466398d0c60 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:06.632979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05ccb3e1-dc63-4ff5-ae1a-4466398d0c60 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:06.633640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05ccb3e1-dc63-4ff5-ae1a-4466398d0c60 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:07.262778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6102ad21-c129-45da-9fd0-7c6fde3a4629 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:07.263553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6102ad21-c129-45da-9fd0-7c6fde3a4629 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:07.283560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6102ad21-c129-45da-9fd0-7c6fde3a4629 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:07.284227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6102ad21-c129-45da-9fd0-7c6fde3a4629 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:07.288370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6102ad21-c129-45da-9fd0-7c6fde3a4629 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:07.289955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6102ad21-c129-45da-9fd0-7c6fde3a4629 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:07.290650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6102ad21-c129-45da-9fd0-7c6fde3a4629 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:07.295199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6102ad21-c129-45da-9fd0-7c6fde3a4629 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:07.302460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05ccb3e1-dc63-4ff5-ae1a-4466398d0c60 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:07.317381 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05ccb3e1-dc63-4ff5-ae1a-4466398d0c60 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1308 microversion: 2.1 time: 0.715187 Aug 09 14:44:07.333616 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1650/3242] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:06 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1308 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:08.307363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6102ad21-c129-45da-9fd0-7c6fde3a4629 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:08.340879 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6102ad21-c129-45da-9fd0-7c6fde3a4629 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 1.101024 Aug 09 14:44:08.343329 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1593/3243] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:07 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:08.347009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f046ec24-6acc-4dc1-95a9-e0918e78c395 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:08.348295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f046ec24-6acc-4dc1-95a9-e0918e78c395 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:08.361757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f046ec24-6acc-4dc1-95a9-e0918e78c395 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:08.363239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f046ec24-6acc-4dc1-95a9-e0918e78c395 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:08.363901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f046ec24-6acc-4dc1-95a9-e0918e78c395 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:08.364840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f046ec24-6acc-4dc1-95a9-e0918e78c395 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:08.365494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f046ec24-6acc-4dc1-95a9-e0918e78c395 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:08.366141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f046ec24-6acc-4dc1-95a9-e0918e78c395 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:09.370399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c035a37-3a23-4abf-b8f2-a98ebdb152fd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:09.371027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c035a37-3a23-4abf-b8f2-a98ebdb152fd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:09.381457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f046ec24-6acc-4dc1-95a9-e0918e78c395 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:09.405415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c035a37-3a23-4abf-b8f2-a98ebdb152fd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:09.407736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c035a37-3a23-4abf-b8f2-a98ebdb152fd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:09.409248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c035a37-3a23-4abf-b8f2-a98ebdb152fd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:09.410163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c035a37-3a23-4abf-b8f2-a98ebdb152fd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:09.411452 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f046ec24-6acc-4dc1-95a9-e0918e78c395 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1488 microversion: 2.1 time: 1.066325 Aug 09 14:44:09.411910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c035a37-3a23-4abf-b8f2-a98ebdb152fd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:09.413352 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1651/3244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:08 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1488 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:09.436501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c035a37-3a23-4abf-b8f2-a98ebdb152fd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:09.444495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a17e9a9d-7200-4fe4-8d0a-76d6463950d3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:09.445133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a17e9a9d-7200-4fe4-8d0a-76d6463950d3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:09.458955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a17e9a9d-7200-4fe4-8d0a-76d6463950d3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:09.459674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a17e9a9d-7200-4fe4-8d0a-76d6463950d3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:09.460189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a17e9a9d-7200-4fe4-8d0a-76d6463950d3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:09.461018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a17e9a9d-7200-4fe4-8d0a-76d6463950d3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:09.461630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a17e9a9d-7200-4fe4-8d0a-76d6463950d3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:09.462139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a17e9a9d-7200-4fe4-8d0a-76d6463950d3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:09.541748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-a17e9a9d-7200-4fe4-8d0a-76d6463950d3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lazy-loading 'flavor' on Instance uuid 65b708eb-9c45-4e12-8917-50a349e7f0f4 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:44:09.635917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:09.717766 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a17e9a9d-7200-4fe4-8d0a-76d6463950d3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "POST /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4/action" status: 202 len: 0 microversion: 2.1 time: 0.280596 Aug 09 14:44:09.719773 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1652/3245] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:44:09 2022] POST /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:44:09.753264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aed5e0f1-abff-4699-9f3d-dd369e693c0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:09.754618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aed5e0f1-abff-4699-9f3d-dd369e693c0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:09.767465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aed5e0f1-abff-4699-9f3d-dd369e693c0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:09.770181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aed5e0f1-abff-4699-9f3d-dd369e693c0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:09.770950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aed5e0f1-abff-4699-9f3d-dd369e693c0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:09.771976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aed5e0f1-abff-4699-9f3d-dd369e693c0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:09.778013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aed5e0f1-abff-4699-9f3d-dd369e693c0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:09.782130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aed5e0f1-abff-4699-9f3d-dd369e693c0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:10.013204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c035a37-3a23-4abf-b8f2-a98ebdb152fd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:10.025851 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c035a37-3a23-4abf-b8f2-a98ebdb152fd tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 0.660105 Aug 09 14:44:10.027593 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1594/3246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:09 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:11.038554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aed5e0f1-abff-4699-9f3d-dd369e693c0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:11.056821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-25d4c329-f0d9-4ea9-8fed-b3e98115d410 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:11.057463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-25d4c329-f0d9-4ea9-8fed-b3e98115d410 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:11.063398 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aed5e0f1-abff-4699-9f3d-dd369e693c0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1496 microversion: 2.1 time: 1.329907 Aug 09 14:44:11.065951 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1653/3247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:09 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1496 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:11.069533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25d4c329-f0d9-4ea9-8fed-b3e98115d410 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:11.070034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25d4c329-f0d9-4ea9-8fed-b3e98115d410 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:11.070471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25d4c329-f0d9-4ea9-8fed-b3e98115d410 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:11.076684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25d4c329-f0d9-4ea9-8fed-b3e98115d410 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:11.079901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25d4c329-f0d9-4ea9-8fed-b3e98115d410 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:11.080349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25d4c329-f0d9-4ea9-8fed-b3e98115d410 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:11.902204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-25d4c329-f0d9-4ea9-8fed-b3e98115d410 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:11.924253 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-25d4c329-f0d9-4ea9-8fed-b3e98115d410 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 0.876267 Aug 09 14:44:11.934755 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1595/3248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:11 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:12.098161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e2a26c8a-7c95-4ec1-8b6a-895520af81a5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:12.099512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e2a26c8a-7c95-4ec1-8b6a-895520af81a5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:12.109654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2a26c8a-7c95-4ec1-8b6a-895520af81a5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:12.134575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2a26c8a-7c95-4ec1-8b6a-895520af81a5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:12.135806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2a26c8a-7c95-4ec1-8b6a-895520af81a5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:12.139251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2a26c8a-7c95-4ec1-8b6a-895520af81a5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:12.140529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2a26c8a-7c95-4ec1-8b6a-895520af81a5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:12.143920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2a26c8a-7c95-4ec1-8b6a-895520af81a5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:12.764810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-454916d2-4089-488a-af32-0bfdac4b8687 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'create', calling method: .version_select at 0x7f41e755f280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-186883662", "description": "tempest-description-651541038"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:13.357604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e2a26c8a-7c95-4ec1-8b6a-895520af81a5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:13.368193 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e2a26c8a-7c95-4ec1-8b6a-895520af81a5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 200 len: 1479 microversion: 2.1 time: 1.274069 Aug 09 14:44:13.368788 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1654/3249] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:12 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 1479 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:44:13.379871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0befeb29-9a40-4697-a364-50045e69b1bb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:13.380660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0befeb29-9a40-4697-a364-50045e69b1bb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:13.409724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0befeb29-9a40-4697-a364-50045e69b1bb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:13.410356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0befeb29-9a40-4697-a364-50045e69b1bb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:13.410809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0befeb29-9a40-4697-a364-50045e69b1bb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:13.411589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0befeb29-9a40-4697-a364-50045e69b1bb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:13.412553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0befeb29-9a40-4697-a364-50045e69b1bb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:13.413161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0befeb29-9a40-4697-a364-50045e69b1bb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:13.989187 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-454916d2-4089-488a-af32-0bfdac4b8687 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.459115 Aug 09 14:44:13.990464 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1596/3250] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:44:12 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:13.995700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e54120d6-a7f1-42cc-a892-108bd022c162 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1956816072"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:14.011792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e54120d6-a7f1-42cc-a892-108bd022c162 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:14.030938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e54120d6-a7f1-42cc-a892-108bd022c162 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:14.032031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e54120d6-a7f1-42cc-a892-108bd022c162 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:14.034132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e54120d6-a7f1-42cc-a892-108bd022c162 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:14.036467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e54120d6-a7f1-42cc-a892-108bd022c162 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:14.038218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e54120d6-a7f1-42cc-a892-108bd022c162 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:14.038890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e54120d6-a7f1-42cc-a892-108bd022c162 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:14.083916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0befeb29-9a40-4697-a364-50045e69b1bb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:14.092408 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0befeb29-9a40-4697-a364-50045e69b1bb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 0.716264 Aug 09 14:44:14.106539 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1655/3251] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:13 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:14.124379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-88537516-6c72-4c63-9c29-d54c7d4bbcd4 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'create', calling method: .version_select at 0x7f41dd349ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1994564960", "description": "tempest-description-1070358420"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:14.439917 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e54120d6-a7f1-42cc-a892-108bd022c162 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "POST /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4/action" status: 202 len: 0 microversion: 2.1 time: 0.447535 Aug 09 14:44:14.443291 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1597/3252] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:44:13 2022] POST /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 14:44:14.710449 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-88537516-6c72-4c63-9c29-d54c7d4bbcd4 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.602439 Aug 09 14:44:14.711067 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1656/3253] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:44:14 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:14.727007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7e7e74f5-5fb2-4bbf-8ff5-13c7a45f32ae tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd329310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:14.838559 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7e7e74f5-5fb2-4bbf-8ff5-13c7a45f32ae tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.125574 Aug 09 14:44:14.841272 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1657/3254] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:14 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:14.851786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-485e1bd3-3e54-4b28-8ec7-199a9338478c tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41ddda0ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1987885467", "description": "tempest-description-2052059050"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:15.051336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1135339549", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "6fbe09fe-8d24-4718-8a00-12c30074556f"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:15.169540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] validate_networks() for [('6fbe09fe-8d24-4718-8a00-12c30074556f', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:44:15.472900 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-485e1bd3-3e54-4b28-8ec7-199a9338478c tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.026586 Aug 09 14:44:15.474995 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1598/3255] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:44:14 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:15.490076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-96332650-5407-439e-bb31-9e1d7b4edfe2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:15.492551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-96332650-5407-439e-bb31-9e1d7b4edfe2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:15.505090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96332650-5407-439e-bb31-9e1d7b4edfe2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:15.506019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96332650-5407-439e-bb31-9e1d7b4edfe2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:15.506700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96332650-5407-439e-bb31-9e1d7b4edfe2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:15.508561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96332650-5407-439e-bb31-9e1d7b4edfe2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:15.509325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96332650-5407-439e-bb31-9e1d7b4edfe2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:15.509970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96332650-5407-439e-bb31-9e1d7b4edfe2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:16.047501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-96332650-5407-439e-bb31-9e1d7b4edfe2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:16.051166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:16.058798 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-96332650-5407-439e-bb31-9e1d7b4edfe2 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 0.581966 Aug 09 14:44:16.064354 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1599/3256] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:15 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:16.092673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-550a210c-4575-4486-9b6c-d1722ddae177 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41dd347700>, body: {"security_group_rule": {"parent_group_id": "5a5ddbf0-70a4-48ac-aa0b-def71ada14dc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:16.426800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:44:16.427364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:44:16.427829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:44:16.428233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:44:16.428642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:44:16.448864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:16.449367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:16.451349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:16.453620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:16.455822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:16.456498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:16.507482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Getting quotas for project 255e01b50a0249008b5c4533efbef0fd. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:44:16.522726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Getting quotas for user 37ed1274a3df4202a9417070db172cfa and project 255e01b50a0249008b5c4533efbef0fd. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:44:16.539752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:44:16.543577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:44:16.623839 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ebb632b1-91f5-4650-81c4-5f465a9fcf40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.578247 Aug 09 14:44:16.625923 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1658/3257] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:44:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:44:16.631922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-13e8d8f5-a71b-4536-af4d-ad1c0a1b169d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd169820>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:16.773223 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-13e8d8f5-a71b-4536-af4d-ad1c0a1b169d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.145880 Aug 09 14:44:16.774434 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1659/3258] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:16 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:16.779967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-953fb107-94b9-4742-a637-bca625e6d08e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:16.788211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-953fb107-94b9-4742-a637-bca625e6d08e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:16.986521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-953fb107-94b9-4742-a637-bca625e6d08e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:16.996683 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-953fb107-94b9-4742-a637-bca625e6d08e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1216 microversion: 2.1 time: 0.220428 Aug 09 14:44:17.011645 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1660/3259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:16 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1216 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:17.013167 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-550a210c-4575-4486-9b6c-d1722ddae177 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.946826 Aug 09 14:44:17.020607 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1600/3260] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:44:16 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:17.045243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a3d9145f-e055-4d87-90a7-7572b226764d tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41dc8fc0d0>, body: {"security_group_rule": {"parent_group_id": "5a5ddbf0-70a4-48ac-aa0b-def71ada14dc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:17.086061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1ce7eb3-1a6c-41f8-99f7-66cde8e77eda tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:17.086655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1ce7eb3-1a6c-41f8-99f7-66cde8e77eda tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:17.094499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1ce7eb3-1a6c-41f8-99f7-66cde8e77eda tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:17.107453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1ce7eb3-1a6c-41f8-99f7-66cde8e77eda tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:17.108170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1ce7eb3-1a6c-41f8-99f7-66cde8e77eda tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:17.108925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1ce7eb3-1a6c-41f8-99f7-66cde8e77eda tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:17.109432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1ce7eb3-1a6c-41f8-99f7-66cde8e77eda tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:17.109858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1ce7eb3-1a6c-41f8-99f7-66cde8e77eda tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:17.653795 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-a3d9145f-e055-4d87-90a7-7572b226764d tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] HTTP exception thrown: This rule already exists in group 5a5ddbf0-70a4-48ac-aa0b-def71ada14dc Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a3d9145f-e055-4d87-90a7-7572b226764d tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Request method failure captured: Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 138 Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nK-s9a1C4ceq8ywqw2sDtNxkud1aetdU2NkgGies3C4FmtrsaaWPcHu7A7O8f1e3p-r_j5TXB-nJaosa1qp2Oji7HVzqm-ybln_lIWX363iwfLDh69Fqt_l_gQGY-xjudsLosR_LjjAmhkkSjHWF5LcgpgEcL9HEw-fq2fKaiZ1wVg Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ef2893cc1a3480b89c0c91353cf264e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 87eee6fa5d6941cc8dc387879ba9f01a Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: {"security_group_rule": {"parent_group_id": "5a5ddbf0-70a4-48ac-aa0b-def71ada14dc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: exception: This rule already exists in group 5a5ddbf0-70a4-48ac-aa0b-def71ada14dc Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5a5ddbf0-70a4-48ac-aa0b-def71ada14dc', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 5a5ddbf0-70a4-48ac-aa0b-def71ada14dc Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 5a5ddbf0-70a4-48ac-aa0b-def71ada14dc Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:17.655607 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:17.661068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:17.661068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:17.661068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 5a5ddbf0-70a4-48ac-aa0b-def71ada14dc Aug 09 14:44:17.661068 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:17.661068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a3d9145f-e055-4d87-90a7-7572b226764d tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Returning 400 to user: This rule already exists in group 5a5ddbf0-70a4-48ac-aa0b-def71ada14dc {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:17.661068 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a3d9145f-e055-4d87-90a7-7572b226764d tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.616225 Aug 09 14:44:17.661068 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1661/3261] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:44:17 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 624 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:44:17.668253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5608f2bd-ddef-4698-a61e-b7502fd966fa tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Calling method '.version_select at 0x7f41dcbf7670>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:17.860889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e1ce7eb3-1a6c-41f8-99f7-66cde8e77eda tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:17.873948 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1ce7eb3-1a6c-41f8-99f7-66cde8e77eda tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 0.792592 Aug 09 14:44:17.876398 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1601/3262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:17 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:44:17.905748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b922c9d0-fda4-4091-94ba-864170b64178 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41e758ae50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:18.044881 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b922c9d0-fda4-4091-94ba-864170b64178 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.166861 Aug 09 14:44:18.053591 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1602/3263] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:17 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:18.069878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1243e4c9-64d6-4c27-bae7-1dc086df9e43 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:18.070775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1243e4c9-64d6-4c27-bae7-1dc086df9e43 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:18.087130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1243e4c9-64d6-4c27-bae7-1dc086df9e43 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:18.090051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1243e4c9-64d6-4c27-bae7-1dc086df9e43 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:18.091959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1243e4c9-64d6-4c27-bae7-1dc086df9e43 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:18.095304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1243e4c9-64d6-4c27-bae7-1dc086df9e43 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:18.096372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1243e4c9-64d6-4c27-bae7-1dc086df9e43 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:18.097672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1243e4c9-64d6-4c27-bae7-1dc086df9e43 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:18.309846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1243e4c9-64d6-4c27-bae7-1dc086df9e43 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:18.324353 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1243e4c9-64d6-4c27-bae7-1dc086df9e43 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1212 microversion: 2.1 time: 0.268738 Aug 09 14:44:18.325336 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1603/3264] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:18 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1212 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:18.445600 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5608f2bd-ddef-4698-a61e-b7502fd966fa tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/ebcbface-e1a1-48c3-a1ee-93a4627fb618" status: 202 len: 0 microversion: 2.1 time: 0.783186 Aug 09 14:44:18.446442 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1662/3265] 10.222.0.50 () {58 vars in 1287 bytes} [Tue Aug 9 14:44:17 2022] DELETE /compute/v2.1/os-security-group-rules/ebcbface-e1a1-48c3-a1ee-93a4627fb618 => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 14:44:18.459713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fc2a9ceb-4b59-4eac-ac55-9e2146a1ef34 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41e7591940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-651027944", "description": "tempest-description-331606724"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:18.825669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-269941de-2948-4e68-b6be-0be6312cb03f req-16cb0602-cf39-46ed-ad2b-86b5c0dec096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b708eb-9c45-4e12-8917-50a349e7f0f4", "name": "network-vif-plugged", "status": "completed", "tag": "a835f71e-30b9-4171-aeed-864546a009c0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:18.863828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-269941de-2948-4e68-b6be-0be6312cb03f req-16cb0602-cf39-46ed-ad2b-86b5c0dec096 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:18.865756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-269941de-2948-4e68-b6be-0be6312cb03f req-16cb0602-cf39-46ed-ad2b-86b5c0dec096 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:18.868579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-269941de-2948-4e68-b6be-0be6312cb03f req-16cb0602-cf39-46ed-ad2b-86b5c0dec096 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:18.906411 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-269941de-2948-4e68-b6be-0be6312cb03f req-16cb0602-cf39-46ed-ad2b-86b5c0dec096 service nova] Creating event network-vif-plugged:a835f71e-30b9-4171-aeed-864546a009c0 for instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 on n-h2-844626-8 Aug 09 14:44:18.940771 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-269941de-2948-4e68-b6be-0be6312cb03f req-16cb0602-cf39-46ed-ad2b-86b5c0dec096 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120294 Aug 09 14:44:18.942724 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1663/3266] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:18.994946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-090e16fe-7d51-4f01-a767-1b8144dae374 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:18.996297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-090e16fe-7d51-4f01-a767-1b8144dae374 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:19.019245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-090e16fe-7d51-4f01-a767-1b8144dae374 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:19.021495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-090e16fe-7d51-4f01-a767-1b8144dae374 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:19.022111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-090e16fe-7d51-4f01-a767-1b8144dae374 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:19.023947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-090e16fe-7d51-4f01-a767-1b8144dae374 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:19.027552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-090e16fe-7d51-4f01-a767-1b8144dae374 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:19.028243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-090e16fe-7d51-4f01-a767-1b8144dae374 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:19.062023 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fc2a9ceb-4b59-4eac-ac55-9e2146a1ef34 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.609524 Aug 09 14:44:19.063023 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1604/3267] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:44:18 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:19.068445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e66492f4-0170-46fe-9b00-2df5e149593e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddd96550>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:19.215742 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e66492f4-0170-46fe-9b00-2df5e149593e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.149795 Aug 09 14:44:19.231039 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1605/3268] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:19 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:19.247763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2d45cab3-677d-43ed-82a1-ea602c0a4a00 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41de16cee0>, body: {"security_group_rule": {"parent_group_id": "ab1ddb94-27bd-4744-aef1-f0fd3836154e", "ip_protocol": "tcp", "from_port": 643270993, "to_port": 22}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:19.538869 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-2d45cab3-677d-43ed-82a1-ea602c0a4a00 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] HTTP exception thrown: Invalid port range 643270993:22. Former value cannot be greater than the later Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2d45cab3-677d-43ed-82a1-ea602c0a4a00 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Request method failure captured: Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 145 Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK-s9a1C4ceq8ywqw2sDtNxkud1aetdU2NkgGies3C4FmtrsaaWPcHu7A7O8f1e3p-r_j5TXB-nJaosa1qp2Oji7HVzqm-ybln_lIWX363iwfLDh69Fqt_l_gQGY-xjudsLosR_LjjAmhkkSjHWF5LcgpgEcL9HEw-fq2fKaiZ1wVg Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ef2893cc1a3480b89c0c91353cf264e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 87eee6fa5d6941cc8dc387879ba9f01a Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: {"security_group_rule": {"parent_group_id": "ab1ddb94-27bd-4744-aef1-f0fd3836154e", "ip_protocol": "tcp", "from_port": 643270993, "to_port": 22}} Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid port range 643270993:22. Former value cannot be greater than the later Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ab1ddb94-27bd-4744-aef1-f0fd3836154e', 'ip_protocol': 'tcp', 'from_port': 643270993, 'to_port': 22}}} Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 643270993:22. Former value cannot be greater than the later Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 643270993:22. Former value cannot be greater than the later Aug 09 14:44:19.542942 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:19.549098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:19.549098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:19.549098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:19.549098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:19.549098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:19.549098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:19.549098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:19.549098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 643270993:22. Former value cannot be greater than the later Aug 09 14:44:19.549098 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:19.552636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2d45cab3-677d-43ed-82a1-ea602c0a4a00 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Returning 400 to user: Invalid port range 643270993:22. Former value cannot be greater than the later {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:19.555491 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2d45cab3-677d-43ed-82a1-ea602c0a4a00 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.320485 Aug 09 14:44:19.561081 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1606/3269] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:44:19 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 329 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:44:19.576133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f1c12364-4ce7-4f93-932f-c2d6442ba073 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:19.582835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f1c12364-4ce7-4f93-932f-c2d6442ba073 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:19.601177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1c12364-4ce7-4f93-932f-c2d6442ba073 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:19.602841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1c12364-4ce7-4f93-932f-c2d6442ba073 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:19.604558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1c12364-4ce7-4f93-932f-c2d6442ba073 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:19.605470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1c12364-4ce7-4f93-932f-c2d6442ba073 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:19.607409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1c12364-4ce7-4f93-932f-c2d6442ba073 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:19.609485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f1c12364-4ce7-4f93-932f-c2d6442ba073 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:19.699363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-090e16fe-7d51-4f01-a767-1b8144dae374 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:19.708856 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-090e16fe-7d51-4f01-a767-1b8144dae374 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 0.730799 Aug 09 14:44:19.712371 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1664/3270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:18 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:19.736179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-71030aa4-41c6-434c-b0bb-70f5c7d83adc tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41dc8fcaf0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1330314177", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:19.741220 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-71030aa4-41c6-434c-b0bb-70f5c7d83adc tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] HTTP exception thrown: Security group id should be uuid Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-71030aa4-41c6-434c-b0bb-70f5c7d83adc tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Request method failure captured: Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 131 Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nK-s9a1C4ceq8ywqw2sDtNxkud1aetdU2NkgGies3C4FmtrsaaWPcHu7A7O8f1e3p-r_j5TXB-nJaosa1qp2Oji7HVzqm-ybln_lIWX363iwfLDh69Fqt_l_gQGY-xjudsLosR_LjjAmhkkSjHWF5LcgpgEcL9HEw-fq2fKaiZ1wVg Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ef2893cc1a3480b89c0c91353cf264e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 87eee6fa5d6941cc8dc387879ba9f01a Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1330314177", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: exception: Security group id should be uuid Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1330314177', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:19.744958 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:19.749194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 09 14:44:19.749194 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:19.759442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-71030aa4-41c6-434c-b0bb-70f5c7d83adc tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Returning 400 to user: Security group id should be uuid {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:19.761266 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-71030aa4-41c6-434c-b0bb-70f5c7d83adc tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.028450 Aug 09 14:44:19.762093 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1665/3271] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:44:19 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:44:19.773318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d3fd852b-ba3f-4607-8100-1e029c98de29 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41dc92e430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-504008074", "description": "tempest-description-159448637"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:19.781370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f1c12364-4ce7-4f93-932f-c2d6442ba073 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:19.798726 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f1c12364-4ce7-4f93-932f-c2d6442ba073 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1274 microversion: 2.1 time: 0.231063 Aug 09 14:44:19.812743 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1607/3272] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:19 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1274 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:20.235663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c163618a-c53a-459f-9545-eeb9df25e235 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd347b80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:20.318475 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c163618a-c53a-459f-9545-eeb9df25e235 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.086719 Aug 09 14:44:20.320273 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1608/3273] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:20 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:20.509497 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d3fd852b-ba3f-4607-8100-1e029c98de29 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.740636 Aug 09 14:44:20.510852 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1666/3274] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:44:19 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:44:20.524357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ed9e202-5032-4078-8208-884fc6f21aa8 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41ddd96700>, body: {"security_group_rule": {"parent_group_id": "2ecde91c-3366-42e6-8c9f-961cf15392af", "ip_protocol": "tempest-999-233328084", "from_port": 22, "to_port": 22}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:20.733442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28ab40f4-e092-469f-a46f-b1fb0179c5a0 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:20.738627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28ab40f4-e092-469f-a46f-b1fb0179c5a0 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:20.750726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28ab40f4-e092-469f-a46f-b1fb0179c5a0 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:20.759687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28ab40f4-e092-469f-a46f-b1fb0179c5a0 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:20.760478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28ab40f4-e092-469f-a46f-b1fb0179c5a0 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:20.763729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28ab40f4-e092-469f-a46f-b1fb0179c5a0 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:20.766899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28ab40f4-e092-469f-a46f-b1fb0179c5a0 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:20.769921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28ab40f4-e092-469f-a46f-b1fb0179c5a0 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:20.975786 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6ed9e202-5032-4078-8208-884fc6f21aa8 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] HTTP exception thrown: Invalid IP protocol tempest-999-233328084. Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ed9e202-5032-4078-8208-884fc6f21aa8 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Request method failure captured: Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 156 Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK-s9a1C4ceq8ywqw2sDtNxkud1aetdU2NkgGies3C4FmtrsaaWPcHu7A7O8f1e3p-r_j5TXB-nJaosa1qp2Oji7HVzqm-ybln_lIWX363iwfLDh69Fqt_l_gQGY-xjudsLosR_LjjAmhkkSjHWF5LcgpgEcL9HEw-fq2fKaiZ1wVg Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ef2893cc1a3480b89c0c91353cf264e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 87eee6fa5d6941cc8dc387879ba9f01a Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: {"security_group_rule": {"parent_group_id": "2ecde91c-3366-42e6-8c9f-961cf15392af", "ip_protocol": "tempest-999-233328084", "from_port": 22, "to_port": 22}} Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid IP protocol tempest-999-233328084. Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2ecde91c-3366-42e6-8c9f-961cf15392af', 'ip_protocol': 'tempest-999-233328084', 'from_port': 22, 'to_port': 22}}} Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-233328084. Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-233328084. Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:20.977355 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:20.981938 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:20.981938 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:20.981938 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:20.981938 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:20.981938 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:20.981938 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:20.981938 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-233328084. Aug 09 14:44:20.981938 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:20.981938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ed9e202-5032-4078-8208-884fc6f21aa8 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Returning 400 to user: Invalid IP protocol tempest-999-233328084. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:20.981938 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ed9e202-5032-4078-8208-884fc6f21aa8 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.459488 Aug 09 14:44:20.985353 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1609/3275] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:44:20 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 466 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:44:20.993919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b79b8e7b-370f-4608-8c65-a79d754a14df tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:20.994539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b79b8e7b-370f-4608-8c65-a79d754a14df tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:21.020030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b79b8e7b-370f-4608-8c65-a79d754a14df tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:21.020875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b79b8e7b-370f-4608-8c65-a79d754a14df tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:21.022517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b79b8e7b-370f-4608-8c65-a79d754a14df tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:21.027462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b79b8e7b-370f-4608-8c65-a79d754a14df tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:21.032022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b79b8e7b-370f-4608-8c65-a79d754a14df tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:21.032735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b79b8e7b-370f-4608-8c65-a79d754a14df tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:21.997248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-28ab40f4-e092-469f-a46f-b1fb0179c5a0 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:22.009392 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28ab40f4-e092-469f-a46f-b1fb0179c5a0 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 1.280177 Aug 09 14:44:22.010249 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1667/3276] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:20 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:44:22.036561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0ea847a-f7a4-46cf-ac36-847468a28eea tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41dc934670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1683393822", "description": "tempest-description-572488427"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:22.718614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b79b8e7b-370f-4608-8c65-a79d754a14df tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:22.736471 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b79b8e7b-370f-4608-8c65-a79d754a14df tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1316 microversion: 2.1 time: 1.749953 Aug 09 14:44:22.751884 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1610/3277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:20 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1316 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:22.757648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-278057ba-59ad-4a53-b76f-b49ac613a195 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddf77820>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:22.834521 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-278057ba-59ad-4a53-b76f-b49ac613a195 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.080919 Aug 09 14:44:22.849720 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1611/3278] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:22 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:23.046136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b78cb4ad-6e66-4a66-8df3-0d532fa1826a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:23.047243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b78cb4ad-6e66-4a66-8df3-0d532fa1826a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:23.060975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b78cb4ad-6e66-4a66-8df3-0d532fa1826a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:23.061879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b78cb4ad-6e66-4a66-8df3-0d532fa1826a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:23.062773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b78cb4ad-6e66-4a66-8df3-0d532fa1826a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:23.063715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b78cb4ad-6e66-4a66-8df3-0d532fa1826a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:23.064374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b78cb4ad-6e66-4a66-8df3-0d532fa1826a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:23.065030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b78cb4ad-6e66-4a66-8df3-0d532fa1826a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:23.552162 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0ea847a-f7a4-46cf-ac36-847468a28eea tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.534933 Aug 09 14:44:23.554226 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1668/3279] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:44:22 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:23.567465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-1c590ff9-60ad-4364-8c39-488c15b6af96 req-3a00f7d1-3a80-4ada-82fd-369bd0aa8592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136ce1bd-97a7-4072-9bf3-c218db6b023b", "tag": "742c23b3-637d-41b6-9013-f8555384198c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:23.589939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1c590ff9-60ad-4364-8c39-488c15b6af96 req-3a00f7d1-3a80-4ada-82fd-369bd0aa8592 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:23.590720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1c590ff9-60ad-4364-8c39-488c15b6af96 req-3a00f7d1-3a80-4ada-82fd-369bd0aa8592 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:23.592194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1c590ff9-60ad-4364-8c39-488c15b6af96 req-3a00f7d1-3a80-4ada-82fd-369bd0aa8592 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:23.631988 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1c590ff9-60ad-4364-8c39-488c15b6af96 req-3a00f7d1-3a80-4ada-82fd-369bd0aa8592 service nova] Creating event network-changed:742c23b3-637d-41b6-9013-f8555384198c for instance 136ce1bd-97a7-4072-9bf3-c218db6b023b on n-h1-844626-8 Aug 09 14:44:23.642893 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-1c590ff9-60ad-4364-8c39-488c15b6af96 req-3a00f7d1-3a80-4ada-82fd-369bd0aa8592 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085316 Aug 09 14:44:23.644430 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1669/3280] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:23.676796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-486a9fc3-0d03-46a2-acbc-f3fee73c67c3 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41dc92bd30>, body: {"security_group_rule": {"parent_group_id": "38677f15-e8f7-472a-b9b5-a4bcfb9dfb8e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:23.724684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b78cb4ad-6e66-4a66-8df3-0d532fa1826a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:23.732744 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b78cb4ad-6e66-4a66-8df3-0d532fa1826a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 0.698475 Aug 09 14:44:23.736684 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1612/3281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:23 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:23.766292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fc75384c-b972-4dc4-9603-b57b2cc95b9c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:23.768589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fc75384c-b972-4dc4-9603-b57b2cc95b9c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:23.787363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc75384c-b972-4dc4-9603-b57b2cc95b9c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:23.801785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc75384c-b972-4dc4-9603-b57b2cc95b9c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:23.802548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc75384c-b972-4dc4-9603-b57b2cc95b9c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:23.803528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc75384c-b972-4dc4-9603-b57b2cc95b9c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:23.809827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc75384c-b972-4dc4-9603-b57b2cc95b9c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:23.813265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc75384c-b972-4dc4-9603-b57b2cc95b9c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:24.176062 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-486a9fc3-0d03-46a2-acbc-f3fee73c67c3 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-486a9fc3-0d03-46a2-acbc-f3fee73c67c3 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Request method failure captured: Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 138 Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nK-s9a1C4ceq8ywqw2sDtNxkud1aetdU2NkgGies3C4FmtrsaaWPcHu7A7O8f1e3p-r_j5TXB-nJaosa1qp2Oji7HVzqm-ybln_lIWX363iwfLDh69Fqt_l_gQGY-xjudsLosR_LjjAmhkkSjHWF5LcgpgEcL9HEw-fq2fKaiZ1wVg Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ef2893cc1a3480b89c0c91353cf264e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 87eee6fa5d6941cc8dc387879ba9f01a Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: {"security_group_rule": {"parent_group_id": "38677f15-e8f7-472a-b9b5-a4bcfb9dfb8e", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'security_group_rule': {'parent_group_id': '38677f15-e8f7-472a-b9b5-a4bcfb9dfb8e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 09 14:44:24.184053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:24.189817 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:24.189817 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:24.189817 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:24.189817 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:24.189817 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:24.189817 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:24.189817 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:24.189817 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 09 14:44:24.189817 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:24.195720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-486a9fc3-0d03-46a2-acbc-f3fee73c67c3 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:24.218332 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-486a9fc3-0d03-46a2-acbc-f3fee73c67c3 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.563522 Aug 09 14:44:24.223520 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1670/3282] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:44:23 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 578 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:44:24.261454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7edcccb-c84a-4193-81f9-312d6e92a243 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dc934550>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:24.450598 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7edcccb-c84a-4193-81f9-312d6e92a243 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.224787 Aug 09 14:44:24.453814 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1671/3283] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:24 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:24.464370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fc75384c-b972-4dc4-9603-b57b2cc95b9c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:24.487396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b71e8c38-3869-4113-8a2b-f08c99d0da7d tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41dd2f6670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-686154043", "description": "tempest-description-1470906712"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:24.495444 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fc75384c-b972-4dc4-9603-b57b2cc95b9c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1316 microversion: 2.1 time: 0.731054 Aug 09 14:44:24.502863 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1613/3284] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:23 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1316 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:24.759772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4854b2d4-c16f-47d1-9564-e8bed0db16ae tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:24.761272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4854b2d4-c16f-47d1-9564-e8bed0db16ae tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:24.774151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4854b2d4-c16f-47d1-9564-e8bed0db16ae tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:24.774950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4854b2d4-c16f-47d1-9564-e8bed0db16ae tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:24.775568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4854b2d4-c16f-47d1-9564-e8bed0db16ae tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:24.777045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4854b2d4-c16f-47d1-9564-e8bed0db16ae tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:24.781564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4854b2d4-c16f-47d1-9564-e8bed0db16ae tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:24.782268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4854b2d4-c16f-47d1-9564-e8bed0db16ae tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:25.168529 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b71e8c38-3869-4113-8a2b-f08c99d0da7d tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.713242 Aug 09 14:44:25.172331 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1672/3285] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:44:24 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:25.185780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23ca9fb9-2d15-40ec-9632-b73eec52a7cb tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41dd3c63a0>, body: {"security_group_rule": {"parent_group_id": "236ae045-4766-4a0a-b43e-8df1e6b1d6db", "ip_protocol": "tcp", "from_port": 22, "to_port": 1452299030}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:25.419430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4854b2d4-c16f-47d1-9564-e8bed0db16ae tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:25.430102 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4854b2d4-c16f-47d1-9564-e8bed0db16ae tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 0.674366 Aug 09 14:44:25.430707 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1614/3286] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:24 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:25.467797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1fd3fea-40a3-4759-a68c-2202dd38ec49 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddd964c0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:25.526496 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-23ca9fb9-2d15-40ec-9632-b73eec52a7cb tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] HTTP exception thrown: Invalid port range 22:1452299030. Valid TCP ports should be between 1-65535 Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23ca9fb9-2d15-40ec-9632-b73eec52a7cb tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Request method failure captured: Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 146 Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nK-s9a1C4ceq8ywqw2sDtNxkud1aetdU2NkgGies3C4FmtrsaaWPcHu7A7O8f1e3p-r_j5TXB-nJaosa1qp2Oji7HVzqm-ybln_lIWX363iwfLDh69Fqt_l_gQGY-xjudsLosR_LjjAmhkkSjHWF5LcgpgEcL9HEw-fq2fKaiZ1wVg Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ef2893cc1a3480b89c0c91353cf264e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 87eee6fa5d6941cc8dc387879ba9f01a Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: {"security_group_rule": {"parent_group_id": "236ae045-4766-4a0a-b43e-8df1e6b1d6db", "ip_protocol": "tcp", "from_port": 22, "to_port": 1452299030}} Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid port range 22:1452299030. Valid TCP ports should be between 1-65535 Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'security_group_rule': {'parent_group_id': '236ae045-4766-4a0a-b43e-8df1e6b1d6db', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1452299030}}} Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1452299030. Valid TCP ports should be between 1-65535 Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1452299030. Valid TCP ports should be between 1-65535 Aug 09 14:44:25.528454 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:25.534826 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:25.534826 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:25.534826 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:25.534826 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:25.534826 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:25.534826 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:25.534826 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:25.534826 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1452299030. Valid TCP ports should be between 1-65535 Aug 09 14:44:25.534826 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:25.534826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23ca9fb9-2d15-40ec-9632-b73eec52a7cb tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Returning 400 to user: Invalid port range 22:1452299030. Valid TCP ports should be between 1-65535 {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:25.534826 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23ca9fb9-2d15-40ec-9632-b73eec52a7cb tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.352636 Aug 09 14:44:25.540663 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1673/3287] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:44:25 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 360 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:44:25.551109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4661f039-5d79-4214-b374-3db6d24ceb60 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:25.553602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4661f039-5d79-4214-b374-3db6d24ceb60 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:25.569441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:25.572427 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1fd3fea-40a3-4759-a68c-2202dd38ec49 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.108455 Aug 09 14:44:25.575362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4661f039-5d79-4214-b374-3db6d24ceb60 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:25.577365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4661f039-5d79-4214-b374-3db6d24ceb60 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:25.579623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4661f039-5d79-4214-b374-3db6d24ceb60 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:25.580405 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1615/3288] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:25 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:25.583932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4661f039-5d79-4214-b374-3db6d24ceb60 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:25.587062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4661f039-5d79-4214-b374-3db6d24ceb60 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:25.589422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4661f039-5d79-4214-b374-3db6d24ceb60 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:25.593917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d19ca03-1b38-452a-bb0c-e417182c5757 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Action: 'create', calling method: .version_select at 0x7f41de17d670>, body: {"security_group_rule": {"parent_group_id": "54800496-dccb-49ad-87d7-a93fb4a0011e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:25.927537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-4d19ca03-1b38-452a-bb0c-e417182c5757 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54800496-dccb-49ad-87d7-a93fb4a0011e does not exist", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:44:25.930223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.security_group_api [None req-4d19ca03-1b38-452a-bb0c-e417182c5757 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Neutron security group 54800496-dccb-49ad-87d7-a93fb4a0011e not found {{(pid=119406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:44:25.931165 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4d19ca03-1b38-452a-bb0c-e417182c5757 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] HTTP exception thrown: Security group 54800496-dccb-49ad-87d7-a93fb4a0011e does not exist Aug 09 14:44:25.931165 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-605f0f50-d3af-459f-9882-e6847b2e7362'] Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d19ca03-1b38-452a-bb0c-e417182c5757 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Request method failure captured: Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 138 Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK-s9a1C4ceq8ywqw2sDtNxkud1aetdU2NkgGies3C4FmtrsaaWPcHu7A7O8f1e3p-r_j5TXB-nJaosa1qp2Oji7HVzqm-ybln_lIWX363iwfLDh69Fqt_l_gQGY-xjudsLosR_LjjAmhkkSjHWF5LcgpgEcL9HEw-fq2fKaiZ1wVg Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ef2893cc1a3480b89c0c91353cf264e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 87eee6fa5d6941cc8dc387879ba9f01a Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: {"security_group_rule": {"parent_group_id": "54800496-dccb-49ad-87d7-a93fb4a0011e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: exception: Security group 54800496-dccb-49ad-87d7-a93fb4a0011e does not exist Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-605f0f50-d3af-459f-9882-e6847b2e7362'] Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'security_group_rule': {'parent_group_id': '54800496-dccb-49ad-87d7-a93fb4a0011e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:44:25.936378 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54800496-dccb-49ad-87d7-a93fb4a0011e does not exist Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-605f0f50-d3af-459f-9882-e6847b2e7362'] Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54800496-dccb-49ad-87d7-a93fb4a0011e does not exist Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-605f0f50-d3af-459f-9882-e6847b2e7362'] Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54800496-dccb-49ad-87d7-a93fb4a0011e does not exist Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-605f0f50-d3af-459f-9882-e6847b2e7362'] Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54800496-dccb-49ad-87d7-a93fb4a0011e does not exist Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-605f0f50-d3af-459f-9882-e6847b2e7362'] Aug 09 14:44:25.945105 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:25.950529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d19ca03-1b38-452a-bb0c-e417182c5757 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Returning 404 to user: Security group 54800496-dccb-49ad-87d7-a93fb4a0011e does not exist Aug 09 14:44:25.950529 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-605f0f50-d3af-459f-9882-e6847b2e7362'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:25.951966 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4d19ca03-1b38-452a-bb0c-e417182c5757 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.370320 Aug 09 14:44:25.953339 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1616/3289] 10.222.0.50 () {60 vars in 1195 bytes} [Tue Aug 9 14:44:25 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 372 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:44:25.971772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6426d533-3db1-4f15-b229-67fd89391520 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Calling method '.version_select at 0x7f41ddf5bb80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:26.107626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-6426d533-3db1-4f15-b229-67fd89391520 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e does not exist", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:44:26.108947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.security_group_api [None req-6426d533-3db1-4f15-b229-67fd89391520 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Neutron security group rule bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e not found {{(pid=119406) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 09 14:44:26.110050 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6426d533-3db1-4f15-b229-67fd89391520 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] HTTP exception thrown: Security group rule bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e does not exist Aug 09 14:44:26.110050 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-ea58af98-f587-4172-bad1-dfb763d77ed4'] Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6426d533-3db1-4f15-b229-67fd89391520 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Request method failure captured: Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-security-group-rules/bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e HTTP/1.1 Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK-s9a1C4ceq8ywqw2sDtNxkud1aetdU2NkgGies3C4FmtrsaaWPcHu7A7O8f1e3p-r_j5TXB-nJaosa1qp2Oji7HVzqm-ybln_lIWX363iwfLDh69Fqt_l_gQGY-xjudsLosR_LjjAmhkkSjHWF5LcgpgEcL9HEw-fq2fKaiZ1wVg Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ef2893cc1a3480b89c0c91353cf264e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ef2893cc1a3480b89c0c91353cf264e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 0ef2893cc1a3480b89c0c91353cf264e Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439 Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 87eee6fa5d6941cc8dc387879ba9f01a Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: exception: Security group rule bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e does not exist Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-ea58af98-f587-4172-bad1-dfb763d77ed4'] Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e'} Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:44:26.116367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e does not exist Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea58af98-f587-4172-bad1-dfb763d77ed4'] Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e does not exist Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea58af98-f587-4172-bad1-dfb763d77ed4'] Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e does not exist Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea58af98-f587-4172-bad1-dfb763d77ed4'] Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e does not exist Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea58af98-f587-4172-bad1-dfb763d77ed4'] Aug 09 14:44:26.122819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:44:26.137579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6426d533-3db1-4f15-b229-67fd89391520 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Returning 404 to user: Security group rule bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e does not exist Aug 09 14:44:26.137579 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-ea58af98-f587-4172-bad1-dfb763d77ed4'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:26.138292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4661f039-5d79-4214-b374-3db6d24ceb60 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:26.138569 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6426d533-3db1-4f15-b229-67fd89391520 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-group-rules/bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e" status: 404 len: 199 microversion: 2.1 time: 0.169087 Aug 09 14:44:26.148875 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4661f039-5d79-4214-b374-3db6d24ceb60 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1316 microversion: 2.1 time: 0.606509 Aug 09 14:44:26.151499 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1674/3290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:25 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1316 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:26.160388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9921320e-1b7c-4359-a3b7-747942a899cf tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Calling method '.version_select at 0x7f41dc92ed30>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:26.164584 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1617/3291] 10.222.0.50 () {58 vars in 1287 bytes} [Tue Aug 9 14:44:25 2022] DELETE /compute/v2.1/os-security-group-rules/bcbf8bcc-4c24-47d8-a701-f0ceac2dfe2e => generated 199 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:44:26.451932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-849ad577-2ffa-4a54-8ce4-ff3b6aca15ea tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:26.452925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-849ad577-2ffa-4a54-8ce4-ff3b6aca15ea tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:26.464935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-849ad577-2ffa-4a54-8ce4-ff3b6aca15ea tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:26.468214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-849ad577-2ffa-4a54-8ce4-ff3b6aca15ea tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:26.482417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:26.484197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-849ad577-2ffa-4a54-8ce4-ff3b6aca15ea tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:26.488738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-849ad577-2ffa-4a54-8ce4-ff3b6aca15ea tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:26.489455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-849ad577-2ffa-4a54-8ce4-ff3b6aca15ea tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:26.489886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-849ad577-2ffa-4a54-8ce4-ff3b6aca15ea tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:26.975434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-849ad577-2ffa-4a54-8ce4-ff3b6aca15ea tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:26.991839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:26.995909 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-849ad577-2ffa-4a54-8ce4-ff3b6aca15ea tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 0.547210 Aug 09 14:44:26.999713 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1618/3292] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:26 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:44:27.000954 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9921320e-1b7c-4359-a3b7-747942a899cf tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/236ae045-4766-4a0a-b43e-8df1e6b1d6db" status: 202 len: 0 microversion: 2.1 time: 0.848037 Aug 09 14:44:27.001892 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1675/3293] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:44:26 2022] DELETE /compute/v2.1/os-security-groups/236ae045-4766-4a0a-b43e-8df1e6b1d6db => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:44:27.014327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce7bc683-15de-43a0-9315-9bf2dc3ac2a4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddf5b5e0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:27.020142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a8cc9468-96de-47c8-8b56-e3c4e887df34 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Calling method '.version_select at 0x7f41dc92e280>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:27.123712 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ce7bc683-15de-43a0-9315-9bf2dc3ac2a4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.122456 Aug 09 14:44:27.134477 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1619/3294] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:26 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:27.178270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-97b100c9-b501-4a27-be58-c891d753259c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:27.179223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-97b100c9-b501-4a27-be58-c891d753259c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:27.192877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97b100c9-b501-4a27-be58-c891d753259c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:27.193804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97b100c9-b501-4a27-be58-c891d753259c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:27.194474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97b100c9-b501-4a27-be58-c891d753259c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:27.195676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97b100c9-b501-4a27-be58-c891d753259c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:27.196520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97b100c9-b501-4a27-be58-c891d753259c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:27.197582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97b100c9-b501-4a27-be58-c891d753259c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:27.802432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-97b100c9-b501-4a27-be58-c891d753259c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:27.811332 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-97b100c9-b501-4a27-be58-c891d753259c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1316 microversion: 2.1 time: 0.641800 Aug 09 14:44:27.829102 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1620/3295] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:27 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1316 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:28.024357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aeeaf480-5ec5-4cda-9ecf-b37547856cd3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:28.025178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aeeaf480-5ec5-4cda-9ecf-b37547856cd3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:28.044788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeeaf480-5ec5-4cda-9ecf-b37547856cd3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:28.045356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeeaf480-5ec5-4cda-9ecf-b37547856cd3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:28.045948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeeaf480-5ec5-4cda-9ecf-b37547856cd3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:28.046700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeeaf480-5ec5-4cda-9ecf-b37547856cd3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:28.047316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeeaf480-5ec5-4cda-9ecf-b37547856cd3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:28.047747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeeaf480-5ec5-4cda-9ecf-b37547856cd3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:28.083839 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a8cc9468-96de-47c8-8b56-e3c4e887df34 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/38677f15-e8f7-472a-b9b5-a4bcfb9dfb8e" status: 202 len: 0 microversion: 2.1 time: 1.067713 Aug 09 14:44:28.087642 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1676/3296] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:44:27 2022] DELETE /compute/v2.1/os-security-groups/38677f15-e8f7-472a-b9b5-a4bcfb9dfb8e => generated 0 bytes in 1072 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 14:44:28.103827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d16202f-41af-42ac-bd18-bf18117a286e tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Calling method '.version_select at 0x7f41dd58f940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:28.741045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aeeaf480-5ec5-4cda-9ecf-b37547856cd3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:28.771003 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aeeaf480-5ec5-4cda-9ecf-b37547856cd3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 0.751456 Aug 09 14:44:28.773583 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1621/3297] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:28 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:44:28.808347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b7478381-5292-45d4-ac41-db4b55e8c98e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddf3ff70>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:29.051917 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b7478381-5292-45d4-ac41-db4b55e8c98e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.258180 Aug 09 14:44:29.068587 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1622/3298] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:28 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:29.118955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-78a2c3ee-13da-4c9e-90d3-248903e179ec tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:29.126326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-78a2c3ee-13da-4c9e-90d3-248903e179ec tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:29.163730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78a2c3ee-13da-4c9e-90d3-248903e179ec tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:29.175526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78a2c3ee-13da-4c9e-90d3-248903e179ec tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:29.181351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78a2c3ee-13da-4c9e-90d3-248903e179ec tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:29.193071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78a2c3ee-13da-4c9e-90d3-248903e179ec tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:29.201841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78a2c3ee-13da-4c9e-90d3-248903e179ec tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:29.209116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78a2c3ee-13da-4c9e-90d3-248903e179ec tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:30.352213 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d16202f-41af-42ac-bd18-bf18117a286e tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/2ecde91c-3366-42e6-8c9f-961cf15392af" status: 202 len: 0 microversion: 2.1 time: 2.261923 Aug 09 14:44:30.357754 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1677/3299] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:44:28 2022] DELETE /compute/v2.1/os-security-groups/2ecde91c-3366-42e6-8c9f-961cf15392af => generated 0 bytes in 2267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:44:30.383984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc86bd14-3f19-4cfb-93be-88fee14894d8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:30.385858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bc86bd14-3f19-4cfb-93be-88fee14894d8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:30.436962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc86bd14-3f19-4cfb-93be-88fee14894d8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:30.440703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc86bd14-3f19-4cfb-93be-88fee14894d8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:30.444956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc86bd14-3f19-4cfb-93be-88fee14894d8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:30.453810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc86bd14-3f19-4cfb-93be-88fee14894d8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:30.455068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc86bd14-3f19-4cfb-93be-88fee14894d8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:30.457630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc86bd14-3f19-4cfb-93be-88fee14894d8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:30.857745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-78a2c3ee-13da-4c9e-90d3-248903e179ec tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:30.928194 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-78a2c3ee-13da-4c9e-90d3-248903e179ec tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1316 microversion: 2.1 time: 1.858690 Aug 09 14:44:30.931406 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1623/3300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:29 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1316 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:30.949326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-15f73e05-0a4f-4dcf-bf4a-837c59969389 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dd347310>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:31.115773 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-15f73e05-0a4f-4dcf-bf4a-837c59969389 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.179545 Aug 09 14:44:31.118643 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1624/3301] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:30 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:31.144582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a612ccc-826f-4250-b7c8-a925b95fb6e5 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Calling method '.version_select at 0x7f41ddd968b0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:32.088271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bc86bd14-3f19-4cfb-93be-88fee14894d8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:32.105277 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc86bd14-3f19-4cfb-93be-88fee14894d8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 1.743145 Aug 09 14:44:32.106017 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1678/3302] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:30 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:32.143405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e67bfb93-4faf-4a8e-991a-b851474c07f0 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:32.150819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e67bfb93-4faf-4a8e-991a-b851474c07f0 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:32.170179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67bfb93-4faf-4a8e-991a-b851474c07f0 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:32.170696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67bfb93-4faf-4a8e-991a-b851474c07f0 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:32.171157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67bfb93-4faf-4a8e-991a-b851474c07f0 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:32.174683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67bfb93-4faf-4a8e-991a-b851474c07f0 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:32.175202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67bfb93-4faf-4a8e-991a-b851474c07f0 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:32.175637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e67bfb93-4faf-4a8e-991a-b851474c07f0 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:32.642510 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5a612ccc-826f-4250-b7c8-a925b95fb6e5 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/ab1ddb94-27bd-4744-aef1-f0fd3836154e" status: 202 len: 0 microversion: 2.1 time: 1.518983 Aug 09 14:44:32.646355 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1625/3303] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:44:31 2022] DELETE /compute/v2.1/os-security-groups/ab1ddb94-27bd-4744-aef1-f0fd3836154e => generated 0 bytes in 1521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:44:32.650365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-bf018b3c-9a03-47d9-84e7-dabb683e458b req-c8be313e-9c6b-4924-bdb1-4b7a696fa1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136ce1bd-97a7-4072-9bf3-c218db6b023b", "name": "network-vif-plugged", "status": "completed", "tag": "742c23b3-637d-41b6-9013-f8555384198c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:32.685156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bf018b3c-9a03-47d9-84e7-dabb683e458b req-c8be313e-9c6b-4924-bdb1-4b7a696fa1e9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:32.692630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bf018b3c-9a03-47d9-84e7-dabb683e458b req-c8be313e-9c6b-4924-bdb1-4b7a696fa1e9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:32.693554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bf018b3c-9a03-47d9-84e7-dabb683e458b req-c8be313e-9c6b-4924-bdb1-4b7a696fa1e9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:32.729085 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-bf018b3c-9a03-47d9-84e7-dabb683e458b req-c8be313e-9c6b-4924-bdb1-4b7a696fa1e9 service nova] Creating event network-vif-plugged:742c23b3-637d-41b6-9013-f8555384198c for instance 136ce1bd-97a7-4072-9bf3-c218db6b023b on n-h1-844626-8 Aug 09 14:44:32.748868 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-bf018b3c-9a03-47d9-84e7-dabb683e458b req-c8be313e-9c6b-4924-bdb1-4b7a696fa1e9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103420 Aug 09 14:44:32.753291 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1626/3304] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:32.772423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-956163bf-7b43-4379-a905-0051528c4e31 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddec0ee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:32.795641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e67bfb93-4faf-4a8e-991a-b851474c07f0 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:32.852403 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e67bfb93-4faf-4a8e-991a-b851474c07f0 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1316 microversion: 2.1 time: 0.729163 Aug 09 14:44:32.860756 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-956163bf-7b43-4379-a905-0051528c4e31 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.104406 Aug 09 14:44:32.861898 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1627/3305] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:32 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:32.867517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3eeefa6e-a236-417b-a662-bb4105477f24 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] Calling method '.version_select at 0x7f41ddf3f820>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:32.881888 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1679/3306] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:32 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1316 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:33.138058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de66dd46-b517-4251-ab15-88fbf7e46678 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:33.140712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de66dd46-b517-4251-ab15-88fbf7e46678 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:33.168835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de66dd46-b517-4251-ab15-88fbf7e46678 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:33.169614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de66dd46-b517-4251-ab15-88fbf7e46678 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:33.173992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de66dd46-b517-4251-ab15-88fbf7e46678 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:33.178427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de66dd46-b517-4251-ab15-88fbf7e46678 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:33.180668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de66dd46-b517-4251-ab15-88fbf7e46678 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:33.181576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de66dd46-b517-4251-ab15-88fbf7e46678 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:33.352120 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3eeefa6e-a236-417b-a662-bb4105477f24 tempest-SecurityGroupRulesNegativeTestJSON-1966509439 tempest-SecurityGroupRulesNegativeTestJSON-1966509439-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/5a5ddbf0-70a4-48ac-aa0b-def71ada14dc" status: 202 len: 0 microversion: 2.1 time: 0.488767 Aug 09 14:44:33.353309 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1628/3307] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:44:32 2022] DELETE /compute/v2.1/os-security-groups/5a5ddbf0-70a4-48ac-aa0b-def71ada14dc => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:44:33.874859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4afc38e1-0a0f-49e0-91dd-4e1457a481f2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:33.878448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4afc38e1-0a0f-49e0-91dd-4e1457a481f2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:33.897337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4afc38e1-0a0f-49e0-91dd-4e1457a481f2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:33.899716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4afc38e1-0a0f-49e0-91dd-4e1457a481f2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:33.901135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4afc38e1-0a0f-49e0-91dd-4e1457a481f2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:33.901135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4afc38e1-0a0f-49e0-91dd-4e1457a481f2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:33.903703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4afc38e1-0a0f-49e0-91dd-4e1457a481f2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:33.904222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4afc38e1-0a0f-49e0-91dd-4e1457a481f2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:34.232471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-de66dd46-b517-4251-ab15-88fbf7e46678 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:34.246629 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de66dd46-b517-4251-ab15-88fbf7e46678 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 1.119387 Aug 09 14:44:34.248095 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1680/3308] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:33 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:34.259055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84efbcf7-aade-41c0-8069-979f1af1989b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dc9348b0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:34.338424 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-84efbcf7-aade-41c0-8069-979f1af1989b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.087784 Aug 09 14:44:34.339448 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1681/3309] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:34 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:34.364392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4afc38e1-0a0f-49e0-91dd-4e1457a481f2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:34.385903 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4afc38e1-0a0f-49e0-91dd-4e1457a481f2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1316 microversion: 2.1 time: 0.515798 Aug 09 14:44:34.386628 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1629/3310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:33 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1316 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:34.906424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4393fda5-6583-4a5d-bfe3-190337468a35 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:34.914001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4393fda5-6583-4a5d-bfe3-190337468a35 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:34.923447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4393fda5-6583-4a5d-bfe3-190337468a35 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Searching by: {'deleted': False, 'project_id': '46e7f336a89344d4b290ca53afb88a67'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:44:34.951236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4393fda5-6583-4a5d-bfe3-190337468a35 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:34.959991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4393fda5-6583-4a5d-bfe3-190337468a35 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:34.963252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4393fda5-6583-4a5d-bfe3-190337468a35 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:34.966451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4393fda5-6583-4a5d-bfe3-190337468a35 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:34.970772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4393fda5-6583-4a5d-bfe3-190337468a35 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:34.972474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4393fda5-6583-4a5d-bfe3-190337468a35 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:35.088000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-4393fda5-6583-4a5d-bfe3-190337468a35 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:44:35.195243 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4393fda5-6583-4a5d-bfe3-190337468a35 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.292688 Aug 09 14:44:35.206544 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1682/3311] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 14:44:34 2022] GET /compute/v2.1/servers => generated 334 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:35.216306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:35.222859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:35.230249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Searching by: {'deleted': False, 'project_id': '46e7f336a89344d4b290ca53afb88a67'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:44:35.253955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:35.254456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:35.254886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:35.267555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:35.272463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:35.276596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:35.301345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a59a09ee-21f8-4ac0-8719-fbf39ff256e3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:35.304746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a59a09ee-21f8-4ac0-8719-fbf39ff256e3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:35.318019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59a09ee-21f8-4ac0-8719-fbf39ff256e3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:35.325310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59a09ee-21f8-4ac0-8719-fbf39ff256e3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:35.328748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59a09ee-21f8-4ac0-8719-fbf39ff256e3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:35.332525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59a09ee-21f8-4ac0-8719-fbf39ff256e3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:35.334924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59a09ee-21f8-4ac0-8719-fbf39ff256e3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:35.336626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a59a09ee-21f8-4ac0-8719-fbf39ff256e3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:35.360440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:44:35.547223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:35.579849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=44 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:35.600610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:35.601991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:35.604512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:36.438514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a59a09ee-21f8-4ac0-8719-fbf39ff256e3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:36.444865 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5f8eec93-8480-4aca-82fb-a06f998f8e24 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 1.232193 Aug 09 14:44:36.446836 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1630/3312] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:44:35 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:36.458396 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a59a09ee-21f8-4ac0-8719-fbf39ff256e3 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1524 microversion: 2.1 time: 1.154375 Aug 09 14:44:36.462508 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1683/3313] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:35 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1524 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:36.469123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bc5fab8-bf84-4b83-8a15-33a7c7ed8fd9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41de16cc10>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:36.477116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c82d91b-14f8-48af-9edd-277b60183878 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:36.489373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5c82d91b-14f8-48af-9edd-277b60183878 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:36.536104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c82d91b-14f8-48af-9edd-277b60183878 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:36.537373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c82d91b-14f8-48af-9edd-277b60183878 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:36.544748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c82d91b-14f8-48af-9edd-277b60183878 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:36.548704 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8bc5fab8-bf84-4b83-8a15-33a7c7ed8fd9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.100071 Aug 09 14:44:36.550514 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1631/3314] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:36 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:36.555621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-099ac1e6-1bc6-44b5-8d64-a4fe1583c1d8 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:36.565905 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-099ac1e6-1bc6-44b5-8d64-a4fe1583c1d8 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013933 Aug 09 14:44:36.567378 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1632/3315] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:44:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:36.573534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c82d91b-14f8-48af-9edd-277b60183878 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:36.574376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c82d91b-14f8-48af-9edd-277b60183878 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:36.575812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5c82d91b-14f8-48af-9edd-277b60183878 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:36.914352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-511662a7-3a9a-44cb-a8bf-c1bb7761a44e tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:36.914995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-511662a7-3a9a-44cb-a8bf-c1bb7761a44e tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:36.928373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-511662a7-3a9a-44cb-a8bf-c1bb7761a44e tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:36.930507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-511662a7-3a9a-44cb-a8bf-c1bb7761a44e tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:36.931056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-511662a7-3a9a-44cb-a8bf-c1bb7761a44e tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:36.933136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-511662a7-3a9a-44cb-a8bf-c1bb7761a44e tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:36.935894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-511662a7-3a9a-44cb-a8bf-c1bb7761a44e tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:36.937864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-511662a7-3a9a-44cb-a8bf-c1bb7761a44e tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:37.052391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-511662a7-3a9a-44cb-a8bf-c1bb7761a44e tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:44:37.263001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:37.390521 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-511662a7-3a9a-44cb-a8bf-c1bb7761a44e tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "DELETE /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 204 len: 0 microversion: 2.1 time: 0.476540 Aug 09 14:44:37.392651 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1633/3316] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:44:36 2022] DELETE /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:44:37.401133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5c82d91b-14f8-48af-9edd-277b60183878 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:37.415372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-740e6a39-27f7-49cd-8562-9ef388620a58 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:37.421531 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c82d91b-14f8-48af-9edd-277b60183878 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1504 microversion: 2.1 time: 0.957380 Aug 09 14:44:37.421911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-740e6a39-27f7-49cd-8562-9ef388620a58 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:37.426569 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1684/3317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:36 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1504 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:37.455792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740e6a39-27f7-49cd-8562-9ef388620a58 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:37.458796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740e6a39-27f7-49cd-8562-9ef388620a58 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:37.459709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740e6a39-27f7-49cd-8562-9ef388620a58 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:37.462385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740e6a39-27f7-49cd-8562-9ef388620a58 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:37.465343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1a710dde-ba5e-4b40-abaf-720896e97fd4 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-186883662"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:37.466479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740e6a39-27f7-49cd-8562-9ef388620a58 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:37.468243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1a710dde-ba5e-4b40-abaf-720896e97fd4 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:37.472857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740e6a39-27f7-49cd-8562-9ef388620a58 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:37.479224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a710dde-ba5e-4b40-abaf-720896e97fd4 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:37.480407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a710dde-ba5e-4b40-abaf-720896e97fd4 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:37.481371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a710dde-ba5e-4b40-abaf-720896e97fd4 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:37.482872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a710dde-ba5e-4b40-abaf-720896e97fd4 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:37.483916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a710dde-ba5e-4b40-abaf-720896e97fd4 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:37.487395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a710dde-ba5e-4b40-abaf-720896e97fd4 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:38.477265 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.network.security_group_api [None req-1a710dde-ba5e-4b40-abaf-720896e97fd4 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Adding security group 42e24b96-306e-45fa-85d2-af7da279c5d9 to port 742c23b3-637d-41b6-9013-f8555384198c Aug 09 14:44:38.914881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-740e6a39-27f7-49cd-8562-9ef388620a58 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:38.988112 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-740e6a39-27f7-49cd-8562-9ef388620a58 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1702 microversion: 2.1 time: 1.584255 Aug 09 14:44:38.991174 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1634/3318] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:37 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1702 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:39.003152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e2922b42-04e6-4421-ba6a-2a0f3d2d930a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:39.027871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e2922b42-04e6-4421-ba6a-2a0f3d2d930a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:39.096873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2922b42-04e6-4421-ba6a-2a0f3d2d930a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:39.107931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2922b42-04e6-4421-ba6a-2a0f3d2d930a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:39.108701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2922b42-04e6-4421-ba6a-2a0f3d2d930a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:39.117497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2922b42-04e6-4421-ba6a-2a0f3d2d930a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:39.118325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2922b42-04e6-4421-ba6a-2a0f3d2d930a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:39.119116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2922b42-04e6-4421-ba6a-2a0f3d2d930a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:40.629554 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1a710dde-ba5e-4b40-abaf-720896e97fd4 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b/action" status: 202 len: 0 microversion: 2.1 time: 3.172184 Aug 09 14:44:40.631649 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1685/3319] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:44:37 2022] POST /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b/action => generated 0 bytes in 3176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 14:44:40.681109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ca478da-a058-4fa4-ad40-34c97ce1f4fe tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dc8c7820>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:40.946326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e2922b42-04e6-4421-ba6a-2a0f3d2d930a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:40.962035 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ca478da-a058-4fa4-ad40-34c97ce1f4fe tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.327770 Aug 09 14:44:40.967451 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1686/3320] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:40 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:40.977878 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e2922b42-04e6-4421-ba6a-2a0f3d2d930a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1504 microversion: 2.1 time: 1.985455 Aug 09 14:44:40.994323 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1635/3321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:38 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1504 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:40.994491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-56155692-b2b7-4b00-8e0c-02b941a538e0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:40.994491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-56155692-b2b7-4b00-8e0c-02b941a538e0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:41.034713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-adc90082-dbab-4d78-b9bb-cb08751caa40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1994564960"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:41.039464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-adc90082-dbab-4d78-b9bb-cb08751caa40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:41.052825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56155692-b2b7-4b00-8e0c-02b941a538e0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:41.053950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56155692-b2b7-4b00-8e0c-02b941a538e0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:41.055639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56155692-b2b7-4b00-8e0c-02b941a538e0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:41.058028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56155692-b2b7-4b00-8e0c-02b941a538e0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:41.058778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56155692-b2b7-4b00-8e0c-02b941a538e0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:41.060910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56155692-b2b7-4b00-8e0c-02b941a538e0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:41.074642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:41.090834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adc90082-dbab-4d78-b9bb-cb08751caa40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:41.102604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adc90082-dbab-4d78-b9bb-cb08751caa40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:41.109937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adc90082-dbab-4d78-b9bb-cb08751caa40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:41.116804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adc90082-dbab-4d78-b9bb-cb08751caa40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:41.118050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adc90082-dbab-4d78-b9bb-cb08751caa40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:41.119006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adc90082-dbab-4d78-b9bb-cb08751caa40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:43.486241 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.network.security_group_api [None req-adc90082-dbab-4d78-b9bb-cb08751caa40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Adding security group c0f2b6d0-e467-47e3-88ab-03d9d53243ad to port 742c23b3-637d-41b6-9013-f8555384198c Aug 09 14:44:43.573422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-56155692-b2b7-4b00-8e0c-02b941a538e0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:43.605962 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-56155692-b2b7-4b00-8e0c-02b941a538e0 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1702 microversion: 2.1 time: 2.633198 Aug 09 14:44:43.616866 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1687/3322] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:40 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1702 bytes in 2648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:43.662182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-aa5ddbd4-6e02-4480-af03-0802f7fe50c0 req-d1e83166-b7be-46e8-92dd-697c2418d053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136ce1bd-97a7-4072-9bf3-c218db6b023b", "tag": "742c23b3-637d-41b6-9013-f8555384198c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:43.711755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-aa5ddbd4-6e02-4480-af03-0802f7fe50c0 req-d1e83166-b7be-46e8-92dd-697c2418d053 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:43.712577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-aa5ddbd4-6e02-4480-af03-0802f7fe50c0 req-d1e83166-b7be-46e8-92dd-697c2418d053 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:43.713592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-aa5ddbd4-6e02-4480-af03-0802f7fe50c0 req-d1e83166-b7be-46e8-92dd-697c2418d053 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:43.748602 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-aa5ddbd4-6e02-4480-af03-0802f7fe50c0 req-d1e83166-b7be-46e8-92dd-697c2418d053 service nova] Creating event network-changed:742c23b3-637d-41b6-9013-f8555384198c for instance 136ce1bd-97a7-4072-9bf3-c218db6b023b on n-h1-844626-8 Aug 09 14:44:43.759568 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-aa5ddbd4-6e02-4480-af03-0802f7fe50c0 req-d1e83166-b7be-46e8-92dd-697c2418d053 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140404 Aug 09 14:44:43.761291 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1688/3323] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:43.773713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-61b53cd6-87ed-41bd-8368-9ef8c2e7f1ec tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Action: 'create', calling method: .version_select at 0x7f41dcbdb790>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-700411546", "description": "tempest-description-1637953746"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:45.023454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:45.304325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:45.531633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:45.748209 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-61b53cd6-87ed-41bd-8368-9ef8c2e7f1ec tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.984513 Aug 09 14:44:45.765773 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1689/3324] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:44:43 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:45.779318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f19fb750-14dc-42dc-8f74-db0acba9ffe7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dc8fc700>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:45.897807 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f19fb750-14dc-42dc-8f74-db0acba9ffe7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1440 microversion: 2.1 time: 0.129720 Aug 09 14:44:45.901778 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1690/3325] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:45 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1440 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:45.909663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-7344548d-316c-40c7-8d03-c8423dead981 req-53ae208f-403a-497c-9576-1e187744c72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a2a79d-0cb7-4f9f-9b23-13b4b566c043", "name": "network-vif-unplugged", "status": "completed", "tag": "75d75b68-e994-4644-9c35-1692aa641cb5"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:45.946051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7344548d-316c-40c7-8d03-c8423dead981 req-53ae208f-403a-497c-9576-1e187744c72a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:45.949014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7344548d-316c-40c7-8d03-c8423dead981 req-53ae208f-403a-497c-9576-1e187744c72a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:45.950056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7344548d-316c-40c7-8d03-c8423dead981 req-53ae208f-403a-497c-9576-1e187744c72a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:45.998160 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-7344548d-316c-40c7-8d03-c8423dead981 req-53ae208f-403a-497c-9576-1e187744c72a service nova] Creating event network-vif-unplugged:75d75b68-e994-4644-9c35-1692aa641cb5 for instance e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 on n-h2-844626-8 Aug 09 14:44:46.023976 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-7344548d-316c-40c7-8d03-c8423dead981 req-53ae208f-403a-497c-9576-1e187744c72a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122658 Aug 09 14:44:46.050074 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1691/3326] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:46.074486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e22c08f5-bbcb-464d-a9d2-4dcc1b62cfc1 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:46.075810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e22c08f5-bbcb-464d-a9d2-4dcc1b62cfc1 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:46.102703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e22c08f5-bbcb-464d-a9d2-4dcc1b62cfc1 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:46.103538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e22c08f5-bbcb-464d-a9d2-4dcc1b62cfc1 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:46.104294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e22c08f5-bbcb-464d-a9d2-4dcc1b62cfc1 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:46.105528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e22c08f5-bbcb-464d-a9d2-4dcc1b62cfc1 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:46.106341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e22c08f5-bbcb-464d-a9d2-4dcc1b62cfc1 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:46.107064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e22c08f5-bbcb-464d-a9d2-4dcc1b62cfc1 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:46.421494 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-adc90082-dbab-4d78-b9bb-cb08751caa40 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b/action" status: 202 len: 0 microversion: 2.1 time: 5.430350 Aug 09 14:44:46.421494 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1636/3327] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:44:40 2022] POST /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b/action => generated 0 bytes in 5435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:44:46.434825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f448e2d7-49c2-4b4c-862c-85d345301892 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-700411546"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:46.451438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f448e2d7-49c2-4b4c-862c-85d345301892 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:46.479196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e22c08f5-bbcb-464d-a9d2-4dcc1b62cfc1 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e06d9e017984792867874887aa80991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e7f336a89344d4b290ca53afb88a67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:44:46.487965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f448e2d7-49c2-4b4c-862c-85d345301892 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:46.488791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f448e2d7-49c2-4b4c-862c-85d345301892 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:46.489547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f448e2d7-49c2-4b4c-862c-85d345301892 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:46.504844 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e22c08f5-bbcb-464d-a9d2-4dcc1b62cfc1 tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 200 len: 1635 microversion: 2.1 time: 0.452363 Aug 09 14:44:46.506259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f448e2d7-49c2-4b4c-862c-85d345301892 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:46.506758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f448e2d7-49c2-4b4c-862c-85d345301892 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:46.507224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f448e2d7-49c2-4b4c-862c-85d345301892 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:46.511886 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1692/3328] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:46 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 1635 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:46.528165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a18f0009-8744-4b9f-ae21-6a0caaa14f3a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:46.529021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a18f0009-8744-4b9f-ae21-6a0caaa14f3a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:46.573922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a18f0009-8744-4b9f-ae21-6a0caaa14f3a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:46.577562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a18f0009-8744-4b9f-ae21-6a0caaa14f3a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:46.579240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a18f0009-8744-4b9f-ae21-6a0caaa14f3a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:46.583194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a18f0009-8744-4b9f-ae21-6a0caaa14f3a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:46.585790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a18f0009-8744-4b9f-ae21-6a0caaa14f3a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:46.587884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a18f0009-8744-4b9f-ae21-6a0caaa14f3a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:47.855057 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a18f0009-8744-4b9f-ae21-6a0caaa14f3a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.341688 Aug 09 14:44:47.857002 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1693/3329] 10.222.0.50 () {58 vars in 1293 bytes} [Tue Aug 9 14:44:46 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b/os-security-groups => generated 1157 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:47.861909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-fb2f1ddb-7cc9-404b-8db0-91c6feb78c91 req-8cc2df6c-f9f0-431e-a07a-7d3cd20c0e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136ce1bd-97a7-4072-9bf3-c218db6b023b", "tag": "742c23b3-637d-41b6-9013-f8555384198c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:47.880078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fb2f1ddb-7cc9-404b-8db0-91c6feb78c91 req-8cc2df6c-f9f0-431e-a07a-7d3cd20c0e0e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:47.886654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fb2f1ddb-7cc9-404b-8db0-91c6feb78c91 req-8cc2df6c-f9f0-431e-a07a-7d3cd20c0e0e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:47.887907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fb2f1ddb-7cc9-404b-8db0-91c6feb78c91 req-8cc2df6c-f9f0-431e-a07a-7d3cd20c0e0e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:47.900046 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.network.security_group_api [None req-f448e2d7-49c2-4b4c-862c-85d345301892 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Adding security group c4316a77-8fec-4be4-b11b-b89c3732e2a0 to port 8e65bee5-f93d-4d11-9c50-0909cf992d51 Aug 09 14:44:47.918548 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-fb2f1ddb-7cc9-404b-8db0-91c6feb78c91 req-8cc2df6c-f9f0-431e-a07a-7d3cd20c0e0e service nova] Creating event network-changed:742c23b3-637d-41b6-9013-f8555384198c for instance 136ce1bd-97a7-4072-9bf3-c218db6b023b on n-h1-844626-8 Aug 09 14:44:47.934891 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-fb2f1ddb-7cc9-404b-8db0-91c6feb78c91 req-8cc2df6c-f9f0-431e-a07a-7d3cd20c0e0e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075918 Aug 09 14:44:47.937278 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1694/3330] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:47.950079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8a55607e-62a2-4886-a8dd-f6b8974174a0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dc902160>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:48.110838 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8a55607e-62a2-4886-a8dd-f6b8974174a0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1449 microversion: 2.1 time: 0.172124 Aug 09 14:44:48.111492 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1695/3331] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:47 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1449 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:48.125029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe4fddf6-6f02-4c55-b343-dad8039fcebe tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:48.137766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe4fddf6-6f02-4c55-b343-dad8039fcebe tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] [instance: e9a2a79d-0cb7-4f9f-9b23-13b4b566c043] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:48.154772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe4fddf6-6f02-4c55-b343-dad8039fcebe tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:48.157598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe4fddf6-6f02-4c55-b343-dad8039fcebe tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:48.158207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe4fddf6-6f02-4c55-b343-dad8039fcebe tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:48.159247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe4fddf6-6f02-4c55-b343-dad8039fcebe tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:48.161662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe4fddf6-6f02-4c55-b343-dad8039fcebe tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:48.162312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe4fddf6-6f02-4c55-b343-dad8039fcebe tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:48.199767 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-fe4fddf6-6f02-4c55-b343-dad8039fcebe tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] HTTP exception thrown: Instance e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 could not be found. Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe4fddf6-6f02-4c55-b343-dad8039fcebe tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Request method failure captured: Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 HTTP/1.1 Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nKF4RXs3L-KiufE-buNRQfLr9OUIZ5Q-Kow-QpdGx27FdUscycvxVYMiuwb-y1irbIAOOSMBU_Mc8HkHz5NSQsh9foRneAAmY26sZpMMUrN4U9LaiMKlZwrkOGuEL39OmKaU60gjKTy-Ze6R-3dyuLcBu9rMxyGVXxbu9qeKVT8iVk Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 46e7f336a89344d4b290ca53afb88a67 Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestJSON-169674042 Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_46e7f336a89344d4b290ca53afb88a67", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/46e7f336a89344d4b290ca53afb88a67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/46e7f336a89344d4b290ca53afb88a67"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/46e7f336a89344d4b290ca53afb88a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestJSON-169674042 Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 46e7f336a89344d4b290ca53afb88a67 Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestJSON-169674042 Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestJSON-169674042-project Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 7e06d9e017984792867874887aa80991 Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestJSON-169674042-project Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 could not be found. Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'e9a2a79d-0cb7-4f9f-9b23-13b4b566c043'} Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 could not be found. Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 could not be found. Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:48.205079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:48.210577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:48.210577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:48.210577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:48.210577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:48.210577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 could not be found. Aug 09 14:44:48.210577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:48.214686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe4fddf6-6f02-4c55-b343-dad8039fcebe tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Returning 404 to user: Instance e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:48.229088 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe4fddf6-6f02-4c55-b343-dad8039fcebe tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043" status: 404 len: 111 microversion: 2.1 time: 0.107351 Aug 09 14:44:48.244316 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1696/3332] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:48 2022] GET /compute/v2.1/servers/e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:44:48.289874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ebbd8e60-89ae-49e1-9593-0167c862541c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'create', calling method: .version_select at 0x7f41dc8fc820>, body: {"security_group": {"name": " tempest-securitygroup -479056494 ", "description": "tempest-description-680269440"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:50.312806 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ebbd8e60-89ae-49e1-9593-0167c862541c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 2.066454 Aug 09 14:44:50.314116 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1697/3333] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:44:48 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:50.319738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8aa9af1-90c8-4ea7-96e1-b6dc159165e6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dc92e4c0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:50.413363 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8aa9af1-90c8-4ea7-96e1-b6dc159165e6 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 200 len: 1449 microversion: 2.1 time: 0.097956 Aug 09 14:44:50.425475 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1698/3334] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:44:50 2022] GET /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 1449 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:44:50.443261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6658a4d1-ef19-4979-80c6-158944492c2c tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] Calling method '.version_select at 0x7f41dc8fca60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:50.457398 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f448e2d7-49c2-4b4c-862c-85d345301892 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "POST /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920/action" status: 202 len: 0 microversion: 2.1 time: 4.035055 Aug 09 14:44:50.459321 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1637/3335] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:44:46 2022] POST /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920/action => generated 0 bytes in 4038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:44:50.465366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7adc7662-17d3-46f9-b44a-30fdf30838af req-a46ab7d6-b3a9-409c-ae48-692fdca4e10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a2a79d-0cb7-4f9f-9b23-13b4b566c043", "name": "network-vif-deleted", "tag": "75d75b68-e994-4644-9c35-1692aa641cb5"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:50.507801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7adc7662-17d3-46f9-b44a-30fdf30838af req-a46ab7d6-b3a9-409c-ae48-692fdca4e10d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:50.508275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7adc7662-17d3-46f9-b44a-30fdf30838af req-a46ab7d6-b3a9-409c-ae48-692fdca4e10d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:50.520930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7adc7662-17d3-46f9-b44a-30fdf30838af req-a46ab7d6-b3a9-409c-ae48-692fdca4e10d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:50.526236 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6658a4d1-ef19-4979-80c6-158944492c2c tempest-ServersTestJSON-169674042 tempest-ServersTestJSON-169674042-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480517280" status: 202 len: 0 microversion: 2.1 time: 0.099072 Aug 09 14:44:50.534172 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1699/3336] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 14:44:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480517280 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:44:50.551669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32c74036-a454-4c31-bd14-2cee45e687fa tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dd3299d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:50.582249 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7adc7662-17d3-46f9-b44a-30fdf30838af req-a46ab7d6-b3a9-409c-ae48-692fdca4e10d service nova] Creating event network-vif-deleted:75d75b68-e994-4644-9c35-1692aa641cb5 for instance e9a2a79d-0cb7-4f9f-9b23-13b4b566c043 on n-h2-844626-8 Aug 09 14:44:50.616777 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7adc7662-17d3-46f9-b44a-30fdf30838af req-a46ab7d6-b3a9-409c-ae48-692fdca4e10d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155935 Aug 09 14:44:50.625625 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1638/3337] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:50.637816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-afdb6aab-4d96-432e-8a3e-9e3198b030f9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddd71160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:51.094151 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32c74036-a454-4c31-bd14-2cee45e687fa tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/0d6fdab7-e465-451c-9e07-c66eecc9ceef" status: 200 len: 222 microversion: 2.1 time: 0.558707 Aug 09 14:44:51.095296 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1700/3338] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:44:50 2022] GET /compute/v2.1/os-security-groups/0d6fdab7-e465-451c-9e07-c66eecc9ceef => generated 222 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:51.109027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7e0470fc-6d37-4e1a-8af1-767273fa1b26 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-700411546"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:51.109799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7e0470fc-6d37-4e1a-8af1-767273fa1b26 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:51.137422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e0470fc-6d37-4e1a-8af1-767273fa1b26 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:51.138045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e0470fc-6d37-4e1a-8af1-767273fa1b26 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:51.138765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e0470fc-6d37-4e1a-8af1-767273fa1b26 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:51.141281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e0470fc-6d37-4e1a-8af1-767273fa1b26 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:51.141903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e0470fc-6d37-4e1a-8af1-767273fa1b26 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:51.147853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e0470fc-6d37-4e1a-8af1-767273fa1b26 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:51.780477 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-afdb6aab-4d96-432e-8a3e-9e3198b030f9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 204 len: 0 microversion: 2.1 time: 1.153361 Aug 09 14:44:51.785537 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1639/3339] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:50 2022] DELETE /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 0 bytes in 1159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:44:51.793958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5d9692f-2c4a-484f-b508-997c658a9c97 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41e7592040>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:52.021474 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.network.security_group_api [None req-7e0470fc-6d37-4e1a-8af1-767273fa1b26 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Removing security group c4316a77-8fec-4be4-b11b-b89c3732e2a0 from port 8e65bee5-f93d-4d11-9c50-0909cf992d51 Aug 09 14:44:53.419947 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5d9692f-2c4a-484f-b508-997c658a9c97 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/0d6fdab7-e465-451c-9e07-c66eecc9ceef" status: 202 len: 0 microversion: 2.1 time: 1.631545 Aug 09 14:44:53.421317 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1640/3340] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:44:51 2022] DELETE /compute/v2.1/os-security-groups/0d6fdab7-e465-451c-9e07-c66eecc9ceef => generated 0 bytes in 1634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:44:53.441235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ed502c1f-7df3-446e-ab28-70028eda7f65 req-58358214-a35e-415c-a204-5353f88978da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b708eb-9c45-4e12-8917-50a349e7f0f4", "name": "network-vif-unplugged", "status": "completed", "tag": "a835f71e-30b9-4171-aeed-864546a009c0"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:53.499675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ed502c1f-7df3-446e-ab28-70028eda7f65 req-58358214-a35e-415c-a204-5353f88978da service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:53.500494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ed502c1f-7df3-446e-ab28-70028eda7f65 req-58358214-a35e-415c-a204-5353f88978da service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:53.504056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ed502c1f-7df3-446e-ab28-70028eda7f65 req-58358214-a35e-415c-a204-5353f88978da service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:53.573841 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ed502c1f-7df3-446e-ab28-70028eda7f65 req-58358214-a35e-415c-a204-5353f88978da service nova] Creating event network-vif-unplugged:a835f71e-30b9-4171-aeed-864546a009c0 for instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 on n-h2-844626-8 Aug 09 14:44:53.596554 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ed502c1f-7df3-446e-ab28-70028eda7f65 req-58358214-a35e-415c-a204-5353f88978da service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173120 Aug 09 14:44:53.603573 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1641/3341] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:53.629157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-58179d5e-5505-4b6f-a991-675a7f772dfa tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:53.631573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-58179d5e-5505-4b6f-a991-675a7f772dfa tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:44:53.666095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58179d5e-5505-4b6f-a991-675a7f772dfa tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:53.670187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58179d5e-5505-4b6f-a991-675a7f772dfa tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:53.671349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58179d5e-5505-4b6f-a991-675a7f772dfa tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:53.679288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58179d5e-5505-4b6f-a991-675a7f772dfa tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:53.683122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58179d5e-5505-4b6f-a991-675a7f772dfa tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:53.688708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58179d5e-5505-4b6f-a991-675a7f772dfa tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:53.773689 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7e0470fc-6d37-4e1a-8af1-767273fa1b26 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "POST /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920/action" status: 202 len: 0 microversion: 2.1 time: 2.676376 Aug 09 14:44:53.775448 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1701/3342] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:44:51 2022] POST /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920/action => generated 0 bytes in 2679 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:44:53.779440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-e52f5771-198e-4363-830a-e92edce3312e req-8efa485c-8980-4de8-843c-13e9e2e4f7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c707b9-a4e0-4d5a-98f4-a8c8f9d82920", "tag": "8e65bee5-f93d-4d11-9c50-0909cf992d51"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:53.813980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e52f5771-198e-4363-830a-e92edce3312e req-8efa485c-8980-4de8-843c-13e9e2e4f7e6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:53.814458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e52f5771-198e-4363-830a-e92edce3312e req-8efa485c-8980-4de8-843c-13e9e2e4f7e6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:53.815143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e52f5771-198e-4363-830a-e92edce3312e req-8efa485c-8980-4de8-843c-13e9e2e4f7e6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:53.838088 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-e52f5771-198e-4363-830a-e92edce3312e req-8efa485c-8980-4de8-843c-13e9e2e4f7e6 service nova] Creating event network-changed:8e65bee5-f93d-4d11-9c50-0909cf992d51 for instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 on n-h1-844626-8 Aug 09 14:44:53.852462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-58179d5e-5505-4b6f-a991-675a7f772dfa tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:44:53.867359 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-e52f5771-198e-4363-830a-e92edce3312e req-8efa485c-8980-4de8-843c-13e9e2e4f7e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091377 Aug 09 14:44:53.867987 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1702/3343] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:53.891062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05edc286-4c4a-4023-b34c-431b0e5b782e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dc902160>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:54.070919 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-58179d5e-5505-4b6f-a991-675a7f772dfa tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 204 len: 0 microversion: 2.1 time: 0.464959 Aug 09 14:44:54.071982 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1642/3344] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:44:53 2022] DELETE /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:44:54.079657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1eeb5ecf-429b-4607-bdd0-a103991f751a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Action: 'create', calling method: .version_select at 0x7f41ddd71c10>, body: {"pool": null} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:54.296698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG neutronclient.v2_0.client [None req-05edc286-4c4a-4023-b34c-431b0e5b782e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist", "detail": ""}} {{(pid=119407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:44:54.297464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.security_group_api [None req-05edc286-4c4a-4023-b34c-431b0e5b782e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Neutron security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef not found {{(pid=119407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:44:54.298109 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-05edc286-4c4a-4023-b34c-431b0e5b782e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:44:54.298109 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-ebe5fa05-5699-40ca-8ab9-68695b1178e7'] Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05edc286-4c4a-4023-b34c-431b0e5b782e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-security-groups/0d6fdab7-e465-451c-9e07-c66eecc9ceef HTTP/1.1 Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: exception: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-ebe5fa05-5699-40ca-8ab9-68695b1178e7'] Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '0d6fdab7-e465-451c-9e07-c66eecc9ceef'} Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:44:54.300599 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebe5fa05-5699-40ca-8ab9-68695b1178e7'] Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebe5fa05-5699-40ca-8ab9-68695b1178e7'] Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebe5fa05-5699-40ca-8ab9-68695b1178e7'] Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebe5fa05-5699-40ca-8ab9-68695b1178e7'] Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05edc286-4c4a-4023-b34c-431b0e5b782e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:44:54.305787 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-ebe5fa05-5699-40ca-8ab9-68695b1178e7'] {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:44:54.310018 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05edc286-4c4a-4023-b34c-431b0e5b782e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/0d6fdab7-e465-451c-9e07-c66eecc9ceef" status: 404 len: 194 microversion: 2.1 time: 0.440550 Aug 09 14:44:54.318763 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1703/3345] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:44:53 2022] GET /compute/v2.1/os-security-groups/0d6fdab7-e465-451c-9e07-c66eecc9ceef => generated 194 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:44:54.334340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7e97c53b-3e8e-4ba5-adac-960c38c0f210 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'create', calling method: .version_select at 0x7f41dd169ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1411613904", "description": "tempest-description-1067973056"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:56.059862 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7e97c53b-3e8e-4ba5-adac-960c38c0f210 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.739467 Aug 09 14:44:56.061647 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1704/3346] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:44:54 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:56.082890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1728433341", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "2885fc04-1f81-4377-a25b-f064edeb4235"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:56.094462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:44:56.179023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] validate_networks() for [('2885fc04-1f81-4377-a25b-f064edeb4235', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:44:58.357277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:44:58.358350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:44:58.358998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:44:58.360591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:44:58.361221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:44:58.388276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:58.391557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:58.392081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:58.396007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:58.396588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:58.397485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:58.471128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Getting quotas for project 426fbb89ba614432b3a0cb87e0e4cd69. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:44:58.491412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Getting quotas for user d1d53fbb760a4b9282197668b9296c38 and project 426fbb89ba614432b3a0cb87e0e4cd69. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:44:58.528339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:44:58.532857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:44:58.722270 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c499626d-debc-4cb5-aa2e-dcd79a6e8404 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.659297 Aug 09 14:44:58.732128 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1705/3347] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:44:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:44:58.738699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-7d59f8f2-84b2-423a-babf-d495448ca7d6 req-bdb13597-2855-4e23-a126-dcfde8677404 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c707b9-a4e0-4d5a-98f4-a8c8f9d82920", "tag": "8e65bee5-f93d-4d11-9c50-0909cf992d51"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:58.772597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7d59f8f2-84b2-423a-babf-d495448ca7d6 req-bdb13597-2855-4e23-a126-dcfde8677404 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:44:58.773513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7d59f8f2-84b2-423a-babf-d495448ca7d6 req-bdb13597-2855-4e23-a126-dcfde8677404 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:44:58.775154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7d59f8f2-84b2-423a-babf-d495448ca7d6 req-bdb13597-2855-4e23-a126-dcfde8677404 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:44:58.807409 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-7d59f8f2-84b2-423a-babf-d495448ca7d6 req-bdb13597-2855-4e23-a126-dcfde8677404 service nova] Creating event network-changed:8e65bee5-f93d-4d11-9c50-0909cf992d51 for instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 on n-h1-844626-8 Aug 09 14:44:58.844691 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-7d59f8f2-84b2-423a-babf-d495448ca7d6 req-bdb13597-2855-4e23-a126-dcfde8677404 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110917 Aug 09 14:44:58.845312 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1706/3348] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:58.876305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1bc9e08b-ac96-47e7-bc94-f8edf37a876d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'create', calling method: .version_select at 0x7f41dc9348b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-386376730", "description": "tempest-description-897262879"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:44:59.832628 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1bc9e08b-ac96-47e7-bc94-f8edf37a876d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.986028 Aug 09 14:44:59.833912 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1707/3349] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:44:58 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:44:59.858968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5f9b13fc-0b92-4b0c-86c6-282f35531245 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:44:59.860204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5f9b13fc-0b92-4b0c-86c6-282f35531245 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:00.031445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5f9b13fc-0b92-4b0c-86c6-282f35531245 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:00.044478 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5f9b13fc-0b92-4b0c-86c6-282f35531245 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1208 microversion: 2.1 time: 0.206882 Aug 09 14:45:00.045181 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1708/3350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:44:59 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1208 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:00.052224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-50abea75-db64-4025-a27e-d7bb192a408c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'create', calling method: .version_select at 0x7f41dc92b700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-424804147", "description": "tempest-description-39374571"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:00.916256 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50abea75-db64-4025-a27e-d7bb192a408c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.869326 Aug 09 14:45:00.917713 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1709/3351] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:45:00 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:00.923320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-7d5bfd0b-164d-466f-bd97-813a069e5462 req-1b6306b5-5055-4da8-8930-2b263a4e12dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65b708eb-9c45-4e12-8917-50a349e7f0f4", "name": "network-vif-deleted", "tag": "a835f71e-30b9-4171-aeed-864546a009c0"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:00.966091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7d5bfd0b-164d-466f-bd97-813a069e5462 req-1b6306b5-5055-4da8-8930-2b263a4e12dd service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:00.968497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7d5bfd0b-164d-466f-bd97-813a069e5462 req-1b6306b5-5055-4da8-8930-2b263a4e12dd service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:00.969787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7d5bfd0b-164d-466f-bd97-813a069e5462 req-1b6306b5-5055-4da8-8930-2b263a4e12dd service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:00.998934 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-7d5bfd0b-164d-466f-bd97-813a069e5462 req-1b6306b5-5055-4da8-8930-2b263a4e12dd service nova] Creating event network-vif-deleted:a835f71e-30b9-4171-aeed-864546a009c0 for instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 on n-h2-844626-8 Aug 09 14:45:01.053284 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-7d5bfd0b-164d-466f-bd97-813a069e5462 req-1b6306b5-5055-4da8-8930-2b263a4e12dd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134026 Aug 09 14:45:01.058547 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1710/3352] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:01.070859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7cf3cba8-d2ae-4bc1-8ca5-742a7a0e3bb3 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dc8d18b0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:01.696589 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1eeb5ecf-429b-4607-bdd0-a103991f751a tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.622803 Aug 09 14:45:01.697646 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1643/3353] 10.222.0.50 () {60 vars in 1170 bytes} [Tue Aug 9 14:44:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:01.712995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6527d661-a850-4716-b732-aa7537acc56f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:01.713919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6527d661-a850-4716-b732-aa7537acc56f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:01.769345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6527d661-a850-4716-b732-aa7537acc56f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:01.770432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6527d661-a850-4716-b732-aa7537acc56f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:01.773261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6527d661-a850-4716-b732-aa7537acc56f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:01.775013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6527d661-a850-4716-b732-aa7537acc56f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:01.776752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6527d661-a850-4716-b732-aa7537acc56f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:01.778134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6527d661-a850-4716-b732-aa7537acc56f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:02.503238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6527d661-a850-4716-b732-aa7537acc56f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:02.517469 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6527d661-a850-4716-b732-aa7537acc56f tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1266 microversion: 2.1 time: 0.818579 Aug 09 14:45:02.520021 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1644/3354] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:01 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1266 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:02.528442 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7cf3cba8-d2ae-4bc1-8ca5-742a7a0e3bb3 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 1.464958 Aug 09 14:45:02.528907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.83"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:02.529113 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1711/3355] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:45:01 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:02.542173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:02.550497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0662961-3d01-42b2-88fe-21151a3e9d71 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dc8db1f0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:02.555368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:02.555923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:02.556371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:02.558768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:02.558768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:02.558768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:02.641434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "refresh_cache-11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:45:02.641846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquired lock "refresh_cache-11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:45:03.819897 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b0662961-3d01-42b2-88fe-21151a3e9d71 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/eeb9657e-e517-4a30-b562-d4bc0a926482" status: 202 len: 0 microversion: 2.1 time: 1.273467 Aug 09 14:45:03.820506 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1712/3356] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:45:02 2022] DELETE /compute/v2.1/os-security-groups/eeb9657e-e517-4a30-b562-d4bc0a926482 => generated 0 bytes in 1275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 14:45:03.828626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f45010c0-d129-4f5b-bdef-27690b9af3fe tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:03.829359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f45010c0-d129-4f5b-bdef-27690b9af3fe tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:03.859581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f45010c0-d129-4f5b-bdef-27690b9af3fe tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:03.860275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f45010c0-d129-4f5b-bdef-27690b9af3fe tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:03.860708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f45010c0-d129-4f5b-bdef-27690b9af3fe tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:03.861610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f45010c0-d129-4f5b-bdef-27690b9af3fe tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:03.861894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f45010c0-d129-4f5b-bdef-27690b9af3fe tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:03.862311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f45010c0-d129-4f5b-bdef-27690b9af3fe tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:05.301245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f45010c0-d129-4f5b-bdef-27690b9af3fe tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:05.309973 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f45010c0-d129-4f5b-bdef-27690b9af3fe tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1308 microversion: 2.1 time: 1.485049 Aug 09 14:45:05.314732 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1713/3357] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:03 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1308 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:05.328697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0eba709-9d5c-4085-93df-fff1da1e9df8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dc8d1940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:05.842843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG neutronclient.v2_0.client [None req-e0eba709-9d5c-4085-93df-fff1da1e9df8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist", "detail": ""}} {{(pid=119407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:45:05.846773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.security_group_api [None req-e0eba709-9d5c-4085-93df-fff1da1e9df8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Neutron security group eeb9657e-e517-4a30-b562-d4bc0a926482 not found {{(pid=119407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:45:05.848019 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e0eba709-9d5c-4085-93df-fff1da1e9df8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:45:05.848019 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-78dfc204-52d4-4e44-8d11-6a470d52556d'] Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0eba709-9d5c-4085-93df-fff1da1e9df8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-security-groups/eeb9657e-e517-4a30-b562-d4bc0a926482 HTTP/1.1 Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: exception: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-78dfc204-52d4-4e44-8d11-6a470d52556d'] Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'eeb9657e-e517-4a30-b562-d4bc0a926482'} Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:45:05.850839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78dfc204-52d4-4e44-8d11-6a470d52556d'] Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78dfc204-52d4-4e44-8d11-6a470d52556d'] Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78dfc204-52d4-4e44-8d11-6a470d52556d'] Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-78dfc204-52d4-4e44-8d11-6a470d52556d'] Aug 09 14:45:05.856455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:05.866120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0eba709-9d5c-4085-93df-fff1da1e9df8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:45:05.866120 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-78dfc204-52d4-4e44-8d11-6a470d52556d'] {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:05.867913 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0eba709-9d5c-4085-93df-fff1da1e9df8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/eeb9657e-e517-4a30-b562-d4bc0a926482" status: 404 len: 194 microversion: 2.1 time: 0.542853 Aug 09 14:45:05.869009 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1714/3358] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:45:05 2022] GET /compute/v2.1/os-security-groups/eeb9657e-e517-4a30-b562-d4bc0a926482 => generated 194 bytes in 545 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:45:05.888062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d357ed68-65f9-43e7-8426-b17588721d17 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dc8c7f70>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:06.844448 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d357ed68-65f9-43e7-8426-b17588721d17 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/edee46d0-f847-45bf-b777-e8f518ccbc7c" status: 202 len: 0 microversion: 2.1 time: 0.969785 Aug 09 14:45:06.845057 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1715/3359] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:45:05 2022] DELETE /compute/v2.1/os-security-groups/edee46d0-f847-45bf-b777-e8f518ccbc7c => generated 0 bytes in 972 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:45:06.852369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea83495f-b08b-45db-8ca6-14e4a15e6bf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:06.853071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea83495f-b08b-45db-8ca6-14e4a15e6bf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:06.867626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea83495f-b08b-45db-8ca6-14e4a15e6bf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:06.868128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea83495f-b08b-45db-8ca6-14e4a15e6bf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:06.871449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea83495f-b08b-45db-8ca6-14e4a15e6bf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:06.872543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea83495f-b08b-45db-8ca6-14e4a15e6bf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:06.872872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea83495f-b08b-45db-8ca6-14e4a15e6bf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:06.873295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea83495f-b08b-45db-8ca6-14e4a15e6bf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:06.921307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Building network info cache for instance {{(pid=119406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 14:45:07.703483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ea83495f-b08b-45db-8ca6-14e4a15e6bf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:07.711595 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea83495f-b08b-45db-8ca6-14e4a15e6bf5 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1308 microversion: 2.1 time: 0.864353 Aug 09 14:45:07.712189 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1716/3360] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:06 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1308 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:07.731450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8cf780fd-f60e-42e0-9465-5f693f6fe119 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dd21daf0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:08.360889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG neutronclient.v2_0.client [None req-8cf780fd-f60e-42e0-9465-5f693f6fe119 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist", "detail": ""}} {{(pid=119407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:45:08.362274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.security_group_api [None req-8cf780fd-f60e-42e0-9465-5f693f6fe119 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Neutron security group edee46d0-f847-45bf-b777-e8f518ccbc7c not found {{(pid=119407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:45:08.362963 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-8cf780fd-f60e-42e0-9465-5f693f6fe119 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:45:08.362963 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-d2f557ed-5388-49e0-9c57-7de51ca2945c'] Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8cf780fd-f60e-42e0-9465-5f693f6fe119 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-security-groups/edee46d0-f847-45bf-b777-e8f518ccbc7c HTTP/1.1 Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: exception: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-d2f557ed-5388-49e0-9c57-7de51ca2945c'] Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'edee46d0-f847-45bf-b777-e8f518ccbc7c'} Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:45:08.365098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2f557ed-5388-49e0-9c57-7de51ca2945c'] Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2f557ed-5388-49e0-9c57-7de51ca2945c'] Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2f557ed-5388-49e0-9c57-7de51ca2945c'] Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2f557ed-5388-49e0-9c57-7de51ca2945c'] Aug 09 14:45:08.369630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:08.373148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8cf780fd-f60e-42e0-9465-5f693f6fe119 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:45:08.373148 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-d2f557ed-5388-49e0-9c57-7de51ca2945c'] {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:08.374268 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8cf780fd-f60e-42e0-9465-5f693f6fe119 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/edee46d0-f847-45bf-b777-e8f518ccbc7c" status: 404 len: 194 microversion: 2.1 time: 0.661177 Aug 09 14:45:08.378363 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1717/3361] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:45:07 2022] GET /compute/v2.1/os-security-groups/edee46d0-f847-45bf-b777-e8f518ccbc7c => generated 194 bytes in 665 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:45:08.389657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-4ba213a6-d07b-483a-98ef-08cd973ad1f0 req-059978fa-1ada-4306-9b02-677265ab9cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c707b9-a4e0-4d5a-98f4-a8c8f9d82920", "tag": "8e65bee5-f93d-4d11-9c50-0909cf992d51"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:08.411448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4ba213a6-d07b-483a-98ef-08cd973ad1f0 req-059978fa-1ada-4306-9b02-677265ab9cf6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:08.414714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4ba213a6-d07b-483a-98ef-08cd973ad1f0 req-059978fa-1ada-4306-9b02-677265ab9cf6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:08.416250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4ba213a6-d07b-483a-98ef-08cd973ad1f0 req-059978fa-1ada-4306-9b02-677265ab9cf6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:08.444734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:08.447395 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-4ba213a6-d07b-483a-98ef-08cd973ad1f0 req-059978fa-1ada-4306-9b02-677265ab9cf6 service nova] Creating event network-changed:8e65bee5-f93d-4d11-9c50-0909cf992d51 for instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 on n-h1-844626-8 Aug 09 14:45:08.460512 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-4ba213a6-d07b-483a-98ef-08cd973ad1f0 req-059978fa-1ada-4306-9b02-677265ab9cf6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080622 Aug 09 14:45:08.461489 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1718/3362] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:08.473949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc2b94a9-7bbf-4d62-ae6e-3eb70a685f58 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dd21d3a0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:08.864838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Updating instance_info_cache with network_info: [{"id": "8e65bee5-f93d-4d11-9c50-0909cf992d51", "address": "fa:16:3e:ea:65:65", "network": {"id": "e0c09af2-a7fb-4eb6-aac5-00280efe005a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-908268990-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6b15c3b0febc415b86ab4c16a7ccefcc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8e65bee5-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 14:45:08.873300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:08.881718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Releasing lock "refresh_cache-11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:45:08.882692 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7d5f28e1-6145-46aa-b1d2-74f9e6c7b1a8 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "POST /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920/action" status: 202 len: 0 microversion: 2.1 time: 6.361607 Aug 09 14:45:08.883353 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1645/3363] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:45:02 2022] POST /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920/action => generated 0 bytes in 6363 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 14:45:08.900615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-88970f28-c91c-4c51-aedf-f07598c0151e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:08.901514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-88970f28-c91c-4c51-aedf-f07598c0151e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:08.918681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:08.920524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88970f28-c91c-4c51-aedf-f07598c0151e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:08.921190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88970f28-c91c-4c51-aedf-f07598c0151e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:08.922089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88970f28-c91c-4c51-aedf-f07598c0151e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:08.923010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88970f28-c91c-4c51-aedf-f07598c0151e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:08.923993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88970f28-c91c-4c51-aedf-f07598c0151e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:08.924628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-88970f28-c91c-4c51-aedf-f07598c0151e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:09.593347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-88970f28-c91c-4c51-aedf-f07598c0151e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:09.608984 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-88970f28-c91c-4c51-aedf-f07598c0151e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1308 microversion: 2.1 time: 0.712520 Aug 09 14:45:09.619435 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1646/3364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:08 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1308 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:09.624711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.83"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:09.979315 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc2b94a9-7bbf-4d62-ae6e-3eb70a685f58 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/fe64013f-9688-4b3b-8fc2-cf2fdc008629" status: 202 len: 0 microversion: 2.1 time: 1.515819 Aug 09 14:45:09.980824 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1719/3365] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:45:08 2022] DELETE /compute/v2.1/os-security-groups/fe64013f-9688-4b3b-8fc2-cf2fdc008629 => generated 0 bytes in 1518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:45:09.989925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef063fc6-fd2f-4a26-ae76-704584a3631b tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dc8c7820>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:10.038047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:10.160054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG neutronclient.v2_0.client [None req-ef063fc6-fd2f-4a26-ae76-704584a3631b tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist", "detail": ""}} {{(pid=119407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:45:10.161326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.security_group_api [None req-ef063fc6-fd2f-4a26-ae76-704584a3631b tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Neutron security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 not found {{(pid=119407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:45:10.162123 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-ef063fc6-fd2f-4a26-ae76-704584a3631b tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:45:10.162123 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-f01e4280-2056-46f5-b294-90cbc54d382b'] Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef063fc6-fd2f-4a26-ae76-704584a3631b tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-security-groups/fe64013f-9688-4b3b-8fc2-cf2fdc008629 HTTP/1.1 Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: exception: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-f01e4280-2056-46f5-b294-90cbc54d382b'] Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'fe64013f-9688-4b3b-8fc2-cf2fdc008629'} Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:45:10.164467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f01e4280-2056-46f5-b294-90cbc54d382b'] Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f01e4280-2056-46f5-b294-90cbc54d382b'] Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f01e4280-2056-46f5-b294-90cbc54d382b'] Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f01e4280-2056-46f5-b294-90cbc54d382b'] Aug 09 14:45:10.169606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:10.177054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef063fc6-fd2f-4a26-ae76-704584a3631b tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:45:10.177054 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-f01e4280-2056-46f5-b294-90cbc54d382b'] {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:10.178353 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ef063fc6-fd2f-4a26-ae76-704584a3631b tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/fe64013f-9688-4b3b-8fc2-cf2fdc008629" status: 404 len: 194 microversion: 2.1 time: 0.193737 Aug 09 14:45:10.179462 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1720/3366] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:45:09 2022] GET /compute/v2.1/os-security-groups/fe64013f-9688-4b3b-8fc2-cf2fdc008629 => generated 194 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:45:10.190785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78825ac3-369f-44fa-9ee3-2b5e2229e489 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dc970310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:10.573456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:10.588401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:10.588915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:10.589373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:10.590083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:10.590542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:10.590968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:11.199002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "refresh_cache-11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 14:45:11.199633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquired lock "refresh_cache-11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 14:45:12.372152 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78825ac3-369f-44fa-9ee3-2b5e2229e489 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 2.187348 Aug 09 14:45:12.372866 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1721/3367] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:45:10 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:12.379807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9c4b27e8-aa26-40cc-ad4f-4b37ab5bd421 req-b13ce0f1-008f-4173-9550-9a89998bf56d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03b0805d-607d-451c-9255-eecd787f5d1e", "tag": "46d5c5bd-6822-49d4-9402-ee1e24c0a915"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:12.415856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9c4b27e8-aa26-40cc-ad4f-4b37ab5bd421 req-b13ce0f1-008f-4173-9550-9a89998bf56d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:12.417080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9c4b27e8-aa26-40cc-ad4f-4b37ab5bd421 req-b13ce0f1-008f-4173-9550-9a89998bf56d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:12.419717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9c4b27e8-aa26-40cc-ad4f-4b37ab5bd421 req-b13ce0f1-008f-4173-9550-9a89998bf56d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:12.440417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=50 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:12.446241 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9c4b27e8-aa26-40cc-ad4f-4b37ab5bd421 req-b13ce0f1-008f-4173-9550-9a89998bf56d service nova] Creating event network-changed:46d5c5bd-6822-49d4-9402-ee1e24c0a915 for instance 03b0805d-607d-451c-9255-eecd787f5d1e on n-h2-844626-8 Aug 09 14:45:12.457901 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9c4b27e8-aa26-40cc-ad4f-4b37ab5bd421 req-b13ce0f1-008f-4173-9550-9a89998bf56d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081205 Aug 09 14:45:12.459421 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1722/3368] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:12.472034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bcb5c05f-7d1e-41b9-b349-eb24f5344eb0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:12.473758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bcb5c05f-7d1e-41b9-b349-eb24f5344eb0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:12.483765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb5c05f-7d1e-41b9-b349-eb24f5344eb0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:12.484815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb5c05f-7d1e-41b9-b349-eb24f5344eb0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:12.488206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb5c05f-7d1e-41b9-b349-eb24f5344eb0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:12.492448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb5c05f-7d1e-41b9-b349-eb24f5344eb0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:12.493237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb5c05f-7d1e-41b9-b349-eb24f5344eb0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:12.496328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcb5c05f-7d1e-41b9-b349-eb24f5344eb0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:13.189412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bcb5c05f-7d1e-41b9-b349-eb24f5344eb0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:13.223663 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bcb5c05f-7d1e-41b9-b349-eb24f5344eb0 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1308 microversion: 2.1 time: 0.760735 Aug 09 14:45:13.232994 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1723/3369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:12 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1308 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:13.252724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c42eaead-c1b8-4d9a-a838-0b6c75219102 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'create', calling method: .version_select at 0x7f41dc92b1f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-518322336", "description": "tempest-description-1684927345"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:14.166035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Building network info cache for instance {{(pid=119406) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 09 14:45:15.053747 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c42eaead-c1b8-4d9a-a838-0b6c75219102 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.819218 Aug 09 14:45:15.054349 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1724/3370] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:45:13 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:15.061536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-675e9d70-8b6d-478a-9b7f-51e45c42dd13 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:15.062411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-675e9d70-8b6d-478a-9b7f-51e45c42dd13 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:15.077681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-675e9d70-8b6d-478a-9b7f-51e45c42dd13 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:15.079715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-675e9d70-8b6d-478a-9b7f-51e45c42dd13 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:15.081411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-675e9d70-8b6d-478a-9b7f-51e45c42dd13 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:15.087222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-675e9d70-8b6d-478a-9b7f-51e45c42dd13 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:15.088437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-675e9d70-8b6d-478a-9b7f-51e45c42dd13 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:15.093147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-675e9d70-8b6d-478a-9b7f-51e45c42dd13 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:15.824907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-675e9d70-8b6d-478a-9b7f-51e45c42dd13 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:15.833463 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-675e9d70-8b6d-478a-9b7f-51e45c42dd13 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1308 microversion: 2.1 time: 0.777592 Aug 09 14:45:15.852547 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1725/3371] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:15 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1308 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:15.852547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-e4d9ec90-dd10-4478-99a4-f612220f2512 req-5cff76a0-a024-4c91-8a63-1c808a4beb47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c707b9-a4e0-4d5a-98f4-a8c8f9d82920", "tag": "8e65bee5-f93d-4d11-9c50-0909cf992d51"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:15.871074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e4d9ec90-dd10-4478-99a4-f612220f2512 req-5cff76a0-a024-4c91-8a63-1c808a4beb47 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:15.875019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e4d9ec90-dd10-4478-99a4-f612220f2512 req-5cff76a0-a024-4c91-8a63-1c808a4beb47 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:15.875728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e4d9ec90-dd10-4478-99a4-f612220f2512 req-5cff76a0-a024-4c91-8a63-1c808a4beb47 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:15.925201 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-e4d9ec90-dd10-4478-99a4-f612220f2512 req-5cff76a0-a024-4c91-8a63-1c808a4beb47 service nova] Creating event network-changed:8e65bee5-f93d-4d11-9c50-0909cf992d51 for instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 on n-h1-844626-8 Aug 09 14:45:15.954697 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-e4d9ec90-dd10-4478-99a4-f612220f2512 req-5cff76a0-a024-4c91-8a63-1c808a4beb47 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112786 Aug 09 14:45:15.955477 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1726/3372] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:15.976969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2065be16-5f37-4571-9592-c17ac940b77d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'create', calling method: .version_select at 0x7f41dd21d430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1638377476", "description": "tempest-description-220461488"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:16.517237 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2065be16-5f37-4571-9592-c17ac940b77d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.558488 Aug 09 14:45:16.517954 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1727/3373] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:45:15 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:16.857765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afa175f8-8354-4ac6-ad5a-62ac757b7617 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Action: 'create', calling method: .version_select at 0x7f41dd58fe50>, body: {"keypair": {"name": "tempest-keypair-1858260550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ8UmP/aM75I17qYYFBuwBYV/UHiSvvafdiePmdvUJADzmjXIVejaTnI0wYKWAc8W1vQrM2Sqb5COFR5iYyTRYla1UWFzf0P3xEhRq88IVwkyaEXjEazQP/gwDyGQriBA=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:16.877038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-afa175f8-8354-4ac6-ad5a-62ac757b7617 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Getting quotas for project bb998d118cec412cb471430bdd655f7e. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:45:16.884929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-afa175f8-8354-4ac6-ad5a-62ac757b7617 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Getting quotas for user e1e57d09b58946aea5a18043522462e3 and project bb998d118cec412cb471430bdd655f7e. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:45:16.918365 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afa175f8-8354-4ac6-ad5a-62ac757b7617 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.399093 Aug 09 14:45:16.919478 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1728/3374] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:45:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:16.927489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2006552775", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "6fbe09fe-8d24-4718-8a00-12c30074556f"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:17.002091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] validate_networks() for [('6fbe09fe-8d24-4718-8a00-12c30074556f', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:45:17.176984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Updating instance_info_cache with network_info: [{"id": "8e65bee5-f93d-4d11-9c50-0909cf992d51", "address": "fa:16:3e:ea:65:65", "network": {"id": "e0c09af2-a7fb-4eb6-aac5-00280efe005a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-908268990-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "6b15c3b0febc415b86ab4c16a7ccefcc", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8e65bee5-f9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=119406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 14:45:17.209527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Releasing lock "refresh_cache-11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" {{(pid=119406) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 14:45:17.211466 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4c7ae867-ea50-4a15-ab13-bf4949dd9a37 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "POST /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920/action" status: 202 len: 0 microversion: 2.1 time: 7.590488 Aug 09 14:45:17.212643 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1647/3375] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:45:09 2022] POST /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920/action => generated 0 bytes in 7592 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 09 14:45:17.218485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e31b43d6-2126-4ac4-b312-8f9fba7378fd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:17.219246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e31b43d6-2126-4ac4-b312-8f9fba7378fd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:17.227294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e31b43d6-2126-4ac4-b312-8f9fba7378fd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:17.228074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e31b43d6-2126-4ac4-b312-8f9fba7378fd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:17.228712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e31b43d6-2126-4ac4-b312-8f9fba7378fd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:17.233932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e31b43d6-2126-4ac4-b312-8f9fba7378fd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:17.234640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e31b43d6-2126-4ac4-b312-8f9fba7378fd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:17.235340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e31b43d6-2126-4ac4-b312-8f9fba7378fd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:18.256165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e31b43d6-2126-4ac4-b312-8f9fba7378fd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:18.267451 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e31b43d6-2126-4ac4-b312-8f9fba7378fd tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1308 microversion: 2.1 time: 1.052348 Aug 09 14:45:18.269566 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1648/3376] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:17 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1308 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:18.280259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4529683-5f04-4059-9582-e787a74fd9cc tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '.version_select at 0x7f41de17d160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:21.422979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:45:21.423757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:45:21.424333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:45:21.425038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:45:21.425584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:45:21.459507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:21.467420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:21.471869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:21.472907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:21.473287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:21.473724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:21.540436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Getting quotas for project 255e01b50a0249008b5c4533efbef0fd. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:45:21.600954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Getting quotas for user 37ed1274a3df4202a9417070db172cfa and project 255e01b50a0249008b5c4533efbef0fd. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:45:21.638252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:45:21.642375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:45:21.721202 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-598bfd91-bd78-40e5-bd5a-8f3d672931ba tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.800089 Aug 09 14:45:21.722443 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1729/3377] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:45:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:45:21.728600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-77b7a34a-0b94-42cf-8b53-ddb10cb57a95 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:21.729679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-77b7a34a-0b94-42cf-8b53-ddb10cb57a95 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:21.744237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77b7a34a-0b94-42cf-8b53-ddb10cb57a95 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:21.745260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77b7a34a-0b94-42cf-8b53-ddb10cb57a95 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:21.746097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77b7a34a-0b94-42cf-8b53-ddb10cb57a95 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:21.747025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77b7a34a-0b94-42cf-8b53-ddb10cb57a95 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:21.750554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77b7a34a-0b94-42cf-8b53-ddb10cb57a95 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:21.770615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77b7a34a-0b94-42cf-8b53-ddb10cb57a95 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:22.905107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-77b7a34a-0b94-42cf-8b53-ddb10cb57a95 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:22.927338 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-77b7a34a-0b94-42cf-8b53-ddb10cb57a95 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1308 microversion: 2.1 time: 1.203416 Aug 09 14:45:22.928299 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1730/3378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:21 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1308 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:22.933487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-90ad254e-e3f3-4683-accb-236219862b1c req-263b919d-832d-4f3e-b2a8-57593918d2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b0805d-607d-451c-9255-eecd787f5d1e", "name": "network-vif-plugged", "status": "completed", "tag": "46d5c5bd-6822-49d4-9402-ee1e24c0a915"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:22.956787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-90ad254e-e3f3-4683-accb-236219862b1c req-263b919d-832d-4f3e-b2a8-57593918d2f1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:22.963361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-90ad254e-e3f3-4683-accb-236219862b1c req-263b919d-832d-4f3e-b2a8-57593918d2f1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:22.963985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-90ad254e-e3f3-4683-accb-236219862b1c req-263b919d-832d-4f3e-b2a8-57593918d2f1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:22.973565 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4529683-5f04-4059-9582-e787a74fd9cc tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "DELETE /compute/v2.1/os-floating-ips/cfc61104-ab94-4cc0-8f33-1e5ae50a1f24" status: 202 len: 0 microversion: 2.1 time: 4.701250 Aug 09 14:45:22.974178 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1649/3379] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:45:18 2022] DELETE /compute/v2.1/os-floating-ips/cfc61104-ab94-4cc0-8f33-1e5ae50a1f24 => generated 0 bytes in 4704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:45:22.979223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8f42ec5f-fb30-435f-975d-2121c3bec6c7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:22.979844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8f42ec5f-fb30-435f-975d-2121c3bec6c7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:22.994373 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-90ad254e-e3f3-4683-accb-236219862b1c req-263b919d-832d-4f3e-b2a8-57593918d2f1 service nova] Creating event network-vif-plugged:46d5c5bd-6822-49d4-9402-ee1e24c0a915 for instance 03b0805d-607d-451c-9255-eecd787f5d1e on n-h2-844626-8 Aug 09 14:45:23.015261 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-90ad254e-e3f3-4683-accb-236219862b1c req-263b919d-832d-4f3e-b2a8-57593918d2f1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082095 Aug 09 14:45:23.016459 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1731/3380] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:23.020807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f42ec5f-fb30-435f-975d-2121c3bec6c7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:23.021310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f42ec5f-fb30-435f-975d-2121c3bec6c7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:23.021746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f42ec5f-fb30-435f-975d-2121c3bec6c7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:23.022516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f42ec5f-fb30-435f-975d-2121c3bec6c7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:23.022975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f42ec5f-fb30-435f-975d-2121c3bec6c7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:23.031247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2c4b6c0-831a-41d1-a216-e6ac4408cceb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '.version_select at 0x7f41dc902310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:23.036409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f42ec5f-fb30-435f-975d-2121c3bec6c7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:23.382993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8f42ec5f-fb30-435f-975d-2121c3bec6c7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:23.396924 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8f42ec5f-fb30-435f-975d-2121c3bec6c7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1220 microversion: 2.1 time: 0.419492 Aug 09 14:45:23.399169 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1650/3381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:22 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1220 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:23.953175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fddd94b2-bc5e-4318-988e-a1cb1e7ef1e8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:23.954173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fddd94b2-bc5e-4318-988e-a1cb1e7ef1e8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:23.982845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fddd94b2-bc5e-4318-988e-a1cb1e7ef1e8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:23.985581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fddd94b2-bc5e-4318-988e-a1cb1e7ef1e8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:23.986936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fddd94b2-bc5e-4318-988e-a1cb1e7ef1e8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:23.990365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fddd94b2-bc5e-4318-988e-a1cb1e7ef1e8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:23.999876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fddd94b2-bc5e-4318-988e-a1cb1e7ef1e8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:24.003582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fddd94b2-bc5e-4318-988e-a1cb1e7ef1e8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:25.004066 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d2c4b6c0-831a-41d1-a216-e6ac4408cceb tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c4316a77-8fec-4be4-b11b-b89c3732e2a0" status: 202 len: 0 microversion: 2.1 time: 1.983453 Aug 09 14:45:25.004646 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1732/3382] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:45:23 2022] DELETE /compute/v2.1/os-security-groups/c4316a77-8fec-4be4-b11b-b89c3732e2a0 => generated 0 bytes in 1988 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:45:25.010531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ccdbfc72-66bf-4a96-b591-e2e285d92160 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:25.011307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ccdbfc72-66bf-4a96-b591-e2e285d92160 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:25.036514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccdbfc72-66bf-4a96-b591-e2e285d92160 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:25.037042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccdbfc72-66bf-4a96-b591-e2e285d92160 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:25.055105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccdbfc72-66bf-4a96-b591-e2e285d92160 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:25.055962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccdbfc72-66bf-4a96-b591-e2e285d92160 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:25.056439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccdbfc72-66bf-4a96-b591-e2e285d92160 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:25.056870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccdbfc72-66bf-4a96-b591-e2e285d92160 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:25.324104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ccdbfc72-66bf-4a96-b591-e2e285d92160 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:25.340953 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ccdbfc72-66bf-4a96-b591-e2e285d92160 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1274 microversion: 2.1 time: 0.330854 Aug 09 14:45:25.351121 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1733/3383] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:25 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1274 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:25.359333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a308f157-7f19-470a-9350-903f5a279ff6 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:25.363805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a308f157-7f19-470a-9350-903f5a279ff6 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:25.379571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a308f157-7f19-470a-9350-903f5a279ff6 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:25.382036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a308f157-7f19-470a-9350-903f5a279ff6 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:25.383348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a308f157-7f19-470a-9350-903f5a279ff6 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:25.387654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a308f157-7f19-470a-9350-903f5a279ff6 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:25.387654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a308f157-7f19-470a-9350-903f5a279ff6 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:25.389848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a308f157-7f19-470a-9350-903f5a279ff6 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:25.460182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a308f157-7f19-470a-9350-903f5a279ff6 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:45:25.477367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fddd94b2-bc5e-4318-988e-a1cb1e7ef1e8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:25.486634 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fddd94b2-bc5e-4318-988e-a1cb1e7ef1e8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1308 microversion: 2.1 time: 1.540806 Aug 09 14:45:25.492901 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1651/3384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:23 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1308 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:45:25.655312 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a308f157-7f19-470a-9350-903f5a279ff6 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "DELETE /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 204 len: 0 microversion: 2.1 time: 0.304740 Aug 09 14:45:25.657888 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1734/3385] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:45:25 2022] DELETE /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:45:25.670827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e7961392-a69d-4838-9a19-ba93fef3809e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:25.674243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e7961392-a69d-4838-9a19-ba93fef3809e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:25.696007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7961392-a69d-4838-9a19-ba93fef3809e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:25.700106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7961392-a69d-4838-9a19-ba93fef3809e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:25.702388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7961392-a69d-4838-9a19-ba93fef3809e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:25.703209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7961392-a69d-4838-9a19-ba93fef3809e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:25.703693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7961392-a69d-4838-9a19-ba93fef3809e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:25.704129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7961392-a69d-4838-9a19-ba93fef3809e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:26.314899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e7961392-a69d-4838-9a19-ba93fef3809e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:26.344357 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e7961392-a69d-4838-9a19-ba93fef3809e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1510 microversion: 2.1 time: 0.678890 Aug 09 14:45:26.346690 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1652/3386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:25 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1510 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:26.366383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ccf7937-49da-4e33-bb64-a7c157a078b1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:26.367108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9ccf7937-49da-4e33-bb64-a7c157a078b1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:26.379277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:26.380759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ccf7937-49da-4e33-bb64-a7c157a078b1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:26.382194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ccf7937-49da-4e33-bb64-a7c157a078b1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:26.382642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ccf7937-49da-4e33-bb64-a7c157a078b1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:26.389641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ccf7937-49da-4e33-bb64-a7c157a078b1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:26.390410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ccf7937-49da-4e33-bb64-a7c157a078b1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:26.408799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ccf7937-49da-4e33-bb64-a7c157a078b1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:26.522649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1aa34132-ec27-4e5d-9210-205d7ea98b44 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:26.523424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1aa34132-ec27-4e5d-9210-205d7ea98b44 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:26.545921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1aa34132-ec27-4e5d-9210-205d7ea98b44 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:26.546163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1aa34132-ec27-4e5d-9210-205d7ea98b44 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:26.548196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1aa34132-ec27-4e5d-9210-205d7ea98b44 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:26.549029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1aa34132-ec27-4e5d-9210-205d7ea98b44 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:26.549502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1aa34132-ec27-4e5d-9210-205d7ea98b44 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:26.549938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1aa34132-ec27-4e5d-9210-205d7ea98b44 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:26.635104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9ccf7937-49da-4e33-bb64-a7c157a078b1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:26.647964 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ccf7937-49da-4e33-bb64-a7c157a078b1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1274 microversion: 2.1 time: 0.285645 Aug 09 14:45:26.653665 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1735/3387] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:26 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1274 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:27.245759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1aa34132-ec27-4e5d-9210-205d7ea98b44 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:27.258075 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1aa34132-ec27-4e5d-9210-205d7ea98b44 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1489 microversion: 2.1 time: 0.749091 Aug 09 14:45:27.258693 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1653/3388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:26 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1489 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:27.280767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f7093f1-93d0-4e70-91eb-3fdc1eecbe17 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2000687954"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:27.283948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f7093f1-93d0-4e70-91eb-3fdc1eecbe17 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:27.302690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f7093f1-93d0-4e70-91eb-3fdc1eecbe17 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:27.305542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f7093f1-93d0-4e70-91eb-3fdc1eecbe17 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:27.306023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f7093f1-93d0-4e70-91eb-3fdc1eecbe17 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:27.306848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f7093f1-93d0-4e70-91eb-3fdc1eecbe17 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:27.310076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f7093f1-93d0-4e70-91eb-3fdc1eecbe17 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:27.310584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f7093f1-93d0-4e70-91eb-3fdc1eecbe17 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:27.368966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9abe7c39-68d8-43ee-9fff-edf03a5cca39 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:27.369804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9abe7c39-68d8-43ee-9fff-edf03a5cca39 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:27.379818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9abe7c39-68d8-43ee-9fff-edf03a5cca39 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:27.382823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9abe7c39-68d8-43ee-9fff-edf03a5cca39 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:27.383509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9abe7c39-68d8-43ee-9fff-edf03a5cca39 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:27.384463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9abe7c39-68d8-43ee-9fff-edf03a5cca39 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:27.386381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9abe7c39-68d8-43ee-9fff-edf03a5cca39 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:27.387049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9abe7c39-68d8-43ee-9fff-edf03a5cca39 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:27.747291 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f7093f1-93d0-4e70-91eb-3fdc1eecbe17 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "POST /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e/action" status: 202 len: 0 microversion: 2.1 time: 0.470013 Aug 09 14:45:27.749403 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1736/3389] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:45:27 2022] POST /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 14:45:27.770978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ec03ae37-9bc1-4986-9e85-b9eaa61bd832 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:27.773093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ec03ae37-9bc1-4986-9e85-b9eaa61bd832 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:27.810876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec03ae37-9bc1-4986-9e85-b9eaa61bd832 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:27.814313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec03ae37-9bc1-4986-9e85-b9eaa61bd832 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:27.815495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec03ae37-9bc1-4986-9e85-b9eaa61bd832 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:27.818728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec03ae37-9bc1-4986-9e85-b9eaa61bd832 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:27.820965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec03ae37-9bc1-4986-9e85-b9eaa61bd832 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:27.821628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec03ae37-9bc1-4986-9e85-b9eaa61bd832 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:28.666178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9abe7c39-68d8-43ee-9fff-edf03a5cca39 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:28.680096 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9abe7c39-68d8-43ee-9fff-edf03a5cca39 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1510 microversion: 2.1 time: 1.316827 Aug 09 14:45:28.680734 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1654/3390] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:27 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1510 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:28.693992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a0f1b70-34e2-465a-a44d-2ac62a2d98ef tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41de301d30>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:28.787040 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a0f1b70-34e2-465a-a44d-2ac62a2d98ef tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/7f0439eb-99f0-4dff-9874-d62bb56eace6" status: 200 len: 1414 microversion: 2.1 time: 0.104961 Aug 09 14:45:28.796427 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1655/3391] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:45:28 2022] GET /compute/v2.1/images/7f0439eb-99f0-4dff-9874-d62bb56eace6 => generated 1414 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:28.808281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-32136017", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "29b98737-df90-43a2-a1f2-24c88e1bbc45"}], "security_groups": [{"name": "tempest-securitygroup--1670160551"}], "key_name": "tempest-keypair-1858260550", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:29.472025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] validate_networks() for [('29b98737-df90-43a2-a1f2-24c88e1bbc45', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:45:30.328662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ec03ae37-9bc1-4986-9e85-b9eaa61bd832 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:30.348942 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ec03ae37-9bc1-4986-9e85-b9eaa61bd832 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1316 microversion: 2.1 time: 2.597829 Aug 09 14:45:30.350035 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1737/3392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:27 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1316 bytes in 2600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:30.377293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fabc7d5e-24d6-4d9c-ad09-1fd8772abff4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dc92e670>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:30.880491 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fabc7d5e-24d6-4d9c-ad09-1fd8772abff4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/7f0439eb-99f0-4dff-9874-d62bb56eace6" status: 200 len: 1414 microversion: 2.1 time: 0.529133 Aug 09 14:45:30.888906 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1738/3393] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:45:30 2022] GET /compute/v2.1/images/7f0439eb-99f0-4dff-9874-d62bb56eace6 => generated 1414 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:30.898041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d115b76c-f91b-40b2-b331-1268471e370e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:30.898834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d115b76c-f91b-40b2-b331-1268471e370e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:30.910559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d115b76c-f91b-40b2-b331-1268471e370e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:30.913195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d115b76c-f91b-40b2-b331-1268471e370e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:30.914839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d115b76c-f91b-40b2-b331-1268471e370e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:30.915873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d115b76c-f91b-40b2-b331-1268471e370e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:30.916341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d115b76c-f91b-40b2-b331-1268471e370e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:30.919897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d115b76c-f91b-40b2-b331-1268471e370e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:31.506676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:31.579787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d115b76c-f91b-40b2-b331-1268471e370e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:31.593640 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d115b76c-f91b-40b2-b331-1268471e370e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1510 microversion: 2.1 time: 0.706045 Aug 09 14:45:31.594649 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1739/3394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:30 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1510 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:31.602965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b13b4570-cec0-455b-89dc-3b4a8c738745 req-a5c7e82e-b214-415a-a061-c12147194c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27684bc-0b81-45ee-8f6b-fddcfa000bdf", "tag": "57fb83f8-f7aa-4e16-aa43-91cb5686c4a6"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:31.622760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b13b4570-cec0-455b-89dc-3b4a8c738745 req-a5c7e82e-b214-415a-a061-c12147194c4d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:31.627809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b13b4570-cec0-455b-89dc-3b4a8c738745 req-a5c7e82e-b214-415a-a061-c12147194c4d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:31.628474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b13b4570-cec0-455b-89dc-3b4a8c738745 req-a5c7e82e-b214-415a-a061-c12147194c4d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:31.639022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=10 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:31.659907 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b13b4570-cec0-455b-89dc-3b4a8c738745 req-a5c7e82e-b214-415a-a061-c12147194c4d service nova] Creating event network-changed:57fb83f8-f7aa-4e16-aa43-91cb5686c4a6 for instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf on n-h2-844626-8 Aug 09 14:45:31.671718 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b13b4570-cec0-455b-89dc-3b4a8c738745 req-a5c7e82e-b214-415a-a061-c12147194c4d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073773 Aug 09 14:45:31.678146 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1740/3395] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:31.685563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b4c4a2e-4ddf-4e51-9fb7-bba49b7d173d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41dc8c7f70>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:31.929556 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b4c4a2e-4ddf-4e51-9fb7-bba49b7d173d tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/images/7f0439eb-99f0-4dff-9874-d62bb56eace6" status: 204 len: 0 microversion: 2.1 time: 0.249956 Aug 09 14:45:31.930256 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1741/3396] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:31 2022] DELETE /compute/v2.1/images/7f0439eb-99f0-4dff-9874-d62bb56eace6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:45:31.936275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e7484a7-4f57-4257-9a3e-d61fa1f00261 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:31.937415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e7484a7-4f57-4257-9a3e-d61fa1f00261 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:31.954687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e7484a7-4f57-4257-9a3e-d61fa1f00261 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:31.958683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e7484a7-4f57-4257-9a3e-d61fa1f00261 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:31.959172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e7484a7-4f57-4257-9a3e-d61fa1f00261 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:31.961854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e7484a7-4f57-4257-9a3e-d61fa1f00261 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:31.964584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e7484a7-4f57-4257-9a3e-d61fa1f00261 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:31.965918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e7484a7-4f57-4257-9a3e-d61fa1f00261 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:32.019834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Getting quotas for project bb998d118cec412cb471430bdd655f7e. Resources: dict_keys(['metadata_items']) {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:45:32.057216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Getting quotas for user e1e57d09b58946aea5a18043522462e3 and project bb998d118cec412cb471430bdd655f7e. Resources: dict_keys(['metadata_items']) {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:45:32.108180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:45:32.117486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:45:32.119180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:45:32.119876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:45:32.122726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:45:32.138218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:32.138711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:32.139178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:32.139878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:32.140330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:32.140747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:32.185848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Getting quotas for project bb998d118cec412cb471430bdd655f7e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:45:32.203682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Getting quotas for user e1e57d09b58946aea5a18043522462e3 and project bb998d118cec412cb471430bdd655f7e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:45:32.232493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:45:32.253651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:45:32.427391 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5fb75c6a-9a4b-43fe-920f-4fad36933205 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.629757 Aug 09 14:45:32.430210 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1656/3397] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:45:28 2022] POST /compute/v2.1/servers => generated 409 bytes in 3633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:45:32.439456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ba9f443d-3671-4cf7-b493-3d061398a0f3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41de17dd30>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:32.562516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e7484a7-4f57-4257-9a3e-d61fa1f00261 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:32.587097 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e7484a7-4f57-4257-9a3e-d61fa1f00261 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1316 microversion: 2.1 time: 0.648223 Aug 09 14:45:32.589770 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1742/3398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:31 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1316 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:32.621073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-acce3cf2-d46a-4010-b42b-edc57a7f53ce req-289e7ca0-47a4-469e-8764-3f595f775811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c707b9-a4e0-4d5a-98f4-a8c8f9d82920", "name": "network-vif-deleted", "tag": "8e65bee5-f93d-4d11-9c50-0909cf992d51"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:32.671055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-acce3cf2-d46a-4010-b42b-edc57a7f53ce req-289e7ca0-47a4-469e-8764-3f595f775811 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:32.671701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-acce3cf2-d46a-4010-b42b-edc57a7f53ce req-289e7ca0-47a4-469e-8764-3f595f775811 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:32.672106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-acce3cf2-d46a-4010-b42b-edc57a7f53ce req-289e7ca0-47a4-469e-8764-3f595f775811 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:32.720520 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-acce3cf2-d46a-4010-b42b-edc57a7f53ce req-289e7ca0-47a4-469e-8764-3f595f775811 service nova] Creating event network-vif-deleted:8e65bee5-f93d-4d11-9c50-0909cf992d51 for instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 on n-h1-844626-8 Aug 09 14:45:32.733029 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-acce3cf2-d46a-4010-b42b-edc57a7f53ce req-289e7ca0-47a4-469e-8764-3f595f775811 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132574 Aug 09 14:45:32.736449 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1743/3399] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:32.752485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fd2617b5-bc4c-40ca-8a6b-88a3e144e131 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:32.753246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fd2617b5-bc4c-40ca-8a6b-88a3e144e131 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:32.976664 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ba9f443d-3671-4cf7-b493-3d061398a0f3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] HTTP exception thrown: Image not found. Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ba9f443d-3671-4cf7-b493-3d061398a0f3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Request method failure captured: Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/images/7f0439eb-99f0-4dff-9874-d62bb56eace6 HTTP/1.1 Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nIR2QwlGfXxczDQxiJ-nxdtidHVTvqhomQgCyZ2Y85sDxWtYXcxlvIBrba7bd_NZopS7x7FunncDfFOhUssk7cyRA6E1zM5UOR-f7vSdnLNyyWfvJcGgSTCnHrCqnB7U8a6Cx9DMcJSJ5gS5qk0TPUqeNQEF__CeMX_eNKSDfYq8hg Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_426fbb89ba614432b3a0cb87e0e4cd69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d1d53fbb760a4b9282197668b9296c38 Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '7f0439eb-99f0-4dff-9874-d62bb56eace6'} Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7f0439eb-99f0-4dff-9874-d62bb56eace6 Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 09 14:45:32.986809 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7f0439eb-99f0-4dff-9874-d62bb56eace6 could not be found. Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ba9f443d-3671-4cf7-b493-3d061398a0f3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ba9f443d-3671-4cf7-b493-3d061398a0f3 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/images/7f0439eb-99f0-4dff-9874-d62bb56eace6" status: 404 len: 62 microversion: 2.1 time: 0.557466 Aug 09 14:45:32.996460 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1657/3400] 10.222.0.50 () {58 vars in 1233 bytes} [Tue Aug 9 14:45:32 2022] GET /compute/v2.1/images/7f0439eb-99f0-4dff-9874-d62bb56eace6 => generated 62 bytes in 558 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:45:33.004111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:33.004111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:33.035715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:33.036436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:33.036967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:33.039454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:33.041234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:33.041708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:33.130392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fd2617b5-bc4c-40ca-8a6b-88a3e144e131 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:33.142036 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fd2617b5-bc4c-40ca-8a6b-88a3e144e131 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1276 microversion: 2.1 time: 0.401162 Aug 09 14:45:33.145392 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1744/3401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:32 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1276 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:33.164323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:33.165016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df19d9d6-2061-43ed-8e85-0972f5c2e46b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:33.165847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df19d9d6-2061-43ed-8e85-0972f5c2e46b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:33.165980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:33.166428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:33.171284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lazy-loading 'fault' on Instance uuid 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:45:33.177361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df19d9d6-2061-43ed-8e85-0972f5c2e46b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:33.177848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df19d9d6-2061-43ed-8e85-0972f5c2e46b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:33.183842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df19d9d6-2061-43ed-8e85-0972f5c2e46b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:33.184614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df19d9d6-2061-43ed-8e85-0972f5c2e46b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:33.189067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df19d9d6-2061-43ed-8e85-0972f5c2e46b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:33.189696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df19d9d6-2061-43ed-8e85-0972f5c2e46b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:33.376859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d4f8f2897724d5c8df394925cb7821c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b15c3b0febc415b86ab4c16a7ccefcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:33.389435 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f659eb82-e27e-4a9d-9919-35fa27fe674e tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 200 len: 1313 microversion: 2.1 time: 0.397015 Aug 09 14:45:33.390887 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1658/3402] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:32 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:33.445752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8a8e461b-809c-4421-8a2b-69fc200ab482 req-da89334c-2a6e-47ab-920c-2b6bcb2c65cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b0805d-607d-451c-9255-eecd787f5d1e", "name": "network-vif-plugged", "status": "completed", "tag": "46d5c5bd-6822-49d4-9402-ee1e24c0a915"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:33.469378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8a8e461b-809c-4421-8a2b-69fc200ab482 req-da89334c-2a6e-47ab-920c-2b6bcb2c65cb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:33.470209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8a8e461b-809c-4421-8a2b-69fc200ab482 req-da89334c-2a6e-47ab-920c-2b6bcb2c65cb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:33.471710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8a8e461b-809c-4421-8a2b-69fc200ab482 req-da89334c-2a6e-47ab-920c-2b6bcb2c65cb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:33.521133 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8a8e461b-809c-4421-8a2b-69fc200ab482 req-da89334c-2a6e-47ab-920c-2b6bcb2c65cb service nova] Creating event network-vif-plugged:46d5c5bd-6822-49d4-9402-ee1e24c0a915 for instance 03b0805d-607d-451c-9255-eecd787f5d1e on n-h2-844626-8 Aug 09 14:45:33.527731 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8a8e461b-809c-4421-8a2b-69fc200ab482 req-da89334c-2a6e-47ab-920c-2b6bcb2c65cb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086174 Aug 09 14:45:33.529037 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1659/3403] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:33.615457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c7946d1-c972-4b91-92a2-7babdff579fe tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:33.616767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c7946d1-c972-4b91-92a2-7babdff579fe tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:33.642397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c7946d1-c972-4b91-92a2-7babdff579fe tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:33.643585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c7946d1-c972-4b91-92a2-7babdff579fe tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:33.646535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c7946d1-c972-4b91-92a2-7babdff579fe tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:33.647881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c7946d1-c972-4b91-92a2-7babdff579fe tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:33.651676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c7946d1-c972-4b91-92a2-7babdff579fe tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:33.652313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c7946d1-c972-4b91-92a2-7babdff579fe tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:34.147810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-df19d9d6-2061-43ed-8e85-0972f5c2e46b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:34.156526 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df19d9d6-2061-43ed-8e85-0972f5c2e46b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1489 microversion: 2.1 time: 1.009841 Aug 09 14:45:34.163217 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1745/3404] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:33 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1489 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:34.168243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0bda4a9e-ad75-4ac4-8b9b-6c315e7c26e3 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:34.169145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0bda4a9e-ad75-4ac4-8b9b-6c315e7c26e3 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:34.177251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bda4a9e-ad75-4ac4-8b9b-6c315e7c26e3 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:34.178005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bda4a9e-ad75-4ac4-8b9b-6c315e7c26e3 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:34.178588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bda4a9e-ad75-4ac4-8b9b-6c315e7c26e3 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:34.179511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bda4a9e-ad75-4ac4-8b9b-6c315e7c26e3 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:34.180183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bda4a9e-ad75-4ac4-8b9b-6c315e7c26e3 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:34.181028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bda4a9e-ad75-4ac4-8b9b-6c315e7c26e3 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:34.350857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1c7946d1-c972-4b91-92a2-7babdff579fe tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:34.367878 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c7946d1-c972-4b91-92a2-7babdff579fe tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1316 microversion: 2.1 time: 0.752733 Aug 09 14:45:34.369285 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1660/3405] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:33 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1316 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:34.374302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-48a46eba-8f39-416a-9a18-280e96d58342 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:34.374798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-48a46eba-8f39-416a-9a18-280e96d58342 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:34.388816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48a46eba-8f39-416a-9a18-280e96d58342 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:34.389314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48a46eba-8f39-416a-9a18-280e96d58342 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:34.389753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48a46eba-8f39-416a-9a18-280e96d58342 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:34.390667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48a46eba-8f39-416a-9a18-280e96d58342 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:34.390891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48a46eba-8f39-416a-9a18-280e96d58342 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:34.391340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48a46eba-8f39-416a-9a18-280e96d58342 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:34.463537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-48a46eba-8f39-416a-9a18-280e96d58342 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:45:34.567818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0bda4a9e-ad75-4ac4-8b9b-6c315e7c26e3 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:34.570164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:34.578664 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0bda4a9e-ad75-4ac4-8b9b-6c315e7c26e3 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1328 microversion: 2.1 time: 0.416436 Aug 09 14:45:34.579354 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1746/3406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:34 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1328 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:45:34.632183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82ff5c49-9c4b-4b2d-86d0-46ca5b626766 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:34.632799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82ff5c49-9c4b-4b2d-86d0-46ca5b626766 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] [instance: 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:34.637928 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-48a46eba-8f39-416a-9a18-280e96d58342 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 204 len: 0 microversion: 2.1 time: 0.267119 Aug 09 14:45:34.638878 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1661/3407] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:45:34 2022] DELETE /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:45:34.648666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82ff5c49-9c4b-4b2d-86d0-46ca5b626766 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:34.649166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82ff5c49-9c4b-4b2d-86d0-46ca5b626766 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:34.649636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82ff5c49-9c4b-4b2d-86d0-46ca5b626766 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:34.653287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82ff5c49-9c4b-4b2d-86d0-46ca5b626766 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:34.653287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82ff5c49-9c4b-4b2d-86d0-46ca5b626766 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:34.653287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82ff5c49-9c4b-4b2d-86d0-46ca5b626766 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:34.672528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-942eede4-175c-4348-8660-40d51286283a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41de075f70>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:34.716611 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-82ff5c49-9c4b-4b2d-86d0-46ca5b626766 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] HTTP exception thrown: Instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 could not be found. Aug 09 14:45:34.721613 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-942eede4-175c-4348-8660-40d51286283a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] HTTP exception thrown: Image not found. Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-942eede4-175c-4348-8660-40d51286283a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Request method failure captured: Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/images/7f0439eb-99f0-4dff-9874-d62bb56eace6 HTTP/1.1 Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nIR2QwlGfXxczDQxiJ-nxdtidHVTvqhomQgCyZ2Y85sDxWtYXcxlvIBrba7bd_NZopS7x7FunncDfFOhUssk7cyRA6E1zM5UOR-f7vSdnLNyyWfvJcGgSTCnHrCqnB7U8a6Cx9DMcJSJ5gS5qk0TPUqeNQEF__CeMX_eNKSDfYq8hg Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_426fbb89ba614432b3a0cb87e0e4cd69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d1d53fbb760a4b9282197668b9296c38 Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '7f0439eb-99f0-4dff-9874-d62bb56eace6'} Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7f0439eb-99f0-4dff-9874-d62bb56eace6 to delete Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7f0439eb-99f0-4dff-9874-d62bb56eace6 could not be found. Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:34.723645 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-942eede4-175c-4348-8660-40d51286283a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-942eede4-175c-4348-8660-40d51286283a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/images/7f0439eb-99f0-4dff-9874-d62bb56eace6" status: 404 len: 62 microversion: 2.1 time: 0.069534 Aug 09 14:45:34.728176 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1662/3408] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:34 2022] DELETE /compute/v2.1/images/7f0439eb-99f0-4dff-9874-d62bb56eace6 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82ff5c49-9c4b-4b2d-86d0-46ca5b626766 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Request method failure captured: Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 HTTP/1.1 Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nKd90LgImiL53a_8HuR1fH6AKubMCd7jlxXmLbsUuitTDrU62hrXyD5Eeb-_Ygr1oyjG75R6OXs7zsjHUV6nvx9mdOnPR63s8meZbdALjhgqpXmjnzsfQBld3_jTwA4rxyrWS6dgo5rNeI3HHa2SfNBh_XGwO4DTLERMo6KUoiKdM8 Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 6b15c3b0febc415b86ab4c16a7ccefcc Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-208448019 Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6b15c3b0febc415b86ab4c16a7ccefcc", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6b15c3b0febc415b86ab4c16a7ccefcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b15c3b0febc415b86ab4c16a7ccefcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6b15c3b0febc415b86ab4c16a7ccefcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-208448019 Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 6b15c3b0febc415b86ab4c16a7ccefcc Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-208448019 Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerRescueTestJSONUnderV235-208448019-project Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 5d4f8f2897724d5c8df394925cb7821c Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-208448019-project Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 could not be found. Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '11c707b9-a4e0-4d5a-98f4-a8c8f9d82920'} Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 could not be found. Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 could not be found. Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:34.736462 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:34.740975 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:34.740975 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:34.740975 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:34.740975 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:34.740975 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:34.740975 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:34.740975 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 could not be found. Aug 09 14:45:34.740975 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:34.741512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c6933bbe-2dd2-435c-b5d8-55f4865f7792 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:34.741512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6933bbe-2dd2-435c-b5d8-55f4865f7792 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:34.747719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82ff5c49-9c4b-4b2d-86d0-46ca5b626766 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] Returning 404 to user: Instance 11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:34.749002 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82ff5c49-9c4b-4b2d-86d0-46ca5b626766 tempest-ServerRescueTestJSONUnderV235-208448019 tempest-ServerRescueTestJSONUnderV235-208448019-project] 10.222.0.50 "GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920" status: 404 len: 111 microversion: 2.1 time: 0.152802 Aug 09 14:45:34.749943 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1747/3409] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:34 2022] GET /compute/v2.1/servers/11c707b9-a4e0-4d5a-98f4-a8c8f9d82920 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:45:34.754637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6933bbe-2dd2-435c-b5d8-55f4865f7792 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:34.755271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6933bbe-2dd2-435c-b5d8-55f4865f7792 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:34.755974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6933bbe-2dd2-435c-b5d8-55f4865f7792 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:34.757009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6933bbe-2dd2-435c-b5d8-55f4865f7792 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:34.757541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6933bbe-2dd2-435c-b5d8-55f4865f7792 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:34.758028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6933bbe-2dd2-435c-b5d8-55f4865f7792 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:34.814476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6933bbe-2dd2-435c-b5d8-55f4865f7792 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:45:34.874020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:34.901547 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.compute.api [None req-c6933bbe-2dd2-435c-b5d8-55f4865f7792 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Instance is already in deleting state, ignoring this request Aug 09 14:45:34.903056 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c6933bbe-2dd2-435c-b5d8-55f4865f7792 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 204 len: 0 microversion: 2.1 time: 0.167561 Aug 09 14:45:34.904556 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1663/3410] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:45:34 2022] DELETE /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:45:34.916670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28f4b4a3-5959-4261-9296-eeb410393964 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:34.917667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28f4b4a3-5959-4261-9296-eeb410393964 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:34.927630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28f4b4a3-5959-4261-9296-eeb410393964 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:34.928384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28f4b4a3-5959-4261-9296-eeb410393964 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:34.929230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28f4b4a3-5959-4261-9296-eeb410393964 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:34.930249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28f4b4a3-5959-4261-9296-eeb410393964 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:34.931663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28f4b4a3-5959-4261-9296-eeb410393964 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:34.932376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28f4b4a3-5959-4261-9296-eeb410393964 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:35.294136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-28f4b4a3-5959-4261-9296-eeb410393964 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:35.307501 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28f4b4a3-5959-4261-9296-eeb410393964 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1495 microversion: 2.1 time: 0.393284 Aug 09 14:45:35.308391 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1748/3411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:34 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1495 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:35.391731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-21da9b51-eb07-40cb-9bea-b505d5fd2cb2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:35.392353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-21da9b51-eb07-40cb-9bea-b505d5fd2cb2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:35.417555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21da9b51-eb07-40cb-9bea-b505d5fd2cb2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:35.418037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21da9b51-eb07-40cb-9bea-b505d5fd2cb2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:35.418473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21da9b51-eb07-40cb-9bea-b505d5fd2cb2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:35.419213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21da9b51-eb07-40cb-9bea-b505d5fd2cb2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:35.419849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21da9b51-eb07-40cb-9bea-b505d5fd2cb2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:35.420432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21da9b51-eb07-40cb-9bea-b505d5fd2cb2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:35.600625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-249367ff-60d8-4d7a-9eb7-e55db86089dc tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:35.601238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-249367ff-60d8-4d7a-9eb7-e55db86089dc tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:35.609625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-249367ff-60d8-4d7a-9eb7-e55db86089dc tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:35.610131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-249367ff-60d8-4d7a-9eb7-e55db86089dc tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:35.610662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-249367ff-60d8-4d7a-9eb7-e55db86089dc tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:35.612859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-249367ff-60d8-4d7a-9eb7-e55db86089dc tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:35.615654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-249367ff-60d8-4d7a-9eb7-e55db86089dc tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:35.623902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-249367ff-60d8-4d7a-9eb7-e55db86089dc tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:36.195249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-249367ff-60d8-4d7a-9eb7-e55db86089dc tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:36.206409 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-249367ff-60d8-4d7a-9eb7-e55db86089dc tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1334 microversion: 2.1 time: 0.607207 Aug 09 14:45:36.207713 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1749/3412] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:35 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1334 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:45:36.223209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ab5e1fb2-415e-4403-a207-18d82c3be7df req-4f1af15c-3a9f-45e8-b438-0e9c759e122e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27684bc-0b81-45ee-8f6b-fddcfa000bdf", "name": "network-vif-plugged", "status": "completed", "tag": "57fb83f8-f7aa-4e16-aa43-91cb5686c4a6"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:36.238430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ab5e1fb2-415e-4403-a207-18d82c3be7df req-4f1af15c-3a9f-45e8-b438-0e9c759e122e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:36.242133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-21da9b51-eb07-40cb-9bea-b505d5fd2cb2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:36.254998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ab5e1fb2-415e-4403-a207-18d82c3be7df req-4f1af15c-3a9f-45e8-b438-0e9c759e122e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:36.255575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ab5e1fb2-415e-4403-a207-18d82c3be7df req-4f1af15c-3a9f-45e8-b438-0e9c759e122e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:36.256739 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-21da9b51-eb07-40cb-9bea-b505d5fd2cb2 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1316 microversion: 2.1 time: 0.870236 Aug 09 14:45:36.259807 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1664/3413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:35 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1316 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:36.297993 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ab5e1fb2-415e-4403-a207-18d82c3be7df req-4f1af15c-3a9f-45e8-b438-0e9c759e122e service nova] Creating event network-vif-plugged:57fb83f8-f7aa-4e16-aa43-91cb5686c4a6 for instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf on n-h2-844626-8 Aug 09 14:45:36.311268 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ab5e1fb2-415e-4403-a207-18d82c3be7df req-4f1af15c-3a9f-45e8-b438-0e9c759e122e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102004 Aug 09 14:45:36.314212 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1750/3414] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:36.330664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-663a301a-1f95-43ac-bddd-c63af6dcf7f7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:36.331314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-663a301a-1f95-43ac-bddd-c63af6dcf7f7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:36.353326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-663a301a-1f95-43ac-bddd-c63af6dcf7f7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:36.354225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-663a301a-1f95-43ac-bddd-c63af6dcf7f7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:36.354841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-663a301a-1f95-43ac-bddd-c63af6dcf7f7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:36.355751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-663a301a-1f95-43ac-bddd-c63af6dcf7f7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:36.356425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-663a301a-1f95-43ac-bddd-c63af6dcf7f7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:36.357029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-663a301a-1f95-43ac-bddd-c63af6dcf7f7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:36.603258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-157128393", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "0706003d-cce3-4f80-b4a4-c0270ea8bd2b"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:36.698588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] validate_networks() for [('0706003d-cce3-4f80-b4a4-c0270ea8bd2b', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:45:37.001944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-663a301a-1f95-43ac-bddd-c63af6dcf7f7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:37.011711 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-663a301a-1f95-43ac-bddd-c63af6dcf7f7 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1495 microversion: 2.1 time: 0.685556 Aug 09 14:45:37.012207 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1751/3415] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:36 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1495 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:45:37.229123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2de96010-ff31-4481-bda8-0eeb8acc2a14 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:37.229767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2de96010-ff31-4481-bda8-0eeb8acc2a14 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:37.240286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de96010-ff31-4481-bda8-0eeb8acc2a14 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:37.242320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de96010-ff31-4481-bda8-0eeb8acc2a14 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:37.242764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de96010-ff31-4481-bda8-0eeb8acc2a14 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:37.243534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de96010-ff31-4481-bda8-0eeb8acc2a14 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:37.246273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de96010-ff31-4481-bda8-0eeb8acc2a14 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:37.246709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2de96010-ff31-4481-bda8-0eeb8acc2a14 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:37.678445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2de96010-ff31-4481-bda8-0eeb8acc2a14 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:37.690084 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2de96010-ff31-4481-bda8-0eeb8acc2a14 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1402 microversion: 2.1 time: 0.465037 Aug 09 14:45:37.691987 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1752/3416] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:37 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1402 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:45:37.710073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-39980fd0-2a96-4569-b84f-65dc7ccc3c1e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:37.711623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-39980fd0-2a96-4569-b84f-65dc7ccc3c1e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:37.722521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39980fd0-2a96-4569-b84f-65dc7ccc3c1e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:37.723548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39980fd0-2a96-4569-b84f-65dc7ccc3c1e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:37.725159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39980fd0-2a96-4569-b84f-65dc7ccc3c1e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:37.727043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39980fd0-2a96-4569-b84f-65dc7ccc3c1e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:37.727708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39980fd0-2a96-4569-b84f-65dc7ccc3c1e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:37.729643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39980fd0-2a96-4569-b84f-65dc7ccc3c1e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:37.778779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:45:37.779404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:45:37.779812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:45:37.780296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:45:37.780778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:45:37.801849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:37.812038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:37.812830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:37.814022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:37.814771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:37.815436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:37.858170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Getting quotas for project 0718176228a54016ab1c8a08cb1d8f49. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:45:37.882700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Getting quotas for user c332fc2d7886405fab8d1eb7439d02c8 and project 0718176228a54016ab1c8a08cb1d8f49. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:45:37.924193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:45:37.930659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:45:38.098124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-39980fd0-2a96-4569-b84f-65dc7ccc3c1e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:38.102883 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d3af5b98-4408-4cdc-8fa2-f9ece82f8cb9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.841750 Aug 09 14:45:38.114182 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1665/3417] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:45:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:45:38.125756 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-39980fd0-2a96-4569-b84f-65dc7ccc3c1e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1316 microversion: 2.1 time: 0.430273 Aug 09 14:45:38.130089 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1753/3418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:37 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:38.145556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09e4847b-e70d-41c0-a72b-e29fa8cacbda tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:38.147206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-09e4847b-e70d-41c0-a72b-e29fa8cacbda tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:38.149633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eebd3cbc-0d08-44eb-973a-f1ea25add006 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:38.150374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eebd3cbc-0d08-44eb-973a-f1ea25add006 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:38.169881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eebd3cbc-0d08-44eb-973a-f1ea25add006 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:38.176777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eebd3cbc-0d08-44eb-973a-f1ea25add006 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:38.177342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eebd3cbc-0d08-44eb-973a-f1ea25add006 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:38.178195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eebd3cbc-0d08-44eb-973a-f1ea25add006 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:38.178780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eebd3cbc-0d08-44eb-973a-f1ea25add006 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:38.179342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eebd3cbc-0d08-44eb-973a-f1ea25add006 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:38.444614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-09e4847b-e70d-41c0-a72b-e29fa8cacbda tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:38.447379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eebd3cbc-0d08-44eb-973a-f1ea25add006 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:38.454025 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09e4847b-e70d-41c0-a72b-e29fa8cacbda tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1215 microversion: 2.1 time: 0.322586 Aug 09 14:45:38.459515 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1754/3419] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:38 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1215 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:38.469856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-82a0ef3a-3747-4a84-95a3-466f5225efa7 req-19539bc6-02b7-4a5e-8f62-74186c04919e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b0805d-607d-451c-9255-eecd787f5d1e", "name": "network-vif-unplugged", "status": "completed", "tag": "46d5c5bd-6822-49d4-9402-ee1e24c0a915"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:38.473077 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eebd3cbc-0d08-44eb-973a-f1ea25add006 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1453 microversion: 2.1 time: 0.351372 Aug 09 14:45:38.492708 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1666/3420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:38 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1453 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:38.497330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-82a0ef3a-3747-4a84-95a3-466f5225efa7 req-19539bc6-02b7-4a5e-8f62-74186c04919e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:38.497810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-82a0ef3a-3747-4a84-95a3-466f5225efa7 req-19539bc6-02b7-4a5e-8f62-74186c04919e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:38.498235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-82a0ef3a-3747-4a84-95a3-466f5225efa7 req-19539bc6-02b7-4a5e-8f62-74186c04919e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:38.529262 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-82a0ef3a-3747-4a84-95a3-466f5225efa7 req-19539bc6-02b7-4a5e-8f62-74186c04919e service nova] Creating event network-vif-unplugged:46d5c5bd-6822-49d4-9402-ee1e24c0a915 for instance 03b0805d-607d-451c-9255-eecd787f5d1e on n-h2-844626-8 Aug 09 14:45:38.544357 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-82a0ef3a-3747-4a84-95a3-466f5225efa7 req-19539bc6-02b7-4a5e-8f62-74186c04919e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080647 Aug 09 14:45:38.554205 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1755/3421] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:38.714873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9d4c9081-a487-410d-849f-fd60e3834120 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:38.715756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d4c9081-a487-410d-849f-fd60e3834120 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:38.731250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d4c9081-a487-410d-849f-fd60e3834120 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:38.731657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d4c9081-a487-410d-849f-fd60e3834120 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:38.732099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d4c9081-a487-410d-849f-fd60e3834120 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:38.732832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d4c9081-a487-410d-849f-fd60e3834120 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:38.733287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d4c9081-a487-410d-849f-fd60e3834120 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:38.733704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d4c9081-a487-410d-849f-fd60e3834120 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:39.126471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9d4c9081-a487-410d-849f-fd60e3834120 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:39.140730 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9d4c9081-a487-410d-849f-fd60e3834120 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1402 microversion: 2.1 time: 0.425508 Aug 09 14:45:39.141780 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1667/3422] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:38 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1402 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:39.149637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c1f917c6-1399-4fd7-848c-09f760ee9689 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:39.150346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c1f917c6-1399-4fd7-848c-09f760ee9689 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:39.163709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1f917c6-1399-4fd7-848c-09f760ee9689 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:39.171336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1f917c6-1399-4fd7-848c-09f760ee9689 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:39.171879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1f917c6-1399-4fd7-848c-09f760ee9689 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:39.172801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1f917c6-1399-4fd7-848c-09f760ee9689 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:39.173421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1f917c6-1399-4fd7-848c-09f760ee9689 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:39.174074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1f917c6-1399-4fd7-848c-09f760ee9689 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:39.248462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-915e85e1-a028-4ec0-9317-3a6ad2e57d62 req-708a251f-c3a6-4fe8-84ae-b2629e101a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03b0805d-607d-451c-9255-eecd787f5d1e", "name": "network-vif-deleted", "tag": "46d5c5bd-6822-49d4-9402-ee1e24c0a915"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:39.253963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:39.277724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-915e85e1-a028-4ec0-9317-3a6ad2e57d62 req-708a251f-c3a6-4fe8-84ae-b2629e101a63 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:39.289088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-915e85e1-a028-4ec0-9317-3a6ad2e57d62 req-708a251f-c3a6-4fe8-84ae-b2629e101a63 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:39.289825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-915e85e1-a028-4ec0-9317-3a6ad2e57d62 req-708a251f-c3a6-4fe8-84ae-b2629e101a63 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:39.312933 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-915e85e1-a028-4ec0-9317-3a6ad2e57d62 req-708a251f-c3a6-4fe8-84ae-b2629e101a63 service nova] Creating event network-vif-deleted:46d5c5bd-6822-49d4-9402-ee1e24c0a915 for instance 03b0805d-607d-451c-9255-eecd787f5d1e on n-h2-844626-8 Aug 09 14:45:39.327822 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-915e85e1-a028-4ec0-9317-3a6ad2e57d62 req-708a251f-c3a6-4fe8-84ae-b2629e101a63 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083575 Aug 09 14:45:39.329293 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1668/3423] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:45:39.477235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-adaefe74-92aa-4063-9019-7de29a1fd910 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:39.482011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-adaefe74-92aa-4063-9019-7de29a1fd910 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:39.543045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adaefe74-92aa-4063-9019-7de29a1fd910 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:39.543618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adaefe74-92aa-4063-9019-7de29a1fd910 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:39.544077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adaefe74-92aa-4063-9019-7de29a1fd910 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:39.544839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adaefe74-92aa-4063-9019-7de29a1fd910 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:39.545485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adaefe74-92aa-4063-9019-7de29a1fd910 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:39.545927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adaefe74-92aa-4063-9019-7de29a1fd910 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:39.716244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-adaefe74-92aa-4063-9019-7de29a1fd910 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:39.727724 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-adaefe74-92aa-4063-9019-7de29a1fd910 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1219 microversion: 2.1 time: 0.256609 Aug 09 14:45:39.728334 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1669/3424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:39 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1219 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:45:39.741917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:39.754202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:39.773379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:39.775672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:39.779696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:39.781301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:39.781712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:39.782323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:39.794246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c1f917c6-1399-4fd7-848c-09f760ee9689 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:39.812195 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c1f917c6-1399-4fd7-848c-09f760ee9689 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1505 microversion: 2.1 time: 0.667879 Aug 09 14:45:39.830221 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1756/3425] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:39 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1505 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:39.845219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-111467c0-ffa8-4002-94cd-6cd0c3545d57 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-518322336"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:39.846155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-111467c0-ffa8-4002-94cd-6cd0c3545d57 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:39.857550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:39.858311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:39.858934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:39.859572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lazy-loading 'fault' on Instance uuid 03b0805d-607d-451c-9255-eecd787f5d1e {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:45:39.862723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-111467c0-ffa8-4002-94cd-6cd0c3545d57 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:39.863381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-111467c0-ffa8-4002-94cd-6cd0c3545d57 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:39.863662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-111467c0-ffa8-4002-94cd-6cd0c3545d57 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:39.864360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-111467c0-ffa8-4002-94cd-6cd0c3545d57 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:39.873100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-111467c0-ffa8-4002-94cd-6cd0c3545d57 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:39.873715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-111467c0-ffa8-4002-94cd-6cd0c3545d57 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:39.994204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1d53fbb760a4b9282197668b9296c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426fbb89ba614432b3a0cb87e0e4cd69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:40.016676 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03f56638-9fbc-4b10-8495-854d9169b1f8 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 200 len: 1298 microversion: 2.1 time: 0.285673 Aug 09 14:45:40.035451 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1670/3426] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:39 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 1298 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:40.164469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b93abf3b-d951-46bc-b885-6d4334d8f20b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:40.165900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b93abf3b-d951-46bc-b885-6d4334d8f20b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:40.183756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b93abf3b-d951-46bc-b885-6d4334d8f20b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:40.185756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b93abf3b-d951-46bc-b885-6d4334d8f20b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:40.186221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b93abf3b-d951-46bc-b885-6d4334d8f20b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:40.186989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b93abf3b-d951-46bc-b885-6d4334d8f20b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:40.187486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b93abf3b-d951-46bc-b885-6d4334d8f20b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:40.190449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b93abf3b-d951-46bc-b885-6d4334d8f20b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:40.237857 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.network.security_group_api [None req-111467c0-ffa8-4002-94cd-6cd0c3545d57 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Adding security group 9a0b804d-11eb-452f-8e5d-97641a2247b9 to port 57fb83f8-f7aa-4e16-aa43-91cb5686c4a6 Aug 09 14:45:40.838224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b93abf3b-d951-46bc-b885-6d4334d8f20b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:40.853170 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b93abf3b-d951-46bc-b885-6d4334d8f20b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1402 microversion: 2.1 time: 0.694659 Aug 09 14:45:40.854177 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1671/3427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:40 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1402 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:45:40.860445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c451c2e-aa53-4603-8265-e6a8c85d684d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:40.863838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c451c2e-aa53-4603-8265-e6a8c85d684d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:40.874517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c451c2e-aa53-4603-8265-e6a8c85d684d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:40.878406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c451c2e-aa53-4603-8265-e6a8c85d684d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:40.879632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c451c2e-aa53-4603-8265-e6a8c85d684d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:40.890569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c451c2e-aa53-4603-8265-e6a8c85d684d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:40.891168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c451c2e-aa53-4603-8265-e6a8c85d684d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:40.891752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c451c2e-aa53-4603-8265-e6a8c85d684d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.137320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1c451c2e-aa53-4603-8265-e6a8c85d684d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:41.147588 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c451c2e-aa53-4603-8265-e6a8c85d684d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1273 microversion: 2.1 time: 0.292059 Aug 09 14:45:41.150970 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1672/3428] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:40 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:41.156389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-374fc914-50dc-4cad-b12e-bc00db1424b4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:41.163604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-374fc914-50dc-4cad-b12e-bc00db1424b4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 03b0805d-607d-451c-9255-eecd787f5d1e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:41.178084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-374fc914-50dc-4cad-b12e-bc00db1424b4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.179581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-374fc914-50dc-4cad-b12e-bc00db1424b4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.180210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-374fc914-50dc-4cad-b12e-bc00db1424b4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.188310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-374fc914-50dc-4cad-b12e-bc00db1424b4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.189075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-374fc914-50dc-4cad-b12e-bc00db1424b4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.189709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-374fc914-50dc-4cad-b12e-bc00db1424b4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.225209 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-374fc914-50dc-4cad-b12e-bc00db1424b4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] HTTP exception thrown: Instance 03b0805d-607d-451c-9255-eecd787f5d1e could not be found. Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-374fc914-50dc-4cad-b12e-bc00db1424b4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Request method failure captured: Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e HTTP/1.1 Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nIR2QwlGfXxczDQxiJ-nxdtidHVTvqhomQgCyZ2Y85sDxWtYXcxlvIBrba7bd_NZopS7x7FunncDfFOhUssk7cyRA6E1zM5UOR-f7vSdnLNyyWfvJcGgSTCnHrCqnB7U8a6Cx9DMcJSJ5gS5qk0TPUqeNQEF__CeMX_eNKSDfYq8hg Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_426fbb89ba614432b3a0cb87e0e4cd69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d1d53fbb760a4b9282197668b9296c38 Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 03b0805d-607d-451c-9255-eecd787f5d1e could not be found. Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '03b0805d-607d-451c-9255-eecd787f5d1e'} Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03b0805d-607d-451c-9255-eecd787f5d1e could not be found. Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03b0805d-607d-451c-9255-eecd787f5d1e could not be found. Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.231503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.236873 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.236873 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.236873 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:41.236873 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:41.236873 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03b0805d-607d-451c-9255-eecd787f5d1e could not be found. Aug 09 14:45:41.236873 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.238441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-374fc914-50dc-4cad-b12e-bc00db1424b4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Returning 404 to user: Instance 03b0805d-607d-451c-9255-eecd787f5d1e could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:41.241637 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-374fc914-50dc-4cad-b12e-bc00db1424b4 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e" status: 404 len: 111 microversion: 2.1 time: 0.089196 Aug 09 14:45:41.242182 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1673/3429] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:41 2022] GET /compute/v2.1/servers/03b0805d-607d-451c-9255-eecd787f5d1e => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:45:41.253980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-676fb9ba-e864-4bda-8aad-f45f8c113a7a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41ddda0af0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:41.281679 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-676fb9ba-e864-4bda-8aad-f45f8c113a7a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] HTTP exception thrown: Image not found. Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-676fb9ba-e864-4bda-8aad-f45f8c113a7a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Request method failure captured: Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b HTTP/1.1 Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nIR2QwlGfXxczDQxiJ-nxdtidHVTvqhomQgCyZ2Y85sDxWtYXcxlvIBrba7bd_NZopS7x7FunncDfFOhUssk7cyRA6E1zM5UOR-f7vSdnLNyyWfvJcGgSTCnHrCqnB7U8a6Cx9DMcJSJ5gS5qk0TPUqeNQEF__CeMX_eNKSDfYq8hg Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_426fbb89ba614432b3a0cb87e0e4cd69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d1d53fbb760a4b9282197668b9296c38 Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'e736221b-49aa-43dd-b7bc-4c3033ea4b3b'} Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e736221b-49aa-43dd-b7bc-4c3033ea4b3b to delete Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e736221b-49aa-43dd-b7bc-4c3033ea4b3b could not be found. Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.284067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:45:41.289594 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.292259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-676fb9ba-e864-4bda-8aad-f45f8c113a7a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:41.293347 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-676fb9ba-e864-4bda-8aad-f45f8c113a7a tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b" status: 404 len: 62 microversion: 2.1 time: 0.046817 Aug 09 14:45:41.294313 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1674/3430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:41 2022] DELETE /compute/v2.1/images/e736221b-49aa-43dd-b7bc-4c3033ea4b3b => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:45:41.306633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3690e80b-33f5-4a44-9297-fb64e6d22a0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:41.307419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3690e80b-33f5-4a44-9297-fb64e6d22a0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:41.316255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3690e80b-33f5-4a44-9297-fb64e6d22a0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.316877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3690e80b-33f5-4a44-9297-fb64e6d22a0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.317419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3690e80b-33f5-4a44-9297-fb64e6d22a0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.318249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3690e80b-33f5-4a44-9297-fb64e6d22a0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.318817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3690e80b-33f5-4a44-9297-fb64e6d22a0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.319402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3690e80b-33f5-4a44-9297-fb64e6d22a0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.346140 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-3690e80b-33f5-4a44-9297-fb64e6d22a0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] HTTP exception thrown: Instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 could not be found. Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3690e80b-33f5-4a44-9297-fb64e6d22a0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Request method failure captured: Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 HTTP/1.1 Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nIR2QwlGfXxczDQxiJ-nxdtidHVTvqhomQgCyZ2Y85sDxWtYXcxlvIBrba7bd_NZopS7x7FunncDfFOhUssk7cyRA6E1zM5UOR-f7vSdnLNyyWfvJcGgSTCnHrCqnB7U8a6Cx9DMcJSJ5gS5qk0TPUqeNQEF__CeMX_eNKSDfYq8hg Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_426fbb89ba614432b3a0cb87e0e4cd69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d1d53fbb760a4b9282197668b9296c38 Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 could not be found. Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '65b708eb-9c45-4e12-8917-50a349e7f0f4'} Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 could not be found. Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:45:41.348211 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 could not be found. Aug 09 14:45:41.353077 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.353077 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.353077 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.353077 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.353077 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.353077 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.353077 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:41.353077 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:41.353077 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 could not be found. Aug 09 14:45:41.353077 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.355405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3690e80b-33f5-4a44-9297-fb64e6d22a0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Returning 404 to user: Instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:41.356640 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3690e80b-33f5-4a44-9297-fb64e6d22a0b tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 404 len: 111 microversion: 2.1 time: 0.057898 Aug 09 14:45:41.357750 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1675/3431] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:45:41 2022] DELETE /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:45:41.370130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bdef65f6-0f38-4102-afd1-78ce501d6735 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:41.370130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bdef65f6-0f38-4102-afd1-78ce501d6735 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 65b708eb-9c45-4e12-8917-50a349e7f0f4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:41.382794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdef65f6-0f38-4102-afd1-78ce501d6735 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.383765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdef65f6-0f38-4102-afd1-78ce501d6735 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.384372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdef65f6-0f38-4102-afd1-78ce501d6735 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.387463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdef65f6-0f38-4102-afd1-78ce501d6735 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.388382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdef65f6-0f38-4102-afd1-78ce501d6735 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.389104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdef65f6-0f38-4102-afd1-78ce501d6735 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.411714 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-bdef65f6-0f38-4102-afd1-78ce501d6735 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] HTTP exception thrown: Instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 could not be found. Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bdef65f6-0f38-4102-afd1-78ce501d6735 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Request method failure captured: Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 HTTP/1.1 Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nIR2QwlGfXxczDQxiJ-nxdtidHVTvqhomQgCyZ2Y85sDxWtYXcxlvIBrba7bd_NZopS7x7FunncDfFOhUssk7cyRA6E1zM5UOR-f7vSdnLNyyWfvJcGgSTCnHrCqnB7U8a6Cx9DMcJSJ5gS5qk0TPUqeNQEF__CeMX_eNKSDfYq8hg Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_426fbb89ba614432b3a0cb87e0e4cd69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d1d53fbb760a4b9282197668b9296c38 Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 could not be found. Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '65b708eb-9c45-4e12-8917-50a349e7f0f4'} Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 could not be found. Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 could not be found. Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.413761 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.419758 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.419758 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.419758 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:41.419758 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:41.419758 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 could not be found. Aug 09 14:45:41.419758 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.422370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bdef65f6-0f38-4102-afd1-78ce501d6735 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Returning 404 to user: Instance 65b708eb-9c45-4e12-8917-50a349e7f0f4 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:41.423745 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bdef65f6-0f38-4102-afd1-78ce501d6735 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4" status: 404 len: 111 microversion: 2.1 time: 0.061687 Aug 09 14:45:41.425875 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1676/3432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:41 2022] GET /compute/v2.1/servers/65b708eb-9c45-4e12-8917-50a349e7f0f4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:45:41.435579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-af07a49b-e0cf-4c4a-a4dd-1590e59ab35e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41de113280>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:41.460617 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-af07a49b-e0cf-4c4a-a4dd-1590e59ab35e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] HTTP exception thrown: Image not found. Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-af07a49b-e0cf-4c4a-a4dd-1590e59ab35e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Request method failure captured: Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c HTTP/1.1 Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nIR2QwlGfXxczDQxiJ-nxdtidHVTvqhomQgCyZ2Y85sDxWtYXcxlvIBrba7bd_NZopS7x7FunncDfFOhUssk7cyRA6E1zM5UOR-f7vSdnLNyyWfvJcGgSTCnHrCqnB7U8a6Cx9DMcJSJ5gS5qk0TPUqeNQEF__CeMX_eNKSDfYq8hg Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_426fbb89ba614432b3a0cb87e0e4cd69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d1d53fbb760a4b9282197668b9296c38 Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'f282085b-844e-4fe1-a096-1254e735b76c'} Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f282085b-844e-4fe1-a096-1254e735b76c to delete Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f282085b-844e-4fe1-a096-1254e735b76c could not be found. Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.462534 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-af07a49b-e0cf-4c4a-a4dd-1590e59ab35e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:41.468057 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-af07a49b-e0cf-4c4a-a4dd-1590e59ab35e tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c" status: 404 len: 62 microversion: 2.1 time: 0.034905 Aug 09 14:45:41.502315 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1677/3433] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:41 2022] DELETE /compute/v2.1/images/f282085b-844e-4fe1-a096-1254e735b76c => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:45:41.509302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6170ee65-e7f1-43f7-a3fa-3178e6d690a2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:41.510081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6170ee65-e7f1-43f7-a3fa-3178e6d690a2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:41.523801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6170ee65-e7f1-43f7-a3fa-3178e6d690a2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.524488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6170ee65-e7f1-43f7-a3fa-3178e6d690a2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.524948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6170ee65-e7f1-43f7-a3fa-3178e6d690a2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.525669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6170ee65-e7f1-43f7-a3fa-3178e6d690a2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.526152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6170ee65-e7f1-43f7-a3fa-3178e6d690a2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.526581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6170ee65-e7f1-43f7-a3fa-3178e6d690a2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.545209 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6170ee65-e7f1-43f7-a3fa-3178e6d690a2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] HTTP exception thrown: Instance 99173f66-b303-416e-b3ba-71109d2fc9f8 could not be found. Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6170ee65-e7f1-43f7-a3fa-3178e6d690a2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Request method failure captured: Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 HTTP/1.1 Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nIR2QwlGfXxczDQxiJ-nxdtidHVTvqhomQgCyZ2Y85sDxWtYXcxlvIBrba7bd_NZopS7x7FunncDfFOhUssk7cyRA6E1zM5UOR-f7vSdnLNyyWfvJcGgSTCnHrCqnB7U8a6Cx9DMcJSJ5gS5qk0TPUqeNQEF__CeMX_eNKSDfYq8hg Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_426fbb89ba614432b3a0cb87e0e4cd69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d1d53fbb760a4b9282197668b9296c38 Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 99173f66-b303-416e-b3ba-71109d2fc9f8 could not be found. Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '99173f66-b303-416e-b3ba-71109d2fc9f8'} Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99173f66-b303-416e-b3ba-71109d2fc9f8 could not be found. Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:45:41.547025 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99173f66-b303-416e-b3ba-71109d2fc9f8 could not be found. Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99173f66-b303-416e-b3ba-71109d2fc9f8 could not be found. Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6170ee65-e7f1-43f7-a3fa-3178e6d690a2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Returning 404 to user: Instance 99173f66-b303-416e-b3ba-71109d2fc9f8 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6170ee65-e7f1-43f7-a3fa-3178e6d690a2 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 404 len: 111 microversion: 2.1 time: 0.045493 Aug 09 14:45:41.553338 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1678/3434] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:45:41 2022] DELETE /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:45:41.557955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b7763e3-2e82-461b-a547-968f955e0dce tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:41.558954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b7763e3-2e82-461b-a547-968f955e0dce tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: 99173f66-b303-416e-b3ba-71109d2fc9f8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:41.566526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b7763e3-2e82-461b-a547-968f955e0dce tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.567373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b7763e3-2e82-461b-a547-968f955e0dce tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.568076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b7763e3-2e82-461b-a547-968f955e0dce tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.569025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b7763e3-2e82-461b-a547-968f955e0dce tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.569888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b7763e3-2e82-461b-a547-968f955e0dce tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.570558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b7763e3-2e82-461b-a547-968f955e0dce tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.586673 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-9b7763e3-2e82-461b-a547-968f955e0dce tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] HTTP exception thrown: Instance 99173f66-b303-416e-b3ba-71109d2fc9f8 could not be found. Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b7763e3-2e82-461b-a547-968f955e0dce tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Request method failure captured: Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 HTTP/1.1 Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nIR2QwlGfXxczDQxiJ-nxdtidHVTvqhomQgCyZ2Y85sDxWtYXcxlvIBrba7bd_NZopS7x7FunncDfFOhUssk7cyRA6E1zM5UOR-f7vSdnLNyyWfvJcGgSTCnHrCqnB7U8a6Cx9DMcJSJ5gS5qk0TPUqeNQEF__CeMX_eNKSDfYq8hg Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_426fbb89ba614432b3a0cb87e0e4cd69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d1d53fbb760a4b9282197668b9296c38 Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 99173f66-b303-416e-b3ba-71109d2fc9f8 could not be found. Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '99173f66-b303-416e-b3ba-71109d2fc9f8'} Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99173f66-b303-416e-b3ba-71109d2fc9f8 could not be found. Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99173f66-b303-416e-b3ba-71109d2fc9f8 could not be found. Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.588496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.594488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.594488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.594488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:41.594488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:41.594488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99173f66-b303-416e-b3ba-71109d2fc9f8 could not be found. Aug 09 14:45:41.594488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.596956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b7763e3-2e82-461b-a547-968f955e0dce tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Returning 404 to user: Instance 99173f66-b303-416e-b3ba-71109d2fc9f8 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:41.598067 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b7763e3-2e82-461b-a547-968f955e0dce tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8" status: 404 len: 111 microversion: 2.1 time: 0.043896 Aug 09 14:45:41.598874 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1679/3435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:41 2022] GET /compute/v2.1/servers/99173f66-b303-416e-b3ba-71109d2fc9f8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:45:41.607540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ad4e1f92-5a3b-4497-8cb6-b13381e90dd9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '.version_select at 0x7f41de29c160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:41.659492 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ad4e1f92-5a3b-4497-8cb6-b13381e90dd9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] HTTP exception thrown: Image not found. Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ad4e1f92-5a3b-4497-8cb6-b13381e90dd9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Request method failure captured: Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 HTTP/1.1 Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nIR2QwlGfXxczDQxiJ-nxdtidHVTvqhomQgCyZ2Y85sDxWtYXcxlvIBrba7bd_NZopS7x7FunncDfFOhUssk7cyRA6E1zM5UOR-f7vSdnLNyyWfvJcGgSTCnHrCqnB7U8a6Cx9DMcJSJ5gS5qk0TPUqeNQEF__CeMX_eNKSDfYq8hg Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_426fbb89ba614432b3a0cb87e0e4cd69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d1d53fbb760a4b9282197668b9296c38 Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: exception: Image not found. Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '51b589a7-c050-4965-9839-d92a87c3cfe6'} Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 51b589a7-c050-4965-9839-d92a87c3cfe6 to delete Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 51b589a7-c050-4965-9839-d92a87c3cfe6 could not be found. Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.661783 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 09 14:45:41.667583 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.669873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ad4e1f92-5a3b-4497-8cb6-b13381e90dd9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Returning 404 to user: Image not found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:41.674707 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ad4e1f92-5a3b-4497-8cb6-b13381e90dd9 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6" status: 404 len: 62 microversion: 2.1 time: 0.067733 Aug 09 14:45:41.678877 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1680/3436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:41 2022] DELETE /compute/v2.1/images/51b589a7-c050-4965-9839-d92a87c3cfe6 => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:45:41.693145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-276aa3e1-e003-40b3-b6b7-09f48cdde971 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:41.693844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-276aa3e1-e003-40b3-b6b7-09f48cdde971 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:41.708045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-276aa3e1-e003-40b3-b6b7-09f48cdde971 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.708696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-276aa3e1-e003-40b3-b6b7-09f48cdde971 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.709624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-276aa3e1-e003-40b3-b6b7-09f48cdde971 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.710497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-276aa3e1-e003-40b3-b6b7-09f48cdde971 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.712511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-276aa3e1-e003-40b3-b6b7-09f48cdde971 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.713692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-276aa3e1-e003-40b3-b6b7-09f48cdde971 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.736724 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-276aa3e1-e003-40b3-b6b7-09f48cdde971 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] HTTP exception thrown: Instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 could not be found. Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-276aa3e1-e003-40b3-b6b7-09f48cdde971 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Request method failure captured: Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 HTTP/1.1 Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nIR2QwlGfXxczDQxiJ-nxdtidHVTvqhomQgCyZ2Y85sDxWtYXcxlvIBrba7bd_NZopS7x7FunncDfFOhUssk7cyRA6E1zM5UOR-f7vSdnLNyyWfvJcGgSTCnHrCqnB7U8a6Cx9DMcJSJ5gS5qk0TPUqeNQEF__CeMX_eNKSDfYq8hg Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_426fbb89ba614432b3a0cb87e0e4cd69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d1d53fbb760a4b9282197668b9296c38 Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 could not be found. Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'd9e3bd4a-f659-481c-bdeb-dfd8b8642d34'} Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 could not be found. Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:45:41.738988 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 could not be found. Aug 09 14:45:41.743817 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.743817 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.743817 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.743817 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.743817 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.743817 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.743817 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:41.743817 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:41.743817 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 could not be found. Aug 09 14:45:41.743817 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.743817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-276aa3e1-e003-40b3-b6b7-09f48cdde971 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Returning 404 to user: Instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:41.745128 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-276aa3e1-e003-40b3-b6b7-09f48cdde971 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 404 len: 111 microversion: 2.1 time: 0.060551 Aug 09 14:45:41.745969 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1681/3437] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:45:41 2022] DELETE /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:45:41.756063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac104210-87e2-4a8f-9349-4d553c402924 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:41.756860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ac104210-87e2-4a8f-9349-4d553c402924 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] [instance: d9e3bd4a-f659-481c-bdeb-dfd8b8642d34] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:41.766588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac104210-87e2-4a8f-9349-4d553c402924 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.767427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac104210-87e2-4a8f-9349-4d553c402924 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.768096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac104210-87e2-4a8f-9349-4d553c402924 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.769205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac104210-87e2-4a8f-9349-4d553c402924 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.769731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac104210-87e2-4a8f-9349-4d553c402924 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.770268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac104210-87e2-4a8f-9349-4d553c402924 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.787759 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ac104210-87e2-4a8f-9349-4d553c402924 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] HTTP exception thrown: Instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 could not be found. Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac104210-87e2-4a8f-9349-4d553c402924 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Request method failure captured: Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 HTTP/1.1 Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nIR2QwlGfXxczDQxiJ-nxdtidHVTvqhomQgCyZ2Y85sDxWtYXcxlvIBrba7bd_NZopS7x7FunncDfFOhUssk7cyRA6E1zM5UOR-f7vSdnLNyyWfvJcGgSTCnHrCqnB7U8a6Cx9DMcJSJ5gS5qk0TPUqeNQEF__CeMX_eNKSDfYq8hg Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_426fbb89ba614432b3a0cb87e0e4cd69", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/426fbb89ba614432b3a0cb87e0e4cd69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 426fbb89ba614432b3a0cb87e0e4cd69 Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ImagesTestJSON-1868982752 Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d1d53fbb760a4b9282197668b9296c38 Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ImagesTestJSON-1868982752-project Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 could not be found. Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'd9e3bd4a-f659-481c-bdeb-dfd8b8642d34'} Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 could not be found. Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 could not be found. Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.789751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:41.798020 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:41.798020 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:41.798020 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:41.798020 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:41.798020 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 could not be found. Aug 09 14:45:41.798020 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:45:41.798020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac104210-87e2-4a8f-9349-4d553c402924 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] Returning 404 to user: Instance d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:41.798020 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ac104210-87e2-4a8f-9349-4d553c402924 tempest-ImagesTestJSON-1868982752 tempest-ImagesTestJSON-1868982752-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34" status: 404 len: 111 microversion: 2.1 time: 0.040233 Aug 09 14:45:41.798020 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1682/3438] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:41 2022] GET /compute/v2.1/servers/d9e3bd4a-f659-481c-bdeb-dfd8b8642d34 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:45:41.876814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2774303b-7549-4f5b-86e8-3b9332bd3819 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:41.876814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2774303b-7549-4f5b-86e8-3b9332bd3819 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:41.884011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2774303b-7549-4f5b-86e8-3b9332bd3819 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.886135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2774303b-7549-4f5b-86e8-3b9332bd3819 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.887707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2774303b-7549-4f5b-86e8-3b9332bd3819 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.888642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2774303b-7549-4f5b-86e8-3b9332bd3819 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:41.889894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2774303b-7549-4f5b-86e8-3b9332bd3819 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:41.890335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2774303b-7549-4f5b-86e8-3b9332bd3819 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:41.955443 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-111467c0-ffa8-4002-94cd-6cd0c3545d57 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf/action" status: 202 len: 0 microversion: 2.1 time: 2.115352 Aug 09 14:45:41.956501 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1757/3439] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:45:39 2022] POST /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf/action => generated 0 bytes in 2118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:45:41.966279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efc0b14f-c69e-4505-aa13-895e99898be7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dc8d1280>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:42.630114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2774303b-7549-4f5b-86e8-3b9332bd3819 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:42.639837 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2774303b-7549-4f5b-86e8-3b9332bd3819 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1402 microversion: 2.1 time: 0.769684 Aug 09 14:45:42.651401 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1683/3440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:41 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1402 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:45:42.657007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG neutronclient.v2_0.client [None req-efc0b14f-c69e-4505-aa13-895e99898be7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9a0b804d-11eb-452f-8e5d-97641a2247b9 in use.", "detail": ""}} {{(pid=119407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:45:42.658131 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-efc0b14f-c69e-4505-aa13-895e99898be7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Security Group 9a0b804d-11eb-452f-8e5d-97641a2247b9 in use. Aug 09 14:45:42.658131 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-22db5eda-a260-4d57-938a-826aafbcfc47'] Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efc0b14f-c69e-4505-aa13-895e99898be7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/os-security-groups/9a0b804d-11eb-452f-8e5d-97641a2247b9 HTTP/1.1 Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: exception: Security Group 9a0b804d-11eb-452f-8e5d-97641a2247b9 in use. Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-22db5eda-a260-4d57-938a-826aafbcfc47'] Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '9a0b804d-11eb-452f-8e5d-97641a2247b9'} Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:45:42.661091 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9a0b804d-11eb-452f-8e5d-97641a2247b9 in use. Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22db5eda-a260-4d57-938a-826aafbcfc47'] Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9a0b804d-11eb-452f-8e5d-97641a2247b9 in use. Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22db5eda-a260-4d57-938a-826aafbcfc47'] Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9a0b804d-11eb-452f-8e5d-97641a2247b9 in use. Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22db5eda-a260-4d57-938a-826aafbcfc47'] Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9a0b804d-11eb-452f-8e5d-97641a2247b9 in use. Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-22db5eda-a260-4d57-938a-826aafbcfc47'] Aug 09 14:45:42.666073 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:42.669006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-985b4005-e4a5-444d-929e-9ad6b9108908 req-15a6a6e2-74f3-49e5-9ce9-eada01f3d525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27684bc-0b81-45ee-8f6b-fddcfa000bdf", "tag": "57fb83f8-f7aa-4e16-aa43-91cb5686c4a6"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:42.670128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efc0b14f-c69e-4505-aa13-895e99898be7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 400 to user: Security Group 9a0b804d-11eb-452f-8e5d-97641a2247b9 in use. Aug 09 14:45:42.670128 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-22db5eda-a260-4d57-938a-826aafbcfc47'] {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:42.671115 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-efc0b14f-c69e-4505-aa13-895e99898be7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/9a0b804d-11eb-452f-8e5d-97641a2247b9" status: 400 len: 185 microversion: 2.1 time: 0.710222 Aug 09 14:45:42.672133 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1758/3441] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:45:41 2022] DELETE /compute/v2.1/os-security-groups/9a0b804d-11eb-452f-8e5d-97641a2247b9 => generated 185 bytes in 712 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:45:42.682346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-985b4005-e4a5-444d-929e-9ad6b9108908 req-15a6a6e2-74f3-49e5-9ce9-eada01f3d525 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:42.684871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-985b4005-e4a5-444d-929e-9ad6b9108908 req-15a6a6e2-74f3-49e5-9ce9-eada01f3d525 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:42.685304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-985b4005-e4a5-444d-929e-9ad6b9108908 req-15a6a6e2-74f3-49e5-9ce9-eada01f3d525 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:42.686119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc537428-33d8-47cb-b114-a27ebe373917 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:42.686751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fc537428-33d8-47cb-b114-a27ebe373917 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:42.702673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc537428-33d8-47cb-b114-a27ebe373917 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:42.704587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc537428-33d8-47cb-b114-a27ebe373917 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:42.707306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc537428-33d8-47cb-b114-a27ebe373917 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:42.711139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc537428-33d8-47cb-b114-a27ebe373917 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:42.711771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc537428-33d8-47cb-b114-a27ebe373917 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:42.712381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc537428-33d8-47cb-b114-a27ebe373917 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:42.715817 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-985b4005-e4a5-444d-929e-9ad6b9108908 req-15a6a6e2-74f3-49e5-9ce9-eada01f3d525 service nova] Creating event network-changed:57fb83f8-f7aa-4e16-aa43-91cb5686c4a6 for instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf on n-h2-844626-8 Aug 09 14:45:42.726419 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-985b4005-e4a5-444d-929e-9ad6b9108908 req-15a6a6e2-74f3-49e5-9ce9-eada01f3d525 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073455 Aug 09 14:45:42.730213 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1684/3442] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:42.741171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23c466a4-24ba-45e7-aa1e-bd44dc097461 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:42.745601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-23c466a4-24ba-45e7-aa1e-bd44dc097461 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:42.756604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23c466a4-24ba-45e7-aa1e-bd44dc097461 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:42.760107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23c466a4-24ba-45e7-aa1e-bd44dc097461 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:42.761226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23c466a4-24ba-45e7-aa1e-bd44dc097461 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:42.763543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23c466a4-24ba-45e7-aa1e-bd44dc097461 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:42.764026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23c466a4-24ba-45e7-aa1e-bd44dc097461 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:42.764463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23c466a4-24ba-45e7-aa1e-bd44dc097461 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:43.021854 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-23c466a4-24ba-45e7-aa1e-bd44dc097461 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf/action" status: 202 len: 0 microversion: 2.1 time: 0.288165 Aug 09 14:45:43.023178 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1685/3443] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:45:42 2022] POST /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:45:43.031070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-aa587632-a880-47f5-afc9-207688200c91 req-b83b3147-b91a-4095-8b03-1fa5aedf5d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e99b44-1a79-447e-bf30-01f5960687e3", "tag": "36ea3e78-3624-4828-923b-7aa0969c0afd"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:43.044067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-aa587632-a880-47f5-afc9-207688200c91 req-b83b3147-b91a-4095-8b03-1fa5aedf5d1e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:43.045120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-aa587632-a880-47f5-afc9-207688200c91 req-b83b3147-b91a-4095-8b03-1fa5aedf5d1e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:43.046140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-aa587632-a880-47f5-afc9-207688200c91 req-b83b3147-b91a-4095-8b03-1fa5aedf5d1e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:43.062264 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-aa587632-a880-47f5-afc9-207688200c91 req-b83b3147-b91a-4095-8b03-1fa5aedf5d1e service nova] Creating event network-changed:36ea3e78-3624-4828-923b-7aa0969c0afd for instance 30e99b44-1a79-447e-bf30-01f5960687e3 on n-h1-844626-8 Aug 09 14:45:43.069042 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-aa587632-a880-47f5-afc9-207688200c91 req-b83b3147-b91a-4095-8b03-1fa5aedf5d1e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043979 Aug 09 14:45:43.070558 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1686/3444] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:43.077907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94cb5f65-d221-4456-96b1-240566680c56 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:43.080225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-94cb5f65-d221-4456-96b1-240566680c56 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:43.091520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94cb5f65-d221-4456-96b1-240566680c56 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:43.092204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94cb5f65-d221-4456-96b1-240566680c56 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:43.092773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94cb5f65-d221-4456-96b1-240566680c56 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:43.094208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94cb5f65-d221-4456-96b1-240566680c56 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:43.094738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94cb5f65-d221-4456-96b1-240566680c56 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:43.095395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94cb5f65-d221-4456-96b1-240566680c56 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:43.653004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc537428-33d8-47cb-b114-a27ebe373917 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:43.665735 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc537428-33d8-47cb-b114-a27ebe373917 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1315 microversion: 2.1 time: 0.992176 Aug 09 14:45:43.672723 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1759/3445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:42 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1315 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:43.687317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d3b064b5-faca-4099-becb-559a641b5523 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:43.689000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d3b064b5-faca-4099-becb-559a641b5523 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:43.703952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3b064b5-faca-4099-becb-559a641b5523 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:43.704735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3b064b5-faca-4099-becb-559a641b5523 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:43.705347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3b064b5-faca-4099-becb-559a641b5523 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:43.706343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3b064b5-faca-4099-becb-559a641b5523 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:43.706964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3b064b5-faca-4099-becb-559a641b5523 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:43.707795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3b064b5-faca-4099-becb-559a641b5523 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:43.717148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-94cb5f65-d221-4456-96b1-240566680c56 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:43.727662 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-94cb5f65-d221-4456-96b1-240566680c56 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1575 microversion: 2.1 time: 0.654860 Aug 09 14:45:43.728784 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1687/3446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:43 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1575 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:44.306589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3b064b5-faca-4099-becb-559a641b5523 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:44.316678 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d3b064b5-faca-4099-becb-559a641b5523 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1402 microversion: 2.1 time: 0.642784 Aug 09 14:45:44.322155 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1760/3447] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:43 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1402 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:44.700588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bfcdeecb-46e0-4c2b-9159-a263febb7926 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:44.701410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bfcdeecb-46e0-4c2b-9159-a263febb7926 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:44.725554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfcdeecb-46e0-4c2b-9159-a263febb7926 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:44.726778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfcdeecb-46e0-4c2b-9159-a263febb7926 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:44.727269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfcdeecb-46e0-4c2b-9159-a263febb7926 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:44.728032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfcdeecb-46e0-4c2b-9159-a263febb7926 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:44.728498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfcdeecb-46e0-4c2b-9159-a263febb7926 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:44.735598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bfcdeecb-46e0-4c2b-9159-a263febb7926 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:44.751739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b34256d-7d79-456f-99cf-3a1e4d1c75f7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:44.753126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b34256d-7d79-456f-99cf-3a1e4d1c75f7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:44.768044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b34256d-7d79-456f-99cf-3a1e4d1c75f7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:44.777452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b34256d-7d79-456f-99cf-3a1e4d1c75f7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:44.777947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b34256d-7d79-456f-99cf-3a1e4d1c75f7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:44.778968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b34256d-7d79-456f-99cf-3a1e4d1c75f7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:44.781485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b34256d-7d79-456f-99cf-3a1e4d1c75f7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:44.782023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b34256d-7d79-456f-99cf-3a1e4d1c75f7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:45.750554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bfcdeecb-46e0-4c2b-9159-a263febb7926 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:45.758153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:45.762074 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bfcdeecb-46e0-4c2b-9159-a263febb7926 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1315 microversion: 2.1 time: 1.073300 Aug 09 14:45:45.762974 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1688/3448] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:44 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1315 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:45.784107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d538aa8-ee86-4b3c-9693-4754a535de0b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:45.788650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d538aa8-ee86-4b3c-9693-4754a535de0b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:45.795332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d538aa8-ee86-4b3c-9693-4754a535de0b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:45.796111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d538aa8-ee86-4b3c-9693-4754a535de0b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:45.796839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d538aa8-ee86-4b3c-9693-4754a535de0b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:45.798130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d538aa8-ee86-4b3c-9693-4754a535de0b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:45.798803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d538aa8-ee86-4b3c-9693-4754a535de0b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:45.799503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d538aa8-ee86-4b3c-9693-4754a535de0b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:45.887720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b34256d-7d79-456f-99cf-3a1e4d1c75f7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:45.915390 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b34256d-7d79-456f-99cf-3a1e4d1c75f7 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1575 microversion: 2.1 time: 1.169547 Aug 09 14:45:45.916556 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1761/3449] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:44 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1575 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:45:46.377382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6d538aa8-ee86-4b3c-9693-4754a535de0b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:46.387281 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d538aa8-ee86-4b3c-9693-4754a535de0b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1402 microversion: 2.1 time: 0.608418 Aug 09 14:45:46.404858 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1689/3450] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:45 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1402 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:46.758594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-04f0986c-d1d2-4b6e-8654-f68a3e2a0dec req-d042864a-4967-4462-9734-5e6847bea50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "869e1aa4-a65f-4809-b887-43189411412d", "tag": "f26f4997-3ecf-4530-a83d-0274887258bf"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:46.783552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-04f0986c-d1d2-4b6e-8654-f68a3e2a0dec req-d042864a-4967-4462-9734-5e6847bea50a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:46.786569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-04f0986c-d1d2-4b6e-8654-f68a3e2a0dec req-d042864a-4967-4462-9734-5e6847bea50a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:46.787078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e76290be-bab6-42e8-aab1-d2b3ff1d2152 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:46.787910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-04f0986c-d1d2-4b6e-8654-f68a3e2a0dec req-d042864a-4967-4462-9734-5e6847bea50a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:46.788499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e76290be-bab6-42e8-aab1-d2b3ff1d2152 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:46.802156 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-04f0986c-d1d2-4b6e-8654-f68a3e2a0dec req-d042864a-4967-4462-9734-5e6847bea50a service nova] Creating event network-changed:f26f4997-3ecf-4530-a83d-0274887258bf for instance 869e1aa4-a65f-4809-b887-43189411412d on n-h1-844626-8 Aug 09 14:45:46.806638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e76290be-bab6-42e8-aab1-d2b3ff1d2152 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:46.808163 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-04f0986c-d1d2-4b6e-8654-f68a3e2a0dec req-d042864a-4967-4462-9734-5e6847bea50a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053383 Aug 09 14:45:46.809423 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1762/3451] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:46.810952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e76290be-bab6-42e8-aab1-d2b3ff1d2152 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:46.811564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e76290be-bab6-42e8-aab1-d2b3ff1d2152 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:46.815615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e76290be-bab6-42e8-aab1-d2b3ff1d2152 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:46.819702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e76290be-bab6-42e8-aab1-d2b3ff1d2152 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:46.820224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e76290be-bab6-42e8-aab1-d2b3ff1d2152 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:46.939872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-128df52d-fde3-4179-90cf-db79956e8e7a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:46.940494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-128df52d-fde3-4179-90cf-db79956e8e7a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:46.947463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-128df52d-fde3-4179-90cf-db79956e8e7a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:46.948674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-128df52d-fde3-4179-90cf-db79956e8e7a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:46.949290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-128df52d-fde3-4179-90cf-db79956e8e7a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:46.950242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-128df52d-fde3-4179-90cf-db79956e8e7a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:46.950856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-128df52d-fde3-4179-90cf-db79956e8e7a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:46.951466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-128df52d-fde3-4179-90cf-db79956e8e7a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:47.220165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e76290be-bab6-42e8-aab1-d2b3ff1d2152 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:47.232849 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e76290be-bab6-42e8-aab1-d2b3ff1d2152 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1315 microversion: 2.1 time: 0.451910 Aug 09 14:45:47.234230 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1690/3452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:46 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1315 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:47.318244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-128df52d-fde3-4179-90cf-db79956e8e7a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:47.330437 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-128df52d-fde3-4179-90cf-db79956e8e7a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1575 microversion: 2.1 time: 0.396004 Aug 09 14:45:47.344370 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1763/3453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:46 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1575 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:45:47.411383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34572f9f-0471-44a7-83ba-0bd69571d18b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:47.412509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34572f9f-0471-44a7-83ba-0bd69571d18b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:47.424264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34572f9f-0471-44a7-83ba-0bd69571d18b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:47.424843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34572f9f-0471-44a7-83ba-0bd69571d18b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:47.425344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34572f9f-0471-44a7-83ba-0bd69571d18b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:47.428966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34572f9f-0471-44a7-83ba-0bd69571d18b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:47.429695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34572f9f-0471-44a7-83ba-0bd69571d18b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:47.430328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34572f9f-0471-44a7-83ba-0bd69571d18b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:47.733261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34572f9f-0471-44a7-83ba-0bd69571d18b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:47.742388 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34572f9f-0471-44a7-83ba-0bd69571d18b tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1402 microversion: 2.1 time: 0.336275 Aug 09 14:45:47.743017 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1691/3454] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:47 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1402 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:48.254063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-460e0775-4eb2-447f-b45d-9f1f927dd64b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:48.254686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-460e0775-4eb2-447f-b45d-9f1f927dd64b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:48.267972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460e0775-4eb2-447f-b45d-9f1f927dd64b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:48.268711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460e0775-4eb2-447f-b45d-9f1f927dd64b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:48.269150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460e0775-4eb2-447f-b45d-9f1f927dd64b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:48.269888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460e0775-4eb2-447f-b45d-9f1f927dd64b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:48.278044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460e0775-4eb2-447f-b45d-9f1f927dd64b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:48.278926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460e0775-4eb2-447f-b45d-9f1f927dd64b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:48.353967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7cec0be5-a6c5-4736-ac5c-61843c597523 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:48.355312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7cec0be5-a6c5-4736-ac5c-61843c597523 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:48.358412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:48.359771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=16 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:48.368192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cec0be5-a6c5-4736-ac5c-61843c597523 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:48.368800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cec0be5-a6c5-4736-ac5c-61843c597523 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:48.369327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cec0be5-a6c5-4736-ac5c-61843c597523 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:48.370642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cec0be5-a6c5-4736-ac5c-61843c597523 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:48.371217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cec0be5-a6c5-4736-ac5c-61843c597523 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:48.371714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cec0be5-a6c5-4736-ac5c-61843c597523 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:48.450064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:48.707480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-460e0775-4eb2-447f-b45d-9f1f927dd64b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:48.733284 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-460e0775-4eb2-447f-b45d-9f1f927dd64b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1315 microversion: 2.1 time: 0.482187 Aug 09 14:45:48.734796 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1764/3455] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:48 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:48.775754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7deeb990-5c6b-4b44-997c-c61fa0717642 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:48.777313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7deeb990-5c6b-4b44-997c-c61fa0717642 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:48.785941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7deeb990-5c6b-4b44-997c-c61fa0717642 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:48.786990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7deeb990-5c6b-4b44-997c-c61fa0717642 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:48.793974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7deeb990-5c6b-4b44-997c-c61fa0717642 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:48.794991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7deeb990-5c6b-4b44-997c-c61fa0717642 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:48.795706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7deeb990-5c6b-4b44-997c-c61fa0717642 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:48.796268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7deeb990-5c6b-4b44-997c-c61fa0717642 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:48.911546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7cec0be5-a6c5-4736-ac5c-61843c597523 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:48.935704 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7cec0be5-a6c5-4736-ac5c-61843c597523 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1575 microversion: 2.1 time: 0.585873 Aug 09 14:45:48.938680 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1692/3456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:48 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1575 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:49.393190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7deeb990-5c6b-4b44-997c-c61fa0717642 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:49.406058 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7deeb990-5c6b-4b44-997c-c61fa0717642 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1402 microversion: 2.1 time: 0.636579 Aug 09 14:45:49.409426 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1765/3457] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:48 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1402 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:49.756200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c1116862-b2af-43f0-b01c-0095df7ec1fe tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:49.757868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c1116862-b2af-43f0-b01c-0095df7ec1fe tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:49.774305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1116862-b2af-43f0-b01c-0095df7ec1fe tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:49.775337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1116862-b2af-43f0-b01c-0095df7ec1fe tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:49.775943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1116862-b2af-43f0-b01c-0095df7ec1fe tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:49.776850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1116862-b2af-43f0-b01c-0095df7ec1fe tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:49.777521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1116862-b2af-43f0-b01c-0095df7ec1fe tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:49.778110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1116862-b2af-43f0-b01c-0095df7ec1fe tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:49.844374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-61cacf16-c153-4ae1-9189-244fe294cfcd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Action: 'create', calling method: .version_select at 0x7f41dc92edc0>, body: {"keypair": {"name": "tempest-keypair-1799985017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrbew02vQZ/VyQl5ubwKBzwWjZQD6FuOwN/Ck5n9z9d+bVTm76DcPD7keQSHpIMTADPZq7AqKHe3ql5Idbqci+DY4cCpXjyT98NjqwQcQffSNXWy2MkmPXeMwixyflvAQ=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:49.883381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-61cacf16-c153-4ae1-9189-244fe294cfcd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Getting quotas for project dd3f9be3e6694608a10e84ebab6d1a2a. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:45:49.899326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-61cacf16-c153-4ae1-9189-244fe294cfcd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Getting quotas for user df55ede6220049c1aee1bfd628c13a23 and project dd3f9be3e6694608a10e84ebab6d1a2a. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:45:49.967992 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-61cacf16-c153-4ae1-9189-244fe294cfcd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.133448 Aug 09 14:45:49.975320 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1766/3458] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 9 14:45:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 142 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 14:45:49.984146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-180c564d-d69f-45db-8f1e-6faf1f6fe49d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:49.985934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-180c564d-d69f-45db-8f1e-6faf1f6fe49d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:49.997537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-180c564d-d69f-45db-8f1e-6faf1f6fe49d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:49.998553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-180c564d-d69f-45db-8f1e-6faf1f6fe49d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:49.998990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-180c564d-d69f-45db-8f1e-6faf1f6fe49d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:50.002270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-180c564d-d69f-45db-8f1e-6faf1f6fe49d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:50.003845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-180c564d-d69f-45db-8f1e-6faf1f6fe49d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:50.004289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-180c564d-d69f-45db-8f1e-6faf1f6fe49d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:50.700910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c1116862-b2af-43f0-b01c-0095df7ec1fe tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:50.720815 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c1116862-b2af-43f0-b01c-0095df7ec1fe tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1315 microversion: 2.1 time: 0.966948 Aug 09 14:45:50.722469 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1693/3459] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:49 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1315 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:50.738071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de58f1cf-5842-4178-a4b5-eb026559dbec tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:50.738822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-de58f1cf-5842-4178-a4b5-eb026559dbec tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:50.755495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de58f1cf-5842-4178-a4b5-eb026559dbec tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:50.757078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de58f1cf-5842-4178-a4b5-eb026559dbec tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:50.760490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de58f1cf-5842-4178-a4b5-eb026559dbec tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:50.761405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de58f1cf-5842-4178-a4b5-eb026559dbec tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:50.762154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de58f1cf-5842-4178-a4b5-eb026559dbec tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:50.766301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de58f1cf-5842-4178-a4b5-eb026559dbec tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:51.286773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-180c564d-d69f-45db-8f1e-6faf1f6fe49d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:51.311562 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-180c564d-d69f-45db-8f1e-6faf1f6fe49d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1573 microversion: 2.1 time: 1.334107 Aug 09 14:45:51.314050 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1767/3460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:49 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1573 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:51.335348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0db14cac-50cb-42cf-a1e9-9130e6634107 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1638377476"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:51.335869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0db14cac-50cb-42cf-a1e9-9130e6634107 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:51.339413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-de58f1cf-5842-4178-a4b5-eb026559dbec tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:51.345118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db14cac-50cb-42cf-a1e9-9130e6634107 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:51.345870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db14cac-50cb-42cf-a1e9-9130e6634107 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:51.346450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db14cac-50cb-42cf-a1e9-9130e6634107 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:51.347423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db14cac-50cb-42cf-a1e9-9130e6634107 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:51.348287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db14cac-50cb-42cf-a1e9-9130e6634107 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:51.348862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db14cac-50cb-42cf-a1e9-9130e6634107 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:51.350863 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-de58f1cf-5842-4178-a4b5-eb026559dbec tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1402 microversion: 2.1 time: 0.626985 Aug 09 14:45:51.354879 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1694/3461] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:50 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1402 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:51.746054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3303e0d4-91c0-45c0-a18d-97db29c679d2 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:51.746526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3303e0d4-91c0-45c0-a18d-97db29c679d2 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:51.766728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3303e0d4-91c0-45c0-a18d-97db29c679d2 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:51.767429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3303e0d4-91c0-45c0-a18d-97db29c679d2 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:51.770543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3303e0d4-91c0-45c0-a18d-97db29c679d2 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:51.771360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3303e0d4-91c0-45c0-a18d-97db29c679d2 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:51.771839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3303e0d4-91c0-45c0-a18d-97db29c679d2 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:51.772280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3303e0d4-91c0-45c0-a18d-97db29c679d2 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:51.927430 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.network.security_group_api [None req-0db14cac-50cb-42cf-a1e9-9130e6634107 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Adding security group 889ea0db-76a7-494c-a948-ea9925f36c0c to port 57fb83f8-f7aa-4e16-aa43-91cb5686c4a6 Aug 09 14:45:52.355684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3303e0d4-91c0-45c0-a18d-97db29c679d2 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:52.365176 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3303e0d4-91c0-45c0-a18d-97db29c679d2 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1315 microversion: 2.1 time: 0.623179 Aug 09 14:45:52.365782 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1695/3462] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:51 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1315 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:45:52.405663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7e006c69-d096-488c-90d9-52f268235cb5 req-e60dea8c-5bc7-4efd-8445-a5d51305af2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e99b44-1a79-447e-bf30-01f5960687e3", "name": "network-vif-plugged", "status": "completed", "tag": "36ea3e78-3624-4828-923b-7aa0969c0afd"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:52.429174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7e006c69-d096-488c-90d9-52f268235cb5 req-e60dea8c-5bc7-4efd-8445-a5d51305af2a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:52.429920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7e006c69-d096-488c-90d9-52f268235cb5 req-e60dea8c-5bc7-4efd-8445-a5d51305af2a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:52.430347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7e006c69-d096-488c-90d9-52f268235cb5 req-e60dea8c-5bc7-4efd-8445-a5d51305af2a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:52.455026 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7e006c69-d096-488c-90d9-52f268235cb5 req-e60dea8c-5bc7-4efd-8445-a5d51305af2a service nova] Creating event network-vif-plugged:36ea3e78-3624-4828-923b-7aa0969c0afd for instance 30e99b44-1a79-447e-bf30-01f5960687e3 on n-h1-844626-8 Aug 09 14:45:52.471970 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7e006c69-d096-488c-90d9-52f268235cb5 req-e60dea8c-5bc7-4efd-8445-a5d51305af2a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073309 Aug 09 14:45:52.473088 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1696/3463] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:52.488256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e74bbaf6-66de-4f23-b8f2-7575908dca03 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:52.491115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e74bbaf6-66de-4f23-b8f2-7575908dca03 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:52.508115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e74bbaf6-66de-4f23-b8f2-7575908dca03 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:52.508814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e74bbaf6-66de-4f23-b8f2-7575908dca03 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:52.509830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e74bbaf6-66de-4f23-b8f2-7575908dca03 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:52.510905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e74bbaf6-66de-4f23-b8f2-7575908dca03 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:52.511574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e74bbaf6-66de-4f23-b8f2-7575908dca03 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:52.512225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e74bbaf6-66de-4f23-b8f2-7575908dca03 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:53.060840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e74bbaf6-66de-4f23-b8f2-7575908dca03 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:53.091831 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e74bbaf6-66de-4f23-b8f2-7575908dca03 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1402 microversion: 2.1 time: 0.614350 Aug 09 14:45:53.096044 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1697/3464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:52 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1402 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:53.397501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-865604f5-f0e1-4d0a-961c-9f0cc50af04b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:53.398174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-865604f5-f0e1-4d0a-961c-9f0cc50af04b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:53.406125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-865604f5-f0e1-4d0a-961c-9f0cc50af04b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:53.406586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-865604f5-f0e1-4d0a-961c-9f0cc50af04b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:53.407273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-865604f5-f0e1-4d0a-961c-9f0cc50af04b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:53.407919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-865604f5-f0e1-4d0a-961c-9f0cc50af04b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:53.408626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-865604f5-f0e1-4d0a-961c-9f0cc50af04b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:53.409060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-865604f5-f0e1-4d0a-961c-9f0cc50af04b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:53.545853 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0db14cac-50cb-42cf-a1e9-9130e6634107 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf/action" status: 202 len: 0 microversion: 2.1 time: 2.215167 Aug 09 14:45:53.546483 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1768/3465] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:45:51 2022] POST /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf/action => generated 0 bytes in 2217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:45:53.556407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-755ad49b-088d-4e9d-8c56-c8d89d102b1c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dd21d790>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:54.015021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-865604f5-f0e1-4d0a-961c-9f0cc50af04b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:54.026028 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-865604f5-f0e1-4d0a-961c-9f0cc50af04b tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1315 microversion: 2.1 time: 0.635284 Aug 09 14:45:54.027185 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1698/3466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:53 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:54.298683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG neutronclient.v2_0.client [None req-755ad49b-088d-4e9d-8c56-c8d89d102b1c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 889ea0db-76a7-494c-a948-ea9925f36c0c in use.", "detail": ""}} {{(pid=119407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:45:54.300709 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-755ad49b-088d-4e9d-8c56-c8d89d102b1c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Security Group 889ea0db-76a7-494c-a948-ea9925f36c0c in use. Aug 09 14:45:54.300709 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-74c8bd7f-2bde-45dc-a8ee-db2cc1b668de'] Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-755ad49b-088d-4e9d-8c56-c8d89d102b1c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/os-security-groups/889ea0db-76a7-494c-a948-ea9925f36c0c HTTP/1.1 Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: exception: Security Group 889ea0db-76a7-494c-a948-ea9925f36c0c in use. Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-74c8bd7f-2bde-45dc-a8ee-db2cc1b668de'] Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '889ea0db-76a7-494c-a948-ea9925f36c0c'} Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:45:54.308701 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 889ea0db-76a7-494c-a948-ea9925f36c0c in use. Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74c8bd7f-2bde-45dc-a8ee-db2cc1b668de'] Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 889ea0db-76a7-494c-a948-ea9925f36c0c in use. Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74c8bd7f-2bde-45dc-a8ee-db2cc1b668de'] Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 889ea0db-76a7-494c-a948-ea9925f36c0c in use. Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74c8bd7f-2bde-45dc-a8ee-db2cc1b668de'] Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 889ea0db-76a7-494c-a948-ea9925f36c0c in use. Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74c8bd7f-2bde-45dc-a8ee-db2cc1b668de'] Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-755ad49b-088d-4e9d-8c56-c8d89d102b1c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 400 to user: Security Group 889ea0db-76a7-494c-a948-ea9925f36c0c in use. Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-74c8bd7f-2bde-45dc-a8ee-db2cc1b668de'] {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-755ad49b-088d-4e9d-8c56-c8d89d102b1c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/889ea0db-76a7-494c-a948-ea9925f36c0c" status: 400 len: 185 microversion: 2.1 time: 0.759536 Aug 09 14:45:54.313741 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1769/3467] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:45:53 2022] DELETE /compute/v2.1/os-security-groups/889ea0db-76a7-494c-a948-ea9925f36c0c => generated 185 bytes in 761 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:45:54.334358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44f83f2a-2cbf-4c37-a3bf-83bbe18b2af8 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:54.334358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44f83f2a-2cbf-4c37-a3bf-83bbe18b2af8 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:54.378206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44f83f2a-2cbf-4c37-a3bf-83bbe18b2af8 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:54.381792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44f83f2a-2cbf-4c37-a3bf-83bbe18b2af8 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:54.382686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44f83f2a-2cbf-4c37-a3bf-83bbe18b2af8 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:54.384348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44f83f2a-2cbf-4c37-a3bf-83bbe18b2af8 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:54.386693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44f83f2a-2cbf-4c37-a3bf-83bbe18b2af8 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:54.387147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44f83f2a-2cbf-4c37-a3bf-83bbe18b2af8 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:54.415617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7ff7e9ea-8f7d-422d-9847-8baeecfb22c2 req-51303076-42e5-4ab8-913c-f3b93e05d708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d27684bc-0b81-45ee-8f6b-fddcfa000bdf", "tag": "57fb83f8-f7aa-4e16-aa43-91cb5686c4a6"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:54.435438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7ff7e9ea-8f7d-422d-9847-8baeecfb22c2 req-51303076-42e5-4ab8-913c-f3b93e05d708 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:54.435931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7ff7e9ea-8f7d-422d-9847-8baeecfb22c2 req-51303076-42e5-4ab8-913c-f3b93e05d708 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:54.436365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7ff7e9ea-8f7d-422d-9847-8baeecfb22c2 req-51303076-42e5-4ab8-913c-f3b93e05d708 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:54.462828 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7ff7e9ea-8f7d-422d-9847-8baeecfb22c2 req-51303076-42e5-4ab8-913c-f3b93e05d708 service nova] Creating event network-changed:57fb83f8-f7aa-4e16-aa43-91cb5686c4a6 for instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf on n-h2-844626-8 Aug 09 14:45:54.472637 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7ff7e9ea-8f7d-422d-9847-8baeecfb22c2 req-51303076-42e5-4ab8-913c-f3b93e05d708 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.444047 Aug 09 14:45:54.480379 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1699/3468] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:54.486753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f48dc7a-2b96-4f69-82f3-28cbe148b259 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:54.491575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f48dc7a-2b96-4f69-82f3-28cbe148b259 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:54.505423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f48dc7a-2b96-4f69-82f3-28cbe148b259 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:54.505926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f48dc7a-2b96-4f69-82f3-28cbe148b259 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:54.506455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f48dc7a-2b96-4f69-82f3-28cbe148b259 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:54.507052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f48dc7a-2b96-4f69-82f3-28cbe148b259 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:54.511850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f48dc7a-2b96-4f69-82f3-28cbe148b259 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:54.512526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f48dc7a-2b96-4f69-82f3-28cbe148b259 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:54.580840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f48dc7a-2b96-4f69-82f3-28cbe148b259 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:45:54.793591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-44f83f2a-2cbf-4c37-a3bf-83bbe18b2af8 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:54.795911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:54.806133 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44f83f2a-2cbf-4c37-a3bf-83bbe18b2af8 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1589 microversion: 2.1 time: 0.480448 Aug 09 14:45:54.806734 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1770/3469] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:54 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1589 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:54.826186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-441795de-fba7-4dc2-9b47-6d890900dfe1 req-f23e5daf-9c82-4e25-b307-a8900d6b223b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869e1aa4-a65f-4809-b887-43189411412d", "name": "network-vif-plugged", "status": "completed", "tag": "f26f4997-3ecf-4530-a83d-0274887258bf"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:54.827118 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f48dc7a-2b96-4f69-82f3-28cbe148b259 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 204 len: 0 microversion: 2.1 time: 0.344140 Aug 09 14:45:54.828050 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1700/3470] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:45:54 2022] DELETE /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:45:54.838374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-93084ffd-75b1-481e-aa09-f02469836977 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:54.839571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-93084ffd-75b1-481e-aa09-f02469836977 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:54.852477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-441795de-fba7-4dc2-9b47-6d890900dfe1 req-f23e5daf-9c82-4e25-b307-a8900d6b223b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:54.853437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-441795de-fba7-4dc2-9b47-6d890900dfe1 req-f23e5daf-9c82-4e25-b307-a8900d6b223b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:54.855030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-441795de-fba7-4dc2-9b47-6d890900dfe1 req-f23e5daf-9c82-4e25-b307-a8900d6b223b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:54.859609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93084ffd-75b1-481e-aa09-f02469836977 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:54.860446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93084ffd-75b1-481e-aa09-f02469836977 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:54.862461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93084ffd-75b1-481e-aa09-f02469836977 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:54.865507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93084ffd-75b1-481e-aa09-f02469836977 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:54.866559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93084ffd-75b1-481e-aa09-f02469836977 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:54.868148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93084ffd-75b1-481e-aa09-f02469836977 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:54.892719 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-441795de-fba7-4dc2-9b47-6d890900dfe1 req-f23e5daf-9c82-4e25-b307-a8900d6b223b service nova] Creating event network-vif-plugged:f26f4997-3ecf-4530-a83d-0274887258bf for instance 869e1aa4-a65f-4809-b887-43189411412d on n-h1-844626-8 Aug 09 14:45:54.910389 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-441795de-fba7-4dc2-9b47-6d890900dfe1 req-f23e5daf-9c82-4e25-b307-a8900d6b223b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098201 Aug 09 14:45:54.913038 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1771/3471] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:54.943386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8b701982-7d58-4687-9fd1-b0a7edd9f570 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:54.948372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8b701982-7d58-4687-9fd1-b0a7edd9f570 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:54.974502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b701982-7d58-4687-9fd1-b0a7edd9f570 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:54.976554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b701982-7d58-4687-9fd1-b0a7edd9f570 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:54.977549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b701982-7d58-4687-9fd1-b0a7edd9f570 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:54.980404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b701982-7d58-4687-9fd1-b0a7edd9f570 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:54.981584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b701982-7d58-4687-9fd1-b0a7edd9f570 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:54.982231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b701982-7d58-4687-9fd1-b0a7edd9f570 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:55.560741 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-93084ffd-75b1-481e-aa09-f02469836977 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.731164 Aug 09 14:45:55.561362 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1701/3472] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:45:54 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3/os-interface => generated 284 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:55.568123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-043e5357-8431-4b18-90b0-21f613aeb24c tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:55.568123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-043e5357-8431-4b18-90b0-21f613aeb24c tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:55.582065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043e5357-8431-4b18-90b0-21f613aeb24c tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:55.582558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043e5357-8431-4b18-90b0-21f613aeb24c tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:55.583193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043e5357-8431-4b18-90b0-21f613aeb24c tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:55.584065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043e5357-8431-4b18-90b0-21f613aeb24c tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:55.584672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043e5357-8431-4b18-90b0-21f613aeb24c tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:55.585238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-043e5357-8431-4b18-90b0-21f613aeb24c tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:56.174347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8b701982-7d58-4687-9fd1-b0a7edd9f570 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:56.194242 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8b701982-7d58-4687-9fd1-b0a7edd9f570 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1648 microversion: 2.1 time: 1.267187 Aug 09 14:45:56.196009 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1772/3473] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:54 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1648 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:56.245583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-043e5357-8431-4b18-90b0-21f613aeb24c tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:56.262604 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-043e5357-8431-4b18-90b0-21f613aeb24c tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1315 microversion: 2.1 time: 0.700097 Aug 09 14:45:56.263285 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1702/3474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:55 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:57.233468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0d7369b-f1e7-49b2-92ed-205940f5a9dd tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:57.235890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0d7369b-f1e7-49b2-92ed-205940f5a9dd tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:57.256239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:57.273845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0d7369b-f1e7-49b2-92ed-205940f5a9dd tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:57.274384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0d7369b-f1e7-49b2-92ed-205940f5a9dd tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:57.275217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0d7369b-f1e7-49b2-92ed-205940f5a9dd tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:57.278352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0d7369b-f1e7-49b2-92ed-205940f5a9dd tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:57.279049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0d7369b-f1e7-49b2-92ed-205940f5a9dd tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:57.279727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0d7369b-f1e7-49b2-92ed-205940f5a9dd tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:57.285525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3493ef66-b8ed-4f43-97e4-ce36ad70a610 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:57.286159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3493ef66-b8ed-4f43-97e4-ce36ad70a610 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:57.310603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3493ef66-b8ed-4f43-97e4-ce36ad70a610 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:57.313089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3493ef66-b8ed-4f43-97e4-ce36ad70a610 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:57.314158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3493ef66-b8ed-4f43-97e4-ce36ad70a610 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:57.316875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3493ef66-b8ed-4f43-97e4-ce36ad70a610 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:57.320998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3493ef66-b8ed-4f43-97e4-ce36ad70a610 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:57.322047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3493ef66-b8ed-4f43-97e4-ce36ad70a610 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:57.869226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3493ef66-b8ed-4f43-97e4-ce36ad70a610 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:57.886330 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3493ef66-b8ed-4f43-97e4-ce36ad70a610 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1503 microversion: 2.1 time: 0.606801 Aug 09 14:45:57.886949 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1703/3475] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:57 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1503 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:58.109575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0d7369b-f1e7-49b2-92ed-205940f5a9dd tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:58.121456 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0d7369b-f1e7-49b2-92ed-205940f5a9dd tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1648 microversion: 2.1 time: 0.907776 Aug 09 14:45:58.123434 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1773/3476] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:57 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1648 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:58.133882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-691105587", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7c382fe5-ff24-478e-8968-9df4be96b1f0"}, {"port": "e829cab8-175f-46b9-b942-fa93e4bf48bb", "tag": "port-1"}, {"port": "5bcb9340-d16d-4086-bbb3-c3282b5f4b53", "tag": "port-2"}, {"uuid": "d09494fb-e7e8-4cf4-87af-08a3adf89fb9", "tag": "net-1"}, {"uuid": "d09494fb-e7e8-4cf4-87af-08a3adf89fb9"}, {"uuid": "4a3fd423-28e1-4fa7-a543-9103a6d15614", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "4a3fd423-28e1-4fa7-a543-9103a6d15614", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "64c8a3a1-3dbf-4cf9-bbaa-7d5a57db4323", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7e9edb78-ae65-4f19-855c-93aacfff79e8", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fa9b2fa4-0417-4f8b-802d-65b1df5caf7f", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--978899240"}], "key_name": "tempest-keypair-1799985017", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:45:58.279715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-891e2471-4066-44b8-87ec-f5c809dc28ea tempest-AbsoluteLimitsTestJSON-689698537 tempest-AbsoluteLimitsTestJSON-689698537-project] Calling method '.version_select at 0x7f41ddb62ee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:58.315540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-891e2471-4066-44b8-87ec-f5c809dc28ea tempest-AbsoluteLimitsTestJSON-689698537 tempest-AbsoluteLimitsTestJSON-689698537-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:58.316254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-891e2471-4066-44b8-87ec-f5c809dc28ea tempest-AbsoluteLimitsTestJSON-689698537 tempest-AbsoluteLimitsTestJSON-689698537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:58.316424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-891e2471-4066-44b8-87ec-f5c809dc28ea tempest-AbsoluteLimitsTestJSON-689698537 tempest-AbsoluteLimitsTestJSON-689698537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:58.320688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-891e2471-4066-44b8-87ec-f5c809dc28ea tempest-AbsoluteLimitsTestJSON-689698537 tempest-AbsoluteLimitsTestJSON-689698537-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:58.321416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-891e2471-4066-44b8-87ec-f5c809dc28ea tempest-AbsoluteLimitsTestJSON-689698537 tempest-AbsoluteLimitsTestJSON-689698537-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:58.322495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-891e2471-4066-44b8-87ec-f5c809dc28ea tempest-AbsoluteLimitsTestJSON-689698537 tempest-AbsoluteLimitsTestJSON-689698537-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:58.376898 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-891e2471-4066-44b8-87ec-f5c809dc28ea tempest-AbsoluteLimitsTestJSON-689698537 tempest-AbsoluteLimitsTestJSON-689698537-project] 10.222.0.50 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.488642 Aug 09 14:45:58.378270 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1704/3477] 10.222.0.50 () {58 vars in 1122 bytes} [Tue Aug 9 14:45:57 2022] GET /compute/v2.1/limits => generated 511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:45:58.384826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f02cc52c-9863-4581-b588-cee1937e493d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:58.385637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f02cc52c-9863-4581-b588-cee1937e493d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:58.393596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02cc52c-9863-4581-b588-cee1937e493d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:58.394533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02cc52c-9863-4581-b588-cee1937e493d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:58.395202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02cc52c-9863-4581-b588-cee1937e493d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:58.396114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02cc52c-9863-4581-b588-cee1937e493d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:58.396778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02cc52c-9863-4581-b588-cee1937e493d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:58.397422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02cc52c-9863-4581-b588-cee1937e493d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:58.455205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:45:58.517698 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f02cc52c-9863-4581-b588-cee1937e493d tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "DELETE /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.137974 Aug 09 14:45:58.518702 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1705/3478] 10.222.0.50 () {58 vars in 1296 bytes} [Tue Aug 9 14:45:58 2022] DELETE /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d/os-server-password => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:45:58.529344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fdb64ef9-cc0e-42ae-9eff-93b1c6c304e6 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:58.534197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fdb64ef9-cc0e-42ae-9eff-93b1c6c304e6 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:58.549197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdb64ef9-cc0e-42ae-9eff-93b1c6c304e6 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:58.551576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdb64ef9-cc0e-42ae-9eff-93b1c6c304e6 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:58.552214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdb64ef9-cc0e-42ae-9eff-93b1c6c304e6 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:58.554554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdb64ef9-cc0e-42ae-9eff-93b1c6c304e6 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:58.556548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdb64ef9-cc0e-42ae-9eff-93b1c6c304e6 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:58.557187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdb64ef9-cc0e-42ae-9eff-93b1c6c304e6 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:58.612039 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fdb64ef9-cc0e-42ae-9eff-93b1c6c304e6 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.087410 Aug 09 14:45:58.612974 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1706/3479] 10.222.0.50 () {58 vars in 1293 bytes} [Tue Aug 9 14:45:58 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d/os-server-password => generated 16 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:45:58.624115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-46252a2b-1f4e-4d48-a5dd-7cce50b53272 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:58.624979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-46252a2b-1f4e-4d48-a5dd-7cce50b53272 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:58.632719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46252a2b-1f4e-4d48-a5dd-7cce50b53272 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:58.633473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46252a2b-1f4e-4d48-a5dd-7cce50b53272 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:58.634091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46252a2b-1f4e-4d48-a5dd-7cce50b53272 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:58.634964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46252a2b-1f4e-4d48-a5dd-7cce50b53272 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:58.635595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46252a2b-1f4e-4d48-a5dd-7cce50b53272 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:58.636341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46252a2b-1f4e-4d48-a5dd-7cce50b53272 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:58.685870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-46252a2b-1f4e-4d48-a5dd-7cce50b53272 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:45:58.809071 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-46252a2b-1f4e-4d48-a5dd-7cce50b53272 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "DELETE /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 204 len: 0 microversion: 2.1 time: 0.189703 Aug 09 14:45:58.810466 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1707/3480] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:45:58 2022] DELETE /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:45:58.827976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-685d592d-a48b-45b7-b1ef-8289f4d55ce3 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:58.834634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-685d592d-a48b-45b7-b1ef-8289f4d55ce3 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:58.841998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-685d592d-a48b-45b7-b1ef-8289f4d55ce3 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:58.842809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-685d592d-a48b-45b7-b1ef-8289f4d55ce3 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:58.843543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-685d592d-a48b-45b7-b1ef-8289f4d55ce3 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:58.844944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-685d592d-a48b-45b7-b1ef-8289f4d55ce3 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:58.845574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-685d592d-a48b-45b7-b1ef-8289f4d55ce3 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:58.846160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-685d592d-a48b-45b7-b1ef-8289f4d55ce3 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:59.128788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] validate_networks() for [('7c382fe5-ff24-478e-8968-9df4be96b1f0', None, None, None, None, None), (None, None, 'e829cab8-175f-46b9-b942-fa93e4bf48bb', None, None, None), (None, None, '5bcb9340-d16d-4086-bbb3-c3282b5f4b53', None, None, None), ('d09494fb-e7e8-4cf4-87af-08a3adf89fb9', None, None, None, None, None), ('d09494fb-e7e8-4cf4-87af-08a3adf89fb9', None, None, None, None, None), ('4a3fd423-28e1-4fa7-a543-9103a6d15614', '10.2.2.100', None, None, None, None), ('4a3fd423-28e1-4fa7-a543-9103a6d15614', '10.2.2.200', None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:45:59.760670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-685d592d-a48b-45b7-b1ef-8289f4d55ce3 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:45:59.875349 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-685d592d-a48b-45b7-b1ef-8289f4d55ce3 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1509 microversion: 2.1 time: 1.055749 Aug 09 14:45:59.892612 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1708/3481] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:58 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1509 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:45:59.898583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e88f588f-c401-4eec-930d-c9c00c9cf8b8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:45:59.899602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e88f588f-c401-4eec-930d-c9c00c9cf8b8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:45:59.906833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e88f588f-c401-4eec-930d-c9c00c9cf8b8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:59.907766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e88f588f-c401-4eec-930d-c9c00c9cf8b8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:59.908455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e88f588f-c401-4eec-930d-c9c00c9cf8b8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:59.909985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e88f588f-c401-4eec-930d-c9c00c9cf8b8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:45:59.910662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e88f588f-c401-4eec-930d-c9c00c9cf8b8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:45:59.911483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e88f588f-c401-4eec-930d-c9c00c9cf8b8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:45:59.917045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:00.080165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e88f588f-c401-4eec-930d-c9c00c9cf8b8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:00.095880 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e88f588f-c401-4eec-930d-c9c00c9cf8b8 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 200 len: 1301 microversion: 2.1 time: 0.199959 Aug 09 14:46:00.096529 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1709/3482] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:45:59 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 1301 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:00.108072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-dc6368e7-4783-438f-8967-536de5670310 req-812b5818-4c76-40e9-8540-013055b734f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d27684bc-0b81-45ee-8f6b-fddcfa000bdf", "name": "network-vif-deleted", "tag": "57fb83f8-f7aa-4e16-aa43-91cb5686c4a6"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:00.124518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:00.137584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dc6368e7-4783-438f-8967-536de5670310 req-812b5818-4c76-40e9-8540-013055b734f0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:00.138417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dc6368e7-4783-438f-8967-536de5670310 req-812b5818-4c76-40e9-8540-013055b734f0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:00.139170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dc6368e7-4783-438f-8967-536de5670310 req-812b5818-4c76-40e9-8540-013055b734f0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:00.156316 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-dc6368e7-4783-438f-8967-536de5670310 req-812b5818-4c76-40e9-8540-013055b734f0 service nova] Creating event network-vif-deleted:57fb83f8-f7aa-4e16-aa43-91cb5686c4a6 for instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf on n-h2-844626-8 Aug 09 14:46:00.165637 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-dc6368e7-4783-438f-8967-536de5670310 req-812b5818-4c76-40e9-8540-013055b734f0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066564 Aug 09 14:46:00.166600 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1710/3483] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:00.857288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79926102-af20-441e-bb5b-741aa9b54868 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:00.858733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-79926102-af20-441e-bb5b-741aa9b54868 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:00.879715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79926102-af20-441e-bb5b-741aa9b54868 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:00.880567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79926102-af20-441e-bb5b-741aa9b54868 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:00.882220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79926102-af20-441e-bb5b-741aa9b54868 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:00.888801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79926102-af20-441e-bb5b-741aa9b54868 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:00.889502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79926102-af20-441e-bb5b-741aa9b54868 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:00.890109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79926102-af20-441e-bb5b-741aa9b54868 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:02.290904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-79926102-af20-441e-bb5b-741aa9b54868 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:02.307483 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-79926102-af20-441e-bb5b-741aa9b54868 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1589 microversion: 2.1 time: 1.451742 Aug 09 14:46:02.311674 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1711/3484] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:00 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1589 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:46:02.322856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fcd71549-2bb1-4dd9-9ccf-cb4c8d3d20c9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:02.325263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fcd71549-2bb1-4dd9-9ccf-cb4c8d3d20c9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:02.342927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcd71549-2bb1-4dd9-9ccf-cb4c8d3d20c9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:02.345162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcd71549-2bb1-4dd9-9ccf-cb4c8d3d20c9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:02.346571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcd71549-2bb1-4dd9-9ccf-cb4c8d3d20c9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:02.350547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcd71549-2bb1-4dd9-9ccf-cb4c8d3d20c9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:02.351317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcd71549-2bb1-4dd9-9ccf-cb4c8d3d20c9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:02.351762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcd71549-2bb1-4dd9-9ccf-cb4c8d3d20c9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:02.519475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fcd71549-2bb1-4dd9-9ccf-cb4c8d3d20c9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c332fc2d7886405fab8d1eb7439d02c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0718176228a54016ab1c8a08cb1d8f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:02.534012 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fcd71549-2bb1-4dd9-9ccf-cb4c8d3d20c9 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 200 len: 1300 microversion: 2.1 time: 0.220787 Aug 09 14:46:02.535685 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1712/3485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:02 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 1300 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:02.541986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e6000997-2448-44df-90da-5300be597869 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:02.542820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e6000997-2448-44df-90da-5300be597869 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:02.549585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6000997-2448-44df-90da-5300be597869 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:02.550348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6000997-2448-44df-90da-5300be597869 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:02.550948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6000997-2448-44df-90da-5300be597869 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:02.552001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6000997-2448-44df-90da-5300be597869 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:02.552650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6000997-2448-44df-90da-5300be597869 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:02.553241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6000997-2448-44df-90da-5300be597869 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:02.572133 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-e6000997-2448-44df-90da-5300be597869 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e6000997-2448-44df-90da-5300be597869 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf HTTP/1.1 Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'd27684bc-0b81-45ee-8f6b-fddcfa000bdf'} Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:02.574389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:02.579979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:02.579979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:02.579979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:02.579979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:02.579979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:02.579979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:02.579979 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:02.581459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e6000997-2448-44df-90da-5300be597869 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:02.582680 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e6000997-2448-44df-90da-5300be597869 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 404 len: 111 microversion: 2.1 time: 0.045469 Aug 09 14:46:02.583473 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1713/3486] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:02 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:46:02.591606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f7fb21aa-9055-4e30-b2c2-21f76fafc2b7 req-0768e17e-fc87-421d-96d3-c34142f842f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e99b44-1a79-447e-bf30-01f5960687e3", "tag": "36ea3e78-3624-4828-923b-7aa0969c0afd"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:02.603806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f7fb21aa-9055-4e30-b2c2-21f76fafc2b7 req-0768e17e-fc87-421d-96d3-c34142f842f9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:02.604410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f7fb21aa-9055-4e30-b2c2-21f76fafc2b7 req-0768e17e-fc87-421d-96d3-c34142f842f9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:02.604939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f7fb21aa-9055-4e30-b2c2-21f76fafc2b7 req-0768e17e-fc87-421d-96d3-c34142f842f9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:02.622009 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f7fb21aa-9055-4e30-b2c2-21f76fafc2b7 req-0768e17e-fc87-421d-96d3-c34142f842f9 service nova] Creating event network-changed:36ea3e78-3624-4828-923b-7aa0969c0afd for instance 30e99b44-1a79-447e-bf30-01f5960687e3 on n-h1-844626-8 Aug 09 14:46:02.629535 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f7fb21aa-9055-4e30-b2c2-21f76fafc2b7 req-0768e17e-fc87-421d-96d3-c34142f842f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042287 Aug 09 14:46:02.632116 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1714/3487] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:02.638986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-86c0fa5d-195c-4ec6-ab8b-8b5b5d70493e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41ddbfbee0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:03.900383 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-86c0fa5d-195c-4ec6-ab8b-8b5b5d70493e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/9a0b804d-11eb-452f-8e5d-97641a2247b9" status: 202 len: 0 microversion: 2.1 time: 1.266754 Aug 09 14:46:03.901877 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1715/3488] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:02 2022] DELETE /compute/v2.1/os-security-groups/9a0b804d-11eb-452f-8e5d-97641a2247b9 => generated 0 bytes in 1269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:46:03.908334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-087c70f8-1f97-49d9-936a-14c0c318f4f5 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:03.910327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-087c70f8-1f97-49d9-936a-14c0c318f4f5 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] [instance: 869e1aa4-a65f-4809-b887-43189411412d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:03.933771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-087c70f8-1f97-49d9-936a-14c0c318f4f5 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:03.934314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-087c70f8-1f97-49d9-936a-14c0c318f4f5 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:03.934745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-087c70f8-1f97-49d9-936a-14c0c318f4f5 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:03.936834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-087c70f8-1f97-49d9-936a-14c0c318f4f5 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:03.937480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-087c70f8-1f97-49d9-936a-14c0c318f4f5 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:03.938395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-087c70f8-1f97-49d9-936a-14c0c318f4f5 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:03.956140 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-087c70f8-1f97-49d9-936a-14c0c318f4f5 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] HTTP exception thrown: Instance 869e1aa4-a65f-4809-b887-43189411412d could not be found. Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-087c70f8-1f97-49d9-936a-14c0c318f4f5 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Request method failure captured: Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d HTTP/1.1 Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nMP2MK20Mt8449G-PRZ1wIeDIbshlnPYUQsDI7U32n2oE4CePf7g0zBjJPL9eT1_JODAiih0Ue64X3k0-aT-Jdr2vSiZX7DS54C2cdpJ87baWIQ_pdel_XcTaaFGtmRyezoptybLDDESo6a8PQvqzMuIFtflakmOw6nAfyLVanKwls Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 0718176228a54016ab1c8a08cb1d8f49 Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerPasswordTestJSON-2132482349 Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0718176228a54016ab1c8a08cb1d8f49", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0718176228a54016ab1c8a08cb1d8f49"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0718176228a54016ab1c8a08cb1d8f49"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0718176228a54016ab1c8a08cb1d8f49"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerPasswordTestJSON-2132482349 Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 0718176228a54016ab1c8a08cb1d8f49 Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2132482349 Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerPasswordTestJSON-2132482349-project Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: c332fc2d7886405fab8d1eb7439d02c8 Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerPasswordTestJSON-2132482349-project Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 869e1aa4-a65f-4809-b887-43189411412d could not be found. Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '869e1aa4-a65f-4809-b887-43189411412d'} Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 869e1aa4-a65f-4809-b887-43189411412d could not be found. Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 869e1aa4-a65f-4809-b887-43189411412d could not be found. Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:03.958343 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:03.964796 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:03.964796 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:03.964796 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:03.964796 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:03.964796 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:03.964796 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 869e1aa4-a65f-4809-b887-43189411412d could not be found. Aug 09 14:46:03.964796 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:03.967026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-087c70f8-1f97-49d9-936a-14c0c318f4f5 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] Returning 404 to user: Instance 869e1aa4-a65f-4809-b887-43189411412d could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:03.970982 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-087c70f8-1f97-49d9-936a-14c0c318f4f5 tempest-ServerPasswordTestJSON-2132482349 tempest-ServerPasswordTestJSON-2132482349-project] 10.222.0.50 "GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d" status: 404 len: 111 microversion: 2.1 time: 0.064854 Aug 09 14:46:03.971897 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1716/3489] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:03 2022] GET /compute/v2.1/servers/869e1aa4-a65f-4809-b887-43189411412d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:46:03.987588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cf22aaeb-826f-4383-9156-a099b31c3753 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41e74f33a0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:05.091537 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cf22aaeb-826f-4383-9156-a099b31c3753 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/889ea0db-76a7-494c-a948-ea9925f36c0c" status: 202 len: 0 microversion: 2.1 time: 1.114352 Aug 09 14:46:05.094822 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1717/3490] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:03 2022] DELETE /compute/v2.1/os-security-groups/889ea0db-76a7-494c-a948-ea9925f36c0c => generated 0 bytes in 1118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:46:05.105813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5c231a2b-e062-4f73-898b-8b468fa68e74 req-de7f98a2-46cf-4403-9354-5808a876fa9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869e1aa4-a65f-4809-b887-43189411412d", "name": "network-vif-deleted", "tag": "f26f4997-3ecf-4530-a83d-0274887258bf"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:05.134615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5c231a2b-e062-4f73-898b-8b468fa68e74 req-de7f98a2-46cf-4403-9354-5808a876fa9d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:05.135093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5c231a2b-e062-4f73-898b-8b468fa68e74 req-de7f98a2-46cf-4403-9354-5808a876fa9d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:05.145026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5c231a2b-e062-4f73-898b-8b468fa68e74 req-de7f98a2-46cf-4403-9354-5808a876fa9d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:05.194316 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5c231a2b-e062-4f73-898b-8b468fa68e74 req-de7f98a2-46cf-4403-9354-5808a876fa9d service nova] Creating event network-vif-deleted:f26f4997-3ecf-4530-a83d-0274887258bf for instance 869e1aa4-a65f-4809-b887-43189411412d on n-h1-844626-8 Aug 09 14:46:05.213915 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5c231a2b-e062-4f73-898b-8b468fa68e74 req-de7f98a2-46cf-4403-9354-5808a876fa9d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116536 Aug 09 14:46:05.214763 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1718/3491] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:05.463977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1167395865", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "30aba5ea-e8bf-477f-854b-721cd8625243"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:05.589445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] validate_networks() for [('30aba5ea-e8bf-477f-854b-721cd8625243', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:46:08.117609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=15 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:08.303772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:46:08.304278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:46:08.311943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:46:08.318373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:46:08.322230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:46:08.331036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:08.341686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:08.343485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:08.344496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:08.345508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:08.346362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:08.347513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:08.349749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:08.410615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Getting quotas for project 12f25cb25344492fa158ce40e09ab8c2. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:46:08.426438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Getting quotas for user 0bf5faa9df9147e8ad0d7dfd68112672 and project 12f25cb25344492fa158ce40e09ab8c2. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:46:08.462430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:46:08.467117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:46:08.594770 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eee749ff-4cd3-44c4-ab49-92a3c7cae5f7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.377442 Aug 09 14:46:08.599120 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1719/3492] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:46:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 3380 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 14:46:08.606369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8008ad10-6fde-4616-b81d-8c098cb1af51 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'create', calling method: .version_select at 0x7f41ddaaeb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1388025131", "description": "tempest-description-577532374"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:09.162674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:46:09.163230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:46:09.164344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:46:09.165521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:46:09.166173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:46:09.184643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:09.185172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:09.186744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:09.188813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:09.189389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:09.190270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:09.269918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Getting quotas for project dd3f9be3e6694608a10e84ebab6d1a2a. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:46:09.285876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Getting quotas for user df55ede6220049c1aee1bfd628c13a23 and project dd3f9be3e6694608a10e84ebab6d1a2a. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:46:09.550037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:46:09.552771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='64c8a3a1-3dbf-4cf9-bbaa-7d5a57db4323',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7e9edb78-ae65-4f19-855c-93aacfff79e8',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa9b2fa4-0417-4f8b-802d-65b1df5caf7f',volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:46:09.947906 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8008ad10-6fde-4616-b81d-8c098cb1af51 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.350603 Aug 09 14:46:09.949127 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1720/3493] 10.222.0.50 () {60 vars in 1180 bytes} [Tue Aug 9 14:46:08 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:09.954706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db21b74f-b970-4f4f-be9f-433aa9cc98b7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:09.955341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db21b74f-b970-4f4f-be9f-433aa9cc98b7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:09.967997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db21b74f-b970-4f4f-be9f-433aa9cc98b7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:09.968371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db21b74f-b970-4f4f-be9f-433aa9cc98b7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:09.968972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db21b74f-b970-4f4f-be9f-433aa9cc98b7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:09.973796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db21b74f-b970-4f4f-be9f-433aa9cc98b7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:09.983686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db21b74f-b970-4f4f-be9f-433aa9cc98b7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:09.984178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db21b74f-b970-4f4f-be9f-433aa9cc98b7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:10.190906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-db21b74f-b970-4f4f-be9f-433aa9cc98b7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:10.192718 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22294fcd-fb5c-4e61-be25-f6bea04f02bb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 12.067800 Aug 09 14:46:10.193907 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1774/3494] 10.222.0.50 () {62 vars in 1189 bytes} [Tue Aug 9 14:45:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 12070 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 14:46:10.200990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e975ad9d-df19-40cc-8a00-1817eec791ad tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Action: 'update', calling method: .version_select at 0x7f41dc902550>, body: {"security_group": {"name": "tempest-sg-hth-21473302", "description": "tempest-description-hth-1359860796"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:10.210547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-db21b74f-b970-4f4f-be9f-433aa9cc98b7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:10.224837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-db21b74f-b970-4f4f-be9f-433aa9cc98b7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:10.226076 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db21b74f-b970-4f4f-be9f-433aa9cc98b7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1314 microversion: 2.26 time: 0.275823 Aug 09 14:46:10.226654 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1721/3495] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:09 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:10.246566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0015162b-81a2-453e-8f0c-ada2d3ec7941 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:10.254005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0015162b-81a2-453e-8f0c-ada2d3ec7941 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:10.813159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0015162b-81a2-453e-8f0c-ada2d3ec7941 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:10.827790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0015162b-81a2-453e-8f0c-ada2d3ec7941 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:10.829657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0015162b-81a2-453e-8f0c-ada2d3ec7941 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:10.831305 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0015162b-81a2-453e-8f0c-ada2d3ec7941 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1285 microversion: 2.42 time: 0.597455 Aug 09 14:46:10.850491 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1722/3496] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:10 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1285 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:11.253111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-59b4044f-c28c-493a-ba6a-050d7eb6acdd tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:11.253718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-59b4044f-c28c-493a-ba6a-050d7eb6acdd tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:11.271897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59b4044f-c28c-493a-ba6a-050d7eb6acdd tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:11.272390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59b4044f-c28c-493a-ba6a-050d7eb6acdd tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:11.272823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59b4044f-c28c-493a-ba6a-050d7eb6acdd tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:11.273533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59b4044f-c28c-493a-ba6a-050d7eb6acdd tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:11.273981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59b4044f-c28c-493a-ba6a-050d7eb6acdd tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:11.274399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59b4044f-c28c-493a-ba6a-050d7eb6acdd tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:11.807242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-59b4044f-c28c-493a-ba6a-050d7eb6acdd tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:11.820874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-59b4044f-c28c-493a-ba6a-050d7eb6acdd tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:11.823281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-59b4044f-c28c-493a-ba6a-050d7eb6acdd tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:11.828642 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-59b4044f-c28c-493a-ba6a-050d7eb6acdd tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1320 microversion: 2.26 time: 0.581821 Aug 09 14:46:11.832904 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1723/3497] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:11 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1320 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:11.859247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-92457c33-79a5-4b9d-a153-0c4a331b667b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:11.861462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-92457c33-79a5-4b9d-a153-0c4a331b667b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:11.879728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92457c33-79a5-4b9d-a153-0c4a331b667b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:11.880410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92457c33-79a5-4b9d-a153-0c4a331b667b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:11.881190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92457c33-79a5-4b9d-a153-0c4a331b667b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:11.884566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92457c33-79a5-4b9d-a153-0c4a331b667b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:11.885376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92457c33-79a5-4b9d-a153-0c4a331b667b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:11.885979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92457c33-79a5-4b9d-a153-0c4a331b667b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:12.011228 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e975ad9d-df19-40cc-8a00-1817eec791ad tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "PUT /compute/v2.1/os-security-groups/2603552d-357a-47a1-b985-3fc5d5de7c13" status: 200 len: 216 microversion: 2.1 time: 1.815311 Aug 09 14:46:12.022986 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1775/3498] 10.222.0.50 () {60 vars in 1290 bytes} [Tue Aug 9 14:46:10 2022] PUT /compute/v2.1/os-security-groups/2603552d-357a-47a1-b985-3fc5d5de7c13 => generated 216 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:12.036424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c949bf23-a958-4088-a099-0f3a7b20db9a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dc8a1790>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:12.089043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-92457c33-79a5-4b9d-a153-0c4a331b667b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:12.100722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-92457c33-79a5-4b9d-a153-0c4a331b667b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:12.102240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-92457c33-79a5-4b9d-a153-0c4a331b667b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:12.103657 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-92457c33-79a5-4b9d-a153-0c4a331b667b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1519 microversion: 2.42 time: 0.249318 Aug 09 14:46:12.104452 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1724/3499] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:11 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:12.407283 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c949bf23-a958-4088-a099-0f3a7b20db9a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/2603552d-357a-47a1-b985-3fc5d5de7c13" status: 200 len: 216 microversion: 2.1 time: 0.381887 Aug 09 14:46:12.408555 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1776/3500] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:46:12 2022] GET /compute/v2.1/os-security-groups/2603552d-357a-47a1-b985-3fc5d5de7c13 => generated 216 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:12.426283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ad64c8d7-76cd-4215-b310-195b9f0d5c6d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dda6aca0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:12.857344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-25f91639-33d8-45a4-822d-370131fac230 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:12.858018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-25f91639-33d8-45a4-822d-370131fac230 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:12.868211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25f91639-33d8-45a4-822d-370131fac230 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:12.868704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25f91639-33d8-45a4-822d-370131fac230 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:12.873161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25f91639-33d8-45a4-822d-370131fac230 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:12.873541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25f91639-33d8-45a4-822d-370131fac230 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:12.874062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25f91639-33d8-45a4-822d-370131fac230 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:12.874482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-25f91639-33d8-45a4-822d-370131fac230 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:13.193795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-25f91639-33d8-45a4-822d-370131fac230 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:13.215916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-25f91639-33d8-45a4-822d-370131fac230 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:13.236568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-25f91639-33d8-45a4-822d-370131fac230 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:13.237889 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-25f91639-33d8-45a4-822d-370131fac230 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1320 microversion: 2.26 time: 0.385159 Aug 09 14:46:13.243733 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1777/3501] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:12 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1320 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:13.252443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-140f8c5e-9eb1-46b0-8923-803ad7751135 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:13.254256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-140f8c5e-9eb1-46b0-8923-803ad7751135 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:13.278093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-140f8c5e-9eb1-46b0-8923-803ad7751135 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:13.279564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-140f8c5e-9eb1-46b0-8923-803ad7751135 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:13.281229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-140f8c5e-9eb1-46b0-8923-803ad7751135 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:13.282957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-140f8c5e-9eb1-46b0-8923-803ad7751135 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:13.283459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-140f8c5e-9eb1-46b0-8923-803ad7751135 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:13.285523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-140f8c5e-9eb1-46b0-8923-803ad7751135 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:13.864334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-140f8c5e-9eb1-46b0-8923-803ad7751135 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:13.890697 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ad64c8d7-76cd-4215-b310-195b9f0d5c6d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/2603552d-357a-47a1-b985-3fc5d5de7c13" status: 202 len: 0 microversion: 2.1 time: 1.472282 Aug 09 14:46:13.894216 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1725/3502] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:12 2022] DELETE /compute/v2.1/os-security-groups/2603552d-357a-47a1-b985-3fc5d5de7c13 => generated 0 bytes in 1474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:46:13.899813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-140f8c5e-9eb1-46b0-8923-803ad7751135 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:13.900659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-292a8d2d-634b-4e54-a0fc-f269654ae063 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:13.901186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-292a8d2d-634b-4e54-a0fc-f269654ae063 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:13.905758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-140f8c5e-9eb1-46b0-8923-803ad7751135 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:13.910437 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-140f8c5e-9eb1-46b0-8923-803ad7751135 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1593 microversion: 2.42 time: 0.664267 Aug 09 14:46:13.912368 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1778/3503] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:13 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1593 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:13.932103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292a8d2d-634b-4e54-a0fc-f269654ae063 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:13.932608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292a8d2d-634b-4e54-a0fc-f269654ae063 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:13.933055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292a8d2d-634b-4e54-a0fc-f269654ae063 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:13.933781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292a8d2d-634b-4e54-a0fc-f269654ae063 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:13.934239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292a8d2d-634b-4e54-a0fc-f269654ae063 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:13.934667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292a8d2d-634b-4e54-a0fc-f269654ae063 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:13.977265 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-292a8d2d-634b-4e54-a0fc-f269654ae063 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-292a8d2d-634b-4e54-a0fc-f269654ae063 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf HTTP/1.1 Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'd27684bc-0b81-45ee-8f6b-fddcfa000bdf'} Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:46:13.985203 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:46:13.990386 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:13.990386 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:13.990386 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:13.990386 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:13.990386 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:13.990386 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:13.990386 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:13.990386 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:13.990386 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:13.990386 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:13.990386 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:13.994954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-292a8d2d-634b-4e54-a0fc-f269654ae063 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:13.998222 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-292a8d2d-634b-4e54-a0fc-f269654ae063 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 404 len: 111 microversion: 2.1 time: 0.100708 Aug 09 14:46:14.010540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-08ae8bbc-c20f-40fe-9cf2-bc4cb6fa52db tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:14.013628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-08ae8bbc-c20f-40fe-9cf2-bc4cb6fa52db tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: d27684bc-0b81-45ee-8f6b-fddcfa000bdf] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:14.028902 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1726/3504] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:46:13 2022] DELETE /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:46:14.040393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08ae8bbc-c20f-40fe-9cf2-bc4cb6fa52db tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:14.040899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08ae8bbc-c20f-40fe-9cf2-bc4cb6fa52db tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:14.041349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08ae8bbc-c20f-40fe-9cf2-bc4cb6fa52db tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:14.042081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08ae8bbc-c20f-40fe-9cf2-bc4cb6fa52db tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:14.042523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08ae8bbc-c20f-40fe-9cf2-bc4cb6fa52db tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:14.042945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08ae8bbc-c20f-40fe-9cf2-bc4cb6fa52db tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:14.095824 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-08ae8bbc-c20f-40fe-9cf2-bc4cb6fa52db tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-08ae8bbc-c20f-40fe-9cf2-bc4cb6fa52db tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf HTTP/1.1 Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'd27684bc-0b81-45ee-8f6b-fddcfa000bdf'} Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.102055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.108207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.108207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:14.108207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:14.108207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:14.108207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:14.108207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. Aug 09 14:46:14.108207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.108207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-08ae8bbc-c20f-40fe-9cf2-bc4cb6fa52db tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Instance d27684bc-0b81-45ee-8f6b-fddcfa000bdf could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:14.108207 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-08ae8bbc-c20f-40fe-9cf2-bc4cb6fa52db tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf" status: 404 len: 111 microversion: 2.1 time: 0.101687 Aug 09 14:46:14.118061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8be22c11-ef92-48e5-8671-93d09adc1af1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dda8ddc0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:14.124073 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1779/3505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:14 2022] GET /compute/v2.1/servers/d27684bc-0b81-45ee-8f6b-fddcfa000bdf => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:46:14.266760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f2dec648-b099-4ed8-909b-206be45a4f5d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:14.267412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f2dec648-b099-4ed8-909b-206be45a4f5d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:14.277072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2dec648-b099-4ed8-909b-206be45a4f5d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:14.278529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2dec648-b099-4ed8-909b-206be45a4f5d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:14.279522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2dec648-b099-4ed8-909b-206be45a4f5d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:14.281139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2dec648-b099-4ed8-909b-206be45a4f5d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:14.284582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2dec648-b099-4ed8-909b-206be45a4f5d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:14.287265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-8be22c11-ef92-48e5-8671-93d09adc1af1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 889ea0db-76a7-494c-a948-ea9925f36c0c does not exist", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:46:14.288058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.security_group_api [None req-8be22c11-ef92-48e5-8671-93d09adc1af1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Neutron security group 889ea0db-76a7-494c-a948-ea9925f36c0c not found {{(pid=119406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:46:14.288719 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-8be22c11-ef92-48e5-8671-93d09adc1af1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Security group 889ea0db-76a7-494c-a948-ea9925f36c0c does not exist Aug 09 14:46:14.288719 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-4e6006f5-6166-43a1-bda7-bfed32eeebf3'] Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8be22c11-ef92-48e5-8671-93d09adc1af1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-security-groups/889ea0db-76a7-494c-a948-ea9925f36c0c HTTP/1.1 Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: exception: Security group 889ea0db-76a7-494c-a948-ea9925f36c0c does not exist Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-4e6006f5-6166-43a1-bda7-bfed32eeebf3'] Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '889ea0db-76a7-494c-a948-ea9925f36c0c'} Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:46:14.291031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 889ea0db-76a7-494c-a948-ea9925f36c0c does not exist Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e6006f5-6166-43a1-bda7-bfed32eeebf3'] Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 889ea0db-76a7-494c-a948-ea9925f36c0c does not exist Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e6006f5-6166-43a1-bda7-bfed32eeebf3'] Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 889ea0db-76a7-494c-a948-ea9925f36c0c does not exist Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e6006f5-6166-43a1-bda7-bfed32eeebf3'] Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 889ea0db-76a7-494c-a948-ea9925f36c0c does not exist Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e6006f5-6166-43a1-bda7-bfed32eeebf3'] Aug 09 14:46:14.295744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.300928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8be22c11-ef92-48e5-8671-93d09adc1af1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Security group 889ea0db-76a7-494c-a948-ea9925f36c0c does not exist Aug 09 14:46:14.300928 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-4e6006f5-6166-43a1-bda7-bfed32eeebf3'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:14.302078 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8be22c11-ef92-48e5-8671-93d09adc1af1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/889ea0db-76a7-494c-a948-ea9925f36c0c" status: 404 len: 194 microversion: 2.1 time: 0.188677 Aug 09 14:46:14.302822 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1727/3506] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:14 2022] DELETE /compute/v2.1/os-security-groups/889ea0db-76a7-494c-a948-ea9925f36c0c => generated 194 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:46:14.306536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2dec648-b099-4ed8-909b-206be45a4f5d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:14.323345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43954740-0f28-499e-a038-c0123abaa37c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dd929e50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:14.442671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-43954740-0f28-499e-a038-c0123abaa37c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9a0b804d-11eb-452f-8e5d-97641a2247b9 does not exist", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:46:14.443438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.security_group_api [None req-43954740-0f28-499e-a038-c0123abaa37c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Neutron security group 9a0b804d-11eb-452f-8e5d-97641a2247b9 not found {{(pid=119406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:46:14.444135 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-43954740-0f28-499e-a038-c0123abaa37c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Security group 9a0b804d-11eb-452f-8e5d-97641a2247b9 does not exist Aug 09 14:46:14.444135 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-185b20f3-364f-487f-8104-9a296e4dbde8'] Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43954740-0f28-499e-a038-c0123abaa37c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-security-groups/9a0b804d-11eb-452f-8e5d-97641a2247b9 HTTP/1.1 Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: exception: Security group 9a0b804d-11eb-452f-8e5d-97641a2247b9 does not exist Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-185b20f3-364f-487f-8104-9a296e4dbde8'] Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '9a0b804d-11eb-452f-8e5d-97641a2247b9'} Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:46:14.446472 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9a0b804d-11eb-452f-8e5d-97641a2247b9 does not exist Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-185b20f3-364f-487f-8104-9a296e4dbde8'] Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9a0b804d-11eb-452f-8e5d-97641a2247b9 does not exist Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-185b20f3-364f-487f-8104-9a296e4dbde8'] Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9a0b804d-11eb-452f-8e5d-97641a2247b9 does not exist Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-185b20f3-364f-487f-8104-9a296e4dbde8'] Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9a0b804d-11eb-452f-8e5d-97641a2247b9 does not exist Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-185b20f3-364f-487f-8104-9a296e4dbde8'] Aug 09 14:46:14.451506 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.455712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43954740-0f28-499e-a038-c0123abaa37c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Security group 9a0b804d-11eb-452f-8e5d-97641a2247b9 does not exist Aug 09 14:46:14.455712 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-185b20f3-364f-487f-8104-9a296e4dbde8'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:14.456881 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-43954740-0f28-499e-a038-c0123abaa37c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/9a0b804d-11eb-452f-8e5d-97641a2247b9" status: 404 len: 194 microversion: 2.1 time: 0.148882 Aug 09 14:46:14.457941 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1728/3507] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:14 2022] DELETE /compute/v2.1/os-security-groups/9a0b804d-11eb-452f-8e5d-97641a2247b9 => generated 194 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:46:14.473602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ece020df-3ae6-41ff-a9ce-dd7f59c461e9 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dd9e0040>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:14.537412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-ece020df-3ae6-41ff-a9ce-dd7f59c461e9 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:46:14.538547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.security_group_api [None req-ece020df-3ae6-41ff-a9ce-dd7f59c461e9 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Neutron security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 not found {{(pid=119406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:46:14.539417 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ece020df-3ae6-41ff-a9ce-dd7f59c461e9 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:46:14.539417 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-977eb13a-5355-47f8-8102-e4d32beaa2fd'] Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ece020df-3ae6-41ff-a9ce-dd7f59c461e9 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-security-groups/fe64013f-9688-4b3b-8fc2-cf2fdc008629 HTTP/1.1 Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: exception: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-977eb13a-5355-47f8-8102-e4d32beaa2fd'] Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'fe64013f-9688-4b3b-8fc2-cf2fdc008629'} Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:46:14.542031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-977eb13a-5355-47f8-8102-e4d32beaa2fd'] Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-977eb13a-5355-47f8-8102-e4d32beaa2fd'] Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-977eb13a-5355-47f8-8102-e4d32beaa2fd'] Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-977eb13a-5355-47f8-8102-e4d32beaa2fd'] Aug 09 14:46:14.547124 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.551691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ece020df-3ae6-41ff-a9ce-dd7f59c461e9 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Security group fe64013f-9688-4b3b-8fc2-cf2fdc008629 does not exist Aug 09 14:46:14.551691 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-977eb13a-5355-47f8-8102-e4d32beaa2fd'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:14.552987 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ece020df-3ae6-41ff-a9ce-dd7f59c461e9 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/fe64013f-9688-4b3b-8fc2-cf2fdc008629" status: 404 len: 194 microversion: 2.1 time: 0.090473 Aug 09 14:46:14.556949 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1729/3508] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:14 2022] DELETE /compute/v2.1/os-security-groups/fe64013f-9688-4b3b-8fc2-cf2fdc008629 => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:46:14.568931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-05aea5ab-9977-4ca7-8696-ef28ef109aa1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41ddf109d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:14.708671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-05aea5ab-9977-4ca7-8696-ef28ef109aa1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:46:14.710367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.security_group_api [None req-05aea5ab-9977-4ca7-8696-ef28ef109aa1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Neutron security group edee46d0-f847-45bf-b777-e8f518ccbc7c not found {{(pid=119406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:46:14.711181 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-05aea5ab-9977-4ca7-8696-ef28ef109aa1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:46:14.711181 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-fed8b438-e11e-4632-9815-2f384afeea43'] Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-05aea5ab-9977-4ca7-8696-ef28ef109aa1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-security-groups/edee46d0-f847-45bf-b777-e8f518ccbc7c HTTP/1.1 Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: exception: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-fed8b438-e11e-4632-9815-2f384afeea43'] Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'edee46d0-f847-45bf-b777-e8f518ccbc7c'} Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:46:14.713272 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fed8b438-e11e-4632-9815-2f384afeea43'] Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fed8b438-e11e-4632-9815-2f384afeea43'] Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fed8b438-e11e-4632-9815-2f384afeea43'] Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fed8b438-e11e-4632-9815-2f384afeea43'] Aug 09 14:46:14.718006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.722891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-05aea5ab-9977-4ca7-8696-ef28ef109aa1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Security group edee46d0-f847-45bf-b777-e8f518ccbc7c does not exist Aug 09 14:46:14.722891 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-fed8b438-e11e-4632-9815-2f384afeea43'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:14.724120 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-05aea5ab-9977-4ca7-8696-ef28ef109aa1 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/edee46d0-f847-45bf-b777-e8f518ccbc7c" status: 404 len: 194 microversion: 2.1 time: 0.165934 Aug 09 14:46:14.727980 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1730/3509] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:14 2022] DELETE /compute/v2.1/os-security-groups/edee46d0-f847-45bf-b777-e8f518ccbc7c => generated 194 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:46:14.736351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71cb6e22-1fba-439d-891d-3ca02d7bd17c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dda8daf0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:14.829138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-71cb6e22-1fba-439d-891d-3ca02d7bd17c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:46:14.831128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.security_group_api [None req-71cb6e22-1fba-439d-891d-3ca02d7bd17c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Neutron security group eeb9657e-e517-4a30-b562-d4bc0a926482 not found {{(pid=119406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:46:14.831910 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-71cb6e22-1fba-439d-891d-3ca02d7bd17c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:46:14.831910 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-fdb79ae9-ed66-404d-a556-e1e8cd7d1226'] Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71cb6e22-1fba-439d-891d-3ca02d7bd17c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-security-groups/eeb9657e-e517-4a30-b562-d4bc0a926482 HTTP/1.1 Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: exception: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-fdb79ae9-ed66-404d-a556-e1e8cd7d1226'] Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'eeb9657e-e517-4a30-b562-d4bc0a926482'} Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:46:14.834401 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdb79ae9-ed66-404d-a556-e1e8cd7d1226'] Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdb79ae9-ed66-404d-a556-e1e8cd7d1226'] Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdb79ae9-ed66-404d-a556-e1e8cd7d1226'] Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdb79ae9-ed66-404d-a556-e1e8cd7d1226'] Aug 09 14:46:14.838812 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:14.847490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71cb6e22-1fba-439d-891d-3ca02d7bd17c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Security group eeb9657e-e517-4a30-b562-d4bc0a926482 does not exist Aug 09 14:46:14.847490 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-fdb79ae9-ed66-404d-a556-e1e8cd7d1226'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:14.848744 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-71cb6e22-1fba-439d-891d-3ca02d7bd17c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/eeb9657e-e517-4a30-b562-d4bc0a926482" status: 404 len: 194 microversion: 2.1 time: 0.119308 Aug 09 14:46:14.852935 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1731/3510] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:14 2022] DELETE /compute/v2.1/os-security-groups/eeb9657e-e517-4a30-b562-d4bc0a926482 => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:46:14.858434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62071a31-388e-407e-a824-b33b278b0a99 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dda559d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:15.013090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-62071a31-388e-407e-a824-b33b278b0a99 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:46:15.015911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.security_group_api [None req-62071a31-388e-407e-a824-b33b278b0a99 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Neutron security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef not found {{(pid=119406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:46:15.017557 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-62071a31-388e-407e-a824-b33b278b0a99 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:46:15.017557 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-f321e983-a0ec-4e36-9d1c-0ecf0bd64489'] Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62071a31-388e-407e-a824-b33b278b0a99 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-security-groups/0d6fdab7-e465-451c-9e07-c66eecc9ceef HTTP/1.1 Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: exception: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-f321e983-a0ec-4e36-9d1c-0ecf0bd64489'] Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '0d6fdab7-e465-451c-9e07-c66eecc9ceef'} Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:46:15.020196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f321e983-a0ec-4e36-9d1c-0ecf0bd64489'] Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f321e983-a0ec-4e36-9d1c-0ecf0bd64489'] Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f321e983-a0ec-4e36-9d1c-0ecf0bd64489'] Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f321e983-a0ec-4e36-9d1c-0ecf0bd64489'] Aug 09 14:46:15.024466 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:15.041059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f2dec648-b099-4ed8-909b-206be45a4f5d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:15.050769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62071a31-388e-407e-a824-b33b278b0a99 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Security group 0d6fdab7-e465-451c-9e07-c66eecc9ceef does not exist Aug 09 14:46:15.050769 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-f321e983-a0ec-4e36-9d1c-0ecf0bd64489'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:15.053120 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-62071a31-388e-407e-a824-b33b278b0a99 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/0d6fdab7-e465-451c-9e07-c66eecc9ceef" status: 404 len: 194 microversion: 2.1 time: 0.198603 Aug 09 14:46:15.057939 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1732/3511] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:14 2022] DELETE /compute/v2.1/os-security-groups/0d6fdab7-e465-451c-9e07-c66eecc9ceef => generated 194 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:46:15.060334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f2dec648-b099-4ed8-909b-206be45a4f5d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:15.062052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f2dec648-b099-4ed8-909b-206be45a4f5d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:15.063330 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f2dec648-b099-4ed8-909b-206be45a4f5d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1362 microversion: 2.26 time: 0.801212 Aug 09 14:46:15.064071 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1780/3512] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:14 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1362 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:15.068833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8f6d8049-d4b1-4bac-9279-bc3de8dd184a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:15.069008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a1675fe-b18a-41a8-be12-89bfb035121d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:15.069331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8f6d8049-d4b1-4bac-9279-bc3de8dd184a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:15.072045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a1675fe-b18a-41a8-be12-89bfb035121d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:15.086223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f6d8049-d4b1-4bac-9279-bc3de8dd184a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:15.086724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f6d8049-d4b1-4bac-9279-bc3de8dd184a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:15.087185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f6d8049-d4b1-4bac-9279-bc3de8dd184a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:15.087900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f6d8049-d4b1-4bac-9279-bc3de8dd184a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:15.088361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f6d8049-d4b1-4bac-9279-bc3de8dd184a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:15.088792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f6d8049-d4b1-4bac-9279-bc3de8dd184a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:15.090971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1675fe-b18a-41a8-be12-89bfb035121d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:15.092066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1675fe-b18a-41a8-be12-89bfb035121d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:15.095779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1675fe-b18a-41a8-be12-89bfb035121d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:15.097361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1675fe-b18a-41a8-be12-89bfb035121d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:15.101075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1675fe-b18a-41a8-be12-89bfb035121d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:15.102459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a1675fe-b18a-41a8-be12-89bfb035121d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:15.179937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8f6d8049-d4b1-4bac-9279-bc3de8dd184a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:46:15.297071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a1675fe-b18a-41a8-be12-89bfb035121d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:15.313401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a1675fe-b18a-41a8-be12-89bfb035121d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:15.315108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a1675fe-b18a-41a8-be12-89bfb035121d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:15.319308 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a1675fe-b18a-41a8-be12-89bfb035121d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1593 microversion: 2.42 time: 0.260025 Aug 09 14:46:15.320487 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1733/3513] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:15 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1593 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:15.389547 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8f6d8049-d4b1-4bac-9279-bc3de8dd184a tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 204 len: 0 microversion: 2.1 time: 0.324115 Aug 09 14:46:15.390747 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1781/3514] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:46:15 2022] DELETE /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:46:15.399803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9c125760-fa3d-45b6-93dd-2aa70371f85d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:15.400423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9c125760-fa3d-45b6-93dd-2aa70371f85d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:15.407495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c125760-fa3d-45b6-93dd-2aa70371f85d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:15.414556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c125760-fa3d-45b6-93dd-2aa70371f85d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:15.415136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c125760-fa3d-45b6-93dd-2aa70371f85d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:15.415899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c125760-fa3d-45b6-93dd-2aa70371f85d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:15.416528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c125760-fa3d-45b6-93dd-2aa70371f85d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:15.416776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c125760-fa3d-45b6-93dd-2aa70371f85d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:15.829592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9c125760-fa3d-45b6-93dd-2aa70371f85d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:15.847281 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9c125760-fa3d-45b6-93dd-2aa70371f85d tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1647 microversion: 2.1 time: 0.451754 Aug 09 14:46:15.847915 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1734/3515] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:15 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1647 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:16.088047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-47225fee-274f-416e-bd7e-77a4f22e379e tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:16.088752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-47225fee-274f-416e-bd7e-77a4f22e379e tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:16.109764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47225fee-274f-416e-bd7e-77a4f22e379e tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:16.110283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47225fee-274f-416e-bd7e-77a4f22e379e tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:16.110683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47225fee-274f-416e-bd7e-77a4f22e379e tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:16.111411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47225fee-274f-416e-bd7e-77a4f22e379e tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:16.111853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47225fee-274f-416e-bd7e-77a4f22e379e tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:16.112270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47225fee-274f-416e-bd7e-77a4f22e379e tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:16.345160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91659fe9-71e5-4bcb-ad43-7cb2c89b5d13 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:16.346650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91659fe9-71e5-4bcb-ad43-7cb2c89b5d13 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:16.366315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91659fe9-71e5-4bcb-ad43-7cb2c89b5d13 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:16.366848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91659fe9-71e5-4bcb-ad43-7cb2c89b5d13 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:16.370237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91659fe9-71e5-4bcb-ad43-7cb2c89b5d13 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:16.371037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91659fe9-71e5-4bcb-ad43-7cb2c89b5d13 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:16.375039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91659fe9-71e5-4bcb-ad43-7cb2c89b5d13 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:16.377010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91659fe9-71e5-4bcb-ad43-7cb2c89b5d13 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:16.837088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-47225fee-274f-416e-bd7e-77a4f22e379e tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:16.851735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-47225fee-274f-416e-bd7e-77a4f22e379e tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:16.868506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-47225fee-274f-416e-bd7e-77a4f22e379e tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:16.870362 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-47225fee-274f-416e-bd7e-77a4f22e379e tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1362 microversion: 2.26 time: 0.787569 Aug 09 14:46:16.872268 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1782/3516] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:16 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1362 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:16.885222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-73cedd65-8b3e-4532-8f16-eaba4745e989 req-2bdfb06d-9ddc-4749-b276-4428dbd444aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7926ec88-423a-407b-a99e-d48cda387c93", "tag": "6b2f17ec-d760-478c-9b8c-8ecc8257ad7d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:16.926036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-73cedd65-8b3e-4532-8f16-eaba4745e989 req-2bdfb06d-9ddc-4749-b276-4428dbd444aa service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:16.926893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-73cedd65-8b3e-4532-8f16-eaba4745e989 req-2bdfb06d-9ddc-4749-b276-4428dbd444aa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:16.945086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-73cedd65-8b3e-4532-8f16-eaba4745e989 req-2bdfb06d-9ddc-4749-b276-4428dbd444aa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:16.972505 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-73cedd65-8b3e-4532-8f16-eaba4745e989 req-2bdfb06d-9ddc-4749-b276-4428dbd444aa service nova] Creating event network-changed:6b2f17ec-d760-478c-9b8c-8ecc8257ad7d for instance 7926ec88-423a-407b-a99e-d48cda387c93 on n-h2-844626-8 Aug 09 14:46:16.986983 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-73cedd65-8b3e-4532-8f16-eaba4745e989 req-2bdfb06d-9ddc-4749-b276-4428dbd444aa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105941 Aug 09 14:46:16.988496 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1783/3517] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:16.996581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0619891-d9e6-43af-bc88-0027e7901b2e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:16.997616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0619891-d9e6-43af-bc88-0027e7901b2e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:17.013879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0619891-d9e6-43af-bc88-0027e7901b2e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:17.014617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0619891-d9e6-43af-bc88-0027e7901b2e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:17.015250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0619891-d9e6-43af-bc88-0027e7901b2e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:17.016216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0619891-d9e6-43af-bc88-0027e7901b2e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:17.016819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0619891-d9e6-43af-bc88-0027e7901b2e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:17.017390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0619891-d9e6-43af-bc88-0027e7901b2e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:18.016663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91659fe9-71e5-4bcb-ad43-7cb2c89b5d13 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:18.030597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:18.047920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91659fe9-71e5-4bcb-ad43-7cb2c89b5d13 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:18.056144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91659fe9-71e5-4bcb-ad43-7cb2c89b5d13 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:18.061227 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91659fe9-71e5-4bcb-ad43-7cb2c89b5d13 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1660 microversion: 2.42 time: 1.720017 Aug 09 14:46:18.063966 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1735/3518] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:16 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1660 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:18.081814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3bf4fc40-d166-40a0-b28c-9df56920a2fc tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:18.088895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3bf4fc40-d166-40a0-b28c-9df56920a2fc tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:18.097413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a0619891-d9e6-43af-bc88-0027e7901b2e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:18.106565 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0619891-d9e6-43af-bc88-0027e7901b2e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1647 microversion: 2.1 time: 1.114283 Aug 09 14:46:18.107182 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1784/3519] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:16 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1647 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:18.111866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bf4fc40-d166-40a0-b28c-9df56920a2fc tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:18.113661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bf4fc40-d166-40a0-b28c-9df56920a2fc tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:18.114294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bf4fc40-d166-40a0-b28c-9df56920a2fc tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:18.117992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bf4fc40-d166-40a0-b28c-9df56920a2fc tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:18.118658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bf4fc40-d166-40a0-b28c-9df56920a2fc tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:18.120297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bf4fc40-d166-40a0-b28c-9df56920a2fc tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:18.365362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:18.683961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3bf4fc40-d166-40a0-b28c-9df56920a2fc tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:18.696996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3bf4fc40-d166-40a0-b28c-9df56920a2fc tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:18.698750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3bf4fc40-d166-40a0-b28c-9df56920a2fc tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:18.699941 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3bf4fc40-d166-40a0-b28c-9df56920a2fc tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1362 microversion: 2.26 time: 0.633998 Aug 09 14:46:18.727167 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1736/3520] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:18 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1362 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:19.087961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c71831f9-b85b-41d7-951c-99eee8e590c8 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:19.088893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c71831f9-b85b-41d7-951c-99eee8e590c8 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:19.103493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71831f9-b85b-41d7-951c-99eee8e590c8 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:19.109138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71831f9-b85b-41d7-951c-99eee8e590c8 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:19.109889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71831f9-b85b-41d7-951c-99eee8e590c8 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:19.110811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71831f9-b85b-41d7-951c-99eee8e590c8 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:19.111745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71831f9-b85b-41d7-951c-99eee8e590c8 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:19.112496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c71831f9-b85b-41d7-951c-99eee8e590c8 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:19.133932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01a79af9-6057-4818-90ad-d438badf8c5e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:19.135010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01a79af9-6057-4818-90ad-d438badf8c5e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:19.153359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a79af9-6057-4818-90ad-d438badf8c5e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:19.159715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a79af9-6057-4818-90ad-d438badf8c5e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:19.160542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a79af9-6057-4818-90ad-d438badf8c5e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:19.161578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a79af9-6057-4818-90ad-d438badf8c5e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:19.162273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a79af9-6057-4818-90ad-d438badf8c5e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:19.163808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a79af9-6057-4818-90ad-d438badf8c5e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:19.221848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:19.305052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:19.630150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-01a79af9-6057-4818-90ad-d438badf8c5e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ed1274a3df4202a9417070db172cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '255e01b50a0249008b5c4533efbef0fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:19.644240 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01a79af9-6057-4818-90ad-d438badf8c5e tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 200 len: 1468 microversion: 2.1 time: 0.517406 Aug 09 14:46:19.647043 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1737/3521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:19 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 1468 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:46:19.653217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d9537456-da84-4596-9280-2e9090f5e972 req-5622c5ac-6666-4684-be28-5d6cb8175e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136ce1bd-97a7-4072-9bf3-c218db6b023b", "name": "network-vif-deleted", "tag": "742c23b3-637d-41b6-9013-f8555384198c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:19.665737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d9537456-da84-4596-9280-2e9090f5e972 req-5622c5ac-6666-4684-be28-5d6cb8175e05 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:19.666647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d9537456-da84-4596-9280-2e9090f5e972 req-5622c5ac-6666-4684-be28-5d6cb8175e05 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:19.667397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d9537456-da84-4596-9280-2e9090f5e972 req-5622c5ac-6666-4684-be28-5d6cb8175e05 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:19.712167 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d9537456-da84-4596-9280-2e9090f5e972 req-5622c5ac-6666-4684-be28-5d6cb8175e05 service nova] Creating event network-vif-deleted:742c23b3-637d-41b6-9013-f8555384198c for instance 136ce1bd-97a7-4072-9bf3-c218db6b023b on n-h1-844626-8 Aug 09 14:46:19.721678 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d9537456-da84-4596-9280-2e9090f5e972 req-5622c5ac-6666-4684-be28-5d6cb8175e05 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071704 Aug 09 14:46:19.722822 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1738/3522] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:19.747710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f01a4aff-d37c-4563-8f42-05c7828f254d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:19.749301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f01a4aff-d37c-4563-8f42-05c7828f254d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:19.759037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f01a4aff-d37c-4563-8f42-05c7828f254d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:19.759676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f01a4aff-d37c-4563-8f42-05c7828f254d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:19.760391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f01a4aff-d37c-4563-8f42-05c7828f254d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:19.763559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f01a4aff-d37c-4563-8f42-05c7828f254d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:19.764244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f01a4aff-d37c-4563-8f42-05c7828f254d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:19.764783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f01a4aff-d37c-4563-8f42-05c7828f254d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:20.282618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c71831f9-b85b-41d7-951c-99eee8e590c8 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:20.301309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c71831f9-b85b-41d7-951c-99eee8e590c8 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:20.305388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c71831f9-b85b-41d7-951c-99eee8e590c8 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:20.309712 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c71831f9-b85b-41d7-951c-99eee8e590c8 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1706 microversion: 2.42 time: 1.225052 Aug 09 14:46:20.324346 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1785/3523] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:19 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1706 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:20.537465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f01a4aff-d37c-4563-8f42-05c7828f254d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:20.552784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f01a4aff-d37c-4563-8f42-05c7828f254d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:20.558323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f01a4aff-d37c-4563-8f42-05c7828f254d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:20.560282 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f01a4aff-d37c-4563-8f42-05c7828f254d tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1362 microversion: 2.26 time: 0.825414 Aug 09 14:46:20.561192 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1739/3524] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:19 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1362 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:20.667945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cafb6bc3-6700-4870-8d11-dc60aa197cc6 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Calling method '.version_select at 0x7f41dc8b6820>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:20.669014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-539593d1-835b-4bbb-9b98-dc6f13d3846c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:20.669735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-539593d1-835b-4bbb-9b98-dc6f13d3846c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] [instance: 136ce1bd-97a7-4072-9bf3-c218db6b023b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:20.686128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-539593d1-835b-4bbb-9b98-dc6f13d3846c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:20.687018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-539593d1-835b-4bbb-9b98-dc6f13d3846c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:20.687822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-539593d1-835b-4bbb-9b98-dc6f13d3846c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:20.688814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-539593d1-835b-4bbb-9b98-dc6f13d3846c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:20.689496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-539593d1-835b-4bbb-9b98-dc6f13d3846c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:20.690164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-539593d1-835b-4bbb-9b98-dc6f13d3846c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:20.729848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG neutronclient.v2_0.client [None req-cafb6bc3-6700-4870-8d11-dc60aa197cc6 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bbd3c126-daf6-40ca-a271-02687375251b does not exist", "detail": ""}} {{(pid=119407) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:46:20.732019 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-539593d1-835b-4bbb-9b98-dc6f13d3846c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] HTTP exception thrown: Instance 136ce1bd-97a7-4072-9bf3-c218db6b023b could not be found. Aug 09 14:46:20.732187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.security_group_api [None req-cafb6bc3-6700-4870-8d11-dc60aa197cc6 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Neutron security group bbd3c126-daf6-40ca-a271-02687375251b not found {{(pid=119407) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:46:20.732886 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-cafb6bc3-6700-4870-8d11-dc60aa197cc6 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] HTTP exception thrown: Security group bbd3c126-daf6-40ca-a271-02687375251b does not exist Aug 09 14:46:20.732886 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-b065ff85-dcc5-4399-af44-851b848e4ec3'] Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cafb6bc3-6700-4870-8d11-dc60aa197cc6 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Request method failure captured: Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/os-security-groups/bbd3c126-daf6-40ca-a271-02687375251b HTTP/1.1 Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nM7Qm2pQOsBubxswbAQGsuUdrsz64_nxroEWSfysJtea2cedNPVlrsgM_5w2ytRjOKnvkNo0ur3yvSpPtexMkDxrsqoKsMOYPHrm9O3HYJefnkrGIeqcZa5EmNt3A3OOPjTeevY2uLSXsisg4RjYERQZlepXILwZolIKTmCLEdDRRQ Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: cb37abf573ce497b9967099b5a1fcf64 Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-438290410 Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cb37abf573ce497b9967099b5a1fcf64", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cb37abf573ce497b9967099b5a1fcf64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb37abf573ce497b9967099b5a1fcf64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb37abf573ce497b9967099b5a1fcf64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-438290410 Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: cb37abf573ce497b9967099b5a1fcf64 Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-438290410 Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-SecurityGroupsNegativeTestJSON-438290410-project Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 39f9a732a5a14b78afbde62904a5459e Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-438290410-project Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: exception: Security group bbd3c126-daf6-40ca-a271-02687375251b does not exist Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-b065ff85-dcc5-4399-af44-851b848e4ec3'] Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'bbd3c126-daf6-40ca-a271-02687375251b'} Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:46:20.735927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bbd3c126-daf6-40ca-a271-02687375251b does not exist Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b065ff85-dcc5-4399-af44-851b848e4ec3'] Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bbd3c126-daf6-40ca-a271-02687375251b does not exist Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b065ff85-dcc5-4399-af44-851b848e4ec3'] Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bbd3c126-daf6-40ca-a271-02687375251b does not exist Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b065ff85-dcc5-4399-af44-851b848e4ec3'] Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bbd3c126-daf6-40ca-a271-02687375251b does not exist Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b065ff85-dcc5-4399-af44-851b848e4ec3'] Aug 09 14:46:20.741587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-539593d1-835b-4bbb-9b98-dc6f13d3846c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Request method failure captured: Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b HTTP/1.1 Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nK8OAedsZ7BijnW_vgPley-SM5E_JYj3bAp2WW58j0uiQcPERS8oKHPzxY7MPXsPmD_6en60Hr3NRBTuTAbsfsZ6wIIntgKIhl5yLdMi4PqzaN26f_fdOHt5NsCCop7_DjM06Aj2Phjxsyks9fZFNMuSzN37d1qijoA7GRdzmBEBcE Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_255e01b50a0249008b5c4533efbef0fd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/255e01b50a0249008b5c4533efbef0fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 255e01b50a0249008b5c4533efbef0fd Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1192264354 Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 37ed1274a3df4202a9417070db172cfa Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupsTestJSON-1192264354-project Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 136ce1bd-97a7-4072-9bf3-c218db6b023b could not be found. Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '136ce1bd-97a7-4072-9bf3-c218db6b023b'} Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 136ce1bd-97a7-4072-9bf3-c218db6b023b could not be found. Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 136ce1bd-97a7-4072-9bf3-c218db6b023b could not be found. Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:20.745123 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:20.754550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:20.754550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:20.754550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:20.754550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:20.754550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:20.754550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 136ce1bd-97a7-4072-9bf3-c218db6b023b could not be found. Aug 09 14:46:20.754550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:20.754550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-539593d1-835b-4bbb-9b98-dc6f13d3846c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Returning 404 to user: Instance 136ce1bd-97a7-4072-9bf3-c218db6b023b could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:20.754550 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-539593d1-835b-4bbb-9b98-dc6f13d3846c tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b" status: 404 len: 111 microversion: 2.1 time: 0.086303 Aug 09 14:46:20.755333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cafb6bc3-6700-4870-8d11-dc60aa197cc6 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Returning 404 to user: Security group bbd3c126-daf6-40ca-a271-02687375251b does not exist Aug 09 14:46:20.755333 n-d-844626-8 devstack@n-api.service[119407]: Neutron server returns request_ids: ['req-b065ff85-dcc5-4399-af44-851b848e4ec3'] {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:20.755333 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cafb6bc3-6700-4870-8d11-dc60aa197cc6 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/bbd3c126-daf6-40ca-a271-02687375251b" status: 404 len: 194 microversion: 2.1 time: 0.439898 Aug 09 14:46:20.756644 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1786/3525] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:20 2022] DELETE /compute/v2.1/os-security-groups/bbd3c126-daf6-40ca-a271-02687375251b => generated 194 bytes in 445 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:46:20.760971 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1740/3526] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:20 2022] GET /compute/v2.1/servers/136ce1bd-97a7-4072-9bf3-c218db6b023b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:46:20.768517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7e1ff336-209e-454c-8728-47147e7d8803 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dc8db670>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:20.775050 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-12060ee1-c46f-4b0a-baff-d06a4721d89c tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.009656 Aug 09 14:46:20.775819 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1741/3527] 10.222.0.50 () {58 vars in 1164 bytes} [Tue Aug 9 14:46:20 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 14:46:20.787972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-344f65e1-4194-4a2d-96c6-7b5349cae4c2 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Calling method '.version_select at 0x7f41ddda0ca0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:20.826924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:21.504725 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-344f65e1-4194-4a2d-96c6-7b5349cae4c2 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.721789 Aug 09 14:46:21.505478 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1742/3528] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 14:46:20 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:46:21.789399 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7e1ff336-209e-454c-8728-47147e7d8803 tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/c0f2b6d0-e467-47e3-88ab-03d9d53243ad" status: 202 len: 0 microversion: 2.1 time: 1.030503 Aug 09 14:46:21.790380 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1787/3529] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:20 2022] DELETE /compute/v2.1/os-security-groups/c0f2b6d0-e467-47e3-88ab-03d9d53243ad => generated 0 bytes in 1032 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:46:21.795421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-50b63711-a459-4b70-96f5-95e71255db78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:21.796053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-50b63711-a459-4b70-96f5-95e71255db78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:21.810675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1862180496", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": "none"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:21.830207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50b63711-a459-4b70-96f5-95e71255db78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:21.830723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50b63711-a459-4b70-96f5-95e71255db78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:21.831268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50b63711-a459-4b70-96f5-95e71255db78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:21.831916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50b63711-a459-4b70-96f5-95e71255db78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:21.832370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50b63711-a459-4b70-96f5-95e71255db78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:21.832794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50b63711-a459-4b70-96f5-95e71255db78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:21.941888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:46:21.941888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:46:21.942111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:46:21.942455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:46:21.947598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:46:21.974641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:21.975381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:21.975983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:21.976902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:21.977681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:21.978395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:22.002731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Getting quotas for project cd13df97b24c400ba82340468d2635cd. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:46:22.009072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Getting quotas for user 280c6a8b06e24528ac29a386143ff8e0 and project cd13df97b24c400ba82340468d2635cd. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:46:22.026380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:46:22.029178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:46:22.105321 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-967b6944-c420-4489-b758-d98d6cee6ece tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.598685 Aug 09 14:46:22.106684 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1743/3530] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:46:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 14:46:22.112062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-14b55cb8-90d7-49a4-bc99-d30fec3981f8 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Calling method '.version_select at 0x7f41dda559d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:22.272946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-50b63711-a459-4b70-96f5-95e71255db78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:22.299039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-50b63711-a459-4b70-96f5-95e71255db78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:22.309377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-50b63711-a459-4b70-96f5-95e71255db78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:22.324514 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50b63711-a459-4b70-96f5-95e71255db78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1752 microversion: 2.42 time: 0.519637 Aug 09 14:46:22.325079 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1788/3531] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:21 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1752 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:22.347626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1388501e-aac8-42c0-b24d-9dbe071c0b60 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:22.349269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1388501e-aac8-42c0-b24d-9dbe071c0b60 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:22.374042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1388501e-aac8-42c0-b24d-9dbe071c0b60 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:22.374530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1388501e-aac8-42c0-b24d-9dbe071c0b60 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:22.381303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1388501e-aac8-42c0-b24d-9dbe071c0b60 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:22.382081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1388501e-aac8-42c0-b24d-9dbe071c0b60 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:22.382555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1388501e-aac8-42c0-b24d-9dbe071c0b60 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:22.386196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1388501e-aac8-42c0-b24d-9dbe071c0b60 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:22.409637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-14b55cb8-90d7-49a4-bc99-d30fec3981f8 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:46:22.410447 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-14b55cb8-90d7-49a4-bc99-d30fec3981f8 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 09 14:46:22.410447 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-74efb8fb-cacd-4aed-85bb-ade4841a7ef8'] Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-14b55cb8-90d7-49a4-bc99-d30fec3981f8 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Request method failure captured: Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-security-groups/e1bc4d0a-c35c-407b-884a-43c5e35e5c18 HTTP/1.1 Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nM7Qm2pQOsBubxswbAQGsuUdrsz64_nxroEWSfysJtea2cedNPVlrsgM_5w2ytRjOKnvkNo0ur3yvSpPtexMkDxrsqoKsMOYPHrm9O3HYJefnkrGIeqcZa5EmNt3A3OOPjTeevY2uLSXsisg4RjYERQZlepXILwZolIKTmCLEdDRRQ Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: cb37abf573ce497b9967099b5a1fcf64 Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-438290410 Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cb37abf573ce497b9967099b5a1fcf64", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cb37abf573ce497b9967099b5a1fcf64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb37abf573ce497b9967099b5a1fcf64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb37abf573ce497b9967099b5a1fcf64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-438290410 Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: cb37abf573ce497b9967099b5a1fcf64 Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-438290410 Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupsNegativeTestJSON-438290410-project Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 39f9a732a5a14b78afbde62904a5459e Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-438290410-project Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: exception: Insufficient rights for removing default security group. Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-74efb8fb-cacd-4aed-85bb-ade4841a7ef8'] Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'e1bc4d0a-c35c-407b-884a-43c5e35e5c18'} Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:46:22.412719 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74efb8fb-cacd-4aed-85bb-ade4841a7ef8'] Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74efb8fb-cacd-4aed-85bb-ade4841a7ef8'] Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74efb8fb-cacd-4aed-85bb-ade4841a7ef8'] Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74efb8fb-cacd-4aed-85bb-ade4841a7ef8'] Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-14b55cb8-90d7-49a4-bc99-d30fec3981f8 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 09 14:46:22.417660 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-74efb8fb-cacd-4aed-85bb-ade4841a7ef8'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:22.423640 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-14b55cb8-90d7-49a4-bc99-d30fec3981f8 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/e1bc4d0a-c35c-407b-884a-43c5e35e5c18" status: 400 len: 182 microversion: 2.1 time: 0.313038 Aug 09 14:46:22.423640 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1744/3532] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:22 2022] DELETE /compute/v2.1/os-security-groups/e1bc4d0a-c35c-407b-884a-43c5e35e5c18 => generated 182 bytes in 315 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:46:22.432296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-113b8b15-e83c-40bb-b90b-a8820809744b tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] Calling method '.version_select at 0x7f41dd9e00d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:23.028101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1388501e-aac8-42c0-b24d-9dbe071c0b60 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:23.044882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1388501e-aac8-42c0-b24d-9dbe071c0b60 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:23.047788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1388501e-aac8-42c0-b24d-9dbe071c0b60 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:23.049887 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1388501e-aac8-42c0-b24d-9dbe071c0b60 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1362 microversion: 2.26 time: 0.714483 Aug 09 14:46:23.056843 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1789/3533] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:22 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1362 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:23.062664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cfdc4c14-686e-448e-a119-2280ebf0ead5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:23.063674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cfdc4c14-686e-448e-a119-2280ebf0ead5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:23.068376 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-113b8b15-e83c-40bb-b90b-a8820809744b tempest-SecurityGroupsTestJSON-1192264354 tempest-SecurityGroupsTestJSON-1192264354-project] 10.222.0.50 "DELETE /compute/v2.1/os-security-groups/42e24b96-306e-45fa-85d2-af7da279c5d9" status: 202 len: 0 microversion: 2.1 time: 0.643727 Aug 09 14:46:23.069564 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1745/3534] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:46:22 2022] DELETE /compute/v2.1/os-security-groups/42e24b96-306e-45fa-85d2-af7da279c5d9 => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:46:23.072231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfdc4c14-686e-448e-a119-2280ebf0ead5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:23.073104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfdc4c14-686e-448e-a119-2280ebf0ead5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:23.073785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfdc4c14-686e-448e-a119-2280ebf0ead5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:23.074791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfdc4c14-686e-448e-a119-2280ebf0ead5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:23.075538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfdc4c14-686e-448e-a119-2280ebf0ead5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:23.077137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cfdc4c14-686e-448e-a119-2280ebf0ead5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:23.077271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-24b3d0f8-a25c-4d27-9e87-73fb760bdc76 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Calling method '.version_select at 0x7f41ddda0430>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:23.258687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-24b3d0f8-a25c-4d27-9e87-73fb760bdc76 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 810a0293-d359-4e3b-815f-c7f7463762f6 does not exist", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:46:23.259663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.security_group_api [None req-24b3d0f8-a25c-4d27-9e87-73fb760bdc76 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Neutron security group 810a0293-d359-4e3b-815f-c7f7463762f6 not found {{(pid=119406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:46:23.261148 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-24b3d0f8-a25c-4d27-9e87-73fb760bdc76 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] HTTP exception thrown: Security group 810a0293-d359-4e3b-815f-c7f7463762f6 does not exist Aug 09 14:46:23.261148 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-2d73f141-11a9-429b-a3fa-a22f4b4810ae'] Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-24b3d0f8-a25c-4d27-9e87-73fb760bdc76 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Request method failure captured: Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/os-security-groups/810a0293-d359-4e3b-815f-c7f7463762f6 HTTP/1.1 Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nM7Qm2pQOsBubxswbAQGsuUdrsz64_nxroEWSfysJtea2cedNPVlrsgM_5w2ytRjOKnvkNo0ur3yvSpPtexMkDxrsqoKsMOYPHrm9O3HYJefnkrGIeqcZa5EmNt3A3OOPjTeevY2uLSXsisg4RjYERQZlepXILwZolIKTmCLEdDRRQ Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: cb37abf573ce497b9967099b5a1fcf64 Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-438290410 Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cb37abf573ce497b9967099b5a1fcf64", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cb37abf573ce497b9967099b5a1fcf64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb37abf573ce497b9967099b5a1fcf64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb37abf573ce497b9967099b5a1fcf64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-438290410 Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: cb37abf573ce497b9967099b5a1fcf64 Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-438290410 Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupsNegativeTestJSON-438290410-project Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 39f9a732a5a14b78afbde62904a5459e Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-438290410-project Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: exception: Security group 810a0293-d359-4e3b-815f-c7f7463762f6 does not exist Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-2d73f141-11a9-429b-a3fa-a22f4b4810ae'] Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '810a0293-d359-4e3b-815f-c7f7463762f6'} Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:46:23.264887 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 810a0293-d359-4e3b-815f-c7f7463762f6 does not exist Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d73f141-11a9-429b-a3fa-a22f4b4810ae'] Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 810a0293-d359-4e3b-815f-c7f7463762f6 does not exist Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d73f141-11a9-429b-a3fa-a22f4b4810ae'] Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 810a0293-d359-4e3b-815f-c7f7463762f6 does not exist Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d73f141-11a9-429b-a3fa-a22f4b4810ae'] Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 810a0293-d359-4e3b-815f-c7f7463762f6 does not exist Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2d73f141-11a9-429b-a3fa-a22f4b4810ae'] Aug 09 14:46:23.270387 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.273502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cfdc4c14-686e-448e-a119-2280ebf0ead5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:23.276351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-24b3d0f8-a25c-4d27-9e87-73fb760bdc76 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Returning 404 to user: Security group 810a0293-d359-4e3b-815f-c7f7463762f6 does not exist Aug 09 14:46:23.276351 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-2d73f141-11a9-429b-a3fa-a22f4b4810ae'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:23.276351 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-24b3d0f8-a25c-4d27-9e87-73fb760bdc76 tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] 10.222.0.50 "GET /compute/v2.1/os-security-groups/810a0293-d359-4e3b-815f-c7f7463762f6" status: 404 len: 194 microversion: 2.1 time: 0.205002 Aug 09 14:46:23.276351 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1746/3535] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:46:23 2022] GET /compute/v2.1/os-security-groups/810a0293-d359-4e3b-815f-c7f7463762f6 => generated 194 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:46:23.295884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cfdc4c14-686e-448e-a119-2280ebf0ead5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:23.297878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-11254c9a-7bec-4771-81f2-9f005180b1ed tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Action: 'update', calling method: .version_select at 0x7f41dda1e3a0>, body: {"security_group": {"name": "tempest-sg-48416815", "description": "tempest-description-1261882211"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:23.300667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cfdc4c14-686e-448e-a119-2280ebf0ead5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:23.313384 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cfdc4c14-686e-448e-a119-2280ebf0ead5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1282 microversion: 2.54 time: 0.244483 Aug 09 14:46:23.313949 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1790/3536] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:23 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1282 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:23.357733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89851c15-005a-4080-aa03-59dd234dd6a2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:23.358550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-89851c15-005a-4080-aa03-59dd234dd6a2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:23.372986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89851c15-005a-4080-aa03-59dd234dd6a2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:23.374981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89851c15-005a-4080-aa03-59dd234dd6a2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:23.378510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89851c15-005a-4080-aa03-59dd234dd6a2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:23.380132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89851c15-005a-4080-aa03-59dd234dd6a2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:23.380934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89851c15-005a-4080-aa03-59dd234dd6a2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:23.383410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89851c15-005a-4080-aa03-59dd234dd6a2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:23.505464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG neutronclient.v2_0.client [None req-11254c9a-7bec-4771-81f2-9f005180b1ed tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0 does not exist", "detail": ""}} {{(pid=119406) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 09 14:46:23.506523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.security_group_api [None req-11254c9a-7bec-4771-81f2-9f005180b1ed tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Neutron security group 4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0 not found {{(pid=119406) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 09 14:46:23.506679 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-11254c9a-7bec-4771-81f2-9f005180b1ed tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] HTTP exception thrown: Security group 4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0 does not exist Aug 09 14:46:23.506679 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-3ab2ef61-1a35-43ad-96f4-d4fe8e453426'] Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-11254c9a-7bec-4771-81f2-9f005180b1ed tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Request method failure captured: Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: request: PUT /compute/v2.1/os-security-groups/4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0 HTTP/1.1 Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 100 Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nM7Qm2pQOsBubxswbAQGsuUdrsz64_nxroEWSfysJtea2cedNPVlrsgM_5w2ytRjOKnvkNo0ur3yvSpPtexMkDxrsqoKsMOYPHrm9O3HYJefnkrGIeqcZa5EmNt3A3OOPjTeevY2uLSXsisg4RjYERQZlepXILwZolIKTmCLEdDRRQ Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: cb37abf573ce497b9967099b5a1fcf64 Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-438290410 Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cb37abf573ce497b9967099b5a1fcf64", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cb37abf573ce497b9967099b5a1fcf64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb37abf573ce497b9967099b5a1fcf64"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cb37abf573ce497b9967099b5a1fcf64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-438290410 Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: cb37abf573ce497b9967099b5a1fcf64 Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-438290410 Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-SecurityGroupsNegativeTestJSON-438290410-project Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 39f9a732a5a14b78afbde62904a5459e Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-438290410-project Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: {"security_group": {"name": "tempest-sg-48416815", "description": "tempest-description-1261882211"}} Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: exception: Security group 4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0 does not exist Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-3ab2ef61-1a35-43ad-96f4-d4fe8e453426'] Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0', 'body': {'security_group': {'name': 'tempest-sg-48416815', 'description': 'tempest-description-1261882211'}}} Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 09 14:46:23.509630 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0 does not exist Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ab2ef61-1a35-43ad-96f4-d4fe8e453426'] Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0 does not exist Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ab2ef61-1a35-43ad-96f4-d4fe8e453426'] Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0 does not exist Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ab2ef61-1a35-43ad-96f4-d4fe8e453426'] Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0 does not exist Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ab2ef61-1a35-43ad-96f4-d4fe8e453426'] Aug 09 14:46:23.514853 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:46:23.520353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-11254c9a-7bec-4771-81f2-9f005180b1ed tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] Returning 404 to user: Security group 4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0 does not exist Aug 09 14:46:23.520353 n-d-844626-8 devstack@n-api.service[119406]: Neutron server returns request_ids: ['req-3ab2ef61-1a35-43ad-96f4-d4fe8e453426'] {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:23.522102 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-11254c9a-7bec-4771-81f2-9f005180b1ed tempest-SecurityGroupsNegativeTestJSON-438290410 tempest-SecurityGroupsNegativeTestJSON-438290410-project] 10.222.0.50 "PUT /compute/v2.1/os-security-groups/4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0" status: 404 len: 194 microversion: 2.1 time: 0.228893 Aug 09 14:46:23.522909 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1747/3537] 10.222.0.50 () {60 vars in 1290 bytes} [Tue Aug 9 14:46:23 2022] PUT /compute/v2.1/os-security-groups/4f3aef33-e0bb-4e7a-b770-5fa7506e8fc0 => generated 194 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:46:24.030733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-89851c15-005a-4080-aa03-59dd234dd6a2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:24.047113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-89851c15-005a-4080-aa03-59dd234dd6a2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:24.054234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-89851c15-005a-4080-aa03-59dd234dd6a2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:24.055910 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-89851c15-005a-4080-aa03-59dd234dd6a2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1752 microversion: 2.42 time: 0.707311 Aug 09 14:46:24.056727 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1791/3538] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:23 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1752 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:24.075954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43eb31c4-1db0-4c26-9a3f-c799a83888a8 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:24.077631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-43eb31c4-1db0-4c26-9a3f-c799a83888a8 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:24.091490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43eb31c4-1db0-4c26-9a3f-c799a83888a8 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:24.091997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43eb31c4-1db0-4c26-9a3f-c799a83888a8 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:24.092484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43eb31c4-1db0-4c26-9a3f-c799a83888a8 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:24.093259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43eb31c4-1db0-4c26-9a3f-c799a83888a8 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:24.093817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43eb31c4-1db0-4c26-9a3f-c799a83888a8 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:24.108644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43eb31c4-1db0-4c26-9a3f-c799a83888a8 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:24.345848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2016c77c-f13d-45e4-a552-dcabae87a363 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:24.346485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2016c77c-f13d-45e4-a552-dcabae87a363 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:24.360687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2016c77c-f13d-45e4-a552-dcabae87a363 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:24.361821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2016c77c-f13d-45e4-a552-dcabae87a363 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:24.362264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2016c77c-f13d-45e4-a552-dcabae87a363 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:24.362979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2016c77c-f13d-45e4-a552-dcabae87a363 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:24.363460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2016c77c-f13d-45e4-a552-dcabae87a363 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:24.367948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2016c77c-f13d-45e4-a552-dcabae87a363 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:24.863172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2016c77c-f13d-45e4-a552-dcabae87a363 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:24.878767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2016c77c-f13d-45e4-a552-dcabae87a363 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:24.884487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2016c77c-f13d-45e4-a552-dcabae87a363 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:24.890154 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2016c77c-f13d-45e4-a552-dcabae87a363 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1336 microversion: 2.54 time: 0.549110 Aug 09 14:46:24.891453 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1792/3539] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:24 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1336 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:25.086856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f571e34d-07e7-4c9d-87f0-39ccfac63f93 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:25.087529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f571e34d-07e7-4c9d-87f0-39ccfac63f93 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:25.113160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f571e34d-07e7-4c9d-87f0-39ccfac63f93 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:25.120234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f571e34d-07e7-4c9d-87f0-39ccfac63f93 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:25.123318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f571e34d-07e7-4c9d-87f0-39ccfac63f93 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:25.124353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f571e34d-07e7-4c9d-87f0-39ccfac63f93 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:25.125175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f571e34d-07e7-4c9d-87f0-39ccfac63f93 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:25.130095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f571e34d-07e7-4c9d-87f0-39ccfac63f93 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:25.134795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-43eb31c4-1db0-4c26-9a3f-c799a83888a8 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:25.154453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-43eb31c4-1db0-4c26-9a3f-c799a83888a8 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:25.171556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-43eb31c4-1db0-4c26-9a3f-c799a83888a8 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:25.172867 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-43eb31c4-1db0-4c26-9a3f-c799a83888a8 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1362 microversion: 2.26 time: 1.102929 Aug 09 14:46:25.173469 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1748/3540] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:24 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1362 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:25.423688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8dad0da5-d2e5-48b7-b8b9-ad2d4ad75092 req-525bdd2f-3358-4bf1-bd82-61589b45871a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7926ec88-423a-407b-a99e-d48cda387c93", "name": "network-vif-plugged", "status": "completed", "tag": "6b2f17ec-d760-478c-9b8c-8ecc8257ad7d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:25.447409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8dad0da5-d2e5-48b7-b8b9-ad2d4ad75092 req-525bdd2f-3358-4bf1-bd82-61589b45871a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:25.447925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8dad0da5-d2e5-48b7-b8b9-ad2d4ad75092 req-525bdd2f-3358-4bf1-bd82-61589b45871a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:25.448400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8dad0da5-d2e5-48b7-b8b9-ad2d4ad75092 req-525bdd2f-3358-4bf1-bd82-61589b45871a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:25.477910 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8dad0da5-d2e5-48b7-b8b9-ad2d4ad75092 req-525bdd2f-3358-4bf1-bd82-61589b45871a service nova] Creating event network-vif-plugged:6b2f17ec-d760-478c-9b8c-8ecc8257ad7d for instance 7926ec88-423a-407b-a99e-d48cda387c93 on n-h2-844626-8 Aug 09 14:46:25.501241 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8dad0da5-d2e5-48b7-b8b9-ad2d4ad75092 req-525bdd2f-3358-4bf1-bd82-61589b45871a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081908 Aug 09 14:46:25.502668 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1749/3541] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:25.803935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f571e34d-07e7-4c9d-87f0-39ccfac63f93 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:25.822316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f571e34d-07e7-4c9d-87f0-39ccfac63f93 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:25.823960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f571e34d-07e7-4c9d-87f0-39ccfac63f93 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:25.825199 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f571e34d-07e7-4c9d-87f0-39ccfac63f93 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1752 microversion: 2.42 time: 0.747100 Aug 09 14:46:25.836874 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1793/3542] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:25 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1752 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:25.915723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e264714d-8ca0-4fcb-ae4d-e95202b5c529 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:25.916516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e264714d-8ca0-4fcb-ae4d-e95202b5c529 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:25.937513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e264714d-8ca0-4fcb-ae4d-e95202b5c529 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:25.938222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e264714d-8ca0-4fcb-ae4d-e95202b5c529 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:25.938862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e264714d-8ca0-4fcb-ae4d-e95202b5c529 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:25.939829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e264714d-8ca0-4fcb-ae4d-e95202b5c529 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:25.944318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e264714d-8ca0-4fcb-ae4d-e95202b5c529 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:25.944975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e264714d-8ca0-4fcb-ae4d-e95202b5c529 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:26.153505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e264714d-8ca0-4fcb-ae4d-e95202b5c529 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:26.182734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e264714d-8ca0-4fcb-ae4d-e95202b5c529 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:26.190631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e264714d-8ca0-4fcb-ae4d-e95202b5c529 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:26.193502 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e264714d-8ca0-4fcb-ae4d-e95202b5c529 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1336 microversion: 2.54 time: 0.282868 Aug 09 14:46:26.197681 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1750/3543] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:25 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1336 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:26.215591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c37527eb-cffa-47bc-bbcf-c0fd2fededee tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:26.216158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c37527eb-cffa-47bc-bbcf-c0fd2fededee tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:26.227620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c37527eb-cffa-47bc-bbcf-c0fd2fededee tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:26.239900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c37527eb-cffa-47bc-bbcf-c0fd2fededee tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:26.240631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c37527eb-cffa-47bc-bbcf-c0fd2fededee tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:26.241523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c37527eb-cffa-47bc-bbcf-c0fd2fededee tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:26.242140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c37527eb-cffa-47bc-bbcf-c0fd2fededee tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:26.242725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c37527eb-cffa-47bc-bbcf-c0fd2fededee tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:26.627369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c37527eb-cffa-47bc-bbcf-c0fd2fededee tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:26.631760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:26.644651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c37527eb-cffa-47bc-bbcf-c0fd2fededee tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:26.647718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c37527eb-cffa-47bc-bbcf-c0fd2fededee tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:26.650375 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c37527eb-cffa-47bc-bbcf-c0fd2fededee tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1362 microversion: 2.26 time: 0.457954 Aug 09 14:46:26.653259 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1794/3544] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:26 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:26.870962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-11d6fd5f-f186-460a-9934-7c4b5664af31 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:26.872009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-11d6fd5f-f186-460a-9934-7c4b5664af31 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:26.894274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11d6fd5f-f186-460a-9934-7c4b5664af31 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:26.894787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11d6fd5f-f186-460a-9934-7c4b5664af31 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:26.895280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11d6fd5f-f186-460a-9934-7c4b5664af31 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:26.896030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11d6fd5f-f186-460a-9934-7c4b5664af31 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:26.901497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11d6fd5f-f186-460a-9934-7c4b5664af31 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:26.902000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-11d6fd5f-f186-460a-9934-7c4b5664af31 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:27.217930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1baae830-42ee-4f0b-bc62-3546bc3a615b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:27.220566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1baae830-42ee-4f0b-bc62-3546bc3a615b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:27.245625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1baae830-42ee-4f0b-bc62-3546bc3a615b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:27.248050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1baae830-42ee-4f0b-bc62-3546bc3a615b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:27.248614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1baae830-42ee-4f0b-bc62-3546bc3a615b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:27.251317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1baae830-42ee-4f0b-bc62-3546bc3a615b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:27.251996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1baae830-42ee-4f0b-bc62-3546bc3a615b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:27.255166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1baae830-42ee-4f0b-bc62-3546bc3a615b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:27.457250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1baae830-42ee-4f0b-bc62-3546bc3a615b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:27.481377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1baae830-42ee-4f0b-bc62-3546bc3a615b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:27.486489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1baae830-42ee-4f0b-bc62-3546bc3a615b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:27.490600 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1baae830-42ee-4f0b-bc62-3546bc3a615b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1357 microversion: 2.54 time: 0.277082 Aug 09 14:46:27.491467 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1795/3545] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:27 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1357 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:27.553526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ca91b042-41ae-4d60-91c9-aa92ee839f2a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Action: 'create', calling method: .version_select at 0x7f41dd58ff70>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1942673087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkTPpp2OKL6DiMPZmDb7Nkui6ZV7f72GgtpQGo1a1sQmJzvgjKDkn2wTndTIsQKStBjSz2n+Ppv7P8duFaBY46RAh48bV9Ruv+hwOUEvOjBZFsh3NMP//4c+sXcUojvxw=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:27.570427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:27.596920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-11d6fd5f-f186-460a-9934-7c4b5664af31 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:27.608043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ca91b042-41ae-4d60-91c9-aa92ee839f2a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Getting quotas for project cd13df97b24c400ba82340468d2635cd. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:46:27.624740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-11d6fd5f-f186-460a-9934-7c4b5664af31 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:27.638128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ca91b042-41ae-4d60-91c9-aa92ee839f2a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Getting quotas for user 280c6a8b06e24528ac29a386143ff8e0 and project cd13df97b24c400ba82340468d2635cd. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:46:27.638921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-11d6fd5f-f186-460a-9934-7c4b5664af31 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:27.640392 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-11d6fd5f-f186-460a-9934-7c4b5664af31 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1798 microversion: 2.42 time: 0.779592 Aug 09 14:46:27.655760 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1751/3546] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:26 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1798 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:27.680321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d009105-15cb-4c11-8bb1-71e0a6fae6c4 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:27.681513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3d009105-15cb-4c11-8bb1-71e0a6fae6c4 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:27.689296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d009105-15cb-4c11-8bb1-71e0a6fae6c4 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:27.690119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d009105-15cb-4c11-8bb1-71e0a6fae6c4 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:27.690827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d009105-15cb-4c11-8bb1-71e0a6fae6c4 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:27.691861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d009105-15cb-4c11-8bb1-71e0a6fae6c4 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:27.692890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d009105-15cb-4c11-8bb1-71e0a6fae6c4 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:27.693952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d009105-15cb-4c11-8bb1-71e0a6fae6c4 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:27.723629 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ca91b042-41ae-4d60-91c9-aa92ee839f2a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.187129 Aug 09 14:46:27.725728 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1796/3547] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 9 14:46:27 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 192 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 14:46:27.742345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1942673087", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:27.750100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:27.771272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:27.772710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:27.773343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:27.777149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:27.785016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:27.785685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:27.940530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:46:27.942687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:46:27.943396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:46:27.946386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:46:27.947055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:46:28.123138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:28.141088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:28.143435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:28.145108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:28.147305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:28.149366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:28.149984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:28.220478 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9f8ef47e-2854-44db-979e-b16846dcde29 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "POST /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305/action" status: 202 len: 1140 microversion: 2.54 time: 0.487567 Aug 09 14:46:28.227663 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1797/3548] 10.222.0.50 () {62 vars in 1320 bytes} [Tue Aug 9 14:46:27 2022] POST /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305/action => generated 1140 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 09 14:46:28.244618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2b5d2c50-293c-4160-af9b-6a4877e4e29e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:28.246956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2b5d2c50-293c-4160-af9b-6a4877e4e29e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:28.264630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b5d2c50-293c-4160-af9b-6a4877e4e29e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:28.265488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b5d2c50-293c-4160-af9b-6a4877e4e29e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:28.266180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b5d2c50-293c-4160-af9b-6a4877e4e29e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:28.267407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b5d2c50-293c-4160-af9b-6a4877e4e29e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:28.267793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b5d2c50-293c-4160-af9b-6a4877e4e29e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:28.268214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b5d2c50-293c-4160-af9b-6a4877e4e29e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:28.465875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b5d2c50-293c-4160-af9b-6a4877e4e29e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:28.495471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b5d2c50-293c-4160-af9b-6a4877e4e29e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:28.504178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b5d2c50-293c-4160-af9b-6a4877e4e29e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:28.506983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d009105-15cb-4c11-8bb1-71e0a6fae6c4 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:28.508332 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2b5d2c50-293c-4160-af9b-6a4877e4e29e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.266495 Aug 09 14:46:28.509781 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1798/3549] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:28 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:28.517455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d009105-15cb-4c11-8bb1-71e0a6fae6c4 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:28.519385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d009105-15cb-4c11-8bb1-71e0a6fae6c4 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:28.520815 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d009105-15cb-4c11-8bb1-71e0a6fae6c4 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1545 microversion: 2.26 time: 0.845496 Aug 09 14:46:28.531631 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1752/3550] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:27 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1545 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:28.548934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dc8a1670>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:28.567959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:28.568469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:28.568936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:28.571997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:28.588708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:28.591431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:28.592378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:28.595406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:28.602531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:28.609984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:28.686698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12d6cc61-f81a-4bec-8a17-0236ed9b67fb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:28.689275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-12d6cc61-f81a-4bec-8a17-0236ed9b67fb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:28.737221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12d6cc61-f81a-4bec-8a17-0236ed9b67fb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:28.741299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12d6cc61-f81a-4bec-8a17-0236ed9b67fb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:28.742060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12d6cc61-f81a-4bec-8a17-0236ed9b67fb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:28.742824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12d6cc61-f81a-4bec-8a17-0236ed9b67fb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:28.751575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:28.751990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12d6cc61-f81a-4bec-8a17-0236ed9b67fb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:28.752574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12d6cc61-f81a-4bec-8a17-0236ed9b67fb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:28.755467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:28.755939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:28.824063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:28.825171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:28.826243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:28.918457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:28.965560 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da954c8a-c597-448b-87e2-f9bf9a4eed8c tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-1287676755" status: 201 len: 0 microversion: 2.26 time: 0.420347 Aug 09 14:46:28.966335 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1799/3551] 10.222.0.50 () {62 vars in 1380 bytes} [Tue Aug 9 14:46:28 2022] PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-1287676755 => generated 0 bytes in 423 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 09 14:46:28.983567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6bcbffb2-0d66-4079-a2ca-b98765f8d0d9 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dc8a1ee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:29.003764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bcbffb2-0d66-4079-a2ca-b98765f8d0d9 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.005259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bcbffb2-0d66-4079-a2ca-b98765f8d0d9 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.007612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bcbffb2-0d66-4079-a2ca-b98765f8d0d9 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.048099 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6bcbffb2-0d66-4079-a2ca-b98765f8d0d9 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-1287676755" status: 204 len: 0 microversion: 2.26 time: 0.074364 Aug 09 14:46:29.055255 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1800/3552] 10.222.0.50 () {60 vars in 1361 bytes} [Tue Aug 9 14:46:28 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-1287676755 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:46:29.073642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dd58fdc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:29.098142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.104623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.105245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.105687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:29.119471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.121260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.121712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.125237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.125855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.126294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.180311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.180799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.181228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.211813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:29.244744 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05e3e47c-37b4-415d-b4e8-680954b28c17 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags" status: 204 len: 0 microversion: 2.26 time: 0.187342 Aug 09 14:46:29.248290 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1801/3553] 10.222.0.50 () {60 vars in 1295 bytes} [Tue Aug 9 14:46:29 2022] DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:46:29.259593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6b5af62a-4088-4fcb-92e1-7c8a1f27d713 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dd32d9d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:29.291806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b5af62a-4088-4fcb-92e1-7c8a1f27d713 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.292424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b5af62a-4088-4fcb-92e1-7c8a1f27d713 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.292849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b5af62a-4088-4fcb-92e1-7c8a1f27d713 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.322935 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6b5af62a-4088-4fcb-92e1-7c8a1f27d713 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags" status: 200 len: 12 microversion: 2.26 time: 0.062283 Aug 09 14:46:29.325216 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1802/3554] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 9 14:46:29 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags => generated 12 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:29.342755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dc8b1550>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:29.357614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.358782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.360444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.361473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:29.375248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.377005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.377711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.379862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.380616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.381439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.452428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.453227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.455048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.474605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.475650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.476241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.512627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:29.534639 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-26e90956-741a-49d3-b683-051c8ce6fdca tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-927813908" status: 201 len: 0 microversion: 2.26 time: 0.202309 Aug 09 14:46:29.540434 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1803/3555] 10.222.0.50 () {62 vars in 1377 bytes} [Tue Aug 9 14:46:29 2022] PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-927813908 => generated 0 bytes in 208 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 09 14:46:29.796628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f45a1db3-9d9b-41b1-afbb-c727332e5b6e req-94465c10-c40a-49e3-b7ac-95f5690f1b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "tag": "e7aebd18-0445-48e5-9830-d801f5f45d18"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:29.807794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f45a1db3-9d9b-41b1-afbb-c727332e5b6e req-94465c10-c40a-49e3-b7ac-95f5690f1b2b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.808526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f45a1db3-9d9b-41b1-afbb-c727332e5b6e req-94465c10-c40a-49e3-b7ac-95f5690f1b2b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.809869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f45a1db3-9d9b-41b1-afbb-c727332e5b6e req-94465c10-c40a-49e3-b7ac-95f5690f1b2b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.823077 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f45a1db3-9d9b-41b1-afbb-c727332e5b6e req-94465c10-c40a-49e3-b7ac-95f5690f1b2b service nova] Creating event network-changed:e7aebd18-0445-48e5-9830-d801f5f45d18 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:46:29.830041 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f45a1db3-9d9b-41b1-afbb-c727332e5b6e req-94465c10-c40a-49e3-b7ac-95f5690f1b2b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289190 Aug 09 14:46:29.830041 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1804/3556] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:29.837252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0dfc8d96-038b-4d3d-9951-27aa5a68aae2 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:29.838306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0dfc8d96-038b-4d3d-9951-27aa5a68aae2 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:29.847673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dfc8d96-038b-4d3d-9951-27aa5a68aae2 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.848174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dfc8d96-038b-4d3d-9951-27aa5a68aae2 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.848916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dfc8d96-038b-4d3d-9951-27aa5a68aae2 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.849827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dfc8d96-038b-4d3d-9951-27aa5a68aae2 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:29.850365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dfc8d96-038b-4d3d-9951-27aa5a68aae2 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:29.850805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0dfc8d96-038b-4d3d-9951-27aa5a68aae2 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:29.976500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-12d6cc61-f81a-4bec-8a17-0236ed9b67fb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:29.995246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-12d6cc61-f81a-4bec-8a17-0236ed9b67fb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:29.997633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-12d6cc61-f81a-4bec-8a17-0236ed9b67fb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:29.999269 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-12d6cc61-f81a-4bec-8a17-0236ed9b67fb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1844 microversion: 2.42 time: 1.332746 Aug 09 14:46:30.025854 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1753/3557] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:28 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1844 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:30.034961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3bbd3a96-bdac-4da7-88f8-9a881d463675 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dda6a9d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:30.047888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbd3a96-bdac-4da7-88f8-9a881d463675 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:30.048665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbd3a96-bdac-4da7-88f8-9a881d463675 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:30.049358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3bbd3a96-bdac-4da7-88f8-9a881d463675 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:30.073285 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3bbd3a96-bdac-4da7-88f8-9a881d463675 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags" status: 200 len: 35 microversion: 2.26 time: 0.045122 Aug 09 14:46:30.080111 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1754/3558] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 9 14:46:30 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags => generated 35 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:30.097168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dda6a3a0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:30.116004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:30.119554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:30.120197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:30.121422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:30.124075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0dfc8d96-038b-4d3d-9951-27aa5a68aae2 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:30.137924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:30.139767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:30.140340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:30.141959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:30.142596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:30.143168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:30.149529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0dfc8d96-038b-4d3d-9951-27aa5a68aae2 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:30.151329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0dfc8d96-038b-4d3d-9951-27aa5a68aae2 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:30.152858 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0dfc8d96-038b-4d3d-9951-27aa5a68aae2 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.321872 Aug 09 14:46:30.168206 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1805/3559] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:29 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:30.194614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:30.195537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:30.196323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:30.222495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bbfff408-876b-4222-bb94-428a67e2b3ab tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:30.240531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bbfff408-876b-4222-bb94-428a67e2b3ab tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:30.242771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bbfff408-876b-4222-bb94-428a67e2b3ab tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Searching by: {'deleted': False, 'project_id': 'bb998d118cec412cb471430bdd655f7e'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:46:30.256518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbfff408-876b-4222-bb94-428a67e2b3ab tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:30.258621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:30.259338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbfff408-876b-4222-bb94-428a67e2b3ab tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:30.260774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbfff408-876b-4222-bb94-428a67e2b3ab tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:30.264946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbfff408-876b-4222-bb94-428a67e2b3ab tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:30.265715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbfff408-876b-4222-bb94-428a67e2b3ab tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:30.267766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbfff408-876b-4222-bb94-428a67e2b3ab tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:30.295709 n-d-844626-8 devstack@n-api.service[119406]: ERROR oslo.messaging._drivers.impl_rabbit [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [6b48ce44-3cfa-42b6-ae27-9c3c61fd7355] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 14:46:30.325303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-bbfff408-876b-4222-bb94-428a67e2b3ab tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:46:30.370223 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bbfff408-876b-4222-bb94-428a67e2b3ab tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 338 microversion: 2.1 time: 0.155110 Aug 09 14:46:30.371888 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1806/3560] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 14:46:30 2022] GET /compute/v2.1/servers => generated 338 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:46:30.388466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:30.395240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:30.396457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Searching by: {'deleted': False, 'project_id': 'bb998d118cec412cb471430bdd655f7e'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:46:30.404144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:30.404633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:30.405065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:30.405832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:30.406288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:30.406705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:30.439026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:30.443706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:46:30.538765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:30.552355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:30.553179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:30.553979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:31.305601 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [6b48ce44-3cfa-42b6-ae27-9c3c61fd7355] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 35334. Aug 09 14:46:31.310977 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-086a3f81-afd0-4a68-bfca-a10e2a3c3791 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-927813908" status: 204 len: 0 microversion: 2.26 time: 1.221989 Aug 09 14:46:31.311705 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1755/3561] 10.222.0.50 () {60 vars in 1361 bytes} [Tue Aug 9 14:46:30 2022] DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-927813908 => generated 0 bytes in 1224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:46:31.324651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4647e539-b741-418e-b67d-679f7cd2463f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:31.325178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4647e539-b741-418e-b67d-679f7cd2463f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:31.336869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:31.344287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4647e539-b741-418e-b67d-679f7cd2463f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:31.345180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4647e539-b741-418e-b67d-679f7cd2463f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:31.347766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4647e539-b741-418e-b67d-679f7cd2463f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:31.348750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4647e539-b741-418e-b67d-679f7cd2463f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:31.349376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4647e539-b741-418e-b67d-679f7cd2463f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:31.356000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4647e539-b741-418e-b67d-679f7cd2463f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:31.600675 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e9cf1b06-c33d-4cc9-9046-c81a6361b61c tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.217239 Aug 09 14:46:31.602157 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1807/3562] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:46:30 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:31.609503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1900d07a-b8f2-476c-a644-329a9b0db7a6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:31.613187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1900d07a-b8f2-476c-a644-329a9b0db7a6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:31.631938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1900d07a-b8f2-476c-a644-329a9b0db7a6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:31.635855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1900d07a-b8f2-476c-a644-329a9b0db7a6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:31.636651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1900d07a-b8f2-476c-a644-329a9b0db7a6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:31.637643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1900d07a-b8f2-476c-a644-329a9b0db7a6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:31.640479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1900d07a-b8f2-476c-a644-329a9b0db7a6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:31.640694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1900d07a-b8f2-476c-a644-329a9b0db7a6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:31.900527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1900d07a-b8f2-476c-a644-329a9b0db7a6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:31.913167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1900d07a-b8f2-476c-a644-329a9b0db7a6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:31.918948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1900d07a-b8f2-476c-a644-329a9b0db7a6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:31.920509 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1900d07a-b8f2-476c-a644-329a9b0db7a6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.316681 Aug 09 14:46:31.936077 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1808/3563] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:31 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:31.950832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-35d00bab-501d-463d-ae69-f2b7ac80b9b9 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dc8a1310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:31.960056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d00bab-501d-463d-ae69-f2b7ac80b9b9 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:31.960813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d00bab-501d-463d-ae69-f2b7ac80b9b9 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:31.961464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d00bab-501d-463d-ae69-f2b7ac80b9b9 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:31.971933 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-35d00bab-501d-463d-ae69-f2b7ac80b9b9 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags" status: 200 len: 12 microversion: 2.26 time: 0.033930 Aug 09 14:46:31.973192 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1809/3564] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 9 14:46:31 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags => generated 12 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:31.982795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-205f66cc-6d8d-4921-b7ac-00dbe867f7fd tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:31.987678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4647e539-b741-418e-b67d-679f7cd2463f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:31.990616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:31.993244 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-205f66cc-6d8d-4921-b7ac-00dbe867f7fd tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018756 Aug 09 14:46:31.994491 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1810/3565] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:46:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:32.000805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-493722a5-ddb8-4338-803c-f193c7a8304c req-79a79567-f48a-427b-9f25-5f5a6882dab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "tag": "e829cab8-175f-46b9-b942-fa93e4bf48bb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:32.005997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4647e539-b741-418e-b67d-679f7cd2463f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:32.012102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-493722a5-ddb8-4338-803c-f193c7a8304c req-79a79567-f48a-427b-9f25-5f5a6882dab3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.012941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-493722a5-ddb8-4338-803c-f193c7a8304c req-79a79567-f48a-427b-9f25-5f5a6882dab3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.013578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-493722a5-ddb8-4338-803c-f193c7a8304c req-79a79567-f48a-427b-9f25-5f5a6882dab3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.013848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4647e539-b741-418e-b67d-679f7cd2463f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:32.015349 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4647e539-b741-418e-b67d-679f7cd2463f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1865 microversion: 2.42 time: 0.702363 Aug 09 14:46:32.019689 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1756/3566] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:31 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1865 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:32.027309 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-493722a5-ddb8-4338-803c-f193c7a8304c req-79a79567-f48a-427b-9f25-5f5a6882dab3 service nova] Creating event network-changed:e829cab8-175f-46b9-b942-fa93e4bf48bb for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:46:32.032960 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-493722a5-ddb8-4338-803c-f193c7a8304c req-79a79567-f48a-427b-9f25-5f5a6882dab3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037017 Aug 09 14:46:32.034535 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1811/3567] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:32.038499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41ddaaeb80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:32.047966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:32.061223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.063629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.065746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.067714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:32.080528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.081544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.082215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.084158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.084899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.085557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.124904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.125773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.126437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.169003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:32.231209 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-64f25a71-bfec-4cc7-921e-33b0e2296699 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags" status: 204 len: 0 microversion: 2.26 time: 0.208642 Aug 09 14:46:32.240605 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1757/3568] 10.222.0.50 () {60 vars in 1295 bytes} [Tue Aug 9 14:46:32 2022] DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:46:32.245921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dc92b0d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:32.262609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.263204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.263547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.264123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:32.285520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.286416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.286931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.288224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.288838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.291453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.349243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5f29fa82-99b5-445e-8399-78959d66db3d tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:32.349822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5f29fa82-99b5-445e-8399-78959d66db3d tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:32.354532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.358537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.359647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.364590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f29fa82-99b5-445e-8399-78959d66db3d tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.367044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f29fa82-99b5-445e-8399-78959d66db3d tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.368607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f29fa82-99b5-445e-8399-78959d66db3d tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.372259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f29fa82-99b5-445e-8399-78959d66db3d tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.373539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f29fa82-99b5-445e-8399-78959d66db3d tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.375363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f29fa82-99b5-445e-8399-78959d66db3d tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.383382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.383880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.384319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.432836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5f29fa82-99b5-445e-8399-78959d66db3d tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:46:32.438764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:32.471398 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e1c3d029-6f29-43ba-b008-955f1b502f76 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-733002152" status: 201 len: 0 microversion: 2.26 time: 0.228781 Aug 09 14:46:32.474068 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1812/3569] 10.222.0.50 () {62 vars in 1377 bytes} [Tue Aug 9 14:46:32 2022] PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-733002152 => generated 0 bytes in 233 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 09 14:46:32.487679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dcbdbf70>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:32.501692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:32.529062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.548031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.548654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.552667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:32.554045 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5f29fa82-99b5-445e-8399-78959d66db3d tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "DELETE /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 204 len: 0 microversion: 2.1 time: 0.208248 Aug 09 14:46:32.555783 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1758/3570] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:46:32 2022] DELETE /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:46:32.569220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.570089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.571066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.572836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.573290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c07bdce-77b8-4b4d-ae44-74a163f8d7e6 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:32.574370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2c07bdce-77b8-4b4d-ae44-74a163f8d7e6 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:32.575170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.575796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.585201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c07bdce-77b8-4b4d-ae44-74a163f8d7e6 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.585763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c07bdce-77b8-4b4d-ae44-74a163f8d7e6 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.586275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c07bdce-77b8-4b4d-ae44-74a163f8d7e6 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.587789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c07bdce-77b8-4b4d-ae44-74a163f8d7e6 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.588331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c07bdce-77b8-4b4d-ae44-74a163f8d7e6 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.589009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c07bdce-77b8-4b4d-ae44-74a163f8d7e6 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.607543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.608958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.609636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.621015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.622035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.622717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.649697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:32.670152 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-10c18b07-d6d7-4efb-9a3c-03e49b212558 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-1050342859" status: 201 len: 0 microversion: 2.26 time: 0.190704 Aug 09 14:46:32.671711 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1813/3571] 10.222.0.50 () {62 vars in 1380 bytes} [Tue Aug 9 14:46:32 2022] PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-1050342859 => generated 0 bytes in 193 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 09 14:46:32.682111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dc92b700>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:32.692589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.693801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.694462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.695378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:32.703012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.704225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.705061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.707146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.707867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.708561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.734970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.735492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.735922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.757856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:32.786758 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5bd2d8ab-9ee1-4efd-9427-33d8ffcb60c7 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags" status: 204 len: 0 microversion: 2.26 time: 0.109278 Aug 09 14:46:32.795851 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1814/3572] 10.222.0.50 () {60 vars in 1295 bytes} [Tue Aug 9 14:46:32 2022] DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 09 14:46:32.804776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-11c7e917-b164-45b8-a104-adb5ed05eb58 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dc8a11f0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:32.823109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11c7e917-b164-45b8-a104-adb5ed05eb58 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.825120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11c7e917-b164-45b8-a104-adb5ed05eb58 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.825821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11c7e917-b164-45b8-a104-adb5ed05eb58 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.840169 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-11c7e917-b164-45b8-a104-adb5ed05eb58 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags" status: 200 len: 12 microversion: 2.26 time: 0.039222 Aug 09 14:46:32.841538 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1815/3573] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 9 14:46:32 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:46:32.861950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dc92e940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:32.873073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.875118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.875919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.876837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:32.886310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.886995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.887573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.888427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.888991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.890485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.924356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:32.925304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:32.926228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:32.945579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:32.977987 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-db6e3d60-96d5-4ba3-a42a-b0c778d17e91 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags" status: 204 len: 0 microversion: 2.26 time: 0.126765 Aug 09 14:46:32.979580 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1816/3574] 10.222.0.50 () {60 vars in 1295 bytes} [Tue Aug 9 14:46:32 2022] DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:46:32.990359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cab5bbec-79ab-4a13-aa02-06753c21ed11 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:32.991343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cab5bbec-79ab-4a13-aa02-06753c21ed11 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:33.000463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab5bbec-79ab-4a13-aa02-06753c21ed11 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.001146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab5bbec-79ab-4a13-aa02-06753c21ed11 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.001736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab5bbec-79ab-4a13-aa02-06753c21ed11 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.002551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab5bbec-79ab-4a13-aa02-06753c21ed11 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.003136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab5bbec-79ab-4a13-aa02-06753c21ed11 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.004387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab5bbec-79ab-4a13-aa02-06753c21ed11 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.181124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2c07bdce-77b8-4b4d-ae44-74a163f8d7e6 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:33.197055 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2c07bdce-77b8-4b4d-ae44-74a163f8d7e6 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1714 microversion: 2.1 time: 0.635365 Aug 09 14:46:33.201586 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1759/3575] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:32 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1714 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:33.207684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cab5bbec-79ab-4a13-aa02-06753c21ed11 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:33.218914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dda09790>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:33.224121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cab5bbec-79ab-4a13-aa02-06753c21ed11 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:33.226467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cab5bbec-79ab-4a13-aa02-06753c21ed11 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:33.228025 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cab5bbec-79ab-4a13-aa02-06753c21ed11 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.246957 Aug 09 14:46:33.230551 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1817/3576] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:32 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:33.233503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.234352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.234964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.235654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:33.242741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.243837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-131c1734-057b-41f5-b94d-c783e0993cd2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:33.244066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.244663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-131c1734-057b-41f5-b94d-c783e0993cd2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:33.244985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.245835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.246669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.247402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.262794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131c1734-057b-41f5-b94d-c783e0993cd2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.263369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131c1734-057b-41f5-b94d-c783e0993cd2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.263812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131c1734-057b-41f5-b94d-c783e0993cd2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.264617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131c1734-057b-41f5-b94d-c783e0993cd2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.265340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131c1734-057b-41f5-b94d-c783e0993cd2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.265924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131c1734-057b-41f5-b94d-c783e0993cd2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.305238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.305773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.306212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.339484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.340463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.341070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.387840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:33.411741 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f623d0fe-5574-48c5-bdde-b6768c13bede tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-1293161001" status: 201 len: 0 microversion: 2.26 time: 0.208151 Aug 09 14:46:33.415252 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1760/3577] 10.222.0.50 () {62 vars in 1380 bytes} [Tue Aug 9 14:46:33 2022] PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-1293161001 => generated 0 bytes in 212 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 09 14:46:33.430311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dda77160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:33.443751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.444799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.445445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.446448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:33.454141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.455273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.455877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.457297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.459504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.465174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.538612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.539138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.539599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.556128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.556613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.557047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.586601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:33.605338 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4c026248-61d3-4f99-9045-51afa5afdf38 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-570614128" status: 201 len: 0 microversion: 2.26 time: 0.185276 Aug 09 14:46:33.606489 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1761/3578] 10.222.0.50 () {62 vars in 1377 bytes} [Tue Aug 9 14:46:33 2022] PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags/tempest-tag-570614128 => generated 0 bytes in 187 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 09 14:46:33.633451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Action: 'update_all', calling method: .version_select at 0x7f41dda5c790>, body: {"tags": ["tempest-tag-939791733", "tempest-tag-576146134"]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:33.649378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.649789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.650241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.650720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:33.657306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.657906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.658459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.659731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.660273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.660761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.693168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.693690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.694136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.718410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:33.739772 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-261a56f3-cd94-48cc-81f4-f29442250f81 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags" status: 200 len: 60 microversion: 2.26 time: 0.110985 Aug 09 14:46:33.740791 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1762/3579] 10.222.0.50 () {62 vars in 1312 bytes} [Tue Aug 9 14:46:33 2022] PUT /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags => generated 60 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:33.754777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b04ae56e-90c0-4068-b464-07f10cb12383 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41ddaaed30>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:33.785029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04ae56e-90c0-4068-b464-07f10cb12383 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.785357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04ae56e-90c0-4068-b464-07f10cb12383 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.785965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b04ae56e-90c0-4068-b464-07f10cb12383 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.801046 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b04ae56e-90c0-4068-b464-07f10cb12383 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags" status: 200 len: 60 microversion: 2.26 time: 0.053157 Aug 09 14:46:33.804725 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1763/3580] 10.222.0.50 () {60 vars in 1292 bytes} [Tue Aug 9 14:46:33 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags => generated 60 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:33.833451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '.version_select at 0x7f41dd9e0160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:33.846605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.847156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.847857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.848071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:33.855599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.856126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.856633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.857343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.857842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.858364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.884559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.885075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.885507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.903388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'flavor' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:33.930602 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2dd7a94e-7d49-4bf8-af09-cbae11b5343b tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags" status: 204 len: 0 microversion: 2.26 time: 0.119113 Aug 09 14:46:33.932292 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1764/3581] 10.222.0.50 () {60 vars in 1295 bytes} [Tue Aug 9 14:46:33 2022] DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:46:33.948575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1805aee6-3532-4e27-897d-316f73a7a450 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:33.949688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1805aee6-3532-4e27-897d-316f73a7a450 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:33.969316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1805aee6-3532-4e27-897d-316f73a7a450 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.970955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1805aee6-3532-4e27-897d-316f73a7a450 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.972834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1805aee6-3532-4e27-897d-316f73a7a450 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:33.975281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1805aee6-3532-4e27-897d-316f73a7a450 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:33.976935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1805aee6-3532-4e27-897d-316f73a7a450 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:33.978334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1805aee6-3532-4e27-897d-316f73a7a450 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:34.040270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1805aee6-3532-4e27-897d-316f73a7a450 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:46:34.208424 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1805aee6-3532-4e27-897d-316f73a7a450 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 204 len: 0 microversion: 2.26 time: 0.268585 Aug 09 14:46:34.209725 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1765/3582] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:46:33 2022] DELETE /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:46:34.226918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-df90727c-7838-465c-aad4-c7c690cc9fc1 req-9e627f55-47e3-4367-a286-9da5d821d8cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "tag": "5bcb9340-d16d-4086-bbb3-c3282b5f4b53"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:34.253637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-df90727c-7838-465c-aad4-c7c690cc9fc1 req-9e627f55-47e3-4367-a286-9da5d821d8cb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:34.253637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-df90727c-7838-465c-aad4-c7c690cc9fc1 req-9e627f55-47e3-4367-a286-9da5d821d8cb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:34.253637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-df90727c-7838-465c-aad4-c7c690cc9fc1 req-9e627f55-47e3-4367-a286-9da5d821d8cb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:34.263603 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-df90727c-7838-465c-aad4-c7c690cc9fc1 req-9e627f55-47e3-4367-a286-9da5d821d8cb service nova] Creating event network-changed:5bcb9340-d16d-4086-bbb3-c3282b5f4b53 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:46:34.270735 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-df90727c-7838-465c-aad4-c7c690cc9fc1 req-9e627f55-47e3-4367-a286-9da5d821d8cb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057833 Aug 09 14:46:34.272912 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1766/3583] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:34.279764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33257c1b-77ae-4dfd-91bf-0583df8a9257 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:34.280476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-33257c1b-77ae-4dfd-91bf-0583df8a9257 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:34.293712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33257c1b-77ae-4dfd-91bf-0583df8a9257 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:34.294581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33257c1b-77ae-4dfd-91bf-0583df8a9257 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:34.295292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33257c1b-77ae-4dfd-91bf-0583df8a9257 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:34.296297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33257c1b-77ae-4dfd-91bf-0583df8a9257 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:34.297420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33257c1b-77ae-4dfd-91bf-0583df8a9257 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:34.300647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33257c1b-77ae-4dfd-91bf-0583df8a9257 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:34.542657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-131c1734-057b-41f5-b94d-c783e0993cd2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:34.553313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-131c1734-057b-41f5-b94d-c783e0993cd2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:34.555253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-131c1734-057b-41f5-b94d-c783e0993cd2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:34.556704 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-131c1734-057b-41f5-b94d-c783e0993cd2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1886 microversion: 2.42 time: 1.324896 Aug 09 14:46:34.557516 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1818/3584] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:33 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1886 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:34.562428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-719f0a9a-d63f-45b4-9329-978a9b2d4cca tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:34.563389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-719f0a9a-d63f-45b4-9329-978a9b2d4cca tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:34.569712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-719f0a9a-d63f-45b4-9329-978a9b2d4cca tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:34.570455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-719f0a9a-d63f-45b4-9329-978a9b2d4cca tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:34.571139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-719f0a9a-d63f-45b4-9329-978a9b2d4cca tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:34.572086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-719f0a9a-d63f-45b4-9329-978a9b2d4cca tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:34.572775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-719f0a9a-d63f-45b4-9329-978a9b2d4cca tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:34.573415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-719f0a9a-d63f-45b4-9329-978a9b2d4cca tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:35.022800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-33257c1b-77ae-4dfd-91bf-0583df8a9257 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:35.032821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-33257c1b-77ae-4dfd-91bf-0583df8a9257 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:35.034736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-33257c1b-77ae-4dfd-91bf-0583df8a9257 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:35.044488 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-33257c1b-77ae-4dfd-91bf-0583df8a9257 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1551 microversion: 2.26 time: 0.770006 Aug 09 14:46:35.045574 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1767/3585] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:34 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1551 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:35.063803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b2a5b95-3e39-4d34-a3d2-3b2bda21cf3d tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:35.064458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b2a5b95-3e39-4d34-a3d2-3b2bda21cf3d tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:35.075328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b2a5b95-3e39-4d34-a3d2-3b2bda21cf3d tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:35.075825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b2a5b95-3e39-4d34-a3d2-3b2bda21cf3d tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:35.076261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b2a5b95-3e39-4d34-a3d2-3b2bda21cf3d tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:35.076974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b2a5b95-3e39-4d34-a3d2-3b2bda21cf3d tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:35.077424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b2a5b95-3e39-4d34-a3d2-3b2bda21cf3d tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:35.078098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b2a5b95-3e39-4d34-a3d2-3b2bda21cf3d tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:35.090153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-719f0a9a-d63f-45b4-9329-978a9b2d4cca tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:35.099790 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-719f0a9a-d63f-45b4-9329-978a9b2d4cca tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1714 microversion: 2.1 time: 0.540987 Aug 09 14:46:35.117116 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1819/3586] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:34 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1714 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:35.211224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b2a5b95-3e39-4d34-a3d2-3b2bda21cf3d tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:35.221911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b2a5b95-3e39-4d34-a3d2-3b2bda21cf3d tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:35.223656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b2a5b95-3e39-4d34-a3d2-3b2bda21cf3d tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:35.224856 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b2a5b95-3e39-4d34-a3d2-3b2bda21cf3d tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.168338 Aug 09 14:46:35.235262 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1768/3587] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:35 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:35.588049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63584db6-4a4d-4e7d-998e-f2073f21f2e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:35.589397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-63584db6-4a4d-4e7d-998e-f2073f21f2e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:35.604858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63584db6-4a4d-4e7d-998e-f2073f21f2e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:35.607242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63584db6-4a4d-4e7d-998e-f2073f21f2e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:35.607876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63584db6-4a4d-4e7d-998e-f2073f21f2e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:35.611658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63584db6-4a4d-4e7d-998e-f2073f21f2e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:35.612365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63584db6-4a4d-4e7d-998e-f2073f21f2e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:35.613048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63584db6-4a4d-4e7d-998e-f2073f21f2e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:36.072823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36ea3806-ec94-4e7b-820c-758e12f0a028 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:36.074262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-36ea3806-ec94-4e7b-820c-758e12f0a028 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:36.085847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36ea3806-ec94-4e7b-820c-758e12f0a028 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:36.086695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36ea3806-ec94-4e7b-820c-758e12f0a028 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:36.087451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36ea3806-ec94-4e7b-820c-758e12f0a028 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:36.088443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36ea3806-ec94-4e7b-820c-758e12f0a028 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:36.089160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36ea3806-ec94-4e7b-820c-758e12f0a028 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:36.090820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36ea3806-ec94-4e7b-820c-758e12f0a028 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:36.120724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:36.313682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-63584db6-4a4d-4e7d-998e-f2073f21f2e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:36.332113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-63584db6-4a4d-4e7d-998e-f2073f21f2e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:36.338333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-63584db6-4a4d-4e7d-998e-f2073f21f2e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:36.342591 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63584db6-4a4d-4e7d-998e-f2073f21f2e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1886 microversion: 2.42 time: 0.757599 Aug 09 14:46:36.356971 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1820/3588] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:35 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1886 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:36.414033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a17b103-8eb1-4f15-8457-3ee3fcc1fa6f tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:36.418020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a17b103-8eb1-4f15-8457-3ee3fcc1fa6f tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:36.445485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a17b103-8eb1-4f15-8457-3ee3fcc1fa6f tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:36.446285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a17b103-8eb1-4f15-8457-3ee3fcc1fa6f tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:36.447028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a17b103-8eb1-4f15-8457-3ee3fcc1fa6f tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:36.448373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a17b103-8eb1-4f15-8457-3ee3fcc1fa6f tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:36.449043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a17b103-8eb1-4f15-8457-3ee3fcc1fa6f tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:36.456148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a17b103-8eb1-4f15-8457-3ee3fcc1fa6f tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:36.475031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:36.586474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3a17b103-8eb1-4f15-8457-3ee3fcc1fa6f tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:36.600455 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a17b103-8eb1-4f15-8457-3ee3fcc1fa6f tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1646 microversion: 2.1 time: 0.241920 Aug 09 14:46:36.601571 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1821/3589] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:36 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1646 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:36.606889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-51bc54d3-ca2b-4789-b0c0-f1c39ccc76d1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:36.607529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-51bc54d3-ca2b-4789-b0c0-f1c39ccc76d1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:36.623102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51bc54d3-ca2b-4789-b0c0-f1c39ccc76d1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:36.623591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51bc54d3-ca2b-4789-b0c0-f1c39ccc76d1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:36.624017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51bc54d3-ca2b-4789-b0c0-f1c39ccc76d1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:36.624771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51bc54d3-ca2b-4789-b0c0-f1c39ccc76d1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:36.625254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51bc54d3-ca2b-4789-b0c0-f1c39ccc76d1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:36.625615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51bc54d3-ca2b-4789-b0c0-f1c39ccc76d1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:36.718680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-36ea3806-ec94-4e7b-820c-758e12f0a028 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:36.733809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-36ea3806-ec94-4e7b-820c-758e12f0a028 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:36.735630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-36ea3806-ec94-4e7b-820c-758e12f0a028 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:36.738383 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36ea3806-ec94-4e7b-820c-758e12f0a028 tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1551 microversion: 2.26 time: 0.669186 Aug 09 14:46:36.787388 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1769/3590] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:36 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1551 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:36.793550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-21cbb419-de1b-4842-8fdf-c43d7d6f72ef req-9dd4e515-0782-45fc-b9e1-1c3d5482f821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "tag": "e630072b-3881-4138-9288-6963597d3178"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:36.807574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-21cbb419-de1b-4842-8fdf-c43d7d6f72ef req-9dd4e515-0782-45fc-b9e1-1c3d5482f821 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:36.808091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-21cbb419-de1b-4842-8fdf-c43d7d6f72ef req-9dd4e515-0782-45fc-b9e1-1c3d5482f821 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:36.809102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-21cbb419-de1b-4842-8fdf-c43d7d6f72ef req-9dd4e515-0782-45fc-b9e1-1c3d5482f821 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:36.843588 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-21cbb419-de1b-4842-8fdf-c43d7d6f72ef req-9dd4e515-0782-45fc-b9e1-1c3d5482f821 service nova] Creating event network-changed:e630072b-3881-4138-9288-6963597d3178 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:46:36.865344 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-21cbb419-de1b-4842-8fdf-c43d7d6f72ef req-9dd4e515-0782-45fc-b9e1-1c3d5482f821 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072877 Aug 09 14:46:36.867442 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1770/3591] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:37.312777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-51bc54d3-ca2b-4789-b0c0-f1c39ccc76d1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:37.326648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-51bc54d3-ca2b-4789-b0c0-f1c39ccc76d1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:37.329980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-51bc54d3-ca2b-4789-b0c0-f1c39ccc76d1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:37.334325 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-51bc54d3-ca2b-4789-b0c0-f1c39ccc76d1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.729211 Aug 09 14:46:37.336461 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1822/3592] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:36 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:37.373957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa6da5a9-9a57-4338-992a-92f6f4589f6b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:37.383263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa6da5a9-9a57-4338-992a-92f6f4589f6b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:37.386925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-3defece6-38c0-4071-ab5b-b30ee5c4ed10 req-386f1cc2-4c5d-40f0-b96f-1146d8919f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e99b44-1a79-447e-bf30-01f5960687e3", "name": "network-vif-deleted", "tag": "36ea3e78-3624-4828-923b-7aa0969c0afd"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:37.408122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa6da5a9-9a57-4338-992a-92f6f4589f6b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:37.409365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa6da5a9-9a57-4338-992a-92f6f4589f6b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:37.410028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa6da5a9-9a57-4338-992a-92f6f4589f6b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:37.414369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3defece6-38c0-4071-ab5b-b30ee5c4ed10 req-386f1cc2-4c5d-40f0-b96f-1146d8919f54 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:37.415559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa6da5a9-9a57-4338-992a-92f6f4589f6b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:37.416271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa6da5a9-9a57-4338-992a-92f6f4589f6b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:37.417057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa6da5a9-9a57-4338-992a-92f6f4589f6b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:37.424172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3defece6-38c0-4071-ab5b-b30ee5c4ed10 req-386f1cc2-4c5d-40f0-b96f-1146d8919f54 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:37.424872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3defece6-38c0-4071-ab5b-b30ee5c4ed10 req-386f1cc2-4c5d-40f0-b96f-1146d8919f54 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:37.475872 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3defece6-38c0-4071-ab5b-b30ee5c4ed10 req-386f1cc2-4c5d-40f0-b96f-1146d8919f54 service nova] Creating event network-vif-deleted:36ea3e78-3624-4828-923b-7aa0969c0afd for instance 30e99b44-1a79-447e-bf30-01f5960687e3 on n-h1-844626-8 Aug 09 14:46:37.491673 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-3defece6-38c0-4071-ab5b-b30ee5c4ed10 req-386f1cc2-4c5d-40f0-b96f-1146d8919f54 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127815 Aug 09 14:46:37.509725 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1771/3593] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:37.624858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:37.630211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:37.652670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:37.653790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:37.660172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:37.661189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:37.665717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:37.667802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:37.763578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:37.763578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:37.763578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:37.763578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lazy-loading 'fault' on Instance uuid 30e99b44-1a79-447e-bf30-01f5960687e3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:38.069331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1e57d09b58946aea5a18043522462e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb998d118cec412cb471430bdd655f7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:38.086537 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-78af1056-1bc4-4695-bb6e-977456e135e5 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 200 len: 1366 microversion: 2.1 time: 0.463529 Aug 09 14:46:38.087613 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1772/3594] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:37 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 1366 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:46:38.106339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:38.121362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:38.147632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:38.152296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:38.156240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:38.157893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:38.159047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:38.165701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:38.263747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:38.264540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:38.275810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:38.277085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lazy-loading 'fault' on Instance uuid 7926ec88-423a-407b-a99e-d48cda387c93 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:46:39.117447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:39.130798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fa6da5a9-9a57-4338-992a-92f6f4589f6b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:39.145474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:39.146631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fa6da5a9-9a57-4338-992a-92f6f4589f6b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:39.148528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bf5faa9df9147e8ad0d7dfd68112672', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f25cb25344492fa158ce40e09ab8c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:39.151944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fa6da5a9-9a57-4338-992a-92f6f4589f6b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:39.154634 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa6da5a9-9a57-4338-992a-92f6f4589f6b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1886 microversion: 2.42 time: 1.787339 Aug 09 14:46:39.155447 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b893e21-9876-4715-9897-7e3648e231af tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 200 len: 1352 microversion: 2.26 time: 1.062845 Aug 09 14:46:39.158077 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1773/3595] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:38 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 1352 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:39.164086 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1823/3596] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:37 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1886 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:39.169181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-c2169f6c-8ae3-4176-8b37-feb5dcbd2479 req-ee621353-9c44-4d92-938b-d61219989269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "tag": "bef1c2ab-48c1-4197-be01-418d835b0f52"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:39.170789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-05aaea13-7f51-4b56-b9b9-e9850a34943e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:39.171783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-05aaea13-7f51-4b56-b9b9-e9850a34943e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:39.188326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05aaea13-7f51-4b56-b9b9-e9850a34943e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:39.189258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05aaea13-7f51-4b56-b9b9-e9850a34943e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:39.190197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05aaea13-7f51-4b56-b9b9-e9850a34943e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:39.192211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c2169f6c-8ae3-4176-8b37-feb5dcbd2479 req-ee621353-9c44-4d92-938b-d61219989269 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:39.193241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05aaea13-7f51-4b56-b9b9-e9850a34943e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:39.193887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05aaea13-7f51-4b56-b9b9-e9850a34943e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:39.194517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05aaea13-7f51-4b56-b9b9-e9850a34943e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:39.198607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c2169f6c-8ae3-4176-8b37-feb5dcbd2479 req-ee621353-9c44-4d92-938b-d61219989269 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:39.199423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c2169f6c-8ae3-4176-8b37-feb5dcbd2479 req-ee621353-9c44-4d92-938b-d61219989269 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:39.230259 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-c2169f6c-8ae3-4176-8b37-feb5dcbd2479 req-ee621353-9c44-4d92-938b-d61219989269 service nova] Creating event network-changed:bef1c2ab-48c1-4197-be01-418d835b0f52 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:46:39.238723 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-c2169f6c-8ae3-4176-8b37-feb5dcbd2479 req-ee621353-9c44-4d92-938b-d61219989269 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072992 Aug 09 14:46:39.243793 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1824/3597] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:39.254837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6df2dea1-b4c5-401c-8c6a-5bcf4220d085 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:39.262283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6df2dea1-b4c5-401c-8c6a-5bcf4220d085 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] [instance: 30e99b44-1a79-447e-bf30-01f5960687e3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:39.271351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df2dea1-b4c5-401c-8c6a-5bcf4220d085 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:39.272226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df2dea1-b4c5-401c-8c6a-5bcf4220d085 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:39.273228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df2dea1-b4c5-401c-8c6a-5bcf4220d085 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:39.274280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df2dea1-b4c5-401c-8c6a-5bcf4220d085 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:39.274922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df2dea1-b4c5-401c-8c6a-5bcf4220d085 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:39.275549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df2dea1-b4c5-401c-8c6a-5bcf4220d085 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:39.294745 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-6df2dea1-b4c5-401c-8c6a-5bcf4220d085 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] HTTP exception thrown: Instance 30e99b44-1a79-447e-bf30-01f5960687e3 could not be found. Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6df2dea1-b4c5-401c-8c6a-5bcf4220d085 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Request method failure captured: Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 HTTP/1.1 Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nL7haPW3VRPbj_bkWspvUT9MmFj9oLpNYdP8g2imnInsnmdkAbZpZjHul4xYl5_NjZAmTqe1i76iMPgI3644sPufUtIYNEyFcLiVONyZNdOgg3Owfxt-TqxXno1qBqJJR011_NVkAjOieNfIMoLudKdPrltIlYCdSaTyiMlYN8Sv5s Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: bb998d118cec412cb471430bdd655f7e Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestManualDisk-1711251250 Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_bb998d118cec412cb471430bdd655f7e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/bb998d118cec412cb471430bdd655f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bb998d118cec412cb471430bdd655f7e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/bb998d118cec412cb471430bdd655f7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestManualDisk-1711251250 Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: bb998d118cec412cb471430bdd655f7e Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestManualDisk-1711251250 Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestManualDisk-1711251250-project Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e1e57d09b58946aea5a18043522462e3 Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestManualDisk-1711251250-project Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 30e99b44-1a79-447e-bf30-01f5960687e3 could not be found. Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '30e99b44-1a79-447e-bf30-01f5960687e3'} Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e99b44-1a79-447e-bf30-01f5960687e3 could not be found. Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e99b44-1a79-447e-bf30-01f5960687e3 could not be found. Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:39.296864 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:39.302265 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:39.302265 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:39.302265 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:39.302265 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:39.302265 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:39.302265 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e99b44-1a79-447e-bf30-01f5960687e3 could not be found. Aug 09 14:46:39.302265 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:39.304052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6df2dea1-b4c5-401c-8c6a-5bcf4220d085 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Returning 404 to user: Instance 30e99b44-1a79-447e-bf30-01f5960687e3 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:39.305120 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6df2dea1-b4c5-401c-8c6a-5bcf4220d085 tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3" status: 404 len: 111 microversion: 2.1 time: 0.059929 Aug 09 14:46:39.305897 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1825/3598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:46:39 2022] GET /compute/v2.1/servers/30e99b44-1a79-447e-bf30-01f5960687e3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:46:39.318304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da0efad9-64d7-483a-9afd-c42235ca595e tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] Calling method '.version_select at 0x7f41dc81e310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:39.341691 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da0efad9-64d7-483a-9afd-c42235ca595e tempest-ServersTestManualDisk-1711251250 tempest-ServersTestManualDisk-1711251250-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858260550" status: 202 len: 0 microversion: 2.1 time: 0.027288 Aug 09 14:46:39.343055 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1826/3599] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 14:46:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1858260550 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:46:39.431919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-05aaea13-7f51-4b56-b9b9-e9850a34943e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:39.445156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-05aaea13-7f51-4b56-b9b9-e9850a34943e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:39.447442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-05aaea13-7f51-4b56-b9b9-e9850a34943e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:39.449305 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-05aaea13-7f51-4b56-b9b9-e9850a34943e tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.289462 Aug 09 14:46:39.450560 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1774/3600] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:39 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:39.560464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-86d7c112-83a0-401b-b76d-5135b10c529f req-ac27f218-ceca-4501-a883-7ae8a3cda16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7926ec88-423a-407b-a99e-d48cda387c93", "name": "network-vif-deleted", "tag": "6b2f17ec-d760-478c-9b8c-8ecc8257ad7d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:39.578095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-86d7c112-83a0-401b-b76d-5135b10c529f req-ac27f218-ceca-4501-a883-7ae8a3cda16a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:39.578575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-86d7c112-83a0-401b-b76d-5135b10c529f req-ac27f218-ceca-4501-a883-7ae8a3cda16a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:39.584089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-86d7c112-83a0-401b-b76d-5135b10c529f req-ac27f218-ceca-4501-a883-7ae8a3cda16a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:39.610496 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-86d7c112-83a0-401b-b76d-5135b10c529f req-ac27f218-ceca-4501-a883-7ae8a3cda16a service nova] Creating event network-vif-deleted:6b2f17ec-d760-478c-9b8c-8ecc8257ad7d for instance 7926ec88-423a-407b-a99e-d48cda387c93 on n-h2-844626-8 Aug 09 14:46:39.619965 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-86d7c112-83a0-401b-b76d-5135b10c529f req-ac27f218-ceca-4501-a883-7ae8a3cda16a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060782 Aug 09 14:46:39.623943 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1827/3601] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:40.191483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a2b822ec-3c61-4219-b89b-68c789fb1a16 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:40.194462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a2b822ec-3c61-4219-b89b-68c789fb1a16 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:40.195725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc33cdf4-c86a-493f-8d42-f6a5ddd18c3f tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:40.198579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fc33cdf4-c86a-493f-8d42-f6a5ddd18c3f tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] [instance: 7926ec88-423a-407b-a99e-d48cda387c93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:40.212955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2b822ec-3c61-4219-b89b-68c789fb1a16 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:40.214419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2b822ec-3c61-4219-b89b-68c789fb1a16 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:40.217446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc33cdf4-c86a-493f-8d42-f6a5ddd18c3f tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:40.218083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2b822ec-3c61-4219-b89b-68c789fb1a16 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:40.218945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2b822ec-3c61-4219-b89b-68c789fb1a16 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:40.219765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2b822ec-3c61-4219-b89b-68c789fb1a16 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:40.220198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a2b822ec-3c61-4219-b89b-68c789fb1a16 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:40.220839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc33cdf4-c86a-493f-8d42-f6a5ddd18c3f tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:40.222435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc33cdf4-c86a-493f-8d42-f6a5ddd18c3f tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:40.227187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc33cdf4-c86a-493f-8d42-f6a5ddd18c3f tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:40.228009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc33cdf4-c86a-493f-8d42-f6a5ddd18c3f tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:40.230636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc33cdf4-c86a-493f-8d42-f6a5ddd18c3f tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:40.295583 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-fc33cdf4-c86a-493f-8d42-f6a5ddd18c3f tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] HTTP exception thrown: Instance 7926ec88-423a-407b-a99e-d48cda387c93 could not be found. Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc33cdf4-c86a-493f-8d42-f6a5ddd18c3f tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Request method failure captured: Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 HTTP/1.1 Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nMsW7ht_tr7pqBa9GLjlnYZJikWKnX5XeEhyVjGr3sIycqLogfOVZc_UaIiHpTbRGpxOzL7valbKPpqWvUQJ5kFm8VXJM5Wkd8juVpZqUwbUNvdjjRHmbxWKqwF_gYqHrmPnh-8ipJidAYSCqqR2SWcv5FCeJE7qByu_Bp--oAfPZA Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.26 Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 12f25cb25344492fa158ce40e09ab8c2 Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerTagsTestJSON-186673887 Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_12f25cb25344492fa158ce40e09ab8c2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/12f25cb25344492fa158ce40e09ab8c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12f25cb25344492fa158ce40e09ab8c2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/12f25cb25344492fa158ce40e09ab8c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerTagsTestJSON-186673887 Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 12f25cb25344492fa158ce40e09ab8c2 Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerTagsTestJSON-186673887 Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerTagsTestJSON-186673887-project Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 0bf5faa9df9147e8ad0d7dfd68112672 Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerTagsTestJSON-186673887-project Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 7926ec88-423a-407b-a99e-d48cda387c93 could not be found. Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '7926ec88-423a-407b-a99e-d48cda387c93'} Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7926ec88-423a-407b-a99e-d48cda387c93 could not be found. Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7926ec88-423a-407b-a99e-d48cda387c93 could not be found. Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:46:40.305969 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:40.315211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:46:40.315211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:46:40.315211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:46:40.315211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:46:40.315211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:46:40.315211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7926ec88-423a-407b-a99e-d48cda387c93 could not be found. Aug 09 14:46:40.315211 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:46:40.318985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc33cdf4-c86a-493f-8d42-f6a5ddd18c3f tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] Returning 404 to user: Instance 7926ec88-423a-407b-a99e-d48cda387c93 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:46:40.324010 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc33cdf4-c86a-493f-8d42-f6a5ddd18c3f tempest-ServerTagsTestJSON-186673887 tempest-ServerTagsTestJSON-186673887-project] 10.222.0.50 "GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93" status: 404 len: 111 microversion: 2.26 time: 0.142414 Aug 09 14:46:40.329479 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1828/3602] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:40 2022] GET /compute/v2.1/servers/7926ec88-423a-407b-a99e-d48cda387c93 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:46:40.473847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eadf8f61-b982-4762-b7e8-d97291d0f46c tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:40.475078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eadf8f61-b982-4762-b7e8-d97291d0f46c tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:40.483604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:40.486154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:40.488294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eadf8f61-b982-4762-b7e8-d97291d0f46c tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:40.489166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eadf8f61-b982-4762-b7e8-d97291d0f46c tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:40.489834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eadf8f61-b982-4762-b7e8-d97291d0f46c tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:40.490953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eadf8f61-b982-4762-b7e8-d97291d0f46c tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:40.491930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eadf8f61-b982-4762-b7e8-d97291d0f46c tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:40.495111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eadf8f61-b982-4762-b7e8-d97291d0f46c tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:40.532147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:40.713679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eadf8f61-b982-4762-b7e8-d97291d0f46c tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:40.725072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eadf8f61-b982-4762-b7e8-d97291d0f46c tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:40.726635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eadf8f61-b982-4762-b7e8-d97291d0f46c tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:40.731368 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eadf8f61-b982-4762-b7e8-d97291d0f46c tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.262171 Aug 09 14:46:40.734218 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1829/3603] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:40 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:40.908911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a2b822ec-3c61-4219-b89b-68c789fb1a16 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:40.918855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a2b822ec-3c61-4219-b89b-68c789fb1a16 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:40.929807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a2b822ec-3c61-4219-b89b-68c789fb1a16 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:40.931487 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a2b822ec-3c61-4219-b89b-68c789fb1a16 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.754484 Aug 09 14:46:40.947475 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1775/3604] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:40 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:41.763895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d008651b-b564-4090-a414-b782d4f0f6e9 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:41.765432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d008651b-b564-4090-a414-b782d4f0f6e9 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:41.775473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d008651b-b564-4090-a414-b782d4f0f6e9 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:41.776394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d008651b-b564-4090-a414-b782d4f0f6e9 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:41.777095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d008651b-b564-4090-a414-b782d4f0f6e9 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:41.778147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d008651b-b564-4090-a414-b782d4f0f6e9 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:41.778945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d008651b-b564-4090-a414-b782d4f0f6e9 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:41.779590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d008651b-b564-4090-a414-b782d4f0f6e9 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:41.947151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d008651b-b564-4090-a414-b782d4f0f6e9 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:41.958042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d008651b-b564-4090-a414-b782d4f0f6e9 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:41.960998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-46af9fbe-5501-42f2-895c-b97cae500a63 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:41.961561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d008651b-b564-4090-a414-b782d4f0f6e9 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:41.962267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-46af9fbe-5501-42f2-895c-b97cae500a63 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:41.965470 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d008651b-b564-4090-a414-b782d4f0f6e9 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.205760 Aug 09 14:46:41.982530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46af9fbe-5501-42f2-895c-b97cae500a63 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:41.983600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46af9fbe-5501-42f2-895c-b97cae500a63 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:41.984275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46af9fbe-5501-42f2-895c-b97cae500a63 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:41.984435 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1830/3605] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:41 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:41.985463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46af9fbe-5501-42f2-895c-b97cae500a63 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:41.986193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46af9fbe-5501-42f2-895c-b97cae500a63 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:41.987228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46af9fbe-5501-42f2-895c-b97cae500a63 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:42.163419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-799ba28c-bf0b-4a1b-bcdd-9e5d7b2c8c8d req-880a5168-79f1-46b9-99b2-6a13a1bfdee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "tag": "57a05dd9-1f79-490b-9377-d421d6b2c674"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:42.184042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-799ba28c-bf0b-4a1b-bcdd-9e5d7b2c8c8d req-880a5168-79f1-46b9-99b2-6a13a1bfdee1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:42.187431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-799ba28c-bf0b-4a1b-bcdd-9e5d7b2c8c8d req-880a5168-79f1-46b9-99b2-6a13a1bfdee1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:42.189027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-799ba28c-bf0b-4a1b-bcdd-9e5d7b2c8c8d req-880a5168-79f1-46b9-99b2-6a13a1bfdee1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:42.485463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46af9fbe-5501-42f2-895c-b97cae500a63 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:42.496371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46af9fbe-5501-42f2-895c-b97cae500a63 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:42.503640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46af9fbe-5501-42f2-895c-b97cae500a63 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:42.508482 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-46af9fbe-5501-42f2-895c-b97cae500a63 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.551265 Aug 09 14:46:42.512659 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1776/3606] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:41 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:42.656196 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-799ba28c-bf0b-4a1b-bcdd-9e5d7b2c8c8d req-880a5168-79f1-46b9-99b2-6a13a1bfdee1 service nova] Creating event network-changed:57a05dd9-1f79-490b-9377-d421d6b2c674 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:46:42.662020 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-799ba28c-bf0b-4a1b-bcdd-9e5d7b2c8c8d req-880a5168-79f1-46b9-99b2-6a13a1bfdee1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.505858 Aug 09 14:46:42.663230 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1831/3607] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:42.995786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c005531-9e68-4707-ae0d-4a2e9e44bcc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:42.996392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c005531-9e68-4707-ae0d-4a2e9e44bcc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:43.008140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c005531-9e68-4707-ae0d-4a2e9e44bcc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:43.010407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c005531-9e68-4707-ae0d-4a2e9e44bcc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:43.011343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c005531-9e68-4707-ae0d-4a2e9e44bcc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:43.012600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c005531-9e68-4707-ae0d-4a2e9e44bcc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:43.013305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c005531-9e68-4707-ae0d-4a2e9e44bcc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:43.013999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c005531-9e68-4707-ae0d-4a2e9e44bcc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:43.199757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c005531-9e68-4707-ae0d-4a2e9e44bcc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:43.215185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c005531-9e68-4707-ae0d-4a2e9e44bcc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:43.217544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c005531-9e68-4707-ae0d-4a2e9e44bcc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:43.222985 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c005531-9e68-4707-ae0d-4a2e9e44bcc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.232798 Aug 09 14:46:43.237593 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1777/3608] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:42 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:43.538393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f409c872-71c6-4ba2-a6e0-672eba1a6d95 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:43.539055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f409c872-71c6-4ba2-a6e0-672eba1a6d95 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:43.545856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f409c872-71c6-4ba2-a6e0-672eba1a6d95 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:43.546427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f409c872-71c6-4ba2-a6e0-672eba1a6d95 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:43.547127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f409c872-71c6-4ba2-a6e0-672eba1a6d95 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:43.548125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f409c872-71c6-4ba2-a6e0-672eba1a6d95 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:43.548822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f409c872-71c6-4ba2-a6e0-672eba1a6d95 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:43.549495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f409c872-71c6-4ba2-a6e0-672eba1a6d95 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:44.252069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-410ceaaf-3c6b-48df-aafe-5ccd1cd8aca5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:44.253816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-410ceaaf-3c6b-48df-aafe-5ccd1cd8aca5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:44.262576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f409c872-71c6-4ba2-a6e0-672eba1a6d95 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:44.264422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-410ceaaf-3c6b-48df-aafe-5ccd1cd8aca5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:44.265946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-410ceaaf-3c6b-48df-aafe-5ccd1cd8aca5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:44.266628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-410ceaaf-3c6b-48df-aafe-5ccd1cd8aca5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:44.271326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-410ceaaf-3c6b-48df-aafe-5ccd1cd8aca5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:44.272147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-410ceaaf-3c6b-48df-aafe-5ccd1cd8aca5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:44.273342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-410ceaaf-3c6b-48df-aafe-5ccd1cd8aca5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:44.293690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f409c872-71c6-4ba2-a6e0-672eba1a6d95 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:44.296273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f409c872-71c6-4ba2-a6e0-672eba1a6d95 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:44.299511 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f409c872-71c6-4ba2-a6e0-672eba1a6d95 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.766773 Aug 09 14:46:44.303561 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1832/3609] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:43 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:44.504016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-410ceaaf-3c6b-48df-aafe-5ccd1cd8aca5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:44.523531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-410ceaaf-3c6b-48df-aafe-5ccd1cd8aca5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:44.529486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-410ceaaf-3c6b-48df-aafe-5ccd1cd8aca5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:44.532247 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-410ceaaf-3c6b-48df-aafe-5ccd1cd8aca5 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.285113 Aug 09 14:46:44.536166 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1778/3610] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:44 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:45.273832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-57019ecf-2687-401c-99be-38afc2b6605d req-17179d55-36a4-417f-9675-4d59a1f03cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "tag": "b584a69e-d71b-4c4f-80e9-ed537e73ff17"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:45.294670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-57019ecf-2687-401c-99be-38afc2b6605d req-17179d55-36a4-417f-9675-4d59a1f03cd2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:45.312513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-57019ecf-2687-401c-99be-38afc2b6605d req-17179d55-36a4-417f-9675-4d59a1f03cd2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:45.316270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-57019ecf-2687-401c-99be-38afc2b6605d req-17179d55-36a4-417f-9675-4d59a1f03cd2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:45.328320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dafbba92-2927-4cd7-90d0-10fe526ea6aa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:45.328958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dafbba92-2927-4cd7-90d0-10fe526ea6aa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:45.344783 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-57019ecf-2687-401c-99be-38afc2b6605d req-17179d55-36a4-417f-9675-4d59a1f03cd2 service nova] Creating event network-changed:b584a69e-d71b-4c4f-80e9-ed537e73ff17 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:46:45.344955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dafbba92-2927-4cd7-90d0-10fe526ea6aa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:45.345599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dafbba92-2927-4cd7-90d0-10fe526ea6aa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:45.349537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dafbba92-2927-4cd7-90d0-10fe526ea6aa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:45.350928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dafbba92-2927-4cd7-90d0-10fe526ea6aa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:45.351458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dafbba92-2927-4cd7-90d0-10fe526ea6aa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:45.351898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dafbba92-2927-4cd7-90d0-10fe526ea6aa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:45.352802 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-57019ecf-2687-401c-99be-38afc2b6605d req-17179d55-36a4-417f-9675-4d59a1f03cd2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082328 Aug 09 14:46:45.354291 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1833/3611] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:45.564266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-393d3000-3c3b-4519-83bd-a5403383b180 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:45.565531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-393d3000-3c3b-4519-83bd-a5403383b180 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:45.578124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-393d3000-3c3b-4519-83bd-a5403383b180 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:45.579019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-393d3000-3c3b-4519-83bd-a5403383b180 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:45.579699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-393d3000-3c3b-4519-83bd-a5403383b180 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:45.581907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-393d3000-3c3b-4519-83bd-a5403383b180 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:45.583212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-393d3000-3c3b-4519-83bd-a5403383b180 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:45.585012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-393d3000-3c3b-4519-83bd-a5403383b180 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:45.719495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-393d3000-3c3b-4519-83bd-a5403383b180 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:45.733716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-393d3000-3c3b-4519-83bd-a5403383b180 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:45.735834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-393d3000-3c3b-4519-83bd-a5403383b180 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:45.737589 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-393d3000-3c3b-4519-83bd-a5403383b180 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.179033 Aug 09 14:46:45.751907 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1834/3612] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:45 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:45.806461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dafbba92-2927-4cd7-90d0-10fe526ea6aa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:45.817104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dafbba92-2927-4cd7-90d0-10fe526ea6aa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:45.818692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dafbba92-2927-4cd7-90d0-10fe526ea6aa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:45.819979 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dafbba92-2927-4cd7-90d0-10fe526ea6aa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.497746 Aug 09 14:46:45.820547 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1779/3613] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:45 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:46.766170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-20c7e1ca-9bb4-4c9e-bc8b-6120701fcd62 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:46.768085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-20c7e1ca-9bb4-4c9e-bc8b-6120701fcd62 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:46.781787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20c7e1ca-9bb4-4c9e-bc8b-6120701fcd62 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:46.786827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20c7e1ca-9bb4-4c9e-bc8b-6120701fcd62 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:46.791193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20c7e1ca-9bb4-4c9e-bc8b-6120701fcd62 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:46.792826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20c7e1ca-9bb4-4c9e-bc8b-6120701fcd62 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:46.794374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20c7e1ca-9bb4-4c9e-bc8b-6120701fcd62 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:46.795044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20c7e1ca-9bb4-4c9e-bc8b-6120701fcd62 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:46.853520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-491d80a3-c1b9-4c32-96dc-727c89d8e78e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:46.863728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-491d80a3-c1b9-4c32-96dc-727c89d8e78e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:46.871376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-491d80a3-c1b9-4c32-96dc-727c89d8e78e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:46.872235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-491d80a3-c1b9-4c32-96dc-727c89d8e78e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:46.872899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-491d80a3-c1b9-4c32-96dc-727c89d8e78e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:46.874193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-491d80a3-c1b9-4c32-96dc-727c89d8e78e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:46.875004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-491d80a3-c1b9-4c32-96dc-727c89d8e78e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:46.875691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-491d80a3-c1b9-4c32-96dc-727c89d8e78e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:47.050175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-20c7e1ca-9bb4-4c9e-bc8b-6120701fcd62 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:47.065709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-20c7e1ca-9bb4-4c9e-bc8b-6120701fcd62 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:47.076189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-20c7e1ca-9bb4-4c9e-bc8b-6120701fcd62 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:47.077666 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-20c7e1ca-9bb4-4c9e-bc8b-6120701fcd62 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.316993 Aug 09 14:46:47.092134 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1835/3614] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:46 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:47.373194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-491d80a3-c1b9-4c32-96dc-727c89d8e78e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:47.383996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-491d80a3-c1b9-4c32-96dc-727c89d8e78e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:47.386096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-491d80a3-c1b9-4c32-96dc-727c89d8e78e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:47.392973 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-491d80a3-c1b9-4c32-96dc-727c89d8e78e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.539826 Aug 09 14:46:47.413942 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1780/3615] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:46 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:48.106528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-caf39a0b-bc3d-42a2-ac14-8386e90de6ee tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:48.108094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-caf39a0b-bc3d-42a2-ac14-8386e90de6ee tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:48.130522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caf39a0b-bc3d-42a2-ac14-8386e90de6ee tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:48.134858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caf39a0b-bc3d-42a2-ac14-8386e90de6ee tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:48.138810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caf39a0b-bc3d-42a2-ac14-8386e90de6ee tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:48.139610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caf39a0b-bc3d-42a2-ac14-8386e90de6ee tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:48.148686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caf39a0b-bc3d-42a2-ac14-8386e90de6ee tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:48.149388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-caf39a0b-bc3d-42a2-ac14-8386e90de6ee tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:48.418583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44ccd61f-9ff9-42bd-81ab-fc8bc01a26bc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:48.419840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44ccd61f-9ff9-42bd-81ab-fc8bc01a26bc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:48.431223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44ccd61f-9ff9-42bd-81ab-fc8bc01a26bc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:48.431708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44ccd61f-9ff9-42bd-81ab-fc8bc01a26bc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:48.432135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44ccd61f-9ff9-42bd-81ab-fc8bc01a26bc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:48.437020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44ccd61f-9ff9-42bd-81ab-fc8bc01a26bc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:48.441731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44ccd61f-9ff9-42bd-81ab-fc8bc01a26bc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:48.442462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44ccd61f-9ff9-42bd-81ab-fc8bc01a26bc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:48.448649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-caf39a0b-bc3d-42a2-ac14-8386e90de6ee tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:48.463057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-caf39a0b-bc3d-42a2-ac14-8386e90de6ee tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:48.465433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-caf39a0b-bc3d-42a2-ac14-8386e90de6ee tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:48.467423 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-caf39a0b-bc3d-42a2-ac14-8386e90de6ee tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.365352 Aug 09 14:46:48.472928 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1836/3616] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:48 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:49.021957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-44ccd61f-9ff9-42bd-81ab-fc8bc01a26bc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:49.050875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-44ccd61f-9ff9-42bd-81ab-fc8bc01a26bc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:49.058178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-44ccd61f-9ff9-42bd-81ab-fc8bc01a26bc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:49.067726 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44ccd61f-9ff9-42bd-81ab-fc8bc01a26bc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.644881 Aug 09 14:46:49.068394 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1781/3617] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:48 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:49.498390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-be642b69-8c17-46cc-907c-d90f2c21c016 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:49.499032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-be642b69-8c17-46cc-907c-d90f2c21c016 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:49.520883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be642b69-8c17-46cc-907c-d90f2c21c016 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:49.523369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be642b69-8c17-46cc-907c-d90f2c21c016 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:49.523827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be642b69-8c17-46cc-907c-d90f2c21c016 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:49.530754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be642b69-8c17-46cc-907c-d90f2c21c016 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:49.535584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be642b69-8c17-46cc-907c-d90f2c21c016 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:49.539601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be642b69-8c17-46cc-907c-d90f2c21c016 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:49.857868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-be642b69-8c17-46cc-907c-d90f2c21c016 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:49.872126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-be642b69-8c17-46cc-907c-d90f2c21c016 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:49.873656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-be642b69-8c17-46cc-907c-d90f2c21c016 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:49.874915 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-be642b69-8c17-46cc-907c-d90f2c21c016 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.382162 Aug 09 14:46:49.890168 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1837/3618] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:49 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:50.095875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a8ba73e-c5ff-47f5-ae1b-f20ecf6f4d71 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:50.096479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a8ba73e-c5ff-47f5-ae1b-f20ecf6f4d71 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:50.113352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a8ba73e-c5ff-47f5-ae1b-f20ecf6f4d71 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:50.114203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a8ba73e-c5ff-47f5-ae1b-f20ecf6f4d71 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:50.114797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a8ba73e-c5ff-47f5-ae1b-f20ecf6f4d71 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:50.115872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a8ba73e-c5ff-47f5-ae1b-f20ecf6f4d71 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:50.116526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a8ba73e-c5ff-47f5-ae1b-f20ecf6f4d71 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:50.117565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a8ba73e-c5ff-47f5-ae1b-f20ecf6f4d71 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:50.830123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1a8ba73e-c5ff-47f5-ae1b-f20ecf6f4d71 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:50.840597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1a8ba73e-c5ff-47f5-ae1b-f20ecf6f4d71 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:50.852857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1a8ba73e-c5ff-47f5-ae1b-f20ecf6f4d71 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:50.854281 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a8ba73e-c5ff-47f5-ae1b-f20ecf6f4d71 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.763497 Aug 09 14:46:50.854998 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1782/3619] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:50 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:50.899265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bb5a6c21-55a1-4295-bbe9-12c12855da30 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:50.899873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bb5a6c21-55a1-4295-bbe9-12c12855da30 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:50.916329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb5a6c21-55a1-4295-bbe9-12c12855da30 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:50.916822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb5a6c21-55a1-4295-bbe9-12c12855da30 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:50.917253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb5a6c21-55a1-4295-bbe9-12c12855da30 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:50.917967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb5a6c21-55a1-4295-bbe9-12c12855da30 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:50.918431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb5a6c21-55a1-4295-bbe9-12c12855da30 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:50.918829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb5a6c21-55a1-4295-bbe9-12c12855da30 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:51.322705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bb5a6c21-55a1-4295-bbe9-12c12855da30 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:51.332755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bb5a6c21-55a1-4295-bbe9-12c12855da30 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:51.334773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bb5a6c21-55a1-4295-bbe9-12c12855da30 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:51.336341 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bb5a6c21-55a1-4295-bbe9-12c12855da30 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.441181 Aug 09 14:46:51.351325 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1838/3620] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:50 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:51.880788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d5bad696-047b-4c16-ba63-3292bd933dbd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:51.882020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d5bad696-047b-4c16-ba63-3292bd933dbd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:51.897018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5bad696-047b-4c16-ba63-3292bd933dbd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:51.897826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5bad696-047b-4c16-ba63-3292bd933dbd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:51.898433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5bad696-047b-4c16-ba63-3292bd933dbd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:51.899360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5bad696-047b-4c16-ba63-3292bd933dbd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:51.899982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5bad696-047b-4c16-ba63-3292bd933dbd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:51.900589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5bad696-047b-4c16-ba63-3292bd933dbd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:52.363698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efbc6b90-ff11-4102-9e92-2117e6df713b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:52.366792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-efbc6b90-ff11-4102-9e92-2117e6df713b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:52.379599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efbc6b90-ff11-4102-9e92-2117e6df713b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:52.380314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efbc6b90-ff11-4102-9e92-2117e6df713b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:52.380935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efbc6b90-ff11-4102-9e92-2117e6df713b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:52.385176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efbc6b90-ff11-4102-9e92-2117e6df713b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:52.385889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efbc6b90-ff11-4102-9e92-2117e6df713b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:52.386488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efbc6b90-ff11-4102-9e92-2117e6df713b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:52.603610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-efbc6b90-ff11-4102-9e92-2117e6df713b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:52.613184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-efbc6b90-ff11-4102-9e92-2117e6df713b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:52.615603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-efbc6b90-ff11-4102-9e92-2117e6df713b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:52.616776 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-efbc6b90-ff11-4102-9e92-2117e6df713b tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.258084 Aug 09 14:46:52.627371 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1839/3621] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:52 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:53.311682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d5bad696-047b-4c16-ba63-3292bd933dbd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:53.336200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d5bad696-047b-4c16-ba63-3292bd933dbd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:53.343341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d5bad696-047b-4c16-ba63-3292bd933dbd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:53.354061 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d5bad696-047b-4c16-ba63-3292bd933dbd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.477929 Aug 09 14:46:53.356299 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1783/3622] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:51 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:53.644553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-04a67145-a173-48a6-922e-e8d02394b176 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:53.645178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-04a67145-a173-48a6-922e-e8d02394b176 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:53.663772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04a67145-a173-48a6-922e-e8d02394b176 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:53.664005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04a67145-a173-48a6-922e-e8d02394b176 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:53.664339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04a67145-a173-48a6-922e-e8d02394b176 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:53.665115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04a67145-a173-48a6-922e-e8d02394b176 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:53.665607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04a67145-a173-48a6-922e-e8d02394b176 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:53.666015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04a67145-a173-48a6-922e-e8d02394b176 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:53.874882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-04a67145-a173-48a6-922e-e8d02394b176 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:53.886959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-04a67145-a173-48a6-922e-e8d02394b176 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:53.892719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-04a67145-a173-48a6-922e-e8d02394b176 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:53.894223 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-04a67145-a173-48a6-922e-e8d02394b176 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.254066 Aug 09 14:46:53.894959 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1840/3623] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:53 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:54.378937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6df7e793-c8f5-4c44-8ae0-71d9ec391b4c tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:54.380009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6df7e793-c8f5-4c44-8ae0-71d9ec391b4c tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:54.391137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7e793-c8f5-4c44-8ae0-71d9ec391b4c tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:54.396846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7e793-c8f5-4c44-8ae0-71d9ec391b4c tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:54.397497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7e793-c8f5-4c44-8ae0-71d9ec391b4c tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:54.398422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7e793-c8f5-4c44-8ae0-71d9ec391b4c tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:54.399035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7e793-c8f5-4c44-8ae0-71d9ec391b4c tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:54.399639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df7e793-c8f5-4c44-8ae0-71d9ec391b4c tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:54.628342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a154be43-a2d6-4cea-b17e-ce21b222b249 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Action: 'create', calling method: .version_select at 0x7f41dda65b80>, body: {"keypair": {"name": "tempest-keypair-1005722400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTA06NQ2a9uLJ6aehLG1+RnkAl2e4JvT9uzxg4EWHHoH1n8urM2Bvs4k1WSdZI81lAQjmLav6J3o2QAs1U8QWKf0YDtiBw6Pzx13XeLcxeNdP9QJr0l7v8dMsnWTanbKQ=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:46:54.695174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-a154be43-a2d6-4cea-b17e-ce21b222b249 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Getting quotas for project 159f7d3784934b59ac35dd1adb06886e. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:46:54.709789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-a154be43-a2d6-4cea-b17e-ce21b222b249 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Getting quotas for user c84d23aa3a7b485690191a9d84386946 and project 159f7d3784934b59ac35dd1adb06886e. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:46:54.745323 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a154be43-a2d6-4cea-b17e-ce21b222b249 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.417439 Aug 09 14:46:54.753032 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1784/3624] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:46:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:46:54.925860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c031870b-4b24-42af-bc9b-a465588a8562 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:54.927455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c031870b-4b24-42af-bc9b-a465588a8562 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:54.950383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c031870b-4b24-42af-bc9b-a465588a8562 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:54.951660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c031870b-4b24-42af-bc9b-a465588a8562 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:54.952716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c031870b-4b24-42af-bc9b-a465588a8562 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:54.955042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c031870b-4b24-42af-bc9b-a465588a8562 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:54.957542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c031870b-4b24-42af-bc9b-a465588a8562 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:54.960152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c031870b-4b24-42af-bc9b-a465588a8562 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:55.060384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6df7e793-c8f5-4c44-8ae0-71d9ec391b4c tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:55.079471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6df7e793-c8f5-4c44-8ae0-71d9ec391b4c tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:55.084620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6df7e793-c8f5-4c44-8ae0-71d9ec391b4c tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:55.087026 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6df7e793-c8f5-4c44-8ae0-71d9ec391b4c tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.713094 Aug 09 14:46:55.090257 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1841/3625] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:54 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:55.166525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c031870b-4b24-42af-bc9b-a465588a8562 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:55.185113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c031870b-4b24-42af-bc9b-a465588a8562 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:55.187054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c031870b-4b24-42af-bc9b-a465588a8562 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:55.188327 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c031870b-4b24-42af-bc9b-a465588a8562 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1409 microversion: 2.54 time: 0.269658 Aug 09 14:46:55.200867 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1785/3626] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:54 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1409 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:56.113282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8100aa75-5293-4a97-8edb-51f49380e052 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:56.113863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8100aa75-5293-4a97-8edb-51f49380e052 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:56.121851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8100aa75-5293-4a97-8edb-51f49380e052 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:56.122610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8100aa75-5293-4a97-8edb-51f49380e052 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:56.123280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8100aa75-5293-4a97-8edb-51f49380e052 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:56.124276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8100aa75-5293-4a97-8edb-51f49380e052 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:56.124998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8100aa75-5293-4a97-8edb-51f49380e052 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:56.125575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8100aa75-5293-4a97-8edb-51f49380e052 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:56.215553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55bd5309-9915-4260-89ba-ef0c01bb7cc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:56.216345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55bd5309-9915-4260-89ba-ef0c01bb7cc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:56.235399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55bd5309-9915-4260-89ba-ef0c01bb7cc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:56.240836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55bd5309-9915-4260-89ba-ef0c01bb7cc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:56.242114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55bd5309-9915-4260-89ba-ef0c01bb7cc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:56.245297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55bd5309-9915-4260-89ba-ef0c01bb7cc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:56.248038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55bd5309-9915-4260-89ba-ef0c01bb7cc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:56.249297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55bd5309-9915-4260-89ba-ef0c01bb7cc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:56.437657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-55bd5309-9915-4260-89ba-ef0c01bb7cc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:56.456514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-55bd5309-9915-4260-89ba-ef0c01bb7cc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:56.468158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-55bd5309-9915-4260-89ba-ef0c01bb7cc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:56.469880 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-55bd5309-9915-4260-89ba-ef0c01bb7cc4 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1415 microversion: 2.54 time: 0.259962 Aug 09 14:46:56.482726 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1786/3627] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:56 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1415 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:46:57.328650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8100aa75-5293-4a97-8edb-51f49380e052 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:57.339642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8100aa75-5293-4a97-8edb-51f49380e052 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:57.341501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8100aa75-5293-4a97-8edb-51f49380e052 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:57.342951 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8100aa75-5293-4a97-8edb-51f49380e052 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.234914 Aug 09 14:46:57.344770 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1842/3628] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:56 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:57.505967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7df9d9f9-8900-4c63-8612-ebba05dafee6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:57.506588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7df9d9f9-8900-4c63-8612-ebba05dafee6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:57.521519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7df9d9f9-8900-4c63-8612-ebba05dafee6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:57.522089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7df9d9f9-8900-4c63-8612-ebba05dafee6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:57.523238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7df9d9f9-8900-4c63-8612-ebba05dafee6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:57.524674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7df9d9f9-8900-4c63-8612-ebba05dafee6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:57.525367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7df9d9f9-8900-4c63-8612-ebba05dafee6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:57.526891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7df9d9f9-8900-4c63-8612-ebba05dafee6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:57.729471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7df9d9f9-8900-4c63-8612-ebba05dafee6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:57.756138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:57.763936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7df9d9f9-8900-4c63-8612-ebba05dafee6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:57.766277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7df9d9f9-8900-4c63-8612-ebba05dafee6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:57.768707 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7df9d9f9-8900-4c63-8612-ebba05dafee6 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1415 microversion: 2.54 time: 0.266843 Aug 09 14:46:57.798267 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1787/3629] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:57 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1415 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:58.366088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7925d988-3782-42bb-a194-2f8d23063d15 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:58.366749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7925d988-3782-42bb-a194-2f8d23063d15 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:58.373837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7925d988-3782-42bb-a194-2f8d23063d15 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:58.374335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7925d988-3782-42bb-a194-2f8d23063d15 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:58.374773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7925d988-3782-42bb-a194-2f8d23063d15 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:58.375527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7925d988-3782-42bb-a194-2f8d23063d15 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:58.375980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7925d988-3782-42bb-a194-2f8d23063d15 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:58.376409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7925d988-3782-42bb-a194-2f8d23063d15 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:58.381997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:58.735024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7925d988-3782-42bb-a194-2f8d23063d15 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:58.744746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7925d988-3782-42bb-a194-2f8d23063d15 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:58.746163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7925d988-3782-42bb-a194-2f8d23063d15 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:58.747954 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7925d988-3782-42bb-a194-2f8d23063d15 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.385853 Aug 09 14:46:58.759478 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1843/3630] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:58 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:58.799390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3da27101-d77c-4f0b-9087-cfb1cf35495a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:58.800953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3da27101-d77c-4f0b-9087-cfb1cf35495a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:58.804581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:46:58.820706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3da27101-d77c-4f0b-9087-cfb1cf35495a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:58.822845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3da27101-d77c-4f0b-9087-cfb1cf35495a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:58.836046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3da27101-d77c-4f0b-9087-cfb1cf35495a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:58.837235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3da27101-d77c-4f0b-9087-cfb1cf35495a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:58.838030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3da27101-d77c-4f0b-9087-cfb1cf35495a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:58.839115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3da27101-d77c-4f0b-9087-cfb1cf35495a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:59.081607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3da27101-d77c-4f0b-9087-cfb1cf35495a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:59.114541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3da27101-d77c-4f0b-9087-cfb1cf35495a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:59.115953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3da27101-d77c-4f0b-9087-cfb1cf35495a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:59.120048 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3da27101-d77c-4f0b-9087-cfb1cf35495a tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1400 microversion: 2.54 time: 0.326764 Aug 09 14:46:59.136317 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1788/3631] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:58 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1400 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:46:59.147561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a5546f49-e96b-4a0a-9b78-b9b68f1c9e93 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '.version_select at 0x7f41dd58fe50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:59.178315 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a5546f49-e96b-4a0a-9b78-b9b68f1c9e93 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1942673087" status: 204 len: 0 microversion: 2.54 time: 0.033548 Aug 09 14:46:59.179586 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1844/3632] 10.222.0.50 () {60 vars in 1319 bytes} [Tue Aug 9 14:46:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1942673087 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:46:59.191316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1401fb3f-1475-4b10-9777-5ad6498134a1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:59.192180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1401fb3f-1475-4b10-9777-5ad6498134a1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:59.201539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1401fb3f-1475-4b10-9777-5ad6498134a1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:59.210130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1401fb3f-1475-4b10-9777-5ad6498134a1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:59.211001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1401fb3f-1475-4b10-9777-5ad6498134a1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:59.213194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1401fb3f-1475-4b10-9777-5ad6498134a1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:59.213898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1401fb3f-1475-4b10-9777-5ad6498134a1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:59.214343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1401fb3f-1475-4b10-9777-5ad6498134a1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:59.288731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1401fb3f-1475-4b10-9777-5ad6498134a1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:46:59.419318 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1401fb3f-1475-4b10-9777-5ad6498134a1 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 204 len: 0 microversion: 2.54 time: 0.232128 Aug 09 14:46:59.420604 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1789/3633] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:46:59 2022] DELETE /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:46:59.429790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-39ada4ef-3cf7-4e44-8125-142eea99a3f7 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:59.430670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-39ada4ef-3cf7-4e44-8125-142eea99a3f7 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:59.441299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39ada4ef-3cf7-4e44-8125-142eea99a3f7 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:59.442032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39ada4ef-3cf7-4e44-8125-142eea99a3f7 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:59.444168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39ada4ef-3cf7-4e44-8125-142eea99a3f7 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:59.446366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39ada4ef-3cf7-4e44-8125-142eea99a3f7 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:59.447042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39ada4ef-3cf7-4e44-8125-142eea99a3f7 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:59.447868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39ada4ef-3cf7-4e44-8125-142eea99a3f7 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:59.780047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67d4b1df-055c-4787-b7f6-55f16a347834 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:46:59.781109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-67d4b1df-055c-4787-b7f6-55f16a347834 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:46:59.812827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67d4b1df-055c-4787-b7f6-55f16a347834 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:59.813491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67d4b1df-055c-4787-b7f6-55f16a347834 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:59.814657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67d4b1df-055c-4787-b7f6-55f16a347834 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:59.816908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67d4b1df-055c-4787-b7f6-55f16a347834 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:46:59.817475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67d4b1df-055c-4787-b7f6-55f16a347834 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:46:59.819639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67d4b1df-055c-4787-b7f6-55f16a347834 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:46:59.955246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-39ada4ef-3cf7-4e44-8125-142eea99a3f7 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:59.972705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-39ada4ef-3cf7-4e44-8125-142eea99a3f7 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:59.976317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-39ada4ef-3cf7-4e44-8125-142eea99a3f7 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:46:59.981512 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-39ada4ef-3cf7-4e44-8125-142eea99a3f7 tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1406 microversion: 2.54 time: 0.556507 Aug 09 14:46:59.982114 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1845/3634] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:59 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1406 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:47:00.452834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-67d4b1df-055c-4787-b7f6-55f16a347834 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:00.464638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-67d4b1df-055c-4787-b7f6-55f16a347834 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:00.482731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-67d4b1df-055c-4787-b7f6-55f16a347834 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:00.484751 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-67d4b1df-055c-4787-b7f6-55f16a347834 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.713740 Aug 09 14:47:00.488327 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1790/3635] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:46:59 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:47:01.006498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-921d78d3-8c1a-455c-b487-062060a026fe tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:01.007294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-921d78d3-8c1a-455c-b487-062060a026fe tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:01.026099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-921d78d3-8c1a-455c-b487-062060a026fe tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:01.026599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-921d78d3-8c1a-455c-b487-062060a026fe tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:01.031756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-921d78d3-8c1a-455c-b487-062060a026fe tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:01.035842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-921d78d3-8c1a-455c-b487-062060a026fe tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:01.038124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-921d78d3-8c1a-455c-b487-062060a026fe tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:01.040843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-921d78d3-8c1a-455c-b487-062060a026fe tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:01.343367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-921d78d3-8c1a-455c-b487-062060a026fe tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:01.355243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-173837350", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:01.372029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-921d78d3-8c1a-455c-b487-062060a026fe tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:01.381797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-921d78d3-8c1a-455c-b487-062060a026fe tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:01.385116 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-921d78d3-8c1a-455c-b487-062060a026fe tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1406 microversion: 2.54 time: 0.383588 Aug 09 14:47:01.387828 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1791/3636] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:01 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1406 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:47:01.509847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] validate_networks() for [('583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:47:01.512182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a7199dc-70db-4cfd-844a-95c09d13fd7b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:01.513094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a7199dc-70db-4cfd-844a-95c09d13fd7b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:01.525168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a7199dc-70db-4cfd-844a-95c09d13fd7b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:01.526074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a7199dc-70db-4cfd-844a-95c09d13fd7b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:01.527443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a7199dc-70db-4cfd-844a-95c09d13fd7b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:01.530512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a7199dc-70db-4cfd-844a-95c09d13fd7b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:01.531346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a7199dc-70db-4cfd-844a-95c09d13fd7b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:01.532351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a7199dc-70db-4cfd-844a-95c09d13fd7b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:02.433969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a7199dc-70db-4cfd-844a-95c09d13fd7b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:02.444861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a7199dc-70db-4cfd-844a-95c09d13fd7b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:02.457196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a7199dc-70db-4cfd-844a-95c09d13fd7b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:02.458769 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a7199dc-70db-4cfd-844a-95c09d13fd7b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.952205 Aug 09 14:47:02.459569 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1792/3637] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:01 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:47:02.464491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-424005ee-3a41-4532-98d7-e7db7af4e98f tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:02.471962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-424005ee-3a41-4532-98d7-e7db7af4e98f tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:02.482380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-424005ee-3a41-4532-98d7-e7db7af4e98f tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:02.482871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-424005ee-3a41-4532-98d7-e7db7af4e98f tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:02.483372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-424005ee-3a41-4532-98d7-e7db7af4e98f tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:02.484072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-424005ee-3a41-4532-98d7-e7db7af4e98f tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:02.484517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-424005ee-3a41-4532-98d7-e7db7af4e98f tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:02.484932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-424005ee-3a41-4532-98d7-e7db7af4e98f tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:02.723165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-424005ee-3a41-4532-98d7-e7db7af4e98f tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:02.731929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-424005ee-3a41-4532-98d7-e7db7af4e98f tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:02.733579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-424005ee-3a41-4532-98d7-e7db7af4e98f tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '280c6a8b06e24528ac29a386143ff8e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd13df97b24c400ba82340468d2635cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:02.734711 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-424005ee-3a41-4532-98d7-e7db7af4e98f tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 200 len: 1406 microversion: 2.54 time: 0.274060 Aug 09 14:47:02.735379 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1793/3638] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:02 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:03.488301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca909922-3e9a-46d2-b766-602c680d1198 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:03.488986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca909922-3e9a-46d2-b766-602c680d1198 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:03.508694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca909922-3e9a-46d2-b766-602c680d1198 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:03.510051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca909922-3e9a-46d2-b766-602c680d1198 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:03.510208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca909922-3e9a-46d2-b766-602c680d1198 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:03.511448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca909922-3e9a-46d2-b766-602c680d1198 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:03.511913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca909922-3e9a-46d2-b766-602c680d1198 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:03.512339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca909922-3e9a-46d2-b766-602c680d1198 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:03.732567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:47:03.733767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:47:03.734580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:47:03.735121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:47:03.735575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:47:03.764932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:03.765474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:03.767277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:03.768160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:03.768628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:03.769061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:03.830518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:47:03.844223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for user d970d0bf9e754591b09af75bbf64a96d and project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:47:03.886389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca909922-3e9a-46d2-b766-602c680d1198 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:03.898397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca909922-3e9a-46d2-b766-602c680d1198 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:03.900951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca909922-3e9a-46d2-b766-602c680d1198 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:03.902401 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca909922-3e9a-46d2-b766-602c680d1198 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.419535 Aug 09 14:47:03.903558 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1794/3639] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:03 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:47:03.906062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:47:03.910563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84cf40db-7203-42dc-9188-82570d24e6ea tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:03.911431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84cf40db-7203-42dc-9188-82570d24e6ea tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] [instance: 5e5366b8-dc3f-42fb-92b0-0843773c3305] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:03.916138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:47:03.920786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84cf40db-7203-42dc-9188-82570d24e6ea tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:03.921780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84cf40db-7203-42dc-9188-82570d24e6ea tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:03.922445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84cf40db-7203-42dc-9188-82570d24e6ea tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:03.923351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84cf40db-7203-42dc-9188-82570d24e6ea tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:03.924484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84cf40db-7203-42dc-9188-82570d24e6ea tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:03.925416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84cf40db-7203-42dc-9188-82570d24e6ea tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:03.963614 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-84cf40db-7203-42dc-9188-82570d24e6ea tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] HTTP exception thrown: Instance 5e5366b8-dc3f-42fb-92b0-0843773c3305 could not be found. Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84cf40db-7203-42dc-9188-82570d24e6ea tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Request method failure captured: Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 HTTP/1.1 Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nM8wldMMcg7ZRZyvKQ9J4hWolXjl-MhhJVNancbUvQimlWOGe4TRjHUgZ26eIwdTGuqE_-lj72tl2ia5bFwQ2VptJH3JDULGtjIJpTPRB-A_Z7uWKHbFN1k8VCPR-0hAOHnYqoUa2w0VSII6g6BsHbd2gxC6iGCP5klMds3YhnJCOE Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.54 Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: cd13df97b24c400ba82340468d2635cd Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerShowV254Test-691228640 Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd13df97b24c400ba82340468d2635cd", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd13df97b24c400ba82340468d2635cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd13df97b24c400ba82340468d2635cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd13df97b24c400ba82340468d2635cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerShowV254Test-691228640 Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: cd13df97b24c400ba82340468d2635cd Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerShowV254Test-691228640 Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerShowV254Test-691228640-project Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 280c6a8b06e24528ac29a386143ff8e0 Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerShowV254Test-691228640-project Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 5e5366b8-dc3f-42fb-92b0-0843773c3305 could not be found. Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '5e5366b8-dc3f-42fb-92b0-0843773c3305'} Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e5366b8-dc3f-42fb-92b0-0843773c3305 could not be found. Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e5366b8-dc3f-42fb-92b0-0843773c3305 could not be found. Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:47:03.966152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:47:03.972651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:47:03.972651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:47:03.972651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:47:03.972651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:47:03.972651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:47:03.972651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e5366b8-dc3f-42fb-92b0-0843773c3305 could not be found. Aug 09 14:47:03.972651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:47:03.972651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84cf40db-7203-42dc-9188-82570d24e6ea tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] Returning 404 to user: Instance 5e5366b8-dc3f-42fb-92b0-0843773c3305 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:47:03.972651 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84cf40db-7203-42dc-9188-82570d24e6ea tempest-ServerShowV254Test-691228640 tempest-ServerShowV254Test-691228640-project] 10.222.0.50 "GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305" status: 404 len: 111 microversion: 2.54 time: 0.064670 Aug 09 14:47:03.991703 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1795/3640] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:03 2022] GET /compute/v2.1/servers/5e5366b8-dc3f-42fb-92b0-0843773c3305 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:47:04.042586 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-939c69bc-0dba-4626-8bce-5dda05444dad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.359541 Aug 09 14:47:04.043418 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1846/3641] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:47:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:47:04.055751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e52a0f2c-279f-4fb8-a148-14d500782a00 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:04.056682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e52a0f2c-279f-4fb8-a148-14d500782a00 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:04.239440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e52a0f2c-279f-4fb8-a148-14d500782a00 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:04.251107 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e52a0f2c-279f-4fb8-a148-14d500782a00 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1214 microversion: 2.1 time: 0.197373 Aug 09 14:47:04.267830 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1796/3642] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:04 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1214 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:04.933817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d017a5e4-8d62-42a4-8b1a-104f3f42b88d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:04.934310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d017a5e4-8d62-42a4-8b1a-104f3f42b88d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:04.966114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d017a5e4-8d62-42a4-8b1a-104f3f42b88d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:04.967200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d017a5e4-8d62-42a4-8b1a-104f3f42b88d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:04.973548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d017a5e4-8d62-42a4-8b1a-104f3f42b88d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:04.974754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d017a5e4-8d62-42a4-8b1a-104f3f42b88d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:04.976145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d017a5e4-8d62-42a4-8b1a-104f3f42b88d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:04.976516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d017a5e4-8d62-42a4-8b1a-104f3f42b88d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:05.286091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e4e9a468-e9db-45ae-86d5-2413ec51f5fd tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:05.286714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e4e9a468-e9db-45ae-86d5-2413ec51f5fd tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:05.324212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4e9a468-e9db-45ae-86d5-2413ec51f5fd tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:05.324720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4e9a468-e9db-45ae-86d5-2413ec51f5fd tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:05.325156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4e9a468-e9db-45ae-86d5-2413ec51f5fd tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:05.329536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4e9a468-e9db-45ae-86d5-2413ec51f5fd tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:05.333173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4e9a468-e9db-45ae-86d5-2413ec51f5fd tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:05.333833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4e9a468-e9db-45ae-86d5-2413ec51f5fd tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:05.801153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e4e9a468-e9db-45ae-86d5-2413ec51f5fd tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:05.822706 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e4e9a468-e9db-45ae-86d5-2413ec51f5fd tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1210 microversion: 2.1 time: 0.540486 Aug 09 14:47:05.825401 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1797/3643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:05 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1210 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:06.139282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d017a5e4-8d62-42a4-8b1a-104f3f42b88d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:06.153313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d017a5e4-8d62-42a4-8b1a-104f3f42b88d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:06.154859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d017a5e4-8d62-42a4-8b1a-104f3f42b88d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:06.165223 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d017a5e4-8d62-42a4-8b1a-104f3f42b88d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.240404 Aug 09 14:47:06.166456 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1847/3644] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:04 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:06.848218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dd9df528-2084-4c63-926e-fb154efd11d2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:06.849037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dd9df528-2084-4c63-926e-fb154efd11d2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:06.863959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd9df528-2084-4c63-926e-fb154efd11d2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:06.864458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd9df528-2084-4c63-926e-fb154efd11d2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:06.866919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd9df528-2084-4c63-926e-fb154efd11d2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:06.868961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd9df528-2084-4c63-926e-fb154efd11d2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:06.872511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd9df528-2084-4c63-926e-fb154efd11d2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:06.873224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd9df528-2084-4c63-926e-fb154efd11d2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:07.091007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd9df528-2084-4c63-926e-fb154efd11d2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:07.125128 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dd9df528-2084-4c63-926e-fb154efd11d2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1272 microversion: 2.1 time: 0.278209 Aug 09 14:47:07.141983 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1798/3645] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:06 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:47:07.192790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a4bf6dcd-f11e-4989-9ffc-15ac3283a43b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:07.194281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a4bf6dcd-f11e-4989-9ffc-15ac3283a43b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:07.206530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4bf6dcd-f11e-4989-9ffc-15ac3283a43b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:07.210163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4bf6dcd-f11e-4989-9ffc-15ac3283a43b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:07.210843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4bf6dcd-f11e-4989-9ffc-15ac3283a43b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:07.212078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4bf6dcd-f11e-4989-9ffc-15ac3283a43b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:07.215164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4bf6dcd-f11e-4989-9ffc-15ac3283a43b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:07.215852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4bf6dcd-f11e-4989-9ffc-15ac3283a43b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:08.146372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a0f5109-9eda-4a96-828f-172d1130c7e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:08.147988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a0f5109-9eda-4a96-828f-172d1130c7e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:08.174247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a0f5109-9eda-4a96-828f-172d1130c7e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:08.174922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a0f5109-9eda-4a96-828f-172d1130c7e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:08.176568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a0f5109-9eda-4a96-828f-172d1130c7e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:08.178615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a0f5109-9eda-4a96-828f-172d1130c7e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:08.179585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a0f5109-9eda-4a96-828f-172d1130c7e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:08.180019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a0f5109-9eda-4a96-828f-172d1130c7e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:08.261749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a4bf6dcd-f11e-4989-9ffc-15ac3283a43b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:08.278368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a4bf6dcd-f11e-4989-9ffc-15ac3283a43b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:08.284061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a4bf6dcd-f11e-4989-9ffc-15ac3283a43b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:08.285246 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a4bf6dcd-f11e-4989-9ffc-15ac3283a43b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.097221 Aug 09 14:47:08.289959 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1848/3646] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:07 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:09.228462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4a0f5109-9eda-4a96-828f-172d1130c7e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:09.242170 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a0f5109-9eda-4a96-828f-172d1130c7e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1314 microversion: 2.1 time: 1.098861 Aug 09 14:47:09.272806 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1799/3647] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:08 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1314 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:47:09.313915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-04058fbf-b3da-4446-a90a-f7dee31d9a37 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:09.314538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-04058fbf-b3da-4446-a90a-f7dee31d9a37 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:09.322122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04058fbf-b3da-4446-a90a-f7dee31d9a37 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:09.322616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04058fbf-b3da-4446-a90a-f7dee31d9a37 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:09.323051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04058fbf-b3da-4446-a90a-f7dee31d9a37 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:09.323792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04058fbf-b3da-4446-a90a-f7dee31d9a37 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:09.324239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04058fbf-b3da-4446-a90a-f7dee31d9a37 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:09.324747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-04058fbf-b3da-4446-a90a-f7dee31d9a37 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:10.272674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d9baea50-c0f9-44dd-b7d2-430f4aa1a22e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:10.274035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d9baea50-c0f9-44dd-b7d2-430f4aa1a22e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:10.292335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9baea50-c0f9-44dd-b7d2-430f4aa1a22e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:10.292840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9baea50-c0f9-44dd-b7d2-430f4aa1a22e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:10.293738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9baea50-c0f9-44dd-b7d2-430f4aa1a22e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:10.297650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9baea50-c0f9-44dd-b7d2-430f4aa1a22e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:10.299437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9baea50-c0f9-44dd-b7d2-430f4aa1a22e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:10.301762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9baea50-c0f9-44dd-b7d2-430f4aa1a22e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:10.443204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-04058fbf-b3da-4446-a90a-f7dee31d9a37 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:10.461813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-04058fbf-b3da-4446-a90a-f7dee31d9a37 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:10.465642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-04058fbf-b3da-4446-a90a-f7dee31d9a37 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:10.466894 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-04058fbf-b3da-4446-a90a-f7dee31d9a37 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.157578 Aug 09 14:47:10.470795 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1849/3648] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:09 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:11.360810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d9baea50-c0f9-44dd-b7d2-430f4aa1a22e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:11.375402 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d9baea50-c0f9-44dd-b7d2-430f4aa1a22e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1314 microversion: 2.1 time: 1.108778 Aug 09 14:47:11.378250 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1800/3649] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:10 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1314 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:47:11.490649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5bedc1ee-528f-413c-aab3-b47fa54e3ea9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:11.491325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5bedc1ee-528f-413c-aab3-b47fa54e3ea9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:11.494172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:11.504171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bedc1ee-528f-413c-aab3-b47fa54e3ea9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:11.504667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bedc1ee-528f-413c-aab3-b47fa54e3ea9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:11.515524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bedc1ee-528f-413c-aab3-b47fa54e3ea9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:11.516444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bedc1ee-528f-413c-aab3-b47fa54e3ea9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:11.523954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bedc1ee-528f-413c-aab3-b47fa54e3ea9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:11.524416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bedc1ee-528f-413c-aab3-b47fa54e3ea9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:12.397897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-368f0275-f945-4a59-ab3b-d5bd9da42f47 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:12.398599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-368f0275-f945-4a59-ab3b-d5bd9da42f47 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:12.413616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-368f0275-f945-4a59-ab3b-d5bd9da42f47 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:12.414406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-368f0275-f945-4a59-ab3b-d5bd9da42f47 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:12.414836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-368f0275-f945-4a59-ab3b-d5bd9da42f47 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:12.415586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-368f0275-f945-4a59-ab3b-d5bd9da42f47 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:12.416207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-368f0275-f945-4a59-ab3b-d5bd9da42f47 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:12.416987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-368f0275-f945-4a59-ab3b-d5bd9da42f47 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:12.728668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5bedc1ee-528f-413c-aab3-b47fa54e3ea9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:12.738620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5bedc1ee-528f-413c-aab3-b47fa54e3ea9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:12.740161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5bedc1ee-528f-413c-aab3-b47fa54e3ea9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:12.741485 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5bedc1ee-528f-413c-aab3-b47fa54e3ea9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.254980 Aug 09 14:47:12.751974 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1850/3650] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:11 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:12.910888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-670843cd-fe58-4f7f-b70f-0015625b51d3 req-12567f26-9dae-435e-8817-59a3d17381ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc", "tag": "9e839813-0150-466e-ab00-441302ebdf0c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:12.933329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-670843cd-fe58-4f7f-b70f-0015625b51d3 req-12567f26-9dae-435e-8817-59a3d17381ae service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:12.933736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-670843cd-fe58-4f7f-b70f-0015625b51d3 req-12567f26-9dae-435e-8817-59a3d17381ae service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:12.934180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-670843cd-fe58-4f7f-b70f-0015625b51d3 req-12567f26-9dae-435e-8817-59a3d17381ae service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:12.961709 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-670843cd-fe58-4f7f-b70f-0015625b51d3 req-12567f26-9dae-435e-8817-59a3d17381ae service nova] Creating event network-changed:9e839813-0150-466e-ab00-441302ebdf0c for instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc on n-h1-844626-8 Aug 09 14:47:12.970467 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-670843cd-fe58-4f7f-b70f-0015625b51d3 req-12567f26-9dae-435e-8817-59a3d17381ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061594 Aug 09 14:47:12.971504 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1851/3651] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:47:13.077198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-368f0275-f945-4a59-ab3b-d5bd9da42f47 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:13.088447 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-368f0275-f945-4a59-ab3b-d5bd9da42f47 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1314 microversion: 2.1 time: 0.693265 Aug 09 14:47:13.091465 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1801/3652] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:12 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1314 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:47:13.776256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ca9dc96-749b-4182-ab21-2e9eab27b982 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:13.776999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ca9dc96-749b-4182-ab21-2e9eab27b982 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:13.794765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:13.796392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ca9dc96-749b-4182-ab21-2e9eab27b982 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:13.796913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ca9dc96-749b-4182-ab21-2e9eab27b982 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:13.797408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ca9dc96-749b-4182-ab21-2e9eab27b982 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:13.798246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ca9dc96-749b-4182-ab21-2e9eab27b982 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:13.798727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ca9dc96-749b-4182-ab21-2e9eab27b982 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:13.799354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ca9dc96-749b-4182-ab21-2e9eab27b982 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:13.868751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:14.118349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5f976736-1b5e-4c17-9a33-fad26a956d15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:14.120976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5f976736-1b5e-4c17-9a33-fad26a956d15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:14.130915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f976736-1b5e-4c17-9a33-fad26a956d15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:14.131709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f976736-1b5e-4c17-9a33-fad26a956d15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:14.132391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f976736-1b5e-4c17-9a33-fad26a956d15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:14.133424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f976736-1b5e-4c17-9a33-fad26a956d15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:14.134377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f976736-1b5e-4c17-9a33-fad26a956d15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:14.135181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f976736-1b5e-4c17-9a33-fad26a956d15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:14.248804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:14.969520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f976736-1b5e-4c17-9a33-fad26a956d15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:14.977505 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5f976736-1b5e-4c17-9a33-fad26a956d15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1314 microversion: 2.1 time: 0.868792 Aug 09 14:47:14.980615 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1802/3653] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:14 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:15.908501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ca9dc96-749b-4182-ab21-2e9eab27b982 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:15.942496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ca9dc96-749b-4182-ab21-2e9eab27b982 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:15.945057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ca9dc96-749b-4182-ab21-2e9eab27b982 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:15.966926 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ca9dc96-749b-4182-ab21-2e9eab27b982 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 2.178948 Aug 09 14:47:15.968984 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1852/3654] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:13 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:15.998130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c190d4c6-62a4-4b1c-a355-4212fe21b994 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:15.999053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c190d4c6-62a4-4b1c-a355-4212fe21b994 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:16.012955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c190d4c6-62a4-4b1c-a355-4212fe21b994 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:16.013469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c190d4c6-62a4-4b1c-a355-4212fe21b994 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:16.013906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c190d4c6-62a4-4b1c-a355-4212fe21b994 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:16.016679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c190d4c6-62a4-4b1c-a355-4212fe21b994 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:16.021001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c190d4c6-62a4-4b1c-a355-4212fe21b994 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:16.021448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c190d4c6-62a4-4b1c-a355-4212fe21b994 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:16.980087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c190d4c6-62a4-4b1c-a355-4212fe21b994 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:16.991985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8a20131-082a-4832-a8cc-9ff09217e37b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:16.993156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b8a20131-082a-4832-a8cc-9ff09217e37b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:17.000618 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c190d4c6-62a4-4b1c-a355-4212fe21b994 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1314 microversion: 2.1 time: 0.996019 Aug 09 14:47:17.003976 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1803/3655] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:15 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1314 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:17.007195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8a20131-082a-4832-a8cc-9ff09217e37b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:17.008660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8a20131-082a-4832-a8cc-9ff09217e37b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:17.009419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8a20131-082a-4832-a8cc-9ff09217e37b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:17.010861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8a20131-082a-4832-a8cc-9ff09217e37b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:17.011580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8a20131-082a-4832-a8cc-9ff09217e37b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:17.012451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8a20131-082a-4832-a8cc-9ff09217e37b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:18.026564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9acdfa48-7a38-42ca-8c26-eab01bf4d3ba tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:18.028037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9acdfa48-7a38-42ca-8c26-eab01bf4d3ba tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:18.045465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acdfa48-7a38-42ca-8c26-eab01bf4d3ba tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:18.046116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acdfa48-7a38-42ca-8c26-eab01bf4d3ba tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:18.046650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acdfa48-7a38-42ca-8c26-eab01bf4d3ba tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:18.048594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acdfa48-7a38-42ca-8c26-eab01bf4d3ba tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:18.054629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acdfa48-7a38-42ca-8c26-eab01bf4d3ba tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:18.055552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acdfa48-7a38-42ca-8c26-eab01bf4d3ba tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:18.103222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:18.127728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8a20131-082a-4832-a8cc-9ff09217e37b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:18.148163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8a20131-082a-4832-a8cc-9ff09217e37b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:18.149686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8a20131-082a-4832-a8cc-9ff09217e37b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:18.163776 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8a20131-082a-4832-a8cc-9ff09217e37b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.176295 Aug 09 14:47:18.165094 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1853/3656] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:16 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:18.851709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9acdfa48-7a38-42ca-8c26-eab01bf4d3ba tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:18.871304 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9acdfa48-7a38-42ca-8c26-eab01bf4d3ba tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1314 microversion: 2.1 time: 0.852715 Aug 09 14:47:18.881020 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1804/3657] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:18 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1314 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:19.194773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81a86c9e-b1dd-4b5e-87f6-5b1e7010cccf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:19.195423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-81a86c9e-b1dd-4b5e-87f6-5b1e7010cccf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:19.211848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81a86c9e-b1dd-4b5e-87f6-5b1e7010cccf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:19.215291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81a86c9e-b1dd-4b5e-87f6-5b1e7010cccf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:19.215985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81a86c9e-b1dd-4b5e-87f6-5b1e7010cccf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:19.220775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81a86c9e-b1dd-4b5e-87f6-5b1e7010cccf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:19.221442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81a86c9e-b1dd-4b5e-87f6-5b1e7010cccf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:19.222069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81a86c9e-b1dd-4b5e-87f6-5b1e7010cccf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:19.902673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bcf63612-11ef-4beb-abb1-ce7c0647722d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:19.904082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bcf63612-11ef-4beb-abb1-ce7c0647722d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:19.928506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcf63612-11ef-4beb-abb1-ce7c0647722d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:19.937183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcf63612-11ef-4beb-abb1-ce7c0647722d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:19.938130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcf63612-11ef-4beb-abb1-ce7c0647722d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:19.940451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcf63612-11ef-4beb-abb1-ce7c0647722d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:19.941141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcf63612-11ef-4beb-abb1-ce7c0647722d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:19.941913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcf63612-11ef-4beb-abb1-ce7c0647722d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:20.008564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-81a86c9e-b1dd-4b5e-87f6-5b1e7010cccf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:20.018847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-81a86c9e-b1dd-4b5e-87f6-5b1e7010cccf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:20.020772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-81a86c9e-b1dd-4b5e-87f6-5b1e7010cccf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:20.025064 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81a86c9e-b1dd-4b5e-87f6-5b1e7010cccf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.834807 Aug 09 14:47:20.045578 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1854/3658] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:19 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:20.388704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bcf63612-11ef-4beb-abb1-ce7c0647722d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:20.405341 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bcf63612-11ef-4beb-abb1-ce7c0647722d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1314 microversion: 2.1 time: 0.505476 Aug 09 14:47:20.407173 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1805/3659] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:19 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:21.053635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c421995a-5d53-4147-90bc-3fab6761ebe2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:21.054495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c421995a-5d53-4147-90bc-3fab6761ebe2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:21.070324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c421995a-5d53-4147-90bc-3fab6761ebe2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:21.075172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c421995a-5d53-4147-90bc-3fab6761ebe2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:21.075751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c421995a-5d53-4147-90bc-3fab6761ebe2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:21.076551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c421995a-5d53-4147-90bc-3fab6761ebe2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:21.077021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c421995a-5d53-4147-90bc-3fab6761ebe2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:21.077447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c421995a-5d53-4147-90bc-3fab6761ebe2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:21.131833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1228476552", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "6a899c18-f652-4631-930f-b41b34ce15a7"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:21.269127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] validate_networks() for [('6a899c18-f652-4631-930f-b41b34ce15a7', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:47:21.658778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c421995a-5d53-4147-90bc-3fab6761ebe2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:21.676028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c421995a-5d53-4147-90bc-3fab6761ebe2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:21.694144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c421995a-5d53-4147-90bc-3fab6761ebe2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:21.696054 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c421995a-5d53-4147-90bc-3fab6761ebe2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.646175 Aug 09 14:47:21.696960 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1806/3660] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:21 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:21.702111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f20ca8d-a758-4f4e-b29f-4941c4befe4e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:21.706570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f20ca8d-a758-4f4e-b29f-4941c4befe4e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:21.727002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f20ca8d-a758-4f4e-b29f-4941c4befe4e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:21.727554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f20ca8d-a758-4f4e-b29f-4941c4befe4e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:21.728203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f20ca8d-a758-4f4e-b29f-4941c4befe4e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:21.729095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f20ca8d-a758-4f4e-b29f-4941c4befe4e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:21.729710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f20ca8d-a758-4f4e-b29f-4941c4befe4e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:21.730304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f20ca8d-a758-4f4e-b29f-4941c4befe4e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:22.478682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:47:22.479826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:47:22.480528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:47:22.481357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:47:22.482015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:47:22.505659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:22.507845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:22.508304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:22.509074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:22.509522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:22.509939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:22.573145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Getting quotas for project aec9ea2e96bf4bce80f7a13442ba5275. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:47:22.593890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0f20ca8d-a758-4f4e-b29f-4941c4befe4e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:22.595621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Getting quotas for user 4ac6e55128794059b04e74e1fe8ea175 and project aec9ea2e96bf4bce80f7a13442ba5275. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:47:22.606789 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f20ca8d-a758-4f4e-b29f-4941c4befe4e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1314 microversion: 2.1 time: 0.907749 Aug 09 14:47:22.607911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1807/3661] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:21 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:22.667539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Going to run 2 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:47:22.671596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 372a7545-fba6-408b-a38c-42008793c527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:47:22.755816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-51347b5f-9335-4462-9206-f2c6cfab7a26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Action: 'create', calling method: .version_select at 0x7f41ddb1b0d0>, body: {"keypair": {"name": "tempest-keypair-947609621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGYJq5Qs19Um5Hb8LlHNb0NJ/rWWLlfVyCWXE5oIsDSdZdVrrpuXvSny7AglfauhXkl6QPMUh2ma2CZbUpOO8qy9jhqXJc9TLJRVObCNEpPeBiFDiM8W/zWkzyieNWZ1FA=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:22.800859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-51347b5f-9335-4462-9206-f2c6cfab7a26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Getting quotas for project cd7add50097c4b84859dbfac51473919. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:47:22.817807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=372a7545-fba6-408b-a38c-42008793c527,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:47:22.819027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-51347b5f-9335-4462-9206-f2c6cfab7a26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Getting quotas for user 13b12146c9774e9c8360d7535e43bfe3 and project cd7add50097c4b84859dbfac51473919. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:47:22.888987 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-51347b5f-9335-4462-9206-f2c6cfab7a26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.279344 Aug 09 14:47:22.890649 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1808/3662] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 9 14:47:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 282 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 14:47:22.901534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d88978a-a3f0-42b6-929c-7561531c786d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:22.902903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4d88978a-a3f0-42b6-929c-7561531c786d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:22.920340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d88978a-a3f0-42b6-929c-7561531c786d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:22.921463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d88978a-a3f0-42b6-929c-7561531c786d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:22.922164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d88978a-a3f0-42b6-929c-7561531c786d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:22.923564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d88978a-a3f0-42b6-929c-7561531c786d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:22.924314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d88978a-a3f0-42b6-929c-7561531c786d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:22.926231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d88978a-a3f0-42b6-929c-7561531c786d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:23.044992 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ffb488c2-9097-42da-8687-d15a7b1bc502 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.295036 Aug 09 14:47:23.051182 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1855/3663] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:47:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:47:23.058637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9cd87144-eaa8-4904-b746-92afa463fcba tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:23.069380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9cd87144-eaa8-4904-b746-92afa463fcba tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:23.076163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9cd87144-eaa8-4904-b746-92afa463fcba tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Searching by: {'deleted': False, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:47:23.181817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cd87144-eaa8-4904-b746-92afa463fcba tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:23.184291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cd87144-eaa8-4904-b746-92afa463fcba tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:23.184798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cd87144-eaa8-4904-b746-92afa463fcba tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:23.188173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cd87144-eaa8-4904-b746-92afa463fcba tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:23.188666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cd87144-eaa8-4904-b746-92afa463fcba tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:23.189110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9cd87144-eaa8-4904-b746-92afa463fcba tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:23.261413 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9cd87144-eaa8-4904-b746-92afa463fcba tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.208229 Aug 09 14:47:23.262284 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1856/3664] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 14:47:23 2022] GET /compute/v2.1/servers => generated 677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:47:23.422135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-805aa172-d551-4992-b22e-453e3985e661 req-6f92c12d-b5cb-4b37-8a29-12551daa9c8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc", "name": "network-vif-plugged", "status": "completed", "tag": "9e839813-0150-466e-ab00-441302ebdf0c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:23.457477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-805aa172-d551-4992-b22e-453e3985e661 req-6f92c12d-b5cb-4b37-8a29-12551daa9c8d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:23.457967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-805aa172-d551-4992-b22e-453e3985e661 req-6f92c12d-b5cb-4b37-8a29-12551daa9c8d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:23.458456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-805aa172-d551-4992-b22e-453e3985e661 req-6f92c12d-b5cb-4b37-8a29-12551daa9c8d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:23.489723 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-805aa172-d551-4992-b22e-453e3985e661 req-6f92c12d-b5cb-4b37-8a29-12551daa9c8d service nova] Creating event network-vif-plugged:9e839813-0150-466e-ab00-441302ebdf0c for instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc on n-h1-844626-8 Aug 09 14:47:23.499536 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-805aa172-d551-4992-b22e-453e3985e661 req-6f92c12d-b5cb-4b37-8a29-12551daa9c8d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235507 Aug 09 14:47:23.502933 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1857/3665] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:23.520482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75608494-5236-4aab-9529-1759b274f0be tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:23.521505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75608494-5236-4aab-9529-1759b274f0be tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:23.927076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-75608494-5236-4aab-9529-1759b274f0be tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:23.936362 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75608494-5236-4aab-9529-1759b274f0be tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1220 microversion: 2.1 time: 0.431898 Aug 09 14:47:23.936948 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1858/3666] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:23 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1220 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:23.951534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9dca73ca-59e5-4bea-8923-da55aa92a30d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:23.952153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9dca73ca-59e5-4bea-8923-da55aa92a30d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:23.991622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dca73ca-59e5-4bea-8923-da55aa92a30d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:24.006725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dca73ca-59e5-4bea-8923-da55aa92a30d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:24.007739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dca73ca-59e5-4bea-8923-da55aa92a30d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:24.009087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dca73ca-59e5-4bea-8923-da55aa92a30d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:24.010308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dca73ca-59e5-4bea-8923-da55aa92a30d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:24.010982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dca73ca-59e5-4bea-8923-da55aa92a30d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:24.050728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d88978a-a3f0-42b6-929c-7561531c786d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:24.070165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d88978a-a3f0-42b6-929c-7561531c786d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:24.074067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d88978a-a3f0-42b6-929c-7561531c786d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:24.079529 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4d88978a-a3f0-42b6-929c-7561531c786d tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.186229 Aug 09 14:47:24.099284 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1809/3667] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:22 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:24.560921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9dca73ca-59e5-4bea-8923-da55aa92a30d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:24.581594 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9dca73ca-59e5-4bea-8923-da55aa92a30d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1314 microversion: 2.1 time: 0.643320 Aug 09 14:47:24.582210 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1859/3668] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:23 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:24.957955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a12d7d0c-257e-4c2a-809c-c0616909989a tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:24.958577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a12d7d0c-257e-4c2a-809c-c0616909989a tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:24.970726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a12d7d0c-257e-4c2a-809c-c0616909989a tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:24.971270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a12d7d0c-257e-4c2a-809c-c0616909989a tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:24.971704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a12d7d0c-257e-4c2a-809c-c0616909989a tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:24.996366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a12d7d0c-257e-4c2a-809c-c0616909989a tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:24.996856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a12d7d0c-257e-4c2a-809c-c0616909989a tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:24.997293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a12d7d0c-257e-4c2a-809c-c0616909989a tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:25.114420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f8baacb4-4f60-48a2-8ab1-d2494d806a3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:25.115076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8baacb4-4f60-48a2-8ab1-d2494d806a3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:25.137454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8baacb4-4f60-48a2-8ab1-d2494d806a3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:25.137963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8baacb4-4f60-48a2-8ab1-d2494d806a3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:25.138406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8baacb4-4f60-48a2-8ab1-d2494d806a3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:25.142689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8baacb4-4f60-48a2-8ab1-d2494d806a3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:25.143532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8baacb4-4f60-48a2-8ab1-d2494d806a3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:25.147233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8baacb4-4f60-48a2-8ab1-d2494d806a3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:25.776655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a12d7d0c-257e-4c2a-809c-c0616909989a tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:25.790051 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a12d7d0c-257e-4c2a-809c-c0616909989a tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1224 microversion: 2.1 time: 0.836232 Aug 09 14:47:25.795499 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1810/3669] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:24 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1224 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:25.810266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-47d41f9d-b703-4438-a350-1f0f4d916ecb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:25.811293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-47d41f9d-b703-4438-a350-1f0f4d916ecb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:25.831316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47d41f9d-b703-4438-a350-1f0f4d916ecb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:25.835201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47d41f9d-b703-4438-a350-1f0f4d916ecb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:25.838429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47d41f9d-b703-4438-a350-1f0f4d916ecb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:25.840963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47d41f9d-b703-4438-a350-1f0f4d916ecb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:25.841616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47d41f9d-b703-4438-a350-1f0f4d916ecb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:25.843854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47d41f9d-b703-4438-a350-1f0f4d916ecb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:26.328946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-47d41f9d-b703-4438-a350-1f0f4d916ecb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:26.345333 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-47d41f9d-b703-4438-a350-1f0f4d916ecb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1501 microversion: 2.1 time: 0.548239 Aug 09 14:47:26.362651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8baacb4-4f60-48a2-8ab1-d2494d806a3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:26.368785 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1811/3670] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:25 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1501 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:26.384441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8baacb4-4f60-48a2-8ab1-d2494d806a3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:26.391052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c05079e-180b-4e7e-8833-60e48ef66068 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:26.391581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c05079e-180b-4e7e-8833-60e48ef66068 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:26.391742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8baacb4-4f60-48a2-8ab1-d2494d806a3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:26.393192 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f8baacb4-4f60-48a2-8ab1-d2494d806a3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.289659 Aug 09 14:47:26.395837 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1860/3671] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:25 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:47:26.420742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c05079e-180b-4e7e-8833-60e48ef66068 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:26.421322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c05079e-180b-4e7e-8833-60e48ef66068 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:26.421765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c05079e-180b-4e7e-8833-60e48ef66068 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:26.426878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c05079e-180b-4e7e-8833-60e48ef66068 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:26.435935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c05079e-180b-4e7e-8833-60e48ef66068 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:26.436783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c05079e-180b-4e7e-8833-60e48ef66068 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:26.512122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c05079e-180b-4e7e-8833-60e48ef66068 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:47:26.693562 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c05079e-180b-4e7e-8833-60e48ef66068 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 204 len: 0 microversion: 2.1 time: 0.316282 Aug 09 14:47:26.694862 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1812/3672] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:47:26 2022] DELETE /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:47:26.703401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-601393e9-6154-4ea5-be36-1a4997bbe4a6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:26.704270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-601393e9-6154-4ea5-be36-1a4997bbe4a6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:26.714397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601393e9-6154-4ea5-be36-1a4997bbe4a6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:26.728583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601393e9-6154-4ea5-be36-1a4997bbe4a6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:26.731886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601393e9-6154-4ea5-be36-1a4997bbe4a6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:26.734352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601393e9-6154-4ea5-be36-1a4997bbe4a6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:26.745258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601393e9-6154-4ea5-be36-1a4997bbe4a6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:26.745883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601393e9-6154-4ea5-be36-1a4997bbe4a6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:26.815639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-27186a30-abc8-4c08-bae4-b69c8d4176ed tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:26.816357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-27186a30-abc8-4c08-bae4-b69c8d4176ed tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:26.838361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27186a30-abc8-4c08-bae4-b69c8d4176ed tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:26.839186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27186a30-abc8-4c08-bae4-b69c8d4176ed tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:26.844331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27186a30-abc8-4c08-bae4-b69c8d4176ed tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:26.845418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27186a30-abc8-4c08-bae4-b69c8d4176ed tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:26.846072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27186a30-abc8-4c08-bae4-b69c8d4176ed tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:26.846681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27186a30-abc8-4c08-bae4-b69c8d4176ed tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:26.964183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-27186a30-abc8-4c08-bae4-b69c8d4176ed tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:26.985742 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-27186a30-abc8-4c08-bae4-b69c8d4176ed tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1278 microversion: 2.1 time: 0.176316 Aug 09 14:47:26.988066 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1813/3673] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:26 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:47:27.371186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-601393e9-6154-4ea5-be36-1a4997bbe4a6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:27.384538 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-601393e9-6154-4ea5-be36-1a4997bbe4a6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1507 microversion: 2.1 time: 0.685542 Aug 09 14:47:27.385323 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1861/3674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:26 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1507 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:27.424153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-46b5efdc-7d12-4683-a994-d6e9a6cca1ac tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:27.424781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-46b5efdc-7d12-4683-a994-d6e9a6cca1ac tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:27.437273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46b5efdc-7d12-4683-a994-d6e9a6cca1ac tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:27.438116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46b5efdc-7d12-4683-a994-d6e9a6cca1ac tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:27.438565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46b5efdc-7d12-4683-a994-d6e9a6cca1ac tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:27.439317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46b5efdc-7d12-4683-a994-d6e9a6cca1ac tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:27.439771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46b5efdc-7d12-4683-a994-d6e9a6cca1ac tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:27.450703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46b5efdc-7d12-4683-a994-d6e9a6cca1ac tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:27.911603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46b5efdc-7d12-4683-a994-d6e9a6cca1ac tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:27.928578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46b5efdc-7d12-4683-a994-d6e9a6cca1ac tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:27.940194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46b5efdc-7d12-4683-a994-d6e9a6cca1ac tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:27.941752 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-46b5efdc-7d12-4683-a994-d6e9a6cca1ac tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.522638 Aug 09 14:47:27.942833 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1814/3675] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:27 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:47:28.019656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a97bb6e3-4646-478b-abf7-b9fcae28a0f3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:28.021014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a97bb6e3-4646-478b-abf7-b9fcae28a0f3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:28.039481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a97bb6e3-4646-478b-abf7-b9fcae28a0f3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:28.040160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a97bb6e3-4646-478b-abf7-b9fcae28a0f3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:28.040767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a97bb6e3-4646-478b-abf7-b9fcae28a0f3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:28.041701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a97bb6e3-4646-478b-abf7-b9fcae28a0f3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:28.042336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a97bb6e3-4646-478b-abf7-b9fcae28a0f3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:28.042976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a97bb6e3-4646-478b-abf7-b9fcae28a0f3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:28.367113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a97bb6e3-4646-478b-abf7-b9fcae28a0f3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:28.381699 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a97bb6e3-4646-478b-abf7-b9fcae28a0f3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1278 microversion: 2.1 time: 0.370832 Aug 09 14:47:28.396912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-498189395", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fb950fa-ff8d-422a-85c2-70f980c88e78"}], "security_groups": [{"name": "tempest-securitygroup--214509477"}], "key_name": "tempest-keypair-947609621", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:28.404940 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1862/3676] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:28 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1278 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:28.425685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0fcd9e71-24f5-4d3e-bedd-cd4417113b27 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:28.432742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0fcd9e71-24f5-4d3e-bedd-cd4417113b27 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:28.452457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fcd9e71-24f5-4d3e-bedd-cd4417113b27 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:28.452942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fcd9e71-24f5-4d3e-bedd-cd4417113b27 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:28.457398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fcd9e71-24f5-4d3e-bedd-cd4417113b27 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:28.459116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fcd9e71-24f5-4d3e-bedd-cd4417113b27 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:28.460008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fcd9e71-24f5-4d3e-bedd-cd4417113b27 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:28.460759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fcd9e71-24f5-4d3e-bedd-cd4417113b27 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:28.513229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=88 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:28.702950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0fcd9e71-24f5-4d3e-bedd-cd4417113b27 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:28.716653 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0fcd9e71-24f5-4d3e-bedd-cd4417113b27 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 200 len: 1507 microversion: 2.1 time: 0.309688 Aug 09 14:47:28.717353 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1863/3677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:28 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 1507 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:28.769388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] validate_networks() for [('3fb950fa-ff8d-422a-85c2-70f980c88e78', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:47:28.967017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:28.968284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:28.987529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:28.988026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:28.988464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:28.989179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:28.989633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:28.990054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:29.818696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:29.835759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:29.839725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:29.842711 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.878444 Aug 09 14:47:29.853671 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1864/3678] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:28 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:47:29.855232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:29.858722 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6bfcf085-c94a-4842-81a8-493b914f8622 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003853 Aug 09 14:47:29.859379 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1865/3679] 10.222.0.50 () {56 vars in 886 bytes} [Tue Aug 9 14:47:29 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 09 14:47:29.870293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-7aec6f06-3a2b-4a80-a2f1-fc2242a52802 req-0f57ceb3-4cd7-44f1-a153-06222b36d4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc", "name": "network-vif-deleted", "tag": "9e839813-0150-466e-ab00-441302ebdf0c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:29.899480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7aec6f06-3a2b-4a80-a2f1-fc2242a52802 req-0f57ceb3-4cd7-44f1-a153-06222b36d4f3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:29.901077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7aec6f06-3a2b-4a80-a2f1-fc2242a52802 req-0f57ceb3-4cd7-44f1-a153-06222b36d4f3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:29.901812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7aec6f06-3a2b-4a80-a2f1-fc2242a52802 req-0f57ceb3-4cd7-44f1-a153-06222b36d4f3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:29.934886 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-7aec6f06-3a2b-4a80-a2f1-fc2242a52802 req-0f57ceb3-4cd7-44f1-a153-06222b36d4f3 service nova] Creating event network-vif-deleted:9e839813-0150-466e-ab00-441302ebdf0c for instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc on n-h1-844626-8 Aug 09 14:47:29.935283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:29.942335 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-7aec6f06-3a2b-4a80-a2f1-fc2242a52802 req-0f57ceb3-4cd7-44f1-a153-06222b36d4f3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081007 Aug 09 14:47:29.944056 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1866/3680] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:29.966985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e2e882b1-0be5-4771-a0d8-a9397640ead6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:29.968357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e2e882b1-0be5-4771-a0d8-a9397640ead6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:29.988680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2e882b1-0be5-4771-a0d8-a9397640ead6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:29.989891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2e882b1-0be5-4771-a0d8-a9397640ead6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:29.992305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2e882b1-0be5-4771-a0d8-a9397640ead6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:29.994416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2e882b1-0be5-4771-a0d8-a9397640ead6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:29.995642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2e882b1-0be5-4771-a0d8-a9397640ead6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:29.997860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2e882b1-0be5-4771-a0d8-a9397640ead6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:30.793228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e2e882b1-0be5-4771-a0d8-a9397640ead6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:30.801687 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e2e882b1-0be5-4771-a0d8-a9397640ead6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1320 microversion: 2.1 time: 0.855834 Aug 09 14:47:30.807690 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1867/3681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:29 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1320 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:30.817233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9e83d43-6453-4a1d-ba3f-a3a4cfda5956 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:30.820264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9e83d43-6453-4a1d-ba3f-a3a4cfda5956 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:30.841725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e83d43-6453-4a1d-ba3f-a3a4cfda5956 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:30.843318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e83d43-6453-4a1d-ba3f-a3a4cfda5956 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:30.844521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e83d43-6453-4a1d-ba3f-a3a4cfda5956 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:30.847740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e83d43-6453-4a1d-ba3f-a3a4cfda5956 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:30.848632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e83d43-6453-4a1d-ba3f-a3a4cfda5956 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:30.850150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9e83d43-6453-4a1d-ba3f-a3a4cfda5956 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:30.887840 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-f9e83d43-6453-4a1d-ba3f-a3a4cfda5956 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9e83d43-6453-4a1d-ba3f-a3a4cfda5956 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc HTTP/1.1 Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc'} Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:47:30.890216 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:47:30.895040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:47:30.895040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:47:30.895040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:47:30.895040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:47:30.895040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:47:30.895040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:47:30.895040 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:47:30.897414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9e83d43-6453-4a1d-ba3f-a3a4cfda5956 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:47:30.898634 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9e83d43-6453-4a1d-ba3f-a3a4cfda5956 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 404 len: 111 microversion: 2.1 time: 0.089589 Aug 09 14:47:30.912038 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1868/3682] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:30 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:47:30.952601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30be7f47-09b8-48b1-864a-272fc7bb8195 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:30.971719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30be7f47-09b8-48b1-864a-272fc7bb8195 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:31.010029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30be7f47-09b8-48b1-864a-272fc7bb8195 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:31.028094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30be7f47-09b8-48b1-864a-272fc7bb8195 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:31.028662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30be7f47-09b8-48b1-864a-272fc7bb8195 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:31.030389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30be7f47-09b8-48b1-864a-272fc7bb8195 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:31.030975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30be7f47-09b8-48b1-864a-272fc7bb8195 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:31.040925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30be7f47-09b8-48b1-864a-272fc7bb8195 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:32.144337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:47:32.144862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:47:32.145203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:47:32.146503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:47:32.147180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:47:32.163043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:32.165344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:32.167624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:32.168715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:32.169922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:32.171489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:32.196979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Getting quotas for project cd7add50097c4b84859dbfac51473919. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:47:32.205077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Getting quotas for user 13b12146c9774e9c8360d7535e43bfe3 and project cd7add50097c4b84859dbfac51473919. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:47:32.219980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:47:32.223331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:47:32.277112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30be7f47-09b8-48b1-864a-272fc7bb8195 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:32.296612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30be7f47-09b8-48b1-864a-272fc7bb8195 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:32.303150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30be7f47-09b8-48b1-864a-272fc7bb8195 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:32.311311 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30be7f47-09b8-48b1-864a-272fc7bb8195 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.392299 Aug 09 14:47:32.313284 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1869/3683] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:30 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:32.329223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1339637701", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:32.335132 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34edb6e6-17e6-4baa-8c4f-1aaf112cffb8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.946179 Aug 09 14:47:32.336630 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1815/3684] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:47:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 3955 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 09 14:47:32.351508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1524e39a-e202-433d-ba8b-6363129ebb42 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:32.357768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1524e39a-e202-433d-ba8b-6363129ebb42 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:32.375815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1524e39a-e202-433d-ba8b-6363129ebb42 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:32.376721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1524e39a-e202-433d-ba8b-6363129ebb42 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:32.377425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1524e39a-e202-433d-ba8b-6363129ebb42 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:32.390374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1524e39a-e202-433d-ba8b-6363129ebb42 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:32.393364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1524e39a-e202-433d-ba8b-6363129ebb42 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:32.398290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1524e39a-e202-433d-ba8b-6363129ebb42 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:32.454561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] validate_networks() for [('583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:47:33.213572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:33.688015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1524e39a-e202-433d-ba8b-6363129ebb42 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:33.714409 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1524e39a-e202-433d-ba8b-6363129ebb42 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1320 microversion: 2.1 time: 1.375139 Aug 09 14:47:33.722768 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1816/3685] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:32 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1320 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:33.737254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42cb0468-d022-416b-b4c4-edde3bc20b33 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:33.740538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42cb0468-d022-416b-b4c4-edde3bc20b33 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:33.759330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42cb0468-d022-416b-b4c4-edde3bc20b33 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:33.762259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42cb0468-d022-416b-b4c4-edde3bc20b33 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:33.763602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42cb0468-d022-416b-b4c4-edde3bc20b33 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:33.789488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42cb0468-d022-416b-b4c4-edde3bc20b33 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:33.790729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42cb0468-d022-416b-b4c4-edde3bc20b33 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:33.791860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42cb0468-d022-416b-b4c4-edde3bc20b33 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:33.936077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:34.443110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42cb0468-d022-416b-b4c4-edde3bc20b33 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:34.453860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42cb0468-d022-416b-b4c4-edde3bc20b33 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:34.457744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42cb0468-d022-416b-b4c4-edde3bc20b33 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:34.471445 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42cb0468-d022-416b-b4c4-edde3bc20b33 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1276 microversion: 2.20 time: 0.745908 Aug 09 14:47:34.487110 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1817/3686] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:33 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1276 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:34.537006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6855e1e1-6647-430b-8b82-728b806387cb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:34.552188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6855e1e1-6647-430b-8b82-728b806387cb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:34.588952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6855e1e1-6647-430b-8b82-728b806387cb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:34.594337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6855e1e1-6647-430b-8b82-728b806387cb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:34.599482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6855e1e1-6647-430b-8b82-728b806387cb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:34.604303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6855e1e1-6647-430b-8b82-728b806387cb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:34.605057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6855e1e1-6647-430b-8b82-728b806387cb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:34.605793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6855e1e1-6647-430b-8b82-728b806387cb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:35.079431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:47:35.079918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:47:35.080309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:47:35.080722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:47:35.081118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:47:35.102508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:35.107447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:35.111127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:35.112250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:35.112912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:35.114070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:35.211323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:47:35.227531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for user d970d0bf9e754591b09af75bbf64a96d and project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:47:35.283016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:47:35.291102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:47:35.414309 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eaa23766-ff60-409c-b770-9e08543593c9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.099610 Aug 09 14:47:35.418116 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1870/3687] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:47:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:47:35.430042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23a7e0c6-869b-4bc7-a700-3457aa03cbeb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:35.432089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-23a7e0c6-869b-4bc7-a700-3457aa03cbeb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:35.448094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23a7e0c6-869b-4bc7-a700-3457aa03cbeb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:35.450233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23a7e0c6-869b-4bc7-a700-3457aa03cbeb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:35.453816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23a7e0c6-869b-4bc7-a700-3457aa03cbeb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:35.456126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23a7e0c6-869b-4bc7-a700-3457aa03cbeb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:35.463064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23a7e0c6-869b-4bc7-a700-3457aa03cbeb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:35.463763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23a7e0c6-869b-4bc7-a700-3457aa03cbeb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:35.800060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-23a7e0c6-869b-4bc7-a700-3457aa03cbeb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:35.817647 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23a7e0c6-869b-4bc7-a700-3457aa03cbeb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1320 microversion: 2.1 time: 0.398226 Aug 09 14:47:35.818237 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1871/3688] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:35 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1320 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:35.838399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb1ed631-2182-42fc-9d98-081674a36342 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:35.839018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb1ed631-2182-42fc-9d98-081674a36342 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:36.008680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fb1ed631-2182-42fc-9d98-081674a36342 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:36.033282 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb1ed631-2182-42fc-9d98-081674a36342 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1215 microversion: 2.1 time: 0.202906 Aug 09 14:47:36.042768 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1872/3689] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:35 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1215 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:36.047949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1469076b-fd4f-4d43-a382-039f4ef2b3a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:36.048562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1469076b-fd4f-4d43-a382-039f4ef2b3a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:36.049950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6855e1e1-6647-430b-8b82-728b806387cb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:36.068878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6855e1e1-6647-430b-8b82-728b806387cb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:36.073067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1469076b-fd4f-4d43-a382-039f4ef2b3a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:36.073798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1469076b-fd4f-4d43-a382-039f4ef2b3a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:36.075661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1469076b-fd4f-4d43-a382-039f4ef2b3a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:36.076983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1469076b-fd4f-4d43-a382-039f4ef2b3a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:36.078822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1469076b-fd4f-4d43-a382-039f4ef2b3a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:36.079633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6855e1e1-6647-430b-8b82-728b806387cb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:36.082058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1469076b-fd4f-4d43-a382-039f4ef2b3a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:36.086916 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6855e1e1-6647-430b-8b82-728b806387cb tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.595750 Aug 09 14:47:36.087589 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1818/3690] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:34 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:36.131101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c03631eb-b7a7-4794-a8a5-4eb0744d96f3 req-f69f1427-246a-48aa-bd80-4e0ea04dd636 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "372a7545-fba6-408b-a38c-42008793c527", "tag": "b0f1168b-97c4-481d-9fba-f38870e9d2d4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:36.177230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c03631eb-b7a7-4794-a8a5-4eb0744d96f3 req-f69f1427-246a-48aa-bd80-4e0ea04dd636 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:36.177730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c03631eb-b7a7-4794-a8a5-4eb0744d96f3 req-f69f1427-246a-48aa-bd80-4e0ea04dd636 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:36.178167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c03631eb-b7a7-4794-a8a5-4eb0744d96f3 req-f69f1427-246a-48aa-bd80-4e0ea04dd636 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:36.229169 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-c03631eb-b7a7-4794-a8a5-4eb0744d96f3 req-f69f1427-246a-48aa-bd80-4e0ea04dd636 service nova] Creating event network-changed:b0f1168b-97c4-481d-9fba-f38870e9d2d4 for instance 372a7545-fba6-408b-a38c-42008793c527 on n-h2-844626-8 Aug 09 14:47:36.254466 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c03631eb-b7a7-4794-a8a5-4eb0744d96f3 req-f69f1427-246a-48aa-bd80-4e0ea04dd636 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142976 Aug 09 14:47:36.258623 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1819/3691] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:36.280617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-cdad54fa-eb2d-4b72-a4d5-aaefc8c5ab8d req-d922f58f-31b5-4104-803f-16224450ab2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7acba673-037e-4f32-ac61-9f37ecbeeec5", "tag": "87b21f16-e01c-49d8-ba9b-e9701c27d4e4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:36.308973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cdad54fa-eb2d-4b72-a4d5-aaefc8c5ab8d req-d922f58f-31b5-4104-803f-16224450ab2b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:36.315418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cdad54fa-eb2d-4b72-a4d5-aaefc8c5ab8d req-d922f58f-31b5-4104-803f-16224450ab2b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:36.315910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cdad54fa-eb2d-4b72-a4d5-aaefc8c5ab8d req-d922f58f-31b5-4104-803f-16224450ab2b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:36.349268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1469076b-fd4f-4d43-a382-039f4ef2b3a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:36.366360 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-cdad54fa-eb2d-4b72-a4d5-aaefc8c5ab8d req-d922f58f-31b5-4104-803f-16224450ab2b service nova] Creating event network-changed:87b21f16-e01c-49d8-ba9b-e9701c27d4e4 for instance 7acba673-037e-4f32-ac61-9f37ecbeeec5 on n-h1-844626-8 Aug 09 14:47:36.379680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1469076b-fd4f-4d43-a382-039f4ef2b3a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:36.382404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1469076b-fd4f-4d43-a382-039f4ef2b3a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:36.382797 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-cdad54fa-eb2d-4b72-a4d5-aaefc8c5ab8d req-d922f58f-31b5-4104-803f-16224450ab2b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122773 Aug 09 14:47:36.386432 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1820/3692] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:36.386971 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1469076b-fd4f-4d43-a382-039f4ef2b3a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1338 microversion: 2.20 time: 0.340649 Aug 09 14:47:36.387809 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1873/3693] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:36 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1338 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:36.847636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-235626a7-fa8c-4265-b54b-5ae9c3cde611 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:36.853028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-235626a7-fa8c-4265-b54b-5ae9c3cde611 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:36.876302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235626a7-fa8c-4265-b54b-5ae9c3cde611 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:36.876822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235626a7-fa8c-4265-b54b-5ae9c3cde611 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:36.877325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235626a7-fa8c-4265-b54b-5ae9c3cde611 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:36.880614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235626a7-fa8c-4265-b54b-5ae9c3cde611 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:36.882187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235626a7-fa8c-4265-b54b-5ae9c3cde611 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:36.885125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235626a7-fa8c-4265-b54b-5ae9c3cde611 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:37.055410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89489637-75ea-4d72-a6c1-8dca6e43b2f2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:37.056032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-89489637-75ea-4d72-a6c1-8dca6e43b2f2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:37.070797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89489637-75ea-4d72-a6c1-8dca6e43b2f2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:37.071344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89489637-75ea-4d72-a6c1-8dca6e43b2f2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:37.073699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89489637-75ea-4d72-a6c1-8dca6e43b2f2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:37.074452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89489637-75ea-4d72-a6c1-8dca6e43b2f2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:37.077996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89489637-75ea-4d72-a6c1-8dca6e43b2f2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:37.078677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89489637-75ea-4d72-a6c1-8dca6e43b2f2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:37.229864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-89489637-75ea-4d72-a6c1-8dca6e43b2f2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:37.241975 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-89489637-75ea-4d72-a6c1-8dca6e43b2f2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1267 microversion: 2.1 time: 0.191816 Aug 09 14:47:37.247509 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1874/3694] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:37 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:37.263578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a8b7bf23-4323-4425-80a4-84b0e589a843 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:37.265052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a8b7bf23-4323-4425-80a4-84b0e589a843 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:37.284906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b7bf23-4323-4425-80a4-84b0e589a843 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:37.285399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b7bf23-4323-4425-80a4-84b0e589a843 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:37.289791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b7bf23-4323-4425-80a4-84b0e589a843 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:37.290817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b7bf23-4323-4425-80a4-84b0e589a843 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:37.299563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b7bf23-4323-4425-80a4-84b0e589a843 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:37.300186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b7bf23-4323-4425-80a4-84b0e589a843 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:37.901388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-235626a7-fa8c-4265-b54b-5ae9c3cde611 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:37.911051 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-235626a7-fa8c-4265-b54b-5ae9c3cde611 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1320 microversion: 2.1 time: 1.072807 Aug 09 14:47:37.921761 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1821/3695] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:36 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1320 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:37.928734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7bca6817-efaf-4b24-9dee-8bd3b0610cee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:37.936531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7bca6817-efaf-4b24-9dee-8bd3b0610cee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:37.980608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bca6817-efaf-4b24-9dee-8bd3b0610cee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:37.981180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bca6817-efaf-4b24-9dee-8bd3b0610cee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:37.981740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bca6817-efaf-4b24-9dee-8bd3b0610cee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:37.982664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bca6817-efaf-4b24-9dee-8bd3b0610cee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:37.985332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bca6817-efaf-4b24-9dee-8bd3b0610cee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:37.986148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bca6817-efaf-4b24-9dee-8bd3b0610cee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:38.015119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:38.033543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8b7bf23-4323-4425-80a4-84b0e589a843 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:38.066685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8b7bf23-4323-4425-80a4-84b0e589a843 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:38.073493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8b7bf23-4323-4425-80a4-84b0e589a843 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:38.076161 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a8b7bf23-4323-4425-80a4-84b0e589a843 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.826298 Aug 09 14:47:38.088397 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1875/3696] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:37 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:38.110044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1913045909", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "c7358f03-9555-4911-85c0-7ebf68f6eaf1"}], "security_groups": [{"name": "tempest-securitygroup--1331597412"}], "key_name": "tempest-keypair-1005722400", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "67e25f51-1e25-40b2-b2dd-d56e79007a48", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:38.512701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] validate_networks() for [('c7358f03-9555-4911-85c0-7ebf68f6eaf1', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:47:38.681676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7bca6817-efaf-4b24-9dee-8bd3b0610cee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:38.696229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7bca6817-efaf-4b24-9dee-8bd3b0610cee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:38.697792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7bca6817-efaf-4b24-9dee-8bd3b0610cee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:38.698956 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7bca6817-efaf-4b24-9dee-8bd3b0610cee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1405 microversion: 2.20 time: 0.776017 Aug 09 14:47:38.700688 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1822/3697] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:37 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1405 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:38.705745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04d49ee9-487f-4651-9241-ab62438d0db9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:38.712295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-04d49ee9-487f-4651-9241-ab62438d0db9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:38.727829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04d49ee9-487f-4651-9241-ab62438d0db9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:38.728471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04d49ee9-487f-4651-9241-ab62438d0db9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:38.729015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04d49ee9-487f-4651-9241-ab62438d0db9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:38.731066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04d49ee9-487f-4651-9241-ab62438d0db9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:38.731671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04d49ee9-487f-4651-9241-ab62438d0db9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:38.735059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04d49ee9-487f-4651-9241-ab62438d0db9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:38.863525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-04d49ee9-487f-4651-9241-ab62438d0db9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:38.879446 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-04d49ee9-487f-4651-9241-ab62438d0db9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1273 microversion: 2.1 time: 0.177334 Aug 09 14:47:38.888038 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1823/3698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:38 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:38.937269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06d71271-5973-4598-81c3-08b5d1d778c8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:38.945100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-06d71271-5973-4598-81c3-08b5d1d778c8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:38.956330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06d71271-5973-4598-81c3-08b5d1d778c8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:38.956843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06d71271-5973-4598-81c3-08b5d1d778c8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:38.957393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06d71271-5973-4598-81c3-08b5d1d778c8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:38.958114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06d71271-5973-4598-81c3-08b5d1d778c8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:38.958711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06d71271-5973-4598-81c3-08b5d1d778c8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:38.958984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06d71271-5973-4598-81c3-08b5d1d778c8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:39.916498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-06d71271-5973-4598-81c3-08b5d1d778c8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:39.935387 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-06d71271-5973-4598-81c3-08b5d1d778c8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1320 microversion: 2.1 time: 1.001830 Aug 09 14:47:39.952863 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1824/3699] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:38 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1320 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:39.952863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1f3f847f-5b93-4ab7-8911-7b582be77aa7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:39.952863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1f3f847f-5b93-4ab7-8911-7b582be77aa7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:39.974888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f3f847f-5b93-4ab7-8911-7b582be77aa7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:39.975614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f3f847f-5b93-4ab7-8911-7b582be77aa7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:39.976227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f3f847f-5b93-4ab7-8911-7b582be77aa7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:39.977098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f3f847f-5b93-4ab7-8911-7b582be77aa7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:39.977712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f3f847f-5b93-4ab7-8911-7b582be77aa7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:39.978292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f3f847f-5b93-4ab7-8911-7b582be77aa7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:40.411896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Getting quotas for project 159f7d3784934b59ac35dd1adb06886e. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:47:40.423028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Getting quotas for user c84d23aa3a7b485690191a9d84386946 and project 159f7d3784934b59ac35dd1adb06886e. Resources: dict_keys(['metadata_items']) {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:47:40.440738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:47:40.441573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:47:40.442221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:47:40.442798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:47:40.443447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:47:40.455807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:40.456926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:40.457529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:40.458452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:40.459103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:40.460269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:40.477076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:40.488749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Getting quotas for project 159f7d3784934b59ac35dd1adb06886e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:47:40.498558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Getting quotas for user c84d23aa3a7b485690191a9d84386946 and project 159f7d3784934b59ac35dd1adb06886e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:47:40.623778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:47:40.626130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='67e25f51-1e25-40b2-b2dd-d56e79007a48',volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:47:40.633671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1f3f847f-5b93-4ab7-8911-7b582be77aa7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:40.653033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1f3f847f-5b93-4ab7-8911-7b582be77aa7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:40.660320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1f3f847f-5b93-4ab7-8911-7b582be77aa7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:40.664094 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1f3f847f-5b93-4ab7-8911-7b582be77aa7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.723240 Aug 09 14:47:40.666195 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1825/3700] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:39 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:40.688234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e44cd716-a927-4734-a929-e1b67fd8a332 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:40.692432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e44cd716-a927-4734-a929-e1b67fd8a332 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:40.729730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e44cd716-a927-4734-a929-e1b67fd8a332 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:40.733812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e44cd716-a927-4734-a929-e1b67fd8a332 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:40.734388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e44cd716-a927-4734-a929-e1b67fd8a332 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:40.735177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e44cd716-a927-4734-a929-e1b67fd8a332 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:40.735647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e44cd716-a927-4734-a929-e1b67fd8a332 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:40.736486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e44cd716-a927-4734-a929-e1b67fd8a332 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:41.061261 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9f9fc559-2ff6-425a-9ab5-896f241b3376 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.970321 Aug 09 14:47:41.063698 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1876/3701] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:47:38 2022] POST /compute/v2.1/servers => generated 407 bytes in 2975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:47:41.069773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27c5be23-9282-43f8-b4c0-8a496e361e58 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:41.070659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-27c5be23-9282-43f8-b4c0-8a496e361e58 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:41.103251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c5be23-9282-43f8-b4c0-8a496e361e58 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:41.106364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c5be23-9282-43f8-b4c0-8a496e361e58 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:41.109397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c5be23-9282-43f8-b4c0-8a496e361e58 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:41.112319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c5be23-9282-43f8-b4c0-8a496e361e58 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:41.112977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c5be23-9282-43f8-b4c0-8a496e361e58 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:41.117395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c5be23-9282-43f8-b4c0-8a496e361e58 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:41.674030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e44cd716-a927-4734-a929-e1b67fd8a332 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:41.688670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e44cd716-a927-4734-a929-e1b67fd8a332 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:41.693718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e44cd716-a927-4734-a929-e1b67fd8a332 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:41.698020 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e44cd716-a927-4734-a929-e1b67fd8a332 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1405 microversion: 2.20 time: 1.028385 Aug 09 14:47:41.700441 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1826/3702] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:40 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1405 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:41.717209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9d30d975-0bdd-4105-9a67-92242779dc38 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:41.719724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d30d975-0bdd-4105-9a67-92242779dc38 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:41.759642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d30d975-0bdd-4105-9a67-92242779dc38 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:41.770799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d30d975-0bdd-4105-9a67-92242779dc38 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:41.771555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d30d975-0bdd-4105-9a67-92242779dc38 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:41.774329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d30d975-0bdd-4105-9a67-92242779dc38 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:41.777708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d30d975-0bdd-4105-9a67-92242779dc38 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:41.779432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d30d975-0bdd-4105-9a67-92242779dc38 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:41.882040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-27c5be23-9282-43f8-b4c0-8a496e361e58 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:41.901098 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-27c5be23-9282-43f8-b4c0-8a496e361e58 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1315 microversion: 2.1 time: 0.833023 Aug 09 14:47:41.902242 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1877/3703] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:41 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1315 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:41.916821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-15715986-eff5-41e4-8604-2b417b40f572 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:41.921344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-15715986-eff5-41e4-8604-2b417b40f572 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:42.188618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:42.215143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=10 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:42.247945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-15715986-eff5-41e4-8604-2b417b40f572 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:42.259522 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-15715986-eff5-41e4-8604-2b417b40f572 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1122 microversion: 2.1 time: 0.355833 Aug 09 14:47:42.260496 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1878/3704] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:41 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1122 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:42.270880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5c592cbc-9dd6-46bf-9baa-e8f557b5cf98 req-6ea83195-b29e-4ada-b3b7-ba10ff5d5618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25a9384-ba3d-4ff8-8f2a-39ccdde0690a", "tag": "ec41d639-5d70-4bd6-8da7-60954703b90b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:42.316983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5c592cbc-9dd6-46bf-9baa-e8f557b5cf98 req-6ea83195-b29e-4ada-b3b7-ba10ff5d5618 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:42.317457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5c592cbc-9dd6-46bf-9baa-e8f557b5cf98 req-6ea83195-b29e-4ada-b3b7-ba10ff5d5618 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:42.322604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5c592cbc-9dd6-46bf-9baa-e8f557b5cf98 req-6ea83195-b29e-4ada-b3b7-ba10ff5d5618 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:42.331902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9d30d975-0bdd-4105-9a67-92242779dc38 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:42.345443 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9d30d975-0bdd-4105-9a67-92242779dc38 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1320 microversion: 2.1 time: 0.640577 Aug 09 14:47:42.359851 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1827/3705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:41 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1320 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:42.376955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7f7864e3-3525-43ea-87aa-ea7d7f529d5f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:42.382632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7f7864e3-3525-43ea-87aa-ea7d7f529d5f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:42.387303 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5c592cbc-9dd6-46bf-9baa-e8f557b5cf98 req-6ea83195-b29e-4ada-b3b7-ba10ff5d5618 service nova] Creating event network-changed:ec41d639-5d70-4bd6-8da7-60954703b90b for instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a on n-h1-844626-8 Aug 09 14:47:42.404466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f7864e3-3525-43ea-87aa-ea7d7f529d5f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:42.404951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f7864e3-3525-43ea-87aa-ea7d7f529d5f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:42.406118 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5c592cbc-9dd6-46bf-9baa-e8f557b5cf98 req-6ea83195-b29e-4ada-b3b7-ba10ff5d5618 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141672 Aug 09 14:47:42.407970 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1879/3706] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:42.408457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f7864e3-3525-43ea-87aa-ea7d7f529d5f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:42.409391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f7864e3-3525-43ea-87aa-ea7d7f529d5f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:42.411410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f7864e3-3525-43ea-87aa-ea7d7f529d5f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:42.412027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f7864e3-3525-43ea-87aa-ea7d7f529d5f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:42.724625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0192ad5-a138-4a07-a41a-bfb58dce7302 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:42.725530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0192ad5-a138-4a07-a41a-bfb58dce7302 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:42.736898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0192ad5-a138-4a07-a41a-bfb58dce7302 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:42.737558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0192ad5-a138-4a07-a41a-bfb58dce7302 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:42.737863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0192ad5-a138-4a07-a41a-bfb58dce7302 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:42.743567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0192ad5-a138-4a07-a41a-bfb58dce7302 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:42.744067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0192ad5-a138-4a07-a41a-bfb58dce7302 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:42.745901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0192ad5-a138-4a07-a41a-bfb58dce7302 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:43.617637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7f7864e3-3525-43ea-87aa-ea7d7f529d5f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:43.632091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0192ad5-a138-4a07-a41a-bfb58dce7302 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:43.645447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0192ad5-a138-4a07-a41a-bfb58dce7302 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:43.647347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0192ad5-a138-4a07-a41a-bfb58dce7302 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:43.649622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7f7864e3-3525-43ea-87aa-ea7d7f529d5f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:43.664677 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0192ad5-a138-4a07-a41a-bfb58dce7302 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1405 microversion: 2.20 time: 0.945036 Aug 09 14:47:43.666380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7f7864e3-3525-43ea-87aa-ea7d7f529d5f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:43.667212 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1880/3707] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:42 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1405 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:43.670039 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7f7864e3-3525-43ea-87aa-ea7d7f529d5f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.308965 Aug 09 14:47:43.674349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ec8ee977-d221-4064-8088-f866e72a0442 req-9e702efa-fa95-4b2a-8c0b-0412a1647cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-plugged", "status": "completed", "tag": "5bcb9340-d16d-4086-bbb3-c3282b5f4b53"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:43.675235 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1828/3708] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:42 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:43.684002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-28018d18-53d9-4e85-afb3-634a9a82e634 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:43.689779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-28018d18-53d9-4e85-afb3-634a9a82e634 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:43.700952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28018d18-53d9-4e85-afb3-634a9a82e634 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:43.701705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28018d18-53d9-4e85-afb3-634a9a82e634 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:43.702292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28018d18-53d9-4e85-afb3-634a9a82e634 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:43.702792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ec8ee977-d221-4064-8088-f866e72a0442 req-9e702efa-fa95-4b2a-8c0b-0412a1647cd0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:43.703694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28018d18-53d9-4e85-afb3-634a9a82e634 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:43.704410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ec8ee977-d221-4064-8088-f866e72a0442 req-9e702efa-fa95-4b2a-8c0b-0412a1647cd0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:43.705003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ec8ee977-d221-4064-8088-f866e72a0442 req-9e702efa-fa95-4b2a-8c0b-0412a1647cd0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:43.705645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28018d18-53d9-4e85-afb3-634a9a82e634 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:43.710643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28018d18-53d9-4e85-afb3-634a9a82e634 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:43.736972 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ec8ee977-d221-4064-8088-f866e72a0442 req-9e702efa-fa95-4b2a-8c0b-0412a1647cd0 service nova] Creating event network-vif-plugged:5bcb9340-d16d-4086-bbb3-c3282b5f4b53 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:47:43.752132 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ec8ee977-d221-4064-8088-f866e72a0442 req-9e702efa-fa95-4b2a-8c0b-0412a1647cd0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082431 Aug 09 14:47:43.755053 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1881/3709] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:43.767256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d049468a-311a-4c2c-8eb4-cd88cfa13a68 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:43.769071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d049468a-311a-4c2c-8eb4-cd88cfa13a68 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:43.783654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d049468a-311a-4c2c-8eb4-cd88cfa13a68 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:43.784874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d049468a-311a-4c2c-8eb4-cd88cfa13a68 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:43.785869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d049468a-311a-4c2c-8eb4-cd88cfa13a68 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:43.787773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d049468a-311a-4c2c-8eb4-cd88cfa13a68 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:43.788374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d049468a-311a-4c2c-8eb4-cd88cfa13a68 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:43.788941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d049468a-311a-4c2c-8eb4-cd88cfa13a68 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:44.369604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d049468a-311a-4c2c-8eb4-cd88cfa13a68 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:44.386205 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d049468a-311a-4c2c-8eb4-cd88cfa13a68 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1238 microversion: 2.1 time: 0.628127 Aug 09 14:47:44.388337 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1882/3710] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:43 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1238 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:44.410772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e5b7dfaa-cb2c-402d-a465-1380124d94e1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:44.415152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e5b7dfaa-cb2c-402d-a465-1380124d94e1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:44.430019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5b7dfaa-cb2c-402d-a465-1380124d94e1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:44.432475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5b7dfaa-cb2c-402d-a465-1380124d94e1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:44.433191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5b7dfaa-cb2c-402d-a465-1380124d94e1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:44.436811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5b7dfaa-cb2c-402d-a465-1380124d94e1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:44.437649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5b7dfaa-cb2c-402d-a465-1380124d94e1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:44.438309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5b7dfaa-cb2c-402d-a465-1380124d94e1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:44.927617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-28018d18-53d9-4e85-afb3-634a9a82e634 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:44.957310 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-28018d18-53d9-4e85-afb3-634a9a82e634 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1315 microversion: 2.1 time: 1.278804 Aug 09 14:47:44.959787 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1829/3711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:43 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1315 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:44.982883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c70255a2-7963-40fe-8de6-6d196231dbd8 req-c8ae7789-84a3-4de2-aa42-42aca28411ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fbebfa-9a85-4730-843f-9863ac60c365", "tag": "8508749d-11fb-461b-8a81-7fac3aeb9ac9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:45.050596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c70255a2-7963-40fe-8de6-6d196231dbd8 req-c8ae7789-84a3-4de2-aa42-42aca28411ee service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:45.056951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c70255a2-7963-40fe-8de6-6d196231dbd8 req-c8ae7789-84a3-4de2-aa42-42aca28411ee service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:45.060895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c70255a2-7963-40fe-8de6-6d196231dbd8 req-c8ae7789-84a3-4de2-aa42-42aca28411ee service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:45.086499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e5b7dfaa-cb2c-402d-a465-1380124d94e1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:45.100547 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e5b7dfaa-cb2c-402d-a465-1380124d94e1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1320 microversion: 2.1 time: 0.707915 Aug 09 14:47:45.113480 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-c70255a2-7963-40fe-8de6-6d196231dbd8 req-c8ae7789-84a3-4de2-aa42-42aca28411ee service nova] Creating event network-changed:8508749d-11fb-461b-8a81-7fac3aeb9ac9 for instance 99fbebfa-9a85-4730-843f-9863ac60c365 on n-h1-844626-8 Aug 09 14:47:45.118385 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1883/3712] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:44 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1320 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:45.131749 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c70255a2-7963-40fe-8de6-6d196231dbd8 req-c8ae7789-84a3-4de2-aa42-42aca28411ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168149 Aug 09 14:47:45.132946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0877324-01fe-456f-ba69-1d4a0dc18675 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:45.133573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0877324-01fe-456f-ba69-1d4a0dc18675 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:45.134202 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1830/3713] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:45.150288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-21c0593c-a8ae-4a02-934f-2e3a0fb46d73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:45.152312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-21c0593c-a8ae-4a02-934f-2e3a0fb46d73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:45.161450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0877324-01fe-456f-ba69-1d4a0dc18675 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:45.161962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0877324-01fe-456f-ba69-1d4a0dc18675 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:45.162472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0877324-01fe-456f-ba69-1d4a0dc18675 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:45.167722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0877324-01fe-456f-ba69-1d4a0dc18675 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:45.168216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0877324-01fe-456f-ba69-1d4a0dc18675 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:45.168655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0877324-01fe-456f-ba69-1d4a0dc18675 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:45.179776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21c0593c-a8ae-4a02-934f-2e3a0fb46d73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:45.181755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21c0593c-a8ae-4a02-934f-2e3a0fb46d73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:45.184085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21c0593c-a8ae-4a02-934f-2e3a0fb46d73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:45.186480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21c0593c-a8ae-4a02-934f-2e3a0fb46d73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:45.188875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21c0593c-a8ae-4a02-934f-2e3a0fb46d73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:45.192523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21c0593c-a8ae-4a02-934f-2e3a0fb46d73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:45.818046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0877324-01fe-456f-ba69-1d4a0dc18675 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:45.832808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0877324-01fe-456f-ba69-1d4a0dc18675 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:45.843788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0877324-01fe-456f-ba69-1d4a0dc18675 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:45.845696 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0877324-01fe-456f-ba69-1d4a0dc18675 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.726222 Aug 09 14:47:45.846291 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1884/3714] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:45 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:45.851533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1b15733c-0eb5-4c59-9ac1-2794ec0b7900 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:45.853364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1b15733c-0eb5-4c59-9ac1-2794ec0b7900 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:45.867751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b15733c-0eb5-4c59-9ac1-2794ec0b7900 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:45.871404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b15733c-0eb5-4c59-9ac1-2794ec0b7900 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:45.872091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b15733c-0eb5-4c59-9ac1-2794ec0b7900 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:45.873563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b15733c-0eb5-4c59-9ac1-2794ec0b7900 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:45.874222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b15733c-0eb5-4c59-9ac1-2794ec0b7900 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:45.875017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b15733c-0eb5-4c59-9ac1-2794ec0b7900 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:46.049014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-21c0593c-a8ae-4a02-934f-2e3a0fb46d73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:46.080292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-21c0593c-a8ae-4a02-934f-2e3a0fb46d73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:46.089795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-21c0593c-a8ae-4a02-934f-2e3a0fb46d73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:46.091496 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-21c0593c-a8ae-4a02-934f-2e3a0fb46d73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1405 microversion: 2.20 time: 0.955231 Aug 09 14:47:46.103113 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1831/3715] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:45 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1405 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:46.103113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-9c52e899-a9d2-4412-bb2c-1188128881c7 req-ea24ab14-7d50-414c-84ed-0e5f4958261e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-plugged", "status": "completed", "tag": "57a05dd9-1f79-490b-9377-d421d6b2c674"}, {"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-plugged", "status": "completed", "tag": "b584a69e-d71b-4c4f-80e9-ed537e73ff17"}, {"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-plugged", "status": "completed", "tag": "e630072b-3881-4138-9288-6963597d3178"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:46.123480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9c52e899-a9d2-4412-bb2c-1188128881c7 req-ea24ab14-7d50-414c-84ed-0e5f4958261e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:46.126766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9c52e899-a9d2-4412-bb2c-1188128881c7 req-ea24ab14-7d50-414c-84ed-0e5f4958261e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:46.131940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9c52e899-a9d2-4412-bb2c-1188128881c7 req-ea24ab14-7d50-414c-84ed-0e5f4958261e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:46.155358 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9c52e899-a9d2-4412-bb2c-1188128881c7 req-ea24ab14-7d50-414c-84ed-0e5f4958261e service nova] Creating event network-vif-plugged:57a05dd9-1f79-490b-9377-d421d6b2c674 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:47:46.155968 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9c52e899-a9d2-4412-bb2c-1188128881c7 req-ea24ab14-7d50-414c-84ed-0e5f4958261e service nova] Creating event network-vif-plugged:b584a69e-d71b-4c4f-80e9-ed537e73ff17 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:47:46.156543 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9c52e899-a9d2-4412-bb2c-1188128881c7 req-ea24ab14-7d50-414c-84ed-0e5f4958261e service nova] Creating event network-vif-plugged:e630072b-3881-4138-9288-6963597d3178 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:47:46.171905 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-9c52e899-a9d2-4412-bb2c-1188128881c7 req-ea24ab14-7d50-414c-84ed-0e5f4958261e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.077930 Aug 09 14:47:46.172538 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1832/3716] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:46.194549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37acbe76-6211-4ac1-a118-4e62e71817f4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:46.194549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37acbe76-6211-4ac1-a118-4e62e71817f4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:46.200175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37acbe76-6211-4ac1-a118-4e62e71817f4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:46.200698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37acbe76-6211-4ac1-a118-4e62e71817f4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:46.201333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37acbe76-6211-4ac1-a118-4e62e71817f4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:46.201991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37acbe76-6211-4ac1-a118-4e62e71817f4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:46.202431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37acbe76-6211-4ac1-a118-4e62e71817f4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:46.202830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37acbe76-6211-4ac1-a118-4e62e71817f4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:46.404954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1b15733c-0eb5-4c59-9ac1-2794ec0b7900 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:46.419781 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1b15733c-0eb5-4c59-9ac1-2794ec0b7900 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1306 microversion: 2.1 time: 0.571395 Aug 09 14:47:46.422785 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1885/3717] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:45 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1306 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:46.435501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-532f6499-534a-4dfe-bea6-6f1743f71980 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:46.437153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-532f6499-534a-4dfe-bea6-6f1743f71980 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:46.453575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-532f6499-534a-4dfe-bea6-6f1743f71980 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:46.457973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-532f6499-534a-4dfe-bea6-6f1743f71980 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:46.459632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-532f6499-534a-4dfe-bea6-6f1743f71980 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:46.461189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-532f6499-534a-4dfe-bea6-6f1743f71980 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:46.461869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-532f6499-534a-4dfe-bea6-6f1743f71980 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:46.462677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-532f6499-534a-4dfe-bea6-6f1743f71980 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:46.754639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-37acbe76-6211-4ac1-a118-4e62e71817f4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:46.785394 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37acbe76-6211-4ac1-a118-4e62e71817f4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1315 microversion: 2.1 time: 0.607620 Aug 09 14:47:46.791182 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1833/3718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:46 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:46.872871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-86d67673-8bc9-45a1-ad08-0cf9423250e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:46.873497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-86d67673-8bc9-45a1-ad08-0cf9423250e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:46.883623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86d67673-8bc9-45a1-ad08-0cf9423250e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:46.884113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86d67673-8bc9-45a1-ad08-0cf9423250e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:46.884547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86d67673-8bc9-45a1-ad08-0cf9423250e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:46.894176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86d67673-8bc9-45a1-ad08-0cf9423250e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:46.894871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86d67673-8bc9-45a1-ad08-0cf9423250e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:46.895938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86d67673-8bc9-45a1-ad08-0cf9423250e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:46.914152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-532f6499-534a-4dfe-bea6-6f1743f71980 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:46.922453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:46.936234 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-532f6499-534a-4dfe-bea6-6f1743f71980 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1320 microversion: 2.1 time: 0.512015 Aug 09 14:47:46.938402 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1886/3719] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:46 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1320 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:47.118292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ddedf49-8f41-433d-a4bc-dcec1e5ffa35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:47.119227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ddedf49-8f41-433d-a4bc-dcec1e5ffa35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:47.138346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ddedf49-8f41-433d-a4bc-dcec1e5ffa35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:47.140582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ddedf49-8f41-433d-a4bc-dcec1e5ffa35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:47.141200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ddedf49-8f41-433d-a4bc-dcec1e5ffa35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:47.142669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ddedf49-8f41-433d-a4bc-dcec1e5ffa35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:47.143336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ddedf49-8f41-433d-a4bc-dcec1e5ffa35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:47.143923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ddedf49-8f41-433d-a4bc-dcec1e5ffa35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:48.196850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-86d67673-8bc9-45a1-ad08-0cf9423250e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:48.230633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-86d67673-8bc9-45a1-ad08-0cf9423250e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:48.241921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-86d67673-8bc9-45a1-ad08-0cf9423250e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:48.243925 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-86d67673-8bc9-45a1-ad08-0cf9423250e2 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 1.375290 Aug 09 14:47:48.264824 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1834/3720] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:46 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:48.277188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dccdb33d-09e9-4bd6-9ff1-ade0d652fda2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:48.278425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dccdb33d-09e9-4bd6-9ff1-ade0d652fda2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:48.297409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ddedf49-8f41-433d-a4bc-dcec1e5ffa35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:48.308262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dccdb33d-09e9-4bd6-9ff1-ade0d652fda2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:48.309018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dccdb33d-09e9-4bd6-9ff1-ade0d652fda2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:48.309676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dccdb33d-09e9-4bd6-9ff1-ade0d652fda2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:48.310901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dccdb33d-09e9-4bd6-9ff1-ade0d652fda2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:48.311647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dccdb33d-09e9-4bd6-9ff1-ade0d652fda2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:48.312293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dccdb33d-09e9-4bd6-9ff1-ade0d652fda2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:48.318068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ddedf49-8f41-433d-a4bc-dcec1e5ffa35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:48.325437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ddedf49-8f41-433d-a4bc-dcec1e5ffa35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:48.332319 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ddedf49-8f41-433d-a4bc-dcec1e5ffa35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1405 microversion: 2.20 time: 1.218083 Aug 09 14:47:48.343532 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1887/3721] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:47 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1405 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:47:48.367250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ebd7bb53-7fde-425e-895c-5bac7761460b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:48.368828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ebd7bb53-7fde-425e-895c-5bac7761460b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:48.397106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebd7bb53-7fde-425e-895c-5bac7761460b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:48.408347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebd7bb53-7fde-425e-895c-5bac7761460b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:48.409326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebd7bb53-7fde-425e-895c-5bac7761460b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:48.410613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebd7bb53-7fde-425e-895c-5bac7761460b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:48.411505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebd7bb53-7fde-425e-895c-5bac7761460b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:48.412335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebd7bb53-7fde-425e-895c-5bac7761460b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:49.036930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dccdb33d-09e9-4bd6-9ff1-ade0d652fda2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:49.042410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ebd7bb53-7fde-425e-895c-5bac7761460b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:49.050280 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dccdb33d-09e9-4bd6-9ff1-ade0d652fda2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1306 microversion: 2.1 time: 0.783858 Aug 09 14:47:49.051223 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1835/3722] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:48 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1306 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:49.059589 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ebd7bb53-7fde-425e-895c-5bac7761460b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1315 microversion: 2.1 time: 0.706276 Aug 09 14:47:49.062015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1e9baf6d-b59e-4f44-932f-1a6679d12024 req-5e3f7d57-93d7-4ceb-b2f9-ea0149369dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1379ae48-c028-4c75-9d03-e9763b74ee26", "tag": "ba2d3796-12d3-490e-9866-ad13300d7ffb"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:49.078748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1e9baf6d-b59e-4f44-932f-1a6679d12024 req-5e3f7d57-93d7-4ceb-b2f9-ea0149369dc0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:49.079534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1e9baf6d-b59e-4f44-932f-1a6679d12024 req-5e3f7d57-93d7-4ceb-b2f9-ea0149369dc0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:49.080632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1e9baf6d-b59e-4f44-932f-1a6679d12024 req-5e3f7d57-93d7-4ceb-b2f9-ea0149369dc0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:49.088258 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1888/3723] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:48 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:49.101634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da5b08c4-93b3-4ab0-a9fa-a1b4fd969cf5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:49.102276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da5b08c4-93b3-4ab0-a9fa-a1b4fd969cf5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:49.103430 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1e9baf6d-b59e-4f44-932f-1a6679d12024 req-5e3f7d57-93d7-4ceb-b2f9-ea0149369dc0 service nova] Creating event network-changed:ba2d3796-12d3-490e-9866-ad13300d7ffb for instance 1379ae48-c028-4c75-9d03-e9763b74ee26 on n-h2-844626-8 Aug 09 14:47:49.126362 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1e9baf6d-b59e-4f44-932f-1a6679d12024 req-5e3f7d57-93d7-4ceb-b2f9-ea0149369dc0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060423 Aug 09 14:47:49.133567 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1836/3724] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:49.146010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-6ac576b2-e8ee-47d1-859e-32eefc54a317 req-d8dd9dbe-b966-4ac4-b21f-a24b94986180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7acba673-037e-4f32-ac61-9f37ecbeeec5", "name": "network-vif-plugged", "status": "completed", "tag": "87b21f16-e01c-49d8-ba9b-e9701c27d4e4"}, {"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-plugged", "status": "completed", "tag": "bef1c2ab-48c1-4197-be01-418d835b0f52"}, {"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-plugged", "status": "completed", "tag": "e829cab8-175f-46b9-b942-fa93e4bf48bb"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:49.153120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da5b08c4-93b3-4ab0-a9fa-a1b4fd969cf5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:49.156428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da5b08c4-93b3-4ab0-a9fa-a1b4fd969cf5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:49.157231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da5b08c4-93b3-4ab0-a9fa-a1b4fd969cf5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:49.157960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da5b08c4-93b3-4ab0-a9fa-a1b4fd969cf5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:49.158412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da5b08c4-93b3-4ab0-a9fa-a1b4fd969cf5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:49.158831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da5b08c4-93b3-4ab0-a9fa-a1b4fd969cf5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:49.192645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6ac576b2-e8ee-47d1-859e-32eefc54a317 req-d8dd9dbe-b966-4ac4-b21f-a24b94986180 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:49.193588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6ac576b2-e8ee-47d1-859e-32eefc54a317 req-d8dd9dbe-b966-4ac4-b21f-a24b94986180 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:49.197910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6ac576b2-e8ee-47d1-859e-32eefc54a317 req-d8dd9dbe-b966-4ac4-b21f-a24b94986180 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:49.223198 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-6ac576b2-e8ee-47d1-859e-32eefc54a317 req-d8dd9dbe-b966-4ac4-b21f-a24b94986180 service nova] Creating event network-vif-plugged:87b21f16-e01c-49d8-ba9b-e9701c27d4e4 for instance 7acba673-037e-4f32-ac61-9f37ecbeeec5 on n-h1-844626-8 Aug 09 14:47:49.223769 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-6ac576b2-e8ee-47d1-859e-32eefc54a317 req-d8dd9dbe-b966-4ac4-b21f-a24b94986180 service nova] Creating event network-vif-plugged:bef1c2ab-48c1-4197-be01-418d835b0f52 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:47:49.224442 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-6ac576b2-e8ee-47d1-859e-32eefc54a317 req-d8dd9dbe-b966-4ac4-b21f-a24b94986180 service nova] Creating event network-vif-plugged:e829cab8-175f-46b9-b942-fa93e4bf48bb for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:47:49.236656 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-6ac576b2-e8ee-47d1-859e-32eefc54a317 req-d8dd9dbe-b966-4ac4-b21f-a24b94986180 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.100987 Aug 09 14:47:49.237972 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1837/3725] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:49.284800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44ce2659-97fa-45e3-837d-9af3946f10be tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:49.285521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44ce2659-97fa-45e3-837d-9af3946f10be tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:49.302154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44ce2659-97fa-45e3-837d-9af3946f10be tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:49.302721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44ce2659-97fa-45e3-837d-9af3946f10be tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:49.303187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44ce2659-97fa-45e3-837d-9af3946f10be tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:49.304491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44ce2659-97fa-45e3-837d-9af3946f10be tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:49.304942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44ce2659-97fa-45e3-837d-9af3946f10be tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:49.305369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44ce2659-97fa-45e3-837d-9af3946f10be tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:49.939112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-da5b08c4-93b3-4ab0-a9fa-a1b4fd969cf5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:49.948275 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da5b08c4-93b3-4ab0-a9fa-a1b4fd969cf5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1320 microversion: 2.1 time: 0.858053 Aug 09 14:47:49.975110 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1889/3726] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:49 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1320 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:49.993217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d664efe9-f0fc-4ec7-8272-ff35a200d9b5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:49.996420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d664efe9-f0fc-4ec7-8272-ff35a200d9b5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:50.019546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d664efe9-f0fc-4ec7-8272-ff35a200d9b5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:50.021130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d664efe9-f0fc-4ec7-8272-ff35a200d9b5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:50.021584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d664efe9-f0fc-4ec7-8272-ff35a200d9b5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:50.025289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d664efe9-f0fc-4ec7-8272-ff35a200d9b5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:50.025751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d664efe9-f0fc-4ec7-8272-ff35a200d9b5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:50.026194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d664efe9-f0fc-4ec7-8272-ff35a200d9b5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:50.033636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-44ce2659-97fa-45e3-837d-9af3946f10be tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:50.046489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-44ce2659-97fa-45e3-837d-9af3946f10be tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:50.056455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-44ce2659-97fa-45e3-837d-9af3946f10be tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:50.057984 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44ce2659-97fa-45e3-837d-9af3946f10be tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.779151 Aug 09 14:47:50.058749 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1838/3727] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:49 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:47:50.078400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1b814eae-497b-4617-9a24-91f1b6f63b97 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:50.079309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1b814eae-497b-4617-9a24-91f1b6f63b97 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:50.091954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b814eae-497b-4617-9a24-91f1b6f63b97 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:50.092806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b814eae-497b-4617-9a24-91f1b6f63b97 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:50.093386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b814eae-497b-4617-9a24-91f1b6f63b97 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:50.095285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b814eae-497b-4617-9a24-91f1b6f63b97 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:50.095995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b814eae-497b-4617-9a24-91f1b6f63b97 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:50.107856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b814eae-497b-4617-9a24-91f1b6f63b97 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:50.472735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:50.851923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b814eae-497b-4617-9a24-91f1b6f63b97 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:50.863136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d664efe9-f0fc-4ec7-8272-ff35a200d9b5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:50.867669 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1b814eae-497b-4617-9a24-91f1b6f63b97 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1306 microversion: 2.1 time: 0.798609 Aug 09 14:47:50.873084 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1839/3728] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:50 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1306 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:50.889415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d664efe9-f0fc-4ec7-8272-ff35a200d9b5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:50.896813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d664efe9-f0fc-4ec7-8272-ff35a200d9b5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:50.899551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0c398f1d-f7e3-4021-95f0-10e955991bd9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:50.912150 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d664efe9-f0fc-4ec7-8272-ff35a200d9b5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1405 microversion: 2.20 time: 0.941509 Aug 09 14:47:50.914163 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1890/3729] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:49 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1405 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:50.924972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0c398f1d-f7e3-4021-95f0-10e955991bd9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:50.966604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c398f1d-f7e3-4021-95f0-10e955991bd9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:50.970785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c398f1d-f7e3-4021-95f0-10e955991bd9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:50.971117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c398f1d-f7e3-4021-95f0-10e955991bd9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:50.976290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c398f1d-f7e3-4021-95f0-10e955991bd9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:50.976802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c398f1d-f7e3-4021-95f0-10e955991bd9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:50.977243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c398f1d-f7e3-4021-95f0-10e955991bd9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:50.986259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-257b49d1-eaa9-4fa7-ade5-4d860636d3ca tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:50.986968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-257b49d1-eaa9-4fa7-ade5-4d860636d3ca tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:50.998792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-257b49d1-eaa9-4fa7-ade5-4d860636d3ca tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:51.002347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-257b49d1-eaa9-4fa7-ade5-4d860636d3ca tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:51.002933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-257b49d1-eaa9-4fa7-ade5-4d860636d3ca tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:51.014191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-257b49d1-eaa9-4fa7-ade5-4d860636d3ca tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:51.023433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-257b49d1-eaa9-4fa7-ade5-4d860636d3ca tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:51.025164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-257b49d1-eaa9-4fa7-ade5-4d860636d3ca tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:52.253025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=20 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:52.439155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-257b49d1-eaa9-4fa7-ade5-4d860636d3ca tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:52.442323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0c398f1d-f7e3-4021-95f0-10e955991bd9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:52.451986 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0c398f1d-f7e3-4021-95f0-10e955991bd9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1315 microversion: 2.1 time: 1.577138 Aug 09 14:47:52.454298 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-257b49d1-eaa9-4fa7-ade5-4d860636d3ca tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1320 microversion: 2.1 time: 1.471661 Aug 09 14:47:52.455114 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1840/3730] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:50 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1315 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:52.456244 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1891/3731] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:50 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1320 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:47:52.462316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-e10bdeff-da35-4704-9a36-52398b85f653 req-4c6c6a45-a0fd-4003-8713-28d2c1cef7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-plugged", "status": "completed", "tag": "e7aebd18-0445-48e5-9830-d801f5f45d18"}, {"server_uuid": "372a7545-fba6-408b-a38c-42008793c527", "name": "network-vif-plugged", "status": "completed", "tag": "b0f1168b-97c4-481d-9fba-f38870e9d2d4"}, {"server_uuid": "c25a9384-ba3d-4ff8-8f2a-39ccdde0690a", "name": "network-vif-plugged", "status": "completed", "tag": "ec41d639-5d70-4bd6-8da7-60954703b90b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:52.481567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:52.482514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:52.484303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e10bdeff-da35-4704-9a36-52398b85f653 req-4c6c6a45-a0fd-4003-8713-28d2c1cef7a0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:52.485988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e10bdeff-da35-4704-9a36-52398b85f653 req-4c6c6a45-a0fd-4003-8713-28d2c1cef7a0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:52.487019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e10bdeff-da35-4704-9a36-52398b85f653 req-4c6c6a45-a0fd-4003-8713-28d2c1cef7a0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:52.492257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:52.492918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:52.493721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:52.494588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:52.495106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:52.495595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:52.519630 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-e10bdeff-da35-4704-9a36-52398b85f653 req-4c6c6a45-a0fd-4003-8713-28d2c1cef7a0 service nova] Creating event network-vif-plugged:e7aebd18-0445-48e5-9830-d801f5f45d18 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:47:52.520498 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-e10bdeff-da35-4704-9a36-52398b85f653 req-4c6c6a45-a0fd-4003-8713-28d2c1cef7a0 service nova] Creating event network-vif-plugged:b0f1168b-97c4-481d-9fba-f38870e9d2d4 for instance 372a7545-fba6-408b-a38c-42008793c527 on n-h2-844626-8 Aug 09 14:47:52.521352 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-e10bdeff-da35-4704-9a36-52398b85f653 req-4c6c6a45-a0fd-4003-8713-28d2c1cef7a0 service nova] Creating event network-vif-plugged:ec41d639-5d70-4bd6-8da7-60954703b90b for instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a on n-h1-844626-8 Aug 09 14:47:52.542147 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-e10bdeff-da35-4704-9a36-52398b85f653 req-4c6c6a45-a0fd-4003-8713-28d2c1cef7a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.083630 Aug 09 14:47:52.544839 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1892/3732] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:52.580137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bddd97b9-6993-4fb8-a1d4-165aca58c762 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:52.581752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bddd97b9-6993-4fb8-a1d4-165aca58c762 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:52.605403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bddd97b9-6993-4fb8-a1d4-165aca58c762 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:52.606074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bddd97b9-6993-4fb8-a1d4-165aca58c762 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:52.608998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bddd97b9-6993-4fb8-a1d4-165aca58c762 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:52.610786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bddd97b9-6993-4fb8-a1d4-165aca58c762 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:52.611551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bddd97b9-6993-4fb8-a1d4-165aca58c762 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:52.612168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bddd97b9-6993-4fb8-a1d4-165aca58c762 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:53.192934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bddd97b9-6993-4fb8-a1d4-165aca58c762 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:53.208990 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bddd97b9-6993-4fb8-a1d4-165aca58c762 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1306 microversion: 2.1 time: 0.662353 Aug 09 14:47:53.209509 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1893/3733] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:52 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1306 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:53.228305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed92764b-2707-4e6d-88ec-67e40d9951b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:53.228939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed92764b-2707-4e6d-88ec-67e40d9951b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:53.239505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed92764b-2707-4e6d-88ec-67e40d9951b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:53.240223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed92764b-2707-4e6d-88ec-67e40d9951b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:53.240919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed92764b-2707-4e6d-88ec-67e40d9951b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:53.241782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed92764b-2707-4e6d-88ec-67e40d9951b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:53.242376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed92764b-2707-4e6d-88ec-67e40d9951b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:53.242966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed92764b-2707-4e6d-88ec-67e40d9951b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:53.255282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:53.258162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:47:53.277753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:53.279673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:53.282162 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.825645 Aug 09 14:47:53.284679 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1841/3734] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:52 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:53.288697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:53.291169 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001519 Aug 09 14:47:53.292766 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1842/3735] 10.222.0.50 () {56 vars in 886 bytes} [Tue Aug 9 14:47:53 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 09 14:47:53.300077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:53.301451 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001865 Aug 09 14:47:53.303971 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1843/3736] 10.222.0.50 () {54 vars in 1035 bytes} [Tue Aug 9 14:47:53 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 09 14:47:53.310176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:53.317617 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001767 Aug 09 14:47:53.318407 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1844/3737] 10.222.0.50 () {54 vars in 1041 bytes} [Tue Aug 9 14:47:53 2022] GET /compute/v2.1/ => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:53.327445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:53.328599 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-752d2f7b-276a-4f9b-9301-e0ba855f5ef9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001528 Aug 09 14:47:53.329133 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1845/3738] 10.222.0.50 () {56 vars in 886 bytes} [Tue Aug 9 14:47:53 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 09 14:47:53.481688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe9d7c96-ee37-468a-9b53-2e501f88a629 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:53.482702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fe9d7c96-ee37-468a-9b53-2e501f88a629 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:53.505149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe9d7c96-ee37-468a-9b53-2e501f88a629 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:53.505900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe9d7c96-ee37-468a-9b53-2e501f88a629 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:53.506545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe9d7c96-ee37-468a-9b53-2e501f88a629 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:53.508091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe9d7c96-ee37-468a-9b53-2e501f88a629 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:53.508955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe9d7c96-ee37-468a-9b53-2e501f88a629 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:53.511775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe9d7c96-ee37-468a-9b53-2e501f88a629 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:54.021418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed92764b-2707-4e6d-88ec-67e40d9951b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:54.038340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed92764b-2707-4e6d-88ec-67e40d9951b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:54.041792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed92764b-2707-4e6d-88ec-67e40d9951b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:54.044100 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed92764b-2707-4e6d-88ec-67e40d9951b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1405 microversion: 2.20 time: 0.832345 Aug 09 14:47:54.060466 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1894/3739] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:53 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1405 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:54.069191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09bc5e06-dec1-4b19-82e6-95c4a4a45891 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:54.084221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-09bc5e06-dec1-4b19-82e6-95c4a4a45891 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:54.106947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09bc5e06-dec1-4b19-82e6-95c4a4a45891 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:54.107780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09bc5e06-dec1-4b19-82e6-95c4a4a45891 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:54.108644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09bc5e06-dec1-4b19-82e6-95c4a4a45891 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:54.110089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09bc5e06-dec1-4b19-82e6-95c4a4a45891 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:54.111909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09bc5e06-dec1-4b19-82e6-95c4a4a45891 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:54.116978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09bc5e06-dec1-4b19-82e6-95c4a4a45891 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:54.155566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fe9d7c96-ee37-468a-9b53-2e501f88a629 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:54.165037 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fe9d7c96-ee37-468a-9b53-2e501f88a629 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 200 len: 1508 microversion: 2.1 time: 0.689722 Aug 09 14:47:54.166336 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1846/3740] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:53 2022] GET /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 1508 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:47:54.200206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4fb31480-e16c-4e8a-9cd5-eccdb1e1dfa3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:54.202405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4fb31480-e16c-4e8a-9cd5-eccdb1e1dfa3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 372a7545-fba6-408b-a38c-42008793c527] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:54.227748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb31480-e16c-4e8a-9cd5-eccdb1e1dfa3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:54.228382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb31480-e16c-4e8a-9cd5-eccdb1e1dfa3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:54.229470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb31480-e16c-4e8a-9cd5-eccdb1e1dfa3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:54.234011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb31480-e16c-4e8a-9cd5-eccdb1e1dfa3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:54.234772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb31480-e16c-4e8a-9cd5-eccdb1e1dfa3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:54.235912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb31480-e16c-4e8a-9cd5-eccdb1e1dfa3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:54.541587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-09bc5e06-dec1-4b19-82e6-95c4a4a45891 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:54.542137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4fb31480-e16c-4e8a-9cd5-eccdb1e1dfa3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:54.583570 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09bc5e06-dec1-4b19-82e6-95c4a4a45891 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1315 microversion: 2.1 time: 0.516791 Aug 09 14:47:54.584770 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4fb31480-e16c-4e8a-9cd5-eccdb1e1dfa3 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/372a7545-fba6-408b-a38c-42008793c527" status: 200 len: 1320 microversion: 2.1 time: 0.374685 Aug 09 14:47:54.586398 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1895/3741] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:54 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:54.604605 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1847/3742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:54 2022] GET /compute/v2.1/servers/372a7545-fba6-408b-a38c-42008793c527 => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:47:54.617873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-89c08597-99f7-4896-a646-8706316f36af tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:54.618486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-89c08597-99f7-4896-a646-8706316f36af tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:54.625121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a04878c-b9cb-4aad-8a8f-5f33b982dbc3 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:54.625761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a04878c-b9cb-4aad-8a8f-5f33b982dbc3 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:54.645024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a04878c-b9cb-4aad-8a8f-5f33b982dbc3 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:54.647996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89c08597-99f7-4896-a646-8706316f36af tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:54.648332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a04878c-b9cb-4aad-8a8f-5f33b982dbc3 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:54.649062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a04878c-b9cb-4aad-8a8f-5f33b982dbc3 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:54.650135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89c08597-99f7-4896-a646-8706316f36af tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:54.651055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a04878c-b9cb-4aad-8a8f-5f33b982dbc3 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:54.651712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a04878c-b9cb-4aad-8a8f-5f33b982dbc3 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:54.652976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89c08597-99f7-4896-a646-8706316f36af tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:54.653782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a04878c-b9cb-4aad-8a8f-5f33b982dbc3 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:54.653893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89c08597-99f7-4896-a646-8706316f36af tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:54.654328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89c08597-99f7-4896-a646-8706316f36af tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:54.659653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89c08597-99f7-4896-a646-8706316f36af tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:55.174861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-89c08597-99f7-4896-a646-8706316f36af tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:55.194928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-89c08597-99f7-4896-a646-8706316f36af tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:55.197917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-89c08597-99f7-4896-a646-8706316f36af tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:55.200198 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-89c08597-99f7-4896-a646-8706316f36af tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1874 microversion: 2.42 time: 0.593781 Aug 09 14:47:55.201663 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1848/3743] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:54 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1874 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:55.211253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-cb91b70f-9396-4e91-90d0-e35569230faf req-a1cace56-7783-48f5-af76-1c0c4ea20f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fbebfa-9a85-4730-843f-9863ac60c365", "name": "network-vif-plugged", "status": "completed", "tag": "8508749d-11fb-461b-8a81-7fac3aeb9ac9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:55.229374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cb91b70f-9396-4e91-90d0-e35569230faf req-a1cace56-7783-48f5-af76-1c0c4ea20f7e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:55.230104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cb91b70f-9396-4e91-90d0-e35569230faf req-a1cace56-7783-48f5-af76-1c0c4ea20f7e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:55.230931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cb91b70f-9396-4e91-90d0-e35569230faf req-a1cace56-7783-48f5-af76-1c0c4ea20f7e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:55.237382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3a04878c-b9cb-4aad-8a8f-5f33b982dbc3 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:55.253693 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-cb91b70f-9396-4e91-90d0-e35569230faf req-a1cace56-7783-48f5-af76-1c0c4ea20f7e service nova] Creating event network-vif-plugged:8508749d-11fb-461b-8a81-7fac3aeb9ac9 for instance 99fbebfa-9a85-4730-843f-9863ac60c365 on n-h1-844626-8 Aug 09 14:47:55.260415 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a04878c-b9cb-4aad-8a8f-5f33b982dbc3 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1306 microversion: 2.1 time: 0.656586 Aug 09 14:47:55.261751 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-cb91b70f-9396-4e91-90d0-e35569230faf req-a1cace56-7783-48f5-af76-1c0c4ea20f7e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057815 Aug 09 14:47:55.262671 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1849/3744] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:47:55.265446 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1896/3745] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:54 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1306 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:55.277486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e3d33363-46aa-444e-82cf-aebcc969bc97 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:55.281014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e3d33363-46aa-444e-82cf-aebcc969bc97 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:55.318936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d33363-46aa-444e-82cf-aebcc969bc97 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:55.320825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d33363-46aa-444e-82cf-aebcc969bc97 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:55.321938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d33363-46aa-444e-82cf-aebcc969bc97 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:55.323116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d33363-46aa-444e-82cf-aebcc969bc97 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:55.323864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d33363-46aa-444e-82cf-aebcc969bc97 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:55.324557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3d33363-46aa-444e-82cf-aebcc969bc97 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:55.564207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e3d33363-46aa-444e-82cf-aebcc969bc97 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:55.578761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e3d33363-46aa-444e-82cf-aebcc969bc97 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:55.580794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e3d33363-46aa-444e-82cf-aebcc969bc97 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:55.582404 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e3d33363-46aa-444e-82cf-aebcc969bc97 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1598 microversion: 2.20 time: 0.317986 Aug 09 14:47:55.583170 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1850/3746] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:55 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1598 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:55.612666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-26c98566-fcac-48df-b5ef-0918263979e7 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:55.613195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-26c98566-fcac-48df-b5ef-0918263979e7 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 372a7545-fba6-408b-a38c-42008793c527] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:55.621236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26c98566-fcac-48df-b5ef-0918263979e7 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:55.623115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26c98566-fcac-48df-b5ef-0918263979e7 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:55.623732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26c98566-fcac-48df-b5ef-0918263979e7 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:55.625628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8b389b2-0841-4214-817f-d0b7b9c830a1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:55.626209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8b389b2-0841-4214-817f-d0b7b9c830a1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:55.626693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26c98566-fcac-48df-b5ef-0918263979e7 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:55.627356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26c98566-fcac-48df-b5ef-0918263979e7 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:55.628158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26c98566-fcac-48df-b5ef-0918263979e7 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:55.643952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b389b2-0841-4214-817f-d0b7b9c830a1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:55.646860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b389b2-0841-4214-817f-d0b7b9c830a1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:55.648872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b389b2-0841-4214-817f-d0b7b9c830a1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:55.651062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b389b2-0841-4214-817f-d0b7b9c830a1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:55.652195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b389b2-0841-4214-817f-d0b7b9c830a1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:55.653524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b389b2-0841-4214-817f-d0b7b9c830a1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:55.887380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-26c98566-fcac-48df-b5ef-0918263979e7 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:55.895487 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-26c98566-fcac-48df-b5ef-0918263979e7 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/372a7545-fba6-408b-a38c-42008793c527" status: 200 len: 1508 microversion: 2.1 time: 0.292114 Aug 09 14:47:55.896810 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1897/3747] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:55 2022] GET /compute/v2.1/servers/372a7545-fba6-408b-a38c-42008793c527 => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:55.901898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-272e40ce-13a5-44f6-87ba-15c4cefbf9be tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:55.902735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-272e40ce-13a5-44f6-87ba-15c4cefbf9be tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:55.910311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-272e40ce-13a5-44f6-87ba-15c4cefbf9be tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:55.911198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-272e40ce-13a5-44f6-87ba-15c4cefbf9be tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:55.911805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-272e40ce-13a5-44f6-87ba-15c4cefbf9be tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:55.912708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-272e40ce-13a5-44f6-87ba-15c4cefbf9be tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:55.913288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-272e40ce-13a5-44f6-87ba-15c4cefbf9be tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:55.913849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-272e40ce-13a5-44f6-87ba-15c4cefbf9be tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:55.951754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f8b389b2-0841-4214-817f-d0b7b9c830a1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:55.972661 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8b389b2-0841-4214-817f-d0b7b9c830a1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1315 microversion: 2.1 time: 0.366536 Aug 09 14:47:55.973395 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1851/3748] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:55 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:55.995833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-381b8029-621d-48f9-80cb-5aafefe449a5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:55.996592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-381b8029-621d-48f9-80cb-5aafefe449a5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 372a7545-fba6-408b-a38c-42008793c527] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:56.006285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-381b8029-621d-48f9-80cb-5aafefe449a5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:56.010240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-381b8029-621d-48f9-80cb-5aafefe449a5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:56.010848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-381b8029-621d-48f9-80cb-5aafefe449a5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:56.013293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-381b8029-621d-48f9-80cb-5aafefe449a5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:56.014057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-381b8029-621d-48f9-80cb-5aafefe449a5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:56.015213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-381b8029-621d-48f9-80cb-5aafefe449a5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:56.032838 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-272e40ce-13a5-44f6-87ba-15c4cefbf9be tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.134659 Aug 09 14:47:56.033520 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1898/3749] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 9 14:47:55 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:47:56.082756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-381b8029-621d-48f9-80cb-5aafefe449a5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 372a7545-fba6-408b-a38c-42008793c527] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:47:56.226075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b31d06aa-744e-4876-8237-63573413a16a tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:56.226684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b31d06aa-744e-4876-8237-63573413a16a tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:56.238089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b31d06aa-744e-4876-8237-63573413a16a tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:56.241934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b31d06aa-744e-4876-8237-63573413a16a tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:56.243070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b31d06aa-744e-4876-8237-63573413a16a tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:56.244866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b31d06aa-744e-4876-8237-63573413a16a tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:56.246581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b31d06aa-744e-4876-8237-63573413a16a tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:56.248310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b31d06aa-744e-4876-8237-63573413a16a tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:56.286396 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-381b8029-621d-48f9-80cb-5aafefe449a5 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "DELETE /compute/v2.1/servers/372a7545-fba6-408b-a38c-42008793c527" status: 204 len: 0 microversion: 2.1 time: 0.297280 Aug 09 14:47:56.293105 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1852/3750] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:47:55 2022] DELETE /compute/v2.1/servers/372a7545-fba6-408b-a38c-42008793c527 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:47:56.298290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8b6dca8a-3d21-4a9b-9464-6dac8d9d8c7f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:56.320064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8b6dca8a-3d21-4a9b-9464-6dac8d9d8c7f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:56.331700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b6dca8a-3d21-4a9b-9464-6dac8d9d8c7f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:56.335236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b6dca8a-3d21-4a9b-9464-6dac8d9d8c7f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:56.337882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b6dca8a-3d21-4a9b-9464-6dac8d9d8c7f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:56.340683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b6dca8a-3d21-4a9b-9464-6dac8d9d8c7f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:56.344679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b6dca8a-3d21-4a9b-9464-6dac8d9d8c7f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:56.345267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b6dca8a-3d21-4a9b-9464-6dac8d9d8c7f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:57.139515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b31d06aa-744e-4876-8237-63573413a16a tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:57.156575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b31d06aa-744e-4876-8237-63573413a16a tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:57.160310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b31d06aa-744e-4876-8237-63573413a16a tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:57.162398 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b31d06aa-744e-4876-8237-63573413a16a tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 2834 microversion: 2.42 time: 0.941168 Aug 09 14:47:57.163777 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1899/3751] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:47:56 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 2834 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:57.180711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ab8b70ac-00b2-453c-b7d2-aebf9c703906 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:57.181897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ab8b70ac-00b2-453c-b7d2-aebf9c703906 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:57.198555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab8b70ac-00b2-453c-b7d2-aebf9c703906 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:57.201491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab8b70ac-00b2-453c-b7d2-aebf9c703906 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:57.202864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab8b70ac-00b2-453c-b7d2-aebf9c703906 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:57.203662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab8b70ac-00b2-453c-b7d2-aebf9c703906 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:57.204147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab8b70ac-00b2-453c-b7d2-aebf9c703906 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:57.204546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab8b70ac-00b2-453c-b7d2-aebf9c703906 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:57.231147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8b6dca8a-3d21-4a9b-9464-6dac8d9d8c7f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:57.248147 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8b6dca8a-3d21-4a9b-9464-6dac8d9d8c7f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1294 microversion: 2.1 time: 0.957603 Aug 09 14:47:57.248682 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1853/3752] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:56 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1294 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:57.250316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ab8b70ac-00b2-453c-b7d2-aebf9c703906 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 7acba673-037e-4f32-ac61-9f37ecbeeec5] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:47:57.254230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dfcc72f8-2b6b-4f17-86fb-32eb05d1b4b8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:57.256087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dfcc72f8-2b6b-4f17-86fb-32eb05d1b4b8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:57.271708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfcc72f8-2b6b-4f17-86fb-32eb05d1b4b8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:57.272432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfcc72f8-2b6b-4f17-86fb-32eb05d1b4b8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:57.272877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfcc72f8-2b6b-4f17-86fb-32eb05d1b4b8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:57.273592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfcc72f8-2b6b-4f17-86fb-32eb05d1b4b8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:57.274041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfcc72f8-2b6b-4f17-86fb-32eb05d1b4b8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:57.274460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfcc72f8-2b6b-4f17-86fb-32eb05d1b4b8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:57.451245 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ab8b70ac-00b2-453c-b7d2-aebf9c703906 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5" status: 204 len: 0 microversion: 2.1 time: 0.285387 Aug 09 14:47:57.453579 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1900/3753] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:47:57 2022] DELETE /compute/v2.1/servers/7acba673-037e-4f32-ac61-9f37ecbeeec5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:47:57.463569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30fbc0ef-bef3-4f76-8365-ad039f6d9824 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:57.464480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30fbc0ef-bef3-4f76-8365-ad039f6d9824 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:57.474181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30fbc0ef-bef3-4f76-8365-ad039f6d9824 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:57.474913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30fbc0ef-bef3-4f76-8365-ad039f6d9824 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:57.475580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30fbc0ef-bef3-4f76-8365-ad039f6d9824 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:57.476481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30fbc0ef-bef3-4f76-8365-ad039f6d9824 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:57.477284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30fbc0ef-bef3-4f76-8365-ad039f6d9824 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:57.477905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30fbc0ef-bef3-4f76-8365-ad039f6d9824 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:57.812193 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30fbc0ef-bef3-4f76-8365-ad039f6d9824 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.356005 Aug 09 14:47:57.812903 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1901/3754] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 9 14:47:57 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af/os-interface => generated 1833 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:47:57.818050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1226039195", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "6a899c18-f652-4631-930f-b41b34ce15a7"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:47:57.889251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] validate_networks() for [('6a899c18-f652-4631-930f-b41b34ce15a7', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:47:57.926531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dfcc72f8-2b6b-4f17-86fb-32eb05d1b4b8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:57.936322 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dfcc72f8-2b6b-4f17-86fb-32eb05d1b4b8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1502 microversion: 2.1 time: 0.686082 Aug 09 14:47:57.954830 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1854/3755] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:57 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1502 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:47:58.269858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9be0b22e-e7bc-48d1-89e5-766451c53c35 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:47:58.271164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9be0b22e-e7bc-48d1-89e5-766451c53c35 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:47:58.291518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9be0b22e-e7bc-48d1-89e5-766451c53c35 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:58.292606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9be0b22e-e7bc-48d1-89e5-766451c53c35 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:58.293247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9be0b22e-e7bc-48d1-89e5-766451c53c35 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:58.294413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9be0b22e-e7bc-48d1-89e5-766451c53c35 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:58.296832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9be0b22e-e7bc-48d1-89e5-766451c53c35 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:58.298271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9be0b22e-e7bc-48d1-89e5-766451c53c35 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:59.318880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9be0b22e-e7bc-48d1-89e5-766451c53c35 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:47:59.335745 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9be0b22e-e7bc-48d1-89e5-766451c53c35 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1294 microversion: 2.1 time: 1.069910 Aug 09 14:47:59.339196 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1855/3756] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:47:58 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1294 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:47:59.819533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:47:59.820099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:47:59.820427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:47:59.820996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:47:59.821599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:47:59.836427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:59.839663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:59.840283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:59.853407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:47:59.854053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:47:59.854623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:47:59.900390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Getting quotas for project aec9ea2e96bf4bce80f7a13442ba5275. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:47:59.916085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Getting quotas for user 4ac6e55128794059b04e74e1fe8ea175 and project aec9ea2e96bf4bce80f7a13442ba5275. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:47:59.954915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Going to run 2 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:47:59.959157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:48:00.045350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=5d1bc1a4-e0a4-41b3-a792-5370908d8e1a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:48:00.152760 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44b806ce-11fe-492c-a3e9-b5958c4a02fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.338451 Aug 09 14:48:00.162238 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1902/3757] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:47:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 2349 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 09 14:48:00.185264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fcab0e86-6399-4fd2-b68b-df34a3d730d8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:00.205493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fcab0e86-6399-4fd2-b68b-df34a3d730d8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:00.206612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fcab0e86-6399-4fd2-b68b-df34a3d730d8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Searching by: {'deleted': False, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:48:00.228647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:00.249294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcab0e86-6399-4fd2-b68b-df34a3d730d8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:00.250864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcab0e86-6399-4fd2-b68b-df34a3d730d8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:00.251609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcab0e86-6399-4fd2-b68b-df34a3d730d8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:00.253048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcab0e86-6399-4fd2-b68b-df34a3d730d8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:00.253671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcab0e86-6399-4fd2-b68b-df34a3d730d8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:00.254404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcab0e86-6399-4fd2-b68b-df34a3d730d8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:00.312134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-fcab0e86-6399-4fd2-b68b-df34a3d730d8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:48:00.355850 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fcab0e86-6399-4fd2-b68b-df34a3d730d8 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.182698 Aug 09 14:48:00.364804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f157bb50-88d6-4ebd-af78-7dc6722bf092 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:00.364804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f157bb50-88d6-4ebd-af78-7dc6722bf092 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:00.367612 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1856/3758] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 14:48:00 2022] GET /compute/v2.1/servers => generated 1337 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:00.373389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-327a09f5-2bfe-4707-883d-14f7f16c7b60 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:00.374692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-327a09f5-2bfe-4707-883d-14f7f16c7b60 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:00.378513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f157bb50-88d6-4ebd-af78-7dc6722bf092 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:00.379840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f157bb50-88d6-4ebd-af78-7dc6722bf092 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:00.381927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f157bb50-88d6-4ebd-af78-7dc6722bf092 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:00.382818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f157bb50-88d6-4ebd-af78-7dc6722bf092 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:00.384255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f157bb50-88d6-4ebd-af78-7dc6722bf092 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:00.385440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f157bb50-88d6-4ebd-af78-7dc6722bf092 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:00.804866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-327a09f5-2bfe-4707-883d-14f7f16c7b60 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:00.817338 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-327a09f5-2bfe-4707-883d-14f7f16c7b60 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1218 microversion: 2.1 time: 0.446741 Aug 09 14:48:00.825694 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1857/3759] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:00 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1218 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:00.898218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f157bb50-88d6-4ebd-af78-7dc6722bf092 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:00.900671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8636ec2d-8083-4f41-a002-ee01ac555371 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4f1a2d9-c1f1-4d58-a8ce-d7c7ff4d875b"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:00.902046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:00.902954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8636ec2d-8083-4f41-a002-ee01ac555371 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:00.916443 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f157bb50-88d6-4ebd-af78-7dc6722bf092 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1294 microversion: 2.1 time: 0.553625 Aug 09 14:48:00.920159 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1903/3760] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:00 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1294 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:48:00.945955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8636ec2d-8083-4f41-a002-ee01ac555371 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:00.946465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8636ec2d-8083-4f41-a002-ee01ac555371 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:00.946908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8636ec2d-8083-4f41-a002-ee01ac555371 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:00.947669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8636ec2d-8083-4f41-a002-ee01ac555371 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:00.948116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8636ec2d-8083-4f41-a002-ee01ac555371 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:00.951391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8636ec2d-8083-4f41-a002-ee01ac555371 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:01.539413 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8636ec2d-8083-4f41-a002-ee01ac555371 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "POST /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.641598 Aug 09 14:48:01.553768 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1858/3761] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 14:48:00 2022] POST /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365/os-volume_attachments => generated 194 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:48:01.588018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-fd9226c3-765d-4cd3-8596-8cfddbdbd44b req-e50bdc18-b318-4c9c-ba47-7819692e37aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25a9384-ba3d-4ff8-8f2a-39ccdde0690a", "tag": "ec41d639-5d70-4bd6-8da7-60954703b90b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:01.613361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fd9226c3-765d-4cd3-8596-8cfddbdbd44b req-e50bdc18-b318-4c9c-ba47-7819692e37aa service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:01.621330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fd9226c3-765d-4cd3-8596-8cfddbdbd44b req-e50bdc18-b318-4c9c-ba47-7819692e37aa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:01.631564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fd9226c3-765d-4cd3-8596-8cfddbdbd44b req-e50bdc18-b318-4c9c-ba47-7819692e37aa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:01.666078 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-fd9226c3-765d-4cd3-8596-8cfddbdbd44b req-e50bdc18-b318-4c9c-ba47-7819692e37aa service nova] Creating event network-changed:ec41d639-5d70-4bd6-8da7-60954703b90b for instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a on n-h1-844626-8 Aug 09 14:48:01.682310 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-fd9226c3-765d-4cd3-8596-8cfddbdbd44b req-e50bdc18-b318-4c9c-ba47-7819692e37aa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098505 Aug 09 14:48:01.688257 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1904/3762] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:01.848296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cb1c6be7-8459-4098-87a8-050b0f0381ef tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:01.849378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cb1c6be7-8459-4098-87a8-050b0f0381ef tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:01.943606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75d7f60c-bd3a-41ee-8b2c-3e6260fa223c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:01.944988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75d7f60c-bd3a-41ee-8b2c-3e6260fa223c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:01.998195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75d7f60c-bd3a-41ee-8b2c-3e6260fa223c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:02.003070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75d7f60c-bd3a-41ee-8b2c-3e6260fa223c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:02.006513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75d7f60c-bd3a-41ee-8b2c-3e6260fa223c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:02.008647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75d7f60c-bd3a-41ee-8b2c-3e6260fa223c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:02.025692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75d7f60c-bd3a-41ee-8b2c-3e6260fa223c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:02.025692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75d7f60c-bd3a-41ee-8b2c-3e6260fa223c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:02.041556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cb1c6be7-8459-4098-87a8-050b0f0381ef tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:02.060250 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cb1c6be7-8459-4098-87a8-050b0f0381ef tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1218 microversion: 2.1 time: 0.216918 Aug 09 14:48:02.076000 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1859/3763] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:01 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1218 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:02.386560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-cd5fa3ae-d2dd-4675-8ea9-4fbd8bda0c05 req-6b40892e-43ca-4e5d-a533-0a9d482cf82b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7acba673-037e-4f32-ac61-9f37ecbeeec5", "name": "network-vif-deleted", "tag": "87b21f16-e01c-49d8-ba9b-e9701c27d4e4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:02.418649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cd5fa3ae-d2dd-4675-8ea9-4fbd8bda0c05 req-6b40892e-43ca-4e5d-a533-0a9d482cf82b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:02.422504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cd5fa3ae-d2dd-4675-8ea9-4fbd8bda0c05 req-6b40892e-43ca-4e5d-a533-0a9d482cf82b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:02.423076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cd5fa3ae-d2dd-4675-8ea9-4fbd8bda0c05 req-6b40892e-43ca-4e5d-a533-0a9d482cf82b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:02.439739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-75d7f60c-bd3a-41ee-8b2c-3e6260fa223c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:02.456907 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75d7f60c-bd3a-41ee-8b2c-3e6260fa223c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1294 microversion: 2.1 time: 0.518864 Aug 09 14:48:02.461299 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1905/3764] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:01 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1294 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:02.465579 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-cd5fa3ae-d2dd-4675-8ea9-4fbd8bda0c05 req-6b40892e-43ca-4e5d-a533-0a9d482cf82b service nova] Creating event network-vif-deleted:87b21f16-e01c-49d8-ba9b-e9701c27d4e4 for instance 7acba673-037e-4f32-ac61-9f37ecbeeec5 on n-h1-844626-8 Aug 09 14:48:02.475981 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-cd5fa3ae-d2dd-4675-8ea9-4fbd8bda0c05 req-6b40892e-43ca-4e5d-a533-0a9d482cf82b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093811 Aug 09 14:48:02.477258 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1860/3765] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:03.082624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09e639fb-a629-4a7d-b36f-b125baa373b9 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:03.083443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-09e639fb-a629-4a7d-b36f-b125baa373b9 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:03.126301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09e639fb-a629-4a7d-b36f-b125baa373b9 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:03.127480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09e639fb-a629-4a7d-b36f-b125baa373b9 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:03.130619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09e639fb-a629-4a7d-b36f-b125baa373b9 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:03.134832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09e639fb-a629-4a7d-b36f-b125baa373b9 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:03.150585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09e639fb-a629-4a7d-b36f-b125baa373b9 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:03.155573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09e639fb-a629-4a7d-b36f-b125baa373b9 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:03.485477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-caad190a-ae15-4164-a45b-1f627f27ed83 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:03.486250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-caad190a-ae15-4164-a45b-1f627f27ed83 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:03.505473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caad190a-ae15-4164-a45b-1f627f27ed83 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:03.506168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caad190a-ae15-4164-a45b-1f627f27ed83 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:03.506792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caad190a-ae15-4164-a45b-1f627f27ed83 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:03.508190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caad190a-ae15-4164-a45b-1f627f27ed83 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:03.508863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caad190a-ae15-4164-a45b-1f627f27ed83 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:03.509428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caad190a-ae15-4164-a45b-1f627f27ed83 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:03.641745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-09e639fb-a629-4a7d-b36f-b125baa373b9 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:03.661644 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09e639fb-a629-4a7d-b36f-b125baa373b9 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1278 microversion: 2.1 time: 0.582044 Aug 09 14:48:03.681508 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1906/3766] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:03 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1278 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:03.872027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-d528b31d-efa3-4de3-8ea8-d1486bcafea4 req-8c5c418e-5708-4032-aa6a-a20328c74427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "372a7545-fba6-408b-a38c-42008793c527", "name": "network-vif-deleted", "tag": "b0f1168b-97c4-481d-9fba-f38870e9d2d4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:03.902808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d528b31d-efa3-4de3-8ea8-d1486bcafea4 req-8c5c418e-5708-4032-aa6a-a20328c74427 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:03.909226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d528b31d-efa3-4de3-8ea8-d1486bcafea4 req-8c5c418e-5708-4032-aa6a-a20328c74427 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:03.909975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d528b31d-efa3-4de3-8ea8-d1486bcafea4 req-8c5c418e-5708-4032-aa6a-a20328c74427 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:03.955436 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d528b31d-efa3-4de3-8ea8-d1486bcafea4 req-8c5c418e-5708-4032-aa6a-a20328c74427 service nova] Creating event network-vif-deleted:b0f1168b-97c4-481d-9fba-f38870e9d2d4 for instance 372a7545-fba6-408b-a38c-42008793c527 on n-h2-844626-8 Aug 09 14:48:03.983781 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-d528b31d-efa3-4de3-8ea8-d1486bcafea4 req-8c5c418e-5708-4032-aa6a-a20328c74427 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114738 Aug 09 14:48:03.987853 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1907/3767] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:48:04.449683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-caad190a-ae15-4164-a45b-1f627f27ed83 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:04.460900 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-caad190a-ae15-4164-a45b-1f627f27ed83 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1294 microversion: 2.1 time: 0.983216 Aug 09 14:48:04.465168 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1861/3768] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:03 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1294 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:48:04.664189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-4f427be9-7606-4cb3-a2f9-8e6a57e3d6d3 req-83587d2c-e3e3-4442-bc0d-adde7e46ad9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "tag": "e7aebd18-0445-48e5-9830-d801f5f45d18"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:04.679405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:04.690967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ad729a9-fcea-4b90-8290-ab85ea3f1f35 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:04.692303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ad729a9-fcea-4b90-8290-ab85ea3f1f35 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:04.711466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4f427be9-7606-4cb3-a2f9-8e6a57e3d6d3 req-83587d2c-e3e3-4442-bc0d-adde7e46ad9f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:04.711820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad729a9-fcea-4b90-8290-ab85ea3f1f35 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:04.712519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad729a9-fcea-4b90-8290-ab85ea3f1f35 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:04.713417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad729a9-fcea-4b90-8290-ab85ea3f1f35 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:04.714089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4f427be9-7606-4cb3-a2f9-8e6a57e3d6d3 req-83587d2c-e3e3-4442-bc0d-adde7e46ad9f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:04.717124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4f427be9-7606-4cb3-a2f9-8e6a57e3d6d3 req-83587d2c-e3e3-4442-bc0d-adde7e46ad9f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:04.719799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad729a9-fcea-4b90-8290-ab85ea3f1f35 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:04.720512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad729a9-fcea-4b90-8290-ab85ea3f1f35 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:04.721488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ad729a9-fcea-4b90-8290-ab85ea3f1f35 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:04.759310 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-4f427be9-7606-4cb3-a2f9-8e6a57e3d6d3 req-83587d2c-e3e3-4442-bc0d-adde7e46ad9f service nova] Creating event network-changed:e7aebd18-0445-48e5-9830-d801f5f45d18 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:48:04.768689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:04.784515 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-4f427be9-7606-4cb3-a2f9-8e6a57e3d6d3 req-83587d2c-e3e3-4442-bc0d-adde7e46ad9f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121737 Aug 09 14:48:04.789627 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1908/3769] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:04.927293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ad729a9-fcea-4b90-8290-ab85ea3f1f35 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:04.946926 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ad729a9-fcea-4b90-8290-ab85ea3f1f35 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1276 microversion: 2.1 time: 0.260652 Aug 09 14:48:04.967493 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1862/3770] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:04 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1276 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:05.488204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-02d668a4-860b-42e9-a1e5-7f2effd743ba tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:05.488977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-02d668a4-860b-42e9-a1e5-7f2effd743ba tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:05.499445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02d668a4-860b-42e9-a1e5-7f2effd743ba tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:05.508241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02d668a4-860b-42e9-a1e5-7f2effd743ba tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:05.510143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02d668a4-860b-42e9-a1e5-7f2effd743ba tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:05.515557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02d668a4-860b-42e9-a1e5-7f2effd743ba tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:05.516489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02d668a4-860b-42e9-a1e5-7f2effd743ba tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:05.520461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02d668a4-860b-42e9-a1e5-7f2effd743ba tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:05.973534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07fd0cb5-fcc8-4b39-8282-adf742532e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:05.974274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07fd0cb5-fcc8-4b39-8282-adf742532e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:05.994602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07fd0cb5-fcc8-4b39-8282-adf742532e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:05.995669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07fd0cb5-fcc8-4b39-8282-adf742532e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:05.997851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07fd0cb5-fcc8-4b39-8282-adf742532e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:05.998863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07fd0cb5-fcc8-4b39-8282-adf742532e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:06.000155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07fd0cb5-fcc8-4b39-8282-adf742532e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:06.003687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07fd0cb5-fcc8-4b39-8282-adf742532e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:06.299828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07fd0cb5-fcc8-4b39-8282-adf742532e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:06.347076 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07fd0cb5-fcc8-4b39-8282-adf742532e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1276 microversion: 2.1 time: 0.377715 Aug 09 14:48:06.350808 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1863/3771] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:05 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1276 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:48:06.352278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-02d668a4-860b-42e9-a1e5-7f2effd743ba tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:06.365526 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-02d668a4-860b-42e9-a1e5-7f2effd743ba tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1294 microversion: 2.1 time: 0.881564 Aug 09 14:48:06.371138 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1909/3772] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:05 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1294 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:48:07.380540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2d9046e-7fc9-41d7-b7f2-13d140d77bee tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:07.381993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c2d9046e-7fc9-41d7-b7f2-13d140d77bee tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:07.398773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2d9046e-7fc9-41d7-b7f2-13d140d77bee tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:07.400869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2d9046e-7fc9-41d7-b7f2-13d140d77bee tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:07.403624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2d9046e-7fc9-41d7-b7f2-13d140d77bee tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:07.404735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2d9046e-7fc9-41d7-b7f2-13d140d77bee tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:07.411334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-374d4a11-4cd9-45fb-b7d8-653eca316e45 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:07.411814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2d9046e-7fc9-41d7-b7f2-13d140d77bee tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:07.412269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2d9046e-7fc9-41d7-b7f2-13d140d77bee tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:07.412810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-374d4a11-4cd9-45fb-b7d8-653eca316e45 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:07.422209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-374d4a11-4cd9-45fb-b7d8-653eca316e45 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:07.424114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-374d4a11-4cd9-45fb-b7d8-653eca316e45 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:07.424756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-374d4a11-4cd9-45fb-b7d8-653eca316e45 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:07.425655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-374d4a11-4cd9-45fb-b7d8-653eca316e45 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:07.426301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-374d4a11-4cd9-45fb-b7d8-653eca316e45 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:07.426953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-374d4a11-4cd9-45fb-b7d8-653eca316e45 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:07.554817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c2d9046e-7fc9-41d7-b7f2-13d140d77bee tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:07.572945 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2d9046e-7fc9-41d7-b7f2-13d140d77bee tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1276 microversion: 2.1 time: 0.197523 Aug 09 14:48:07.595224 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1864/3773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:07 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1276 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:07.626080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0c54f8d0-f634-4d45-808f-cc7077b7828b req-634e142e-d078-4b29-8b6d-d8e4e583ec7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1379ae48-c028-4c75-9d03-e9763b74ee26", "name": "network-vif-plugged", "status": "completed", "tag": "ba2d3796-12d3-490e-9866-ad13300d7ffb"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:07.649079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0c54f8d0-f634-4d45-808f-cc7077b7828b req-634e142e-d078-4b29-8b6d-d8e4e583ec7a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:07.650946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0c54f8d0-f634-4d45-808f-cc7077b7828b req-634e142e-d078-4b29-8b6d-d8e4e583ec7a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:07.653057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0c54f8d0-f634-4d45-808f-cc7077b7828b req-634e142e-d078-4b29-8b6d-d8e4e583ec7a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:07.694344 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0c54f8d0-f634-4d45-808f-cc7077b7828b req-634e142e-d078-4b29-8b6d-d8e4e583ec7a service nova] Creating event network-vif-plugged:ba2d3796-12d3-490e-9866-ad13300d7ffb for instance 1379ae48-c028-4c75-9d03-e9763b74ee26 on n-h2-844626-8 Aug 09 14:48:07.700738 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0c54f8d0-f634-4d45-808f-cc7077b7828b req-634e142e-d078-4b29-8b6d-d8e4e583ec7a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080251 Aug 09 14:48:07.701859 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1865/3774] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:08.391928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-374d4a11-4cd9-45fb-b7d8-653eca316e45 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:08.402179 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-374d4a11-4cd9-45fb-b7d8-653eca316e45 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1294 microversion: 2.1 time: 1.003848 Aug 09 14:48:08.403625 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1910/3775] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:07 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1294 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:48:08.604715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-45d68f62-b257-413f-8df0-1e5a1a215e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:08.606080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-45d68f62-b257-413f-8df0-1e5a1a215e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:08.622741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45d68f62-b257-413f-8df0-1e5a1a215e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:08.625172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45d68f62-b257-413f-8df0-1e5a1a215e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:08.625853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45d68f62-b257-413f-8df0-1e5a1a215e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:08.630341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45d68f62-b257-413f-8df0-1e5a1a215e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:08.631249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45d68f62-b257-413f-8df0-1e5a1a215e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:08.631876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45d68f62-b257-413f-8df0-1e5a1a215e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:08.751761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45d68f62-b257-413f-8df0-1e5a1a215e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:08.762979 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-45d68f62-b257-413f-8df0-1e5a1a215e02 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1276 microversion: 2.1 time: 0.163506 Aug 09 14:48:08.766815 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1866/3776] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:08 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1276 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:09.424251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5d60c75c-d57b-4228-9b47-f2e9471554c2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:09.425599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5d60c75c-d57b-4228-9b47-f2e9471554c2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:09.442119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d60c75c-d57b-4228-9b47-f2e9471554c2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:09.443230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d60c75c-d57b-4228-9b47-f2e9471554c2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:09.444914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d60c75c-d57b-4228-9b47-f2e9471554c2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:09.450600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d60c75c-d57b-4228-9b47-f2e9471554c2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:09.451489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d60c75c-d57b-4228-9b47-f2e9471554c2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:09.453332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d60c75c-d57b-4228-9b47-f2e9471554c2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:09.756081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-bc3caac3-0310-44e8-bf53-2b577a5df2e7 req-e1c70c2a-58c3-494e-b48c-fd833a2b3652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d1bc1a4-e0a4-41b3-a792-5370908d8e1a", "tag": "865fb7af-2dbd-49e7-8b3c-cbdeb5478736"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:09.788229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bc3caac3-0310-44e8-bf53-2b577a5df2e7 req-e1c70c2a-58c3-494e-b48c-fd833a2b3652 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:09.788889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bc3caac3-0310-44e8-bf53-2b577a5df2e7 req-e1c70c2a-58c3-494e-b48c-fd833a2b3652 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:09.791442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bc3caac3-0310-44e8-bf53-2b577a5df2e7 req-e1c70c2a-58c3-494e-b48c-fd833a2b3652 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:09.823078 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-bc3caac3-0310-44e8-bf53-2b577a5df2e7 req-e1c70c2a-58c3-494e-b48c-fd833a2b3652 service nova] Creating event network-changed:865fb7af-2dbd-49e7-8b3c-cbdeb5478736 for instance 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a on n-h1-844626-8 Aug 09 14:48:09.843128 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-bc3caac3-0310-44e8-bf53-2b577a5df2e7 req-e1c70c2a-58c3-494e-b48c-fd833a2b3652 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092667 Aug 09 14:48:09.846613 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1867/3777] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:48:09.861722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ccd45a35-bf9d-424b-8fa8-b261031e26c1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:09.864852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ccd45a35-bf9d-424b-8fa8-b261031e26c1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:09.873312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:09.877054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ccd45a35-bf9d-424b-8fa8-b261031e26c1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:09.877748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ccd45a35-bf9d-424b-8fa8-b261031e26c1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:09.880704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ccd45a35-bf9d-424b-8fa8-b261031e26c1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:09.881743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ccd45a35-bf9d-424b-8fa8-b261031e26c1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:09.882348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ccd45a35-bf9d-424b-8fa8-b261031e26c1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:09.882982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ccd45a35-bf9d-424b-8fa8-b261031e26c1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:09.939625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:10.277888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:10.564193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ccd45a35-bf9d-424b-8fa8-b261031e26c1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:10.579516 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ccd45a35-bf9d-424b-8fa8-b261031e26c1 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1318 microversion: 2.1 time: 0.729551 Aug 09 14:48:10.583435 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1868/3778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:09 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1318 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:10.820691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5d60c75c-d57b-4228-9b47-f2e9471554c2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:10.834281 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5d60c75c-d57b-4228-9b47-f2e9471554c2 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1294 microversion: 2.1 time: 1.414096 Aug 09 14:48:10.851028 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1911/3779] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:09 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1294 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:11.605307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-428dc71d-5d42-4a4d-be8b-b0c493172280 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:11.605967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-428dc71d-5d42-4a4d-be8b-b0c493172280 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:11.627005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-428dc71d-5d42-4a4d-be8b-b0c493172280 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:11.628940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-428dc71d-5d42-4a4d-be8b-b0c493172280 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:11.635520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-428dc71d-5d42-4a4d-be8b-b0c493172280 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:11.639154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-428dc71d-5d42-4a4d-be8b-b0c493172280 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:11.642408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-428dc71d-5d42-4a4d-be8b-b0c493172280 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:11.643459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-428dc71d-5d42-4a4d-be8b-b0c493172280 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:11.713083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-55413f7d-64da-49ca-836e-594877217579 req-d91aea8f-d4fa-41c6-bc68-e2a41405c048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb0cf23-9edc-47c3-9573-bd98fd9a0d90", "tag": "fedb63af-fc0c-4f42-9e80-4179b7e837f2"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:11.741853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-55413f7d-64da-49ca-836e-594877217579 req-d91aea8f-d4fa-41c6-bc68-e2a41405c048 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:11.742338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-55413f7d-64da-49ca-836e-594877217579 req-d91aea8f-d4fa-41c6-bc68-e2a41405c048 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:11.742767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-55413f7d-64da-49ca-836e-594877217579 req-d91aea8f-d4fa-41c6-bc68-e2a41405c048 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:11.778099 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-55413f7d-64da-49ca-836e-594877217579 req-d91aea8f-d4fa-41c6-bc68-e2a41405c048 service nova] Creating event network-changed:fedb63af-fc0c-4f42-9e80-4179b7e837f2 for instance afb0cf23-9edc-47c3-9573-bd98fd9a0d90 on n-h2-844626-8 Aug 09 14:48:11.792549 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-55413f7d-64da-49ca-836e-594877217579 req-d91aea8f-d4fa-41c6-bc68-e2a41405c048 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083153 Aug 09 14:48:11.793924 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1912/3780] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:48:11.856808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-acfd73c6-f13f-43b3-a5c2-6f62abf63566 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:11.858186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-acfd73c6-f13f-43b3-a5c2-6f62abf63566 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:11.880942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acfd73c6-f13f-43b3-a5c2-6f62abf63566 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:11.884501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acfd73c6-f13f-43b3-a5c2-6f62abf63566 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:11.888347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acfd73c6-f13f-43b3-a5c2-6f62abf63566 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:11.889262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acfd73c6-f13f-43b3-a5c2-6f62abf63566 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:11.889860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acfd73c6-f13f-43b3-a5c2-6f62abf63566 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:11.891372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acfd73c6-f13f-43b3-a5c2-6f62abf63566 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:12.058616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:12.589507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-428dc71d-5d42-4a4d-be8b-b0c493172280 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:12.600208 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-428dc71d-5d42-4a4d-be8b-b0c493172280 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1318 microversion: 2.1 time: 1.000020 Aug 09 14:48:12.601528 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1869/3781] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:11 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1318 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:12.812494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-acfd73c6-f13f-43b3-a5c2-6f62abf63566 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:12.822089 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-acfd73c6-f13f-43b3-a5c2-6f62abf63566 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1485 microversion: 2.1 time: 0.969524 Aug 09 14:48:12.835109 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1913/3782] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:11 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1485 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:12.844136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2edc5561-7111-402c-87e3-d1c4e6db5f86 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:12.844781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2edc5561-7111-402c-87e3-d1c4e6db5f86 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:12.858186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2edc5561-7111-402c-87e3-d1c4e6db5f86 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:12.858834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2edc5561-7111-402c-87e3-d1c4e6db5f86 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:12.859300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2edc5561-7111-402c-87e3-d1c4e6db5f86 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:12.860021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2edc5561-7111-402c-87e3-d1c4e6db5f86 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:12.860482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2edc5561-7111-402c-87e3-d1c4e6db5f86 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:12.860913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2edc5561-7111-402c-87e3-d1c4e6db5f86 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:13.093485 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2edc5561-7111-402c-87e3-d1c4e6db5f86 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.253729 Aug 09 14:48:13.094112 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1870/3783] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:48:12 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26/os-interface => generated 285 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:13.627335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fbd9c659-5d17-4cad-97c9-932e029c6c31 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:13.628714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fbd9c659-5d17-4cad-97c9-932e029c6c31 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:13.639624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd9c659-5d17-4cad-97c9-932e029c6c31 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:13.645398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd9c659-5d17-4cad-97c9-932e029c6c31 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:13.646113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd9c659-5d17-4cad-97c9-932e029c6c31 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:13.647189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd9c659-5d17-4cad-97c9-932e029c6c31 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:13.647795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd9c659-5d17-4cad-97c9-932e029c6c31 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:13.649489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbd9c659-5d17-4cad-97c9-932e029c6c31 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:14.567665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fbd9c659-5d17-4cad-97c9-932e029c6c31 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:14.576327 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fbd9c659-5d17-4cad-97c9-932e029c6c31 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1318 microversion: 2.1 time: 0.953520 Aug 09 14:48:14.585811 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1914/3784] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:13 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1318 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:15.110737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-51af2482-3b37-4668-9ef0-fded5bceb36f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:15.112078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-51af2482-3b37-4668-9ef0-fded5bceb36f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:15.126812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8060108a-33b4-4c04-915a-6f4319f5cb82 req-42e43f6d-445b-4665-93c9-f9a1d298e046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1379ae48-c028-4c75-9d03-e9763b74ee26", "tag": "ba2d3796-12d3-490e-9866-ad13300d7ffb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:15.147401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8060108a-33b4-4c04-915a-6f4319f5cb82 req-42e43f6d-445b-4665-93c9-f9a1d298e046 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:15.148353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8060108a-33b4-4c04-915a-6f4319f5cb82 req-42e43f6d-445b-4665-93c9-f9a1d298e046 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:15.149927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8060108a-33b4-4c04-915a-6f4319f5cb82 req-42e43f6d-445b-4665-93c9-f9a1d298e046 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:15.152536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51af2482-3b37-4668-9ef0-fded5bceb36f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:15.153043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51af2482-3b37-4668-9ef0-fded5bceb36f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:15.153679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51af2482-3b37-4668-9ef0-fded5bceb36f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:15.158650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51af2482-3b37-4668-9ef0-fded5bceb36f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:15.159538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51af2482-3b37-4668-9ef0-fded5bceb36f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:15.160406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51af2482-3b37-4668-9ef0-fded5bceb36f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:15.194623 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8060108a-33b4-4c04-915a-6f4319f5cb82 req-42e43f6d-445b-4665-93c9-f9a1d298e046 service nova] Creating event network-changed:ba2d3796-12d3-490e-9866-ad13300d7ffb for instance 1379ae48-c028-4c75-9d03-e9763b74ee26 on n-h2-844626-8 Aug 09 14:48:15.207333 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8060108a-33b4-4c04-915a-6f4319f5cb82 req-42e43f6d-445b-4665-93c9-f9a1d298e046 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084121 Aug 09 14:48:15.207970 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1915/3785] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:15.608506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc71a76d-3ecf-46b9-bdaf-ad02de5c1c71 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:15.609460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc71a76d-3ecf-46b9-bdaf-ad02de5c1c71 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:15.625201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc71a76d-3ecf-46b9-bdaf-ad02de5c1c71 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:15.626138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc71a76d-3ecf-46b9-bdaf-ad02de5c1c71 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:15.626943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc71a76d-3ecf-46b9-bdaf-ad02de5c1c71 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:15.628429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc71a76d-3ecf-46b9-bdaf-ad02de5c1c71 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:15.629709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc71a76d-3ecf-46b9-bdaf-ad02de5c1c71 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:15.631866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc71a76d-3ecf-46b9-bdaf-ad02de5c1c71 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:16.119239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-51af2482-3b37-4668-9ef0-fded5bceb36f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:16.132332 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-51af2482-3b37-4668-9ef0-fded5bceb36f tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1485 microversion: 2.1 time: 1.027888 Aug 09 14:48:16.137821 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1871/3786] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:15 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1485 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:16.153745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f275404c-4ef6-4b23-bad9-da1319a3cabe req-70e7f20a-5c73-4f92-99a9-2d00bc1f981c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d1bc1a4-e0a4-41b3-a792-5370908d8e1a", "name": "network-vif-plugged", "status": "completed", "tag": "865fb7af-2dbd-49e7-8b3c-cbdeb5478736"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:16.186264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f275404c-4ef6-4b23-bad9-da1319a3cabe req-70e7f20a-5c73-4f92-99a9-2d00bc1f981c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:16.187719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f275404c-4ef6-4b23-bad9-da1319a3cabe req-70e7f20a-5c73-4f92-99a9-2d00bc1f981c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:16.188858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f275404c-4ef6-4b23-bad9-da1319a3cabe req-70e7f20a-5c73-4f92-99a9-2d00bc1f981c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:16.235677 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f275404c-4ef6-4b23-bad9-da1319a3cabe req-70e7f20a-5c73-4f92-99a9-2d00bc1f981c service nova] Creating event network-vif-plugged:865fb7af-2dbd-49e7-8b3c-cbdeb5478736 for instance 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a on n-h1-844626-8 Aug 09 14:48:16.242317 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f275404c-4ef6-4b23-bad9-da1319a3cabe req-70e7f20a-5c73-4f92-99a9-2d00bc1f981c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098373 Aug 09 14:48:16.243592 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1872/3787] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:16.521510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dc71a76d-3ecf-46b9-bdaf-ad02de5c1c71 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:16.539369 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc71a76d-3ecf-46b9-bdaf-ad02de5c1c71 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1318 microversion: 2.1 time: 0.936234 Aug 09 14:48:16.540414 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1916/3788] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:15 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1318 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:48:17.578719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-367bf5ab-0742-4ef8-beb9-094dbf04a6db tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:17.581166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-367bf5ab-0742-4ef8-beb9-094dbf04a6db tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:17.606501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-367bf5ab-0742-4ef8-beb9-094dbf04a6db tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:17.607016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-367bf5ab-0742-4ef8-beb9-094dbf04a6db tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:17.607500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-367bf5ab-0742-4ef8-beb9-094dbf04a6db tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:17.611587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-367bf5ab-0742-4ef8-beb9-094dbf04a6db tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:17.612536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-367bf5ab-0742-4ef8-beb9-094dbf04a6db tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:17.615282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-367bf5ab-0742-4ef8-beb9-094dbf04a6db tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:18.022868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-367bf5ab-0742-4ef8-beb9-094dbf04a6db tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:18.033082 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-367bf5ab-0742-4ef8-beb9-094dbf04a6db tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1318 microversion: 2.1 time: 0.475934 Aug 09 14:48:18.038371 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1873/3789] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:17 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1318 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:19.060731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aaeb6e65-500e-4e5f-88e8-3bc067f76842 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:19.061358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aaeb6e65-500e-4e5f-88e8-3bc067f76842 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:19.081551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-36216f22-8da2-44bd-8588-126b577cfc62 req-5d4fda3d-8ea6-48db-b675-462e1ee04c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb0cf23-9edc-47c3-9573-bd98fd9a0d90", "name": "network-vif-plugged", "status": "completed", "tag": "fedb63af-fc0c-4f42-9e80-4179b7e837f2"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:19.091122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaeb6e65-500e-4e5f-88e8-3bc067f76842 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:19.094130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaeb6e65-500e-4e5f-88e8-3bc067f76842 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:19.094689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaeb6e65-500e-4e5f-88e8-3bc067f76842 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:19.096295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaeb6e65-500e-4e5f-88e8-3bc067f76842 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:19.097773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaeb6e65-500e-4e5f-88e8-3bc067f76842 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:19.102514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aaeb6e65-500e-4e5f-88e8-3bc067f76842 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:19.119656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-36216f22-8da2-44bd-8588-126b577cfc62 req-5d4fda3d-8ea6-48db-b675-462e1ee04c46 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:19.120233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-36216f22-8da2-44bd-8588-126b577cfc62 req-5d4fda3d-8ea6-48db-b675-462e1ee04c46 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:19.120568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-36216f22-8da2-44bd-8588-126b577cfc62 req-5d4fda3d-8ea6-48db-b675-462e1ee04c46 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:19.166476 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-36216f22-8da2-44bd-8588-126b577cfc62 req-5d4fda3d-8ea6-48db-b675-462e1ee04c46 service nova] Creating event network-vif-plugged:fedb63af-fc0c-4f42-9e80-4179b7e837f2 for instance afb0cf23-9edc-47c3-9573-bd98fd9a0d90 on n-h2-844626-8 Aug 09 14:48:19.188926 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-36216f22-8da2-44bd-8588-126b577cfc62 req-5d4fda3d-8ea6-48db-b675-462e1ee04c46 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106570 Aug 09 14:48:19.192893 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1874/3790] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:19.203723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-83cff13c-b0bc-460c-9fcb-25c9c68426c7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:19.204315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-83cff13c-b0bc-460c-9fcb-25c9c68426c7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:19.226654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83cff13c-b0bc-460c-9fcb-25c9c68426c7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:19.227183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83cff13c-b0bc-460c-9fcb-25c9c68426c7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:19.227618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83cff13c-b0bc-460c-9fcb-25c9c68426c7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:19.228326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83cff13c-b0bc-460c-9fcb-25c9c68426c7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:19.228788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83cff13c-b0bc-460c-9fcb-25c9c68426c7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:19.229222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83cff13c-b0bc-460c-9fcb-25c9c68426c7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:19.320047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-83cff13c-b0bc-460c-9fcb-25c9c68426c7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:48:19.475236 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-83cff13c-b0bc-460c-9fcb-25c9c68426c7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 204 len: 0 microversion: 2.1 time: 0.280305 Aug 09 14:48:19.477039 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1875/3791] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:48:19 2022] DELETE /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:48:19.491960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84cd016c-dc9f-468f-aa91-0bd11acb65c5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:19.492815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84cd016c-dc9f-468f-aa91-0bd11acb65c5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:19.507343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84cd016c-dc9f-468f-aa91-0bd11acb65c5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:19.507938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84cd016c-dc9f-468f-aa91-0bd11acb65c5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:19.508373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84cd016c-dc9f-468f-aa91-0bd11acb65c5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:19.515603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84cd016c-dc9f-468f-aa91-0bd11acb65c5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:19.516090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84cd016c-dc9f-468f-aa91-0bd11acb65c5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:19.517574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84cd016c-dc9f-468f-aa91-0bd11acb65c5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:19.761047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aaeb6e65-500e-4e5f-88e8-3bc067f76842 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:19.772303 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aaeb6e65-500e-4e5f-88e8-3bc067f76842 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1318 microversion: 2.1 time: 0.716731 Aug 09 14:48:19.790095 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1917/3792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:19 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1318 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:19.885722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-84cd016c-dc9f-468f-aa91-0bd11acb65c5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:19.902134 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84cd016c-dc9f-468f-aa91-0bd11acb65c5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1554 microversion: 2.1 time: 0.420513 Aug 09 14:48:19.902765 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1876/3793] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:19 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1554 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:20.797333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f7b772ff-3bb1-4f3c-b7c6-25002dc528fb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:20.798944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7b772ff-3bb1-4f3c-b7c6-25002dc528fb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:20.807390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7b772ff-3bb1-4f3c-b7c6-25002dc528fb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:20.808154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7b772ff-3bb1-4f3c-b7c6-25002dc528fb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:20.808969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7b772ff-3bb1-4f3c-b7c6-25002dc528fb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:20.810038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7b772ff-3bb1-4f3c-b7c6-25002dc528fb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:20.810789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7b772ff-3bb1-4f3c-b7c6-25002dc528fb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:20.811288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7b772ff-3bb1-4f3c-b7c6-25002dc528fb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:20.932128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c446505-acde-497d-bdf5-11ca307624f7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:20.933051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6c446505-acde-497d-bdf5-11ca307624f7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:20.953330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c446505-acde-497d-bdf5-11ca307624f7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:20.953876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c446505-acde-497d-bdf5-11ca307624f7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:20.954317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c446505-acde-497d-bdf5-11ca307624f7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:20.962493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c446505-acde-497d-bdf5-11ca307624f7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:20.963071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c446505-acde-497d-bdf5-11ca307624f7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:20.964964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c446505-acde-497d-bdf5-11ca307624f7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:20.988745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f7b772ff-3bb1-4f3c-b7c6-25002dc528fb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:21.002923 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f7b772ff-3bb1-4f3c-b7c6-25002dc528fb tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1318 microversion: 2.1 time: 0.205470 Aug 09 14:48:21.020840 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1918/3794] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:20 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:21.285033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6c446505-acde-497d-bdf5-11ca307624f7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:21.298722 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6c446505-acde-497d-bdf5-11ca307624f7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1554 microversion: 2.1 time: 0.374937 Aug 09 14:48:21.302309 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1877/3795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:20 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1554 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:22.029466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e57ed93e-5ad3-4359-ac98-eef16797ebb6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:22.030874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e57ed93e-5ad3-4359-ac98-eef16797ebb6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:22.042926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e57ed93e-5ad3-4359-ac98-eef16797ebb6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:22.043444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e57ed93e-5ad3-4359-ac98-eef16797ebb6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:22.047877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e57ed93e-5ad3-4359-ac98-eef16797ebb6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:22.052905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e57ed93e-5ad3-4359-ac98-eef16797ebb6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:22.053411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e57ed93e-5ad3-4359-ac98-eef16797ebb6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:22.053885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e57ed93e-5ad3-4359-ac98-eef16797ebb6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:22.275450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e57ed93e-5ad3-4359-ac98-eef16797ebb6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:22.290464 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e57ed93e-5ad3-4359-ac98-eef16797ebb6 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 200 len: 1506 microversion: 2.1 time: 0.266454 Aug 09 14:48:22.296504 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1919/3796] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:22 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:22.314417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-050a53be-2d2f-4ae7-8692-122c74fce51f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:22.315488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-050a53be-2d2f-4ae7-8692-122c74fce51f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:22.324886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-050a53be-2d2f-4ae7-8692-122c74fce51f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:22.325526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5efc221c-611d-4366-a23f-446f0f6a55d5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:22.326115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-050a53be-2d2f-4ae7-8692-122c74fce51f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:22.326282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5efc221c-611d-4366-a23f-446f0f6a55d5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:22.326960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-050a53be-2d2f-4ae7-8692-122c74fce51f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:22.327849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-050a53be-2d2f-4ae7-8692-122c74fce51f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:22.328561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-050a53be-2d2f-4ae7-8692-122c74fce51f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:22.329144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-050a53be-2d2f-4ae7-8692-122c74fce51f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:22.334545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5efc221c-611d-4366-a23f-446f0f6a55d5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:22.335661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5efc221c-611d-4366-a23f-446f0f6a55d5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:22.336356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5efc221c-611d-4366-a23f-446f0f6a55d5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:22.337481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5efc221c-611d-4366-a23f-446f0f6a55d5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:22.338306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5efc221c-611d-4366-a23f-446f0f6a55d5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:22.339022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5efc221c-611d-4366-a23f-446f0f6a55d5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:22.507005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5efc221c-611d-4366-a23f-446f0f6a55d5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:22.525545 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5efc221c-611d-4366-a23f-446f0f6a55d5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1512 microversion: 2.1 time: 0.204700 Aug 09 14:48:22.526145 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1920/3797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:22 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:48:22.625481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-558f93c5-f77f-48f5-9b9e-37d825aabe6d req-7ec609c2-6df0-4a47-8c65-0462a9580610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fbebfa-9a85-4730-843f-9863ac60c365", "name": "network-vif-deleted", "tag": "8508749d-11fb-461b-8a81-7fac3aeb9ac9"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:22.661017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-558f93c5-f77f-48f5-9b9e-37d825aabe6d req-7ec609c2-6df0-4a47-8c65-0462a9580610 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:22.662838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-558f93c5-f77f-48f5-9b9e-37d825aabe6d req-7ec609c2-6df0-4a47-8c65-0462a9580610 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:22.664704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-558f93c5-f77f-48f5-9b9e-37d825aabe6d req-7ec609c2-6df0-4a47-8c65-0462a9580610 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:22.688063 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-558f93c5-f77f-48f5-9b9e-37d825aabe6d req-7ec609c2-6df0-4a47-8c65-0462a9580610 service nova] Creating event network-vif-deleted:8508749d-11fb-461b-8a81-7fac3aeb9ac9 for instance 99fbebfa-9a85-4730-843f-9863ac60c365 on n-h1-844626-8 Aug 09 14:48:22.694131 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-558f93c5-f77f-48f5-9b9e-37d825aabe6d req-7ec609c2-6df0-4a47-8c65-0462a9580610 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073108 Aug 09 14:48:22.695918 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1921/3798] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:22.705339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-050a53be-2d2f-4ae7-8692-122c74fce51f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:22.720637 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-050a53be-2d2f-4ae7-8692-122c74fce51f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a" status: 200 len: 1506 microversion: 2.1 time: 0.410947 Aug 09 14:48:22.721283 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1878/3799] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:22 2022] GET /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:22.749310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e94268c-f60d-4f73-8938-ff4d819e6e2f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:22.758321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e94268c-f60d-4f73-8938-ff4d819e6e2f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:22.777711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e94268c-f60d-4f73-8938-ff4d819e6e2f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:22.778727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e94268c-f60d-4f73-8938-ff4d819e6e2f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:22.778727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e94268c-f60d-4f73-8938-ff4d819e6e2f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:22.779452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e94268c-f60d-4f73-8938-ff4d819e6e2f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:22.779909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e94268c-f60d-4f73-8938-ff4d819e6e2f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:22.780648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e94268c-f60d-4f73-8938-ff4d819e6e2f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:22.866346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e94268c-f60d-4f73-8938-ff4d819e6e2f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:48:23.067301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:23.111602 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e94268c-f60d-4f73-8938-ff4d819e6e2f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a" status: 204 len: 0 microversion: 2.1 time: 0.368149 Aug 09 14:48:23.112921 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1922/3800] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:48:22 2022] DELETE /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:48:23.123635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87653573-1e65-4154-9804-c7f836cc1476 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:23.124794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-87653573-1e65-4154-9804-c7f836cc1476 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:23.134042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87653573-1e65-4154-9804-c7f836cc1476 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:23.134787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87653573-1e65-4154-9804-c7f836cc1476 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:23.135432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87653573-1e65-4154-9804-c7f836cc1476 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:23.136601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87653573-1e65-4154-9804-c7f836cc1476 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:23.137411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87653573-1e65-4154-9804-c7f836cc1476 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:23.138217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87653573-1e65-4154-9804-c7f836cc1476 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:23.171927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-87653573-1e65-4154-9804-c7f836cc1476 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:48:23.223727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:23.330520 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87653573-1e65-4154-9804-c7f836cc1476 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "DELETE /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 204 len: 0 microversion: 2.1 time: 0.209497 Aug 09 14:48:23.332288 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1879/3801] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:48:23 2022] DELETE /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:48:23.342129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-68d30329-f2ae-485f-ab48-8854052f1a30 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:23.342833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-68d30329-f2ae-485f-ab48-8854052f1a30 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:23.368200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68d30329-f2ae-485f-ab48-8854052f1a30 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:23.368698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68d30329-f2ae-485f-ab48-8854052f1a30 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:23.371364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68d30329-f2ae-485f-ab48-8854052f1a30 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:23.375001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68d30329-f2ae-485f-ab48-8854052f1a30 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:23.375684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68d30329-f2ae-485f-ab48-8854052f1a30 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:23.377465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68d30329-f2ae-485f-ab48-8854052f1a30 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:23.551725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-183ce1b8-ea5f-4449-ad2c-63af6f9f9749 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:23.553256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-183ce1b8-ea5f-4449-ad2c-63af6f9f9749 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:23.569360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-183ce1b8-ea5f-4449-ad2c-63af6f9f9749 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:23.569601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-183ce1b8-ea5f-4449-ad2c-63af6f9f9749 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:23.570042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-183ce1b8-ea5f-4449-ad2c-63af6f9f9749 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:23.570875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-183ce1b8-ea5f-4449-ad2c-63af6f9f9749 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:23.571425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-183ce1b8-ea5f-4449-ad2c-63af6f9f9749 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:23.572436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-183ce1b8-ea5f-4449-ad2c-63af6f9f9749 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:23.715198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-183ce1b8-ea5f-4449-ad2c-63af6f9f9749 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:23.730541 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-183ce1b8-ea5f-4449-ad2c-63af6f9f9749 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1346 microversion: 2.1 time: 0.184683 Aug 09 14:48:23.731328 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1880/3802] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:23 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:23.940361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-68d30329-f2ae-485f-ab48-8854052f1a30 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:23.962720 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-68d30329-f2ae-485f-ab48-8854052f1a30 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a" status: 200 len: 1512 microversion: 2.1 time: 0.622544 Aug 09 14:48:23.979390 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1923/3803] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:23 2022] GET /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a => generated 1512 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:24.752592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c0b4f0f-1c32-4344-9f3c-18d7e3c94a7b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:24.753276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c0b4f0f-1c32-4344-9f3c-18d7e3c94a7b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:24.768487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0b4f0f-1c32-4344-9f3c-18d7e3c94a7b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:24.769013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0b4f0f-1c32-4344-9f3c-18d7e3c94a7b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:24.769498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0b4f0f-1c32-4344-9f3c-18d7e3c94a7b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:24.770209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0b4f0f-1c32-4344-9f3c-18d7e3c94a7b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:24.770663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0b4f0f-1c32-4344-9f3c-18d7e3c94a7b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:24.771134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c0b4f0f-1c32-4344-9f3c-18d7e3c94a7b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:24.940058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c0b4f0f-1c32-4344-9f3c-18d7e3c94a7b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:24.950223 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c0b4f0f-1c32-4344-9f3c-18d7e3c94a7b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1346 microversion: 2.1 time: 0.201489 Aug 09 14:48:24.964124 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1881/3804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:24 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1346 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:24.989926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-52ca170e-449c-4e9f-9858-fddfd06d632f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:24.990682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-52ca170e-449c-4e9f-9858-fddfd06d632f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:25.004854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52ca170e-449c-4e9f-9858-fddfd06d632f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:25.009528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52ca170e-449c-4e9f-9858-fddfd06d632f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:25.010238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52ca170e-449c-4e9f-9858-fddfd06d632f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:25.011293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52ca170e-449c-4e9f-9858-fddfd06d632f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:25.011907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52ca170e-449c-4e9f-9858-fddfd06d632f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:25.013117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52ca170e-449c-4e9f-9858-fddfd06d632f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:25.891128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-9df88638-d79a-42a9-9ec9-5cfe843d8d80 req-b8ec894a-5acf-442c-9a8b-852d6ec14681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d1bc1a4-e0a4-41b3-a792-5370908d8e1a", "name": "network-vif-deleted", "tag": "865fb7af-2dbd-49e7-8b3c-cbdeb5478736"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:25.938367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-52ca170e-449c-4e9f-9858-fddfd06d632f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:25.952725 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-52ca170e-449c-4e9f-9858-fddfd06d632f tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a" status: 200 len: 1512 microversion: 2.1 time: 0.971374 Aug 09 14:48:25.967759 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1924/3805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:24 2022] GET /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a => generated 1512 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:25.983230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27510eb6-c830-4f17-8846-a5da1269ba61 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:25.984137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9df88638-d79a-42a9-9ec9-5cfe843d8d80 req-b8ec894a-5acf-442c-9a8b-852d6ec14681 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:25.985041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-27510eb6-c830-4f17-8846-a5da1269ba61 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:25.988868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9df88638-d79a-42a9-9ec9-5cfe843d8d80 req-b8ec894a-5acf-442c-9a8b-852d6ec14681 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:25.989367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9df88638-d79a-42a9-9ec9-5cfe843d8d80 req-b8ec894a-5acf-442c-9a8b-852d6ec14681 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:26.006419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27510eb6-c830-4f17-8846-a5da1269ba61 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:26.008020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27510eb6-c830-4f17-8846-a5da1269ba61 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:26.009047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27510eb6-c830-4f17-8846-a5da1269ba61 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:26.019861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27510eb6-c830-4f17-8846-a5da1269ba61 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:26.027483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27510eb6-c830-4f17-8846-a5da1269ba61 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:26.028199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27510eb6-c830-4f17-8846-a5da1269ba61 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:26.056335 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9df88638-d79a-42a9-9ec9-5cfe843d8d80 req-b8ec894a-5acf-442c-9a8b-852d6ec14681 service nova] Creating event network-vif-deleted:865fb7af-2dbd-49e7-8b3c-cbdeb5478736 for instance 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a on n-h1-844626-8 Aug 09 14:48:26.071771 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-9df88638-d79a-42a9-9ec9-5cfe843d8d80 req-b8ec894a-5acf-442c-9a8b-852d6ec14681 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189266 Aug 09 14:48:26.075004 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1882/3806] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:26.271471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-27510eb6-c830-4f17-8846-a5da1269ba61 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:26.287024 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-27510eb6-c830-4f17-8846-a5da1269ba61 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1346 microversion: 2.1 time: 0.316390 Aug 09 14:48:26.294991 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1925/3807] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:25 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1346 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:26.324040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-00800d37-0a0a-440d-9394-8adc058f70e0 req-c771e3f5-e378-49e8-aac2-080ec837dd34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb0cf23-9edc-47c3-9573-bd98fd9a0d90", "name": "network-vif-deleted", "tag": "fedb63af-fc0c-4f42-9e80-4179b7e837f2"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:26.351243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-00800d37-0a0a-440d-9394-8adc058f70e0 req-c771e3f5-e378-49e8-aac2-080ec837dd34 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:26.352975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-00800d37-0a0a-440d-9394-8adc058f70e0 req-c771e3f5-e378-49e8-aac2-080ec837dd34 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:26.353637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-00800d37-0a0a-440d-9394-8adc058f70e0 req-c771e3f5-e378-49e8-aac2-080ec837dd34 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:26.396061 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-00800d37-0a0a-440d-9394-8adc058f70e0 req-c771e3f5-e378-49e8-aac2-080ec837dd34 service nova] Creating event network-vif-deleted:fedb63af-fc0c-4f42-9e80-4179b7e837f2 for instance afb0cf23-9edc-47c3-9573-bd98fd9a0d90 on n-h2-844626-8 Aug 09 14:48:26.412215 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-00800d37-0a0a-440d-9394-8adc058f70e0 req-c771e3f5-e378-49e8-aac2-080ec837dd34 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087011 Aug 09 14:48:26.414909 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1883/3808] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:26.974696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:26.975560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:27.016893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:27.017503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:27.017849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:27.018575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:27.024657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:27.032716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:27.127483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:27.131306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:27.132193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:27.133748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lazy-loading 'fault' on Instance uuid 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:48:27.324075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57fb2a36-31ca-4fd6-8da2-1a9e38f635ee tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:27.330057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57fb2a36-31ca-4fd6-8da2-1a9e38f635ee tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:27.355663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57fb2a36-31ca-4fd6-8da2-1a9e38f635ee tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:27.369340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57fb2a36-31ca-4fd6-8da2-1a9e38f635ee tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:27.369833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57fb2a36-31ca-4fd6-8da2-1a9e38f635ee tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:27.370629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57fb2a36-31ca-4fd6-8da2-1a9e38f635ee tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:27.371124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57fb2a36-31ca-4fd6-8da2-1a9e38f635ee tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:27.371599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57fb2a36-31ca-4fd6-8da2-1a9e38f635ee tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:27.613207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-57fb2a36-31ca-4fd6-8da2-1a9e38f635ee tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:27.625808 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57fb2a36-31ca-4fd6-8da2-1a9e38f635ee tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1346 microversion: 2.1 time: 0.312877 Aug 09 14:48:27.641019 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1884/3809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:27 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1346 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:27.672916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac6e55128794059b04e74e1fe8ea175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aec9ea2e96bf4bce80f7a13442ba5275', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:27.686066 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2062b4e7-9432-4902-9dcd-115672199f18 tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a" status: 200 len: 1308 microversion: 2.1 time: 0.714609 Aug 09 14:48:27.688354 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1926/3810] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:26 2022] GET /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a => generated 1308 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:28.658028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f26bf45-9ccb-49b0-b78b-885bfbf57f11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:28.658997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f26bf45-9ccb-49b0-b78b-885bfbf57f11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:28.680476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f26bf45-9ccb-49b0-b78b-885bfbf57f11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:28.686152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f26bf45-9ccb-49b0-b78b-885bfbf57f11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:28.694632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f26bf45-9ccb-49b0-b78b-885bfbf57f11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:28.696972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f26bf45-9ccb-49b0-b78b-885bfbf57f11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:28.697485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f26bf45-9ccb-49b0-b78b-885bfbf57f11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:28.701052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f26bf45-9ccb-49b0-b78b-885bfbf57f11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:28.709884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-362d13bc-e11e-4027-9801-47a9deec14fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:28.711161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-362d13bc-e11e-4027-9801-47a9deec14fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:28.726541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-362d13bc-e11e-4027-9801-47a9deec14fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:28.729980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-362d13bc-e11e-4027-9801-47a9deec14fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:28.732433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-362d13bc-e11e-4027-9801-47a9deec14fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:28.734146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-362d13bc-e11e-4027-9801-47a9deec14fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:28.735619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-362d13bc-e11e-4027-9801-47a9deec14fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:28.736382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-362d13bc-e11e-4027-9801-47a9deec14fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:28.777590 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-362d13bc-e11e-4027-9801-47a9deec14fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] HTTP exception thrown: Instance 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a could not be found. Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-362d13bc-e11e-4027-9801-47a9deec14fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Request method failure captured: Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a HTTP/1.1 Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nN41dXb8FVSwtVJR-A8JFJwqBzvgSFFTNXDxODSQXqXngYx5SAaoxjtAmnUbUJQeGDbqAv3F0jqd3R76pcImmLHBpE5xzQjzVnhSN9_nTWnccTuyEk6lpytdHYdaeRikRUA4KXw4UtxPcb7ulRI3YfrKFnb106tQ9Q2QNAjMH3rik4 Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: aec9ea2e96bf4bce80f7a13442ba5275 Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-MultipleCreateTestJSON-103965928 Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aec9ea2e96bf4bce80f7a13442ba5275", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aec9ea2e96bf4bce80f7a13442ba5275"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aec9ea2e96bf4bce80f7a13442ba5275"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aec9ea2e96bf4bce80f7a13442ba5275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-MultipleCreateTestJSON-103965928 Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: aec9ea2e96bf4bce80f7a13442ba5275 Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-MultipleCreateTestJSON-103965928 Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-MultipleCreateTestJSON-103965928-project Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 4ac6e55128794059b04e74e1fe8ea175 Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-MultipleCreateTestJSON-103965928-project Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a could not be found. Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '5d1bc1a4-e0a4-41b3-a792-5370908d8e1a'} Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a could not be found. Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a could not be found. Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:28.781733 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:28.786455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:28.786455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:28.786455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:28.786455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:48:28.786455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:48:28.786455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a could not be found. Aug 09 14:48:28.786455 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:28.793427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-362d13bc-e11e-4027-9801-47a9deec14fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Returning 404 to user: Instance 5d1bc1a4-e0a4-41b3-a792-5370908d8e1a could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:48:28.795996 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-362d13bc-e11e-4027-9801-47a9deec14fc tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a" status: 404 len: 111 microversion: 2.1 time: 0.090521 Aug 09 14:48:28.806924 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1927/3811] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:28 2022] GET /compute/v2.1/servers/5d1bc1a4-e0a4-41b3-a792-5370908d8e1a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:48:28.823046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-961111f0-8318-4f8d-aaed-d476c2fe56ff tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:28.825662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-961111f0-8318-4f8d-aaed-d476c2fe56ff tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] [instance: afb0cf23-9edc-47c3-9573-bd98fd9a0d90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:28.845843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-961111f0-8318-4f8d-aaed-d476c2fe56ff tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:28.848415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-961111f0-8318-4f8d-aaed-d476c2fe56ff tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:28.849050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-961111f0-8318-4f8d-aaed-d476c2fe56ff tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:28.850299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-961111f0-8318-4f8d-aaed-d476c2fe56ff tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:28.853267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-961111f0-8318-4f8d-aaed-d476c2fe56ff tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:28.853870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-961111f0-8318-4f8d-aaed-d476c2fe56ff tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:28.895070 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-961111f0-8318-4f8d-aaed-d476c2fe56ff tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] HTTP exception thrown: Instance afb0cf23-9edc-47c3-9573-bd98fd9a0d90 could not be found. Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-961111f0-8318-4f8d-aaed-d476c2fe56ff tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Request method failure captured: Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 HTTP/1.1 Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nN41dXb8FVSwtVJR-A8JFJwqBzvgSFFTNXDxODSQXqXngYx5SAaoxjtAmnUbUJQeGDbqAv3F0jqd3R76pcImmLHBpE5xzQjzVnhSN9_nTWnccTuyEk6lpytdHYdaeRikRUA4KXw4UtxPcb7ulRI3YfrKFnb106tQ9Q2QNAjMH3rik4 Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: aec9ea2e96bf4bce80f7a13442ba5275 Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-MultipleCreateTestJSON-103965928 Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aec9ea2e96bf4bce80f7a13442ba5275", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aec9ea2e96bf4bce80f7a13442ba5275"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aec9ea2e96bf4bce80f7a13442ba5275"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aec9ea2e96bf4bce80f7a13442ba5275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-MultipleCreateTestJSON-103965928 Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: aec9ea2e96bf4bce80f7a13442ba5275 Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-MultipleCreateTestJSON-103965928 Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-MultipleCreateTestJSON-103965928-project Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 4ac6e55128794059b04e74e1fe8ea175 Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-MultipleCreateTestJSON-103965928-project Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance afb0cf23-9edc-47c3-9573-bd98fd9a0d90 could not be found. Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'afb0cf23-9edc-47c3-9573-bd98fd9a0d90'} Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb0cf23-9edc-47c3-9573-bd98fd9a0d90 could not be found. Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb0cf23-9edc-47c3-9573-bd98fd9a0d90 could not be found. Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:28.899965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:28.904644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:28.904644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:28.904644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:28.904644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:48:28.904644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:48:28.904644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb0cf23-9edc-47c3-9573-bd98fd9a0d90 could not be found. Aug 09 14:48:28.904644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:28.908275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-961111f0-8318-4f8d-aaed-d476c2fe56ff tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] Returning 404 to user: Instance afb0cf23-9edc-47c3-9573-bd98fd9a0d90 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:48:28.911466 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-961111f0-8318-4f8d-aaed-d476c2fe56ff tempest-MultipleCreateTestJSON-103965928 tempest-MultipleCreateTestJSON-103965928-project] 10.222.0.50 "GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90" status: 404 len: 111 microversion: 2.1 time: 0.100542 Aug 09 14:48:28.921199 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1928/3812] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:28 2022] GET /compute/v2.1/servers/afb0cf23-9edc-47c3-9573-bd98fd9a0d90 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:48:28.930968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0f26bf45-9ccb-49b0-b78b-885bfbf57f11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:28.941921 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f26bf45-9ccb-49b0-b78b-885bfbf57f11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1346 microversion: 2.1 time: 0.289023 Aug 09 14:48:28.973134 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1885/3813] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:28 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1346 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:30.009686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ebe7bec4-341f-4288-81a2-8a8a265f8d1f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:30.011172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ebe7bec4-341f-4288-81a2-8a8a265f8d1f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:30.021037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebe7bec4-341f-4288-81a2-8a8a265f8d1f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:30.022036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebe7bec4-341f-4288-81a2-8a8a265f8d1f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:30.022684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebe7bec4-341f-4288-81a2-8a8a265f8d1f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:30.024031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebe7bec4-341f-4288-81a2-8a8a265f8d1f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:30.024767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebe7bec4-341f-4288-81a2-8a8a265f8d1f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:30.025428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebe7bec4-341f-4288-81a2-8a8a265f8d1f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:30.260138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ebe7bec4-341f-4288-81a2-8a8a265f8d1f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:30.273301 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ebe7bec4-341f-4288-81a2-8a8a265f8d1f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1346 microversion: 2.1 time: 0.280350 Aug 09 14:48:30.275561 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1929/3814] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:29 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1346 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:31.304969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:31.308001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:31.322280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:31.354630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:31.357638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:31.359488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:31.360901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:31.363343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:31.364035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:31.449121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:31.449910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:31.451070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:31.453639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lazy-loading 'fault' on Instance uuid 99fbebfa-9a85-4730-843f-9863ac60c365 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:48:31.645071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:31.693932 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d60eb35a-5bb4-4e2a-813e-5384736f1942 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 200 len: 1351 microversion: 2.1 time: 0.401938 Aug 09 14:48:31.696314 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1886/3815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:31 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 1351 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:32.719691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5924dac-62e4-4a9a-a3b9-b3cd1a0c1507 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:32.720247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5924dac-62e4-4a9a-a3b9-b3cd1a0c1507 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:32.733909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5924dac-62e4-4a9a-a3b9-b3cd1a0c1507 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:32.737475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5924dac-62e4-4a9a-a3b9-b3cd1a0c1507 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:32.738106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5924dac-62e4-4a9a-a3b9-b3cd1a0c1507 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:32.740898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5924dac-62e4-4a9a-a3b9-b3cd1a0c1507 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:32.741651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5924dac-62e4-4a9a-a3b9-b3cd1a0c1507 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:32.742206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5924dac-62e4-4a9a-a3b9-b3cd1a0c1507 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:32.779631 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-f5924dac-62e4-4a9a-a3b9-b3cd1a0c1507 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5924dac-62e4-4a9a-a3b9-b3cd1a0c1507 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 HTTP/1.1 Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '99fbebfa-9a85-4730-843f-9863ac60c365'} Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:32.781833 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:32.786065 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:32.786065 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:32.786065 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:32.786065 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:48:32.786065 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:48:32.786065 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:48:32.786065 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:32.787336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5924dac-62e4-4a9a-a3b9-b3cd1a0c1507 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:48:32.788467 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5924dac-62e4-4a9a-a3b9-b3cd1a0c1507 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 404 len: 111 microversion: 2.1 time: 0.073356 Aug 09 14:48:32.791592 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1930/3816] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:32 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:48:33.040316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c484f4a-4f60-4dcf-b663-b7d90680dadf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:33.042509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c484f4a-4f60-4dcf-b663-b7d90680dadf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:33.087160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c484f4a-4f60-4dcf-b663-b7d90680dadf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:33.088058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c484f4a-4f60-4dcf-b663-b7d90680dadf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:33.088709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c484f4a-4f60-4dcf-b663-b7d90680dadf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:33.090461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c484f4a-4f60-4dcf-b663-b7d90680dadf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:33.092516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c484f4a-4f60-4dcf-b663-b7d90680dadf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:33.093510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c484f4a-4f60-4dcf-b663-b7d90680dadf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:33.164149 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-7c484f4a-4f60-4dcf-b663-b7d90680dadf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c484f4a-4f60-4dcf-b663-b7d90680dadf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365/os-volume_attachments HTTP/1.1 Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'server_id': '99fbebfa-9a85-4730-843f-9863ac60c365'} Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:48:33.181410 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:48:33.185572 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:48:33.185572 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:33.185572 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:33.185572 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:33.185572 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:33.185572 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:33.185572 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:33.185572 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:48:33.185572 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:48:33.185572 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:48:33.185572 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:33.185572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c484f4a-4f60-4dcf-b663-b7d90680dadf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:48:33.186609 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c484f4a-4f60-4dcf-b663-b7d90680dadf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.155960 Aug 09 14:48:33.187293 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1887/3817] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:48:33 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365/os-volume_attachments => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:48:33.590050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-225844011", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:33.707650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cd0c9c6c-e49a-42d3-8539-726100ed13f6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:33.708203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cd0c9c6c-e49a-42d3-8539-726100ed13f6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:33.725562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] validate_networks() for [('583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:48:33.739845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd0c9c6c-e49a-42d3-8539-726100ed13f6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:33.744433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd0c9c6c-e49a-42d3-8539-726100ed13f6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:33.745130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd0c9c6c-e49a-42d3-8539-726100ed13f6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:33.746111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd0c9c6c-e49a-42d3-8539-726100ed13f6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:33.746842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd0c9c6c-e49a-42d3-8539-726100ed13f6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:33.753799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd0c9c6c-e49a-42d3-8539-726100ed13f6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:33.817262 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cd0c9c6c-e49a-42d3-8539-726100ed13f6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/ips" status: 200 len: 153 microversion: 2.20 time: 0.115564 Aug 09 14:48:33.818955 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1888/3818] 10.222.0.50 () {60 vars in 1289 bytes} [Tue Aug 9 14:48:33 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/ips => generated 153 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 14:48:35.827564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:48:35.828889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:48:35.829688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:48:35.830316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:48:35.830990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:48:35.834845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:35.862854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:35.863634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:35.877200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:35.878897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:35.880946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:35.883372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:35.966846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:48:35.985881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for user d970d0bf9e754591b09af75bbf64a96d and project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:48:36.027716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:48:36.039848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 460340e3-68cf-4917-84d1-85ac5b0fbaad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:48:36.157399 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea04ab73-daea-47ad-afff-1eb8af751128 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.572493 Aug 09 14:48:36.164169 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1931/3819] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:48:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:48:36.176029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-320303a8-eedb-4095-be04-5f88ae7d6910 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:36.178498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-320303a8-eedb-4095-be04-5f88ae7d6910 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 460340e3-68cf-4917-84d1-85ac5b0fbaad] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:36.674520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-320303a8-eedb-4095-be04-5f88ae7d6910 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:36.688666 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-320303a8-eedb-4095-be04-5f88ae7d6910 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad" status: 200 len: 1214 microversion: 2.1 time: 0.516333 Aug 09 14:48:36.706378 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1889/3820] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:36 2022] GET /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad => generated 1214 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:36.714524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-006b19b9-3264-466e-9ced-ad2c38f8b5e2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:36.715454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-006b19b9-3264-466e-9ced-ad2c38f8b5e2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 460340e3-68cf-4917-84d1-85ac5b0fbaad] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:36.789122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-006b19b9-3264-466e-9ced-ad2c38f8b5e2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 460340e3-68cf-4917-84d1-85ac5b0fbaad] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:48:37.304839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a5766536-0c84-4449-9a7d-cdb04ebc27e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:37.305620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a5766536-0c84-4449-9a7d-cdb04ebc27e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:37.336862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5766536-0c84-4449-9a7d-cdb04ebc27e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:37.338500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5766536-0c84-4449-9a7d-cdb04ebc27e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:37.340516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5766536-0c84-4449-9a7d-cdb04ebc27e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:37.345584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5766536-0c84-4449-9a7d-cdb04ebc27e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:37.346562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5766536-0c84-4449-9a7d-cdb04ebc27e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:37.348604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5766536-0c84-4449-9a7d-cdb04ebc27e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:37.420756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-a5766536-0c84-4449-9a7d-cdb04ebc27e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lazy-loading 'flavor' on Instance uuid c25a9384-ba3d-4ff8-8f2a-39ccdde0690a {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:48:37.553368 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.scheduler.client.report [None req-006b19b9-3264-466e-9ced-ad2c38f8b5e2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Deleted allocations for instance 460340e3-68cf-4917-84d1-85ac5b0fbaad Aug 09 14:48:37.634365 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-006b19b9-3264-466e-9ced-ad2c38f8b5e2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad" status: 204 len: 0 microversion: 2.1 time: 0.925503 Aug 09 14:48:37.640880 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1932/3821] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:48:36 2022] DELETE /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad => generated 0 bytes in 934 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:48:37.681083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-52574b8b-0e6b-47bb-b835-1eea9a13bc35 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:37.685367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-52574b8b-0e6b-47bb-b835-1eea9a13bc35 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 460340e3-68cf-4917-84d1-85ac5b0fbaad] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:37.730418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52574b8b-0e6b-47bb-b835-1eea9a13bc35 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:37.732196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52574b8b-0e6b-47bb-b835-1eea9a13bc35 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:37.733295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52574b8b-0e6b-47bb-b835-1eea9a13bc35 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:37.737512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52574b8b-0e6b-47bb-b835-1eea9a13bc35 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:37.740697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52574b8b-0e6b-47bb-b835-1eea9a13bc35 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:37.741459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52574b8b-0e6b-47bb-b835-1eea9a13bc35 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:37.776316 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-52574b8b-0e6b-47bb-b835-1eea9a13bc35 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-52574b8b-0e6b-47bb-b835-1eea9a13bc35 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad HTTP/1.1 Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '460340e3-68cf-4917-84d1-85ac5b0fbaad'} Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:37.780055 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:37.785891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:37.785891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:37.785891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:37.785891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:48:37.785891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:48:37.785891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:48:37.785891 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:37.792751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-52574b8b-0e6b-47bb-b835-1eea9a13bc35 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:48:37.794419 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-52574b8b-0e6b-47bb-b835-1eea9a13bc35 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad" status: 404 len: 111 microversion: 2.1 time: 0.147815 Aug 09 14:48:37.795555 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1933/3822] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:37 2022] GET /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:48:38.143541 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a5766536-0c84-4449-9a7d-cdb04ebc27e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "POST /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/action" status: 202 len: 0 microversion: 2.20 time: 0.844034 Aug 09 14:48:38.144871 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1890/3823] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:48:37 2022] POST /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/action => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:48:38.158788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60acc8a8-ccbe-439a-8533-7c7fc69f623b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:38.159879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-60acc8a8-ccbe-439a-8533-7c7fc69f623b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:38.176195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60acc8a8-ccbe-439a-8533-7c7fc69f623b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:38.176643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60acc8a8-ccbe-439a-8533-7c7fc69f623b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:38.177097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60acc8a8-ccbe-439a-8533-7c7fc69f623b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:38.178543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-308572463", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:38.179598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60acc8a8-ccbe-439a-8533-7c7fc69f623b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:38.180570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60acc8a8-ccbe-439a-8533-7c7fc69f623b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:38.182016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60acc8a8-ccbe-439a-8533-7c7fc69f623b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:38.305064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] validate_networks() for [('583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:48:38.594691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60acc8a8-ccbe-439a-8533-7c7fc69f623b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:38.610645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60acc8a8-ccbe-439a-8533-7c7fc69f623b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:38.615590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60acc8a8-ccbe-439a-8533-7c7fc69f623b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:38.621265 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60acc8a8-ccbe-439a-8533-7c7fc69f623b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1723 microversion: 2.20 time: 0.467273 Aug 09 14:48:38.622501 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1934/3824] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:38 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1723 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:48:39.272061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:48:39.273006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:48:39.273485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:48:39.274321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:48:39.275215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:48:39.292102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:39.293284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:39.293943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:39.295014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:39.295833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:39.296855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:39.360733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:48:39.380751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for user d970d0bf9e754591b09af75bbf64a96d and project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:48:39.422537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:48:39.432066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:48:39.562610 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7086f3a6-4893-4768-8878-e8379d0d7720 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400372 Aug 09 14:48:39.565489 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1891/3825] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:48:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:48:39.582088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1111081-41f1-4845-be45-2ef52e054eeb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:39.584127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1111081-41f1-4845-be45-2ef52e054eeb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:39.650368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d5f79fb-3d4a-4313-ad45-38c1afea378e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:39.650982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d5f79fb-3d4a-4313-ad45-38c1afea378e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:39.662880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d5f79fb-3d4a-4313-ad45-38c1afea378e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:39.663418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d5f79fb-3d4a-4313-ad45-38c1afea378e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:39.663851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d5f79fb-3d4a-4313-ad45-38c1afea378e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:39.667612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d5f79fb-3d4a-4313-ad45-38c1afea378e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:39.668800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d5f79fb-3d4a-4313-ad45-38c1afea378e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:39.669680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d5f79fb-3d4a-4313-ad45-38c1afea378e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:39.740774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1111081-41f1-4845-be45-2ef52e054eeb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:39.754691 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1111081-41f1-4845-be45-2ef52e054eeb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1214 microversion: 2.1 time: 0.181708 Aug 09 14:48:39.775388 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1935/3826] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:39 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1214 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:40.164187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d5f79fb-3d4a-4313-ad45-38c1afea378e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:40.182700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d5f79fb-3d4a-4313-ad45-38c1afea378e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:40.192278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d5f79fb-3d4a-4313-ad45-38c1afea378e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:40.198134 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d5f79fb-3d4a-4313-ad45-38c1afea378e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1723 microversion: 2.20 time: 0.547711 Aug 09 14:48:40.198795 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1892/3827] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:39 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1723 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:48:40.781932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30a1221e-2525-4132-8cf7-f640c734f8c6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:40.782583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30a1221e-2525-4132-8cf7-f640c734f8c6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:40.804858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30a1221e-2525-4132-8cf7-f640c734f8c6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:40.806791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30a1221e-2525-4132-8cf7-f640c734f8c6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:40.809080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30a1221e-2525-4132-8cf7-f640c734f8c6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:40.811632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30a1221e-2525-4132-8cf7-f640c734f8c6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:40.812579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30a1221e-2525-4132-8cf7-f640c734f8c6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:40.813620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30a1221e-2525-4132-8cf7-f640c734f8c6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:40.998217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30a1221e-2525-4132-8cf7-f640c734f8c6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:41.021024 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30a1221e-2525-4132-8cf7-f640c734f8c6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1266 microversion: 2.1 time: 0.242900 Aug 09 14:48:41.041439 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1936/3828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:40 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:41.225151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e169801-4f90-473c-b590-cbbdefb34ab3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:41.226791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e169801-4f90-473c-b590-cbbdefb34ab3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:41.243497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e169801-4f90-473c-b590-cbbdefb34ab3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:41.244336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e169801-4f90-473c-b590-cbbdefb34ab3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:41.247010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e169801-4f90-473c-b590-cbbdefb34ab3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:41.251803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e169801-4f90-473c-b590-cbbdefb34ab3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:41.252635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e169801-4f90-473c-b590-cbbdefb34ab3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:41.253562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e169801-4f90-473c-b590-cbbdefb34ab3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:41.803753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e169801-4f90-473c-b590-cbbdefb34ab3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:41.818493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e169801-4f90-473c-b590-cbbdefb34ab3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:41.822066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e169801-4f90-473c-b590-cbbdefb34ab3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:41.824176 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e169801-4f90-473c-b590-cbbdefb34ab3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1723 microversion: 2.20 time: 0.603417 Aug 09 14:48:41.847275 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1893/3829] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:41 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1723 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:48:42.049606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0714814b-8c2e-47be-8b67-6edf34818552 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:42.051460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0714814b-8c2e-47be-8b67-6edf34818552 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:42.071726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0714814b-8c2e-47be-8b67-6edf34818552 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:42.073629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0714814b-8c2e-47be-8b67-6edf34818552 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:42.076851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0714814b-8c2e-47be-8b67-6edf34818552 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:42.079164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0714814b-8c2e-47be-8b67-6edf34818552 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:42.083379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0714814b-8c2e-47be-8b67-6edf34818552 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:42.086686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0714814b-8c2e-47be-8b67-6edf34818552 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:42.267118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0714814b-8c2e-47be-8b67-6edf34818552 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:42.279898 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0714814b-8c2e-47be-8b67-6edf34818552 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1272 microversion: 2.1 time: 0.236066 Aug 09 14:48:42.289760 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1937/3830] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:42 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:42.384633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34287d33-ca13-40bf-aa38-ed2ef85797bc tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-91982308", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:42.388392 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-34287d33-ca13-40bf-aa38-ed2ef85797bc tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] HTTP exception thrown: min_count must be <= max_count Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34287d33-ca13-40bf-aa38-ed2ef85797bc tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Request method failure captured: Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 182 Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nPJ2AoG6PiC2XpVLUiRordJH9HPuBUGceOOWotzMbIFjj1hJV5-XIlIg-W_Ae3g8b2ITlmWv1IAuJUSYxtlpw2w-2hiPiWaqR91qdsIKqwrA3QxXPljz0U-QPBSnp2D_KiERcmxuC4Fi1-7ixx-sgu1B2Iaii-ynYPkm4D7P6SvucI Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 159694c8d8544350a4f4f5130f0f023b Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_159694c8d8544350a4f4f5130f0f023b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 159694c8d8544350a4f4f5130f0f023b Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-MultipleCreateNegativeTestJSON-521551693-project Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 626c678069334dbe98afd34cb91deb37 Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-521551693-project Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-91982308", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: exception: min_count must be <= max_count Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-91982308', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 09 14:48:42.390029 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.406552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34287d33-ca13-40bf-aa38-ed2ef85797bc tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Returning 400 to user: min_count must be <= max_count {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:48:42.409122 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34287d33-ca13-40bf-aa38-ed2ef85797bc tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.316757 Aug 09 14:48:42.411691 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1894/3831] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:48:42 2022] POST /compute/v2.1/servers => generated 74 bytes in 321 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 14:48:42.499565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-092f9b21-0bfa-4674-a45f-bddcfc91236e tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-337466314", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "max_count": 0}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-092f9b21-0bfa-4674-a45f-bddcfc91236e tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Request method failure captured: Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 167 Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nPJ2AoG6PiC2XpVLUiRordJH9HPuBUGceOOWotzMbIFjj1hJV5-XIlIg-W_Ae3g8b2ITlmWv1IAuJUSYxtlpw2w-2hiPiWaqR91qdsIKqwrA3QxXPljz0U-QPBSnp2D_KiERcmxuC4Fi1-7ixx-sgu1B2Iaii-ynYPkm4D7P6SvucI Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 159694c8d8544350a4f4f5130f0f023b Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_159694c8d8544350a4f4f5130f0f023b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 159694c8d8544350a4f4f5130f0f023b Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-MultipleCreateNegativeTestJSON-521551693-project Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 626c678069334dbe98afd34cb91deb37 Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-521551693-project Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-337466314", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "max_count": 0}} Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-337466314', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'max_count': 0}}} Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 0 Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:48:42.505471 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.511560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-092f9b21-0bfa-4674-a45f-bddcfc91236e tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:48:42.512953 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-092f9b21-0bfa-4674-a45f-bddcfc91236e tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016039 Aug 09 14:48:42.517219 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1938/3832] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:48:42 2022] POST /compute/v2.1/servers => generated 130 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:48:42.614010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-29aa6fdc-4af9-4a1d-9fbc-5a9d37894efc tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2023326659", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "max_count": 2.5}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-29aa6fdc-4af9-4a1d-9fbc-5a9d37894efc tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Request method failure captured: Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 170 Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nPJ2AoG6PiC2XpVLUiRordJH9HPuBUGceOOWotzMbIFjj1hJV5-XIlIg-W_Ae3g8b2ITlmWv1IAuJUSYxtlpw2w-2hiPiWaqR91qdsIKqwrA3QxXPljz0U-QPBSnp2D_KiERcmxuC4Fi1-7ixx-sgu1B2Iaii-ynYPkm4D7P6SvucI Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 159694c8d8544350a4f4f5130f0f023b Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_159694c8d8544350a4f4f5130f0f023b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 159694c8d8544350a4f4f5130f0f023b Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-MultipleCreateNegativeTestJSON-521551693-project Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 626c678069334dbe98afd34cb91deb37 Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-521551693-project Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2023326659", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "max_count": 2.5}} Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2023326659', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'max_count': 2.5}}} Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 2.5 Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:48:42.620301 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.624400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-29aa6fdc-4af9-4a1d-9fbc-5a9d37894efc tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:48:42.626869 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-29aa6fdc-4af9-4a1d-9fbc-5a9d37894efc tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017448 Aug 09 14:48:42.627531 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1895/3833] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:48:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:48:42.713109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27ba4f4c-70d6-4292-9ea3-9705b93fb104 tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1054998357", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "min_count": 0}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27ba4f4c-70d6-4292-9ea3-9705b93fb104 tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Request method failure captured: Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 168 Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nPJ2AoG6PiC2XpVLUiRordJH9HPuBUGceOOWotzMbIFjj1hJV5-XIlIg-W_Ae3g8b2ITlmWv1IAuJUSYxtlpw2w-2hiPiWaqR91qdsIKqwrA3QxXPljz0U-QPBSnp2D_KiERcmxuC4Fi1-7ixx-sgu1B2Iaii-ynYPkm4D7P6SvucI Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 159694c8d8544350a4f4f5130f0f023b Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_159694c8d8544350a4f4f5130f0f023b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 159694c8d8544350a4f4f5130f0f023b Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-MultipleCreateNegativeTestJSON-521551693-project Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 626c678069334dbe98afd34cb91deb37 Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-521551693-project Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1054998357", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "min_count": 0}} Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1054998357', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'min_count': 0}}} Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 0 Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:48:42.723573 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27ba4f4c-70d6-4292-9ea3-9705b93fb104 tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-27ba4f4c-70d6-4292-9ea3-9705b93fb104 tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.023061 Aug 09 14:48:42.737450 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1939/3834] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:48:42 2022] POST /compute/v2.1/servers => generated 130 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:48:42.854742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-15312b9d-fa7c-4a5a-a1a7-8d2763c896f5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:42.855700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-15312b9d-fa7c-4a5a-a1a7-8d2763c896f5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:42.868545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15312b9d-fa7c-4a5a-a1a7-8d2763c896f5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:42.869359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15312b9d-fa7c-4a5a-a1a7-8d2763c896f5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:42.871720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15312b9d-fa7c-4a5a-a1a7-8d2763c896f5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:42.873865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15312b9d-fa7c-4a5a-a1a7-8d2763c896f5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:42.874589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15312b9d-fa7c-4a5a-a1a7-8d2763c896f5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:42.877575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15312b9d-fa7c-4a5a-a1a7-8d2763c896f5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:42.904972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b45b4a8a-e7c1-414b-9976-efeb3888a831 tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1915634", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "min_count": 2.5}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b45b4a8a-e7c1-414b-9976-efeb3888a831 tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Request method failure captured: Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 167 Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nPJ2AoG6PiC2XpVLUiRordJH9HPuBUGceOOWotzMbIFjj1hJV5-XIlIg-W_Ae3g8b2ITlmWv1IAuJUSYxtlpw2w-2hiPiWaqR91qdsIKqwrA3QxXPljz0U-QPBSnp2D_KiERcmxuC4Fi1-7ixx-sgu1B2Iaii-ynYPkm4D7P6SvucI Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 159694c8d8544350a4f4f5130f0f023b Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_159694c8d8544350a4f4f5130f0f023b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/159694c8d8544350a4f4f5130f0f023b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 159694c8d8544350a4f4f5130f0f023b Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-521551693 Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-MultipleCreateNegativeTestJSON-521551693-project Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 626c678069334dbe98afd34cb91deb37 Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-521551693-project Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1915634", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "min_count": 2.5}} Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1915634', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'min_count': 2.5}}} Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 2.5 Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:48:42.921965 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 09 14:48:42.926751 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:48:42.930934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b45b4a8a-e7c1-414b-9976-efeb3888a831 tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:48:42.931974 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b45b4a8a-e7c1-414b-9976-efeb3888a831 tempest-MultipleCreateNegativeTestJSON-521551693 tempest-MultipleCreateNegativeTestJSON-521551693-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.033527 Aug 09 14:48:42.944947 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1940/3835] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:48:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:48:43.306756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34248c26-59e5-4f3a-9e00-5da76d02a8ef tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:43.307547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34248c26-59e5-4f3a-9e00-5da76d02a8ef tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:43.321666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34248c26-59e5-4f3a-9e00-5da76d02a8ef tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:43.322160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34248c26-59e5-4f3a-9e00-5da76d02a8ef tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:43.326862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34248c26-59e5-4f3a-9e00-5da76d02a8ef tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:43.327979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34248c26-59e5-4f3a-9e00-5da76d02a8ef tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:43.328463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34248c26-59e5-4f3a-9e00-5da76d02a8ef tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:43.341320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34248c26-59e5-4f3a-9e00-5da76d02a8ef tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:43.422358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-15312b9d-fa7c-4a5a-a1a7-8d2763c896f5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:43.437978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-15312b9d-fa7c-4a5a-a1a7-8d2763c896f5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:43.439739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-15312b9d-fa7c-4a5a-a1a7-8d2763c896f5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:43.441992 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-15312b9d-fa7c-4a5a-a1a7-8d2763c896f5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1723 microversion: 2.20 time: 0.591435 Aug 09 14:48:43.443470 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1896/3836] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:42 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1723 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:48:43.834212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-34248c26-59e5-4f3a-9e00-5da76d02a8ef tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:43.855145 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34248c26-59e5-4f3a-9e00-5da76d02a8ef tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1314 microversion: 2.1 time: 0.554339 Aug 09 14:48:43.856579 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1941/3837] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:43 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:44.469789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-722f03c3-7771-48f4-a267-0b8dc5e6bd67 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:44.470536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-722f03c3-7771-48f4-a267-0b8dc5e6bd67 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:44.484188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-722f03c3-7771-48f4-a267-0b8dc5e6bd67 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:44.484831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-722f03c3-7771-48f4-a267-0b8dc5e6bd67 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:44.485474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-722f03c3-7771-48f4-a267-0b8dc5e6bd67 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:44.486370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-722f03c3-7771-48f4-a267-0b8dc5e6bd67 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:44.490085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-722f03c3-7771-48f4-a267-0b8dc5e6bd67 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:44.490949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-722f03c3-7771-48f4-a267-0b8dc5e6bd67 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:44.788547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-722f03c3-7771-48f4-a267-0b8dc5e6bd67 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:44.808918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-722f03c3-7771-48f4-a267-0b8dc5e6bd67 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:44.816983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-722f03c3-7771-48f4-a267-0b8dc5e6bd67 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:44.818939 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-722f03c3-7771-48f4-a267-0b8dc5e6bd67 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1723 microversion: 2.20 time: 0.354303 Aug 09 14:48:44.819745 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1897/3838] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:44 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1723 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:48:44.879912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc3db735-d288-4c18-87f6-c0b1bcf17f8b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:44.880739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bc3db735-d288-4c18-87f6-c0b1bcf17f8b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:44.909204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc3db735-d288-4c18-87f6-c0b1bcf17f8b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:44.909860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc3db735-d288-4c18-87f6-c0b1bcf17f8b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:44.910528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc3db735-d288-4c18-87f6-c0b1bcf17f8b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:44.911538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc3db735-d288-4c18-87f6-c0b1bcf17f8b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:44.912587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc3db735-d288-4c18-87f6-c0b1bcf17f8b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:44.913226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc3db735-d288-4c18-87f6-c0b1bcf17f8b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:45.269021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ed625a1a-4077-4fce-82ba-9521e4bbbbd4 req-072be380-19a5-4828-9abd-9d38baa76ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "271e7ad9-2da4-4661-83b9-f55d0c7c7e73", "tag": "8fd29250-d175-4175-abd3-ef0d31da2ee9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:45.291769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ed625a1a-4077-4fce-82ba-9521e4bbbbd4 req-072be380-19a5-4828-9abd-9d38baa76ce8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:45.293495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ed625a1a-4077-4fce-82ba-9521e4bbbbd4 req-072be380-19a5-4828-9abd-9d38baa76ce8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:45.296486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ed625a1a-4077-4fce-82ba-9521e4bbbbd4 req-072be380-19a5-4828-9abd-9d38baa76ce8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:45.323773 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ed625a1a-4077-4fce-82ba-9521e4bbbbd4 req-072be380-19a5-4828-9abd-9d38baa76ce8 service nova] Creating event network-changed:8fd29250-d175-4175-abd3-ef0d31da2ee9 for instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 on n-h1-844626-8 Aug 09 14:48:45.337543 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ed625a1a-4077-4fce-82ba-9521e4bbbbd4 req-072be380-19a5-4828-9abd-9d38baa76ce8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071825 Aug 09 14:48:45.338444 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1898/3839] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:48:45.850077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4b6febc-91c5-4dfd-b711-02846bf5a3ad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:45.851170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b4b6febc-91c5-4dfd-b711-02846bf5a3ad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:45.868500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4b6febc-91c5-4dfd-b711-02846bf5a3ad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:45.869008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4b6febc-91c5-4dfd-b711-02846bf5a3ad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:45.869470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4b6febc-91c5-4dfd-b711-02846bf5a3ad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:45.870225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4b6febc-91c5-4dfd-b711-02846bf5a3ad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:45.878500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4b6febc-91c5-4dfd-b711-02846bf5a3ad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:45.879055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4b6febc-91c5-4dfd-b711-02846bf5a3ad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:45.931942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:46.077271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bc3db735-d288-4c18-87f6-c0b1bcf17f8b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:46.104131 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc3db735-d288-4c18-87f6-c0b1bcf17f8b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1314 microversion: 2.1 time: 1.228941 Aug 09 14:48:46.105249 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1942/3840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:44 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1314 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:46.367259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b4b6febc-91c5-4dfd-b711-02846bf5a3ad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:46.374815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:46.385955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b4b6febc-91c5-4dfd-b711-02846bf5a3ad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:46.388193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b4b6febc-91c5-4dfd-b711-02846bf5a3ad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:46.389617 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b4b6febc-91c5-4dfd-b711-02846bf5a3ad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1723 microversion: 2.20 time: 0.544224 Aug 09 14:48:46.410842 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1899/3841] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:45 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1723 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:48:47.128068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-062d264f-632a-4664-9dc2-df74102fb58a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:47.129103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-062d264f-632a-4664-9dc2-df74102fb58a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:47.146001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-062d264f-632a-4664-9dc2-df74102fb58a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:47.146804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-062d264f-632a-4664-9dc2-df74102fb58a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:47.147480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-062d264f-632a-4664-9dc2-df74102fb58a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:47.148527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-062d264f-632a-4664-9dc2-df74102fb58a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:47.149259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-062d264f-632a-4664-9dc2-df74102fb58a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:47.149683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-062d264f-632a-4664-9dc2-df74102fb58a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:47.414348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac530f4c-81e1-49a2-9a9e-69e3b2973145 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:47.415510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ac530f4c-81e1-49a2-9a9e-69e3b2973145 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:47.432218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac530f4c-81e1-49a2-9a9e-69e3b2973145 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:47.433188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac530f4c-81e1-49a2-9a9e-69e3b2973145 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:47.433946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac530f4c-81e1-49a2-9a9e-69e3b2973145 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:47.437459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac530f4c-81e1-49a2-9a9e-69e3b2973145 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:47.438286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac530f4c-81e1-49a2-9a9e-69e3b2973145 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:47.438914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac530f4c-81e1-49a2-9a9e-69e3b2973145 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:47.468669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-062d264f-632a-4664-9dc2-df74102fb58a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:47.480072 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-062d264f-632a-4664-9dc2-df74102fb58a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1314 microversion: 2.1 time: 0.357483 Aug 09 14:48:47.483129 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1943/3842] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:47 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:47.694296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ac530f4c-81e1-49a2-9a9e-69e3b2973145 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:47.713468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ac530f4c-81e1-49a2-9a9e-69e3b2973145 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:47.721700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ac530f4c-81e1-49a2-9a9e-69e3b2973145 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:47.726874 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ac530f4c-81e1-49a2-9a9e-69e3b2973145 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1723 microversion: 2.20 time: 0.316169 Aug 09 14:48:47.728492 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1900/3843] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:47 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1723 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:48:48.504581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9874ef9d-3ba7-4be6-b685-e20082d29449 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:48.505693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9874ef9d-3ba7-4be6-b685-e20082d29449 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:48.518618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9874ef9d-3ba7-4be6-b685-e20082d29449 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:48.520361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9874ef9d-3ba7-4be6-b685-e20082d29449 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:48.522238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9874ef9d-3ba7-4be6-b685-e20082d29449 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:48.525323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9874ef9d-3ba7-4be6-b685-e20082d29449 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:48.526063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9874ef9d-3ba7-4be6-b685-e20082d29449 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:48.529197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9874ef9d-3ba7-4be6-b685-e20082d29449 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:48.557202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b44d373a-e66e-4f76-b2bd-63f2ed81debd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:48.557945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b44d373a-e66e-4f76-b2bd-63f2ed81debd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:48.582836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b44d373a-e66e-4f76-b2bd-63f2ed81debd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:48.583592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b44d373a-e66e-4f76-b2bd-63f2ed81debd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:48.584689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b44d373a-e66e-4f76-b2bd-63f2ed81debd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:48.586680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b44d373a-e66e-4f76-b2bd-63f2ed81debd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:48.589022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b44d373a-e66e-4f76-b2bd-63f2ed81debd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:48.590650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b44d373a-e66e-4f76-b2bd-63f2ed81debd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:49.050878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b44d373a-e66e-4f76-b2bd-63f2ed81debd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:49.079868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b44d373a-e66e-4f76-b2bd-63f2ed81debd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:49.087747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b44d373a-e66e-4f76-b2bd-63f2ed81debd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:49.089105 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b44d373a-e66e-4f76-b2bd-63f2ed81debd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 2952 microversion: 2.42 time: 0.536696 Aug 09 14:48:49.090920 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1901/3844] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:48 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 2952 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:48:49.116239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce454f46-f2dd-4fc8-b514-4114bb5d6a91 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:49.117200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ce454f46-f2dd-4fc8-b514-4114bb5d6a91 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:49.130253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce454f46-f2dd-4fc8-b514-4114bb5d6a91 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:49.135185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce454f46-f2dd-4fc8-b514-4114bb5d6a91 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:49.136798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce454f46-f2dd-4fc8-b514-4114bb5d6a91 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:49.138596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce454f46-f2dd-4fc8-b514-4114bb5d6a91 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:49.139671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce454f46-f2dd-4fc8-b514-4114bb5d6a91 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:49.142200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce454f46-f2dd-4fc8-b514-4114bb5d6a91 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:49.256176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9874ef9d-3ba7-4be6-b685-e20082d29449 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:49.264735 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9874ef9d-3ba7-4be6-b685-e20082d29449 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1314 microversion: 2.1 time: 0.766294 Aug 09 14:48:49.278445 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1944/3845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:48 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:49.288842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b22f85f2-22d8-42fc-a1a5-1b63c689afaa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:49.289358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b22f85f2-22d8-42fc-a1a5-1b63c689afaa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:49.305886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b22f85f2-22d8-42fc-a1a5-1b63c689afaa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:49.312341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b22f85f2-22d8-42fc-a1a5-1b63c689afaa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:49.314429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b22f85f2-22d8-42fc-a1a5-1b63c689afaa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:49.315461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b22f85f2-22d8-42fc-a1a5-1b63c689afaa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:49.317109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b22f85f2-22d8-42fc-a1a5-1b63c689afaa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:49.317109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b22f85f2-22d8-42fc-a1a5-1b63c689afaa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:49.320872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:49.404538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:49.706935 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b22f85f2-22d8-42fc-a1a5-1b63c689afaa tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.432429 Aug 09 14:48:49.708880 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1945/3846] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 9 14:48:49 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af/os-interface => generated 1833 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:48:49.812671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ce454f46-f2dd-4fc8-b514-4114bb5d6a91 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:49.826537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ce454f46-f2dd-4fc8-b514-4114bb5d6a91 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:49.828172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ce454f46-f2dd-4fc8-b514-4114bb5d6a91 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:49.829385 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ce454f46-f2dd-4fc8-b514-4114bb5d6a91 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1744 microversion: 2.20 time: 0.733298 Aug 09 14:48:49.829970 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1902/3847] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:49 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1744 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:48:50.282971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=10 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:50.289152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1a411ee-1743-4084-ad7a-571f265bce11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:50.290641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1a411ee-1743-4084-ad7a-571f265bce11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:50.304925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1a411ee-1743-4084-ad7a-571f265bce11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:50.307153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1a411ee-1743-4084-ad7a-571f265bce11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:50.313474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1a411ee-1743-4084-ad7a-571f265bce11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:50.314590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1a411ee-1743-4084-ad7a-571f265bce11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:50.316133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1a411ee-1743-4084-ad7a-571f265bce11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:50.317439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1a411ee-1743-4084-ad7a-571f265bce11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:50.860029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-46ccf27e-9107-4442-ade6-03026afc2227 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:50.864908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-46ccf27e-9107-4442-ade6-03026afc2227 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:50.888011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46ccf27e-9107-4442-ade6-03026afc2227 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:50.888556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46ccf27e-9107-4442-ade6-03026afc2227 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:50.888972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46ccf27e-9107-4442-ade6-03026afc2227 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:50.889703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46ccf27e-9107-4442-ade6-03026afc2227 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:50.890150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46ccf27e-9107-4442-ade6-03026afc2227 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:50.890567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46ccf27e-9107-4442-ade6-03026afc2227 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:50.945926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1a411ee-1743-4084-ad7a-571f265bce11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:50.964344 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1a411ee-1743-4084-ad7a-571f265bce11 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1314 microversion: 2.1 time: 0.681760 Aug 09 14:48:50.966576 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1946/3848] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:50 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:51.605022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46ccf27e-9107-4442-ade6-03026afc2227 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:51.649930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46ccf27e-9107-4442-ade6-03026afc2227 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:51.660252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46ccf27e-9107-4442-ade6-03026afc2227 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:51.667653 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-46ccf27e-9107-4442-ade6-03026afc2227 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 0.815080 Aug 09 14:48:51.669564 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1903/3849] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:50 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:48:51.991405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16637d0b-1fcc-473d-8171-4effa6e233a7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:51.992157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-16637d0b-1fcc-473d-8171-4effa6e233a7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:52.057160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16637d0b-1fcc-473d-8171-4effa6e233a7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:52.059153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16637d0b-1fcc-473d-8171-4effa6e233a7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:52.061406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16637d0b-1fcc-473d-8171-4effa6e233a7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:52.064031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16637d0b-1fcc-473d-8171-4effa6e233a7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:52.065999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16637d0b-1fcc-473d-8171-4effa6e233a7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:52.066968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16637d0b-1fcc-473d-8171-4effa6e233a7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:52.697712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef488821-aea0-4049-abb3-aa3f55b6d435 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:52.698333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef488821-aea0-4049-abb3-aa3f55b6d435 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:52.721255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef488821-aea0-4049-abb3-aa3f55b6d435 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:52.722788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef488821-aea0-4049-abb3-aa3f55b6d435 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:52.722788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef488821-aea0-4049-abb3-aa3f55b6d435 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:52.726010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef488821-aea0-4049-abb3-aa3f55b6d435 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:52.726636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef488821-aea0-4049-abb3-aa3f55b6d435 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:52.729071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef488821-aea0-4049-abb3-aa3f55b6d435 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:52.821939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-16637d0b-1fcc-473d-8171-4effa6e233a7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:52.830032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:48:52.856047 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16637d0b-1fcc-473d-8171-4effa6e233a7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1314 microversion: 2.1 time: 0.864700 Aug 09 14:48:52.857436 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1947/3850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:51 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:53.499940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef488821-aea0-4049-abb3-aa3f55b6d435 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:53.518089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef488821-aea0-4049-abb3-aa3f55b6d435 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:53.520086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef488821-aea0-4049-abb3-aa3f55b6d435 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:53.526084 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef488821-aea0-4049-abb3-aa3f55b6d435 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 0.832541 Aug 09 14:48:53.534021 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1904/3851] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:52 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:48:53.890040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d04c9aeb-e46a-4ea7-96ef-2add21d03dbb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:53.891550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d04c9aeb-e46a-4ea7-96ef-2add21d03dbb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:53.922326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04c9aeb-e46a-4ea7-96ef-2add21d03dbb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:53.923039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04c9aeb-e46a-4ea7-96ef-2add21d03dbb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:53.926213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04c9aeb-e46a-4ea7-96ef-2add21d03dbb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:53.927616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04c9aeb-e46a-4ea7-96ef-2add21d03dbb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:53.933112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04c9aeb-e46a-4ea7-96ef-2add21d03dbb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:53.933904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04c9aeb-e46a-4ea7-96ef-2add21d03dbb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:54.387072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d04c9aeb-e46a-4ea7-96ef-2add21d03dbb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:54.410455 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d04c9aeb-e46a-4ea7-96ef-2add21d03dbb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1314 microversion: 2.1 time: 0.530027 Aug 09 14:48:54.412092 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1948/3852] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:53 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:54.495120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4acc9da5-6c79-4855-b3e5-dd40972783ff tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:54.500194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4acc9da5-6c79-4855-b3e5-dd40972783ff tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:54.500969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4acc9da5-6c79-4855-b3e5-dd40972783ff tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Searching by: {'deleted': False, 'project_id': '159f7d3784934b59ac35dd1adb06886e'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:48:54.529231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4acc9da5-6c79-4855-b3e5-dd40972783ff tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:54.529715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4acc9da5-6c79-4855-b3e5-dd40972783ff tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:54.530143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4acc9da5-6c79-4855-b3e5-dd40972783ff tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:54.553340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4acc9da5-6c79-4855-b3e5-dd40972783ff tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:54.553946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4acc9da5-6c79-4855-b3e5-dd40972783ff tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:54.554398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4acc9da5-6c79-4855-b3e5-dd40972783ff tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:54.558718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6fd8d6b1-f375-4078-842d-a3d80bdfa34d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:54.559634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6fd8d6b1-f375-4078-842d-a3d80bdfa34d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:54.572530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6fd8d6b1-f375-4078-842d-a3d80bdfa34d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:54.575262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6fd8d6b1-f375-4078-842d-a3d80bdfa34d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:54.576926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6fd8d6b1-f375-4078-842d-a3d80bdfa34d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:54.578693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6fd8d6b1-f375-4078-842d-a3d80bdfa34d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:54.580580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6fd8d6b1-f375-4078-842d-a3d80bdfa34d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:54.581477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6fd8d6b1-f375-4078-842d-a3d80bdfa34d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:54.680878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-4acc9da5-6c79-4855-b3e5-dd40972783ff tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:48:54.820432 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4acc9da5-6c79-4855-b3e5-dd40972783ff tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.328135 Aug 09 14:48:54.840825 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1905/3853] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 14:48:54 2022] GET /compute/v2.1/servers => generated 344 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:54.847053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:54.860184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:54.861219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Searching by: {'deleted': False, 'project_id': '159f7d3784934b59ac35dd1adb06886e'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:48:54.874584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:54.875070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:54.875527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:54.876256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:54.876709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:54.877140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:54.982829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:48:55.072409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:55.080489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:55.081219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:55.081824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:55.823851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6fd8d6b1-f375-4078-842d-a3d80bdfa34d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:55.841166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6fd8d6b1-f375-4078-842d-a3d80bdfa34d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:55.843983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6fd8d6b1-f375-4078-842d-a3d80bdfa34d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:55.846221 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6fd8d6b1-f375-4078-842d-a3d80bdfa34d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 1.292353 Aug 09 14:48:55.847320 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1949/3854] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:54 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:48:55.852648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef9befd5-f892-4c4e-89a2-d5c57e40f1a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:55.853753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ef9befd5-f892-4c4e-89a2-d5c57e40f1a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:55.862882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9befd5-f892-4c4e-89a2-d5c57e40f1a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:55.863718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9befd5-f892-4c4e-89a2-d5c57e40f1a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:55.864301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9befd5-f892-4c4e-89a2-d5c57e40f1a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:55.865507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9befd5-f892-4c4e-89a2-d5c57e40f1a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:55.866153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9befd5-f892-4c4e-89a2-d5c57e40f1a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:55.866952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9befd5-f892-4c4e-89a2-d5c57e40f1a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:55.930892 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4667863-191f-4124-a794-f89c80d171e8 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 1.088301 Aug 09 14:48:55.931817 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1906/3855] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:48:54 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:48:55.936638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-3b2e1b6d-0150-4742-8c3c-71bd572cbc98 req-024baad3-9f14-4cd7-a06d-71ec9a4b4b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271e7ad9-2da4-4661-83b9-f55d0c7c7e73", "name": "network-vif-plugged", "status": "completed", "tag": "8fd29250-d175-4175-abd3-ef0d31da2ee9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:55.975995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3b2e1b6d-0150-4742-8c3c-71bd572cbc98 req-024baad3-9f14-4cd7-a06d-71ec9a4b4b40 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:55.978443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3b2e1b6d-0150-4742-8c3c-71bd572cbc98 req-024baad3-9f14-4cd7-a06d-71ec9a4b4b40 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:55.982759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3b2e1b6d-0150-4742-8c3c-71bd572cbc98 req-024baad3-9f14-4cd7-a06d-71ec9a4b4b40 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:56.039584 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3b2e1b6d-0150-4742-8c3c-71bd572cbc98 req-024baad3-9f14-4cd7-a06d-71ec9a4b4b40 service nova] Creating event network-vif-plugged:8fd29250-d175-4175-abd3-ef0d31da2ee9 for instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 on n-h1-844626-8 Aug 09 14:48:56.052775 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-3b2e1b6d-0150-4742-8c3c-71bd572cbc98 req-024baad3-9f14-4cd7-a06d-71ec9a4b4b40 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118588 Aug 09 14:48:56.055569 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1907/3856] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:56.067785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc4dabeb-3820-47f3-95ea-268e83c19f41 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:56.119659 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc4dabeb-3820-47f3-95ea-268e83c19f41 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.061804 Aug 09 14:48:56.122559 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1908/3857] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:48:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:48:56.518947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9bedb478-88e4-4048-964f-255095213046 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:56.519587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9bedb478-88e4-4048-964f-255095213046 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:56.540305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bedb478-88e4-4048-964f-255095213046 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:56.540794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bedb478-88e4-4048-964f-255095213046 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:56.543583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bedb478-88e4-4048-964f-255095213046 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:56.546568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bedb478-88e4-4048-964f-255095213046 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:56.547550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bedb478-88e4-4048-964f-255095213046 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:56.549174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bedb478-88e4-4048-964f-255095213046 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:56.617420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9bedb478-88e4-4048-964f-255095213046 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:48:56.815694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ef9befd5-f892-4c4e-89a2-d5c57e40f1a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:56.841061 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9bedb478-88e4-4048-964f-255095213046 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 204 len: 0 microversion: 2.1 time: 0.324880 Aug 09 14:48:56.841942 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1909/3858] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:48:56 2022] DELETE /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:48:56.851660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-02b5acf3-ba94-47f3-b55c-3b8216d32925 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:56.853217 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ef9befd5-f892-4c4e-89a2-d5c57e40f1a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1314 microversion: 2.1 time: 1.000799 Aug 09 14:48:56.854318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-02b5acf3-ba94-47f3-b55c-3b8216d32925 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:56.857956 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1950/3859] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:55 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1314 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:56.880907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02b5acf3-ba94-47f3-b55c-3b8216d32925 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:56.885613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b5b9f162-65d4-4d6f-9128-fdccce864b3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:56.886821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02b5acf3-ba94-47f3-b55c-3b8216d32925 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:56.887462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02b5acf3-ba94-47f3-b55c-3b8216d32925 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:56.888892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02b5acf3-ba94-47f3-b55c-3b8216d32925 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:56.889565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02b5acf3-ba94-47f3-b55c-3b8216d32925 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:56.890211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02b5acf3-ba94-47f3-b55c-3b8216d32925 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:56.900962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b5b9f162-65d4-4d6f-9128-fdccce864b3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:56.922939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5b9f162-65d4-4d6f-9128-fdccce864b3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:56.923456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5b9f162-65d4-4d6f-9128-fdccce864b3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:56.923899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5b9f162-65d4-4d6f-9128-fdccce864b3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:56.933605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5b9f162-65d4-4d6f-9128-fdccce864b3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:56.949049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5b9f162-65d4-4d6f-9128-fdccce864b3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:56.950684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5b9f162-65d4-4d6f-9128-fdccce864b3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:57.580513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-02b5acf3-ba94-47f3-b55c-3b8216d32925 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:57.589853 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-02b5acf3-ba94-47f3-b55c-3b8216d32925 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1609 microversion: 2.1 time: 0.742635 Aug 09 14:48:57.590638 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1910/3860] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:56 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1609 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:48:57.812331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b5b9f162-65d4-4d6f-9128-fdccce864b3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:57.868832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b5b9f162-65d4-4d6f-9128-fdccce864b3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:57.880317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2079b52f-ad37-4434-80c8-6d878094a5d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:57.881377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2079b52f-ad37-4434-80c8-6d878094a5d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:57.892259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b5b9f162-65d4-4d6f-9128-fdccce864b3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:57.893639 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b5b9f162-65d4-4d6f-9128-fdccce864b3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 1.023401 Aug 09 14:48:57.894249 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1951/3861] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:56 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:48:57.895396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2079b52f-ad37-4434-80c8-6d878094a5d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:57.896352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2079b52f-ad37-4434-80c8-6d878094a5d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:57.896925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2079b52f-ad37-4434-80c8-6d878094a5d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:57.897841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2079b52f-ad37-4434-80c8-6d878094a5d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:57.898446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2079b52f-ad37-4434-80c8-6d878094a5d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:57.899009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2079b52f-ad37-4434-80c8-6d878094a5d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:58.240706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2079b52f-ad37-4434-80c8-6d878094a5d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:48:58.260636 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2079b52f-ad37-4434-80c8-6d878094a5d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1314 microversion: 2.1 time: 0.384154 Aug 09 14:48:58.280919 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1911/3862] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:57 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:48:58.525026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-fc72f2ee-27ff-4362-8497-fddfdf3d6360 req-8f102b73-8bf3-4f83-859e-3f0978014c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25a9384-ba3d-4ff8-8f2a-39ccdde0690a", "name": "network-vif-plugged", "status": "completed", "tag": "ec41d639-5d70-4bd6-8da7-60954703b90b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:48:58.570299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fc72f2ee-27ff-4362-8497-fddfdf3d6360 req-8f102b73-8bf3-4f83-859e-3f0978014c5e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:58.575613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fc72f2ee-27ff-4362-8497-fddfdf3d6360 req-8f102b73-8bf3-4f83-859e-3f0978014c5e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:58.576262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fc72f2ee-27ff-4362-8497-fddfdf3d6360 req-8f102b73-8bf3-4f83-859e-3f0978014c5e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:58.611845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-740264b5-3a5e-486b-bda3-cf37ebbb7016 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:58.612504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-740264b5-3a5e-486b-bda3-cf37ebbb7016 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:58.621238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740264b5-3a5e-486b-bda3-cf37ebbb7016 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:58.633808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740264b5-3a5e-486b-bda3-cf37ebbb7016 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:58.634421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740264b5-3a5e-486b-bda3-cf37ebbb7016 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:58.635193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740264b5-3a5e-486b-bda3-cf37ebbb7016 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:58.635651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740264b5-3a5e-486b-bda3-cf37ebbb7016 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:58.636068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-740264b5-3a5e-486b-bda3-cf37ebbb7016 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:58.637259 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-fc72f2ee-27ff-4362-8497-fddfdf3d6360 req-8f102b73-8bf3-4f83-859e-3f0978014c5e service nova] Creating event network-vif-plugged:ec41d639-5d70-4bd6-8da7-60954703b90b for instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a on n-h1-844626-8 Aug 09 14:48:58.649886 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-fc72f2ee-27ff-4362-8497-fddfdf3d6360 req-8f102b73-8bf3-4f83-859e-3f0978014c5e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129891 Aug 09 14:48:58.658708 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1952/3863] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:48:58.936365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-51be7eb1-7072-4470-bd58-5f7f63224faa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:48:58.937861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-51be7eb1-7072-4470-bd58-5f7f63224faa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:48:58.951833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51be7eb1-7072-4470-bd58-5f7f63224faa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:58.952559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51be7eb1-7072-4470-bd58-5f7f63224faa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:58.955616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51be7eb1-7072-4470-bd58-5f7f63224faa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:48:58.958657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51be7eb1-7072-4470-bd58-5f7f63224faa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:48:58.962390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51be7eb1-7072-4470-bd58-5f7f63224faa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:48:58.965394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51be7eb1-7072-4470-bd58-5f7f63224faa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:00.028111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-740264b5-3a5e-486b-bda3-cf37ebbb7016 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:00.047015 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-740264b5-3a5e-486b-bda3-cf37ebbb7016 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1609 microversion: 2.1 time: 1.439673 Aug 09 14:49:00.063222 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1912/3864] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:48:58 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1609 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:00.126553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-51be7eb1-7072-4470-bd58-5f7f63224faa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:00.141756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-51be7eb1-7072-4470-bd58-5f7f63224faa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:00.143794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-51be7eb1-7072-4470-bd58-5f7f63224faa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:00.157636 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-51be7eb1-7072-4470-bd58-5f7f63224faa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 1.220608 Aug 09 14:49:00.175006 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1953/3865] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:48:58 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:00.199243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fcac086a-887c-4e7f-b92b-7268d4028205 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:00.205442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fcac086a-887c-4e7f-b92b-7268d4028205 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:00.247609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcac086a-887c-4e7f-b92b-7268d4028205 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:00.256042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcac086a-887c-4e7f-b92b-7268d4028205 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:00.257866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcac086a-887c-4e7f-b92b-7268d4028205 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:00.258774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcac086a-887c-4e7f-b92b-7268d4028205 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:00.264068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcac086a-887c-4e7f-b92b-7268d4028205 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:00.265684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcac086a-887c-4e7f-b92b-7268d4028205 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:00.428494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1599841181", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "890b31f2-b263-407b-907d-693f4fb3025d"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:00.565562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] validate_networks() for [('890b31f2-b263-407b-907d-693f4fb3025d', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:49:01.418458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fcac086a-887c-4e7f-b92b-7268d4028205 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:01.430396 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fcac086a-887c-4e7f-b92b-7268d4028205 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1501 microversion: 2.1 time: 1.253925 Aug 09 14:49:01.430993 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1954/3866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:00 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1501 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:01.435632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0eab9f70-18e2-44b1-9bee-774a2efbde4c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:01.442435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0eab9f70-18e2-44b1-9bee-774a2efbde4c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:01.453985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eab9f70-18e2-44b1-9bee-774a2efbde4c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:01.455143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eab9f70-18e2-44b1-9bee-774a2efbde4c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:01.462680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eab9f70-18e2-44b1-9bee-774a2efbde4c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:01.463723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eab9f70-18e2-44b1-9bee-774a2efbde4c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:01.464332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eab9f70-18e2-44b1-9bee-774a2efbde4c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:01.464973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0eab9f70-18e2-44b1-9bee-774a2efbde4c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:01.609923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0eab9f70-18e2-44b1-9bee-774a2efbde4c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:01.632669 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0eab9f70-18e2-44b1-9bee-774a2efbde4c tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1541 microversion: 2.1 time: 0.194267 Aug 09 14:49:01.633784 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1955/3867] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:01 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1541 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:01.650721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a60f8938-446f-4662-a57a-e9e8bcc5c74d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:01.652149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a60f8938-446f-4662-a57a-e9e8bcc5c74d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:01.669649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a60f8938-446f-4662-a57a-e9e8bcc5c74d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:01.673122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a60f8938-446f-4662-a57a-e9e8bcc5c74d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:01.673599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a60f8938-446f-4662-a57a-e9e8bcc5c74d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:01.674363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a60f8938-446f-4662-a57a-e9e8bcc5c74d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:01.674816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a60f8938-446f-4662-a57a-e9e8bcc5c74d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:01.675277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a60f8938-446f-4662-a57a-e9e8bcc5c74d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:02.525470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a60f8938-446f-4662-a57a-e9e8bcc5c74d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:02.570256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a60f8938-446f-4662-a57a-e9e8bcc5c74d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:02.584084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a60f8938-446f-4662-a57a-e9e8bcc5c74d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:02.589286 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a60f8938-446f-4662-a57a-e9e8bcc5c74d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 0.954283 Aug 09 14:49:02.601038 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1956/3868] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:01 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:02.624619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dcc17c2f-98cb-4cce-98c7-9e273b6ff59f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:02.626077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dcc17c2f-98cb-4cce-98c7-9e273b6ff59f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:02.643727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc17c2f-98cb-4cce-98c7-9e273b6ff59f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:02.647999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc17c2f-98cb-4cce-98c7-9e273b6ff59f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:02.650350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc17c2f-98cb-4cce-98c7-9e273b6ff59f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:02.656760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc17c2f-98cb-4cce-98c7-9e273b6ff59f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:02.658326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc17c2f-98cb-4cce-98c7-9e273b6ff59f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:02.661395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc17c2f-98cb-4cce-98c7-9e273b6ff59f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:02.877097 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dcc17c2f-98cb-4cce-98c7-9e273b6ff59f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "POST /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73/action" status: 202 len: 0 microversion: 2.1 time: 0.274000 Aug 09 14:49:02.878043 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1957/3869] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:49:02 2022] POST /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:49:02.913807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-adaa6ab6-54e2-4c36-aedf-6afd547cedd3 req-236ba957-ec58-4e92-bacf-8c15ddccd22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1379ae48-c028-4c75-9d03-e9763b74ee26", "name": "network-vif-deleted", "tag": "ba2d3796-12d3-490e-9866-ad13300d7ffb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:02.942310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-adaa6ab6-54e2-4c36-aedf-6afd547cedd3 req-236ba957-ec58-4e92-bacf-8c15ddccd22e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:02.946447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-adaa6ab6-54e2-4c36-aedf-6afd547cedd3 req-236ba957-ec58-4e92-bacf-8c15ddccd22e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:02.947670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-adaa6ab6-54e2-4c36-aedf-6afd547cedd3 req-236ba957-ec58-4e92-bacf-8c15ddccd22e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:03.034483 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-adaa6ab6-54e2-4c36-aedf-6afd547cedd3 req-236ba957-ec58-4e92-bacf-8c15ddccd22e service nova] Creating event network-vif-deleted:ba2d3796-12d3-490e-9866-ad13300d7ffb for instance 1379ae48-c028-4c75-9d03-e9763b74ee26 on n-h2-844626-8 Aug 09 14:49:03.083708 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-adaa6ab6-54e2-4c36-aedf-6afd547cedd3 req-236ba957-ec58-4e92-bacf-8c15ddccd22e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199682 Aug 09 14:49:03.086355 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1958/3870] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:49:03.126105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-521b23cc-b94f-4a9d-bc93-e606d7781857 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:03.134455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-521b23cc-b94f-4a9d-bc93-e606d7781857 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:03.169731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-521b23cc-b94f-4a9d-bc93-e606d7781857 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:03.170267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-521b23cc-b94f-4a9d-bc93-e606d7781857 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:03.170721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-521b23cc-b94f-4a9d-bc93-e606d7781857 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:03.178163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-521b23cc-b94f-4a9d-bc93-e606d7781857 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:03.181829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-521b23cc-b94f-4a9d-bc93-e606d7781857 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:03.185515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-521b23cc-b94f-4a9d-bc93-e606d7781857 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:03.203425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:49:03.204412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:49:03.206523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:49:03.207805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:49:03.209619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:49:03.220248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:03.253997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:03.254920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:03.270471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:03.275836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:03.276348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:03.276800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:03.332096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Getting quotas for project 9fb91797fb8e427588194573250d2953. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:49:03.341594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Getting quotas for user d985ad594bb9409b859e7812f32a9a64 and project 9fb91797fb8e427588194573250d2953. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:49:03.365705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:49:03.368440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:49:03.548594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-521b23cc-b94f-4a9d-bc93-e606d7781857 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:03.557439 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-521b23cc-b94f-4a9d-bc93-e606d7781857 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1253 microversion: 2.1 time: 0.468911 Aug 09 14:49:03.558124 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1959/3871] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:03 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1253 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:03.604885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62b0f5ae-3466-4869-adef-7b3389282e70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:03.605743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-62b0f5ae-3466-4869-adef-7b3389282e70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:03.618477 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c37f5032-c543-4a99-b0ea-643dab253d4c tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.553369 Aug 09 14:49:03.619736 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1913/3872] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:49:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:49:03.632449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62b0f5ae-3466-4869-adef-7b3389282e70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:03.633100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62b0f5ae-3466-4869-adef-7b3389282e70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:03.633630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62b0f5ae-3466-4869-adef-7b3389282e70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:03.634405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62b0f5ae-3466-4869-adef-7b3389282e70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:03.634855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62b0f5ae-3466-4869-adef-7b3389282e70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:03.635861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62b0f5ae-3466-4869-adef-7b3389282e70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:03.648437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0537553b-8599-40b8-8729-8634d003d398 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:03.649384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0537553b-8599-40b8-8729-8634d003d398 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:03.906921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0537553b-8599-40b8-8729-8634d003d398 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:03.922467 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0537553b-8599-40b8-8729-8634d003d398 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1225 microversion: 2.1 time: 0.289537 Aug 09 14:49:03.938726 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1914/3873] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:03 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1225 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:03.959294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03beb9dc-031d-43cf-800c-a58c7f437ca1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:03.962999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03beb9dc-031d-43cf-800c-a58c7f437ca1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:04.008109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03beb9dc-031d-43cf-800c-a58c7f437ca1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:04.008898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03beb9dc-031d-43cf-800c-a58c7f437ca1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:04.011334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03beb9dc-031d-43cf-800c-a58c7f437ca1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:04.012482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03beb9dc-031d-43cf-800c-a58c7f437ca1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:04.062185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03beb9dc-031d-43cf-800c-a58c7f437ca1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:04.062924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03beb9dc-031d-43cf-800c-a58c7f437ca1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:04.434804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-62b0f5ae-3466-4869-adef-7b3389282e70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:04.445858 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-62b0f5ae-3466-4869-adef-7b3389282e70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1486 microversion: 2.1 time: 0.870302 Aug 09 14:49:04.454704 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1960/3874] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:03 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1486 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:04.495709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a5108670-0053-40ea-a565-c4cc9469b0b6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:04.496264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a5108670-0053-40ea-a565-c4cc9469b0b6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:04.541931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5108670-0053-40ea-a565-c4cc9469b0b6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:04.542460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5108670-0053-40ea-a565-c4cc9469b0b6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:04.542902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5108670-0053-40ea-a565-c4cc9469b0b6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:04.555199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5108670-0053-40ea-a565-c4cc9469b0b6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:04.555748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5108670-0053-40ea-a565-c4cc9469b0b6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:04.556135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a5108670-0053-40ea-a565-c4cc9469b0b6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:04.694315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a5108670-0053-40ea-a565-c4cc9469b0b6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:49:04.757638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-03beb9dc-031d-43cf-800c-a58c7f437ca1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:04.784808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-03beb9dc-031d-43cf-800c-a58c7f437ca1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:04.786926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-03beb9dc-031d-43cf-800c-a58c7f437ca1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:04.823200 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03beb9dc-031d-43cf-800c-a58c7f437ca1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 0.892366 Aug 09 14:49:04.830393 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1915/3875] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:03 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:04.850013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fdb7d3a-cb9f-4dc5-9479-22604dce49aa tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:04.852871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3fdb7d3a-cb9f-4dc5-9479-22604dce49aa tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:04.877722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fdb7d3a-cb9f-4dc5-9479-22604dce49aa tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:04.884956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fdb7d3a-cb9f-4dc5-9479-22604dce49aa tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:04.886900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fdb7d3a-cb9f-4dc5-9479-22604dce49aa tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:04.889216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fdb7d3a-cb9f-4dc5-9479-22604dce49aa tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:04.891024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fdb7d3a-cb9f-4dc5-9479-22604dce49aa tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:04.894152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fdb7d3a-cb9f-4dc5-9479-22604dce49aa tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:05.040815 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a5108670-0053-40ea-a565-c4cc9469b0b6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 204 len: 0 microversion: 2.1 time: 0.561740 Aug 09 14:49:05.044366 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1961/3876] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:49:04 2022] DELETE /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:49:05.057657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8f058d34-8911-4989-bb37-5d66a7aac8fa tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:05.064673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8f058d34-8911-4989-bb37-5d66a7aac8fa tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:05.116070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f058d34-8911-4989-bb37-5d66a7aac8fa tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:05.116566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f058d34-8911-4989-bb37-5d66a7aac8fa tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:05.117005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f058d34-8911-4989-bb37-5d66a7aac8fa tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:05.117717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f058d34-8911-4989-bb37-5d66a7aac8fa tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:05.126327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f058d34-8911-4989-bb37-5d66a7aac8fa tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:05.126787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f058d34-8911-4989-bb37-5d66a7aac8fa tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:05.176373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3fdb7d3a-cb9f-4dc5-9479-22604dce49aa tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:05.192415 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fdb7d3a-cb9f-4dc5-9479-22604dce49aa tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1253 microversion: 2.1 time: 0.360864 Aug 09 14:49:05.193958 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1916/3877] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:04 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1253 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:05.224427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1b5b3740-5016-4e79-9f72-3c12255056b9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:05.225051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1b5b3740-5016-4e79-9f72-3c12255056b9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:05.248452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b5b3740-5016-4e79-9f72-3c12255056b9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:05.248949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b5b3740-5016-4e79-9f72-3c12255056b9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:05.249384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b5b3740-5016-4e79-9f72-3c12255056b9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:05.250098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b5b3740-5016-4e79-9f72-3c12255056b9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:05.250744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b5b3740-5016-4e79-9f72-3c12255056b9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:05.250974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b5b3740-5016-4e79-9f72-3c12255056b9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:05.271871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:05.366475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8f058d34-8911-4989-bb37-5d66a7aac8fa tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:05.375771 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8f058d34-8911-4989-bb37-5d66a7aac8fa tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1229 microversion: 2.1 time: 0.329937 Aug 09 14:49:05.399130 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1962/3878] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:05 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1229 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:05.853961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5cbaaef3-1fc6-4676-a4d0-a16ba3aeb956 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:05.854794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5cbaaef3-1fc6-4676-a4d0-a16ba3aeb956 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:05.892740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cbaaef3-1fc6-4676-a4d0-a16ba3aeb956 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:05.895555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cbaaef3-1fc6-4676-a4d0-a16ba3aeb956 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:05.896198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cbaaef3-1fc6-4676-a4d0-a16ba3aeb956 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:05.898103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cbaaef3-1fc6-4676-a4d0-a16ba3aeb956 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:05.898578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cbaaef3-1fc6-4676-a4d0-a16ba3aeb956 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:05.899011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cbaaef3-1fc6-4676-a4d0-a16ba3aeb956 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:05.912717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:05.936658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b5b3740-5016-4e79-9f72-3c12255056b9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:05.945398 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1b5b3740-5016-4e79-9f72-3c12255056b9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1492 microversion: 2.1 time: 0.736266 Aug 09 14:49:05.957913 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1917/3879] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:05 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1492 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:06.215910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf974ee5-024b-4066-b538-fb3a8508bcbd tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:06.216545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf974ee5-024b-4066-b538-fb3a8508bcbd tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:06.250925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf974ee5-024b-4066-b538-fb3a8508bcbd tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:06.256470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf974ee5-024b-4066-b538-fb3a8508bcbd tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:06.266766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf974ee5-024b-4066-b538-fb3a8508bcbd tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:06.267690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf974ee5-024b-4066-b538-fb3a8508bcbd tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:06.268199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf974ee5-024b-4066-b538-fb3a8508bcbd tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:06.278960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf974ee5-024b-4066-b538-fb3a8508bcbd tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:06.886251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5cbaaef3-1fc6-4676-a4d0-a16ba3aeb956 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:06.906678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5cbaaef3-1fc6-4676-a4d0-a16ba3aeb956 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:06.910278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5cbaaef3-1fc6-4676-a4d0-a16ba3aeb956 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:06.913075 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5cbaaef3-1fc6-4676-a4d0-a16ba3aeb956 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 1.063586 Aug 09 14:49:06.916770 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1963/3880] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:05 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:06.940764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8bf260e2-1c8b-49b9-b0d5-a677b10b386e tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:06.941848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8bf260e2-1c8b-49b9-b0d5-a677b10b386e tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:06.948115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:06.956111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bf974ee5-024b-4066-b538-fb3a8508bcbd tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:06.974780 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf974ee5-024b-4066-b538-fb3a8508bcbd tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1253 microversion: 2.1 time: 0.761277 Aug 09 14:49:06.993792 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1918/3881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:06 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1253 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:06.995052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8bf260e2-1c8b-49b9-b0d5-a677b10b386e tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:06.999047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8bf260e2-1c8b-49b9-b0d5-a677b10b386e tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:06.999811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8bf260e2-1c8b-49b9-b0d5-a677b10b386e tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:07.002295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8bf260e2-1c8b-49b9-b0d5-a677b10b386e tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:07.004761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8bf260e2-1c8b-49b9-b0d5-a677b10b386e tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:07.005464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8bf260e2-1c8b-49b9-b0d5-a677b10b386e tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:07.009353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c49160b3-6fbb-4794-9211-e1d889677a55 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:07.010971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c49160b3-6fbb-4794-9211-e1d889677a55 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:07.041504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c49160b3-6fbb-4794-9211-e1d889677a55 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:07.044356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c49160b3-6fbb-4794-9211-e1d889677a55 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:07.045125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c49160b3-6fbb-4794-9211-e1d889677a55 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:07.046071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c49160b3-6fbb-4794-9211-e1d889677a55 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:07.047609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c49160b3-6fbb-4794-9211-e1d889677a55 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:07.048187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c49160b3-6fbb-4794-9211-e1d889677a55 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:07.155590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8bf260e2-1c8b-49b9-b0d5-a677b10b386e tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:07.170006 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8bf260e2-1c8b-49b9-b0d5-a677b10b386e tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1277 microversion: 2.1 time: 0.251218 Aug 09 14:49:07.184604 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1964/3882] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:06 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1277 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:07.943438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c4d5b476-8111-4027-b28e-e5348ade7e19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:07.944123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c4d5b476-8111-4027-b28e-e5348ade7e19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:07.975127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4d5b476-8111-4027-b28e-e5348ade7e19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:07.978220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4d5b476-8111-4027-b28e-e5348ade7e19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:07.978676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4d5b476-8111-4027-b28e-e5348ade7e19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:07.979457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4d5b476-8111-4027-b28e-e5348ade7e19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:07.979978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4d5b476-8111-4027-b28e-e5348ade7e19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:07.980402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4d5b476-8111-4027-b28e-e5348ade7e19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:08.310380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c49160b3-6fbb-4794-9211-e1d889677a55 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:08.325536 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c49160b3-6fbb-4794-9211-e1d889677a55 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1492 microversion: 2.1 time: 1.328940 Aug 09 14:49:08.328598 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1919/3883] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:06 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1492 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:08.379629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67f03df6-c101-4081-956f-6709c60242e0 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:08.384170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-67f03df6-c101-4081-956f-6709c60242e0 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:08.443899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c4d5b476-8111-4027-b28e-e5348ade7e19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:08.446645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67f03df6-c101-4081-956f-6709c60242e0 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:08.447848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67f03df6-c101-4081-956f-6709c60242e0 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:08.448520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67f03df6-c101-4081-956f-6709c60242e0 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:08.449608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67f03df6-c101-4081-956f-6709c60242e0 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:08.451942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67f03df6-c101-4081-956f-6709c60242e0 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:08.452941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67f03df6-c101-4081-956f-6709c60242e0 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:08.458520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c4d5b476-8111-4027-b28e-e5348ade7e19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:08.470819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c4d5b476-8111-4027-b28e-e5348ade7e19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:08.472254 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c4d5b476-8111-4027-b28e-e5348ade7e19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 0.533390 Aug 09 14:49:08.478317 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1965/3884] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:07 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:08.508835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cb3a1c34-3547-4121-ae24-da7f6ceb65ef tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:08.515914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cb3a1c34-3547-4121-ae24-da7f6ceb65ef tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:08.534188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb3a1c34-3547-4121-ae24-da7f6ceb65ef tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:08.536583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb3a1c34-3547-4121-ae24-da7f6ceb65ef tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:08.537215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb3a1c34-3547-4121-ae24-da7f6ceb65ef tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:08.539953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb3a1c34-3547-4121-ae24-da7f6ceb65ef tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:08.543393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb3a1c34-3547-4121-ae24-da7f6ceb65ef tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:08.545877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cb3a1c34-3547-4121-ae24-da7f6ceb65ef tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:08.803634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-67f03df6-c101-4081-956f-6709c60242e0 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:08.815734 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-67f03df6-c101-4081-956f-6709c60242e0 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1253 microversion: 2.1 time: 0.483792 Aug 09 14:49:08.816557 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1920/3885] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:08 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1253 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:09.031230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cb3a1c34-3547-4121-ae24-da7f6ceb65ef tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:09.042738 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cb3a1c34-3547-4121-ae24-da7f6ceb65ef tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1283 microversion: 2.1 time: 0.544482 Aug 09 14:49:09.048565 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1966/3886] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:08 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1283 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:09.352630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-212a92af-71ea-4d62-92ee-5b30f0c5229f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:09.353253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-212a92af-71ea-4d62-92ee-5b30f0c5229f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:09.371985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-212a92af-71ea-4d62-92ee-5b30f0c5229f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:09.372485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-212a92af-71ea-4d62-92ee-5b30f0c5229f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:09.385696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-212a92af-71ea-4d62-92ee-5b30f0c5229f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:09.386555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-212a92af-71ea-4d62-92ee-5b30f0c5229f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:09.387153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-212a92af-71ea-4d62-92ee-5b30f0c5229f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:09.388878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-212a92af-71ea-4d62-92ee-5b30f0c5229f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:09.505012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ff31a1c4-cf60-4f9d-a937-44e1f569c5b8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:09.507803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ff31a1c4-cf60-4f9d-a937-44e1f569c5b8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:09.532764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff31a1c4-cf60-4f9d-a937-44e1f569c5b8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:09.534753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff31a1c4-cf60-4f9d-a937-44e1f569c5b8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:09.538095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff31a1c4-cf60-4f9d-a937-44e1f569c5b8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:09.539041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff31a1c4-cf60-4f9d-a937-44e1f569c5b8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:09.541319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-212a92af-71ea-4d62-92ee-5b30f0c5229f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:09.542003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff31a1c4-cf60-4f9d-a937-44e1f569c5b8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:09.545134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ff31a1c4-cf60-4f9d-a937-44e1f569c5b8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:09.566574 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-212a92af-71ea-4d62-92ee-5b30f0c5229f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1450 microversion: 2.1 time: 0.213130 Aug 09 14:49:09.569784 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1921/3887] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:09 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1450 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:09.841347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c8196d2-e429-44df-a357-f09e4d461164 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:09.842061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c8196d2-e429-44df-a357-f09e4d461164 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:09.857714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c8196d2-e429-44df-a357-f09e4d461164 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:09.859783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c8196d2-e429-44df-a357-f09e4d461164 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:09.867431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c8196d2-e429-44df-a357-f09e4d461164 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:09.871042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c8196d2-e429-44df-a357-f09e4d461164 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:09.874726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c8196d2-e429-44df-a357-f09e4d461164 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:09.877423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c8196d2-e429-44df-a357-f09e4d461164 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:10.270782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1c8196d2-e429-44df-a357-f09e4d461164 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:10.316243 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c8196d2-e429-44df-a357-f09e4d461164 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1253 microversion: 2.1 time: 0.478932 Aug 09 14:49:10.321512 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1922/3888] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:09 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1253 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:49:10.337998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb47beeb-1580-422e-96bd-ede203386066 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:10.345625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eb47beeb-1580-422e-96bd-ede203386066 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:10.379153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb47beeb-1580-422e-96bd-ede203386066 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:10.380489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb47beeb-1580-422e-96bd-ede203386066 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:10.383208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb47beeb-1580-422e-96bd-ede203386066 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:10.384943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb47beeb-1580-422e-96bd-ede203386066 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:10.388953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb47beeb-1580-422e-96bd-ede203386066 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:10.389647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb47beeb-1580-422e-96bd-ede203386066 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:10.582538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ff31a1c4-cf60-4f9d-a937-44e1f569c5b8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:10.594657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ff31a1c4-cf60-4f9d-a937-44e1f569c5b8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:10.610167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ff31a1c4-cf60-4f9d-a937-44e1f569c5b8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:10.611459 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ff31a1c4-cf60-4f9d-a937-44e1f569c5b8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 1.113390 Aug 09 14:49:10.617685 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1967/3889] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:09 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:10.619886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb47beeb-1580-422e-96bd-ede203386066 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:10.629807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-27c85625-4380-44e0-bc6d-2c10da543261 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:10.630452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-27c85625-4380-44e0-bc6d-2c10da543261 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:10.636942 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb47beeb-1580-422e-96bd-ede203386066 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1283 microversion: 2.1 time: 0.306566 Aug 09 14:49:10.640118 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1923/3890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:10 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1283 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:10.651297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c85625-4380-44e0-bc6d-2c10da543261 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:10.653626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c85625-4380-44e0-bc6d-2c10da543261 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:10.662113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c85625-4380-44e0-bc6d-2c10da543261 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:10.666823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c85625-4380-44e0-bc6d-2c10da543261 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:10.668898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c85625-4380-44e0-bc6d-2c10da543261 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:10.676109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-27c85625-4380-44e0-bc6d-2c10da543261 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:10.720716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-9baf4fbb-ea35-4ae4-93b5-2053537f41cd req-5886e3fc-4c78-41d3-9b4e-7744960f9865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271e7ad9-2da4-4661-83b9-f55d0c7c7e73", "name": "network-vif-deleted", "tag": "8fd29250-d175-4175-abd3-ef0d31da2ee9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:10.748829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9baf4fbb-ea35-4ae4-93b5-2053537f41cd req-5886e3fc-4c78-41d3-9b4e-7744960f9865 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:10.750643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9baf4fbb-ea35-4ae4-93b5-2053537f41cd req-5886e3fc-4c78-41d3-9b4e-7744960f9865 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:10.751204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9baf4fbb-ea35-4ae4-93b5-2053537f41cd req-5886e3fc-4c78-41d3-9b4e-7744960f9865 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:10.826958 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9baf4fbb-ea35-4ae4-93b5-2053537f41cd req-5886e3fc-4c78-41d3-9b4e-7744960f9865 service nova] Creating event network-vif-deleted:8fd29250-d175-4175-abd3-ef0d31da2ee9 for instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 on n-h1-844626-8 Aug 09 14:49:10.848144 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-9baf4fbb-ea35-4ae4-93b5-2053537f41cd req-5886e3fc-4c78-41d3-9b4e-7744960f9865 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132438 Aug 09 14:49:10.856554 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1924/3891] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:49:11.105412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-27c85625-4380-44e0-bc6d-2c10da543261 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:11.132397 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-27c85625-4380-44e0-bc6d-2c10da543261 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 200 len: 1284 microversion: 2.1 time: 0.513538 Aug 09 14:49:11.133006 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1968/3892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:10 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 1284 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:11.343646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-49b66c2d-b897-4834-b60d-c2af7924334e tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:11.344801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-49b66c2d-b897-4834-b60d-c2af7924334e tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:11.368858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b66c2d-b897-4834-b60d-c2af7924334e tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:11.369650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b66c2d-b897-4834-b60d-c2af7924334e tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:11.371011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b66c2d-b897-4834-b60d-c2af7924334e tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:11.372093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b66c2d-b897-4834-b60d-c2af7924334e tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:11.377954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b66c2d-b897-4834-b60d-c2af7924334e tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:11.379057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49b66c2d-b897-4834-b60d-c2af7924334e tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:11.605536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-49b66c2d-b897-4834-b60d-c2af7924334e tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:11.640099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afd22d34-853e-4dcc-b2dd-5cc7ebfa2b26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:11.641577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-afd22d34-853e-4dcc-b2dd-5cc7ebfa2b26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:11.653450 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-49b66c2d-b897-4834-b60d-c2af7924334e tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1253 microversion: 2.1 time: 0.310531 Aug 09 14:49:11.689557 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1925/3893] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:11 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1253 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:11.694801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a8ff13dd-c686-4bb5-85af-8d6ff8c77655 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:11.703558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afd22d34-853e-4dcc-b2dd-5cc7ebfa2b26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:11.712993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afd22d34-853e-4dcc-b2dd-5cc7ebfa2b26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:11.713497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afd22d34-853e-4dcc-b2dd-5cc7ebfa2b26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:11.715909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a8ff13dd-c686-4bb5-85af-8d6ff8c77655 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:11.719692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afd22d34-853e-4dcc-b2dd-5cc7ebfa2b26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:11.720326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afd22d34-853e-4dcc-b2dd-5cc7ebfa2b26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:11.720744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afd22d34-853e-4dcc-b2dd-5cc7ebfa2b26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:11.743304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8ff13dd-c686-4bb5-85af-8d6ff8c77655 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:11.750718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8ff13dd-c686-4bb5-85af-8d6ff8c77655 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:11.751649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8ff13dd-c686-4bb5-85af-8d6ff8c77655 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:11.752693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8ff13dd-c686-4bb5-85af-8d6ff8c77655 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:11.753825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8ff13dd-c686-4bb5-85af-8d6ff8c77655 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:11.755042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8ff13dd-c686-4bb5-85af-8d6ff8c77655 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:12.473984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a8ff13dd-c686-4bb5-85af-8d6ff8c77655 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:12.485537 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a8ff13dd-c686-4bb5-85af-8d6ff8c77655 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1325 microversion: 2.1 time: 0.794619 Aug 09 14:49:12.486520 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1926/3894] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:11 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1325 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:12.505119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-afd22d34-853e-4dcc-b2dd-5cc7ebfa2b26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:12.518294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-898f6a7f-e695-4f81-9a0c-898d4f4a1480 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:12.531880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-afd22d34-853e-4dcc-b2dd-5cc7ebfa2b26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:12.533956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-afd22d34-853e-4dcc-b2dd-5cc7ebfa2b26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:12.534934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-898f6a7f-e695-4f81-9a0c-898d4f4a1480 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:12.541556 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afd22d34-853e-4dcc-b2dd-5cc7ebfa2b26 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 0.906287 Aug 09 14:49:12.545908 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1969/3895] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:11 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:49:12.556477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-898f6a7f-e695-4f81-9a0c-898d4f4a1480 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:12.557290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-898f6a7f-e695-4f81-9a0c-898d4f4a1480 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:12.557994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-898f6a7f-e695-4f81-9a0c-898d4f4a1480 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:12.558979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-898f6a7f-e695-4f81-9a0c-898d4f4a1480 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:12.559793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-898f6a7f-e695-4f81-9a0c-898d4f4a1480 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:12.560441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-898f6a7f-e695-4f81-9a0c-898d4f4a1480 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:12.606185 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-898f6a7f-e695-4f81-9a0c-898d4f4a1480 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-898f6a7f-e695-4f81-9a0c-898d4f4a1480 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 HTTP/1.1 Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '271e7ad9-2da4-4661-83b9-f55d0c7c7e73'} Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:49:12.614718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:12.618323 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:12.618323 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:49:12.618323 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:49:12.618323 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:49:12.618323 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:49:12.618323 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:49:12.618323 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:12.620319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-898f6a7f-e695-4f81-9a0c-898d4f4a1480 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:49:12.627540 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-898f6a7f-e695-4f81-9a0c-898d4f4a1480 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 404 len: 111 microversion: 2.1 time: 0.133537 Aug 09 14:49:12.635497 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1927/3896] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:12 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:49:12.678057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36327c14-ac9b-41b7-bc9b-57048070f3df tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:12.678801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36327c14-ac9b-41b7-bc9b-57048070f3df tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:12.691381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36327c14-ac9b-41b7-bc9b-57048070f3df tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:12.700187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36327c14-ac9b-41b7-bc9b-57048070f3df tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:12.703734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36327c14-ac9b-41b7-bc9b-57048070f3df tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:12.704634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36327c14-ac9b-41b7-bc9b-57048070f3df tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:12.705224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36327c14-ac9b-41b7-bc9b-57048070f3df tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:12.705758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36327c14-ac9b-41b7-bc9b-57048070f3df tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:12.913614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1109017722", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:12.935039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-36327c14-ac9b-41b7-bc9b-57048070f3df tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:12.952235 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36327c14-ac9b-41b7-bc9b-57048070f3df tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1253 microversion: 2.1 time: 0.278770 Aug 09 14:49:12.962526 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1970/3897] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:12 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1253 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:13.098156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] validate_networks() for [('583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:49:13.318924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:13.512667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ac33b91-56e9-42e6-bc28-4b8fc7279bbb tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:13.513295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5ac33b91-56e9-42e6-bc28-4b8fc7279bbb tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:13.524488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac33b91-56e9-42e6-bc28-4b8fc7279bbb tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:13.537987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac33b91-56e9-42e6-bc28-4b8fc7279bbb tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:13.538452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac33b91-56e9-42e6-bc28-4b8fc7279bbb tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:13.539253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac33b91-56e9-42e6-bc28-4b8fc7279bbb tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:13.539730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac33b91-56e9-42e6-bc28-4b8fc7279bbb tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:13.540143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ac33b91-56e9-42e6-bc28-4b8fc7279bbb tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:13.912388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=10 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:14.595336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5ac33b91-56e9-42e6-bc28-4b8fc7279bbb tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:14.605382 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5ac33b91-56e9-42e6-bc28-4b8fc7279bbb tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1325 microversion: 2.1 time: 1.097925 Aug 09 14:49:14.606015 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1971/3898] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:13 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1325 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:14.620149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-372f1810-9f88-4eee-9e3d-36cff73fec7c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:14.638650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-372f1810-9f88-4eee-9e3d-36cff73fec7c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:14.652055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-372f1810-9f88-4eee-9e3d-36cff73fec7c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:14.652545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-372f1810-9f88-4eee-9e3d-36cff73fec7c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:14.661306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-372f1810-9f88-4eee-9e3d-36cff73fec7c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:14.662448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-372f1810-9f88-4eee-9e3d-36cff73fec7c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:14.664810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-372f1810-9f88-4eee-9e3d-36cff73fec7c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:14.665446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-372f1810-9f88-4eee-9e3d-36cff73fec7c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:14.897229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:49:14.899836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:49:14.900367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:49:14.900785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:49:14.901731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:49:14.930413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:14.930998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:14.931448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:14.932192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:14.932646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:14.933115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:15.008256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:49:15.052603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for user d970d0bf9e754591b09af75bbf64a96d and project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:49:15.088010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:49:15.107600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:49:15.229495 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ce55ba4a-5d49-4af5-92c5-b8d65a48fd26 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.318521 Aug 09 14:49:15.232273 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1928/3899] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:49:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:49:15.241604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3b296f2d-17be-44f1-9678-0cdce94c4286 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:15.244883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3b296f2d-17be-44f1-9678-0cdce94c4286 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:15.261831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b296f2d-17be-44f1-9678-0cdce94c4286 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:15.262599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b296f2d-17be-44f1-9678-0cdce94c4286 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:15.263228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b296f2d-17be-44f1-9678-0cdce94c4286 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:15.264152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b296f2d-17be-44f1-9678-0cdce94c4286 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:15.264754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b296f2d-17be-44f1-9678-0cdce94c4286 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:15.266054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b296f2d-17be-44f1-9678-0cdce94c4286 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:15.575040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3b296f2d-17be-44f1-9678-0cdce94c4286 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:15.590183 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3b296f2d-17be-44f1-9678-0cdce94c4286 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1253 microversion: 2.1 time: 0.356442 Aug 09 14:49:15.599819 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1929/3900] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:15 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1253 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:15.616403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-17fcf9e0-4cd0-4a44-9767-3e285b84867b req-dab71a52-3da5-4ad2-be13-00c790004c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "837955cd-5239-4a7b-a5a3-7ab9a15431ed", "tag": "889d4096-79c0-4ef1-9820-306700841a6e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:15.653638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-17fcf9e0-4cd0-4a44-9767-3e285b84867b req-dab71a52-3da5-4ad2-be13-00c790004c09 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:15.654402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-17fcf9e0-4cd0-4a44-9767-3e285b84867b req-dab71a52-3da5-4ad2-be13-00c790004c09 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:15.655523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-17fcf9e0-4cd0-4a44-9767-3e285b84867b req-dab71a52-3da5-4ad2-be13-00c790004c09 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:15.672727 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-17fcf9e0-4cd0-4a44-9767-3e285b84867b req-dab71a52-3da5-4ad2-be13-00c790004c09 service nova] Creating event network-changed:889d4096-79c0-4ef1-9820-306700841a6e for instance 837955cd-5239-4a7b-a5a3-7ab9a15431ed on n-h2-844626-8 Aug 09 14:49:15.681986 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-17fcf9e0-4cd0-4a44-9767-3e285b84867b req-dab71a52-3da5-4ad2-be13-00c790004c09 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080210 Aug 09 14:49:15.683203 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1930/3901] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:49:15.689720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e78eadf5-bb46-46d6-9b34-503c5843f0bf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:15.690518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e78eadf5-bb46-46d6-9b34-503c5843f0bf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:15.899560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-372f1810-9f88-4eee-9e3d-36cff73fec7c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:15.921518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-372f1810-9f88-4eee-9e3d-36cff73fec7c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:15.942009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-372f1810-9f88-4eee-9e3d-36cff73fec7c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:15.943698 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-372f1810-9f88-4eee-9e3d-36cff73fec7c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 1.333193 Aug 09 14:49:15.947362 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1972/3902] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:14 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:15.971214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc2930f3-adc6-4269-afdd-8dca680ab9c0 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:15.972069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fc2930f3-adc6-4269-afdd-8dca680ab9c0 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:15.989707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2930f3-adc6-4269-afdd-8dca680ab9c0 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:15.998031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2930f3-adc6-4269-afdd-8dca680ab9c0 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:16.000849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2930f3-adc6-4269-afdd-8dca680ab9c0 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:16.008000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2930f3-adc6-4269-afdd-8dca680ab9c0 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:16.011901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2930f3-adc6-4269-afdd-8dca680ab9c0 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:16.013322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc2930f3-adc6-4269-afdd-8dca680ab9c0 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:16.149233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e78eadf5-bb46-46d6-9b34-503c5843f0bf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:16.161971 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e78eadf5-bb46-46d6-9b34-503c5843f0bf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1215 microversion: 2.1 time: 0.475639 Aug 09 14:49:16.162821 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1931/3903] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:15 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1215 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:16.621339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b5ed6f6c-3d4a-4dd8-972d-9951da2d2791 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:16.622163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b5ed6f6c-3d4a-4dd8-972d-9951da2d2791 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:16.661071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5ed6f6c-3d4a-4dd8-972d-9951da2d2791 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:16.687896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5ed6f6c-3d4a-4dd8-972d-9951da2d2791 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:16.687896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5ed6f6c-3d4a-4dd8-972d-9951da2d2791 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:16.687896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5ed6f6c-3d4a-4dd8-972d-9951da2d2791 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:16.687896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5ed6f6c-3d4a-4dd8-972d-9951da2d2791 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:16.689064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5ed6f6c-3d4a-4dd8-972d-9951da2d2791 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:17.127924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b5ed6f6c-3d4a-4dd8-972d-9951da2d2791 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84d23aa3a7b485690191a9d84386946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159f7d3784934b59ac35dd1adb06886e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:17.143842 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b5ed6f6c-3d4a-4dd8-972d-9951da2d2791 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 200 len: 1253 microversion: 2.1 time: 0.522300 Aug 09 14:49:17.144789 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1932/3904] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:16 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 1253 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:17.173225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0b3948f-6e90-4bb2-a514-312b47dc1986 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:17.180391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0b3948f-6e90-4bb2-a514-312b47dc1986 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:17.238594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0b3948f-6e90-4bb2-a514-312b47dc1986 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:17.242577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0b3948f-6e90-4bb2-a514-312b47dc1986 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:17.246373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0b3948f-6e90-4bb2-a514-312b47dc1986 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:17.249083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0b3948f-6e90-4bb2-a514-312b47dc1986 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:17.257195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0b3948f-6e90-4bb2-a514-312b47dc1986 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:17.257890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0b3948f-6e90-4bb2-a514-312b47dc1986 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:17.374510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc2930f3-adc6-4269-afdd-8dca680ab9c0 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:17.388477 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc2930f3-adc6-4269-afdd-8dca680ab9c0 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1325 microversion: 2.1 time: 1.438974 Aug 09 14:49:17.395914 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1973/3905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:15 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1325 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:17.417774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48b6e30a-0dc1-495b-bba0-e7d0bacc3280 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:17.419909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48b6e30a-0dc1-495b-bba0-e7d0bacc3280 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:17.440808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48b6e30a-0dc1-495b-bba0-e7d0bacc3280 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:17.442650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48b6e30a-0dc1-495b-bba0-e7d0bacc3280 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:17.443607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48b6e30a-0dc1-495b-bba0-e7d0bacc3280 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:17.450429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48b6e30a-0dc1-495b-bba0-e7d0bacc3280 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:17.451299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48b6e30a-0dc1-495b-bba0-e7d0bacc3280 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:17.451910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48b6e30a-0dc1-495b-bba0-e7d0bacc3280 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:17.921112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48b6e30a-0dc1-495b-bba0-e7d0bacc3280 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:17.931489 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48b6e30a-0dc1-495b-bba0-e7d0bacc3280 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1275 microversion: 2.1 time: 0.534126 Aug 09 14:49:17.937359 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1974/3906] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:17 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1275 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:18.166052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1043c609-e205-4104-b773-7c3e466293ad tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:18.167812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1043c609-e205-4104-b773-7c3e466293ad tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] [instance: 1379ae48-c028-4c75-9d03-e9763b74ee26] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:18.189229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1043c609-e205-4104-b773-7c3e466293ad tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:18.192887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1043c609-e205-4104-b773-7c3e466293ad tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:18.193456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1043c609-e205-4104-b773-7c3e466293ad tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:18.196250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1043c609-e205-4104-b773-7c3e466293ad tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:18.196973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1043c609-e205-4104-b773-7c3e466293ad tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:18.198937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1043c609-e205-4104-b773-7c3e466293ad tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:18.237445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0b3948f-6e90-4bb2-a514-312b47dc1986 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:18.263470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0b3948f-6e90-4bb2-a514-312b47dc1986 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:18.266163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0b3948f-6e90-4bb2-a514-312b47dc1986 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:18.267726 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-1043c609-e205-4104-b773-7c3e466293ad tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] HTTP exception thrown: Instance 1379ae48-c028-4c75-9d03-e9763b74ee26 could not be found. Aug 09 14:49:18.269229 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0b3948f-6e90-4bb2-a514-312b47dc1986 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 1.122994 Aug 09 14:49:18.275406 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1933/3907] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:17 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1043c609-e205-4104-b773-7c3e466293ad tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Request method failure captured: Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 HTTP/1.1 Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNe0t1SO4W_zepA2iMd-dbW6nUd2Fzt9rQjYaclLxpM-SEt97pg5iISr0jNZsMVIVxhQNvrJUNCOPU_IDTztN1UkpuyHVtCzM5Cu-_WmemKQOWToIna03m-4uFTeXjvi_dkU8x56iTIEkv8UjNs5Gp0e5_k7dR4APNKxyr-JpMvjkI Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 159f7d3784934b59ac35dd1adb06886e Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersTestBootFromVolume-223603359 Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_159f7d3784934b59ac35dd1adb06886e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/159f7d3784934b59ac35dd1adb06886e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/159f7d3784934b59ac35dd1adb06886e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/159f7d3784934b59ac35dd1adb06886e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersTestBootFromVolume-223603359 Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 159f7d3784934b59ac35dd1adb06886e Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersTestBootFromVolume-223603359 Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersTestBootFromVolume-223603359-project Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: c84d23aa3a7b485690191a9d84386946 Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersTestBootFromVolume-223603359-project Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 1379ae48-c028-4c75-9d03-e9763b74ee26 could not be found. Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '1379ae48-c028-4c75-9d03-e9763b74ee26'} Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1379ae48-c028-4c75-9d03-e9763b74ee26 could not be found. Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1379ae48-c028-4c75-9d03-e9763b74ee26 could not be found. Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:49:18.277566 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:49:18.282157 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:18.282157 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:49:18.282157 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:49:18.282157 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:49:18.282157 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:49:18.282157 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1379ae48-c028-4c75-9d03-e9763b74ee26 could not be found. Aug 09 14:49:18.282157 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:49:18.304910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1043c609-e205-4104-b773-7c3e466293ad tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Returning 404 to user: Instance 1379ae48-c028-4c75-9d03-e9763b74ee26 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:49:18.306597 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1043c609-e205-4104-b773-7c3e466293ad tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26" status: 404 len: 111 microversion: 2.1 time: 0.144817 Aug 09 14:49:18.310302 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1975/3908] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:18 2022] GET /compute/v2.1/servers/1379ae48-c028-4c75-9d03-e9763b74ee26 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:49:18.335387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb29d3d6-dc6d-47ad-b223-e5fbc5c06ed5 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] Calling method '.version_select at 0x7f41dd2785e0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:18.402759 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb29d3d6-dc6d-47ad-b223-e5fbc5c06ed5 tempest-ServersTestBootFromVolume-223603359 tempest-ServersTestBootFromVolume-223603359-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005722400" status: 202 len: 0 microversion: 2.1 time: 0.074530 Aug 09 14:49:18.403530 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1934/3909] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 14:49:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005722400 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:49:18.415614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e879ee14-93df-40ce-a54e-b02cab5632be tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:18.417049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e879ee14-93df-40ce-a54e-b02cab5632be tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:18.428701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e879ee14-93df-40ce-a54e-b02cab5632be tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:18.431708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e879ee14-93df-40ce-a54e-b02cab5632be tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:18.434821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e879ee14-93df-40ce-a54e-b02cab5632be tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:18.437004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e879ee14-93df-40ce-a54e-b02cab5632be tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:18.437702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e879ee14-93df-40ce-a54e-b02cab5632be tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:18.439466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e879ee14-93df-40ce-a54e-b02cab5632be tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:18.946580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e879ee14-93df-40ce-a54e-b02cab5632be tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:18.958052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-232fa46f-682f-401a-92ba-1fe1e7c2a06f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:18.958676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-232fa46f-682f-401a-92ba-1fe1e7c2a06f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:18.960609 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e879ee14-93df-40ce-a54e-b02cab5632be tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1325 microversion: 2.1 time: 0.550537 Aug 09 14:49:18.962113 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1976/3910] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:18 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1325 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:18.990318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-232fa46f-682f-401a-92ba-1fe1e7c2a06f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:18.993743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-232fa46f-682f-401a-92ba-1fe1e7c2a06f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:18.997230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-232fa46f-682f-401a-92ba-1fe1e7c2a06f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:19.001761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-232fa46f-682f-401a-92ba-1fe1e7c2a06f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:19.007693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-232fa46f-682f-401a-92ba-1fe1e7c2a06f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:19.009357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-232fa46f-682f-401a-92ba-1fe1e7c2a06f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:19.226597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-232fa46f-682f-401a-92ba-1fe1e7c2a06f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:19.241316 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-232fa46f-682f-401a-92ba-1fe1e7c2a06f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1273 microversion: 2.1 time: 0.287445 Aug 09 14:49:19.241938 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1935/3911] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:18 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:49:19.301633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-460439ef-0fda-4075-88b8-02d52a21705b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:19.302703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-460439ef-0fda-4075-88b8-02d52a21705b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:19.328698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460439ef-0fda-4075-88b8-02d52a21705b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:19.333716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460439ef-0fda-4075-88b8-02d52a21705b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:19.337494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460439ef-0fda-4075-88b8-02d52a21705b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:19.339767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460439ef-0fda-4075-88b8-02d52a21705b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:19.344502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460439ef-0fda-4075-88b8-02d52a21705b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:19.346183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460439ef-0fda-4075-88b8-02d52a21705b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:19.807425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-460439ef-0fda-4075-88b8-02d52a21705b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:19.820259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-460439ef-0fda-4075-88b8-02d52a21705b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:19.821827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-460439ef-0fda-4075-88b8-02d52a21705b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:19.823051 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-460439ef-0fda-4075-88b8-02d52a21705b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 0.527757 Aug 09 14:49:19.840362 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1977/3912] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:19 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:19.984795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-167db2ac-39d9-4440-bf30-24d950d6cbae tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:19.986131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-167db2ac-39d9-4440-bf30-24d950d6cbae tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:20.003435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-167db2ac-39d9-4440-bf30-24d950d6cbae tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:20.005969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-167db2ac-39d9-4440-bf30-24d950d6cbae tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:20.009192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-167db2ac-39d9-4440-bf30-24d950d6cbae tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:20.010158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-167db2ac-39d9-4440-bf30-24d950d6cbae tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:20.010799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-167db2ac-39d9-4440-bf30-24d950d6cbae tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:20.033679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-167db2ac-39d9-4440-bf30-24d950d6cbae tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:20.265730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de7d6400-4e8e-45e2-b610-2755ac381408 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:20.266766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de7d6400-4e8e-45e2-b610-2755ac381408 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:20.281280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de7d6400-4e8e-45e2-b610-2755ac381408 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:20.282187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de7d6400-4e8e-45e2-b610-2755ac381408 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:20.283359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de7d6400-4e8e-45e2-b610-2755ac381408 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:20.284423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de7d6400-4e8e-45e2-b610-2755ac381408 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:20.286953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de7d6400-4e8e-45e2-b610-2755ac381408 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:20.289248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de7d6400-4e8e-45e2-b610-2755ac381408 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:20.534927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-de7d6400-4e8e-45e2-b610-2755ac381408 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:20.555445 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de7d6400-4e8e-45e2-b610-2755ac381408 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1273 microversion: 2.1 time: 0.296594 Aug 09 14:49:20.556411 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1978/3913] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:20 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:49:20.679927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-167db2ac-39d9-4440-bf30-24d950d6cbae tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:20.704563 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-167db2ac-39d9-4440-bf30-24d950d6cbae tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1325 microversion: 2.1 time: 0.724787 Aug 09 14:49:20.707979 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1936/3914] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:19 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1325 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:20.853987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fba24e4a-6dde-405a-8f92-a6723f6b2338 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:20.854621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fba24e4a-6dde-405a-8f92-a6723f6b2338 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:20.874447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fba24e4a-6dde-405a-8f92-a6723f6b2338 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:20.874944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fba24e4a-6dde-405a-8f92-a6723f6b2338 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:20.883369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fba24e4a-6dde-405a-8f92-a6723f6b2338 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:20.884424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fba24e4a-6dde-405a-8f92-a6723f6b2338 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:20.885523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fba24e4a-6dde-405a-8f92-a6723f6b2338 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:20.886055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fba24e4a-6dde-405a-8f92-a6723f6b2338 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:21.576648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0ad1f96-0129-43b5-872f-d1f20624f352 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:21.577323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0ad1f96-0129-43b5-872f-d1f20624f352 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:21.599663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0ad1f96-0129-43b5-872f-d1f20624f352 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:21.600569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0ad1f96-0129-43b5-872f-d1f20624f352 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:21.610851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0ad1f96-0129-43b5-872f-d1f20624f352 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:21.613212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0ad1f96-0129-43b5-872f-d1f20624f352 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:21.613870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0ad1f96-0129-43b5-872f-d1f20624f352 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:21.616322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0ad1f96-0129-43b5-872f-d1f20624f352 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:21.707817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fba24e4a-6dde-405a-8f92-a6723f6b2338 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:21.731281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fba24e4a-6dde-405a-8f92-a6723f6b2338 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:21.757931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fba24e4a-6dde-405a-8f92-a6723f6b2338 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:21.764454 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fba24e4a-6dde-405a-8f92-a6723f6b2338 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 0.914453 Aug 09 14:49:21.776574 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1979/3915] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:20 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:21.814656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aee4d1a7-923d-47b9-87cb-760c83b874ad tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:21.816055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aee4d1a7-923d-47b9-87cb-760c83b874ad tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:21.847587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aee4d1a7-923d-47b9-87cb-760c83b874ad tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:21.848104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aee4d1a7-923d-47b9-87cb-760c83b874ad tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:21.848548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aee4d1a7-923d-47b9-87cb-760c83b874ad tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:21.849280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aee4d1a7-923d-47b9-87cb-760c83b874ad tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:21.849736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aee4d1a7-923d-47b9-87cb-760c83b874ad tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:21.850162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aee4d1a7-923d-47b9-87cb-760c83b874ad tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:21.940092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:22.799034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0ad1f96-0129-43b5-872f-d1f20624f352 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:22.812977 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0ad1f96-0129-43b5-872f-d1f20624f352 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1315 microversion: 2.1 time: 1.238950 Aug 09 14:49:22.815849 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1937/3916] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:21 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1315 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:49:22.851302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-780bb4c7-8dd0-44f4-bb45-bdd4ea998eea tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:22.855650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-780bb4c7-8dd0-44f4-bb45-bdd4ea998eea tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:22.894205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-780bb4c7-8dd0-44f4-bb45-bdd4ea998eea tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:22.898154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-780bb4c7-8dd0-44f4-bb45-bdd4ea998eea tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:22.900860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-780bb4c7-8dd0-44f4-bb45-bdd4ea998eea tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:22.901904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-780bb4c7-8dd0-44f4-bb45-bdd4ea998eea tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:22.903347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-780bb4c7-8dd0-44f4-bb45-bdd4ea998eea tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:22.907255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-780bb4c7-8dd0-44f4-bb45-bdd4ea998eea tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:22.923807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aee4d1a7-923d-47b9-87cb-760c83b874ad tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:22.963008 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aee4d1a7-923d-47b9-87cb-760c83b874ad tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1325 microversion: 2.1 time: 1.181502 Aug 09 14:49:22.990571 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1980/3917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:21 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1325 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:23.015722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:23.801642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-780bb4c7-8dd0-44f4-bb45-bdd4ea998eea tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:23.816196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-780bb4c7-8dd0-44f4-bb45-bdd4ea998eea tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:23.822190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-780bb4c7-8dd0-44f4-bb45-bdd4ea998eea tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:23.825898 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-780bb4c7-8dd0-44f4-bb45-bdd4ea998eea tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 1.006617 Aug 09 14:49:23.826720 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1938/3918] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:22 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:23.843359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afb80bf0-33e5-441a-96e7-a8fa80e14ac3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:23.843992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-afb80bf0-33e5-441a-96e7-a8fa80e14ac3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:23.850653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afb80bf0-33e5-441a-96e7-a8fa80e14ac3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:23.871329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afb80bf0-33e5-441a-96e7-a8fa80e14ac3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:23.872360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afb80bf0-33e5-441a-96e7-a8fa80e14ac3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:23.875213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afb80bf0-33e5-441a-96e7-a8fa80e14ac3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:23.876233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afb80bf0-33e5-441a-96e7-a8fa80e14ac3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:23.876943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afb80bf0-33e5-441a-96e7-a8fa80e14ac3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:24.002233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f54b61b4-7d86-4257-b129-e4b526f0b4c7 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:24.003545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f54b61b4-7d86-4257-b129-e4b526f0b4c7 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:24.039432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f54b61b4-7d86-4257-b129-e4b526f0b4c7 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:24.052748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f54b61b4-7d86-4257-b129-e4b526f0b4c7 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:24.054806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f54b61b4-7d86-4257-b129-e4b526f0b4c7 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:24.058787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f54b61b4-7d86-4257-b129-e4b526f0b4c7 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:24.059570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f54b61b4-7d86-4257-b129-e4b526f0b4c7 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:24.060240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f54b61b4-7d86-4257-b129-e4b526f0b4c7 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:24.982285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:25.258963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f54b61b4-7d86-4257-b129-e4b526f0b4c7 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:25.275829 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f54b61b4-7d86-4257-b129-e4b526f0b4c7 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1325 microversion: 2.1 time: 1.279105 Aug 09 14:49:25.276456 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1939/3919] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:23 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1325 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:25.288357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-429d852a-0a23-4bc5-bcb8-e5c1357e1726 req-4ea56f84-0e21-48d0-b719-7450ee631944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f8bb6e-e556-4454-bea9-c1d1b0e3d986", "tag": "ea448bc1-5122-4971-97e6-788506f2959a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:25.325338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-429d852a-0a23-4bc5-bcb8-e5c1357e1726 req-4ea56f84-0e21-48d0-b719-7450ee631944 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:25.325876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-429d852a-0a23-4bc5-bcb8-e5c1357e1726 req-4ea56f84-0e21-48d0-b719-7450ee631944 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:25.327584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-429d852a-0a23-4bc5-bcb8-e5c1357e1726 req-4ea56f84-0e21-48d0-b719-7450ee631944 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:25.357164 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-429d852a-0a23-4bc5-bcb8-e5c1357e1726 req-4ea56f84-0e21-48d0-b719-7450ee631944 service nova] Creating event network-changed:ea448bc1-5122-4971-97e6-788506f2959a for instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 on n-h1-844626-8 Aug 09 14:49:25.364010 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-429d852a-0a23-4bc5-bcb8-e5c1357e1726 req-4ea56f84-0e21-48d0-b719-7450ee631944 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083096 Aug 09 14:49:25.365919 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1940/3920] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:49:25.377776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07d4ee12-ff43-4ad4-a437-9bddaa1b4c55 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:25.379923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07d4ee12-ff43-4ad4-a437-9bddaa1b4c55 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:25.400232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07d4ee12-ff43-4ad4-a437-9bddaa1b4c55 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:25.400831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07d4ee12-ff43-4ad4-a437-9bddaa1b4c55 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:25.401423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07d4ee12-ff43-4ad4-a437-9bddaa1b4c55 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:25.404047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07d4ee12-ff43-4ad4-a437-9bddaa1b4c55 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:25.404893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07d4ee12-ff43-4ad4-a437-9bddaa1b4c55 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:25.407501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07d4ee12-ff43-4ad4-a437-9bddaa1b4c55 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:26.105689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-afb80bf0-33e5-441a-96e7-a8fa80e14ac3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:26.123664 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afb80bf0-33e5-441a-96e7-a8fa80e14ac3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1315 microversion: 2.1 time: 2.290598 Aug 09 14:49:26.126121 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1981/3921] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:23 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1315 bytes in 2294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:26.141464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-76ac5182-4ffe-4a40-a34a-28c01ea294e5 req-5aa51aca-5eae-4df1-8a2d-6c11b77a07d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837955cd-5239-4a7b-a5a3-7ab9a15431ed", "name": "network-vif-plugged", "status": "completed", "tag": "889d4096-79c0-4ef1-9820-306700841a6e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:26.154143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-76ac5182-4ffe-4a40-a34a-28c01ea294e5 req-5aa51aca-5eae-4df1-8a2d-6c11b77a07d5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:26.155207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-76ac5182-4ffe-4a40-a34a-28c01ea294e5 req-5aa51aca-5eae-4df1-8a2d-6c11b77a07d5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:26.155840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-76ac5182-4ffe-4a40-a34a-28c01ea294e5 req-5aa51aca-5eae-4df1-8a2d-6c11b77a07d5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:26.156137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:26.178817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07d4ee12-ff43-4ad4-a437-9bddaa1b4c55 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:26.179146 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-76ac5182-4ffe-4a40-a34a-28c01ea294e5 req-5aa51aca-5eae-4df1-8a2d-6c11b77a07d5 service nova] Creating event network-vif-plugged:889d4096-79c0-4ef1-9820-306700841a6e for instance 837955cd-5239-4a7b-a5a3-7ab9a15431ed on n-h2-844626-8 Aug 09 14:49:26.190074 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-76ac5182-4ffe-4a40-a34a-28c01ea294e5 req-5aa51aca-5eae-4df1-8a2d-6c11b77a07d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055754 Aug 09 14:49:26.192174 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1982/3922] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:49:26.198463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07d4ee12-ff43-4ad4-a437-9bddaa1b4c55 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:26.201070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07d4ee12-ff43-4ad4-a437-9bddaa1b4c55 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:26.202946 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07d4ee12-ff43-4ad4-a437-9bddaa1b4c55 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1739 microversion: 2.20 time: 0.835942 Aug 09 14:49:26.204122 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1941/3923] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:25 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1739 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:26.303964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85455983-e924-4da1-9d3a-bdd081b950fc tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:26.305268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85455983-e924-4da1-9d3a-bdd081b950fc tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:26.321954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85455983-e924-4da1-9d3a-bdd081b950fc tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:26.326559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85455983-e924-4da1-9d3a-bdd081b950fc tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:26.328045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85455983-e924-4da1-9d3a-bdd081b950fc tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:26.332230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85455983-e924-4da1-9d3a-bdd081b950fc tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:26.340528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85455983-e924-4da1-9d3a-bdd081b950fc tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:26.341827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85455983-e924-4da1-9d3a-bdd081b950fc tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:27.006008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-85455983-e924-4da1-9d3a-bdd081b950fc tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:27.024860 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85455983-e924-4da1-9d3a-bdd081b950fc tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1325 microversion: 2.1 time: 0.728967 Aug 09 14:49:27.029869 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1983/3924] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:26 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1325 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:27.151620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fcf581a1-c900-421c-b07c-f48a51eb07d3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:27.152705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fcf581a1-c900-421c-b07c-f48a51eb07d3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:27.173696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcf581a1-c900-421c-b07c-f48a51eb07d3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:27.174314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcf581a1-c900-421c-b07c-f48a51eb07d3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:27.174534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcf581a1-c900-421c-b07c-f48a51eb07d3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:27.178035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcf581a1-c900-421c-b07c-f48a51eb07d3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:27.179650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcf581a1-c900-421c-b07c-f48a51eb07d3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:27.181328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcf581a1-c900-421c-b07c-f48a51eb07d3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:27.232040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3f02f4c3-ce81-46c5-b07a-ed876267f396 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:27.233253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3f02f4c3-ce81-46c5-b07a-ed876267f396 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:27.243450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f02f4c3-ce81-46c5-b07a-ed876267f396 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:27.243928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f02f4c3-ce81-46c5-b07a-ed876267f396 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:27.244357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f02f4c3-ce81-46c5-b07a-ed876267f396 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:27.245132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f02f4c3-ce81-46c5-b07a-ed876267f396 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:27.245572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f02f4c3-ce81-46c5-b07a-ed876267f396 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:27.250721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f02f4c3-ce81-46c5-b07a-ed876267f396 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:27.556423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3f02f4c3-ce81-46c5-b07a-ed876267f396 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:27.579682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3f02f4c3-ce81-46c5-b07a-ed876267f396 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:27.585739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3f02f4c3-ce81-46c5-b07a-ed876267f396 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:27.589465 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3f02f4c3-ce81-46c5-b07a-ed876267f396 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1721 microversion: 2.20 time: 0.361604 Aug 09 14:49:27.591485 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1984/3925] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:27 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1721 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:49:27.720295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fcf581a1-c900-421c-b07c-f48a51eb07d3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:27.730914 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fcf581a1-c900-421c-b07c-f48a51eb07d3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1315 microversion: 2.1 time: 0.587236 Aug 09 14:49:27.731543 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1942/3926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:27 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1315 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:28.051334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a394069f-f776-43a8-b86d-f2f410eda17a tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:28.052503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a394069f-f776-43a8-b86d-f2f410eda17a tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:28.070182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a394069f-f776-43a8-b86d-f2f410eda17a tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:28.072428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a394069f-f776-43a8-b86d-f2f410eda17a tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:28.073757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a394069f-f776-43a8-b86d-f2f410eda17a tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:28.075910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a394069f-f776-43a8-b86d-f2f410eda17a tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:28.077156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a394069f-f776-43a8-b86d-f2f410eda17a tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:28.079607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a394069f-f776-43a8-b86d-f2f410eda17a tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:28.435805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a394069f-f776-43a8-b86d-f2f410eda17a tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:28.450679 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a394069f-f776-43a8-b86d-f2f410eda17a tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1325 microversion: 2.1 time: 0.404031 Aug 09 14:49:28.463197 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1985/3927] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:28 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1325 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:28.623390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22c3f564-17f7-4e28-956d-b5f8b01cfacb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:28.631978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22c3f564-17f7-4e28-956d-b5f8b01cfacb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:28.658069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22c3f564-17f7-4e28-956d-b5f8b01cfacb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:28.678611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22c3f564-17f7-4e28-956d-b5f8b01cfacb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:28.680454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22c3f564-17f7-4e28-956d-b5f8b01cfacb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:28.681713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22c3f564-17f7-4e28-956d-b5f8b01cfacb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:28.682361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22c3f564-17f7-4e28-956d-b5f8b01cfacb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:28.683293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22c3f564-17f7-4e28-956d-b5f8b01cfacb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:28.755733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d605b959-5b9e-4968-bdda-74a5ad21eaec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:28.756608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d605b959-5b9e-4968-bdda-74a5ad21eaec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:28.769890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d605b959-5b9e-4968-bdda-74a5ad21eaec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:28.770650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d605b959-5b9e-4968-bdda-74a5ad21eaec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:28.771302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d605b959-5b9e-4968-bdda-74a5ad21eaec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:28.773820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d605b959-5b9e-4968-bdda-74a5ad21eaec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:28.774474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d605b959-5b9e-4968-bdda-74a5ad21eaec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:28.779160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d605b959-5b9e-4968-bdda-74a5ad21eaec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:29.186290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d605b959-5b9e-4968-bdda-74a5ad21eaec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:29.198223 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d605b959-5b9e-4968-bdda-74a5ad21eaec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1315 microversion: 2.1 time: 0.446194 Aug 09 14:49:29.211641 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1986/3928] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:28 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:29.359368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-22c3f564-17f7-4e28-956d-b5f8b01cfacb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:29.370302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-22c3f564-17f7-4e28-956d-b5f8b01cfacb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:29.371984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-22c3f564-17f7-4e28-956d-b5f8b01cfacb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:29.374424 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22c3f564-17f7-4e28-956d-b5f8b01cfacb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1721 microversion: 2.20 time: 0.757767 Aug 09 14:49:29.374638 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1943/3929] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:28 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1721 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:29.476070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b70a23bd-70cc-4bda-a03c-ffe069dc62e4 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:29.477367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b70a23bd-70cc-4bda-a03c-ffe069dc62e4 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:29.492139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b70a23bd-70cc-4bda-a03c-ffe069dc62e4 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:29.492640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b70a23bd-70cc-4bda-a03c-ffe069dc62e4 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:29.493073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b70a23bd-70cc-4bda-a03c-ffe069dc62e4 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:29.493965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b70a23bd-70cc-4bda-a03c-ffe069dc62e4 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:29.494564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b70a23bd-70cc-4bda-a03c-ffe069dc62e4 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:29.495259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b70a23bd-70cc-4bda-a03c-ffe069dc62e4 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:30.225438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-231eb792-c880-4bf5-a228-e066b7aa1271 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:30.226712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-231eb792-c880-4bf5-a228-e066b7aa1271 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:30.235492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-231eb792-c880-4bf5-a228-e066b7aa1271 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:30.235704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-231eb792-c880-4bf5-a228-e066b7aa1271 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:30.237321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-231eb792-c880-4bf5-a228-e066b7aa1271 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:30.240865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-231eb792-c880-4bf5-a228-e066b7aa1271 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:30.241511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-231eb792-c880-4bf5-a228-e066b7aa1271 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:30.242665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-231eb792-c880-4bf5-a228-e066b7aa1271 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:30.361301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b70a23bd-70cc-4bda-a03c-ffe069dc62e4 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:30.384844 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b70a23bd-70cc-4bda-a03c-ffe069dc62e4 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1520 microversion: 2.1 time: 0.910758 Aug 09 14:49:30.387922 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1987/3930] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:29 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1520 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:30.408469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-660eb207-0992-403a-8611-646ad0f1482d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:30.411825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-660eb207-0992-403a-8611-646ad0f1482d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:30.426903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-660eb207-0992-403a-8611-646ad0f1482d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:30.427390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-660eb207-0992-403a-8611-646ad0f1482d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:30.427996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-660eb207-0992-403a-8611-646ad0f1482d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:30.432148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-660eb207-0992-403a-8611-646ad0f1482d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:30.432951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-660eb207-0992-403a-8611-646ad0f1482d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:30.433610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-660eb207-0992-403a-8611-646ad0f1482d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:30.782600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-231eb792-c880-4bf5-a228-e066b7aa1271 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:30.826043 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-231eb792-c880-4bf5-a228-e066b7aa1271 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1315 microversion: 2.1 time: 0.602576 Aug 09 14:49:30.828109 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1944/3931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:30 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:30.848513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-660eb207-0992-403a-8611-646ad0f1482d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:30.863520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-660eb207-0992-403a-8611-646ad0f1482d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:30.865122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-660eb207-0992-403a-8611-646ad0f1482d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:30.866612 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-660eb207-0992-403a-8611-646ad0f1482d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1721 microversion: 2.20 time: 0.472235 Aug 09 14:49:30.868361 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1988/3932] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:30 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1721 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:30.884625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-21ac844e-c67b-43b4-9a88-7b584120b505 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:30.885884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-825d4497-401d-48fe-9266-bc3de53ed5e3 req-690aede8-2305-464d-98c0-9d962cc617f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25a9384-ba3d-4ff8-8f2a-39ccdde0690a", "name": "network-vif-unplugged", "status": "completed", "tag": "ec41d639-5d70-4bd6-8da7-60954703b90b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:30.886928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-21ac844e-c67b-43b4-9a88-7b584120b505 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:30.936673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-825d4497-401d-48fe-9266-bc3de53ed5e3 req-690aede8-2305-464d-98c0-9d962cc617f7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:30.937159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-825d4497-401d-48fe-9266-bc3de53ed5e3 req-690aede8-2305-464d-98c0-9d962cc617f7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:30.940403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-825d4497-401d-48fe-9266-bc3de53ed5e3 req-690aede8-2305-464d-98c0-9d962cc617f7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:30.941171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21ac844e-c67b-43b4-9a88-7b584120b505 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:30.945197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21ac844e-c67b-43b4-9a88-7b584120b505 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:30.946013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21ac844e-c67b-43b4-9a88-7b584120b505 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:30.948160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21ac844e-c67b-43b4-9a88-7b584120b505 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:30.949493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21ac844e-c67b-43b4-9a88-7b584120b505 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:30.951579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21ac844e-c67b-43b4-9a88-7b584120b505 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:30.984548 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-825d4497-401d-48fe-9266-bc3de53ed5e3 req-690aede8-2305-464d-98c0-9d962cc617f7 service nova] Creating event network-vif-unplugged:ec41d639-5d70-4bd6-8da7-60954703b90b for instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a on n-h1-844626-8 Aug 09 14:49:31.003973 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-825d4497-401d-48fe-9266-bc3de53ed5e3 req-690aede8-2305-464d-98c0-9d962cc617f7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132608 Aug 09 14:49:31.008110 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1989/3933] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:49:31.028557 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-21ac844e-c67b-43b4-9a88-7b584120b505 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] HTTP exception thrown: Instance is not a member of specified network Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-21ac844e-c67b-43b4-9a88-7b584120b505 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Request method failure captured: Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed/ips/invalid HTTP/1.1 Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nPa11Cwfp04hQb9iHnoAjzix25mErRGOQSloDZmgDtN1MCxZkorjpejHkRWMHQKR8VCgFHMJ3UM2IpBrk7pMANbVT-n7VubCtT9HYMQGFHUbCRA9W7ypFlI4f59-3oq5BPvx9vptlmqPnagsBa2c98yNgOYDIxxLRB9N02Re6gZOxA Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9fb91797fb8e427588194573250d2953 Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1166498832 Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9fb91797fb8e427588194573250d2953", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9fb91797fb8e427588194573250d2953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9fb91797fb8e427588194573250d2953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9fb91797fb8e427588194573250d2953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1166498832 Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9fb91797fb8e427588194573250d2953 Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1166498832 Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerAddressesNegativeTestJSON-1166498832-project Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d985ad594bb9409b859e7812f32a9a64 Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1166498832-project Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance is not a member of specified network Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'server_id': '837955cd-5239-4a7b-a5a3-7ab9a15431ed', 'id': 'invalid'} Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 09 14:49:31.035500 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:31.040899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-21ac844e-c67b-43b4-9a88-7b584120b505 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Returning 404 to user: Instance is not a member of specified network {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:49:31.045022 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-21ac844e-c67b-43b4-9a88-7b584120b505 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.197845 Aug 09 14:49:31.054229 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1945/3934] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 14:49:30 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed/ips/invalid => generated 91 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:49:31.082035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-20dc9f74-c734-4f31-872b-7e9a0d2d2b45 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:31.084016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-20dc9f74-c734-4f31-872b-7e9a0d2d2b45 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Failed to fetch instance by id 999 {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 14:49:31.084785 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-20dc9f74-c734-4f31-872b-7e9a0d2d2b45 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] HTTP exception thrown: Instance 999 could not be found. Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-20dc9f74-c734-4f31-872b-7e9a0d2d2b45 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Request method failure captured: Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nPa11Cwfp04hQb9iHnoAjzix25mErRGOQSloDZmgDtN1MCxZkorjpejHkRWMHQKR8VCgFHMJ3UM2IpBrk7pMANbVT-n7VubCtT9HYMQGFHUbCRA9W7ypFlI4f59-3oq5BPvx9vptlmqPnagsBa2c98yNgOYDIxxLRB9N02Re6gZOxA Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9fb91797fb8e427588194573250d2953 Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1166498832 Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9fb91797fb8e427588194573250d2953", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9fb91797fb8e427588194573250d2953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9fb91797fb8e427588194573250d2953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9fb91797fb8e427588194573250d2953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1166498832 Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9fb91797fb8e427588194573250d2953 Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1166498832 Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerAddressesNegativeTestJSON-1166498832-project Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d985ad594bb9409b859e7812f32a9a64 Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1166498832-project Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 999 could not be found. Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'server_id': '999'} Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 09 14:49:31.091915 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:49:31.098284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-20dc9f74-c734-4f31-872b-7e9a0d2d2b45 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Returning 404 to user: Instance 999 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:49:31.099462 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-20dc9f74-c734-4f31-872b-7e9a0d2d2b45 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.046880 Aug 09 14:49:31.105184 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1990/3935] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 9 14:49:31 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 09 14:49:31.114496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7d7bfee6-ae8a-4f93-b77c-ac34cfd25b96 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:31.115291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7d7bfee6-ae8a-4f93-b77c-ac34cfd25b96 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:31.123200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d7bfee6-ae8a-4f93-b77c-ac34cfd25b96 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:31.123933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d7bfee6-ae8a-4f93-b77c-ac34cfd25b96 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:31.124534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d7bfee6-ae8a-4f93-b77c-ac34cfd25b96 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:31.125453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d7bfee6-ae8a-4f93-b77c-ac34cfd25b96 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:31.126055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d7bfee6-ae8a-4f93-b77c-ac34cfd25b96 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:31.126846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7d7bfee6-ae8a-4f93-b77c-ac34cfd25b96 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:31.163498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7d7bfee6-ae8a-4f93-b77c-ac34cfd25b96 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:49:31.262622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:31.286280 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7d7bfee6-ae8a-4f93-b77c-ac34cfd25b96 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "DELETE /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 204 len: 0 microversion: 2.1 time: 0.171512 Aug 09 14:49:31.286735 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1946/3936] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:49:31 2022] DELETE /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:49:31.298673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-757467d6-4400-4c10-b8bd-f1ba1e601a70 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:31.299862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-757467d6-4400-4c10-b8bd-f1ba1e601a70 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:31.312805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-757467d6-4400-4c10-b8bd-f1ba1e601a70 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:31.314118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-757467d6-4400-4c10-b8bd-f1ba1e601a70 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:31.314771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-757467d6-4400-4c10-b8bd-f1ba1e601a70 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:31.317002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-757467d6-4400-4c10-b8bd-f1ba1e601a70 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:31.317618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-757467d6-4400-4c10-b8bd-f1ba1e601a70 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:31.319048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-757467d6-4400-4c10-b8bd-f1ba1e601a70 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:31.790728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-757467d6-4400-4c10-b8bd-f1ba1e601a70 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:31.806308 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-757467d6-4400-4c10-b8bd-f1ba1e601a70 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1526 microversion: 2.1 time: 0.513341 Aug 09 14:49:31.810018 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1991/3937] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:31 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1526 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:31.852020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fc67fc35-fb08-4109-a3b2-eb12f692b4e1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:31.853064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fc67fc35-fb08-4109-a3b2-eb12f692b4e1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:31.867868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc67fc35-fb08-4109-a3b2-eb12f692b4e1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:31.868564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc67fc35-fb08-4109-a3b2-eb12f692b4e1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:31.870726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc67fc35-fb08-4109-a3b2-eb12f692b4e1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:31.871794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc67fc35-fb08-4109-a3b2-eb12f692b4e1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:31.873449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc67fc35-fb08-4109-a3b2-eb12f692b4e1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:31.880519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc67fc35-fb08-4109-a3b2-eb12f692b4e1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:31.896502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e04a9ee-e664-4e54-97f8-0f55de7bc9c2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:31.897905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9e04a9ee-e664-4e54-97f8-0f55de7bc9c2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:31.976552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e04a9ee-e664-4e54-97f8-0f55de7bc9c2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:31.978108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e04a9ee-e664-4e54-97f8-0f55de7bc9c2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:31.982767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e04a9ee-e664-4e54-97f8-0f55de7bc9c2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:31.986539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e04a9ee-e664-4e54-97f8-0f55de7bc9c2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:31.989374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e04a9ee-e664-4e54-97f8-0f55de7bc9c2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:31.993583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e04a9ee-e664-4e54-97f8-0f55de7bc9c2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:32.279702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fc67fc35-fb08-4109-a3b2-eb12f692b4e1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:32.303234 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fc67fc35-fb08-4109-a3b2-eb12f692b4e1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1315 microversion: 2.1 time: 0.445669 Aug 09 14:49:32.308449 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1947/3938] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:31 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1315 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:32.357291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9e04a9ee-e664-4e54-97f8-0f55de7bc9c2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:32.369223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9e04a9ee-e664-4e54-97f8-0f55de7bc9c2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:32.370954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9e04a9ee-e664-4e54-97f8-0f55de7bc9c2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:32.372198 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e04a9ee-e664-4e54-97f8-0f55de7bc9c2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1664 microversion: 2.20 time: 0.482434 Aug 09 14:49:32.372762 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1992/3939] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:31 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1664 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:32.396018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81c98654-4e22-4817-b29f-79242affb561 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92fd0b8b-93a4-43b9-addd-8fa75302226b"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:32.399239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81c98654-4e22-4817-b29f-79242affb561 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:32.408607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81c98654-4e22-4817-b29f-79242affb561 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:32.409453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81c98654-4e22-4817-b29f-79242affb561 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:32.410273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81c98654-4e22-4817-b29f-79242affb561 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:32.411127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81c98654-4e22-4817-b29f-79242affb561 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:32.411993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81c98654-4e22-4817-b29f-79242affb561 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:32.412531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81c98654-4e22-4817-b29f-79242affb561 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:32.832460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-068acd08-e8c7-4932-b1ea-f82a1b903257 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:32.833231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-068acd08-e8c7-4932-b1ea-f82a1b903257 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:32.842707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-068acd08-e8c7-4932-b1ea-f82a1b903257 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:32.850517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-068acd08-e8c7-4932-b1ea-f82a1b903257 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:32.852455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-068acd08-e8c7-4932-b1ea-f82a1b903257 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:32.858112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-068acd08-e8c7-4932-b1ea-f82a1b903257 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:32.863880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-068acd08-e8c7-4932-b1ea-f82a1b903257 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:32.864854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-068acd08-e8c7-4932-b1ea-f82a1b903257 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:33.052995 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81c98654-4e22-4817-b29f-79242affb561 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "POST /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.661972 Aug 09 14:49:33.054832 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1948/3940] 10.222.0.50 () {62 vars in 1364 bytes} [Tue Aug 9 14:49:32 2022] POST /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments => generated 188 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:49:33.223702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d2c6876-12fb-47a2-83c6-178cc2688173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:33.224307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d2c6876-12fb-47a2-83c6-178cc2688173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:33.240672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d2c6876-12fb-47a2-83c6-178cc2688173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:33.241162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d2c6876-12fb-47a2-83c6-178cc2688173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:33.241594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d2c6876-12fb-47a2-83c6-178cc2688173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:33.244357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d2c6876-12fb-47a2-83c6-178cc2688173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:33.244917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d2c6876-12fb-47a2-83c6-178cc2688173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:33.245899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d2c6876-12fb-47a2-83c6-178cc2688173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:33.393123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d2c6876-12fb-47a2-83c6-178cc2688173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119406) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 09 14:49:33.515876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-068acd08-e8c7-4932-b1ea-f82a1b903257 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:33.532858 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-068acd08-e8c7-4932-b1ea-f82a1b903257 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1526 microversion: 2.1 time: 0.705352 Aug 09 14:49:33.537049 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1993/3941] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:32 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1526 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:49:33.564133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5918d87a-54d2-4a5d-baac-1407030ade59 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:33.564755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5918d87a-54d2-4a5d-baac-1407030ade59 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:33.585478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5918d87a-54d2-4a5d-baac-1407030ade59 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:33.586051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5918d87a-54d2-4a5d-baac-1407030ade59 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:33.590227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5918d87a-54d2-4a5d-baac-1407030ade59 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:33.591022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5918d87a-54d2-4a5d-baac-1407030ade59 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:33.592984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5918d87a-54d2-4a5d-baac-1407030ade59 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:33.600630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5918d87a-54d2-4a5d-baac-1407030ade59 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:33.620140 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d2c6876-12fb-47a2-83c6-178cc2688173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "POST /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/action" status: 202 len: 0 microversion: 2.20 time: 0.400052 Aug 09 14:49:33.621057 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1949/3942] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:49:33 2022] POST /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:49:33.635524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4ac69173-81ad-4fea-9057-af3fe3f3ffee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:33.637941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4ac69173-81ad-4fea-9057-af3fe3f3ffee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:33.655162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ac69173-81ad-4fea-9057-af3fe3f3ffee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:33.655836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ac69173-81ad-4fea-9057-af3fe3f3ffee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:33.659555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ac69173-81ad-4fea-9057-af3fe3f3ffee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:33.661890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ac69173-81ad-4fea-9057-af3fe3f3ffee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:33.669709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ac69173-81ad-4fea-9057-af3fe3f3ffee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:33.672275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ac69173-81ad-4fea-9057-af3fe3f3ffee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:34.065489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4ac69173-81ad-4fea-9057-af3fe3f3ffee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:34.067936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:34.078667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4ac69173-81ad-4fea-9057-af3fe3f3ffee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:34.081080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4ac69173-81ad-4fea-9057-af3fe3f3ffee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:34.082481 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4ac69173-81ad-4fea-9057-af3fe3f3ffee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1750 microversion: 2.20 time: 0.456333 Aug 09 14:49:34.085193 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1950/3943] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:33 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1750 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:49:34.166220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b7713635-87b5-4713-ba1c-a1284f3e90b1 req-c5769922-f106-4c78-a0ca-066412b8ec46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f8bb6e-e556-4454-bea9-c1d1b0e3d986", "name": "network-vif-plugged", "status": "completed", "tag": "ea448bc1-5122-4971-97e6-788506f2959a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:34.197041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b7713635-87b5-4713-ba1c-a1284f3e90b1 req-c5769922-f106-4c78-a0ca-066412b8ec46 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:34.199373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b7713635-87b5-4713-ba1c-a1284f3e90b1 req-c5769922-f106-4c78-a0ca-066412b8ec46 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:34.200068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b7713635-87b5-4713-ba1c-a1284f3e90b1 req-c5769922-f106-4c78-a0ca-066412b8ec46 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:34.234863 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b7713635-87b5-4713-ba1c-a1284f3e90b1 req-c5769922-f106-4c78-a0ca-066412b8ec46 service nova] Creating event network-vif-plugged:ea448bc1-5122-4971-97e6-788506f2959a for instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 on n-h1-844626-8 Aug 09 14:49:34.248289 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b7713635-87b5-4713-ba1c-a1284f3e90b1 req-c5769922-f106-4c78-a0ca-066412b8ec46 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084131 Aug 09 14:49:34.250546 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1951/3944] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:49:34.254636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5918d87a-54d2-4a5d-baac-1407030ade59 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:34.270237 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5918d87a-54d2-4a5d-baac-1407030ade59 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1315 microversion: 2.1 time: 0.727459 Aug 09 14:49:34.287340 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1994/3945] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:33 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:34.533919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-610d49a5-2f84-4587-a27e-97d4f437a6da req-017ae6d2-4583-4ce5-b8d2-7908b11c13a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "837955cd-5239-4a7b-a5a3-7ab9a15431ed", "name": "network-vif-deleted", "tag": "889d4096-79c0-4ef1-9820-306700841a6e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:34.567624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7aa1324-7f95-4017-98a1-904d35dc7627 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:34.569484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e7aa1324-7f95-4017-98a1-904d35dc7627 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:34.585908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7aa1324-7f95-4017-98a1-904d35dc7627 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:34.586564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7aa1324-7f95-4017-98a1-904d35dc7627 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:34.589040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7aa1324-7f95-4017-98a1-904d35dc7627 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:34.590177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7aa1324-7f95-4017-98a1-904d35dc7627 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:34.590942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7aa1324-7f95-4017-98a1-904d35dc7627 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:34.593452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7aa1324-7f95-4017-98a1-904d35dc7627 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:34.595962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-610d49a5-2f84-4587-a27e-97d4f437a6da req-017ae6d2-4583-4ce5-b8d2-7908b11c13a2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:34.596460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-610d49a5-2f84-4587-a27e-97d4f437a6da req-017ae6d2-4583-4ce5-b8d2-7908b11c13a2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:34.606774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-610d49a5-2f84-4587-a27e-97d4f437a6da req-017ae6d2-4583-4ce5-b8d2-7908b11c13a2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:34.662992 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-610d49a5-2f84-4587-a27e-97d4f437a6da req-017ae6d2-4583-4ce5-b8d2-7908b11c13a2 service nova] Creating event network-vif-deleted:889d4096-79c0-4ef1-9820-306700841a6e for instance 837955cd-5239-4a7b-a5a3-7ab9a15431ed on n-h2-844626-8 Aug 09 14:49:34.682561 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-610d49a5-2f84-4587-a27e-97d4f437a6da req-017ae6d2-4583-4ce5-b8d2-7908b11c13a2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158135 Aug 09 14:49:34.683216 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1952/3946] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:49:34.779684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e7aa1324-7f95-4017-98a1-904d35dc7627 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd985ad594bb9409b859e7812f32a9a64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb91797fb8e427588194573250d2953', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:34.810687 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e7aa1324-7f95-4017-98a1-904d35dc7627 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 200 len: 1484 microversion: 2.1 time: 0.244008 Aug 09 14:49:34.816463 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1995/3947] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:34 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 1484 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:35.109474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1fabecca-1dfd-44b6-be7e-e5606cd86847 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:35.110307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1fabecca-1dfd-44b6-be7e-e5606cd86847 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:35.130582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fabecca-1dfd-44b6-be7e-e5606cd86847 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:35.131073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fabecca-1dfd-44b6-be7e-e5606cd86847 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:35.131526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fabecca-1dfd-44b6-be7e-e5606cd86847 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:35.162828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fabecca-1dfd-44b6-be7e-e5606cd86847 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:35.165121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fabecca-1dfd-44b6-be7e-e5606cd86847 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:35.166131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1fabecca-1dfd-44b6-be7e-e5606cd86847 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:35.296498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-680a9af6-3e39-42b6-9f16-a6d1bebd6e39 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:35.297294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-680a9af6-3e39-42b6-9f16-a6d1bebd6e39 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:35.323978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-680a9af6-3e39-42b6-9f16-a6d1bebd6e39 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:35.324968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-680a9af6-3e39-42b6-9f16-a6d1bebd6e39 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:35.326020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-680a9af6-3e39-42b6-9f16-a6d1bebd6e39 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:35.329512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-680a9af6-3e39-42b6-9f16-a6d1bebd6e39 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:35.330466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-680a9af6-3e39-42b6-9f16-a6d1bebd6e39 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:35.331110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-680a9af6-3e39-42b6-9f16-a6d1bebd6e39 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:35.584545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1fabecca-1dfd-44b6-be7e-e5606cd86847 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:35.605970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1fabecca-1dfd-44b6-be7e-e5606cd86847 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:35.607984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1fabecca-1dfd-44b6-be7e-e5606cd86847 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:35.609416 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1fabecca-1dfd-44b6-be7e-e5606cd86847 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1750 microversion: 2.20 time: 0.505314 Aug 09 14:49:35.610633 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1953/3948] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:35 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1750 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:35.724703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-680a9af6-3e39-42b6-9f16-a6d1bebd6e39 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:35.733716 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-680a9af6-3e39-42b6-9f16-a6d1bebd6e39 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1315 microversion: 2.1 time: 0.441689 Aug 09 14:49:35.736347 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1996/3949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:35 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:35.833811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9177ab76-e15d-410f-b645-b2ce9c9a6900 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:35.835823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9177ab76-e15d-410f-b645-b2ce9c9a6900 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] [instance: 837955cd-5239-4a7b-a5a3-7ab9a15431ed] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:35.854492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9177ab76-e15d-410f-b645-b2ce9c9a6900 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:35.879697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9177ab76-e15d-410f-b645-b2ce9c9a6900 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:35.880546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9177ab76-e15d-410f-b645-b2ce9c9a6900 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:35.881450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9177ab76-e15d-410f-b645-b2ce9c9a6900 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:35.882055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9177ab76-e15d-410f-b645-b2ce9c9a6900 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:35.882878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9177ab76-e15d-410f-b645-b2ce9c9a6900 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:35.908006 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-9177ab76-e15d-410f-b645-b2ce9c9a6900 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] HTTP exception thrown: Instance 837955cd-5239-4a7b-a5a3-7ab9a15431ed could not be found. Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9177ab76-e15d-410f-b645-b2ce9c9a6900 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Request method failure captured: Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed HTTP/1.1 Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nPa11Cwfp04hQb9iHnoAjzix25mErRGOQSloDZmgDtN1MCxZkorjpejHkRWMHQKR8VCgFHMJ3UM2IpBrk7pMANbVT-n7VubCtT9HYMQGFHUbCRA9W7ypFlI4f59-3oq5BPvx9vptlmqPnagsBa2c98yNgOYDIxxLRB9N02Re6gZOxA Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9fb91797fb8e427588194573250d2953 Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1166498832 Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9fb91797fb8e427588194573250d2953", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9fb91797fb8e427588194573250d2953"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9fb91797fb8e427588194573250d2953"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9fb91797fb8e427588194573250d2953"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1166498832 Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9fb91797fb8e427588194573250d2953 Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1166498832 Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerAddressesNegativeTestJSON-1166498832-project Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d985ad594bb9409b859e7812f32a9a64 Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1166498832-project Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 837955cd-5239-4a7b-a5a3-7ab9a15431ed could not be found. Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '837955cd-5239-4a7b-a5a3-7ab9a15431ed'} Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 837955cd-5239-4a7b-a5a3-7ab9a15431ed could not be found. Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 837955cd-5239-4a7b-a5a3-7ab9a15431ed could not be found. Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:35.910051 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:49:35.913616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:35.913616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:49:35.913616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:49:35.913616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:49:35.913616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:49:35.913616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:49:35.913616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 837955cd-5239-4a7b-a5a3-7ab9a15431ed could not be found. Aug 09 14:49:35.913616 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:49:35.916223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9177ab76-e15d-410f-b645-b2ce9c9a6900 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] Returning 404 to user: Instance 837955cd-5239-4a7b-a5a3-7ab9a15431ed could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:49:35.917654 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9177ab76-e15d-410f-b645-b2ce9c9a6900 tempest-ServerAddressesNegativeTestJSON-1166498832 tempest-ServerAddressesNegativeTestJSON-1166498832-project] 10.222.0.50 "GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed" status: 404 len: 111 microversion: 2.1 time: 0.088769 Aug 09 14:49:35.918747 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1954/3950] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:35 2022] GET /compute/v2.1/servers/837955cd-5239-4a7b-a5a3-7ab9a15431ed => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:49:36.644266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f84f5b5-14a4-46b2-bb52-68ab8b51e000 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:36.645563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f84f5b5-14a4-46b2-bb52-68ab8b51e000 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:36.658026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f84f5b5-14a4-46b2-bb52-68ab8b51e000 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:36.658524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f84f5b5-14a4-46b2-bb52-68ab8b51e000 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:36.658965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f84f5b5-14a4-46b2-bb52-68ab8b51e000 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:36.659704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f84f5b5-14a4-46b2-bb52-68ab8b51e000 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:36.660205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f84f5b5-14a4-46b2-bb52-68ab8b51e000 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:36.666911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f84f5b5-14a4-46b2-bb52-68ab8b51e000 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:36.758166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d82b989-5f25-4740-8769-70fc101091a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:36.759564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d82b989-5f25-4740-8769-70fc101091a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:36.796056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d82b989-5f25-4740-8769-70fc101091a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:36.800749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d82b989-5f25-4740-8769-70fc101091a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:36.802404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d82b989-5f25-4740-8769-70fc101091a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:36.805699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d82b989-5f25-4740-8769-70fc101091a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:36.808789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d82b989-5f25-4740-8769-70fc101091a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:36.810168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d82b989-5f25-4740-8769-70fc101091a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:36.947354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2f84f5b5-14a4-46b2-bb52-68ab8b51e000 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:36.961653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2f84f5b5-14a4-46b2-bb52-68ab8b51e000 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:36.963614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2f84f5b5-14a4-46b2-bb52-68ab8b51e000 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:36.968160 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f84f5b5-14a4-46b2-bb52-68ab8b51e000 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1752 microversion: 2.20 time: 0.338757 Aug 09 14:49:36.978300 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1997/3951] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:36 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1752 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:37.342951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0d82b989-5f25-4740-8769-70fc101091a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:37.357949 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d82b989-5f25-4740-8769-70fc101091a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1502 microversion: 2.1 time: 0.600961 Aug 09 14:49:37.360944 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1955/3952] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:36 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1502 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:49:37.385130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa0c21a9-7d32-4222-876f-551aad001369 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:37.385969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa0c21a9-7d32-4222-876f-551aad001369 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:37.396329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=66 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:37.398555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa0c21a9-7d32-4222-876f-551aad001369 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:37.401433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa0c21a9-7d32-4222-876f-551aad001369 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:37.403948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa0c21a9-7d32-4222-876f-551aad001369 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:37.406352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa0c21a9-7d32-4222-876f-551aad001369 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:37.407728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa0c21a9-7d32-4222-876f-551aad001369 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:37.412830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa0c21a9-7d32-4222-876f-551aad001369 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:37.464381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-fa0c21a9-7d32-4222-876f-551aad001369 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lazy-loading 'flavor' on Instance uuid 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:49:37.525755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:49:37.898160 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa0c21a9-7d32-4222-876f-551aad001369 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "POST /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986/action" status: 202 len: 0 microversion: 2.1 time: 0.517023 Aug 09 14:49:37.900574 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1998/3953] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:49:37 2022] POST /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:49:37.911562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c770ec8-eebe-4bdb-b25d-0afce80e7ab4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:37.913303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c770ec8-eebe-4bdb-b25d-0afce80e7ab4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:37.929319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c770ec8-eebe-4bdb-b25d-0afce80e7ab4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:37.930118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c770ec8-eebe-4bdb-b25d-0afce80e7ab4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:37.930791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c770ec8-eebe-4bdb-b25d-0afce80e7ab4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:37.931730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c770ec8-eebe-4bdb-b25d-0afce80e7ab4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:37.932373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c770ec8-eebe-4bdb-b25d-0afce80e7ab4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:37.932997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c770ec8-eebe-4bdb-b25d-0afce80e7ab4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:38.004560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aedb3ba9-86b6-4840-9b1a-a054c4fe0ac5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:38.005284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aedb3ba9-86b6-4840-9b1a-a054c4fe0ac5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:38.025286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aedb3ba9-86b6-4840-9b1a-a054c4fe0ac5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:38.026260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aedb3ba9-86b6-4840-9b1a-a054c4fe0ac5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:38.026863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aedb3ba9-86b6-4840-9b1a-a054c4fe0ac5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:38.028647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aedb3ba9-86b6-4840-9b1a-a054c4fe0ac5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:38.029579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aedb3ba9-86b6-4840-9b1a-a054c4fe0ac5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:38.030230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aedb3ba9-86b6-4840-9b1a-a054c4fe0ac5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:38.364319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c770ec8-eebe-4bdb-b25d-0afce80e7ab4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:38.381471 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c770ec8-eebe-4bdb-b25d-0afce80e7ab4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1508 microversion: 2.1 time: 0.474743 Aug 09 14:49:38.400734 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1956/3954] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:37 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1508 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:38.580773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aedb3ba9-86b6-4840-9b1a-a054c4fe0ac5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:38.597959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aedb3ba9-86b6-4840-9b1a-a054c4fe0ac5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:38.602764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aedb3ba9-86b6-4840-9b1a-a054c4fe0ac5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:38.607909 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aedb3ba9-86b6-4840-9b1a-a054c4fe0ac5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1752 microversion: 2.20 time: 0.609317 Aug 09 14:49:38.610840 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 1999/3955] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:37 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1752 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:39.403867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d04b87c0-7afd-4944-be37-d385edbff203 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:39.406344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d04b87c0-7afd-4944-be37-d385edbff203 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:39.418111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d04b87c0-7afd-4944-be37-d385edbff203 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:39.418938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d04b87c0-7afd-4944-be37-d385edbff203 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:39.419642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d04b87c0-7afd-4944-be37-d385edbff203 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:39.420581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d04b87c0-7afd-4944-be37-d385edbff203 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:39.421600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d04b87c0-7afd-4944-be37-d385edbff203 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:39.422233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d04b87c0-7afd-4944-be37-d385edbff203 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:39.636740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28879ca4-7f05-4ec1-9da5-1a2b9fffa94c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:39.637806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28879ca4-7f05-4ec1-9da5-1a2b9fffa94c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:39.659847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28879ca4-7f05-4ec1-9da5-1a2b9fffa94c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:39.660928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28879ca4-7f05-4ec1-9da5-1a2b9fffa94c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:39.661830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28879ca4-7f05-4ec1-9da5-1a2b9fffa94c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:39.663322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28879ca4-7f05-4ec1-9da5-1a2b9fffa94c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:39.686461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28879ca4-7f05-4ec1-9da5-1a2b9fffa94c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:39.687455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28879ca4-7f05-4ec1-9da5-1a2b9fffa94c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:41.040899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d04b87c0-7afd-4944-be37-d385edbff203 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:41.052741 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d04b87c0-7afd-4944-be37-d385edbff203 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1508 microversion: 2.1 time: 1.654648 Aug 09 14:49:41.074487 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1957/3956] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:39 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1508 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:41.190852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-28879ca4-7f05-4ec1-9da5-1a2b9fffa94c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:41.212884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-28879ca4-7f05-4ec1-9da5-1a2b9fffa94c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:41.214616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-28879ca4-7f05-4ec1-9da5-1a2b9fffa94c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:41.218274 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28879ca4-7f05-4ec1-9da5-1a2b9fffa94c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1752 microversion: 2.20 time: 1.586488 Aug 09 14:49:41.222356 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2000/3957] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:39 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1752 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:49:42.083339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1370f3b3-b28f-4613-9aa6-d027c9e01fe2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:42.085519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1370f3b3-b28f-4613-9aa6-d027c9e01fe2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:42.101905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1370f3b3-b28f-4613-9aa6-d027c9e01fe2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:42.102774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1370f3b3-b28f-4613-9aa6-d027c9e01fe2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:42.104124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1370f3b3-b28f-4613-9aa6-d027c9e01fe2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:42.107228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1370f3b3-b28f-4613-9aa6-d027c9e01fe2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:42.108008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1370f3b3-b28f-4613-9aa6-d027c9e01fe2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:42.109513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1370f3b3-b28f-4613-9aa6-d027c9e01fe2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:42.256187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f82fa052-07af-4990-8697-bf0048c77129 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:42.258262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f82fa052-07af-4990-8697-bf0048c77129 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:42.290533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f82fa052-07af-4990-8697-bf0048c77129 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:42.292261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f82fa052-07af-4990-8697-bf0048c77129 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:42.294193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f82fa052-07af-4990-8697-bf0048c77129 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:42.297464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f82fa052-07af-4990-8697-bf0048c77129 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:42.298546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f82fa052-07af-4990-8697-bf0048c77129 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:42.299361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f82fa052-07af-4990-8697-bf0048c77129 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:43.475668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1370f3b3-b28f-4613-9aa6-d027c9e01fe2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:43.488880 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1370f3b3-b28f-4613-9aa6-d027c9e01fe2 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1508 microversion: 2.1 time: 1.410206 Aug 09 14:49:43.506396 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1958/3958] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:42 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1508 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:49:43.534864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f82fa052-07af-4990-8697-bf0048c77129 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:43.560318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f82fa052-07af-4990-8697-bf0048c77129 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:43.565231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f82fa052-07af-4990-8697-bf0048c77129 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:43.568205 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f82fa052-07af-4990-8697-bf0048c77129 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1752 microversion: 2.20 time: 1.326496 Aug 09 14:49:43.573250 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2001/3959] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:42 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1752 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:44.510061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-215ea9b0-a8ec-4b13-8c1b-92218a0559a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:44.510735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-215ea9b0-a8ec-4b13-8c1b-92218a0559a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:44.524880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-215ea9b0-a8ec-4b13-8c1b-92218a0559a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:44.525378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-215ea9b0-a8ec-4b13-8c1b-92218a0559a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:44.525859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-215ea9b0-a8ec-4b13-8c1b-92218a0559a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:44.526608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-215ea9b0-a8ec-4b13-8c1b-92218a0559a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:44.527166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-215ea9b0-a8ec-4b13-8c1b-92218a0559a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:44.536872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-215ea9b0-a8ec-4b13-8c1b-92218a0559a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:44.605103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3e183402-3d9e-4538-a00e-9c6e11a0e7e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:44.606380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3e183402-3d9e-4538-a00e-9c6e11a0e7e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:44.627235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e183402-3d9e-4538-a00e-9c6e11a0e7e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:44.629072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e183402-3d9e-4538-a00e-9c6e11a0e7e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:44.630614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e183402-3d9e-4538-a00e-9c6e11a0e7e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:44.633285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e183402-3d9e-4538-a00e-9c6e11a0e7e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:44.634085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e183402-3d9e-4538-a00e-9c6e11a0e7e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:44.634666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3e183402-3d9e-4538-a00e-9c6e11a0e7e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:45.685041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-215ea9b0-a8ec-4b13-8c1b-92218a0559a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:45.714084 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-215ea9b0-a8ec-4b13-8c1b-92218a0559a5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1508 microversion: 2.1 time: 1.207783 Aug 09 14:49:45.717993 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1959/3960] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:44 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1508 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:45.748920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3e183402-3d9e-4538-a00e-9c6e11a0e7e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:45.806749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3e183402-3d9e-4538-a00e-9c6e11a0e7e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:45.811022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3e183402-3d9e-4538-a00e-9c6e11a0e7e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:45.820125 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3e183402-3d9e-4538-a00e-9c6e11a0e7e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1752 microversion: 2.20 time: 1.222611 Aug 09 14:49:45.823238 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2002/3961] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:44 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1752 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:49:46.742616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec26ffdb-c519-4562-b73e-6b8f693c646d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:46.745331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ec26ffdb-c519-4562-b73e-6b8f693c646d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:46.761536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec26ffdb-c519-4562-b73e-6b8f693c646d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:46.765395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec26ffdb-c519-4562-b73e-6b8f693c646d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:46.766289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec26ffdb-c519-4562-b73e-6b8f693c646d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:46.768086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec26ffdb-c519-4562-b73e-6b8f693c646d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:46.769000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec26ffdb-c519-4562-b73e-6b8f693c646d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:46.769861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec26ffdb-c519-4562-b73e-6b8f693c646d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:46.852395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-57d576ff-7a41-4dd3-9772-41305eee36b6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:46.853174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-57d576ff-7a41-4dd3-9772-41305eee36b6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:46.878257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57d576ff-7a41-4dd3-9772-41305eee36b6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:46.879886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57d576ff-7a41-4dd3-9772-41305eee36b6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:46.881768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57d576ff-7a41-4dd3-9772-41305eee36b6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:46.883323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57d576ff-7a41-4dd3-9772-41305eee36b6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:46.887454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57d576ff-7a41-4dd3-9772-41305eee36b6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:46.888216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57d576ff-7a41-4dd3-9772-41305eee36b6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:47.805524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ec26ffdb-c519-4562-b73e-6b8f693c646d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:47.823145 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec26ffdb-c519-4562-b73e-6b8f693c646d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1508 microversion: 2.1 time: 1.085520 Aug 09 14:49:47.845265 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1960/3962] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:46 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1508 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:48.166385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-57d576ff-7a41-4dd3-9772-41305eee36b6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:48.184183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-57d576ff-7a41-4dd3-9772-41305eee36b6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:48.196162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-57d576ff-7a41-4dd3-9772-41305eee36b6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:48.201775 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-57d576ff-7a41-4dd3-9772-41305eee36b6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1752 microversion: 2.20 time: 1.355355 Aug 09 14:49:48.202832 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2003/3963] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:46 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1752 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:48.851537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-761b80f0-a020-41e9-b41c-7c564eb35483 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:48.852787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-761b80f0-a020-41e9-b41c-7c564eb35483 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:48.870535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-761b80f0-a020-41e9-b41c-7c564eb35483 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:48.870972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-761b80f0-a020-41e9-b41c-7c564eb35483 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:48.871452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-761b80f0-a020-41e9-b41c-7c564eb35483 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:48.872188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-761b80f0-a020-41e9-b41c-7c564eb35483 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:48.872822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-761b80f0-a020-41e9-b41c-7c564eb35483 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:48.873417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-761b80f0-a020-41e9-b41c-7c564eb35483 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:49.229995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2b32a631-c9b9-455e-ab91-c3ce240cd26b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:49.232012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2b32a631-c9b9-455e-ab91-c3ce240cd26b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:49.245336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b32a631-c9b9-455e-ab91-c3ce240cd26b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:49.247517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b32a631-c9b9-455e-ab91-c3ce240cd26b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:49.249214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b32a631-c9b9-455e-ab91-c3ce240cd26b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:49.252002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b32a631-c9b9-455e-ab91-c3ce240cd26b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:49.252742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b32a631-c9b9-455e-ab91-c3ce240cd26b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:49.253329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b32a631-c9b9-455e-ab91-c3ce240cd26b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:49.944034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-761b80f0-a020-41e9-b41c-7c564eb35483 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:49.953478 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-761b80f0-a020-41e9-b41c-7c564eb35483 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1508 microversion: 2.1 time: 1.105830 Aug 09 14:49:49.972254 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1961/3964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:48 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1508 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:50.200587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b32a631-c9b9-455e-ab91-c3ce240cd26b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:50.210537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b32a631-c9b9-455e-ab91-c3ce240cd26b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:50.212463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b32a631-c9b9-455e-ab91-c3ce240cd26b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:50.214095 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2b32a631-c9b9-455e-ab91-c3ce240cd26b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.988887 Aug 09 14:49:50.230891 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2004/3965] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:49 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:50.981888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-072444f3-d84e-43ef-b681-5efcdf137ea9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:50.985418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-072444f3-d84e-43ef-b681-5efcdf137ea9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:51.008407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-072444f3-d84e-43ef-b681-5efcdf137ea9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:51.009712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-072444f3-d84e-43ef-b681-5efcdf137ea9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:51.010612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-072444f3-d84e-43ef-b681-5efcdf137ea9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:51.014586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-072444f3-d84e-43ef-b681-5efcdf137ea9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:51.016079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-072444f3-d84e-43ef-b681-5efcdf137ea9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:51.016793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-072444f3-d84e-43ef-b681-5efcdf137ea9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:51.240754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a5a783e-5f3e-49d4-8ba1-f04e85faf339 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:51.242111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a5a783e-5f3e-49d4-8ba1-f04e85faf339 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:51.284380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5a783e-5f3e-49d4-8ba1-f04e85faf339 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:51.285242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5a783e-5f3e-49d4-8ba1-f04e85faf339 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:51.291537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5a783e-5f3e-49d4-8ba1-f04e85faf339 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:51.299284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5a783e-5f3e-49d4-8ba1-f04e85faf339 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:51.302148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5a783e-5f3e-49d4-8ba1-f04e85faf339 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:51.305628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5a783e-5f3e-49d4-8ba1-f04e85faf339 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:52.500916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-072444f3-d84e-43ef-b681-5efcdf137ea9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:52.507696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4a5a783e-5f3e-49d4-8ba1-f04e85faf339 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:52.522722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4a5a783e-5f3e-49d4-8ba1-f04e85faf339 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:52.524771 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-072444f3-d84e-43ef-b681-5efcdf137ea9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1508 microversion: 2.1 time: 1.548536 Aug 09 14:49:52.526050 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1962/3966] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:50 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1508 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:52.528098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4a5a783e-5f3e-49d4-8ba1-f04e85faf339 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:52.529968 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a5a783e-5f3e-49d4-8ba1-f04e85faf339 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 1.296115 Aug 09 14:49:52.543845 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2005/3967] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:51 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:52.802201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7c61dc5f-ce98-41e8-a79b-b032516ea7f4 req-5ce4c796-bbdd-49cc-97e3-235316d12304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c25a9384-ba3d-4ff8-8f2a-39ccdde0690a", "tag": "ec41d639-5d70-4bd6-8da7-60954703b90b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:49:52.827514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7c61dc5f-ce98-41e8-a79b-b032516ea7f4 req-5ce4c796-bbdd-49cc-97e3-235316d12304 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:52.828826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7c61dc5f-ce98-41e8-a79b-b032516ea7f4 req-5ce4c796-bbdd-49cc-97e3-235316d12304 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:52.831554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7c61dc5f-ce98-41e8-a79b-b032516ea7f4 req-5ce4c796-bbdd-49cc-97e3-235316d12304 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:52.864791 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7c61dc5f-ce98-41e8-a79b-b032516ea7f4 req-5ce4c796-bbdd-49cc-97e3-235316d12304 service nova] Creating event network-changed:ec41d639-5d70-4bd6-8da7-60954703b90b for instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a on n-h2-844626-8 Aug 09 14:49:52.876467 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7c61dc5f-ce98-41e8-a79b-b032516ea7f4 req-5ce4c796-bbdd-49cc-97e3-235316d12304 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078406 Aug 09 14:49:52.877539 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1963/3968] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:49:53.546627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a64b842-a5eb-4a4d-b048-a24bc88abc40 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:53.547319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0a64b842-a5eb-4a4d-b048-a24bc88abc40 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:53.560901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b56708d-8d9e-4f13-bbca-670042623a4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:53.561805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b56708d-8d9e-4f13-bbca-670042623a4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:53.571417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a64b842-a5eb-4a4d-b048-a24bc88abc40 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:53.571908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a64b842-a5eb-4a4d-b048-a24bc88abc40 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:53.572343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a64b842-a5eb-4a4d-b048-a24bc88abc40 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:53.573093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a64b842-a5eb-4a4d-b048-a24bc88abc40 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:53.573542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a64b842-a5eb-4a4d-b048-a24bc88abc40 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:53.573966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a64b842-a5eb-4a4d-b048-a24bc88abc40 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:53.589279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b56708d-8d9e-4f13-bbca-670042623a4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:53.589773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b56708d-8d9e-4f13-bbca-670042623a4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:53.590247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b56708d-8d9e-4f13-bbca-670042623a4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:53.591147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b56708d-8d9e-4f13-bbca-670042623a4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:53.591746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b56708d-8d9e-4f13-bbca-670042623a4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:53.592418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b56708d-8d9e-4f13-bbca-670042623a4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:54.009136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0a64b842-a5eb-4a4d-b048-a24bc88abc40 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:54.025239 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0a64b842-a5eb-4a4d-b048-a24bc88abc40 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1508 microversion: 2.1 time: 0.482482 Aug 09 14:49:54.027810 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2006/3969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:53 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1508 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:54.198782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9b56708d-8d9e-4f13-bbca-670042623a4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:54.217074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9b56708d-8d9e-4f13-bbca-670042623a4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:54.221378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9b56708d-8d9e-4f13-bbca-670042623a4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:54.224748 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b56708d-8d9e-4f13-bbca-670042623a4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.673134 Aug 09 14:49:54.226552 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1964/3970] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:53 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:49:55.050515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8dad851-912a-4089-8bbd-c94c989046cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:55.051448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b8dad851-912a-4089-8bbd-c94c989046cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:55.100245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8dad851-912a-4089-8bbd-c94c989046cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:55.103918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8dad851-912a-4089-8bbd-c94c989046cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:55.104820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8dad851-912a-4089-8bbd-c94c989046cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:55.117030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8dad851-912a-4089-8bbd-c94c989046cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:55.118737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8dad851-912a-4089-8bbd-c94c989046cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:55.119313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8dad851-912a-4089-8bbd-c94c989046cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:55.255478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c67cfbe1-b80e-449a-a433-e00cd3e24722 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:55.256097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c67cfbe1-b80e-449a-a433-e00cd3e24722 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:55.273518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c67cfbe1-b80e-449a-a433-e00cd3e24722 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:55.292046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c67cfbe1-b80e-449a-a433-e00cd3e24722 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:55.296559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c67cfbe1-b80e-449a-a433-e00cd3e24722 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:55.297526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c67cfbe1-b80e-449a-a433-e00cd3e24722 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:55.305647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c67cfbe1-b80e-449a-a433-e00cd3e24722 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:55.306303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c67cfbe1-b80e-449a-a433-e00cd3e24722 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:56.398340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8dad851-912a-4089-8bbd-c94c989046cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:56.409464 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8dad851-912a-4089-8bbd-c94c989046cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1508 microversion: 2.1 time: 1.364349 Aug 09 14:49:56.410000 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2007/3971] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:55 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1508 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:56.678404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c67cfbe1-b80e-449a-a433-e00cd3e24722 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:56.679021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c67cfbe1-b80e-449a-a433-e00cd3e24722 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:56.680480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c67cfbe1-b80e-449a-a433-e00cd3e24722 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:56.684689 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c67cfbe1-b80e-449a-a433-e00cd3e24722 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 1.431197 Aug 09 14:49:56.704238 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1965/3972] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:55 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:49:57.434099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4ab1257-9a52-4f55-a19f-19623289d22f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:57.435340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4ab1257-9a52-4f55-a19f-19623289d22f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:57.451588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ab1257-9a52-4f55-a19f-19623289d22f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:57.454614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ab1257-9a52-4f55-a19f-19623289d22f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:57.456992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ab1257-9a52-4f55-a19f-19623289d22f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:57.458003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ab1257-9a52-4f55-a19f-19623289d22f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:57.462547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ab1257-9a52-4f55-a19f-19623289d22f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:57.463304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ab1257-9a52-4f55-a19f-19623289d22f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:57.726906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4cb21465-8e9c-4b44-904a-5fe3c3090e1c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:57.728266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4cb21465-8e9c-4b44-904a-5fe3c3090e1c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:57.740840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cb21465-8e9c-4b44-904a-5fe3c3090e1c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:57.743230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cb21465-8e9c-4b44-904a-5fe3c3090e1c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:57.744077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cb21465-8e9c-4b44-904a-5fe3c3090e1c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:57.745086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cb21465-8e9c-4b44-904a-5fe3c3090e1c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:57.747664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cb21465-8e9c-4b44-904a-5fe3c3090e1c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:57.748238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cb21465-8e9c-4b44-904a-5fe3c3090e1c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:58.390665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d4ab1257-9a52-4f55-a19f-19623289d22f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:58.417958 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4ab1257-9a52-4f55-a19f-19623289d22f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1508 microversion: 2.1 time: 0.983094 Aug 09 14:49:58.427221 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2008/3973] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:57 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1508 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:49:58.721607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4cb21465-8e9c-4b44-904a-5fe3c3090e1c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:58.736350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4cb21465-8e9c-4b44-904a-5fe3c3090e1c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:58.741278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4cb21465-8e9c-4b44-904a-5fe3c3090e1c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:49:58.747237 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4cb21465-8e9c-4b44-904a-5fe3c3090e1c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 1.022324 Aug 09 14:49:58.757663 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1966/3974] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:57 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:49:59.449584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-284d9705-167b-40c0-b273-b083c0d37c78 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:59.450441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-284d9705-167b-40c0-b273-b083c0d37c78 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:59.477499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-284d9705-167b-40c0-b273-b083c0d37c78 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:59.478396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-284d9705-167b-40c0-b273-b083c0d37c78 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:59.479035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-284d9705-167b-40c0-b273-b083c0d37c78 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:59.480195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-284d9705-167b-40c0-b273-b083c0d37c78 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:59.480809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-284d9705-167b-40c0-b273-b083c0d37c78 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:59.481386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-284d9705-167b-40c0-b273-b083c0d37c78 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:59.783817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63c790b0-b5e2-4cb6-a695-df176aef1cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:49:59.784446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63c790b0-b5e2-4cb6-a695-df176aef1cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:49:59.820397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63c790b0-b5e2-4cb6-a695-df176aef1cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:59.821129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63c790b0-b5e2-4cb6-a695-df176aef1cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:59.821586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63c790b0-b5e2-4cb6-a695-df176aef1cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:49:59.822415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63c790b0-b5e2-4cb6-a695-df176aef1cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:49:59.823003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63c790b0-b5e2-4cb6-a695-df176aef1cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:49:59.823457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63c790b0-b5e2-4cb6-a695-df176aef1cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:01.336336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-284d9705-167b-40c0-b273-b083c0d37c78 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:01.352223 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-284d9705-167b-40c0-b273-b083c0d37c78 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1508 microversion: 2.1 time: 1.908715 Aug 09 14:50:01.356867 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2009/3975] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:49:59 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1508 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:01.450460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63c790b0-b5e2-4cb6-a695-df176aef1cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:01.465539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63c790b0-b5e2-4cb6-a695-df176aef1cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:01.470417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63c790b0-b5e2-4cb6-a695-df176aef1cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:01.477424 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63c790b0-b5e2-4cb6-a695-df176aef1cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 1.699292 Aug 09 14:50:01.482596 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1967/3976] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:49:59 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:50:02.392398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a41d10ea-0ac7-41b9-8280-288ca3dc9da1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:02.393908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a41d10ea-0ac7-41b9-8280-288ca3dc9da1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:02.415160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a41d10ea-0ac7-41b9-8280-288ca3dc9da1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:02.424966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a41d10ea-0ac7-41b9-8280-288ca3dc9da1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:02.430043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a41d10ea-0ac7-41b9-8280-288ca3dc9da1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:02.431362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a41d10ea-0ac7-41b9-8280-288ca3dc9da1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:02.432365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a41d10ea-0ac7-41b9-8280-288ca3dc9da1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:02.433040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a41d10ea-0ac7-41b9-8280-288ca3dc9da1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:02.518682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-25ce0af8-a81a-4d37-b41d-91fc5ab8beee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:02.520570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-25ce0af8-a81a-4d37-b41d-91fc5ab8beee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:02.531669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:02.539312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25ce0af8-a81a-4d37-b41d-91fc5ab8beee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:02.543382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25ce0af8-a81a-4d37-b41d-91fc5ab8beee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:02.546164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25ce0af8-a81a-4d37-b41d-91fc5ab8beee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:02.548937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25ce0af8-a81a-4d37-b41d-91fc5ab8beee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:02.550049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25ce0af8-a81a-4d37-b41d-91fc5ab8beee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:02.552896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25ce0af8-a81a-4d37-b41d-91fc5ab8beee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:03.461882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a41d10ea-0ac7-41b9-8280-288ca3dc9da1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:03.506100 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a41d10ea-0ac7-41b9-8280-288ca3dc9da1 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1508 microversion: 2.1 time: 1.124555 Aug 09 14:50:03.510785 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2010/3977] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:02 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1508 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:03.560190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-25ce0af8-a81a-4d37-b41d-91fc5ab8beee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:03.604197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-25ce0af8-a81a-4d37-b41d-91fc5ab8beee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:03.608356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-25ce0af8-a81a-4d37-b41d-91fc5ab8beee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:03.615391 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-25ce0af8-a81a-4d37-b41d-91fc5ab8beee tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 1.101185 Aug 09 14:50:03.620776 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1968/3978] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:02 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:04.532570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ec2ab003-8a88-4d41-b8ae-293d58a948e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:04.533778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ec2ab003-8a88-4d41-b8ae-293d58a948e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:04.551512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec2ab003-8a88-4d41-b8ae-293d58a948e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:04.554657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec2ab003-8a88-4d41-b8ae-293d58a948e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:04.555836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec2ab003-8a88-4d41-b8ae-293d58a948e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:04.557889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec2ab003-8a88-4d41-b8ae-293d58a948e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:04.559669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec2ab003-8a88-4d41-b8ae-293d58a948e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:04.561243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec2ab003-8a88-4d41-b8ae-293d58a948e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:04.660242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5f559f03-a69f-4c54-ae6d-a840741c74d4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:04.660921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5f559f03-a69f-4c54-ae6d-a840741c74d4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:04.680245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f559f03-a69f-4c54-ae6d-a840741c74d4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:04.680956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f559f03-a69f-4c54-ae6d-a840741c74d4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:04.681559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f559f03-a69f-4c54-ae6d-a840741c74d4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:04.682693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f559f03-a69f-4c54-ae6d-a840741c74d4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:04.683590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f559f03-a69f-4c54-ae6d-a840741c74d4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:04.685068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f559f03-a69f-4c54-ae6d-a840741c74d4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:04.740585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=94 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:05.148938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ec2ab003-8a88-4d41-b8ae-293d58a948e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:05.165568 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ec2ab003-8a88-4d41-b8ae-293d58a948e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1529 microversion: 2.1 time: 0.636910 Aug 09 14:50:05.168314 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2011/3979] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:04 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1529 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:05.243029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f559f03-a69f-4c54-ae6d-a840741c74d4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:05.255922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f559f03-a69f-4c54-ae6d-a840741c74d4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:05.264646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f559f03-a69f-4c54-ae6d-a840741c74d4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:05.266314 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5f559f03-a69f-4c54-ae6d-a840741c74d4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.611175 Aug 09 14:50:05.281091 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1969/3980] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:04 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:06.206663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ed17830-cb82-422b-b91d-2c12d858893f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:06.207780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5ed17830-cb82-422b-b91d-2c12d858893f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:06.250585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ed17830-cb82-422b-b91d-2c12d858893f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:06.256470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ed17830-cb82-422b-b91d-2c12d858893f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:06.256818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ed17830-cb82-422b-b91d-2c12d858893f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:06.257567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ed17830-cb82-422b-b91d-2c12d858893f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:06.282321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ed17830-cb82-422b-b91d-2c12d858893f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:06.284770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ed17830-cb82-422b-b91d-2c12d858893f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:06.296463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-677c74bd-2b92-45c6-a2bc-c3a933276cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:06.298214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-677c74bd-2b92-45c6-a2bc-c3a933276cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:06.310852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677c74bd-2b92-45c6-a2bc-c3a933276cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:06.314949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677c74bd-2b92-45c6-a2bc-c3a933276cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:06.318230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677c74bd-2b92-45c6-a2bc-c3a933276cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:06.323556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677c74bd-2b92-45c6-a2bc-c3a933276cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:06.324516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677c74bd-2b92-45c6-a2bc-c3a933276cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:06.328698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677c74bd-2b92-45c6-a2bc-c3a933276cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:07.930076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5ed17830-cb82-422b-b91d-2c12d858893f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:07.938055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:07.941296 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5ed17830-cb82-422b-b91d-2c12d858893f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1524 microversion: 2.1 time: 1.752789 Aug 09 14:50:07.943736 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2012/3981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:06 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1524 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:07.983624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-677c74bd-2b92-45c6-a2bc-c3a933276cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:08.006493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-677c74bd-2b92-45c6-a2bc-c3a933276cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:08.014504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-677c74bd-2b92-45c6-a2bc-c3a933276cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:08.016290 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-677c74bd-2b92-45c6-a2bc-c3a933276cc6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 1.724668 Aug 09 14:50:08.039633 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1970/3982] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:06 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:08.965690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2709879-d1eb-4275-a084-6d2532b1ec5f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:08.967386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2709879-d1eb-4275-a084-6d2532b1ec5f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:08.987466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=30 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:08.989782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2709879-d1eb-4275-a084-6d2532b1ec5f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:08.990681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2709879-d1eb-4275-a084-6d2532b1ec5f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:08.991811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2709879-d1eb-4275-a084-6d2532b1ec5f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:08.995010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2709879-d1eb-4275-a084-6d2532b1ec5f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:09.001049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2709879-d1eb-4275-a084-6d2532b1ec5f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:09.001998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2709879-d1eb-4275-a084-6d2532b1ec5f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:09.053034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63e8b58f-054c-4278-bbb3-e9d70c639410 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:09.053610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63e8b58f-054c-4278-bbb3-e9d70c639410 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:09.077439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e8b58f-054c-4278-bbb3-e9d70c639410 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:09.077943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e8b58f-054c-4278-bbb3-e9d70c639410 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:09.078377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e8b58f-054c-4278-bbb3-e9d70c639410 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:09.099171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e8b58f-054c-4278-bbb3-e9d70c639410 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:09.107032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e8b58f-054c-4278-bbb3-e9d70c639410 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:09.108680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e8b58f-054c-4278-bbb3-e9d70c639410 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:09.214818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2709879-d1eb-4275-a084-6d2532b1ec5f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:09.232763 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2709879-d1eb-4275-a084-6d2532b1ec5f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1524 microversion: 2.1 time: 0.264529 Aug 09 14:50:09.234045 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2013/3983] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:08 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1524 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:09.379904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63e8b58f-054c-4278-bbb3-e9d70c639410 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:09.392348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63e8b58f-054c-4278-bbb3-e9d70c639410 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:09.393890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63e8b58f-054c-4278-bbb3-e9d70c639410 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:09.396270 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63e8b58f-054c-4278-bbb3-e9d70c639410 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.348819 Aug 09 14:50:09.397544 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1971/3984] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:09 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:50:10.256272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b33d073c-08e4-4b32-98d5-ed05de10aeec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:10.257100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b33d073c-08e4-4b32-98d5-ed05de10aeec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:10.273944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b33d073c-08e4-4b32-98d5-ed05de10aeec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:10.273944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b33d073c-08e4-4b32-98d5-ed05de10aeec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:10.274426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b33d073c-08e4-4b32-98d5-ed05de10aeec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:10.275665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b33d073c-08e4-4b32-98d5-ed05de10aeec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:10.276144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b33d073c-08e4-4b32-98d5-ed05de10aeec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:10.276584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b33d073c-08e4-4b32-98d5-ed05de10aeec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:10.429489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9ab8204d-3332-44ff-9457-54ff59026772 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:10.431838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9ab8204d-3332-44ff-9457-54ff59026772 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:10.443806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ab8204d-3332-44ff-9457-54ff59026772 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:10.447850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ab8204d-3332-44ff-9457-54ff59026772 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:10.448598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ab8204d-3332-44ff-9457-54ff59026772 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:10.449589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ab8204d-3332-44ff-9457-54ff59026772 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:10.453842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ab8204d-3332-44ff-9457-54ff59026772 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:10.454755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ab8204d-3332-44ff-9457-54ff59026772 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:10.620830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b33d073c-08e4-4b32-98d5-ed05de10aeec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:10.629386 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b33d073c-08e4-4b32-98d5-ed05de10aeec tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1524 microversion: 2.1 time: 0.377725 Aug 09 14:50:10.635454 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2014/3985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:10 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1524 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:10.874190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9ab8204d-3332-44ff-9457-54ff59026772 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:10.884647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9ab8204d-3332-44ff-9457-54ff59026772 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:10.896696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9ab8204d-3332-44ff-9457-54ff59026772 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:10.901392 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9ab8204d-3332-44ff-9457-54ff59026772 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.480062 Aug 09 14:50:10.907444 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1972/3986] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:10 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:50:11.654029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f971b4a4-2a6e-406e-a70b-bb1a525993ed tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:11.655461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f971b4a4-2a6e-406e-a70b-bb1a525993ed tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:11.666882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f971b4a4-2a6e-406e-a70b-bb1a525993ed tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:11.678346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f971b4a4-2a6e-406e-a70b-bb1a525993ed tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:11.679276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f971b4a4-2a6e-406e-a70b-bb1a525993ed tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:11.680278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f971b4a4-2a6e-406e-a70b-bb1a525993ed tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:11.688030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f971b4a4-2a6e-406e-a70b-bb1a525993ed tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:11.688838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f971b4a4-2a6e-406e-a70b-bb1a525993ed tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:11.938628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ef21b12-b2b1-4d9b-891e-3eb17b9dfb35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:11.940220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ef21b12-b2b1-4d9b-891e-3eb17b9dfb35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:11.952193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ef21b12-b2b1-4d9b-891e-3eb17b9dfb35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:11.957661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ef21b12-b2b1-4d9b-891e-3eb17b9dfb35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:11.958456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ef21b12-b2b1-4d9b-891e-3eb17b9dfb35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:11.960082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ef21b12-b2b1-4d9b-891e-3eb17b9dfb35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:11.963417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ef21b12-b2b1-4d9b-891e-3eb17b9dfb35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:11.964299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ef21b12-b2b1-4d9b-891e-3eb17b9dfb35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:12.103680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f971b4a4-2a6e-406e-a70b-bb1a525993ed tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:12.112030 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f971b4a4-2a6e-406e-a70b-bb1a525993ed tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1524 microversion: 2.1 time: 0.462584 Aug 09 14:50:12.116210 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2015/3987] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:11 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1524 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:12.122805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-c2cbe6fd-0f85-401e-90c3-8fcff71d046f req-16f904c1-20fd-48bd-bae6-2eb29444bf94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f8bb6e-e556-4454-bea9-c1d1b0e3d986", "name": "network-vif-plugged", "status": "completed", "tag": "ea448bc1-5122-4971-97e6-788506f2959a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:12.145382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c2cbe6fd-0f85-401e-90c3-8fcff71d046f req-16f904c1-20fd-48bd-bae6-2eb29444bf94 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:12.155919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c2cbe6fd-0f85-401e-90c3-8fcff71d046f req-16f904c1-20fd-48bd-bae6-2eb29444bf94 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:12.156798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c2cbe6fd-0f85-401e-90c3-8fcff71d046f req-16f904c1-20fd-48bd-bae6-2eb29444bf94 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:12.177436 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-c2cbe6fd-0f85-401e-90c3-8fcff71d046f req-16f904c1-20fd-48bd-bae6-2eb29444bf94 service nova] Creating event network-vif-plugged:ea448bc1-5122-4971-97e6-788506f2959a for instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 on n-h1-844626-8 Aug 09 14:50:12.200243 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-c2cbe6fd-0f85-401e-90c3-8fcff71d046f req-16f904c1-20fd-48bd-bae6-2eb29444bf94 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082368 Aug 09 14:50:12.203991 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2016/3988] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:50:12.352863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ef21b12-b2b1-4d9b-891e-3eb17b9dfb35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:12.364845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ef21b12-b2b1-4d9b-891e-3eb17b9dfb35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:12.377574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ef21b12-b2b1-4d9b-891e-3eb17b9dfb35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:12.379137 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ef21b12-b2b1-4d9b-891e-3eb17b9dfb35 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.451778 Aug 09 14:50:12.380619 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1973/3989] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:11 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:13.138398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b5465ed-fade-44dd-9e93-43d4271d8fe4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:13.142267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0b5465ed-fade-44dd-9e93-43d4271d8fe4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:13.160009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b5465ed-fade-44dd-9e93-43d4271d8fe4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:13.163821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b5465ed-fade-44dd-9e93-43d4271d8fe4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:13.164572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b5465ed-fade-44dd-9e93-43d4271d8fe4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:13.165535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b5465ed-fade-44dd-9e93-43d4271d8fe4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:13.166298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b5465ed-fade-44dd-9e93-43d4271d8fe4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:13.170449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b5465ed-fade-44dd-9e93-43d4271d8fe4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:13.411824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6afb8778-99cb-46be-a9fb-0875876fd2d6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:13.413090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6afb8778-99cb-46be-a9fb-0875876fd2d6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:13.429640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6afb8778-99cb-46be-a9fb-0875876fd2d6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:13.436343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6afb8778-99cb-46be-a9fb-0875876fd2d6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:13.441533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6afb8778-99cb-46be-a9fb-0875876fd2d6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:13.442667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6afb8778-99cb-46be-a9fb-0875876fd2d6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:13.443394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6afb8778-99cb-46be-a9fb-0875876fd2d6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:13.444369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6afb8778-99cb-46be-a9fb-0875876fd2d6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:14.561892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0b5465ed-fade-44dd-9e93-43d4271d8fe4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:14.569786 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b5465ed-fade-44dd-9e93-43d4271d8fe4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1524 microversion: 2.1 time: 1.435926 Aug 09 14:50:14.583483 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2017/3990] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:13 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1524 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:14.673989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6afb8778-99cb-46be-a9fb-0875876fd2d6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:14.695185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6afb8778-99cb-46be-a9fb-0875876fd2d6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:14.699582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6afb8778-99cb-46be-a9fb-0875876fd2d6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:14.703362 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6afb8778-99cb-46be-a9fb-0875876fd2d6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 1.296702 Aug 09 14:50:14.710238 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1974/3991] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:13 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:50:15.320217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-414024680", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:15.593530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8a390c2d-8fa5-4644-8c5a-0a313331692e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:15.594152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8a390c2d-8fa5-4644-8c5a-0a313331692e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:15.606181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a390c2d-8fa5-4644-8c5a-0a313331692e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:15.606731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a390c2d-8fa5-4644-8c5a-0a313331692e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:15.607235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a390c2d-8fa5-4644-8c5a-0a313331692e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:15.608012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a390c2d-8fa5-4644-8c5a-0a313331692e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:15.623446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a390c2d-8fa5-4644-8c5a-0a313331692e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:15.624063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8a390c2d-8fa5-4644-8c5a-0a313331692e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:16.063679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8a390c2d-8fa5-4644-8c5a-0a313331692e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:16.110051 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8a390c2d-8fa5-4644-8c5a-0a313331692e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1524 microversion: 2.1 time: 0.504683 Aug 09 14:50:16.113571 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1975/3992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:15 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1524 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:16.126440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-583522de-43bf-4ae4-9243-949421c0e91a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:16.127322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-583522de-43bf-4ae4-9243-949421c0e91a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:16.161506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-583522de-43bf-4ae4-9243-949421c0e91a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:16.162289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-583522de-43bf-4ae4-9243-949421c0e91a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:16.162996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-583522de-43bf-4ae4-9243-949421c0e91a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:16.164112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-583522de-43bf-4ae4-9243-949421c0e91a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:16.166094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-583522de-43bf-4ae4-9243-949421c0e91a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:16.166791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-583522de-43bf-4ae4-9243-949421c0e91a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:16.471250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] validate_networks() for [('3055f5ba-b955-4552-8d94-e4bbcdd301d2', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:50:17.652146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-583522de-43bf-4ae4-9243-949421c0e91a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:17.679529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-583522de-43bf-4ae4-9243-949421c0e91a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:17.686405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-583522de-43bf-4ae4-9243-949421c0e91a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:17.697750 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-583522de-43bf-4ae4-9243-949421c0e91a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 1.581042 Aug 09 14:50:17.705964 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1976/3993] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:16 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:17.725889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a3247c25-5459-47dd-9e98-2921d52d633c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:17.725889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a3247c25-5459-47dd-9e98-2921d52d633c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:17.754477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3247c25-5459-47dd-9e98-2921d52d633c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:17.757340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3247c25-5459-47dd-9e98-2921d52d633c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:17.757799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3247c25-5459-47dd-9e98-2921d52d633c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:17.768286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3247c25-5459-47dd-9e98-2921d52d633c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:17.772910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3247c25-5459-47dd-9e98-2921d52d633c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:17.773589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3247c25-5459-47dd-9e98-2921d52d633c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:18.842861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:50:18.843517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:50:18.843783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:50:18.844273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:50:18.844698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:50:18.886743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:18.899064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:18.899696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:18.900600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:18.901082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:18.906593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:18.965015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Getting quotas for project e0caed61cb95467ba8b076c63f6706de. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:50:18.971831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a3247c25-5459-47dd-9e98-2921d52d633c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:18.989461 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a3247c25-5459-47dd-9e98-2921d52d633c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1524 microversion: 2.1 time: 1.281960 Aug 09 14:50:19.001528 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1977/3994] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:17 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1524 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:19.008741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Getting quotas for user cfd1981c518d4432b4635c1768114b22 and project e0caed61cb95467ba8b076c63f6706de. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:50:19.022987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60f219ce-edc9-4733-909b-35d38cdf7b0b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:19.023641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60f219ce-edc9-4733-909b-35d38cdf7b0b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:19.051920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f219ce-edc9-4733-909b-35d38cdf7b0b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:19.057467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f219ce-edc9-4733-909b-35d38cdf7b0b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:19.058186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f219ce-edc9-4733-909b-35d38cdf7b0b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:19.061069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f219ce-edc9-4733-909b-35d38cdf7b0b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:19.064629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f219ce-edc9-4733-909b-35d38cdf7b0b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:19.068118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60f219ce-edc9-4733-909b-35d38cdf7b0b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:19.071467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:50:19.074567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:50:19.225534 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f326d718-b26c-45d4-96fe-d6d5bc61893b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.270488 Aug 09 14:50:19.226773 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2018/3995] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:50:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 4272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:50:19.237840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cd830e57-74ce-472a-b35d-ee40d1a9a810 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:19.238722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cd830e57-74ce-472a-b35d-ee40d1a9a810 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:19.693469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cd830e57-74ce-472a-b35d-ee40d1a9a810 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:19.702520 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cd830e57-74ce-472a-b35d-ee40d1a9a810 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1221 microversion: 2.1 time: 0.468617 Aug 09 14:50:19.708961 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2019/3996] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:19 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1221 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:19.888951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1769069822", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:20.188828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60f219ce-edc9-4733-909b-35d38cdf7b0b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:20.209029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60f219ce-edc9-4733-909b-35d38cdf7b0b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:20.216158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60f219ce-edc9-4733-909b-35d38cdf7b0b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:20.226491 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60f219ce-edc9-4733-909b-35d38cdf7b0b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 1.219918 Aug 09 14:50:20.233532 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1978/3997] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:19 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:20.254025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0ffa527-a506-4a9c-a8b9-8e099c581896 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:20.254643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0ffa527-a506-4a9c-a8b9-8e099c581896 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:20.273606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ffa527-a506-4a9c-a8b9-8e099c581896 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:20.276480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ffa527-a506-4a9c-a8b9-8e099c581896 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:20.279313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ffa527-a506-4a9c-a8b9-8e099c581896 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:20.282742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ffa527-a506-4a9c-a8b9-8e099c581896 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:20.283970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ffa527-a506-4a9c-a8b9-8e099c581896 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:20.284710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ffa527-a506-4a9c-a8b9-8e099c581896 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:21.042107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0ffa527-a506-4a9c-a8b9-8e099c581896 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:21.050040 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0ffa527-a506-4a9c-a8b9-8e099c581896 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1524 microversion: 2.1 time: 0.815050 Aug 09 14:50:21.055976 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1979/3998] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:20 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1524 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:21.254680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c8a6c23-9d06-444f-b2ea-a7e1768f96f0 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:21.255485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c8a6c23-9d06-444f-b2ea-a7e1768f96f0 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:21.264576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c8a6c23-9d06-444f-b2ea-a7e1768f96f0 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:21.265072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c8a6c23-9d06-444f-b2ea-a7e1768f96f0 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:21.265503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c8a6c23-9d06-444f-b2ea-a7e1768f96f0 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:21.289329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c8a6c23-9d06-444f-b2ea-a7e1768f96f0 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:21.291343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c8a6c23-9d06-444f-b2ea-a7e1768f96f0 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:21.293774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c8a6c23-9d06-444f-b2ea-a7e1768f96f0 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:22.074261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c8a6c23-9d06-444f-b2ea-a7e1768f96f0 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:22.088225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c8a6c23-9d06-444f-b2ea-a7e1768f96f0 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:22.092754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c8a6c23-9d06-444f-b2ea-a7e1768f96f0 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:22.095450 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c8a6c23-9d06-444f-b2ea-a7e1768f96f0 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.844647 Aug 09 14:50:22.102017 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1980/3999] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:21 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:50:22.109179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4161d4d2-86b1-48fb-a7be-293fa6f8a6d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:22.113709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4161d4d2-86b1-48fb-a7be-293fa6f8a6d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:22.125003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4161d4d2-86b1-48fb-a7be-293fa6f8a6d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:22.127690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4161d4d2-86b1-48fb-a7be-293fa6f8a6d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:22.131650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4161d4d2-86b1-48fb-a7be-293fa6f8a6d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:22.131650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4161d4d2-86b1-48fb-a7be-293fa6f8a6d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:22.132841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4161d4d2-86b1-48fb-a7be-293fa6f8a6d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:22.133810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4161d4d2-86b1-48fb-a7be-293fa6f8a6d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:22.691390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4161d4d2-86b1-48fb-a7be-293fa6f8a6d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:22.700569 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4161d4d2-86b1-48fb-a7be-293fa6f8a6d8 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1524 microversion: 2.1 time: 0.596709 Aug 09 14:50:22.705264 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1981/4000] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:22 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1524 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:23.129793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-060bbb2b-92d0-4cd5-ba3a-a7ab5355e5a4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:23.130681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-060bbb2b-92d0-4cd5-ba3a-a7ab5355e5a4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:23.166370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-060bbb2b-92d0-4cd5-ba3a-a7ab5355e5a4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:23.166874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-060bbb2b-92d0-4cd5-ba3a-a7ab5355e5a4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:23.169661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-060bbb2b-92d0-4cd5-ba3a-a7ab5355e5a4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:23.170407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-060bbb2b-92d0-4cd5-ba3a-a7ab5355e5a4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:23.170934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-060bbb2b-92d0-4cd5-ba3a-a7ab5355e5a4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:23.173733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-060bbb2b-92d0-4cd5-ba3a-a7ab5355e5a4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:24.300100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-060bbb2b-92d0-4cd5-ba3a-a7ab5355e5a4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:24.321167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-060bbb2b-92d0-4cd5-ba3a-a7ab5355e5a4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:24.324503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-060bbb2b-92d0-4cd5-ba3a-a7ab5355e5a4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:24.327604 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-060bbb2b-92d0-4cd5-ba3a-a7ab5355e5a4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 1.207143 Aug 09 14:50:24.331468 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1982/4001] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:23 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:50:24.346232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e79d2b3f-f250-4b72-b160-0890b5d92d6f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:24.347825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e79d2b3f-f250-4b72-b160-0890b5d92d6f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:24.396019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e79d2b3f-f250-4b72-b160-0890b5d92d6f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:24.396526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e79d2b3f-f250-4b72-b160-0890b5d92d6f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:24.402528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e79d2b3f-f250-4b72-b160-0890b5d92d6f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:24.403792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e79d2b3f-f250-4b72-b160-0890b5d92d6f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:24.409477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e79d2b3f-f250-4b72-b160-0890b5d92d6f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:24.410022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e79d2b3f-f250-4b72-b160-0890b5d92d6f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:24.891372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e79d2b3f-f250-4b72-b160-0890b5d92d6f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:24.912966 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e79d2b3f-f250-4b72-b160-0890b5d92d6f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1524 microversion: 2.1 time: 0.577890 Aug 09 14:50:24.919345 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1983/4002] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:24 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1524 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:25.360880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d39ffce-a664-4842-aecf-5375db9141ae tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:25.361612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d39ffce-a664-4842-aecf-5375db9141ae tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:25.379349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d39ffce-a664-4842-aecf-5375db9141ae tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:25.383899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d39ffce-a664-4842-aecf-5375db9141ae tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:25.386814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d39ffce-a664-4842-aecf-5375db9141ae tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:25.394220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d39ffce-a664-4842-aecf-5375db9141ae tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:25.394833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d39ffce-a664-4842-aecf-5375db9141ae tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:25.395231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d39ffce-a664-4842-aecf-5375db9141ae tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:26.249804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d39ffce-a664-4842-aecf-5375db9141ae tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:26.274190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d39ffce-a664-4842-aecf-5375db9141ae tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:26.279538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d39ffce-a664-4842-aecf-5375db9141ae tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:26.282378 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d39ffce-a664-4842-aecf-5375db9141ae tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.926457 Aug 09 14:50:26.292949 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1984/4003] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:25 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:50:26.309934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fbf441e5-2477-4314-af0d-cd5f1a9c26cf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:26.311172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fbf441e5-2477-4314-af0d-cd5f1a9c26cf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:26.342707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbf441e5-2477-4314-af0d-cd5f1a9c26cf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:26.346131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbf441e5-2477-4314-af0d-cd5f1a9c26cf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:26.346778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbf441e5-2477-4314-af0d-cd5f1a9c26cf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:26.350567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbf441e5-2477-4314-af0d-cd5f1a9c26cf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:26.351258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbf441e5-2477-4314-af0d-cd5f1a9c26cf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:26.352203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbf441e5-2477-4314-af0d-cd5f1a9c26cf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:28.111301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fbf441e5-2477-4314-af0d-cd5f1a9c26cf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:28.131060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:28.144448 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fbf441e5-2477-4314-af0d-cd5f1a9c26cf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1524 microversion: 2.1 time: 1.848246 Aug 09 14:50:28.145089 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1985/4004] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:26 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1524 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:28.165760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ebe713a6-d4f1-4d59-b1dc-02680b4f4ff8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:28.167110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ebe713a6-d4f1-4d59-b1dc-02680b4f4ff8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:28.180407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebe713a6-d4f1-4d59-b1dc-02680b4f4ff8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:28.181257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebe713a6-d4f1-4d59-b1dc-02680b4f4ff8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:28.181856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebe713a6-d4f1-4d59-b1dc-02680b4f4ff8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:28.183528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebe713a6-d4f1-4d59-b1dc-02680b4f4ff8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:28.184145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebe713a6-d4f1-4d59-b1dc-02680b4f4ff8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:28.184746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebe713a6-d4f1-4d59-b1dc-02680b4f4ff8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:28.940741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:28.943534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=29 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:29.604418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ebe713a6-d4f1-4d59-b1dc-02680b4f4ff8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:29.625005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ebe713a6-d4f1-4d59-b1dc-02680b4f4ff8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:29.637871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ebe713a6-d4f1-4d59-b1dc-02680b4f4ff8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:29.643633 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ebe713a6-d4f1-4d59-b1dc-02680b4f4ff8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 1.481742 Aug 09 14:50:29.644246 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1986/4005] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:28 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:29.687770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cb8da35f-3a9b-4c69-b521-10141a115187 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:29.688403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cb8da35f-3a9b-4c69-b521-10141a115187 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:29.699582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:29.710918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb8da35f-3a9b-4c69-b521-10141a115187 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:29.712374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb8da35f-3a9b-4c69-b521-10141a115187 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:29.713572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb8da35f-3a9b-4c69-b521-10141a115187 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:29.716222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb8da35f-3a9b-4c69-b521-10141a115187 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:29.716850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb8da35f-3a9b-4c69-b521-10141a115187 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:29.718660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb8da35f-3a9b-4c69-b521-10141a115187 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:29.918007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:30.023905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] validate_networks() for [('3055f5ba-b955-4552-8d94-e4bbcdd301d2', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:50:30.975764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cb8da35f-3a9b-4c69-b521-10141a115187 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:30.987772 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cb8da35f-3a9b-4c69-b521-10141a115187 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1524 microversion: 2.1 time: 1.342459 Aug 09 14:50:30.988957 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1987/4006] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:29 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1524 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:30.993902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1d44e0f6-2cb2-4609-82f5-fc342ca18a24 req-d69a6ac9-abbd-486a-bec3-7c37c16fc58e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e813d1b-4c53-4343-a42b-6692f9fc40b6", "tag": "8f712dae-4cf1-4267-aeca-fc43eb8c99ef"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:31.022633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1d44e0f6-2cb2-4609-82f5-fc342ca18a24 req-d69a6ac9-abbd-486a-bec3-7c37c16fc58e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:31.023336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1d44e0f6-2cb2-4609-82f5-fc342ca18a24 req-d69a6ac9-abbd-486a-bec3-7c37c16fc58e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:31.023922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1d44e0f6-2cb2-4609-82f5-fc342ca18a24 req-d69a6ac9-abbd-486a-bec3-7c37c16fc58e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:31.056471 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1d44e0f6-2cb2-4609-82f5-fc342ca18a24 req-d69a6ac9-abbd-486a-bec3-7c37c16fc58e service nova] Creating event network-changed:8f712dae-4cf1-4267-aeca-fc43eb8c99ef for instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 on n-h2-844626-8 Aug 09 14:50:31.068853 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1d44e0f6-2cb2-4609-82f5-fc342ca18a24 req-d69a6ac9-abbd-486a-bec3-7c37c16fc58e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078389 Aug 09 14:50:31.069748 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1988/4007] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:50:31.082254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d80e97ff-4849-4795-9797-5ca7c3fd8d8a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:31.083491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d80e97ff-4849-4795-9797-5ca7c3fd8d8a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:31.100932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d80e97ff-4849-4795-9797-5ca7c3fd8d8a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:31.101469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d80e97ff-4849-4795-9797-5ca7c3fd8d8a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:31.102245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d80e97ff-4849-4795-9797-5ca7c3fd8d8a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:31.103034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d80e97ff-4849-4795-9797-5ca7c3fd8d8a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:31.103752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d80e97ff-4849-4795-9797-5ca7c3fd8d8a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:31.104453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d80e97ff-4849-4795-9797-5ca7c3fd8d8a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:32.522376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:50:32.522958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:50:32.523317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:50:32.523726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:50:32.524187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:50:32.542883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:32.543395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:32.544203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:32.545265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:32.545725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:32.546163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:32.604961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d80e97ff-4849-4795-9797-5ca7c3fd8d8a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:32.609974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Getting quotas for project e0caed61cb95467ba8b076c63f6706de. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:50:32.619510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d80e97ff-4849-4795-9797-5ca7c3fd8d8a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:32.622981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d80e97ff-4849-4795-9797-5ca7c3fd8d8a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:32.625099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Getting quotas for user cfd1981c518d4432b4635c1768114b22 and project e0caed61cb95467ba8b076c63f6706de. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:50:32.625771 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d80e97ff-4849-4795-9797-5ca7c3fd8d8a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 1.554448 Aug 09 14:50:32.627527 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1989/4008] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:31 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:32.639858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f4eab4d-2d5e-4cb6-a46c-8ac188411a60 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:32.641000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:50:32.643436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:50:32.668620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2f4eab4d-2d5e-4cb6-a46c-8ac188411a60 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:32.690918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=44 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:32.699761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f4eab4d-2d5e-4cb6-a46c-8ac188411a60 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:32.702468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f4eab4d-2d5e-4cb6-a46c-8ac188411a60 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:32.703539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f4eab4d-2d5e-4cb6-a46c-8ac188411a60 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:32.706283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f4eab4d-2d5e-4cb6-a46c-8ac188411a60 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:32.709454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f4eab4d-2d5e-4cb6-a46c-8ac188411a60 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:32.711153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f4eab4d-2d5e-4cb6-a46c-8ac188411a60 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:32.769820 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bee1db86-23a0-44ee-807a-bd64e96f6278 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 12.882184 Aug 09 14:50:32.775188 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2020/4009] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:50:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 12888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:50:32.785860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-33989289-1f93-45a1-b2af-7dad1185e992 req-23cc1893-4d66-465b-a6c9-6f59f49650bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25a9384-ba3d-4ff8-8f2a-39ccdde0690a", "name": "network-vif-plugged", "status": "completed", "tag": "ec41d639-5d70-4bd6-8da7-60954703b90b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:32.811509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-33989289-1f93-45a1-b2af-7dad1185e992 req-23cc1893-4d66-465b-a6c9-6f59f49650bb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:32.812275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-33989289-1f93-45a1-b2af-7dad1185e992 req-23cc1893-4d66-465b-a6c9-6f59f49650bb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:32.813525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-33989289-1f93-45a1-b2af-7dad1185e992 req-23cc1893-4d66-465b-a6c9-6f59f49650bb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:32.850271 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-33989289-1f93-45a1-b2af-7dad1185e992 req-23cc1893-4d66-465b-a6c9-6f59f49650bb service nova] Creating event network-vif-plugged:ec41d639-5d70-4bd6-8da7-60954703b90b for instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a on n-h2-844626-8 Aug 09 14:50:32.869216 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-33989289-1f93-45a1-b2af-7dad1185e992 req-23cc1893-4d66-465b-a6c9-6f59f49650bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088505 Aug 09 14:50:32.882100 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2021/4010] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:50:32.889985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f42f66bd-4262-47da-8737-98954c92ada7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:32.891344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f42f66bd-4262-47da-8737-98954c92ada7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:33.612367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f42f66bd-4262-47da-8737-98954c92ada7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:33.624968 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f42f66bd-4262-47da-8737-98954c92ada7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1222 microversion: 2.1 time: 0.740558 Aug 09 14:50:33.625603 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2022/4011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:32 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1222 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:33.679410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22b28026-2f6a-486c-a18b-bb129d3f02a7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:33.687955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22b28026-2f6a-486c-a18b-bb129d3f02a7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:33.722188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22b28026-2f6a-486c-a18b-bb129d3f02a7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:33.726520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22b28026-2f6a-486c-a18b-bb129d3f02a7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:33.727486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22b28026-2f6a-486c-a18b-bb129d3f02a7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:33.729692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22b28026-2f6a-486c-a18b-bb129d3f02a7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:33.730381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22b28026-2f6a-486c-a18b-bb129d3f02a7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:33.731410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22b28026-2f6a-486c-a18b-bb129d3f02a7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:33.899612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2f4eab4d-2d5e-4cb6-a46c-8ac188411a60 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:33.912438 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2f4eab4d-2d5e-4cb6-a46c-8ac188411a60 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1506 microversion: 2.1 time: 1.282923 Aug 09 14:50:33.914527 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1990/4012] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:32 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1506 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:34.424333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22b28026-2f6a-486c-a18b-bb129d3f02a7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:34.434472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22b28026-2f6a-486c-a18b-bb129d3f02a7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:34.446324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22b28026-2f6a-486c-a18b-bb129d3f02a7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:34.455072 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22b28026-2f6a-486c-a18b-bb129d3f02a7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.796358 Aug 09 14:50:34.472278 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2023/4013] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:33 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:34.663356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df818aa5-d2fa-4e32-918c-6f42cca5a60d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:34.664201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-df818aa5-d2fa-4e32-918c-6f42cca5a60d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:34.683373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df818aa5-d2fa-4e32-918c-6f42cca5a60d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:34.684496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df818aa5-d2fa-4e32-918c-6f42cca5a60d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:34.685625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df818aa5-d2fa-4e32-918c-6f42cca5a60d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:34.687981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df818aa5-d2fa-4e32-918c-6f42cca5a60d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:34.690895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df818aa5-d2fa-4e32-918c-6f42cca5a60d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:34.691662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df818aa5-d2fa-4e32-918c-6f42cca5a60d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:34.844938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-df818aa5-d2fa-4e32-918c-6f42cca5a60d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:34.871743 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-df818aa5-d2fa-4e32-918c-6f42cca5a60d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1274 microversion: 2.1 time: 0.220161 Aug 09 14:50:34.877516 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1991/4014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:34 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1274 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:34.936351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b3f29672-1fb1-4956-b3df-8d8d4a69f92e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:34.936961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b3f29672-1fb1-4956-b3df-8d8d4a69f92e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:34.956668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3f29672-1fb1-4956-b3df-8d8d4a69f92e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:34.961914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3f29672-1fb1-4956-b3df-8d8d4a69f92e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:34.962581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3f29672-1fb1-4956-b3df-8d8d4a69f92e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:34.963539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3f29672-1fb1-4956-b3df-8d8d4a69f92e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:34.964163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3f29672-1fb1-4956-b3df-8d8d4a69f92e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:34.964746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b3f29672-1fb1-4956-b3df-8d8d4a69f92e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:35.112409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-20badf58-f952-4e1a-a391-dc5cec8ad7e1 req-6b922a96-4585-412c-9bc0-6e6c750c010f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f8bb6e-e556-4454-bea9-c1d1b0e3d986", "name": "network-vif-unplugged", "status": "completed", "tag": "ea448bc1-5122-4971-97e6-788506f2959a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:35.138032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-20badf58-f952-4e1a-a391-dc5cec8ad7e1 req-6b922a96-4585-412c-9bc0-6e6c750c010f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:35.138676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-20badf58-f952-4e1a-a391-dc5cec8ad7e1 req-6b922a96-4585-412c-9bc0-6e6c750c010f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:35.140248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-20badf58-f952-4e1a-a391-dc5cec8ad7e1 req-6b922a96-4585-412c-9bc0-6e6c750c010f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:35.165671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.compute.server_external_events [req-20badf58-f952-4e1a-a391-dc5cec8ad7e1 req-6b922a96-4585-412c-9bc0-6e6c750c010f service nova] Unable to find a host for instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986. Dropping event network-vif-unplugged {{(pid=119406) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 14:50:35.166747 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-20badf58-f952-4e1a-a391-dc5cec8ad7e1 req-6b922a96-4585-412c-9bc0-6e6c750c010f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.058346 Aug 09 14:50:35.167697 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1992/4015] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 09 14:50:35.492758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b3e8798-b683-4ff6-b2ac-4179569db2fa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:35.493429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b3e8798-b683-4ff6-b2ac-4179569db2fa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:35.516027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b3e8798-b683-4ff6-b2ac-4179569db2fa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:35.516791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b3e8798-b683-4ff6-b2ac-4179569db2fa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:35.517395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b3e8798-b683-4ff6-b2ac-4179569db2fa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:35.532909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b3e8798-b683-4ff6-b2ac-4179569db2fa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:35.533663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b3e8798-b683-4ff6-b2ac-4179569db2fa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:35.535155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b3e8798-b683-4ff6-b2ac-4179569db2fa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:35.768544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b3f29672-1fb1-4956-b3df-8d8d4a69f92e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:35.781063 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b3f29672-1fb1-4956-b3df-8d8d4a69f92e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 200 len: 1449 microversion: 2.1 time: 0.849077 Aug 09 14:50:35.785531 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2024/4016] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:34 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 1449 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:35.806303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:35.807069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:35.814590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:35.815298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:35.815900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:35.816806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:35.817406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:35.817993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:35.849561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:50:35.858564 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.compute.api [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Working on deleting snapshot c108a871-adef-44fa-9715-d9cd82bde6f5 from shelved instance... Aug 09 14:50:36.211509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b3e8798-b683-4ff6-b2ac-4179569db2fa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:36.230135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b3e8798-b683-4ff6-b2ac-4179569db2fa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:36.233152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b3e8798-b683-4ff6-b2ac-4179569db2fa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:36.242608 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b3e8798-b683-4ff6-b2ac-4179569db2fa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.750053 Aug 09 14:50:36.247686 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1993/4017] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:35 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:36.270438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca19c802-c781-4bb6-9667-c28aad05241a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:36.273534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca19c802-c781-4bb6-9667-c28aad05241a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:36.308084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca19c802-c781-4bb6-9667-c28aad05241a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:36.311606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca19c802-c781-4bb6-9667-c28aad05241a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:36.314446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca19c802-c781-4bb6-9667-c28aad05241a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:36.317133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca19c802-c781-4bb6-9667-c28aad05241a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:36.317718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca19c802-c781-4bb6-9667-c28aad05241a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:36.321904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca19c802-c781-4bb6-9667-c28aad05241a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:36.482428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca19c802-c781-4bb6-9667-c28aad05241a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:36.493101 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca19c802-c781-4bb6-9667-c28aad05241a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1280 microversion: 2.1 time: 0.244101 Aug 09 14:50:36.493814 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1994/4018] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:36 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1280 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:37.278582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b24a8174-2331-4874-a069-2c50e886ce9a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:37.279444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b24a8174-2331-4874-a069-2c50e886ce9a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:37.288357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b24a8174-2331-4874-a069-2c50e886ce9a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:37.288859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b24a8174-2331-4874-a069-2c50e886ce9a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:37.290493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b24a8174-2331-4874-a069-2c50e886ce9a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:37.292255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b24a8174-2331-4874-a069-2c50e886ce9a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:37.292732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b24a8174-2331-4874-a069-2c50e886ce9a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:37.293169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b24a8174-2331-4874-a069-2c50e886ce9a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:37.767206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b24a8174-2331-4874-a069-2c50e886ce9a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:37.777452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b24a8174-2331-4874-a069-2c50e886ce9a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:37.779385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b24a8174-2331-4874-a069-2c50e886ce9a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:37.780629 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b24a8174-2331-4874-a069-2c50e886ce9a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.511540 Aug 09 14:50:37.790250 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1995/4019] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:37 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:37.805435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-27a0140b-3a1b-4cfd-9643-ec1055c5293b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:37.806092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-27a0140b-3a1b-4cfd-9643-ec1055c5293b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:37.815411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27a0140b-3a1b-4cfd-9643-ec1055c5293b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:37.815962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27a0140b-3a1b-4cfd-9643-ec1055c5293b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:37.816413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27a0140b-3a1b-4cfd-9643-ec1055c5293b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:37.817139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27a0140b-3a1b-4cfd-9643-ec1055c5293b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:37.817593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27a0140b-3a1b-4cfd-9643-ec1055c5293b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:37.818020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27a0140b-3a1b-4cfd-9643-ec1055c5293b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:38.608097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-27a0140b-3a1b-4cfd-9643-ec1055c5293b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:38.618457 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-27a0140b-3a1b-4cfd-9643-ec1055c5293b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1322 microversion: 2.1 time: 0.826795 Aug 09 14:50:38.619039 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1996/4020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:37 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1322 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:38.809454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2cf4913d-75af-4b89-a3c0-c13ff873ef19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:38.810661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2cf4913d-75af-4b89-a3c0-c13ff873ef19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:38.842478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cf4913d-75af-4b89-a3c0-c13ff873ef19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:38.848732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cf4913d-75af-4b89-a3c0-c13ff873ef19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:38.872578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cf4913d-75af-4b89-a3c0-c13ff873ef19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:38.874524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cf4913d-75af-4b89-a3c0-c13ff873ef19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:38.875351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cf4913d-75af-4b89-a3c0-c13ff873ef19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:38.878169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2cf4913d-75af-4b89-a3c0-c13ff873ef19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:39.420783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2cf4913d-75af-4b89-a3c0-c13ff873ef19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:39.430060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2cf4913d-75af-4b89-a3c0-c13ff873ef19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:39.431960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2cf4913d-75af-4b89-a3c0-c13ff873ef19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:39.433385 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2cf4913d-75af-4b89-a3c0-c13ff873ef19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.631386 Aug 09 14:50:39.434456 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1997/4021] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:38 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:50:39.439385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-6adef8bf-f007-45e7-be96-3bd36c396fb4 req-d7633067-75b6-445b-a102-c63802d6815a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d63359-d1e0-41d5-9904-d4149424d2c4", "tag": "f2651a39-42f5-4b62-8fcb-11bc5ff5fe10"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:39.451060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6adef8bf-f007-45e7-be96-3bd36c396fb4 req-d7633067-75b6-445b-a102-c63802d6815a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:39.451649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6adef8bf-f007-45e7-be96-3bd36c396fb4 req-d7633067-75b6-445b-a102-c63802d6815a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:39.452145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6adef8bf-f007-45e7-be96-3bd36c396fb4 req-d7633067-75b6-445b-a102-c63802d6815a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:39.468541 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-6adef8bf-f007-45e7-be96-3bd36c396fb4 req-d7633067-75b6-445b-a102-c63802d6815a service nova] Creating event network-changed:f2651a39-42f5-4b62-8fcb-11bc5ff5fe10 for instance a3d63359-d1e0-41d5-9904-d4149424d2c4 on n-h1-844626-8 Aug 09 14:50:39.473973 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-6adef8bf-f007-45e7-be96-3bd36c396fb4 req-d7633067-75b6-445b-a102-c63802d6815a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037860 Aug 09 14:50:39.474966 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1998/4022] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:50:39.640165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4c71ea23-af13-4270-8910-05be5c0409fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:39.640848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4c71ea23-af13-4270-8910-05be5c0409fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:39.654630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c71ea23-af13-4270-8910-05be5c0409fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:39.655139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c71ea23-af13-4270-8910-05be5c0409fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:39.659773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c71ea23-af13-4270-8910-05be5c0409fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:39.660740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c71ea23-af13-4270-8910-05be5c0409fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:39.661369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c71ea23-af13-4270-8910-05be5c0409fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:39.662205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c71ea23-af13-4270-8910-05be5c0409fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:40.545133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4c71ea23-af13-4270-8910-05be5c0409fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:40.559821 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4c71ea23-af13-4270-8910-05be5c0409fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1322 microversion: 2.1 time: 0.924001 Aug 09 14:50:40.562755 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 1999/4023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:39 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1322 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:40.569043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0370222f-c794-4620-9888-6119997f6a48 req-7b60af35-e809-46de-9f1b-503eac019cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e813d1b-4c53-4343-a42b-6692f9fc40b6", "name": "network-vif-plugged", "status": "completed", "tag": "8f712dae-4cf1-4267-aeca-fc43eb8c99ef"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:40.585582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0370222f-c794-4620-9888-6119997f6a48 req-7b60af35-e809-46de-9f1b-503eac019cea service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:40.586418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0370222f-c794-4620-9888-6119997f6a48 req-7b60af35-e809-46de-9f1b-503eac019cea service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:40.587459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0370222f-c794-4620-9888-6119997f6a48 req-7b60af35-e809-46de-9f1b-503eac019cea service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:40.614347 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0370222f-c794-4620-9888-6119997f6a48 req-7b60af35-e809-46de-9f1b-503eac019cea service nova] Creating event network-vif-plugged:8f712dae-4cf1-4267-aeca-fc43eb8c99ef for instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 on n-h2-844626-8 Aug 09 14:50:40.623645 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0370222f-c794-4620-9888-6119997f6a48 req-7b60af35-e809-46de-9f1b-503eac019cea service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058970 Aug 09 14:50:40.625053 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2000/4024] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:50:40.634560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2bd3dd39-4138-4642-8e21-a4b063629b30 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:40.635519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2bd3dd39-4138-4642-8e21-a4b063629b30 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:40.653942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2bd3dd39-4138-4642-8e21-a4b063629b30 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:40.654666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2bd3dd39-4138-4642-8e21-a4b063629b30 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:40.657073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2bd3dd39-4138-4642-8e21-a4b063629b30 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:40.657073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2bd3dd39-4138-4642-8e21-a4b063629b30 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:40.657516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2bd3dd39-4138-4642-8e21-a4b063629b30 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:40.658043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2bd3dd39-4138-4642-8e21-a4b063629b30 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:41.083474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2bd3dd39-4138-4642-8e21-a4b063629b30 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:41.093121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2bd3dd39-4138-4642-8e21-a4b063629b30 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:41.105407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2bd3dd39-4138-4642-8e21-a4b063629b30 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:41.107372 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2bd3dd39-4138-4642-8e21-a4b063629b30 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.480965 Aug 09 14:50:41.108474 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2001/4025] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:40 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:41.585897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b113853b-e98e-4c2c-a604-bd6eafac323c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:41.586667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b113853b-e98e-4c2c-a604-bd6eafac323c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:41.603758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b113853b-e98e-4c2c-a604-bd6eafac323c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:41.609913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b113853b-e98e-4c2c-a604-bd6eafac323c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:41.611434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b113853b-e98e-4c2c-a604-bd6eafac323c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:41.612459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b113853b-e98e-4c2c-a604-bd6eafac323c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:41.615146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b113853b-e98e-4c2c-a604-bd6eafac323c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:41.615854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b113853b-e98e-4c2c-a604-bd6eafac323c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:41.956668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b113853b-e98e-4c2c-a604-bd6eafac323c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:41.984003 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b113853b-e98e-4c2c-a604-bd6eafac323c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1322 microversion: 2.1 time: 0.404641 Aug 09 14:50:41.986539 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2002/4026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:41 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:42.134715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6419c718-e449-4d5a-ac59-31cfc956c7ce tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:42.135780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6419c718-e449-4d5a-ac59-31cfc956c7ce tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:42.143771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6419c718-e449-4d5a-ac59-31cfc956c7ce tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:42.146800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6419c718-e449-4d5a-ac59-31cfc956c7ce tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:42.147277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6419c718-e449-4d5a-ac59-31cfc956c7ce tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:42.150233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6419c718-e449-4d5a-ac59-31cfc956c7ce tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:42.150698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6419c718-e449-4d5a-ac59-31cfc956c7ce tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:42.151140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6419c718-e449-4d5a-ac59-31cfc956c7ce tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:42.383810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6419c718-e449-4d5a-ac59-31cfc956c7ce tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:42.395971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6419c718-e449-4d5a-ac59-31cfc956c7ce tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:42.400024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6419c718-e449-4d5a-ac59-31cfc956c7ce tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:42.401578 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6419c718-e449-4d5a-ac59-31cfc956c7ce tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.272296 Aug 09 14:50:42.428876 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2003/4027] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:42 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:50:42.569914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:43.008133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-073c7abc-e73f-4866-92dd-6ff69da2d742 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:43.009517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-073c7abc-e73f-4866-92dd-6ff69da2d742 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:43.017826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-073c7abc-e73f-4866-92dd-6ff69da2d742 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:43.018653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-073c7abc-e73f-4866-92dd-6ff69da2d742 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:43.019348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-073c7abc-e73f-4866-92dd-6ff69da2d742 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:43.020558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-073c7abc-e73f-4866-92dd-6ff69da2d742 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:43.021456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-073c7abc-e73f-4866-92dd-6ff69da2d742 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:43.022276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-073c7abc-e73f-4866-92dd-6ff69da2d742 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:43.230485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Doing local delete in cell ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) {{(pid=119407) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 09 14:50:43.231703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:43.233424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:43.234062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:43.234726 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.compute.api [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 09 14:50:43.240309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] deallocate_for_instance() {{(pid=119407) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 09 14:50:43.582242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-073c7abc-e73f-4866-92dd-6ff69da2d742 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:43.622645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:43.625978 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-073c7abc-e73f-4866-92dd-6ff69da2d742 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1322 microversion: 2.1 time: 0.613840 Aug 09 14:50:43.631076 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2004/4028] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:43 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1322 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:50:43.638361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9628bd5a-8c7c-448e-bb5a-57292ca4bc83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:43.638971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9628bd5a-8c7c-448e-bb5a-57292ca4bc83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:43.658609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9628bd5a-8c7c-448e-bb5a-57292ca4bc83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:43.661392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9628bd5a-8c7c-448e-bb5a-57292ca4bc83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:43.662083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9628bd5a-8c7c-448e-bb5a-57292ca4bc83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:43.663981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9628bd5a-8c7c-448e-bb5a-57292ca4bc83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:43.664633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9628bd5a-8c7c-448e-bb5a-57292ca4bc83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:43.667449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9628bd5a-8c7c-448e-bb5a-57292ca4bc83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:43.680470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:44.234812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9628bd5a-8c7c-448e-bb5a-57292ca4bc83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:44.249020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9628bd5a-8c7c-448e-bb5a-57292ca4bc83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:44.250920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9628bd5a-8c7c-448e-bb5a-57292ca4bc83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:44.252457 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9628bd5a-8c7c-448e-bb5a-57292ca4bc83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1808 microversion: 2.20 time: 0.619868 Aug 09 14:50:44.254017 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2005/4029] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:43 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1808 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:44.648031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c46585b-0862-462c-a8ac-e2cddeac0e5e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:44.648858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c46585b-0862-462c-a8ac-e2cddeac0e5e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:44.670341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c46585b-0862-462c-a8ac-e2cddeac0e5e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:44.671095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c46585b-0862-462c-a8ac-e2cddeac0e5e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:44.671791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c46585b-0862-462c-a8ac-e2cddeac0e5e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:44.674722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c46585b-0862-462c-a8ac-e2cddeac0e5e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:44.678369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c46585b-0862-462c-a8ac-e2cddeac0e5e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:44.679532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c46585b-0862-462c-a8ac-e2cddeac0e5e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:44.827451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Updating instance_info_cache with network_info: [] {{(pid=119407) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 14:50:45.069040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c46585b-0862-462c-a8ac-e2cddeac0e5e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:45.084631 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c46585b-0862-462c-a8ac-e2cddeac0e5e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1322 microversion: 2.1 time: 0.440853 Aug 09 14:50:45.100432 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2006/4030] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:44 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:45.109760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-00288a0f-545a-49ce-9e64-74ee32d17aa5 req-33cec64d-d4d0-436d-934e-2cfb826d1478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f8bb6e-e556-4454-bea9-c1d1b0e3d986", "name": "network-vif-deleted", "tag": "ea448bc1-5122-4971-97e6-788506f2959a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:45.126635 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7379aa96-fc50-4000-b9ca-373a222964d7 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 204 len: 0 microversion: 2.1 time: 9.323644 Aug 09 14:50:45.127417 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2025/4031] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:50:35 2022] DELETE /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 0 bytes in 9326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:50:45.133789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-00288a0f-545a-49ce-9e64-74ee32d17aa5 req-33cec64d-d4d0-436d-934e-2cfb826d1478 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:45.134909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-00288a0f-545a-49ce-9e64-74ee32d17aa5 req-33cec64d-d4d0-436d-934e-2cfb826d1478 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:45.135548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-00288a0f-545a-49ce-9e64-74ee32d17aa5 req-33cec64d-d4d0-436d-934e-2cfb826d1478 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:45.138173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78533650-fe46-4311-a38d-52ee852b868a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:45.138796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-78533650-fe46-4311-a38d-52ee852b868a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:45.162358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78533650-fe46-4311-a38d-52ee852b868a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:45.162844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78533650-fe46-4311-a38d-52ee852b868a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:45.164071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78533650-fe46-4311-a38d-52ee852b868a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:45.164792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78533650-fe46-4311-a38d-52ee852b868a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:45.165746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78533650-fe46-4311-a38d-52ee852b868a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:45.165746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78533650-fe46-4311-a38d-52ee852b868a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:45.168034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.compute.server_external_events [req-00288a0f-545a-49ce-9e64-74ee32d17aa5 req-33cec64d-d4d0-436d-934e-2cfb826d1478 service nova] Unable to find a host for instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986. Dropping event network-vif-deleted {{(pid=119406) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 14:50:45.169196 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-00288a0f-545a-49ce-9e64-74ee32d17aa5 req-33cec64d-d4d0-436d-934e-2cfb826d1478 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.066207 Aug 09 14:50:45.170351 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2007/4032] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 69 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 14:50:45.189822 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-78533650-fe46-4311-a38d-52ee852b868a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78533650-fe46-4311-a38d-52ee852b868a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 HTTP/1.1 Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '45f8bb6e-e556-4454-bea9-c1d1b0e3d986'} Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:50:45.191880 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:50:45.195895 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:50:45.195895 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:50:45.195895 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:50:45.195895 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:50:45.195895 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:50:45.195895 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:50:45.195895 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:50:45.195895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78533650-fe46-4311-a38d-52ee852b868a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:50:45.195895 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78533650-fe46-4311-a38d-52ee852b868a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 404 len: 111 microversion: 2.1 time: 0.061929 Aug 09 14:50:45.195895 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2026/4033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:45 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:50:45.280610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3dfc6921-1b14-42da-a351-bef045a81c37 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:45.282640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3dfc6921-1b14-42da-a351-bef045a81c37 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:45.298858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3dfc6921-1b14-42da-a351-bef045a81c37 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:45.299407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3dfc6921-1b14-42da-a351-bef045a81c37 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:45.299984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3dfc6921-1b14-42da-a351-bef045a81c37 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:45.304662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3dfc6921-1b14-42da-a351-bef045a81c37 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:45.305156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3dfc6921-1b14-42da-a351-bef045a81c37 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:45.305644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3dfc6921-1b14-42da-a351-bef045a81c37 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:45.372709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2024947235", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:45.488355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] validate_networks() for [('583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:50:45.737848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3dfc6921-1b14-42da-a351-bef045a81c37 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:45.754800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3dfc6921-1b14-42da-a351-bef045a81c37 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:45.756717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3dfc6921-1b14-42da-a351-bef045a81c37 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:45.764092 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3dfc6921-1b14-42da-a351-bef045a81c37 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1795 microversion: 2.20 time: 0.487800 Aug 09 14:50:45.764981 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2008/4034] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:45 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1795 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:50:45.992700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-dd2a277b-1a0b-4c53-ad1f-93b99265d54d req-1e00cfb9-d70e-4edd-9ff4-74a6a33f48d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d63359-d1e0-41d5-9904-d4149424d2c4", "name": "network-vif-plugged", "status": "completed", "tag": "f2651a39-42f5-4b62-8fcb-11bc5ff5fe10"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:46.020221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dd2a277b-1a0b-4c53-ad1f-93b99265d54d req-1e00cfb9-d70e-4edd-9ff4-74a6a33f48d3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:46.022830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dd2a277b-1a0b-4c53-ad1f-93b99265d54d req-1e00cfb9-d70e-4edd-9ff4-74a6a33f48d3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:46.025065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dd2a277b-1a0b-4c53-ad1f-93b99265d54d req-1e00cfb9-d70e-4edd-9ff4-74a6a33f48d3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:46.057218 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-dd2a277b-1a0b-4c53-ad1f-93b99265d54d req-1e00cfb9-d70e-4edd-9ff4-74a6a33f48d3 service nova] Creating event network-vif-plugged:f2651a39-42f5-4b62-8fcb-11bc5ff5fe10 for instance a3d63359-d1e0-41d5-9904-d4149424d2c4 on n-h1-844626-8 Aug 09 14:50:46.086522 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-dd2a277b-1a0b-4c53-ad1f-93b99265d54d req-1e00cfb9-d70e-4edd-9ff4-74a6a33f48d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096593 Aug 09 14:50:46.101545 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2009/4035] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:50:46.115314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d3c3cbc1-4f29-48ad-a1aa-a8f43b4a6eed tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:46.125561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3c3cbc1-4f29-48ad-a1aa-a8f43b4a6eed tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:46.150875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3c3cbc1-4f29-48ad-a1aa-a8f43b4a6eed tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:46.151399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3c3cbc1-4f29-48ad-a1aa-a8f43b4a6eed tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:46.151862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3c3cbc1-4f29-48ad-a1aa-a8f43b4a6eed tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:46.159647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3c3cbc1-4f29-48ad-a1aa-a8f43b4a6eed tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:46.160252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3c3cbc1-4f29-48ad-a1aa-a8f43b4a6eed tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:46.160714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3c3cbc1-4f29-48ad-a1aa-a8f43b4a6eed tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:47.068087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:50:47.068661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:50:47.069258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:50:47.069967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:50:47.070461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:50:47.099337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:47.100663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:47.101272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:47.102018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:47.102523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:47.102957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:47.120330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d3c3cbc1-4f29-48ad-a1aa-a8f43b4a6eed tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:47.132739 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d3c3cbc1-4f29-48ad-a1aa-a8f43b4a6eed tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1322 microversion: 2.1 time: 1.028009 Aug 09 14:50:47.133350 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2010/4036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:46 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1322 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:47.136055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:50:47.143422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for user d970d0bf9e754591b09af75bbf64a96d and project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:50:47.162936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:50:47.168571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:50:47.265192 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-611f7b1d-3aef-429d-919b-5ce4d7ecba4d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.897296 Aug 09 14:50:47.276489 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2027/4037] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:50:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:50:47.281780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fc493808-9c98-4c25-965e-7823aa9442a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:47.282410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fc493808-9c98-4c25-965e-7823aa9442a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:47.388134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fc493808-9c98-4c25-965e-7823aa9442a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:47.396018 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fc493808-9c98-4c25-965e-7823aa9442a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1215 microversion: 2.1 time: 0.119544 Aug 09 14:50:47.409378 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2011/4038] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:47 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1215 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:50:48.156245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-139dad58-df3a-4906-8810-ca8ae8db7e47 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:48.156880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-139dad58-df3a-4906-8810-ca8ae8db7e47 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:48.173155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-139dad58-df3a-4906-8810-ca8ae8db7e47 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:48.173649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-139dad58-df3a-4906-8810-ca8ae8db7e47 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:48.178996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-139dad58-df3a-4906-8810-ca8ae8db7e47 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:48.180034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-139dad58-df3a-4906-8810-ca8ae8db7e47 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:48.180576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-139dad58-df3a-4906-8810-ca8ae8db7e47 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:48.181035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-139dad58-df3a-4906-8810-ca8ae8db7e47 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:48.417249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ddb15e38-ff53-4514-be15-f02953c5ee84 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:48.417968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ddb15e38-ff53-4514-be15-f02953c5ee84 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:48.440942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddb15e38-ff53-4514-be15-f02953c5ee84 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:48.444809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddb15e38-ff53-4514-be15-f02953c5ee84 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:48.446536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddb15e38-ff53-4514-be15-f02953c5ee84 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:48.452637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddb15e38-ff53-4514-be15-f02953c5ee84 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:48.453397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddb15e38-ff53-4514-be15-f02953c5ee84 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:48.453944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddb15e38-ff53-4514-be15-f02953c5ee84 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:48.710066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ddb15e38-ff53-4514-be15-f02953c5ee84 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:48.724584 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ddb15e38-ff53-4514-be15-f02953c5ee84 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1219 microversion: 2.1 time: 0.311406 Aug 09 14:50:48.729660 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2012/4039] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:48 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1219 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:48.810802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-139dad58-df3a-4906-8810-ca8ae8db7e47 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:48.821875 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-139dad58-df3a-4906-8810-ca8ae8db7e47 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1516 microversion: 2.1 time: 0.671688 Aug 09 14:50:48.839720 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2028/4040] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:48 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1516 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:48.845624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e55315d-83e4-4d30-b911-f7542600d744 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:48.848048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e55315d-83e4-4d30-b911-f7542600d744 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:48.855300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e55315d-83e4-4d30-b911-f7542600d744 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:48.855792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e55315d-83e4-4d30-b911-f7542600d744 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:48.856228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e55315d-83e4-4d30-b911-f7542600d744 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:48.856989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e55315d-83e4-4d30-b911-f7542600d744 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:48.857442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e55315d-83e4-4d30-b911-f7542600d744 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:48.857857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e55315d-83e4-4d30-b911-f7542600d744 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:48.899046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-1e55315d-83e4-4d30-b911-f7542600d744 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lazy-loading 'flavor' on Instance uuid a3d63359-d1e0-41d5-9904-d4149424d2c4 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:50:49.070666 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e55315d-83e4-4d30-b911-f7542600d744 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4/action" status: 200 len: 32 microversion: 2.1 time: 0.228877 Aug 09 14:50:49.075940 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2013/4041] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:50:48 2022] POST /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:50:49.087991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-68893ff8-d97e-439b-9d04-5016f1b2db16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:49.093488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-68893ff8-d97e-439b-9d04-5016f1b2db16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:49.110595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68893ff8-d97e-439b-9d04-5016f1b2db16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:49.113343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68893ff8-d97e-439b-9d04-5016f1b2db16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:49.114763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68893ff8-d97e-439b-9d04-5016f1b2db16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:49.115871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68893ff8-d97e-439b-9d04-5016f1b2db16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:49.120479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68893ff8-d97e-439b-9d04-5016f1b2db16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:49.121765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-68893ff8-d97e-439b-9d04-5016f1b2db16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:49.585072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-68893ff8-d97e-439b-9d04-5016f1b2db16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:49.595775 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-68893ff8-d97e-439b-9d04-5016f1b2db16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.517210 Aug 09 14:50:49.612811 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2029/4042] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:49 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:49.753093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-afd23686-b4a5-48f8-86d5-bebb54f7dc2d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:49.754521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-afd23686-b4a5-48f8-86d5-bebb54f7dc2d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:49.771689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afd23686-b4a5-48f8-86d5-bebb54f7dc2d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:49.772605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afd23686-b4a5-48f8-86d5-bebb54f7dc2d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:49.776127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afd23686-b4a5-48f8-86d5-bebb54f7dc2d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:49.779930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afd23686-b4a5-48f8-86d5-bebb54f7dc2d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:49.781364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afd23686-b4a5-48f8-86d5-bebb54f7dc2d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:49.784464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afd23686-b4a5-48f8-86d5-bebb54f7dc2d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:49.914575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-afd23686-b4a5-48f8-86d5-bebb54f7dc2d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:49.933026 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-afd23686-b4a5-48f8-86d5-bebb54f7dc2d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1273 microversion: 2.1 time: 0.183028 Aug 09 14:50:49.933695 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2014/4043] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:49 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:50.617646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2112cfca-e106-49e6-8435-5f60a47fa181 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:50.618478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2112cfca-e106-49e6-8435-5f60a47fa181 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:50.630438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2112cfca-e106-49e6-8435-5f60a47fa181 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:50.631076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2112cfca-e106-49e6-8435-5f60a47fa181 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:50.639118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2112cfca-e106-49e6-8435-5f60a47fa181 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:50.640047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2112cfca-e106-49e6-8435-5f60a47fa181 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:50.640749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2112cfca-e106-49e6-8435-5f60a47fa181 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:50.641406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2112cfca-e106-49e6-8435-5f60a47fa181 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:50.954168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fb170761-dbd8-4903-9de3-27050b96f6f6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:50.954863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fb170761-dbd8-4903-9de3-27050b96f6f6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:50.983716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb170761-dbd8-4903-9de3-27050b96f6f6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:50.990645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb170761-dbd8-4903-9de3-27050b96f6f6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:50.991185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb170761-dbd8-4903-9de3-27050b96f6f6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:50.991950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb170761-dbd8-4903-9de3-27050b96f6f6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:50.992407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb170761-dbd8-4903-9de3-27050b96f6f6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:51.000439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb170761-dbd8-4903-9de3-27050b96f6f6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:51.394604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fb170761-dbd8-4903-9de3-27050b96f6f6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:51.406154 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fb170761-dbd8-4903-9de3-27050b96f6f6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1273 microversion: 2.1 time: 0.455984 Aug 09 14:50:51.411948 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2015/4044] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:50 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1273 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:50:51.571065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2112cfca-e106-49e6-8435-5f60a47fa181 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:51.586813 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2112cfca-e106-49e6-8435-5f60a47fa181 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.973976 Aug 09 14:50:51.600264 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2030/4045] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:50 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:52.429504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b6b6911f-df8b-40da-84db-9695b1ea2c52 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:52.436760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6b6911f-df8b-40da-84db-9695b1ea2c52 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:52.453009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6b6911f-df8b-40da-84db-9695b1ea2c52 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:52.455163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6b6911f-df8b-40da-84db-9695b1ea2c52 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:52.456715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6b6911f-df8b-40da-84db-9695b1ea2c52 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:52.458377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6b6911f-df8b-40da-84db-9695b1ea2c52 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:52.460720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6b6911f-df8b-40da-84db-9695b1ea2c52 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:52.461376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6b6911f-df8b-40da-84db-9695b1ea2c52 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:52.628283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a6ee63df-210e-4177-bca7-416652ec198b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:52.628943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a6ee63df-210e-4177-bca7-416652ec198b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:52.659590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ee63df-210e-4177-bca7-416652ec198b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:52.661349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ee63df-210e-4177-bca7-416652ec198b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:52.662529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ee63df-210e-4177-bca7-416652ec198b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:52.665349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ee63df-210e-4177-bca7-416652ec198b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:52.667748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ee63df-210e-4177-bca7-416652ec198b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:52.672154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ee63df-210e-4177-bca7-416652ec198b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:53.287816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b6b6911f-df8b-40da-84db-9695b1ea2c52 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:53.297582 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b6b6911f-df8b-40da-84db-9695b1ea2c52 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1315 microversion: 2.1 time: 0.875379 Aug 09 14:50:53.300902 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2016/4046] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:52 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:53.349498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a6ee63df-210e-4177-bca7-416652ec198b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:53.373064 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a6ee63df-210e-4177-bca7-416652ec198b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.743912 Aug 09 14:50:53.376582 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2031/4047] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:52 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:53.583181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f71c7e9b-3ad9-4675-b4eb-280dae6fe92e req-20703364-8ce0-4374-bd27-b112089d75ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a147d07-f2a5-4ecc-a667-295abf7b5da3", "tag": "17b9582e-5700-4af8-9288-7bacc95f529b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:50:53.631791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f71c7e9b-3ad9-4675-b4eb-280dae6fe92e req-20703364-8ce0-4374-bd27-b112089d75ee service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:53.632419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f71c7e9b-3ad9-4675-b4eb-280dae6fe92e req-20703364-8ce0-4374-bd27-b112089d75ee service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:53.635273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f71c7e9b-3ad9-4675-b4eb-280dae6fe92e req-20703364-8ce0-4374-bd27-b112089d75ee service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:53.694965 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f71c7e9b-3ad9-4675-b4eb-280dae6fe92e req-20703364-8ce0-4374-bd27-b112089d75ee service nova] Creating event network-changed:17b9582e-5700-4af8-9288-7bacc95f529b for instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 on n-h1-844626-8 Aug 09 14:50:53.717810 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f71c7e9b-3ad9-4675-b4eb-280dae6fe92e req-20703364-8ce0-4374-bd27-b112089d75ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146575 Aug 09 14:50:53.721009 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2017/4048] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:50:54.323212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d8b460a-1eae-4b19-b2a5-a010f42df384 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:54.325384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d8b460a-1eae-4b19-b2a5-a010f42df384 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:54.333044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d8b460a-1eae-4b19-b2a5-a010f42df384 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:54.333721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d8b460a-1eae-4b19-b2a5-a010f42df384 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:54.334176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d8b460a-1eae-4b19-b2a5-a010f42df384 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:54.335125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d8b460a-1eae-4b19-b2a5-a010f42df384 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:54.335571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d8b460a-1eae-4b19-b2a5-a010f42df384 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:54.335997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d8b460a-1eae-4b19-b2a5-a010f42df384 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:54.407478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b56c466-c478-456a-8f53-08ba5a7f89cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:54.409001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b56c466-c478-456a-8f53-08ba5a7f89cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:54.454290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b56c466-c478-456a-8f53-08ba5a7f89cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:54.467416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b56c466-c478-456a-8f53-08ba5a7f89cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:54.467416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b56c466-c478-456a-8f53-08ba5a7f89cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:54.467416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b56c466-c478-456a-8f53-08ba5a7f89cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:54.467416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b56c466-c478-456a-8f53-08ba5a7f89cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:54.467416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b56c466-c478-456a-8f53-08ba5a7f89cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:54.783895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d8b460a-1eae-4b19-b2a5-a010f42df384 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:54.801720 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d8b460a-1eae-4b19-b2a5-a010f42df384 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1315 microversion: 2.1 time: 0.481834 Aug 09 14:50:54.811402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b56c466-c478-456a-8f53-08ba5a7f89cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:54.811979 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2032/4049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:54 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:54.812089 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b56c466-c478-456a-8f53-08ba5a7f89cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.413001 Aug 09 14:50:54.814193 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2018/4050] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:54 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:55.838728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f7db14fd-54e7-45ae-b543-50bff7687f38 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:55.845474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ad8b7b40-7972-4105-88d8-3c9b244c33b3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:55.847509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ad8b7b40-7972-4105-88d8-3c9b244c33b3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:55.848080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7db14fd-54e7-45ae-b543-50bff7687f38 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:55.880341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad8b7b40-7972-4105-88d8-3c9b244c33b3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:55.888964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7db14fd-54e7-45ae-b543-50bff7687f38 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:55.889720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7db14fd-54e7-45ae-b543-50bff7687f38 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:55.889982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad8b7b40-7972-4105-88d8-3c9b244c33b3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:55.890170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7db14fd-54e7-45ae-b543-50bff7687f38 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:55.890484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad8b7b40-7972-4105-88d8-3c9b244c33b3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:55.891430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad8b7b40-7972-4105-88d8-3c9b244c33b3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:55.891905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad8b7b40-7972-4105-88d8-3c9b244c33b3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:55.892332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ad8b7b40-7972-4105-88d8-3c9b244c33b3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:55.892703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7db14fd-54e7-45ae-b543-50bff7687f38 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:55.893397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7db14fd-54e7-45ae-b543-50bff7687f38 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:55.895729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7db14fd-54e7-45ae-b543-50bff7687f38 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:56.319826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ad8b7b40-7972-4105-88d8-3c9b244c33b3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:56.329413 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ad8b7b40-7972-4105-88d8-3c9b244c33b3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1315 microversion: 2.1 time: 0.489148 Aug 09 14:50:56.335009 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2019/4051] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:55 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:56.375531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f7db14fd-54e7-45ae-b543-50bff7687f38 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:56.379540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:56.390113 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f7db14fd-54e7-45ae-b543-50bff7687f38 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.556861 Aug 09 14:50:56.390987 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2033/4052] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:55 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:57.363426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce9c9da8-981f-4467-a7bf-8f10a5ad0794 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:57.364538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ce9c9da8-981f-4467-a7bf-8f10a5ad0794 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:57.396700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:57.401341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce9c9da8-981f-4467-a7bf-8f10a5ad0794 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:57.402184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce9c9da8-981f-4467-a7bf-8f10a5ad0794 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:57.412086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce9c9da8-981f-4467-a7bf-8f10a5ad0794 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:57.414040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce9c9da8-981f-4467-a7bf-8f10a5ad0794 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:57.418470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce9c9da8-981f-4467-a7bf-8f10a5ad0794 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:57.419103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce9c9da8-981f-4467-a7bf-8f10a5ad0794 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:57.419839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1aa66efa-fcaa-477b-9bf9-32011874da28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:57.421778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1aa66efa-fcaa-477b-9bf9-32011874da28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:57.451214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:57.456766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:57.474761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1aa66efa-fcaa-477b-9bf9-32011874da28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:57.476207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1aa66efa-fcaa-477b-9bf9-32011874da28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:57.477322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1aa66efa-fcaa-477b-9bf9-32011874da28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:57.480073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1aa66efa-fcaa-477b-9bf9-32011874da28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:57.483697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1aa66efa-fcaa-477b-9bf9-32011874da28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:57.484791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1aa66efa-fcaa-477b-9bf9-32011874da28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:58.077453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ce9c9da8-981f-4467-a7bf-8f10a5ad0794 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:58.087700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1aa66efa-fcaa-477b-9bf9-32011874da28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:58.097973 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1aa66efa-fcaa-477b-9bf9-32011874da28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.687762 Aug 09 14:50:58.101350 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2034/4053] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:57 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:50:58.136025 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ce9c9da8-981f-4467-a7bf-8f10a5ad0794 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1315 microversion: 2.1 time: 0.772879 Aug 09 14:50:58.138687 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2020/4054] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:57 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1315 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:58.505623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a2ce34a-bc33-4bd3-b0c3-f4049048fecf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:58.508841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a2ce34a-bc33-4bd3-b0c3-f4049048fecf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:58.521290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a2ce34a-bc33-4bd3-b0c3-f4049048fecf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:58.522002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a2ce34a-bc33-4bd3-b0c3-f4049048fecf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:58.522628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a2ce34a-bc33-4bd3-b0c3-f4049048fecf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:58.523859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a2ce34a-bc33-4bd3-b0c3-f4049048fecf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:58.524867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a2ce34a-bc33-4bd3-b0c3-f4049048fecf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:58.525803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a2ce34a-bc33-4bd3-b0c3-f4049048fecf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:58.619695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a2ce34a-bc33-4bd3-b0c3-f4049048fecf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:50:58.797771 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a2ce34a-bc33-4bd3-b0c3-f4049048fecf tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "DELETE /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 204 len: 0 microversion: 2.42 time: 0.693980 Aug 09 14:50:58.799475 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2035/4055] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:50:58 2022] DELETE /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 0 bytes in 697 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:50:58.815596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4905426-828b-4d35-bc31-0654a973a27b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:58.816689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b4905426-828b-4d35-bc31-0654a973a27b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:58.832971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4905426-828b-4d35-bc31-0654a973a27b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:58.834087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4905426-828b-4d35-bc31-0654a973a27b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:58.835074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4905426-828b-4d35-bc31-0654a973a27b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:58.836644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4905426-828b-4d35-bc31-0654a973a27b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:58.837865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4905426-828b-4d35-bc31-0654a973a27b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:58.838968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4905426-828b-4d35-bc31-0654a973a27b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:59.133073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7662050f-668e-4f64-8ec7-465074162288 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:59.133911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7662050f-668e-4f64-8ec7-465074162288 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:59.148080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7662050f-668e-4f64-8ec7-465074162288 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:59.151565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7662050f-668e-4f64-8ec7-465074162288 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:59.151565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7662050f-668e-4f64-8ec7-465074162288 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:59.151565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7662050f-668e-4f64-8ec7-465074162288 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:59.151565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7662050f-668e-4f64-8ec7-465074162288 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:59.151565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7662050f-668e-4f64-8ec7-465074162288 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:59.543905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b4905426-828b-4d35-bc31-0654a973a27b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:59.583644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b4905426-828b-4d35-bc31-0654a973a27b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:59.589515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b4905426-828b-4d35-bc31-0654a973a27b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:59.593575 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b4905426-828b-4d35-bc31-0654a973a27b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 2958 microversion: 2.42 time: 0.785288 Aug 09 14:50:59.595465 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2021/4056] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:50:58 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 2958 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:50:59.614773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b2cbcca-afe1-4952-aae6-a6985a46478d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:50:59.616351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9b2cbcca-afe1-4952-aae6-a6985a46478d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:50:59.639753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b2cbcca-afe1-4952-aae6-a6985a46478d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:59.642083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b2cbcca-afe1-4952-aae6-a6985a46478d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:59.643113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b2cbcca-afe1-4952-aae6-a6985a46478d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:59.644652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b2cbcca-afe1-4952-aae6-a6985a46478d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:50:59.646316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b2cbcca-afe1-4952-aae6-a6985a46478d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:50:59.647563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9b2cbcca-afe1-4952-aae6-a6985a46478d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:50:59.665147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7662050f-668e-4f64-8ec7-465074162288 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:59.686678 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7662050f-668e-4f64-8ec7-465074162288 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.557736 Aug 09 14:50:59.688549 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2036/4057] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:59 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:50:59.959052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9b2cbcca-afe1-4952-aae6-a6985a46478d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:50:59.967776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:50:59.976075 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b2cbcca-afe1-4952-aae6-a6985a46478d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1315 microversion: 2.1 time: 0.370139 Aug 09 14:50:59.979451 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2022/4058] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:50:59 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:00.145387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-e95fbd35-0618-4f89-986e-ca2f9269c223 req-3f6d9597-156d-474b-a975-afcab3633823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a147d07-f2a5-4ecc-a667-295abf7b5da3", "name": "network-vif-plugged", "status": "completed", "tag": "17b9582e-5700-4af8-9288-7bacc95f529b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:00.168086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:00.190846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e95fbd35-0618-4f89-986e-ca2f9269c223 req-3f6d9597-156d-474b-a975-afcab3633823 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:00.191717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e95fbd35-0618-4f89-986e-ca2f9269c223 req-3f6d9597-156d-474b-a975-afcab3633823 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:00.192476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e95fbd35-0618-4f89-986e-ca2f9269c223 req-3f6d9597-156d-474b-a975-afcab3633823 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:00.234652 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-e95fbd35-0618-4f89-986e-ca2f9269c223 req-3f6d9597-156d-474b-a975-afcab3633823 service nova] Creating event network-vif-plugged:17b9582e-5700-4af8-9288-7bacc95f529b for instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 on n-h1-844626-8 Aug 09 14:51:00.244660 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-e95fbd35-0618-4f89-986e-ca2f9269c223 req-3f6d9597-156d-474b-a975-afcab3633823 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106015 Aug 09 14:51:00.250369 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2037/4059] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:00.623864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa9ed5ed-0e5b-4760-a0eb-9ba44fe8fa3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:00.624553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa9ed5ed-0e5b-4760-a0eb-9ba44fe8fa3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:00.668103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa9ed5ed-0e5b-4760-a0eb-9ba44fe8fa3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:00.668964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa9ed5ed-0e5b-4760-a0eb-9ba44fe8fa3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:00.669691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa9ed5ed-0e5b-4760-a0eb-9ba44fe8fa3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:00.676617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa9ed5ed-0e5b-4760-a0eb-9ba44fe8fa3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:00.677883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa9ed5ed-0e5b-4760-a0eb-9ba44fe8fa3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:00.678942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa9ed5ed-0e5b-4760-a0eb-9ba44fe8fa3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:00.732990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a16a0bb2-3685-4852-a729-6ad53349381a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:00.733816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a16a0bb2-3685-4852-a729-6ad53349381a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:00.760635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a16a0bb2-3685-4852-a729-6ad53349381a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:00.761142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a16a0bb2-3685-4852-a729-6ad53349381a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:00.761582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a16a0bb2-3685-4852-a729-6ad53349381a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:00.762367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a16a0bb2-3685-4852-a729-6ad53349381a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:00.762837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a16a0bb2-3685-4852-a729-6ad53349381a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:00.763265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a16a0bb2-3685-4852-a729-6ad53349381a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:01.446109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a16a0bb2-3685-4852-a729-6ad53349381a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:01.457695 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a16a0bb2-3685-4852-a729-6ad53349381a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.732246 Aug 09 14:51:01.471109 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2038/4060] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:00 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:51:01.475294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c39140f-50b4-4554-a824-65be00590245 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:01.475914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c39140f-50b4-4554-a824-65be00590245 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:01.486022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c39140f-50b4-4554-a824-65be00590245 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:01.486522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c39140f-50b4-4554-a824-65be00590245 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:01.486956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c39140f-50b4-4554-a824-65be00590245 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:01.487692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c39140f-50b4-4554-a824-65be00590245 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:01.488142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c39140f-50b4-4554-a824-65be00590245 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:01.488562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c39140f-50b4-4554-a824-65be00590245 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:01.560260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa9ed5ed-0e5b-4760-a0eb-9ba44fe8fa3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:01.601353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa9ed5ed-0e5b-4760-a0eb-9ba44fe8fa3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:01.609689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa9ed5ed-0e5b-4760-a0eb-9ba44fe8fa3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:01.622263 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa9ed5ed-0e5b-4760-a0eb-9ba44fe8fa3f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 2958 microversion: 2.42 time: 0.998682 Aug 09 14:51:01.623255 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2023/4061] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:00 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 2958 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:01.978750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c39140f-50b4-4554-a824-65be00590245 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:01.989635 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c39140f-50b4-4554-a824-65be00590245 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1315 microversion: 2.1 time: 0.529564 Aug 09 14:51:02.004638 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2039/4062] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:01 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:02.486054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-877ade64-0a44-4585-a609-63313f89730a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:02.486739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-877ade64-0a44-4585-a609-63313f89730a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:02.498758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-877ade64-0a44-4585-a609-63313f89730a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:02.499597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-877ade64-0a44-4585-a609-63313f89730a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:02.500574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-877ade64-0a44-4585-a609-63313f89730a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:02.501302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-877ade64-0a44-4585-a609-63313f89730a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:02.501779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-877ade64-0a44-4585-a609-63313f89730a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:02.502387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-877ade64-0a44-4585-a609-63313f89730a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:02.651579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-38f80f0f-115a-4685-9aa1-1a7a2d16146f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:02.652865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-38f80f0f-115a-4685-9aa1-1a7a2d16146f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:02.661258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38f80f0f-115a-4685-9aa1-1a7a2d16146f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:02.661766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38f80f0f-115a-4685-9aa1-1a7a2d16146f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:02.662210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38f80f0f-115a-4685-9aa1-1a7a2d16146f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:02.662952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38f80f0f-115a-4685-9aa1-1a7a2d16146f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:02.663426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38f80f0f-115a-4685-9aa1-1a7a2d16146f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:02.664017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38f80f0f-115a-4685-9aa1-1a7a2d16146f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:03.190744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-877ade64-0a44-4585-a609-63313f89730a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:03.202630 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-877ade64-0a44-4585-a609-63313f89730a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.723624 Aug 09 14:51:03.204694 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2024/4063] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:02 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:03.223833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b883aaab-cce8-46e7-9144-c27977e730ff tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:03.225267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b883aaab-cce8-46e7-9144-c27977e730ff tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:03.237315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=72 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:03.240909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b883aaab-cce8-46e7-9144-c27977e730ff tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:03.242733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b883aaab-cce8-46e7-9144-c27977e730ff tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:03.243752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b883aaab-cce8-46e7-9144-c27977e730ff tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:03.244805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b883aaab-cce8-46e7-9144-c27977e730ff tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:03.245198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b883aaab-cce8-46e7-9144-c27977e730ff tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:03.245701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b883aaab-cce8-46e7-9144-c27977e730ff tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:03.451031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-38f80f0f-115a-4685-9aa1-1a7a2d16146f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:03.469112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-38f80f0f-115a-4685-9aa1-1a7a2d16146f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:03.471330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-38f80f0f-115a-4685-9aa1-1a7a2d16146f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:03.473538 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-38f80f0f-115a-4685-9aa1-1a7a2d16146f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 2958 microversion: 2.42 time: 0.826008 Aug 09 14:51:03.488878 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2040/4064] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:02 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 2958 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:03.636952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b883aaab-cce8-46e7-9144-c27977e730ff tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:03.647598 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b883aaab-cce8-46e7-9144-c27977e730ff tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1502 microversion: 2.1 time: 0.440319 Aug 09 14:51:03.648610 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2025/4065] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:03 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1502 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:03.668916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee3df2b0-0a59-4cbd-9dac-d8dc5d722683 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:03.675877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee3df2b0-0a59-4cbd-9dac-d8dc5d722683 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:03.676487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee3df2b0-0a59-4cbd-9dac-d8dc5d722683 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:03.676940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee3df2b0-0a59-4cbd-9dac-d8dc5d722683 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:03.703651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee3df2b0-0a59-4cbd-9dac-d8dc5d722683 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Going to try to stop instance {{(pid=119407) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 14:51:03.772886 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee3df2b0-0a59-4cbd-9dac-d8dc5d722683 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "POST /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3/action" status: 202 len: 0 microversion: 2.1 time: 0.108147 Aug 09 14:51:03.773640 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2041/4066] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:51:03 2022] POST /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:51:03.782789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-562a878c-e7a5-4b49-885f-d14ed57d31cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:03.784828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-562a878c-e7a5-4b49-885f-d14ed57d31cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:03.807873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-562a878c-e7a5-4b49-885f-d14ed57d31cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:03.808393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-562a878c-e7a5-4b49-885f-d14ed57d31cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:03.811144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-562a878c-e7a5-4b49-885f-d14ed57d31cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:03.812846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-562a878c-e7a5-4b49-885f-d14ed57d31cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:03.813424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-562a878c-e7a5-4b49-885f-d14ed57d31cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:03.813961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-562a878c-e7a5-4b49-885f-d14ed57d31cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:04.218504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-562a878c-e7a5-4b49-885f-d14ed57d31cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:04.228820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d06291af-84e0-4f79-828a-3f98a8450165 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:04.229764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d06291af-84e0-4f79-828a-3f98a8450165 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:04.242052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d06291af-84e0-4f79-828a-3f98a8450165 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:04.244995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d06291af-84e0-4f79-828a-3f98a8450165 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:04.245989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d06291af-84e0-4f79-828a-3f98a8450165 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:04.246813 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-562a878c-e7a5-4b49-885f-d14ed57d31cb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.468356 Aug 09 14:51:04.248350 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2026/4067] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:03 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:04.252234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d06291af-84e0-4f79-828a-3f98a8450165 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:04.253261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d06291af-84e0-4f79-828a-3f98a8450165 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:04.254153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d06291af-84e0-4f79-828a-3f98a8450165 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:04.502113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb8a6f45-8ab3-4eeb-88be-d03717c7b995 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:04.502731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eb8a6f45-8ab3-4eeb-88be-d03717c7b995 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:04.516165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb8a6f45-8ab3-4eeb-88be-d03717c7b995 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:04.517001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb8a6f45-8ab3-4eeb-88be-d03717c7b995 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:04.517855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb8a6f45-8ab3-4eeb-88be-d03717c7b995 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:04.518830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb8a6f45-8ab3-4eeb-88be-d03717c7b995 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:04.519892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb8a6f45-8ab3-4eeb-88be-d03717c7b995 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:04.521310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb8a6f45-8ab3-4eeb-88be-d03717c7b995 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:05.140240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d06291af-84e0-4f79-828a-3f98a8450165 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:05.153415 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d06291af-84e0-4f79-828a-3f98a8450165 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.927250 Aug 09 14:51:05.167013 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2042/4068] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:04 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:05.278997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-26b344a3-abeb-4e8a-af79-fe89437418eb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:05.280136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-26b344a3-abeb-4e8a-af79-fe89437418eb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:05.292099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26b344a3-abeb-4e8a-af79-fe89437418eb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:05.292888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26b344a3-abeb-4e8a-af79-fe89437418eb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:05.294237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26b344a3-abeb-4e8a-af79-fe89437418eb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:05.301573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26b344a3-abeb-4e8a-af79-fe89437418eb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:05.303490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26b344a3-abeb-4e8a-af79-fe89437418eb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:05.310502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26b344a3-abeb-4e8a-af79-fe89437418eb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:06.039058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-26b344a3-abeb-4e8a-af79-fe89437418eb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:06.049390 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-26b344a3-abeb-4e8a-af79-fe89437418eb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.776642 Aug 09 14:51:06.051849 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2043/4069] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:05 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:51:06.057083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5da6411f-5b01-4e04-878c-bcf06a99f26c req-c8a81c92-d311-43da-b183-ed8ea498eb3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-unplugged", "status": "completed", "tag": "57a05dd9-1f79-490b-9377-d421d6b2c674"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:06.079005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb8a6f45-8ab3-4eeb-88be-d03717c7b995 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:06.091878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb8a6f45-8ab3-4eeb-88be-d03717c7b995 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:06.093755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb8a6f45-8ab3-4eeb-88be-d03717c7b995 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:06.095472 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb8a6f45-8ab3-4eeb-88be-d03717c7b995 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 2958 microversion: 2.42 time: 1.597582 Aug 09 14:51:06.109547 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2027/4070] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:04 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 2958 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:06.113517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5da6411f-5b01-4e04-878c-bcf06a99f26c req-c8a81c92-d311-43da-b183-ed8ea498eb3c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:06.113841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5da6411f-5b01-4e04-878c-bcf06a99f26c req-c8a81c92-d311-43da-b183-ed8ea498eb3c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:06.114488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5da6411f-5b01-4e04-878c-bcf06a99f26c req-c8a81c92-d311-43da-b183-ed8ea498eb3c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:06.149433 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5da6411f-5b01-4e04-878c-bcf06a99f26c req-c8a81c92-d311-43da-b183-ed8ea498eb3c service nova] Creating event network-vif-unplugged:57a05dd9-1f79-490b-9377-d421d6b2c674 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:51:06.166321 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5da6411f-5b01-4e04-878c-bcf06a99f26c req-c8a81c92-d311-43da-b183-ed8ea498eb3c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110566 Aug 09 14:51:06.168755 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2044/4071] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:06.175016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0cc3e47-f6d9-4be7-9dba-a127d8cc4a92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:06.175902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0cc3e47-f6d9-4be7-9dba-a127d8cc4a92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:06.189105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0cc3e47-f6d9-4be7-9dba-a127d8cc4a92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:06.189905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0cc3e47-f6d9-4be7-9dba-a127d8cc4a92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:06.190619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0cc3e47-f6d9-4be7-9dba-a127d8cc4a92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:06.191611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0cc3e47-f6d9-4be7-9dba-a127d8cc4a92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:06.195965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0cc3e47-f6d9-4be7-9dba-a127d8cc4a92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:06.196860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0cc3e47-f6d9-4be7-9dba-a127d8cc4a92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:07.074651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f0fb3f8-be7b-4b55-8c81-5252b5816bd6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:07.075804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7f0fb3f8-be7b-4b55-8c81-5252b5816bd6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:07.087768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f0fb3f8-be7b-4b55-8c81-5252b5816bd6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:07.090841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f0fb3f8-be7b-4b55-8c81-5252b5816bd6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:07.091702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f0fb3f8-be7b-4b55-8c81-5252b5816bd6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:07.095584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f0fb3f8-be7b-4b55-8c81-5252b5816bd6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:07.096889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f0fb3f8-be7b-4b55-8c81-5252b5816bd6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:07.097497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f0fb3f8-be7b-4b55-8c81-5252b5816bd6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:07.214649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0cc3e47-f6d9-4be7-9dba-a127d8cc4a92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:07.226312 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0cc3e47-f6d9-4be7-9dba-a127d8cc4a92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 1.056058 Aug 09 14:51:07.229817 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2028/4072] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:06 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:07.238282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d188ec1a-b115-4cef-a449-5dd5869a9656 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:07.244877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d188ec1a-b115-4cef-a449-5dd5869a9656 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:07.259871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d188ec1a-b115-4cef-a449-5dd5869a9656 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:07.263882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d188ec1a-b115-4cef-a449-5dd5869a9656 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:07.264929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d188ec1a-b115-4cef-a449-5dd5869a9656 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:07.268491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d188ec1a-b115-4cef-a449-5dd5869a9656 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:07.278787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d188ec1a-b115-4cef-a449-5dd5869a9656 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:07.279633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d188ec1a-b115-4cef-a449-5dd5869a9656 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:07.791043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7f0fb3f8-be7b-4b55-8c81-5252b5816bd6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:07.806813 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7f0fb3f8-be7b-4b55-8c81-5252b5816bd6 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.736719 Aug 09 14:51:07.809428 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2045/4073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:07 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:51:07.826176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afa6833d-031e-436c-9346-df831b610d92 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Action: 'create', calling method: .version_select at 0x7f41dd666af0>, body: {"keypair": {"name": "tempest-keypair-1319263904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLDksmgjSU9D0s4fEONNgdT0nhiPCQzgZhFMKrERRILKIOzLwwMD/55B9JehUTqrxRhgo4bISFIvq1hC2GVesa+FwhDHLfOTAoXb+BKV4aHlVyXvIrjD2HUZxhh33OKVQ=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:07.863679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d188ec1a-b115-4cef-a449-5dd5869a9656 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:07.880279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-afa6833d-031e-436c-9346-df831b610d92 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Getting quotas for project ea6c164a34094b61a233eb90f5826bdb. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:51:07.882835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d188ec1a-b115-4cef-a449-5dd5869a9656 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:07.889435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d188ec1a-b115-4cef-a449-5dd5869a9656 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:07.898942 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d188ec1a-b115-4cef-a449-5dd5869a9656 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 2916 microversion: 2.42 time: 0.665276 Aug 09 14:51:07.916034 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2029/4074] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:07 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 2916 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:07.917937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-afa6833d-031e-436c-9346-df831b610d92 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Getting quotas for user e8811057cd0b41f8b19133f759c51fa6 and project ea6c164a34094b61a233eb90f5826bdb. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:51:07.972961 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afa6833d-031e-436c-9346-df831b610d92 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.163460 Aug 09 14:51:07.983552 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2046/4075] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 9 14:51:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 14:51:08.255922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5f979225-82df-4ce8-b714-0129b6d6f16e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:08.256559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5f979225-82df-4ce8-b714-0129b6d6f16e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:08.259365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-1dd5d3a1-7969-438e-9130-ed0277945d85 req-35feb682-14e7-4696-9acc-d14beac78c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-unplugged", "status": "completed", "tag": "b584a69e-d71b-4c4f-80e9-ed537e73ff17"}, {"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-unplugged", "status": "completed", "tag": "e630072b-3881-4138-9288-6963597d3178"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:08.273117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f979225-82df-4ce8-b714-0129b6d6f16e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:08.273631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f979225-82df-4ce8-b714-0129b6d6f16e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:08.274122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f979225-82df-4ce8-b714-0129b6d6f16e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:08.274854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f979225-82df-4ce8-b714-0129b6d6f16e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:08.275336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f979225-82df-4ce8-b714-0129b6d6f16e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:08.275763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f979225-82df-4ce8-b714-0129b6d6f16e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:08.295421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1dd5d3a1-7969-438e-9130-ed0277945d85 req-35feb682-14e7-4696-9acc-d14beac78c5c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:08.295421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1dd5d3a1-7969-438e-9130-ed0277945d85 req-35feb682-14e7-4696-9acc-d14beac78c5c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:08.299490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1dd5d3a1-7969-438e-9130-ed0277945d85 req-35feb682-14e7-4696-9acc-d14beac78c5c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:08.333853 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1dd5d3a1-7969-438e-9130-ed0277945d85 req-35feb682-14e7-4696-9acc-d14beac78c5c service nova] Creating event network-vif-unplugged:b584a69e-d71b-4c4f-80e9-ed537e73ff17 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:51:08.335783 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1dd5d3a1-7969-438e-9130-ed0277945d85 req-35feb682-14e7-4696-9acc-d14beac78c5c service nova] Creating event network-vif-unplugged:e630072b-3881-4138-9288-6963597d3178 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:51:08.364106 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-1dd5d3a1-7969-438e-9130-ed0277945d85 req-35feb682-14e7-4696-9acc-d14beac78c5c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.110580 Aug 09 14:51:08.365157 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2047/4076] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:08.782933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f979225-82df-4ce8-b714-0129b6d6f16e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:08.796706 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5f979225-82df-4ce8-b714-0129b6d6f16e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.550664 Aug 09 14:51:08.797450 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2030/4077] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:08 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:08.831878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2902961-6df4-44a8-9a94-314b50aca6af tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:08.832743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c2902961-6df4-44a8-9a94-314b50aca6af tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:08.851026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2902961-6df4-44a8-9a94-314b50aca6af tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:08.851708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2902961-6df4-44a8-9a94-314b50aca6af tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:08.853560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2902961-6df4-44a8-9a94-314b50aca6af tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:08.856648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2902961-6df4-44a8-9a94-314b50aca6af tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:08.863660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2902961-6df4-44a8-9a94-314b50aca6af tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:08.866395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2902961-6df4-44a8-9a94-314b50aca6af tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:08.929626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-46e2d6e6-8dbf-47d4-aad1-d0ff8ce1fc4b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:08.930293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-46e2d6e6-8dbf-47d4-aad1-d0ff8ce1fc4b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:08.938767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46e2d6e6-8dbf-47d4-aad1-d0ff8ce1fc4b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:08.942442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46e2d6e6-8dbf-47d4-aad1-d0ff8ce1fc4b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:08.943110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46e2d6e6-8dbf-47d4-aad1-d0ff8ce1fc4b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:08.943922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46e2d6e6-8dbf-47d4-aad1-d0ff8ce1fc4b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:08.944378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46e2d6e6-8dbf-47d4-aad1-d0ff8ce1fc4b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:08.944808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46e2d6e6-8dbf-47d4-aad1-d0ff8ce1fc4b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:09.628788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2902961-6df4-44a8-9a94-314b50aca6af tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:09.638763 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2902961-6df4-44a8-9a94-314b50aca6af tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.813416 Aug 09 14:51:09.652529 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2048/4078] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:08 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:09.821341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bbdeaea7-797e-4bf8-8662-1e303cde37ee tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:09.826409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bbdeaea7-797e-4bf8-8662-1e303cde37ee tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:09.833198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbdeaea7-797e-4bf8-8662-1e303cde37ee tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:09.834488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbdeaea7-797e-4bf8-8662-1e303cde37ee tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:09.835380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbdeaea7-797e-4bf8-8662-1e303cde37ee tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:09.839841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbdeaea7-797e-4bf8-8662-1e303cde37ee tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:09.841164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbdeaea7-797e-4bf8-8662-1e303cde37ee tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:09.841856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bbdeaea7-797e-4bf8-8662-1e303cde37ee tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:09.843222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46e2d6e6-8dbf-47d4-aad1-d0ff8ce1fc4b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:09.860762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46e2d6e6-8dbf-47d4-aad1-d0ff8ce1fc4b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:09.862794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46e2d6e6-8dbf-47d4-aad1-d0ff8ce1fc4b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:09.867800 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-46e2d6e6-8dbf-47d4-aad1-d0ff8ce1fc4b tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 2916 microversion: 2.42 time: 0.942015 Aug 09 14:51:09.879130 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2031/4079] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:08 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 2916 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:10.395883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-93a4e543-cf6a-43f9-a848-cb1a2655f8ff req-010f2a7e-6ad8-4fd6-845d-9cdf834e1f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-unplugged", "status": "completed", "tag": "bef1c2ab-48c1-4197-be01-418d835b0f52"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:10.404763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bbdeaea7-797e-4bf8-8662-1e303cde37ee tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:10.418934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-93a4e543-cf6a-43f9-a848-cb1a2655f8ff req-010f2a7e-6ad8-4fd6-845d-9cdf834e1f7a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:10.419474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-93a4e543-cf6a-43f9-a848-cb1a2655f8ff req-010f2a7e-6ad8-4fd6-845d-9cdf834e1f7a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:10.420146 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bbdeaea7-797e-4bf8-8662-1e303cde37ee tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.603461 Aug 09 14:51:10.420734 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2049/4080] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:09 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:10.421315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-93a4e543-cf6a-43f9-a848-cb1a2655f8ff req-010f2a7e-6ad8-4fd6-845d-9cdf834e1f7a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:10.450512 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-93a4e543-cf6a-43f9-a848-cb1a2655f8ff req-010f2a7e-6ad8-4fd6-845d-9cdf834e1f7a service nova] Creating event network-vif-unplugged:bef1c2ab-48c1-4197-be01-418d835b0f52 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:51:10.464935 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-93a4e543-cf6a-43f9-a848-cb1a2655f8ff req-010f2a7e-6ad8-4fd6-845d-9cdf834e1f7a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073548 Aug 09 14:51:10.466191 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2032/4081] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:51:10.684386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-897375c3-0a22-4f91-95e3-749ce11ee641 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:10.685123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-897375c3-0a22-4f91-95e3-749ce11ee641 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:10.705674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-897375c3-0a22-4f91-95e3-749ce11ee641 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:10.707390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-897375c3-0a22-4f91-95e3-749ce11ee641 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:10.707849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-897375c3-0a22-4f91-95e3-749ce11ee641 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:10.711794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-897375c3-0a22-4f91-95e3-749ce11ee641 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:10.712311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-897375c3-0a22-4f91-95e3-749ce11ee641 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:10.712792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-897375c3-0a22-4f91-95e3-749ce11ee641 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:10.937115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ef0f887b-63ec-418c-881d-1a3659b29055 req-7f920bcc-a460-43ee-b615-314e14085c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-deleted", "tag": "e7aebd18-0445-48e5-9830-d801f5f45d18"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:10.956451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ef0f887b-63ec-418c-881d-1a3659b29055 req-7f920bcc-a460-43ee-b615-314e14085c54 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:10.957172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ef0f887b-63ec-418c-881d-1a3659b29055 req-7f920bcc-a460-43ee-b615-314e14085c54 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:10.958175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ef0f887b-63ec-418c-881d-1a3659b29055 req-7f920bcc-a460-43ee-b615-314e14085c54 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:10.984578 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ef0f887b-63ec-418c-881d-1a3659b29055 req-7f920bcc-a460-43ee-b615-314e14085c54 service nova] Creating event network-vif-deleted:e7aebd18-0445-48e5-9830-d801f5f45d18 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:51:10.992447 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ef0f887b-63ec-418c-881d-1a3659b29055 req-7f920bcc-a460-43ee-b615-314e14085c54 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.391418 Aug 09 14:51:10.993651 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2050/4082] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:11.001100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ba4f899-da88-4ddf-a587-fdaa72c2d452 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:11.002232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ba4f899-da88-4ddf-a587-fdaa72c2d452 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:11.013361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba4f899-da88-4ddf-a587-fdaa72c2d452 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:11.014072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba4f899-da88-4ddf-a587-fdaa72c2d452 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:11.014654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba4f899-da88-4ddf-a587-fdaa72c2d452 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:11.015556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba4f899-da88-4ddf-a587-fdaa72c2d452 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:11.016346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba4f899-da88-4ddf-a587-fdaa72c2d452 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:11.016916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba4f899-da88-4ddf-a587-fdaa72c2d452 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:11.048842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:11.857046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ba4f899-da88-4ddf-a587-fdaa72c2d452 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:11.872281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ba4f899-da88-4ddf-a587-fdaa72c2d452 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:11.874069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ba4f899-da88-4ddf-a587-fdaa72c2d452 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:11.878459 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ba4f899-da88-4ddf-a587-fdaa72c2d452 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 2870 microversion: 2.42 time: 0.883463 Aug 09 14:51:11.880963 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2051/4083] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:10 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 2870 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:11.893287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5689869f-aba8-4cf8-8e33-2423731417b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:11.896272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5689869f-aba8-4cf8-8e33-2423731417b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:11.916108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5689869f-aba8-4cf8-8e33-2423731417b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:11.916625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5689869f-aba8-4cf8-8e33-2423731417b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:11.921449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5689869f-aba8-4cf8-8e33-2423731417b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:11.922239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5689869f-aba8-4cf8-8e33-2423731417b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:11.922734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5689869f-aba8-4cf8-8e33-2423731417b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:11.927167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5689869f-aba8-4cf8-8e33-2423731417b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:11.931600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-897375c3-0a22-4f91-95e3-749ce11ee641 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:11.946030 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-897375c3-0a22-4f91-95e3-749ce11ee641 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 1.271727 Aug 09 14:51:11.946901 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2033/4084] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:10 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:12.503804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5689869f-aba8-4cf8-8e33-2423731417b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:12.516645 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5689869f-aba8-4cf8-8e33-2423731417b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.634092 Aug 09 14:51:12.530111 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2052/4085] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:11 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:12.918931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bdb22fdb-1e98-461d-a93f-451be87e3564 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:12.919031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bdb22fdb-1e98-461d-a93f-451be87e3564 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:12.928551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdb22fdb-1e98-461d-a93f-451be87e3564 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:12.929640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdb22fdb-1e98-461d-a93f-451be87e3564 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:12.930201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdb22fdb-1e98-461d-a93f-451be87e3564 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:12.934741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdb22fdb-1e98-461d-a93f-451be87e3564 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:12.936447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdb22fdb-1e98-461d-a93f-451be87e3564 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:12.936930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bdb22fdb-1e98-461d-a93f-451be87e3564 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:12.974347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-47f883aa-85ee-4da8-9b08-f4bdfad3d1d9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:12.978312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-47f883aa-85ee-4da8-9b08-f4bdfad3d1d9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:12.991228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47f883aa-85ee-4da8-9b08-f4bdfad3d1d9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:12.992951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47f883aa-85ee-4da8-9b08-f4bdfad3d1d9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:12.993623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47f883aa-85ee-4da8-9b08-f4bdfad3d1d9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:12.998855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47f883aa-85ee-4da8-9b08-f4bdfad3d1d9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:12.999555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47f883aa-85ee-4da8-9b08-f4bdfad3d1d9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:13.000181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47f883aa-85ee-4da8-9b08-f4bdfad3d1d9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:13.502312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bdb22fdb-1e98-461d-a93f-451be87e3564 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:13.520189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bdb22fdb-1e98-461d-a93f-451be87e3564 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:13.525761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bdb22fdb-1e98-461d-a93f-451be87e3564 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:13.529380 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bdb22fdb-1e98-461d-a93f-451be87e3564 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 2533 microversion: 2.42 time: 0.622741 Aug 09 14:51:13.531113 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2034/4086] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:12 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 2533 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:13.540746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-2305ef74-3133-4665-94ae-5da5e7879e22 req-e28131bb-837f-4dc7-bc6d-80b0218ae8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-deleted", "tag": "57a05dd9-1f79-490b-9377-d421d6b2c674"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:13.564228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2305ef74-3133-4665-94ae-5da5e7879e22 req-e28131bb-837f-4dc7-bc6d-80b0218ae8b1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:13.566240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2305ef74-3133-4665-94ae-5da5e7879e22 req-e28131bb-837f-4dc7-bc6d-80b0218ae8b1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:13.567667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2305ef74-3133-4665-94ae-5da5e7879e22 req-e28131bb-837f-4dc7-bc6d-80b0218ae8b1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:13.606026 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-2305ef74-3133-4665-94ae-5da5e7879e22 req-e28131bb-837f-4dc7-bc6d-80b0218ae8b1 service nova] Creating event network-vif-deleted:57a05dd9-1f79-490b-9377-d421d6b2c674 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:51:13.618733 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-2305ef74-3133-4665-94ae-5da5e7879e22 req-e28131bb-837f-4dc7-bc6d-80b0218ae8b1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085001 Aug 09 14:51:13.621440 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2035/4087] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:13.630579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c8648d1-3ee7-4d26-944c-5a74e43ae9dc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:13.631737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c8648d1-3ee7-4d26-944c-5a74e43ae9dc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:13.641244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c8648d1-3ee7-4d26-944c-5a74e43ae9dc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:13.644777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c8648d1-3ee7-4d26-944c-5a74e43ae9dc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:13.652990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c8648d1-3ee7-4d26-944c-5a74e43ae9dc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:13.668599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c8648d1-3ee7-4d26-944c-5a74e43ae9dc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:13.669418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c8648d1-3ee7-4d26-944c-5a74e43ae9dc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:13.669870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c8648d1-3ee7-4d26-944c-5a74e43ae9dc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:13.684312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-47f883aa-85ee-4da8-9b08-f4bdfad3d1d9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:13.699332 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-47f883aa-85ee-4da8-9b08-f4bdfad3d1d9 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.733437 Aug 09 14:51:13.710728 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2053/4088] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:12 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:13.719004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c6189529-0b61-4506-8258-30273f1f569d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:13.719580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c6189529-0b61-4506-8258-30273f1f569d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:13.749650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6189529-0b61-4506-8258-30273f1f569d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:13.750167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6189529-0b61-4506-8258-30273f1f569d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:13.750705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6189529-0b61-4506-8258-30273f1f569d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:13.751418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6189529-0b61-4506-8258-30273f1f569d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:13.753962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6189529-0b61-4506-8258-30273f1f569d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:13.759815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6189529-0b61-4506-8258-30273f1f569d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:13.824093 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c6189529-0b61-4506-8258-30273f1f569d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments/92fd0b8b-93a4-43b9-addd-8fa75302226b" status: 200 len: 194 microversion: 2.20 time: 0.111811 Aug 09 14:51:13.825008 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2054/4089] 10.222.0.50 () {60 vars in 1454 bytes} [Tue Aug 9 14:51:13 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments/92fd0b8b-93a4-43b9-addd-8fa75302226b => generated 194 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:51:14.037179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-73a66696-1c3b-466d-8490-b4f343edaa83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:14.037703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-73a66696-1c3b-466d-8490-b4f343edaa83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:14.048069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73a66696-1c3b-466d-8490-b4f343edaa83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:14.048815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73a66696-1c3b-466d-8490-b4f343edaa83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:14.049437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73a66696-1c3b-466d-8490-b4f343edaa83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:14.050344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73a66696-1c3b-466d-8490-b4f343edaa83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:14.053419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73a66696-1c3b-466d-8490-b4f343edaa83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:14.054447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73a66696-1c3b-466d-8490-b4f343edaa83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:14.113521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c8648d1-3ee7-4d26-944c-5a74e43ae9dc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:14.144373 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c8648d1-3ee7-4d26-944c-5a74e43ae9dc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.521415 Aug 09 14:51:14.146132 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2036/4090] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:13 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:14.319124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-73a66696-1c3b-466d-8490-b4f343edaa83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lazy-loading 'services' on Instance uuid c25a9384-ba3d-4ff8-8f2a-39ccdde0690a {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:51:14.442112 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-73a66696-1c3b-466d-8490-b4f343edaa83 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments/92fd0b8b-93a4-43b9-addd-8fa75302226b" status: 202 len: 0 microversion: 2.20 time: 0.432996 Aug 09 14:51:14.443120 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2055/4091] 10.222.0.50 () {60 vars in 1457 bytes} [Tue Aug 9 14:51:14 2022] DELETE /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments/92fd0b8b-93a4-43b9-addd-8fa75302226b => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:51:14.452745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40491879-d91b-4297-9182-3aceb758d681 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:14.464372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40491879-d91b-4297-9182-3aceb758d681 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:14.477976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40491879-d91b-4297-9182-3aceb758d681 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:14.484038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40491879-d91b-4297-9182-3aceb758d681 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:14.484618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40491879-d91b-4297-9182-3aceb758d681 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:14.489757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-641390241", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "af01f8a5-2e4c-4398-b5a7-6c2879db985d"}, {"port": "7256ee05-5624-4366-8ab1-5a16dfac3445", "tag": "port-1"}, {"port": "22a7aaf5-6350-415b-823f-52781cbb73ee", "tag": "port-2"}, {"uuid": "20ae5f1d-293f-4de7-b09e-2d2b90b9b26c", "tag": "net-1"}, {"uuid": "20ae5f1d-293f-4de7-b09e-2d2b90b9b26c"}, {"uuid": "f2b9c1ee-51b7-41e4-a167-0871dd998295", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f2b9c1ee-51b7-41e4-a167-0871dd998295", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4840b8f9-bcc6-4eaa-a966-9e7628478ab3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "aeb93732-5709-4bd5-9ac0-af5a80c6b89e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "017c4d78-e1b7-4ff1-98ff-c546ec3b420d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--663630328"}], "key_name": "tempest-keypair-1319263904", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:14.491714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40491879-d91b-4297-9182-3aceb758d681 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:14.492433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40491879-d91b-4297-9182-3aceb758d681 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:14.493118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40491879-d91b-4297-9182-3aceb758d681 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:14.541752 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40491879-d91b-4297-9182-3aceb758d681 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093139 Aug 09 14:51:14.543868 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2037/4092] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:51:14 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:51:14.566200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e916f74-31f0-4fcc-984a-f90686b74b41 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:14.568319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8e916f74-31f0-4fcc-984a-f90686b74b41 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:14.580932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e916f74-31f0-4fcc-984a-f90686b74b41 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:14.585330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e916f74-31f0-4fcc-984a-f90686b74b41 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:14.585940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e916f74-31f0-4fcc-984a-f90686b74b41 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:14.587896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e916f74-31f0-4fcc-984a-f90686b74b41 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:14.588558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e916f74-31f0-4fcc-984a-f90686b74b41 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:14.590286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e916f74-31f0-4fcc-984a-f90686b74b41 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:14.779246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] validate_networks() for [('af01f8a5-2e4c-4398-b5a7-6c2879db985d', None, None, None, None, None), (None, None, '7256ee05-5624-4366-8ab1-5a16dfac3445', None, None, None), (None, None, '22a7aaf5-6350-415b-823f-52781cbb73ee', None, None, None), ('20ae5f1d-293f-4de7-b09e-2d2b90b9b26c', None, None, None, None, None), ('20ae5f1d-293f-4de7-b09e-2d2b90b9b26c', None, None, None, None, None), ('f2b9c1ee-51b7-41e4-a167-0871dd998295', '10.2.2.100', None, None, None, None), ('f2b9c1ee-51b7-41e4-a167-0871dd998295', '10.2.2.200', None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:51:15.141703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e916f74-31f0-4fcc-984a-f90686b74b41 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:15.157016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e916f74-31f0-4fcc-984a-f90686b74b41 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:15.163948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e916f74-31f0-4fcc-984a-f90686b74b41 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:15.166193 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e916f74-31f0-4fcc-984a-f90686b74b41 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 2373 microversion: 2.42 time: 0.610837 Aug 09 14:51:15.167262 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2038/4093] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:14 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 2373 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:15.178664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b854ec11-4506-4c96-8830-232dc0e2111d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:15.179671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b854ec11-4506-4c96-8830-232dc0e2111d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:15.197063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b854ec11-4506-4c96-8830-232dc0e2111d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:15.197918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b854ec11-4506-4c96-8830-232dc0e2111d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:15.198594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b854ec11-4506-4c96-8830-232dc0e2111d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:15.200788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b854ec11-4506-4c96-8830-232dc0e2111d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:15.204686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b854ec11-4506-4c96-8830-232dc0e2111d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:15.204686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b854ec11-4506-4c96-8830-232dc0e2111d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:15.639633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b854ec11-4506-4c96-8830-232dc0e2111d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:15.653159 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b854ec11-4506-4c96-8830-232dc0e2111d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.481636 Aug 09 14:51:15.653796 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2039/4094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:15 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:15.668613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-409be46d-8aff-46ab-8112-b18c9a5107b7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:15.669561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-409be46d-8aff-46ab-8112-b18c9a5107b7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:15.692037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409be46d-8aff-46ab-8112-b18c9a5107b7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:15.695057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409be46d-8aff-46ab-8112-b18c9a5107b7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:15.696304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409be46d-8aff-46ab-8112-b18c9a5107b7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:15.699737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409be46d-8aff-46ab-8112-b18c9a5107b7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:15.702667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409be46d-8aff-46ab-8112-b18c9a5107b7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:15.704124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-409be46d-8aff-46ab-8112-b18c9a5107b7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:16.287364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-409be46d-8aff-46ab-8112-b18c9a5107b7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:16.291077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:16.310519 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-409be46d-8aff-46ab-8112-b18c9a5107b7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.652408 Aug 09 14:51:16.314926 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2040/4095] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:15 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:16.344120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e7153755-0ba3-401e-89f0-fb62e8b3bb06 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:16.348988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e7153755-0ba3-401e-89f0-fb62e8b3bb06 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:16.364312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7153755-0ba3-401e-89f0-fb62e8b3bb06 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:16.366700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7153755-0ba3-401e-89f0-fb62e8b3bb06 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:16.367342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7153755-0ba3-401e-89f0-fb62e8b3bb06 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:16.368496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7153755-0ba3-401e-89f0-fb62e8b3bb06 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:16.371415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7153755-0ba3-401e-89f0-fb62e8b3bb06 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:16.371928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7153755-0ba3-401e-89f0-fb62e8b3bb06 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:16.453567 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e7153755-0ba3-401e-89f0-fb62e8b3bb06 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.136531 Aug 09 14:51:16.454244 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2041/4096] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:51:16 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:51:16.458642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-6d5edc34-cc50-4ef2-90cb-776294ab17c3 req-bc3dbfd0-b626-4f5a-9aa9-3f2d577128fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-deleted", "tag": "b584a69e-d71b-4c4f-80e9-ed537e73ff17"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:16.485459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6d5edc34-cc50-4ef2-90cb-776294ab17c3 req-bc3dbfd0-b626-4f5a-9aa9-3f2d577128fc service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:16.488864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6d5edc34-cc50-4ef2-90cb-776294ab17c3 req-bc3dbfd0-b626-4f5a-9aa9-3f2d577128fc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:16.489484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6d5edc34-cc50-4ef2-90cb-776294ab17c3 req-bc3dbfd0-b626-4f5a-9aa9-3f2d577128fc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:16.522938 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-6d5edc34-cc50-4ef2-90cb-776294ab17c3 req-bc3dbfd0-b626-4f5a-9aa9-3f2d577128fc service nova] Creating event network-vif-deleted:b584a69e-d71b-4c4f-80e9-ed537e73ff17 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:51:16.537926 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-6d5edc34-cc50-4ef2-90cb-776294ab17c3 req-bc3dbfd0-b626-4f5a-9aa9-3f2d577128fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078365 Aug 09 14:51:16.540063 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2042/4097] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:16.553743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39ec9019-96ea-43ab-86f0-e65c151ef753 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:16.555033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39ec9019-96ea-43ab-86f0-e65c151ef753 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:16.577280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39ec9019-96ea-43ab-86f0-e65c151ef753 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:16.578069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39ec9019-96ea-43ab-86f0-e65c151ef753 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:16.586709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39ec9019-96ea-43ab-86f0-e65c151ef753 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:16.590285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39ec9019-96ea-43ab-86f0-e65c151ef753 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:16.592676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39ec9019-96ea-43ab-86f0-e65c151ef753 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:16.593208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39ec9019-96ea-43ab-86f0-e65c151ef753 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:17.000881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-39ec9019-96ea-43ab-86f0-e65c151ef753 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:17.017214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-39ec9019-96ea-43ab-86f0-e65c151ef753 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:17.024380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-39ec9019-96ea-43ab-86f0-e65c151ef753 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:17.025929 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39ec9019-96ea-43ab-86f0-e65c151ef753 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 2169 microversion: 2.42 time: 0.483495 Aug 09 14:51:17.026708 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2043/4098] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:16 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 2169 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:17.049229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df82b60c-829a-4c89-a060-0afeb0da45e5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:17.055940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-df82b60c-829a-4c89-a060-0afeb0da45e5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:17.072316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df82b60c-829a-4c89-a060-0afeb0da45e5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:17.074150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df82b60c-829a-4c89-a060-0afeb0da45e5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:17.076180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df82b60c-829a-4c89-a060-0afeb0da45e5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:17.080210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df82b60c-829a-4c89-a060-0afeb0da45e5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:17.080725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df82b60c-829a-4c89-a060-0afeb0da45e5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:17.081164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df82b60c-829a-4c89-a060-0afeb0da45e5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:17.930891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:17.973769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-df82b60c-829a-4c89-a060-0afeb0da45e5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:17.989116 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-df82b60c-829a-4c89-a060-0afeb0da45e5 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.944636 Aug 09 14:51:17.991849 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2044/4099] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:17 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:18.006287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0026108-a9a0-4e41-8481-1c49a1190de5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:18.007950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0026108-a9a0-4e41-8481-1c49a1190de5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:18.023404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0026108-a9a0-4e41-8481-1c49a1190de5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:18.025240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0026108-a9a0-4e41-8481-1c49a1190de5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:18.026275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0026108-a9a0-4e41-8481-1c49a1190de5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:18.028054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0026108-a9a0-4e41-8481-1c49a1190de5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:18.030402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0026108-a9a0-4e41-8481-1c49a1190de5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:18.031191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0026108-a9a0-4e41-8481-1c49a1190de5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:18.558024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0026108-a9a0-4e41-8481-1c49a1190de5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:18.566862 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0026108-a9a0-4e41-8481-1c49a1190de5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.573034 Aug 09 14:51:18.583750 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2045/4100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:17 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:18.599305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-faaf99d7-81be-46e8-a49d-5eeda93deaaa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:18.602071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-faaf99d7-81be-46e8-a49d-5eeda93deaaa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:18.619610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-faaf99d7-81be-46e8-a49d-5eeda93deaaa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:18.620243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-faaf99d7-81be-46e8-a49d-5eeda93deaaa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:18.620776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-faaf99d7-81be-46e8-a49d-5eeda93deaaa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:18.621641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-faaf99d7-81be-46e8-a49d-5eeda93deaaa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:18.623666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-faaf99d7-81be-46e8-a49d-5eeda93deaaa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:18.624275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-faaf99d7-81be-46e8-a49d-5eeda93deaaa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:18.665561 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-faaf99d7-81be-46e8-a49d-5eeda93deaaa tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080387 Aug 09 14:51:18.666448 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2046/4101] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:51:18 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:51:18.672057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60d5e13d-2b61-4f6f-a309-7f260e1ea1c3 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:18.672876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60d5e13d-2b61-4f6f-a309-7f260e1ea1c3 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:18.679997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d5e13d-2b61-4f6f-a309-7f260e1ea1c3 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:18.680732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d5e13d-2b61-4f6f-a309-7f260e1ea1c3 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:18.681327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d5e13d-2b61-4f6f-a309-7f260e1ea1c3 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:18.682263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d5e13d-2b61-4f6f-a309-7f260e1ea1c3 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:18.682867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d5e13d-2b61-4f6f-a309-7f260e1ea1c3 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:18.683510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60d5e13d-2b61-4f6f-a309-7f260e1ea1c3 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:18.820752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60d5e13d-2b61-4f6f-a309-7f260e1ea1c3 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:18.834779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60d5e13d-2b61-4f6f-a309-7f260e1ea1c3 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:18.837555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60d5e13d-2b61-4f6f-a309-7f260e1ea1c3 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:18.841186 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60d5e13d-2b61-4f6f-a309-7f260e1ea1c3 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.173447 Aug 09 14:51:18.843178 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2047/4102] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:18 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:18.849433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-9dffac87-73a5-440d-998c-367f97bc25af req-c9dc2d9c-e79e-42f5-b9f9-dea7e5ee26bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-deleted", "tag": "e630072b-3881-4138-9288-6963597d3178"}, {"server_uuid": "da519f2f-fb00-4edd-a06f-c055cf7fa4af", "name": "network-vif-deleted", "tag": "bef1c2ab-48c1-4197-be01-418d835b0f52"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:18.862443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9dffac87-73a5-440d-998c-367f97bc25af req-c9dc2d9c-e79e-42f5-b9f9-dea7e5ee26bd service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:18.863170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9dffac87-73a5-440d-998c-367f97bc25af req-c9dc2d9c-e79e-42f5-b9f9-dea7e5ee26bd service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:18.863755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9dffac87-73a5-440d-998c-367f97bc25af req-c9dc2d9c-e79e-42f5-b9f9-dea7e5ee26bd service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:18.878865 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9dffac87-73a5-440d-998c-367f97bc25af req-c9dc2d9c-e79e-42f5-b9f9-dea7e5ee26bd service nova] Creating event network-vif-deleted:e630072b-3881-4138-9288-6963597d3178 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:51:18.879571 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9dffac87-73a5-440d-998c-367f97bc25af req-c9dc2d9c-e79e-42f5-b9f9-dea7e5ee26bd service nova] Creating event network-vif-deleted:bef1c2ab-48c1-4197-be01-418d835b0f52 for instance da519f2f-fb00-4edd-a06f-c055cf7fa4af on n-h2-844626-8 Aug 09 14:51:18.886265 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-9dffac87-73a5-440d-998c-367f97bc25af req-c9dc2d9c-e79e-42f5-b9f9-dea7e5ee26bd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040776 Aug 09 14:51:18.887526 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2048/4103] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:19.016005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ffa4fd56-cadc-42e9-adc3-ed84948d0b70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:19.018223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ffa4fd56-cadc-42e9-adc3-ed84948d0b70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:19.030068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffa4fd56-cadc-42e9-adc3-ed84948d0b70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:19.031006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffa4fd56-cadc-42e9-adc3-ed84948d0b70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:19.033853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffa4fd56-cadc-42e9-adc3-ed84948d0b70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:19.035414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffa4fd56-cadc-42e9-adc3-ed84948d0b70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:19.036041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffa4fd56-cadc-42e9-adc3-ed84948d0b70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:19.036816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffa4fd56-cadc-42e9-adc3-ed84948d0b70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:19.375992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ffa4fd56-cadc-42e9-adc3-ed84948d0b70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:19.388259 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ffa4fd56-cadc-42e9-adc3-ed84948d0b70 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.378932 Aug 09 14:51:19.389001 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2049/4104] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:19 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:19.596660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6264b2ce-505e-4819-898b-f660094a46fe tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:19.597638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6264b2ce-505e-4819-898b-f660094a46fe tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:19.604538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6264b2ce-505e-4819-898b-f660094a46fe tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:19.605296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6264b2ce-505e-4819-898b-f660094a46fe tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:19.605949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6264b2ce-505e-4819-898b-f660094a46fe tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:19.606889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6264b2ce-505e-4819-898b-f660094a46fe tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:19.607570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6264b2ce-505e-4819-898b-f660094a46fe tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:19.608212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6264b2ce-505e-4819-898b-f660094a46fe tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:19.965756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6264b2ce-505e-4819-898b-f660094a46fe tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:19.985419 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6264b2ce-505e-4819-898b-f660094a46fe tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.382821 Aug 09 14:51:19.995234 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2050/4105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:19 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:51:19.995234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7d8bda4-1a82-40aa-b4a3-e3429e25e083 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:19.995234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7d8bda4-1a82-40aa-b4a3-e3429e25e083 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:20.008403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d8bda4-1a82-40aa-b4a3-e3429e25e083 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:20.014185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d8bda4-1a82-40aa-b4a3-e3429e25e083 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:20.015986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d8bda4-1a82-40aa-b4a3-e3429e25e083 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:20.017727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d8bda4-1a82-40aa-b4a3-e3429e25e083 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:20.018827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d8bda4-1a82-40aa-b4a3-e3429e25e083 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:20.019652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d8bda4-1a82-40aa-b4a3-e3429e25e083 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:20.078386 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7d8bda4-1a82-40aa-b4a3-e3429e25e083 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.091073 Aug 09 14:51:20.079275 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2051/4106] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:51:19 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:51:20.088381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b204a92c-1cfe-4966-844c-a2c2820fbc0f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:20.089079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b204a92c-1cfe-4966-844c-a2c2820fbc0f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:20.095290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b204a92c-1cfe-4966-844c-a2c2820fbc0f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:20.095790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b204a92c-1cfe-4966-844c-a2c2820fbc0f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:20.096320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b204a92c-1cfe-4966-844c-a2c2820fbc0f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:20.097101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b204a92c-1cfe-4966-844c-a2c2820fbc0f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:20.097539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b204a92c-1cfe-4966-844c-a2c2820fbc0f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:20.097967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b204a92c-1cfe-4966-844c-a2c2820fbc0f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:20.513201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b204a92c-1cfe-4966-844c-a2c2820fbc0f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:20.525830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b204a92c-1cfe-4966-844c-a2c2820fbc0f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:20.528287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b204a92c-1cfe-4966-844c-a2c2820fbc0f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:20.529354 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b204a92c-1cfe-4966-844c-a2c2820fbc0f tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.445008 Aug 09 14:51:20.530259 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2052/4107] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:20 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:20.535301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c52a539e-68f8-4a13-8d23-7e3c53d8112e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:20.535988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c52a539e-68f8-4a13-8d23-7e3c53d8112e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:20.542609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c52a539e-68f8-4a13-8d23-7e3c53d8112e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:20.543125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c52a539e-68f8-4a13-8d23-7e3c53d8112e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:20.543582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c52a539e-68f8-4a13-8d23-7e3c53d8112e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:20.544416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c52a539e-68f8-4a13-8d23-7e3c53d8112e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:20.544873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c52a539e-68f8-4a13-8d23-7e3c53d8112e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:20.545279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c52a539e-68f8-4a13-8d23-7e3c53d8112e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:20.876066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c52a539e-68f8-4a13-8d23-7e3c53d8112e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:20.883893 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c52a539e-68f8-4a13-8d23-7e3c53d8112e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.352671 Aug 09 14:51:20.884533 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2053/4108] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:20 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:21.011209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0fc283b-bf42-47c1-9c67-8fac6fb52a4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:21.026607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0fc283b-bf42-47c1-9c67-8fac6fb52a4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:21.039501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0fc283b-bf42-47c1-9c67-8fac6fb52a4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:21.039994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0fc283b-bf42-47c1-9c67-8fac6fb52a4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:21.040486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0fc283b-bf42-47c1-9c67-8fac6fb52a4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:21.045589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0fc283b-bf42-47c1-9c67-8fac6fb52a4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:21.046270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0fc283b-bf42-47c1-9c67-8fac6fb52a4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:21.046713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0fc283b-bf42-47c1-9c67-8fac6fb52a4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:21.236372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:51:21.237433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:51:21.238055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:51:21.238608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:51:21.239185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:51:21.262886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:21.263405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:21.263833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:21.264596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:21.265042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:21.265456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:21.303158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Getting quotas for project ea6c164a34094b61a233eb90f5826bdb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:51:21.321384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Getting quotas for user e8811057cd0b41f8b19133f759c51fa6 and project ea6c164a34094b61a233eb90f5826bdb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:51:21.370297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0fc283b-bf42-47c1-9c67-8fac6fb52a4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:21.400444 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0fc283b-bf42-47c1-9c67-8fac6fb52a4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.392520 Aug 09 14:51:21.403696 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2054/4109] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:21 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:51:21.425010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-009aa204-cce0-4272-a0dc-f47d4cce6045 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:21.433025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-009aa204-cce0-4272-a0dc-f47d4cce6045 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:21.449331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-009aa204-cce0-4272-a0dc-f47d4cce6045 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:21.452156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-009aa204-cce0-4272-a0dc-f47d4cce6045 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:21.453657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-009aa204-cce0-4272-a0dc-f47d4cce6045 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:21.454444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-009aa204-cce0-4272-a0dc-f47d4cce6045 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:21.454918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-009aa204-cce0-4272-a0dc-f47d4cce6045 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:21.455382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-009aa204-cce0-4272-a0dc-f47d4cce6045 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:21.521418 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-009aa204-cce0-4272-a0dc-f47d4cce6045 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.115644 Aug 09 14:51:21.528335 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2055/4110] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:51:21 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:21.553059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cd3e2546-371b-4b9b-b394-026640a55e28 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:21.553679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cd3e2546-371b-4b9b-b394-026640a55e28 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:21.561281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd3e2546-371b-4b9b-b394-026640a55e28 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:21.561777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd3e2546-371b-4b9b-b394-026640a55e28 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:21.562296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd3e2546-371b-4b9b-b394-026640a55e28 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:21.563000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd3e2546-371b-4b9b-b394-026640a55e28 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:21.563489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd3e2546-371b-4b9b-b394-026640a55e28 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:21.563910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd3e2546-371b-4b9b-b394-026640a55e28 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:21.679186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cd3e2546-371b-4b9b-b394-026640a55e28 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:21.719620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cd3e2546-371b-4b9b-b394-026640a55e28 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:21.723643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cd3e2546-371b-4b9b-b394-026640a55e28 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:21.724936 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cd3e2546-371b-4b9b-b394-026640a55e28 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.176476 Aug 09 14:51:21.736875 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2056/4111] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:21 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:21.753164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:51:21.756001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4840b8f9-bcc6-4eaa-a966-9e7628478ab3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='aeb93732-5709-4bd5-9ac0-af5a80c6b89e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='017c4d78-e1b7-4ff1-98ff-c546ec3b420d',volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:51:21.757464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-16cc3843-e0e0-496a-af94-74f555fc2b9f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:21.758059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-16cc3843-e0e0-496a-af94-74f555fc2b9f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:21.778506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16cc3843-e0e0-496a-af94-74f555fc2b9f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:21.779007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16cc3843-e0e0-496a-af94-74f555fc2b9f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:21.779479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16cc3843-e0e0-496a-af94-74f555fc2b9f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:21.780195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16cc3843-e0e0-496a-af94-74f555fc2b9f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:21.780650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16cc3843-e0e0-496a-af94-74f555fc2b9f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:21.781073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16cc3843-e0e0-496a-af94-74f555fc2b9f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:21.871556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-16cc3843-e0e0-496a-af94-74f555fc2b9f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:51:21.964528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:22.121054 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-16cc3843-e0e0-496a-af94-74f555fc2b9f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 204 len: 0 microversion: 2.20 time: 0.381260 Aug 09 14:51:22.126055 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2057/4112] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:51:21 2022] DELETE /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:51:22.139990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a5763e11-0145-481a-9618-39b229cc10ad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:22.142972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a5763e11-0145-481a-9618-39b229cc10ad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:22.157263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5763e11-0145-481a-9618-39b229cc10ad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:22.157785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5763e11-0145-481a-9618-39b229cc10ad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:22.158227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5763e11-0145-481a-9618-39b229cc10ad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:22.163704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5763e11-0145-481a-9618-39b229cc10ad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:22.164364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5763e11-0145-481a-9618-39b229cc10ad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:22.164814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a5763e11-0145-481a-9618-39b229cc10ad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:22.411198 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-13d42c1e-aca0-4441-b77d-4c7afde2740d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.930956 Aug 09 14:51:22.413884 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2056/4113] 10.222.0.50 () {62 vars in 1189 bytes} [Tue Aug 9 14:51:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 7935 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 09 14:51:22.422223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed1c0748-fcb6-4513-a02f-46c6dd5c2e73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:22.422846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed1c0748-fcb6-4513-a02f-46c6dd5c2e73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:22.448342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a5763e11-0145-481a-9618-39b229cc10ad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:22.460883 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a5763e11-0145-481a-9618-39b229cc10ad tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.334800 Aug 09 14:51:22.462022 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2058/4114] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:22 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:22.467224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-371474b0-8566-4fd7-b055-fa8f32a05991 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:22.468002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-371474b0-8566-4fd7-b055-fa8f32a05991 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:22.473651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed1c0748-fcb6-4513-a02f-46c6dd5c2e73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:22.474345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed1c0748-fcb6-4513-a02f-46c6dd5c2e73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:22.475717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed1c0748-fcb6-4513-a02f-46c6dd5c2e73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:22.477828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed1c0748-fcb6-4513-a02f-46c6dd5c2e73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:22.478436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed1c0748-fcb6-4513-a02f-46c6dd5c2e73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:22.479632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed1c0748-fcb6-4513-a02f-46c6dd5c2e73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:22.576028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-371474b0-8566-4fd7-b055-fa8f32a05991 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:22.596540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-371474b0-8566-4fd7-b055-fa8f32a05991 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:22.608104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-371474b0-8566-4fd7-b055-fa8f32a05991 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:22.611177 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-371474b0-8566-4fd7-b055-fa8f32a05991 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1285 microversion: 2.32 time: 0.147922 Aug 09 14:51:22.613939 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2059/4115] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:22 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:22.628218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f56c3b78-1e49-427e-890e-77276365364e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:22.635249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f56c3b78-1e49-427e-890e-77276365364e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:22.647320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f56c3b78-1e49-427e-890e-77276365364e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:22.649433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f56c3b78-1e49-427e-890e-77276365364e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:22.662817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f56c3b78-1e49-427e-890e-77276365364e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:22.664211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f56c3b78-1e49-427e-890e-77276365364e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:22.669132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f56c3b78-1e49-427e-890e-77276365364e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:22.671520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f56c3b78-1e49-427e-890e-77276365364e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:22.881667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed1c0748-fcb6-4513-a02f-46c6dd5c2e73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:22.900554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed1c0748-fcb6-4513-a02f-46c6dd5c2e73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:22.903221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed1c0748-fcb6-4513-a02f-46c6dd5c2e73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:22.904697 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed1c0748-fcb6-4513-a02f-46c6dd5c2e73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1723 microversion: 2.20 time: 0.488142 Aug 09 14:51:22.905556 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2057/4116] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:22 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1723 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:22.914293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-53ea8b71-bd41-4874-a3ed-3c76f7b455c0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:22.919683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-53ea8b71-bd41-4874-a3ed-3c76f7b455c0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:22.929318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53ea8b71-bd41-4874-a3ed-3c76f7b455c0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:22.932749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53ea8b71-bd41-4874-a3ed-3c76f7b455c0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:22.948913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53ea8b71-bd41-4874-a3ed-3c76f7b455c0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:22.950415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53ea8b71-bd41-4874-a3ed-3c76f7b455c0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:22.955191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53ea8b71-bd41-4874-a3ed-3c76f7b455c0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:22.956028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53ea8b71-bd41-4874-a3ed-3c76f7b455c0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:22.985305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f56c3b78-1e49-427e-890e-77276365364e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:22.994149 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f56c3b78-1e49-427e-890e-77276365364e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.378906 Aug 09 14:51:23.006283 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2060/4117] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:22 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:23.127991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-53ea8b71-bd41-4874-a3ed-3c76f7b455c0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:23.143834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-53ea8b71-bd41-4874-a3ed-3c76f7b455c0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:23.145349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-53ea8b71-bd41-4874-a3ed-3c76f7b455c0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:23.146580 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-53ea8b71-bd41-4874-a3ed-3c76f7b455c0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.239851 Aug 09 14:51:23.147180 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2058/4118] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:22 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:23.485497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0bc6249c-b7fd-4d61-a6c2-8bb6db00ccf3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:23.486097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0bc6249c-b7fd-4d61-a6c2-8bb6db00ccf3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:23.499964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bc6249c-b7fd-4d61-a6c2-8bb6db00ccf3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:23.500492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bc6249c-b7fd-4d61-a6c2-8bb6db00ccf3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:23.500941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bc6249c-b7fd-4d61-a6c2-8bb6db00ccf3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:23.515463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bc6249c-b7fd-4d61-a6c2-8bb6db00ccf3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:23.516285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bc6249c-b7fd-4d61-a6c2-8bb6db00ccf3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:23.516577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0bc6249c-b7fd-4d61-a6c2-8bb6db00ccf3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:23.659521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b67dc9e6-97d8-460e-b17c-42939c83c440 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:23.660492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b67dc9e6-97d8-460e-b17c-42939c83c440 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:23.811795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b67dc9e6-97d8-460e-b17c-42939c83c440 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:23.821859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b67dc9e6-97d8-460e-b17c-42939c83c440 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:23.826593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b67dc9e6-97d8-460e-b17c-42939c83c440 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:23.837522 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b67dc9e6-97d8-460e-b17c-42939c83c440 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1285 microversion: 2.32 time: 0.200007 Aug 09 14:51:23.838823 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2059/4119] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:23 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:23.928702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-47fc2901-34e9-4002-8a84-1b46434ab65d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:23.930659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-47fc2901-34e9-4002-8a84-1b46434ab65d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:23.933534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0bc6249c-b7fd-4d61-a6c2-8bb6db00ccf3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:23.941465 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0bc6249c-b7fd-4d61-a6c2-8bb6db00ccf3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.460685 Aug 09 14:51:23.944460 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2061/4120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:23 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:23.960568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47fc2901-34e9-4002-8a84-1b46434ab65d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:23.961695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47fc2901-34e9-4002-8a84-1b46434ab65d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:23.962343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47fc2901-34e9-4002-8a84-1b46434ab65d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:23.963529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47fc2901-34e9-4002-8a84-1b46434ab65d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:23.966441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47fc2901-34e9-4002-8a84-1b46434ab65d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:23.968049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47fc2901-34e9-4002-8a84-1b46434ab65d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:24.033846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-753b7792-c33d-4514-b51b-06af61b7e5f5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:24.034796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-753b7792-c33d-4514-b51b-06af61b7e5f5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:24.044254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-753b7792-c33d-4514-b51b-06af61b7e5f5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:24.045304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-753b7792-c33d-4514-b51b-06af61b7e5f5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:24.046406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-753b7792-c33d-4514-b51b-06af61b7e5f5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:24.047631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-753b7792-c33d-4514-b51b-06af61b7e5f5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:24.048540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-753b7792-c33d-4514-b51b-06af61b7e5f5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:24.049168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-753b7792-c33d-4514-b51b-06af61b7e5f5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:24.788853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-753b7792-c33d-4514-b51b-06af61b7e5f5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:24.812547 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-753b7792-c33d-4514-b51b-06af61b7e5f5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1522 microversion: 2.1 time: 0.801193 Aug 09 14:51:24.816269 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2062/4121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:24 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1522 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:24.843732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-da809a2b-7f65-400b-951c-492309840b61 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:24.846870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-da809a2b-7f65-400b-951c-492309840b61 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:24.877893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da809a2b-7f65-400b-951c-492309840b61 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:24.880695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da809a2b-7f65-400b-951c-492309840b61 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:24.884825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da809a2b-7f65-400b-951c-492309840b61 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:24.897737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da809a2b-7f65-400b-951c-492309840b61 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:24.899913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da809a2b-7f65-400b-951c-492309840b61 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:24.902926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da809a2b-7f65-400b-951c-492309840b61 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:25.105509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-47fc2901-34e9-4002-8a84-1b46434ab65d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:25.120530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-47fc2901-34e9-4002-8a84-1b46434ab65d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:25.132018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-47fc2901-34e9-4002-8a84-1b46434ab65d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:25.137127 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-47fc2901-34e9-4002-8a84-1b46434ab65d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1723 microversion: 2.20 time: 1.212219 Aug 09 14:51:25.138814 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2060/4122] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:23 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1723 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:25.150741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6cad8289-93de-4ded-95fe-775fdbb13b54 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:25.152254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6cad8289-93de-4ded-95fe-775fdbb13b54 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:25.165590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cad8289-93de-4ded-95fe-775fdbb13b54 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:25.171360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cad8289-93de-4ded-95fe-775fdbb13b54 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:25.172089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cad8289-93de-4ded-95fe-775fdbb13b54 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:25.173170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cad8289-93de-4ded-95fe-775fdbb13b54 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:25.173808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cad8289-93de-4ded-95fe-775fdbb13b54 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:25.174431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cad8289-93de-4ded-95fe-775fdbb13b54 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:25.244664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da809a2b-7f65-400b-951c-492309840b61 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:25.259303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da809a2b-7f65-400b-951c-492309840b61 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:25.267284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da809a2b-7f65-400b-951c-492309840b61 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:25.276364 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-da809a2b-7f65-400b-951c-492309840b61 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.454116 Aug 09 14:51:25.277607 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2063/4123] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:24 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:25.282207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a322fd5-c435-4036-9ee3-ad1c2bd36457 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:25.286199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a322fd5-c435-4036-9ee3-ad1c2bd36457 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:25.303881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a322fd5-c435-4036-9ee3-ad1c2bd36457 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:25.304685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a322fd5-c435-4036-9ee3-ad1c2bd36457 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:25.305111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a322fd5-c435-4036-9ee3-ad1c2bd36457 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:25.307447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a322fd5-c435-4036-9ee3-ad1c2bd36457 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:25.308594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a322fd5-c435-4036-9ee3-ad1c2bd36457 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:25.310338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a322fd5-c435-4036-9ee3-ad1c2bd36457 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:25.369025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6cad8289-93de-4ded-95fe-775fdbb13b54 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:25.385619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6cad8289-93de-4ded-95fe-775fdbb13b54 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:25.391215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6cad8289-93de-4ded-95fe-775fdbb13b54 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:25.393809 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6cad8289-93de-4ded-95fe-775fdbb13b54 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1593 microversion: 2.32 time: 0.253719 Aug 09 14:51:25.399345 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2061/4124] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:25 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1593 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:25.847548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a322fd5-c435-4036-9ee3-ad1c2bd36457 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:25.850865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f21c96e2-02bb-4068-98f3-e83ee014258b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:25.851854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f21c96e2-02bb-4068-98f3-e83ee014258b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:25.870717 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a322fd5-c435-4036-9ee3-ad1c2bd36457 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.586042 Aug 09 14:51:25.884735 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2064/4125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:25 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:25.888031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f21c96e2-02bb-4068-98f3-e83ee014258b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:25.889002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f21c96e2-02bb-4068-98f3-e83ee014258b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:25.889638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f21c96e2-02bb-4068-98f3-e83ee014258b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:25.893087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f21c96e2-02bb-4068-98f3-e83ee014258b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:25.893917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f21c96e2-02bb-4068-98f3-e83ee014258b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:25.894601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f21c96e2-02bb-4068-98f3-e83ee014258b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:26.165696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d352ae5b-7a6b-4cde-8e08-788a90e0e0d1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:26.166604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d352ae5b-7a6b-4cde-8e08-788a90e0e0d1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:26.179499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d352ae5b-7a6b-4cde-8e08-788a90e0e0d1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:26.180162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d352ae5b-7a6b-4cde-8e08-788a90e0e0d1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:26.181021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d352ae5b-7a6b-4cde-8e08-788a90e0e0d1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:26.182722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d352ae5b-7a6b-4cde-8e08-788a90e0e0d1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:26.184741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d352ae5b-7a6b-4cde-8e08-788a90e0e0d1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:26.186258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d352ae5b-7a6b-4cde-8e08-788a90e0e0d1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:27.149287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f21c96e2-02bb-4068-98f3-e83ee014258b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:27.161663 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f21c96e2-02bb-4068-98f3-e83ee014258b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1502 microversion: 2.1 time: 1.321323 Aug 09 14:51:27.172461 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2062/4126] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:25 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1502 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:27.186518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21e13819-f51c-45de-92b8-28c25a779f86 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:27.187198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-21e13819-f51c-45de-92b8-28c25a779f86 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:27.202047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21e13819-f51c-45de-92b8-28c25a779f86 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:27.202546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21e13819-f51c-45de-92b8-28c25a779f86 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:27.202985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21e13819-f51c-45de-92b8-28c25a779f86 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:27.208547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21e13819-f51c-45de-92b8-28c25a779f86 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:27.210375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21e13819-f51c-45de-92b8-28c25a779f86 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:27.211219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21e13819-f51c-45de-92b8-28c25a779f86 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:27.239260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d352ae5b-7a6b-4cde-8e08-788a90e0e0d1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:27.266161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d352ae5b-7a6b-4cde-8e08-788a90e0e0d1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:27.268486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d352ae5b-7a6b-4cde-8e08-788a90e0e0d1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:27.269919 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d352ae5b-7a6b-4cde-8e08-788a90e0e0d1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1723 microversion: 2.20 time: 1.109108 Aug 09 14:51:27.271006 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2065/4127] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:26 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1723 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:27.279346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cadf935a-80fb-4c2f-b9a4-72fc2ceecc59 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:27.281931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cadf935a-80fb-4c2f-b9a4-72fc2ceecc59 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:27.298831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cadf935a-80fb-4c2f-b9a4-72fc2ceecc59 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:27.299557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cadf935a-80fb-4c2f-b9a4-72fc2ceecc59 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:27.300174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cadf935a-80fb-4c2f-b9a4-72fc2ceecc59 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:27.301042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cadf935a-80fb-4c2f-b9a4-72fc2ceecc59 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:27.301649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cadf935a-80fb-4c2f-b9a4-72fc2ceecc59 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:27.302224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cadf935a-80fb-4c2f-b9a4-72fc2ceecc59 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:27.591658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-21e13819-f51c-45de-92b8-28c25a779f86 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:27.601692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-21e13819-f51c-45de-92b8-28c25a779f86 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:27.613222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-21e13819-f51c-45de-92b8-28c25a779f86 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:27.614885 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-21e13819-f51c-45de-92b8-28c25a779f86 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.439620 Aug 09 14:51:27.616118 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2063/4128] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:27 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:27.621054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5bcdb163-871e-4b7d-aa8e-5532a669d32c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:27.626612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cadf935a-80fb-4c2f-b9a4-72fc2ceecc59 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:27.627631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5bcdb163-871e-4b7d-aa8e-5532a669d32c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:27.640465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bcdb163-871e-4b7d-aa8e-5532a669d32c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:27.643190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cadf935a-80fb-4c2f-b9a4-72fc2ceecc59 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:27.644123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bcdb163-871e-4b7d-aa8e-5532a669d32c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:27.644749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bcdb163-871e-4b7d-aa8e-5532a669d32c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:27.645107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cadf935a-80fb-4c2f-b9a4-72fc2ceecc59 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:27.645841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bcdb163-871e-4b7d-aa8e-5532a669d32c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:27.646470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bcdb163-871e-4b7d-aa8e-5532a669d32c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:27.647103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5bcdb163-871e-4b7d-aa8e-5532a669d32c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:27.648757 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cadf935a-80fb-4c2f-b9a4-72fc2ceecc59 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1593 microversion: 2.32 time: 0.376443 Aug 09 14:51:27.649380 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2066/4129] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:27 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1593 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:27.667208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2923829f-f950-4288-bab5-a259e8e57ac1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:27.668536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2923829f-f950-4288-bab5-a259e8e57ac1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:27.680023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2923829f-f950-4288-bab5-a259e8e57ac1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:27.680814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2923829f-f950-4288-bab5-a259e8e57ac1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:27.681451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2923829f-f950-4288-bab5-a259e8e57ac1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:27.682368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2923829f-f950-4288-bab5-a259e8e57ac1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:27.682994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2923829f-f950-4288-bab5-a259e8e57ac1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:27.687045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2923829f-f950-4288-bab5-a259e8e57ac1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:28.318767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5bcdb163-871e-4b7d-aa8e-5532a669d32c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:28.352814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2923829f-f950-4288-bab5-a259e8e57ac1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:28.364813 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5bcdb163-871e-4b7d-aa8e-5532a669d32c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1512 microversion: 2.1 time: 0.717745 Aug 09 14:51:28.366402 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2064/4130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:27 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1512 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:28.381329 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2923829f-f950-4288-bab5-a259e8e57ac1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1515 microversion: 2.1 time: 0.721984 Aug 09 14:51:28.382461 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2067/4131] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:27 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1515 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:28.383645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f6023d2a-411b-4506-bbec-3912b830475c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:28.384279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f6023d2a-411b-4506-bbec-3912b830475c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:28.401344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6023d2a-411b-4506-bbec-3912b830475c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:28.402200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6023d2a-411b-4506-bbec-3912b830475c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:28.402630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6023d2a-411b-4506-bbec-3912b830475c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:28.403363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6023d2a-411b-4506-bbec-3912b830475c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:28.403809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6023d2a-411b-4506-bbec-3912b830475c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:28.404227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6023d2a-411b-4506-bbec-3912b830475c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:28.409254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79fd57d3-9eeb-40e5-85a4-5c6b1bf50dc9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:28.412357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-79fd57d3-9eeb-40e5-85a4-5c6b1bf50dc9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 4f126f5c-86d6-49b4-93ed-f6bc4636de0c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:28.422312 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-79fd57d3-9eeb-40e5-85a4-5c6b1bf50dc9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] HTTP exception thrown: Instance 4f126f5c-86d6-49b4-93ed-f6bc4636de0c could not be found. Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79fd57d3-9eeb-40e5-85a4-5c6b1bf50dc9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Request method failure captured: Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/4f126f5c-86d6-49b4-93ed-f6bc4636de0c/action HTTP/1.1 Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 14 Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nQm9peRLyL-_ZL-9bNt1h-d9klu5PkrS_r357cpe12gMlxICQ1HHucyUskRO5kPygg95_v20_f9GCogcbu9CMWwyIZJ02lyqO-GFoRzdRBe_4fpq23MfQZHMH2nNzxDS_zNouresiy_aJnSNaognXLjQlW_aeA_R6cmhZY0LfELTto Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0caed61cb95467ba8b076c63f6706de", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cfd1981c518d4432b4635c1768114b22 Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: {"rescue": {}} Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 4f126f5c-86d6-49b4-93ed-f6bc4636de0c could not be found. Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '4f126f5c-86d6-49b4-93ed-f6bc4636de0c', 'body': {'rescue': {}}} Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f126f5c-86d6-49b4-93ed-f6bc4636de0c could not be found. Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f126f5c-86d6-49b4-93ed-f6bc4636de0c could not be found. Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:28.434707 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:28.439731 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:51:28.439731 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:51:28.439731 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:51:28.439731 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:51:28.439731 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f126f5c-86d6-49b4-93ed-f6bc4636de0c could not be found. Aug 09 14:51:28.439731 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:28.441078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79fd57d3-9eeb-40e5-85a4-5c6b1bf50dc9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Returning 404 to user: Instance 4f126f5c-86d6-49b4-93ed-f6bc4636de0c could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:51:28.442421 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-79fd57d3-9eeb-40e5-85a4-5c6b1bf50dc9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/4f126f5c-86d6-49b4-93ed-f6bc4636de0c/action" status: 404 len: 111 microversion: 2.1 time: 0.038126 Aug 09 14:51:28.444122 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2068/4132] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:51:28 2022] POST /compute/v2.1/servers/4f126f5c-86d6-49b4-93ed-f6bc4636de0c/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:51:28.454527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-147b9679-eb9c-449e-a4c2-966bb02c143a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:28.457407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-147b9679-eb9c-449e-a4c2-966bb02c143a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:28.478077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147b9679-eb9c-449e-a4c2-966bb02c143a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:28.483504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147b9679-eb9c-449e-a4c2-966bb02c143a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:28.483980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147b9679-eb9c-449e-a4c2-966bb02c143a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:28.484737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147b9679-eb9c-449e-a4c2-966bb02c143a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:28.485222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147b9679-eb9c-449e-a4c2-966bb02c143a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:28.485631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147b9679-eb9c-449e-a4c2-966bb02c143a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:28.616871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f6023d2a-411b-4506-bbec-3912b830475c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:28.637880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f6023d2a-411b-4506-bbec-3912b830475c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:28.644347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f6023d2a-411b-4506-bbec-3912b830475c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:28.645043 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-147b9679-eb9c-449e-a4c2-966bb02c143a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/action" status: 202 len: 0 microversion: 2.1 time: 0.194874 Aug 09 14:51:28.646302 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2069/4133] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:51:28 2022] POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:51:28.648317 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f6023d2a-411b-4506-bbec-3912b830475c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 200 len: 1656 microversion: 2.20 time: 0.274872 Aug 09 14:51:28.651546 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2065/4134] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:28 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 1656 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:28.656381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e69d177a-44c3-4201-99a8-baced3d6f884 req-58140159-6a33-4b86-8b2e-ac056d7e2280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c25a9384-ba3d-4ff8-8f2a-39ccdde0690a", "name": "network-vif-deleted", "tag": "ec41d639-5d70-4bd6-8da7-60954703b90b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:28.665979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-35b0074b-eb02-4d9d-bb4b-64c91fb4f1a1 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:28.667110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-35b0074b-eb02-4d9d-bb4b-64c91fb4f1a1 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:28.684637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35b0074b-eb02-4d9d-bb4b-64c91fb4f1a1 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:28.685493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e69d177a-44c3-4201-99a8-baced3d6f884 req-58140159-6a33-4b86-8b2e-ac056d7e2280 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:28.686228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e69d177a-44c3-4201-99a8-baced3d6f884 req-58140159-6a33-4b86-8b2e-ac056d7e2280 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:28.686490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35b0074b-eb02-4d9d-bb4b-64c91fb4f1a1 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:28.686997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e69d177a-44c3-4201-99a8-baced3d6f884 req-58140159-6a33-4b86-8b2e-ac056d7e2280 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:28.688512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35b0074b-eb02-4d9d-bb4b-64c91fb4f1a1 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:28.691301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35b0074b-eb02-4d9d-bb4b-64c91fb4f1a1 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:28.692925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35b0074b-eb02-4d9d-bb4b-64c91fb4f1a1 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:28.695130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35b0074b-eb02-4d9d-bb4b-64c91fb4f1a1 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:28.707571 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e69d177a-44c3-4201-99a8-baced3d6f884 req-58140159-6a33-4b86-8b2e-ac056d7e2280 service nova] Creating event network-vif-deleted:ec41d639-5d70-4bd6-8da7-60954703b90b for instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a on n-h2-844626-8 Aug 09 14:51:28.720302 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e69d177a-44c3-4201-99a8-baced3d6f884 req-58140159-6a33-4b86-8b2e-ac056d7e2280 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072357 Aug 09 14:51:28.720924 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2070/4135] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:28.739254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42798ee7-6553-411b-bd8b-2fb33836f2b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:28.740277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42798ee7-6553-411b-bd8b-2fb33836f2b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:28.742788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:28.765707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42798ee7-6553-411b-bd8b-2fb33836f2b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:28.766617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42798ee7-6553-411b-bd8b-2fb33836f2b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:28.768514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42798ee7-6553-411b-bd8b-2fb33836f2b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:28.772337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42798ee7-6553-411b-bd8b-2fb33836f2b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:28.773977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42798ee7-6553-411b-bd8b-2fb33836f2b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:28.775523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42798ee7-6553-411b-bd8b-2fb33836f2b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:28.897265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-35b0074b-eb02-4d9d-bb4b-64c91fb4f1a1 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:28.915222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-35b0074b-eb02-4d9d-bb4b-64c91fb4f1a1 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:28.919104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-35b0074b-eb02-4d9d-bb4b-64c91fb4f1a1 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:28.922831 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-35b0074b-eb02-4d9d-bb4b-64c91fb4f1a1 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.268510 Aug 09 14:51:28.941090 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2066/4136] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:28 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:28.956228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d4471cb-544c-44bd-a45d-b610c8738ce5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:28.957164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d4471cb-544c-44bd-a45d-b610c8738ce5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:28.972510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d4471cb-544c-44bd-a45d-b610c8738ce5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:28.973935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d4471cb-544c-44bd-a45d-b610c8738ce5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:28.975795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d4471cb-544c-44bd-a45d-b610c8738ce5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:28.976800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d4471cb-544c-44bd-a45d-b610c8738ce5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:28.980753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d4471cb-544c-44bd-a45d-b610c8738ce5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:28.983995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d4471cb-544c-44bd-a45d-b610c8738ce5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:29.460764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d4471cb-544c-44bd-a45d-b610c8738ce5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:29.475587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d4471cb-544c-44bd-a45d-b610c8738ce5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:29.477584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d4471cb-544c-44bd-a45d-b610c8738ce5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:29.483040 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d4471cb-544c-44bd-a45d-b610c8738ce5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1660 microversion: 2.32 time: 0.540247 Aug 09 14:51:29.484029 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2067/4137] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:28 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1660 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:29.489982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a9976a9-5e35-4430-a079-597d5d9b7d9a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:29.501689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7a9976a9-5e35-4430-a079-597d5d9b7d9a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:29.509375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42798ee7-6553-411b-bd8b-2fb33836f2b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:29.512177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9976a9-5e35-4430-a079-597d5d9b7d9a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:29.512765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9976a9-5e35-4430-a079-597d5d9b7d9a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:29.513202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9976a9-5e35-4430-a079-597d5d9b7d9a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:29.514963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9976a9-5e35-4430-a079-597d5d9b7d9a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:29.523363 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42798ee7-6553-411b-bd8b-2fb33836f2b2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1520 microversion: 2.1 time: 0.799332 Aug 09 14:51:29.523991 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2071/4138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:28 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1520 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:29.524398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9976a9-5e35-4430-a079-597d5d9b7d9a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:29.525008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9976a9-5e35-4430-a079-597d5d9b7d9a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:29.677136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e2cf1eb-3d5f-4f39-a6ff-b60e64e0a048 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:29.678048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2e2cf1eb-3d5f-4f39-a6ff-b60e64e0a048 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:29.687651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e2cf1eb-3d5f-4f39-a6ff-b60e64e0a048 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:29.694762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e2cf1eb-3d5f-4f39-a6ff-b60e64e0a048 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:29.696113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e2cf1eb-3d5f-4f39-a6ff-b60e64e0a048 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:29.697121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e2cf1eb-3d5f-4f39-a6ff-b60e64e0a048 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:29.698109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e2cf1eb-3d5f-4f39-a6ff-b60e64e0a048 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:29.700934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e2cf1eb-3d5f-4f39-a6ff-b60e64e0a048 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:29.740320 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-2e2cf1eb-3d5f-4f39-a6ff-b60e64e0a048 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] HTTP exception thrown: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e2cf1eb-3d5f-4f39-a6ff-b60e64e0a048 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Request method failure captured: Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a HTTP/1.1 Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nN6Uf8w2h-mfdeKt3XJsoyv-xzv_UyQNTiNQ-vBpfFw6jZ7cScirzV8TkKnGOT2wQDbDlpkmRsC0Lnkh0Ai6f5EyawKCYbM8YAFN3k76pWMnV1jQVbRAURmiaEB6m3ni3IOBHATY6FJaoZDpW-yYZSemU3xW-LdkstpnU-7TqlruYs Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: cd7add50097c4b84859dbfac51473919 Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd7add50097c4b84859dbfac51473919", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd7add50097c4b84859dbfac51473919"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd7add50097c4b84859dbfac51473919"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd7add50097c4b84859dbfac51473919"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: cd7add50097c4b84859dbfac51473919 Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AttachVolumeShelveTestJSON-1410391267-project Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 13b12146c9774e9c8360d7535e43bfe3 Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1410391267-project Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'c25a9384-ba3d-4ff8-8f2a-39ccdde0690a'} Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:29.746843 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:51:29.750945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:29.750945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:29.750945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:51:29.750945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:51:29.750945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:51:29.750945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:51:29.750945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:51:29.750945 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:29.753536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e2cf1eb-3d5f-4f39-a6ff-b60e64e0a048 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Returning 404 to user: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:51:29.758296 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2e2cf1eb-3d5f-4f39-a6ff-b60e64e0a048 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 404 len: 111 microversion: 2.20 time: 0.084935 Aug 09 14:51:29.759222 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2072/4139] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:29 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:51:29.771026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-18530cc3-4077-4a80-b03b-e6a855d8917d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '.version_select at 0x7f41dd1eac10>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:29.831506 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-18530cc3-4077-4a80-b03b-e6a855d8917d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-947609621" status: 204 len: 0 microversion: 2.20 time: 0.066506 Aug 09 14:51:29.832127 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2073/4140] 10.222.0.50 () {60 vars in 1259 bytes} [Tue Aug 9 14:51:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-947609621 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:51:29.952795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-93dbc996-843a-4442-b641-21b849ee1ac0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:29.953658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-93dbc996-843a-4442-b641-21b849ee1ac0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:29.969980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93dbc996-843a-4442-b641-21b849ee1ac0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:29.970834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93dbc996-843a-4442-b641-21b849ee1ac0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:29.971611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93dbc996-843a-4442-b641-21b849ee1ac0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:29.974646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93dbc996-843a-4442-b641-21b849ee1ac0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:29.975330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93dbc996-843a-4442-b641-21b849ee1ac0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:29.975929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93dbc996-843a-4442-b641-21b849ee1ac0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:30.248742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7a9976a9-5e35-4430-a079-597d5d9b7d9a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:30.256742 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a9976a9-5e35-4430-a079-597d5d9b7d9a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1489 microversion: 2.1 time: 0.771462 Aug 09 14:51:30.271800 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2068/4141] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:29 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1489 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:30.283142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b67b632-23ca-4084-8883-b3d709e8db34 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:30.286054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b67b632-23ca-4084-8883-b3d709e8db34 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:30.301005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b67b632-23ca-4084-8883-b3d709e8db34 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:30.303016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b67b632-23ca-4084-8883-b3d709e8db34 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:30.303745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b67b632-23ca-4084-8883-b3d709e8db34 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:30.304762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b67b632-23ca-4084-8883-b3d709e8db34 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:30.305435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b67b632-23ca-4084-8883-b3d709e8db34 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:30.306107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b67b632-23ca-4084-8883-b3d709e8db34 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:30.319815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-93dbc996-843a-4442-b641-21b849ee1ac0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:30.332073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:30.336962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-93dbc996-843a-4442-b641-21b849ee1ac0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:30.337492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b67b632-23ca-4084-8883-b3d709e8db34 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:51:30.340896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-93dbc996-843a-4442-b641-21b849ee1ac0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:30.341988 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-93dbc996-843a-4442-b641-21b849ee1ac0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.393421 Aug 09 14:51:30.355115 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2074/4142] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:29 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:30.504671 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b67b632-23ca-4084-8883-b3d709e8db34 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 204 len: 0 microversion: 2.1 time: 0.225403 Aug 09 14:51:30.507748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b6c759b-19d4-4ca9-9744-42dd27ac06b0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:30.509025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b6c759b-19d4-4ca9-9744-42dd27ac06b0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:30.509954 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2069/4143] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:51:30 2022] DELETE /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:51:30.515628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b77ae8b0-0b9c-4c42-ad7c-ac1a5ba34e81 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:30.516642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b77ae8b0-0b9c-4c42-ad7c-ac1a5ba34e81 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:30.523147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b6c759b-19d4-4ca9-9744-42dd27ac06b0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:30.523769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b6c759b-19d4-4ca9-9744-42dd27ac06b0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:30.524095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b6c759b-19d4-4ca9-9744-42dd27ac06b0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:30.524357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:30.527928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b6c759b-19d4-4ca9-9744-42dd27ac06b0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:30.528748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b6c759b-19d4-4ca9-9744-42dd27ac06b0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:30.529913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b6c759b-19d4-4ca9-9744-42dd27ac06b0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:30.530614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b77ae8b0-0b9c-4c42-ad7c-ac1a5ba34e81 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:30.531136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b77ae8b0-0b9c-4c42-ad7c-ac1a5ba34e81 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:30.531576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b77ae8b0-0b9c-4c42-ad7c-ac1a5ba34e81 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:30.532298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b77ae8b0-0b9c-4c42-ad7c-ac1a5ba34e81 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:30.532742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b77ae8b0-0b9c-4c42-ad7c-ac1a5ba34e81 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:30.533172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b77ae8b0-0b9c-4c42-ad7c-ac1a5ba34e81 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:30.906442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b6c759b-19d4-4ca9-9744-42dd27ac06b0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:30.921133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b77ae8b0-0b9c-4c42-ad7c-ac1a5ba34e81 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:30.923034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b6c759b-19d4-4ca9-9744-42dd27ac06b0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:30.924834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b6c759b-19d4-4ca9-9744-42dd27ac06b0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:30.926242 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b6c759b-19d4-4ca9-9744-42dd27ac06b0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1660 microversion: 2.32 time: 0.423304 Aug 09 14:51:30.927330 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2075/4144] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:30 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1660 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:30.937065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0afa2087-5159-437a-8768-b93487237654 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:30.939717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0afa2087-5159-437a-8768-b93487237654 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:30.950156 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b77ae8b0-0b9c-4c42-ad7c-ac1a5ba34e81 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1495 microversion: 2.1 time: 0.438689 Aug 09 14:51:30.951452 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2070/4145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:30 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1495 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:30.954643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0afa2087-5159-437a-8768-b93487237654 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:30.955427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0afa2087-5159-437a-8768-b93487237654 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:30.956072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0afa2087-5159-437a-8768-b93487237654 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:30.956994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0afa2087-5159-437a-8768-b93487237654 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:30.960120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0afa2087-5159-437a-8768-b93487237654 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:30.960880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0afa2087-5159-437a-8768-b93487237654 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:31.210758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0afa2087-5159-437a-8768-b93487237654 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:31.220978 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0afa2087-5159-437a-8768-b93487237654 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1500 microversion: 2.1 time: 0.292413 Aug 09 14:51:31.233400 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2076/4146] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:30 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1500 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:31.244018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:31.254007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:31.266097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:31.267293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:31.271729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:31.272841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:31.273834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:31.274692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:31.303246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:31.312377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lazy-loading 'flavor' on Instance uuid 7e813d1b-4c53-4343-a42b-6692f9fc40b6 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:51:31.329036 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] HTTP exception thrown: Cannot 'rescue' instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 while it is in vm_state paused Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Request method failure captured: Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/action HTTP/1.1 Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 14 Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nQm9peRLyL-_ZL-9bNt1h-d9klu5PkrS_r357cpe12gMlxICQ1HHucyUskRO5kPygg95_v20_f9GCogcbu9CMWwyIZJ02lyqO-GFoRzdRBe_4fpq23MfQZHMH2nNzxDS_zNouresiy_aJnSNaognXLjQlW_aeA_R6cmhZY0LfELTto Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0caed61cb95467ba8b076c63f6706de", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cfd1981c518d4432b4635c1768114b22 Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: {"rescue": {}} Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: exception: Cannot 'rescue' instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 while it is in vm_state paused Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '7e813d1b-4c53-4343-a42b-6692f9fc40b6', 'body': {'rescue': {}}} Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 in vm_state paused. Cannot rescue while the instance is in this state. Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 while it is in vm_state paused Aug 09 14:51:31.331492 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:51:31.335976 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:51:31.335976 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:51:31.335976 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:31.335976 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:51:31.335976 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:51:31.335976 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:51:31.335976 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:51:31.335976 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 while it is in vm_state paused Aug 09 14:51:31.335976 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:51:31.337475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Returning 409 to user: Cannot 'rescue' instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 while it is in vm_state paused {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:51:31.338564 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-84081446-29da-4095-8df9-58d836476cff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/action" status: 409 len: 144 microversion: 2.1 time: 0.099274 Aug 09 14:51:31.339864 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2071/4147] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:51:31 2022] POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/action => generated 144 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:51:31.347911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d9b490f7-8ab0-4279-864b-7d8ce9439358 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:31.348663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d9b490f7-8ab0-4279-864b-7d8ce9439358 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:31.355162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9b490f7-8ab0-4279-864b-7d8ce9439358 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:31.355955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9b490f7-8ab0-4279-864b-7d8ce9439358 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:31.356624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9b490f7-8ab0-4279-864b-7d8ce9439358 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:31.357560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9b490f7-8ab0-4279-864b-7d8ce9439358 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:31.358215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9b490f7-8ab0-4279-864b-7d8ce9439358 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:31.358861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d9b490f7-8ab0-4279-864b-7d8ce9439358 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:31.362089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:31.372296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fd1cf5bd-5ba6-4f71-9590-5fd410c48539 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:31.372296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fd1cf5bd-5ba6-4f71-9590-5fd410c48539 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:31.387431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd1cf5bd-5ba6-4f71-9590-5fd410c48539 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:31.388681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd1cf5bd-5ba6-4f71-9590-5fd410c48539 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:31.389139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd1cf5bd-5ba6-4f71-9590-5fd410c48539 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:31.390010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd1cf5bd-5ba6-4f71-9590-5fd410c48539 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:31.390855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd1cf5bd-5ba6-4f71-9590-5fd410c48539 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:31.395703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd1cf5bd-5ba6-4f71-9590-5fd410c48539 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:31.488903 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d9b490f7-8ab0-4279-864b-7d8ce9439358 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/action" status: 202 len: 0 microversion: 2.1 time: 0.144580 Aug 09 14:51:31.492959 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2077/4148] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:51:31 2022] POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:51:31.500584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae042926-5249-4263-b995-c2b7c89cfc9f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:31.501532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae042926-5249-4263-b995-c2b7c89cfc9f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:31.506226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fd1cf5bd-5ba6-4f71-9590-5fd410c48539 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:31.509834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae042926-5249-4263-b995-c2b7c89cfc9f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:31.510591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae042926-5249-4263-b995-c2b7c89cfc9f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:31.511548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae042926-5249-4263-b995-c2b7c89cfc9f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:31.512753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae042926-5249-4263-b995-c2b7c89cfc9f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:31.513444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae042926-5249-4263-b995-c2b7c89cfc9f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:31.514024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae042926-5249-4263-b995-c2b7c89cfc9f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:31.538142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fd1cf5bd-5ba6-4f71-9590-5fd410c48539 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:31.541050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fd1cf5bd-5ba6-4f71-9590-5fd410c48539 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:31.542876 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fd1cf5bd-5ba6-4f71-9590-5fd410c48539 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.177539 Aug 09 14:51:31.544957 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2072/4149] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:31 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:31.722451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ae042926-5249-4263-b995-c2b7c89cfc9f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:31.747036 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae042926-5249-4263-b995-c2b7c89cfc9f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1507 microversion: 2.1 time: 0.252434 Aug 09 14:51:31.748517 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2078/4150] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:31 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:31.954398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ac4a4c67-0432-4e4e-b80e-c0ebefc5525c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:31.956008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ac4a4c67-0432-4e4e-b80e-c0ebefc5525c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:31.965971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac4a4c67-0432-4e4e-b80e-c0ebefc5525c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:31.966691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac4a4c67-0432-4e4e-b80e-c0ebefc5525c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:31.967521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac4a4c67-0432-4e4e-b80e-c0ebefc5525c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:31.968435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac4a4c67-0432-4e4e-b80e-c0ebefc5525c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:31.975121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-461c294a-b47e-45dd-92e5-1487af02e816 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:31.976038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-461c294a-b47e-45dd-92e5-1487af02e816 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:31.981036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac4a4c67-0432-4e4e-b80e-c0ebefc5525c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:31.982071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac4a4c67-0432-4e4e-b80e-c0ebefc5525c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:31.985434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461c294a-b47e-45dd-92e5-1487af02e816 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:31.989839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461c294a-b47e-45dd-92e5-1487af02e816 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:31.992547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461c294a-b47e-45dd-92e5-1487af02e816 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:31.998072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461c294a-b47e-45dd-92e5-1487af02e816 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:31.998978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461c294a-b47e-45dd-92e5-1487af02e816 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:31.999553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461c294a-b47e-45dd-92e5-1487af02e816 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:32.596144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:32.759660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac4a4c67-0432-4e4e-b80e-c0ebefc5525c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:32.774460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac4a4c67-0432-4e4e-b80e-c0ebefc5525c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:32.776919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac4a4c67-0432-4e4e-b80e-c0ebefc5525c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:32.779367 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ac4a4c67-0432-4e4e-b80e-c0ebefc5525c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1752 microversion: 2.32 time: 0.829152 Aug 09 14:51:32.781551 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2073/4151] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:31 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1752 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:32.793476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e004ca63-4f02-4afa-a53a-134caf46f173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Action: 'create', calling method: .version_select at 0x7f41dd40be50>, body: {"keypair": {"name": "tempest-keypair-11659598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCieDzhnjjGuPyokueao/xIiMxwWOzs8BK2GBigSJxmXfaVtU+gWMBRq32pEKkBmxSALPcsX4qep6jpkirC17fpLIBTBfBXJljHioh+PpXbBnfudBv5J/PJ5tcIhsJexKA=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:32.800110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-461c294a-b47e-45dd-92e5-1487af02e816 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:32.809122 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-461c294a-b47e-45dd-92e5-1487af02e816 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1495 microversion: 2.1 time: 0.839113 Aug 09 14:51:32.812556 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2079/4152] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:31 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1495 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:51:32.823932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-808165b4-d814-489d-9300-b28713100080 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:32.827233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-808165b4-d814-489d-9300-b28713100080 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:32.833880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-808165b4-d814-489d-9300-b28713100080 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:32.834340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e004ca63-4f02-4afa-a53a-134caf46f173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Getting quotas for project cd7add50097c4b84859dbfac51473919. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:51:32.835507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-808165b4-d814-489d-9300-b28713100080 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:32.836191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-808165b4-d814-489d-9300-b28713100080 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:32.837111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-808165b4-d814-489d-9300-b28713100080 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:32.837776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-808165b4-d814-489d-9300-b28713100080 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:32.838409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-808165b4-d814-489d-9300-b28713100080 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:32.850639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e004ca63-4f02-4afa-a53a-134caf46f173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Getting quotas for user 13b12146c9774e9c8360d7535e43bfe3 and project cd7add50097c4b84859dbfac51473919. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:51:32.908873 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e004ca63-4f02-4afa-a53a-134caf46f173 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.122651 Aug 09 14:51:32.909767 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2074/4153] 10.222.0.50 () {62 vars in 1200 bytes} [Tue Aug 9 14:51:32 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 14:51:32.923484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78e8b401-7050-46bf-9e11-88baa6671653 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:32.924442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-78e8b401-7050-46bf-9e11-88baa6671653 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:32.933078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-808165b4-d814-489d-9300-b28713100080 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:32.935028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78e8b401-7050-46bf-9e11-88baa6671653 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:32.935724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78e8b401-7050-46bf-9e11-88baa6671653 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:32.937454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78e8b401-7050-46bf-9e11-88baa6671653 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:32.939972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78e8b401-7050-46bf-9e11-88baa6671653 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:32.941134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78e8b401-7050-46bf-9e11-88baa6671653 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:32.942867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78e8b401-7050-46bf-9e11-88baa6671653 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:32.949625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-808165b4-d814-489d-9300-b28713100080 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:32.954525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-808165b4-d814-489d-9300-b28713100080 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:32.956106 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-808165b4-d814-489d-9300-b28713100080 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.140353 Aug 09 14:51:32.956716 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2080/4154] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:32 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:33.180940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-78e8b401-7050-46bf-9e11-88baa6671653 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:33.193437 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78e8b401-7050-46bf-9e11-88baa6671653 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1515 microversion: 2.1 time: 0.274562 Aug 09 14:51:33.194672 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2075/4155] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:32 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:33.462973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-194f2b67-f20a-4c98-a42d-8be38400e463 req-3a0db60b-6d74-4a2f-906a-f4a142c4b29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a147d07-f2a5-4ecc-a667-295abf7b5da3", "name": "network-vif-deleted", "tag": "17b9582e-5700-4af8-9288-7bacc95f529b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:33.494473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-194f2b67-f20a-4c98-a42d-8be38400e463 req-3a0db60b-6d74-4a2f-906a-f4a142c4b29e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:33.495975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-194f2b67-f20a-4c98-a42d-8be38400e463 req-3a0db60b-6d74-4a2f-906a-f4a142c4b29e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:33.496674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-194f2b67-f20a-4c98-a42d-8be38400e463 req-3a0db60b-6d74-4a2f-906a-f4a142c4b29e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:33.520890 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-194f2b67-f20a-4c98-a42d-8be38400e463 req-3a0db60b-6d74-4a2f-906a-f4a142c4b29e service nova] Creating event network-vif-deleted:17b9582e-5700-4af8-9288-7bacc95f529b for instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 on n-h1-844626-8 Aug 09 14:51:33.527247 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-194f2b67-f20a-4c98-a42d-8be38400e463 req-3a0db60b-6d74-4a2f-906a-f4a142c4b29e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210357 Aug 09 14:51:33.528435 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2081/4156] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:33.821065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd307ffc-a178-47a4-bf2b-865744dd8876 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:33.822177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd307ffc-a178-47a4-bf2b-865744dd8876 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:33.833521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:33.834201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:33.841812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:33.842302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:33.843531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd307ffc-a178-47a4-bf2b-865744dd8876 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:33.844296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd307ffc-a178-47a4-bf2b-865744dd8876 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:33.844966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd307ffc-a178-47a4-bf2b-865744dd8876 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:33.846064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd307ffc-a178-47a4-bf2b-865744dd8876 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:33.846716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd307ffc-a178-47a4-bf2b-865744dd8876 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:33.847395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd307ffc-a178-47a4-bf2b-865744dd8876 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:33.850830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:33.855961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:33.856665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:33.857255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:33.926486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:33.927380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:33.928032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:33.929260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lazy-loading 'fault' on Instance uuid 4a147d07-f2a5-4ecc-a667-295abf7b5da3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:51:34.071932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:34.082640 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4fb2acff-4fa0-433f-84e4-65b5e0a7f08c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 200 len: 1305 microversion: 2.1 time: 0.253171 Aug 09 14:51:34.087326 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2082/4157] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:33 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 1305 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:34.096813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bcfff15d-403b-4cd0-a0c7-52793aee68ab tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:34.101256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bcfff15d-403b-4cd0-a0c7-52793aee68ab tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:34.108304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfff15d-403b-4cd0-a0c7-52793aee68ab tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:34.109223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfff15d-403b-4cd0-a0c7-52793aee68ab tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:34.110044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfff15d-403b-4cd0-a0c7-52793aee68ab tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:34.111011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfff15d-403b-4cd0-a0c7-52793aee68ab tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:34.111801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfff15d-403b-4cd0-a0c7-52793aee68ab tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:34.112551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bcfff15d-403b-4cd0-a0c7-52793aee68ab tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:34.287033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd307ffc-a178-47a4-bf2b-865744dd8876 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:34.303614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bcfff15d-403b-4cd0-a0c7-52793aee68ab tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:34.307725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd307ffc-a178-47a4-bf2b-865744dd8876 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:34.311682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd307ffc-a178-47a4-bf2b-865744dd8876 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:34.313233 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd307ffc-a178-47a4-bf2b-865744dd8876 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1798 microversion: 2.32 time: 0.504290 Aug 09 14:51:34.327114 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2076/4158] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:33 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1798 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:34.327343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bcfff15d-403b-4cd0-a0c7-52793aee68ab tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:34.327343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bcfff15d-403b-4cd0-a0c7-52793aee68ab tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:34.327343 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bcfff15d-403b-4cd0-a0c7-52793aee68ab tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.230060 Aug 09 14:51:34.339620 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2083/4159] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:34 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:35.105858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf7b9e37-13f6-407b-b032-c8ca3c3b7721 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:35.106637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf7b9e37-13f6-407b-b032-c8ca3c3b7721 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:35.117189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf7b9e37-13f6-407b-b032-c8ca3c3b7721 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:35.123732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf7b9e37-13f6-407b-b032-c8ca3c3b7721 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:35.124226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf7b9e37-13f6-407b-b032-c8ca3c3b7721 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:35.125104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf7b9e37-13f6-407b-b032-c8ca3c3b7721 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:35.125830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf7b9e37-13f6-407b-b032-c8ca3c3b7721 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:35.126255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf7b9e37-13f6-407b-b032-c8ca3c3b7721 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:35.168367 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-bf7b9e37-13f6-407b-b032-c8ca3c3b7721 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf7b9e37-13f6-407b-b032-c8ca3c3b7721 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 HTTP/1.1 Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '4a147d07-f2a5-4ecc-a667-295abf7b5da3'} Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:51:35.170079 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:51:35.174058 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:35.174058 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:51:35.174058 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:51:35.174058 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:51:35.174058 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:51:35.174058 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:51:35.174058 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:51:35.174058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf7b9e37-13f6-407b-b032-c8ca3c3b7721 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:51:35.174058 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf7b9e37-13f6-407b-b032-c8ca3c3b7721 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 404 len: 111 microversion: 2.1 time: 0.070006 Aug 09 14:51:35.175742 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2077/4160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:35 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:51:35.339330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6348da12-c909-4f33-a435-bb8cfa90c95e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:35.341984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6348da12-c909-4f33-a435-bb8cfa90c95e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:35.346950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f806e1b6-43fe-41fe-bbc8-31e68ce2f7dd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:35.347792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f806e1b6-43fe-41fe-bbc8-31e68ce2f7dd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:35.355703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f806e1b6-43fe-41fe-bbc8-31e68ce2f7dd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:35.361213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f806e1b6-43fe-41fe-bbc8-31e68ce2f7dd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:35.362098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f806e1b6-43fe-41fe-bbc8-31e68ce2f7dd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:35.363566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f806e1b6-43fe-41fe-bbc8-31e68ce2f7dd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:35.365500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f806e1b6-43fe-41fe-bbc8-31e68ce2f7dd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:35.367053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f806e1b6-43fe-41fe-bbc8-31e68ce2f7dd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:35.370004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6348da12-c909-4f33-a435-bb8cfa90c95e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:35.370750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6348da12-c909-4f33-a435-bb8cfa90c95e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:35.371409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6348da12-c909-4f33-a435-bb8cfa90c95e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:35.372498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6348da12-c909-4f33-a435-bb8cfa90c95e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:35.373161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6348da12-c909-4f33-a435-bb8cfa90c95e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:35.373805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6348da12-c909-4f33-a435-bb8cfa90c95e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:35.528130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f806e1b6-43fe-41fe-bbc8-31e68ce2f7dd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:35.542065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f806e1b6-43fe-41fe-bbc8-31e68ce2f7dd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:35.544299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f806e1b6-43fe-41fe-bbc8-31e68ce2f7dd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:35.545784 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f806e1b6-43fe-41fe-bbc8-31e68ce2f7dd tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.202965 Aug 09 14:51:35.546878 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2078/4161] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:35 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:35.551806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-77616855", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:35.612647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] validate_networks() for [('583a2fa9-0f81-494a-9b4d-b0d8fdcfb08a', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:51:35.863047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6348da12-c909-4f33-a435-bb8cfa90c95e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:35.880279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6348da12-c909-4f33-a435-bb8cfa90c95e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:35.882727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6348da12-c909-4f33-a435-bb8cfa90c95e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:35.884796 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6348da12-c909-4f33-a435-bb8cfa90c95e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1844 microversion: 2.32 time: 0.549759 Aug 09 14:51:35.907509 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2084/4162] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:35 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1844 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:36.255576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-536943314", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3fb950fa-ff8d-422a-85c2-70f980c88e78"}], "security_groups": [{"name": "tempest-securitygroup--1121468861"}], "key_name": "tempest-keypair-11659598", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:36.530015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] validate_networks() for [('3fb950fa-ff8d-422a-85c2-70f980c88e78', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:51:36.534480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:51:36.535024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:51:36.535707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:51:36.536653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:51:36.537574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:51:36.549641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:36.550425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:36.551789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:36.553071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:36.555113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:36.557513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:36.593916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:51:36.601190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Getting quotas for user d970d0bf9e754591b09af75bbf64a96d and project 74ba1baccbed4737aff5a8aa5d0f8665. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:51:36.617627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:51:36.620749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:51:36.681076 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d64150bf-c90e-429b-b1ab-2a03c5121813 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.132798 Aug 09 14:51:36.682436 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2079/4163] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:51:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:51:36.691833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-505232df-45df-4c51-9d49-b90ec8fb9193 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:36.692804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-505232df-45df-4c51-9d49-b90ec8fb9193 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:36.704074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-505232df-45df-4c51-9d49-b90ec8fb9193 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:36.704959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-505232df-45df-4c51-9d49-b90ec8fb9193 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:36.705854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-505232df-45df-4c51-9d49-b90ec8fb9193 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:36.706997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-505232df-45df-4c51-9d49-b90ec8fb9193 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:36.707674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-505232df-45df-4c51-9d49-b90ec8fb9193 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:36.708981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-505232df-45df-4c51-9d49-b90ec8fb9193 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:36.836417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-505232df-45df-4c51-9d49-b90ec8fb9193 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:36.850191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-505232df-45df-4c51-9d49-b90ec8fb9193 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:36.852933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-505232df-45df-4c51-9d49-b90ec8fb9193 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:36.854866 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-505232df-45df-4c51-9d49-b90ec8fb9193 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.171097 Aug 09 14:51:36.871064 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2080/4164] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:36 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:36.876105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-78a38b25-4a0e-46b4-9eb0-863fea518c60 req-202564b4-3fee-4cfd-8800-78193f54fc20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "tag": "1bbb6bc7-df59-43ad-bd7e-3c6cac208995"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:36.915764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-78a38b25-4a0e-46b4-9eb0-863fea518c60 req-202564b4-3fee-4cfd-8800-78193f54fc20 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:36.918626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-78a38b25-4a0e-46b4-9eb0-863fea518c60 req-202564b4-3fee-4cfd-8800-78193f54fc20 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:36.919198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-78a38b25-4a0e-46b4-9eb0-863fea518c60 req-202564b4-3fee-4cfd-8800-78193f54fc20 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:36.949156 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-78a38b25-4a0e-46b4-9eb0-863fea518c60 req-202564b4-3fee-4cfd-8800-78193f54fc20 service nova] Creating event network-changed:1bbb6bc7-df59-43ad-bd7e-3c6cac208995 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:51:36.963460 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-78a38b25-4a0e-46b4-9eb0-863fea518c60 req-202564b4-3fee-4cfd-8800-78193f54fc20 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099057 Aug 09 14:51:36.964078 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2081/4165] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:36.969145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-65a4989c-25d1-410f-976b-5fa7d671ea89 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:36.969915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-65a4989c-25d1-410f-976b-5fa7d671ea89 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:37.292776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-65a4989c-25d1-410f-976b-5fa7d671ea89 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:37.302092 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-65a4989c-25d1-410f-976b-5fa7d671ea89 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1213 microversion: 2.1 time: 0.336755 Aug 09 14:51:37.305601 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2082/4166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:36 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1213 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:37.313920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-97b4f20f-fa99-4f30-9ca8-48976e813a47 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:37.314740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-97b4f20f-fa99-4f30-9ca8-48976e813a47 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:37.339292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97b4f20f-fa99-4f30-9ca8-48976e813a47 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:37.341559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97b4f20f-fa99-4f30-9ca8-48976e813a47 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:37.342305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97b4f20f-fa99-4f30-9ca8-48976e813a47 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:37.343664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97b4f20f-fa99-4f30-9ca8-48976e813a47 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:37.345397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97b4f20f-fa99-4f30-9ca8-48976e813a47 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:37.346146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97b4f20f-fa99-4f30-9ca8-48976e813a47 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:38.661565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-97b4f20f-fa99-4f30-9ca8-48976e813a47 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:38.699127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-97b4f20f-fa99-4f30-9ca8-48976e813a47 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:38.702758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-97b4f20f-fa99-4f30-9ca8-48976e813a47 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:38.710663 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-97b4f20f-fa99-4f30-9ca8-48976e813a47 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1844 microversion: 2.32 time: 1.402856 Aug 09 14:51:38.713776 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2083/4167] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:37 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1844 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:38.728197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3ce05d81-289e-42d6-8720-56fe695da3cc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:38.731262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3ce05d81-289e-42d6-8720-56fe695da3cc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:38.767959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ce05d81-289e-42d6-8720-56fe695da3cc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:38.770366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ce05d81-289e-42d6-8720-56fe695da3cc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:38.771002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ce05d81-289e-42d6-8720-56fe695da3cc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:38.772153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ce05d81-289e-42d6-8720-56fe695da3cc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:38.775673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ce05d81-289e-42d6-8720-56fe695da3cc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:38.776307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ce05d81-289e-42d6-8720-56fe695da3cc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:39.037022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3ce05d81-289e-42d6-8720-56fe695da3cc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:39.053518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3ce05d81-289e-42d6-8720-56fe695da3cc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:39.057143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3ce05d81-289e-42d6-8720-56fe695da3cc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:39.079692 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3ce05d81-289e-42d6-8720-56fe695da3cc tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.351979 Aug 09 14:51:39.080641 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2084/4168] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:38 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:39.087608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32558c63-b892-4052-b13c-ed36b188d768 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:39.088514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32558c63-b892-4052-b13c-ed36b188d768 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:39.120116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32558c63-b892-4052-b13c-ed36b188d768 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:39.121992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32558c63-b892-4052-b13c-ed36b188d768 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:39.124076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32558c63-b892-4052-b13c-ed36b188d768 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:39.126478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:51:39.127606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32558c63-b892-4052-b13c-ed36b188d768 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:39.128716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32558c63-b892-4052-b13c-ed36b188d768 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:39.130641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:51:39.130789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32558c63-b892-4052-b13c-ed36b188d768 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:39.131470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:51:39.136079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:51:39.136705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:51:39.197601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:39.198526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:39.199151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:39.211459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:39.214906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:39.215485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:39.241165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Getting quotas for project cd7add50097c4b84859dbfac51473919. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:51:39.249750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Getting quotas for user 13b12146c9774e9c8360d7535e43bfe3 and project cd7add50097c4b84859dbfac51473919. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:51:39.278917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:51:39.281653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:51:39.333363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-32558c63-b892-4052-b13c-ed36b188d768 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:39.349799 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32558c63-b892-4052-b13c-ed36b188d768 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1271 microversion: 2.1 time: 0.264966 Aug 09 14:51:39.352661 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2085/4169] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:39 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:39.379146 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39a17f8d-1126-4ae9-b631-82537ae681ef tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.124302 Aug 09 14:51:39.380403 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2085/4170] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:51:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 3132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 09 14:51:39.393326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf9eb399-7929-4d0d-ab55-8a3b1291ef0d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:39.394116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cf9eb399-7929-4d0d-ab55-8a3b1291ef0d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:39.540952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf9eb399-7929-4d0d-ab55-8a3b1291ef0d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:39.554039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf9eb399-7929-4d0d-ab55-8a3b1291ef0d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:39.557309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf9eb399-7929-4d0d-ab55-8a3b1291ef0d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:39.561981 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf9eb399-7929-4d0d-ab55-8a3b1291ef0d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1279 microversion: 2.20 time: 0.174425 Aug 09 14:51:39.563775 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2086/4171] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:39 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:39.720360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-a5cec511-e71a-4afd-8bc5-c24e7909a1d5 req-17c9235c-107d-4efe-b640-569be3203dfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "tag": "7256ee05-5624-4366-8ab1-5a16dfac3445"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:39.741245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7af8af4d-3084-43b1-8fda-72efb123b060 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:39.742046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7af8af4d-3084-43b1-8fda-72efb123b060 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:39.744189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a5cec511-e71a-4afd-8bc5-c24e7909a1d5 req-17c9235c-107d-4efe-b640-569be3203dfe service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:39.746965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a5cec511-e71a-4afd-8bc5-c24e7909a1d5 req-17c9235c-107d-4efe-b640-569be3203dfe service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:39.748028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a5cec511-e71a-4afd-8bc5-c24e7909a1d5 req-17c9235c-107d-4efe-b640-569be3203dfe service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:39.753366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7af8af4d-3084-43b1-8fda-72efb123b060 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:39.754931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7af8af4d-3084-43b1-8fda-72efb123b060 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:39.756139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7af8af4d-3084-43b1-8fda-72efb123b060 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:39.760397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7af8af4d-3084-43b1-8fda-72efb123b060 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:39.761001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7af8af4d-3084-43b1-8fda-72efb123b060 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:39.761913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7af8af4d-3084-43b1-8fda-72efb123b060 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:39.779417 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-a5cec511-e71a-4afd-8bc5-c24e7909a1d5 req-17c9235c-107d-4efe-b640-569be3203dfe service nova] Creating event network-changed:7256ee05-5624-4366-8ab1-5a16dfac3445 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:51:39.803968 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-a5cec511-e71a-4afd-8bc5-c24e7909a1d5 req-17c9235c-107d-4efe-b640-569be3203dfe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089196 Aug 09 14:51:39.808703 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2086/4172] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:51:40.106363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ad4d50b-cfaa-443e-a98b-854d843d52e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:40.108056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ad4d50b-cfaa-443e-a98b-854d843d52e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:40.123894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ad4d50b-cfaa-443e-a98b-854d843d52e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:40.124695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ad4d50b-cfaa-443e-a98b-854d843d52e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:40.125364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ad4d50b-cfaa-443e-a98b-854d843d52e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:40.127682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ad4d50b-cfaa-443e-a98b-854d843d52e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:40.130660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ad4d50b-cfaa-443e-a98b-854d843d52e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:40.131387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ad4d50b-cfaa-443e-a98b-854d843d52e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:40.385669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ad4d50b-cfaa-443e-a98b-854d843d52e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:40.417890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ad4d50b-cfaa-443e-a98b-854d843d52e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:40.428147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ad4d50b-cfaa-443e-a98b-854d843d52e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:40.434210 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ad4d50b-cfaa-443e-a98b-854d843d52e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.331314 Aug 09 14:51:40.438711 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2087/4173] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:40 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:40.461214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd510c73-1bed-45a5-a9e7-d37847abe931 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:40.464952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd510c73-1bed-45a5-a9e7-d37847abe931 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:40.493118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd510c73-1bed-45a5-a9e7-d37847abe931 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:40.496337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd510c73-1bed-45a5-a9e7-d37847abe931 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:40.497033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd510c73-1bed-45a5-a9e7-d37847abe931 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:40.500492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd510c73-1bed-45a5-a9e7-d37847abe931 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:40.501793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd510c73-1bed-45a5-a9e7-d37847abe931 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:40.502543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd510c73-1bed-45a5-a9e7-d37847abe931 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:40.619745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7af8af4d-3084-43b1-8fda-72efb123b060 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:40.664567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7af8af4d-3084-43b1-8fda-72efb123b060 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:40.671414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7af8af4d-3084-43b1-8fda-72efb123b060 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:40.673210 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7af8af4d-3084-43b1-8fda-72efb123b060 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1865 microversion: 2.32 time: 0.936123 Aug 09 14:51:40.673810 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2087/4174] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:39 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1865 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:40.691339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16c3bca4-6e33-42f7-aa66-325729f93857 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:40.696836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-16c3bca4-6e33-42f7-aa66-325729f93857 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:40.717345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16c3bca4-6e33-42f7-aa66-325729f93857 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:40.717883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16c3bca4-6e33-42f7-aa66-325729f93857 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:40.718362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16c3bca4-6e33-42f7-aa66-325729f93857 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:40.719063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16c3bca4-6e33-42f7-aa66-325729f93857 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:40.719739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16c3bca4-6e33-42f7-aa66-325729f93857 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:40.720157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16c3bca4-6e33-42f7-aa66-325729f93857 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:40.947257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-16c3bca4-6e33-42f7-aa66-325729f93857 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:40.971695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-16c3bca4-6e33-42f7-aa66-325729f93857 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:40.971695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-16c3bca4-6e33-42f7-aa66-325729f93857 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:40.971695 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16c3bca4-6e33-42f7-aa66-325729f93857 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1275 microversion: 2.20 time: 0.291505 Aug 09 14:51:40.971695 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2088/4175] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:40 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1275 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:40.990182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e2f7370-fee5-456b-a189-1e6d9c97a9a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:40.993981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9e2f7370-fee5-456b-a189-1e6d9c97a9a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:41.030225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e2f7370-fee5-456b-a189-1e6d9c97a9a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:41.039648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fd510c73-1bed-45a5-a9e7-d37847abe931 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:41.040012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e2f7370-fee5-456b-a189-1e6d9c97a9a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:41.040504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e2f7370-fee5-456b-a189-1e6d9c97a9a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:41.048044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e2f7370-fee5-456b-a189-1e6d9c97a9a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:41.052054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e2f7370-fee5-456b-a189-1e6d9c97a9a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:41.052520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e2f7370-fee5-456b-a189-1e6d9c97a9a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:41.053727 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd510c73-1bed-45a5-a9e7-d37847abe931 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1313 microversion: 2.1 time: 0.610868 Aug 09 14:51:41.067540 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2088/4176] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:40 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:41.075251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:41.171690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-9e2f7370-fee5-456b-a189-1e6d9c97a9a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lazy-loading 'flavor' on Instance uuid 7e813d1b-4c53-4343-a42b-6692f9fc40b6 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:51:41.368138 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e2f7370-fee5-456b-a189-1e6d9c97a9a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/action" status: 200 len: 32 microversion: 2.1 time: 0.394447 Aug 09 14:51:41.371365 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2089/4177] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:51:40 2022] POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/action => generated 32 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:51:41.379830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84bf2643-fc81-43f3-b66a-34a8976b48a4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:41.386467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84bf2643-fc81-43f3-b66a-34a8976b48a4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:41.409567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bf2643-fc81-43f3-b66a-34a8976b48a4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:41.414468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bf2643-fc81-43f3-b66a-34a8976b48a4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:41.415028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bf2643-fc81-43f3-b66a-34a8976b48a4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:41.416345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bf2643-fc81-43f3-b66a-34a8976b48a4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:41.423998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bf2643-fc81-43f3-b66a-34a8976b48a4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:41.424510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bf2643-fc81-43f3-b66a-34a8976b48a4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:41.465022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-54601a97-73a0-44bf-a82c-6c92e3efd8d0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:41.466042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-54601a97-73a0-44bf-a82c-6c92e3efd8d0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:41.478564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54601a97-73a0-44bf-a82c-6c92e3efd8d0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:41.479526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54601a97-73a0-44bf-a82c-6c92e3efd8d0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:41.480221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54601a97-73a0-44bf-a82c-6c92e3efd8d0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:41.481474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54601a97-73a0-44bf-a82c-6c92e3efd8d0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:41.482307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54601a97-73a0-44bf-a82c-6c92e3efd8d0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:41.483118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54601a97-73a0-44bf-a82c-6c92e3efd8d0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:41.760091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-54601a97-73a0-44bf-a82c-6c92e3efd8d0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:41.785304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-54601a97-73a0-44bf-a82c-6c92e3efd8d0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:41.793654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-54601a97-73a0-44bf-a82c-6c92e3efd8d0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:41.798791 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-54601a97-73a0-44bf-a82c-6c92e3efd8d0 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.339950 Aug 09 14:51:41.802493 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2090/4178] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:41 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:41.816452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-566a4314-575a-4aa3-92e0-ab2a04a9e8ca tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:41.819320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-566a4314-575a-4aa3-92e0-ab2a04a9e8ca tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:41.839332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-566a4314-575a-4aa3-92e0-ab2a04a9e8ca tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:41.847891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-566a4314-575a-4aa3-92e0-ab2a04a9e8ca tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:41.848575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-566a4314-575a-4aa3-92e0-ab2a04a9e8ca tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:41.849461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-566a4314-575a-4aa3-92e0-ab2a04a9e8ca tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:41.850056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-566a4314-575a-4aa3-92e0-ab2a04a9e8ca tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:41.850619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-566a4314-575a-4aa3-92e0-ab2a04a9e8ca tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:42.278954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-84bf2643-fc81-43f3-b66a-34a8976b48a4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:42.291075 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84bf2643-fc81-43f3-b66a-34a8976b48a4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1521 microversion: 2.1 time: 0.915086 Aug 09 14:51:42.308674 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2089/4179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:41 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1521 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:42.337381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8bbd42c-3a3f-4229-9d5f-83912d4dbb73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:42.338310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8bbd42c-3a3f-4229-9d5f-83912d4dbb73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:42.345829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bbd42c-3a3f-4229-9d5f-83912d4dbb73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:42.346692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bbd42c-3a3f-4229-9d5f-83912d4dbb73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:42.347491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bbd42c-3a3f-4229-9d5f-83912d4dbb73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:42.348426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bbd42c-3a3f-4229-9d5f-83912d4dbb73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:42.349094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bbd42c-3a3f-4229-9d5f-83912d4dbb73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:42.349744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8bbd42c-3a3f-4229-9d5f-83912d4dbb73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:42.631397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f8bbd42c-3a3f-4229-9d5f-83912d4dbb73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:42.644284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f8bbd42c-3a3f-4229-9d5f-83912d4dbb73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:42.646064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f8bbd42c-3a3f-4229-9d5f-83912d4dbb73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:42.647252 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8bbd42c-3a3f-4229-9d5f-83912d4dbb73 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1337 microversion: 2.20 time: 0.319492 Aug 09 14:51:42.647946 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2090/4180] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:42 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1337 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:42.663574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1523d27d-3b6d-43fe-9ce6-9b6bfcd9f6e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:42.664634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1523d27d-3b6d-43fe-9ce6-9b6bfcd9f6e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:42.677042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1523d27d-3b6d-43fe-9ce6-9b6bfcd9f6e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:42.677790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1523d27d-3b6d-43fe-9ce6-9b6bfcd9f6e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:42.678418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1523d27d-3b6d-43fe-9ce6-9b6bfcd9f6e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:42.679931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1523d27d-3b6d-43fe-9ce6-9b6bfcd9f6e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:42.682926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1523d27d-3b6d-43fe-9ce6-9b6bfcd9f6e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:42.683581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1523d27d-3b6d-43fe-9ce6-9b6bfcd9f6e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:43.548725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-566a4314-575a-4aa3-92e0-ab2a04a9e8ca tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:43.565980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-566a4314-575a-4aa3-92e0-ab2a04a9e8ca tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:43.567501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-566a4314-575a-4aa3-92e0-ab2a04a9e8ca tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:43.568692 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-566a4314-575a-4aa3-92e0-ab2a04a9e8ca tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1886 microversion: 2.32 time: 1.764511 Aug 09 14:51:43.569256 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2091/4181] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:41 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1886 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:43.591317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-728c8500-cc60-4bc3-9e62-bfa0a05a0141 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:43.592181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-728c8500-cc60-4bc3-9e62-bfa0a05a0141 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:43.604473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-728c8500-cc60-4bc3-9e62-bfa0a05a0141 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:43.605001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-728c8500-cc60-4bc3-9e62-bfa0a05a0141 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:43.605385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-728c8500-cc60-4bc3-9e62-bfa0a05a0141 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:43.606095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-728c8500-cc60-4bc3-9e62-bfa0a05a0141 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:43.606540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-728c8500-cc60-4bc3-9e62-bfa0a05a0141 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:43.606957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-728c8500-cc60-4bc3-9e62-bfa0a05a0141 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:43.805344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-728c8500-cc60-4bc3-9e62-bfa0a05a0141 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:43.823640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-728c8500-cc60-4bc3-9e62-bfa0a05a0141 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:43.829866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-728c8500-cc60-4bc3-9e62-bfa0a05a0141 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:43.832173 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-728c8500-cc60-4bc3-9e62-bfa0a05a0141 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.251009 Aug 09 14:51:43.850349 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2092/4182] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:43 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:43.850349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a9f1b356-b038-4ead-a160-f583e9e660d3 req-1aa75646-694f-4540-8c5d-135a833a2e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "tag": "22a7aaf5-6350-415b-823f-52781cbb73ee"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:43.871644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a9f1b356-b038-4ead-a160-f583e9e660d3 req-1aa75646-694f-4540-8c5d-135a833a2e0f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:43.873590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a9f1b356-b038-4ead-a160-f583e9e660d3 req-1aa75646-694f-4540-8c5d-135a833a2e0f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:43.874149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a9f1b356-b038-4ead-a160-f583e9e660d3 req-1aa75646-694f-4540-8c5d-135a833a2e0f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:43.908140 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a9f1b356-b038-4ead-a160-f583e9e660d3 req-1aa75646-694f-4540-8c5d-135a833a2e0f service nova] Creating event network-changed:22a7aaf5-6350-415b-823f-52781cbb73ee for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:51:43.915236 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a9f1b356-b038-4ead-a160-f583e9e660d3 req-1aa75646-694f-4540-8c5d-135a833a2e0f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076874 Aug 09 14:51:43.916769 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2093/4183] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:43.922925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de38ee4a-e87a-4eff-b286-91094a5b90aa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:43.923860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de38ee4a-e87a-4eff-b286-91094a5b90aa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:43.933322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de38ee4a-e87a-4eff-b286-91094a5b90aa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:43.934249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de38ee4a-e87a-4eff-b286-91094a5b90aa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:43.934939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de38ee4a-e87a-4eff-b286-91094a5b90aa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:43.935947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de38ee4a-e87a-4eff-b286-91094a5b90aa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:43.936660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de38ee4a-e87a-4eff-b286-91094a5b90aa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:43.937817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de38ee4a-e87a-4eff-b286-91094a5b90aa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:44.074309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1523d27d-3b6d-43fe-9ce6-9b6bfcd9f6e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:44.088742 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1523d27d-3b6d-43fe-9ce6-9b6bfcd9f6e4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1313 microversion: 2.1 time: 1.434746 Aug 09 14:51:44.090139 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2091/4184] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:42 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1313 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:44.103255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c4c1123d-1b04-4486-b893-c3ab3238e24e req-71ad423f-7b48-48a3-9a4d-e43ba27b7374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13df3ce4-02eb-4393-bb6b-d72ab806dc2a", "tag": "30faceb9-ce6e-49b0-9521-b0b40b2ff926"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:44.124278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c4c1123d-1b04-4486-b893-c3ab3238e24e req-71ad423f-7b48-48a3-9a4d-e43ba27b7374 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:44.128578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c4c1123d-1b04-4486-b893-c3ab3238e24e req-71ad423f-7b48-48a3-9a4d-e43ba27b7374 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:44.129651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c4c1123d-1b04-4486-b893-c3ab3238e24e req-71ad423f-7b48-48a3-9a4d-e43ba27b7374 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:44.165358 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-c4c1123d-1b04-4486-b893-c3ab3238e24e req-71ad423f-7b48-48a3-9a4d-e43ba27b7374 service nova] Creating event network-changed:30faceb9-ce6e-49b0-9521-b0b40b2ff926 for instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a on n-h1-844626-8 Aug 09 14:51:44.181251 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c4c1123d-1b04-4486-b893-c3ab3238e24e req-71ad423f-7b48-48a3-9a4d-e43ba27b7374 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087239 Aug 09 14:51:44.181885 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2092/4185] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:44.188815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1f967609-ab3b-458c-8f1d-e75f205e4807 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:44.189552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1f967609-ab3b-458c-8f1d-e75f205e4807 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:44.210073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f967609-ab3b-458c-8f1d-e75f205e4807 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:44.210674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f967609-ab3b-458c-8f1d-e75f205e4807 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:44.211128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f967609-ab3b-458c-8f1d-e75f205e4807 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:44.211852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f967609-ab3b-458c-8f1d-e75f205e4807 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:44.212301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f967609-ab3b-458c-8f1d-e75f205e4807 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:44.212727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f967609-ab3b-458c-8f1d-e75f205e4807 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:44.877386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-de38ee4a-e87a-4eff-b286-91094a5b90aa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:44.900147 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de38ee4a-e87a-4eff-b286-91094a5b90aa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1521 microversion: 2.1 time: 0.981916 Aug 09 14:51:44.900843 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2094/4186] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:43 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1521 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:44.906997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c1487f82-39fa-418a-bd4b-a52f42e80c10 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:44.908143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c1487f82-39fa-418a-bd4b-a52f42e80c10 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:44.915983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1487f82-39fa-418a-bd4b-a52f42e80c10 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:44.920585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1487f82-39fa-418a-bd4b-a52f42e80c10 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:44.921638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1487f82-39fa-418a-bd4b-a52f42e80c10 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:44.922789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1487f82-39fa-418a-bd4b-a52f42e80c10 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:44.923503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1487f82-39fa-418a-bd4b-a52f42e80c10 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:44.924641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1487f82-39fa-418a-bd4b-a52f42e80c10 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:45.053471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1f967609-ab3b-458c-8f1d-e75f205e4807 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:45.065282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1f967609-ab3b-458c-8f1d-e75f205e4807 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:45.067757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1f967609-ab3b-458c-8f1d-e75f205e4807 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:45.069364 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1f967609-ab3b-458c-8f1d-e75f205e4807 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1405 microversion: 2.20 time: 0.886290 Aug 09 14:51:45.070400 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2093/4187] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:44 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1405 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:45.090151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa08a819-66dc-48de-9166-e8eaeed1b6c7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:45.091635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa08a819-66dc-48de-9166-e8eaeed1b6c7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:45.103603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa08a819-66dc-48de-9166-e8eaeed1b6c7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:45.107544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa08a819-66dc-48de-9166-e8eaeed1b6c7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:45.108484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa08a819-66dc-48de-9166-e8eaeed1b6c7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:45.110533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa08a819-66dc-48de-9166-e8eaeed1b6c7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:45.111387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa08a819-66dc-48de-9166-e8eaeed1b6c7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:45.112064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa08a819-66dc-48de-9166-e8eaeed1b6c7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:45.317003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa08a819-66dc-48de-9166-e8eaeed1b6c7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:45.361308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa08a819-66dc-48de-9166-e8eaeed1b6c7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:45.373492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa08a819-66dc-48de-9166-e8eaeed1b6c7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:45.380403 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa08a819-66dc-48de-9166-e8eaeed1b6c7 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1604 microversion: 2.42 time: 0.305011 Aug 09 14:51:45.381729 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2094/4188] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:45 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1604 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:45.392376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2266de3b-beed-4e90-bad2-7b9a4a82fdb3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:45.411691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2266de3b-beed-4e90-bad2-7b9a4a82fdb3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:45.434562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2266de3b-beed-4e90-bad2-7b9a4a82fdb3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:45.439118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2266de3b-beed-4e90-bad2-7b9a4a82fdb3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:45.439782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2266de3b-beed-4e90-bad2-7b9a4a82fdb3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:45.440727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2266de3b-beed-4e90-bad2-7b9a4a82fdb3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:45.462556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2266de3b-beed-4e90-bad2-7b9a4a82fdb3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:45.471757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2266de3b-beed-4e90-bad2-7b9a4a82fdb3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:45.480004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:45.487995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c1487f82-39fa-418a-bd4b-a52f42e80c10 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:45.509197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c1487f82-39fa-418a-bd4b-a52f42e80c10 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:45.515742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c1487f82-39fa-418a-bd4b-a52f42e80c10 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:45.520718 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c1487f82-39fa-418a-bd4b-a52f42e80c10 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1886 microversion: 2.32 time: 0.617697 Aug 09 14:51:45.521722 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2095/4189] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:44 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1886 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:45.856339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2266de3b-beed-4e90-bad2-7b9a4a82fdb3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:45.865560 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2266de3b-beed-4e90-bad2-7b9a4a82fdb3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1313 microversion: 2.1 time: 0.482092 Aug 09 14:51:45.866163 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2095/4190] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:45 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:45.921911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32b94fd7-b9c7-4578-882d-3440faebbb4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:45.922506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32b94fd7-b9c7-4578-882d-3440faebbb4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:45.929760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32b94fd7-b9c7-4578-882d-3440faebbb4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:45.930602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32b94fd7-b9c7-4578-882d-3440faebbb4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:45.931297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32b94fd7-b9c7-4578-882d-3440faebbb4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:45.932511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32b94fd7-b9c7-4578-882d-3440faebbb4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:45.933174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32b94fd7-b9c7-4578-882d-3440faebbb4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:45.933999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32b94fd7-b9c7-4578-882d-3440faebbb4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:46.033411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-16d347d9-0ad2-4496-8358-8733fab83f27 req-48386b27-8a27-4874-8bda-3b75e87d1e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "tag": "d4803c25-91b8-4eb4-aea2-bdacca010751"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:46.054393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-16d347d9-0ad2-4496-8358-8733fab83f27 req-48386b27-8a27-4874-8bda-3b75e87d1e16 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:46.054877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-16d347d9-0ad2-4496-8358-8733fab83f27 req-48386b27-8a27-4874-8bda-3b75e87d1e16 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:46.055338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-16d347d9-0ad2-4496-8358-8733fab83f27 req-48386b27-8a27-4874-8bda-3b75e87d1e16 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:46.075748 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-16d347d9-0ad2-4496-8358-8733fab83f27 req-48386b27-8a27-4874-8bda-3b75e87d1e16 service nova] Creating event network-changed:d4803c25-91b8-4eb4-aea2-bdacca010751 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:51:46.083184 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-16d347d9-0ad2-4496-8358-8733fab83f27 req-48386b27-8a27-4874-8bda-3b75e87d1e16 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054518 Aug 09 14:51:46.084782 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2096/4191] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:51:46.099242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67380895-2c55-4911-8b29-55009405d877 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:46.102102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-67380895-2c55-4911-8b29-55009405d877 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:46.110452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67380895-2c55-4911-8b29-55009405d877 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:46.111307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67380895-2c55-4911-8b29-55009405d877 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:46.111985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67380895-2c55-4911-8b29-55009405d877 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:46.112929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67380895-2c55-4911-8b29-55009405d877 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:46.113587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67380895-2c55-4911-8b29-55009405d877 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:46.114680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67380895-2c55-4911-8b29-55009405d877 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:46.418334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-32b94fd7-b9c7-4578-882d-3440faebbb4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:46.437225 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32b94fd7-b9c7-4578-882d-3440faebbb4e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1521 microversion: 2.1 time: 0.517180 Aug 09 14:51:46.439222 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2096/4192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:45 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:46.455574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-13e88674-9812-41c4-b5e6-3ecacfb105ea req-1c42ceb7-37c4-44af-bcbf-64e7a9e3d7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bcda666-d36a-488f-8fb0-fe12470ff45f", "tag": "9c42ace2-95a4-43eb-abf9-6c87e774f843"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:46.476486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-67380895-2c55-4911-8b29-55009405d877 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:46.484579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-13e88674-9812-41c4-b5e6-3ecacfb105ea req-1c42ceb7-37c4-44af-bcbf-64e7a9e3d7a8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:46.485952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-67380895-2c55-4911-8b29-55009405d877 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:46.488235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-13e88674-9812-41c4-b5e6-3ecacfb105ea req-1c42ceb7-37c4-44af-bcbf-64e7a9e3d7a8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:46.488709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-13e88674-9812-41c4-b5e6-3ecacfb105ea req-1c42ceb7-37c4-44af-bcbf-64e7a9e3d7a8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:46.494118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-67380895-2c55-4911-8b29-55009405d877 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:46.497837 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-67380895-2c55-4911-8b29-55009405d877 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1405 microversion: 2.20 time: 0.403404 Aug 09 14:51:46.499720 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2097/4193] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:46 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:46.512765 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-13e88674-9812-41c4-b5e6-3ecacfb105ea req-1c42ceb7-37c4-44af-bcbf-64e7a9e3d7a8 service nova] Creating event network-changed:9c42ace2-95a4-43eb-abf9-6c87e774f843 for instance 9bcda666-d36a-488f-8fb0-fe12470ff45f on n-h1-844626-8 Aug 09 14:51:46.522332 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-13e88674-9812-41c4-b5e6-3ecacfb105ea req-1c42ceb7-37c4-44af-bcbf-64e7a9e3d7a8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080262 Aug 09 14:51:46.524618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:46.525738 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2097/4194] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:46.530484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:46.547377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40003c2f-4a65-402d-a02d-f531ff1418d6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:46.548007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40003c2f-4a65-402d-a02d-f531ff1418d6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:46.559524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:46.560023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:46.560459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:46.561163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:46.561616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:46.567719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40003c2f-4a65-402d-a02d-f531ff1418d6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:46.568199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40003c2f-4a65-402d-a02d-f531ff1418d6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:46.568627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40003c2f-4a65-402d-a02d-f531ff1418d6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:46.569328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40003c2f-4a65-402d-a02d-f531ff1418d6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:46.569930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40003c2f-4a65-402d-a02d-f531ff1418d6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:46.570378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40003c2f-4a65-402d-a02d-f531ff1418d6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:46.574191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:46.590752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:46.712312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:46.713986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:46.714584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:46.716289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lazy-loading 'fault' on Instance uuid da519f2f-fb00-4edd-a06f-c055cf7fa4af {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:51:46.960639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:46.971803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:46.979177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df55ede6220049c1aee1bfd628c13a23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3f9be3e6694608a10e84ebab6d1a2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:46.984256 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-591bd39c-d8b9-41dc-a7d6-4ff132ddeb80 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 200 len: 1371 microversion: 2.42 time: 0.483149 Aug 09 14:51:46.986856 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2098/4195] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:46 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 1371 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:47.004047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1af7a28f-8946-4c2d-a26f-bacfb13aabdf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:47.004935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1af7a28f-8946-4c2d-a26f-bacfb13aabdf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:47.041863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af7a28f-8946-4c2d-a26f-bacfb13aabdf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:47.043034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af7a28f-8946-4c2d-a26f-bacfb13aabdf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:47.043640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af7a28f-8946-4c2d-a26f-bacfb13aabdf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:47.044635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af7a28f-8946-4c2d-a26f-bacfb13aabdf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:47.047431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af7a28f-8946-4c2d-a26f-bacfb13aabdf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:47.048053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1af7a28f-8946-4c2d-a26f-bacfb13aabdf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:47.140766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40003c2f-4a65-402d-a02d-f531ff1418d6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:47.155974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40003c2f-4a65-402d-a02d-f531ff1418d6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:47.161134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40003c2f-4a65-402d-a02d-f531ff1418d6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:47.168701 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40003c2f-4a65-402d-a02d-f531ff1418d6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1886 microversion: 2.32 time: 0.625366 Aug 09 14:51:47.170615 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2098/4196] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:46 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1886 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:47.463355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-600ac106-97b5-40a3-99db-b6eb3b400a7f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:47.464072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-600ac106-97b5-40a3-99db-b6eb3b400a7f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:47.479672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-600ac106-97b5-40a3-99db-b6eb3b400a7f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:47.481987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-600ac106-97b5-40a3-99db-b6eb3b400a7f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:47.487927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-600ac106-97b5-40a3-99db-b6eb3b400a7f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:47.489100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-600ac106-97b5-40a3-99db-b6eb3b400a7f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:47.490134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-600ac106-97b5-40a3-99db-b6eb3b400a7f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:47.491145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-600ac106-97b5-40a3-99db-b6eb3b400a7f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:47.586815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1af7a28f-8946-4c2d-a26f-bacfb13aabdf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:47.597416 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1af7a28f-8946-4c2d-a26f-bacfb13aabdf tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1313 microversion: 2.1 time: 0.601586 Aug 09 14:51:47.598675 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2099/4197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:46 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:47.605390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-698f5de1-fae9-4d3f-a44a-403409e6b253 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:47.606346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-698f5de1-fae9-4d3f-a44a-403409e6b253 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:47.614375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-698f5de1-fae9-4d3f-a44a-403409e6b253 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:47.615539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-698f5de1-fae9-4d3f-a44a-403409e6b253 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:47.616256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-698f5de1-fae9-4d3f-a44a-403409e6b253 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:47.617513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-698f5de1-fae9-4d3f-a44a-403409e6b253 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:47.618328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-698f5de1-fae9-4d3f-a44a-403409e6b253 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:47.618975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-698f5de1-fae9-4d3f-a44a-403409e6b253 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:48.114997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-698f5de1-fae9-4d3f-a44a-403409e6b253 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:48.131547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-698f5de1-fae9-4d3f-a44a-403409e6b253 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:48.136644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-698f5de1-fae9-4d3f-a44a-403409e6b253 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:48.140842 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-698f5de1-fae9-4d3f-a44a-403409e6b253 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1405 microversion: 2.20 time: 0.539066 Aug 09 14:51:48.142241 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2100/4198] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:47 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1405 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:48.155451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-766a6fe0-fcd9-40ea-9dec-f6b9bcf73c0e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:48.156815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-766a6fe0-fcd9-40ea-9dec-f6b9bcf73c0e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:48.166542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-600ac106-97b5-40a3-99db-b6eb3b400a7f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:48.185137 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-600ac106-97b5-40a3-99db-b6eb3b400a7f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1521 microversion: 2.1 time: 0.729868 Aug 09 14:51:48.188515 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2099/4199] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:47 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1521 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:51:48.190525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-766a6fe0-fcd9-40ea-9dec-f6b9bcf73c0e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:48.197571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f7859ae8-d15c-4099-ada9-4f4851d8c5e4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:48.200534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-766a6fe0-fcd9-40ea-9dec-f6b9bcf73c0e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:48.201344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-766a6fe0-fcd9-40ea-9dec-f6b9bcf73c0e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:48.202267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-766a6fe0-fcd9-40ea-9dec-f6b9bcf73c0e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:48.203029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-766a6fe0-fcd9-40ea-9dec-f6b9bcf73c0e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:48.203666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-766a6fe0-fcd9-40ea-9dec-f6b9bcf73c0e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:48.206187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7859ae8-d15c-4099-ada9-4f4851d8c5e4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:48.218498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7859ae8-d15c-4099-ada9-4f4851d8c5e4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:48.219569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7859ae8-d15c-4099-ada9-4f4851d8c5e4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:48.220288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7859ae8-d15c-4099-ada9-4f4851d8c5e4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:48.233233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7859ae8-d15c-4099-ada9-4f4851d8c5e4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:48.234597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7859ae8-d15c-4099-ada9-4f4851d8c5e4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:48.236616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7859ae8-d15c-4099-ada9-4f4851d8c5e4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:48.247632 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-766a6fe0-fcd9-40ea-9dec-f6b9bcf73c0e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] HTTP exception thrown: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-766a6fe0-fcd9-40ea-9dec-f6b9bcf73c0e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Request method failure captured: Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af HTTP/1.1 Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nLQadaRdnqc1qNL57GT1yajdgcJOojU3uWtd7e3Mu6KvXvvgqGrFcPlG8SFBhzXFzr0hPvTocdr2_-K0sGh6jO3T6xKH9WAMIGdljkB2T6UTUNEOlRNUivBVi-ozd9XI-Cg6Zub5k75YFHKi5wpSOYkyk7FDX6ZtGRfrHZJY8uNBiI Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.42 Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: dd3f9be3e6694608a10e84ebab6d1a2a Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-831387837 Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dd3f9be3e6694608a10e84ebab6d1a2a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dd3f9be3e6694608a10e84ebab6d1a2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd3f9be3e6694608a10e84ebab6d1a2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd3f9be3e6694608a10e84ebab6d1a2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TaggedBootDevicesTest_v242-831387837 Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: dd3f9be3e6694608a10e84ebab6d1a2a Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-831387837 Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TaggedBootDevicesTest_v242-831387837-project Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: df55ede6220049c1aee1bfd628c13a23 Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TaggedBootDevicesTest_v242-831387837-project Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'da519f2f-fb00-4edd-a06f-c055cf7fa4af'} Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:48.249876 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:51:48.255299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:48.255299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:48.255299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:51:48.255299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:51:48.255299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:51:48.255299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:51:48.255299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:51:48.255299 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:48.257809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-766a6fe0-fcd9-40ea-9dec-f6b9bcf73c0e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Returning 404 to user: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:51:48.260365 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-766a6fe0-fcd9-40ea-9dec-f6b9bcf73c0e tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 404 len: 111 microversion: 2.42 time: 0.116837 Aug 09 14:51:48.265490 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2101/4200] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:48 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:51:48.271945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-df3addec-1fe6-45db-92c1-a2bc65585150 req-dcfcb351-c4db-4954-a89a-c606233b6125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "tag": "c7d99063-f45e-4b7c-95c6-5303b2e5a553"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:48.283300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-df3addec-1fe6-45db-92c1-a2bc65585150 req-dcfcb351-c4db-4954-a89a-c606233b6125 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:48.284125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-df3addec-1fe6-45db-92c1-a2bc65585150 req-dcfcb351-c4db-4954-a89a-c606233b6125 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:48.284779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-df3addec-1fe6-45db-92c1-a2bc65585150 req-dcfcb351-c4db-4954-a89a-c606233b6125 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:48.299645 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-df3addec-1fe6-45db-92c1-a2bc65585150 req-dcfcb351-c4db-4954-a89a-c606233b6125 service nova] Creating event network-changed:c7d99063-f45e-4b7c-95c6-5303b2e5a553 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:51:48.306578 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-df3addec-1fe6-45db-92c1-a2bc65585150 req-dcfcb351-c4db-4954-a89a-c606233b6125 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039113 Aug 09 14:51:48.309130 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2102/4201] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:48.320629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01ff95e0-5543-4af4-91a3-d341dcd8d2e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '.version_select at 0x7f41dda1a0d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:48.369666 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01ff95e0-5543-4af4-91a3-d341dcd8d2e9 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799985017" status: 204 len: 0 microversion: 2.42 time: 0.057976 Aug 09 14:51:48.381414 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2103/4202] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:51:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799985017 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:51:48.621467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-25af8fb7-33e8-4b2a-ad3c-4c2669fb1b9b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:48.622940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-25af8fb7-33e8-4b2a-ad3c-4c2669fb1b9b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:48.632423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25af8fb7-33e8-4b2a-ad3c-4c2669fb1b9b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:48.632805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25af8fb7-33e8-4b2a-ad3c-4c2669fb1b9b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:48.633307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25af8fb7-33e8-4b2a-ad3c-4c2669fb1b9b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:48.634236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25af8fb7-33e8-4b2a-ad3c-4c2669fb1b9b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:48.634850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25af8fb7-33e8-4b2a-ad3c-4c2669fb1b9b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:48.635375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25af8fb7-33e8-4b2a-ad3c-4c2669fb1b9b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:48.668318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f7859ae8-d15c-4099-ada9-4f4851d8c5e4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:48.680030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f7859ae8-d15c-4099-ada9-4f4851d8c5e4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:48.687239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f7859ae8-d15c-4099-ada9-4f4851d8c5e4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:48.694096 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f7859ae8-d15c-4099-ada9-4f4851d8c5e4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1886 microversion: 2.32 time: 0.500072 Aug 09 14:51:48.712455 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2100/4203] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:48 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1886 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:49.170861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8ecbaffc-92f8-4626-85d1-3a66c791ec03 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:49.171560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8ecbaffc-92f8-4626-85d1-3a66c791ec03 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:49.187002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ecbaffc-92f8-4626-85d1-3a66c791ec03 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:49.187541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ecbaffc-92f8-4626-85d1-3a66c791ec03 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:49.187981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ecbaffc-92f8-4626-85d1-3a66c791ec03 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:49.188717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ecbaffc-92f8-4626-85d1-3a66c791ec03 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:49.192775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ecbaffc-92f8-4626-85d1-3a66c791ec03 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:49.193213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ecbaffc-92f8-4626-85d1-3a66c791ec03 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:49.231468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:49.261006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:49.545351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=22 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:49.936904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8ecbaffc-92f8-4626-85d1-3a66c791ec03 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:49.952197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8ecbaffc-92f8-4626-85d1-3a66c791ec03 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:49.956886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8ecbaffc-92f8-4626-85d1-3a66c791ec03 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:49.958462 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8ecbaffc-92f8-4626-85d1-3a66c791ec03 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1405 microversion: 2.20 time: 0.792171 Aug 09 14:51:49.960068 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2101/4204] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:49 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1405 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:49.967487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f3cff449-0dbc-48db-958f-dfc45c9eb977 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:49.974561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f3cff449-0dbc-48db-958f-dfc45c9eb977 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:49.993787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3cff449-0dbc-48db-958f-dfc45c9eb977 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:49.998866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3cff449-0dbc-48db-958f-dfc45c9eb977 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:50.007637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3cff449-0dbc-48db-958f-dfc45c9eb977 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:50.010710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3cff449-0dbc-48db-958f-dfc45c9eb977 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:50.011307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3cff449-0dbc-48db-958f-dfc45c9eb977 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:50.011970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3cff449-0dbc-48db-958f-dfc45c9eb977 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:50.057215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-25af8fb7-33e8-4b2a-ad3c-4c2669fb1b9b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:50.069830 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-25af8fb7-33e8-4b2a-ad3c-4c2669fb1b9b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1313 microversion: 2.1 time: 1.452811 Aug 09 14:51:50.070982 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2104/4205] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:48 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1313 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:51:50.080347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9d174a4-65f7-4dee-a261-27586cfb977f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:50.082015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c9d174a4-65f7-4dee-a261-27586cfb977f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:50.097231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d174a4-65f7-4dee-a261-27586cfb977f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:50.097910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d174a4-65f7-4dee-a261-27586cfb977f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:50.098515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d174a4-65f7-4dee-a261-27586cfb977f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:50.099597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d174a4-65f7-4dee-a261-27586cfb977f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:50.100198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d174a4-65f7-4dee-a261-27586cfb977f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:50.100914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9d174a4-65f7-4dee-a261-27586cfb977f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:50.702710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f3cff449-0dbc-48db-958f-dfc45c9eb977 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:50.722520 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f3cff449-0dbc-48db-958f-dfc45c9eb977 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1521 microversion: 2.1 time: 0.753520 Aug 09 14:51:50.723387 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2102/4206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:49 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1521 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:50.736364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-bcf919d8-f996-45ea-9480-d64c640c322e req-b794dbcc-22c7-4508-b132-5fb24a7b6edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13df3ce4-02eb-4393-bb6b-d72ab806dc2a", "name": "network-vif-plugged", "status": "completed", "tag": "30faceb9-ce6e-49b0-9521-b0b40b2ff926"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:50.769579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bcf919d8-f996-45ea-9480-d64c640c322e req-b794dbcc-22c7-4508-b132-5fb24a7b6edb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:50.770315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bcf919d8-f996-45ea-9480-d64c640c322e req-b794dbcc-22c7-4508-b132-5fb24a7b6edb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:50.772427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bcf919d8-f996-45ea-9480-d64c640c322e req-b794dbcc-22c7-4508-b132-5fb24a7b6edb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:50.808336 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-bcf919d8-f996-45ea-9480-d64c640c322e req-b794dbcc-22c7-4508-b132-5fb24a7b6edb service nova] Creating event network-vif-plugged:30faceb9-ce6e-49b0-9521-b0b40b2ff926 for instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a on n-h1-844626-8 Aug 09 14:51:50.826989 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-bcf919d8-f996-45ea-9480-d64c640c322e req-b794dbcc-22c7-4508-b132-5fb24a7b6edb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096612 Aug 09 14:51:50.829763 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2103/4207] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:50.853594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-30973869-1937-44de-85a7-d07501d89edf req-674ddcf3-df5b-4140-bc4e-93ebe6b83bad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "tag": "c0390f76-5b64-465b-ab1b-c3d6e4b5c819"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:50.867263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-30973869-1937-44de-85a7-d07501d89edf req-674ddcf3-df5b-4140-bc4e-93ebe6b83bad service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:50.868950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-30973869-1937-44de-85a7-d07501d89edf req-674ddcf3-df5b-4140-bc4e-93ebe6b83bad service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:50.869594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-30973869-1937-44de-85a7-d07501d89edf req-674ddcf3-df5b-4140-bc4e-93ebe6b83bad service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:50.887352 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-30973869-1937-44de-85a7-d07501d89edf req-674ddcf3-df5b-4140-bc4e-93ebe6b83bad service nova] Creating event network-changed:c0390f76-5b64-465b-ab1b-c3d6e4b5c819 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:51:50.896084 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-30973869-1937-44de-85a7-d07501d89edf req-674ddcf3-df5b-4140-bc4e-93ebe6b83bad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063298 Aug 09 14:51:50.897736 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2104/4208] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:50.986636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f4c3a89d-c1dc-48c6-8d99-6e05605b11a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:50.987603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f4c3a89d-c1dc-48c6-8d99-6e05605b11a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:51.001446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4c3a89d-c1dc-48c6-8d99-6e05605b11a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:51.002833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4c3a89d-c1dc-48c6-8d99-6e05605b11a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:51.004989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4c3a89d-c1dc-48c6-8d99-6e05605b11a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:51.005735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4c3a89d-c1dc-48c6-8d99-6e05605b11a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:51.007602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4c3a89d-c1dc-48c6-8d99-6e05605b11a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:51.008039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4c3a89d-c1dc-48c6-8d99-6e05605b11a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:51.150109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c9d174a4-65f7-4dee-a261-27586cfb977f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:51.169409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c9d174a4-65f7-4dee-a261-27586cfb977f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:51.170839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c9d174a4-65f7-4dee-a261-27586cfb977f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:51.172061 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c9d174a4-65f7-4dee-a261-27586cfb977f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1886 microversion: 2.32 time: 1.099800 Aug 09 14:51:51.172968 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2105/4209] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:50 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1886 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:51.191115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a0a62d9-e776-4c24-8ecd-34b5d48fa18c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:51.191742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a0a62d9-e776-4c24-8ecd-34b5d48fa18c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:51.212729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0a62d9-e776-4c24-8ecd-34b5d48fa18c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:51.213245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0a62d9-e776-4c24-8ecd-34b5d48fa18c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:51.213790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0a62d9-e776-4c24-8ecd-34b5d48fa18c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:51.214398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0a62d9-e776-4c24-8ecd-34b5d48fa18c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:51.214852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0a62d9-e776-4c24-8ecd-34b5d48fa18c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:51.232299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a0a62d9-e776-4c24-8ecd-34b5d48fa18c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:51.549156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f4c3a89d-c1dc-48c6-8d99-6e05605b11a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:51.569987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f4c3a89d-c1dc-48c6-8d99-6e05605b11a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:51.569987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f4c3a89d-c1dc-48c6-8d99-6e05605b11a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:51.569987 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f4c3a89d-c1dc-48c6-8d99-6e05605b11a5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1405 microversion: 2.20 time: 0.588622 Aug 09 14:51:51.571637 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2105/4210] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:50 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1405 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:51.744332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c4b2b7ae-70b0-4e00-ac6c-3648f246a430 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:51.745227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c4b2b7ae-70b0-4e00-ac6c-3648f246a430 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:51.747456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:51.761677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4b2b7ae-70b0-4e00-ac6c-3648f246a430 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:51.762414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4b2b7ae-70b0-4e00-ac6c-3648f246a430 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:51.763017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4b2b7ae-70b0-4e00-ac6c-3648f246a430 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:51.763898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4b2b7ae-70b0-4e00-ac6c-3648f246a430 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:51.764500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4b2b7ae-70b0-4e00-ac6c-3648f246a430 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:51.765076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4b2b7ae-70b0-4e00-ac6c-3648f246a430 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:51.803607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:51.934988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a0a62d9-e776-4c24-8ecd-34b5d48fa18c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:51.958553 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a0a62d9-e776-4c24-8ecd-34b5d48fa18c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1313 microversion: 2.1 time: 0.784491 Aug 09 14:51:51.976814 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2106/4211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:51 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1313 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:52.198362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d032436-4eb1-4bdf-941a-9ddf25069428 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:52.200733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3d032436-4eb1-4bdf-941a-9ddf25069428 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:52.213281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d032436-4eb1-4bdf-941a-9ddf25069428 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:52.215423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d032436-4eb1-4bdf-941a-9ddf25069428 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:52.216100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d032436-4eb1-4bdf-941a-9ddf25069428 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:52.217938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d032436-4eb1-4bdf-941a-9ddf25069428 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:52.224036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d032436-4eb1-4bdf-941a-9ddf25069428 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:52.224819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d032436-4eb1-4bdf-941a-9ddf25069428 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:52.643890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c4b2b7ae-70b0-4e00-ac6c-3648f246a430 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:52.659709 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c4b2b7ae-70b0-4e00-ac6c-3648f246a430 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1521 microversion: 2.1 time: 0.919212 Aug 09 14:51:52.673604 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2106/4212] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:51 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1521 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:52.678907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ca24d52f-9e5e-4b14-8d4b-87fb40f23f4c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:52.679737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ca24d52f-9e5e-4b14-8d4b-87fb40f23f4c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:52.685961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca24d52f-9e5e-4b14-8d4b-87fb40f23f4c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:52.686692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca24d52f-9e5e-4b14-8d4b-87fb40f23f4c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:52.687302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca24d52f-9e5e-4b14-8d4b-87fb40f23f4c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:52.688152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca24d52f-9e5e-4b14-8d4b-87fb40f23f4c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:52.688751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca24d52f-9e5e-4b14-8d4b-87fb40f23f4c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:52.689313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca24d52f-9e5e-4b14-8d4b-87fb40f23f4c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:53.171987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d032436-4eb1-4bdf-941a-9ddf25069428 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:53.183188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d032436-4eb1-4bdf-941a-9ddf25069428 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:53.184860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d032436-4eb1-4bdf-941a-9ddf25069428 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:53.186142 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d032436-4eb1-4bdf-941a-9ddf25069428 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1886 microversion: 2.32 time: 0.993015 Aug 09 14:51:53.186881 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2107/4213] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:52 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1886 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:53.192459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8479e30f-a92b-4b48-afaa-2b094972919a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:53.193071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8479e30f-a92b-4b48-afaa-2b094972919a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:53.208514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8479e30f-a92b-4b48-afaa-2b094972919a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:53.209118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8479e30f-a92b-4b48-afaa-2b094972919a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:53.209431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8479e30f-a92b-4b48-afaa-2b094972919a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:53.210206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8479e30f-a92b-4b48-afaa-2b094972919a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:53.210645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8479e30f-a92b-4b48-afaa-2b094972919a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:53.211067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8479e30f-a92b-4b48-afaa-2b094972919a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:53.258130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ca24d52f-9e5e-4b14-8d4b-87fb40f23f4c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:53.281248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ca24d52f-9e5e-4b14-8d4b-87fb40f23f4c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:53.283810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ca24d52f-9e5e-4b14-8d4b-87fb40f23f4c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:53.285352 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ca24d52f-9e5e-4b14-8d4b-87fb40f23f4c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1405 microversion: 2.20 time: 0.610451 Aug 09 14:51:53.301826 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2107/4214] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:52 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1405 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:53.445261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-4a372013-6154-4918-88fd-754b361549e0 req-fb47deee-bebd-44e8-8b9d-280ef9a7dfdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "tag": "2c866803-396b-4bd4-8699-4d2560fd9afb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:53.470610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8479e30f-a92b-4b48-afaa-2b094972919a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:53.486398 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8479e30f-a92b-4b48-afaa-2b094972919a tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1499 microversion: 2.1 time: 0.291469 Aug 09 14:51:53.489976 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2108/4215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:53 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1499 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:53.490575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4a372013-6154-4918-88fd-754b361549e0 req-fb47deee-bebd-44e8-8b9d-280ef9a7dfdc service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:53.491714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4a372013-6154-4918-88fd-754b361549e0 req-fb47deee-bebd-44e8-8b9d-280ef9a7dfdc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:53.493492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4a372013-6154-4918-88fd-754b361549e0 req-fb47deee-bebd-44e8-8b9d-280ef9a7dfdc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:53.510870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-49a11caa-b81b-4d0c-9f23-7292ad80657f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:53.511724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-49a11caa-b81b-4d0c-9f23-7292ad80657f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:53.513846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:53.515469 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-4a372013-6154-4918-88fd-754b361549e0 req-fb47deee-bebd-44e8-8b9d-280ef9a7dfdc service nova] Creating event network-changed:2c866803-396b-4bd4-8699-4d2560fd9afb for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:51:53.521517 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-4a372013-6154-4918-88fd-754b361549e0 req-fb47deee-bebd-44e8-8b9d-280ef9a7dfdc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080385 Aug 09 14:51:53.522921 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2108/4216] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:53.528424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49a11caa-b81b-4d0c-9f23-7292ad80657f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:53.528915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49a11caa-b81b-4d0c-9f23-7292ad80657f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:53.538738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49a11caa-b81b-4d0c-9f23-7292ad80657f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:53.539560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49a11caa-b81b-4d0c-9f23-7292ad80657f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:53.540037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49a11caa-b81b-4d0c-9f23-7292ad80657f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:53.540842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49a11caa-b81b-4d0c-9f23-7292ad80657f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:53.568410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-49a11caa-b81b-4d0c-9f23-7292ad80657f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lazy-loading 'flavor' on Instance uuid 13df3ce4-02eb-4393-bb6b-d72ab806dc2a {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:51:53.672753 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-49a11caa-b81b-4d0c-9f23-7292ad80657f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "POST /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a/action" status: 202 len: 0 microversion: 2.1 time: 0.166245 Aug 09 14:51:53.678655 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2109/4217] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:51:53 2022] POST /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 14:51:53.685246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-214ccaa4-b33f-499b-abcb-5a37dfe72845 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:53.686066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-214ccaa4-b33f-499b-abcb-5a37dfe72845 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:53.695218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-214ccaa4-b33f-499b-abcb-5a37dfe72845 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:53.695869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-214ccaa4-b33f-499b-abcb-5a37dfe72845 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:53.696376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-214ccaa4-b33f-499b-abcb-5a37dfe72845 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:53.697235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-214ccaa4-b33f-499b-abcb-5a37dfe72845 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:53.697928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-214ccaa4-b33f-499b-abcb-5a37dfe72845 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:53.698428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-214ccaa4-b33f-499b-abcb-5a37dfe72845 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:53.710901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0f5300a3-7888-427f-8dd9-4f884fb1deca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:53.711702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0f5300a3-7888-427f-8dd9-4f884fb1deca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:53.740704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f5300a3-7888-427f-8dd9-4f884fb1deca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:53.743229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f5300a3-7888-427f-8dd9-4f884fb1deca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:53.744773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f5300a3-7888-427f-8dd9-4f884fb1deca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:53.747887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f5300a3-7888-427f-8dd9-4f884fb1deca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:53.749866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f5300a3-7888-427f-8dd9-4f884fb1deca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:53.750875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f5300a3-7888-427f-8dd9-4f884fb1deca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:54.246761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0f5300a3-7888-427f-8dd9-4f884fb1deca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:54.258876 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0f5300a3-7888-427f-8dd9-4f884fb1deca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1521 microversion: 2.1 time: 0.581171 Aug 09 14:51:54.262097 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2109/4218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:53 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1521 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:51:54.262408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-214ccaa4-b33f-499b-abcb-5a37dfe72845 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:54.271784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2d6aa2f6-4556-4273-9b6e-6527f4140f97 req-9734113d-5e29-4944-993a-0d65f16b80c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcda666-d36a-488f-8fb0-fe12470ff45f", "name": "network-vif-plugged", "status": "completed", "tag": "9c42ace2-95a4-43eb-abf9-6c87e774f843"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:54.281857 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-214ccaa4-b33f-499b-abcb-5a37dfe72845 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1507 microversion: 2.1 time: 0.601375 Aug 09 14:51:54.283660 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2110/4219] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:53 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1507 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:54.304909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-da1df0be-c776-454c-bd88-59657b345326 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:54.306054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-da1df0be-c776-454c-bd88-59657b345326 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:54.320519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da1df0be-c776-454c-bd88-59657b345326 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:54.322189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da1df0be-c776-454c-bd88-59657b345326 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:54.324229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da1df0be-c776-454c-bd88-59657b345326 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:54.326955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2d6aa2f6-4556-4273-9b6e-6527f4140f97 req-9734113d-5e29-4944-993a-0d65f16b80c0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:54.327747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da1df0be-c776-454c-bd88-59657b345326 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:54.329548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da1df0be-c776-454c-bd88-59657b345326 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:54.330276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da1df0be-c776-454c-bd88-59657b345326 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:54.338181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2d6aa2f6-4556-4273-9b6e-6527f4140f97 req-9734113d-5e29-4944-993a-0d65f16b80c0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:54.338664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2d6aa2f6-4556-4273-9b6e-6527f4140f97 req-9734113d-5e29-4944-993a-0d65f16b80c0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:54.399141 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2d6aa2f6-4556-4273-9b6e-6527f4140f97 req-9734113d-5e29-4944-993a-0d65f16b80c0 service nova] Creating event network-vif-plugged:9c42ace2-95a4-43eb-abf9-6c87e774f843 for instance 9bcda666-d36a-488f-8fb0-fe12470ff45f on n-h1-844626-8 Aug 09 14:51:54.422363 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2d6aa2f6-4556-4273-9b6e-6527f4140f97 req-9734113d-5e29-4944-993a-0d65f16b80c0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151254 Aug 09 14:51:54.423311 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2110/4220] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:51:54.440038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2b759e3a-eb06-41af-82cd-cf03a91e4667 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:54.446869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2b759e3a-eb06-41af-82cd-cf03a91e4667 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:54.469434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b759e3a-eb06-41af-82cd-cf03a91e4667 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:54.470370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b759e3a-eb06-41af-82cd-cf03a91e4667 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:54.470985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b759e3a-eb06-41af-82cd-cf03a91e4667 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:54.471982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b759e3a-eb06-41af-82cd-cf03a91e4667 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:54.472692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b759e3a-eb06-41af-82cd-cf03a91e4667 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:54.473314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b759e3a-eb06-41af-82cd-cf03a91e4667 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:55.195563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b759e3a-eb06-41af-82cd-cf03a91e4667 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:55.213345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b759e3a-eb06-41af-82cd-cf03a91e4667 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:55.215807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b759e3a-eb06-41af-82cd-cf03a91e4667 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:55.218025 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2b759e3a-eb06-41af-82cd-cf03a91e4667 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1405 microversion: 2.20 time: 0.793364 Aug 09 14:51:55.219102 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2111/4221] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:54 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1405 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:55.228435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da1df0be-c776-454c-bd88-59657b345326 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:55.239109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da1df0be-c776-454c-bd88-59657b345326 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:55.253435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da1df0be-c776-454c-bd88-59657b345326 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:55.255340 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-da1df0be-c776-454c-bd88-59657b345326 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1886 microversion: 2.32 time: 0.970410 Aug 09 14:51:55.260230 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2111/4222] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:54 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1886 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:55.282981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d92f2fb3-3487-49c7-a215-f65be8537162 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:55.284647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d92f2fb3-3487-49c7-a215-f65be8537162 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:55.292202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d92f2fb3-3487-49c7-a215-f65be8537162 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:55.292688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d92f2fb3-3487-49c7-a215-f65be8537162 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:55.305548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-50c7f860-de5b-4a2a-814b-5acc3e84922d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:55.306162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-50c7f860-de5b-4a2a-814b-5acc3e84922d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:55.311474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d92f2fb3-3487-49c7-a215-f65be8537162 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:55.318617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d92f2fb3-3487-49c7-a215-f65be8537162 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:55.319121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d92f2fb3-3487-49c7-a215-f65be8537162 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:55.319634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d92f2fb3-3487-49c7-a215-f65be8537162 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:55.323161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c7f860-de5b-4a2a-814b-5acc3e84922d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:55.323790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c7f860-de5b-4a2a-814b-5acc3e84922d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:55.332480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c7f860-de5b-4a2a-814b-5acc3e84922d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:55.336323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c7f860-de5b-4a2a-814b-5acc3e84922d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:55.337000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c7f860-de5b-4a2a-814b-5acc3e84922d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:55.338920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c7f860-de5b-4a2a-814b-5acc3e84922d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:55.767680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d92f2fb3-3487-49c7-a215-f65be8537162 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:55.781042 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d92f2fb3-3487-49c7-a215-f65be8537162 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1521 microversion: 2.1 time: 0.502542 Aug 09 14:51:55.792287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-50c7f860-de5b-4a2a-814b-5acc3e84922d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:55.800712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:51:55.801542 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2112/4223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:55 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1521 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:55.805193 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-50c7f860-de5b-4a2a-814b-5acc3e84922d tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1490 microversion: 2.1 time: 0.504315 Aug 09 14:51:55.821487 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2112/4224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:55 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1490 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:55.830312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f8a4bf1d-2e68-44f2-bd80-a29319d1ab03 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:55.831970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8a4bf1d-2e68-44f2-bd80-a29319d1ab03 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:55.839381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a4bf1d-2e68-44f2-bd80-a29319d1ab03 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:55.840688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a4bf1d-2e68-44f2-bd80-a29319d1ab03 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:55.842029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a4bf1d-2e68-44f2-bd80-a29319d1ab03 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:55.842982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a4bf1d-2e68-44f2-bd80-a29319d1ab03 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:55.843678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a4bf1d-2e68-44f2-bd80-a29319d1ab03 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:55.844340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a4bf1d-2e68-44f2-bd80-a29319d1ab03 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:55.877189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8a4bf1d-2e68-44f2-bd80-a29319d1ab03 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:51:56.086867 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f8a4bf1d-2e68-44f2-bd80-a29319d1ab03 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 204 len: 0 microversion: 2.1 time: 0.260097 Aug 09 14:51:56.088339 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2113/4225] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:51:55 2022] DELETE /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:51:56.101056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e101a6b-197a-4e36-9d80-378d54b81b53 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:56.102023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8e101a6b-197a-4e36-9d80-378d54b81b53 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:56.109879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e101a6b-197a-4e36-9d80-378d54b81b53 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:56.112230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e101a6b-197a-4e36-9d80-378d54b81b53 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:56.112230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e101a6b-197a-4e36-9d80-378d54b81b53 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:56.112230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e101a6b-197a-4e36-9d80-378d54b81b53 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:56.112693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e101a6b-197a-4e36-9d80-378d54b81b53 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:56.113228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e101a6b-197a-4e36-9d80-378d54b81b53 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:56.241586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4b4f7933-754c-4885-8555-4868c56f27e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:56.242824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4b4f7933-754c-4885-8555-4868c56f27e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:56.249769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b4f7933-754c-4885-8555-4868c56f27e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:56.250616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b4f7933-754c-4885-8555-4868c56f27e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:56.251312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b4f7933-754c-4885-8555-4868c56f27e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:56.252418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b4f7933-754c-4885-8555-4868c56f27e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:56.253102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b4f7933-754c-4885-8555-4868c56f27e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:56.253732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b4f7933-754c-4885-8555-4868c56f27e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:56.733567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e101a6b-197a-4e36-9d80-378d54b81b53 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:56.750846 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e101a6b-197a-4e36-9d80-378d54b81b53 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1496 microversion: 2.1 time: 0.657329 Aug 09 14:51:56.768073 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2113/4226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:56 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1496 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:56.784788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f23c38c-3f4c-4a99-bc34-06a9f3a9f81c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:56.785460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6f23c38c-3f4c-4a99-bc34-06a9f3a9f81c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:56.801741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f23c38c-3f4c-4a99-bc34-06a9f3a9f81c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:56.806677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f23c38c-3f4c-4a99-bc34-06a9f3a9f81c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:56.809698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f23c38c-3f4c-4a99-bc34-06a9f3a9f81c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:56.812355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f23c38c-3f4c-4a99-bc34-06a9f3a9f81c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:56.816047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f23c38c-3f4c-4a99-bc34-06a9f3a9f81c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:56.816744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f23c38c-3f4c-4a99-bc34-06a9f3a9f81c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:56.992175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4b4f7933-754c-4885-8555-4868c56f27e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:57.001783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4b4f7933-754c-4885-8555-4868c56f27e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:57.003355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4b4f7933-754c-4885-8555-4868c56f27e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:57.004487 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4b4f7933-754c-4885-8555-4868c56f27e6 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1405 microversion: 2.20 time: 0.767373 Aug 09 14:51:57.019021 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2114/4227] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:56 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1405 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:57.037038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d209f49d-0801-48f3-a7bd-bdbaec9ef00d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:57.038106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d209f49d-0801-48f3-a7bd-bdbaec9ef00d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:57.051516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d209f49d-0801-48f3-a7bd-bdbaec9ef00d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:57.052396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d209f49d-0801-48f3-a7bd-bdbaec9ef00d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:57.053074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d209f49d-0801-48f3-a7bd-bdbaec9ef00d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:57.054320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d209f49d-0801-48f3-a7bd-bdbaec9ef00d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:57.058176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d209f49d-0801-48f3-a7bd-bdbaec9ef00d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:57.059020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d209f49d-0801-48f3-a7bd-bdbaec9ef00d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:57.459725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f23c38c-3f4c-4a99-bc34-06a9f3a9f81c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:57.482925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f23c38c-3f4c-4a99-bc34-06a9f3a9f81c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:57.485856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f23c38c-3f4c-4a99-bc34-06a9f3a9f81c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:57.491661 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f23c38c-3f4c-4a99-bc34-06a9f3a9f81c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1886 microversion: 2.32 time: 0.720616 Aug 09 14:51:57.508719 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2114/4228] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:56 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1886 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:51:57.618686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d209f49d-0801-48f3-a7bd-bdbaec9ef00d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:57.632672 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d209f49d-0801-48f3-a7bd-bdbaec9ef00d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1521 microversion: 2.1 time: 0.611964 Aug 09 14:51:57.639638 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2115/4229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:57 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1521 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:57.779279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4faa9991-750f-4d9c-9ab4-a72bd146146f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:57.779911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4faa9991-750f-4d9c-9ab4-a72bd146146f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:57.800459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4faa9991-750f-4d9c-9ab4-a72bd146146f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:57.804099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4faa9991-750f-4d9c-9ab4-a72bd146146f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:57.804795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4faa9991-750f-4d9c-9ab4-a72bd146146f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:57.806414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4faa9991-750f-4d9c-9ab4-a72bd146146f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:57.808415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4faa9991-750f-4d9c-9ab4-a72bd146146f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:57.809338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4faa9991-750f-4d9c-9ab4-a72bd146146f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:58.049331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5cb292fe-4b10-42a0-b461-5c7dbdd38c69 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:58.052426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5cb292fe-4b10-42a0-b461-5c7dbdd38c69 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:58.068041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb292fe-4b10-42a0-b461-5c7dbdd38c69 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:58.068793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb292fe-4b10-42a0-b461-5c7dbdd38c69 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:58.069898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb292fe-4b10-42a0-b461-5c7dbdd38c69 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:58.072726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb292fe-4b10-42a0-b461-5c7dbdd38c69 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:58.074042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb292fe-4b10-42a0-b461-5c7dbdd38c69 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:58.076153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb292fe-4b10-42a0-b461-5c7dbdd38c69 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:58.297385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4faa9991-750f-4d9c-9ab4-a72bd146146f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:58.328690 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4faa9991-750f-4d9c-9ab4-a72bd146146f tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1496 microversion: 2.1 time: 0.556987 Aug 09 14:51:58.329874 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2115/4230] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:57 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1496 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:58.355053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5cb292fe-4b10-42a0-b461-5c7dbdd38c69 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:58.363471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5cb292fe-4b10-42a0-b461-5c7dbdd38c69 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:58.371816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5cb292fe-4b10-42a0-b461-5c7dbdd38c69 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:58.373115 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5cb292fe-4b10-42a0-b461-5c7dbdd38c69 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1597 microversion: 2.20 time: 0.331880 Aug 09 14:51:58.373710 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2116/4231] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:58 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1597 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:58.404406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a124824b-a2cb-42ca-af3d-3e0a5adda022 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:58.405077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a124824b-a2cb-42ca-af3d-3e0a5adda022 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:58.424954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a124824b-a2cb-42ca-af3d-3e0a5adda022 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:58.427768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a124824b-a2cb-42ca-af3d-3e0a5adda022 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:58.428232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a124824b-a2cb-42ca-af3d-3e0a5adda022 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:58.431045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a124824b-a2cb-42ca-af3d-3e0a5adda022 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:58.431583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a124824b-a2cb-42ca-af3d-3e0a5adda022 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:58.432200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a124824b-a2cb-42ca-af3d-3e0a5adda022 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:58.519278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c3abf785-28a2-437f-b206-0f9174a8062b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:58.520255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c3abf785-28a2-437f-b206-0f9174a8062b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:58.528214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3abf785-28a2-437f-b206-0f9174a8062b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:58.528984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3abf785-28a2-437f-b206-0f9174a8062b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:58.529605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3abf785-28a2-437f-b206-0f9174a8062b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:58.530492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3abf785-28a2-437f-b206-0f9174a8062b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:58.531311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3abf785-28a2-437f-b206-0f9174a8062b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:58.531968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3abf785-28a2-437f-b206-0f9174a8062b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:58.636542 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a124824b-a2cb-42ca-af3d-3e0a5adda022 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.239903 Aug 09 14:51:58.638158 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2116/4232] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 9 14:51:58 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/os-interface => generated 284 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:51:58.660911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42b5b3be-80f2-4bfb-8319-2ef8d6497c2e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:58.661537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42b5b3be-80f2-4bfb-8319-2ef8d6497c2e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:58.669880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42b5b3be-80f2-4bfb-8319-2ef8d6497c2e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:58.672804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42b5b3be-80f2-4bfb-8319-2ef8d6497c2e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:58.674925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42b5b3be-80f2-4bfb-8319-2ef8d6497c2e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:58.679582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42b5b3be-80f2-4bfb-8319-2ef8d6497c2e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:58.680349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42b5b3be-80f2-4bfb-8319-2ef8d6497c2e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:58.681113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42b5b3be-80f2-4bfb-8319-2ef8d6497c2e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:59.357111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c3abf785-28a2-437f-b206-0f9174a8062b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:59.381830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c3abf785-28a2-437f-b206-0f9174a8062b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:59.386326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c3abf785-28a2-437f-b206-0f9174a8062b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:59.390783 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c3abf785-28a2-437f-b206-0f9174a8062b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1886 microversion: 2.32 time: 0.875651 Aug 09 14:51:59.393179 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2117/4233] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:51:58 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1886 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:51:59.408320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-998cf3fc-5864-4645-97e6-149ef167a670 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:59.409156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-998cf3fc-5864-4645-97e6-149ef167a670 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:59.431371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-998cf3fc-5864-4645-97e6-149ef167a670 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:59.433217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-998cf3fc-5864-4645-97e6-149ef167a670 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:59.434877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-998cf3fc-5864-4645-97e6-149ef167a670 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:59.435737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-998cf3fc-5864-4645-97e6-149ef167a670 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:59.438445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-998cf3fc-5864-4645-97e6-149ef167a670 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:59.439066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-998cf3fc-5864-4645-97e6-149ef167a670 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:59.488216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42b5b3be-80f2-4bfb-8319-2ef8d6497c2e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:59.514749 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42b5b3be-80f2-4bfb-8319-2ef8d6497c2e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1501 microversion: 2.1 time: 0.858531 Aug 09 14:51:59.516544 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2117/4234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:58 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1501 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:59.541501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d4ee0ef-c743-45f4-bd4c-9248ee8a9c9d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c56c61cd-c8a7-4603-af8e-d96345871856"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:59.547803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3d4ee0ef-c743-45f4-bd4c-9248ee8a9c9d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:59.568326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d4ee0ef-c743-45f4-bd4c-9248ee8a9c9d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:59.569292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d4ee0ef-c743-45f4-bd4c-9248ee8a9c9d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:59.572281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d4ee0ef-c743-45f4-bd4c-9248ee8a9c9d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:59.573243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d4ee0ef-c743-45f4-bd4c-9248ee8a9c9d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:59.573860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d4ee0ef-c743-45f4-bd4c-9248ee8a9c9d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:59.575792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d4ee0ef-c743-45f4-bd4c-9248ee8a9c9d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:59.637445 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-3d4ee0ef-c743-45f4-bd4c-9248ee8a9c9d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] HTTP exception thrown: Cannot 'attach_volume' instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 while it is in vm_state rescued Aug 09 14:51:59.639372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-998cf3fc-5864-4645-97e6-149ef167a670 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd970d0bf9e754591b09af75bbf64a96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74ba1baccbed4737aff5a8aa5d0f8665', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d4ee0ef-c743-45f4-bd4c-9248ee8a9c9d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Request method failure captured: Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/os-volume_attachments HTTP/1.1 Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 74 Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nQm9peRLyL-_ZL-9bNt1h-d9klu5PkrS_r357cpe12gMlxICQ1HHucyUskRO5kPygg95_v20_f9GCogcbu9CMWwyIZJ02lyqO-GFoRzdRBe_4fpq23MfQZHMH2nNzxDS_zNouresiy_aJnSNaognXLjQlW_aeA_R6cmhZY0LfELTto Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0caed61cb95467ba8b076c63f6706de", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cfd1981c518d4432b4635c1768114b22 Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: {"volumeAttachment": {"volumeId": "c56c61cd-c8a7-4603-af8e-d96345871856"}} Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: exception: Cannot 'attach_volume' instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 while it is in vm_state rescued Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'server_id': '7e813d1b-4c53-4343-a42b-6692f9fc40b6', 'body': {'volumeAttachment': {'volumeId': 'c56c61cd-c8a7-4603-af8e-d96345871856'}}} Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 09 14:51:59.639693 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 while it is in vm_state rescued Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 while it is in vm_state rescued Aug 09 14:51:59.644488 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:51:59.648563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d4ee0ef-c743-45f4-bd4c-9248ee8a9c9d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Returning 409 to user: Cannot 'attach_volume' instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 while it is in vm_state rescued {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:51:59.649696 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d4ee0ef-c743-45f4-bd4c-9248ee8a9c9d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.112456 Aug 09 14:51:59.651379 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2118/4235] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 14:51:59 2022] POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/os-volume_attachments => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:51:59.662274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec227a5c-3d32-40c2-ab79-353d8b628124 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:59.663200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ec227a5c-3d32-40c2-ab79-353d8b628124 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:59.665693 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-998cf3fc-5864-4645-97e6-149ef167a670 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 200 len: 1454 microversion: 2.1 time: 0.271124 Aug 09 14:51:59.674809 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2118/4236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:59 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 1454 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:51:59.694641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec227a5c-3d32-40c2-ab79-353d8b628124 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:59.695489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec227a5c-3d32-40c2-ab79-353d8b628124 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:59.696126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec227a5c-3d32-40c2-ab79-353d8b628124 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:59.697568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec227a5c-3d32-40c2-ab79-353d8b628124 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:59.698338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec227a5c-3d32-40c2-ab79-353d8b628124 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:59.699686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec227a5c-3d32-40c2-ab79-353d8b628124 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:59.870070 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec227a5c-3d32-40c2-ab79-353d8b628124 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/action" status: 202 len: 0 microversion: 2.1 time: 0.213991 Aug 09 14:51:59.874936 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2119/4237] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:51:59 2022] POST /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:51:59.880883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0312384-5b85-4dd2-b275-0b54b3753e64 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:51:59.881678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0312384-5b85-4dd2-b275-0b54b3753e64 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:51:59.896378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0312384-5b85-4dd2-b275-0b54b3753e64 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:59.898737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0312384-5b85-4dd2-b275-0b54b3753e64 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:59.900205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0312384-5b85-4dd2-b275-0b54b3753e64 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:59.903610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0312384-5b85-4dd2-b275-0b54b3753e64 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:59.904652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0312384-5b85-4dd2-b275-0b54b3753e64 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:59.908857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0312384-5b85-4dd2-b275-0b54b3753e64 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:59.944914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5707a088-1d79-45f3-a380-65da7696d31e req-1e047673-0450-4ae3-98a0-44c0056ba796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13df3ce4-02eb-4393-bb6b-d72ab806dc2a", "name": "network-vif-deleted", "tag": "30faceb9-ce6e-49b0-9521-b0b40b2ff926"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:51:59.967971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5707a088-1d79-45f3-a380-65da7696d31e req-1e047673-0450-4ae3-98a0-44c0056ba796 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:51:59.968757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5707a088-1d79-45f3-a380-65da7696d31e req-1e047673-0450-4ae3-98a0-44c0056ba796 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:51:59.969360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5707a088-1d79-45f3-a380-65da7696d31e req-1e047673-0450-4ae3-98a0-44c0056ba796 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:51:59.989915 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5707a088-1d79-45f3-a380-65da7696d31e req-1e047673-0450-4ae3-98a0-44c0056ba796 service nova] Creating event network-vif-deleted:30faceb9-ce6e-49b0-9521-b0b40b2ff926 for instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a on n-h1-844626-8 Aug 09 14:52:00.004795 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5707a088-1d79-45f3-a380-65da7696d31e req-1e047673-0450-4ae3-98a0-44c0056ba796 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063739 Aug 09 14:52:00.006245 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2120/4238] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:52:00.428094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1b6fe5d9-d10d-4b98-9f0f-03a082e295f2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:00.429293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1b6fe5d9-d10d-4b98-9f0f-03a082e295f2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:00.450556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b6fe5d9-d10d-4b98-9f0f-03a082e295f2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:00.452028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b6fe5d9-d10d-4b98-9f0f-03a082e295f2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:00.452522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b6fe5d9-d10d-4b98-9f0f-03a082e295f2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:00.453284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b6fe5d9-d10d-4b98-9f0f-03a082e295f2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:00.453756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b6fe5d9-d10d-4b98-9f0f-03a082e295f2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:00.457660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b6fe5d9-d10d-4b98-9f0f-03a082e295f2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:01.194228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0312384-5b85-4dd2-b275-0b54b3753e64 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:01.205808 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0312384-5b85-4dd2-b275-0b54b3753e64 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1509 microversion: 2.1 time: 1.330244 Aug 09 14:52:01.225826 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2119/4239] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:51:59 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1509 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:52:01.698541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc0dd0f0-4650-493c-b4e3-ee42bd073cab tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:01.699450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc0dd0f0-4650-493c-b4e3-ee42bd073cab tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:01.712364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0dd0f0-4650-493c-b4e3-ee42bd073cab tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:01.713719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0dd0f0-4650-493c-b4e3-ee42bd073cab tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:01.715160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0dd0f0-4650-493c-b4e3-ee42bd073cab tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:01.718133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0dd0f0-4650-493c-b4e3-ee42bd073cab tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:01.718826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0dd0f0-4650-493c-b4e3-ee42bd073cab tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:01.720824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc0dd0f0-4650-493c-b4e3-ee42bd073cab tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:01.763384 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-dc0dd0f0-4650-493c-b4e3-ee42bd073cab tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc0dd0f0-4650-493c-b4e3-ee42bd073cab tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a HTTP/1.1 Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '13df3ce4-02eb-4393-bb6b-d72ab806dc2a'} Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:01.769586 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.774476 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:01.774476 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:01.774476 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:01.774476 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:01.774476 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:01.774476 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.774476 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.781750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc0dd0f0-4650-493c-b4e3-ee42bd073cab tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:01.783466 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc0dd0f0-4650-493c-b4e3-ee42bd073cab tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 404 len: 111 microversion: 2.1 time: 0.569326 Aug 09 14:52:01.786814 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2120/4240] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:01 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 111 bytes in 573 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:01.802722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2481b9e7-cfb7-4b88-b600-f7eb17675072 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:01.804978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2481b9e7-cfb7-4b88-b600-f7eb17675072 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:01.820555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2481b9e7-cfb7-4b88-b600-f7eb17675072 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:01.821374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2481b9e7-cfb7-4b88-b600-f7eb17675072 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:01.822779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2481b9e7-cfb7-4b88-b600-f7eb17675072 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:01.824825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2481b9e7-cfb7-4b88-b600-f7eb17675072 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:01.825870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2481b9e7-cfb7-4b88-b600-f7eb17675072 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:01.826728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2481b9e7-cfb7-4b88-b600-f7eb17675072 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:01.876744 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-2481b9e7-cfb7-4b88-b600-f7eb17675072 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2481b9e7-cfb7-4b88-b600-f7eb17675072 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a HTTP/1.1 Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '13df3ce4-02eb-4393-bb6b-d72ab806dc2a'} Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:01.884296 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2481b9e7-cfb7-4b88-b600-f7eb17675072 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:01.888098 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2481b9e7-cfb7-4b88-b600-f7eb17675072 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 404 len: 111 microversion: 2.1 time: 0.096579 Aug 09 14:52:01.891544 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2121/4241] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:52:01 2022] DELETE /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:01.903679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06abd6fe-306e-4080-b9c5-6257ff3fff07 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:01.906216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06abd6fe-306e-4080-b9c5-6257ff3fff07 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 13df3ce4-02eb-4393-bb6b-d72ab806dc2a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:01.919861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06abd6fe-306e-4080-b9c5-6257ff3fff07 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:01.921191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06abd6fe-306e-4080-b9c5-6257ff3fff07 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:01.924323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06abd6fe-306e-4080-b9c5-6257ff3fff07 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:01.926861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06abd6fe-306e-4080-b9c5-6257ff3fff07 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:01.928308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06abd6fe-306e-4080-b9c5-6257ff3fff07 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:01.931208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06abd6fe-306e-4080-b9c5-6257ff3fff07 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:01.966994 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-06abd6fe-306e-4080-b9c5-6257ff3fff07 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06abd6fe-306e-4080-b9c5-6257ff3fff07 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a HTTP/1.1 Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '13df3ce4-02eb-4393-bb6b-d72ab806dc2a'} Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:01.970735 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.975630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:01.975630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:01.975630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:01.975630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:01.975630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:01.975630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. Aug 09 14:52:01.975630 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:01.980050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06abd6fe-306e-4080-b9c5-6257ff3fff07 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 13df3ce4-02eb-4393-bb6b-d72ab806dc2a could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:01.981162 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06abd6fe-306e-4080-b9c5-6257ff3fff07 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a" status: 404 len: 111 microversion: 2.1 time: 0.088414 Aug 09 14:52:01.983762 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2122/4242] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:01 2022] GET /compute/v2.1/servers/13df3ce4-02eb-4393-bb6b-d72ab806dc2a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:01.996548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-213546de-46a3-4b3f-bf5a-7b5e5196a917 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:01.999622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-213546de-46a3-4b3f-bf5a-7b5e5196a917 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:02.016434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-213546de-46a3-4b3f-bf5a-7b5e5196a917 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.017221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-213546de-46a3-4b3f-bf5a-7b5e5196a917 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.019135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-213546de-46a3-4b3f-bf5a-7b5e5196a917 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.021573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-213546de-46a3-4b3f-bf5a-7b5e5196a917 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.022247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-213546de-46a3-4b3f-bf5a-7b5e5196a917 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.023927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-213546de-46a3-4b3f-bf5a-7b5e5196a917 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.058032 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-213546de-46a3-4b3f-bf5a-7b5e5196a917 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-213546de-46a3-4b3f-bf5a-7b5e5196a917 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 HTTP/1.1 Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '4a147d07-f2a5-4ecc-a667-295abf7b5da3'} Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:02.060378 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-213546de-46a3-4b3f-bf5a-7b5e5196a917 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-213546de-46a3-4b3f-bf5a-7b5e5196a917 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 404 len: 111 microversion: 2.1 time: 0.076060 Aug 09 14:52:02.065515 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2123/4243] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:52:01 2022] DELETE /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:02.073653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34a83e7e-38a3-4352-b8ee-c54146e36302 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:02.080546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34a83e7e-38a3-4352-b8ee-c54146e36302 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 4a147d07-f2a5-4ecc-a667-295abf7b5da3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:02.095453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34a83e7e-38a3-4352-b8ee-c54146e36302 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.101482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34a83e7e-38a3-4352-b8ee-c54146e36302 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.102463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34a83e7e-38a3-4352-b8ee-c54146e36302 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.103430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34a83e7e-38a3-4352-b8ee-c54146e36302 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.104068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34a83e7e-38a3-4352-b8ee-c54146e36302 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.104688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34a83e7e-38a3-4352-b8ee-c54146e36302 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.136659 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-34a83e7e-38a3-4352-b8ee-c54146e36302 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34a83e7e-38a3-4352-b8ee-c54146e36302 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 HTTP/1.1 Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '4a147d07-f2a5-4ecc-a667-295abf7b5da3'} Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.144803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.148756 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.148756 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.148756 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.148756 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:02.148756 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:02.148756 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. Aug 09 14:52:02.148756 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.151472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34a83e7e-38a3-4352-b8ee-c54146e36302 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 4a147d07-f2a5-4ecc-a667-295abf7b5da3 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:02.152544 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34a83e7e-38a3-4352-b8ee-c54146e36302 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3" status: 404 len: 111 microversion: 2.1 time: 0.084631 Aug 09 14:52:02.153585 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2124/4244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:02 2022] GET /compute/v2.1/servers/4a147d07-f2a5-4ecc-a667-295abf7b5da3 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:02.165434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9bdc8bac-04e4-4d7c-bdad-43f39c80ad6c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:02.169186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9bdc8bac-04e4-4d7c-bdad-43f39c80ad6c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:02.186308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9bdc8bac-04e4-4d7c-bdad-43f39c80ad6c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.186801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9bdc8bac-04e4-4d7c-bdad-43f39c80ad6c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.187239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9bdc8bac-04e4-4d7c-bdad-43f39c80ad6c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.187940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9bdc8bac-04e4-4d7c-bdad-43f39c80ad6c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.188568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9bdc8bac-04e4-4d7c-bdad-43f39c80ad6c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.189145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9bdc8bac-04e4-4d7c-bdad-43f39c80ad6c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.207121 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-9bdc8bac-04e4-4d7c-bdad-43f39c80ad6c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9bdc8bac-04e4-4d7c-bdad-43f39c80ad6c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 HTTP/1.1 Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '45f8bb6e-e556-4454-bea9-c1d1b0e3d986'} Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:02.209374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:02.213207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:52:02.213207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.213207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.213207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.213207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.213207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.213207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.213207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:02.213207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:02.213207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:52:02.213207 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.215620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9bdc8bac-04e4-4d7c-bdad-43f39c80ad6c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:02.216687 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9bdc8bac-04e4-4d7c-bdad-43f39c80ad6c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 404 len: 111 microversion: 2.1 time: 0.055781 Aug 09 14:52:02.220588 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2125/4245] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:52:02 2022] DELETE /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:52:02.226626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32aaf3b7-6d62-4c02-957d-9d9ddd0ed50e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:02.229299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32aaf3b7-6d62-4c02-957d-9d9ddd0ed50e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 45f8bb6e-e556-4454-bea9-c1d1b0e3d986] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:02.236646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32aaf3b7-6d62-4c02-957d-9d9ddd0ed50e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.237420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32aaf3b7-6d62-4c02-957d-9d9ddd0ed50e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.238272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32aaf3b7-6d62-4c02-957d-9d9ddd0ed50e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.239325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32aaf3b7-6d62-4c02-957d-9d9ddd0ed50e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.239963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32aaf3b7-6d62-4c02-957d-9d9ddd0ed50e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.242383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32aaf3b7-6d62-4c02-957d-9d9ddd0ed50e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.260934 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-32aaf3b7-6d62-4c02-957d-9d9ddd0ed50e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32aaf3b7-6d62-4c02-957d-9d9ddd0ed50e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 HTTP/1.1 Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '45f8bb6e-e556-4454-bea9-c1d1b0e3d986'} Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.262927 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.267019 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.267019 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.267019 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.267019 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:02.267019 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:02.267019 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. Aug 09 14:52:02.267019 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.269231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32aaf3b7-6d62-4c02-957d-9d9ddd0ed50e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 45f8bb6e-e556-4454-bea9-c1d1b0e3d986 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:02.270322 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32aaf3b7-6d62-4c02-957d-9d9ddd0ed50e tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986" status: 404 len: 111 microversion: 2.1 time: 0.048515 Aug 09 14:52:02.274632 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2126/4246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:02 2022] GET /compute/v2.1/servers/45f8bb6e-e556-4454-bea9-c1d1b0e3d986 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:02.280732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-12aaf72d-82cf-4e99-b97d-5721f50caec1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:02.281660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-12aaf72d-82cf-4e99-b97d-5721f50caec1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:02.290937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12aaf72d-82cf-4e99-b97d-5721f50caec1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.291772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12aaf72d-82cf-4e99-b97d-5721f50caec1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.292462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12aaf72d-82cf-4e99-b97d-5721f50caec1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.293386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12aaf72d-82cf-4e99-b97d-5721f50caec1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.294048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12aaf72d-82cf-4e99-b97d-5721f50caec1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.294697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12aaf72d-82cf-4e99-b97d-5721f50caec1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.315896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:02.427727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b6fe5d9-d10d-4b98-9f0f-03a082e295f2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:02.447453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b6fe5d9-d10d-4b98-9f0f-03a082e295f2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:02.451069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b6fe5d9-d10d-4b98-9f0f-03a082e295f2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:02.454489 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1b6fe5d9-d10d-4b98-9f0f-03a082e295f2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1886 microversion: 2.32 time: 2.037946 Aug 09 14:52:02.461929 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2121/4247] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:00 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1886 bytes in 2046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:02.473592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1b02da53-f9ca-4d76-83f0-a7918349accb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:02.474114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1b02da53-f9ca-4d76-83f0-a7918349accb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:02.492239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b02da53-f9ca-4d76-83f0-a7918349accb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.492738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b02da53-f9ca-4d76-83f0-a7918349accb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.493272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b02da53-f9ca-4d76-83f0-a7918349accb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.494054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b02da53-f9ca-4d76-83f0-a7918349accb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.494583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b02da53-f9ca-4d76-83f0-a7918349accb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.495021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b02da53-f9ca-4d76-83f0-a7918349accb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.562653 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-1b02da53-f9ca-4d76-83f0-a7918349accb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1b02da53-f9ca-4d76-83f0-a7918349accb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 HTTP/1.1 Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '271e7ad9-2da4-4661-83b9-f55d0c7c7e73'} Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:02.564459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:02.568177 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:52:02.568177 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.568177 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.568177 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.568177 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.568177 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.568177 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.568177 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:02.568177 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:02.568177 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:52:02.568177 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.568177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1b02da53-f9ca-4d76-83f0-a7918349accb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:02.570393 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1b02da53-f9ca-4d76-83f0-a7918349accb tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 404 len: 111 microversion: 2.1 time: 0.106297 Aug 09 14:52:02.575628 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2122/4248] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:52:02 2022] DELETE /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:02.579407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ab81e10-4c7e-4257-baf9-4a864483de08 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:02.580393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ab81e10-4c7e-4257-baf9-4a864483de08 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:02.589546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ab81e10-4c7e-4257-baf9-4a864483de08 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.590617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ab81e10-4c7e-4257-baf9-4a864483de08 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.592049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ab81e10-4c7e-4257-baf9-4a864483de08 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.593330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ab81e10-4c7e-4257-baf9-4a864483de08 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.594034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ab81e10-4c7e-4257-baf9-4a864483de08 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.595160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ab81e10-4c7e-4257-baf9-4a864483de08 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.613465 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6ab81e10-4c7e-4257-baf9-4a864483de08 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] HTTP exception thrown: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ab81e10-4c7e-4257-baf9-4a864483de08 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Request method failure captured: Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af HTTP/1.1 Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nLQadaRdnqc1qNL57GT1yajdgcJOojU3uWtd7e3Mu6KvXvvgqGrFcPlG8SFBhzXFzr0hPvTocdr2_-K0sGh6jO3T6xKH9WAMIGdljkB2T6UTUNEOlRNUivBVi-ozd9XI-Cg6Zub5k75YFHKi5wpSOYkyk7FDX6ZtGRfrHZJY8uNBiI Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.42 Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: dd3f9be3e6694608a10e84ebab6d1a2a Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-831387837 Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dd3f9be3e6694608a10e84ebab6d1a2a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dd3f9be3e6694608a10e84ebab6d1a2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd3f9be3e6694608a10e84ebab6d1a2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd3f9be3e6694608a10e84ebab6d1a2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TaggedBootDevicesTest_v242-831387837 Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: dd3f9be3e6694608a10e84ebab6d1a2a Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-831387837 Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TaggedBootDevicesTest_v242-831387837-project Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: df55ede6220049c1aee1bfd628c13a23 Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TaggedBootDevicesTest_v242-831387837-project Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'da519f2f-fb00-4edd-a06f-c055cf7fa4af'} Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:02.615518 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:02.619395 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:52:02.619395 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.619395 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.619395 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.619395 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.619395 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.619395 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.619395 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:02.619395 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:02.619395 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:52:02.619395 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.621647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ab81e10-4c7e-4257-baf9-4a864483de08 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Returning 404 to user: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:02.622999 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ab81e10-4c7e-4257-baf9-4a864483de08 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "DELETE /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 404 len: 111 microversion: 2.42 time: 0.048235 Aug 09 14:52:02.627992 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2123/4249] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:52:02 2022] DELETE /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:52:02.637273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ec64d30-3f26-4d9a-b3e5-27bad4436591 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:02.638330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ec64d30-3f26-4d9a-b3e5-27bad4436591 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 271e7ad9-2da4-4661-83b9-f55d0c7c7e73] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:02.649553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec64d30-3f26-4d9a-b3e5-27bad4436591 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.651433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec64d30-3f26-4d9a-b3e5-27bad4436591 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.652029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec64d30-3f26-4d9a-b3e5-27bad4436591 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.654046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec64d30-3f26-4d9a-b3e5-27bad4436591 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.654515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec64d30-3f26-4d9a-b3e5-27bad4436591 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.655003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ec64d30-3f26-4d9a-b3e5-27bad4436591 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.682275 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-5ec64d30-3f26-4d9a-b3e5-27bad4436591 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ec64d30-3f26-4d9a-b3e5-27bad4436591 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 HTTP/1.1 Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '271e7ad9-2da4-4661-83b9-f55d0c7c7e73'} Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.684834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.689650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.689650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.689650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.689650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:02.689650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:02.689650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. Aug 09 14:52:02.689650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.689650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ec64d30-3f26-4d9a-b3e5-27bad4436591 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 271e7ad9-2da4-4661-83b9-f55d0c7c7e73 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:02.689650 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ec64d30-3f26-4d9a-b3e5-27bad4436591 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73" status: 404 len: 111 microversion: 2.1 time: 0.057428 Aug 09 14:52:02.689650 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2124/4250] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:02 2022] GET /compute/v2.1/servers/271e7ad9-2da4-4661-83b9-f55d0c7c7e73 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:02.694088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d82bc38c-215c-43d9-af2f-13f32fc6ce78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:02.694957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d82bc38c-215c-43d9-af2f-13f32fc6ce78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] [instance: da519f2f-fb00-4edd-a06f-c055cf7fa4af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:02.720191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d82bc38c-215c-43d9-af2f-13f32fc6ce78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.721169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d82bc38c-215c-43d9-af2f-13f32fc6ce78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.721901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d82bc38c-215c-43d9-af2f-13f32fc6ce78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.722922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d82bc38c-215c-43d9-af2f-13f32fc6ce78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.724139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d82bc38c-215c-43d9-af2f-13f32fc6ce78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.725830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d82bc38c-215c-43d9-af2f-13f32fc6ce78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.757723 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-d82bc38c-215c-43d9-af2f-13f32fc6ce78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] HTTP exception thrown: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d82bc38c-215c-43d9-af2f-13f32fc6ce78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Request method failure captured: Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af HTTP/1.1 Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nLQadaRdnqc1qNL57GT1yajdgcJOojU3uWtd7e3Mu6KvXvvgqGrFcPlG8SFBhzXFzr0hPvTocdr2_-K0sGh6jO3T6xKH9WAMIGdljkB2T6UTUNEOlRNUivBVi-ozd9XI-Cg6Zub5k75YFHKi5wpSOYkyk7FDX6ZtGRfrHZJY8uNBiI Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.42 Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: dd3f9be3e6694608a10e84ebab6d1a2a Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-831387837 Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_dd3f9be3e6694608a10e84ebab6d1a2a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/dd3f9be3e6694608a10e84ebab6d1a2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd3f9be3e6694608a10e84ebab6d1a2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/dd3f9be3e6694608a10e84ebab6d1a2a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TaggedBootDevicesTest_v242-831387837 Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: dd3f9be3e6694608a10e84ebab6d1a2a Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-831387837 Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TaggedBootDevicesTest_v242-831387837-project Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: df55ede6220049c1aee1bfd628c13a23 Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TaggedBootDevicesTest_v242-831387837-project Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'da519f2f-fb00-4edd-a06f-c055cf7fa4af'} Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.763819 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.768985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.768985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.768985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.768985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.768985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:02.768985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:02.768985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. Aug 09 14:52:02.768985 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.768985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d82bc38c-215c-43d9-af2f-13f32fc6ce78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] Returning 404 to user: Instance da519f2f-fb00-4edd-a06f-c055cf7fa4af could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:02.773227 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d82bc38c-215c-43d9-af2f-13f32fc6ce78 tempest-TaggedBootDevicesTest_v242-831387837 tempest-TaggedBootDevicesTest_v242-831387837-project] 10.222.0.50 "GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af" status: 404 len: 111 microversion: 2.42 time: 0.083941 Aug 09 14:52:02.777448 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2125/4251] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:02 2022] GET /compute/v2.1/servers/da519f2f-fb00-4edd-a06f-c055cf7fa4af => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:52:02.784993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-abb3497c-520b-49d3-9958-6671405e8254 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:02.786046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-abb3497c-520b-49d3-9958-6671405e8254 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 460340e3-68cf-4917-84d1-85ac5b0fbaad] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:02.792867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-abb3497c-520b-49d3-9958-6671405e8254 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.793587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-abb3497c-520b-49d3-9958-6671405e8254 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.794133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-abb3497c-520b-49d3-9958-6671405e8254 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.794995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-abb3497c-520b-49d3-9958-6671405e8254 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.795686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-abb3497c-520b-49d3-9958-6671405e8254 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.796218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-abb3497c-520b-49d3-9958-6671405e8254 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.813673 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-abb3497c-520b-49d3-9958-6671405e8254 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-abb3497c-520b-49d3-9958-6671405e8254 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad HTTP/1.1 Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '460340e3-68cf-4917-84d1-85ac5b0fbaad'} Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:02.815704 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-abb3497c-520b-49d3-9958-6671405e8254 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-abb3497c-520b-49d3-9958-6671405e8254 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad" status: 404 len: 111 microversion: 2.1 time: 0.038738 Aug 09 14:52:02.822479 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2126/4252] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:52:02 2022] DELETE /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:02.838541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a1976ca3-86d0-4144-9ffe-6afec1e857a3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:02.839210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a1976ca3-86d0-4144-9ffe-6afec1e857a3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 460340e3-68cf-4917-84d1-85ac5b0fbaad] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:02.867836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a1976ca3-86d0-4144-9ffe-6afec1e857a3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.869548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a1976ca3-86d0-4144-9ffe-6afec1e857a3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.872565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a1976ca3-86d0-4144-9ffe-6afec1e857a3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.873748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a1976ca3-86d0-4144-9ffe-6afec1e857a3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:02.875365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a1976ca3-86d0-4144-9ffe-6afec1e857a3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:02.876232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a1976ca3-86d0-4144-9ffe-6afec1e857a3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:02.924335 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-a1976ca3-86d0-4144-9ffe-6afec1e857a3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a1976ca3-86d0-4144-9ffe-6afec1e857a3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad HTTP/1.1 Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '460340e3-68cf-4917-84d1-85ac5b0fbaad'} Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:02.927431 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.931376 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:02.931376 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:02.931376 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:02.931376 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:02.931376 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:02.931376 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. Aug 09 14:52:02.931376 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:02.936021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a1976ca3-86d0-4144-9ffe-6afec1e857a3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 460340e3-68cf-4917-84d1-85ac5b0fbaad could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:02.938000 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a1976ca3-86d0-4144-9ffe-6afec1e857a3 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad" status: 404 len: 111 microversion: 2.1 time: 0.113988 Aug 09 14:52:02.940709 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2127/4253] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:02 2022] GET /compute/v2.1/servers/460340e3-68cf-4917-84d1-85ac5b0fbaad => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:03.097695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-12aaf72d-82cf-4e99-b97d-5721f50caec1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:03.122041 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-12aaf72d-82cf-4e99-b97d-5721f50caec1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1509 microversion: 2.1 time: 0.845872 Aug 09 14:52:03.126090 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2127/4254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:02 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1509 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:03.489047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-084752ac-f9b4-480d-9d81-9d0982ccb789 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:03.489679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-084752ac-f9b4-480d-9d81-9d0982ccb789 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:03.499931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-084752ac-f9b4-480d-9d81-9d0982ccb789 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:03.500490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-084752ac-f9b4-480d-9d81-9d0982ccb789 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:03.500942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-084752ac-f9b4-480d-9d81-9d0982ccb789 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:03.506026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-084752ac-f9b4-480d-9d81-9d0982ccb789 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:03.508784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-084752ac-f9b4-480d-9d81-9d0982ccb789 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:03.509327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-084752ac-f9b4-480d-9d81-9d0982ccb789 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:04.148641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9345eb47-8e79-4302-abdb-1b8bededd882 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:04.149929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9345eb47-8e79-4302-abdb-1b8bededd882 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:04.174888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9345eb47-8e79-4302-abdb-1b8bededd882 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:04.181585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9345eb47-8e79-4302-abdb-1b8bededd882 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:04.182280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9345eb47-8e79-4302-abdb-1b8bededd882 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:04.194898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9345eb47-8e79-4302-abdb-1b8bededd882 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:04.196906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9345eb47-8e79-4302-abdb-1b8bededd882 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:04.197556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9345eb47-8e79-4302-abdb-1b8bededd882 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:04.385553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-084752ac-f9b4-480d-9d81-9d0982ccb789 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:04.401966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-084752ac-f9b4-480d-9d81-9d0982ccb789 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:04.408443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-084752ac-f9b4-480d-9d81-9d0982ccb789 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:04.416680 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-084752ac-f9b4-480d-9d81-9d0982ccb789 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.932710 Aug 09 14:52:04.417992 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2128/4255] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:03 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:04.435836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d82198d5-d92e-4eee-acc4-8c03bff298bb req-4af586e3-6649-4808-8dd7-6be165b3f015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bcda666-d36a-488f-8fb0-fe12470ff45f", "tag": "9c42ace2-95a4-43eb-abf9-6c87e774f843"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:04.460019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d82198d5-d92e-4eee-acc4-8c03bff298bb req-4af586e3-6649-4808-8dd7-6be165b3f015 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:04.461879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d82198d5-d92e-4eee-acc4-8c03bff298bb req-4af586e3-6649-4808-8dd7-6be165b3f015 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:04.462358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d82198d5-d92e-4eee-acc4-8c03bff298bb req-4af586e3-6649-4808-8dd7-6be165b3f015 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:04.493690 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d82198d5-d92e-4eee-acc4-8c03bff298bb req-4af586e3-6649-4808-8dd7-6be165b3f015 service nova] Creating event network-changed:9c42ace2-95a4-43eb-abf9-6c87e774f843 for instance 9bcda666-d36a-488f-8fb0-fe12470ff45f on n-h1-844626-8 Aug 09 14:52:04.503422 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d82198d5-d92e-4eee-acc4-8c03bff298bb req-4af586e3-6649-4808-8dd7-6be165b3f015 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083581 Aug 09 14:52:04.504858 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2129/4256] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:05.070883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9345eb47-8e79-4302-abdb-1b8bededd882 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:05.085365 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9345eb47-8e79-4302-abdb-1b8bededd882 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1515 microversion: 2.1 time: 0.943224 Aug 09 14:52:05.089750 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2128/4257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:04 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1515 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:05.445905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0fd3f3dd-6943-44c1-9cc9-d2d1707c83e5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:05.447052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0fd3f3dd-6943-44c1-9cc9-d2d1707c83e5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:05.461745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3dd-6943-44c1-9cc9-d2d1707c83e5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:05.463304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3dd-6943-44c1-9cc9-d2d1707c83e5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:05.470750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3dd-6943-44c1-9cc9-d2d1707c83e5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:05.471743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3dd-6943-44c1-9cc9-d2d1707c83e5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:05.472892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3dd-6943-44c1-9cc9-d2d1707c83e5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:05.475583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0fd3f3dd-6943-44c1-9cc9-d2d1707c83e5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:06.687347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0fd3f3dd-6943-44c1-9cc9-d2d1707c83e5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:06.709850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0fd3f3dd-6943-44c1-9cc9-d2d1707c83e5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:06.712064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0fd3f3dd-6943-44c1-9cc9-d2d1707c83e5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:06.713955 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0fd3f3dd-6943-44c1-9cc9-d2d1707c83e5 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 1.273556 Aug 09 14:52:06.715295 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2130/4258] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:05 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:07.743373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db7291ff-1657-4b71-96ed-58d2d4e3f7bc tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:07.745610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-db7291ff-1657-4b71-96ed-58d2d4e3f7bc tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:07.762548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db7291ff-1657-4b71-96ed-58d2d4e3f7bc tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:07.764837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db7291ff-1657-4b71-96ed-58d2d4e3f7bc tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:07.765517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db7291ff-1657-4b71-96ed-58d2d4e3f7bc tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:07.767151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db7291ff-1657-4b71-96ed-58d2d4e3f7bc tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:07.769771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db7291ff-1657-4b71-96ed-58d2d4e3f7bc tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:07.772670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db7291ff-1657-4b71-96ed-58d2d4e3f7bc tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:08.337021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d677eb73-c78b-4ac0-bfe6-f942c02e65d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'create', calling method: .version_select at 0x7f41dda65700>, body: {"keypair": {"name": "tempest-keypair-1307513843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9bGV8Pa2MhYURVpSoGpezQXtC7XnHK5xZNHKxYH+/Ti2PHvCFpVsmjdFQlWKLnlHCs3sV3RnkCmDZlIev8+wAD154+tDXABhLa+8m3oGve+SAK2DMHjZ9UGuDJ6YK7+A=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:08.419335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d677eb73-c78b-4ac0-bfe6-f942c02e65d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Getting quotas for project e0caed61cb95467ba8b076c63f6706de. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:08.452930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d677eb73-c78b-4ac0-bfe6-f942c02e65d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Getting quotas for user cfd1981c518d4432b4635c1768114b22 and project e0caed61cb95467ba8b076c63f6706de. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:08.574163 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d677eb73-c78b-4ac0-bfe6-f942c02e65d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.241254 Aug 09 14:52:08.577279 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2131/4259] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:52:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:09.984180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-db7291ff-1657-4b71-96ed-58d2d4e3f7bc tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:10.032655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-db7291ff-1657-4b71-96ed-58d2d4e3f7bc tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:10.047386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-db7291ff-1657-4b71-96ed-58d2d4e3f7bc tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:10.048638 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-db7291ff-1657-4b71-96ed-58d2d4e3f7bc tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 2.310525 Aug 09 14:52:10.071368 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2129/4260] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:07 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:11.078596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1cb85fb8-3589-403d-a9b0-cc9595ad68f9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:11.081669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1cb85fb8-3589-403d-a9b0-cc9595ad68f9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:11.107010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cb85fb8-3589-403d-a9b0-cc9595ad68f9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:11.110023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cb85fb8-3589-403d-a9b0-cc9595ad68f9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:11.111408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cb85fb8-3589-403d-a9b0-cc9595ad68f9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:11.113583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cb85fb8-3589-403d-a9b0-cc9595ad68f9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:11.117773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cb85fb8-3589-403d-a9b0-cc9595ad68f9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:11.118555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cb85fb8-3589-403d-a9b0-cc9595ad68f9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:11.745043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1cb85fb8-3589-403d-a9b0-cc9595ad68f9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:11.767668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1cb85fb8-3589-403d-a9b0-cc9595ad68f9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:11.770283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1cb85fb8-3589-403d-a9b0-cc9595ad68f9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:11.777036 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1cb85fb8-3589-403d-a9b0-cc9595ad68f9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.702320 Aug 09 14:52:11.779237 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2132/4261] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:11 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:12.802320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ffcab86-1291-415a-ac5e-b19fedf8f2c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:12.803120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ffcab86-1291-415a-ac5e-b19fedf8f2c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:12.835834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ffcab86-1291-415a-ac5e-b19fedf8f2c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:12.838101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ffcab86-1291-415a-ac5e-b19fedf8f2c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:12.838679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ffcab86-1291-415a-ac5e-b19fedf8f2c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:12.842140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ffcab86-1291-415a-ac5e-b19fedf8f2c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:12.853601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ffcab86-1291-415a-ac5e-b19fedf8f2c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:12.855113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ffcab86-1291-415a-ac5e-b19fedf8f2c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:13.370876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b248827-621f-419f-89d4-eb59f674db15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:13.371446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b248827-621f-419f-89d4-eb59f674db15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:13.409739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b248827-621f-419f-89d4-eb59f674db15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:13.410285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b248827-621f-419f-89d4-eb59f674db15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:13.410740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b248827-621f-419f-89d4-eb59f674db15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:13.411558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b248827-621f-419f-89d4-eb59f674db15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:13.412018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b248827-621f-419f-89d4-eb59f674db15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:13.419842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b248827-621f-419f-89d4-eb59f674db15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:13.479034 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-7b248827-621f-419f-89d4-eb59f674db15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b248827-621f-419f-89d4-eb59f674db15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 HTTP/1.1 Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '99fbebfa-9a85-4730-843f-9863ac60c365'} Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:13.487941 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:13.494511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:52:13.494511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.494511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:13.494511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.494511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:13.494511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:13.494511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:13.494511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:13.494511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:13.494511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:52:13.494511 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.494511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b248827-621f-419f-89d4-eb59f674db15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:13.500193 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b248827-621f-419f-89d4-eb59f674db15 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 404 len: 111 microversion: 2.1 time: 0.125593 Aug 09 14:52:13.501936 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2133/4262] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:52:13 2022] DELETE /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:13.521054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a8cbb50-79a1-4e37-88b4-70c5db04b5a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:13.522541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a8cbb50-79a1-4e37-88b4-70c5db04b5a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 99fbebfa-9a85-4730-843f-9863ac60c365] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:13.553467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a8cbb50-79a1-4e37-88b4-70c5db04b5a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:13.553861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a8cbb50-79a1-4e37-88b4-70c5db04b5a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:13.554360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a8cbb50-79a1-4e37-88b4-70c5db04b5a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:13.562397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a8cbb50-79a1-4e37-88b4-70c5db04b5a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:13.576892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a8cbb50-79a1-4e37-88b4-70c5db04b5a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:13.577659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a8cbb50-79a1-4e37-88b4-70c5db04b5a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:13.596070 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-1a8cbb50-79a1-4e37-88b4-70c5db04b5a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a8cbb50-79a1-4e37-88b4-70c5db04b5a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 HTTP/1.1 Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '99fbebfa-9a85-4730-843f-9863ac60c365'} Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:13.600292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.604481 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:13.604481 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:13.604481 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:13.604481 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:13.604481 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:13.604481 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. Aug 09 14:52:13.604481 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.608656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a8cbb50-79a1-4e37-88b4-70c5db04b5a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 99fbebfa-9a85-4730-843f-9863ac60c365 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:13.612094 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a8cbb50-79a1-4e37-88b4-70c5db04b5a4 tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365" status: 404 len: 111 microversion: 2.1 time: 0.103623 Aug 09 14:52:13.613475 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2134/4263] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:13 2022] GET /compute/v2.1/servers/99fbebfa-9a85-4730-843f-9863ac60c365 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:13.636602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04315711-d7f7-49e4-b3c9-847bb6002c4c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:13.638882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-04315711-d7f7-49e4-b3c9-847bb6002c4c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:13.676788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04315711-d7f7-49e4-b3c9-847bb6002c4c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:13.677511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04315711-d7f7-49e4-b3c9-847bb6002c4c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:13.678389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04315711-d7f7-49e4-b3c9-847bb6002c4c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:13.683862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04315711-d7f7-49e4-b3c9-847bb6002c4c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:13.686656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04315711-d7f7-49e4-b3c9-847bb6002c4c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:13.687342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04315711-d7f7-49e4-b3c9-847bb6002c4c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:13.719960 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-04315711-d7f7-49e4-b3c9-847bb6002c4c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04315711-d7f7-49e4-b3c9-847bb6002c4c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc HTTP/1.1 Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc'} Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:13.721805 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:13.725691 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:52:13.725691 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.725691 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:13.725691 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.725691 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:13.725691 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:13.725691 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:13.725691 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:13.725691 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:13.725691 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:52:13.725691 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.734910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04315711-d7f7-49e4-b3c9-847bb6002c4c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:13.736486 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-04315711-d7f7-49e4-b3c9-847bb6002c4c tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "DELETE /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 404 len: 111 microversion: 2.1 time: 0.118668 Aug 09 14:52:13.737702 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2135/4264] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:52:13 2022] DELETE /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:52:13.746496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39a19fbb-21f6-490d-86df-149f2fa2433b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:13.747722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39a19fbb-21f6-490d-86df-149f2fa2433b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] [instance: 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:13.783475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a19fbb-21f6-490d-86df-149f2fa2433b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:13.795210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a19fbb-21f6-490d-86df-149f2fa2433b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:13.798572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a19fbb-21f6-490d-86df-149f2fa2433b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:13.799591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a19fbb-21f6-490d-86df-149f2fa2433b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:13.800200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a19fbb-21f6-490d-86df-149f2fa2433b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:13.802335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39a19fbb-21f6-490d-86df-149f2fa2433b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:13.839140 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-39a19fbb-21f6-490d-86df-149f2fa2433b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] HTTP exception thrown: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:52:13.843419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ffcab86-1291-415a-ac5e-b19fedf8f2c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39a19fbb-21f6-490d-86df-149f2fa2433b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Request method failure captured: Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc HTTP/1.1 Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nNklBG2ye3xjaAe5IFtKxkZc4YIOgaXu3UBxt9c8Dl6M3ty3BN6nng-75ZuRRpdAiYqXeFF_5XxFOGtppXKFTlWWmD7ne2pLVuaPIISyIrd7DHQ3Rau_OS8b8Ia-KNXfFPGqpTDsXYpN5S5FO3pDjLgbiTX4jIoIJo9ncu-7PU81nU Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_74ba1baccbed4737aff5a8aa5d0f8665", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/74ba1baccbed4737aff5a8aa5d0f8665"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 74ba1baccbed4737aff5a8aa5d0f8665 Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1977113082 Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: d970d0bf9e754591b09af75bbf64a96d Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-1977113082-project Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc'} Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:52:13.862159 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.866106 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:52:13.866106 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:52:13.866106 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:52:13.866106 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:52:13.866106 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:52:13.866106 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. Aug 09 14:52:13.866106 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:52:13.866106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39a19fbb-21f6-490d-86df-149f2fa2433b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] Returning 404 to user: Instance 12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:52:13.870863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ffcab86-1291-415a-ac5e-b19fedf8f2c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:13.874268 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39a19fbb-21f6-490d-86df-149f2fa2433b tempest-DeleteServersTestJSON-1977113082 tempest-DeleteServersTestJSON-1977113082-project] 10.222.0.50 "GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc" status: 404 len: 111 microversion: 2.1 time: 0.128289 Aug 09 14:52:13.876712 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2136/4265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:13 2022] GET /compute/v2.1/servers/12b7eb6f-cee7-40e7-9b59-8dd0ab91c1fc => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:52:13.881370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ffcab86-1291-415a-ac5e-b19fedf8f2c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:13.885346 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ffcab86-1291-415a-ac5e-b19fedf8f2c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 1.087296 Aug 09 14:52:13.889110 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2130/4266] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:12 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:14.767704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-799760870", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3055f5ba-b955-4552-8d94-e4bbcdd301d2"}], "security_groups": [{"name": "tempest-securitygroup--1303916333"}], "key_name": "tempest-keypair-1307513843", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:14.924484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-559cfa99-a7fe-4046-81a0-a695b15d7f57 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:14.925129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-559cfa99-a7fe-4046-81a0-a695b15d7f57 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:14.959024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-559cfa99-a7fe-4046-81a0-a695b15d7f57 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:14.959664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-559cfa99-a7fe-4046-81a0-a695b15d7f57 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:14.960243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-559cfa99-a7fe-4046-81a0-a695b15d7f57 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:14.961095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-559cfa99-a7fe-4046-81a0-a695b15d7f57 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:14.961541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-559cfa99-a7fe-4046-81a0-a695b15d7f57 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:14.961961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-559cfa99-a7fe-4046-81a0-a695b15d7f57 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:15.164829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] validate_networks() for [('3055f5ba-b955-4552-8d94-e4bbcdd301d2', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:52:15.781523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-559cfa99-a7fe-4046-81a0-a695b15d7f57 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:15.793094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-559cfa99-a7fe-4046-81a0-a695b15d7f57 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:15.805305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-559cfa99-a7fe-4046-81a0-a695b15d7f57 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:15.809990 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-559cfa99-a7fe-4046-81a0-a695b15d7f57 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.895251 Aug 09 14:52:15.811113 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2131/4267] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:14 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:16.835137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:52:16.835684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:52:16.836398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:52:16.836926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:52:16.837456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:52:16.840479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0cb6fe45-8cac-43ee-adba-666d3f88e115 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:16.841101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0cb6fe45-8cac-43ee-adba-666d3f88e115 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:16.850451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0cb6fe45-8cac-43ee-adba-666d3f88e115 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:16.850938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0cb6fe45-8cac-43ee-adba-666d3f88e115 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:16.854796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0cb6fe45-8cac-43ee-adba-666d3f88e115 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:16.855617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0cb6fe45-8cac-43ee-adba-666d3f88e115 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:16.857138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:16.859190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0cb6fe45-8cac-43ee-adba-666d3f88e115 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:16.859879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0cb6fe45-8cac-43ee-adba-666d3f88e115 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:16.861148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:16.861749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:16.864033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:16.886337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:16.887692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:16.931637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Getting quotas for project e0caed61cb95467ba8b076c63f6706de. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:16.952347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Getting quotas for user cfd1981c518d4432b4635c1768114b22 and project e0caed61cb95467ba8b076c63f6706de. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:16.992724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:52:17.009875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:52:17.167656 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f7fbf67c-b9f1-47bf-8ec9-1d0357ab8816 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.404756 Aug 09 14:52:17.168952 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2137/4268] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:52:14 2022] POST /compute/v2.1/servers => generated 409 bytes in 2407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:52:17.203358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a99396d-29d7-488d-ba83-caf13be3f914 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:17.207533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a99396d-29d7-488d-ba83-caf13be3f914 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:17.894807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a99396d-29d7-488d-ba83-caf13be3f914 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:17.915551 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a99396d-29d7-488d-ba83-caf13be3f914 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1245 microversion: 2.1 time: 0.737449 Aug 09 14:52:17.930143 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2138/4269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:17 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1245 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:18.000181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0cb6fe45-8cac-43ee-adba-666d3f88e115 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:18.017203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0cb6fe45-8cac-43ee-adba-666d3f88e115 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:18.024729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0cb6fe45-8cac-43ee-adba-666d3f88e115 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:18.027384 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0cb6fe45-8cac-43ee-adba-666d3f88e115 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 1.191423 Aug 09 14:52:18.046238 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2132/4270] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:16 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:52:18.934522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0e8f285-00fe-436f-a010-822a0ad60e28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:18.935342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e0e8f285-00fe-436f-a010-822a0ad60e28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:18.948537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e8f285-00fe-436f-a010-822a0ad60e28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:18.950070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e8f285-00fe-436f-a010-822a0ad60e28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:18.951667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e8f285-00fe-436f-a010-822a0ad60e28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:18.954299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e8f285-00fe-436f-a010-822a0ad60e28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:18.956499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e8f285-00fe-436f-a010-822a0ad60e28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:18.958352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e8f285-00fe-436f-a010-822a0ad60e28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:19.056129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da969933-c166-4986-b81e-5cac9c7135eb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:19.057477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da969933-c166-4986-b81e-5cac9c7135eb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:19.068591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da969933-c166-4986-b81e-5cac9c7135eb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:19.072468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da969933-c166-4986-b81e-5cac9c7135eb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:19.073263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da969933-c166-4986-b81e-5cac9c7135eb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:19.074253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da969933-c166-4986-b81e-5cac9c7135eb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:19.076259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da969933-c166-4986-b81e-5cac9c7135eb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:19.078934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da969933-c166-4986-b81e-5cac9c7135eb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:19.466062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e0e8f285-00fe-436f-a010-822a0ad60e28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:19.472982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:19.477423 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e0e8f285-00fe-436f-a010-822a0ad60e28 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1305 microversion: 2.1 time: 0.547274 Aug 09 14:52:19.478355 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2139/4271] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:18 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1305 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:52:19.643868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-da969933-c166-4986-b81e-5cac9c7135eb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:19.667301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-da969933-c166-4986-b81e-5cac9c7135eb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:19.668826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-da969933-c166-4986-b81e-5cac9c7135eb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:19.670026 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da969933-c166-4986-b81e-5cac9c7135eb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.618520 Aug 09 14:52:19.675562 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2133/4272] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:19 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:20.502806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e2ae98f8-8651-4a5f-9857-e8a688d32dd4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:20.503981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e2ae98f8-8651-4a5f-9857-e8a688d32dd4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:20.536371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2ae98f8-8651-4a5f-9857-e8a688d32dd4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:20.537749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2ae98f8-8651-4a5f-9857-e8a688d32dd4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:20.538375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2ae98f8-8651-4a5f-9857-e8a688d32dd4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:20.539396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2ae98f8-8651-4a5f-9857-e8a688d32dd4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:20.540345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2ae98f8-8651-4a5f-9857-e8a688d32dd4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:20.540923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2ae98f8-8651-4a5f-9857-e8a688d32dd4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:20.694626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6baf9948-3a35-478c-924d-dc3836759658 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:20.695863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6baf9948-3a35-478c-924d-dc3836759658 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:20.705947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6baf9948-3a35-478c-924d-dc3836759658 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:20.708661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6baf9948-3a35-478c-924d-dc3836759658 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:20.709820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6baf9948-3a35-478c-924d-dc3836759658 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:20.712916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6baf9948-3a35-478c-924d-dc3836759658 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:20.713498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6baf9948-3a35-478c-924d-dc3836759658 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:20.714126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6baf9948-3a35-478c-924d-dc3836759658 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:20.921365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e2ae98f8-8651-4a5f-9857-e8a688d32dd4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:20.947749 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e2ae98f8-8651-4a5f-9857-e8a688d32dd4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1303 microversion: 2.1 time: 0.451780 Aug 09 14:52:20.966104 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2140/4273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:20 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1303 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:21.288605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6baf9948-3a35-478c-924d-dc3836759658 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:21.308098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6baf9948-3a35-478c-924d-dc3836759658 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:21.318652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6baf9948-3a35-478c-924d-dc3836759658 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:21.328082 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6baf9948-3a35-478c-924d-dc3836759658 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.632024 Aug 09 14:52:21.328846 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2134/4274] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:20 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:52:21.975149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1a33a3f-e1e9-4c4f-a5bc-e20dec92050b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:21.976338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1a33a3f-e1e9-4c4f-a5bc-e20dec92050b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:21.996117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1a33a3f-e1e9-4c4f-a5bc-e20dec92050b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:21.998585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1a33a3f-e1e9-4c4f-a5bc-e20dec92050b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:21.999282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1a33a3f-e1e9-4c4f-a5bc-e20dec92050b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:22.014532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1a33a3f-e1e9-4c4f-a5bc-e20dec92050b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:22.015820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1a33a3f-e1e9-4c4f-a5bc-e20dec92050b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:22.016491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1a33a3f-e1e9-4c4f-a5bc-e20dec92050b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:22.351818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e4c3755-d6ec-4961-88cd-7a5ad46a3575 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:22.352654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e4c3755-d6ec-4961-88cd-7a5ad46a3575 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:22.362296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:22.369355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e4c3755-d6ec-4961-88cd-7a5ad46a3575 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:22.370194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e4c3755-d6ec-4961-88cd-7a5ad46a3575 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:22.373858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e4c3755-d6ec-4961-88cd-7a5ad46a3575 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:22.379238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e4c3755-d6ec-4961-88cd-7a5ad46a3575 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:22.380262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e4c3755-d6ec-4961-88cd-7a5ad46a3575 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:22.380596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e4c3755-d6ec-4961-88cd-7a5ad46a3575 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:22.595006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b1a33a3f-e1e9-4c4f-a5bc-e20dec92050b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:22.626754 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b1a33a3f-e1e9-4c4f-a5bc-e20dec92050b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1371 microversion: 2.1 time: 0.657796 Aug 09 14:52:22.630804 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2141/4275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:21 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1371 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:22.770217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ff1aa99c-bf38-4877-ac70-a9b788820753 req-b0a11ec9-d529-408c-a78a-f4ececc16b03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053d7685-e09d-4d66-a6cc-2a61ddefcb23", "tag": "03d361a9-3309-4c45-b997-7791815137fa"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:22.794126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ff1aa99c-bf38-4877-ac70-a9b788820753 req-b0a11ec9-d529-408c-a78a-f4ececc16b03 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:22.794615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ff1aa99c-bf38-4877-ac70-a9b788820753 req-b0a11ec9-d529-408c-a78a-f4ececc16b03 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:22.795056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ff1aa99c-bf38-4877-ac70-a9b788820753 req-b0a11ec9-d529-408c-a78a-f4ececc16b03 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:22.825832 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ff1aa99c-bf38-4877-ac70-a9b788820753 req-b0a11ec9-d529-408c-a78a-f4ececc16b03 service nova] Creating event network-changed:03d361a9-3309-4c45-b997-7791815137fa for instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 on n-h1-844626-8 Aug 09 14:52:22.845324 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ff1aa99c-bf38-4877-ac70-a9b788820753 req-b0a11ec9-d529-408c-a78a-f4ececc16b03 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079520 Aug 09 14:52:22.845971 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2142/4276] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:52:22.958474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2e4c3755-d6ec-4961-88cd-7a5ad46a3575 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:22.978622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2e4c3755-d6ec-4961-88cd-7a5ad46a3575 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:22.980285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2e4c3755-d6ec-4961-88cd-7a5ad46a3575 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:22.981498 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e4c3755-d6ec-4961-88cd-7a5ad46a3575 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.634128 Aug 09 14:52:22.990698 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2135/4277] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:22 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:52:23.652507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ff86a5d-e66b-4cd7-bb09-12724bb26dac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:23.655243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ff86a5d-e66b-4cd7-bb09-12724bb26dac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:23.658397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:23.669073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ff86a5d-e66b-4cd7-bb09-12724bb26dac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:23.669859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ff86a5d-e66b-4cd7-bb09-12724bb26dac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:23.670463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ff86a5d-e66b-4cd7-bb09-12724bb26dac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:23.671461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ff86a5d-e66b-4cd7-bb09-12724bb26dac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:23.672080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ff86a5d-e66b-4cd7-bb09-12724bb26dac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:23.672702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ff86a5d-e66b-4cd7-bb09-12724bb26dac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:24.004999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ebdf4924-a402-4d5f-982e-3bc454f64bf8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:24.006177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ebdf4924-a402-4d5f-982e-3bc454f64bf8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:24.024519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebdf4924-a402-4d5f-982e-3bc454f64bf8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:24.025971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebdf4924-a402-4d5f-982e-3bc454f64bf8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:24.026587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebdf4924-a402-4d5f-982e-3bc454f64bf8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:24.030158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebdf4924-a402-4d5f-982e-3bc454f64bf8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:24.038797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebdf4924-a402-4d5f-982e-3bc454f64bf8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:24.039689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ebdf4924-a402-4d5f-982e-3bc454f64bf8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:25.203585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ff86a5d-e66b-4cd7-bb09-12724bb26dac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:25.229327 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ff86a5d-e66b-4cd7-bb09-12724bb26dac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1371 microversion: 2.1 time: 1.581033 Aug 09 14:52:25.240368 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2143/4278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:23 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1371 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:25.372065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ebdf4924-a402-4d5f-982e-3bc454f64bf8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:25.395826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ebdf4924-a402-4d5f-982e-3bc454f64bf8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:25.404376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ebdf4924-a402-4d5f-982e-3bc454f64bf8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:25.413456 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ebdf4924-a402-4d5f-982e-3bc454f64bf8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 1.412637 Aug 09 14:52:25.423674 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2136/4279] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:23 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:52:26.274783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5611a2bb-4da2-41d0-b386-ba8a30fdd5fc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:26.275751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5611a2bb-4da2-41d0-b386-ba8a30fdd5fc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:26.298000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5611a2bb-4da2-41d0-b386-ba8a30fdd5fc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:26.298401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5611a2bb-4da2-41d0-b386-ba8a30fdd5fc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:26.303276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5611a2bb-4da2-41d0-b386-ba8a30fdd5fc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:26.304164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5611a2bb-4da2-41d0-b386-ba8a30fdd5fc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:26.304659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5611a2bb-4da2-41d0-b386-ba8a30fdd5fc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:26.305099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5611a2bb-4da2-41d0-b386-ba8a30fdd5fc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:26.348252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d5b48ad1-ed36-4fa1-a024-55a4d73a4f4f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1344535379", "availability_zone": "foo_zone"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:26.353808 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:52:26.353808 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:52:26.355973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.aggregate [None req-d5b48ad1-ed36-4fa1-a024-55a4d73a4f4f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Generated uuid 9a976aa7-507d-44dc-9b90-2dffbdec2ac4 for aggregate {{(pid=119406) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 09 14:52:26.456100 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d5b48ad1-ed36-4fa1-a024-55a4d73a4f4f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.533570 Aug 09 14:52:26.460491 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2144/4280] 10.222.0.50 () {60 vars in 1164 bytes} [Tue Aug 9 14:52:25 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:26.477834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-163c243b-2a88-4181-905a-406e038b6cc8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:26.485015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-163c243b-2a88-4181-905a-406e038b6cc8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:26.505577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-163c243b-2a88-4181-905a-406e038b6cc8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:26.506564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-163c243b-2a88-4181-905a-406e038b6cc8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:26.507256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-163c243b-2a88-4181-905a-406e038b6cc8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:26.514338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-163c243b-2a88-4181-905a-406e038b6cc8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:26.515786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-163c243b-2a88-4181-905a-406e038b6cc8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:26.516488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-163c243b-2a88-4181-905a-406e038b6cc8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:26.901948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:27.643771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5611a2bb-4da2-41d0-b386-ba8a30fdd5fc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:27.674544 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5611a2bb-4da2-41d0-b386-ba8a30fdd5fc tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1371 microversion: 2.1 time: 1.411232 Aug 09 14:52:27.687121 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2137/4281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:26 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1371 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:27.700095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8778eb5-b0fc-478d-9d97-fe4db5bedd38 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:27.717065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-163c243b-2a88-4181-905a-406e038b6cc8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:27.726144 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:52:27.726144 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:52:27.751439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-163c243b-2a88-4181-905a-406e038b6cc8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:27.757382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-163c243b-2a88-4181-905a-406e038b6cc8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:27.765420 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-163c243b-2a88-4181-905a-406e038b6cc8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 1.299909 Aug 09 14:52:27.768978 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2145/4282] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:26 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:27.777424 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8778eb5-b0fc-478d-9d97-fe4db5bedd38 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.097848 Aug 09 14:52:27.779277 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2138/4283] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:52:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:27.791617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d567b62-680e-4659-a0d8-6e6f28d19a6f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:27.795197 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:52:27.795197 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:52:27.796849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d567b62-680e-4659-a0d8-6e6f28d19a6f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:27.797559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d567b62-680e-4659-a0d8-6e6f28d19a6f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:27.798204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d567b62-680e-4659-a0d8-6e6f28d19a6f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:27.799246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d567b62-680e-4659-a0d8-6e6f28d19a6f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:27.801066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d567b62-680e-4659-a0d8-6e6f28d19a6f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:27.801705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d567b62-680e-4659-a0d8-6e6f28d19a6f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:27.844641 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d567b62-680e-4659-a0d8-6e6f28d19a6f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] 10.222.0.50 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057320 Aug 09 14:52:27.846231 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2146/4284] 10.222.0.50 () {58 vars in 1176 bytes} [Tue Aug 9 14:52:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:52:27.858326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8487bbab-aa0f-44fe-aade-6217ae880957 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:27.859172 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:52:27.859172 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:52:27.885924 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8487bbab-aa0f-44fe-aade-6217ae880957 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.031496 Aug 09 14:52:27.888606 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2139/4285] 10.222.0.50 () {58 vars in 1143 bytes} [Tue Aug 9 14:52:27 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:27.900935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-68c923cc-960a-49ff-9032-d36ba123e152 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:27.906269 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:52:27.906269 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:52:27.920508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=12 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:27.950753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68c923cc-960a-49ff-9032-d36ba123e152 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:27.951396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68c923cc-960a-49ff-9032-d36ba123e152 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:27.952019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68c923cc-960a-49ff-9032-d36ba123e152 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:28.503562 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-68c923cc-960a-49ff-9032-d36ba123e152 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.607687 Aug 09 14:52:28.509285 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2147/4286] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:52:27 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:28.522134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5c181821-5448-477a-ac18-c1a04576267e tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:28.522927 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:52:28.522927 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:52:28.551472 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5c181821-5448-477a-ac18-c1a04576267e tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.024786 Aug 09 14:52:28.556002 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2140/4287] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:52:28 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:28.567844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3dd6dbf-c9a1-4224-adc3-157bf2627064 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1948250066", "availability_zone": "foo_zone"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:28.571351 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:52:28.571351 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:52:28.679021 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3dd6dbf-c9a1-4224-adc3-157bf2627064 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] 10.222.0.50 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.114950 Aug 09 14:52:28.680520 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2148/4288] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Aug 9 14:52:28 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:28.692698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4e9f37e-b8ea-4897-b440-f234638ffd89 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:28.695944 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:52:28.695944 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:52:28.706068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a775f03-6565-43dd-bda5-4b4727af0e69 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:28.709235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a775f03-6565-43dd-bda5-4b4727af0e69 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:28.722961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a775f03-6565-43dd-bda5-4b4727af0e69 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:28.725836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a775f03-6565-43dd-bda5-4b4727af0e69 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:28.726523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a775f03-6565-43dd-bda5-4b4727af0e69 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:28.727531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a775f03-6565-43dd-bda5-4b4727af0e69 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:28.728244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a775f03-6565-43dd-bda5-4b4727af0e69 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:28.729128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a775f03-6565-43dd-bda5-4b4727af0e69 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:28.792245 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4e9f37e-b8ea-4897-b440-f234638ffd89 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.103590 Aug 09 14:52:28.793568 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2141/4289] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:52:28 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:28.799167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c785c7c4-bbb8-4900-9b00-e0f622052265 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:28.799798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c785c7c4-bbb8-4900-9b00-e0f622052265 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:28.806814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c785c7c4-bbb8-4900-9b00-e0f622052265 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:28.807392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c785c7c4-bbb8-4900-9b00-e0f622052265 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:28.809256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c785c7c4-bbb8-4900-9b00-e0f622052265 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:28.810422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c785c7c4-bbb8-4900-9b00-e0f622052265 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:28.810891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c785c7c4-bbb8-4900-9b00-e0f622052265 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:28.826493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c785c7c4-bbb8-4900-9b00-e0f622052265 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:29.282183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a775f03-6565-43dd-bda5-4b4727af0e69 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:29.294409 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a775f03-6565-43dd-bda5-4b4727af0e69 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1375 microversion: 2.1 time: 0.596900 Aug 09 14:52:29.296041 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2149/4290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:28 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1375 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:29.305416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a705a0d9-db44-4146-8b60-3bd8f42ba499 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:29.306204 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:52:29.306204 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:52:29.336772 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a705a0d9-db44-4146-8b60-3bd8f42ba499 tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] 10.222.0.50 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.038744 Aug 09 14:52:29.340004 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2150/4291] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:52:29 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:29.376816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a440b43-3180-42fb-b500-54542eb5894f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-844626-8"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:29.404535 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:52:29.404535 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 14:52:29.414522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c785c7c4-bbb8-4900-9b00-e0f622052265 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:29.436967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c785c7c4-bbb8-4900-9b00-e0f622052265 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:29.438378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a440b43-3180-42fb-b500-54542eb5894f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:29.441368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a440b43-3180-42fb-b500-54542eb5894f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:29.442718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a440b43-3180-42fb-b500-54542eb5894f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:29.443805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c785c7c4-bbb8-4900-9b00-e0f622052265 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:29.445050 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c785c7c4-bbb8-4900-9b00-e0f622052265 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.650474 Aug 09 14:52:29.451945 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2142/4292] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:28 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:29.986523 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a440b43-3180-42fb-b500-54542eb5894f tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] 10.222.0.50 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.636275 Aug 09 14:52:29.988492 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2151/4293] 10.222.0.50 () {60 vars in 1194 bytes} [Tue Aug 9 14:52:29 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:29.999261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a433f26e-a403-4abe-b8ce-6167a5c59f4e tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:30.000029 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:52:30.000029 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:52:30.073870 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a433f26e-a403-4abe-b8ce-6167a5c59f4e tempest-TestAggregatesBasicOps-1779206943 tempest-TestAggregatesBasicOps-1779206943-project-admin] 10.222.0.50 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.078285 Aug 09 14:52:30.079797 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2143/4294] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 14:52:29 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 09 14:52:30.315244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-41263f78-2910-407a-9de6-2db65950a5ac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:30.316205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-41263f78-2910-407a-9de6-2db65950a5ac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:30.330950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41263f78-2910-407a-9de6-2db65950a5ac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:30.332196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41263f78-2910-407a-9de6-2db65950a5ac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:30.335690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41263f78-2910-407a-9de6-2db65950a5ac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:30.337390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41263f78-2910-407a-9de6-2db65950a5ac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:30.339678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41263f78-2910-407a-9de6-2db65950a5ac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:30.347882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41263f78-2910-407a-9de6-2db65950a5ac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:30.505765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ed783daf-cf6e-46f0-8a20-39089d3850d8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:30.506469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ed783daf-cf6e-46f0-8a20-39089d3850d8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:30.522652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed783daf-cf6e-46f0-8a20-39089d3850d8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:30.523675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed783daf-cf6e-46f0-8a20-39089d3850d8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:30.524827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed783daf-cf6e-46f0-8a20-39089d3850d8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:30.526352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed783daf-cf6e-46f0-8a20-39089d3850d8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:30.529258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed783daf-cf6e-46f0-8a20-39089d3850d8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:30.529959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ed783daf-cf6e-46f0-8a20-39089d3850d8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:30.589329 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ed783daf-cf6e-46f0-8a20-39089d3850d8 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/ips" status: 200 len: 152 microversion: 2.20 time: 0.498745 Aug 09 14:52:30.596025 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2152/4295] 10.222.0.50 () {60 vars in 1289 bytes} [Tue Aug 9 14:52:30 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/ips => generated 152 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:52:30.617073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1516e2f3-ed8c-428a-a272-7ff5c4ba2d0e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:30.623792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1516e2f3-ed8c-428a-a272-7ff5c4ba2d0e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:30.630872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1516e2f3-ed8c-428a-a272-7ff5c4ba2d0e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:30.631810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1516e2f3-ed8c-428a-a272-7ff5c4ba2d0e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:30.632402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1516e2f3-ed8c-428a-a272-7ff5c4ba2d0e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:30.633492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1516e2f3-ed8c-428a-a272-7ff5c4ba2d0e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:30.634101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1516e2f3-ed8c-428a-a272-7ff5c4ba2d0e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:30.634877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1516e2f3-ed8c-428a-a272-7ff5c4ba2d0e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:31.219029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1516e2f3-ed8c-428a-a272-7ff5c4ba2d0e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:31.230504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1516e2f3-ed8c-428a-a272-7ff5c4ba2d0e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:31.232339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1516e2f3-ed8c-428a-a272-7ff5c4ba2d0e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:31.234172 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1516e2f3-ed8c-428a-a272-7ff5c4ba2d0e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.636032 Aug 09 14:52:31.254021 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2153/4296] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:30 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:31.316277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-41263f78-2910-407a-9de6-2db65950a5ac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:31.334277 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-41263f78-2910-407a-9de6-2db65950a5ac tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1371 microversion: 2.1 time: 1.022951 Aug 09 14:52:31.337770 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2144/4297] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:30 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1371 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:52:32.261447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-601aa909-9761-4cee-9882-8967bbe79862 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:32.262695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-601aa909-9761-4cee-9882-8967bbe79862 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:32.276971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-601aa909-9761-4cee-9882-8967bbe79862 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:32.283915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-601aa909-9761-4cee-9882-8967bbe79862 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:32.284975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-601aa909-9761-4cee-9882-8967bbe79862 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:32.285910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-601aa909-9761-4cee-9882-8967bbe79862 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:32.288321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-601aa909-9761-4cee-9882-8967bbe79862 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:32.289003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-601aa909-9761-4cee-9882-8967bbe79862 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:32.357578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8fae8a75-d0e8-4422-856d-ce618b66211f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:32.358464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8fae8a75-d0e8-4422-856d-ce618b66211f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:32.373929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fae8a75-d0e8-4422-856d-ce618b66211f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:32.374425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fae8a75-d0e8-4422-856d-ce618b66211f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:32.374865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fae8a75-d0e8-4422-856d-ce618b66211f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:32.375598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fae8a75-d0e8-4422-856d-ce618b66211f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:32.376054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fae8a75-d0e8-4422-856d-ce618b66211f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:32.376481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fae8a75-d0e8-4422-856d-ce618b66211f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:32.379748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=75 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:32.988210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-601aa909-9761-4cee-9882-8967bbe79862 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:33.000671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-601aa909-9761-4cee-9882-8967bbe79862 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:33.009366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-601aa909-9761-4cee-9882-8967bbe79862 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:33.020965 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-601aa909-9761-4cee-9882-8967bbe79862 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.763575 Aug 09 14:52:33.022242 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2154/4298] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:32 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:33.054440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8fae8a75-d0e8-4422-856d-ce618b66211f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:33.062877 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8fae8a75-d0e8-4422-856d-ce618b66211f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1371 microversion: 2.1 time: 0.709673 Aug 09 14:52:33.085385 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2145/4299] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:32 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1371 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:52:33.953934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f3441a9f-a4a0-424a-8ead-96bdee3b614b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:33.954648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f3441a9f-a4a0-424a-8ead-96bdee3b614b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:33.961726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3441a9f-a4a0-424a-8ead-96bdee3b614b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:33.975900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3441a9f-a4a0-424a-8ead-96bdee3b614b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:33.976365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3441a9f-a4a0-424a-8ead-96bdee3b614b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:33.977157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3441a9f-a4a0-424a-8ead-96bdee3b614b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:33.977581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3441a9f-a4a0-424a-8ead-96bdee3b614b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:33.978080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3441a9f-a4a0-424a-8ead-96bdee3b614b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:34.038128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-f3441a9f-a4a0-424a-8ead-96bdee3b614b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lazy-loading 'flavor' on Instance uuid 9bcda666-d36a-488f-8fb0-fe12470ff45f {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:52:34.050503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-082c36f7-69b6-497d-920f-5ed9fa4bd892 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:34.051724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-082c36f7-69b6-497d-920f-5ed9fa4bd892 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:34.067673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-082c36f7-69b6-497d-920f-5ed9fa4bd892 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:34.072865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-082c36f7-69b6-497d-920f-5ed9fa4bd892 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:34.073510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-082c36f7-69b6-497d-920f-5ed9fa4bd892 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:34.074425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-082c36f7-69b6-497d-920f-5ed9fa4bd892 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:34.075182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-082c36f7-69b6-497d-920f-5ed9fa4bd892 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:34.075760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-082c36f7-69b6-497d-920f-5ed9fa4bd892 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:34.341376 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f3441a9f-a4a0-424a-8ead-96bdee3b614b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "POST /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/action" status: 202 len: 0 microversion: 2.20 time: 0.391037 Aug 09 14:52:34.342021 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2155/4300] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:52:33 2022] POST /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:52:34.355873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5cef405a-1071-49a9-b316-d55c6488ef9e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:34.356834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5cef405a-1071-49a9-b316-d55c6488ef9e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:34.364114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cef405a-1071-49a9-b316-d55c6488ef9e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:34.365062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cef405a-1071-49a9-b316-d55c6488ef9e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:34.365715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cef405a-1071-49a9-b316-d55c6488ef9e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:34.366647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cef405a-1071-49a9-b316-d55c6488ef9e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:34.367282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cef405a-1071-49a9-b316-d55c6488ef9e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:34.367868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cef405a-1071-49a9-b316-d55c6488ef9e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:35.476370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-082c36f7-69b6-497d-920f-5ed9fa4bd892 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:35.496077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-082c36f7-69b6-497d-920f-5ed9fa4bd892 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:35.497858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-082c36f7-69b6-497d-920f-5ed9fa4bd892 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:35.501664 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-082c36f7-69b6-497d-920f-5ed9fa4bd892 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 1.456899 Aug 09 14:52:35.530975 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2146/4301] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:34 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:35.540454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7566c6d-435c-4d2f-93c2-b4ae96a0e213 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:35.550228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e7566c6d-435c-4d2f-93c2-b4ae96a0e213 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:35.576935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7566c6d-435c-4d2f-93c2-b4ae96a0e213 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:35.577930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7566c6d-435c-4d2f-93c2-b4ae96a0e213 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:35.578730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7566c6d-435c-4d2f-93c2-b4ae96a0e213 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:35.579864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7566c6d-435c-4d2f-93c2-b4ae96a0e213 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:35.580569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7566c6d-435c-4d2f-93c2-b4ae96a0e213 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:35.581209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7566c6d-435c-4d2f-93c2-b4ae96a0e213 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:35.943113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cef405a-1071-49a9-b316-d55c6488ef9e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:35.952524 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5cef405a-1071-49a9-b316-d55c6488ef9e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1371 microversion: 2.1 time: 1.609175 Aug 09 14:52:35.953353 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2156/4302] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:34 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1371 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:36.120454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-bf407560-92c8-4c3d-837d-aabb944fae47 req-07a12b83-93a4-4da2-b837-2bf8d96fba4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053d7685-e09d-4d66-a6cc-2a61ddefcb23", "name": "network-vif-plugged", "status": "completed", "tag": "03d361a9-3309-4c45-b997-7791815137fa"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:36.153668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bf407560-92c8-4c3d-837d-aabb944fae47 req-07a12b83-93a4-4da2-b837-2bf8d96fba4c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:36.153668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bf407560-92c8-4c3d-837d-aabb944fae47 req-07a12b83-93a4-4da2-b837-2bf8d96fba4c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:36.153668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bf407560-92c8-4c3d-837d-aabb944fae47 req-07a12b83-93a4-4da2-b837-2bf8d96fba4c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:36.167757 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-bf407560-92c8-4c3d-837d-aabb944fae47 req-07a12b83-93a4-4da2-b837-2bf8d96fba4c service nova] Creating event network-vif-plugged:03d361a9-3309-4c45-b997-7791815137fa for instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 on n-h1-844626-8 Aug 09 14:52:36.195414 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-bf407560-92c8-4c3d-837d-aabb944fae47 req-07a12b83-93a4-4da2-b837-2bf8d96fba4c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213319 Aug 09 14:52:36.197103 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2157/4303] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:36.424600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e7566c6d-435c-4d2f-93c2-b4ae96a0e213 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:36.443369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e7566c6d-435c-4d2f-93c2-b4ae96a0e213 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:36.448031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e7566c6d-435c-4d2f-93c2-b4ae96a0e213 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:36.451528 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e7566c6d-435c-4d2f-93c2-b4ae96a0e213 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1722 microversion: 2.20 time: 0.919115 Aug 09 14:52:36.476987 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2147/4304] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:35 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1722 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:36.543480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fd37b4b-b413-4cdb-9313-a446d7b81762 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:36.544384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3fd37b4b-b413-4cdb-9313-a446d7b81762 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:36.562806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fd37b4b-b413-4cdb-9313-a446d7b81762 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:36.566408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fd37b4b-b413-4cdb-9313-a446d7b81762 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:36.567377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fd37b4b-b413-4cdb-9313-a446d7b81762 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:36.569616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fd37b4b-b413-4cdb-9313-a446d7b81762 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:36.570442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fd37b4b-b413-4cdb-9313-a446d7b81762 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:36.572593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fd37b4b-b413-4cdb-9313-a446d7b81762 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:36.926464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3fd37b4b-b413-4cdb-9313-a446d7b81762 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:36.945322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3fd37b4b-b413-4cdb-9313-a446d7b81762 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:36.951455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3fd37b4b-b413-4cdb-9313-a446d7b81762 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:36.959731 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fd37b4b-b413-4cdb-9313-a446d7b81762 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.417907 Aug 09 14:52:36.960583 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2158/4305] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:36 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:36.980717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e757ac17-10bb-44d5-bab3-9bf1685a9108 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:36.981327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e757ac17-10bb-44d5-bab3-9bf1685a9108 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:36.989755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e757ac17-10bb-44d5-bab3-9bf1685a9108 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:36.995825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e757ac17-10bb-44d5-bab3-9bf1685a9108 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:37.000980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e757ac17-10bb-44d5-bab3-9bf1685a9108 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:37.001743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e757ac17-10bb-44d5-bab3-9bf1685a9108 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:37.002854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e757ac17-10bb-44d5-bab3-9bf1685a9108 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:37.004836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e757ac17-10bb-44d5-bab3-9bf1685a9108 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:37.410763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e757ac17-10bb-44d5-bab3-9bf1685a9108 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:37.423814 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e757ac17-10bb-44d5-bab3-9bf1685a9108 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1371 microversion: 2.1 time: 0.448755 Aug 09 14:52:37.431532 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2148/4306] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:36 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1371 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:37.484505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-027d0399-6b01-48e4-8c9d-08e46199fc7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:37.485491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-027d0399-6b01-48e4-8c9d-08e46199fc7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:37.510069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-027d0399-6b01-48e4-8c9d-08e46199fc7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:37.510685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-027d0399-6b01-48e4-8c9d-08e46199fc7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:37.511967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-027d0399-6b01-48e4-8c9d-08e46199fc7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:37.513158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-027d0399-6b01-48e4-8c9d-08e46199fc7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:37.513884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-027d0399-6b01-48e4-8c9d-08e46199fc7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:37.514922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-027d0399-6b01-48e4-8c9d-08e46199fc7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:37.819553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:37.985549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-588c8c93-e320-4022-b93f-2233273f8837 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:37.987863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-588c8c93-e320-4022-b93f-2233273f8837 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:38.001600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-588c8c93-e320-4022-b93f-2233273f8837 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:38.002901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-588c8c93-e320-4022-b93f-2233273f8837 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:38.004269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-588c8c93-e320-4022-b93f-2233273f8837 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:38.008428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-588c8c93-e320-4022-b93f-2233273f8837 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:38.009752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-588c8c93-e320-4022-b93f-2233273f8837 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:38.011995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-588c8c93-e320-4022-b93f-2233273f8837 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:38.518048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-027d0399-6b01-48e4-8c9d-08e46199fc7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:38.538097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-027d0399-6b01-48e4-8c9d-08e46199fc7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:38.538097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-027d0399-6b01-48e4-8c9d-08e46199fc7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:38.541887 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-027d0399-6b01-48e4-8c9d-08e46199fc7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1722 microversion: 2.20 time: 1.061886 Aug 09 14:52:38.555834 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2159/4307] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:37 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1722 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:52:38.563729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7122efb2-8ecb-4862-8980-4189cb8c445f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:38.564665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7122efb2-8ecb-4862-8980-4189cb8c445f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:38.571560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7122efb2-8ecb-4862-8980-4189cb8c445f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:38.572329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7122efb2-8ecb-4862-8980-4189cb8c445f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:38.572984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7122efb2-8ecb-4862-8980-4189cb8c445f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:38.573874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7122efb2-8ecb-4862-8980-4189cb8c445f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:38.574525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7122efb2-8ecb-4862-8980-4189cb8c445f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:38.575171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7122efb2-8ecb-4862-8980-4189cb8c445f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:38.601172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:38.604506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-588c8c93-e320-4022-b93f-2233273f8837 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:38.616990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-588c8c93-e320-4022-b93f-2233273f8837 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:38.622087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-588c8c93-e320-4022-b93f-2233273f8837 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:38.624168 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-588c8c93-e320-4022-b93f-2233273f8837 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.643264 Aug 09 14:52:38.625338 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2149/4308] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:37 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:52:39.554248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7122efb2-8ecb-4862-8980-4189cb8c445f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:39.567485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23d757b1-0df3-4176-9fcb-b5448f726e3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:39.568918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-23d757b1-0df3-4176-9fcb-b5448f726e3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:39.573831 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7122efb2-8ecb-4862-8980-4189cb8c445f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1565 microversion: 2.1 time: 1.016464 Aug 09 14:52:39.574485 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2160/4309] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:38 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1565 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:39.578524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23d757b1-0df3-4176-9fcb-b5448f726e3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:39.591811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23d757b1-0df3-4176-9fcb-b5448f726e3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:39.592592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23d757b1-0df3-4176-9fcb-b5448f726e3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:39.593540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23d757b1-0df3-4176-9fcb-b5448f726e3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:39.594189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23d757b1-0df3-4176-9fcb-b5448f726e3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:39.594627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-28dd4458-00de-43ef-a51d-ca4ae9d6c5e0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:39.595077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23d757b1-0df3-4176-9fcb-b5448f726e3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:39.595207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-28dd4458-00de-43ef-a51d-ca4ae9d6c5e0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:39.604803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28dd4458-00de-43ef-a51d-ca4ae9d6c5e0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:39.605305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28dd4458-00de-43ef-a51d-ca4ae9d6c5e0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:39.605746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28dd4458-00de-43ef-a51d-ca4ae9d6c5e0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:39.606465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28dd4458-00de-43ef-a51d-ca4ae9d6c5e0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:39.606923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28dd4458-00de-43ef-a51d-ca4ae9d6c5e0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:39.607379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28dd4458-00de-43ef-a51d-ca4ae9d6c5e0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:39.960814 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-28dd4458-00de-43ef-a51d-ca4ae9d6c5e0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.370585 Aug 09 14:52:39.961816 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2161/4310] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:52:39 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-interface => generated 284 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:39.967009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-987de01e-2cdc-42d5-9a02-53d135b0ed87 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:39.967666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-987de01e-2cdc-42d5-9a02-53d135b0ed87 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:39.980083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-987de01e-2cdc-42d5-9a02-53d135b0ed87 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:39.983065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-987de01e-2cdc-42d5-9a02-53d135b0ed87 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:39.983726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-987de01e-2cdc-42d5-9a02-53d135b0ed87 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:39.984666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-987de01e-2cdc-42d5-9a02-53d135b0ed87 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:39.988042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-987de01e-2cdc-42d5-9a02-53d135b0ed87 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:39.988728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-987de01e-2cdc-42d5-9a02-53d135b0ed87 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:40.426283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-23d757b1-0df3-4176-9fcb-b5448f726e3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:40.446046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-23d757b1-0df3-4176-9fcb-b5448f726e3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:40.447596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-23d757b1-0df3-4176-9fcb-b5448f726e3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:40.448793 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23d757b1-0df3-4176-9fcb-b5448f726e3f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1722 microversion: 2.20 time: 0.885148 Aug 09 14:52:40.449376 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2150/4311] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:39 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1722 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:52:40.666656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-987de01e-2cdc-42d5-9a02-53d135b0ed87 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:40.686489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-987de01e-2cdc-42d5-9a02-53d135b0ed87 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:40.688210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-987de01e-2cdc-42d5-9a02-53d135b0ed87 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:40.694468 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-987de01e-2cdc-42d5-9a02-53d135b0ed87 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.731441 Aug 09 14:52:40.719271 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2162/4312] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:39 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:40.960335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2d122be2-c928-4681-9123-52d02ed2ff82 req-1cf1572d-da19-4caa-b622-d45099db74b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-plugged", "status": "completed", "tag": "7256ee05-5624-4366-8ab1-5a16dfac3445"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:40.988928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2d122be2-c928-4681-9123-52d02ed2ff82 req-1cf1572d-da19-4caa-b622-d45099db74b8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:40.992152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2d122be2-c928-4681-9123-52d02ed2ff82 req-1cf1572d-da19-4caa-b622-d45099db74b8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:40.993278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2d122be2-c928-4681-9123-52d02ed2ff82 req-1cf1572d-da19-4caa-b622-d45099db74b8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:41.010467 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2d122be2-c928-4681-9123-52d02ed2ff82 req-1cf1572d-da19-4caa-b622-d45099db74b8 service nova] Creating event network-vif-plugged:7256ee05-5624-4366-8ab1-5a16dfac3445 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:52:41.034751 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2d122be2-c928-4681-9123-52d02ed2ff82 req-1cf1572d-da19-4caa-b622-d45099db74b8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078408 Aug 09 14:52:41.035609 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2151/4313] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:52:41.477236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8fe4eda4-584d-4cdf-af3d-db6d32340900 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:41.478267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8fe4eda4-584d-4cdf-af3d-db6d32340900 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:41.491609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8fe4eda4-584d-4cdf-af3d-db6d32340900 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:41.492534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8fe4eda4-584d-4cdf-af3d-db6d32340900 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:41.493801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8fe4eda4-584d-4cdf-af3d-db6d32340900 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:41.499390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8fe4eda4-584d-4cdf-af3d-db6d32340900 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:41.500563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8fe4eda4-584d-4cdf-af3d-db6d32340900 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:41.501592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8fe4eda4-584d-4cdf-af3d-db6d32340900 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:41.727984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ad522d18-199b-4ca5-9064-e66afc73b139 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:41.731546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ad522d18-199b-4ca5-9064-e66afc73b139 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:41.741116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad522d18-199b-4ca5-9064-e66afc73b139 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:41.741887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad522d18-199b-4ca5-9064-e66afc73b139 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:41.742625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad522d18-199b-4ca5-9064-e66afc73b139 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:41.744381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad522d18-199b-4ca5-9064-e66afc73b139 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:41.748159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad522d18-199b-4ca5-9064-e66afc73b139 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:41.749197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad522d18-199b-4ca5-9064-e66afc73b139 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:42.294104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8fe4eda4-584d-4cdf-af3d-db6d32340900 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:42.309377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8fe4eda4-584d-4cdf-af3d-db6d32340900 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:42.314282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8fe4eda4-584d-4cdf-af3d-db6d32340900 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:42.315644 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8fe4eda4-584d-4cdf-af3d-db6d32340900 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1722 microversion: 2.20 time: 0.842716 Aug 09 14:52:42.321346 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2163/4314] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:41 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1722 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:42.759113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ad522d18-199b-4ca5-9064-e66afc73b139 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:42.775929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ad522d18-199b-4ca5-9064-e66afc73b139 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:42.783579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ad522d18-199b-4ca5-9064-e66afc73b139 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:42.792234 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ad522d18-199b-4ca5-9064-e66afc73b139 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 1.074476 Aug 09 14:52:42.795305 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2152/4315] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:41 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:43.346101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4886116-9aec-4e46-809e-a5fc8d58a09f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:43.346720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b4886116-9aec-4e46-809e-a5fc8d58a09f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:43.366489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4886116-9aec-4e46-809e-a5fc8d58a09f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:43.366984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4886116-9aec-4e46-809e-a5fc8d58a09f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:43.367646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4886116-9aec-4e46-809e-a5fc8d58a09f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:43.368694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4886116-9aec-4e46-809e-a5fc8d58a09f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:43.369362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4886116-9aec-4e46-809e-a5fc8d58a09f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:43.369946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4886116-9aec-4e46-809e-a5fc8d58a09f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:43.821874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d3161e36-4373-421a-b389-9398289aed60 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:43.823736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d3161e36-4373-421a-b389-9398289aed60 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:43.838920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3161e36-4373-421a-b389-9398289aed60 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:43.839585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3161e36-4373-421a-b389-9398289aed60 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:43.840413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3161e36-4373-421a-b389-9398289aed60 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:43.843449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3161e36-4373-421a-b389-9398289aed60 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:43.844146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3161e36-4373-421a-b389-9398289aed60 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:43.844775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3161e36-4373-421a-b389-9398289aed60 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:44.305758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b4886116-9aec-4e46-809e-a5fc8d58a09f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:44.315014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b4886116-9aec-4e46-809e-a5fc8d58a09f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:44.329892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b4886116-9aec-4e46-809e-a5fc8d58a09f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:44.334698 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b4886116-9aec-4e46-809e-a5fc8d58a09f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1722 microversion: 2.20 time: 0.992427 Aug 09 14:52:44.337343 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2164/4316] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:43 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1722 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:44.360369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d9674795-e66c-4b5e-bc6b-d288d3000b78 req-6783c190-aac3-4d67-96b0-c6b5509c6296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053d7685-e09d-4d66-a6cc-2a61ddefcb23", "tag": "03d361a9-3309-4c45-b997-7791815137fa"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:44.396720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d9674795-e66c-4b5e-bc6b-d288d3000b78 req-6783c190-aac3-4d67-96b0-c6b5509c6296 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:44.398868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d9674795-e66c-4b5e-bc6b-d288d3000b78 req-6783c190-aac3-4d67-96b0-c6b5509c6296 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:44.399497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d9674795-e66c-4b5e-bc6b-d288d3000b78 req-6783c190-aac3-4d67-96b0-c6b5509c6296 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:44.437043 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d9674795-e66c-4b5e-bc6b-d288d3000b78 req-6783c190-aac3-4d67-96b0-c6b5509c6296 service nova] Creating event network-changed:03d361a9-3309-4c45-b997-7791815137fa for instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 on n-h1-844626-8 Aug 09 14:52:44.456285 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d9674795-e66c-4b5e-bc6b-d288d3000b78 req-6783c190-aac3-4d67-96b0-c6b5509c6296 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114230 Aug 09 14:52:44.463056 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2165/4317] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:44.476782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f0cffa94-c3fb-4488-8a35-d720807174f8 req-5abb963b-b921-49a8-a28c-24c0b043132a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-plugged", "status": "completed", "tag": "1bbb6bc7-df59-43ad-bd7e-3c6cac208995"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:44.517103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f0cffa94-c3fb-4488-8a35-d720807174f8 req-5abb963b-b921-49a8-a28c-24c0b043132a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:44.517914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f0cffa94-c3fb-4488-8a35-d720807174f8 req-5abb963b-b921-49a8-a28c-24c0b043132a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:44.518792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f0cffa94-c3fb-4488-8a35-d720807174f8 req-5abb963b-b921-49a8-a28c-24c0b043132a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:44.534775 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f0cffa94-c3fb-4488-8a35-d720807174f8 req-5abb963b-b921-49a8-a28c-24c0b043132a service nova] Creating event network-vif-plugged:1bbb6bc7-df59-43ad-bd7e-3c6cac208995 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:52:44.542170 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f0cffa94-c3fb-4488-8a35-d720807174f8 req-5abb963b-b921-49a8-a28c-24c0b043132a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076646 Aug 09 14:52:44.543046 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2166/4318] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:45.175294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3161e36-4373-421a-b389-9398289aed60 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:45.189994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3161e36-4373-421a-b389-9398289aed60 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:45.191683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3161e36-4373-421a-b389-9398289aed60 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:45.192893 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d3161e36-4373-421a-b389-9398289aed60 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 1.376342 Aug 09 14:52:45.193508 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2153/4319] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:43 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:52:45.368992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bd2804b-9a81-47d9-aa81-b33b8a4b84cb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:45.376380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8bd2804b-9a81-47d9-aa81-b33b8a4b84cb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:45.400406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bd2804b-9a81-47d9-aa81-b33b8a4b84cb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:45.401147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bd2804b-9a81-47d9-aa81-b33b8a4b84cb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:45.404772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bd2804b-9a81-47d9-aa81-b33b8a4b84cb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:45.405539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bd2804b-9a81-47d9-aa81-b33b8a4b84cb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:45.406013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bd2804b-9a81-47d9-aa81-b33b8a4b84cb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:45.406437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bd2804b-9a81-47d9-aa81-b33b8a4b84cb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:46.219963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d0356a1-abaa-4d46-bcc5-5880e32ead9f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:46.220688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d0356a1-abaa-4d46-bcc5-5880e32ead9f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:46.241181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d0356a1-abaa-4d46-bcc5-5880e32ead9f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:46.241670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d0356a1-abaa-4d46-bcc5-5880e32ead9f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:46.242104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d0356a1-abaa-4d46-bcc5-5880e32ead9f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:46.242939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d0356a1-abaa-4d46-bcc5-5880e32ead9f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:46.243275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d0356a1-abaa-4d46-bcc5-5880e32ead9f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:46.243696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d0356a1-abaa-4d46-bcc5-5880e32ead9f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:46.307598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8bd2804b-9a81-47d9-aa81-b33b8a4b84cb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:46.318210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8bd2804b-9a81-47d9-aa81-b33b8a4b84cb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:46.319769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8bd2804b-9a81-47d9-aa81-b33b8a4b84cb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:46.330101 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8bd2804b-9a81-47d9-aa81-b33b8a4b84cb tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1722 microversion: 2.20 time: 0.965579 Aug 09 14:52:46.331569 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2167/4320] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:45 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1722 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:46.602613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-058652e5-f9aa-48c1-b039-b1f3f4ccf695 req-8672b36e-43d9-416b-8591-f7b4f42e8da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-plugged", "status": "completed", "tag": "c7d99063-f45e-4b7c-95c6-5303b2e5a553"}, {"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-plugged", "status": "completed", "tag": "2c866803-396b-4bd4-8699-4d2560fd9afb"}, {"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-plugged", "status": "completed", "tag": "d4803c25-91b8-4eb4-aea2-bdacca010751"}, {"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-plugged", "status": "completed", "tag": "22a7aaf5-6350-415b-823f-52781cbb73ee"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:46.635658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-058652e5-f9aa-48c1-b039-b1f3f4ccf695 req-8672b36e-43d9-416b-8591-f7b4f42e8da2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:46.636478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-058652e5-f9aa-48c1-b039-b1f3f4ccf695 req-8672b36e-43d9-416b-8591-f7b4f42e8da2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:46.637086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-058652e5-f9aa-48c1-b039-b1f3f4ccf695 req-8672b36e-43d9-416b-8591-f7b4f42e8da2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:46.664019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d0356a1-abaa-4d46-bcc5-5880e32ead9f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:46.683023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d0356a1-abaa-4d46-bcc5-5880e32ead9f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:46.685670 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-058652e5-f9aa-48c1-b039-b1f3f4ccf695 req-8672b36e-43d9-416b-8591-f7b4f42e8da2 service nova] Creating event network-vif-plugged:c7d99063-f45e-4b7c-95c6-5303b2e5a553 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:52:46.686194 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-058652e5-f9aa-48c1-b039-b1f3f4ccf695 req-8672b36e-43d9-416b-8591-f7b4f42e8da2 service nova] Creating event network-vif-plugged:2c866803-396b-4bd4-8699-4d2560fd9afb for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:52:46.687869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d0356a1-abaa-4d46-bcc5-5880e32ead9f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:46.689143 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d0356a1-abaa-4d46-bcc5-5880e32ead9f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.474408 Aug 09 14:52:46.689839 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-058652e5-f9aa-48c1-b039-b1f3f4ccf695 req-8672b36e-43d9-416b-8591-f7b4f42e8da2 service nova] Creating event network-vif-plugged:d4803c25-91b8-4eb4-aea2-bdacca010751 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:52:46.690658 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-058652e5-f9aa-48c1-b039-b1f3f4ccf695 req-8672b36e-43d9-416b-8591-f7b4f42e8da2 service nova] Creating event network-vif-plugged:22a7aaf5-6350-415b-823f-52781cbb73ee for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:52:46.711350 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2154/4321] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:46 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:46.718458 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-058652e5-f9aa-48c1-b039-b1f3f4ccf695 req-8672b36e-43d9-416b-8591-f7b4f42e8da2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.120401 Aug 09 14:52:46.719584 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2168/4322] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:52:47.093204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4470130-8d5c-435e-b6c4-178ab9885ee9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Action: 'create', calling method: .version_select at 0x7f41e7508700>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-2029153288", "policies": ["affinity"]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:47.147805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b4470130-8d5c-435e-b6c4-178ab9885ee9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:47.168194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b4470130-8d5c-435e-b6c4-178ab9885ee9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:47.252775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b4470130-8d5c-435e-b6c4-178ab9885ee9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:47.281984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b4470130-8d5c-435e-b6c4-178ab9885ee9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:47.312834 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4470130-8d5c-435e-b6c4-178ab9885ee9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.332841 Aug 09 14:52:47.332417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b5f8e8d-f823-4d82-b853-252f485777db tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Action: 'create', calling method: .version_select at 0x7f41dda5cca0>, body: {"server_group": {"name": "tempest-server-group-986603120", "policies": ["affinity"]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:47.335848 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2155/4323] 10.222.0.50 () {60 vars in 1174 bytes} [Tue Aug 9 14:52:46 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:47.358443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c46efc98-8268-47c5-9e8c-1bb47a66898e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:47.359458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c46efc98-8268-47c5-9e8c-1bb47a66898e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:47.372012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c46efc98-8268-47c5-9e8c-1bb47a66898e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:47.374079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c46efc98-8268-47c5-9e8c-1bb47a66898e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:47.376127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c46efc98-8268-47c5-9e8c-1bb47a66898e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:47.377666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c46efc98-8268-47c5-9e8c-1bb47a66898e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:47.379561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c46efc98-8268-47c5-9e8c-1bb47a66898e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:47.381496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c46efc98-8268-47c5-9e8c-1bb47a66898e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:47.409748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9b5f8e8d-f823-4d82-b853-252f485777db tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:47.426846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9b5f8e8d-f823-4d82-b853-252f485777db tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:47.477340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:47.510464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9b5f8e8d-f823-4d82-b853-252f485777db tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:47.516111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9b5f8e8d-f823-4d82-b853-252f485777db tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:47.531706 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b5f8e8d-f823-4d82-b853-252f485777db tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.210936 Aug 09 14:52:47.538060 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2169/4324] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Aug 9 14:52:47 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:52:47.543448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-00626a31-2d98-4165-b8aa-b9249315da87 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Action: 'create', calling method: .version_select at 0x7f41de113820>, body: {"server_group": {"name": "tempest-server-group-986603120", "policies": ["affinity"]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:47.590680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-00626a31-2d98-4165-b8aa-b9249315da87 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:47.602484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-00626a31-2d98-4165-b8aa-b9249315da87 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:47.661571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-00626a31-2d98-4165-b8aa-b9249315da87 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:47.668293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-00626a31-2d98-4165-b8aa-b9249315da87 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:47.699594 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-00626a31-2d98-4165-b8aa-b9249315da87 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.160031 Aug 09 14:52:47.707800 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2170/4325] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Aug 9 14:52:47 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:47.715742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe8a1539-4ce0-45a9-aa45-29776a5aee76 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:47.762154 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fe8a1539-4ce0-45a9-aa45-29776a5aee76 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/69ed739a-e1af-4cd1-811a-5cb10c1f4eb7" status: 204 len: 0 microversion: 2.1 time: 0.051509 Aug 09 14:52:47.767508 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2171/4326] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 14:52:47 2022] DELETE /compute/v2.1/os-server-groups/69ed739a-e1af-4cd1-811a-5cb10c1f4eb7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:52:47.777028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7d523fb-304d-4b94-8dbb-ea598414201f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:47.778113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7d523fb-304d-4b94-8dbb-ea598414201f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:47.790456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7d523fb-304d-4b94-8dbb-ea598414201f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:47.791118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7d523fb-304d-4b94-8dbb-ea598414201f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:47.791797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7d523fb-304d-4b94-8dbb-ea598414201f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:47.793178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7d523fb-304d-4b94-8dbb-ea598414201f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:47.794338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7d523fb-304d-4b94-8dbb-ea598414201f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:47.795622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7d523fb-304d-4b94-8dbb-ea598414201f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:47.848805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c46efc98-8268-47c5-9e8c-1bb47a66898e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:47.860172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c46efc98-8268-47c5-9e8c-1bb47a66898e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:47.864265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c46efc98-8268-47c5-9e8c-1bb47a66898e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:47.870414 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c46efc98-8268-47c5-9e8c-1bb47a66898e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1722 microversion: 2.20 time: 0.516968 Aug 09 14:52:47.872475 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2156/4327] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:47 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1722 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:52:47.880059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7cb6cca4-3d54-420e-afc0-38022d73a955 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:47.900575 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7cb6cca4-3d54-420e-afc0-38022d73a955 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.026135 Aug 09 14:52:47.909132 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2157/4328] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:52:47 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:47.915249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-029438ef-db42-47f8-b346-b4c0e7e6dec8 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:47.947639 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-029438ef-db42-47f8-b346-b4c0e7e6dec8 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/a0322fb4-4025-4e61-b2ea-0808f20ac671" status: 204 len: 0 microversion: 2.1 time: 0.037077 Aug 09 14:52:47.953227 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2158/4329] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 14:52:47 2022] DELETE /compute/v2.1/os-server-groups/a0322fb4-4025-4e61-b2ea-0808f20ac671 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:52:47.961479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0c1c6f0-e58e-4699-9e29-37d49820dfa5 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:48.000769 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0c1c6f0-e58e-4699-9e29-37d49820dfa5 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.041795 Aug 09 14:52:48.002042 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2159/4330] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:52:47 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:48.016751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0417d569-85f2-4c9b-b463-7584317565bc tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Action: 'create', calling method: .version_select at 0x7f41dd7ba5e0>, body: {"server_group": {"name": "tempest-server-group-1695831250", "policies": ["affinity"]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:48.064648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0417d569-85f2-4c9b-b463-7584317565bc tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:48.073400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0417d569-85f2-4c9b-b463-7584317565bc tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:48.091674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:48.148351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0417d569-85f2-4c9b-b463-7584317565bc tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:48.155711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0417d569-85f2-4c9b-b463-7584317565bc tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:48.175314 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0417d569-85f2-4c9b-b463-7584317565bc tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.165003 Aug 09 14:52:48.182466 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2160/4331] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Aug 9 14:52:48 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:52:48.188348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ccc1aa8-4f0e-4a05-b408-e66f72df63b3 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:48.235436 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ccc1aa8-4f0e-4a05-b408-e66f72df63b3 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/a98b86e2-9054-4ed6-ae08-ebb044c1cf7a" status: 204 len: 0 microversion: 2.1 time: 0.050416 Aug 09 14:52:48.236082 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2161/4332] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 14:52:48 2022] DELETE /compute/v2.1/os-server-groups/a98b86e2-9054-4ed6-ae08-ebb044c1cf7a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:52:48.246456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-431f8d54-c674-43e2-83f3-e6cc5bf0fe0a tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:48.290822 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-431f8d54-c674-43e2-83f3-e6cc5bf0fe0a tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.049677 Aug 09 14:52:48.298179 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2162/4333] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:52:48 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:48.314644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e846c51b-9ac2-4378-89aa-d5580b02a9da tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Action: 'create', calling method: .version_select at 0x7f41e7510430>, body: {"server_group": {"name": "tempest-server-group-759183785", "policies": ["anti-affinity"]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:48.352517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e846c51b-9ac2-4378-89aa-d5580b02a9da tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:48.366193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e846c51b-9ac2-4378-89aa-d5580b02a9da tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:48.383319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7d523fb-304d-4b94-8dbb-ea598414201f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:48.401591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7d523fb-304d-4b94-8dbb-ea598414201f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:48.405320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7d523fb-304d-4b94-8dbb-ea598414201f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:48.411911 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7d523fb-304d-4b94-8dbb-ea598414201f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 0.641394 Aug 09 14:52:48.412757 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2172/4334] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:47 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:48.447426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e846c51b-9ac2-4378-89aa-d5580b02a9da tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:48.454279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e846c51b-9ac2-4378-89aa-d5580b02a9da tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_groups'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:48.471436 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e846c51b-9ac2-4378-89aa-d5580b02a9da tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.168257 Aug 09 14:52:48.480468 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2163/4335] 10.222.0.50 () {60 vars in 1173 bytes} [Tue Aug 9 14:52:48 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:48.487544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be4a8057-bdb5-4e1d-bf2e-caf84c4cd500 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:48.524209 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be4a8057-bdb5-4e1d-bf2e-caf84c4cd500 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/3fa8d648-ba99-4c44-a5b1-2c773fc6ccb8" status: 204 len: 0 microversion: 2.1 time: 0.043640 Aug 09 14:52:48.525566 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2173/4336] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 14:52:48 2022] DELETE /compute/v2.1/os-server-groups/3fa8d648-ba99-4c44-a5b1-2c773fc6ccb8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:52:48.541586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c16fdc51-7839-4568-a13d-36eb073136c9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:48.559172 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c16fdc51-7839-4568-a13d-36eb073136c9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.027244 Aug 09 14:52:48.560492 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2164/4337] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:52:48 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:52:48.645433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-337301512", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "0e1ad8e3-7958-4ce8-a977-61741d9c9b1f"}]}, "os:scheduler_hints": {"group": "95056e80-e8ca-4aec-adf3-ccb879f262ef"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:48.761560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] validate_networks() for [('0e1ad8e3-7958-4ce8-a977-61741d9c9b1f', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:52:48.763880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-6e0dcc94-490a-4f10-827a-f931f8b01e15 req-f7fd0ae9-fe37-4b22-a5bc-6cb2ddbda442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-plugged", "status": "completed", "tag": "c0390f76-5b64-465b-ab1b-c3d6e4b5c819"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:48.782662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6e0dcc94-490a-4f10-827a-f931f8b01e15 req-f7fd0ae9-fe37-4b22-a5bc-6cb2ddbda442 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:48.783783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6e0dcc94-490a-4f10-827a-f931f8b01e15 req-f7fd0ae9-fe37-4b22-a5bc-6cb2ddbda442 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:48.784759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6e0dcc94-490a-4f10-827a-f931f8b01e15 req-f7fd0ae9-fe37-4b22-a5bc-6cb2ddbda442 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:48.801971 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-6e0dcc94-490a-4f10-827a-f931f8b01e15 req-f7fd0ae9-fe37-4b22-a5bc-6cb2ddbda442 service nova] Creating event network-vif-plugged:c0390f76-5b64-465b-ab1b-c3d6e4b5c819 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:52:48.808982 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-6e0dcc94-490a-4f10-827a-f931f8b01e15 req-f7fd0ae9-fe37-4b22-a5bc-6cb2ddbda442 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052957 Aug 09 14:52:48.810360 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2165/4338] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:48.901132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f10cf7ae-0f54-476e-978a-db0238258b7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:48.902004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f10cf7ae-0f54-476e-978a-db0238258b7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:48.916550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10cf7ae-0f54-476e-978a-db0238258b7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:48.917400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10cf7ae-0f54-476e-978a-db0238258b7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:48.918050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10cf7ae-0f54-476e-978a-db0238258b7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:48.924458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10cf7ae-0f54-476e-978a-db0238258b7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:48.925239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10cf7ae-0f54-476e-978a-db0238258b7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:48.925891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10cf7ae-0f54-476e-978a-db0238258b7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:50.218237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f10cf7ae-0f54-476e-978a-db0238258b7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:50.229542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f10cf7ae-0f54-476e-978a-db0238258b7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:50.232883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f10cf7ae-0f54-476e-978a-db0238258b7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:50.236797 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f10cf7ae-0f54-476e-978a-db0238258b7f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1722 microversion: 2.20 time: 1.344430 Aug 09 14:52:50.237932 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2166/4339] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:48 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1722 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:50.246686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d40e0b3-16e8-4abd-bdbd-03d86fa5eadb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:50.250446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1d40e0b3-16e8-4abd-bdbd-03d86fa5eadb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:50.266840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d40e0b3-16e8-4abd-bdbd-03d86fa5eadb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:50.267688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d40e0b3-16e8-4abd-bdbd-03d86fa5eadb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:50.268328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d40e0b3-16e8-4abd-bdbd-03d86fa5eadb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:50.269217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d40e0b3-16e8-4abd-bdbd-03d86fa5eadb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:50.270465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d40e0b3-16e8-4abd-bdbd-03d86fa5eadb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:50.272543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d40e0b3-16e8-4abd-bdbd-03d86fa5eadb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:51.932753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d40e0b3-16e8-4abd-bdbd-03d86fa5eadb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:51.948778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d40e0b3-16e8-4abd-bdbd-03d86fa5eadb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:51.950399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d40e0b3-16e8-4abd-bdbd-03d86fa5eadb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:51.953279 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1d40e0b3-16e8-4abd-bdbd-03d86fa5eadb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1874 microversion: 2.32 time: 1.714040 Aug 09 14:52:51.956324 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2167/4340] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:50 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1874 bytes in 1718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:51.962742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6878cff2-b95c-4a35-b6bc-13d796757d14 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:51.963606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6878cff2-b95c-4a35-b6bc-13d796757d14 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:51.977702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6878cff2-b95c-4a35-b6bc-13d796757d14 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:51.979291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6878cff2-b95c-4a35-b6bc-13d796757d14 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:51.980033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6878cff2-b95c-4a35-b6bc-13d796757d14 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:51.981341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6878cff2-b95c-4a35-b6bc-13d796757d14 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:51.982220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6878cff2-b95c-4a35-b6bc-13d796757d14 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:51.983038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6878cff2-b95c-4a35-b6bc-13d796757d14 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:53.281324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6878cff2-b95c-4a35-b6bc-13d796757d14 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:53.293760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6878cff2-b95c-4a35-b6bc-13d796757d14 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:53.297847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6878cff2-b95c-4a35-b6bc-13d796757d14 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:53.303644 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6878cff2-b95c-4a35-b6bc-13d796757d14 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1743 microversion: 2.20 time: 1.345949 Aug 09 14:52:53.304882 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2168/4341] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:51 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1743 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:53.316360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1db18fa-aa60-4bd8-9c13-836e8cb9f4ae tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:53.317230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1db18fa-aa60-4bd8-9c13-836e8cb9f4ae tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:53.329848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1db18fa-aa60-4bd8-9c13-836e8cb9f4ae tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:53.330339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1db18fa-aa60-4bd8-9c13-836e8cb9f4ae tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:53.333265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1db18fa-aa60-4bd8-9c13-836e8cb9f4ae tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:53.337644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1db18fa-aa60-4bd8-9c13-836e8cb9f4ae tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:53.338129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1db18fa-aa60-4bd8-9c13-836e8cb9f4ae tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:53.338580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1db18fa-aa60-4bd8-9c13-836e8cb9f4ae tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:53.373159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:52:53.374958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:52:53.376706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:52:53.378907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:52:53.379741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:52:53.414825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:53.415853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:53.416948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:53.418124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:53.419331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:53.419964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:53.532695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:53.547780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:53.600509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:52:53.608376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:52:53.714022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_group_members'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:53.733135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_group_members'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:53.814530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_group_members'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:52:53.829812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Getting quotas for user c88836e9e3804dc4bc36a325f0f6c230 and project afac4ac2ba124b0980d076fa8a5cb702. Resources: {'server_group_members'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:52:53.882572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1db18fa-aa60-4bd8-9c13-836e8cb9f4ae tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:53.905325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1db18fa-aa60-4bd8-9c13-836e8cb9f4ae tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:53.906985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1db18fa-aa60-4bd8-9c13-836e8cb9f4ae tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:53.910550 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1db18fa-aa60-4bd8-9c13-836e8cb9f4ae tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2826 microversion: 2.32 time: 0.604360 Aug 09 14:52:53.911151 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2169/4342] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:53 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2826 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:53.936426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a243423-1b2f-4067-8e1f-0ae704d3d185 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:53.937199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0a243423-1b2f-4067-8e1f-0ae704d3d185 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:53.942070 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bebee951-25e4-4e36-8103-69f44f9f03df tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.300165 Aug 09 14:52:53.947431 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2174/4343] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:52:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 5308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:52:53.956114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a243423-1b2f-4067-8e1f-0ae704d3d185 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:53.956608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a243423-1b2f-4067-8e1f-0ae704d3d185 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:53.957043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a243423-1b2f-4067-8e1f-0ae704d3d185 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:53.957749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a243423-1b2f-4067-8e1f-0ae704d3d185 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:53.958197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a243423-1b2f-4067-8e1f-0ae704d3d185 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:53.958655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a243423-1b2f-4067-8e1f-0ae704d3d185 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:53.962280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c028f7c1-2042-4044-8c7c-e232469da380 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:53.963216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c028f7c1-2042-4044-8c7c-e232469da380 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:53.977258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:54.233644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c028f7c1-2042-4044-8c7c-e232469da380 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:54.243336 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c028f7c1-2042-4044-8c7c-e232469da380 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1212 microversion: 2.1 time: 0.287750 Aug 09 14:52:54.243945 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2175/4344] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:53 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1212 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:52:54.287016 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0a243423-1b2f-4067-8e1f-0ae704d3d185 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.354614 Aug 09 14:52:54.298799 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2170/4345] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 9 14:52:53 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00/os-interface => generated 1831 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:52:54.330345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb1b5079-46ed-48ce-ad48-4158e9dde933 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:54.331040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eb1b5079-46ed-48ce-ad48-4158e9dde933 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:54.345801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb1b5079-46ed-48ce-ad48-4158e9dde933 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:54.346318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb1b5079-46ed-48ce-ad48-4158e9dde933 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:54.353212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb1b5079-46ed-48ce-ad48-4158e9dde933 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:54.354455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb1b5079-46ed-48ce-ad48-4158e9dde933 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:54.354947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb1b5079-46ed-48ce-ad48-4158e9dde933 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:54.355416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb1b5079-46ed-48ce-ad48-4158e9dde933 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:55.105014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb1b5079-46ed-48ce-ad48-4158e9dde933 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:55.132761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb1b5079-46ed-48ce-ad48-4158e9dde933 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:55.142962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eb1b5079-46ed-48ce-ad48-4158e9dde933 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:55.152058 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb1b5079-46ed-48ce-ad48-4158e9dde933 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 0.823591 Aug 09 14:52:55.169989 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2176/4346] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:54 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:55.267352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-201c20e1-0763-4717-9658-2dffe9ade915 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:55.268235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-201c20e1-0763-4717-9658-2dffe9ade915 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:55.280199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201c20e1-0763-4717-9658-2dffe9ade915 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:55.281403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201c20e1-0763-4717-9658-2dffe9ade915 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:55.282436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201c20e1-0763-4717-9658-2dffe9ade915 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:55.284462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201c20e1-0763-4717-9658-2dffe9ade915 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:55.285700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201c20e1-0763-4717-9658-2dffe9ade915 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:55.286982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-201c20e1-0763-4717-9658-2dffe9ade915 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:55.413709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-201c20e1-0763-4717-9658-2dffe9ade915 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:55.430896 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-201c20e1-0763-4717-9658-2dffe9ade915 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1208 microversion: 2.1 time: 0.167900 Aug 09 14:52:55.454170 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2171/4347] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:55 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1208 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:55.735555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c71cdbce-597f-4bbe-905a-20469e0e61e0 req-1e60b7b9-fde6-47a2-91de-9466a31b7e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcda666-d36a-488f-8fb0-fe12470ff45f", "name": "network-vif-plugged", "status": "completed", "tag": "9c42ace2-95a4-43eb-abf9-6c87e774f843"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:52:55.772648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c71cdbce-597f-4bbe-905a-20469e0e61e0 req-1e60b7b9-fde6-47a2-91de-9466a31b7e45 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:55.773143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c71cdbce-597f-4bbe-905a-20469e0e61e0 req-1e60b7b9-fde6-47a2-91de-9466a31b7e45 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:55.779282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c71cdbce-597f-4bbe-905a-20469e0e61e0 req-1e60b7b9-fde6-47a2-91de-9466a31b7e45 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:55.809694 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-c71cdbce-597f-4bbe-905a-20469e0e61e0 req-1e60b7b9-fde6-47a2-91de-9466a31b7e45 service nova] Creating event network-vif-plugged:9c42ace2-95a4-43eb-abf9-6c87e774f843 for instance 9bcda666-d36a-488f-8fb0-fe12470ff45f on n-h1-844626-8 Aug 09 14:52:55.819359 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c71cdbce-597f-4bbe-905a-20469e0e61e0 req-1e60b7b9-fde6-47a2-91de-9466a31b7e45 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088435 Aug 09 14:52:55.824787 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2177/4348] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:52:56.183384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9d0cb50-ac49-48fe-8693-c51072a282e4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:56.184000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a9d0cb50-ac49-48fe-8693-c51072a282e4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:56.202459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9d0cb50-ac49-48fe-8693-c51072a282e4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:56.205110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9d0cb50-ac49-48fe-8693-c51072a282e4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:56.205822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9d0cb50-ac49-48fe-8693-c51072a282e4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:56.206769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9d0cb50-ac49-48fe-8693-c51072a282e4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:56.209321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9d0cb50-ac49-48fe-8693-c51072a282e4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:56.221439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9d0cb50-ac49-48fe-8693-c51072a282e4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:56.281453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:56.463146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dea7688f-2a70-4262-8269-e57a2218d14d tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:56.463907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dea7688f-2a70-4262-8269-e57a2218d14d tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:56.491771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dea7688f-2a70-4262-8269-e57a2218d14d tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:56.491771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dea7688f-2a70-4262-8269-e57a2218d14d tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:56.492453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dea7688f-2a70-4262-8269-e57a2218d14d tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:56.493047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dea7688f-2a70-4262-8269-e57a2218d14d tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:56.495603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dea7688f-2a70-4262-8269-e57a2218d14d tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:56.509521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dea7688f-2a70-4262-8269-e57a2218d14d tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:56.695917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dea7688f-2a70-4262-8269-e57a2218d14d tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:56.709359 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dea7688f-2a70-4262-8269-e57a2218d14d tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1270 microversion: 2.1 time: 0.251865 Aug 09 14:52:56.711157 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2178/4349] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:56 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1270 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:57.735394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cc4a0113-6dc3-4856-b4f1-d57181fa5784 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:57.736316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cc4a0113-6dc3-4856-b4f1-d57181fa5784 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:57.750852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc4a0113-6dc3-4856-b4f1-d57181fa5784 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:57.753847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc4a0113-6dc3-4856-b4f1-d57181fa5784 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:57.754761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc4a0113-6dc3-4856-b4f1-d57181fa5784 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:57.757596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc4a0113-6dc3-4856-b4f1-d57181fa5784 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:57.758261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc4a0113-6dc3-4856-b4f1-d57181fa5784 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:57.759645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc4a0113-6dc3-4856-b4f1-d57181fa5784 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:58.080046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cc4a0113-6dc3-4856-b4f1-d57181fa5784 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:58.097199 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cc4a0113-6dc3-4856-b4f1-d57181fa5784 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1270 microversion: 2.1 time: 0.363677 Aug 09 14:52:58.097851 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2179/4350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:57 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1270 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:52:58.123813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a9d0cb50-ac49-48fe-8693-c51072a282e4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:58.152723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a9d0cb50-ac49-48fe-8693-c51072a282e4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:58.156130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a9d0cb50-ac49-48fe-8693-c51072a282e4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:52:58.162578 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a9d0cb50-ac49-48fe-8693-c51072a282e4 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 1.983167 Aug 09 14:52:58.166688 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2172/4351] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:56 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:52:59.118122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f880546-b6d3-4d54-bef1-f61e6b1b87e9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:59.118736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f880546-b6d3-4d54-bef1-f61e6b1b87e9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:59.133064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f880546-b6d3-4d54-bef1-f61e6b1b87e9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:59.137991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f880546-b6d3-4d54-bef1-f61e6b1b87e9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:59.140162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f880546-b6d3-4d54-bef1-f61e6b1b87e9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:59.140910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f880546-b6d3-4d54-bef1-f61e6b1b87e9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:59.141378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f880546-b6d3-4d54-bef1-f61e6b1b87e9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:59.141813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f880546-b6d3-4d54-bef1-f61e6b1b87e9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:59.192442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f07791bf-e573-4c72-ac5f-bc9e278db467 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:52:59.193187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f07791bf-e573-4c72-ac5f-bc9e278db467 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:52:59.196850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=24 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:52:59.226324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f07791bf-e573-4c72-ac5f-bc9e278db467 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:59.230608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f07791bf-e573-4c72-ac5f-bc9e278db467 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:59.231162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f07791bf-e573-4c72-ac5f-bc9e278db467 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:52:59.231905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f07791bf-e573-4c72-ac5f-bc9e278db467 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:52:59.235257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f07791bf-e573-4c72-ac5f-bc9e278db467 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:52:59.238063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f07791bf-e573-4c72-ac5f-bc9e278db467 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:00.010414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f07791bf-e573-4c72-ac5f-bc9e278db467 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:00.043633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f07791bf-e573-4c72-ac5f-bc9e278db467 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:00.056480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f07791bf-e573-4c72-ac5f-bc9e278db467 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:00.065774 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f07791bf-e573-4c72-ac5f-bc9e278db467 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 0.874932 Aug 09 14:53:00.078929 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2173/4352] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:52:59 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:00.091676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f880546-b6d3-4d54-bef1-f61e6b1b87e9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:00.103036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8bda07ad-4fa2-4eb7-8761-7bb01df18fbf req-d9e19f8b-5939-47a3-9589-80074d459000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "tag": "1bbb6bc7-df59-43ad-bd7e-3c6cac208995"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:00.105054 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f880546-b6d3-4d54-bef1-f61e6b1b87e9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1312 microversion: 2.1 time: 0.990912 Aug 09 14:53:00.106291 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2180/4353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:52:59 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1312 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:00.132212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8bda07ad-4fa2-4eb7-8761-7bb01df18fbf req-d9e19f8b-5939-47a3-9589-80074d459000 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:00.133280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8bda07ad-4fa2-4eb7-8761-7bb01df18fbf req-d9e19f8b-5939-47a3-9589-80074d459000 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:00.133923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8bda07ad-4fa2-4eb7-8761-7bb01df18fbf req-d9e19f8b-5939-47a3-9589-80074d459000 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:00.150218 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8bda07ad-4fa2-4eb7-8761-7bb01df18fbf req-d9e19f8b-5939-47a3-9589-80074d459000 service nova] Creating event network-changed:1bbb6bc7-df59-43ad-bd7e-3c6cac208995 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:53:00.158318 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8bda07ad-4fa2-4eb7-8761-7bb01df18fbf req-d9e19f8b-5939-47a3-9589-80074d459000 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076847 Aug 09 14:53:00.161335 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2174/4354] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:01.103822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d85e795c-b3bc-4ce6-b664-87506a5aa2a9 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:01.104954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d85e795c-b3bc-4ce6-b664-87506a5aa2a9 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:01.126236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d85e795c-b3bc-4ce6-b664-87506a5aa2a9 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:01.126753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d85e795c-b3bc-4ce6-b664-87506a5aa2a9 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:01.130884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d85e795c-b3bc-4ce6-b664-87506a5aa2a9 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:01.131688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d85e795c-b3bc-4ce6-b664-87506a5aa2a9 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:01.132967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5999a606-3730-4242-89a6-59cb086ac9ac tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:01.134282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5999a606-3730-4242-89a6-59cb086ac9ac tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:01.136393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d85e795c-b3bc-4ce6-b664-87506a5aa2a9 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:01.138401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d85e795c-b3bc-4ce6-b664-87506a5aa2a9 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:01.156088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5999a606-3730-4242-89a6-59cb086ac9ac tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:01.157159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5999a606-3730-4242-89a6-59cb086ac9ac tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:01.159859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5999a606-3730-4242-89a6-59cb086ac9ac tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:01.160829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5999a606-3730-4242-89a6-59cb086ac9ac tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:01.166401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5999a606-3730-4242-89a6-59cb086ac9ac tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:01.166756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5999a606-3730-4242-89a6-59cb086ac9ac tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:01.587636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d85e795c-b3bc-4ce6-b664-87506a5aa2a9 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:01.612814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d85e795c-b3bc-4ce6-b664-87506a5aa2a9 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:01.615251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d85e795c-b3bc-4ce6-b664-87506a5aa2a9 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:01.616621 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d85e795c-b3bc-4ce6-b664-87506a5aa2a9 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 0.518788 Aug 09 14:53:01.626341 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2181/4355] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:01 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:01.713883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5999a606-3730-4242-89a6-59cb086ac9ac tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:01.738765 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5999a606-3730-4242-89a6-59cb086ac9ac tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1312 microversion: 2.1 time: 0.611340 Aug 09 14:53:01.751649 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2175/4356] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:01 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1312 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:02.291776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d3ddf577-d750-49aa-8e11-659b654665c8 req-c7bff1bd-1064-4291-b6f0-707d660d7098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d97dfd-159a-417d-a283-4e9e605535af", "tag": "4fc4de0d-18cd-4b79-ab68-86897c2d91c9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:02.320012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d3ddf577-d750-49aa-8e11-659b654665c8 req-c7bff1bd-1064-4291-b6f0-707d660d7098 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:02.320505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d3ddf577-d750-49aa-8e11-659b654665c8 req-c7bff1bd-1064-4291-b6f0-707d660d7098 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:02.320941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d3ddf577-d750-49aa-8e11-659b654665c8 req-c7bff1bd-1064-4291-b6f0-707d660d7098 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:02.368845 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d3ddf577-d750-49aa-8e11-659b654665c8 req-c7bff1bd-1064-4291-b6f0-707d660d7098 service nova] Creating event network-changed:4fc4de0d-18cd-4b79-ab68-86897c2d91c9 for instance 32d97dfd-159a-417d-a283-4e9e605535af on n-h2-844626-8 Aug 09 14:53:02.384392 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d3ddf577-d750-49aa-8e11-659b654665c8 req-c7bff1bd-1064-4291-b6f0-707d660d7098 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097614 Aug 09 14:53:02.392989 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2182/4357] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:02.647524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba5ea449-3177-44dd-a1b9-ca4769aa387b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:02.648794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba5ea449-3177-44dd-a1b9-ca4769aa387b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:02.661615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5ea449-3177-44dd-a1b9-ca4769aa387b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:02.673646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5ea449-3177-44dd-a1b9-ca4769aa387b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:02.674345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5ea449-3177-44dd-a1b9-ca4769aa387b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:02.676272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5ea449-3177-44dd-a1b9-ca4769aa387b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:02.678957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5ea449-3177-44dd-a1b9-ca4769aa387b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:02.679614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5ea449-3177-44dd-a1b9-ca4769aa387b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:02.762701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d535db5-b564-4b95-bc05-9ea58feeb680 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:02.763432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d535db5-b564-4b95-bc05-9ea58feeb680 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:02.776804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d535db5-b564-4b95-bc05-9ea58feeb680 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:02.777301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d535db5-b564-4b95-bc05-9ea58feeb680 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:02.777743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d535db5-b564-4b95-bc05-9ea58feeb680 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:02.778457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d535db5-b564-4b95-bc05-9ea58feeb680 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:02.778911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d535db5-b564-4b95-bc05-9ea58feeb680 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:02.779355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d535db5-b564-4b95-bc05-9ea58feeb680 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:03.480594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:03.908872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba5ea449-3177-44dd-a1b9-ca4769aa387b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:03.930688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba5ea449-3177-44dd-a1b9-ca4769aa387b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:03.932451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba5ea449-3177-44dd-a1b9-ca4769aa387b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:03.933783 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba5ea449-3177-44dd-a1b9-ca4769aa387b tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 1.290431 Aug 09 14:53:03.934476 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2176/4358] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:02 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:04.169215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d535db5-b564-4b95-bc05-9ea58feeb680 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:04.195967 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d535db5-b564-4b95-bc05-9ea58feeb680 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1312 microversion: 2.1 time: 1.432813 Aug 09 14:53:04.198148 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2183/4359] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:02 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1312 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:04.969202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4391ebee-af9e-4851-a76a-c00b29c1f2b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:04.972059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4391ebee-af9e-4851-a76a-c00b29c1f2b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:04.991702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4391ebee-af9e-4851-a76a-c00b29c1f2b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:04.996781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4391ebee-af9e-4851-a76a-c00b29c1f2b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:04.998588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4391ebee-af9e-4851-a76a-c00b29c1f2b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:04.999844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4391ebee-af9e-4851-a76a-c00b29c1f2b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:05.000214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4391ebee-af9e-4851-a76a-c00b29c1f2b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:05.000784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4391ebee-af9e-4851-a76a-c00b29c1f2b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:05.223065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee9a0c89-8b72-4d53-892a-860dbf7c3283 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:05.225182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee9a0c89-8b72-4d53-892a-860dbf7c3283 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:05.249854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=32 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:05.269720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee9a0c89-8b72-4d53-892a-860dbf7c3283 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:05.279603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee9a0c89-8b72-4d53-892a-860dbf7c3283 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:05.282336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee9a0c89-8b72-4d53-892a-860dbf7c3283 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:05.283962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee9a0c89-8b72-4d53-892a-860dbf7c3283 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:05.287874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee9a0c89-8b72-4d53-892a-860dbf7c3283 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:05.292152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee9a0c89-8b72-4d53-892a-860dbf7c3283 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:05.708966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4391ebee-af9e-4851-a76a-c00b29c1f2b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:05.719525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4391ebee-af9e-4851-a76a-c00b29c1f2b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:05.724954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4391ebee-af9e-4851-a76a-c00b29c1f2b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:05.740990 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4391ebee-af9e-4851-a76a-c00b29c1f2b1 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 0.777608 Aug 09 14:53:05.742194 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2177/4360] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:04 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:06.041866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ee9a0c89-8b72-4d53-892a-860dbf7c3283 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:06.060387 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee9a0c89-8b72-4d53-892a-860dbf7c3283 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1312 microversion: 2.1 time: 0.838315 Aug 09 14:53:06.061106 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2184/4361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:05 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1312 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:06.767661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14e1519c-505b-450e-a420-ee10e033c341 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:06.768442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14e1519c-505b-450e-a420-ee10e033c341 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:06.785953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14e1519c-505b-450e-a420-ee10e033c341 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:06.788680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14e1519c-505b-450e-a420-ee10e033c341 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:06.791656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14e1519c-505b-450e-a420-ee10e033c341 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:06.792603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14e1519c-505b-450e-a420-ee10e033c341 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:06.793225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14e1519c-505b-450e-a420-ee10e033c341 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:06.793809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14e1519c-505b-450e-a420-ee10e033c341 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:07.083829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-21729fb4-f7f5-4c54-acb7-bbdb09dff194 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:07.084451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-21729fb4-f7f5-4c54-acb7-bbdb09dff194 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:07.124324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21729fb4-f7f5-4c54-acb7-bbdb09dff194 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:07.125747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21729fb4-f7f5-4c54-acb7-bbdb09dff194 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:07.126090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14e1519c-505b-450e-a420-ee10e033c341 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:07.126238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21729fb4-f7f5-4c54-acb7-bbdb09dff194 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:07.127003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21729fb4-f7f5-4c54-acb7-bbdb09dff194 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:07.133653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21729fb4-f7f5-4c54-acb7-bbdb09dff194 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:07.136644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14e1519c-505b-450e-a420-ee10e033c341 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:07.139429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21729fb4-f7f5-4c54-acb7-bbdb09dff194 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:07.147967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14e1519c-505b-450e-a420-ee10e033c341 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:07.149860 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14e1519c-505b-450e-a420-ee10e033c341 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 0.387489 Aug 09 14:53:07.153307 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2178/4362] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:06 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:08.175459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ce0d7342-4892-4385-a8bc-665290fb8784 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:08.177793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ce0d7342-4892-4385-a8bc-665290fb8784 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:08.200478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce0d7342-4892-4385-a8bc-665290fb8784 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:08.201418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce0d7342-4892-4385-a8bc-665290fb8784 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:08.202069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce0d7342-4892-4385-a8bc-665290fb8784 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:08.202995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce0d7342-4892-4385-a8bc-665290fb8784 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:08.207883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce0d7342-4892-4385-a8bc-665290fb8784 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:08.208684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce0d7342-4892-4385-a8bc-665290fb8784 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:08.277974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-21729fb4-f7f5-4c54-acb7-bbdb09dff194 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:08.294956 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-21729fb4-f7f5-4c54-acb7-bbdb09dff194 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1312 microversion: 2.1 time: 1.215443 Aug 09 14:53:08.296325 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2185/4363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:07 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1312 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:08.802803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce0d7342-4892-4385-a8bc-665290fb8784 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:08.861220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce0d7342-4892-4385-a8bc-665290fb8784 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:08.863117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce0d7342-4892-4385-a8bc-665290fb8784 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:08.900917 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ce0d7342-4892-4385-a8bc-665290fb8784 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 0.729782 Aug 09 14:53:08.901535 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2179/4364] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:08 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:09.275853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-9e466b0b-1570-4fc8-a882-6b691155f5c9 req-ebac3c04-6a69-4aa6-9be8-0411bf64ade1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d97dfd-159a-417d-a283-4e9e605535af", "name": "network-vif-plugged", "status": "completed", "tag": "4fc4de0d-18cd-4b79-ab68-86897c2d91c9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:09.321947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-15565453-294c-4915-b295-c291d7abd1d8 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:09.322992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-15565453-294c-4915-b295-c291d7abd1d8 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:09.359073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15565453-294c-4915-b295-c291d7abd1d8 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:09.363397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15565453-294c-4915-b295-c291d7abd1d8 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:09.364504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15565453-294c-4915-b295-c291d7abd1d8 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:09.371166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15565453-294c-4915-b295-c291d7abd1d8 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:09.375151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15565453-294c-4915-b295-c291d7abd1d8 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:09.375437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9e466b0b-1570-4fc8-a882-6b691155f5c9 req-ebac3c04-6a69-4aa6-9be8-0411bf64ade1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:09.376636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9e466b0b-1570-4fc8-a882-6b691155f5c9 req-ebac3c04-6a69-4aa6-9be8-0411bf64ade1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:09.377409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15565453-294c-4915-b295-c291d7abd1d8 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:09.381593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9e466b0b-1570-4fc8-a882-6b691155f5c9 req-ebac3c04-6a69-4aa6-9be8-0411bf64ade1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:09.400987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:09.436184 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9e466b0b-1570-4fc8-a882-6b691155f5c9 req-ebac3c04-6a69-4aa6-9be8-0411bf64ade1 service nova] Creating event network-vif-plugged:4fc4de0d-18cd-4b79-ab68-86897c2d91c9 for instance 32d97dfd-159a-417d-a283-4e9e605535af on n-h2-844626-8 Aug 09 14:53:09.459364 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-9e466b0b-1570-4fc8-a882-6b691155f5c9 req-ebac3c04-6a69-4aa6-9be8-0411bf64ade1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187053 Aug 09 14:53:09.461066 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2186/4365] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:09.927126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-45b01759-a160-44a9-8538-7ab593bb2588 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:09.928033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-45b01759-a160-44a9-8538-7ab593bb2588 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:09.941412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45b01759-a160-44a9-8538-7ab593bb2588 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:09.942770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45b01759-a160-44a9-8538-7ab593bb2588 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:09.944959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45b01759-a160-44a9-8538-7ab593bb2588 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:09.946087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45b01759-a160-44a9-8538-7ab593bb2588 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:09.947853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45b01759-a160-44a9-8538-7ab593bb2588 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:09.948580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45b01759-a160-44a9-8538-7ab593bb2588 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:09.975778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-15565453-294c-4915-b295-c291d7abd1d8 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:09.984653 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-15565453-294c-4915-b295-c291d7abd1d8 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1312 microversion: 2.1 time: 0.667888 Aug 09 14:53:09.991360 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2180/4366] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:09 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1312 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:10.337296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45b01759-a160-44a9-8538-7ab593bb2588 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:10.356207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45b01759-a160-44a9-8538-7ab593bb2588 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:10.363207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45b01759-a160-44a9-8538-7ab593bb2588 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:10.364915 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-45b01759-a160-44a9-8538-7ab593bb2588 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 0.442516 Aug 09 14:53:10.367236 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2187/4367] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:09 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:11.009460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-76b8f3f7-c292-4fea-817e-d9e118f60412 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:11.011260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-76b8f3f7-c292-4fea-817e-d9e118f60412 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:11.033089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76b8f3f7-c292-4fea-817e-d9e118f60412 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:11.047125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76b8f3f7-c292-4fea-817e-d9e118f60412 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:11.049447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76b8f3f7-c292-4fea-817e-d9e118f60412 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:11.059842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76b8f3f7-c292-4fea-817e-d9e118f60412 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:11.071141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76b8f3f7-c292-4fea-817e-d9e118f60412 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:11.072016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76b8f3f7-c292-4fea-817e-d9e118f60412 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:11.397948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a132689-6055-429f-ac77-866746fdca4a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:11.398603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a132689-6055-429f-ac77-866746fdca4a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:11.409217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a132689-6055-429f-ac77-866746fdca4a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:11.410102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a132689-6055-429f-ac77-866746fdca4a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:11.410978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a132689-6055-429f-ac77-866746fdca4a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:11.412299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a132689-6055-429f-ac77-866746fdca4a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:11.413040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a132689-6055-429f-ac77-866746fdca4a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:11.413631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a132689-6055-429f-ac77-866746fdca4a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:11.448652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-76b8f3f7-c292-4fea-817e-d9e118f60412 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:11.460460 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-76b8f3f7-c292-4fea-817e-d9e118f60412 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1498 microversion: 2.1 time: 0.458036 Aug 09 14:53:11.467471 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2181/4368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:11 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1498 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:11.489482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-65c5f949-dd73-4098-92de-7698b434bc11 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:11.552534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.compute.server_groups [None req-65c5f949-dd73-4098-92de-7698b434bc11 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Querying cell ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) for 1 instances {{(pid=119407) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 09 14:53:11.561688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65c5f949-dd73-4098-92de-7698b434bc11 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:11.562849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65c5f949-dd73-4098-92de-7698b434bc11 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:11.566106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-65c5f949-dd73-4098-92de-7698b434bc11 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:11.647473 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-65c5f949-dd73-4098-92de-7698b434bc11 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/95056e80-e8ca-4aec-adf3-ccb879f262ef" status: 200 len: 222 microversion: 2.1 time: 0.162485 Aug 09 14:53:11.660565 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2182/4369] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:53:11 2022] GET /compute/v2.1/os-server-groups/95056e80-e8ca-4aec-adf3-ccb879f262ef => generated 222 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:11.700165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7524d59f-a6f7-4eeb-bbb7-bbe96b503d7b tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:11.706870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7524d59f-a6f7-4eeb-bbb7-bbe96b503d7b tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:11.709322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2a132689-6055-429f-ac77-866746fdca4a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:11.724969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2a132689-6055-429f-ac77-866746fdca4a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:11.732251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2a132689-6055-429f-ac77-866746fdca4a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:11.736771 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2a132689-6055-429f-ac77-866746fdca4a tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 0.346816 Aug 09 14:53:11.739534 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2188/4370] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:11 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:11.741021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7524d59f-a6f7-4eeb-bbb7-bbe96b503d7b tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:11.747358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7524d59f-a6f7-4eeb-bbb7-bbe96b503d7b tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:11.747938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7524d59f-a6f7-4eeb-bbb7-bbe96b503d7b tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:11.752553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7524d59f-a6f7-4eeb-bbb7-bbe96b503d7b tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:11.753381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7524d59f-a6f7-4eeb-bbb7-bbe96b503d7b tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:11.756612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7524d59f-a6f7-4eeb-bbb7-bbe96b503d7b tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:11.845225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7524d59f-a6f7-4eeb-bbb7-bbe96b503d7b tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:53:12.089780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:12.114112 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7524d59f-a6f7-4eeb-bbb7-bbe96b503d7b tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "DELETE /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 204 len: 0 microversion: 2.1 time: 0.446256 Aug 09 14:53:12.116859 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2183/4371] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:53:11 2022] DELETE /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:53:12.127445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-310bf32c-2650-405a-a237-8c588b1b6bd0 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:12.128604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-310bf32c-2650-405a-a237-8c588b1b6bd0 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:12.142099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-310bf32c-2650-405a-a237-8c588b1b6bd0 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:12.145121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-310bf32c-2650-405a-a237-8c588b1b6bd0 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:12.145814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-310bf32c-2650-405a-a237-8c588b1b6bd0 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:12.149954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-310bf32c-2650-405a-a237-8c588b1b6bd0 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:12.150910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-310bf32c-2650-405a-a237-8c588b1b6bd0 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:12.152684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-310bf32c-2650-405a-a237-8c588b1b6bd0 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:12.430566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-310bf32c-2650-405a-a237-8c588b1b6bd0 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:12.444459 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-310bf32c-2650-405a-a237-8c588b1b6bd0 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1504 microversion: 2.1 time: 0.318528 Aug 09 14:53:12.445376 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2189/4372] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:12 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1504 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:12.763372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d39670c-3b28-4df2-8dcb-38ddad1b1c8f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:12.764310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d39670c-3b28-4df2-8dcb-38ddad1b1c8f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:12.783544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d39670c-3b28-4df2-8dcb-38ddad1b1c8f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:12.784135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d39670c-3b28-4df2-8dcb-38ddad1b1c8f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:12.790155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d39670c-3b28-4df2-8dcb-38ddad1b1c8f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:12.790928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d39670c-3b28-4df2-8dcb-38ddad1b1c8f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:12.791446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d39670c-3b28-4df2-8dcb-38ddad1b1c8f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:12.791875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d39670c-3b28-4df2-8dcb-38ddad1b1c8f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:13.475661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6dc894a4-8e92-43c1-86c6-08d7c2d9dff2 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:13.478958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6dc894a4-8e92-43c1-86c6-08d7c2d9dff2 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:13.507780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc894a4-8e92-43c1-86c6-08d7c2d9dff2 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:13.511285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc894a4-8e92-43c1-86c6-08d7c2d9dff2 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:13.529556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc894a4-8e92-43c1-86c6-08d7c2d9dff2 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:13.533901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc894a4-8e92-43c1-86c6-08d7c2d9dff2 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:13.536328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc894a4-8e92-43c1-86c6-08d7c2d9dff2 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:13.537089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6dc894a4-8e92-43c1-86c6-08d7c2d9dff2 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:13.703395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9d39670c-3b28-4df2-8dcb-38ddad1b1c8f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:13.718486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9d39670c-3b28-4df2-8dcb-38ddad1b1c8f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:13.720841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9d39670c-3b28-4df2-8dcb-38ddad1b1c8f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:13.724071 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d39670c-3b28-4df2-8dcb-38ddad1b1c8f tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 0.965879 Aug 09 14:53:13.725414 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2184/4373] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:12 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:14.509297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6dc894a4-8e92-43c1-86c6-08d7c2d9dff2 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:14.530084 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6dc894a4-8e92-43c1-86c6-08d7c2d9dff2 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1504 microversion: 2.1 time: 1.065624 Aug 09 14:53:14.534226 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2190/4374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:13 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1504 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:14.753306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ac8c93e8-e109-4de3-81c6-e683d2b6f895 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:14.754056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ac8c93e8-e109-4de3-81c6-e683d2b6f895 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:14.766204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac8c93e8-e109-4de3-81c6-e683d2b6f895 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:14.770817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac8c93e8-e109-4de3-81c6-e683d2b6f895 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:14.771902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac8c93e8-e109-4de3-81c6-e683d2b6f895 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:14.774464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac8c93e8-e109-4de3-81c6-e683d2b6f895 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:14.776145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac8c93e8-e109-4de3-81c6-e683d2b6f895 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:14.778984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac8c93e8-e109-4de3-81c6-e683d2b6f895 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:15.253580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac8c93e8-e109-4de3-81c6-e683d2b6f895 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:15.280523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac8c93e8-e109-4de3-81c6-e683d2b6f895 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:15.295869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac8c93e8-e109-4de3-81c6-e683d2b6f895 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:15.303982 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ac8c93e8-e109-4de3-81c6-e683d2b6f895 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 0.556863 Aug 09 14:53:15.323996 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2185/4375] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:14 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:15.369030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1748181891", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "3fb1c526-035d-4b43-9888-6d19d877dbd5"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:15.485042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] validate_networks() for [('3fb1c526-035d-4b43-9888-6d19d877dbd5', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:53:15.558129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e1ed031d-a6b7-428b-b6a5-8cdde2665fbe tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:15.558693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e1ed031d-a6b7-428b-b6a5-8cdde2665fbe tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:15.565918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1ed031d-a6b7-428b-b6a5-8cdde2665fbe tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:15.566517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1ed031d-a6b7-428b-b6a5-8cdde2665fbe tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:15.566844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1ed031d-a6b7-428b-b6a5-8cdde2665fbe tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:15.572136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1ed031d-a6b7-428b-b6a5-8cdde2665fbe tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:15.572855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1ed031d-a6b7-428b-b6a5-8cdde2665fbe tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:15.573472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1ed031d-a6b7-428b-b6a5-8cdde2665fbe tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:15.889784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e1ed031d-a6b7-428b-b6a5-8cdde2665fbe tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88836e9e3804dc4bc36a325f0f6c230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afac4ac2ba124b0980d076fa8a5cb702', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:15.907137 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e1ed031d-a6b7-428b-b6a5-8cdde2665fbe tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 200 len: 1462 microversion: 2.1 time: 0.358505 Aug 09 14:53:15.910180 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2186/4376] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:15 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 1462 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:15.925149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-80bf8d79-7d63-450f-a02b-f4bb671d778f req-4d494c12-624e-47db-be9a-de1f07e0a60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d97dfd-159a-417d-a283-4e9e605535af", "name": "network-vif-deleted", "tag": "4fc4de0d-18cd-4b79-ab68-86897c2d91c9"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:15.957307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-80bf8d79-7d63-450f-a02b-f4bb671d778f req-4d494c12-624e-47db-be9a-de1f07e0a60d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:15.957794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-80bf8d79-7d63-450f-a02b-f4bb671d778f req-4d494c12-624e-47db-be9a-de1f07e0a60d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:15.958413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-80bf8d79-7d63-450f-a02b-f4bb671d778f req-4d494c12-624e-47db-be9a-de1f07e0a60d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:16.036551 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-80bf8d79-7d63-450f-a02b-f4bb671d778f req-4d494c12-624e-47db-be9a-de1f07e0a60d service nova] Creating event network-vif-deleted:4fc4de0d-18cd-4b79-ab68-86897c2d91c9 for instance 32d97dfd-159a-417d-a283-4e9e605535af on n-h2-844626-8 Aug 09 14:53:16.066434 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-80bf8d79-7d63-450f-a02b-f4bb671d778f req-4d494c12-624e-47db-be9a-de1f07e0a60d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136317 Aug 09 14:53:16.072423 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2187/4377] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:16.335225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1a3d39c9-f6db-4d08-9f89-e6f3d551162e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:16.338784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1a3d39c9-f6db-4d08-9f89-e6f3d551162e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:16.356473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a3d39c9-f6db-4d08-9f89-e6f3d551162e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:16.363124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a3d39c9-f6db-4d08-9f89-e6f3d551162e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:16.380128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a3d39c9-f6db-4d08-9f89-e6f3d551162e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:16.387077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a3d39c9-f6db-4d08-9f89-e6f3d551162e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:16.390063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a3d39c9-f6db-4d08-9f89-e6f3d551162e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:16.392527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a3d39c9-f6db-4d08-9f89-e6f3d551162e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:17.121946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:53:17.122430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:53:17.122851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:53:17.123294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:53:17.123707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:53:17.165713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:17.173283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:17.173283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:17.173453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:17.173915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:17.174356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:17.195795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1a3d39c9-f6db-4d08-9f89-e6f3d551162e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:17.208384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Getting quotas for project 1ecf4e442f194011afb46d6505e11930. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:53:17.213827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1a3d39c9-f6db-4d08-9f89-e6f3d551162e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:17.214556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Getting quotas for user a34039fa16994da2beb3e9df28813a37 and project 1ecf4e442f194011afb46d6505e11930. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:53:17.217596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1a3d39c9-f6db-4d08-9f89-e6f3d551162e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:17.221634 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1a3d39c9-f6db-4d08-9f89-e6f3d551162e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1738 microversion: 2.20 time: 0.893832 Aug 09 14:53:17.235286 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2188/4378] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:16 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1738 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:17.249164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:53:17.251540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:53:17.384044 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d292279c-d8a9-4f88-9482-1aec028a4bae tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.323241 Aug 09 14:53:17.392554 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2191/4379] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:53:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2333 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 14:53:17.402452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3cc419f5-b198-4252-b9de-740ff250f569 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:17.404748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3cc419f5-b198-4252-b9de-740ff250f569 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:17.430334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cc419f5-b198-4252-b9de-740ff250f569 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:17.434180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cc419f5-b198-4252-b9de-740ff250f569 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:17.435252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cc419f5-b198-4252-b9de-740ff250f569 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:17.437933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cc419f5-b198-4252-b9de-740ff250f569 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:17.440826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cc419f5-b198-4252-b9de-740ff250f569 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:17.442022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3cc419f5-b198-4252-b9de-740ff250f569 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:17.471651 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-3cc419f5-b198-4252-b9de-740ff250f569 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] HTTP exception thrown: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3cc419f5-b198-4252-b9de-740ff250f569 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Request method failure captured: Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af HTTP/1.1 Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nS-nsmHLYbY3Rgaq8u52nZvIKm5kp8AHJvqlLYAHZYNroHiOHYKXddciCBDN1pEKvzs0f8kOJ3PJFh1mfB85CB8y1Q-2wANDaJfY1kZYQpYBwYmZqEW-2CpjdQCbsZ_Hrf3dHEm1ZbW7X0TIzMvub7L0NabRiKYFDA1Q9dC83N4lBw Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_afac4ac2ba124b0980d076fa8a5cb702", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: c88836e9e3804dc4bc36a325f0f6c230 Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '32d97dfd-159a-417d-a283-4e9e605535af'} Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:17.479459 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.486751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:17.486751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:17.486751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:17.486751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:53:17.486751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:53:17.486751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.486751 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.486751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3cc419f5-b198-4252-b9de-740ff250f569 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Returning 404 to user: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:53:17.486751 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3cc419f5-b198-4252-b9de-740ff250f569 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 404 len: 111 microversion: 2.1 time: 0.087484 Aug 09 14:53:17.486751 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2192/4380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:17 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:53:17.490525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-050f230d-5118-46f3-83aa-b6ff7957aab7 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:17.491360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-050f230d-5118-46f3-83aa-b6ff7957aab7 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:17.576611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-050f230d-5118-46f3-83aa-b6ff7957aab7 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:17.596989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-050f230d-5118-46f3-83aa-b6ff7957aab7 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:17.604016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-050f230d-5118-46f3-83aa-b6ff7957aab7 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:17.606096 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-050f230d-5118-46f3-83aa-b6ff7957aab7 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1259 microversion: 2.21 time: 0.122174 Aug 09 14:53:17.625119 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2193/4381] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:17 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1259 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:17.640721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73628b0c-aef4-4813-bb65-a2efbe35e154 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:17.642543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0522322-40b7-416c-b285-2eb224efcf68 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Action: 'create', calling method: .version_select at 0x7f41e7510040>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-189901098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOE8R+xWrO8qQbNtJPsskj6IPS7Svlz8PcDJX61A2YWzLhhgiVhVD/rcHoY6zYh9algrVn+UBjFe24mYSBgP6YwdznT8opWVmOoJHsmDe7Nd9hLmrhLWzx2m56joJs+ZMQ=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:17.676689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e0522322-40b7-416c-b285-2eb224efcf68 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Getting quotas for project 7483d79edacf4600aff88566a44c44d9. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:53:17.690599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e0522322-40b7-416c-b285-2eb224efcf68 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Getting quotas for user 1eadaad5eff54da5ba83805c15c28ba1 and project 7483d79edacf4600aff88566a44c44d9. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:53:17.702792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.compute.server_groups [None req-73628b0c-aef4-4813-bb65-a2efbe35e154 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Querying cell ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) for 1 instances {{(pid=119406) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 09 14:53:17.703672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73628b0c-aef4-4813-bb65-a2efbe35e154 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:17.704137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73628b0c-aef4-4813-bb65-a2efbe35e154 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:17.704573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73628b0c-aef4-4813-bb65-a2efbe35e154 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:17.735467 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-73628b0c-aef4-4813-bb65-a2efbe35e154 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.108799 Aug 09 14:53:17.736274 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2194/4382] 10.222.0.50 () {58 vars in 1152 bytes} [Tue Aug 9 14:53:17 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:17.754308 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0522322-40b7-416c-b285-2eb224efcf68 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.521713 Aug 09 14:53:17.759841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e27064b2-246f-4aed-b711-5704e7e1e617 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:17.760061 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2189/4383] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:53:17 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:17.782290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.compute.server_groups [None req-e27064b2-246f-4aed-b711-5704e7e1e617 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Querying cell ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) for 1 instances {{(pid=119406) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 09 14:53:17.783451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e27064b2-246f-4aed-b711-5704e7e1e617 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:17.784329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e27064b2-246f-4aed-b711-5704e7e1e617 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:17.784988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e27064b2-246f-4aed-b711-5704e7e1e617 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:17.801657 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e27064b2-246f-4aed-b711-5704e7e1e617 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/os-server-groups/95056e80-e8ca-4aec-adf3-ccb879f262ef" status: 200 len: 184 microversion: 2.1 time: 0.056413 Aug 09 14:53:17.802534 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2195/4384] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 14:53:17 2022] GET /compute/v2.1/os-server-groups/95056e80-e8ca-4aec-adf3-ccb879f262ef => generated 184 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:17.816005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b02c4699-a32e-4961-b5c5-a2bd359c36d7 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:17.816604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b02c4699-a32e-4961-b5c5-a2bd359c36d7 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:17.833821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b02c4699-a32e-4961-b5c5-a2bd359c36d7 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:17.834317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b02c4699-a32e-4961-b5c5-a2bd359c36d7 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:17.834759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b02c4699-a32e-4961-b5c5-a2bd359c36d7 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:17.835502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b02c4699-a32e-4961-b5c5-a2bd359c36d7 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:17.836045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b02c4699-a32e-4961-b5c5-a2bd359c36d7 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:17.836366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b02c4699-a32e-4961-b5c5-a2bd359c36d7 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:17.848626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:17.863006 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-b02c4699-a32e-4961-b5c5-a2bd359c36d7 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] HTTP exception thrown: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b02c4699-a32e-4961-b5c5-a2bd359c36d7 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Request method failure captured: Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af HTTP/1.1 Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nS-nsmHLYbY3Rgaq8u52nZvIKm5kp8AHJvqlLYAHZYNroHiOHYKXddciCBDN1pEKvzs0f8kOJ3PJFh1mfB85CB8y1Q-2wANDaJfY1kZYQpYBwYmZqEW-2CpjdQCbsZ_Hrf3dHEm1ZbW7X0TIzMvub7L0NabRiKYFDA1Q9dC83N4lBw Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_afac4ac2ba124b0980d076fa8a5cb702", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: c88836e9e3804dc4bc36a325f0f6c230 Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '32d97dfd-159a-417d-a283-4e9e605535af'} Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:53:17.865179 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.869693 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.869693 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:17.869693 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.869693 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:17.869693 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:17.869693 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:17.869693 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:53:17.869693 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:53:17.869693 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.869693 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.871202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b02c4699-a32e-4961-b5c5-a2bd359c36d7 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Returning 404 to user: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:53:17.872623 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b02c4699-a32e-4961-b5c5-a2bd359c36d7 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "DELETE /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 404 len: 111 microversion: 2.1 time: 0.062547 Aug 09 14:53:17.873831 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2190/4385] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:53:17 2022] DELETE /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:53:17.881577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13513b45-23e2-4294-b7a7-795758029d15 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:17.882464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-13513b45-23e2-4294-b7a7-795758029d15 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] [instance: 32d97dfd-159a-417d-a283-4e9e605535af] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:17.898868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13513b45-23e2-4294-b7a7-795758029d15 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:17.900050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13513b45-23e2-4294-b7a7-795758029d15 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:17.900679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13513b45-23e2-4294-b7a7-795758029d15 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:17.901774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13513b45-23e2-4294-b7a7-795758029d15 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:17.902419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13513b45-23e2-4294-b7a7-795758029d15 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:17.903020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13513b45-23e2-4294-b7a7-795758029d15 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:17.919523 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-13513b45-23e2-4294-b7a7-795758029d15 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] HTTP exception thrown: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13513b45-23e2-4294-b7a7-795758029d15 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Request method failure captured: Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af HTTP/1.1 Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nS-nsmHLYbY3Rgaq8u52nZvIKm5kp8AHJvqlLYAHZYNroHiOHYKXddciCBDN1pEKvzs0f8kOJ3PJFh1mfB85CB8y1Q-2wANDaJfY1kZYQpYBwYmZqEW-2CpjdQCbsZ_Hrf3dHEm1ZbW7X0TIzMvub7L0NabRiKYFDA1Q9dC83N4lBw Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_afac4ac2ba124b0980d076fa8a5cb702", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: c88836e9e3804dc4bc36a325f0f6c230 Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '32d97dfd-159a-417d-a283-4e9e605535af'} Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:17.921455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.926880 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:17.926880 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:17.926880 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:17.926880 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:53:17.926880 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:53:17.926880 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. Aug 09 14:53:17.926880 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.928767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13513b45-23e2-4294-b7a7-795758029d15 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Returning 404 to user: Instance 32d97dfd-159a-417d-a283-4e9e605535af could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:53:17.929893 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-13513b45-23e2-4294-b7a7-795758029d15 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af" status: 404 len: 111 microversion: 2.1 time: 0.052341 Aug 09 14:53:17.930983 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2196/4386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:17 2022] GET /compute/v2.1/servers/32d97dfd-159a-417d-a283-4e9e605535af => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:53:17.940973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64e2ca22-fba9-4d91-908f-826fb8c116dc tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:17.979428 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-64e2ca22-fba9-4d91-908f-826fb8c116dc tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] HTTP exception thrown: Instance group 3fa8d648-ba99-4c44-a5b1-2c773fc6ccb8 could not be found. Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64e2ca22-fba9-4d91-908f-826fb8c116dc tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Request method failure captured: Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/os-server-groups/3fa8d648-ba99-4c44-a5b1-2c773fc6ccb8 HTTP/1.1 Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nS-nsmHLYbY3Rgaq8u52nZvIKm5kp8AHJvqlLYAHZYNroHiOHYKXddciCBDN1pEKvzs0f8kOJ3PJFh1mfB85CB8y1Q-2wANDaJfY1kZYQpYBwYmZqEW-2CpjdQCbsZ_Hrf3dHEm1ZbW7X0TIzMvub7L0NabRiKYFDA1Q9dC83N4lBw Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_afac4ac2ba124b0980d076fa8a5cb702", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: c88836e9e3804dc4bc36a325f0f6c230 Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance group 3fa8d648-ba99-4c44-a5b1-2c773fc6ccb8 could not be found. Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3fa8d648-ba99-4c44-a5b1-2c773fc6ccb8'} Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3fa8d648-ba99-4c44-a5b1-2c773fc6ccb8 could not be found. Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3fa8d648-ba99-4c44-a5b1-2c773fc6ccb8 could not be found. Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.986896 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:17.991244 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:17.991244 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:17.991244 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:53:17.991244 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:53:17.991244 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3fa8d648-ba99-4c44-a5b1-2c773fc6ccb8 could not be found. Aug 09 14:53:17.991244 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:17.991244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64e2ca22-fba9-4d91-908f-826fb8c116dc tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Returning 404 to user: Instance group 3fa8d648-ba99-4c44-a5b1-2c773fc6ccb8 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:53:17.993237 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-64e2ca22-fba9-4d91-908f-826fb8c116dc tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/3fa8d648-ba99-4c44-a5b1-2c773fc6ccb8" status: 404 len: 117 microversion: 2.1 time: 0.056848 Aug 09 14:53:17.995912 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2191/4387] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 14:53:17 2022] DELETE /compute/v2.1/os-server-groups/3fa8d648-ba99-4c44-a5b1-2c773fc6ccb8 => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:53:18.001884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c42e1fa9-65ed-4999-9c85-0fc9b3dfbed9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:18.018338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e6262a1-fffb-4746-bdc3-6428aa08e79d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1492b9fb-e3f3-412c-8b5c-a3b394aaf1c7"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:18.019812 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-c42e1fa9-65ed-4999-9c85-0fc9b3dfbed9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] HTTP exception thrown: Instance group a98b86e2-9054-4ed6-ae08-ebb044c1cf7a could not be found. Aug 09 14:53:18.022103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e6262a1-fffb-4746-bdc3-6428aa08e79d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c42e1fa9-65ed-4999-9c85-0fc9b3dfbed9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Request method failure captured: Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-server-groups/a98b86e2-9054-4ed6-ae08-ebb044c1cf7a HTTP/1.1 Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nS-nsmHLYbY3Rgaq8u52nZvIKm5kp8AHJvqlLYAHZYNroHiOHYKXddciCBDN1pEKvzs0f8kOJ3PJFh1mfB85CB8y1Q-2wANDaJfY1kZYQpYBwYmZqEW-2CpjdQCbsZ_Hrf3dHEm1ZbW7X0TIzMvub7L0NabRiKYFDA1Q9dC83N4lBw Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_afac4ac2ba124b0980d076fa8a5cb702", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: c88836e9e3804dc4bc36a325f0f6c230 Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance group a98b86e2-9054-4ed6-ae08-ebb044c1cf7a could not be found. Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'a98b86e2-9054-4ed6-ae08-ebb044c1cf7a'} Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a98b86e2-9054-4ed6-ae08-ebb044c1cf7a could not be found. Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a98b86e2-9054-4ed6-ae08-ebb044c1cf7a could not be found. Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.032241 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:18.036958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:18.036958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:18.036958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:53:18.036958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:53:18.036958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a98b86e2-9054-4ed6-ae08-ebb044c1cf7a could not be found. Aug 09 14:53:18.036958 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.041030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c42e1fa9-65ed-4999-9c85-0fc9b3dfbed9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Returning 404 to user: Instance group a98b86e2-9054-4ed6-ae08-ebb044c1cf7a could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:53:18.042212 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c42e1fa9-65ed-4999-9c85-0fc9b3dfbed9 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/a98b86e2-9054-4ed6-ae08-ebb044c1cf7a" status: 404 len: 117 microversion: 2.1 time: 0.044631 Aug 09 14:53:18.044870 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2197/4388] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 14:53:17 2022] DELETE /compute/v2.1/os-server-groups/a98b86e2-9054-4ed6-ae08-ebb044c1cf7a => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:53:18.057071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e6262a1-fffb-4746-bdc3-6428aa08e79d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:18.059284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e6262a1-fffb-4746-bdc3-6428aa08e79d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:18.059782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e6262a1-fffb-4746-bdc3-6428aa08e79d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:18.060529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e6262a1-fffb-4746-bdc3-6428aa08e79d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:18.060988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e6262a1-fffb-4746-bdc3-6428aa08e79d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:18.061411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e6262a1-fffb-4746-bdc3-6428aa08e79d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:18.080229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8c8665f-e77d-4abe-be86-6c3ef260c38f tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:18.088871 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b8c8665f-e77d-4abe-be86-6c3ef260c38f tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] HTTP exception thrown: Instance group a0322fb4-4025-4e61-b2ea-0808f20ac671 could not be found. Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8c8665f-e77d-4abe-be86-6c3ef260c38f tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Request method failure captured: Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-server-groups/a0322fb4-4025-4e61-b2ea-0808f20ac671 HTTP/1.1 Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nS-nsmHLYbY3Rgaq8u52nZvIKm5kp8AHJvqlLYAHZYNroHiOHYKXddciCBDN1pEKvzs0f8kOJ3PJFh1mfB85CB8y1Q-2wANDaJfY1kZYQpYBwYmZqEW-2CpjdQCbsZ_Hrf3dHEm1ZbW7X0TIzMvub7L0NabRiKYFDA1Q9dC83N4lBw Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_afac4ac2ba124b0980d076fa8a5cb702", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: c88836e9e3804dc4bc36a325f0f6c230 Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance group a0322fb4-4025-4e61-b2ea-0808f20ac671 could not be found. Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'a0322fb4-4025-4e61-b2ea-0808f20ac671'} Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a0322fb4-4025-4e61-b2ea-0808f20ac671 could not be found. Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a0322fb4-4025-4e61-b2ea-0808f20ac671 could not be found. Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.091018 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:18.097243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:18.097243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:18.097243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:53:18.097243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:53:18.097243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a0322fb4-4025-4e61-b2ea-0808f20ac671 could not be found. Aug 09 14:53:18.097243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.109331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8c8665f-e77d-4abe-be86-6c3ef260c38f tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Returning 404 to user: Instance group a0322fb4-4025-4e61-b2ea-0808f20ac671 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:53:18.110241 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8c8665f-e77d-4abe-be86-6c3ef260c38f tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/a0322fb4-4025-4e61-b2ea-0808f20ac671" status: 404 len: 117 microversion: 2.1 time: 0.056250 Aug 09 14:53:18.120415 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2198/4389] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 14:53:18 2022] DELETE /compute/v2.1/os-server-groups/a0322fb4-4025-4e61-b2ea-0808f20ac671 => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:53:18.126738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b5774868-af0c-42a4-9c96-dce0f8efc199 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:18.133253 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b5774868-af0c-42a4-9c96-dce0f8efc199 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] HTTP exception thrown: Instance group 69ed739a-e1af-4cd1-811a-5cb10c1f4eb7 could not be found. Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b5774868-af0c-42a4-9c96-dce0f8efc199 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Request method failure captured: Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-server-groups/69ed739a-e1af-4cd1-811a-5cb10c1f4eb7 HTTP/1.1 Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nS-nsmHLYbY3Rgaq8u52nZvIKm5kp8AHJvqlLYAHZYNroHiOHYKXddciCBDN1pEKvzs0f8kOJ3PJFh1mfB85CB8y1Q-2wANDaJfY1kZYQpYBwYmZqEW-2CpjdQCbsZ_Hrf3dHEm1ZbW7X0TIzMvub7L0NabRiKYFDA1Q9dC83N4lBw Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_afac4ac2ba124b0980d076fa8a5cb702", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/afac4ac2ba124b0980d076fa8a5cb702"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: afac4ac2ba124b0980d076fa8a5cb702 Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerGroupTestJSON-1287626 Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: c88836e9e3804dc4bc36a325f0f6c230 Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerGroupTestJSON-1287626-project Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance group 69ed739a-e1af-4cd1-811a-5cb10c1f4eb7 could not be found. Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '69ed739a-e1af-4cd1-811a-5cb10c1f4eb7'} Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 69ed739a-e1af-4cd1-811a-5cb10c1f4eb7 could not be found. Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 69ed739a-e1af-4cd1-811a-5cb10c1f4eb7 could not be found. Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.134824 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:18.140503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:18.140503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:18.140503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:53:18.140503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:53:18.140503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 69ed739a-e1af-4cd1-811a-5cb10c1f4eb7 could not be found. Aug 09 14:53:18.140503 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:18.140503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b5774868-af0c-42a4-9c96-dce0f8efc199 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Returning 404 to user: Instance group 69ed739a-e1af-4cd1-811a-5cb10c1f4eb7 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:53:18.140503 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b5774868-af0c-42a4-9c96-dce0f8efc199 tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/69ed739a-e1af-4cd1-811a-5cb10c1f4eb7" status: 404 len: 117 microversion: 2.1 time: 0.014764 Aug 09 14:53:18.140503 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2199/4390] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 14:53:18 2022] DELETE /compute/v2.1/os-server-groups/69ed739a-e1af-4cd1-811a-5cb10c1f4eb7 => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:53:18.168315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2965604-b362-49df-8771-14c8bb1de21f tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:18.257902 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2965604-b362-49df-8771-14c8bb1de21f tempest-ServerGroupTestJSON-1287626 tempest-ServerGroupTestJSON-1287626-project] 10.222.0.50 "DELETE /compute/v2.1/os-server-groups/95056e80-e8ca-4aec-adf3-ccb879f262ef" status: 204 len: 0 microversion: 2.1 time: 0.110610 Aug 09 14:53:18.258888 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2200/4391] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 14:53:18 2022] DELETE /compute/v2.1/os-server-groups/95056e80-e8ca-4aec-adf3-ccb879f262ef => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:53:18.264307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-766459c1-bcf6-4b3d-9f68-1c849869db19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:18.265423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-766459c1-bcf6-4b3d-9f68-1c849869db19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:18.303687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-766459c1-bcf6-4b3d-9f68-1c849869db19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:18.304917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-766459c1-bcf6-4b3d-9f68-1c849869db19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:18.307784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-766459c1-bcf6-4b3d-9f68-1c849869db19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:18.308873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-766459c1-bcf6-4b3d-9f68-1c849869db19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:18.310142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-766459c1-bcf6-4b3d-9f68-1c849869db19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:18.312151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-766459c1-bcf6-4b3d-9f68-1c849869db19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:18.772444 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e6262a1-fffb-4746-bdc3-6428aa08e79d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.764286 Aug 09 14:53:18.773067 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2192/4392] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 14:53:18 2022] POST /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 194 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:18.796935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3672fdb4-f6f1-4431-91bd-54de5c783cf3 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:18.797946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3672fdb4-f6f1-4431-91bd-54de5c783cf3 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:18.822860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3672fdb4-f6f1-4431-91bd-54de5c783cf3 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:18.824662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3672fdb4-f6f1-4431-91bd-54de5c783cf3 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:18.825255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3672fdb4-f6f1-4431-91bd-54de5c783cf3 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:18.826158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3672fdb4-f6f1-4431-91bd-54de5c783cf3 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:18.826821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3672fdb4-f6f1-4431-91bd-54de5c783cf3 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:18.827559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3672fdb4-f6f1-4431-91bd-54de5c783cf3 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:19.063072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3672fdb4-f6f1-4431-91bd-54de5c783cf3 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:19.077098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3672fdb4-f6f1-4431-91bd-54de5c783cf3 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:19.085649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3672fdb4-f6f1-4431-91bd-54de5c783cf3 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:19.087047 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3672fdb4-f6f1-4431-91bd-54de5c783cf3 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1255 microversion: 2.21 time: 0.310431 Aug 09 14:53:19.087636 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2193/4393] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:18 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1255 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:19.103139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-766459c1-bcf6-4b3d-9f68-1c849869db19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:19.112372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-766459c1-bcf6-4b3d-9f68-1c849869db19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:19.114161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-766459c1-bcf6-4b3d-9f68-1c849869db19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:19.115657 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-766459c1-bcf6-4b3d-9f68-1c849869db19 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1720 microversion: 2.20 time: 0.855667 Aug 09 14:53:19.117498 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2201/4394] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:18 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1720 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:20.116314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2085bfa-d884-4628-8a02-78c82fb38689 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:20.117670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c2085bfa-d884-4628-8a02-78c82fb38689 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:20.141695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-615b8236-16e0-4bad-9dc8-572e3cf8679d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:20.142327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-615b8236-16e0-4bad-9dc8-572e3cf8679d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:20.151066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2085bfa-d884-4628-8a02-78c82fb38689 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:20.151791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2085bfa-d884-4628-8a02-78c82fb38689 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:20.155888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2085bfa-d884-4628-8a02-78c82fb38689 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:20.156981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2085bfa-d884-4628-8a02-78c82fb38689 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:20.164066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2085bfa-d884-4628-8a02-78c82fb38689 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:20.165501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-615b8236-16e0-4bad-9dc8-572e3cf8679d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:20.166227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2085bfa-d884-4628-8a02-78c82fb38689 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:20.171970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-615b8236-16e0-4bad-9dc8-572e3cf8679d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:20.172865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-615b8236-16e0-4bad-9dc8-572e3cf8679d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:20.173880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-615b8236-16e0-4bad-9dc8-572e3cf8679d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:20.174570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-615b8236-16e0-4bad-9dc8-572e3cf8679d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:20.175268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-615b8236-16e0-4bad-9dc8-572e3cf8679d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:20.642141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2085bfa-d884-4628-8a02-78c82fb38689 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:20.655059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2085bfa-d884-4628-8a02-78c82fb38689 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:20.657220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2085bfa-d884-4628-8a02-78c82fb38689 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:20.658605 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2085bfa-d884-4628-8a02-78c82fb38689 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1317 microversion: 2.21 time: 0.547506 Aug 09 14:53:20.659787 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2194/4395] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:20 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:21.069448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-615b8236-16e0-4bad-9dc8-572e3cf8679d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:21.087978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-615b8236-16e0-4bad-9dc8-572e3cf8679d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:21.094225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-615b8236-16e0-4bad-9dc8-572e3cf8679d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:21.097473 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-615b8236-16e0-4bad-9dc8-572e3cf8679d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1720 microversion: 2.20 time: 0.959886 Aug 09 14:53:21.099642 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2202/4396] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:20 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1720 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:21.705867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fd3a28e2-290a-446e-9018-4b728ce808cc tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:21.713148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fd3a28e2-290a-446e-9018-4b728ce808cc tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:21.743225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd3a28e2-290a-446e-9018-4b728ce808cc tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:21.747063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd3a28e2-290a-446e-9018-4b728ce808cc tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:21.749617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd3a28e2-290a-446e-9018-4b728ce808cc tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:21.750574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd3a28e2-290a-446e-9018-4b728ce808cc tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:21.753513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd3a28e2-290a-446e-9018-4b728ce808cc tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:21.755836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd3a28e2-290a-446e-9018-4b728ce808cc tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:21.901645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-9687b1dd-fdcb-40ce-b0dd-b9e8a6b80249 req-3465ff53-0f9e-4ba7-91b1-633257014fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcda666-d36a-488f-8fb0-fe12470ff45f", "name": "network-vif-unplugged", "status": "completed", "tag": "9c42ace2-95a4-43eb-abf9-6c87e774f843"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:21.934051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9687b1dd-fdcb-40ce-b0dd-b9e8a6b80249 req-3465ff53-0f9e-4ba7-91b1-633257014fc6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:21.934831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9687b1dd-fdcb-40ce-b0dd-b9e8a6b80249 req-3465ff53-0f9e-4ba7-91b1-633257014fc6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:21.936185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9687b1dd-fdcb-40ce-b0dd-b9e8a6b80249 req-3465ff53-0f9e-4ba7-91b1-633257014fc6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:21.961030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fd3a28e2-290a-446e-9018-4b728ce808cc tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:21.971254 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9687b1dd-fdcb-40ce-b0dd-b9e8a6b80249 req-3465ff53-0f9e-4ba7-91b1-633257014fc6 service nova] Creating event network-vif-unplugged:9c42ace2-95a4-43eb-abf9-6c87e774f843 for instance 9bcda666-d36a-488f-8fb0-fe12470ff45f on n-h1-844626-8 Aug 09 14:53:21.979525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fd3a28e2-290a-446e-9018-4b728ce808cc tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:21.983071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fd3a28e2-290a-446e-9018-4b728ce808cc tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:21.986257 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-9687b1dd-fdcb-40ce-b0dd-b9e8a6b80249 req-3465ff53-0f9e-4ba7-91b1-633257014fc6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091798 Aug 09 14:53:21.987027 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fd3a28e2-290a-446e-9018-4b728ce808cc tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1317 microversion: 2.21 time: 0.297481 Aug 09 14:53:21.988147 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2203/4397] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:22.004588 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2195/4398] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:21 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:22.125102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d8a870cf-6ad0-401b-b1f5-0bad9eb8a203 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:22.127775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d8a870cf-6ad0-401b-b1f5-0bad9eb8a203 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:22.177518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8a870cf-6ad0-401b-b1f5-0bad9eb8a203 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:22.178514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8a870cf-6ad0-401b-b1f5-0bad9eb8a203 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:22.186063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8a870cf-6ad0-401b-b1f5-0bad9eb8a203 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:22.193649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8a870cf-6ad0-401b-b1f5-0bad9eb8a203 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:22.195183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8a870cf-6ad0-401b-b1f5-0bad9eb8a203 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:22.197212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8a870cf-6ad0-401b-b1f5-0bad9eb8a203 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:23.039116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-189dd30c-3fe3-4b8c-a7d9-64c9fa9b0b53 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:23.039873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-189dd30c-3fe3-4b8c-a7d9-64c9fa9b0b53 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:23.060069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-189dd30c-3fe3-4b8c-a7d9-64c9fa9b0b53 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:23.060583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-189dd30c-3fe3-4b8c-a7d9-64c9fa9b0b53 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:23.064561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-189dd30c-3fe3-4b8c-a7d9-64c9fa9b0b53 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:23.065955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-189dd30c-3fe3-4b8c-a7d9-64c9fa9b0b53 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:23.066652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-189dd30c-3fe3-4b8c-a7d9-64c9fa9b0b53 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:23.067332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-189dd30c-3fe3-4b8c-a7d9-64c9fa9b0b53 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:23.846756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-189dd30c-3fe3-4b8c-a7d9-64c9fa9b0b53 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:23.858279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d8a870cf-6ad0-401b-b1f5-0bad9eb8a203 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:23.866217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-189dd30c-3fe3-4b8c-a7d9-64c9fa9b0b53 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:23.868926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-189dd30c-3fe3-4b8c-a7d9-64c9fa9b0b53 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:23.871713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d8a870cf-6ad0-401b-b1f5-0bad9eb8a203 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:23.874381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d8a870cf-6ad0-401b-b1f5-0bad9eb8a203 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:23.878587 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-189dd30c-3fe3-4b8c-a7d9-64c9fa9b0b53 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1317 microversion: 2.21 time: 0.864896 Aug 09 14:53:23.879241 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2196/4399] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:23 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1317 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:23.892902 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d8a870cf-6ad0-401b-b1f5-0bad9eb8a203 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1663 microversion: 2.20 time: 1.772434 Aug 09 14:53:23.896037 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2204/4400] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:22 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1663 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:23.923047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c5b0504-e884-4d3f-8a94-48a4fc2e3b46 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bbf6a12-c3c9-44ca-9620-672217175d0b"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:23.925777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2c5b0504-e884-4d3f-8a94-48a4fc2e3b46 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:23.948444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5b0504-e884-4d3f-8a94-48a4fc2e3b46 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:23.949070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5b0504-e884-4d3f-8a94-48a4fc2e3b46 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:23.953876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5b0504-e884-4d3f-8a94-48a4fc2e3b46 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:23.954765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5b0504-e884-4d3f-8a94-48a4fc2e3b46 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:23.959568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5b0504-e884-4d3f-8a94-48a4fc2e3b46 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:23.961842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5b0504-e884-4d3f-8a94-48a4fc2e3b46 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:24.542916 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2c5b0504-e884-4d3f-8a94-48a4fc2e3b46 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "POST /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.624030 Aug 09 14:53:24.546215 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2197/4401] 10.222.0.50 () {62 vars in 1364 bytes} [Tue Aug 9 14:53:23 2022] POST /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/os-volume_attachments => generated 188 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:53:24.828439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31b30025-dfb7-4792-bd30-f94d79152b8c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:24.828945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31b30025-dfb7-4792-bd30-f94d79152b8c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:24.845651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:24.848891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b30025-dfb7-4792-bd30-f94d79152b8c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:24.849647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b30025-dfb7-4792-bd30-f94d79152b8c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:24.850170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b30025-dfb7-4792-bd30-f94d79152b8c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:24.850863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b30025-dfb7-4792-bd30-f94d79152b8c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:24.851361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b30025-dfb7-4792-bd30-f94d79152b8c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:24.852024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31b30025-dfb7-4792-bd30-f94d79152b8c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:24.905838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5cb89ba1-fb09-4133-8009-9a75224e1a13 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:24.906533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5cb89ba1-fb09-4133-8009-9a75224e1a13 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:24.926975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb89ba1-fb09-4133-8009-9a75224e1a13 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:24.927477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb89ba1-fb09-4133-8009-9a75224e1a13 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:24.928098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb89ba1-fb09-4133-8009-9a75224e1a13 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:24.929083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb89ba1-fb09-4133-8009-9a75224e1a13 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:24.930141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb89ba1-fb09-4133-8009-9a75224e1a13 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:24.930756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5cb89ba1-fb09-4133-8009-9a75224e1a13 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:25.352544 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31b30025-dfb7-4792-bd30-f94d79152b8c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/os-volume_attachments/5bbf6a12-c3c9-44ca-9620-672217175d0b" status: 202 len: 0 microversion: 2.20 time: 0.530069 Aug 09 14:53:25.353166 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2205/4402] 10.222.0.50 () {60 vars in 1457 bytes} [Tue Aug 9 14:53:24 2022] DELETE /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/os-volume_attachments/5bbf6a12-c3c9-44ca-9620-672217175d0b => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:53:25.452128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52a583f4-a216-4ca9-b517-ccbd79e54046 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:25.453003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52a583f4-a216-4ca9-b517-ccbd79e54046 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:25.460362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52a583f4-a216-4ca9-b517-ccbd79e54046 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:25.461207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52a583f4-a216-4ca9-b517-ccbd79e54046 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:25.463571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52a583f4-a216-4ca9-b517-ccbd79e54046 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:25.465362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52a583f4-a216-4ca9-b517-ccbd79e54046 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:25.466021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52a583f4-a216-4ca9-b517-ccbd79e54046 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:25.466929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52a583f4-a216-4ca9-b517-ccbd79e54046 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:25.501918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52a583f4-a216-4ca9-b517-ccbd79e54046 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119406) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 09 14:53:25.596834 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52a583f4-a216-4ca9-b517-ccbd79e54046 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "POST /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/action" status: 202 len: 0 microversion: 2.20 time: 0.148979 Aug 09 14:53:25.598550 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2206/4403] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:53:25 2022] POST /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:53:25.612967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-76947da8-0216-4e72-ae40-2e25a5470eac tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:25.614195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-76947da8-0216-4e72-ae40-2e25a5470eac tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:25.623972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76947da8-0216-4e72-ae40-2e25a5470eac tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:25.625242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76947da8-0216-4e72-ae40-2e25a5470eac tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:25.626345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76947da8-0216-4e72-ae40-2e25a5470eac tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:25.627471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76947da8-0216-4e72-ae40-2e25a5470eac tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:25.628189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76947da8-0216-4e72-ae40-2e25a5470eac tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:25.629760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76947da8-0216-4e72-ae40-2e25a5470eac tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:26.558795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5cb89ba1-fb09-4133-8009-9a75224e1a13 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:26.572786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5cb89ba1-fb09-4133-8009-9a75224e1a13 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:26.574875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5cb89ba1-fb09-4133-8009-9a75224e1a13 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:26.576545 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5cb89ba1-fb09-4133-8009-9a75224e1a13 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1359 microversion: 2.21 time: 1.676037 Aug 09 14:53:26.578035 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2198/4404] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:24 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1359 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:26.776826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-76947da8-0216-4e72-ae40-2e25a5470eac tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:26.795238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-76947da8-0216-4e72-ae40-2e25a5470eac tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:26.797940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-76947da8-0216-4e72-ae40-2e25a5470eac tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:26.799941 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-76947da8-0216-4e72-ae40-2e25a5470eac tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1671 microversion: 2.20 time: 1.196951 Aug 09 14:53:26.801738 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2207/4405] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:25 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1671 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:27.614652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c918b7ec-572b-4a33-aac0-23ebeb3b96e8 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:27.616847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c918b7ec-572b-4a33-aac0-23ebeb3b96e8 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:27.655381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c918b7ec-572b-4a33-aac0-23ebeb3b96e8 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:27.658345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c918b7ec-572b-4a33-aac0-23ebeb3b96e8 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:27.658969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c918b7ec-572b-4a33-aac0-23ebeb3b96e8 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:27.659874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c918b7ec-572b-4a33-aac0-23ebeb3b96e8 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:27.661125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c918b7ec-572b-4a33-aac0-23ebeb3b96e8 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:27.662979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c918b7ec-572b-4a33-aac0-23ebeb3b96e8 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:27.725853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:27.824761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a77d04a-0717-43b9-acec-61d02730504c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:27.825531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a77d04a-0717-43b9-acec-61d02730504c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:27.831523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:27.836915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:27.844372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a77d04a-0717-43b9-acec-61d02730504c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:27.845225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a77d04a-0717-43b9-acec-61d02730504c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:27.846591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a77d04a-0717-43b9-acec-61d02730504c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:27.847604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a77d04a-0717-43b9-acec-61d02730504c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:27.848665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a77d04a-0717-43b9-acec-61d02730504c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:27.849693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a77d04a-0717-43b9-acec-61d02730504c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:28.482244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c918b7ec-572b-4a33-aac0-23ebeb3b96e8 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:28.493696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c918b7ec-572b-4a33-aac0-23ebeb3b96e8 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:28.495764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c918b7ec-572b-4a33-aac0-23ebeb3b96e8 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:28.497465 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c918b7ec-572b-4a33-aac0-23ebeb3b96e8 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1359 microversion: 2.21 time: 0.899714 Aug 09 14:53:28.498095 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2199/4406] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:27 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1359 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:28.505137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ea302b6f-d012-488e-9aa0-4fa75acb8d74 req-c2b1ea00-7e30-48eb-96e3-2c209b0e568d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa761ac-9ba1-483c-bb1e-8d8dc04b1596", "tag": "0643f4b1-c763-45fb-9e4c-bf8cdcdc127b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:28.518638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ea302b6f-d012-488e-9aa0-4fa75acb8d74 req-c2b1ea00-7e30-48eb-96e3-2c209b0e568d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:28.519597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ea302b6f-d012-488e-9aa0-4fa75acb8d74 req-c2b1ea00-7e30-48eb-96e3-2c209b0e568d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:28.520467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ea302b6f-d012-488e-9aa0-4fa75acb8d74 req-c2b1ea00-7e30-48eb-96e3-2c209b0e568d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:28.537363 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ea302b6f-d012-488e-9aa0-4fa75acb8d74 req-c2b1ea00-7e30-48eb-96e3-2c209b0e568d service nova] Creating event network-changed:0643f4b1-c763-45fb-9e4c-bf8cdcdc127b for instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 on n-h2-844626-8 Aug 09 14:53:28.556934 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ea302b6f-d012-488e-9aa0-4fa75acb8d74 req-c2b1ea00-7e30-48eb-96e3-2c209b0e568d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056141 Aug 09 14:53:28.559887 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2200/4407] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:28.580231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a77d04a-0717-43b9-acec-61d02730504c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:28.586835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:28.603005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a77d04a-0717-43b9-acec-61d02730504c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:28.606258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a77d04a-0717-43b9-acec-61d02730504c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:28.617331 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a77d04a-0717-43b9-acec-61d02730504c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.796257 Aug 09 14:53:28.618720 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2208/4408] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:27 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:29.530457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4827f2d-7f5a-4684-acd6-4b851da5743b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:29.537684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e4827f2d-7f5a-4684-acd6-4b851da5743b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:29.565640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4827f2d-7f5a-4684-acd6-4b851da5743b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:29.566172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4827f2d-7f5a-4684-acd6-4b851da5743b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:29.567831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4827f2d-7f5a-4684-acd6-4b851da5743b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:29.568600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4827f2d-7f5a-4684-acd6-4b851da5743b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:29.569066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4827f2d-7f5a-4684-acd6-4b851da5743b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:29.569496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4827f2d-7f5a-4684-acd6-4b851da5743b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:29.651144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8dbf78d0-97bb-4e77-931b-a478d0882bdf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:29.651743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8dbf78d0-97bb-4e77-931b-a478d0882bdf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:29.679237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dbf78d0-97bb-4e77-931b-a478d0882bdf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:29.683120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dbf78d0-97bb-4e77-931b-a478d0882bdf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:29.684863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dbf78d0-97bb-4e77-931b-a478d0882bdf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:29.691861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dbf78d0-97bb-4e77-931b-a478d0882bdf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:29.692345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dbf78d0-97bb-4e77-931b-a478d0882bdf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:29.699308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8dbf78d0-97bb-4e77-931b-a478d0882bdf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:30.818604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e4827f2d-7f5a-4684-acd6-4b851da5743b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:30.832122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e4827f2d-7f5a-4684-acd6-4b851da5743b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:30.842302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e4827f2d-7f5a-4684-acd6-4b851da5743b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:30.848734 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4827f2d-7f5a-4684-acd6-4b851da5743b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1359 microversion: 2.21 time: 1.330240 Aug 09 14:53:30.849975 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2201/4409] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:29 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1359 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:31.126463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8dbf78d0-97bb-4e77-931b-a478d0882bdf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:31.163129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8dbf78d0-97bb-4e77-931b-a478d0882bdf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:31.175531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8dbf78d0-97bb-4e77-931b-a478d0882bdf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:31.179347 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8dbf78d0-97bb-4e77-931b-a478d0882bdf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 1.539428 Aug 09 14:53:31.198190 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2209/4410] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:29 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:31.879509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c21994dd-fa96-47a0-825a-d2005fe0e0a2 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:31.880594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c21994dd-fa96-47a0-825a-d2005fe0e0a2 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:31.902685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c21994dd-fa96-47a0-825a-d2005fe0e0a2 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:31.907619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c21994dd-fa96-47a0-825a-d2005fe0e0a2 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:31.911895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c21994dd-fa96-47a0-825a-d2005fe0e0a2 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:31.914508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c21994dd-fa96-47a0-825a-d2005fe0e0a2 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:31.916960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c21994dd-fa96-47a0-825a-d2005fe0e0a2 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:31.920494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c21994dd-fa96-47a0-825a-d2005fe0e0a2 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:32.205149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eebfdbd9-57db-4522-8dcf-e41ce026e9bf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:32.205818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eebfdbd9-57db-4522-8dcf-e41ce026e9bf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:32.220224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eebfdbd9-57db-4522-8dcf-e41ce026e9bf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:32.226193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eebfdbd9-57db-4522-8dcf-e41ce026e9bf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:32.227058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eebfdbd9-57db-4522-8dcf-e41ce026e9bf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:32.228116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eebfdbd9-57db-4522-8dcf-e41ce026e9bf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:32.228746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eebfdbd9-57db-4522-8dcf-e41ce026e9bf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:32.231287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eebfdbd9-57db-4522-8dcf-e41ce026e9bf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:33.198220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c21994dd-fa96-47a0-825a-d2005fe0e0a2 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:33.233246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c21994dd-fa96-47a0-825a-d2005fe0e0a2 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:33.237385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c21994dd-fa96-47a0-825a-d2005fe0e0a2 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:33.241009 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c21994dd-fa96-47a0-825a-d2005fe0e0a2 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1359 microversion: 2.21 time: 1.365947 Aug 09 14:53:33.245270 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2202/4411] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:31 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1359 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:33.276985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eebfdbd9-57db-4522-8dcf-e41ce026e9bf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:33.294354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eebfdbd9-57db-4522-8dcf-e41ce026e9bf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:33.297696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eebfdbd9-57db-4522-8dcf-e41ce026e9bf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:33.303695 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eebfdbd9-57db-4522-8dcf-e41ce026e9bf tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 1.103845 Aug 09 14:53:33.309758 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2210/4412] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:32 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:34.268003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0383694-9bf3-47b7-a09c-cf2bb0e2f644 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:34.269906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0383694-9bf3-47b7-a09c-cf2bb0e2f644 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:34.312817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0383694-9bf3-47b7-a09c-cf2bb0e2f644 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:34.315801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0383694-9bf3-47b7-a09c-cf2bb0e2f644 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:34.316605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0383694-9bf3-47b7-a09c-cf2bb0e2f644 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:34.317716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0383694-9bf3-47b7-a09c-cf2bb0e2f644 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:34.319505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0383694-9bf3-47b7-a09c-cf2bb0e2f644 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:34.322537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0383694-9bf3-47b7-a09c-cf2bb0e2f644 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:34.331263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22ef1660-a999-440e-81de-6acdff91c73d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:34.332680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22ef1660-a999-440e-81de-6acdff91c73d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:34.345777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22ef1660-a999-440e-81de-6acdff91c73d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:34.349416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22ef1660-a999-440e-81de-6acdff91c73d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:34.350189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22ef1660-a999-440e-81de-6acdff91c73d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:34.353487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22ef1660-a999-440e-81de-6acdff91c73d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:34.354386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22ef1660-a999-440e-81de-6acdff91c73d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:34.355618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22ef1660-a999-440e-81de-6acdff91c73d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:34.845468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-22ef1660-a999-440e-81de-6acdff91c73d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:34.851535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0383694-9bf3-47b7-a09c-cf2bb0e2f644 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:34.861865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0383694-9bf3-47b7-a09c-cf2bb0e2f644 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:34.863413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0383694-9bf3-47b7-a09c-cf2bb0e2f644 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:34.865025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-22ef1660-a999-440e-81de-6acdff91c73d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:34.870578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-22ef1660-a999-440e-81de-6acdff91c73d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:34.873057 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22ef1660-a999-440e-81de-6acdff91c73d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.546049 Aug 09 14:53:34.876117 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2211/4413] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:34 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:34.889851 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0383694-9bf3-47b7-a09c-cf2bb0e2f644 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1359 microversion: 2.21 time: 0.625459 Aug 09 14:53:34.890813 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2203/4414] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:34 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1359 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:35.902630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c07b5468-398f-4ffc-b0f5-70cf00bd172e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:35.904177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c07b5468-398f-4ffc-b0f5-70cf00bd172e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:35.917773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc55931d-d73e-4860-a115-14044a30127b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:35.919044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bc55931d-d73e-4860-a115-14044a30127b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:35.931411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc55931d-d73e-4860-a115-14044a30127b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:35.932212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc55931d-d73e-4860-a115-14044a30127b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:35.932836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc55931d-d73e-4860-a115-14044a30127b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:35.933582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc55931d-d73e-4860-a115-14044a30127b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:35.933996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc55931d-d73e-4860-a115-14044a30127b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:35.934412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc55931d-d73e-4860-a115-14044a30127b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:35.939761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c07b5468-398f-4ffc-b0f5-70cf00bd172e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:35.948205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c07b5468-398f-4ffc-b0f5-70cf00bd172e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:35.950319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c07b5468-398f-4ffc-b0f5-70cf00bd172e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:35.953134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c07b5468-398f-4ffc-b0f5-70cf00bd172e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:35.957594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c07b5468-398f-4ffc-b0f5-70cf00bd172e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:35.959603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c07b5468-398f-4ffc-b0f5-70cf00bd172e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:36.507710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bc55931d-d73e-4860-a115-14044a30127b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:36.517787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bc55931d-d73e-4860-a115-14044a30127b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:36.519433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bc55931d-d73e-4860-a115-14044a30127b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:36.531304 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc55931d-d73e-4860-a115-14044a30127b tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1359 microversion: 2.21 time: 0.617216 Aug 09 14:53:36.540372 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2204/4415] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:35 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1359 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:36.696486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c07b5468-398f-4ffc-b0f5-70cf00bd172e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:36.708210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c07b5468-398f-4ffc-b0f5-70cf00bd172e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:36.713426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c07b5468-398f-4ffc-b0f5-70cf00bd172e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:36.733769 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c07b5468-398f-4ffc-b0f5-70cf00bd172e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.837212 Aug 09 14:53:36.743743 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2212/4416] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:35 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:36.862756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1076274633", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": "none"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:36.980073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:53:36.982683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:53:36.983748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:53:36.984781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:53:36.985433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:53:37.006476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:37.010749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:37.014928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:37.017815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:37.019566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:37.020504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:37.034716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:37.046565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Getting quotas for project a2f1c70cf47b4611878af8ab9cce587d. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:53:37.054120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Getting quotas for user 2f4ccc8b818e431cb9443b2cf60f0b05 and project a2f1c70cf47b4611878af8ab9cce587d. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:53:37.083713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:53:37.087101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:53:37.181578 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a20f5ec6-cae4-41ea-a4cf-417430615d02 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.638001 Aug 09 14:53:37.193840 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2205/4417] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:53:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 14:53:37.201199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a23c3061-8c59-4f9c-be38-c5929a512953 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:37.202529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a23c3061-8c59-4f9c-be38-c5929a512953 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:37.271648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7e4e3ed-fb44-487e-bfaf-32414f00391a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:37.276078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b7e4e3ed-fb44-487e-bfaf-32414f00391a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:37.298033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7e4e3ed-fb44-487e-bfaf-32414f00391a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:37.298819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7e4e3ed-fb44-487e-bfaf-32414f00391a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:37.300277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7e4e3ed-fb44-487e-bfaf-32414f00391a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:37.301303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7e4e3ed-fb44-487e-bfaf-32414f00391a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:37.302142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7e4e3ed-fb44-487e-bfaf-32414f00391a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:37.302724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7e4e3ed-fb44-487e-bfaf-32414f00391a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:37.330325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-b7e4e3ed-fb44-487e-bfaf-32414f00391a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lazy-loading 'flavor' on Instance uuid 053d7685-e09d-4d66-a6cc-2a61ddefcb23 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:53:37.414501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a23c3061-8c59-4f9c-be38-c5929a512953 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:37.423254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a23c3061-8c59-4f9c-be38-c5929a512953 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:37.425387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a23c3061-8c59-4f9c-be38-c5929a512953 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:37.427075 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a23c3061-8c59-4f9c-be38-c5929a512953 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1278 microversion: 2.57 time: 0.231239 Aug 09 14:53:37.468699 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2213/4418] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:37 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1278 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:37.557957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-907eaa1f-8909-490b-bb26-51be7e64fe44 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:37.558579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-907eaa1f-8909-490b-bb26-51be7e64fe44 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:37.572057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-907eaa1f-8909-490b-bb26-51be7e64fe44 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:37.572513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-907eaa1f-8909-490b-bb26-51be7e64fe44 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:37.573037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-907eaa1f-8909-490b-bb26-51be7e64fe44 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:37.573850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-907eaa1f-8909-490b-bb26-51be7e64fe44 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:37.574452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-907eaa1f-8909-490b-bb26-51be7e64fe44 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:37.575189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-907eaa1f-8909-490b-bb26-51be7e64fe44 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:37.643271 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7e4e3ed-fb44-487e-bfaf-32414f00391a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/action" status: 200 len: 32 microversion: 2.1 time: 0.373608 Aug 09 14:53:37.659558 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2206/4419] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:53:37 2022] POST /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/action => generated 32 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:53:37.677335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4745e393-5b90-4eea-bd16-7b9b940ef6cd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:37.678087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4745e393-5b90-4eea-bd16-7b9b940ef6cd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:37.709358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4745e393-5b90-4eea-bd16-7b9b940ef6cd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:37.709976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4745e393-5b90-4eea-bd16-7b9b940ef6cd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:37.724059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4745e393-5b90-4eea-bd16-7b9b940ef6cd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:37.724932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4745e393-5b90-4eea-bd16-7b9b940ef6cd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:37.725467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4745e393-5b90-4eea-bd16-7b9b940ef6cd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:37.727998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4745e393-5b90-4eea-bd16-7b9b940ef6cd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:38.802321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4745e393-5b90-4eea-bd16-7b9b940ef6cd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:38.819274 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4745e393-5b90-4eea-bd16-7b9b940ef6cd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 1.149538 Aug 09 14:53:38.820417 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2207/4420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:37 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:38.835954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ddebcde8-d798-4888-8248-aaf70fb25e85 req-bb9628a7-2901-4758-9bbc-3a895c76def3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa761ac-9ba1-483c-bb1e-8d8dc04b1596", "name": "network-vif-plugged", "status": "completed", "tag": "0643f4b1-c763-45fb-9e4c-bf8cdcdc127b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:38.858238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-907eaa1f-8909-490b-bb26-51be7e64fe44 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:38.873517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ddebcde8-d798-4888-8248-aaf70fb25e85 req-bb9628a7-2901-4758-9bbc-3a895c76def3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:38.876040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ddebcde8-d798-4888-8248-aaf70fb25e85 req-bb9628a7-2901-4758-9bbc-3a895c76def3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:38.879552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ddebcde8-d798-4888-8248-aaf70fb25e85 req-bb9628a7-2901-4758-9bbc-3a895c76def3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:38.880751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-907eaa1f-8909-490b-bb26-51be7e64fe44 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:38.900922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-907eaa1f-8909-490b-bb26-51be7e64fe44 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:38.902243 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-907eaa1f-8909-490b-bb26-51be7e64fe44 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1359 microversion: 2.21 time: 1.349194 Aug 09 14:53:38.904360 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2214/4421] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:37 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1359 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:38.910301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d68400ca-9c26-40f9-a55e-44ebae036b92 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:38.936804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d68400ca-9c26-40f9-a55e-44ebae036b92 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:38.937543 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ddebcde8-d798-4888-8248-aaf70fb25e85 req-bb9628a7-2901-4758-9bbc-3a895c76def3 service nova] Creating event network-vif-plugged:0643f4b1-c763-45fb-9e4c-bf8cdcdc127b for instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 on n-h2-844626-8 Aug 09 14:53:38.960060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d68400ca-9c26-40f9-a55e-44ebae036b92 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:38.960060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d68400ca-9c26-40f9-a55e-44ebae036b92 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:38.960060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d68400ca-9c26-40f9-a55e-44ebae036b92 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:38.960060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d68400ca-9c26-40f9-a55e-44ebae036b92 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:38.960060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d68400ca-9c26-40f9-a55e-44ebae036b92 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:38.960060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d68400ca-9c26-40f9-a55e-44ebae036b92 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:38.962166 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ddebcde8-d798-4888-8248-aaf70fb25e85 req-bb9628a7-2901-4758-9bbc-3a895c76def3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131902 Aug 09 14:53:38.965146 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2208/4422] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:39.010410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-17245d22-eec1-42bd-8cce-10ddfea12fbf tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:39.020127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-17245d22-eec1-42bd-8cce-10ddfea12fbf tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:39.048580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17245d22-eec1-42bd-8cce-10ddfea12fbf tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:39.052192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17245d22-eec1-42bd-8cce-10ddfea12fbf tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:39.055305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17245d22-eec1-42bd-8cce-10ddfea12fbf tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:39.056761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17245d22-eec1-42bd-8cce-10ddfea12fbf tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:39.075640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17245d22-eec1-42bd-8cce-10ddfea12fbf tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:39.076256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17245d22-eec1-42bd-8cce-10ddfea12fbf tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:39.474217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-17245d22-eec1-42bd-8cce-10ddfea12fbf tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:39.489388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-17245d22-eec1-42bd-8cce-10ddfea12fbf tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:39.497482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-17245d22-eec1-42bd-8cce-10ddfea12fbf tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:39.501323 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-17245d22-eec1-42bd-8cce-10ddfea12fbf tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1274 microversion: 2.57 time: 0.515997 Aug 09 14:53:39.502485 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2209/4423] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:38 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1274 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:39.850153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d68400ca-9c26-40f9-a55e-44ebae036b92 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:39.857417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64366fab-0cf9-4922-aee3-54864bb6b28d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:39.862276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-64366fab-0cf9-4922-aee3-54864bb6b28d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:39.893274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d68400ca-9c26-40f9-a55e-44ebae036b92 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:39.895261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64366fab-0cf9-4922-aee3-54864bb6b28d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:39.896093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64366fab-0cf9-4922-aee3-54864bb6b28d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:39.897949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d68400ca-9c26-40f9-a55e-44ebae036b92 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:39.899199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64366fab-0cf9-4922-aee3-54864bb6b28d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:39.900916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64366fab-0cf9-4922-aee3-54864bb6b28d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:39.902256 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d68400ca-9c26-40f9-a55e-44ebae036b92 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.996093 Aug 09 14:53:39.909322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64366fab-0cf9-4922-aee3-54864bb6b28d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:39.910492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64366fab-0cf9-4922-aee3-54864bb6b28d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:39.911804 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2215/4424] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:38 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:39.936671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-43e6b62e-c770-439f-bf16-25bbe9484c36 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:39.939670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-43e6b62e-c770-439f-bf16-25bbe9484c36 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:39.963330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43e6b62e-c770-439f-bf16-25bbe9484c36 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:39.963999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43e6b62e-c770-439f-bf16-25bbe9484c36 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:39.967227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43e6b62e-c770-439f-bf16-25bbe9484c36 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:39.968920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43e6b62e-c770-439f-bf16-25bbe9484c36 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:39.971276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43e6b62e-c770-439f-bf16-25bbe9484c36 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:39.974071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-43e6b62e-c770-439f-bf16-25bbe9484c36 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:40.491466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-43e6b62e-c770-439f-bf16-25bbe9484c36 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:40.505161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-64366fab-0cf9-4922-aee3-54864bb6b28d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:40.509507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-43e6b62e-c770-439f-bf16-25bbe9484c36 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:40.518411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-43e6b62e-c770-439f-bf16-25bbe9484c36 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:40.519637 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-43e6b62e-c770-439f-bf16-25bbe9484c36 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1359 microversion: 2.21 time: 0.597224 Aug 09 14:53:40.526934 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2216/4425] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:39 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1359 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:40.539309 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-64366fab-0cf9-4922-aee3-54864bb6b28d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.679483 Aug 09 14:53:40.543423 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2210/4426] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:39 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:40.543607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f66c6ae-c48c-421b-853b-936e3c1cf4aa tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:40.552714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0f66c6ae-c48c-421b-853b-936e3c1cf4aa tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:40.586754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f66c6ae-c48c-421b-853b-936e3c1cf4aa tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:40.587540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f66c6ae-c48c-421b-853b-936e3c1cf4aa tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:40.589727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f66c6ae-c48c-421b-853b-936e3c1cf4aa tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:40.591721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f66c6ae-c48c-421b-853b-936e3c1cf4aa tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:40.593290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f66c6ae-c48c-421b-853b-936e3c1cf4aa tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:40.596187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0f66c6ae-c48c-421b-853b-936e3c1cf4aa tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:40.739242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0f66c6ae-c48c-421b-853b-936e3c1cf4aa tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:40.777342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0f66c6ae-c48c-421b-853b-936e3c1cf4aa tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:40.787247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0f66c6ae-c48c-421b-853b-936e3c1cf4aa tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:40.792059 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f66c6ae-c48c-421b-853b-936e3c1cf4aa tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1338 microversion: 2.57 time: 0.253612 Aug 09 14:53:40.795900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-626437288-access_point-1484145256", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "bf6a7b5a-adf8-49c5-bc4c-6077be903824"}], "key_name": "tempest-TestSecurityGroupsBasicOps-189901098", "security_groups": [{"name": "tempest-secgroup_access--407326437"}, {"name": "tempest-secgroup_general--776325711"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:40.813272 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2217/4427] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:40 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1338 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:40.945106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b087a41-f655-487b-9000-e9c54cea4623 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:40.946590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b087a41-f655-487b-9000-e9c54cea4623 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:40.972350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b087a41-f655-487b-9000-e9c54cea4623 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:40.973587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b087a41-f655-487b-9000-e9c54cea4623 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:40.974686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b087a41-f655-487b-9000-e9c54cea4623 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:40.977151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b087a41-f655-487b-9000-e9c54cea4623 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:40.978029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b087a41-f655-487b-9000-e9c54cea4623 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:40.979382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b087a41-f655-487b-9000-e9c54cea4623 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:41.271646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] validate_networks() for [('bf6a7b5a-adf8-49c5-bc4c-6077be903824', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:53:41.325216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b087a41-f655-487b-9000-e9c54cea4623 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:41.337129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b087a41-f655-487b-9000-e9c54cea4623 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:41.338772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b087a41-f655-487b-9000-e9c54cea4623 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:41.340062 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b087a41-f655-487b-9000-e9c54cea4623 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.403620 Aug 09 14:53:41.346279 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2218/4428] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:40 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:41.549580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37963086-4699-4729-b005-af75a42ceddb tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:41.550263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37963086-4699-4729-b005-af75a42ceddb tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:41.562655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37963086-4699-4729-b005-af75a42ceddb tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:41.567300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37963086-4699-4729-b005-af75a42ceddb tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:41.568506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37963086-4699-4729-b005-af75a42ceddb tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:41.570079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37963086-4699-4729-b005-af75a42ceddb tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:41.570962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37963086-4699-4729-b005-af75a42ceddb tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:41.571638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37963086-4699-4729-b005-af75a42ceddb tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:42.028610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-37963086-4699-4729-b005-af75a42ceddb tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:42.046877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-37963086-4699-4729-b005-af75a42ceddb tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:42.051717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-37963086-4699-4729-b005-af75a42ceddb tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:42.054980 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37963086-4699-4729-b005-af75a42ceddb tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1553 microversion: 2.21 time: 0.509701 Aug 09 14:53:42.077250 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2219/4429] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:41 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1553 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:42.088491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe84eee8-e84a-4db3-8617-44b913ca1333 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:42.089479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fe84eee8-e84a-4db3-8617-44b913ca1333 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:42.104584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe84eee8-e84a-4db3-8617-44b913ca1333 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:42.105816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe84eee8-e84a-4db3-8617-44b913ca1333 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:42.106528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe84eee8-e84a-4db3-8617-44b913ca1333 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:42.108303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe84eee8-e84a-4db3-8617-44b913ca1333 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:42.115649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe84eee8-e84a-4db3-8617-44b913ca1333 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:42.116514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe84eee8-e84a-4db3-8617-44b913ca1333 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:42.505489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fe84eee8-e84a-4db3-8617-44b913ca1333 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:42.521627 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fe84eee8-e84a-4db3-8617-44b913ca1333 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.442697 Aug 09 14:53:42.522016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:53:42.522643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:53:42.523815 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2220/4430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:42 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:42.529925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac3899cd-0f13-4348-a0cf-66828493b19f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:42.531189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ac3899cd-0f13-4348-a0cf-66828493b19f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:42.539995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac3899cd-0f13-4348-a0cf-66828493b19f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:42.540551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:53:42.541172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:53:42.541378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac3899cd-0f13-4348-a0cf-66828493b19f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:42.541591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:53:42.542157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac3899cd-0f13-4348-a0cf-66828493b19f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:42.543046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac3899cd-0f13-4348-a0cf-66828493b19f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:42.543773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac3899cd-0f13-4348-a0cf-66828493b19f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:42.544359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac3899cd-0f13-4348-a0cf-66828493b19f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:42.559214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:42.563236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:42.563706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:42.566468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:42.567032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:42.569588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:42.630199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Getting quotas for project 7483d79edacf4600aff88566a44c44d9. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:53:42.641495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Getting quotas for user 1eadaad5eff54da5ba83805c15c28ba1 and project 7483d79edacf4600aff88566a44c44d9. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:53:42.675796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:53:42.677943 n-d-844626-8 devstack@n-api.service[119407]: WARNING nova.utils [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-626437288-access_point-1484145256 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-626437288-acc Aug 09 14:53:42.678652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:53:42.680151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ac3899cd-0f13-4348-a0cf-66828493b19f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:42.689277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ac3899cd-0f13-4348-a0cf-66828493b19f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:42.691140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ac3899cd-0f13-4348-a0cf-66828493b19f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:42.693213 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ac3899cd-0f13-4348-a0cf-66828493b19f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1336 microversion: 2.57 time: 0.167814 Aug 09 14:53:42.694222 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2221/4431] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:42 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1336 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:42.700783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-feae6c44-52bc-4507-a1b3-51c8a6bb7c0c tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:42.701912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-feae6c44-52bc-4507-a1b3-51c8a6bb7c0c tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:42.710274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feae6c44-52bc-4507-a1b3-51c8a6bb7c0c tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:42.711138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feae6c44-52bc-4507-a1b3-51c8a6bb7c0c tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:42.711915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feae6c44-52bc-4507-a1b3-51c8a6bb7c0c tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:42.712836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feae6c44-52bc-4507-a1b3-51c8a6bb7c0c tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:42.713455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feae6c44-52bc-4507-a1b3-51c8a6bb7c0c tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:42.714036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feae6c44-52bc-4507-a1b3-51c8a6bb7c0c tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:42.780744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-feae6c44-52bc-4507-a1b3-51c8a6bb7c0c tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:53:42.818419 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1802cfac-2e44-47e2-8fd2-a483ecc8f076 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.027270 Aug 09 14:53:42.822733 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2211/4432] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:53:40 2022] POST /compute/v2.1/servers => generated 456 bytes in 2032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:53:42.841643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-649d0359-07b5-4476-8e7d-a747a875a631 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:42.842753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-649d0359-07b5-4476-8e7d-a747a875a631 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:42.859342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-649d0359-07b5-4476-8e7d-a747a875a631 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:42.860052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-649d0359-07b5-4476-8e7d-a747a875a631 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:42.871204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-649d0359-07b5-4476-8e7d-a747a875a631 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:42.872184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-649d0359-07b5-4476-8e7d-a747a875a631 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:42.872673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-649d0359-07b5-4476-8e7d-a747a875a631 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:42.873115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-649d0359-07b5-4476-8e7d-a747a875a631 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:43.035991 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-feae6c44-52bc-4507-a1b3-51c8a6bb7c0c tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "DELETE /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 204 len: 0 microversion: 2.21 time: 0.339866 Aug 09 14:53:43.037423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2222/4433] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:53:42 2022] DELETE /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:53:43.070943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a7a847d-5cf8-4271-989a-fa3822b50a1a tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:43.071706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a7a847d-5cf8-4271-989a-fa3822b50a1a tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:43.156033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-649d0359-07b5-4476-8e7d-a747a875a631 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:43.164867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-649d0359-07b5-4476-8e7d-a747a875a631 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:43.173354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-649d0359-07b5-4476-8e7d-a747a875a631 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:43.179362 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-649d0359-07b5-4476-8e7d-a747a875a631 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.350077 Aug 09 14:53:43.180574 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2212/4434] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:42 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:43.203142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07182020-99b1-479a-92c9-53bd0eca022f tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:43.203738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07182020-99b1-479a-92c9-53bd0eca022f tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:43.206781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:43.232828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07182020-99b1-479a-92c9-53bd0eca022f tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:43.233330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07182020-99b1-479a-92c9-53bd0eca022f tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:43.233760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07182020-99b1-479a-92c9-53bd0eca022f tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:43.234479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07182020-99b1-479a-92c9-53bd0eca022f tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:43.234917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07182020-99b1-479a-92c9-53bd0eca022f tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:43.235367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07182020-99b1-479a-92c9-53bd0eca022f tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:43.254223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9a7a847d-5cf8-4271-989a-fa3822b50a1a tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:43.271603 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a7a847d-5cf8-4271-989a-fa3822b50a1a tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1293 microversion: 2.1 time: 0.227976 Aug 09 14:53:43.273159 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2223/4435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:43 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1293 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:43.548427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f7fe7b0-5750-46ac-8a05-8eba29a9b663 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:43.549573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9f7fe7b0-5750-46ac-8a05-8eba29a9b663 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:43.563243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f7fe7b0-5750-46ac-8a05-8eba29a9b663 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:43.565945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f7fe7b0-5750-46ac-8a05-8eba29a9b663 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:43.567199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f7fe7b0-5750-46ac-8a05-8eba29a9b663 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:43.569276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f7fe7b0-5750-46ac-8a05-8eba29a9b663 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:43.571029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f7fe7b0-5750-46ac-8a05-8eba29a9b663 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:43.572052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f7fe7b0-5750-46ac-8a05-8eba29a9b663 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:43.603758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07182020-99b1-479a-92c9-53bd0eca022f tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:43.617599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07182020-99b1-479a-92c9-53bd0eca022f tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:43.619422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07182020-99b1-479a-92c9-53bd0eca022f tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:43.621040 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07182020-99b1-479a-92c9-53bd0eca022f tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1559 microversion: 2.21 time: 0.437622 Aug 09 14:53:43.622160 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2213/4436] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:43 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1559 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:43.727604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-51559f1d-c2fe-4cbc-8c38-891b6bad38a3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:43.729842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-51559f1d-c2fe-4cbc-8c38-891b6bad38a3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:43.745684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51559f1d-c2fe-4cbc-8c38-891b6bad38a3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:43.746625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51559f1d-c2fe-4cbc-8c38-891b6bad38a3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:43.748723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51559f1d-c2fe-4cbc-8c38-891b6bad38a3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:43.749727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51559f1d-c2fe-4cbc-8c38-891b6bad38a3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:43.751690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51559f1d-c2fe-4cbc-8c38-891b6bad38a3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:43.752447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51559f1d-c2fe-4cbc-8c38-891b6bad38a3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:43.980997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-51559f1d-c2fe-4cbc-8c38-891b6bad38a3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:43.997470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-51559f1d-c2fe-4cbc-8c38-891b6bad38a3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:44.000364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-51559f1d-c2fe-4cbc-8c38-891b6bad38a3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:44.004943 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-51559f1d-c2fe-4cbc-8c38-891b6bad38a3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1336 microversion: 2.57 time: 0.281382 Aug 09 14:53:44.009214 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2214/4437] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:43 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1336 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:44.105421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9f7fe7b0-5750-46ac-8a05-8eba29a9b663 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:44.131318 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f7fe7b0-5750-46ac-8a05-8eba29a9b663 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.575029 Aug 09 14:53:44.131318 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2224/4438] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:43 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:53:44.204896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a56be058-414e-4da5-b542-762a851da443 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:44.205833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a56be058-414e-4da5-b542-762a851da443 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:44.235051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56be058-414e-4da5-b542-762a851da443 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:44.241990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56be058-414e-4da5-b542-762a851da443 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:44.244115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56be058-414e-4da5-b542-762a851da443 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:44.246505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56be058-414e-4da5-b542-762a851da443 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:44.254925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56be058-414e-4da5-b542-762a851da443 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:44.256223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56be058-414e-4da5-b542-762a851da443 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:44.294740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-21188b6d-ff34-4ee0-bb0e-b704f359670e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:44.295492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-21188b6d-ff34-4ee0-bb0e-b704f359670e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:44.307127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21188b6d-ff34-4ee0-bb0e-b704f359670e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:44.310633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21188b6d-ff34-4ee0-bb0e-b704f359670e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:44.311345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21188b6d-ff34-4ee0-bb0e-b704f359670e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:44.312369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21188b6d-ff34-4ee0-bb0e-b704f359670e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:44.313478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21188b6d-ff34-4ee0-bb0e-b704f359670e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:44.315683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21188b6d-ff34-4ee0-bb0e-b704f359670e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:44.470769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-21188b6d-ff34-4ee0-bb0e-b704f359670e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:44.475199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:44.488183 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-21188b6d-ff34-4ee0-bb0e-b704f359670e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1297 microversion: 2.1 time: 0.198179 Aug 09 14:53:44.489082 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2225/4439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:44 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1297 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:53:44.646252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07b8ceca-46ae-491c-9689-595390b5afb5 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:44.647165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07b8ceca-46ae-491c-9689-595390b5afb5 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:44.662680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b8ceca-46ae-491c-9689-595390b5afb5 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:44.663406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b8ceca-46ae-491c-9689-595390b5afb5 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:44.665512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b8ceca-46ae-491c-9689-595390b5afb5 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:44.668185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b8ceca-46ae-491c-9689-595390b5afb5 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:44.670216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b8ceca-46ae-491c-9689-595390b5afb5 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:44.670866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b8ceca-46ae-491c-9689-595390b5afb5 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:45.779010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a56be058-414e-4da5-b542-762a851da443 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:45.800708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a56be058-414e-4da5-b542-762a851da443 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:45.802700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a56be058-414e-4da5-b542-762a851da443 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:45.814373 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a56be058-414e-4da5-b542-762a851da443 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 1.609508 Aug 09 14:53:45.840753 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2215/4440] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:44 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:45.846705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-be9c087a-cf0a-46a0-b65f-c3d5b72af429 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:45.847626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-be9c087a-cf0a-46a0-b65f-c3d5b72af429 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:45.863404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be9c087a-cf0a-46a0-b65f-c3d5b72af429 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:45.864271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be9c087a-cf0a-46a0-b65f-c3d5b72af429 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:45.864873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be9c087a-cf0a-46a0-b65f-c3d5b72af429 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:45.868424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be9c087a-cf0a-46a0-b65f-c3d5b72af429 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:45.869105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be9c087a-cf0a-46a0-b65f-c3d5b72af429 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:45.870506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be9c087a-cf0a-46a0-b65f-c3d5b72af429 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:46.274931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-be9c087a-cf0a-46a0-b65f-c3d5b72af429 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:46.316600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-be9c087a-cf0a-46a0-b65f-c3d5b72af429 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:46.319157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-be9c087a-cf0a-46a0-b65f-c3d5b72af429 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:46.328077 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-be9c087a-cf0a-46a0-b65f-c3d5b72af429 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1357 microversion: 2.57 time: 0.478308 Aug 09 14:53:46.329863 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2216/4441] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:45 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1357 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:46.349926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07b8ceca-46ae-491c-9689-595390b5afb5 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:46.351162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f428a36-d035-4b0e-87fd-c17dff0586d3 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:46.353897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f428a36-d035-4b0e-87fd-c17dff0586d3 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:46.359973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07b8ceca-46ae-491c-9689-595390b5afb5 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:46.361492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07b8ceca-46ae-491c-9689-595390b5afb5 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:46.373604 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07b8ceca-46ae-491c-9689-595390b5afb5 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1559 microversion: 2.21 time: 1.731936 Aug 09 14:53:46.376882 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2226/4442] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:44 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1559 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:46.377995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f428a36-d035-4b0e-87fd-c17dff0586d3 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:46.382664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f428a36-d035-4b0e-87fd-c17dff0586d3 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:46.383137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f428a36-d035-4b0e-87fd-c17dff0586d3 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:46.383869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f428a36-d035-4b0e-87fd-c17dff0586d3 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:46.384336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f428a36-d035-4b0e-87fd-c17dff0586d3 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:46.384757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f428a36-d035-4b0e-87fd-c17dff0586d3 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:46.387617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4bc16901-80bb-4e40-b885-06dd38e8515b tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:46.393069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4bc16901-80bb-4e40-b885-06dd38e8515b tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:46.404223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bc16901-80bb-4e40-b885-06dd38e8515b tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:46.410662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bc16901-80bb-4e40-b885-06dd38e8515b tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:46.411579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bc16901-80bb-4e40-b885-06dd38e8515b tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:46.412852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bc16901-80bb-4e40-b885-06dd38e8515b tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:46.413539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bc16901-80bb-4e40-b885-06dd38e8515b tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:46.414225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bc16901-80bb-4e40-b885-06dd38e8515b tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:46.677237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4bc16901-80bb-4e40-b885-06dd38e8515b tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:46.694003 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4bc16901-80bb-4e40-b885-06dd38e8515b tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1345 microversion: 2.1 time: 0.315455 Aug 09 14:53:46.697183 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2227/4443] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:46 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1345 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:46.712507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:46.718431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:46.732007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:46.735856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:46.736311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:46.737067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:46.737529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:46.738233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:46.999250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:53:46.999645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:53:47.000143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:53:47.003304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:53:47.003812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:53:47.102579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6f428a36-d035-4b0e-87fd-c17dff0586d3 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:47.124321 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f428a36-d035-4b0e-87fd-c17dff0586d3 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.793140 Aug 09 14:53:47.150262 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2217/4444] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:46 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:47.165976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c59c8b6a-828a-43b7-8cbe-48b5bf77178c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:47.166763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c59c8b6a-828a-43b7-8cbe-48b5bf77178c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:47.185865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c59c8b6a-828a-43b7-8cbe-48b5bf77178c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:47.194153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c59c8b6a-828a-43b7-8cbe-48b5bf77178c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:47.194943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c59c8b6a-828a-43b7-8cbe-48b5bf77178c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:47.195908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c59c8b6a-828a-43b7-8cbe-48b5bf77178c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:47.199192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c59c8b6a-828a-43b7-8cbe-48b5bf77178c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:47.200531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c59c8b6a-828a-43b7-8cbe-48b5bf77178c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:47.260268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:47.280841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:47.281421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:47.283102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:47.283874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:47.287877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:47.288385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:47.395872 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63bfa1f5-ea7e-4fc7-bc68-ebfbff659c0b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "POST /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1/action" status: 202 len: 1138 microversion: 2.57 time: 0.696280 Aug 09 14:53:47.414852 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2228/4445] 10.222.0.50 () {62 vars in 1320 bytes} [Tue Aug 9 14:53:46 2022] POST /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1/action => generated 1138 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 09 14:53:47.432372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a216bf5-4561-46d7-9299-8b8c81130610 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:47.435541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a216bf5-4561-46d7-9299-8b8c81130610 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:47.464184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a216bf5-4561-46d7-9299-8b8c81130610 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:47.465363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a216bf5-4561-46d7-9299-8b8c81130610 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:47.465851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a216bf5-4561-46d7-9299-8b8c81130610 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:47.470368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a216bf5-4561-46d7-9299-8b8c81130610 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:47.472616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a216bf5-4561-46d7-9299-8b8c81130610 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:47.473175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a216bf5-4561-46d7-9299-8b8c81130610 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:47.711190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c59c8b6a-828a-43b7-8cbe-48b5bf77178c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:47.722614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c59c8b6a-828a-43b7-8cbe-48b5bf77178c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:47.727707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4a216bf5-4561-46d7-9299-8b8c81130610 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:47.730026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c59c8b6a-828a-43b7-8cbe-48b5bf77178c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:47.735490 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c59c8b6a-828a-43b7-8cbe-48b5bf77178c tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.583910 Aug 09 14:53:47.738496 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2218/4446] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:47 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:47.756369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-415b5194-7d6a-452d-863b-8b93da2d11ec tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:47.758819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4a216bf5-4561-46d7-9299-8b8c81130610 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:47.760667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4a216bf5-4561-46d7-9299-8b8c81130610 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a34039fa16994da2beb3e9df28813a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf4e442f194011afb46d6505e11930', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:47.764205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-415b5194-7d6a-452d-863b-8b93da2d11ec tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:47.774740 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a216bf5-4561-46d7-9299-8b8c81130610 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 200 len: 1517 microversion: 2.21 time: 0.355449 Aug 09 14:53:47.777235 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2229/4447] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:47 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 1517 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:47.788546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-415b5194-7d6a-452d-863b-8b93da2d11ec tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:47.788546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-415b5194-7d6a-452d-863b-8b93da2d11ec tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:47.788546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-415b5194-7d6a-452d-863b-8b93da2d11ec tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:47.790184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-415b5194-7d6a-452d-863b-8b93da2d11ec tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:47.790918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-415b5194-7d6a-452d-863b-8b93da2d11ec tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:47.791858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-415b5194-7d6a-452d-863b-8b93da2d11ec tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:47.814386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1189622b-d125-42a1-800f-00d7e5c73ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:47.823876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1189622b-d125-42a1-800f-00d7e5c73ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:47.866694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1189622b-d125-42a1-800f-00d7e5c73ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:47.868968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1189622b-d125-42a1-800f-00d7e5c73ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:47.871714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1189622b-d125-42a1-800f-00d7e5c73ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:47.874791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1189622b-d125-42a1-800f-00d7e5c73ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:47.879022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1189622b-d125-42a1-800f-00d7e5c73ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:47.882137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1189622b-d125-42a1-800f-00d7e5c73ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:48.001266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-415b5194-7d6a-452d-863b-8b93da2d11ec tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:48.010196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-415b5194-7d6a-452d-863b-8b93da2d11ec tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:48.017586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-415b5194-7d6a-452d-863b-8b93da2d11ec tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:48.020085 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-415b5194-7d6a-452d-863b-8b93da2d11ec tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.279597 Aug 09 14:53:48.028234 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2219/4448] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:47 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:48.042347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9dbf5c6a-4752-4332-af00-7b9aeda0ccc6 req-b98e4f7d-169c-45ea-adc8-a8214bfe06d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa761ac-9ba1-483c-bb1e-8d8dc04b1596", "name": "network-vif-deleted", "tag": "0643f4b1-c763-45fb-9e4c-bf8cdcdc127b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:48.072761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9dbf5c6a-4752-4332-af00-7b9aeda0ccc6 req-b98e4f7d-169c-45ea-adc8-a8214bfe06d5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:48.073547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9dbf5c6a-4752-4332-af00-7b9aeda0ccc6 req-b98e4f7d-169c-45ea-adc8-a8214bfe06d5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:48.083478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9dbf5c6a-4752-4332-af00-7b9aeda0ccc6 req-b98e4f7d-169c-45ea-adc8-a8214bfe06d5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:48.149875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1189622b-d125-42a1-800f-00d7e5c73ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:48.162575 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1189622b-d125-42a1-800f-00d7e5c73ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1363 microversion: 2.1 time: 0.382367 Aug 09 14:53:48.165646 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2230/4449] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:47 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:48.168117 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9dbf5c6a-4752-4332-af00-7b9aeda0ccc6 req-b98e4f7d-169c-45ea-adc8-a8214bfe06d5 service nova] Creating event network-vif-deleted:0643f4b1-c763-45fb-9e4c-bf8cdcdc127b for instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 on n-h2-844626-8 Aug 09 14:53:48.181018 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9dbf5c6a-4752-4332-af00-7b9aeda0ccc6 req-b98e4f7d-169c-45ea-adc8-a8214bfe06d5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147423 Aug 09 14:53:48.184849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d125eae0-2974-49be-9d75-d17d9da1ac56 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:48.185970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d125eae0-2974-49be-9d75-d17d9da1ac56 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:48.196699 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2220/4450] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:48.214125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d125eae0-2974-49be-9d75-d17d9da1ac56 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:48.216507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d125eae0-2974-49be-9d75-d17d9da1ac56 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:48.217395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d125eae0-2974-49be-9d75-d17d9da1ac56 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:48.218442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d125eae0-2974-49be-9d75-d17d9da1ac56 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:48.223875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d125eae0-2974-49be-9d75-d17d9da1ac56 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:48.224776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d125eae0-2974-49be-9d75-d17d9da1ac56 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:48.577878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d125eae0-2974-49be-9d75-d17d9da1ac56 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:48.595817 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d125eae0-2974-49be-9d75-d17d9da1ac56 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.428908 Aug 09 14:53:48.614896 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2231/4451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:48 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:48.768659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b9b8f815-eafe-4d8a-81f1-6aa987528017 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:48.769607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b9b8f815-eafe-4d8a-81f1-6aa987528017 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:48.781974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9b8f815-eafe-4d8a-81f1-6aa987528017 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:48.782701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9b8f815-eafe-4d8a-81f1-6aa987528017 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:48.783303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9b8f815-eafe-4d8a-81f1-6aa987528017 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:48.784322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9b8f815-eafe-4d8a-81f1-6aa987528017 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:48.785008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9b8f815-eafe-4d8a-81f1-6aa987528017 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:48.785895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9b8f815-eafe-4d8a-81f1-6aa987528017 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:48.800555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-15d4fa1d-972d-4667-99b7-f85e2eb64285 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:48.801361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-15d4fa1d-972d-4667-99b7-f85e2eb64285 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:48.813688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15d4fa1d-972d-4667-99b7-f85e2eb64285 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:48.814465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15d4fa1d-972d-4667-99b7-f85e2eb64285 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:48.814906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15d4fa1d-972d-4667-99b7-f85e2eb64285 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:48.815795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15d4fa1d-972d-4667-99b7-f85e2eb64285 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:48.816252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15d4fa1d-972d-4667-99b7-f85e2eb64285 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:48.816777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-15d4fa1d-972d-4667-99b7-f85e2eb64285 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:48.849012 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-15d4fa1d-972d-4667-99b7-f85e2eb64285 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] HTTP exception thrown: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-15d4fa1d-972d-4667-99b7-f85e2eb64285 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Request method failure captured: Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 HTTP/1.1 Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nTaAOClr8NRZ6HbJG0MAjF6JF-Mg2KiIrNH3_WPZAFh6_HK9qDPeVTqWmKkZTkHX14YoZZOe0kzy23z2WKy5-mBxdsoIRiXwh7VEjwEEiA7ktSDxDpKrvTtiapPJg0dXF4693YaXlnTV8MGD_VPn8tvU0xIHWRiWpjeWFXjRbfBiZ4 Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.21 Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 1ecf4e442f194011afb46d6505e11930 Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-InstanceActionsV221TestJSON-306668744 Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1ecf4e442f194011afb46d6505e11930", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1ecf4e442f194011afb46d6505e11930"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1ecf4e442f194011afb46d6505e11930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1ecf4e442f194011afb46d6505e11930"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-InstanceActionsV221TestJSON-306668744 Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 1ecf4e442f194011afb46d6505e11930 Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-306668744 Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-InstanceActionsV221TestJSON-306668744-project Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: a34039fa16994da2beb3e9df28813a37 Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-InstanceActionsV221TestJSON-306668744-project Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'afa761ac-9ba1-483c-bb1e-8d8dc04b1596'} Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:48.856510 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:48.862187 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:48.862187 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:48.862187 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:48.862187 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:48.862187 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:53:48.862187 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:53:48.862187 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:48.862187 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:48.863881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-15d4fa1d-972d-4667-99b7-f85e2eb64285 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Returning 404 to user: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:53:48.865000 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-15d4fa1d-972d-4667-99b7-f85e2eb64285 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 404 len: 111 microversion: 2.21 time: 0.068724 Aug 09 14:53:48.872042 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2232/4452] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:48 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:53:48.881409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a12033d8-85f5-4d42-a994-ffe861ac76d1 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '.version_select at 0x7f41de1130d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:48.888107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a12033d8-85f5-4d42-a994-ffe861ac76d1 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:48.907356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a12033d8-85f5-4d42-a994-ffe861ac76d1 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:48.908146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a12033d8-85f5-4d42-a994-ffe861ac76d1 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:48.908824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a12033d8-85f5-4d42-a994-ffe861ac76d1 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:48.910590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a12033d8-85f5-4d42-a994-ffe861ac76d1 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:48.911660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a12033d8-85f5-4d42-a994-ffe861ac76d1 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:48.912531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a12033d8-85f5-4d42-a994-ffe861ac76d1 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:49.010103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b9b8f815-eafe-4d8a-81f1-6aa987528017 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:49.023944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b9b8f815-eafe-4d8a-81f1-6aa987528017 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:49.025889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b9b8f815-eafe-4d8a-81f1-6aa987528017 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:49.027852 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b9b8f815-eafe-4d8a-81f1-6aa987528017 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.266059 Aug 09 14:53:49.047777 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2221/4453] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:48 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:49.063309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ed28f0c-51a8-48bd-8a2b-999cdb39a51e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:49.065194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ed28f0c-51a8-48bd-8a2b-999cdb39a51e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:49.081814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed28f0c-51a8-48bd-8a2b-999cdb39a51e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:49.082697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed28f0c-51a8-48bd-8a2b-999cdb39a51e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:49.083686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed28f0c-51a8-48bd-8a2b-999cdb39a51e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:49.085285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed28f0c-51a8-48bd-8a2b-999cdb39a51e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:49.085912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed28f0c-51a8-48bd-8a2b-999cdb39a51e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:49.086487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ed28f0c-51a8-48bd-8a2b-999cdb39a51e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:49.091544 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a12033d8-85f5-4d42-a994-ffe861ac76d1 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.215225 Aug 09 14:53:49.092166 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2233/4454] 10.222.0.50 () {60 vars in 1337 bytes} [Tue Aug 9 14:53:48 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596/os-instance-actions => generated 611 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 14:53:49.106756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0f6e965-6809-4fdb-a244-6ae337552f0d tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:49.107500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e0f6e965-6809-4fdb-a244-6ae337552f0d tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:49.124618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0f6e965-6809-4fdb-a244-6ae337552f0d tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:49.126725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0f6e965-6809-4fdb-a244-6ae337552f0d tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:49.127511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0f6e965-6809-4fdb-a244-6ae337552f0d tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:49.130719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0f6e965-6809-4fdb-a244-6ae337552f0d tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:49.131788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0f6e965-6809-4fdb-a244-6ae337552f0d tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:49.134253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0f6e965-6809-4fdb-a244-6ae337552f0d tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:49.138597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:49.167905 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-e0f6e965-6809-4fdb-a244-6ae337552f0d tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] HTTP exception thrown: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0f6e965-6809-4fdb-a244-6ae337552f0d tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Request method failure captured: Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 HTTP/1.1 Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nTaAOClr8NRZ6HbJG0MAjF6JF-Mg2KiIrNH3_WPZAFh6_HK9qDPeVTqWmKkZTkHX14YoZZOe0kzy23z2WKy5-mBxdsoIRiXwh7VEjwEEiA7ktSDxDpKrvTtiapPJg0dXF4693YaXlnTV8MGD_VPn8tvU0xIHWRiWpjeWFXjRbfBiZ4 Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.21 Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 1ecf4e442f194011afb46d6505e11930 Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-InstanceActionsV221TestJSON-306668744 Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1ecf4e442f194011afb46d6505e11930", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1ecf4e442f194011afb46d6505e11930"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1ecf4e442f194011afb46d6505e11930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1ecf4e442f194011afb46d6505e11930"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-InstanceActionsV221TestJSON-306668744 Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 1ecf4e442f194011afb46d6505e11930 Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-306668744 Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-InstanceActionsV221TestJSON-306668744-project Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: a34039fa16994da2beb3e9df28813a37 Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-InstanceActionsV221TestJSON-306668744-project Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'afa761ac-9ba1-483c-bb1e-8d8dc04b1596'} Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:53:49.170019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:53:49.179367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:49.179367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:49.179367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:49.179367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:49.179367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:49.179367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:49.179367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:49.179367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:53:49.179367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:53:49.179367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:49.179367 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:53:49.182108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0f6e965-6809-4fdb-a244-6ae337552f0d tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Returning 404 to user: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:53:49.183558 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e0f6e965-6809-4fdb-a244-6ae337552f0d tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "DELETE /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 404 len: 111 microversion: 2.21 time: 0.081083 Aug 09 14:53:49.188028 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2234/4455] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:53:49 2022] DELETE /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:53:49.206326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ed28f0c-51a8-48bd-8a2b-999cdb39a51e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:49.213013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a353b0b-0625-4cbc-a684-57b7c8c3cf12 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:49.215808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a353b0b-0625-4cbc-a684-57b7c8c3cf12 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:49.225145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ed28f0c-51a8-48bd-8a2b-999cdb39a51e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:49.227053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ed28f0c-51a8-48bd-8a2b-999cdb39a51e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:49.228475 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ed28f0c-51a8-48bd-8a2b-999cdb39a51e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.179419 Aug 09 14:53:49.229609 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2222/4456] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:49 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:49.245340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-055fa448-c9c3-44c1-b77f-d7cc1106f571 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:49.246509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-055fa448-c9c3-44c1-b77f-d7cc1106f571 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] [instance: afa761ac-9ba1-483c-bb1e-8d8dc04b1596] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:49.251295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a353b0b-0625-4cbc-a684-57b7c8c3cf12 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:49.251963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a353b0b-0625-4cbc-a684-57b7c8c3cf12 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:49.252542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a353b0b-0625-4cbc-a684-57b7c8c3cf12 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:49.253632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a353b0b-0625-4cbc-a684-57b7c8c3cf12 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:49.254285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a353b0b-0625-4cbc-a684-57b7c8c3cf12 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:49.254856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a353b0b-0625-4cbc-a684-57b7c8c3cf12 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:49.255753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-055fa448-c9c3-44c1-b77f-d7cc1106f571 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:49.256249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-055fa448-c9c3-44c1-b77f-d7cc1106f571 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:49.258317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-055fa448-c9c3-44c1-b77f-d7cc1106f571 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:49.259327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-055fa448-c9c3-44c1-b77f-d7cc1106f571 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:49.259743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-055fa448-c9c3-44c1-b77f-d7cc1106f571 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:49.260163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-055fa448-c9c3-44c1-b77f-d7cc1106f571 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:49.286534 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-055fa448-c9c3-44c1-b77f-d7cc1106f571 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] HTTP exception thrown: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-055fa448-c9c3-44c1-b77f-d7cc1106f571 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Request method failure captured: Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 HTTP/1.1 Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nTaAOClr8NRZ6HbJG0MAjF6JF-Mg2KiIrNH3_WPZAFh6_HK9qDPeVTqWmKkZTkHX14YoZZOe0kzy23z2WKy5-mBxdsoIRiXwh7VEjwEEiA7ktSDxDpKrvTtiapPJg0dXF4693YaXlnTV8MGD_VPn8tvU0xIHWRiWpjeWFXjRbfBiZ4 Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.21 Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 1ecf4e442f194011afb46d6505e11930 Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-InstanceActionsV221TestJSON-306668744 Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1ecf4e442f194011afb46d6505e11930", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1ecf4e442f194011afb46d6505e11930"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1ecf4e442f194011afb46d6505e11930"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1ecf4e442f194011afb46d6505e11930"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-InstanceActionsV221TestJSON-306668744 Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 1ecf4e442f194011afb46d6505e11930 Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-306668744 Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-InstanceActionsV221TestJSON-306668744-project Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: a34039fa16994da2beb3e9df28813a37 Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-InstanceActionsV221TestJSON-306668744-project Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'afa761ac-9ba1-483c-bb1e-8d8dc04b1596'} Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:49.288536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:53:49.293644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:49.293644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:53:49.293644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:53:49.293644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:53:49.293644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:53:49.293644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:53:49.293644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. Aug 09 14:53:49.293644 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:53:49.295980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-055fa448-c9c3-44c1-b77f-d7cc1106f571 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] Returning 404 to user: Instance afa761ac-9ba1-483c-bb1e-8d8dc04b1596 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:53:49.297039 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-055fa448-c9c3-44c1-b77f-d7cc1106f571 tempest-InstanceActionsV221TestJSON-306668744 tempest-InstanceActionsV221TestJSON-306668744-project] 10.222.0.50 "GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596" status: 404 len: 111 microversion: 2.21 time: 0.065306 Aug 09 14:53:49.298093 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2223/4457] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:49 2022] GET /compute/v2.1/servers/afa761ac-9ba1-483c-bb1e-8d8dc04b1596 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:53:49.499397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4a353b0b-0625-4cbc-a684-57b7c8c3cf12 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:49.513162 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a353b0b-0625-4cbc-a684-57b7c8c3cf12 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1351 microversion: 2.1 time: 0.321412 Aug 09 14:53:49.513936 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2235/4458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:49 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1351 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:49.622118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1c49f51-00cc-4d54-b91d-1d05bb589b3f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:49.622757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1c49f51-00cc-4d54-b91d-1d05bb589b3f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:49.638462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1c49f51-00cc-4d54-b91d-1d05bb589b3f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:49.638954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1c49f51-00cc-4d54-b91d-1d05bb589b3f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:49.639408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1c49f51-00cc-4d54-b91d-1d05bb589b3f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:49.640112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1c49f51-00cc-4d54-b91d-1d05bb589b3f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:49.640553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1c49f51-00cc-4d54-b91d-1d05bb589b3f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:49.640966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1c49f51-00cc-4d54-b91d-1d05bb589b3f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:50.061894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d416b0c5-f72f-4711-9cb1-84dcf68a8e34 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:50.062517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d416b0c5-f72f-4711-9cb1-84dcf68a8e34 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:50.082641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d416b0c5-f72f-4711-9cb1-84dcf68a8e34 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:50.086822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d416b0c5-f72f-4711-9cb1-84dcf68a8e34 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:50.090508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d416b0c5-f72f-4711-9cb1-84dcf68a8e34 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:50.092652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d416b0c5-f72f-4711-9cb1-84dcf68a8e34 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:50.094286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d416b0c5-f72f-4711-9cb1-84dcf68a8e34 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:50.095969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d416b0c5-f72f-4711-9cb1-84dcf68a8e34 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:50.194918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1c49f51-00cc-4d54-b91d-1d05bb589b3f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:50.205428 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1c49f51-00cc-4d54-b91d-1d05bb589b3f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.587437 Aug 09 14:53:50.210186 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2224/4459] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:49 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:50.220566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1cbc73b9-343d-474c-ab45-2ad271ddb313 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:50.225860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1cbc73b9-343d-474c-ab45-2ad271ddb313 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:50.236162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cbc73b9-343d-474c-ab45-2ad271ddb313 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:50.238923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cbc73b9-343d-474c-ab45-2ad271ddb313 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:50.240691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cbc73b9-343d-474c-ab45-2ad271ddb313 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:50.241440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cbc73b9-343d-474c-ab45-2ad271ddb313 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:50.241900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cbc73b9-343d-474c-ab45-2ad271ddb313 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:50.242321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cbc73b9-343d-474c-ab45-2ad271ddb313 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:50.840979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d416b0c5-f72f-4711-9cb1-84dcf68a8e34 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:50.858440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d416b0c5-f72f-4711-9cb1-84dcf68a8e34 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:50.869963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d416b0c5-f72f-4711-9cb1-84dcf68a8e34 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:50.872976 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d416b0c5-f72f-4711-9cb1-84dcf68a8e34 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.816282 Aug 09 14:53:50.878277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1cbc73b9-343d-474c-ab45-2ad271ddb313 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:50.894024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1cbc73b9-343d-474c-ab45-2ad271ddb313 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:50.895851 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2236/4460] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:50 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:50.903717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1cbc73b9-343d-474c-ab45-2ad271ddb313 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:50.909429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42ec59cf-f43f-482f-8e24-0616dd49d33d tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:50.911754 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1cbc73b9-343d-474c-ab45-2ad271ddb313 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2945 microversion: 2.32 time: 0.699639 Aug 09 14:53:50.912360 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2225/4461] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:50 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2945 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:50.914935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42ec59cf-f43f-482f-8e24-0616dd49d33d tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:50.936498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ec59cf-f43f-482f-8e24-0616dd49d33d tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:50.937437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ec59cf-f43f-482f-8e24-0616dd49d33d tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:50.941895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ec59cf-f43f-482f-8e24-0616dd49d33d tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:50.942705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ec59cf-f43f-482f-8e24-0616dd49d33d tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:50.943212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ec59cf-f43f-482f-8e24-0616dd49d33d tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:50.943652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ec59cf-f43f-482f-8e24-0616dd49d33d tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:50.951827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-953bd44b-704e-4e52-b61b-d10491b8ac80 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:50.960838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-953bd44b-704e-4e52-b61b-d10491b8ac80 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:50.993752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-953bd44b-704e-4e52-b61b-d10491b8ac80 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:50.994846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-953bd44b-704e-4e52-b61b-d10491b8ac80 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:50.995522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-953bd44b-704e-4e52-b61b-d10491b8ac80 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:51.000917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-953bd44b-704e-4e52-b61b-d10491b8ac80 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:51.001633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-953bd44b-704e-4e52-b61b-d10491b8ac80 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:51.002263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-953bd44b-704e-4e52-b61b-d10491b8ac80 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:51.329470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42ec59cf-f43f-482f-8e24-0616dd49d33d tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:51.344203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42ec59cf-f43f-482f-8e24-0616dd49d33d tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:51.356835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42ec59cf-f43f-482f-8e24-0616dd49d33d tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:51.363647 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42ec59cf-f43f-482f-8e24-0616dd49d33d tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.462214 Aug 09 14:53:51.379719 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2237/4462] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:50 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:51.384555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-25ff16b1-b1c5-40b9-ab52-7ab75946c475 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:51.385879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-25ff16b1-b1c5-40b9-ab52-7ab75946c475 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:51.405177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25ff16b1-b1c5-40b9-ab52-7ab75946c475 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:51.406134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25ff16b1-b1c5-40b9-ab52-7ab75946c475 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:51.407507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25ff16b1-b1c5-40b9-ab52-7ab75946c475 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:51.409894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25ff16b1-b1c5-40b9-ab52-7ab75946c475 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:51.411438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25ff16b1-b1c5-40b9-ab52-7ab75946c475 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:51.413210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25ff16b1-b1c5-40b9-ab52-7ab75946c475 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:51.644399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-953bd44b-704e-4e52-b61b-d10491b8ac80 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:51.657358 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-953bd44b-704e-4e52-b61b-d10491b8ac80 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1469 microversion: 2.1 time: 0.712248 Aug 09 14:53:51.658545 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2226/4463] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:50 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1469 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:51.671682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da4ce753-54b8-48be-a0ae-65710b859df8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:51.672581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da4ce753-54b8-48be-a0ae-65710b859df8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:51.688495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da4ce753-54b8-48be-a0ae-65710b859df8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:51.689095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da4ce753-54b8-48be-a0ae-65710b859df8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:51.689540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da4ce753-54b8-48be-a0ae-65710b859df8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:51.690309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da4ce753-54b8-48be-a0ae-65710b859df8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:51.690675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da4ce753-54b8-48be-a0ae-65710b859df8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:51.695180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da4ce753-54b8-48be-a0ae-65710b859df8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:51.731758 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-25ff16b1-b1c5-40b9-ab52-7ab75946c475 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.356966 Aug 09 14:53:51.733076 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2238/4464] 10.222.0.50 () {60 vars in 1316 bytes} [Tue Aug 9 14:53:51 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00/os-interface => generated 1831 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:51.904361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b48e05d-46b6-4960-a9c5-6ef503f7b222 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:51.904876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b48e05d-46b6-4960-a9c5-6ef503f7b222 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:51.919589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b48e05d-46b6-4960-a9c5-6ef503f7b222 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:51.920339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b48e05d-46b6-4960-a9c5-6ef503f7b222 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:51.920958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b48e05d-46b6-4960-a9c5-6ef503f7b222 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:51.921851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b48e05d-46b6-4960-a9c5-6ef503f7b222 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:51.922457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b48e05d-46b6-4960-a9c5-6ef503f7b222 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:51.930428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b48e05d-46b6-4960-a9c5-6ef503f7b222 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:52.260833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-da4ce753-54b8-48be-a0ae-65710b859df8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:52.271747 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da4ce753-54b8-48be-a0ae-65710b859df8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.611590 Aug 09 14:53:52.297978 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2227/4465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:51 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:52.378912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0b48e05d-46b6-4960-a9c5-6ef503f7b222 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:52.389837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0b48e05d-46b6-4960-a9c5-6ef503f7b222 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:52.393517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0b48e05d-46b6-4960-a9c5-6ef503f7b222 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:52.393910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ccf48315-edfc-4771-b64b-6aa8b3880d16 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:52.394970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ccf48315-edfc-4771-b64b-6aa8b3880d16 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:52.407729 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b48e05d-46b6-4960-a9c5-6ef503f7b222 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.494620 Aug 09 14:53:52.408496 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2239/4466] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:51 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:52.418147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccf48315-edfc-4771-b64b-6aa8b3880d16 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:52.419145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccf48315-edfc-4771-b64b-6aa8b3880d16 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:52.421237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccf48315-edfc-4771-b64b-6aa8b3880d16 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:52.422486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccf48315-edfc-4771-b64b-6aa8b3880d16 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:52.423981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccf48315-edfc-4771-b64b-6aa8b3880d16 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:52.426979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccf48315-edfc-4771-b64b-6aa8b3880d16 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:52.507717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ccf48315-edfc-4771-b64b-6aa8b3880d16 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:52.520864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ccf48315-edfc-4771-b64b-6aa8b3880d16 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:52.523179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ccf48315-edfc-4771-b64b-6aa8b3880d16 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:52.525643 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ccf48315-edfc-4771-b64b-6aa8b3880d16 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.138909 Aug 09 14:53:52.527117 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2228/4467] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:52 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:52.678723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a6b51c3-ff6a-4862-98f0-92706caef6c5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:52.680460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a6b51c3-ff6a-4862-98f0-92706caef6c5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:52.688713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6b51c3-ff6a-4862-98f0-92706caef6c5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:52.689237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6b51c3-ff6a-4862-98f0-92706caef6c5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:52.691054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6b51c3-ff6a-4862-98f0-92706caef6c5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:52.691899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6b51c3-ff6a-4862-98f0-92706caef6c5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:52.692360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6b51c3-ff6a-4862-98f0-92706caef6c5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:52.692786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a6b51c3-ff6a-4862-98f0-92706caef6c5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:52.934064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a6b51c3-ff6a-4862-98f0-92706caef6c5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:52.942986 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a6b51c3-ff6a-4862-98f0-92706caef6c5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1469 microversion: 2.1 time: 0.268184 Aug 09 14:53:52.943892 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2240/4468] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:52 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:52.987520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-34bf2b95-9533-4be1-b8bd-e9d3a2eb79f8 req-e8a43fc9-fc04-40bb-98e0-5bc2915f6e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f7c79f-5422-4b54-8b30-6e43275685ca", "tag": "cba71fef-c335-4fa5-9aee-238338ee5ad7"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:52.996993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:53.012780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=12 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:53.026716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-34bf2b95-9533-4be1-b8bd-e9d3a2eb79f8 req-e8a43fc9-fc04-40bb-98e0-5bc2915f6e9c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:53.028353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-34bf2b95-9533-4be1-b8bd-e9d3a2eb79f8 req-e8a43fc9-fc04-40bb-98e0-5bc2915f6e9c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:53.031665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-34bf2b95-9533-4be1-b8bd-e9d3a2eb79f8 req-e8a43fc9-fc04-40bb-98e0-5bc2915f6e9c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:53.050838 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-34bf2b95-9533-4be1-b8bd-e9d3a2eb79f8 req-e8a43fc9-fc04-40bb-98e0-5bc2915f6e9c service nova] Creating event network-changed:cba71fef-c335-4fa5-9aee-238338ee5ad7 for instance 67f7c79f-5422-4b54-8b30-6e43275685ca on n-h1-844626-8 Aug 09 14:53:53.069677 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-34bf2b95-9533-4be1-b8bd-e9d3a2eb79f8 req-e8a43fc9-fc04-40bb-98e0-5bc2915f6e9c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092367 Aug 09 14:53:53.074056 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2229/4469] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:53:53.303924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5867ef16-bf15-41d5-abc2-637adfd7a1d9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:53.304545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5867ef16-bf15-41d5-abc2-637adfd7a1d9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:53.306516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:53.315651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5867ef16-bf15-41d5-abc2-637adfd7a1d9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:53.316150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5867ef16-bf15-41d5-abc2-637adfd7a1d9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:53.322919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5867ef16-bf15-41d5-abc2-637adfd7a1d9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:53.324006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5867ef16-bf15-41d5-abc2-637adfd7a1d9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:53.324741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5867ef16-bf15-41d5-abc2-637adfd7a1d9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:53.325426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5867ef16-bf15-41d5-abc2-637adfd7a1d9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:53.434373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8ede38c9-34f3-4a81-a676-3271e49bef38 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:53.435023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8ede38c9-34f3-4a81-a676-3271e49bef38 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:53.446318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ede38c9-34f3-4a81-a676-3271e49bef38 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:53.447010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ede38c9-34f3-4a81-a676-3271e49bef38 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:53.447664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ede38c9-34f3-4a81-a676-3271e49bef38 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:53.448589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ede38c9-34f3-4a81-a676-3271e49bef38 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:53.449198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ede38c9-34f3-4a81-a676-3271e49bef38 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:53.449960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ede38c9-34f3-4a81-a676-3271e49bef38 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:53.763298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5867ef16-bf15-41d5-abc2-637adfd7a1d9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:53.783378 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5867ef16-bf15-41d5-abc2-637adfd7a1d9 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.481023 Aug 09 14:53:53.796633 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2241/4470] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:53 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:53.805579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-143ce3a8-5793-4a02-b594-796ed9ebb23e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:53.807904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-143ce3a8-5793-4a02-b594-796ed9ebb23e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:53.820346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-143ce3a8-5793-4a02-b594-796ed9ebb23e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:53.821123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-143ce3a8-5793-4a02-b594-796ed9ebb23e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:53.821558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-143ce3a8-5793-4a02-b594-796ed9ebb23e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:53.822302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-143ce3a8-5793-4a02-b594-796ed9ebb23e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:53.822756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-143ce3a8-5793-4a02-b594-796ed9ebb23e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:53.823248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-143ce3a8-5793-4a02-b594-796ed9ebb23e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:53.863301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:53.937894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-143ce3a8-5793-4a02-b594-796ed9ebb23e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:53.949163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-143ce3a8-5793-4a02-b594-796ed9ebb23e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:53.951054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-143ce3a8-5793-4a02-b594-796ed9ebb23e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:53.952646 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-143ce3a8-5793-4a02-b594-796ed9ebb23e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.159892 Aug 09 14:53:53.953699 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2242/4471] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:53 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:53.972720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d0b8429-96e4-42ca-8f51-14fd7b9b1257 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:53.973780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d0b8429-96e4-42ca-8f51-14fd7b9b1257 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:53.987271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d0b8429-96e4-42ca-8f51-14fd7b9b1257 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:53.988070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d0b8429-96e4-42ca-8f51-14fd7b9b1257 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:53.988693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d0b8429-96e4-42ca-8f51-14fd7b9b1257 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:53.989581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d0b8429-96e4-42ca-8f51-14fd7b9b1257 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:53.990370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d0b8429-96e4-42ca-8f51-14fd7b9b1257 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:53.990955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d0b8429-96e4-42ca-8f51-14fd7b9b1257 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:54.008216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8ede38c9-34f3-4a81-a676-3271e49bef38 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:54.026474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8ede38c9-34f3-4a81-a676-3271e49bef38 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:54.030166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8ede38c9-34f3-4a81-a676-3271e49bef38 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:54.032520 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8ede38c9-34f3-4a81-a676-3271e49bef38 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.602767 Aug 09 14:53:54.040880 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2230/4472] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:53 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:54.267538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-faba90e9-4acc-4f9a-93eb-a317059e0c0d req-3ddf4890-e98e-457f-8a9a-b21dfce97a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcda666-d36a-488f-8fb0-fe12470ff45f", "name": "network-vif-plugged", "status": "completed", "tag": "9c42ace2-95a4-43eb-abf9-6c87e774f843"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:53:54.286457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-faba90e9-4acc-4f9a-93eb-a317059e0c0d req-3ddf4890-e98e-457f-8a9a-b21dfce97a36 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:54.291769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-faba90e9-4acc-4f9a-93eb-a317059e0c0d req-3ddf4890-e98e-457f-8a9a-b21dfce97a36 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:54.292467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-faba90e9-4acc-4f9a-93eb-a317059e0c0d req-3ddf4890-e98e-457f-8a9a-b21dfce97a36 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:54.332008 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-faba90e9-4acc-4f9a-93eb-a317059e0c0d req-3ddf4890-e98e-457f-8a9a-b21dfce97a36 service nova] Creating event network-vif-plugged:9c42ace2-95a4-43eb-abf9-6c87e774f843 for instance 9bcda666-d36a-488f-8fb0-fe12470ff45f on n-h1-844626-8 Aug 09 14:53:54.337292 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-faba90e9-4acc-4f9a-93eb-a317059e0c0d req-3ddf4890-e98e-457f-8a9a-b21dfce97a36 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074428 Aug 09 14:53:54.337924 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2231/4473] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:53:54.703755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d0b8429-96e4-42ca-8f51-14fd7b9b1257 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:54.713883 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d0b8429-96e4-42ca-8f51-14fd7b9b1257 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1469 microversion: 2.1 time: 0.744666 Aug 09 14:53:54.715346 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2243/4474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:53 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1469 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:53:54.806744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e75ccd05-0029-481e-af29-6007c7aa5ea6 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:54.807696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e75ccd05-0029-481e-af29-6007c7aa5ea6 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:54.822552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e75ccd05-0029-481e-af29-6007c7aa5ea6 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:54.827713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e75ccd05-0029-481e-af29-6007c7aa5ea6 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:54.828594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e75ccd05-0029-481e-af29-6007c7aa5ea6 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:54.829626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e75ccd05-0029-481e-af29-6007c7aa5ea6 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:54.830161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e75ccd05-0029-481e-af29-6007c7aa5ea6 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:54.830652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e75ccd05-0029-481e-af29-6007c7aa5ea6 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:54.980270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dd2e2c1c-f234-46a7-a447-f6f5d017b2ad tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:54.982361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dd2e2c1c-f234-46a7-a447-f6f5d017b2ad tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:54.997935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:53:55.000818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd2e2c1c-f234-46a7-a447-f6f5d017b2ad tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:55.001688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd2e2c1c-f234-46a7-a447-f6f5d017b2ad tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:55.002313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd2e2c1c-f234-46a7-a447-f6f5d017b2ad tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:55.010587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd2e2c1c-f234-46a7-a447-f6f5d017b2ad tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:55.011542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd2e2c1c-f234-46a7-a447-f6f5d017b2ad tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:55.012151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd2e2c1c-f234-46a7-a447-f6f5d017b2ad tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:55.136235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd2e2c1c-f234-46a7-a447-f6f5d017b2ad tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:55.146671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd2e2c1c-f234-46a7-a447-f6f5d017b2ad tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:55.149415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd2e2c1c-f234-46a7-a447-f6f5d017b2ad tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:55.151370 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dd2e2c1c-f234-46a7-a447-f6f5d017b2ad tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.179357 Aug 09 14:53:55.152526 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2244/4475] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:54 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:55.158920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe9e7414-67fb-4931-af5b-4eebd7ebc5df tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:55.159875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fe9e7414-67fb-4931-af5b-4eebd7ebc5df tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:55.164003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e75ccd05-0029-481e-af29-6007c7aa5ea6 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:55.175760 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e75ccd05-0029-481e-af29-6007c7aa5ea6 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.373665 Aug 09 14:53:55.180268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe9e7414-67fb-4931-af5b-4eebd7ebc5df tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:55.181603 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2232/4476] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:54 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:55.182252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe9e7414-67fb-4931-af5b-4eebd7ebc5df tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:55.182797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe9e7414-67fb-4931-af5b-4eebd7ebc5df tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:55.183638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe9e7414-67fb-4931-af5b-4eebd7ebc5df tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:55.184299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe9e7414-67fb-4931-af5b-4eebd7ebc5df tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:55.184947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe9e7414-67fb-4931-af5b-4eebd7ebc5df tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:55.572806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fe9e7414-67fb-4931-af5b-4eebd7ebc5df tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:55.572806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fe9e7414-67fb-4931-af5b-4eebd7ebc5df tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:55.572806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fe9e7414-67fb-4931-af5b-4eebd7ebc5df tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:55.572806 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fe9e7414-67fb-4931-af5b-4eebd7ebc5df tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.317332 Aug 09 14:53:55.572806 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2245/4477] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:55 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:55.743757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-351392b1-fbd7-4787-b6ae-5fc3637cb669 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:55.744347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-351392b1-fbd7-4787-b6ae-5fc3637cb669 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:55.751757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-351392b1-fbd7-4787-b6ae-5fc3637cb669 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:55.752309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-351392b1-fbd7-4787-b6ae-5fc3637cb669 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:55.752887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-351392b1-fbd7-4787-b6ae-5fc3637cb669 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:55.755505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-351392b1-fbd7-4787-b6ae-5fc3637cb669 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:55.756703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-351392b1-fbd7-4787-b6ae-5fc3637cb669 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:55.756703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-351392b1-fbd7-4787-b6ae-5fc3637cb669 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:56.068965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-351392b1-fbd7-4787-b6ae-5fc3637cb669 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:56.088700 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-351392b1-fbd7-4787-b6ae-5fc3637cb669 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1469 microversion: 2.1 time: 0.357114 Aug 09 14:53:56.089815 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2233/4478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:55 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1469 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:56.178126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e006b9f9-91be-4b1e-8eac-beeaa6bf20ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:56.178746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e006b9f9-91be-4b1e-8eac-beeaa6bf20ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:56.195044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e006b9f9-91be-4b1e-8eac-beeaa6bf20ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:56.195977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e006b9f9-91be-4b1e-8eac-beeaa6bf20ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:56.196648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e006b9f9-91be-4b1e-8eac-beeaa6bf20ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:56.202218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-acb4f313-f17d-4e0e-81a5-357cec228fe0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:56.203654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-acb4f313-f17d-4e0e-81a5-357cec228fe0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:56.207798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e006b9f9-91be-4b1e-8eac-beeaa6bf20ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:56.211542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e006b9f9-91be-4b1e-8eac-beeaa6bf20ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:56.212261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e006b9f9-91be-4b1e-8eac-beeaa6bf20ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:56.213754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acb4f313-f17d-4e0e-81a5-357cec228fe0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:56.216483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acb4f313-f17d-4e0e-81a5-357cec228fe0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:56.217195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acb4f313-f17d-4e0e-81a5-357cec228fe0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:56.218124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acb4f313-f17d-4e0e-81a5-357cec228fe0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:56.218765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acb4f313-f17d-4e0e-81a5-357cec228fe0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:56.220231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acb4f313-f17d-4e0e-81a5-357cec228fe0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:56.434071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e006b9f9-91be-4b1e-8eac-beeaa6bf20ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:56.446676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e006b9f9-91be-4b1e-8eac-beeaa6bf20ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:56.450131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e006b9f9-91be-4b1e-8eac-beeaa6bf20ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:56.452417 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e006b9f9-91be-4b1e-8eac-beeaa6bf20ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.278510 Aug 09 14:53:56.471773 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2246/4479] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:56 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:56.498428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-363fbb77-9e2f-4ee0-81ce-a639c0cc08d7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:56.499227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-363fbb77-9e2f-4ee0-81ce-a639c0cc08d7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:56.507178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-363fbb77-9e2f-4ee0-81ce-a639c0cc08d7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:56.507819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-363fbb77-9e2f-4ee0-81ce-a639c0cc08d7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:56.508449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-363fbb77-9e2f-4ee0-81ce-a639c0cc08d7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:56.509357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-363fbb77-9e2f-4ee0-81ce-a639c0cc08d7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:56.509906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-363fbb77-9e2f-4ee0-81ce-a639c0cc08d7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:56.510424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-363fbb77-9e2f-4ee0-81ce-a639c0cc08d7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:56.767877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-acb4f313-f17d-4e0e-81a5-357cec228fe0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:56.788588 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-acb4f313-f17d-4e0e-81a5-357cec228fe0 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.590374 Aug 09 14:53:56.807710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-363fbb77-9e2f-4ee0-81ce-a639c0cc08d7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:56.815684 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2234/4480] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:56 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:56.818914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-363fbb77-9e2f-4ee0-81ce-a639c0cc08d7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:56.820522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-363fbb77-9e2f-4ee0-81ce-a639c0cc08d7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:56.821801 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-363fbb77-9e2f-4ee0-81ce-a639c0cc08d7 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.327239 Aug 09 14:53:56.822787 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2247/4481] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:56 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:57.110369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5972b91-9530-4d8b-bf5d-d5d915089f99 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:57.110934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5972b91-9530-4d8b-bf5d-d5d915089f99 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:57.122319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5972b91-9530-4d8b-bf5d-d5d915089f99 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:57.123029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5972b91-9530-4d8b-bf5d-d5d915089f99 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:57.123518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5972b91-9530-4d8b-bf5d-d5d915089f99 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:57.124222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5972b91-9530-4d8b-bf5d-d5d915089f99 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:57.124670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5972b91-9530-4d8b-bf5d-d5d915089f99 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:57.125084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5972b91-9530-4d8b-bf5d-d5d915089f99 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:57.469541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5972b91-9530-4d8b-bf5d-d5d915089f99 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:57.477767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3292d9c-67b1-4be6-b93b-3930232d0658 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:57.478407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3292d9c-67b1-4be6-b93b-3930232d0658 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:57.485393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3292d9c-67b1-4be6-b93b-3930232d0658 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:57.485808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3292d9c-67b1-4be6-b93b-3930232d0658 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:57.486243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3292d9c-67b1-4be6-b93b-3930232d0658 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:57.486927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3292d9c-67b1-4be6-b93b-3930232d0658 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:57.490944 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5972b91-9530-4d8b-bf5d-d5d915089f99 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1469 microversion: 2.1 time: 0.384435 Aug 09 14:53:57.493754 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2235/4482] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:57 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1469 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:57.494262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3292d9c-67b1-4be6-b93b-3930232d0658 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:57.494828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3292d9c-67b1-4be6-b93b-3930232d0658 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:57.595052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b3292d9c-67b1-4be6-b93b-3930232d0658 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:57.614034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b3292d9c-67b1-4be6-b93b-3930232d0658 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:57.619665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b3292d9c-67b1-4be6-b93b-3930232d0658 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:57.624394 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3292d9c-67b1-4be6-b93b-3930232d0658 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.150414 Aug 09 14:53:57.627303 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2248/4483] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:57 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:57.809869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a7667d2-1024-4d63-9d2c-8a5e0eb0cb92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:57.810586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a7667d2-1024-4d63-9d2c-8a5e0eb0cb92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:57.848855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e86e65a-f8aa-4c92-aa7b-89a050163106 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:57.849678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2e86e65a-f8aa-4c92-aa7b-89a050163106 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:57.850582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a7667d2-1024-4d63-9d2c-8a5e0eb0cb92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:57.851530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a7667d2-1024-4d63-9d2c-8a5e0eb0cb92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:57.852347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a7667d2-1024-4d63-9d2c-8a5e0eb0cb92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:57.853511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a7667d2-1024-4d63-9d2c-8a5e0eb0cb92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:57.854277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a7667d2-1024-4d63-9d2c-8a5e0eb0cb92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:57.855138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a7667d2-1024-4d63-9d2c-8a5e0eb0cb92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:57.856706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e86e65a-f8aa-4c92-aa7b-89a050163106 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:57.857175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e86e65a-f8aa-4c92-aa7b-89a050163106 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:57.857604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e86e65a-f8aa-4c92-aa7b-89a050163106 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:57.858288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e86e65a-f8aa-4c92-aa7b-89a050163106 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:57.858970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e86e65a-f8aa-4c92-aa7b-89a050163106 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:57.859754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e86e65a-f8aa-4c92-aa7b-89a050163106 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:58.361966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2e86e65a-f8aa-4c92-aa7b-89a050163106 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:58.373405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2e86e65a-f8aa-4c92-aa7b-89a050163106 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:58.375960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2e86e65a-f8aa-4c92-aa7b-89a050163106 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:58.377427 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2e86e65a-f8aa-4c92-aa7b-89a050163106 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1729 microversion: 2.20 time: 0.533227 Aug 09 14:53:58.378935 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2249/4484] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:57 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1729 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:58.390492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3a7667d2-1024-4d63-9d2c-8a5e0eb0cb92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:58.400925 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a7667d2-1024-4d63-9d2c-8a5e0eb0cb92 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.595008 Aug 09 14:53:58.401521 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2236/4485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:57 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:53:58.517068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c085373-44af-438b-9305-fac38bd285cd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:58.519566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c085373-44af-438b-9305-fac38bd285cd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:58.533863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c085373-44af-438b-9305-fac38bd285cd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:58.534399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c085373-44af-438b-9305-fac38bd285cd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:58.534837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c085373-44af-438b-9305-fac38bd285cd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:58.545424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c085373-44af-438b-9305-fac38bd285cd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:58.545998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c085373-44af-438b-9305-fac38bd285cd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:58.546735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c085373-44af-438b-9305-fac38bd285cd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:58.650847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d5b988ef-3556-4692-91ae-5c7227112a2b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:58.652625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d5b988ef-3556-4692-91ae-5c7227112a2b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:58.663232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5b988ef-3556-4692-91ae-5c7227112a2b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:58.665057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5b988ef-3556-4692-91ae-5c7227112a2b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:58.665505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5b988ef-3556-4692-91ae-5c7227112a2b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:58.668212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5b988ef-3556-4692-91ae-5c7227112a2b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:58.668728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5b988ef-3556-4692-91ae-5c7227112a2b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:58.669159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5b988ef-3556-4692-91ae-5c7227112a2b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:58.837079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c085373-44af-438b-9305-fac38bd285cd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:58.839514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d5b988ef-3556-4692-91ae-5c7227112a2b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:58.846013 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c085373-44af-438b-9305-fac38bd285cd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1469 microversion: 2.1 time: 0.336155 Aug 09 14:53:58.849775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d5b988ef-3556-4692-91ae-5c7227112a2b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:58.851502 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2250/4486] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:58 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1469 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:53:58.865585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d5b988ef-3556-4692-91ae-5c7227112a2b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:58.867719 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d5b988ef-3556-4692-91ae-5c7227112a2b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.221619 Aug 09 14:53:58.884254 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2237/4487] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:58 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:53:59.418554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:59.419659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:59.423064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-920038fd-6427-4eca-8020-1507928887a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:59.423720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-920038fd-6427-4eca-8020-1507928887a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:59.431260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-920038fd-6427-4eca-8020-1507928887a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:59.431870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-920038fd-6427-4eca-8020-1507928887a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:59.432306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-920038fd-6427-4eca-8020-1507928887a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:59.433146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-920038fd-6427-4eca-8020-1507928887a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:59.433791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-920038fd-6427-4eca-8020-1507928887a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:59.434354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-920038fd-6427-4eca-8020-1507928887a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:59.438469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:59.438980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:59.444796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:59.445625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:59.446099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:59.446534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:59.705671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:59.716963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:59.718879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:59.720279 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1716 microversion: 2.20 time: 0.317723 Aug 09 14:53:59.721016 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2251/4488] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:59 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1716 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:53:59.743380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:59.744608 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9593dfc9-8039-419b-87b3-df86ddf7fcda tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001583 Aug 09 14:53:59.744906 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2252/4489] 10.222.0.50 () {56 vars in 886 bytes} [Tue Aug 9 14:53:59 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 09 14:53:59.785443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-920038fd-6427-4eca-8020-1507928887a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:53:59.805732 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-920038fd-6427-4eca-8020-1507928887a1 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.387053 Aug 09 14:53:59.810333 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2238/4490] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:59 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:53:59.873905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17acc253-1eff-440a-9016-be8fc4bd2ecd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:59.874616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17acc253-1eff-440a-9016-be8fc4bd2ecd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:59.882228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17acc253-1eff-440a-9016-be8fc4bd2ecd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:59.883101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17acc253-1eff-440a-9016-be8fc4bd2ecd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:59.883858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17acc253-1eff-440a-9016-be8fc4bd2ecd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:59.887287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17acc253-1eff-440a-9016-be8fc4bd2ecd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:59.888240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17acc253-1eff-440a-9016-be8fc4bd2ecd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:59.889181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17acc253-1eff-440a-9016-be8fc4bd2ecd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:59.891834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ffbceb6d-64da-454f-a1c5-3f6de6334c4b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:53:59.892458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ffbceb6d-64da-454f-a1c5-3f6de6334c4b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:53:59.907293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffbceb6d-64da-454f-a1c5-3f6de6334c4b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:59.908103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffbceb6d-64da-454f-a1c5-3f6de6334c4b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:59.908729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffbceb6d-64da-454f-a1c5-3f6de6334c4b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:53:59.909662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffbceb6d-64da-454f-a1c5-3f6de6334c4b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:53:59.912624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffbceb6d-64da-454f-a1c5-3f6de6334c4b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:53:59.913269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ffbceb6d-64da-454f-a1c5-3f6de6334c4b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:00.045114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffbceb6d-64da-454f-a1c5-3f6de6334c4b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:00.055592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffbceb6d-64da-454f-a1c5-3f6de6334c4b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:00.058903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ffbceb6d-64da-454f-a1c5-3f6de6334c4b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:00.060483 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ffbceb6d-64da-454f-a1c5-3f6de6334c4b tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.172801 Aug 09 14:54:00.071599 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2239/4491] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:53:59 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:00.082707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-d409688f-ca51-454c-8c63-98689cd4114a req-5ba06bf3-085d-45c9-ac8e-5ed1cfa2aff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f7c79f-5422-4b54-8b30-6e43275685ca", "name": "network-vif-plugged", "status": "completed", "tag": "cba71fef-c335-4fa5-9aee-238338ee5ad7"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:54:00.094503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d409688f-ca51-454c-8c63-98689cd4114a req-5ba06bf3-085d-45c9-ac8e-5ed1cfa2aff1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:00.095337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d409688f-ca51-454c-8c63-98689cd4114a req-5ba06bf3-085d-45c9-ac8e-5ed1cfa2aff1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:00.095931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d409688f-ca51-454c-8c63-98689cd4114a req-5ba06bf3-085d-45c9-ac8e-5ed1cfa2aff1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:00.110770 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d409688f-ca51-454c-8c63-98689cd4114a req-5ba06bf3-085d-45c9-ac8e-5ed1cfa2aff1 service nova] Creating event network-vif-plugged:cba71fef-c335-4fa5-9aee-238338ee5ad7 for instance 67f7c79f-5422-4b54-8b30-6e43275685ca on n-h1-844626-8 Aug 09 14:54:00.123244 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-d409688f-ca51-454c-8c63-98689cd4114a req-5ba06bf3-085d-45c9-ac8e-5ed1cfa2aff1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048636 Aug 09 14:54:00.133556 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2240/4492] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:00.176013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-17acc253-1eff-440a-9016-be8fc4bd2ecd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:00.192965 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17acc253-1eff-440a-9016-be8fc4bd2ecd tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1469 microversion: 2.1 time: 0.323320 Aug 09 14:54:00.208426 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2253/4493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:53:59 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1469 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:00.832057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d10015fb-39b8-49c0-b4c8-f5ea6538138b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:00.833597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d10015fb-39b8-49c0-b4c8-f5ea6538138b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:00.842172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d10015fb-39b8-49c0-b4c8-f5ea6538138b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:00.843020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d10015fb-39b8-49c0-b4c8-f5ea6538138b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:00.844248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d10015fb-39b8-49c0-b4c8-f5ea6538138b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:00.845150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d10015fb-39b8-49c0-b4c8-f5ea6538138b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:00.845901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d10015fb-39b8-49c0-b4c8-f5ea6538138b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:00.846485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d10015fb-39b8-49c0-b4c8-f5ea6538138b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:01.088608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b27e054-0719-4180-956e-d696e88c04e8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:01.089470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b27e054-0719-4180-956e-d696e88c04e8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:01.109407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b27e054-0719-4180-956e-d696e88c04e8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:01.112832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b27e054-0719-4180-956e-d696e88c04e8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:01.113693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b27e054-0719-4180-956e-d696e88c04e8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:01.117550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b27e054-0719-4180-956e-d696e88c04e8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:01.118317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b27e054-0719-4180-956e-d696e88c04e8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:01.120005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b27e054-0719-4180-956e-d696e88c04e8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:01.201261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d10015fb-39b8-49c0-b4c8-f5ea6538138b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:01.205710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:54:01.218198 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d10015fb-39b8-49c0-b4c8-f5ea6538138b tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.391072 Aug 09 14:54:01.218797 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2241/4494] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:00 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:01.236448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-580fe5f0-2b84-4338-b442-4b2553482763 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:01.237351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-580fe5f0-2b84-4338-b442-4b2553482763 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:01.260837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-580fe5f0-2b84-4338-b442-4b2553482763 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:01.261333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-580fe5f0-2b84-4338-b442-4b2553482763 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:01.262062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-580fe5f0-2b84-4338-b442-4b2553482763 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:01.262931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-580fe5f0-2b84-4338-b442-4b2553482763 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:01.266600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-580fe5f0-2b84-4338-b442-4b2553482763 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:01.267529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-580fe5f0-2b84-4338-b442-4b2553482763 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:01.314490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2b27e054-0719-4180-956e-d696e88c04e8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:01.358300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2b27e054-0719-4180-956e-d696e88c04e8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:01.365786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2b27e054-0719-4180-956e-d696e88c04e8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:01.367443 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b27e054-0719-4180-956e-d696e88c04e8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.284842 Aug 09 14:54:01.372725 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2254/4495] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:01 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:01.743070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-580fe5f0-2b84-4338-b442-4b2553482763 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:01.751607 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-580fe5f0-2b84-4338-b442-4b2553482763 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1469 microversion: 2.1 time: 0.525096 Aug 09 14:54:01.752158 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2242/4496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:01 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1469 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:02.107238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d5d028c9-ff00-4821-855c-66062b7fbd8b tempest-QuotasTestJSON-1452409028 tempest-QuotasTestJSON-1452409028-project] Calling method '.version_select at 0x7f41ddadf3a0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:02.169407 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d5d028c9-ff00-4821-855c-66062b7fbd8b tempest-QuotasTestJSON-1452409028 tempest-QuotasTestJSON-1452409028-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/514fc65b770545c5bb183c33280e6db8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.246986 Aug 09 14:54:02.170445 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2255/4497] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:54:01 2022] GET /compute/v2.1/os-quota-sets/514fc65b770545c5bb183c33280e6db8/defaults => generated 371 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:02.182100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-47d6dfe9-6dcf-46c1-a9fd-bb1727a2ff6f tempest-QuotasTestJSON-1452409028 tempest-QuotasTestJSON-1452409028-project] Calling method '.version_select at 0x7f41dc76c5e0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:02.246687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cce0260b-a1a2-457a-8571-e417b0767afa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:02.247674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cce0260b-a1a2-457a-8571-e417b0767afa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:02.258664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cce0260b-a1a2-457a-8571-e417b0767afa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:02.259188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cce0260b-a1a2-457a-8571-e417b0767afa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:02.260049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cce0260b-a1a2-457a-8571-e417b0767afa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:02.261523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cce0260b-a1a2-457a-8571-e417b0767afa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:02.262933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cce0260b-a1a2-457a-8571-e417b0767afa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:02.263576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cce0260b-a1a2-457a-8571-e417b0767afa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:02.282007 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-47d6dfe9-6dcf-46c1-a9fd-bb1727a2ff6f tempest-QuotasTestJSON-1452409028 tempest-QuotasTestJSON-1452409028-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/514fc65b770545c5bb183c33280e6db8" status: 200 len: 371 microversion: 2.1 time: 0.103695 Aug 09 14:54:02.282932 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2243/4498] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 9 14:54:02 2022] GET /compute/v2.1/os-quota-sets/514fc65b770545c5bb183c33280e6db8 => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:02.297419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93aca40f-bdfd-41ed-9cb0-85ca9aa218ad tempest-QuotasTestJSON-1452409028 tempest-QuotasTestJSON-1452409028-project] Calling method '.version_select at 0x7f41dc7829d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:02.400604 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93aca40f-bdfd-41ed-9cb0-85ca9aa218ad tempest-QuotasTestJSON-1452409028 tempest-QuotasTestJSON-1452409028-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/514fc65b770545c5bb183c33280e6db8/defaults" status: 200 len: 371 microversion: 2.1 time: 0.108159 Aug 09 14:54:02.401405 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2244/4499] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 14:54:02 2022] GET /compute/v2.1/os-quota-sets/514fc65b770545c5bb183c33280e6db8/defaults => generated 371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:54:02.406133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b37a0774-7456-4bad-b6bb-c9f3ad8e59f9 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:02.407757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b37a0774-7456-4bad-b6bb-c9f3ad8e59f9 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:02.417564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b37a0774-7456-4bad-b6bb-c9f3ad8e59f9 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:02.418273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b37a0774-7456-4bad-b6bb-c9f3ad8e59f9 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:02.418957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b37a0774-7456-4bad-b6bb-c9f3ad8e59f9 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:02.420074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b37a0774-7456-4bad-b6bb-c9f3ad8e59f9 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:02.420846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b37a0774-7456-4bad-b6bb-c9f3ad8e59f9 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:02.421608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b37a0774-7456-4bad-b6bb-c9f3ad8e59f9 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:02.546626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b37a0774-7456-4bad-b6bb-c9f3ad8e59f9 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:02.558973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b37a0774-7456-4bad-b6bb-c9f3ad8e59f9 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:02.560681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b37a0774-7456-4bad-b6bb-c9f3ad8e59f9 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:02.562126 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b37a0774-7456-4bad-b6bb-c9f3ad8e59f9 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.159478 Aug 09 14:54:02.568372 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2245/4500] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:02 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:02.574343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cce0260b-a1a2-457a-8571-e417b0767afa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:02.583428 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cce0260b-a1a2-457a-8571-e417b0767afa tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.343396 Aug 09 14:54:02.584767 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2256/4501] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:02 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:02.595880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9822cec6-4656-4801-a846-3fc675a828f4 tempest-QuotasTestJSON-1452409028 tempest-QuotasTestJSON-1452409028-project] Calling method '.version_select at 0x7f41dc745a60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:02.669736 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9822cec6-4656-4801-a846-3fc675a828f4 tempest-QuotasTestJSON-1452409028 tempest-QuotasTestJSON-1452409028-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/514fc65b770545c5bb183c33280e6db8" status: 200 len: 371 microversion: 2.1 time: 0.099231 Aug 09 14:54:02.671190 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2246/4502] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 9 14:54:02 2022] GET /compute/v2.1/os-quota-sets/514fc65b770545c5bb183c33280e6db8 => generated 371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:02.683890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dae04f0b-976a-4964-beaf-1b48ea610bc5 tempest-QuotasTestJSON-1452409028 tempest-QuotasTestJSON-1452409028-project] Calling method '.version_select at 0x7f41ddd7ed30>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:02.773930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40855058-fad3-4fa3-a864-9fe8cc16155c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:02.774647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40855058-fad3-4fa3-a864-9fe8cc16155c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:02.779698 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dae04f0b-976a-4964-beaf-1b48ea610bc5 tempest-QuotasTestJSON-1452409028 tempest-QuotasTestJSON-1452409028-project] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/514fc65b770545c5bb183c33280e6db8?user_id=aa869d00f1284ffbb3c2bcb24fc30e90" status: 200 len: 371 microversion: 2.1 time: 0.099697 Aug 09 14:54:02.780629 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2257/4503] 10.222.0.50 () {58 vars in 1323 bytes} [Tue Aug 9 14:54:02 2022] GET /compute/v2.1/os-quota-sets/514fc65b770545c5bb183c33280e6db8?user_id=aa869d00f1284ffbb3c2bcb24fc30e90 => generated 371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:02.789709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40855058-fad3-4fa3-a864-9fe8cc16155c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:02.790195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40855058-fad3-4fa3-a864-9fe8cc16155c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:02.790634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40855058-fad3-4fa3-a864-9fe8cc16155c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:02.791380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40855058-fad3-4fa3-a864-9fe8cc16155c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:02.791835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40855058-fad3-4fa3-a864-9fe8cc16155c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:02.792265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40855058-fad3-4fa3-a864-9fe8cc16155c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:03.019108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40855058-fad3-4fa3-a864-9fe8cc16155c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:03.029372 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40855058-fad3-4fa3-a864-9fe8cc16155c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1640 microversion: 2.1 time: 0.260237 Aug 09 14:54:03.031867 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2247/4504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:02 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1640 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:03.051574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5cb48420-6734-4584-b6ee-1d7ff78a04f7 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:03.052539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5cb48420-6734-4584-b6ee-1d7ff78a04f7 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:03.059428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cb48420-6734-4584-b6ee-1d7ff78a04f7 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:03.060166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cb48420-6734-4584-b6ee-1d7ff78a04f7 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:03.060800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cb48420-6734-4584-b6ee-1d7ff78a04f7 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:03.061760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cb48420-6734-4584-b6ee-1d7ff78a04f7 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:03.062299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cb48420-6734-4584-b6ee-1d7ff78a04f7 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:03.062794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cb48420-6734-4584-b6ee-1d7ff78a04f7 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:03.275779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cb48420-6734-4584-b6ee-1d7ff78a04f7 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:03.285425 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5cb48420-6734-4584-b6ee-1d7ff78a04f7 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1640 microversion: 2.1 time: 0.237663 Aug 09 14:54:03.286439 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2258/4505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:03 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1640 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:03.320687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d5928340-2a87-44b0-ad32-5e37c6e924a5 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:03.322486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d5928340-2a87-44b0-ad32-5e37c6e924a5 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:03.331555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5928340-2a87-44b0-ad32-5e37c6e924a5 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:03.332728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5928340-2a87-44b0-ad32-5e37c6e924a5 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:03.333372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5928340-2a87-44b0-ad32-5e37c6e924a5 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:03.334665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5928340-2a87-44b0-ad32-5e37c6e924a5 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:03.335764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5928340-2a87-44b0-ad32-5e37c6e924a5 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:03.336205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5928340-2a87-44b0-ad32-5e37c6e924a5 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:03.586961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-21cd0486-2f93-4bde-8a16-187ecfc8a15f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:03.587629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-21cd0486-2f93-4bde-8a16-187ecfc8a15f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:03.600636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21cd0486-2f93-4bde-8a16-187ecfc8a15f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:03.601155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21cd0486-2f93-4bde-8a16-187ecfc8a15f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:03.601637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21cd0486-2f93-4bde-8a16-187ecfc8a15f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:03.602646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21cd0486-2f93-4bde-8a16-187ecfc8a15f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:03.602927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21cd0486-2f93-4bde-8a16-187ecfc8a15f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:03.603320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21cd0486-2f93-4bde-8a16-187ecfc8a15f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:03.743266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-21cd0486-2f93-4bde-8a16-187ecfc8a15f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:03.767618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-21cd0486-2f93-4bde-8a16-187ecfc8a15f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:03.773628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-21cd0486-2f93-4bde-8a16-187ecfc8a15f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:03.777049 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-21cd0486-2f93-4bde-8a16-187ecfc8a15f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.194224 Aug 09 14:54:03.781364 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2259/4506] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:03 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:03.795218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-677b2c37-2a0d-4ec7-b050-ebea8a58dd95 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:03.798823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-677b2c37-2a0d-4ec7-b050-ebea8a58dd95 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:03.833654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677b2c37-2a0d-4ec7-b050-ebea8a58dd95 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:03.834000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677b2c37-2a0d-4ec7-b050-ebea8a58dd95 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:03.834552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677b2c37-2a0d-4ec7-b050-ebea8a58dd95 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:03.835178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677b2c37-2a0d-4ec7-b050-ebea8a58dd95 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:03.835807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677b2c37-2a0d-4ec7-b050-ebea8a58dd95 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:03.836035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-677b2c37-2a0d-4ec7-b050-ebea8a58dd95 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:04.040388 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d5928340-2a87-44b0-ad32-5e37c6e924a5 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1791 microversion: 2.1 time: 0.724514 Aug 09 14:54:04.042191 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2248/4507] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:03 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1791 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:04.159800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-677b2c37-2a0d-4ec7-b050-ebea8a58dd95 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:04.171685 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-677b2c37-2a0d-4ec7-b050-ebea8a58dd95 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.388796 Aug 09 14:54:04.173676 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2260/4508] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:03 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:04.802782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-41f98937-1d1f-42b0-8af0-0ca80b91e365 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:04.806363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-41f98937-1d1f-42b0-8af0-0ca80b91e365 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:04.817083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41f98937-1d1f-42b0-8af0-0ca80b91e365 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:04.817942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41f98937-1d1f-42b0-8af0-0ca80b91e365 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:04.818583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41f98937-1d1f-42b0-8af0-0ca80b91e365 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:04.820234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41f98937-1d1f-42b0-8af0-0ca80b91e365 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:04.820910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41f98937-1d1f-42b0-8af0-0ca80b91e365 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:04.821534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41f98937-1d1f-42b0-8af0-0ca80b91e365 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:04.900176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-41f98937-1d1f-42b0-8af0-0ca80b91e365 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:04.909742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-41f98937-1d1f-42b0-8af0-0ca80b91e365 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:04.911314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-41f98937-1d1f-42b0-8af0-0ca80b91e365 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:04.912523 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-41f98937-1d1f-42b0-8af0-0ca80b91e365 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.114723 Aug 09 14:54:04.913399 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2249/4509] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:04 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:05.194269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fc304097-39d1-4751-ba3f-7ccaf17c8935 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:05.195576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fc304097-39d1-4751-ba3f-7ccaf17c8935 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:05.214629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc304097-39d1-4751-ba3f-7ccaf17c8935 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:05.215209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc304097-39d1-4751-ba3f-7ccaf17c8935 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:05.215644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc304097-39d1-4751-ba3f-7ccaf17c8935 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:05.216338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc304097-39d1-4751-ba3f-7ccaf17c8935 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:05.216777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc304097-39d1-4751-ba3f-7ccaf17c8935 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:05.217186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc304097-39d1-4751-ba3f-7ccaf17c8935 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:05.497656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fc304097-39d1-4751-ba3f-7ccaf17c8935 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:05.501343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:54:05.510567 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fc304097-39d1-4751-ba3f-7ccaf17c8935 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.320128 Aug 09 14:54:05.514589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf85f020-0379-4d8d-a423-984a7d3ae9ed tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] Action: 'create', calling method: .version_select at 0x7f41dcb39430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2053148451", "metadata": {"Type": "work"}}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:54:05.516636 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2261/4510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:05 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:05.940077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-02c41add-0be2-49ae-92d8-5766353fbe1c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:05.941339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-02c41add-0be2-49ae-92d8-5766353fbe1c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:05.963048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02c41add-0be2-49ae-92d8-5766353fbe1c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:05.965987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02c41add-0be2-49ae-92d8-5766353fbe1c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:05.966504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02c41add-0be2-49ae-92d8-5766353fbe1c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:05.967373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02c41add-0be2-49ae-92d8-5766353fbe1c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:05.972185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02c41add-0be2-49ae-92d8-5766353fbe1c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:05.972884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02c41add-0be2-49ae-92d8-5766353fbe1c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:06.088325 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf85f020-0379-4d8d-a423-984a7d3ae9ed tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.768836 Aug 09 14:54:06.089161 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2250/4511] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Aug 9 14:54:05 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 770 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 14:54:06.102859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c46d8250-7c12-468a-b9f6-8fc017f17150 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] Calling method '.version_select at 0x7f41dc720160>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:06.151902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-02c41add-0be2-49ae-92d8-5766353fbe1c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:06.186400 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c46d8250-7c12-468a-b9f6-8fc017f17150 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f" status: 200 len: 353 microversion: 2.1 time: 0.086365 Aug 09 14:54:06.189407 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2251/4512] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:54:06 2022] GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:06.190055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-02c41add-0be2-49ae-92d8-5766353fbe1c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:06.197847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-02c41add-0be2-49ae-92d8-5766353fbe1c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:06.201433 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-02c41add-0be2-49ae-92d8-5766353fbe1c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.265847 Aug 09 14:54:06.211863 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2262/4513] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:05 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:06.532564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94721e10-e9ae-4a32-8c2b-8e743a0318dd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:06.533189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94721e10-e9ae-4a32-8c2b-8e743a0318dd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:06.547387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94721e10-e9ae-4a32-8c2b-8e743a0318dd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:06.547951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94721e10-e9ae-4a32-8c2b-8e743a0318dd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:06.548411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94721e10-e9ae-4a32-8c2b-8e743a0318dd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:06.549146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94721e10-e9ae-4a32-8c2b-8e743a0318dd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:06.560306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94721e10-e9ae-4a32-8c2b-8e743a0318dd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:06.560715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94721e10-e9ae-4a32-8c2b-8e743a0318dd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:06.850559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-94721e10-e9ae-4a32-8c2b-8e743a0318dd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:06.860348 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94721e10-e9ae-4a32-8c2b-8e743a0318dd tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.331923 Aug 09 14:54:06.870652 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2252/4514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:06 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:07.206922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c306d180-7030-4b8f-b2c0-519d98153588 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] Calling method '.version_select at 0x7f41e75921f0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:07.228018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aec6b162-d602-477b-b446-2ac9101a4b6f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:07.229479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aec6b162-d602-477b-b446-2ac9101a4b6f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:07.239545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aec6b162-d602-477b-b446-2ac9101a4b6f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:07.240820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aec6b162-d602-477b-b446-2ac9101a4b6f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:07.240820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aec6b162-d602-477b-b446-2ac9101a4b6f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:07.242367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aec6b162-d602-477b-b446-2ac9101a4b6f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:07.242832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aec6b162-d602-477b-b446-2ac9101a4b6f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:07.243295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aec6b162-d602-477b-b446-2ac9101a4b6f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:07.322232 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c306d180-7030-4b8f-b2c0-519d98153588 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f" status: 200 len: 353 microversion: 2.1 time: 0.123237 Aug 09 14:54:07.322868 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2263/4515] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:54:07 2022] GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:07.369990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aec6b162-d602-477b-b446-2ac9101a4b6f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:07.380031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aec6b162-d602-477b-b446-2ac9101a4b6f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:07.381802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aec6b162-d602-477b-b446-2ac9101a4b6f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:07.383383 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aec6b162-d602-477b-b446-2ac9101a4b6f tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.161261 Aug 09 14:54:07.384522 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2253/4516] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:07 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:54:07.885473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0dff9eb-5ebe-4110-b65c-bc1e7b166213 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:07.886084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0dff9eb-5ebe-4110-b65c-bc1e7b166213 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:07.893635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0dff9eb-5ebe-4110-b65c-bc1e7b166213 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:07.895300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0dff9eb-5ebe-4110-b65c-bc1e7b166213 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:07.895770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0dff9eb-5ebe-4110-b65c-bc1e7b166213 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:07.896637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0dff9eb-5ebe-4110-b65c-bc1e7b166213 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:07.897441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0dff9eb-5ebe-4110-b65c-bc1e7b166213 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:07.898286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0dff9eb-5ebe-4110-b65c-bc1e7b166213 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:08.123011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0dff9eb-5ebe-4110-b65c-bc1e7b166213 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:08.132245 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0dff9eb-5ebe-4110-b65c-bc1e7b166213 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1736 microversion: 2.1 time: 0.251173 Aug 09 14:54:08.132986 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2264/4517] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:07 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1736 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:08.337094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a1483892-a7b2-42c6-b3d0-27b3758a1df6 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] Calling method '.version_select at 0x7f41dc7a2f70>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:08.414263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d4897e21-3255-4d47-8250-8e7e78c60adb tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:08.417729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d4897e21-3255-4d47-8250-8e7e78c60adb tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:08.419654 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a1483892-a7b2-42c6-b3d0-27b3758a1df6 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f" status: 200 len: 354 microversion: 2.1 time: 0.086515 Aug 09 14:54:08.422300 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2254/4518] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:54:08 2022] GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:08.437233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0cdca6f3-52b3-41ec-a177-0811e2652208 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] Calling method '.version_select at 0x7f41dc706280>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:08.445389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4897e21-3255-4d47-8250-8e7e78c60adb tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:08.445959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4897e21-3255-4d47-8250-8e7e78c60adb tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:08.446363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4897e21-3255-4d47-8250-8e7e78c60adb tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:08.447280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4897e21-3255-4d47-8250-8e7e78c60adb tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:08.447912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4897e21-3255-4d47-8250-8e7e78c60adb tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:08.448242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4897e21-3255-4d47-8250-8e7e78c60adb tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:08.505896 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0cdca6f3-52b3-41ec-a177-0811e2652208 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f" status: 200 len: 354 microversion: 2.1 time: 0.072475 Aug 09 14:54:08.506486 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2255/4519] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:54:08 2022] GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:08.520537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8cd4a293-823d-4fb1-97e4-393c4d6c17ba tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] Calling method '.version_select at 0x7f41dc779430>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:08.558285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d4897e21-3255-4d47-8250-8e7e78c60adb tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:08.569981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d4897e21-3255-4d47-8250-8e7e78c60adb tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:08.574738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d4897e21-3255-4d47-8250-8e7e78c60adb tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:08.579317 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d4897e21-3255-4d47-8250-8e7e78c60adb tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.175808 Aug 09 14:54:08.580014 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2265/4520] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:08 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:08.618343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-89ddb5d8-8f56-41ec-ba2d-dd9c3adad202 req-bfb28e7b-0b5c-4837-83fe-5662e8f9b721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f7c79f-5422-4b54-8b30-6e43275685ca", "tag": "cba71fef-c335-4fa5-9aee-238338ee5ad7"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:54:08.629165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-89ddb5d8-8f56-41ec-ba2d-dd9c3adad202 req-bfb28e7b-0b5c-4837-83fe-5662e8f9b721 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:08.629646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-89ddb5d8-8f56-41ec-ba2d-dd9c3adad202 req-bfb28e7b-0b5c-4837-83fe-5662e8f9b721 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:08.630257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-89ddb5d8-8f56-41ec-ba2d-dd9c3adad202 req-bfb28e7b-0b5c-4837-83fe-5662e8f9b721 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:08.643478 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-89ddb5d8-8f56-41ec-ba2d-dd9c3adad202 req-bfb28e7b-0b5c-4837-83fe-5662e8f9b721 service nova] Creating event network-changed:cba71fef-c335-4fa5-9aee-238338ee5ad7 for instance 67f7c79f-5422-4b54-8b30-6e43275685ca on n-h1-844626-8 Aug 09 14:54:08.651831 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-89ddb5d8-8f56-41ec-ba2d-dd9c3adad202 req-bfb28e7b-0b5c-4837-83fe-5662e8f9b721 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041289 Aug 09 14:54:08.653639 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2266/4521] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:08.659294 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8cd4a293-823d-4fb1-97e4-393c4d6c17ba tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f" status: 202 len: 0 microversion: 2.1 time: 0.142458 Aug 09 14:54:08.663696 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2256/4522] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:54:08 2022] DELETE /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:54:08.670345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9f77ad7-7040-4a19-b0ff-6b95cbfb5050 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] Calling method '.version_select at 0x7f41ddd7e3a0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:08.733023 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9f77ad7-7040-4a19-b0ff-6b95cbfb5050 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f" status: 200 len: 353 microversion: 2.1 time: 0.067544 Aug 09 14:54:08.733909 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2267/4523] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:54:08 2022] GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:54:09.155016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-19294e7d-438a-468d-9db4-04581992676a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:09.159603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-19294e7d-438a-468d-9db4-04581992676a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:09.182283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-19294e7d-438a-468d-9db4-04581992676a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:09.187262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-19294e7d-438a-468d-9db4-04581992676a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:09.188013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-19294e7d-438a-468d-9db4-04581992676a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:09.194397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-19294e7d-438a-468d-9db4-04581992676a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:09.198933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-19294e7d-438a-468d-9db4-04581992676a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:09.201789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-19294e7d-438a-468d-9db4-04581992676a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:09.623899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91bd4b9b-f946-46a1-b24f-7a0d819b69ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:09.624677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91bd4b9b-f946-46a1-b24f-7a0d819b69ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:09.653901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91bd4b9b-f946-46a1-b24f-7a0d819b69ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:09.654753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91bd4b9b-f946-46a1-b24f-7a0d819b69ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:09.658749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91bd4b9b-f946-46a1-b24f-7a0d819b69ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:09.660694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91bd4b9b-f946-46a1-b24f-7a0d819b69ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:09.661377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91bd4b9b-f946-46a1-b24f-7a0d819b69ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:09.662877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91bd4b9b-f946-46a1-b24f-7a0d819b69ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:09.794078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-19294e7d-438a-468d-9db4-04581992676a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:09.814254 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-19294e7d-438a-468d-9db4-04581992676a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1716 microversion: 2.1 time: 0.657118 Aug 09 14:54:09.820008 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2257/4524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:09 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1716 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:09.826250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-35023111-d020-47e1-9705-b5098daec472 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] Calling method '.version_select at 0x7f41dc706c10>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:09.844363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91bd4b9b-f946-46a1-b24f-7a0d819b69ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:09.870819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91bd4b9b-f946-46a1-b24f-7a0d819b69ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:09.872418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91bd4b9b-f946-46a1-b24f-7a0d819b69ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:09.880871 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91bd4b9b-f946-46a1-b24f-7a0d819b69ed tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.262784 Aug 09 14:54:09.885401 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2268/4525] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:09 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:09.958472 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-35023111-d020-47e1-9705-b5098daec472 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f" status: 200 len: 353 microversion: 2.1 time: 0.136982 Aug 09 14:54:09.961235 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2258/4526] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:54:09 2022] GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:10.042667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f273db6-d3a6-4231-8b37-e098c0789809 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:10.043583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f273db6-d3a6-4231-8b37-e098c0789809 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:10.061080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f273db6-d3a6-4231-8b37-e098c0789809 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:10.061593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f273db6-d3a6-4231-8b37-e098c0789809 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:10.062039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f273db6-d3a6-4231-8b37-e098c0789809 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:10.062767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f273db6-d3a6-4231-8b37-e098c0789809 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:10.063251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f273db6-d3a6-4231-8b37-e098c0789809 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:10.063683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f273db6-d3a6-4231-8b37-e098c0789809 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:10.265333 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4f273db6-d3a6-4231-8b37-e098c0789809 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] HTTP exception thrown: Cannot 'detach_volume' instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 while it is in vm_state rescued Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f273db6-d3a6-4231-8b37-e098c0789809 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Request method failure captured: Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments/1492b9fb-e3f3-412c-8b5c-a3b394aaf1c7 HTTP/1.1 Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nQm9peRLyL-_ZL-9bNt1h-d9klu5PkrS_r357cpe12gMlxICQ1HHucyUskRO5kPygg95_v20_f9GCogcbu9CMWwyIZJ02lyqO-GFoRzdRBe_4fpq23MfQZHMH2nNzxDS_zNouresiy_aJnSNaognXLjQlW_aeA_R6cmhZY0LfELTto Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0caed61cb95467ba8b076c63f6706de", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cfd1981c518d4432b4635c1768114b22 Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: exception: Cannot 'detach_volume' instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 while it is in vm_state rescued Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'server_id': '053d7685-e09d-4d66-a6cc-2a61ddefcb23', 'id': '1492b9fb-e3f3-412c-8b5c-a3b394aaf1c7'} Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 while it is in vm_state rescued Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:10.268911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:10.274821 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:54:10.274821 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:54:10.274821 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:54:10.274821 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:54:10.274821 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 while it is in vm_state rescued Aug 09 14:54:10.274821 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:10.281062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f273db6-d3a6-4231-8b37-e098c0789809 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Returning 409 to user: Cannot 'detach_volume' instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 while it is in vm_state rescued {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:54:10.282288 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f273db6-d3a6-4231-8b37-e098c0789809 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "DELETE /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments/1492b9fb-e3f3-412c-8b5c-a3b394aaf1c7" status: 409 len: 152 microversion: 2.1 time: 0.243710 Aug 09 14:54:10.283558 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2269/4527] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 14:54:10 2022] DELETE /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments/1492b9fb-e3f3-412c-8b5c-a3b394aaf1c7 => generated 152 bytes in 245 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:54:10.291989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99074857-4f17-475c-8b76-170b50f1f04a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:54:10.292710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-99074857-4f17-475c-8b76-170b50f1f04a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:10.312411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99074857-4f17-475c-8b76-170b50f1f04a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:10.313681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99074857-4f17-475c-8b76-170b50f1f04a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:10.314638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99074857-4f17-475c-8b76-170b50f1f04a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:10.316184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99074857-4f17-475c-8b76-170b50f1f04a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:10.316882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99074857-4f17-475c-8b76-170b50f1f04a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:10.317356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99074857-4f17-475c-8b76-170b50f1f04a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:10.452205 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99074857-4f17-475c-8b76-170b50f1f04a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/action" status: 202 len: 0 microversion: 2.1 time: 0.164012 Aug 09 14:54:10.453901 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2259/4528] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:54:10 2022] POST /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:54:10.465716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aff149ec-cd30-4d32-8187-b0ed2b56d7f7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:10.466762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aff149ec-cd30-4d32-8187-b0ed2b56d7f7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:10.482995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aff149ec-cd30-4d32-8187-b0ed2b56d7f7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:10.484557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aff149ec-cd30-4d32-8187-b0ed2b56d7f7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:10.485615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aff149ec-cd30-4d32-8187-b0ed2b56d7f7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:10.486682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aff149ec-cd30-4d32-8187-b0ed2b56d7f7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:10.488038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aff149ec-cd30-4d32-8187-b0ed2b56d7f7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:10.490070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aff149ec-cd30-4d32-8187-b0ed2b56d7f7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:10.685141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aff149ec-cd30-4d32-8187-b0ed2b56d7f7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:10.704606 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aff149ec-cd30-4d32-8187-b0ed2b56d7f7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1724 microversion: 2.1 time: 0.244483 Aug 09 14:54:10.705946 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2270/4529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:10 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:10.908788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b6e4807-8cd2-4adb-aad3-8c40ff42a582 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:10.910090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b6e4807-8cd2-4adb-aad3-8c40ff42a582 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:10.929046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b6e4807-8cd2-4adb-aad3-8c40ff42a582 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:10.934395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b6e4807-8cd2-4adb-aad3-8c40ff42a582 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:10.937822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b6e4807-8cd2-4adb-aad3-8c40ff42a582 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:10.940610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b6e4807-8cd2-4adb-aad3-8c40ff42a582 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:10.942728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b6e4807-8cd2-4adb-aad3-8c40ff42a582 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:10.943682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b6e4807-8cd2-4adb-aad3-8c40ff42a582 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:10.976032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-15b4011d-118c-4841-8e79-abfb40f0cbbc tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] Calling method '.version_select at 0x7f41dd1ead30>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:11.092206 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-15b4011d-118c-4841-8e79-abfb40f0cbbc tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f" status: 200 len: 353 microversion: 2.1 time: 0.121727 Aug 09 14:54:11.101727 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2271/4530] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:54:10 2022] GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:11.591489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b6e4807-8cd2-4adb-aad3-8c40ff42a582 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:11.608328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b6e4807-8cd2-4adb-aad3-8c40ff42a582 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:11.609832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3b6e4807-8cd2-4adb-aad3-8c40ff42a582 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:11.611808 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b6e4807-8cd2-4adb-aad3-8c40ff42a582 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.707534 Aug 09 14:54:11.624397 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2260/4531] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:10 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:11.733153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d878bf8a-573e-4cf3-8ffd-b15719afab6d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:11.733879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d878bf8a-573e-4cf3-8ffd-b15719afab6d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:11.745115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d878bf8a-573e-4cf3-8ffd-b15719afab6d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:11.747021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d878bf8a-573e-4cf3-8ffd-b15719afab6d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:11.747866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d878bf8a-573e-4cf3-8ffd-b15719afab6d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:11.748844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d878bf8a-573e-4cf3-8ffd-b15719afab6d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:11.749656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d878bf8a-573e-4cf3-8ffd-b15719afab6d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:11.750317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d878bf8a-573e-4cf3-8ffd-b15719afab6d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:12.053230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d878bf8a-573e-4cf3-8ffd-b15719afab6d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:12.063775 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d878bf8a-573e-4cf3-8ffd-b15719afab6d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1724 microversion: 2.1 time: 0.335659 Aug 09 14:54:12.065086 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2272/4532] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:11 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:54:12.108282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84af846c-85d0-459b-9e66-78d3f5ba7102 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] Calling method '.version_select at 0x7f41dc71aee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:12.145526 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-84af846c-85d0-459b-9e66-78d3f5ba7102 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] HTTP exception thrown: Volume 4139a176-aec4-4f6c-9e8c-dd67e22cad5f could not be found. Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84af846c-85d0-459b-9e66-78d3f5ba7102 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] Request method failure captured: Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f HTTP/1.1 Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nUNvSdi4XsHHJiWKEMi-O8yc3uiNJN68esesvL3gNgEjlAi7FObOAmvuK4uLokanU448R5GHDPMOVxtdFCRD0mPHBj2Xp8TxDa3J71kyHdYV8mbVvmGGDg4j3iWGzu1F0NYB94SFDWjvl_xOM1hHnQs6XsxeVKMYI87MFKdTgsyztw Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 7c1668a8fdd4400e830af63e5d2d0563 Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesGetTestJSON-1773579484 Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7c1668a8fdd4400e830af63e5d2d0563", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7c1668a8fdd4400e830af63e5d2d0563"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7c1668a8fdd4400e830af63e5d2d0563"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7c1668a8fdd4400e830af63e5d2d0563"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-VolumesGetTestJSON-1773579484 Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 7c1668a8fdd4400e830af63e5d2d0563 Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesGetTestJSON-1773579484 Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-VolumesGetTestJSON-1773579484-project Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 4ea7d0bfff0c450690ed3be7769b7ada Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-VolumesGetTestJSON-1773579484-project Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: exception: Volume 4139a176-aec4-4f6c-9e8c-dd67e22cad5f could not be found. Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '4139a176-aec4-4f6c-9e8c-dd67e22cad5f'} Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4139a176-aec4-4f6c-9e8c-dd67e22cad5f could not be found. (HTTP 404) (Request-ID: req-8c9531a4-b65a-4ad6-ac81-05c8a51c409f) Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 14:54:12.155395 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4139a176-aec4-4f6c-9e8c-dd67e22cad5f could not be found. Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4139a176-aec4-4f6c-9e8c-dd67e22cad5f could not be found. Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4139a176-aec4-4f6c-9e8c-dd67e22cad5f could not be found. Aug 09 14:54:12.160130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:54:12.164626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84af846c-85d0-459b-9e66-78d3f5ba7102 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] Returning 404 to user: Volume 4139a176-aec4-4f6c-9e8c-dd67e22cad5f could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:54:12.165724 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-84af846c-85d0-459b-9e66-78d3f5ba7102 tempest-VolumesGetTestJSON-1773579484 tempest-VolumesGetTestJSON-1773579484-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f" status: 404 len: 109 microversion: 2.1 time: 0.063219 Aug 09 14:54:12.169720 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2261/4533] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:54:12 2022] GET /compute/v2.1/os-volumes/4139a176-aec4-4f6c-9e8c-dd67e22cad5f => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:54:12.636800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4ef9f3a3-044e-4c88-b2a3-1cbd059e1d04 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:12.637526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4ef9f3a3-044e-4c88-b2a3-1cbd059e1d04 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:12.656550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ef9f3a3-044e-4c88-b2a3-1cbd059e1d04 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:12.657529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ef9f3a3-044e-4c88-b2a3-1cbd059e1d04 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:12.658121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ef9f3a3-044e-4c88-b2a3-1cbd059e1d04 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:12.659154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ef9f3a3-044e-4c88-b2a3-1cbd059e1d04 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:12.660684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ef9f3a3-044e-4c88-b2a3-1cbd059e1d04 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:12.661864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ef9f3a3-044e-4c88-b2a3-1cbd059e1d04 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:12.772685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:54:12.810658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4ef9f3a3-044e-4c88-b2a3-1cbd059e1d04 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:12.823830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4ef9f3a3-044e-4c88-b2a3-1cbd059e1d04 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:12.828502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4ef9f3a3-044e-4c88-b2a3-1cbd059e1d04 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:12.830166 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4ef9f3a3-044e-4c88-b2a3-1cbd059e1d04 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.197597 Aug 09 14:54:12.875288 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2273/4534] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:12 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:13.086223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:54:13.093915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-10bab7e1-e46c-4547-9617-5b7e66d0f5cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:13.094541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-10bab7e1-e46c-4547-9617-5b7e66d0f5cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:13.105363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10bab7e1-e46c-4547-9617-5b7e66d0f5cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:13.106287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10bab7e1-e46c-4547-9617-5b7e66d0f5cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:13.107383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10bab7e1-e46c-4547-9617-5b7e66d0f5cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:13.108414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10bab7e1-e46c-4547-9617-5b7e66d0f5cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:13.110306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10bab7e1-e46c-4547-9617-5b7e66d0f5cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:13.110929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10bab7e1-e46c-4547-9617-5b7e66d0f5cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:13.557146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-10bab7e1-e46c-4547-9617-5b7e66d0f5cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:13.567008 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-10bab7e1-e46c-4547-9617-5b7e66d0f5cf tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1724 microversion: 2.1 time: 0.484340 Aug 09 14:54:13.568010 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2262/4535] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:13 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1724 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:13.874649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5fe84b0c-dbdb-41b2-83f9-4e852a86dd33 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:13.876495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5fe84b0c-dbdb-41b2-83f9-4e852a86dd33 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:13.885948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe84b0c-dbdb-41b2-83f9-4e852a86dd33 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:13.886841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe84b0c-dbdb-41b2-83f9-4e852a86dd33 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:13.887696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe84b0c-dbdb-41b2-83f9-4e852a86dd33 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:13.888672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe84b0c-dbdb-41b2-83f9-4e852a86dd33 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:13.889336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe84b0c-dbdb-41b2-83f9-4e852a86dd33 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:13.890340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5fe84b0c-dbdb-41b2-83f9-4e852a86dd33 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:14.002422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5fe84b0c-dbdb-41b2-83f9-4e852a86dd33 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:14.028783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5fe84b0c-dbdb-41b2-83f9-4e852a86dd33 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:14.031613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5fe84b0c-dbdb-41b2-83f9-4e852a86dd33 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:14.033539 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5fe84b0c-dbdb-41b2-83f9-4e852a86dd33 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.164519 Aug 09 14:54:14.039114 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2274/4536] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:13 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:14.590400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-827b4344-c1d8-4895-b0ec-3c54b306c4bb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:14.591222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-827b4344-c1d8-4895-b0ec-3c54b306c4bb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:14.599532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=90 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:54:14.601840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-827b4344-c1d8-4895-b0ec-3c54b306c4bb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:14.602855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-827b4344-c1d8-4895-b0ec-3c54b306c4bb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:14.603574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-827b4344-c1d8-4895-b0ec-3c54b306c4bb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:14.604610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-827b4344-c1d8-4895-b0ec-3c54b306c4bb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:14.605619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-827b4344-c1d8-4895-b0ec-3c54b306c4bb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:14.606317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-827b4344-c1d8-4895-b0ec-3c54b306c4bb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:14.855505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-827b4344-c1d8-4895-b0ec-3c54b306c4bb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:14.865647 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-827b4344-c1d8-4895-b0ec-3c54b306c4bb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1730 microversion: 2.1 time: 0.279735 Aug 09 14:54:14.866243 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2263/4537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:54:14 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1730 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:14.892957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9bb67848-6216-4f17-8a1f-069d5429c5e5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:14.892957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9bb67848-6216-4f17-8a1f-069d5429c5e5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:14.900835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bb67848-6216-4f17-8a1f-069d5429c5e5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:14.901343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bb67848-6216-4f17-8a1f-069d5429c5e5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:14.903925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bb67848-6216-4f17-8a1f-069d5429c5e5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:14.904701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bb67848-6216-4f17-8a1f-069d5429c5e5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:14.905183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bb67848-6216-4f17-8a1f-069d5429c5e5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:14.913039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9bb67848-6216-4f17-8a1f-069d5429c5e5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:15.057019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b52aeb44-9e0e-4a5e-b28c-bd6a5d4515f1 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:15.057626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b52aeb44-9e0e-4a5e-b28c-bd6a5d4515f1 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:15.069545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b52aeb44-9e0e-4a5e-b28c-bd6a5d4515f1 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:15.070226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b52aeb44-9e0e-4a5e-b28c-bd6a5d4515f1 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:15.072018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b52aeb44-9e0e-4a5e-b28c-bd6a5d4515f1 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:15.073129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b52aeb44-9e0e-4a5e-b28c-bd6a5d4515f1 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:15.073760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b52aeb44-9e0e-4a5e-b28c-bd6a5d4515f1 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:15.074191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b52aeb44-9e0e-4a5e-b28c-bd6a5d4515f1 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:15.090385 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9bb67848-6216-4f17-8a1f-069d5429c5e5 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204239 Aug 09 14:54:15.099802 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2275/4538] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:54:14 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:15.458978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b52aeb44-9e0e-4a5e-b28c-bd6a5d4515f1 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:15.471772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b52aeb44-9e0e-4a5e-b28c-bd6a5d4515f1 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:15.473385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b52aeb44-9e0e-4a5e-b28c-bd6a5d4515f1 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:15.478989 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b52aeb44-9e0e-4a5e-b28c-bd6a5d4515f1 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.425849 Aug 09 14:54:15.484287 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2264/4539] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:15 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:54:16.509813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d0e5837a-0275-4d6b-a8fe-94e2c682a729 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:16.511256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d0e5837a-0275-4d6b-a8fe-94e2c682a729 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:16.525874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0e5837a-0275-4d6b-a8fe-94e2c682a729 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:16.527235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0e5837a-0275-4d6b-a8fe-94e2c682a729 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:16.528988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0e5837a-0275-4d6b-a8fe-94e2c682a729 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:16.531168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0e5837a-0275-4d6b-a8fe-94e2c682a729 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:16.534343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0e5837a-0275-4d6b-a8fe-94e2c682a729 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:16.536798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d0e5837a-0275-4d6b-a8fe-94e2c682a729 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:16.694480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d0e5837a-0275-4d6b-a8fe-94e2c682a729 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:16.706482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d0e5837a-0275-4d6b-a8fe-94e2c682a729 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:16.709040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d0e5837a-0275-4d6b-a8fe-94e2c682a729 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:16.710654 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d0e5837a-0275-4d6b-a8fe-94e2c682a729 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.207444 Aug 09 14:54:16.711691 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2276/4540] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:16 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:16.924428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-af116057-1161-485f-8299-0ad1d5a2e327 req-18ad408d-4266-4ac0-8aa0-ec89ffa811c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053d7685-e09d-4d66-a6cc-2a61ddefcb23", "tag": "03d361a9-3309-4c45-b997-7791815137fa"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:54:16.939357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-af116057-1161-485f-8299-0ad1d5a2e327 req-18ad408d-4266-4ac0-8aa0-ec89ffa811c7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:16.939839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-af116057-1161-485f-8299-0ad1d5a2e327 req-18ad408d-4266-4ac0-8aa0-ec89ffa811c7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:16.940263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-af116057-1161-485f-8299-0ad1d5a2e327 req-18ad408d-4266-4ac0-8aa0-ec89ffa811c7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:16.958129 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-af116057-1161-485f-8299-0ad1d5a2e327 req-18ad408d-4266-4ac0-8aa0-ec89ffa811c7 service nova] Creating event network-changed:03d361a9-3309-4c45-b997-7791815137fa for instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 on n-h1-844626-8 Aug 09 14:54:16.963841 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-af116057-1161-485f-8299-0ad1d5a2e327 req-18ad408d-4266-4ac0-8aa0-ec89ffa811c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044766 Aug 09 14:54:16.970062 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2265/4541] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:17.734078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-788402aa-449b-4ff4-bd38-96af8c27f801 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:17.734717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-788402aa-449b-4ff4-bd38-96af8c27f801 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:17.744922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788402aa-449b-4ff4-bd38-96af8c27f801 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:17.745516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788402aa-449b-4ff4-bd38-96af8c27f801 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:17.745969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788402aa-449b-4ff4-bd38-96af8c27f801 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:17.746769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788402aa-449b-4ff4-bd38-96af8c27f801 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:17.747697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788402aa-449b-4ff4-bd38-96af8c27f801 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:17.748337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-788402aa-449b-4ff4-bd38-96af8c27f801 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:17.855383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-788402aa-449b-4ff4-bd38-96af8c27f801 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:17.879512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-788402aa-449b-4ff4-bd38-96af8c27f801 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:17.886683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-788402aa-449b-4ff4-bd38-96af8c27f801 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:17.887855 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-788402aa-449b-4ff4-bd38-96af8c27f801 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.157914 Aug 09 14:54:17.890697 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2277/4542] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:17 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:18.915376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5d4f981d-f57d-474f-b5f0-c41b07e70ee0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:18.916717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5d4f981d-f57d-474f-b5f0-c41b07e70ee0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:18.923786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d4f981d-f57d-474f-b5f0-c41b07e70ee0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:18.924538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d4f981d-f57d-474f-b5f0-c41b07e70ee0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:18.925219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d4f981d-f57d-474f-b5f0-c41b07e70ee0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:18.926117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d4f981d-f57d-474f-b5f0-c41b07e70ee0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:18.926726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d4f981d-f57d-474f-b5f0-c41b07e70ee0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:18.927350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d4f981d-f57d-474f-b5f0-c41b07e70ee0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:19.012667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-878a6436-9ae6-4009-aaa1-683e75dac331 req-e398d5fe-8827-460f-bf27-c53e7d26625d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "053d7685-e09d-4d66-a6cc-2a61ddefcb23", "tag": "03d361a9-3309-4c45-b997-7791815137fa"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:54:19.034192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-878a6436-9ae6-4009-aaa1-683e75dac331 req-e398d5fe-8827-460f-bf27-c53e7d26625d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:19.034800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-878a6436-9ae6-4009-aaa1-683e75dac331 req-e398d5fe-8827-460f-bf27-c53e7d26625d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:19.035882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-878a6436-9ae6-4009-aaa1-683e75dac331 req-e398d5fe-8827-460f-bf27-c53e7d26625d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:19.049520 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-878a6436-9ae6-4009-aaa1-683e75dac331 req-e398d5fe-8827-460f-bf27-c53e7d26625d service nova] Creating event network-changed:03d361a9-3309-4c45-b997-7791815137fa for instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 on n-h1-844626-8 Aug 09 14:54:19.056653 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-878a6436-9ae6-4009-aaa1-683e75dac331 req-e398d5fe-8827-460f-bf27-c53e7d26625d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053676 Aug 09 14:54:19.057993 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2278/4543] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:54:19.091545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5d4f981d-f57d-474f-b5f0-c41b07e70ee0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:19.106418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5d4f981d-f57d-474f-b5f0-c41b07e70ee0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:19.109079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5d4f981d-f57d-474f-b5f0-c41b07e70ee0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:19.111840 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5d4f981d-f57d-474f-b5f0-c41b07e70ee0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.201945 Aug 09 14:54:19.113178 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2266/4544] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:18 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:20.140717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fa284467-00a4-4bb7-9fc3-7bee4005d7b0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:20.142002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fa284467-00a4-4bb7-9fc3-7bee4005d7b0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:20.152057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa284467-00a4-4bb7-9fc3-7bee4005d7b0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:20.152057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa284467-00a4-4bb7-9fc3-7bee4005d7b0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:20.152509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa284467-00a4-4bb7-9fc3-7bee4005d7b0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:20.153346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa284467-00a4-4bb7-9fc3-7bee4005d7b0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:20.179333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa284467-00a4-4bb7-9fc3-7bee4005d7b0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:20.180795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa284467-00a4-4bb7-9fc3-7bee4005d7b0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:20.518406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fa284467-00a4-4bb7-9fc3-7bee4005d7b0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:20.545709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fa284467-00a4-4bb7-9fc3-7bee4005d7b0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:20.548101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fa284467-00a4-4bb7-9fc3-7bee4005d7b0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:20.549844 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fa284467-00a4-4bb7-9fc3-7bee4005d7b0 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1366 microversion: 2.57 time: 0.417329 Aug 09 14:54:20.551718 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2279/4545] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:20 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1366 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:21.583958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b82d47d-4d2b-4ecb-89eb-706696229cf3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:21.585763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0b82d47d-4d2b-4ecb-89eb-706696229cf3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:21.601584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b82d47d-4d2b-4ecb-89eb-706696229cf3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:21.603297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b82d47d-4d2b-4ecb-89eb-706696229cf3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:21.606576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b82d47d-4d2b-4ecb-89eb-706696229cf3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:21.609062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b82d47d-4d2b-4ecb-89eb-706696229cf3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:21.613459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b82d47d-4d2b-4ecb-89eb-706696229cf3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:21.614516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b82d47d-4d2b-4ecb-89eb-706696229cf3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:21.813867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0b82d47d-4d2b-4ecb-89eb-706696229cf3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:21.831587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0b82d47d-4d2b-4ecb-89eb-706696229cf3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:21.833647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0b82d47d-4d2b-4ecb-89eb-706696229cf3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:21.838059 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b82d47d-4d2b-4ecb-89eb-706696229cf3 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1372 microversion: 2.57 time: 0.263993 Aug 09 14:54:21.839002 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2267/4546] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:21 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1372 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:22.866002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-afa1dce1-b5f0-4a70-9dd6-33a06f54d133 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:22.866686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-afa1dce1-b5f0-4a70-9dd6-33a06f54d133 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:22.881408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afa1dce1-b5f0-4a70-9dd6-33a06f54d133 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:22.881952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afa1dce1-b5f0-4a70-9dd6-33a06f54d133 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:22.882403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afa1dce1-b5f0-4a70-9dd6-33a06f54d133 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:22.889965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afa1dce1-b5f0-4a70-9dd6-33a06f54d133 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:22.890479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afa1dce1-b5f0-4a70-9dd6-33a06f54d133 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:22.890929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afa1dce1-b5f0-4a70-9dd6-33a06f54d133 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:23.033588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-afa1dce1-b5f0-4a70-9dd6-33a06f54d133 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:23.042780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-afa1dce1-b5f0-4a70-9dd6-33a06f54d133 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:23.047353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-afa1dce1-b5f0-4a70-9dd6-33a06f54d133 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:23.049990 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-afa1dce1-b5f0-4a70-9dd6-33a06f54d133 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1372 microversion: 2.57 time: 0.189471 Aug 09 14:54:23.054594 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2280/4547] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:22 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1372 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:24.077901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f2ba5a6-f2e2-43d9-900e-eaa06bf294bc tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:24.079471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f2ba5a6-f2e2-43d9-900e-eaa06bf294bc tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:24.101360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f2ba5a6-f2e2-43d9-900e-eaa06bf294bc tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:24.102001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f2ba5a6-f2e2-43d9-900e-eaa06bf294bc tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:24.104120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f2ba5a6-f2e2-43d9-900e-eaa06bf294bc tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:24.104872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f2ba5a6-f2e2-43d9-900e-eaa06bf294bc tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:24.108177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f2ba5a6-f2e2-43d9-900e-eaa06bf294bc tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:24.118096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f2ba5a6-f2e2-43d9-900e-eaa06bf294bc tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:24.135847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:54:24.219843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f2ba5a6-f2e2-43d9-900e-eaa06bf294bc tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:24.230557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f2ba5a6-f2e2-43d9-900e-eaa06bf294bc tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:24.232995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f2ba5a6-f2e2-43d9-900e-eaa06bf294bc tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:24.234674 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4f2ba5a6-f2e2-43d9-900e-eaa06bf294bc tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1357 microversion: 2.57 time: 0.162388 Aug 09 14:54:24.235417 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2268/4548] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:24 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:24.264627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22ea2888-3adb-426e-83ef-343bc94935b7 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:24.265181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22ea2888-3adb-426e-83ef-343bc94935b7 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:24.272972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22ea2888-3adb-426e-83ef-343bc94935b7 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:24.273372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22ea2888-3adb-426e-83ef-343bc94935b7 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:24.274486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22ea2888-3adb-426e-83ef-343bc94935b7 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:24.274486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22ea2888-3adb-426e-83ef-343bc94935b7 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:24.274971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22ea2888-3adb-426e-83ef-343bc94935b7 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:24.275370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22ea2888-3adb-426e-83ef-343bc94935b7 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:24.313889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22ea2888-3adb-426e-83ef-343bc94935b7 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:54:24.369151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:54:24.446027 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22ea2888-3adb-426e-83ef-343bc94935b7 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "DELETE /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 204 len: 0 microversion: 2.57 time: 0.184947 Aug 09 14:54:24.450640 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2281/4549] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:54:24 2022] DELETE /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:54:24.463744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8bda1681-28dc-4adb-a451-e8020559a190 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:24.464606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8bda1681-28dc-4adb-a451-e8020559a190 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:24.472910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8bda1681-28dc-4adb-a451-e8020559a190 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:24.473845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8bda1681-28dc-4adb-a451-e8020559a190 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:24.474521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8bda1681-28dc-4adb-a451-e8020559a190 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:24.477005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8bda1681-28dc-4adb-a451-e8020559a190 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:24.477697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8bda1681-28dc-4adb-a451-e8020559a190 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:24.478343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8bda1681-28dc-4adb-a451-e8020559a190 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:24.571136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8bda1681-28dc-4adb-a451-e8020559a190 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:24.583938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8bda1681-28dc-4adb-a451-e8020559a190 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:24.586075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8bda1681-28dc-4adb-a451-e8020559a190 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:24.587555 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8bda1681-28dc-4adb-a451-e8020559a190 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1363 microversion: 2.57 time: 0.131409 Aug 09 14:54:24.588439 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2269/4550] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:24 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1363 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:25.612253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fa4630a4-755b-421c-ae41-767efebe7f5e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:25.613076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fa4630a4-755b-421c-ae41-767efebe7f5e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:25.627139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:54:25.644427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa4630a4-755b-421c-ae41-767efebe7f5e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:25.644974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa4630a4-755b-421c-ae41-767efebe7f5e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:25.645429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa4630a4-755b-421c-ae41-767efebe7f5e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:25.646203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa4630a4-755b-421c-ae41-767efebe7f5e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:25.646668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa4630a4-755b-421c-ae41-767efebe7f5e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:25.647118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa4630a4-755b-421c-ae41-767efebe7f5e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:25.766142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fa4630a4-755b-421c-ae41-767efebe7f5e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:25.778984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fa4630a4-755b-421c-ae41-767efebe7f5e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:25.780748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fa4630a4-755b-421c-ae41-767efebe7f5e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:25.782456 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fa4630a4-755b-421c-ae41-767efebe7f5e tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1363 microversion: 2.57 time: 0.175050 Aug 09 14:54:25.783181 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2282/4551] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:25 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:26.807333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:26.807929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:26.819468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:26.819960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:26.820407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:26.821104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:26.821550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:26.821969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:26.871846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:26.872522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:26.873215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:26.873819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lazy-loading 'fault' on Instance uuid 6bcfef02-a022-45b9-ae33-70fc4a9691f1 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:54:26.928976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:26.940635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:26.942299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f4ccc8b818e431cb9443b2cf60f0b05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2f1c70cf47b4611878af8ab9cce587d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:26.944649 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d353f97d-d26d-4ec5-a2e9-c5a6d92a2e2c tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 200 len: 1368 microversion: 2.57 time: 0.141198 Aug 09 14:54:26.945441 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2270/4552] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:26 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 1368 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:27.972805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a1a5e3b-fad7-481f-a6c0-2c750105bcc8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:27.974276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a1a5e3b-fad7-481f-a6c0-2c750105bcc8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] [instance: 6bcfef02-a022-45b9-ae33-70fc4a9691f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:27.987525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a1a5e3b-fad7-481f-a6c0-2c750105bcc8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:27.988310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a1a5e3b-fad7-481f-a6c0-2c750105bcc8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:27.989439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a1a5e3b-fad7-481f-a6c0-2c750105bcc8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:27.990612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a1a5e3b-fad7-481f-a6c0-2c750105bcc8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:27.991311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a1a5e3b-fad7-481f-a6c0-2c750105bcc8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:27.992158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a1a5e3b-fad7-481f-a6c0-2c750105bcc8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:28.011311 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-0a1a5e3b-fad7-481f-a6c0-2c750105bcc8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] HTTP exception thrown: Instance 6bcfef02-a022-45b9-ae33-70fc4a9691f1 could not be found. Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a1a5e3b-fad7-481f-a6c0-2c750105bcc8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Request method failure captured: Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 HTTP/1.1 Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nTvVP14zMVCfF-HzND0YAQtCFYBkj9dhQeLZ--yDEcL8znwWY3j-vVqvs374NjDjvM10ZTqX8wPdN16Sy1MIMDrOJwmb0USqhwGTE44vr_Y-sdMZIcSIYvSmI05CxwY68XW_9gT4xp2kRokF6zAf37l507-CLT6f6j4LIV1H0fwxnU Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.57 Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a2f1c70cf47b4611878af8ab9cce587d Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerShowV257Test-1579107266 Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a2f1c70cf47b4611878af8ab9cce587d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a2f1c70cf47b4611878af8ab9cce587d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2f1c70cf47b4611878af8ab9cce587d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a2f1c70cf47b4611878af8ab9cce587d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerShowV257Test-1579107266 Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a2f1c70cf47b4611878af8ab9cce587d Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerShowV257Test-1579107266 Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerShowV257Test-1579107266-project Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 2f4ccc8b818e431cb9443b2cf60f0b05 Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerShowV257Test-1579107266-project Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 6bcfef02-a022-45b9-ae33-70fc4a9691f1 could not be found. Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '6bcfef02-a022-45b9-ae33-70fc4a9691f1'} Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bcfef02-a022-45b9-ae33-70fc4a9691f1 could not be found. Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bcfef02-a022-45b9-ae33-70fc4a9691f1 could not be found. Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:28.013455 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:28.018296 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:28.018296 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:54:28.018296 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:54:28.018296 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:54:28.018296 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:54:28.018296 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bcfef02-a022-45b9-ae33-70fc4a9691f1 could not be found. Aug 09 14:54:28.018296 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:28.018296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a1a5e3b-fad7-481f-a6c0-2c750105bcc8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] Returning 404 to user: Instance 6bcfef02-a022-45b9-ae33-70fc4a9691f1 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:54:28.018296 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a1a5e3b-fad7-481f-a6c0-2c750105bcc8 tempest-ServerShowV257Test-1579107266 tempest-ServerShowV257Test-1579107266-project] 10.222.0.50 "GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1" status: 404 len: 111 microversion: 2.57 time: 0.047202 Aug 09 14:54:28.019425 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2283/4553] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:27 2022] GET /compute/v2.1/servers/6bcfef02-a022-45b9-ae33-70fc4a9691f1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:54:38.299459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8b5e3dd-f389-4f8a-872d-f96fdf66e913 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:38.303426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8b5e3dd-f389-4f8a-872d-f96fdf66e913 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:38.306281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=17 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:54:38.306945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=19 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:54:38.325475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8b5e3dd-f389-4f8a-872d-f96fdf66e913 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:38.327248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8b5e3dd-f389-4f8a-872d-f96fdf66e913 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:38.329556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8b5e3dd-f389-4f8a-872d-f96fdf66e913 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:38.331651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8b5e3dd-f389-4f8a-872d-f96fdf66e913 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:38.333291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8b5e3dd-f389-4f8a-872d-f96fdf66e913 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:38.335698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8b5e3dd-f389-4f8a-872d-f96fdf66e913 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:38.411163 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8b5e3dd-f389-4f8a-872d-f96fdf66e913 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.112536 Aug 09 14:54:38.412030 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2271/4554] 10.222.0.50 () {60 vars in 1343 bytes} [Tue Aug 9 14:54:38 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:54:38.570743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-77cbf289-46ba-4149-92c7-ae8707460b5d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:38.571332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77cbf289-46ba-4149-92c7-ae8707460b5d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:38.578626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:54:38.579342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:54:38.584287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77cbf289-46ba-4149-92c7-ae8707460b5d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:38.585120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77cbf289-46ba-4149-92c7-ae8707460b5d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:38.585577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77cbf289-46ba-4149-92c7-ae8707460b5d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:38.586543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77cbf289-46ba-4149-92c7-ae8707460b5d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:38.587050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77cbf289-46ba-4149-92c7-ae8707460b5d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:38.587521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77cbf289-46ba-4149-92c7-ae8707460b5d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:38.651529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77cbf289-46ba-4149-92c7-ae8707460b5d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:54:38.841926 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-77cbf289-46ba-4149-92c7-ae8707460b5d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 204 len: 0 microversion: 2.20 time: 0.279863 Aug 09 14:54:38.844564 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2284/4555] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:54:38 2022] DELETE /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:54:38.852761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b74b2856-d4c6-453b-b5b4-6c605bf17b4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:38.853294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b74b2856-d4c6-453b-b5b4-6c605bf17b4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:38.863803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b74b2856-d4c6-453b-b5b4-6c605bf17b4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:38.864369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b74b2856-d4c6-453b-b5b4-6c605bf17b4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:38.864805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b74b2856-d4c6-453b-b5b4-6c605bf17b4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:38.865516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b74b2856-d4c6-453b-b5b4-6c605bf17b4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:38.868026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b74b2856-d4c6-453b-b5b4-6c605bf17b4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:38.870251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b74b2856-d4c6-453b-b5b4-6c605bf17b4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:39.263548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b74b2856-d4c6-453b-b5b4-6c605bf17b4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:39.276436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b74b2856-d4c6-453b-b5b4-6c605bf17b4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:39.279409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b74b2856-d4c6-453b-b5b4-6c605bf17b4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:39.284790 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b74b2856-d4c6-453b-b5b4-6c605bf17b4e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1722 microversion: 2.20 time: 0.436036 Aug 09 14:54:39.306374 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2272/4556] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:38 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:40.316681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b7a5ff97-fad4-4ccf-a6e1-0b4b079cd99d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:40.320660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b7a5ff97-fad4-4ccf-a6e1-0b4b079cd99d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:40.358261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7a5ff97-fad4-4ccf-a6e1-0b4b079cd99d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:40.368597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7a5ff97-fad4-4ccf-a6e1-0b4b079cd99d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:40.370325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7a5ff97-fad4-4ccf-a6e1-0b4b079cd99d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:40.372918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7a5ff97-fad4-4ccf-a6e1-0b4b079cd99d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:40.373411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7a5ff97-fad4-4ccf-a6e1-0b4b079cd99d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:40.373849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7a5ff97-fad4-4ccf-a6e1-0b4b079cd99d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:40.964598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b7a5ff97-fad4-4ccf-a6e1-0b4b079cd99d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:40.975360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b7a5ff97-fad4-4ccf-a6e1-0b4b079cd99d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:40.982687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b7a5ff97-fad4-4ccf-a6e1-0b4b079cd99d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:40.991365 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b7a5ff97-fad4-4ccf-a6e1-0b4b079cd99d tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1722 microversion: 2.20 time: 0.684457 Aug 09 14:54:40.992363 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2285/4557] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:40 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1722 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:42.040256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48282e39-5ce8-4b29-b430-40b017c3d63e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:42.040948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48282e39-5ce8-4b29-b430-40b017c3d63e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:42.071773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48282e39-5ce8-4b29-b430-40b017c3d63e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:42.073133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48282e39-5ce8-4b29-b430-40b017c3d63e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:42.073809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48282e39-5ce8-4b29-b430-40b017c3d63e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:42.075733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48282e39-5ce8-4b29-b430-40b017c3d63e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:42.079841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48282e39-5ce8-4b29-b430-40b017c3d63e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:42.080901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48282e39-5ce8-4b29-b430-40b017c3d63e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:42.409039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48282e39-5ce8-4b29-b430-40b017c3d63e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:42.423649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48282e39-5ce8-4b29-b430-40b017c3d63e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:42.432023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48282e39-5ce8-4b29-b430-40b017c3d63e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:42.437626 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48282e39-5ce8-4b29-b430-40b017c3d63e tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1654 microversion: 2.20 time: 0.402476 Aug 09 14:54:42.443180 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2273/4558] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:42 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1654 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:43.134383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0018df45-010d-42a9-8dbf-a01fea257a5f req-0388fec4-e784-4444-807f-15cc482c6569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bcda666-d36a-488f-8fb0-fe12470ff45f", "name": "network-vif-deleted", "tag": "9c42ace2-95a4-43eb-abf9-6c87e774f843"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:54:43.179580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0018df45-010d-42a9-8dbf-a01fea257a5f req-0388fec4-e784-4444-807f-15cc482c6569 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:43.201437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0018df45-010d-42a9-8dbf-a01fea257a5f req-0388fec4-e784-4444-807f-15cc482c6569 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:43.205001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0018df45-010d-42a9-8dbf-a01fea257a5f req-0388fec4-e784-4444-807f-15cc482c6569 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:43.273495 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0018df45-010d-42a9-8dbf-a01fea257a5f req-0388fec4-e784-4444-807f-15cc482c6569 service nova] Creating event network-vif-deleted:9c42ace2-95a4-43eb-abf9-6c87e774f843 for instance 9bcda666-d36a-488f-8fb0-fe12470ff45f on n-h1-844626-8 Aug 09 14:54:43.293997 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0018df45-010d-42a9-8dbf-a01fea257a5f req-0388fec4-e784-4444-807f-15cc482c6569 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163628 Aug 09 14:54:43.298340 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2286/4559] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:43.468290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:43.470467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:43.487244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:43.488447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:43.490430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:43.494553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:43.495769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:43.498135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:43.610302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:43.612585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:43.619297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:43.620184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lazy-loading 'fault' on Instance uuid 9bcda666-d36a-488f-8fb0-fe12470ff45f {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:54:43.771850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:43.784671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:43.786168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b12146c9774e9c8360d7535e43bfe3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7add50097c4b84859dbfac51473919', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:54:43.795876 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14f60177-ec5f-474a-8e2d-39ad15df7cad tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 200 len: 1369 microversion: 2.20 time: 0.334391 Aug 09 14:54:43.800043 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2274/4560] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:43 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 1369 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:54:44.827955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b09a4846-d5ca-4313-a44e-c863fbec6201 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:44.830043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b09a4846-d5ca-4313-a44e-c863fbec6201 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:44.872867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b09a4846-d5ca-4313-a44e-c863fbec6201 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:44.873676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b09a4846-d5ca-4313-a44e-c863fbec6201 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:44.877814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b09a4846-d5ca-4313-a44e-c863fbec6201 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:44.886163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b09a4846-d5ca-4313-a44e-c863fbec6201 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:44.886163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b09a4846-d5ca-4313-a44e-c863fbec6201 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:44.888327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b09a4846-d5ca-4313-a44e-c863fbec6201 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:44.933789 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b09a4846-d5ca-4313-a44e-c863fbec6201 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] HTTP exception thrown: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b09a4846-d5ca-4313-a44e-c863fbec6201 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Request method failure captured: Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f HTTP/1.1 Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nN6Uf8w2h-mfdeKt3XJsoyv-xzv_UyQNTiNQ-vBpfFw6jZ7cScirzV8TkKnGOT2wQDbDlpkmRsC0Lnkh0Ai6f5EyawKCYbM8YAFN3k76pWMnV1jQVbRAURmiaEB6m3ni3IOBHATY6FJaoZDpW-yYZSemU3xW-LdkstpnU-7TqlruYs Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: cd7add50097c4b84859dbfac51473919 Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd7add50097c4b84859dbfac51473919", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd7add50097c4b84859dbfac51473919"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd7add50097c4b84859dbfac51473919"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd7add50097c4b84859dbfac51473919"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: cd7add50097c4b84859dbfac51473919 Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AttachVolumeShelveTestJSON-1410391267-project Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 13b12146c9774e9c8360d7535e43bfe3 Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1410391267-project Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '9bcda666-d36a-488f-8fb0-fe12470ff45f'} Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:44.942019 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:44.947675 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:44.947675 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:44.947675 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:54:44.947675 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:54:44.947675 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:54:44.947675 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:54:44.947675 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:44.947675 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:44.947675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b09a4846-d5ca-4313-a44e-c863fbec6201 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Returning 404 to user: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:54:44.947675 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b09a4846-d5ca-4313-a44e-c863fbec6201 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 404 len: 111 microversion: 2.20 time: 0.121347 Aug 09 14:54:44.952740 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2287/4561] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:44 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:54:44.957799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eaad6db5-d65f-4a27-876e-9e462ecd1bf5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '.version_select at 0x7f41dc76c310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:45.030996 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eaad6db5-d65f-4a27-876e-9e462ecd1bf5 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-11659598" status: 204 len: 0 microversion: 2.20 time: 0.077190 Aug 09 14:54:45.031807 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2275/4562] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 9 14:54:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-11659598 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:54:49.359105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-187ca943-2b3c-43d1-a260-cc6f831dcbe2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:49.360508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-187ca943-2b3c-43d1-a260-cc6f831dcbe2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:49.384125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-187ca943-2b3c-43d1-a260-cc6f831dcbe2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:49.385998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-187ca943-2b3c-43d1-a260-cc6f831dcbe2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:49.386676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-187ca943-2b3c-43d1-a260-cc6f831dcbe2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:49.390006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-187ca943-2b3c-43d1-a260-cc6f831dcbe2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:49.391016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-187ca943-2b3c-43d1-a260-cc6f831dcbe2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:49.392294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-187ca943-2b3c-43d1-a260-cc6f831dcbe2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:49.595219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-187ca943-2b3c-43d1-a260-cc6f831dcbe2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lazy-loading 'services' on Instance uuid 053d7685-e09d-4d66-a6cc-2a61ddefcb23 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:54:49.836826 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-187ca943-2b3c-43d1-a260-cc6f831dcbe2 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "DELETE /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments/1492b9fb-e3f3-412c-8b5c-a3b394aaf1c7" status: 202 len: 0 microversion: 2.1 time: 0.482025 Aug 09 14:54:49.843763 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2288/4563] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 14:54:49 2022] DELETE /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments/1492b9fb-e3f3-412c-8b5c-a3b394aaf1c7 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:54:49.851400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-935285cf-6ce8-4080-8c21-978c99283867 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:49.854847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-935285cf-6ce8-4080-8c21-978c99283867 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:49.870093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935285cf-6ce8-4080-8c21-978c99283867 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:49.871037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935285cf-6ce8-4080-8c21-978c99283867 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:49.871772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935285cf-6ce8-4080-8c21-978c99283867 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:49.874851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935285cf-6ce8-4080-8c21-978c99283867 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:49.875459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935285cf-6ce8-4080-8c21-978c99283867 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:49.876023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935285cf-6ce8-4080-8c21-978c99283867 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:49.996054 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-935285cf-6ce8-4080-8c21-978c99283867 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137904 Aug 09 14:54:50.003902 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2276/4564] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:54:49 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:51.034653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf5299a1-b4b0-49c2-99b6-787c8c22bb4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:51.040199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf5299a1-b4b0-49c2-99b6-787c8c22bb4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:51.086748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf5299a1-b4b0-49c2-99b6-787c8c22bb4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:51.100146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf5299a1-b4b0-49c2-99b6-787c8c22bb4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:51.106266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf5299a1-b4b0-49c2-99b6-787c8c22bb4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:51.108364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf5299a1-b4b0-49c2-99b6-787c8c22bb4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:51.117779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf5299a1-b4b0-49c2-99b6-787c8c22bb4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:51.118036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf5299a1-b4b0-49c2-99b6-787c8c22bb4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:51.221813 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf5299a1-b4b0-49c2-99b6-787c8c22bb4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215373 Aug 09 14:54:51.224928 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2289/4565] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:54:51 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:52.237567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-08f208dc-2c37-49a7-9fb8-1ceee38d2a7a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:52.239920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-08f208dc-2c37-49a7-9fb8-1ceee38d2a7a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:52.269943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08f208dc-2c37-49a7-9fb8-1ceee38d2a7a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:52.273748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08f208dc-2c37-49a7-9fb8-1ceee38d2a7a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:52.274167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08f208dc-2c37-49a7-9fb8-1ceee38d2a7a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:52.274998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08f208dc-2c37-49a7-9fb8-1ceee38d2a7a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:52.278450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08f208dc-2c37-49a7-9fb8-1ceee38d2a7a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:52.278916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-08f208dc-2c37-49a7-9fb8-1ceee38d2a7a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:52.443934 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-08f208dc-2c37-49a7-9fb8-1ceee38d2a7a tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210727 Aug 09 14:54:52.450833 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2277/4566] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:54:52 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:53.461436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9047b5a3-05ac-4baa-9b75-7479cbc5718c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:53.465374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9047b5a3-05ac-4baa-9b75-7479cbc5718c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:53.503573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9047b5a3-05ac-4baa-9b75-7479cbc5718c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:53.505639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9047b5a3-05ac-4baa-9b75-7479cbc5718c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:53.508688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9047b5a3-05ac-4baa-9b75-7479cbc5718c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:53.514311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9047b5a3-05ac-4baa-9b75-7479cbc5718c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:53.515985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9047b5a3-05ac-4baa-9b75-7479cbc5718c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:53.517717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9047b5a3-05ac-4baa-9b75-7479cbc5718c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:53.678259 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9047b5a3-05ac-4baa-9b75-7479cbc5718c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.220462 Aug 09 14:54:53.683166 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2290/4567] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:54:53 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:54.694182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ce2f872a-e62e-42ba-8a24-8278a0072b85 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:54.696647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ce2f872a-e62e-42ba-8a24-8278a0072b85 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:54.710496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce2f872a-e62e-42ba-8a24-8278a0072b85 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:54.711304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce2f872a-e62e-42ba-8a24-8278a0072b85 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:54.711919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce2f872a-e62e-42ba-8a24-8278a0072b85 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:54.712999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce2f872a-e62e-42ba-8a24-8278a0072b85 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:54.713863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce2f872a-e62e-42ba-8a24-8278a0072b85 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:54.714467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce2f872a-e62e-42ba-8a24-8278a0072b85 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:54.800189 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ce2f872a-e62e-42ba-8a24-8278a0072b85 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110359 Aug 09 14:54:54.803442 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2278/4568] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:54:54 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:55.343234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b504ff56-c92d-4860-a06d-497310da64f3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:55.343751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b504ff56-c92d-4860-a06d-497310da64f3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:55.372002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b504ff56-c92d-4860-a06d-497310da64f3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:55.372514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b504ff56-c92d-4860-a06d-497310da64f3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:55.372950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b504ff56-c92d-4860-a06d-497310da64f3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:55.374220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b504ff56-c92d-4860-a06d-497310da64f3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:55.377202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b504ff56-c92d-4860-a06d-497310da64f3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:55.385356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b504ff56-c92d-4860-a06d-497310da64f3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:55.440086 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b504ff56-c92d-4860-a06d-497310da64f3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] HTTP exception thrown: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b504ff56-c92d-4860-a06d-497310da64f3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Request method failure captured: Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f HTTP/1.1 Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nN6Uf8w2h-mfdeKt3XJsoyv-xzv_UyQNTiNQ-vBpfFw6jZ7cScirzV8TkKnGOT2wQDbDlpkmRsC0Lnkh0Ai6f5EyawKCYbM8YAFN3k76pWMnV1jQVbRAURmiaEB6m3ni3IOBHATY6FJaoZDpW-yYZSemU3xW-LdkstpnU-7TqlruYs Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: cd7add50097c4b84859dbfac51473919 Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd7add50097c4b84859dbfac51473919", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd7add50097c4b84859dbfac51473919"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd7add50097c4b84859dbfac51473919"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd7add50097c4b84859dbfac51473919"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: cd7add50097c4b84859dbfac51473919 Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AttachVolumeShelveTestJSON-1410391267-project Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 13b12146c9774e9c8360d7535e43bfe3 Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1410391267-project Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '9bcda666-d36a-488f-8fb0-fe12470ff45f'} Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:54:55.444460 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:54:55.450531 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:55.450531 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:55.450531 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:55.450531 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:55.450531 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:55.450531 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:54:55.450531 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:54:55.450531 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:54:55.450531 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:54:55.450531 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:55.450531 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:54:55.452610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b504ff56-c92d-4860-a06d-497310da64f3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Returning 404 to user: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:54:55.458793 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b504ff56-c92d-4860-a06d-497310da64f3 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 404 len: 111 microversion: 2.20 time: 0.120013 Aug 09 14:54:55.460098 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2291/4569] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:54:55 2022] DELETE /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:54:55.474756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-599bb995-df17-4fa9-9fcd-8f9ca2a8e753 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:55.475715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-599bb995-df17-4fa9-9fcd-8f9ca2a8e753 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: 9bcda666-d36a-488f-8fb0-fe12470ff45f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:55.494782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-599bb995-df17-4fa9-9fcd-8f9ca2a8e753 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:55.495549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-599bb995-df17-4fa9-9fcd-8f9ca2a8e753 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:55.496204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-599bb995-df17-4fa9-9fcd-8f9ca2a8e753 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:55.497116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-599bb995-df17-4fa9-9fcd-8f9ca2a8e753 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:55.497746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-599bb995-df17-4fa9-9fcd-8f9ca2a8e753 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:55.498325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-599bb995-df17-4fa9-9fcd-8f9ca2a8e753 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:55.529453 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-599bb995-df17-4fa9-9fcd-8f9ca2a8e753 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] HTTP exception thrown: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-599bb995-df17-4fa9-9fcd-8f9ca2a8e753 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Request method failure captured: Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f HTTP/1.1 Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nN6Uf8w2h-mfdeKt3XJsoyv-xzv_UyQNTiNQ-vBpfFw6jZ7cScirzV8TkKnGOT2wQDbDlpkmRsC0Lnkh0Ai6f5EyawKCYbM8YAFN3k76pWMnV1jQVbRAURmiaEB6m3ni3IOBHATY6FJaoZDpW-yYZSemU3xW-LdkstpnU-7TqlruYs Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: cd7add50097c4b84859dbfac51473919 Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd7add50097c4b84859dbfac51473919", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd7add50097c4b84859dbfac51473919"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd7add50097c4b84859dbfac51473919"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd7add50097c4b84859dbfac51473919"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: cd7add50097c4b84859dbfac51473919 Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeShelveTestJSON-1410391267-project Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 13b12146c9774e9c8360d7535e43bfe3 Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1410391267-project Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '9bcda666-d36a-488f-8fb0-fe12470ff45f'} Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:54:55.534168 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:54:55.539803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:54:55.539803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:54:55.539803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:54:55.539803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:54:55.539803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:54:55.539803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:54:55.539803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. Aug 09 14:54:55.539803 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:54:55.543963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-599bb995-df17-4fa9-9fcd-8f9ca2a8e753 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Returning 404 to user: Instance 9bcda666-d36a-488f-8fb0-fe12470ff45f could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:54:55.545056 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-599bb995-df17-4fa9-9fcd-8f9ca2a8e753 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f" status: 404 len: 111 microversion: 2.20 time: 0.075117 Aug 09 14:54:55.546845 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2279/4570] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:54:55 2022] GET /compute/v2.1/servers/9bcda666-d36a-488f-8fb0-fe12470ff45f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:54:55.816025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-490ca0f2-d822-4682-9e18-a4e6c676b27e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:55.819631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-490ca0f2-d822-4682-9e18-a4e6c676b27e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:55.892386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490ca0f2-d822-4682-9e18-a4e6c676b27e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:55.898177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490ca0f2-d822-4682-9e18-a4e6c676b27e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:55.898772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490ca0f2-d822-4682-9e18-a4e6c676b27e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:55.913290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490ca0f2-d822-4682-9e18-a4e6c676b27e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:55.913787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490ca0f2-d822-4682-9e18-a4e6c676b27e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:55.914235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-490ca0f2-d822-4682-9e18-a4e6c676b27e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:56.072362 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-490ca0f2-d822-4682-9e18-a4e6c676b27e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.261679 Aug 09 14:54:56.079632 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2292/4571] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:54:55 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:57.085362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-73b08a5c-f8b0-4ba8-9023-c9270172f5c8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:57.087896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-73b08a5c-f8b0-4ba8-9023-c9270172f5c8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:57.111357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73b08a5c-f8b0-4ba8-9023-c9270172f5c8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:57.112272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73b08a5c-f8b0-4ba8-9023-c9270172f5c8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:57.120128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73b08a5c-f8b0-4ba8-9023-c9270172f5c8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:57.123176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73b08a5c-f8b0-4ba8-9023-c9270172f5c8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:57.125714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73b08a5c-f8b0-4ba8-9023-c9270172f5c8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:57.126431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-73b08a5c-f8b0-4ba8-9023-c9270172f5c8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:57.267111 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-73b08a5c-f8b0-4ba8-9023-c9270172f5c8 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186457 Aug 09 14:54:57.267948 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2280/4572] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:54:57 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:58.283119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-853076f9-e59b-432f-a08b-0b4d0d29607c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:58.286833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-853076f9-e59b-432f-a08b-0b4d0d29607c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:58.313326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-853076f9-e59b-432f-a08b-0b4d0d29607c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:58.313326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-853076f9-e59b-432f-a08b-0b4d0d29607c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:58.313326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-853076f9-e59b-432f-a08b-0b4d0d29607c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:58.314144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-853076f9-e59b-432f-a08b-0b4d0d29607c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:58.314803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-853076f9-e59b-432f-a08b-0b4d0d29607c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:58.316922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-853076f9-e59b-432f-a08b-0b4d0d29607c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:58.372780 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-853076f9-e59b-432f-a08b-0b4d0d29607c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096565 Aug 09 14:54:58.374404 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2293/4573] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:54:58 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:54:59.391775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f66ed71b-e0b3-4300-9e6f-b6189de2e2fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:54:59.417801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f66ed71b-e0b3-4300-9e6f-b6189de2e2fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:54:59.459375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f66ed71b-e0b3-4300-9e6f-b6189de2e2fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:59.459375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f66ed71b-e0b3-4300-9e6f-b6189de2e2fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:59.459375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f66ed71b-e0b3-4300-9e6f-b6189de2e2fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:59.485849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f66ed71b-e0b3-4300-9e6f-b6189de2e2fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:54:59.486815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f66ed71b-e0b3-4300-9e6f-b6189de2e2fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:54:59.493116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f66ed71b-e0b3-4300-9e6f-b6189de2e2fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:54:59.655962 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f66ed71b-e0b3-4300-9e6f-b6189de2e2fb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.269962 Aug 09 14:54:59.659157 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2281/4574] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:54:59 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:00.671389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a8282eca-e6a9-43ec-b878-bb223cc98334 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:00.674270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a8282eca-e6a9-43ec-b878-bb223cc98334 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:00.704992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8282eca-e6a9-43ec-b878-bb223cc98334 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:00.705849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8282eca-e6a9-43ec-b878-bb223cc98334 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:00.706462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8282eca-e6a9-43ec-b878-bb223cc98334 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:00.708245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8282eca-e6a9-43ec-b878-bb223cc98334 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:00.709967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8282eca-e6a9-43ec-b878-bb223cc98334 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:00.713941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8282eca-e6a9-43ec-b878-bb223cc98334 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:00.772495 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a8282eca-e6a9-43ec-b878-bb223cc98334 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107668 Aug 09 14:55:00.774157 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2294/4575] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:55:00 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:01.785120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aa4f920d-e9a6-4b08-bd48-0c784675e98f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:01.788409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aa4f920d-e9a6-4b08-bd48-0c784675e98f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:01.813813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa4f920d-e9a6-4b08-bd48-0c784675e98f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:01.817874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa4f920d-e9a6-4b08-bd48-0c784675e98f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:01.818459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa4f920d-e9a6-4b08-bd48-0c784675e98f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:01.823380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa4f920d-e9a6-4b08-bd48-0c784675e98f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:01.824906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa4f920d-e9a6-4b08-bd48-0c784675e98f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:01.826668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa4f920d-e9a6-4b08-bd48-0c784675e98f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:01.912448 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aa4f920d-e9a6-4b08-bd48-0c784675e98f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132004 Aug 09 14:55:01.913064 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2282/4576] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:55:01 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:02.934677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-204cf9f3-5895-4cd9-a212-93f20b2def16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:02.953283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-204cf9f3-5895-4cd9-a212-93f20b2def16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:02.988362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204cf9f3-5895-4cd9-a212-93f20b2def16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:02.991877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204cf9f3-5895-4cd9-a212-93f20b2def16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:02.994132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204cf9f3-5895-4cd9-a212-93f20b2def16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:02.996806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204cf9f3-5895-4cd9-a212-93f20b2def16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:02.998369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204cf9f3-5895-4cd9-a212-93f20b2def16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:03.002315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-204cf9f3-5895-4cd9-a212-93f20b2def16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:03.198220 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-204cf9f3-5895-4cd9-a212-93f20b2def16 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.276754 Aug 09 14:55:03.199750 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2295/4577] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:55:02 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:03.811991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1954251925", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "2b41208f-1d77-4241-b447-f62c3a34141c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-189901098", "security_groups": []}, "os:scheduler_hints": {"different_host": ["67f7c79f-5422-4b54-8b30-6e43275685ca"]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:03.930722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] validate_networks() for [('2b41208f-1d77-4241-b447-f62c3a34141c', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:55:04.211794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eef61d91-a5e5-4991-9710-fec60e0b1232 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:04.214159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eef61d91-a5e5-4991-9710-fec60e0b1232 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:04.232712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eef61d91-a5e5-4991-9710-fec60e0b1232 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:04.233640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eef61d91-a5e5-4991-9710-fec60e0b1232 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:04.234797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eef61d91-a5e5-4991-9710-fec60e0b1232 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:04.237139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eef61d91-a5e5-4991-9710-fec60e0b1232 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:04.239745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eef61d91-a5e5-4991-9710-fec60e0b1232 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:04.241064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eef61d91-a5e5-4991-9710-fec60e0b1232 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:04.352075 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eef61d91-a5e5-4991-9710-fec60e0b1232 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141503 Aug 09 14:55:04.356690 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2296/4578] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:55:04 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:05.262557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:55:05.263112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:55:05.263612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:55:05.264098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:55:05.264821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:55:05.298907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:05.299765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:05.303690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:05.305197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:05.305924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:05.306850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:05.378697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Getting quotas for project 7483d79edacf4600aff88566a44c44d9. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:55:05.402634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Getting quotas for user 1eadaad5eff54da5ba83805c15c28ba1 and project 7483d79edacf4600aff88566a44c44d9. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:55:05.449257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:55:05.455922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:55:05.574917 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ccab18e5-2745-4031-a7f6-cf9568f5d4df tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.767009 Aug 09 14:55:05.584362 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2283/4579] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:55:03 2022] POST /compute/v2.1/servers => generated 361 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:55:05.598805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-120e41fb-05f9-4c6d-b094-eecbd90baa63 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:05.611541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-120e41fb-05f9-4c6d-b094-eecbd90baa63 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:05.646024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-120e41fb-05f9-4c6d-b094-eecbd90baa63 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:05.646184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-120e41fb-05f9-4c6d-b094-eecbd90baa63 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:05.647573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-418660808", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "2447d34f-9d1f-49d0-85ed-a36cdb3785bd"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:05.655278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-120e41fb-05f9-4c6d-b094-eecbd90baa63 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:05.656153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-120e41fb-05f9-4c6d-b094-eecbd90baa63 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:05.656640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-120e41fb-05f9-4c6d-b094-eecbd90baa63 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:05.657079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-120e41fb-05f9-4c6d-b094-eecbd90baa63 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:05.773427 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-120e41fb-05f9-4c6d-b094-eecbd90baa63 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.186265 Aug 09 14:55:05.780232 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2284/4580] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 14:55:05 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23/os-volume_attachments => generated 25 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 14:55:05.788296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d16afd37-b3a8-4d7c-bc63-577583dd099e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:05.788930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d16afd37-b3a8-4d7c-bc63-577583dd099e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:05.914213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] validate_networks() for [('2447d34f-9d1f-49d0-85ed-a36cdb3785bd', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:55:06.086102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d16afd37-b3a8-4d7c-bc63-577583dd099e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:06.094476 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d16afd37-b3a8-4d7c-bc63-577583dd099e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1241 microversion: 2.1 time: 0.313121 Aug 09 14:55:06.098329 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2285/4581] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:05 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1241 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:06.120168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8ff6b1b8-35af-4db3-b3cc-ad09a0f05956 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:06.131633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8ff6b1b8-35af-4db3-b3cc-ad09a0f05956 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:06.151588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ff6b1b8-35af-4db3-b3cc-ad09a0f05956 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:06.155883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ff6b1b8-35af-4db3-b3cc-ad09a0f05956 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:06.159142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ff6b1b8-35af-4db3-b3cc-ad09a0f05956 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:06.162327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ff6b1b8-35af-4db3-b3cc-ad09a0f05956 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:06.175323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ff6b1b8-35af-4db3-b3cc-ad09a0f05956 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:06.177257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ff6b1b8-35af-4db3-b3cc-ad09a0f05956 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:06.285498 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-8ff6b1b8-35af-4db3-b3cc-ad09a0f05956 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] HTTP exception thrown: Cannot 'reboot' instance a3d63359-d1e0-41d5-9904-d4149424d2c4 while it is in vm_state rescued Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8ff6b1b8-35af-4db3-b3cc-ad09a0f05956 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Request method failure captured: Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4/action HTTP/1.1 Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 28 Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nQm9peRLyL-_ZL-9bNt1h-d9klu5PkrS_r357cpe12gMlxICQ1HHucyUskRO5kPygg95_v20_f9GCogcbu9CMWwyIZJ02lyqO-GFoRzdRBe_4fpq23MfQZHMH2nNzxDS_zNouresiy_aJnSNaognXLjQlW_aeA_R6cmhZY0LfELTto Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0caed61cb95467ba8b076c63f6706de", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cfd1981c518d4432b4635c1768114b22 Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: {"reboot": {"type": "HARD"}} Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: exception: Cannot 'reboot' instance a3d63359-d1e0-41d5-9904-d4149424d2c4 while it is in vm_state rescued Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'a3d63359-d1e0-41d5-9904-d4149424d2c4', 'body': {'reboot': {'type': 'HARD'}}} Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a3d63359-d1e0-41d5-9904-d4149424d2c4 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 14:55:06.295392 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 14:55:06.300300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance a3d63359-d1e0-41d5-9904-d4149424d2c4 while it is in vm_state rescued Aug 09 14:55:06.300300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:06.300300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:06.300300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:06.300300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:06.300300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:06.300300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:06.300300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:06.300300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:06.300300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance a3d63359-d1e0-41d5-9904-d4149424d2c4 while it is in vm_state rescued Aug 09 14:55:06.300300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:06.311900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8ff6b1b8-35af-4db3-b3cc-ad09a0f05956 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Returning 409 to user: Cannot 'reboot' instance a3d63359-d1e0-41d5-9904-d4149424d2c4 while it is in vm_state rescued {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:06.314180 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8ff6b1b8-35af-4db3-b3cc-ad09a0f05956 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4/action" status: 409 len: 145 microversion: 2.1 time: 0.213365 Aug 09 14:55:06.316882 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2286/4582] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:55:06 2022] POST /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4/action => generated 145 bytes in 217 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:55:06.353366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a16adef-6c40-418f-a2cf-70c4a796fd5d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:06.357315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7a16adef-6c40-418f-a2cf-70c4a796fd5d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:06.422923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a16adef-6c40-418f-a2cf-70c4a796fd5d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:06.429973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a16adef-6c40-418f-a2cf-70c4a796fd5d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:06.430450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a16adef-6c40-418f-a2cf-70c4a796fd5d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:06.438657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a16adef-6c40-418f-a2cf-70c4a796fd5d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:06.439553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a16adef-6c40-418f-a2cf-70c4a796fd5d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:06.440222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a16adef-6c40-418f-a2cf-70c4a796fd5d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:06.549577 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-7a16adef-6c40-418f-a2cf-70c4a796fd5d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] HTTP exception thrown: Cannot 'rebuild' instance a3d63359-d1e0-41d5-9904-d4149424d2c4 while it is in vm_state rescued Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a16adef-6c40-418f-a2cf-70c4a796fd5d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Request method failure captured: Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4/action HTTP/1.1 Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 65 Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nQm9peRLyL-_ZL-9bNt1h-d9klu5PkrS_r357cpe12gMlxICQ1HHucyUskRO5kPygg95_v20_f9GCogcbu9CMWwyIZJ02lyqO-GFoRzdRBe_4fpq23MfQZHMH2nNzxDS_zNouresiy_aJnSNaognXLjQlW_aeA_R6cmhZY0LfELTto Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0caed61cb95467ba8b076c63f6706de", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cfd1981c518d4432b4635c1768114b22 Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: exception: Cannot 'rebuild' instance a3d63359-d1e0-41d5-9904-d4149424d2c4 while it is in vm_state rescued Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'a3d63359-d1e0-41d5-9904-d4149424d2c4', 'body': {'rebuild': {'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250'}}} Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a3d63359-d1e0-41d5-9904-d4149424d2c4 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:55:06.551340 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance a3d63359-d1e0-41d5-9904-d4149424d2c4 while it is in vm_state rescued Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance a3d63359-d1e0-41d5-9904-d4149424d2c4 while it is in vm_state rescued Aug 09 14:55:06.557358 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:06.571785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a16adef-6c40-418f-a2cf-70c4a796fd5d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Returning 409 to user: Cannot 'rebuild' instance a3d63359-d1e0-41d5-9904-d4149424d2c4 while it is in vm_state rescued {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:06.574721 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a16adef-6c40-418f-a2cf-70c4a796fd5d tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "POST /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4/action" status: 409 len: 146 microversion: 2.1 time: 0.251266 Aug 09 14:55:06.575607 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2287/4583] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:55:06 2022] POST /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4/action => generated 146 bytes in 254 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 09 14:55:06.587041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f6281418-3788-463c-9780-56a3e5c39967 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:06.603829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f6281418-3788-463c-9780-56a3e5c39967 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:06.621845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6281418-3788-463c-9780-56a3e5c39967 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:06.623852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6281418-3788-463c-9780-56a3e5c39967 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:06.624610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6281418-3788-463c-9780-56a3e5c39967 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:06.629493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6281418-3788-463c-9780-56a3e5c39967 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:06.630639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6281418-3788-463c-9780-56a3e5c39967 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:06.631917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6281418-3788-463c-9780-56a3e5c39967 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:06.716855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f6281418-3788-463c-9780-56a3e5c39967 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:55:07.002978 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f6281418-3788-463c-9780-56a3e5c39967 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "DELETE /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 204 len: 0 microversion: 2.1 time: 0.408772 Aug 09 14:55:07.015757 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2288/4584] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:55:06 2022] DELETE /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:55:07.038370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6450e9b4-a435-4ab6-9c74-54ec4022c63f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:07.045857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6450e9b4-a435-4ab6-9c74-54ec4022c63f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:07.091762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6450e9b4-a435-4ab6-9c74-54ec4022c63f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:07.092269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6450e9b4-a435-4ab6-9c74-54ec4022c63f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:07.097154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6450e9b4-a435-4ab6-9c74-54ec4022c63f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:07.102827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6450e9b4-a435-4ab6-9c74-54ec4022c63f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:07.106279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6450e9b4-a435-4ab6-9c74-54ec4022c63f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:07.106828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6450e9b4-a435-4ab6-9c74-54ec4022c63f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:07.236527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:08.025430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6450e9b4-a435-4ab6-9c74-54ec4022c63f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:08.042001 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6450e9b4-a435-4ab6-9c74-54ec4022c63f tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1690 microversion: 2.1 time: 1.021559 Aug 09 14:55:08.060571 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2289/4585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:07 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1690 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:08.068829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0162b55-c6e9-4526-9ed9-52d0218b7c97 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:08.069768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0162b55-c6e9-4526-9ed9-52d0218b7c97 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:08.086135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0162b55-c6e9-4526-9ed9-52d0218b7c97 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:08.088303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0162b55-c6e9-4526-9ed9-52d0218b7c97 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:08.088979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0162b55-c6e9-4526-9ed9-52d0218b7c97 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:08.090417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0162b55-c6e9-4526-9ed9-52d0218b7c97 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:08.092283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0162b55-c6e9-4526-9ed9-52d0218b7c97 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:08.093032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0162b55-c6e9-4526-9ed9-52d0218b7c97 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:08.327747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c0162b55-c6e9-4526-9ed9-52d0218b7c97 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:08.344667 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0162b55-c6e9-4526-9ed9-52d0218b7c97 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1293 microversion: 2.1 time: 0.277642 Aug 09 14:55:08.345333 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2290/4586] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:08 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1293 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:09.075799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14c8907a-ec76-4fc0-b72c-08663962ca09 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:09.077467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14c8907a-ec76-4fc0-b72c-08663962ca09 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:09.080756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:09.104607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14c8907a-ec76-4fc0-b72c-08663962ca09 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:09.105763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14c8907a-ec76-4fc0-b72c-08663962ca09 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:09.107778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14c8907a-ec76-4fc0-b72c-08663962ca09 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:09.109860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14c8907a-ec76-4fc0-b72c-08663962ca09 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:09.119478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14c8907a-ec76-4fc0-b72c-08663962ca09 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:09.122889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14c8907a-ec76-4fc0-b72c-08663962ca09 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:10.278181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:55:10.278698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:55:10.279446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:55:10.281374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:55:10.281915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:55:10.286335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:10.328084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:10.333779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:10.336655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:10.342370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:10.347099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:10.348061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:10.393813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:10.457565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Getting quotas for project 9a7fa0b5c3e24ed19b5b8a1c613d9e8f. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:55:10.482936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Getting quotas for user 40efafeecf384c5bbcd52138b8ba5a1a and project 9a7fa0b5c3e24ed19b5b8a1c613d9e8f. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:55:10.546757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:55:10.555684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14c8907a-ec76-4fc0-b72c-08663962ca09 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:10.560649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:55:10.568306 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14c8907a-ec76-4fc0-b72c-08663962ca09 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1690 microversion: 2.1 time: 1.499907 Aug 09 14:55:10.571394 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2291/4587] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:09 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1690 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:10.587392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e74e1f14-e829-4dc3-8113-bfe2710d52e1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:10.588089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e74e1f14-e829-4dc3-8113-bfe2710d52e1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:10.598652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e74e1f14-e829-4dc3-8113-bfe2710d52e1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:10.604830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e74e1f14-e829-4dc3-8113-bfe2710d52e1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:10.605440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e74e1f14-e829-4dc3-8113-bfe2710d52e1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:10.606388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e74e1f14-e829-4dc3-8113-bfe2710d52e1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:10.607628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e74e1f14-e829-4dc3-8113-bfe2710d52e1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:10.608716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e74e1f14-e829-4dc3-8113-bfe2710d52e1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:10.746848 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17bbf619-c195-4eac-9f24-416b7f3d8148 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.646197 Aug 09 14:55:10.754775 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2297/4588] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:55:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 5655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:55:10.779330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-48240858-f3e0-4a00-b0a2-a3023b2ba668 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:10.785382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-48240858-f3e0-4a00-b0a2-a3023b2ba668 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:10.989279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e74e1f14-e829-4dc3-8113-bfe2710d52e1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:10.998369 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e74e1f14-e829-4dc3-8113-bfe2710d52e1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 0.424333 Aug 09 14:55:11.002268 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2292/4589] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:10 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:11.068524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-48240858-f3e0-4a00-b0a2-a3023b2ba668 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:11.084195 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-48240858-f3e0-4a00-b0a2-a3023b2ba668 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1227 microversion: 2.1 time: 0.315847 Aug 09 14:55:11.087230 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2298/4590] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:10 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1227 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:11.595282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d985667-e43f-489b-83e0-3c0474fb1d57 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:11.595924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6d985667-e43f-489b-83e0-3c0474fb1d57 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:11.614993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d985667-e43f-489b-83e0-3c0474fb1d57 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:11.618385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d985667-e43f-489b-83e0-3c0474fb1d57 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:11.620636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d985667-e43f-489b-83e0-3c0474fb1d57 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:11.633672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d985667-e43f-489b-83e0-3c0474fb1d57 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:11.634797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d985667-e43f-489b-83e0-3c0474fb1d57 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:11.636120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d985667-e43f-489b-83e0-3c0474fb1d57 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:12.028795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42fe6910-2159-4290-9e32-e914a1e2e599 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:12.029589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42fe6910-2159-4290-9e32-e914a1e2e599 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:12.061754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42fe6910-2159-4290-9e32-e914a1e2e599 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:12.062300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42fe6910-2159-4290-9e32-e914a1e2e599 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:12.070970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42fe6910-2159-4290-9e32-e914a1e2e599 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:12.071826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42fe6910-2159-4290-9e32-e914a1e2e599 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:12.072325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42fe6910-2159-4290-9e32-e914a1e2e599 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:12.073190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42fe6910-2159-4290-9e32-e914a1e2e599 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:12.299504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6d985667-e43f-489b-83e0-3c0474fb1d57 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:12.315480 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6d985667-e43f-489b-83e0-3c0474fb1d57 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1690 microversion: 2.1 time: 0.721522 Aug 09 14:55:12.319369 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2293/4591] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:11 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1690 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:12.341330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e00eaf8-a303-44cd-b98e-4a8cfade110e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:12.341955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e00eaf8-a303-44cd-b98e-4a8cfade110e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:12.363473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e00eaf8-a303-44cd-b98e-4a8cfade110e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:12.365672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e00eaf8-a303-44cd-b98e-4a8cfade110e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:12.367820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e00eaf8-a303-44cd-b98e-4a8cfade110e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:12.370487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e00eaf8-a303-44cd-b98e-4a8cfade110e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:12.371262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e00eaf8-a303-44cd-b98e-4a8cfade110e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:12.372473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e00eaf8-a303-44cd-b98e-4a8cfade110e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:12.580938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42fe6910-2159-4290-9e32-e914a1e2e599 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:12.597815 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42fe6910-2159-4290-9e32-e914a1e2e599 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 0.575104 Aug 09 14:55:12.615340 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2299/4592] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:12 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:12.699581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e00eaf8-a303-44cd-b98e-4a8cfade110e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:12.715596 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e00eaf8-a303-44cd-b98e-4a8cfade110e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1279 microversion: 2.1 time: 0.391732 Aug 09 14:55:12.717978 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2294/4593] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:12 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1279 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:13.341556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bf23b19-84ac-4494-ac67-1fcb8e9cda39 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:13.342229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8bf23b19-84ac-4494-ac67-1fcb8e9cda39 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:13.360268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bf23b19-84ac-4494-ac67-1fcb8e9cda39 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:13.360767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bf23b19-84ac-4494-ac67-1fcb8e9cda39 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:13.361251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bf23b19-84ac-4494-ac67-1fcb8e9cda39 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:13.361977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bf23b19-84ac-4494-ac67-1fcb8e9cda39 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:13.362431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bf23b19-84ac-4494-ac67-1fcb8e9cda39 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:13.362849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bf23b19-84ac-4494-ac67-1fcb8e9cda39 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:13.408479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d50d6eb6-5b4d-4d2f-a1d2-b3e4cce189e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:13.409292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d50d6eb6-5b4d-4d2f-a1d2-b3e4cce189e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:13.419178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d50d6eb6-5b4d-4d2f-a1d2-b3e4cce189e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:13.420294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d50d6eb6-5b4d-4d2f-a1d2-b3e4cce189e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:13.422190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d50d6eb6-5b4d-4d2f-a1d2-b3e4cce189e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:13.424930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d50d6eb6-5b4d-4d2f-a1d2-b3e4cce189e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:13.425602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d50d6eb6-5b4d-4d2f-a1d2-b3e4cce189e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:13.429509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d50d6eb6-5b4d-4d2f-a1d2-b3e4cce189e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:13.460097 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-d50d6eb6-5b4d-4d2f-a1d2-b3e4cce189e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] HTTP exception thrown: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d50d6eb6-5b4d-4d2f-a1d2-b3e4cce189e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Request method failure captured: Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a HTTP/1.1 Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nN6Uf8w2h-mfdeKt3XJsoyv-xzv_UyQNTiNQ-vBpfFw6jZ7cScirzV8TkKnGOT2wQDbDlpkmRsC0Lnkh0Ai6f5EyawKCYbM8YAFN3k76pWMnV1jQVbRAURmiaEB6m3ni3IOBHATY6FJaoZDpW-yYZSemU3xW-LdkstpnU-7TqlruYs Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: cd7add50097c4b84859dbfac51473919 Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd7add50097c4b84859dbfac51473919", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd7add50097c4b84859dbfac51473919"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd7add50097c4b84859dbfac51473919"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd7add50097c4b84859dbfac51473919"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: cd7add50097c4b84859dbfac51473919 Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeShelveTestJSON-1410391267-project Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 13b12146c9774e9c8360d7535e43bfe3 Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1410391267-project Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'c25a9384-ba3d-4ff8-8f2a-39ccdde0690a'} Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:55:13.467421 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d50d6eb6-5b4d-4d2f-a1d2-b3e4cce189e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Returning 404 to user: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:13.472851 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d50d6eb6-5b4d-4d2f-a1d2-b3e4cce189e2 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 404 len: 111 microversion: 2.20 time: 0.066146 Aug 09 14:55:13.477429 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2295/4594] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:55:13 2022] DELETE /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:55:13.503881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c40d73d-670b-4df4-aa34-7cb18995b024 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:13.504439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c40d73d-670b-4df4-aa34-7cb18995b024 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] [instance: c25a9384-ba3d-4ff8-8f2a-39ccdde0690a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:13.533863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c40d73d-670b-4df4-aa34-7cb18995b024 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:13.535400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c40d73d-670b-4df4-aa34-7cb18995b024 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:13.535883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c40d73d-670b-4df4-aa34-7cb18995b024 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:13.539206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c40d73d-670b-4df4-aa34-7cb18995b024 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:13.539695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c40d73d-670b-4df4-aa34-7cb18995b024 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:13.540145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c40d73d-670b-4df4-aa34-7cb18995b024 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:13.601710 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-0c40d73d-670b-4df4-aa34-7cb18995b024 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] HTTP exception thrown: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c40d73d-670b-4df4-aa34-7cb18995b024 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Request method failure captured: Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a HTTP/1.1 Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nN6Uf8w2h-mfdeKt3XJsoyv-xzv_UyQNTiNQ-vBpfFw6jZ7cScirzV8TkKnGOT2wQDbDlpkmRsC0Lnkh0Ai6f5EyawKCYbM8YAFN3k76pWMnV1jQVbRAURmiaEB6m3ni3IOBHATY6FJaoZDpW-yYZSemU3xW-LdkstpnU-7TqlruYs Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: cd7add50097c4b84859dbfac51473919 Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd7add50097c4b84859dbfac51473919", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd7add50097c4b84859dbfac51473919"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd7add50097c4b84859dbfac51473919"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd7add50097c4b84859dbfac51473919"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: cd7add50097c4b84859dbfac51473919 Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1410391267 Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeShelveTestJSON-1410391267-project Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 13b12146c9774e9c8360d7535e43bfe3 Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1410391267-project Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'c25a9384-ba3d-4ff8-8f2a-39ccdde0690a'} Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:13.609081 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:13.613763 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:13.613763 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:13.613763 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:13.613763 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:13.613763 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:13.613763 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:13.613763 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. Aug 09 14:55:13.613763 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:13.613763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c40d73d-670b-4df4-aa34-7cb18995b024 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] Returning 404 to user: Instance c25a9384-ba3d-4ff8-8f2a-39ccdde0690a could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:13.614718 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c40d73d-670b-4df4-aa34-7cb18995b024 tempest-AttachVolumeShelveTestJSON-1410391267 tempest-AttachVolumeShelveTestJSON-1410391267-project] 10.222.0.50 "GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a" status: 404 len: 111 microversion: 2.20 time: 0.135460 Aug 09 14:55:13.624320 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2296/4595] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:55:13 2022] GET /compute/v2.1/servers/c25a9384-ba3d-4ff8-8f2a-39ccdde0690a => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:55:13.646239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a233ce3d-8c35-4b46-9b2a-9f98427fa259 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:13.650257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a233ce3d-8c35-4b46-9b2a-9f98427fa259 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:13.680996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8bf23b19-84ac-4494-ac67-1fcb8e9cda39 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:13.681160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a233ce3d-8c35-4b46-9b2a-9f98427fa259 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:13.683637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a233ce3d-8c35-4b46-9b2a-9f98427fa259 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:13.687790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a233ce3d-8c35-4b46-9b2a-9f98427fa259 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:13.688678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a233ce3d-8c35-4b46-9b2a-9f98427fa259 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:13.689162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a233ce3d-8c35-4b46-9b2a-9f98427fa259 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:13.693176 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8bf23b19-84ac-4494-ac67-1fcb8e9cda39 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1690 microversion: 2.1 time: 0.355776 Aug 09 14:55:13.693422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a233ce3d-8c35-4b46-9b2a-9f98427fa259 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:13.707078 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2300/4596] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:13 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1690 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:13.744793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5756f27c-aa6f-42d1-992a-789298647ccf tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:13.747527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5756f27c-aa6f-42d1-992a-789298647ccf tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:13.765659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5756f27c-aa6f-42d1-992a-789298647ccf tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:13.766057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5756f27c-aa6f-42d1-992a-789298647ccf tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:13.766509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5756f27c-aa6f-42d1-992a-789298647ccf tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:13.767264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5756f27c-aa6f-42d1-992a-789298647ccf tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:13.767839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5756f27c-aa6f-42d1-992a-789298647ccf tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:13.783648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5756f27c-aa6f-42d1-992a-789298647ccf tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:14.080969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a233ce3d-8c35-4b46-9b2a-9f98427fa259 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:14.099680 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a233ce3d-8c35-4b46-9b2a-9f98427fa259 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 0.472926 Aug 09 14:55:14.102551 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2297/4597] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:13 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:14.109563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5756f27c-aa6f-42d1-992a-789298647ccf tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:14.130229 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5756f27c-aa6f-42d1-992a-789298647ccf tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1285 microversion: 2.1 time: 0.390826 Aug 09 14:55:14.133397 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2301/4598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:13 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1285 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:14.600099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-59a004bf-6744-488b-8316-a45ba6f73aa0 req-29421ddf-b521-47eb-a2cc-3d5bef5d901e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bdeab23-1e83-4809-98db-604e374f2e90", "tag": "fa915fdb-743b-486d-b63c-5ee9a1c9eaeb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:14.626051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-59a004bf-6744-488b-8316-a45ba6f73aa0 req-29421ddf-b521-47eb-a2cc-3d5bef5d901e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:14.631776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-59a004bf-6744-488b-8316-a45ba6f73aa0 req-29421ddf-b521-47eb-a2cc-3d5bef5d901e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:14.634167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-59a004bf-6744-488b-8316-a45ba6f73aa0 req-29421ddf-b521-47eb-a2cc-3d5bef5d901e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:14.683457 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-59a004bf-6744-488b-8316-a45ba6f73aa0 req-29421ddf-b521-47eb-a2cc-3d5bef5d901e service nova] Creating event network-changed:fa915fdb-743b-486d-b63c-5ee9a1c9eaeb for instance 3bdeab23-1e83-4809-98db-604e374f2e90 on n-h2-844626-8 Aug 09 14:55:14.694551 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-59a004bf-6744-488b-8316-a45ba6f73aa0 req-29421ddf-b521-47eb-a2cc-3d5bef5d901e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098866 Aug 09 14:55:14.699161 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2298/4599] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:15.125149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-632fb6b6-e4ea-423e-ad96-5aeb30e5b512 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:15.127520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-632fb6b6-e4ea-423e-ad96-5aeb30e5b512 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:15.142906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-632fb6b6-e4ea-423e-ad96-5aeb30e5b512 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:15.145510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-632fb6b6-e4ea-423e-ad96-5aeb30e5b512 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:15.147370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-632fb6b6-e4ea-423e-ad96-5aeb30e5b512 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:15.148364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-632fb6b6-e4ea-423e-ad96-5aeb30e5b512 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:15.152877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-632fb6b6-e4ea-423e-ad96-5aeb30e5b512 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:15.153616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-632fb6b6-e4ea-423e-ad96-5aeb30e5b512 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:15.207120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb951afc-a34c-41e9-80c6-16658016ff22 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:15.209154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bb951afc-a34c-41e9-80c6-16658016ff22 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:15.221563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb951afc-a34c-41e9-80c6-16658016ff22 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:15.227351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb951afc-a34c-41e9-80c6-16658016ff22 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:15.230361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb951afc-a34c-41e9-80c6-16658016ff22 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:15.231431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb951afc-a34c-41e9-80c6-16658016ff22 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:15.232126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb951afc-a34c-41e9-80c6-16658016ff22 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:15.233417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb951afc-a34c-41e9-80c6-16658016ff22 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:15.340064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:15.499568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bb951afc-a34c-41e9-80c6-16658016ff22 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:15.517048 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb951afc-a34c-41e9-80c6-16658016ff22 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 200 len: 1622 microversion: 2.1 time: 0.806361 Aug 09 14:55:15.518200 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2302/4600] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:14 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 1622 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:15.523533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-77900d83-ef33-4408-88cc-52e625af38a8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:15.526429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77900d83-ef33-4408-88cc-52e625af38a8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:15.541169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77900d83-ef33-4408-88cc-52e625af38a8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:15.541757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77900d83-ef33-4408-88cc-52e625af38a8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:15.543685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77900d83-ef33-4408-88cc-52e625af38a8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:15.546514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77900d83-ef33-4408-88cc-52e625af38a8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:15.547315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77900d83-ef33-4408-88cc-52e625af38a8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:15.551018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77900d83-ef33-4408-88cc-52e625af38a8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:15.592495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-632fb6b6-e4ea-423e-ad96-5aeb30e5b512 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:15.613201 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-632fb6b6-e4ea-423e-ad96-5aeb30e5b512 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 0.492825 Aug 09 14:55:15.614945 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2299/4601] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:15 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:15.738750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-1fa22797-213c-414d-ad5d-5211be97aca5 req-a1bb743f-7eba-4297-ac1d-b49fafd9e514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "053d7685-e09d-4d66-a6cc-2a61ddefcb23", "name": "network-vif-deleted", "tag": "03d361a9-3309-4c45-b997-7791815137fa"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:15.748420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-77900d83-ef33-4408-88cc-52e625af38a8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:15.765934 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-77900d83-ef33-4408-88cc-52e625af38a8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1285 microversion: 2.1 time: 0.242216 Aug 09 14:55:15.768779 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2303/4602] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:15 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1285 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:15.772188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1fa22797-213c-414d-ad5d-5211be97aca5 req-a1bb743f-7eba-4297-ac1d-b49fafd9e514 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:15.779039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1fa22797-213c-414d-ad5d-5211be97aca5 req-a1bb743f-7eba-4297-ac1d-b49fafd9e514 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:15.779760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1fa22797-213c-414d-ad5d-5211be97aca5 req-a1bb743f-7eba-4297-ac1d-b49fafd9e514 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:15.820336 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1fa22797-213c-414d-ad5d-5211be97aca5 req-a1bb743f-7eba-4297-ac1d-b49fafd9e514 service nova] Creating event network-vif-deleted:03d361a9-3309-4c45-b997-7791815137fa for instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 on n-h1-844626-8 Aug 09 14:55:15.838463 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-1fa22797-213c-414d-ad5d-5211be97aca5 req-a1bb743f-7eba-4297-ac1d-b49fafd9e514 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104417 Aug 09 14:55:15.863205 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2300/4603] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:55:16.540160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a0d4609-5755-48ed-b59d-57c398e3f316 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:16.540793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2a0d4609-5755-48ed-b59d-57c398e3f316 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 053d7685-e09d-4d66-a6cc-2a61ddefcb23] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:16.558292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a0d4609-5755-48ed-b59d-57c398e3f316 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:16.558814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a0d4609-5755-48ed-b59d-57c398e3f316 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:16.559327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a0d4609-5755-48ed-b59d-57c398e3f316 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:16.560068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a0d4609-5755-48ed-b59d-57c398e3f316 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:16.560560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a0d4609-5755-48ed-b59d-57c398e3f316 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:16.561000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2a0d4609-5755-48ed-b59d-57c398e3f316 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:16.619313 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-2a0d4609-5755-48ed-b59d-57c398e3f316 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] HTTP exception thrown: Instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 could not be found. Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a0d4609-5755-48ed-b59d-57c398e3f316 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Request method failure captured: Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 HTTP/1.1 Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nQm9peRLyL-_ZL-9bNt1h-d9klu5PkrS_r357cpe12gMlxICQ1HHucyUskRO5kPygg95_v20_f9GCogcbu9CMWwyIZJ02lyqO-GFoRzdRBe_4fpq23MfQZHMH2nNzxDS_zNouresiy_aJnSNaognXLjQlW_aeA_R6cmhZY0LfELTto Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0caed61cb95467ba8b076c63f6706de", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cfd1981c518d4432b4635c1768114b22 Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 could not be found. Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '053d7685-e09d-4d66-a6cc-2a61ddefcb23'} Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 could not be found. Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 could not be found. Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:16.620836 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:16.626580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:16.626580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:16.626580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:16.626580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:16.626580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:16.626580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:16.626580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 could not be found. Aug 09 14:55:16.626580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:16.632872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2a0d4609-5755-48ed-b59d-57c398e3f316 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Returning 404 to user: Instance 053d7685-e09d-4d66-a6cc-2a61ddefcb23 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:16.635737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6820845a-49c3-4b78-bee7-4e816d41e05e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:16.636773 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2a0d4609-5755-48ed-b59d-57c398e3f316 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23" status: 404 len: 111 microversion: 2.1 time: 0.098929 Aug 09 14:55:16.637715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6820845a-49c3-4b78-bee7-4e816d41e05e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:16.640119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:16.640304 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2304/4604] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:16 2022] GET /compute/v2.1/servers/053d7685-e09d-4d66-a6cc-2a61ddefcb23 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:55:16.647930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6820845a-49c3-4b78-bee7-4e816d41e05e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:16.648640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6820845a-49c3-4b78-bee7-4e816d41e05e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:16.649272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6820845a-49c3-4b78-bee7-4e816d41e05e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:16.652324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6820845a-49c3-4b78-bee7-4e816d41e05e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:16.653023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6820845a-49c3-4b78-bee7-4e816d41e05e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:16.653737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6820845a-49c3-4b78-bee7-4e816d41e05e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:16.663675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d16bffb9-f17c-445f-9c00-838f819c3b5e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '.version_select at 0x7f41ddd804c0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:16.741460 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d16bffb9-f17c-445f-9c00-838f819c3b5e tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1307513843" status: 202 len: 0 microversion: 2.1 time: 0.096340 Aug 09 14:55:16.744319 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2305/4605] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 14:55:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1307513843 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:55:16.788663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ca562b8-5f15-4b78-962a-c4e7502957ff tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:16.788837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ca562b8-5f15-4b78-962a-c4e7502957ff tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:16.827628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ca562b8-5f15-4b78-962a-c4e7502957ff tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:16.827967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ca562b8-5f15-4b78-962a-c4e7502957ff tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:16.831496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ca562b8-5f15-4b78-962a-c4e7502957ff tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:16.834829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ca562b8-5f15-4b78-962a-c4e7502957ff tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:16.853323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ca562b8-5f15-4b78-962a-c4e7502957ff tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:16.855937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ca562b8-5f15-4b78-962a-c4e7502957ff tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:17.145070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6820845a-49c3-4b78-bee7-4e816d41e05e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:17.172208 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6820845a-49c3-4b78-bee7-4e816d41e05e tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 0.541720 Aug 09 14:55:17.175126 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2301/4606] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:16 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:18.106918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ca562b8-5f15-4b78-962a-c4e7502957ff tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:18.118510 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ca562b8-5f15-4b78-962a-c4e7502957ff tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1327 microversion: 2.1 time: 1.333505 Aug 09 14:55:18.122042 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2306/4607] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:16 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1327 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:18.199425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-02f287da-1d8c-49ee-9986-d0f54f857e52 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:18.200000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-02f287da-1d8c-49ee-9986-d0f54f857e52 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:18.212700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02f287da-1d8c-49ee-9986-d0f54f857e52 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:18.213086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02f287da-1d8c-49ee-9986-d0f54f857e52 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:18.213733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02f287da-1d8c-49ee-9986-d0f54f857e52 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:18.214671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02f287da-1d8c-49ee-9986-d0f54f857e52 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:18.223844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02f287da-1d8c-49ee-9986-d0f54f857e52 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:18.224554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02f287da-1d8c-49ee-9986-d0f54f857e52 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:18.479769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-02f287da-1d8c-49ee-9986-d0f54f857e52 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:18.488993 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-02f287da-1d8c-49ee-9986-d0f54f857e52 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 0.293612 Aug 09 14:55:18.496154 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2302/4608] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:18 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:19.144387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-619436a9-6025-4f4e-accd-2f4d19c56637 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:19.145004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-619436a9-6025-4f4e-accd-2f4d19c56637 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:19.159168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619436a9-6025-4f4e-accd-2f4d19c56637 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:19.159674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619436a9-6025-4f4e-accd-2f4d19c56637 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:19.160119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619436a9-6025-4f4e-accd-2f4d19c56637 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:19.160838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619436a9-6025-4f4e-accd-2f4d19c56637 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:19.161291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619436a9-6025-4f4e-accd-2f4d19c56637 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:19.172204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-619436a9-6025-4f4e-accd-2f4d19c56637 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:19.517221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7e9dde27-7721-49cf-80ba-823e4ac5e089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:19.518121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7e9dde27-7721-49cf-80ba-823e4ac5e089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:19.533188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e9dde27-7721-49cf-80ba-823e4ac5e089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:19.533743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e9dde27-7721-49cf-80ba-823e4ac5e089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:19.534184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e9dde27-7721-49cf-80ba-823e4ac5e089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:19.534950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e9dde27-7721-49cf-80ba-823e4ac5e089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:19.549519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e9dde27-7721-49cf-80ba-823e4ac5e089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:19.555325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e9dde27-7721-49cf-80ba-823e4ac5e089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:19.775634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7e9dde27-7721-49cf-80ba-823e4ac5e089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:19.785700 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7e9dde27-7721-49cf-80ba-823e4ac5e089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 0.272558 Aug 09 14:55:19.786649 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2303/4609] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:19 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:19.979339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-619436a9-6025-4f4e-accd-2f4d19c56637 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:20.009873 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-619436a9-6025-4f4e-accd-2f4d19c56637 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1327 microversion: 2.1 time: 0.861787 Aug 09 14:55:20.027940 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2307/4610] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:19 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1327 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:20.812614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9866ff4-1306-4b9b-9c40-b91d4eef5735 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:20.814014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9866ff4-1306-4b9b-9c40-b91d4eef5735 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:20.825476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9866ff4-1306-4b9b-9c40-b91d4eef5735 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:20.826310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9866ff4-1306-4b9b-9c40-b91d4eef5735 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:20.826947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9866ff4-1306-4b9b-9c40-b91d4eef5735 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:20.828220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9866ff4-1306-4b9b-9c40-b91d4eef5735 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:20.828848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9866ff4-1306-4b9b-9c40-b91d4eef5735 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:20.829538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9866ff4-1306-4b9b-9c40-b91d4eef5735 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:21.034095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c0a8ed5-9342-4617-a42c-f7b67267ffb8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:21.034724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c0a8ed5-9342-4617-a42c-f7b67267ffb8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:21.058393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:21.065995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c0a8ed5-9342-4617-a42c-f7b67267ffb8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:21.066726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c0a8ed5-9342-4617-a42c-f7b67267ffb8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:21.067213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c0a8ed5-9342-4617-a42c-f7b67267ffb8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:21.067967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c0a8ed5-9342-4617-a42c-f7b67267ffb8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:21.068414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c0a8ed5-9342-4617-a42c-f7b67267ffb8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:21.076315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c0a8ed5-9342-4617-a42c-f7b67267ffb8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:21.081761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9866ff4-1306-4b9b-9c40-b91d4eef5735 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:21.082745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:21.091702 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9866ff4-1306-4b9b-9c40-b91d4eef5735 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 0.283749 Aug 09 14:55:21.097903 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2304/4611] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:20 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:21.117359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3c546fff-ad39-481c-9be5-8f956edb2607 req-e811b064-a86e-41c3-823f-d01e7645fe22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c29f9fe5-1403-4e50-8594-6b7638881d65", "tag": "e66caf28-aa20-4086-ab34-312fa518ae33"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:21.153398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3c546fff-ad39-481c-9be5-8f956edb2607 req-e811b064-a86e-41c3-823f-d01e7645fe22 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:21.154193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3c546fff-ad39-481c-9be5-8f956edb2607 req-e811b064-a86e-41c3-823f-d01e7645fe22 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:21.154775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3c546fff-ad39-481c-9be5-8f956edb2607 req-e811b064-a86e-41c3-823f-d01e7645fe22 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:21.191279 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3c546fff-ad39-481c-9be5-8f956edb2607 req-e811b064-a86e-41c3-823f-d01e7645fe22 service nova] Creating event network-changed:e66caf28-aa20-4086-ab34-312fa518ae33 for instance c29f9fe5-1403-4e50-8594-6b7638881d65 on n-h1-844626-8 Aug 09 14:55:21.212136 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3c546fff-ad39-481c-9be5-8f956edb2607 req-e811b064-a86e-41c3-823f-d01e7645fe22 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111438 Aug 09 14:55:21.213557 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2305/4612] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:21.500054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1c0a8ed5-9342-4617-a42c-f7b67267ffb8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:21.528416 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c0a8ed5-9342-4617-a42c-f7b67267ffb8 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1327 microversion: 2.1 time: 0.491068 Aug 09 14:55:21.546735 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2308/4613] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:21 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1327 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:22.119403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3874109b-f34c-48f8-8e60-21da3d200089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:22.121457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3874109b-f34c-48f8-8e60-21da3d200089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:22.138271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3874109b-f34c-48f8-8e60-21da3d200089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:22.142665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3874109b-f34c-48f8-8e60-21da3d200089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:22.144050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3874109b-f34c-48f8-8e60-21da3d200089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:22.144928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3874109b-f34c-48f8-8e60-21da3d200089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:22.147481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3874109b-f34c-48f8-8e60-21da3d200089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:22.148104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3874109b-f34c-48f8-8e60-21da3d200089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:22.553959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8515e46c-1022-4c40-ad4f-400c8495ec48 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:22.554561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8515e46c-1022-4c40-ad4f-400c8495ec48 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:22.565039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8515e46c-1022-4c40-ad4f-400c8495ec48 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:22.565543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8515e46c-1022-4c40-ad4f-400c8495ec48 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:22.565978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8515e46c-1022-4c40-ad4f-400c8495ec48 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:22.566688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8515e46c-1022-4c40-ad4f-400c8495ec48 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:22.573103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8515e46c-1022-4c40-ad4f-400c8495ec48 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:22.578327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8515e46c-1022-4c40-ad4f-400c8495ec48 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:22.583906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3874109b-f34c-48f8-8e60-21da3d200089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:22.599167 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3874109b-f34c-48f8-8e60-21da3d200089 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 0.485343 Aug 09 14:55:22.605174 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2306/4614] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:22 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:23.200114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8515e46c-1022-4c40-ad4f-400c8495ec48 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:23.209166 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8515e46c-1022-4c40-ad4f-400c8495ec48 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1327 microversion: 2.1 time: 0.659076 Aug 09 14:55:23.209772 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2309/4615] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:22 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1327 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:23.623598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9dd306f0-554f-446f-b937-50f37e837896 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:23.624510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9dd306f0-554f-446f-b937-50f37e837896 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:23.640551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd306f0-554f-446f-b937-50f37e837896 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:23.642973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd306f0-554f-446f-b937-50f37e837896 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:23.644940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd306f0-554f-446f-b937-50f37e837896 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:23.648282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd306f0-554f-446f-b937-50f37e837896 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:23.649057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd306f0-554f-446f-b937-50f37e837896 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:23.651282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd306f0-554f-446f-b937-50f37e837896 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:24.004216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9dd306f0-554f-446f-b937-50f37e837896 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:24.036656 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9dd306f0-554f-446f-b937-50f37e837896 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 0.418412 Aug 09 14:55:24.037436 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2307/4616] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:23 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:24.229304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e5311f2-fc4c-4c1f-a219-ea5edee78eae tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:24.230428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8e5311f2-fc4c-4c1f-a219-ea5edee78eae tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:24.259153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e5311f2-fc4c-4c1f-a219-ea5edee78eae tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:24.262079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e5311f2-fc4c-4c1f-a219-ea5edee78eae tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:24.262753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e5311f2-fc4c-4c1f-a219-ea5edee78eae tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:24.266628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e5311f2-fc4c-4c1f-a219-ea5edee78eae tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:24.267449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e5311f2-fc4c-4c1f-a219-ea5edee78eae tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:24.268122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e5311f2-fc4c-4c1f-a219-ea5edee78eae tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:24.768873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e5311f2-fc4c-4c1f-a219-ea5edee78eae tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:24.794169 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e5311f2-fc4c-4c1f-a219-ea5edee78eae tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1327 microversion: 2.1 time: 0.569152 Aug 09 14:55:24.827978 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2310/4617] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:24 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1327 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:25.062373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91a4e094-d35e-483b-8449-fd04fa10f69c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:25.063855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-91a4e094-d35e-483b-8449-fd04fa10f69c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:25.079279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91a4e094-d35e-483b-8449-fd04fa10f69c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:25.080163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91a4e094-d35e-483b-8449-fd04fa10f69c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:25.080861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91a4e094-d35e-483b-8449-fd04fa10f69c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:25.081824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91a4e094-d35e-483b-8449-fd04fa10f69c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:25.082532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91a4e094-d35e-483b-8449-fd04fa10f69c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:25.083366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91a4e094-d35e-483b-8449-fd04fa10f69c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:25.285364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-91a4e094-d35e-483b-8449-fd04fa10f69c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:25.295472 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91a4e094-d35e-483b-8449-fd04fa10f69c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 0.237049 Aug 09 14:55:25.301433 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2308/4618] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:25 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:25.856202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd175395-c557-45e6-9be7-a3825d99686b tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:25.857689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd175395-c557-45e6-9be7-a3825d99686b tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:25.870187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd175395-c557-45e6-9be7-a3825d99686b tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:25.882720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd175395-c557-45e6-9be7-a3825d99686b tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:25.886449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd175395-c557-45e6-9be7-a3825d99686b tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:25.890377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd175395-c557-45e6-9be7-a3825d99686b tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:25.907078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd175395-c557-45e6-9be7-a3825d99686b tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:25.910162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd175395-c557-45e6-9be7-a3825d99686b tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:26.142000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fd175395-c557-45e6-9be7-a3825d99686b tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:26.166922 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd175395-c557-45e6-9be7-a3825d99686b tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1327 microversion: 2.1 time: 0.317709 Aug 09 14:55:26.170501 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2311/4619] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:25 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1327 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:26.318751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c54bbe9-5a67-4864-86d7-571782b27dde tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:26.321755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3c54bbe9-5a67-4864-86d7-571782b27dde tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:26.354639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c54bbe9-5a67-4864-86d7-571782b27dde tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:26.355934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c54bbe9-5a67-4864-86d7-571782b27dde tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:26.362968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c54bbe9-5a67-4864-86d7-571782b27dde tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:26.365279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c54bbe9-5a67-4864-86d7-571782b27dde tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:26.367345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c54bbe9-5a67-4864-86d7-571782b27dde tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:26.367800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c54bbe9-5a67-4864-86d7-571782b27dde tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:26.470407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:26.638344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3c54bbe9-5a67-4864-86d7-571782b27dde tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:26.654462 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3c54bbe9-5a67-4864-86d7-571782b27dde tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 0.340858 Aug 09 14:55:26.678934 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2309/4620] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:26 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:27.195836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-90d12d06-80a0-4fe3-aa94-8531b3a79a1c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:27.197169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-90d12d06-80a0-4fe3-aa94-8531b3a79a1c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:27.214440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-27f4569a-d7a5-491c-ae97-71487392504c req-0d8a2259-56f4-4279-82f4-1e800b75b5e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bdeab23-1e83-4809-98db-604e374f2e90", "name": "network-vif-plugged", "status": "completed", "tag": "fa915fdb-743b-486d-b63c-5ee9a1c9eaeb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:27.236968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90d12d06-80a0-4fe3-aa94-8531b3a79a1c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:27.239174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-27f4569a-d7a5-491c-ae97-71487392504c req-0d8a2259-56f4-4279-82f4-1e800b75b5e2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:27.239680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-27f4569a-d7a5-491c-ae97-71487392504c req-0d8a2259-56f4-4279-82f4-1e800b75b5e2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:27.243224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90d12d06-80a0-4fe3-aa94-8531b3a79a1c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:27.243597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90d12d06-80a0-4fe3-aa94-8531b3a79a1c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:27.244613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90d12d06-80a0-4fe3-aa94-8531b3a79a1c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:27.244804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90d12d06-80a0-4fe3-aa94-8531b3a79a1c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:27.245442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-27f4569a-d7a5-491c-ae97-71487392504c req-0d8a2259-56f4-4279-82f4-1e800b75b5e2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:27.250520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-90d12d06-80a0-4fe3-aa94-8531b3a79a1c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:27.308810 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-27f4569a-d7a5-491c-ae97-71487392504c req-0d8a2259-56f4-4279-82f4-1e800b75b5e2 service nova] Creating event network-vif-plugged:fa915fdb-743b-486d-b63c-5ee9a1c9eaeb for instance 3bdeab23-1e83-4809-98db-604e374f2e90 on n-h2-844626-8 Aug 09 14:55:27.328531 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-27f4569a-d7a5-491c-ae97-71487392504c req-0d8a2259-56f4-4279-82f4-1e800b75b5e2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123622 Aug 09 14:55:27.363007 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2310/4621] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:27.682045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aa2ddc5e-92fc-4ba2-b62f-f2b0a50a6563 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:27.682909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aa2ddc5e-92fc-4ba2-b62f-f2b0a50a6563 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:27.691205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa2ddc5e-92fc-4ba2-b62f-f2b0a50a6563 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:27.691719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa2ddc5e-92fc-4ba2-b62f-f2b0a50a6563 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:27.692141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa2ddc5e-92fc-4ba2-b62f-f2b0a50a6563 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:27.692845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa2ddc5e-92fc-4ba2-b62f-f2b0a50a6563 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:27.693293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa2ddc5e-92fc-4ba2-b62f-f2b0a50a6563 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:27.693709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa2ddc5e-92fc-4ba2-b62f-f2b0a50a6563 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:27.743482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-90d12d06-80a0-4fe3-aa94-8531b3a79a1c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:27.755799 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-90d12d06-80a0-4fe3-aa94-8531b3a79a1c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1327 microversion: 2.1 time: 0.570562 Aug 09 14:55:27.757001 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2312/4622] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:27 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1327 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:28.431942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e6d8d57f-0ce2-473d-8017-6e397d931057 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Action: 'create', calling method: .version_select at 0x7f41e7592790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1276816095", "metadata": {"Type": "work"}}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e6d8d57f-0ce2-473d-8017-6e397d931057 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Request method failure captured: Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 122 Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nVf_vQzulbWGIPmqJcPGA53KutmCsOZkDjWSbBRO9n5wR4QG58S3O2UPHrmYjOSZ-YbMYDS4ut5_9XtmPS7lhIkMuTbgvzFWmMnZw6fUdIy4wdZfuNMMyGY6okeaDLya1MsVsEfC0pXNl3ETZT2EwP5HETxMYPxVeLlkytCiRDWJVE Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 4c4124e8ade54d5d9aefec49008d804c Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c4124e8ade54d5d9aefec49008d804c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 4c4124e8ade54d5d9aefec49008d804c Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-VolumesNegativeTest-1689559086-project Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e879be341d784194af7ca14d3c97f0e7 Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-VolumesNegativeTest-1689559086-project Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1276816095", "metadata": {"Type": "work"}}} Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1276816095', 'metadata': {'Type': 'work'}}}} Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi '#$%' Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:55:28.438243 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:55:28.443168 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 14:55:28.443168 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.443168 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:28.443168 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.443168 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.443168 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:28.443168 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:28.443168 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:55:28.443168 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:55:28.443168 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 14:55:28.443168 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.443168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e6d8d57f-0ce2-473d-8017-6e397d931057 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:28.445043 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e6d8d57f-0ce2-473d-8017-6e397d931057 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.319008 Aug 09 14:55:28.448489 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2313/4623] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Aug 9 14:55:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 324 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 14:55:28.459310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-38787985-61b9-4d0d-91b3-dffd470cd434 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Action: 'create', calling method: .version_select at 0x7f41ddf3f5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-552414316", "metadata": {"Type": "work"}}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-38787985-61b9-4d0d-91b3-dffd470cd434 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Request method failure captured: Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 119 Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nVf_vQzulbWGIPmqJcPGA53KutmCsOZkDjWSbBRO9n5wR4QG58S3O2UPHrmYjOSZ-YbMYDS4ut5_9XtmPS7lhIkMuTbgvzFWmMnZw6fUdIy4wdZfuNMMyGY6okeaDLya1MsVsEfC0pXNl3ETZT2EwP5HETxMYPxVeLlkytCiRDWJVE Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 4c4124e8ade54d5d9aefec49008d804c Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c4124e8ade54d5d9aefec49008d804c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 4c4124e8ade54d5d9aefec49008d804c Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-VolumesNegativeTest-1689559086-project Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e879be341d784194af7ca14d3c97f0e7 Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-VolumesNegativeTest-1689559086-project Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-552414316", "metadata": {"Type": "work"}}} Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-552414316', 'metadata': {'Type': 'work'}}}} Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi '0' Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:55:28.476632 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:55:28.483755 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 14:55:28.483755 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.483755 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:28.483755 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.483755 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.483755 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:28.483755 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:28.483755 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:55:28.483755 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:55:28.483755 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 14:55:28.483755 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.492189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-38787985-61b9-4d0d-91b3-dffd470cd434 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:28.493489 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-38787985-61b9-4d0d-91b3-dffd470cd434 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.038278 Aug 09 14:55:28.494581 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2314/4624] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Aug 9 14:55:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:55:28.507650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0d1702b-4389-46e2-b1e5-b934eb5bf6ca tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Action: 'create', calling method: .version_select at 0x7f41e7592670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-777025003", "metadata": {"Type": "work"}}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0d1702b-4389-46e2-b1e5-b934eb5bf6ca tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Request method failure captured: Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 118 Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nVf_vQzulbWGIPmqJcPGA53KutmCsOZkDjWSbBRO9n5wR4QG58S3O2UPHrmYjOSZ-YbMYDS4ut5_9XtmPS7lhIkMuTbgvzFWmMnZw6fUdIy4wdZfuNMMyGY6okeaDLya1MsVsEfC0pXNl3ETZT2EwP5HETxMYPxVeLlkytCiRDWJVE Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 4c4124e8ade54d5d9aefec49008d804c Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c4124e8ade54d5d9aefec49008d804c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 4c4124e8ade54d5d9aefec49008d804c Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-VolumesNegativeTest-1689559086-project Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e879be341d784194af7ca14d3c97f0e7 Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-VolumesNegativeTest-1689559086-project Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-777025003", "metadata": {"Type": "work"}}} Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-777025003', 'metadata': {'Type': 'work'}}}} Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi '' Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 14:55:28.511913 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 14:55:28.517532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 14:55:28.517532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.517532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:28.517532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.517532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.517532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:28.517532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:28.517532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 14:55:28.517532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 14:55:28.517532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 14:55:28.517532 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.528214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0d1702b-4389-46e2-b1e5-b934eb5bf6ca tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:28.529290 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0d1702b-4389-46e2-b1e5-b934eb5bf6ca tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027871 Aug 09 14:55:28.530896 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2315/4625] 10.222.0.50 () {60 vars in 1156 bytes} [Tue Aug 9 14:55:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:55:28.555079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf374fd9-d0ad-4b6d-99cc-6de03fd7d8ff tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Calling method '.version_select at 0x7f41ddf249d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:28.598353 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-bf374fd9-d0ad-4b6d-99cc-6de03fd7d8ff tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] HTTP exception thrown: Volume tempest-invalid-574968987 could not be found. Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf374fd9-d0ad-4b6d-99cc-6de03fd7d8ff tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Request method failure captured: Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-574968987 HTTP/1.1 Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nVf_vQzulbWGIPmqJcPGA53KutmCsOZkDjWSbBRO9n5wR4QG58S3O2UPHrmYjOSZ-YbMYDS4ut5_9XtmPS7lhIkMuTbgvzFWmMnZw6fUdIy4wdZfuNMMyGY6okeaDLya1MsVsEfC0pXNl3ETZT2EwP5HETxMYPxVeLlkytCiRDWJVE Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 4c4124e8ade54d5d9aefec49008d804c Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c4124e8ade54d5d9aefec49008d804c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 4c4124e8ade54d5d9aefec49008d804c Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-VolumesNegativeTest-1689559086-project Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e879be341d784194af7ca14d3c97f0e7 Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-VolumesNegativeTest-1689559086-project Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: exception: Volume tempest-invalid-574968987 could not be found. Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'tempest-invalid-574968987'} Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-574968987 could not be found. (HTTP 404) (Request-ID: req-7ad60612-90da-453f-96ba-4a95b1b3f240) Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 14:55:28.601562 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-574968987 could not be found. Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-574968987 could not be found. Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-574968987 could not be found. Aug 09 14:55:28.608046 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.613562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf374fd9-d0ad-4b6d-99cc-6de03fd7d8ff tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Returning 404 to user: Volume tempest-invalid-574968987 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:28.615426 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf374fd9-d0ad-4b6d-99cc-6de03fd7d8ff tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-574968987" status: 404 len: 98 microversion: 2.1 time: 0.067319 Aug 09 14:55:28.616537 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2316/4626] 10.222.0.50 () {58 vars in 1215 bytes} [Tue Aug 9 14:55:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-574968987 => generated 98 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 14:55:28.628361 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb3ef592-a182-42ac-bd7e-25c0ece27a70 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006645 Aug 09 14:55:28.629416 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2317/4627] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Aug 9 14:55:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 09 14:55:28.651714 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a1c12ed-083a-474b-bd13-687b50c6f4d2 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016283 Aug 09 14:55:28.653790 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2318/4628] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 14:55:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 14:55:28.670992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2819605b-8138-4451-b546-e16ef1a2653b tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Calling method '.version_select at 0x7f41e7592ca0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:28.827113 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-2819605b-8138-4451-b546-e16ef1a2653b tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] HTTP exception thrown: Volume 7e321044-84fb-4bbb-bbe3-5104bdc0a079 could not be found. Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2819605b-8138-4451-b546-e16ef1a2653b tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Request method failure captured: Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-volumes/7e321044-84fb-4bbb-bbe3-5104bdc0a079 HTTP/1.1 Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nVf_vQzulbWGIPmqJcPGA53KutmCsOZkDjWSbBRO9n5wR4QG58S3O2UPHrmYjOSZ-YbMYDS4ut5_9XtmPS7lhIkMuTbgvzFWmMnZw6fUdIy4wdZfuNMMyGY6okeaDLya1MsVsEfC0pXNl3ETZT2EwP5HETxMYPxVeLlkytCiRDWJVE Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 4c4124e8ade54d5d9aefec49008d804c Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c4124e8ade54d5d9aefec49008d804c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 4c4124e8ade54d5d9aefec49008d804c Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-VolumesNegativeTest-1689559086-project Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e879be341d784194af7ca14d3c97f0e7 Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-VolumesNegativeTest-1689559086-project Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: exception: Volume 7e321044-84fb-4bbb-bbe3-5104bdc0a079 could not be found. Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '7e321044-84fb-4bbb-bbe3-5104bdc0a079'} Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7e321044-84fb-4bbb-bbe3-5104bdc0a079 could not be found. (HTTP 404) (Request-ID: req-ec10118a-8038-4954-91e6-c31330bb80a0) Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 14:55:28.829458 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7e321044-84fb-4bbb-bbe3-5104bdc0a079 could not be found. Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7e321044-84fb-4bbb-bbe3-5104bdc0a079 could not be found. Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7e321044-84fb-4bbb-bbe3-5104bdc0a079 could not be found. Aug 09 14:55:28.834769 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:28.839667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2819605b-8138-4451-b546-e16ef1a2653b tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Returning 404 to user: Volume 7e321044-84fb-4bbb-bbe3-5104bdc0a079 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:28.841628 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2819605b-8138-4451-b546-e16ef1a2653b tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/7e321044-84fb-4bbb-bbe3-5104bdc0a079" status: 404 len: 109 microversion: 2.1 time: 0.175322 Aug 09 14:55:28.843649 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2319/4629] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:55:28 2022] DELETE /compute/v2.1/os-volumes/7e321044-84fb-4bbb-bbe3-5104bdc0a079 => generated 109 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:55:28.857005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-27b4f9eb-b54a-423e-8f4d-3f2d9804f288 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:28.859627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-27b4f9eb-b54a-423e-8f4d-3f2d9804f288 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:28.874522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27b4f9eb-b54a-423e-8f4d-3f2d9804f288 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:28.877956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27b4f9eb-b54a-423e-8f4d-3f2d9804f288 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:28.879611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27b4f9eb-b54a-423e-8f4d-3f2d9804f288 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:28.882861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27b4f9eb-b54a-423e-8f4d-3f2d9804f288 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:28.884087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27b4f9eb-b54a-423e-8f4d-3f2d9804f288 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:28.885886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27b4f9eb-b54a-423e-8f4d-3f2d9804f288 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:29.141607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aa2ddc5e-92fc-4ba2-b62f-f2b0a50a6563 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:29.151192 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aa2ddc5e-92fc-4ba2-b62f-f2b0a50a6563 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1299 microversion: 2.1 time: 1.474402 Aug 09 14:55:29.161323 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2311/4630] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:27 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1299 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:29.192070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-80f9baed-533e-44b0-964c-bd2d241101d2 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Calling method '.version_select at 0x7f41dc69e670>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:29.260081 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-80f9baed-533e-44b0-964c-bd2d241101d2 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] HTTP exception thrown: Volume 909e03ab-1aa7-410a-8117-a37f6a18fc99 could not be found. Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-80f9baed-533e-44b0-964c-bd2d241101d2 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Request method failure captured: Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-volumes/909e03ab-1aa7-410a-8117-a37f6a18fc99 HTTP/1.1 Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nVf_vQzulbWGIPmqJcPGA53KutmCsOZkDjWSbBRO9n5wR4QG58S3O2UPHrmYjOSZ-YbMYDS4ut5_9XtmPS7lhIkMuTbgvzFWmMnZw6fUdIy4wdZfuNMMyGY6okeaDLya1MsVsEfC0pXNl3ETZT2EwP5HETxMYPxVeLlkytCiRDWJVE Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 4c4124e8ade54d5d9aefec49008d804c Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c4124e8ade54d5d9aefec49008d804c", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c4124e8ade54d5d9aefec49008d804c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 4c4124e8ade54d5d9aefec49008d804c Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesNegativeTest-1689559086 Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-VolumesNegativeTest-1689559086-project Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e879be341d784194af7ca14d3c97f0e7 Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-VolumesNegativeTest-1689559086-project Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: exception: Volume 909e03ab-1aa7-410a-8117-a37f6a18fc99 could not be found. Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '909e03ab-1aa7-410a-8117-a37f6a18fc99'} Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 909e03ab-1aa7-410a-8117-a37f6a18fc99 could not be found. (HTTP 404) (Request-ID: req-ff9089eb-5fbd-4762-bffb-ed0958a0b063) Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 14:55:29.262284 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 909e03ab-1aa7-410a-8117-a37f6a18fc99 could not be found. Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 909e03ab-1aa7-410a-8117-a37f6a18fc99 could not be found. Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 909e03ab-1aa7-410a-8117-a37f6a18fc99 could not be found. Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-80f9baed-533e-44b0-964c-bd2d241101d2 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] Returning 404 to user: Volume 909e03ab-1aa7-410a-8117-a37f6a18fc99 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-80f9baed-533e-44b0-964c-bd2d241101d2 tempest-VolumesNegativeTest-1689559086 tempest-VolumesNegativeTest-1689559086-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/909e03ab-1aa7-410a-8117-a37f6a18fc99" status: 404 len: 109 microversion: 2.1 time: 0.088803 Aug 09 14:55:29.268689 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2312/4631] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:55:29 2022] GET /compute/v2.1/os-volumes/909e03ab-1aa7-410a-8117-a37f6a18fc99 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:55:29.364876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-27b4f9eb-b54a-423e-8f4d-3f2d9804f288 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:29.376323 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-27b4f9eb-b54a-423e-8f4d-3f2d9804f288 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1327 microversion: 2.1 time: 0.531237 Aug 09 14:55:29.393214 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2320/4632] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:28 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1327 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:29.436559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-baf01982-0938-4160-9462-49d7e8efc3f2 req-068cd563-49d1-4378-81ee-cbce9faf19b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c29f9fe5-1403-4e50-8594-6b7638881d65", "name": "network-vif-plugged", "status": "completed", "tag": "e66caf28-aa20-4086-ab34-312fa518ae33"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:29.479603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-baf01982-0938-4160-9462-49d7e8efc3f2 req-068cd563-49d1-4378-81ee-cbce9faf19b7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:29.480105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-baf01982-0938-4160-9462-49d7e8efc3f2 req-068cd563-49d1-4378-81ee-cbce9faf19b7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:29.480568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-baf01982-0938-4160-9462-49d7e8efc3f2 req-068cd563-49d1-4378-81ee-cbce9faf19b7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:29.530188 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-baf01982-0938-4160-9462-49d7e8efc3f2 req-068cd563-49d1-4378-81ee-cbce9faf19b7 service nova] Creating event network-vif-plugged:e66caf28-aa20-4086-ab34-312fa518ae33 for instance c29f9fe5-1403-4e50-8594-6b7638881d65 on n-h1-844626-8 Aug 09 14:55:29.536769 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-baf01982-0938-4160-9462-49d7e8efc3f2 req-068cd563-49d1-4378-81ee-cbce9faf19b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103979 Aug 09 14:55:29.558546 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2313/4633] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:30.186380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-292244b5-745a-42b5-b415-71c4c88e30b5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:30.187322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-292244b5-745a-42b5-b415-71c4c88e30b5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:30.212912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292244b5-745a-42b5-b415-71c4c88e30b5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:30.213521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292244b5-745a-42b5-b415-71c4c88e30b5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:30.214059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292244b5-745a-42b5-b415-71c4c88e30b5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:30.214879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292244b5-745a-42b5-b415-71c4c88e30b5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:30.218808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292244b5-745a-42b5-b415-71c4c88e30b5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:30.220863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-292244b5-745a-42b5-b415-71c4c88e30b5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:30.409965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b771960-e6d2-46fc-b472-977699d7b66e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:30.410673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0b771960-e6d2-46fc-b472-977699d7b66e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:30.429947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b771960-e6d2-46fc-b472-977699d7b66e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:30.430518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b771960-e6d2-46fc-b472-977699d7b66e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:30.430979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b771960-e6d2-46fc-b472-977699d7b66e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:30.431825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b771960-e6d2-46fc-b472-977699d7b66e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:30.449434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b771960-e6d2-46fc-b472-977699d7b66e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:30.450312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0b771960-e6d2-46fc-b472-977699d7b66e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:30.509991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-292244b5-745a-42b5-b415-71c4c88e30b5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:30.519251 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-292244b5-745a-42b5-b415-71c4c88e30b5 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1471 microversion: 2.1 time: 0.338750 Aug 09 14:55:30.525028 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2321/4634] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:30 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:30.552417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-66f39b4a-2542-4b94-83ad-afbad6160f71 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:30.553445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-66f39b4a-2542-4b94-83ad-afbad6160f71 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:30.568705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66f39b4a-2542-4b94-83ad-afbad6160f71 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:30.569748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66f39b4a-2542-4b94-83ad-afbad6160f71 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:30.570661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66f39b4a-2542-4b94-83ad-afbad6160f71 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:30.571800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66f39b4a-2542-4b94-83ad-afbad6160f71 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:30.572508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66f39b4a-2542-4b94-83ad-afbad6160f71 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:30.580607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66f39b4a-2542-4b94-83ad-afbad6160f71 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:30.976162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-66f39b4a-2542-4b94-83ad-afbad6160f71 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:30.997732 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-66f39b4a-2542-4b94-83ad-afbad6160f71 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1471 microversion: 2.1 time: 0.447698 Aug 09 14:55:31.001382 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2322/4635] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:30 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1471 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:31.026717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a4524fc4-2038-453a-b5a0-f84c86db6ad9 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:31.029894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a4524fc4-2038-453a-b5a0-f84c86db6ad9 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:31.050300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4524fc4-2038-453a-b5a0-f84c86db6ad9 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:31.056143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4524fc4-2038-453a-b5a0-f84c86db6ad9 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:31.058107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4524fc4-2038-453a-b5a0-f84c86db6ad9 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:31.060805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4524fc4-2038-453a-b5a0-f84c86db6ad9 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:31.063775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4524fc4-2038-453a-b5a0-f84c86db6ad9 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:31.066132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a4524fc4-2038-453a-b5a0-f84c86db6ad9 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:31.401429 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a4524fc4-2038-453a-b5a0-f84c86db6ad9 tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1622 microversion: 2.1 time: 0.377613 Aug 09 14:55:31.403314 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2323/4636] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:31 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1622 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:31.429200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-954df745-7e01-440d-a3fd-21d5c144380e tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:31.430714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-954df745-7e01-440d-a3fd-21d5c144380e tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:31.458189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-954df745-7e01-440d-a3fd-21d5c144380e tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:31.459484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-954df745-7e01-440d-a3fd-21d5c144380e tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:31.462670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-954df745-7e01-440d-a3fd-21d5c144380e tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:31.463563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-954df745-7e01-440d-a3fd-21d5c144380e tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:31.467412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-954df745-7e01-440d-a3fd-21d5c144380e tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:31.470838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-954df745-7e01-440d-a3fd-21d5c144380e tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:31.490441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:31.586193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0b771960-e6d2-46fc-b472-977699d7b66e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:31.599249 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b771960-e6d2-46fc-b472-977699d7b66e tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1327 microversion: 2.1 time: 1.193675 Aug 09 14:55:31.606744 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2314/4637] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:30 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1327 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:32.404450 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-954df745-7e01-440d-a3fd-21d5c144380e tempest-TestSecurityGroupsBasicOps-1805618307 tempest-TestSecurityGroupsBasicOps-1805618307-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1910 microversion: 2.1 time: 0.979516 Aug 09 14:55:32.407736 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2324/4638] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:31 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1910 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:32.631848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2f4f483d-efdd-4828-b4df-d98dfd0d677c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:32.633815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2f4f483d-efdd-4828-b4df-d98dfd0d677c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:32.644799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f4f483d-efdd-4828-b4df-d98dfd0d677c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:32.645500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f4f483d-efdd-4828-b4df-d98dfd0d677c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:32.647432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f4f483d-efdd-4828-b4df-d98dfd0d677c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:32.648896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f4f483d-efdd-4828-b4df-d98dfd0d677c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:32.651075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f4f483d-efdd-4828-b4df-d98dfd0d677c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:32.651776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2f4f483d-efdd-4828-b4df-d98dfd0d677c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:32.781644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85e1d824-f1fa-4ce0-ac42-332e276f8ec0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:32.785485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-85e1d824-f1fa-4ce0-ac42-332e276f8ec0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:32.820893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85e1d824-f1fa-4ce0-ac42-332e276f8ec0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:32.835044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85e1d824-f1fa-4ce0-ac42-332e276f8ec0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:32.852031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85e1d824-f1fa-4ce0-ac42-332e276f8ec0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:32.852836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85e1d824-f1fa-4ce0-ac42-332e276f8ec0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:32.853364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85e1d824-f1fa-4ce0-ac42-332e276f8ec0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:32.853854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85e1d824-f1fa-4ce0-ac42-332e276f8ec0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:32.948392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-85e1d824-f1fa-4ce0-ac42-332e276f8ec0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:55:33.149411 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-85e1d824-f1fa-4ce0-ac42-332e276f8ec0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 204 len: 0 microversion: 2.1 time: 0.372990 Aug 09 14:55:33.151975 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2325/4639] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:55:32 2022] DELETE /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:55:33.168675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bea5b8e8-6fd5-49f7-965e-dba14daae5f3 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:33.174390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bea5b8e8-6fd5-49f7-965e-dba14daae5f3 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:33.191153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bea5b8e8-6fd5-49f7-965e-dba14daae5f3 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:33.191537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bea5b8e8-6fd5-49f7-965e-dba14daae5f3 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:33.191975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bea5b8e8-6fd5-49f7-965e-dba14daae5f3 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:33.192687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bea5b8e8-6fd5-49f7-965e-dba14daae5f3 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:33.196840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bea5b8e8-6fd5-49f7-965e-dba14daae5f3 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:33.199326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bea5b8e8-6fd5-49f7-965e-dba14daae5f3 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:33.788087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bea5b8e8-6fd5-49f7-965e-dba14daae5f3 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:33.801851 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bea5b8e8-6fd5-49f7-965e-dba14daae5f3 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1477 microversion: 2.1 time: 0.644852 Aug 09 14:55:33.802469 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2326/4640] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:33 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1477 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:33.825795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2f4f483d-efdd-4828-b4df-d98dfd0d677c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:33.832351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5b4de59c-66bc-4f48-8d75-2ec83cfac3d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:33.835039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b4de59c-66bc-4f48-8d75-2ec83cfac3d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:33.844102 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2f4f483d-efdd-4828-b4df-d98dfd0d677c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1527 microversion: 2.1 time: 1.217093 Aug 09 14:55:33.848366 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2315/4641] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:32 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1527 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:33.873530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34925142-7035-4ccc-a93a-7fe8463282e0 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:33.875516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b4de59c-66bc-4f48-8d75-2ec83cfac3d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:33.883274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b4de59c-66bc-4f48-8d75-2ec83cfac3d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:33.883274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b4de59c-66bc-4f48-8d75-2ec83cfac3d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:33.883274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b4de59c-66bc-4f48-8d75-2ec83cfac3d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:33.887727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b4de59c-66bc-4f48-8d75-2ec83cfac3d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:33.888593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b4de59c-66bc-4f48-8d75-2ec83cfac3d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:33.896181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34925142-7035-4ccc-a93a-7fe8463282e0 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:33.936829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34925142-7035-4ccc-a93a-7fe8463282e0 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:33.937323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34925142-7035-4ccc-a93a-7fe8463282e0 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:33.953793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34925142-7035-4ccc-a93a-7fe8463282e0 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:33.955696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34925142-7035-4ccc-a93a-7fe8463282e0 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:33.969958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34925142-7035-4ccc-a93a-7fe8463282e0 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:33.979661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34925142-7035-4ccc-a93a-7fe8463282e0 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:34.062936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b4de59c-66bc-4f48-8d75-2ec83cfac3d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:55:34.355596 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5b4de59c-66bc-4f48-8d75-2ec83cfac3d4 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 204 len: 0 microversion: 2.1 time: 0.547996 Aug 09 14:55:34.356487 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2327/4642] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:55:33 2022] DELETE /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:55:34.370177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c49dae7-8efa-4e6d-a86d-8e2920f726de tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:34.370955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2c49dae7-8efa-4e6d-a86d-8e2920f726de tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:34.387587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c49dae7-8efa-4e6d-a86d-8e2920f726de tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:34.388034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c49dae7-8efa-4e6d-a86d-8e2920f726de tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:34.388475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c49dae7-8efa-4e6d-a86d-8e2920f726de tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:34.389176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c49dae7-8efa-4e6d-a86d-8e2920f726de tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:34.389671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c49dae7-8efa-4e6d-a86d-8e2920f726de tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:34.390231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c49dae7-8efa-4e6d-a86d-8e2920f726de tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:35.840220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-34925142-7035-4ccc-a93a-7fe8463282e0 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:35.849495 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34925142-7035-4ccc-a93a-7fe8463282e0 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1527 microversion: 2.1 time: 1.982421 Aug 09 14:55:35.867059 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2316/4643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:33 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1527 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:55:35.878491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1cea9add-4c7f-4b33-8bc6-b192b5695390 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:35.884133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1cea9add-4c7f-4b33-8bc6-b192b5695390 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:35.891241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cea9add-4c7f-4b33-8bc6-b192b5695390 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:35.892096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cea9add-4c7f-4b33-8bc6-b192b5695390 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:35.892767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cea9add-4c7f-4b33-8bc6-b192b5695390 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:35.894571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cea9add-4c7f-4b33-8bc6-b192b5695390 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:35.896111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cea9add-4c7f-4b33-8bc6-b192b5695390 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:35.896768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1cea9add-4c7f-4b33-8bc6-b192b5695390 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:35.950993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2c49dae7-8efa-4e6d-a86d-8e2920f726de tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:35.963030 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2c49dae7-8efa-4e6d-a86d-8e2920f726de tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1508 microversion: 2.1 time: 1.600159 Aug 09 14:55:35.964772 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2328/4644] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:34 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1508 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:36.551261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d8ebbe47-8dfe-43f0-a9b1-a23e9340e1c9 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:36.551762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d8ebbe47-8dfe-43f0-a9b1-a23e9340e1c9 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:36.570961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8ebbe47-8dfe-43f0-a9b1-a23e9340e1c9 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:36.576042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8ebbe47-8dfe-43f0-a9b1-a23e9340e1c9 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:36.578532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8ebbe47-8dfe-43f0-a9b1-a23e9340e1c9 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:36.583490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8ebbe47-8dfe-43f0-a9b1-a23e9340e1c9 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:36.584278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8ebbe47-8dfe-43f0-a9b1-a23e9340e1c9 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:36.584994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8ebbe47-8dfe-43f0-a9b1-a23e9340e1c9 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:36.636950 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-d8ebbe47-8dfe-43f0-a9b1-a23e9340e1c9 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] HTTP exception thrown: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d8ebbe47-8dfe-43f0-a9b1-a23e9340e1c9 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Request method failure captured: Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 HTTP/1.1 Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nVIwUjuWWrSR3EFsKmMw18f_qiat98f3XiJRG5CvD3dOXovu76K_2PheV6Wjejj_GrXbaSZMyQBkqWW5-7pBFhl3gBBSnlqvjrjJR5OTCf0K99EZAzVuQi9EVqrpQXxHr1vwD2TglxLKGUjkJoYeLrazE9-KGoelSrgRuFzXDmqQJE Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 8b6f9b754f1a4dc1bfdfb3a96a3d0c6f Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2095982954 Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8b6f9b754f1a4dc1bfdfb3a96a3d0c6f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8b6f9b754f1a4dc1bfdfb3a96a3d0c6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8b6f9b754f1a4dc1bfdfb3a96a3d0c6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8b6f9b754f1a4dc1bfdfb3a96a3d0c6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2095982954 Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 8b6f9b754f1a4dc1bfdfb3a96a3d0c6f Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2095982954 Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2095982954-project Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 840f1e61cff34f1eac5afe13b8b3a001 Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2095982954-project Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'c29f9fe5-1403-4e50-8594-6b7638881d65'} Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:55:36.638778 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d8ebbe47-8dfe-43f0-a9b1-a23e9340e1c9 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Returning 404 to user: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:36.644681 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d8ebbe47-8dfe-43f0-a9b1-a23e9340e1c9 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 404 len: 111 microversion: 2.1 time: 0.670695 Aug 09 14:55:36.665372 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2329/4645] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:55:35 2022] DELETE /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 111 bytes in 699 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:55:36.675782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f02241b7-3f35-4bcf-bc4e-47ce6a93f27c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:36.676890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f02241b7-3f35-4bcf-bc4e-47ce6a93f27c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:36.697027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02241b7-3f35-4bcf-bc4e-47ce6a93f27c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:36.697435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02241b7-3f35-4bcf-bc4e-47ce6a93f27c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:36.697871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02241b7-3f35-4bcf-bc4e-47ce6a93f27c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:36.698657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02241b7-3f35-4bcf-bc4e-47ce6a93f27c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:36.699136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02241b7-3f35-4bcf-bc4e-47ce6a93f27c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:36.699550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f02241b7-3f35-4bcf-bc4e-47ce6a93f27c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:37.133543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1cea9add-4c7f-4b33-8bc6-b192b5695390 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:37.146068 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1cea9add-4c7f-4b33-8bc6-b192b5695390 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1477 microversion: 2.1 time: 1.275348 Aug 09 14:55:37.159482 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2317/4646] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:35 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1477 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:37.159482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c524bc2a-232e-4a0a-a577-21852994b931 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:37.160265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c524bc2a-232e-4a0a-a577-21852994b931 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:37.187593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c524bc2a-232e-4a0a-a577-21852994b931 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:37.188087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c524bc2a-232e-4a0a-a577-21852994b931 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:37.191341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c524bc2a-232e-4a0a-a577-21852994b931 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:37.192483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c524bc2a-232e-4a0a-a577-21852994b931 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:37.193150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c524bc2a-232e-4a0a-a577-21852994b931 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:37.193792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c524bc2a-232e-4a0a-a577-21852994b931 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:38.124900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f02241b7-3f35-4bcf-bc4e-47ce6a93f27c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:38.141933 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f02241b7-3f35-4bcf-bc4e-47ce6a93f27c tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1527 microversion: 2.1 time: 1.473849 Aug 09 14:55:38.143756 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2330/4647] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:36 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1527 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:38.154917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-2ff849ba-640c-4a94-8a58-2109590bd0a7 req-ea2dbcad-f567-4c5e-98d8-3143c09472e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bdeab23-1e83-4809-98db-604e374f2e90", "name": "network-vif-deleted", "tag": "fa915fdb-743b-486d-b63c-5ee9a1c9eaeb"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:38.192661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2ff849ba-640c-4a94-8a58-2109590bd0a7 req-ea2dbcad-f567-4c5e-98d8-3143c09472e1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:38.195823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2ff849ba-640c-4a94-8a58-2109590bd0a7 req-ea2dbcad-f567-4c5e-98d8-3143c09472e1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:38.200233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2ff849ba-640c-4a94-8a58-2109590bd0a7 req-ea2dbcad-f567-4c5e-98d8-3143c09472e1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:38.239577 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-2ff849ba-640c-4a94-8a58-2109590bd0a7 req-ea2dbcad-f567-4c5e-98d8-3143c09472e1 service nova] Creating event network-vif-deleted:fa915fdb-743b-486d-b63c-5ee9a1c9eaeb for instance 3bdeab23-1e83-4809-98db-604e374f2e90 on n-h2-844626-8 Aug 09 14:55:38.252776 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-2ff849ba-640c-4a94-8a58-2109590bd0a7 req-ea2dbcad-f567-4c5e-98d8-3143c09472e1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105420 Aug 09 14:55:38.255222 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2331/4648] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:38.274411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41add2cb-9c03-466a-8ab0-abb780049097 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Action: 'update', calling method: >, body: {"server": {"name": "c29f9fe5-1403-4e50-8594-6b7638881d65_new"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:38.276782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c524bc2a-232e-4a0a-a577-21852994b931 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:38.284640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-41add2cb-9c03-466a-8ab0-abb780049097 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:38.284877 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c524bc2a-232e-4a0a-a577-21852994b931 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1508 microversion: 2.1 time: 1.136452 Aug 09 14:55:38.290374 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2318/4649] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:37 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1508 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:38.295265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-03b07cb8-afaa-436b-b086-70d8e9bc6ce0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:38.295700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41add2cb-9c03-466a-8ab0-abb780049097 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:38.295869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-03b07cb8-afaa-436b-b086-70d8e9bc6ce0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:38.296490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41add2cb-9c03-466a-8ab0-abb780049097 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:38.301825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41add2cb-9c03-466a-8ab0-abb780049097 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:38.306285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41add2cb-9c03-466a-8ab0-abb780049097 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:38.307236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41add2cb-9c03-466a-8ab0-abb780049097 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:38.308077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41add2cb-9c03-466a-8ab0-abb780049097 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:38.316286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b07cb8-afaa-436b-b086-70d8e9bc6ce0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:38.316777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b07cb8-afaa-436b-b086-70d8e9bc6ce0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:38.317208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b07cb8-afaa-436b-b086-70d8e9bc6ce0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:38.317917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b07cb8-afaa-436b-b086-70d8e9bc6ce0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:38.318356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b07cb8-afaa-436b-b086-70d8e9bc6ce0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:38.318778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03b07cb8-afaa-436b-b086-70d8e9bc6ce0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:38.342176 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-41add2cb-9c03-466a-8ab0-abb780049097 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] HTTP exception thrown: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41add2cb-9c03-466a-8ab0-abb780049097 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Request method failure captured: Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: request: PUT /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 HTTP/1.1 Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 64 Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nVIwUjuWWrSR3EFsKmMw18f_qiat98f3XiJRG5CvD3dOXovu76K_2PheV6Wjejj_GrXbaSZMyQBkqWW5-7pBFhl3gBBSnlqvjrjJR5OTCf0K99EZAzVuQi9EVqrpQXxHr1vwD2TglxLKGUjkJoYeLrazE9-KGoelSrgRuFzXDmqQJE Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 8b6f9b754f1a4dc1bfdfb3a96a3d0c6f Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2095982954 Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8b6f9b754f1a4dc1bfdfb3a96a3d0c6f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8b6f9b754f1a4dc1bfdfb3a96a3d0c6f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8b6f9b754f1a4dc1bfdfb3a96a3d0c6f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8b6f9b754f1a4dc1bfdfb3a96a3d0c6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2095982954 Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 8b6f9b754f1a4dc1bfdfb3a96a3d0c6f Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2095982954 Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2095982954-project Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 840f1e61cff34f1eac5afe13b8b3a001 Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2095982954-project Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": "c29f9fe5-1403-4e50-8594-6b7638881d65_new"}} Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'c29f9fe5-1403-4e50-8594-6b7638881d65', 'body': {'server': {'name': 'c29f9fe5-1403-4e50-8594-6b7638881d65_new'}}} Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 14:55:38.345292 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:38.350847 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:38.356080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41add2cb-9c03-466a-8ab0-abb780049097 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] Returning 404 to user: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:38.357487 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-41add2cb-9c03-466a-8ab0-abb780049097 tempest-ServersNegativeTestMultiTenantJSON-2095982954 tempest-ServersNegativeTestMultiTenantJSON-2095982954-project] 10.222.0.50 "PUT /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 404 len: 111 microversion: 2.1 time: 0.100661 Aug 09 14:55:38.358321 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2332/4650] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 9 14:55:38 2022] PUT /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:55:38.377058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7fb434a-3ac4-4e26-b240-2c8947c04212 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:38.379975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7fb434a-3ac4-4e26-b240-2c8947c04212 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:38.399191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7fb434a-3ac4-4e26-b240-2c8947c04212 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:38.401037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7fb434a-3ac4-4e26-b240-2c8947c04212 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:38.402965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7fb434a-3ac4-4e26-b240-2c8947c04212 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:38.404044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7fb434a-3ac4-4e26-b240-2c8947c04212 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:38.404751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7fb434a-3ac4-4e26-b240-2c8947c04212 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:38.405653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7fb434a-3ac4-4e26-b240-2c8947c04212 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:38.477730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7fb434a-3ac4-4e26-b240-2c8947c04212 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:55:38.520159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-03b07cb8-afaa-436b-b086-70d8e9bc6ce0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:38.531064 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-03b07cb8-afaa-436b-b086-70d8e9bc6ce0 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 200 len: 1326 microversion: 2.1 time: 0.239476 Aug 09 14:55:38.544272 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2319/4651] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:38 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 1326 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:38.688288 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7fb434a-3ac4-4e26-b240-2c8947c04212 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 204 len: 0 microversion: 2.1 time: 0.321275 Aug 09 14:55:38.688939 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2333/4652] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:55:38 2022] DELETE /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:55:38.701819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9dd0a373-e2c0-4a16-a3ac-14ea0359fe2d tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:38.702712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9dd0a373-e2c0-4a16-a3ac-14ea0359fe2d tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:38.718060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd0a373-e2c0-4a16-a3ac-14ea0359fe2d tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:38.718891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd0a373-e2c0-4a16-a3ac-14ea0359fe2d tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:38.720676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd0a373-e2c0-4a16-a3ac-14ea0359fe2d tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:38.723298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd0a373-e2c0-4a16-a3ac-14ea0359fe2d tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:38.726159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd0a373-e2c0-4a16-a3ac-14ea0359fe2d tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:38.726876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9dd0a373-e2c0-4a16-a3ac-14ea0359fe2d tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:39.095881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f376e0ac-33fb-4d7f-999a-af38f7b070e3 req-2762acde-2ea1-44e7-9762-6452ebf3a5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d63359-d1e0-41d5-9904-d4149424d2c4", "name": "network-vif-deleted", "tag": "f2651a39-42f5-4b62-8fcb-11bc5ff5fe10"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:39.107024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f376e0ac-33fb-4d7f-999a-af38f7b070e3 req-2762acde-2ea1-44e7-9762-6452ebf3a5d0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:39.108516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f376e0ac-33fb-4d7f-999a-af38f7b070e3 req-2762acde-2ea1-44e7-9762-6452ebf3a5d0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:39.109143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f376e0ac-33fb-4d7f-999a-af38f7b070e3 req-2762acde-2ea1-44e7-9762-6452ebf3a5d0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:39.126846 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f376e0ac-33fb-4d7f-999a-af38f7b070e3 req-2762acde-2ea1-44e7-9762-6452ebf3a5d0 service nova] Creating event network-vif-deleted:f2651a39-42f5-4b62-8fcb-11bc5ff5fe10 for instance a3d63359-d1e0-41d5-9904-d4149424d2c4 on n-h1-844626-8 Aug 09 14:55:39.135413 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f376e0ac-33fb-4d7f-999a-af38f7b070e3 req-2762acde-2ea1-44e7-9762-6452ebf3a5d0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044805 Aug 09 14:55:39.141163 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2334/4653] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:39.215156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9dd0a373-e2c0-4a16-a3ac-14ea0359fe2d tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:39.232072 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9dd0a373-e2c0-4a16-a3ac-14ea0359fe2d tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1533 microversion: 2.1 time: 0.534602 Aug 09 14:55:39.233202 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2320/4654] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:38 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1533 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:39.310307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-98a88185-8c95-4f93-9f30-6d6fec1b4c00 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:39.311242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-98a88185-8c95-4f93-9f30-6d6fec1b4c00 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:39.324422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a88185-8c95-4f93-9f30-6d6fec1b4c00 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:39.332661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a88185-8c95-4f93-9f30-6d6fec1b4c00 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:39.333220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a88185-8c95-4f93-9f30-6d6fec1b4c00 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:39.333978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a88185-8c95-4f93-9f30-6d6fec1b4c00 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:39.334456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a88185-8c95-4f93-9f30-6d6fec1b4c00 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:39.334890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-98a88185-8c95-4f93-9f30-6d6fec1b4c00 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:39.565993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c2cfca5-1f4b-4b0d-9d79-4283e1788fd1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:39.566592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2c2cfca5-1f4b-4b0d-9d79-4283e1788fd1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 3bdeab23-1e83-4809-98db-604e374f2e90] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:39.569829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=58 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:39.579044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c2cfca5-1f4b-4b0d-9d79-4283e1788fd1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:39.580434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c2cfca5-1f4b-4b0d-9d79-4283e1788fd1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:39.580560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c2cfca5-1f4b-4b0d-9d79-4283e1788fd1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:39.581346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c2cfca5-1f4b-4b0d-9d79-4283e1788fd1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:39.581832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c2cfca5-1f4b-4b0d-9d79-4283e1788fd1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:39.582334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c2cfca5-1f4b-4b0d-9d79-4283e1788fd1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:39.628300 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-2c2cfca5-1f4b-4b0d-9d79-4283e1788fd1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] HTTP exception thrown: Instance 3bdeab23-1e83-4809-98db-604e374f2e90 could not be found. Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c2cfca5-1f4b-4b0d-9d79-4283e1788fd1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Request method failure captured: Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 HTTP/1.1 Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nTYkqdPyyHztL3GVWZppwetRTICEOqQ7MqyWjQTEbC0R6vtjE3DMOqz8O169STIrvZJ_4-nwKrqeSHflVE2n3V7h4y99L_dtmiOJrudxqDvuRWCpcmNSGAxzKGXgUo-D3NVHjTkDh1gJqOCNkB4WeQU1cdo1UMAf68FgC59tPzuRac Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 7483d79edacf4600aff88566a44c44d9 Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-626437288 Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7483d79edacf4600aff88566a44c44d9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7483d79edacf4600aff88566a44c44d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7483d79edacf4600aff88566a44c44d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7483d79edacf4600aff88566a44c44d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestSecurityGroupsBasicOps-626437288 Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 7483d79edacf4600aff88566a44c44d9 Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-626437288 Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestSecurityGroupsBasicOps-626437288-project Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 1eadaad5eff54da5ba83805c15c28ba1 Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestSecurityGroupsBasicOps-626437288-project Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 3bdeab23-1e83-4809-98db-604e374f2e90 could not be found. Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3bdeab23-1e83-4809-98db-604e374f2e90'} Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bdeab23-1e83-4809-98db-604e374f2e90 could not be found. Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bdeab23-1e83-4809-98db-604e374f2e90 could not be found. Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:39.630601 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:39.637150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:39.637150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:39.637150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:39.637150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:39.637150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:39.637150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bdeab23-1e83-4809-98db-604e374f2e90 could not be found. Aug 09 14:55:39.637150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:39.637150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c2cfca5-1f4b-4b0d-9d79-4283e1788fd1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Returning 404 to user: Instance 3bdeab23-1e83-4809-98db-604e374f2e90 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:39.637150 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2c2cfca5-1f4b-4b0d-9d79-4283e1788fd1 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90" status: 404 len: 111 microversion: 2.1 time: 0.070769 Aug 09 14:55:39.641255 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2321/4655] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:39 2022] GET /compute/v2.1/servers/3bdeab23-1e83-4809-98db-604e374f2e90 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:55:39.760438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-98a88185-8c95-4f93-9f30-6d6fec1b4c00 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:39.770066 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-98a88185-8c95-4f93-9f30-6d6fec1b4c00 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 200 len: 1466 microversion: 2.1 time: 0.468046 Aug 09 14:55:39.784015 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2335/4656] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:39 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 1466 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:40.259744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-625fc10d-1503-42e6-98d6-c2cdb0c173af tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:40.262351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-625fc10d-1503-42e6-98d6-c2cdb0c173af tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:40.279735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625fc10d-1503-42e6-98d6-c2cdb0c173af tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:40.285163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625fc10d-1503-42e6-98d6-c2cdb0c173af tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:40.287967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625fc10d-1503-42e6-98d6-c2cdb0c173af tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:40.289672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625fc10d-1503-42e6-98d6-c2cdb0c173af tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:40.290463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625fc10d-1503-42e6-98d6-c2cdb0c173af tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:40.291207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-625fc10d-1503-42e6-98d6-c2cdb0c173af tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:40.805292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71004d6b-213c-4558-874d-8e66ff515bba tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:40.806527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-71004d6b-213c-4558-874d-8e66ff515bba tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: a3d63359-d1e0-41d5-9904-d4149424d2c4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:40.809730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:40.826828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71004d6b-213c-4558-874d-8e66ff515bba tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:40.827608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71004d6b-213c-4558-874d-8e66ff515bba tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:40.828233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71004d6b-213c-4558-874d-8e66ff515bba tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:40.829112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71004d6b-213c-4558-874d-8e66ff515bba tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:40.829859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71004d6b-213c-4558-874d-8e66ff515bba tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:40.830390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71004d6b-213c-4558-874d-8e66ff515bba tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:40.866815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-625fc10d-1503-42e6-98d6-c2cdb0c173af tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40efafeecf384c5bbcd52138b8ba5a1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7fa0b5c3e24ed19b5b8a1c613d9e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:40.869271 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-71004d6b-213c-4558-874d-8e66ff515bba tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] HTTP exception thrown: Instance a3d63359-d1e0-41d5-9904-d4149424d2c4 could not be found. Aug 09 14:55:40.878573 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-625fc10d-1503-42e6-98d6-c2cdb0c173af tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 200 len: 1533 microversion: 2.1 time: 0.624925 Aug 09 14:55:40.879328 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2322/4657] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:40 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 1533 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71004d6b-213c-4558-874d-8e66ff515bba tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Request method failure captured: Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 HTTP/1.1 Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nQm9peRLyL-_ZL-9bNt1h-d9klu5PkrS_r357cpe12gMlxICQ1HHucyUskRO5kPygg95_v20_f9GCogcbu9CMWwyIZJ02lyqO-GFoRzdRBe_4fpq23MfQZHMH2nNzxDS_zNouresiy_aJnSNaognXLjQlW_aeA_R6cmhZY0LfELTto Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0caed61cb95467ba8b076c63f6706de", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cfd1981c518d4432b4635c1768114b22 Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance a3d63359-d1e0-41d5-9904-d4149424d2c4 could not be found. Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'a3d63359-d1e0-41d5-9904-d4149424d2c4'} Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d63359-d1e0-41d5-9904-d4149424d2c4 could not be found. Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d63359-d1e0-41d5-9904-d4149424d2c4 could not be found. Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:40.892052 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:40.898703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:40.898703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:40.898703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:40.898703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:40.898703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:40.898703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:40.898703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d63359-d1e0-41d5-9904-d4149424d2c4 could not be found. Aug 09 14:55:40.898703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:40.900768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71004d6b-213c-4558-874d-8e66ff515bba tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Returning 404 to user: Instance a3d63359-d1e0-41d5-9904-d4149424d2c4 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:40.901911 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-71004d6b-213c-4558-874d-8e66ff515bba tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4" status: 404 len: 111 microversion: 2.1 time: 0.100848 Aug 09 14:55:40.905781 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2336/4658] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:40 2022] GET /compute/v2.1/servers/a3d63359-d1e0-41d5-9904-d4149424d2c4 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:55:40.913534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7e93e10c-2bee-45df-b7e8-cded414a78ca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:40.914297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7e93e10c-2bee-45df-b7e8-cded414a78ca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:40.920444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e93e10c-2bee-45df-b7e8-cded414a78ca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:40.921254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e93e10c-2bee-45df-b7e8-cded414a78ca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:40.921914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e93e10c-2bee-45df-b7e8-cded414a78ca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:40.922850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e93e10c-2bee-45df-b7e8-cded414a78ca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:40.923727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e93e10c-2bee-45df-b7e8-cded414a78ca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:40.924366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e93e10c-2bee-45df-b7e8-cded414a78ca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:40.954766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7e93e10c-2bee-45df-b7e8-cded414a78ca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:55:41.132645 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7e93e10c-2bee-45df-b7e8-cded414a78ca tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 204 len: 0 microversion: 2.1 time: 0.220198 Aug 09 14:55:41.133277 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2323/4659] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:55:40 2022] DELETE /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:55:41.142197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f37e309-10dc-4712-a470-e51af1a08c4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:41.142798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3f37e309-10dc-4712-a470-e51af1a08c4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:41.158563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f37e309-10dc-4712-a470-e51af1a08c4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:41.159067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f37e309-10dc-4712-a470-e51af1a08c4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:41.159535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f37e309-10dc-4712-a470-e51af1a08c4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:41.160265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f37e309-10dc-4712-a470-e51af1a08c4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:41.160708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f37e309-10dc-4712-a470-e51af1a08c4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:41.161130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f37e309-10dc-4712-a470-e51af1a08c4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:41.196978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-748a51ae-3bbf-47f6-99d5-b7f8cf408cec req-630106f5-a6af-4ee2-b2d7-00297d6fd426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c29f9fe5-1403-4e50-8594-6b7638881d65", "name": "network-vif-deleted", "tag": "e66caf28-aa20-4086-ab34-312fa518ae33"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:41.225634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-748a51ae-3bbf-47f6-99d5-b7f8cf408cec req-630106f5-a6af-4ee2-b2d7-00297d6fd426 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:41.229867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-748a51ae-3bbf-47f6-99d5-b7f8cf408cec req-630106f5-a6af-4ee2-b2d7-00297d6fd426 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:41.232489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-748a51ae-3bbf-47f6-99d5-b7f8cf408cec req-630106f5-a6af-4ee2-b2d7-00297d6fd426 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:41.271995 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-748a51ae-3bbf-47f6-99d5-b7f8cf408cec req-630106f5-a6af-4ee2-b2d7-00297d6fd426 service nova] Creating event network-vif-deleted:e66caf28-aa20-4086-ab34-312fa518ae33 for instance c29f9fe5-1403-4e50-8594-6b7638881d65 on n-h1-844626-8 Aug 09 14:55:41.284642 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-748a51ae-3bbf-47f6-99d5-b7f8cf408cec req-630106f5-a6af-4ee2-b2d7-00297d6fd426 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090875 Aug 09 14:55:41.285321 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2324/4660] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:55:41.900853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bd3df824-85fe-4bb6-9e72-3c34eb0f21b3 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:41.902666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bd3df824-85fe-4bb6-9e72-3c34eb0f21b3 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] [instance: c29f9fe5-1403-4e50-8594-6b7638881d65] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:41.912324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3f37e309-10dc-4712-a470-e51af1a08c4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:41.914457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd3df824-85fe-4bb6-9e72-3c34eb0f21b3 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:41.915149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd3df824-85fe-4bb6-9e72-3c34eb0f21b3 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:41.915907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd3df824-85fe-4bb6-9e72-3c34eb0f21b3 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:41.916936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd3df824-85fe-4bb6-9e72-3c34eb0f21b3 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:41.917733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd3df824-85fe-4bb6-9e72-3c34eb0f21b3 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:41.918329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd3df824-85fe-4bb6-9e72-3c34eb0f21b3 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:41.933171 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3f37e309-10dc-4712-a470-e51af1a08c4c tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1521 microversion: 2.1 time: 0.795171 Aug 09 14:55:41.936352 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-bd3df824-85fe-4bb6-9e72-3c34eb0f21b3 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] HTTP exception thrown: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:41.937313 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2337/4661] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:41 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1521 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bd3df824-85fe-4bb6-9e72-3c34eb0f21b3 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Request method failure captured: Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 HTTP/1.1 Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nUwrg2dMA_URbXsdBC-CF1lnEFbVvLVrPN_EHqLCLtaX8BV1y1JhZfgMMuQGA5EyKheb7TusGo-elmUkZ5mzzZ5kPSoDmxzeKCkfujoKFJMzQOMZAy4k9UGlCsOyAzcOU8oJ8Zd6Ru38l9yk9ByXIsWh2klArgSHBo_krp9w6P9Mhg Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9a7fa0b5c3e24ed19b5b8a1c613d9e8f Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1808510031 Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9a7fa0b5c3e24ed19b5b8a1c613d9e8f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9a7fa0b5c3e24ed19b5b8a1c613d9e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9a7fa0b5c3e24ed19b5b8a1c613d9e8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9a7fa0b5c3e24ed19b5b8a1c613d9e8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1808510031 Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9a7fa0b5c3e24ed19b5b8a1c613d9e8f Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1808510031 Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1808510031-project Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 40efafeecf384c5bbcd52138b8ba5a1a Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1808510031-project Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'c29f9fe5-1403-4e50-8594-6b7638881d65'} Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:41.938649 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:41.945780 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:41.945780 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:41.945780 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:41.945780 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:41.945780 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:41.945780 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:41.945780 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:41.945780 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. Aug 09 14:55:41.945780 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:55:41.945780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bd3df824-85fe-4bb6-9e72-3c34eb0f21b3 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] Returning 404 to user: Instance c29f9fe5-1403-4e50-8594-6b7638881d65 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:41.945780 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bd3df824-85fe-4bb6-9e72-3c34eb0f21b3 tempest-ServersNegativeTestMultiTenantJSON-1808510031 tempest-ServersNegativeTestMultiTenantJSON-1808510031-project] 10.222.0.50 "GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65" status: 404 len: 111 microversion: 2.1 time: 0.044172 Aug 09 14:55:41.945780 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2325/4662] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:41 2022] GET /compute/v2.1/servers/c29f9fe5-1403-4e50-8594-6b7638881d65 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:55:42.967042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7f51d275-8cd4-4010-9ef2-520eef4693ff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:42.974225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7f51d275-8cd4-4010-9ef2-520eef4693ff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:42.982706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f51d275-8cd4-4010-9ef2-520eef4693ff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:42.984551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f51d275-8cd4-4010-9ef2-520eef4693ff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:42.986216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f51d275-8cd4-4010-9ef2-520eef4693ff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:42.987916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f51d275-8cd4-4010-9ef2-520eef4693ff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:42.990338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f51d275-8cd4-4010-9ef2-520eef4693ff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:42.990971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f51d275-8cd4-4010-9ef2-520eef4693ff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:43.475111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7f51d275-8cd4-4010-9ef2-520eef4693ff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:43.491707 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7f51d275-8cd4-4010-9ef2-520eef4693ff tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1521 microversion: 2.1 time: 0.535989 Aug 09 14:55:43.499341 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2338/4663] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:42 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:44.528553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f6f6b34a-478e-4ba8-92cb-f2296b9a8ff7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:44.529269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f6f6b34a-478e-4ba8-92cb-f2296b9a8ff7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:44.540336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6f6b34a-478e-4ba8-92cb-f2296b9a8ff7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:44.540901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6f6b34a-478e-4ba8-92cb-f2296b9a8ff7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:44.542234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6f6b34a-478e-4ba8-92cb-f2296b9a8ff7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:44.543434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6f6b34a-478e-4ba8-92cb-f2296b9a8ff7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:44.544156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6f6b34a-478e-4ba8-92cb-f2296b9a8ff7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:44.544839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6f6b34a-478e-4ba8-92cb-f2296b9a8ff7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:45.440772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f6f6b34a-478e-4ba8-92cb-f2296b9a8ff7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:45.451011 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f6f6b34a-478e-4ba8-92cb-f2296b9a8ff7 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1521 microversion: 2.1 time: 0.932556 Aug 09 14:55:45.454149 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2326/4664] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:44 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1521 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:46.477818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a56444cd-0753-4c49-81ae-043f20b13106 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:46.479362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a56444cd-0753-4c49-81ae-043f20b13106 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:46.504948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a56444cd-0753-4c49-81ae-043f20b13106 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:46.505504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a56444cd-0753-4c49-81ae-043f20b13106 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:46.508824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a56444cd-0753-4c49-81ae-043f20b13106 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:46.512929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a56444cd-0753-4c49-81ae-043f20b13106 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:46.516552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a56444cd-0753-4c49-81ae-043f20b13106 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:46.517039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a56444cd-0753-4c49-81ae-043f20b13106 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:46.532126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:46.947376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a56444cd-0753-4c49-81ae-043f20b13106 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd1981c518d4432b4635c1768114b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0caed61cb95467ba8b076c63f6706de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:46.958922 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a56444cd-0753-4c49-81ae-043f20b13106 tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 200 len: 1479 microversion: 2.1 time: 0.490838 Aug 09 14:55:46.960934 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2339/4665] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:46 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 1479 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:55:46.988161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-7ee2dd0e-9590-4cc6-998f-408cc7bce0f1 req-4eb22e9c-0dfd-4f80-8467-2057d0a31bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e813d1b-4c53-4343-a42b-6692f9fc40b6", "name": "network-vif-deleted", "tag": "8f712dae-4cf1-4267-aeca-fc43eb8c99ef"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:47.047291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7ee2dd0e-9590-4cc6-998f-408cc7bce0f1 req-4eb22e9c-0dfd-4f80-8467-2057d0a31bc9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:47.048980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7ee2dd0e-9590-4cc6-998f-408cc7bce0f1 req-4eb22e9c-0dfd-4f80-8467-2057d0a31bc9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:47.049817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7ee2dd0e-9590-4cc6-998f-408cc7bce0f1 req-4eb22e9c-0dfd-4f80-8467-2057d0a31bc9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:47.082863 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-7ee2dd0e-9590-4cc6-998f-408cc7bce0f1 req-4eb22e9c-0dfd-4f80-8467-2057d0a31bc9 service nova] Creating event network-vif-deleted:8f712dae-4cf1-4267-aeca-fc43eb8c99ef for instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 on n-h2-844626-8 Aug 09 14:55:47.097139 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-7ee2dd0e-9590-4cc6-998f-408cc7bce0f1 req-4eb22e9c-0dfd-4f80-8467-2057d0a31bc9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119682 Aug 09 14:55:47.099034 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2327/4666] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:47.985551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8ae94d2-f91c-401c-9fbc-7be2fb90dedb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:47.986325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8ae94d2-f91c-401c-9fbc-7be2fb90dedb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] [instance: 7e813d1b-4c53-4343-a42b-6692f9fc40b6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:48.005927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8ae94d2-f91c-401c-9fbc-7be2fb90dedb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:48.006578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8ae94d2-f91c-401c-9fbc-7be2fb90dedb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:48.007134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8ae94d2-f91c-401c-9fbc-7be2fb90dedb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:48.007952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8ae94d2-f91c-401c-9fbc-7be2fb90dedb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:48.008506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8ae94d2-f91c-401c-9fbc-7be2fb90dedb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:48.009050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8ae94d2-f91c-401c-9fbc-7be2fb90dedb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:48.038316 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-e8ae94d2-f91c-401c-9fbc-7be2fb90dedb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] HTTP exception thrown: Instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 could not be found. Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8ae94d2-f91c-401c-9fbc-7be2fb90dedb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Request method failure captured: Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 HTTP/1.1 Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nQm9peRLyL-_ZL-9bNt1h-d9klu5PkrS_r357cpe12gMlxICQ1HHucyUskRO5kPygg95_v20_f9GCogcbu9CMWwyIZJ02lyqO-GFoRzdRBe_4fpq23MfQZHMH2nNzxDS_zNouresiy_aJnSNaognXLjQlW_aeA_R6cmhZY0LfELTto Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0caed61cb95467ba8b076c63f6706de", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0caed61cb95467ba8b076c63f6706de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: e0caed61cb95467ba8b076c63f6706de Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1796794339 Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cfd1981c518d4432b4635c1768114b22 Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1796794339-project Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 could not be found. Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '7e813d1b-4c53-4343-a42b-6692f9fc40b6'} Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 could not be found. Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 could not be found. Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:48.040030 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:55:48.044479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:48.044479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:55:48.044479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:55:48.044479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:55:48.044479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:55:48.044479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:55:48.044479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 could not be found. Aug 09 14:55:48.044479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:55:48.048472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8ae94d2-f91c-401c-9fbc-7be2fb90dedb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] Returning 404 to user: Instance 7e813d1b-4c53-4343-a42b-6692f9fc40b6 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:55:48.054234 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e8ae94d2-f91c-401c-9fbc-7be2fb90dedb tempest-ServerRescueNegativeTestJSON-1796794339 tempest-ServerRescueNegativeTestJSON-1796794339-project] 10.222.0.50 "GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6" status: 404 len: 111 microversion: 2.1 time: 0.072937 Aug 09 14:55:48.055122 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2340/4667] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:47 2022] GET /compute/v2.1/servers/7e813d1b-4c53-4343-a42b-6692f9fc40b6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:55:57.043293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:57.054464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f3528d0f-e0cc-45d1-8188-92f6c978b52d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:57.055294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f3528d0f-e0cc-45d1-8188-92f6c978b52d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:57.065065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:57.070837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3528d0f-e0cc-45d1-8188-92f6c978b52d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:57.071393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3528d0f-e0cc-45d1-8188-92f6c978b52d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:57.071868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3528d0f-e0cc-45d1-8188-92f6c978b52d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:57.077723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3528d0f-e0cc-45d1-8188-92f6c978b52d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:57.078310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3528d0f-e0cc-45d1-8188-92f6c978b52d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:57.078766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3528d0f-e0cc-45d1-8188-92f6c978b52d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:58.007580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f3528d0f-e0cc-45d1-8188-92f6c978b52d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:55:58.269361 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f3528d0f-e0cc-45d1-8188-92f6c978b52d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 204 len: 0 microversion: 2.32 time: 1.910206 Aug 09 14:55:58.273465 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2328/4668] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:55:56 2022] DELETE /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 0 bytes in 1917 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:55:58.281163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cbd6bb73-9648-4c87-a047-edcbd15a991f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:58.282100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cbd6bb73-9648-4c87-a047-edcbd15a991f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:58.286957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=9 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:58.287529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=7 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:55:58.304043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbd6bb73-9648-4c87-a047-edcbd15a991f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:58.304563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbd6bb73-9648-4c87-a047-edcbd15a991f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:58.305222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbd6bb73-9648-4c87-a047-edcbd15a991f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:58.306401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbd6bb73-9648-4c87-a047-edcbd15a991f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:58.307040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbd6bb73-9648-4c87-a047-edcbd15a991f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:58.308060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbd6bb73-9648-4c87-a047-edcbd15a991f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:58.540570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-20a70ed2-9399-462b-ac1c-a765538a279c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:58.541445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-20a70ed2-9399-462b-ac1c-a765538a279c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:58.552451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20a70ed2-9399-462b-ac1c-a765538a279c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:58.553249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20a70ed2-9399-462b-ac1c-a765538a279c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:58.554633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20a70ed2-9399-462b-ac1c-a765538a279c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:58.559133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20a70ed2-9399-462b-ac1c-a765538a279c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:58.559771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20a70ed2-9399-462b-ac1c-a765538a279c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:58.560302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20a70ed2-9399-462b-ac1c-a765538a279c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:58.604218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-20a70ed2-9399-462b-ac1c-a765538a279c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:55:58.847855 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-20a70ed2-9399-462b-ac1c-a765538a279c tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "DELETE /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 204 len: 0 microversion: 2.1 time: 0.307987 Aug 09 14:55:58.850288 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2329/4669] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:55:58 2022] DELETE /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 14:55:58.871762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-aa1ff1d8-85ac-4702-b124-e26890f2d701 req-2748ed26-5eb9-4b72-a2dc-e8db0012feaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f7c79f-5422-4b54-8b30-6e43275685ca", "tag": "cba71fef-c335-4fa5-9aee-238338ee5ad7"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:55:58.921886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-aa1ff1d8-85ac-4702-b124-e26890f2d701 req-2748ed26-5eb9-4b72-a2dc-e8db0012feaa service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:58.922618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-aa1ff1d8-85ac-4702-b124-e26890f2d701 req-2748ed26-5eb9-4b72-a2dc-e8db0012feaa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:58.924162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-aa1ff1d8-85ac-4702-b124-e26890f2d701 req-2748ed26-5eb9-4b72-a2dc-e8db0012feaa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:58.948709 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-aa1ff1d8-85ac-4702-b124-e26890f2d701 req-2748ed26-5eb9-4b72-a2dc-e8db0012feaa service nova] Creating event network-changed:cba71fef-c335-4fa5-9aee-238338ee5ad7 for instance 67f7c79f-5422-4b54-8b30-6e43275685ca on n-h1-844626-8 Aug 09 14:55:58.966838 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-aa1ff1d8-85ac-4702-b124-e26890f2d701 req-2748ed26-5eb9-4b72-a2dc-e8db0012feaa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111686 Aug 09 14:55:58.967921 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2330/4670] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:55:58.982815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-38ac0ef5-66b3-41dd-a677-5e37d1c29775 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:55:58.983594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-38ac0ef5-66b3-41dd-a677-5e37d1c29775 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:55:59.004932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38ac0ef5-66b3-41dd-a677-5e37d1c29775 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:59.008568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38ac0ef5-66b3-41dd-a677-5e37d1c29775 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:59.009426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38ac0ef5-66b3-41dd-a677-5e37d1c29775 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:59.010073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38ac0ef5-66b3-41dd-a677-5e37d1c29775 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:55:59.010601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38ac0ef5-66b3-41dd-a677-5e37d1c29775 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:55:59.011051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38ac0ef5-66b3-41dd-a677-5e37d1c29775 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:55:59.363518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cbd6bb73-9648-4c87-a047-edcbd15a991f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:59.384593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cbd6bb73-9648-4c87-a047-edcbd15a991f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:59.388422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cbd6bb73-9648-4c87-a047-edcbd15a991f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:59.403672 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cbd6bb73-9648-4c87-a047-edcbd15a991f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2951 microversion: 2.32 time: 1.126324 Aug 09 14:55:59.404911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2341/4671] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:55:58 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2951 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:55:59.582300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-38ac0ef5-66b3-41dd-a677-5e37d1c29775 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:55:59.593101 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-38ac0ef5-66b3-41dd-a677-5e37d1c29775 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1765 microversion: 2.1 time: 0.620144 Aug 09 14:55:59.594710 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2331/4672] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:55:58 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1765 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:56:00.447026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-16746f44-74d7-448c-993f-455d5d3f4a5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:00.447832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-16746f44-74d7-448c-993f-455d5d3f4a5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:00.469282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16746f44-74d7-448c-993f-455d5d3f4a5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:00.471015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16746f44-74d7-448c-993f-455d5d3f4a5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:00.471342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16746f44-74d7-448c-993f-455d5d3f4a5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:00.472442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16746f44-74d7-448c-993f-455d5d3f4a5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:00.473495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16746f44-74d7-448c-993f-455d5d3f4a5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:00.476085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16746f44-74d7-448c-993f-455d5d3f4a5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:00.615186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f175bc57-ffaa-4675-aff5-0fb4e7a561ec tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:00.616459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f175bc57-ffaa-4675-aff5-0fb4e7a561ec tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:00.623583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f175bc57-ffaa-4675-aff5-0fb4e7a561ec tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:00.624076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f175bc57-ffaa-4675-aff5-0fb4e7a561ec tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:00.631786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f175bc57-ffaa-4675-aff5-0fb4e7a561ec tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:00.632574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f175bc57-ffaa-4675-aff5-0fb4e7a561ec tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:00.633055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f175bc57-ffaa-4675-aff5-0fb4e7a561ec tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:00.633489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f175bc57-ffaa-4675-aff5-0fb4e7a561ec tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:01.182324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f175bc57-ffaa-4675-aff5-0fb4e7a561ec tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:01.195116 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f175bc57-ffaa-4675-aff5-0fb4e7a561ec tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1765 microversion: 2.1 time: 0.579995 Aug 09 14:56:01.196400 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2332/4673] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:00 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1765 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:56:01.216193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-16746f44-74d7-448c-993f-455d5d3f4a5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:01.239667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-16746f44-74d7-448c-993f-455d5d3f4a5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:01.252109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-16746f44-74d7-448c-993f-455d5d3f4a5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:01.255743 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-16746f44-74d7-448c-993f-455d5d3f4a5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2951 microversion: 2.32 time: 0.822810 Aug 09 14:56:01.261464 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2342/4674] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:00 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2951 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:02.216901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a11b7106-41ab-4fb9-bdbe-ad09fa3b2c58 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:02.217509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a11b7106-41ab-4fb9-bdbe-ad09fa3b2c58 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:02.228455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a11b7106-41ab-4fb9-bdbe-ad09fa3b2c58 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:02.238103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a11b7106-41ab-4fb9-bdbe-ad09fa3b2c58 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:02.238671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a11b7106-41ab-4fb9-bdbe-ad09fa3b2c58 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:02.239469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a11b7106-41ab-4fb9-bdbe-ad09fa3b2c58 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:02.239968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a11b7106-41ab-4fb9-bdbe-ad09fa3b2c58 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:02.240402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a11b7106-41ab-4fb9-bdbe-ad09fa3b2c58 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:02.292722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36f7b08b-41e7-4ca2-8328-e567b077d0be tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:02.294213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-36f7b08b-41e7-4ca2-8328-e567b077d0be tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:02.303944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36f7b08b-41e7-4ca2-8328-e567b077d0be tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:02.310312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36f7b08b-41e7-4ca2-8328-e567b077d0be tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:02.311148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36f7b08b-41e7-4ca2-8328-e567b077d0be tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:02.312255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36f7b08b-41e7-4ca2-8328-e567b077d0be tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:02.312882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36f7b08b-41e7-4ca2-8328-e567b077d0be tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:02.313549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36f7b08b-41e7-4ca2-8328-e567b077d0be tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:03.065625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-36f7b08b-41e7-4ca2-8328-e567b077d0be tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:03.080928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-36f7b08b-41e7-4ca2-8328-e567b077d0be tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:03.085715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-36f7b08b-41e7-4ca2-8328-e567b077d0be tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:03.088731 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36f7b08b-41e7-4ca2-8328-e567b077d0be tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2951 microversion: 2.32 time: 0.800967 Aug 09 14:56:03.091513 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2343/4675] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:02 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2951 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:03.100178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a11b7106-41ab-4fb9-bdbe-ad09fa3b2c58 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:03.112104 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a11b7106-41ab-4fb9-bdbe-ad09fa3b2c58 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1765 microversion: 2.1 time: 0.898894 Aug 09 14:56:03.116348 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2333/4676] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:02 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1765 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:56:04.147760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8e7dce3-f199-44e3-b6ee-44293a15c114 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:04.148453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b8e7dce3-f199-44e3-b6ee-44293a15c114 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:04.168100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e7dce3-f199-44e3-b6ee-44293a15c114 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:04.170043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e7dce3-f199-44e3-b6ee-44293a15c114 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:04.171045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e7dce3-f199-44e3-b6ee-44293a15c114 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:04.174556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e7dce3-f199-44e3-b6ee-44293a15c114 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:04.175405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e7dce3-f199-44e3-b6ee-44293a15c114 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:04.179707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e7dce3-f199-44e3-b6ee-44293a15c114 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:04.201799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0b3dac3-bb9a-475f-a829-478fc29d805c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:04.202775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e0b3dac3-bb9a-475f-a829-478fc29d805c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:04.226153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0b3dac3-bb9a-475f-a829-478fc29d805c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:04.229345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0b3dac3-bb9a-475f-a829-478fc29d805c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:04.229934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0b3dac3-bb9a-475f-a829-478fc29d805c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:04.233282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0b3dac3-bb9a-475f-a829-478fc29d805c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:04.235999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0b3dac3-bb9a-475f-a829-478fc29d805c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:04.236563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0b3dac3-bb9a-475f-a829-478fc29d805c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:04.733742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8e7dce3-f199-44e3-b6ee-44293a15c114 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eadaad5eff54da5ba83805c15c28ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7483d79edacf4600aff88566a44c44d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:04.755254 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8e7dce3-f199-44e3-b6ee-44293a15c114 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 200 len: 1528 microversion: 2.1 time: 0.611775 Aug 09 14:56:04.756330 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2344/4677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:04 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 1528 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:56:04.788295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-cac43ea3-597a-4ae3-ab69-69d62b99b543 req-938a287d-0c18-4184-86fd-4ffb0549e798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-unplugged", "status": "completed", "tag": "1bbb6bc7-df59-43ad-bd7e-3c6cac208995"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:04.835499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cac43ea3-597a-4ae3-ab69-69d62b99b543 req-938a287d-0c18-4184-86fd-4ffb0549e798 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:04.835988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cac43ea3-597a-4ae3-ab69-69d62b99b543 req-938a287d-0c18-4184-86fd-4ffb0549e798 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:04.836421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cac43ea3-597a-4ae3-ab69-69d62b99b543 req-938a287d-0c18-4184-86fd-4ffb0549e798 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:04.880537 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-cac43ea3-597a-4ae3-ab69-69d62b99b543 req-938a287d-0c18-4184-86fd-4ffb0549e798 service nova] Creating event network-vif-unplugged:1bbb6bc7-df59-43ad-bd7e-3c6cac208995 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:56:04.905598 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-cac43ea3-597a-4ae3-ab69-69d62b99b543 req-938a287d-0c18-4184-86fd-4ffb0549e798 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143403 Aug 09 14:56:04.914049 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2345/4678] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:04.922702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5a75a0e2-b22f-48c8-9a68-bb95f44d1c21 req-984a7b75-f287-4793-b4ad-b078555cadf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f7c79f-5422-4b54-8b30-6e43275685ca", "name": "network-vif-deleted", "tag": "cba71fef-c335-4fa5-9aee-238338ee5ad7"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:04.971840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5a75a0e2-b22f-48c8-9a68-bb95f44d1c21 req-984a7b75-f287-4793-b4ad-b078555cadf1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:04.975807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5a75a0e2-b22f-48c8-9a68-bb95f44d1c21 req-984a7b75-f287-4793-b4ad-b078555cadf1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:04.979464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5a75a0e2-b22f-48c8-9a68-bb95f44d1c21 req-984a7b75-f287-4793-b4ad-b078555cadf1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:05.024608 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5a75a0e2-b22f-48c8-9a68-bb95f44d1c21 req-984a7b75-f287-4793-b4ad-b078555cadf1 service nova] Creating event network-vif-deleted:cba71fef-c335-4fa5-9aee-238338ee5ad7 for instance 67f7c79f-5422-4b54-8b30-6e43275685ca on n-h1-844626-8 Aug 09 14:56:05.042477 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5a75a0e2-b22f-48c8-9a68-bb95f44d1c21 req-984a7b75-f287-4793-b4ad-b078555cadf1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126583 Aug 09 14:56:05.049256 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2346/4679] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:05.537120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e0b3dac3-bb9a-475f-a829-478fc29d805c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:05.549479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e0b3dac3-bb9a-475f-a829-478fc29d805c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:05.555635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e0b3dac3-bb9a-475f-a829-478fc29d805c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:05.557089 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0b3dac3-bb9a-475f-a829-478fc29d805c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2930 microversion: 2.32 time: 1.360059 Aug 09 14:56:05.557693 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2334/4680] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:04 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2930 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:05.778798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84ccefa1-0b78-4dce-9934-9b1e40c07ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:05.780163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84ccefa1-0b78-4dce-9934-9b1e40c07ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] [instance: 67f7c79f-5422-4b54-8b30-6e43275685ca] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:05.796739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84ccefa1-0b78-4dce-9934-9b1e40c07ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:05.804265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84ccefa1-0b78-4dce-9934-9b1e40c07ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:05.804734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84ccefa1-0b78-4dce-9934-9b1e40c07ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:05.805742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84ccefa1-0b78-4dce-9934-9b1e40c07ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:05.807634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84ccefa1-0b78-4dce-9934-9b1e40c07ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:05.809512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84ccefa1-0b78-4dce-9934-9b1e40c07ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:05.850956 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-84ccefa1-0b78-4dce-9934-9b1e40c07ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] HTTP exception thrown: Instance 67f7c79f-5422-4b54-8b30-6e43275685ca could not be found. Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84ccefa1-0b78-4dce-9934-9b1e40c07ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Request method failure captured: Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca HTTP/1.1 Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nTYkqdPyyHztL3GVWZppwetRTICEOqQ7MqyWjQTEbC0R6vtjE3DMOqz8O169STIrvZJ_4-nwKrqeSHflVE2n3V7h4y99L_dtmiOJrudxqDvuRWCpcmNSGAxzKGXgUo-D3NVHjTkDh1gJqOCNkB4WeQU1cdo1UMAf68FgC59tPzuRac Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 7483d79edacf4600aff88566a44c44d9 Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-626437288 Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_7483d79edacf4600aff88566a44c44d9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/7483d79edacf4600aff88566a44c44d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7483d79edacf4600aff88566a44c44d9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/7483d79edacf4600aff88566a44c44d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestSecurityGroupsBasicOps-626437288 Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 7483d79edacf4600aff88566a44c44d9 Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-626437288 Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestSecurityGroupsBasicOps-626437288-project Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 1eadaad5eff54da5ba83805c15c28ba1 Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestSecurityGroupsBasicOps-626437288-project Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 67f7c79f-5422-4b54-8b30-6e43275685ca could not be found. Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '67f7c79f-5422-4b54-8b30-6e43275685ca'} Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f7c79f-5422-4b54-8b30-6e43275685ca could not be found. Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f7c79f-5422-4b54-8b30-6e43275685ca could not be found. Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:05.855021 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:05.860415 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:05.860415 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:05.860415 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:05.860415 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:56:05.860415 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:56:05.860415 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f7c79f-5422-4b54-8b30-6e43275685ca could not be found. Aug 09 14:56:05.860415 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:05.864183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84ccefa1-0b78-4dce-9934-9b1e40c07ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Returning 404 to user: Instance 67f7c79f-5422-4b54-8b30-6e43275685ca could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:56:05.869495 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84ccefa1-0b78-4dce-9934-9b1e40c07ea9 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca" status: 404 len: 111 microversion: 2.1 time: 0.095170 Aug 09 14:56:05.872214 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2347/4681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:05 2022] GET /compute/v2.1/servers/67f7c79f-5422-4b54-8b30-6e43275685ca => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:56:06.584616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fcdcd717-e0e3-4d43-a8fa-a7bb2141c2d2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:06.585467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fcdcd717-e0e3-4d43-a8fa-a7bb2141c2d2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:06.610785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcdcd717-e0e3-4d43-a8fa-a7bb2141c2d2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:06.611318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcdcd717-e0e3-4d43-a8fa-a7bb2141c2d2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:06.611761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcdcd717-e0e3-4d43-a8fa-a7bb2141c2d2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:06.612926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcdcd717-e0e3-4d43-a8fa-a7bb2141c2d2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:06.612926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcdcd717-e0e3-4d43-a8fa-a7bb2141c2d2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:06.613491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fcdcd717-e0e3-4d43-a8fa-a7bb2141c2d2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:06.973929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-3dd3be00-4c21-439e-8a68-100005280b52 req-5ec4bc4e-9b41-4878-89f9-882bd949b3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-unplugged", "status": "completed", "tag": "c7d99063-f45e-4b7c-95c6-5303b2e5a553"}, {"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-unplugged", "status": "completed", "tag": "2c866803-396b-4bd4-8699-4d2560fd9afb"}, {"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-unplugged", "status": "completed", "tag": "d4803c25-91b8-4eb4-aea2-bdacca010751"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:07.000613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3dd3be00-4c21-439e-8a68-100005280b52 req-5ec4bc4e-9b41-4878-89f9-882bd949b3df service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:07.001514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3dd3be00-4c21-439e-8a68-100005280b52 req-5ec4bc4e-9b41-4878-89f9-882bd949b3df service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:07.004369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3dd3be00-4c21-439e-8a68-100005280b52 req-5ec4bc4e-9b41-4878-89f9-882bd949b3df service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:07.057575 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3dd3be00-4c21-439e-8a68-100005280b52 req-5ec4bc4e-9b41-4878-89f9-882bd949b3df service nova] Creating event network-vif-unplugged:c7d99063-f45e-4b7c-95c6-5303b2e5a553 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:56:07.058090 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3dd3be00-4c21-439e-8a68-100005280b52 req-5ec4bc4e-9b41-4878-89f9-882bd949b3df service nova] Creating event network-vif-unplugged:2c866803-396b-4bd4-8699-4d2560fd9afb for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:56:07.064523 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3dd3be00-4c21-439e-8a68-100005280b52 req-5ec4bc4e-9b41-4878-89f9-882bd949b3df service nova] Creating event network-vif-unplugged:d4803c25-91b8-4eb4-aea2-bdacca010751 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:56:07.082730 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-3dd3be00-4c21-439e-8a68-100005280b52 req-5ec4bc4e-9b41-4878-89f9-882bd949b3df service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.112239 Aug 09 14:56:07.084542 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2348/4682] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:07.374477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fcdcd717-e0e3-4d43-a8fa-a7bb2141c2d2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:07.387563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fcdcd717-e0e3-4d43-a8fa-a7bb2141c2d2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:07.390397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fcdcd717-e0e3-4d43-a8fa-a7bb2141c2d2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:07.392741 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fcdcd717-e0e3-4d43-a8fa-a7bb2141c2d2 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2909 microversion: 2.32 time: 0.812242 Aug 09 14:56:07.394598 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2335/4683] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:06 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2909 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:07.991060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b2cad8f5-e824-4cfb-95ce-9c29bba8d1f0 req-493cbf09-9bc7-4d0a-bde3-4bfda4201237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-deleted", "tag": "c0390f76-5b64-465b-ab1b-c3d6e4b5c819"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:08.007348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b2cad8f5-e824-4cfb-95ce-9c29bba8d1f0 req-493cbf09-9bc7-4d0a-bde3-4bfda4201237 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:08.008991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b2cad8f5-e824-4cfb-95ce-9c29bba8d1f0 req-493cbf09-9bc7-4d0a-bde3-4bfda4201237 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:08.009657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b2cad8f5-e824-4cfb-95ce-9c29bba8d1f0 req-493cbf09-9bc7-4d0a-bde3-4bfda4201237 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:08.056607 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b2cad8f5-e824-4cfb-95ce-9c29bba8d1f0 req-493cbf09-9bc7-4d0a-bde3-4bfda4201237 service nova] Creating event network-vif-deleted:c0390f76-5b64-465b-ab1b-c3d6e4b5c819 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:56:08.073136 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b2cad8f5-e824-4cfb-95ce-9c29bba8d1f0 req-493cbf09-9bc7-4d0a-bde3-4bfda4201237 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091047 Aug 09 14:56:08.076720 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2349/4684] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:08.433942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-27bddb5e-0491-462c-a6db-c0649333f878 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:08.435280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-27bddb5e-0491-462c-a6db-c0649333f878 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:08.460290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27bddb5e-0491-462c-a6db-c0649333f878 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:08.460801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27bddb5e-0491-462c-a6db-c0649333f878 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:08.461248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27bddb5e-0491-462c-a6db-c0649333f878 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:08.464969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27bddb5e-0491-462c-a6db-c0649333f878 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:08.467134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27bddb5e-0491-462c-a6db-c0649333f878 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:08.467679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27bddb5e-0491-462c-a6db-c0649333f878 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:08.616866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-349903357", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": "none"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:08.718865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:56:08.719501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:56:08.720138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:56:08.720737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:56:08.721299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:56:08.755211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:08.756130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:08.757117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:08.760047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:08.761420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:08.761958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:08.798393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Getting quotas for project 808e29814b7946febc8610a17314fe8a. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:56:08.807832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Getting quotas for user 8aeecd7a11194ae7bd58ce80db75365c and project 808e29814b7946febc8610a17314fe8a. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:56:08.829428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:56:08.831972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 9476f95c-fb45-4c1f-a055-43985199dc00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:56:08.933136 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-154bf87a-8d3e-40cc-afe6-847322b7519e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.880343 Aug 09 14:56:08.937372 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2336/4685] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:56:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 09 14:56:08.950243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ce83749a-b5d4-46ea-afa8-2ed5d0a3265c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:08.952614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ce83749a-b5d4-46ea-afa8-2ed5d0a3265c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 9476f95c-fb45-4c1f-a055-43985199dc00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:08.975334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-27bddb5e-0491-462c-a6db-c0649333f878 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:08.985064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-27bddb5e-0491-462c-a6db-c0649333f878 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:08.986594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-27bddb5e-0491-462c-a6db-c0649333f878 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:08.996739 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-27bddb5e-0491-462c-a6db-c0649333f878 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2749 microversion: 2.32 time: 0.569614 Aug 09 14:56:08.997790 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2350/4686] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:08 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2749 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:09.084713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce83749a-b5d4-46ea-afa8-2ed5d0a3265c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:09.113150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d834851d-eedb-48e0-b172-58f8255acd9e req-49b95841-b964-4317-a0b1-abd1d93cdb3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-unplugged", "status": "completed", "tag": "c0390f76-5b64-465b-ab1b-c3d6e4b5c819"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:09.116112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce83749a-b5d4-46ea-afa8-2ed5d0a3265c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:09.118735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce83749a-b5d4-46ea-afa8-2ed5d0a3265c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:09.120223 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ce83749a-b5d4-46ea-afa8-2ed5d0a3265c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/9476f95c-fb45-4c1f-a055-43985199dc00" status: 200 len: 1277 microversion: 2.47 time: 0.174559 Aug 09 14:56:09.121465 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2337/4687] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:08 2022] GET /compute/v2.1/servers/9476f95c-fb45-4c1f-a055-43985199dc00 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:09.131493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d834851d-eedb-48e0-b172-58f8255acd9e req-49b95841-b964-4317-a0b1-abd1d93cdb3f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:09.132070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d834851d-eedb-48e0-b172-58f8255acd9e req-49b95841-b964-4317-a0b1-abd1d93cdb3f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:09.132589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d834851d-eedb-48e0-b172-58f8255acd9e req-49b95841-b964-4317-a0b1-abd1d93cdb3f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:09.179114 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d834851d-eedb-48e0-b172-58f8255acd9e req-49b95841-b964-4317-a0b1-abd1d93cdb3f service nova] Creating event network-vif-unplugged:c0390f76-5b64-465b-ab1b-c3d6e4b5c819 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:56:09.195019 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d834851d-eedb-48e0-b172-58f8255acd9e req-49b95841-b964-4317-a0b1-abd1d93cdb3f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088931 Aug 09 14:56:09.199687 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2351/4688] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:56:09.701168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1785009884", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": "none"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:09.819900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:56:09.820350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:56:09.821058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:56:09.821260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:56:09.821692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:56:09.853795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:09.854286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:09.854723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:09.865663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:09.867571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:09.867571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:09.907331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Getting quotas for project 808e29814b7946febc8610a17314fe8a. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:56:09.921720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Getting quotas for user 8aeecd7a11194ae7bd58ce80db75365c and project 808e29814b7946febc8610a17314fe8a. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:56:09.958885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:56:09.962926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:56:10.033528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-428ab3d6-1fc6-4695-ac9b-d5cc20fb63db tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:10.035034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-428ab3d6-1fc6-4695-ac9b-d5cc20fb63db tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:10.069270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-428ab3d6-1fc6-4695-ac9b-d5cc20fb63db tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:10.071678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-428ab3d6-1fc6-4695-ac9b-d5cc20fb63db tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:10.072946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-428ab3d6-1fc6-4695-ac9b-d5cc20fb63db tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:10.076141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-428ab3d6-1fc6-4695-ac9b-d5cc20fb63db tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:10.078855 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d8bd4e0d-2213-4a59-a030-4c383ceb5eed tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.379862 Aug 09 14:56:10.082148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-428ab3d6-1fc6-4695-ac9b-d5cc20fb63db tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:10.083368 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2338/4689] 10.222.0.50 () {62 vars in 1188 bytes} [Tue Aug 9 14:56:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 386 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 14:56:10.084661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-428ab3d6-1fc6-4695-ac9b-d5cc20fb63db tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:10.102808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9a706b55-0d6f-4e52-b12d-b552540501c9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:10.109422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9a706b55-0d6f-4e52-b12d-b552540501c9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:10.270666 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9a706b55-0d6f-4e52-b12d-b552540501c9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "PUT /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 992 microversion: 2.47 time: 0.180139 Aug 09 14:56:10.275903 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2339/4690] 10.222.0.50 () {62 vars in 1297 bytes} [Tue Aug 9 14:56:10 2022] PUT /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 992 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 14:56:10.285794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a3ad6069-9719-44f6-ae93-eb9662759dd3 req-44521784-f9d6-462a-ac13-be775cda8c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-deleted", "tag": "2c866803-396b-4bd4-8699-4d2560fd9afb"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:10.353713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a3ad6069-9719-44f6-ae93-eb9662759dd3 req-44521784-f9d6-462a-ac13-be775cda8c37 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:10.354214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a3ad6069-9719-44f6-ae93-eb9662759dd3 req-44521784-f9d6-462a-ac13-be775cda8c37 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:10.359582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a3ad6069-9719-44f6-ae93-eb9662759dd3 req-44521784-f9d6-462a-ac13-be775cda8c37 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:10.422752 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a3ad6069-9719-44f6-ae93-eb9662759dd3 req-44521784-f9d6-462a-ac13-be775cda8c37 service nova] Creating event network-vif-deleted:2c866803-396b-4bd4-8699-4d2560fd9afb for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:56:10.452438 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a3ad6069-9719-44f6-ae93-eb9662759dd3 req-44521784-f9d6-462a-ac13-be775cda8c37 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171223 Aug 09 14:56:10.456463 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2340/4691] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:10.472969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-acc793a6-4c3c-4442-8dad-b6b1d574cf81 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:10.473564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-acc793a6-4c3c-4442-8dad-b6b1d574cf81 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:10.994426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-acc793a6-4c3c-4442-8dad-b6b1d574cf81 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:11.011242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-acc793a6-4c3c-4442-8dad-b6b1d574cf81 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:11.016252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-acc793a6-4c3c-4442-8dad-b6b1d574cf81 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:11.022436 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-acc793a6-4c3c-4442-8dad-b6b1d574cf81 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1278 microversion: 2.47 time: 0.557614 Aug 09 14:56:11.032558 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2341/4692] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:10 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1278 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:11.450812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-428ab3d6-1fc6-4695-ac9b-d5cc20fb63db tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:11.473434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-428ab3d6-1fc6-4695-ac9b-d5cc20fb63db tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:11.485609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-428ab3d6-1fc6-4695-ac9b-d5cc20fb63db tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:11.489586 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-428ab3d6-1fc6-4695-ac9b-d5cc20fb63db tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2703 microversion: 2.32 time: 1.459931 Aug 09 14:56:11.492086 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2352/4693] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:10 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2703 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:11.833882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c23df7c-a21d-4bda-82c4-504e754f3ab3 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Action: 'create', calling method: .version_select at 0x7f41dc8dbdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-49572463"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:12.049434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41ff0667-217c-428b-9e8c-179b34d9628b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:12.050259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-41ff0667-217c-428b-9e8c-179b34d9628b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:12.079144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41ff0667-217c-428b-9e8c-179b34d9628b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:12.079659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41ff0667-217c-428b-9e8c-179b34d9628b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:12.080108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41ff0667-217c-428b-9e8c-179b34d9628b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:12.083269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41ff0667-217c-428b-9e8c-179b34d9628b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:12.088965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41ff0667-217c-428b-9e8c-179b34d9628b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:12.089666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41ff0667-217c-428b-9e8c-179b34d9628b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:12.420904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-41ff0667-217c-428b-9e8c-179b34d9628b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:12.437907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-41ff0667-217c-428b-9e8c-179b34d9628b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:12.444782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-41ff0667-217c-428b-9e8c-179b34d9628b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:12.449579 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-41ff0667-217c-428b-9e8c-179b34d9628b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1330 microversion: 2.47 time: 0.405856 Aug 09 14:56:12.459722 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2353/4694] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:12 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1330 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:12.521693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71396a19-b9c6-4def-9c59-a89e4dd3ce5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:12.522389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-71396a19-b9c6-4def-9c59-a89e4dd3ce5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:12.537683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71396a19-b9c6-4def-9c59-a89e4dd3ce5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:12.538290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71396a19-b9c6-4def-9c59-a89e4dd3ce5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:12.538661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71396a19-b9c6-4def-9c59-a89e4dd3ce5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:12.539456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71396a19-b9c6-4def-9c59-a89e4dd3ce5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:12.540026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71396a19-b9c6-4def-9c59-a89e4dd3ce5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:12.540558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71396a19-b9c6-4def-9c59-a89e4dd3ce5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:12.668102 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c23df7c-a21d-4bda-82c4-504e754f3ab3 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 1.572492 Aug 09 14:56:12.672189 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2342/4695] 10.222.0.50 () {60 vars in 1155 bytes} [Tue Aug 9 14:56:11 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 1577 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 09 14:56:12.686785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-712ae631-1d01-4c15-990c-bff92121027d tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dc706670>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:12.824866 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-712ae631-1d01-4c15-990c-bff92121027d tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180" status: 200 len: 343 microversion: 2.1 time: 0.142500 Aug 09 14:56:12.825970 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2343/4696] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:56:12 2022] GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 => generated 343 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:13.487792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-671e1655-4309-498a-980b-a1659efcbca9 req-983e38ec-cd38-4fa0-a4d5-2630eee90af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-deleted", "tag": "d4803c25-91b8-4eb4-aea2-bdacca010751"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:13.512236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-671e1655-4309-498a-980b-a1659efcbca9 req-983e38ec-cd38-4fa0-a4d5-2630eee90af7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:13.513857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-671e1655-4309-498a-980b-a1659efcbca9 req-983e38ec-cd38-4fa0-a4d5-2630eee90af7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:13.516015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-671e1655-4309-498a-980b-a1659efcbca9 req-983e38ec-cd38-4fa0-a4d5-2630eee90af7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:13.547757 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-671e1655-4309-498a-980b-a1659efcbca9 req-983e38ec-cd38-4fa0-a4d5-2630eee90af7 service nova] Creating event network-vif-deleted:d4803c25-91b8-4eb4-aea2-bdacca010751 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:56:13.563448 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-671e1655-4309-498a-980b-a1659efcbca9 req-983e38ec-cd38-4fa0-a4d5-2630eee90af7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.473694 Aug 09 14:56:13.564620 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2344/4697] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:56:13.579494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-643f3776-fc0e-421e-843a-773d9832e2c8 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:13.580872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-643f3776-fc0e-421e-843a-773d9832e2c8 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:13.596556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-643f3776-fc0e-421e-843a-773d9832e2c8 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:13.598493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-643f3776-fc0e-421e-843a-773d9832e2c8 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:13.600393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-643f3776-fc0e-421e-843a-773d9832e2c8 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:13.601459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-643f3776-fc0e-421e-843a-773d9832e2c8 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:13.604012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-643f3776-fc0e-421e-843a-773d9832e2c8 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:13.604543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-643f3776-fc0e-421e-843a-773d9832e2c8 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:13.969246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-643f3776-fc0e-421e-843a-773d9832e2c8 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:13.978025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-643f3776-fc0e-421e-843a-773d9832e2c8 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:13.979574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-643f3776-fc0e-421e-843a-773d9832e2c8 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:13.980804 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-643f3776-fc0e-421e-843a-773d9832e2c8 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1336 microversion: 2.47 time: 0.414913 Aug 09 14:56:14.011494 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2345/4698] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:13 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1336 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:14.016600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-59b3ca65-ee4d-4d6d-9ad8-be715588b107 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dc8dbca0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:14.089754 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-59b3ca65-ee4d-4d6d-9ad8-be715588b107 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180" status: 200 len: 343 microversion: 2.1 time: 0.077020 Aug 09 14:56:14.090309 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2346/4699] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:56:14 2022] GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 => generated 343 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:14.122860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-71396a19-b9c6-4def-9c59-a89e4dd3ce5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:14.133639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-71396a19-b9c6-4def-9c59-a89e4dd3ce5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:14.145854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-71396a19-b9c6-4def-9c59-a89e4dd3ce5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:14.149981 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-71396a19-b9c6-4def-9c59-a89e4dd3ce5d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2500 microversion: 2.32 time: 1.631998 Aug 09 14:56:14.157398 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2354/4700] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:12 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2500 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:15.008404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e6d39e21-5749-475d-b2e7-77c9fc126cac tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:15.009017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e6d39e21-5749-475d-b2e7-77c9fc126cac tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:15.024166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6d39e21-5749-475d-b2e7-77c9fc126cac tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:15.026250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6d39e21-5749-475d-b2e7-77c9fc126cac tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:15.028026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6d39e21-5749-475d-b2e7-77c9fc126cac tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:15.029634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6d39e21-5749-475d-b2e7-77c9fc126cac tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:15.031462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6d39e21-5749-475d-b2e7-77c9fc126cac tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:15.032147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6d39e21-5749-475d-b2e7-77c9fc126cac tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:15.108580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f3e6ad65-a6f3-4f65-aa2c-449dc76bee81 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dd217e50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:15.208995 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f3e6ad65-a6f3-4f65-aa2c-449dc76bee81 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180" status: 200 len: 344 microversion: 2.1 time: 0.107219 Aug 09 14:56:15.209551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e6d39e21-5749-475d-b2e7-77c9fc126cac tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:15.209654 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2355/4701] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:56:15 2022] GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 => generated 344 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:56:15.223484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-45c38184-32c7-459c-a457-77d81ee75b3b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:15.224125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e6d39e21-5749-475d-b2e7-77c9fc126cac tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:15.224251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-45c38184-32c7-459c-a457-77d81ee75b3b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:15.225653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e6d39e21-5749-475d-b2e7-77c9fc126cac tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:15.226822 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e6d39e21-5749-475d-b2e7-77c9fc126cac tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1336 microversion: 2.47 time: 0.222697 Aug 09 14:56:15.230326 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2347/4702] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:15 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1336 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:15.248474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f27516fc-0cd2-4918-ad7d-660f81d0a384 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Action: 'create', calling method: .version_select at 0x7f41dd854670>, body: {"snapshot": {"volume_id": "de4efee3-4088-48cb-8757-91df557bf180", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1022120357"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:15.256586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45c38184-32c7-459c-a457-77d81ee75b3b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:15.257149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45c38184-32c7-459c-a457-77d81ee75b3b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:15.257591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45c38184-32c7-459c-a457-77d81ee75b3b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:15.258311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45c38184-32c7-459c-a457-77d81ee75b3b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:15.261639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45c38184-32c7-459c-a457-77d81ee75b3b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:15.262141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-45c38184-32c7-459c-a457-77d81ee75b3b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:15.606156 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f27516fc-0cd2-4918-ad7d-660f81d0a384 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.374349 Aug 09 14:56:15.608352 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2348/4703] 10.222.0.50 () {60 vars in 1162 bytes} [Tue Aug 9 14:56:15 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:15.618861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bcfbf9a5-27c2-42ae-b842-9f0b19f3d76b tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dc7573a0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:15.719882 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bcfbf9a5-27c2-42ae-b842-9f0b19f3d76b tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486" status: 200 len: 287 microversion: 2.1 time: 0.104572 Aug 09 14:56:15.726037 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2349/4704] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:56:15 2022] GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:15.736992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f5f3333-159f-4341-a998-16cb1c2aeaa7 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dc757310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:15.830398 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f5f3333-159f-4341-a998-16cb1c2aeaa7 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.102962 Aug 09 14:56:15.831842 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2350/4705] 10.222.0.50 () {58 vars in 1140 bytes} [Tue Aug 9 14:56:15 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:56:15.843162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72cd00da-7f68-4437-a5e8-cf775b59526f tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dc757b80>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:15.900527 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72cd00da-7f68-4437-a5e8-cf775b59526f tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486" status: 200 len: 287 microversion: 2.1 time: 0.061686 Aug 09 14:56:15.906645 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2351/4706] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:56:15 2022] GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:56:15.934845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45c38184-32c7-459c-a457-77d81ee75b3b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:15.949725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45c38184-32c7-459c-a457-77d81ee75b3b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:15.957074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-45c38184-32c7-459c-a457-77d81ee75b3b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:15.959791 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-45c38184-32c7-459c-a457-77d81ee75b3b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2387 microversion: 2.32 time: 0.749130 Aug 09 14:56:15.963213 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2356/4707] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:15 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2387 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:16.258167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d24f2f1-a228-443a-8750-78ebd1c76592 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:16.259745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6d24f2f1-a228-443a-8750-78ebd1c76592 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:16.288267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d24f2f1-a228-443a-8750-78ebd1c76592 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:16.292581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d24f2f1-a228-443a-8750-78ebd1c76592 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:16.293446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d24f2f1-a228-443a-8750-78ebd1c76592 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:16.294404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d24f2f1-a228-443a-8750-78ebd1c76592 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:16.297638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d24f2f1-a228-443a-8750-78ebd1c76592 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:16.298273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d24f2f1-a228-443a-8750-78ebd1c76592 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:16.777729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6d24f2f1-a228-443a-8750-78ebd1c76592 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:16.819686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6d24f2f1-a228-443a-8750-78ebd1c76592 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:16.825075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6d24f2f1-a228-443a-8750-78ebd1c76592 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:16.833503 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6d24f2f1-a228-443a-8750-78ebd1c76592 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1357 microversion: 2.47 time: 0.578001 Aug 09 14:56:16.838896 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2352/4708] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:16 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1357 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:16.860357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:16.864030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:16.918630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a8b50e0-2188-47d3-bc6b-96dbd26d5710 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dd7ba430>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:16.919116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:16.931203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:16.933036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:16.935159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:16.956656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:16.958963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:17.070178 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a8b50e0-2188-47d3-bc6b-96dbd26d5710 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486" status: 200 len: 287 microversion: 2.1 time: 0.158993 Aug 09 14:56:17.078171 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2353/4709] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:56:16 2022] GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486 => generated 287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:17.085258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0453c3de-bf95-4cc0-a219-6de8f237f97d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:17.098165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0453c3de-bf95-4cc0-a219-6de8f237f97d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:17.151518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0453c3de-bf95-4cc0-a219-6de8f237f97d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:17.162288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0453c3de-bf95-4cc0-a219-6de8f237f97d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:17.162948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0453c3de-bf95-4cc0-a219-6de8f237f97d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:17.166777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0453c3de-bf95-4cc0-a219-6de8f237f97d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:17.168854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0453c3de-bf95-4cc0-a219-6de8f237f97d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:17.169316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0453c3de-bf95-4cc0-a219-6de8f237f97d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:17.327688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:56:17.328226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:56:17.328765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:56:17.333475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:56:17.334135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:56:17.461902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:17.473821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:17.474297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:17.474959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:17.476264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:17.477246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:17.478060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:17.522196 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8f2b6f34-4f92-4d41-a9ad-acc7a4c2c04f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "POST /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a/action" status: 202 len: 1079 microversion: 2.47 time: 0.666168 Aug 09 14:56:17.523640 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2357/4710] 10.222.0.50 () {62 vars in 1319 bytes} [Tue Aug 9 14:56:16 2022] POST /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a/action => generated 1079 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 09 14:56:17.545342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e165beb4-1c92-4b13-9120-ca3c417375a9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:17.546549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e165beb4-1c92-4b13-9120-ca3c417375a9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:17.557052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e165beb4-1c92-4b13-9120-ca3c417375a9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:17.557565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e165beb4-1c92-4b13-9120-ca3c417375a9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:17.558038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e165beb4-1c92-4b13-9120-ca3c417375a9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:17.559054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e165beb4-1c92-4b13-9120-ca3c417375a9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:17.559611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e165beb4-1c92-4b13-9120-ca3c417375a9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:17.560187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e165beb4-1c92-4b13-9120-ca3c417375a9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:18.150201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e165beb4-1c92-4b13-9120-ca3c417375a9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:18.175713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e165beb4-1c92-4b13-9120-ca3c417375a9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:18.180835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e165beb4-1c92-4b13-9120-ca3c417375a9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:18.186733 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e165beb4-1c92-4b13-9120-ca3c417375a9 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.643727 Aug 09 14:56:18.201737 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2358/4711] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:17 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:18.217574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0213c5cb-3c54-4ece-a9c9-526f42513e97 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41de303b80>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:18.270107 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0213c5cb-3c54-4ece-a9c9-526f42513e97 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486" status: 200 len: 287 microversion: 2.1 time: 0.061450 Aug 09 14:56:18.272113 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2359/4712] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:56:18 2022] GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:18.288270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1997feea-dade-421a-a09d-0d1c70745354 req-45dc3950-9b78-473c-b07f-ad28e356e306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-deleted", "tag": "1bbb6bc7-df59-43ad-bd7e-3c6cac208995"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:18.359736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1997feea-dade-421a-a09d-0d1c70745354 req-45dc3950-9b78-473c-b07f-ad28e356e306 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:18.363165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1997feea-dade-421a-a09d-0d1c70745354 req-45dc3950-9b78-473c-b07f-ad28e356e306 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:18.365637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1997feea-dade-421a-a09d-0d1c70745354 req-45dc3950-9b78-473c-b07f-ad28e356e306 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:18.394226 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1997feea-dade-421a-a09d-0d1c70745354 req-45dc3950-9b78-473c-b07f-ad28e356e306 service nova] Creating event network-vif-deleted:1bbb6bc7-df59-43ad-bd7e-3c6cac208995 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:56:18.407004 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1997feea-dade-421a-a09d-0d1c70745354 req-45dc3950-9b78-473c-b07f-ad28e356e306 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133257 Aug 09 14:56:18.409093 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2360/4713] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:18.673841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0453c3de-bf95-4cc0-a219-6de8f237f97d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:18.691886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0453c3de-bf95-4cc0-a219-6de8f237f97d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:18.698979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0453c3de-bf95-4cc0-a219-6de8f237f97d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:18.702561 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0453c3de-bf95-4cc0-a219-6de8f237f97d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2341 microversion: 2.32 time: 1.620929 Aug 09 14:56:18.723866 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2354/4714] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:17 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2341 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:19.229552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cffb1b70-c5d8-46d8-b68c-030021d86284 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:19.230553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cffb1b70-c5d8-46d8-b68c-030021d86284 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:19.263995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cffb1b70-c5d8-46d8-b68c-030021d86284 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:19.270182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cffb1b70-c5d8-46d8-b68c-030021d86284 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:19.274195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cffb1b70-c5d8-46d8-b68c-030021d86284 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:19.275046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cffb1b70-c5d8-46d8-b68c-030021d86284 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:19.275594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cffb1b70-c5d8-46d8-b68c-030021d86284 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:19.276041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cffb1b70-c5d8-46d8-b68c-030021d86284 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:19.282808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-10b21b2a-88a3-4ffa-ada2-601aea23ff6a tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dc8db550>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:19.363136 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-10b21b2a-88a3-4ffa-ada2-601aea23ff6a tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486" status: 200 len: 288 microversion: 2.1 time: 0.084312 Aug 09 14:56:19.363937 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2355/4715] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:56:19 2022] GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486 => generated 288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:56:19.375123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eba10e57-2bdf-40fa-83a9-4861c562e242 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dcb398b0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:19.501742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cffb1b70-c5d8-46d8-b68c-030021d86284 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:19.516373 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eba10e57-2bdf-40fa-83a9-4861c562e242 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486" status: 202 len: 0 microversion: 2.1 time: 0.144955 Aug 09 14:56:19.516890 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2356/4716] 10.222.0.50 () {58 vars in 1254 bytes} [Tue Aug 9 14:56:19 2022] DELETE /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:56:19.524415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cffb1b70-c5d8-46d8-b68c-030021d86284 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:19.526895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70debffb-7150-4aaf-802e-698232acfda0 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dc8db940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:19.528521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cffb1b70-c5d8-46d8-b68c-030021d86284 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:19.532175 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cffb1b70-c5d8-46d8-b68c-030021d86284 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.322051 Aug 09 14:56:19.534012 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2361/4717] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:19 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:19.603497 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70debffb-7150-4aaf-802e-698232acfda0 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486" status: 200 len: 287 microversion: 2.1 time: 0.081820 Aug 09 14:56:19.604612 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2357/4718] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:56:19 2022] GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:19.731791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ee076dd-d1ad-4e69-be67-3642a4cd4796 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:19.732588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ee076dd-d1ad-4e69-be67-3642a4cd4796 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:19.750899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee076dd-d1ad-4e69-be67-3642a4cd4796 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:19.752768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee076dd-d1ad-4e69-be67-3642a4cd4796 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:19.753916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee076dd-d1ad-4e69-be67-3642a4cd4796 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:19.757816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee076dd-d1ad-4e69-be67-3642a4cd4796 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:19.759515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee076dd-d1ad-4e69-be67-3642a4cd4796 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:19.760286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee076dd-d1ad-4e69-be67-3642a4cd4796 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:19.779027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:20.558680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:20.564526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-562f48d7-94c1-4e9b-b39f-0f3550d7db5d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:20.565397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-562f48d7-94c1-4e9b-b39f-0f3550d7db5d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:20.580321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-562f48d7-94c1-4e9b-b39f-0f3550d7db5d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:20.580820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-562f48d7-94c1-4e9b-b39f-0f3550d7db5d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:20.581254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-562f48d7-94c1-4e9b-b39f-0f3550d7db5d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:20.581963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-562f48d7-94c1-4e9b-b39f-0f3550d7db5d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:20.582414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-562f48d7-94c1-4e9b-b39f-0f3550d7db5d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:20.582837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-562f48d7-94c1-4e9b-b39f-0f3550d7db5d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:20.692227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:20.757063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ee076dd-d1ad-4e69-be67-3642a4cd4796 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:20.785465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ee076dd-d1ad-4e69-be67-3642a4cd4796 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:20.796175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5ee076dd-d1ad-4e69-be67-3642a4cd4796 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:20.799728 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ee076dd-d1ad-4e69-be67-3642a4cd4796 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 2053 microversion: 2.32 time: 1.070701 Aug 09 14:56:20.802359 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2362/4719] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:19 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 2053 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:20.844810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-20223524-8683-4f69-9059-b56e5b15b151 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41ddfaa9d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:20.913731 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-20223524-8683-4f69-9059-b56e5b15b151 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486" status: 200 len: 287 microversion: 2.1 time: 0.108459 Aug 09 14:56:20.914812 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2363/4720] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:56:20 2022] GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:20.923521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-6106164b-5417-4063-b31b-dd6f504f2f92 req-f82bd6dc-73fe-4bc8-8c48-499bfbcc3ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec868ce-9219-4e7d-88fd-0740de733a00", "name": "network-vif-deleted", "tag": "c7d99063-f45e-4b7c-95c6-5303b2e5a553"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:20.967434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6106164b-5417-4063-b31b-dd6f504f2f92 req-f82bd6dc-73fe-4bc8-8c48-499bfbcc3ee0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:20.969469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6106164b-5417-4063-b31b-dd6f504f2f92 req-f82bd6dc-73fe-4bc8-8c48-499bfbcc3ee0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:20.971568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6106164b-5417-4063-b31b-dd6f504f2f92 req-f82bd6dc-73fe-4bc8-8c48-499bfbcc3ee0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:21.005721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=16 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:21.006893 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-6106164b-5417-4063-b31b-dd6f504f2f92 req-f82bd6dc-73fe-4bc8-8c48-499bfbcc3ee0 service nova] Creating event network-vif-deleted:c7d99063-f45e-4b7c-95c6-5303b2e5a553 for instance 7ec868ce-9219-4e7d-88fd-0740de733a00 on n-h2-844626-8 Aug 09 14:56:21.029049 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-6106164b-5417-4063-b31b-dd6f504f2f92 req-f82bd6dc-73fe-4bc8-8c48-499bfbcc3ee0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112683 Aug 09 14:56:21.037610 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2364/4721] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:21.057249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-562f48d7-94c1-4e9b-b39f-0f3550d7db5d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:21.067345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-562f48d7-94c1-4e9b-b39f-0f3550d7db5d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:21.082271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-562f48d7-94c1-4e9b-b39f-0f3550d7db5d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:21.086396 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-562f48d7-94c1-4e9b-b39f-0f3550d7db5d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.528617 Aug 09 14:56:21.089492 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2358/4722] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:20 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:21.830267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a043316f-27c2-4d19-95d2-81707ed80247 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:21.830960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a043316f-27c2-4d19-95d2-81707ed80247 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:21.855776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a043316f-27c2-4d19-95d2-81707ed80247 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:21.856391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a043316f-27c2-4d19-95d2-81707ed80247 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:21.856793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a043316f-27c2-4d19-95d2-81707ed80247 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:21.857566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a043316f-27c2-4d19-95d2-81707ed80247 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:21.858070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a043316f-27c2-4d19-95d2-81707ed80247 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:21.858499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a043316f-27c2-4d19-95d2-81707ed80247 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:21.926805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9c4775f8-2e7b-4a05-ba62-ef7cac21b1d7 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dc67eb80>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:21.990544 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9c4775f8-2e7b-4a05-ba62-ef7cac21b1d7 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486" status: 200 len: 287 microversion: 2.1 time: 0.068066 Aug 09 14:56:21.991884 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2359/4723] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:56:21 2022] GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:22.113121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1af5f047-663d-4a77-9eab-3f19dd4dd743 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:22.114098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1af5f047-663d-4a77-9eab-3f19dd4dd743 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:22.128729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1af5f047-663d-4a77-9eab-3f19dd4dd743 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:22.132866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1af5f047-663d-4a77-9eab-3f19dd4dd743 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:22.139340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1af5f047-663d-4a77-9eab-3f19dd4dd743 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:22.140446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1af5f047-663d-4a77-9eab-3f19dd4dd743 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:22.141215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1af5f047-663d-4a77-9eab-3f19dd4dd743 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:22.142048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1af5f047-663d-4a77-9eab-3f19dd4dd743 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:22.165483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a043316f-27c2-4d19-95d2-81707ed80247 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:22.180630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a043316f-27c2-4d19-95d2-81707ed80247 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:22.184630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a043316f-27c2-4d19-95d2-81707ed80247 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:22.185959 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a043316f-27c2-4d19-95d2-81707ed80247 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.362121 Aug 09 14:56:22.203112 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2365/4724] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:21 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:22.453798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1af5f047-663d-4a77-9eab-3f19dd4dd743 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:22.469698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1af5f047-663d-4a77-9eab-3f19dd4dd743 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:22.474675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1af5f047-663d-4a77-9eab-3f19dd4dd743 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:22.486647 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1af5f047-663d-4a77-9eab-3f19dd4dd743 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.375598 Aug 09 14:56:22.486647 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2360/4725] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:22 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:23.005458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2db14072-4bdd-4f69-9b58-eca023149b43 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dd217550>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:23.098664 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2db14072-4bdd-4f69-9b58-eca023149b43 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486" status: 200 len: 287 microversion: 2.1 time: 0.098048 Aug 09 14:56:23.103911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2366/4726] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:56:22 2022] GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:23.219719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-160ee62e-809b-40c5-b216-e062de27c2e6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:23.221083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-160ee62e-809b-40c5-b216-e062de27c2e6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:23.231215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-160ee62e-809b-40c5-b216-e062de27c2e6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:23.242789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-160ee62e-809b-40c5-b216-e062de27c2e6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:23.246008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-160ee62e-809b-40c5-b216-e062de27c2e6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:23.247034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-160ee62e-809b-40c5-b216-e062de27c2e6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:23.250350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-160ee62e-809b-40c5-b216-e062de27c2e6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:23.252354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-160ee62e-809b-40c5-b216-e062de27c2e6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:23.513721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42097766-8cf3-4a83-8900-c68ba5f40f83 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:23.515297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42097766-8cf3-4a83-8900-c68ba5f40f83 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:23.524134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42097766-8cf3-4a83-8900-c68ba5f40f83 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:23.525185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42097766-8cf3-4a83-8900-c68ba5f40f83 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:23.525850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42097766-8cf3-4a83-8900-c68ba5f40f83 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:23.526822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42097766-8cf3-4a83-8900-c68ba5f40f83 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:23.527548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42097766-8cf3-4a83-8900-c68ba5f40f83 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:23.528346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42097766-8cf3-4a83-8900-c68ba5f40f83 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:23.580513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-160ee62e-809b-40c5-b216-e062de27c2e6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:23.600142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-160ee62e-809b-40c5-b216-e062de27c2e6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:23.606634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-160ee62e-809b-40c5-b216-e062de27c2e6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:23.612945 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-160ee62e-809b-40c5-b216-e062de27c2e6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.397340 Aug 09 14:56:23.615876 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2361/4727] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:23 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:23.656328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b5d9d0da-f3a1-4f2a-bdde-f62a4a810da6 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] Calling method '.version_select at 0x7f41dd830ca0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:23.712647 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b5d9d0da-f3a1-4f2a-bdde-f62a4a810da6 tempest-TestSecurityGroupsBasicOps-626437288 tempest-TestSecurityGroupsBasicOps-626437288-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-189901098" status: 202 len: 0 microversion: 2.1 time: 0.072965 Aug 09 14:56:23.717439 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2362/4728] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:56:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-189901098 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:56:23.806333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42097766-8cf3-4a83-8900-c68ba5f40f83 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:23.826500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42097766-8cf3-4a83-8900-c68ba5f40f83 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:23.828337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42097766-8cf3-4a83-8900-c68ba5f40f83 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:23.852711 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42097766-8cf3-4a83-8900-c68ba5f40f83 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.343331 Aug 09 14:56:23.855826 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2367/4729] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:23 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:24.111879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0aae000-8590-4ea2-92ec-4ba89f0aeab9 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dc8dbd30>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:24.184361 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-b0aae000-8590-4ea2-92ec-4ba89f0aeab9 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] HTTP exception thrown: Snapshot df0b4589-1e16-43d0-b99b-ab6a1317b486 could not be found. Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0aae000-8590-4ea2-92ec-4ba89f0aeab9 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Request method failure captured: Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486 HTTP/1.1 Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nWKA2Ld7j-ozO6Bh0dZhaeqp5mfHGAhqO50Q34_j8k9wPg0YjQ6f76jY26mvhLYLvDwhPk2HZySPMGU6BTc4hbBMdFZ76dUPefDkY5jwCetgcpG70NaRLssd_ob1QLBeLeTGnP8HCO-Lkn8OjVK_DQTQyZq_dkoByfHSH_Yn7AlUtA Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 590f17b83647440b9dd11528b48c259e Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1500654600 Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_590f17b83647440b9dd11528b48c259e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/590f17b83647440b9dd11528b48c259e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/590f17b83647440b9dd11528b48c259e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/590f17b83647440b9dd11528b48c259e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1500654600 Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 590f17b83647440b9dd11528b48c259e Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1500654600 Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-VolumesSnapshotsTestJSON-1500654600-project Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 82343b52b6dd4886b61068cbebc0b0e4 Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1500654600-project Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: exception: Snapshot df0b4589-1e16-43d0-b99b-ab6a1317b486 could not be found. Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'df0b4589-1e16-43d0-b99b-ab6a1317b486'} Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot df0b4589-1e16-43d0-b99b-ab6a1317b486 could not be found. (HTTP 404) (Request-ID: req-c30e23a8-4bad-4cbd-9a37-8da6e38ac05c) Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 14:56:24.192682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot df0b4589-1e16-43d0-b99b-ab6a1317b486 could not be found. Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot df0b4589-1e16-43d0-b99b-ab6a1317b486 could not be found. Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot df0b4589-1e16-43d0-b99b-ab6a1317b486 could not be found. Aug 09 14:56:24.196687 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:24.199996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0aae000-8590-4ea2-92ec-4ba89f0aeab9 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Returning 404 to user: Snapshot df0b4589-1e16-43d0-b99b-ab6a1317b486 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:56:24.200354 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b0aae000-8590-4ea2-92ec-4ba89f0aeab9 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486" status: 404 len: 111 microversion: 2.1 time: 0.092438 Aug 09 14:56:24.201528 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2363/4730] 10.222.0.50 () {58 vars in 1251 bytes} [Tue Aug 9 14:56:24 2022] GET /compute/v2.1/os-snapshots/df0b4589-1e16-43d0-b99b-ab6a1317b486 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:56:24.209623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9b41c713-faca-4506-8e38-bf5dbac2208f tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41ddbfbe50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:24.365276 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9b41c713-faca-4506-8e38-bf5dbac2208f tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180" status: 202 len: 0 microversion: 2.1 time: 0.159585 Aug 09 14:56:24.367417 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2368/4731] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:56:24 2022] DELETE /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:56:24.378366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9cfe5840-c8c3-472e-825b-4234a3304e39 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dc8dbdc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:24.522581 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9cfe5840-c8c3-472e-825b-4234a3304e39 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180" status: 200 len: 343 microversion: 2.1 time: 0.150419 Aug 09 14:56:24.524378 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2364/4732] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:56:24 2022] GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 => generated 343 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:24.642200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8499e162-848f-4d79-88a0-b17eb4963128 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:24.642939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8499e162-848f-4d79-88a0-b17eb4963128 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:24.666320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8499e162-848f-4d79-88a0-b17eb4963128 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:24.669508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8499e162-848f-4d79-88a0-b17eb4963128 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:24.670512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8499e162-848f-4d79-88a0-b17eb4963128 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:24.671903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8499e162-848f-4d79-88a0-b17eb4963128 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:24.672728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8499e162-848f-4d79-88a0-b17eb4963128 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:24.678361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8499e162-848f-4d79-88a0-b17eb4963128 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:24.882968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-57bee8ca-fa80-4d0a-be12-3e744223f152 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:24.884190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-57bee8ca-fa80-4d0a-be12-3e744223f152 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:24.902199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:24.907560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57bee8ca-fa80-4d0a-be12-3e744223f152 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:24.908154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57bee8ca-fa80-4d0a-be12-3e744223f152 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:24.922372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57bee8ca-fa80-4d0a-be12-3e744223f152 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:24.923506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57bee8ca-fa80-4d0a-be12-3e744223f152 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:24.926219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57bee8ca-fa80-4d0a-be12-3e744223f152 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:24.926769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57bee8ca-fa80-4d0a-be12-3e744223f152 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:26.041418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8499e162-848f-4d79-88a0-b17eb4963128 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:26.079521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8499e162-848f-4d79-88a0-b17eb4963128 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:26.084802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8499e162-848f-4d79-88a0-b17eb4963128 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:26.097139 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8499e162-848f-4d79-88a0-b17eb4963128 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 1.449633 Aug 09 14:56:26.104766 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2369/4733] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:24 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:26.118457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-57bee8ca-fa80-4d0a-be12-3e744223f152 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:26.142685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cbd85bfe-889b-41eb-a0b5-3ad3936972c2 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dd2171f0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:26.143773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-57bee8ca-fa80-4d0a-be12-3e744223f152 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:26.146225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-57bee8ca-fa80-4d0a-be12-3e744223f152 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:26.151534 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-57bee8ca-fa80-4d0a-be12-3e744223f152 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 1.272649 Aug 09 14:56:26.154991 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2365/4734] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:24 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:26.326715 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cbd85bfe-889b-41eb-a0b5-3ad3936972c2 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180" status: 200 len: 343 microversion: 2.1 time: 0.218246 Aug 09 14:56:26.327616 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2370/4735] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:56:26 2022] GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 => generated 343 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:27.126593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-56e4aa4f-85ad-45c7-b5a9-b399186f2780 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:27.127855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-56e4aa4f-85ad-45c7-b5a9-b399186f2780 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:27.145945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56e4aa4f-85ad-45c7-b5a9-b399186f2780 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:27.146745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56e4aa4f-85ad-45c7-b5a9-b399186f2780 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:27.147406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56e4aa4f-85ad-45c7-b5a9-b399186f2780 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:27.148500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56e4aa4f-85ad-45c7-b5a9-b399186f2780 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:27.149095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56e4aa4f-85ad-45c7-b5a9-b399186f2780 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:27.149715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56e4aa4f-85ad-45c7-b5a9-b399186f2780 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:27.186153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e7618127-7ff5-401c-b9bc-d6eacdc29a75 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:27.186755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e7618127-7ff5-401c-b9bc-d6eacdc29a75 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:27.224421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7618127-7ff5-401c-b9bc-d6eacdc29a75 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:27.228326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7618127-7ff5-401c-b9bc-d6eacdc29a75 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:27.228871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7618127-7ff5-401c-b9bc-d6eacdc29a75 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:27.234414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7618127-7ff5-401c-b9bc-d6eacdc29a75 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:27.243227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7618127-7ff5-401c-b9bc-d6eacdc29a75 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:27.244193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7618127-7ff5-401c-b9bc-d6eacdc29a75 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:27.731373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-56e4aa4f-85ad-45c7-b5a9-b399186f2780 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:27.747397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-56e4aa4f-85ad-45c7-b5a9-b399186f2780 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:27.749456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-56e4aa4f-85ad-45c7-b5a9-b399186f2780 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:27.754926 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-56e4aa4f-85ad-45c7-b5a9-b399186f2780 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.632741 Aug 09 14:56:27.756128 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2366/4736] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:27 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:27.778139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2d50a54-1699-4744-9315-5cc9751a61f6 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dcb50b80>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:27.780856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e7618127-7ff5-401c-b9bc-d6eacdc29a75 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:27.800638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e7618127-7ff5-401c-b9bc-d6eacdc29a75 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:27.802604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e7618127-7ff5-401c-b9bc-d6eacdc29a75 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:27.810643 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e7618127-7ff5-401c-b9bc-d6eacdc29a75 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.630233 Aug 09 14:56:27.824359 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2371/4737] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:27 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:27.887779 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2d50a54-1699-4744-9315-5cc9751a61f6 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180" status: 200 len: 343 microversion: 2.1 time: 0.117933 Aug 09 14:56:27.889044 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2367/4738] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:56:27 2022] GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 => generated 343 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:28.784602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-461d39b8-2f1e-4a8f-877d-2a99768c670d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:28.785216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-461d39b8-2f1e-4a8f-877d-2a99768c670d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:28.806556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=55 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:28.818154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461d39b8-2f1e-4a8f-877d-2a99768c670d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:28.824191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461d39b8-2f1e-4a8f-877d-2a99768c670d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:28.825359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461d39b8-2f1e-4a8f-877d-2a99768c670d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:28.828155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461d39b8-2f1e-4a8f-877d-2a99768c670d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:28.828657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461d39b8-2f1e-4a8f-877d-2a99768c670d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:28.834595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-461d39b8-2f1e-4a8f-877d-2a99768c670d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:28.842326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9cb2b3c-3124-4850-a579-d4a7fb6f1412 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:28.844149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e9cb2b3c-3124-4850-a579-d4a7fb6f1412 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:28.865021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cb2b3c-3124-4850-a579-d4a7fb6f1412 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:28.868146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cb2b3c-3124-4850-a579-d4a7fb6f1412 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:28.870421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cb2b3c-3124-4850-a579-d4a7fb6f1412 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:28.872641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cb2b3c-3124-4850-a579-d4a7fb6f1412 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:28.874712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cb2b3c-3124-4850-a579-d4a7fb6f1412 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:28.876416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9cb2b3c-3124-4850-a579-d4a7fb6f1412 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:29.238156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e9cb2b3c-3124-4850-a579-d4a7fb6f1412 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:29.256357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e9cb2b3c-3124-4850-a579-d4a7fb6f1412 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:29.259177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-461d39b8-2f1e-4a8f-877d-2a99768c670d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:29.262575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e9cb2b3c-3124-4850-a579-d4a7fb6f1412 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:29.264530 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e9cb2b3c-3124-4850-a579-d4a7fb6f1412 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.428859 Aug 09 14:56:29.277832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-461d39b8-2f1e-4a8f-877d-2a99768c670d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:29.280906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-461d39b8-2f1e-4a8f-877d-2a99768c670d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:29.287039 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2368/4739] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:28 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:29.290958 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-461d39b8-2f1e-4a8f-877d-2a99768c670d tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.511029 Aug 09 14:56:29.293698 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2372/4740] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:28 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:29.302706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bef1bb39-a86e-4dfc-a96b-c646879e3db7 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dc757940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:29.567606 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bef1bb39-a86e-4dfc-a96b-c646879e3db7 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180" status: 200 len: 343 microversion: 2.1 time: 0.279008 Aug 09 14:56:29.568775 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2369/4741] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:56:29 2022] GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 => generated 343 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:30.294098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c993c096-d5f3-43a9-8eca-9cf912cd3bb5 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:30.294963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c993c096-d5f3-43a9-8eca-9cf912cd3bb5 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:30.308647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c993c096-d5f3-43a9-8eca-9cf912cd3bb5 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:30.318833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d402dec-3105-469c-93c5-d5cdeb5c0503 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:30.319602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d402dec-3105-469c-93c5-d5cdeb5c0503 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:30.324531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c993c096-d5f3-43a9-8eca-9cf912cd3bb5 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:30.325455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c993c096-d5f3-43a9-8eca-9cf912cd3bb5 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:30.330014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d402dec-3105-469c-93c5-d5cdeb5c0503 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:30.335040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c993c096-d5f3-43a9-8eca-9cf912cd3bb5 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:30.335924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c993c096-d5f3-43a9-8eca-9cf912cd3bb5 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:30.336557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c993c096-d5f3-43a9-8eca-9cf912cd3bb5 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:30.343327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d402dec-3105-469c-93c5-d5cdeb5c0503 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:30.344254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d402dec-3105-469c-93c5-d5cdeb5c0503 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:30.348091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d402dec-3105-469c-93c5-d5cdeb5c0503 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:30.355345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d402dec-3105-469c-93c5-d5cdeb5c0503 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:30.355491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d402dec-3105-469c-93c5-d5cdeb5c0503 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:30.766845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d402dec-3105-469c-93c5-d5cdeb5c0503 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:30.780270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d402dec-3105-469c-93c5-d5cdeb5c0503 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:30.783765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d402dec-3105-469c-93c5-d5cdeb5c0503 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:30.786552 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d402dec-3105-469c-93c5-d5cdeb5c0503 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.471776 Aug 09 14:56:30.801723 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2370/4742] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:30 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:30.807559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c993c096-d5f3-43a9-8eca-9cf912cd3bb5 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:30.833519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-425240c1-53cb-4545-89f8-d4481a8133d8 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41e7508dc0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:30.839242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c993c096-d5f3-43a9-8eca-9cf912cd3bb5 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:30.843122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c993c096-d5f3-43a9-8eca-9cf912cd3bb5 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:30.845554 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c993c096-d5f3-43a9-8eca-9cf912cd3bb5 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.556318 Aug 09 14:56:30.852514 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2373/4743] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:30 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:30.947815 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-425240c1-53cb-4545-89f8-d4481a8133d8 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] HTTP exception thrown: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-425240c1-53cb-4545-89f8-d4481a8133d8 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Request method failure captured: Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 HTTP/1.1 Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nWKA2Ld7j-ozO6Bh0dZhaeqp5mfHGAhqO50Q34_j8k9wPg0YjQ6f76jY26mvhLYLvDwhPk2HZySPMGU6BTc4hbBMdFZ76dUPefDkY5jwCetgcpG70NaRLssd_ob1QLBeLeTGnP8HCO-Lkn8OjVK_DQTQyZq_dkoByfHSH_Yn7AlUtA Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 590f17b83647440b9dd11528b48c259e Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1500654600 Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_590f17b83647440b9dd11528b48c259e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/590f17b83647440b9dd11528b48c259e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/590f17b83647440b9dd11528b48c259e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/590f17b83647440b9dd11528b48c259e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1500654600 Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 590f17b83647440b9dd11528b48c259e Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1500654600 Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-VolumesSnapshotsTestJSON-1500654600-project Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 82343b52b6dd4886b61068cbebc0b0e4 Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1500654600-project Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: exception: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'de4efee3-4088-48cb-8757-91df557bf180'} Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. (HTTP 404) (Request-ID: req-00d039b0-1799-4c8e-a2d3-d13bedc67e77) Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 14:56:30.951203 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:30.955166 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:30.959153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-425240c1-53cb-4545-89f8-d4481a8133d8 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Returning 404 to user: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:56:30.960190 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-425240c1-53cb-4545-89f8-d4481a8133d8 tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180" status: 404 len: 109 microversion: 2.1 time: 0.152852 Aug 09 14:56:30.961010 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2371/4744] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:56:30 2022] GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:56:30.975165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-442ae18e-665a-42a7-9f07-53a8c979db0d tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dd217e50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:31.648026 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-442ae18e-665a-42a7-9f07-53a8c979db0d tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] HTTP exception thrown: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-442ae18e-665a-42a7-9f07-53a8c979db0d tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Request method failure captured: Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 HTTP/1.1 Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nWKA2Ld7j-ozO6Bh0dZhaeqp5mfHGAhqO50Q34_j8k9wPg0YjQ6f76jY26mvhLYLvDwhPk2HZySPMGU6BTc4hbBMdFZ76dUPefDkY5jwCetgcpG70NaRLssd_ob1QLBeLeTGnP8HCO-Lkn8OjVK_DQTQyZq_dkoByfHSH_Yn7AlUtA Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 590f17b83647440b9dd11528b48c259e Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1500654600 Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_590f17b83647440b9dd11528b48c259e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/590f17b83647440b9dd11528b48c259e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/590f17b83647440b9dd11528b48c259e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/590f17b83647440b9dd11528b48c259e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1500654600 Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 590f17b83647440b9dd11528b48c259e Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1500654600 Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-VolumesSnapshotsTestJSON-1500654600-project Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 82343b52b6dd4886b61068cbebc0b0e4 Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1500654600-project Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: method: Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: exception: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'de4efee3-4088-48cb-8757-91df557bf180'} Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. (HTTP 404) (Request-ID: req-e318d141-012a-45ed-b095-b66e05f254c3) Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 14:56:31.652546 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:31.656457 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.662015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-442ae18e-665a-42a7-9f07-53a8c979db0d tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Returning 404 to user: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:56:31.663369 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-442ae18e-665a-42a7-9f07-53a8c979db0d tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180" status: 404 len: 109 microversion: 2.1 time: 0.695650 Aug 09 14:56:31.664885 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2374/4745] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:56:30 2022] DELETE /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 => generated 109 bytes in 698 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:56:31.675122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a92b9851-d9e4-4379-b9ef-429dcffee02c tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Calling method '.version_select at 0x7f41dc76c790>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:31.741503 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-a92b9851-d9e4-4379-b9ef-429dcffee02c tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] HTTP exception thrown: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a92b9851-d9e4-4379-b9ef-429dcffee02c tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Request method failure captured: Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 HTTP/1.1 Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nWKA2Ld7j-ozO6Bh0dZhaeqp5mfHGAhqO50Q34_j8k9wPg0YjQ6f76jY26mvhLYLvDwhPk2HZySPMGU6BTc4hbBMdFZ76dUPefDkY5jwCetgcpG70NaRLssd_ob1QLBeLeTGnP8HCO-Lkn8OjVK_DQTQyZq_dkoByfHSH_Yn7AlUtA Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 590f17b83647440b9dd11528b48c259e Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1500654600 Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_590f17b83647440b9dd11528b48c259e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/590f17b83647440b9dd11528b48c259e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/590f17b83647440b9dd11528b48c259e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/590f17b83647440b9dd11528b48c259e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1500654600 Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 590f17b83647440b9dd11528b48c259e Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1500654600 Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-VolumesSnapshotsTestJSON-1500654600-project Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 82343b52b6dd4886b61068cbebc0b0e4 Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1500654600-project Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: method: Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: exception: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'de4efee3-4088-48cb-8757-91df557bf180'} Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. (HTTP 404) (Request-ID: req-9da73d2b-d805-4b55-a709-632cb83c84f7) Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 14:56:31.743467 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a92b9851-d9e4-4379-b9ef-429dcffee02c tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] Returning 404 to user: Volume de4efee3-4088-48cb-8757-91df557bf180 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a92b9851-d9e4-4379-b9ef-429dcffee02c tempest-VolumesSnapshotsTestJSON-1500654600 tempest-VolumesSnapshotsTestJSON-1500654600-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180" status: 404 len: 109 microversion: 2.1 time: 0.076225 Aug 09 14:56:31.746491 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2372/4746] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 14:56:31 2022] GET /compute/v2.1/os-volumes/de4efee3-4088-48cb-8757-91df557bf180 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:56:31.813860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-562baa4d-ee30-4a37-b6da-e92052ce4c52 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:31.815367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-562baa4d-ee30-4a37-b6da-e92052ce4c52 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:31.823136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-562baa4d-ee30-4a37-b6da-e92052ce4c52 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:31.823643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-562baa4d-ee30-4a37-b6da-e92052ce4c52 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:31.824081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-562baa4d-ee30-4a37-b6da-e92052ce4c52 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:31.824791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-562baa4d-ee30-4a37-b6da-e92052ce4c52 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:31.825245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-562baa4d-ee30-4a37-b6da-e92052ce4c52 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:31.825688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-562baa4d-ee30-4a37-b6da-e92052ce4c52 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:31.876813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-98cb7218-3b28-4cfc-9414-e0bc561d968b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:31.877429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-98cb7218-3b28-4cfc-9414-e0bc561d968b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:31.885493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98cb7218-3b28-4cfc-9414-e0bc561d968b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:31.885977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98cb7218-3b28-4cfc-9414-e0bc561d968b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:31.886405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98cb7218-3b28-4cfc-9414-e0bc561d968b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:31.898551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98cb7218-3b28-4cfc-9414-e0bc561d968b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:31.899500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98cb7218-3b28-4cfc-9414-e0bc561d968b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:31.900091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98cb7218-3b28-4cfc-9414-e0bc561d968b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:31.985866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-562baa4d-ee30-4a37-b6da-e92052ce4c52 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:32.043139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-562baa4d-ee30-4a37-b6da-e92052ce4c52 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:32.051876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-562baa4d-ee30-4a37-b6da-e92052ce4c52 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:32.053939 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-562baa4d-ee30-4a37-b6da-e92052ce4c52 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.243777 Aug 09 14:56:32.055102 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2375/4747] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:31 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:32.104808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-98cb7218-3b28-4cfc-9414-e0bc561d968b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:32.126032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-98cb7218-3b28-4cfc-9414-e0bc561d968b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:32.127880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-98cb7218-3b28-4cfc-9414-e0bc561d968b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:32.133115 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-98cb7218-3b28-4cfc-9414-e0bc561d968b tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.257933 Aug 09 14:56:32.134906 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2373/4748] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:31 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:33.081810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2248420d-6192-4547-a6be-37a40199f5c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:33.082565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2248420d-6192-4547-a6be-37a40199f5c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:33.100525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2248420d-6192-4547-a6be-37a40199f5c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:33.101308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2248420d-6192-4547-a6be-37a40199f5c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:33.101911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2248420d-6192-4547-a6be-37a40199f5c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:33.103342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2248420d-6192-4547-a6be-37a40199f5c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:33.108102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2248420d-6192-4547-a6be-37a40199f5c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:33.108686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2248420d-6192-4547-a6be-37a40199f5c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:33.175442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-da7e229b-f7ee-4f5a-a022-da7f5132233f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:33.176861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-da7e229b-f7ee-4f5a-a022-da7f5132233f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:33.199097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da7e229b-f7ee-4f5a-a022-da7f5132233f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:33.200198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da7e229b-f7ee-4f5a-a022-da7f5132233f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:33.200842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da7e229b-f7ee-4f5a-a022-da7f5132233f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:33.202157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da7e229b-f7ee-4f5a-a022-da7f5132233f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:33.204295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da7e229b-f7ee-4f5a-a022-da7f5132233f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:33.205548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-da7e229b-f7ee-4f5a-a022-da7f5132233f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:33.249436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2248420d-6192-4547-a6be-37a40199f5c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:33.263533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2248420d-6192-4547-a6be-37a40199f5c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:33.268461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2248420d-6192-4547-a6be-37a40199f5c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:33.275569 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2248420d-6192-4547-a6be-37a40199f5c4 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.198251 Aug 09 14:56:33.276856 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2376/4749] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:33 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:33.336362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-da7e229b-f7ee-4f5a-a022-da7f5132233f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:33.351590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-da7e229b-f7ee-4f5a-a022-da7f5132233f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:33.354306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-da7e229b-f7ee-4f5a-a022-da7f5132233f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:33.355661 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-da7e229b-f7ee-4f5a-a022-da7f5132233f tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.195720 Aug 09 14:56:33.356237 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2374/4750] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:33 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:34.302369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb3b3aa4-797d-4450-85ea-561c47c90039 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:34.302974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bb3b3aa4-797d-4450-85ea-561c47c90039 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:34.312868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb3b3aa4-797d-4450-85ea-561c47c90039 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:34.313895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb3b3aa4-797d-4450-85ea-561c47c90039 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:34.315199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb3b3aa4-797d-4450-85ea-561c47c90039 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:34.316234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb3b3aa4-797d-4450-85ea-561c47c90039 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:34.316826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb3b3aa4-797d-4450-85ea-561c47c90039 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:34.317406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb3b3aa4-797d-4450-85ea-561c47c90039 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:34.382604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd156cc6-b27a-4640-a86f-e2802e2f1a71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:34.383857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd156cc6-b27a-4640-a86f-e2802e2f1a71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:34.400501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd156cc6-b27a-4640-a86f-e2802e2f1a71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:34.401112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd156cc6-b27a-4640-a86f-e2802e2f1a71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:34.401554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd156cc6-b27a-4640-a86f-e2802e2f1a71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:34.402268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd156cc6-b27a-4640-a86f-e2802e2f1a71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:34.402799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd156cc6-b27a-4640-a86f-e2802e2f1a71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:34.403252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd156cc6-b27a-4640-a86f-e2802e2f1a71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:34.496685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bb3b3aa4-797d-4450-85ea-561c47c90039 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:34.518474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bb3b3aa4-797d-4450-85ea-561c47c90039 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:34.520592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bb3b3aa4-797d-4450-85ea-561c47c90039 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:34.524592 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb3b3aa4-797d-4450-85ea-561c47c90039 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.225285 Aug 09 14:56:34.525910 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2377/4751] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:34 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:34.585901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd156cc6-b27a-4640-a86f-e2802e2f1a71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:34.603714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd156cc6-b27a-4640-a86f-e2802e2f1a71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:34.608970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd156cc6-b27a-4640-a86f-e2802e2f1a71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:34.613915 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd156cc6-b27a-4640-a86f-e2802e2f1a71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.236167 Aug 09 14:56:34.615119 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2375/4752] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:34 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:35.557195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e5050793-f843-4f68-9b9a-32758f743c1e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:35.559512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e5050793-f843-4f68-9b9a-32758f743c1e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:35.580918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5050793-f843-4f68-9b9a-32758f743c1e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:35.581940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5050793-f843-4f68-9b9a-32758f743c1e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:35.582602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5050793-f843-4f68-9b9a-32758f743c1e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:35.586464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5050793-f843-4f68-9b9a-32758f743c1e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:35.588430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5050793-f843-4f68-9b9a-32758f743c1e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:35.589444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5050793-f843-4f68-9b9a-32758f743c1e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:35.639676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0d74785-3677-4180-9332-22acfdbf69ad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:35.640998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b0d74785-3677-4180-9332-22acfdbf69ad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:35.670036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0d74785-3677-4180-9332-22acfdbf69ad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:35.677548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0d74785-3677-4180-9332-22acfdbf69ad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:35.680368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0d74785-3677-4180-9332-22acfdbf69ad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:35.681161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0d74785-3677-4180-9332-22acfdbf69ad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:35.694248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0d74785-3677-4180-9332-22acfdbf69ad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:35.694998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0d74785-3677-4180-9332-22acfdbf69ad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:36.048067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e5050793-f843-4f68-9b9a-32758f743c1e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:36.050540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b0d74785-3677-4180-9332-22acfdbf69ad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:36.063109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b0d74785-3677-4180-9332-22acfdbf69ad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:36.065052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b0d74785-3677-4180-9332-22acfdbf69ad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:36.071298 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b0d74785-3677-4180-9332-22acfdbf69ad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.434610 Aug 09 14:56:36.072975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e5050793-f843-4f68-9b9a-32758f743c1e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:36.075217 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2376/4753] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:35 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:36.076814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e5050793-f843-4f68-9b9a-32758f743c1e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:36.078153 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e5050793-f843-4f68-9b9a-32758f743c1e tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.526407 Aug 09 14:56:36.088865 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2378/4754] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:35 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:37.145983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ece90f0-4520-40f7-83b4-9f1c2981d5e7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:37.146853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ece90f0-4520-40f7-83b4-9f1c2981d5e7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:37.152084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dd991388-ffae-47be-a85b-10d97d71ebd0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:37.152754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dd991388-ffae-47be-a85b-10d97d71ebd0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:37.168123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ece90f0-4520-40f7-83b4-9f1c2981d5e7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:37.168734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ece90f0-4520-40f7-83b4-9f1c2981d5e7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:37.169166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ece90f0-4520-40f7-83b4-9f1c2981d5e7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:37.170272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ece90f0-4520-40f7-83b4-9f1c2981d5e7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:37.171151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ece90f0-4520-40f7-83b4-9f1c2981d5e7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:37.173109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ece90f0-4520-40f7-83b4-9f1c2981d5e7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:37.191391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd991388-ffae-47be-a85b-10d97d71ebd0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:37.192167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd991388-ffae-47be-a85b-10d97d71ebd0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:37.193244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd991388-ffae-47be-a85b-10d97d71ebd0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:37.195042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd991388-ffae-47be-a85b-10d97d71ebd0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:37.199849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd991388-ffae-47be-a85b-10d97d71ebd0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:37.200894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dd991388-ffae-47be-a85b-10d97d71ebd0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:37.410448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ece90f0-4520-40f7-83b4-9f1c2981d5e7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:37.423782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ece90f0-4520-40f7-83b4-9f1c2981d5e7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:37.429152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ece90f0-4520-40f7-83b4-9f1c2981d5e7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:37.430754 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ece90f0-4520-40f7-83b4-9f1c2981d5e7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.290494 Aug 09 14:56:37.437855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd991388-ffae-47be-a85b-10d97d71ebd0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:37.441307 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2377/4755] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:37 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:37.457819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd991388-ffae-47be-a85b-10d97d71ebd0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:37.459568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dd991388-ffae-47be-a85b-10d97d71ebd0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:37.463474 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dd991388-ffae-47be-a85b-10d97d71ebd0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.317380 Aug 09 14:56:37.465174 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2379/4756] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:37 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:38.458169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a29bf63-7080-4d42-a270-0d061d32b124 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:38.458796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a29bf63-7080-4d42-a270-0d061d32b124 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:38.493127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a8803bf-d8dd-49f0-9882-cb592ed44cd6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:38.498492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a8803bf-d8dd-49f0-9882-cb592ed44cd6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:38.499458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a29bf63-7080-4d42-a270-0d061d32b124 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:38.502874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a29bf63-7080-4d42-a270-0d061d32b124 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:38.506338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a29bf63-7080-4d42-a270-0d061d32b124 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:38.509386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a29bf63-7080-4d42-a270-0d061d32b124 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:38.509996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a29bf63-7080-4d42-a270-0d061d32b124 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:38.512320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a29bf63-7080-4d42-a270-0d061d32b124 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:38.522819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8803bf-d8dd-49f0-9882-cb592ed44cd6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:38.523689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8803bf-d8dd-49f0-9882-cb592ed44cd6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:38.525230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8803bf-d8dd-49f0-9882-cb592ed44cd6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:38.528305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8803bf-d8dd-49f0-9882-cb592ed44cd6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:38.531158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8803bf-d8dd-49f0-9882-cb592ed44cd6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:38.535668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a8803bf-d8dd-49f0-9882-cb592ed44cd6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:38.754047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9a8803bf-d8dd-49f0-9882-cb592ed44cd6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:38.774311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9a8803bf-d8dd-49f0-9882-cb592ed44cd6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:38.777390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9a8803bf-d8dd-49f0-9882-cb592ed44cd6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:38.778865 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a8803bf-d8dd-49f0-9882-cb592ed44cd6 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.290372 Aug 09 14:56:38.779937 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2380/4757] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:38 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:38.838054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4a29bf63-7080-4d42-a270-0d061d32b124 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:38.853297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4a29bf63-7080-4d42-a270-0d061d32b124 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:38.856085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4a29bf63-7080-4d42-a270-0d061d32b124 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:38.857604 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a29bf63-7080-4d42-a270-0d061d32b124 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.405735 Aug 09 14:56:38.873263 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2378/4758] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:38 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:39.807466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07b0da83-2fe8-4107-ba07-3a52618518bf tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:39.809604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07b0da83-2fe8-4107-ba07-3a52618518bf tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:39.824776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b0da83-2fe8-4107-ba07-3a52618518bf tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:39.825800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b0da83-2fe8-4107-ba07-3a52618518bf tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:39.826616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b0da83-2fe8-4107-ba07-3a52618518bf tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:39.829476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b0da83-2fe8-4107-ba07-3a52618518bf tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:39.831957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b0da83-2fe8-4107-ba07-3a52618518bf tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:39.832659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07b0da83-2fe8-4107-ba07-3a52618518bf tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:39.892715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14aea3fb-7bdd-4d74-990f-6339daa62241 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:39.893335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14aea3fb-7bdd-4d74-990f-6339daa62241 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:39.917275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14aea3fb-7bdd-4d74-990f-6339daa62241 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:39.920280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14aea3fb-7bdd-4d74-990f-6339daa62241 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:39.920999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14aea3fb-7bdd-4d74-990f-6339daa62241 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:39.923572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14aea3fb-7bdd-4d74-990f-6339daa62241 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:39.926293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14aea3fb-7bdd-4d74-990f-6339daa62241 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:39.927375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14aea3fb-7bdd-4d74-990f-6339daa62241 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:40.079478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07b0da83-2fe8-4107-ba07-3a52618518bf tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:40.099146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07b0da83-2fe8-4107-ba07-3a52618518bf tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:40.101243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07b0da83-2fe8-4107-ba07-3a52618518bf tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:40.102952 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07b0da83-2fe8-4107-ba07-3a52618518bf tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.301085 Aug 09 14:56:40.105159 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2381/4759] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:39 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:40.138192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14aea3fb-7bdd-4d74-990f-6339daa62241 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:40.164003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14aea3fb-7bdd-4d74-990f-6339daa62241 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:40.166511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14aea3fb-7bdd-4d74-990f-6339daa62241 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:40.168000 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14aea3fb-7bdd-4d74-990f-6339daa62241 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.279633 Aug 09 14:56:40.168785 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2379/4760] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:39 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:41.135068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-227b3e8e-c416-4262-9428-d2b4cda06dc7 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:41.136634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-227b3e8e-c416-4262-9428-d2b4cda06dc7 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:41.157167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-227b3e8e-c416-4262-9428-d2b4cda06dc7 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:41.158137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-227b3e8e-c416-4262-9428-d2b4cda06dc7 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:41.158736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-227b3e8e-c416-4262-9428-d2b4cda06dc7 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:41.160527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-227b3e8e-c416-4262-9428-d2b4cda06dc7 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:41.162143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-227b3e8e-c416-4262-9428-d2b4cda06dc7 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:41.162800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-227b3e8e-c416-4262-9428-d2b4cda06dc7 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:41.195341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a8f0f1a6-81dd-4436-af78-5264c020e591 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:41.196486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a8f0f1a6-81dd-4436-af78-5264c020e591 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:41.214224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8f0f1a6-81dd-4436-af78-5264c020e591 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:41.220353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8f0f1a6-81dd-4436-af78-5264c020e591 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:41.221618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8f0f1a6-81dd-4436-af78-5264c020e591 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:41.224017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8f0f1a6-81dd-4436-af78-5264c020e591 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:41.228582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8f0f1a6-81dd-4436-af78-5264c020e591 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:41.230531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8f0f1a6-81dd-4436-af78-5264c020e591 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:41.336053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-227b3e8e-c416-4262-9428-d2b4cda06dc7 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:41.369259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-227b3e8e-c416-4262-9428-d2b4cda06dc7 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:41.372641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-227b3e8e-c416-4262-9428-d2b4cda06dc7 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:41.374082 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-227b3e8e-c416-4262-9428-d2b4cda06dc7 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.245283 Aug 09 14:56:41.387111 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2382/4761] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:41 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:41.445285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8f0f1a6-81dd-4436-af78-5264c020e591 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:41.454126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8f0f1a6-81dd-4436-af78-5264c020e591 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:41.462014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8f0f1a6-81dd-4436-af78-5264c020e591 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:41.463557 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a8f0f1a6-81dd-4436-af78-5264c020e591 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.275212 Aug 09 14:56:41.483832 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2380/4762] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:41 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:41.961202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1183568868", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "ff4f070d-1d8b-4ee6-8cce-fa57b3811e2b"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:42.125733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] validate_networks() for [('ff4f070d-1d8b-4ee6-8cce-fa57b3811e2b', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:56:42.410566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72504acc-70c5-4b1d-9e8a-91219d5c55fb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:42.411832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-72504acc-70c5-4b1d-9e8a-91219d5c55fb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:42.428987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72504acc-70c5-4b1d-9e8a-91219d5c55fb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:42.429838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72504acc-70c5-4b1d-9e8a-91219d5c55fb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:42.430756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72504acc-70c5-4b1d-9e8a-91219d5c55fb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:42.431730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72504acc-70c5-4b1d-9e8a-91219d5c55fb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:42.432623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72504acc-70c5-4b1d-9e8a-91219d5c55fb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:42.433199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72504acc-70c5-4b1d-9e8a-91219d5c55fb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:42.641021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-72504acc-70c5-4b1d-9e8a-91219d5c55fb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:42.664592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-72504acc-70c5-4b1d-9e8a-91219d5c55fb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:42.667284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-72504acc-70c5-4b1d-9e8a-91219d5c55fb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:42.668768 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72504acc-70c5-4b1d-9e8a-91219d5c55fb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.266019 Aug 09 14:56:42.670384 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2381/4763] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:42 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:42.676344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8f3cac9-f124-403a-b6d7-10d8db492f71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:42.677274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b8f3cac9-f124-403a-b6d7-10d8db492f71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:42.684520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8f3cac9-f124-403a-b6d7-10d8db492f71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:42.685236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8f3cac9-f124-403a-b6d7-10d8db492f71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:42.685825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8f3cac9-f124-403a-b6d7-10d8db492f71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:42.686693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8f3cac9-f124-403a-b6d7-10d8db492f71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:42.687363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8f3cac9-f124-403a-b6d7-10d8db492f71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:42.687930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8f3cac9-f124-403a-b6d7-10d8db492f71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:42.846281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8f3cac9-f124-403a-b6d7-10d8db492f71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:42.859412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8f3cac9-f124-403a-b6d7-10d8db492f71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:42.863840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8f3cac9-f124-403a-b6d7-10d8db492f71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:42.865532 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8f3cac9-f124-403a-b6d7-10d8db492f71 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.193973 Aug 09 14:56:42.869424 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2382/4764] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:42 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:43.092569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:56:43.094115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:56:43.094880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:56:43.096283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:56:43.096794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:56:43.119244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:43.119940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:43.120580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:43.121480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:43.122246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:43.122909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:43.160826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Getting quotas for project fb56e12b0adf49a29fd10b116d76df80. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:56:43.176305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Getting quotas for user f005f855f5c547688f0ea3a276b398f1 and project fb56e12b0adf49a29fd10b116d76df80. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:56:43.224288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:56:43.230437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:56:43.361137 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07a0a92b-b0d7-4cc5-9f72-d6a97591a1a0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.984690 Aug 09 14:56:43.362112 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2383/4765] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:56:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:56:43.373193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5766acb1-3444-4c70-afba-3bdbd7dff07f tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:43.373817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5766acb1-3444-4c70-afba-3bdbd7dff07f tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:43.524658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5766acb1-3444-4c70-afba-3bdbd7dff07f tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:43.535010 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5766acb1-3444-4c70-afba-3bdbd7dff07f tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1215 microversion: 2.1 time: 0.165620 Aug 09 14:56:43.539977 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2383/4766] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:43 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:56:43.697648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85e46f0d-e374-4970-8f33-14695781f64c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:43.698312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-85e46f0d-e374-4970-8f33-14695781f64c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:43.711469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85e46f0d-e374-4970-8f33-14695781f64c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:43.728693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85e46f0d-e374-4970-8f33-14695781f64c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:43.730016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85e46f0d-e374-4970-8f33-14695781f64c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:43.731125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85e46f0d-e374-4970-8f33-14695781f64c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:43.732258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85e46f0d-e374-4970-8f33-14695781f64c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:43.734466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85e46f0d-e374-4970-8f33-14695781f64c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:43.895103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82cc48a7-7d80-4bfd-8851-68057433ed2a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:43.895834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82cc48a7-7d80-4bfd-8851-68057433ed2a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:43.912449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82cc48a7-7d80-4bfd-8851-68057433ed2a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:43.914200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82cc48a7-7d80-4bfd-8851-68057433ed2a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:43.914801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82cc48a7-7d80-4bfd-8851-68057433ed2a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:43.919310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82cc48a7-7d80-4bfd-8851-68057433ed2a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:43.920040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82cc48a7-7d80-4bfd-8851-68057433ed2a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:43.920617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82cc48a7-7d80-4bfd-8851-68057433ed2a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:43.931575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:43.988909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-85e46f0d-e374-4970-8f33-14695781f64c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:44.024887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-85e46f0d-e374-4970-8f33-14695781f64c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:44.035509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-85e46f0d-e374-4970-8f33-14695781f64c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:44.047544 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-85e46f0d-e374-4970-8f33-14695781f64c tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.349431 Aug 09 14:56:44.060502 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2384/4767] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:43 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:44.105165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-82cc48a7-7d80-4bfd-8851-68057433ed2a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:44.114805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-82cc48a7-7d80-4bfd-8851-68057433ed2a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:44.122366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-82cc48a7-7d80-4bfd-8851-68057433ed2a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:44.125313 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82cc48a7-7d80-4bfd-8851-68057433ed2a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.236143 Aug 09 14:56:44.140394 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2384/4768] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:43 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:44.562517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-24e262b5-1de0-4e50-a65d-3d3e471947e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:44.563149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-24e262b5-1de0-4e50-a65d-3d3e471947e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:44.588228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e262b5-1de0-4e50-a65d-3d3e471947e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:44.589969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e262b5-1de0-4e50-a65d-3d3e471947e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:44.590579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e262b5-1de0-4e50-a65d-3d3e471947e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:44.591718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e262b5-1de0-4e50-a65d-3d3e471947e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:44.592508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e262b5-1de0-4e50-a65d-3d3e471947e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:44.593370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-24e262b5-1de0-4e50-a65d-3d3e471947e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:44.667384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:45.075542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-24e262b5-1de0-4e50-a65d-3d3e471947e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:45.084687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70dfe8c4-f02e-4cee-b878-ee2e98f88f72 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:45.085211 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-24e262b5-1de0-4e50-a65d-3d3e471947e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1219 microversion: 2.1 time: 0.526187 Aug 09 14:56:45.085328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-70dfe8c4-f02e-4cee-b878-ee2e98f88f72 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:45.096684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70dfe8c4-f02e-4cee-b878-ee2e98f88f72 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:45.097176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70dfe8c4-f02e-4cee-b878-ee2e98f88f72 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:45.103602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70dfe8c4-f02e-4cee-b878-ee2e98f88f72 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:45.104442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70dfe8c4-f02e-4cee-b878-ee2e98f88f72 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:45.104923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70dfe8c4-f02e-4cee-b878-ee2e98f88f72 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:45.105359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70dfe8c4-f02e-4cee-b878-ee2e98f88f72 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:45.108649 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2385/4769] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:44 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1219 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:56:45.157879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dde87625-22b8-4976-be36-8936ae8d17c4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:45.159497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dde87625-22b8-4976-be36-8936ae8d17c4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:45.176165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dde87625-22b8-4976-be36-8936ae8d17c4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:45.176991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dde87625-22b8-4976-be36-8936ae8d17c4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:45.177581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dde87625-22b8-4976-be36-8936ae8d17c4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:45.179712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dde87625-22b8-4976-be36-8936ae8d17c4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:45.181871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dde87625-22b8-4976-be36-8936ae8d17c4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:45.183407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dde87625-22b8-4976-be36-8936ae8d17c4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:45.446031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dde87625-22b8-4976-be36-8936ae8d17c4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:45.454082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-70dfe8c4-f02e-4cee-b878-ee2e98f88f72 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:45.470741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dde87625-22b8-4976-be36-8936ae8d17c4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:45.472505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-70dfe8c4-f02e-4cee-b878-ee2e98f88f72 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:45.475046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dde87625-22b8-4976-be36-8936ae8d17c4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:45.477946 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dde87625-22b8-4976-be36-8936ae8d17c4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.324505 Aug 09 14:56:45.487297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-70dfe8c4-f02e-4cee-b878-ee2e98f88f72 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:45.505278 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70dfe8c4-f02e-4cee-b878-ee2e98f88f72 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.420055 Aug 09 14:56:45.506779 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2385/4771] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:45 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:45.509416 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2386/4771] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:45 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:46.112540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0133ba6-e8b4-4662-9138-6696e77511d9 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:46.113222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0133ba6-e8b4-4662-9138-6696e77511d9 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:46.134884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0133ba6-e8b4-4662-9138-6696e77511d9 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:46.139752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0133ba6-e8b4-4662-9138-6696e77511d9 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:46.143895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0133ba6-e8b4-4662-9138-6696e77511d9 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:46.153255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0133ba6-e8b4-4662-9138-6696e77511d9 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:46.156366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0133ba6-e8b4-4662-9138-6696e77511d9 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:46.160613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0133ba6-e8b4-4662-9138-6696e77511d9 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:46.516035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bce62f44-f765-4977-80e0-88ad800c3905 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:46.517203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bce62f44-f765-4977-80e0-88ad800c3905 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:46.535376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bce62f44-f765-4977-80e0-88ad800c3905 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:46.547963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bce62f44-f765-4977-80e0-88ad800c3905 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:46.551819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bce62f44-f765-4977-80e0-88ad800c3905 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:46.552855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bce62f44-f765-4977-80e0-88ad800c3905 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:46.553621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bce62f44-f765-4977-80e0-88ad800c3905 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:46.554192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bce62f44-f765-4977-80e0-88ad800c3905 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:47.014384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bce62f44-f765-4977-80e0-88ad800c3905 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:47.038754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bce62f44-f765-4977-80e0-88ad800c3905 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:47.039907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bce62f44-f765-4977-80e0-88ad800c3905 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:47.041134 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bce62f44-f765-4977-80e0-88ad800c3905 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.529539 Aug 09 14:56:47.074130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a0133ba6-e8b4-4662-9138-6696e77511d9 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:47.075464 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2387/4772] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:46 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:47.080492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9813f766-a80d-43b3-8271-c738528b2272 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:47.081110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9813f766-a80d-43b3-8271-c738528b2272 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:47.093673 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0133ba6-e8b4-4662-9138-6696e77511d9 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1273 microversion: 2.1 time: 0.985655 Aug 09 14:56:47.097281 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2386/4773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:46 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1273 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:56:47.110348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9813f766-a80d-43b3-8271-c738528b2272 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:47.110837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9813f766-a80d-43b3-8271-c738528b2272 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:47.122158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9813f766-a80d-43b3-8271-c738528b2272 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:47.123071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9813f766-a80d-43b3-8271-c738528b2272 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:47.123754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9813f766-a80d-43b3-8271-c738528b2272 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:47.124575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9813f766-a80d-43b3-8271-c738528b2272 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:47.600910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9813f766-a80d-43b3-8271-c738528b2272 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:47.614610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9813f766-a80d-43b3-8271-c738528b2272 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:47.617841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9813f766-a80d-43b3-8271-c738528b2272 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:47.619126 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9813f766-a80d-43b3-8271-c738528b2272 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.542557 Aug 09 14:56:47.622753 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2388/4774] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:47 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:48.066392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-57afab8b-7f58-4ce3-be95-c4228fded8aa tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:48.067876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-57afab8b-7f58-4ce3-be95-c4228fded8aa tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:48.099316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57afab8b-7f58-4ce3-be95-c4228fded8aa tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:48.102442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57afab8b-7f58-4ce3-be95-c4228fded8aa tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:48.103062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57afab8b-7f58-4ce3-be95-c4228fded8aa tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:48.108615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57afab8b-7f58-4ce3-be95-c4228fded8aa tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:48.109583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57afab8b-7f58-4ce3-be95-c4228fded8aa tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:48.111875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57afab8b-7f58-4ce3-be95-c4228fded8aa tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:48.116609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1bfd3e8a-ab47-48a0-a389-b8432730d192 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:48.117227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1bfd3e8a-ab47-48a0-a389-b8432730d192 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:48.131136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bfd3e8a-ab47-48a0-a389-b8432730d192 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:48.132328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bfd3e8a-ab47-48a0-a389-b8432730d192 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:48.133141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bfd3e8a-ab47-48a0-a389-b8432730d192 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:48.135044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bfd3e8a-ab47-48a0-a389-b8432730d192 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:48.137825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bfd3e8a-ab47-48a0-a389-b8432730d192 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:48.139333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bfd3e8a-ab47-48a0-a389-b8432730d192 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:48.397551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-57afab8b-7f58-4ce3-be95-c4228fded8aa tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:48.415265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-57afab8b-7f58-4ce3-be95-c4228fded8aa tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:48.420000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-57afab8b-7f58-4ce3-be95-c4228fded8aa tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:48.421528 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-57afab8b-7f58-4ce3-be95-c4228fded8aa tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.359449 Aug 09 14:56:48.432308 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2387/4775] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:48 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:48.646997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f610f5d4-3314-4ae8-988f-c80aaeb8b82a tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:48.647965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f610f5d4-3314-4ae8-988f-c80aaeb8b82a tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:48.662073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f610f5d4-3314-4ae8-988f-c80aaeb8b82a tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:48.668947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f610f5d4-3314-4ae8-988f-c80aaeb8b82a tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:48.669613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f610f5d4-3314-4ae8-988f-c80aaeb8b82a tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:48.670503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f610f5d4-3314-4ae8-988f-c80aaeb8b82a tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:48.675202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f610f5d4-3314-4ae8-988f-c80aaeb8b82a tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:48.675896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f610f5d4-3314-4ae8-988f-c80aaeb8b82a tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:48.946085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f610f5d4-3314-4ae8-988f-c80aaeb8b82a tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:48.963360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f610f5d4-3314-4ae8-988f-c80aaeb8b82a tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:48.964853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f610f5d4-3314-4ae8-988f-c80aaeb8b82a tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:48.966254 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f610f5d4-3314-4ae8-988f-c80aaeb8b82a tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.323733 Aug 09 14:56:48.968293 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2388/4776] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:48 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:48.977000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1bfd3e8a-ab47-48a0-a389-b8432730d192 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:48.985855 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1bfd3e8a-ab47-48a0-a389-b8432730d192 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1315 microversion: 2.1 time: 0.873448 Aug 09 14:56:48.990439 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2389/4777] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:48 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:56:49.457417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee6abecb-54be-40c3-a31d-7c8b781f23f2 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:49.458604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee6abecb-54be-40c3-a31d-7c8b781f23f2 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:49.472807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee6abecb-54be-40c3-a31d-7c8b781f23f2 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:49.479858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee6abecb-54be-40c3-a31d-7c8b781f23f2 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:49.480561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee6abecb-54be-40c3-a31d-7c8b781f23f2 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:49.481602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee6abecb-54be-40c3-a31d-7c8b781f23f2 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:49.482192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee6abecb-54be-40c3-a31d-7c8b781f23f2 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:49.484854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee6abecb-54be-40c3-a31d-7c8b781f23f2 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:49.882889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee6abecb-54be-40c3-a31d-7c8b781f23f2 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:49.910924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee6abecb-54be-40c3-a31d-7c8b781f23f2 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:49.919282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee6abecb-54be-40c3-a31d-7c8b781f23f2 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:49.924337 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee6abecb-54be-40c3-a31d-7c8b781f23f2 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1366 microversion: 2.47 time: 0.471027 Aug 09 14:56:49.927562 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2389/4778] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:49 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1366 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:49.990358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0d07e27-74db-43ff-91e7-3ad7fd7b9ff0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:49.991719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e0d07e27-74db-43ff-91e7-3ad7fd7b9ff0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:50.012805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0d07e27-74db-43ff-91e7-3ad7fd7b9ff0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:50.013716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0d07e27-74db-43ff-91e7-3ad7fd7b9ff0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:50.020312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0d07e27-74db-43ff-91e7-3ad7fd7b9ff0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:50.021380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0d07e27-74db-43ff-91e7-3ad7fd7b9ff0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:50.022273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0d07e27-74db-43ff-91e7-3ad7fd7b9ff0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:50.031649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f149c28e-9b95-4164-9b70-1e5b2f48f1f4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:50.032920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f149c28e-9b95-4164-9b70-1e5b2f48f1f4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:50.043276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0d07e27-74db-43ff-91e7-3ad7fd7b9ff0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:50.059892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f149c28e-9b95-4164-9b70-1e5b2f48f1f4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:50.060648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f149c28e-9b95-4164-9b70-1e5b2f48f1f4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:50.061439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f149c28e-9b95-4164-9b70-1e5b2f48f1f4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:50.067620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f149c28e-9b95-4164-9b70-1e5b2f48f1f4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:50.068295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f149c28e-9b95-4164-9b70-1e5b2f48f1f4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:50.068904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f149c28e-9b95-4164-9b70-1e5b2f48f1f4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:50.329804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e0d07e27-74db-43ff-91e7-3ad7fd7b9ff0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:50.345544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e0d07e27-74db-43ff-91e7-3ad7fd7b9ff0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:50.349899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e0d07e27-74db-43ff-91e7-3ad7fd7b9ff0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:50.351802 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e0d07e27-74db-43ff-91e7-3ad7fd7b9ff0 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.365845 Aug 09 14:56:50.356864 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2390/4779] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:49 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:50.787213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f149c28e-9b95-4164-9b70-1e5b2f48f1f4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:50.797531 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f149c28e-9b95-4164-9b70-1e5b2f48f1f4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1315 microversion: 2.1 time: 0.790190 Aug 09 14:56:50.807816 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2390/4780] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:50 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:56:50.889486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-2928f3c9-a4b0-4ed2-a65f-2d98a2f5ca31 req-1a2bbe4f-3112-4930-bf54-c48ca562104e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f446270d-87a1-4212-9171-a49584b351d2", "tag": "eb9996db-ff21-4e80-a9b4-5d1f3f6eddd8"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:50.923389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2928f3c9-a4b0-4ed2-a65f-2d98a2f5ca31 req-1a2bbe4f-3112-4930-bf54-c48ca562104e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:50.925748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2928f3c9-a4b0-4ed2-a65f-2d98a2f5ca31 req-1a2bbe4f-3112-4930-bf54-c48ca562104e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:50.944440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2928f3c9-a4b0-4ed2-a65f-2d98a2f5ca31 req-1a2bbe4f-3112-4930-bf54-c48ca562104e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:50.977190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1054631-b62c-4a62-84ad-a73d1e777c8a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:50.977816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1054631-b62c-4a62-84ad-a73d1e777c8a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:51.000591 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-2928f3c9-a4b0-4ed2-a65f-2d98a2f5ca31 req-1a2bbe4f-3112-4930-bf54-c48ca562104e service nova] Creating event network-changed:eb9996db-ff21-4e80-a9b4-5d1f3f6eddd8 for instance f446270d-87a1-4212-9171-a49584b351d2 on n-h2-844626-8 Aug 09 14:56:51.001499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1054631-b62c-4a62-84ad-a73d1e777c8a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:51.001499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1054631-b62c-4a62-84ad-a73d1e777c8a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:51.001848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1054631-b62c-4a62-84ad-a73d1e777c8a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:51.006474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1054631-b62c-4a62-84ad-a73d1e777c8a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:51.013103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1054631-b62c-4a62-84ad-a73d1e777c8a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:51.013564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1054631-b62c-4a62-84ad-a73d1e777c8a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:51.050812 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-2928f3c9-a4b0-4ed2-a65f-2d98a2f5ca31 req-1a2bbe4f-3112-4930-bf54-c48ca562104e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166339 Aug 09 14:56:51.058095 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2391/4781] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:56:51.336226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1054631-b62c-4a62-84ad-a73d1e777c8a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:51.355578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1054631-b62c-4a62-84ad-a73d1e777c8a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:51.357397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1054631-b62c-4a62-84ad-a73d1e777c8a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:51.369827 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1054631-b62c-4a62-84ad-a73d1e777c8a tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1372 microversion: 2.47 time: 0.391553 Aug 09 14:56:51.370898 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2391/4782] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:50 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1372 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:51.382783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a7ce20e-626f-4629-8588-627347f6ffb8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:51.384596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a7ce20e-626f-4629-8588-627347f6ffb8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:51.401580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a7ce20e-626f-4629-8588-627347f6ffb8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:51.402073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a7ce20e-626f-4629-8588-627347f6ffb8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:51.410140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a7ce20e-626f-4629-8588-627347f6ffb8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:51.416603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a7ce20e-626f-4629-8588-627347f6ffb8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:51.417282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a7ce20e-626f-4629-8588-627347f6ffb8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:51.417832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a7ce20e-626f-4629-8588-627347f6ffb8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:51.841177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a7ce20e-626f-4629-8588-627347f6ffb8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:51.843876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8c743b30-3de3-44c5-a20f-6f945fc38cd0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:51.845054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8c743b30-3de3-44c5-a20f-6f945fc38cd0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:51.859473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a7ce20e-626f-4629-8588-627347f6ffb8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:51.861873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a7ce20e-626f-4629-8588-627347f6ffb8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:51.867292 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a7ce20e-626f-4629-8588-627347f6ffb8 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.490288 Aug 09 14:56:51.873960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c743b30-3de3-44c5-a20f-6f945fc38cd0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:51.874649 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2392/4783] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:51 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:51.881726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c743b30-3de3-44c5-a20f-6f945fc38cd0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:51.882287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c743b30-3de3-44c5-a20f-6f945fc38cd0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:51.883665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c743b30-3de3-44c5-a20f-6f945fc38cd0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:51.889377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c743b30-3de3-44c5-a20f-6f945fc38cd0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:51.889920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8c743b30-3de3-44c5-a20f-6f945fc38cd0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:52.410573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d37e21c-cc12-463f-ba15-24674ffce50d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:52.411866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4d37e21c-cc12-463f-ba15-24674ffce50d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:52.427632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d37e21c-cc12-463f-ba15-24674ffce50d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:52.428796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d37e21c-cc12-463f-ba15-24674ffce50d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:52.434773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d37e21c-cc12-463f-ba15-24674ffce50d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:52.439539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d37e21c-cc12-463f-ba15-24674ffce50d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:52.441568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d37e21c-cc12-463f-ba15-24674ffce50d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:52.443662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d37e21c-cc12-463f-ba15-24674ffce50d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:53.138186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:53.199829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:53.213217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d37e21c-cc12-463f-ba15-24674ffce50d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:53.233575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d37e21c-cc12-463f-ba15-24674ffce50d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:53.242767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d37e21c-cc12-463f-ba15-24674ffce50d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:53.246921 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4d37e21c-cc12-463f-ba15-24674ffce50d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1357 microversion: 2.47 time: 0.838717 Aug 09 14:56:53.252244 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2393/4784] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:52 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1357 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:53.270724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7cd2f338-b729-4a07-9d69-8c78d8c60d67 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:53.272255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7cd2f338-b729-4a07-9d69-8c78d8c60d67 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:53.290836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cd2f338-b729-4a07-9d69-8c78d8c60d67 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:53.314570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cd2f338-b729-4a07-9d69-8c78d8c60d67 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:53.314570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cd2f338-b729-4a07-9d69-8c78d8c60d67 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:53.326497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cd2f338-b729-4a07-9d69-8c78d8c60d67 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:53.326497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cd2f338-b729-4a07-9d69-8c78d8c60d67 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:53.326497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cd2f338-b729-4a07-9d69-8c78d8c60d67 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:53.464863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8c743b30-3de3-44c5-a20f-6f945fc38cd0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:53.485491 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8c743b30-3de3-44c5-a20f-6f945fc38cd0 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1315 microversion: 2.1 time: 1.646298 Aug 09 14:56:53.486710 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2392/4785] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:51 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1315 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:56:53.500723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:53.507404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:53.509058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Searching by: {'deleted': False, 'project_id': '808e29814b7946febc8610a17314fe8a'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 14:56:53.517042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:53.517853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:53.518505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:53.520637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:53.521370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:53.522509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:53.545441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7cd2f338-b729-4a07-9d69-8c78d8c60d67 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:53.573697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7cd2f338-b729-4a07-9d69-8c78d8c60d67 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:53.580476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7cd2f338-b729-4a07-9d69-8c78d8c60d67 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:53.582282 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7cd2f338-b729-4a07-9d69-8c78d8c60d67 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1604 microversion: 2.32 time: 0.326169 Aug 09 14:56:53.599111 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2394/4786] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:53 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:53.617086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:53.752237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 14:56:53.911866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:53.922650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:53.923306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:53.925809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:53.941344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:53.943486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:53.993674 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-faa41e88-3ae2-4446-8cbf-8dfbbd988644 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.501085 Aug 09 14:56:53.994827 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2393/4787] 10.222.0.50 () {60 vars in 1187 bytes} [Tue Aug 9 14:56:53 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:54.045969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55468786-2dae-4f3e-a1b5-58750ae09bc7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:54.046538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55468786-2dae-4f3e-a1b5-58750ae09bc7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:54.053581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55468786-2dae-4f3e-a1b5-58750ae09bc7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:54.054326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55468786-2dae-4f3e-a1b5-58750ae09bc7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:54.054916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55468786-2dae-4f3e-a1b5-58750ae09bc7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:54.056001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55468786-2dae-4f3e-a1b5-58750ae09bc7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:54.056596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55468786-2dae-4f3e-a1b5-58750ae09bc7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:54.057161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55468786-2dae-4f3e-a1b5-58750ae09bc7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:54.085176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55468786-2dae-4f3e-a1b5-58750ae09bc7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:56:54.216312 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-55468786-2dae-4f3e-a1b5-58750ae09bc7 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "DELETE /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 204 len: 0 microversion: 2.47 time: 0.185838 Aug 09 14:56:54.217625 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2395/4788] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:56:54 2022] DELETE /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:56:54.226501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ce3a0c7-8a05-4238-8cb0-14a1a811969c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:54.227217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ce3a0c7-8a05-4238-8cb0-14a1a811969c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:54.240212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ce3a0c7-8a05-4238-8cb0-14a1a811969c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:54.241064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ce3a0c7-8a05-4238-8cb0-14a1a811969c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:54.241535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ce3a0c7-8a05-4238-8cb0-14a1a811969c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:54.242502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ce3a0c7-8a05-4238-8cb0-14a1a811969c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:54.243341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ce3a0c7-8a05-4238-8cb0-14a1a811969c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:54.243984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ce3a0c7-8a05-4238-8cb0-14a1a811969c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:54.328312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ce3a0c7-8a05-4238-8cb0-14a1a811969c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:54.339774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ce3a0c7-8a05-4238-8cb0-14a1a811969c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:54.343299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ce3a0c7-8a05-4238-8cb0-14a1a811969c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:54.344729 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ce3a0c7-8a05-4238-8cb0-14a1a811969c tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1363 microversion: 2.47 time: 0.122622 Aug 09 14:56:54.345782 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2394/4789] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:54 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1363 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:54.511858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa8e4b25-9d4e-494d-8934-e0454fec15ac tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:54.512914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa8e4b25-9d4e-494d-8934-e0454fec15ac tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:54.526310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa8e4b25-9d4e-494d-8934-e0454fec15ac tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:54.526837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa8e4b25-9d4e-494d-8934-e0454fec15ac tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:54.527757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa8e4b25-9d4e-494d-8934-e0454fec15ac tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:54.528711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa8e4b25-9d4e-494d-8934-e0454fec15ac tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:54.529671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa8e4b25-9d4e-494d-8934-e0454fec15ac tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:54.530295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa8e4b25-9d4e-494d-8934-e0454fec15ac tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:54.614463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:54.615841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:54.625303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:54.627900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:54.630641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:54.631994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:54.637439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:54.638886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:54.716907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:54.717458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:54.718165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:54.718618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lazy-loading 'fault' on Instance uuid 7ec868ce-9219-4e7d-88fd-0740de733a00 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:56:54.802432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:54.816638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:54.821161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8811057cd0b41f8b19133f759c51fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6c164a34094b61a233eb90f5826bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:54.823896 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dcc7cc23-7cb7-43a9-a036-07a1bec2adbb tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 200 len: 1609 microversion: 2.32 time: 0.213646 Aug 09 14:56:54.825373 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2395/4790] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:54 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 1609 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 14:56:54.851233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa8e4b25-9d4e-494d-8934-e0454fec15ac tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:54.859436 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa8e4b25-9d4e-494d-8934-e0454fec15ac tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1315 microversion: 2.1 time: 0.353735 Aug 09 14:56:54.860690 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2396/4791] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:54 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:56:55.372865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06c0f331-a20f-451d-bc17-19cb422865c3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:55.373156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06c0f331-a20f-451d-bc17-19cb422865c3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:55.377709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=59 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:55.412442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06c0f331-a20f-451d-bc17-19cb422865c3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:55.412442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06c0f331-a20f-451d-bc17-19cb422865c3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:55.412442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06c0f331-a20f-451d-bc17-19cb422865c3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:55.412442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06c0f331-a20f-451d-bc17-19cb422865c3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:55.412442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06c0f331-a20f-451d-bc17-19cb422865c3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:55.412442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06c0f331-a20f-451d-bc17-19cb422865c3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:55.643218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-06c0f331-a20f-451d-bc17-19cb422865c3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:55.656471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-06c0f331-a20f-451d-bc17-19cb422865c3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:55.658674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-06c0f331-a20f-451d-bc17-19cb422865c3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:55.660117 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06c0f331-a20f-451d-bc17-19cb422865c3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1363 microversion: 2.47 time: 0.292481 Aug 09 14:56:55.684134 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2396/4792] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:55 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1363 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:55.853080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23e2646b-5dec-4580-bc7b-79eb7d152d4f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:55.854776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-23e2646b-5dec-4580-bc7b-79eb7d152d4f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:55.868719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23e2646b-5dec-4580-bc7b-79eb7d152d4f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:55.869480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23e2646b-5dec-4580-bc7b-79eb7d152d4f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:55.870239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23e2646b-5dec-4580-bc7b-79eb7d152d4f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:55.871631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23e2646b-5dec-4580-bc7b-79eb7d152d4f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:55.872162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23e2646b-5dec-4580-bc7b-79eb7d152d4f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:55.872611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23e2646b-5dec-4580-bc7b-79eb7d152d4f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:55.880861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2a942f6-6c43-4cd5-b71b-b4980246c9fa tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:55.881662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c2a942f6-6c43-4cd5-b71b-b4980246c9fa tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:55.892048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a942f6-6c43-4cd5-b71b-b4980246c9fa tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:55.893242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a942f6-6c43-4cd5-b71b-b4980246c9fa tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:55.895824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a942f6-6c43-4cd5-b71b-b4980246c9fa tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:55.899121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a942f6-6c43-4cd5-b71b-b4980246c9fa tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:55.900185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a942f6-6c43-4cd5-b71b-b4980246c9fa tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:55.900852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a942f6-6c43-4cd5-b71b-b4980246c9fa tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:55.921636 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-23e2646b-5dec-4580-bc7b-79eb7d152d4f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] HTTP exception thrown: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23e2646b-5dec-4580-bc7b-79eb7d152d4f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Request method failure captured: Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 HTTP/1.1 Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nQOSaoEYj4cMAB5vHvSq5IB-HTj3SleBQ98gjGLrPK0SpHSBfTySOyHkGlJR81e8S9jbhv6k76vogy1hbV50-XY2KyQVc2stRJvp9dAZgOjNv0o4iUFyZW0KQ-du8nO1jYd1t6eXo0uUsQJibmbOeL34EkwexDW0DA6dnLsJBO5c3w Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.32 Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: ea6c164a34094b61a233eb90f5826bdb Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TaggedBootDevicesTest-44154871 Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea6c164a34094b61a233eb90f5826bdb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea6c164a34094b61a233eb90f5826bdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea6c164a34094b61a233eb90f5826bdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea6c164a34094b61a233eb90f5826bdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TaggedBootDevicesTest-44154871 Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: ea6c164a34094b61a233eb90f5826bdb Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TaggedBootDevicesTest-44154871 Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TaggedBootDevicesTest-44154871-project Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e8811057cd0b41f8b19133f759c51fa6 Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TaggedBootDevicesTest-44154871-project Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '7ec868ce-9219-4e7d-88fd-0740de733a00'} Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:55.927526 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:55.931239 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:55.931239 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:55.931239 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:55.931239 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:56:55.931239 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:56:55.931239 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:56:55.931239 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:55.933133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23e2646b-5dec-4580-bc7b-79eb7d152d4f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Returning 404 to user: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:56:55.934159 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-23e2646b-5dec-4580-bc7b-79eb7d152d4f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 404 len: 111 microversion: 2.32 time: 0.085731 Aug 09 14:56:55.935737 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2397/4793] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:55 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:56:55.958113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-93da6867-0d07-4cdb-b325-153b28bd0f5b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '.version_select at 0x7f41e755f940>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:55.988235 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-93da6867-0d07-4cdb-b325-153b28bd0f5b tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319263904" status: 204 len: 0 microversion: 2.32 time: 0.047150 Aug 09 14:56:55.989738 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2398/4794] 10.222.0.50 () {60 vars in 1262 bytes} [Tue Aug 9 14:56:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319263904 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:56:56.337613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2a942f6-6c43-4cd5-b71b-b4980246c9fa tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:56.347200 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2a942f6-6c43-4cd5-b71b-b4980246c9fa tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1315 microversion: 2.1 time: 0.470567 Aug 09 14:56:56.352551 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2397/4795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:55 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:56:56.690974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:56.692589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:56.710824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:56.711149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:56.713654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:56.715434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:56.717157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:56.717835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:56.839910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:56.840805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:56.871307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:56.872154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lazy-loading 'fault' on Instance uuid 295313b2-572e-45ac-aee8-faeb31e4c57a {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:56:57.296398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:57.310558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:57.315015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:57.316416 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6836377c-adc1-4bfd-b6af-9dbedfb532b4 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 200 len: 1368 microversion: 2.47 time: 0.635102 Aug 09 14:56:57.320003 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2399/4796] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:56 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 1368 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:57.400699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2ad426e-ead0-4a2a-9dce-606a36ea5dbb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:57.401457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2ad426e-ead0-4a2a-9dce-606a36ea5dbb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:57.423706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2ad426e-ead0-4a2a-9dce-606a36ea5dbb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:57.424140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2ad426e-ead0-4a2a-9dce-606a36ea5dbb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:57.424576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2ad426e-ead0-4a2a-9dce-606a36ea5dbb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:57.425280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2ad426e-ead0-4a2a-9dce-606a36ea5dbb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:57.425718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2ad426e-ead0-4a2a-9dce-606a36ea5dbb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:57.426141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2ad426e-ead0-4a2a-9dce-606a36ea5dbb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:57.775315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2ad426e-ead0-4a2a-9dce-606a36ea5dbb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:57.786776 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2ad426e-ead0-4a2a-9dce-606a36ea5dbb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1315 microversion: 2.1 time: 0.390620 Aug 09 14:56:57.787745 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2398/4797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:57 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:56:58.345541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ada57d94-32c8-4a05-ac82-b9d59cb0859e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:58.347079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ada57d94-32c8-4a05-ac82-b9d59cb0859e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 295313b2-572e-45ac-aee8-faeb31e4c57a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:58.358591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ada57d94-32c8-4a05-ac82-b9d59cb0859e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:58.361308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ada57d94-32c8-4a05-ac82-b9d59cb0859e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:58.363184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ada57d94-32c8-4a05-ac82-b9d59cb0859e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:58.365316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ada57d94-32c8-4a05-ac82-b9d59cb0859e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:58.368520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ada57d94-32c8-4a05-ac82-b9d59cb0859e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:58.369172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ada57d94-32c8-4a05-ac82-b9d59cb0859e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:58.402814 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ada57d94-32c8-4a05-ac82-b9d59cb0859e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] HTTP exception thrown: Instance 295313b2-572e-45ac-aee8-faeb31e4c57a could not be found. Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ada57d94-32c8-4a05-ac82-b9d59cb0859e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Request method failure captured: Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a HTTP/1.1 Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nWHBtqvFCorxXWqJX-AroZfbK8s1yY8MPnW8qodTtcwI11-Jx6UOXuDwKvXR0wtLIW_3JpKbPaUsuQD1ghjOM2VjD33EDo555vTK06pxLr4vbUawM-T1AF1PulwqN5D36mdiijNK9QgLOxjmBYdWanW89kKMuVgtmQFNjsPrx5uWts Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Openstack-Nova-Api-Version: 2.47 Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 808e29814b7946febc8610a17314fe8a Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerShowV247Test-1915217664 Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_808e29814b7946febc8610a17314fe8a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/808e29814b7946febc8610a17314fe8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/808e29814b7946febc8610a17314fe8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/808e29814b7946febc8610a17314fe8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerShowV247Test-1915217664 Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 808e29814b7946febc8610a17314fe8a Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerShowV247Test-1915217664 Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerShowV247Test-1915217664-project Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 8aeecd7a11194ae7bd58ce80db75365c Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerShowV247Test-1915217664-project Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 295313b2-572e-45ac-aee8-faeb31e4c57a could not be found. Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '295313b2-572e-45ac-aee8-faeb31e4c57a'} Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 295313b2-572e-45ac-aee8-faeb31e4c57a could not be found. Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 295313b2-572e-45ac-aee8-faeb31e4c57a could not be found. Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:56:58.410384 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:58.417117 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:56:58.417117 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:56:58.417117 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:56:58.417117 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:56:58.417117 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:56:58.417117 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 295313b2-572e-45ac-aee8-faeb31e4c57a could not be found. Aug 09 14:56:58.417117 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:56:58.419250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ada57d94-32c8-4a05-ac82-b9d59cb0859e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Returning 404 to user: Instance 295313b2-572e-45ac-aee8-faeb31e4c57a could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:56:58.420434 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ada57d94-32c8-4a05-ac82-b9d59cb0859e tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a" status: 404 len: 111 microversion: 2.47 time: 0.079487 Aug 09 14:56:58.422040 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2400/4798] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:58 2022] GET /compute/v2.1/servers/295313b2-572e-45ac-aee8-faeb31e4c57a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:56:58.435410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d5dd8558-23da-4f13-b14d-4450171cd4e3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:58.436143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d5dd8558-23da-4f13-b14d-4450171cd4e3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 9476f95c-fb45-4c1f-a055-43985199dc00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:58.467529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-aa939e8d-4b66-4a54-a7f5-3923ce2e0381 req-4874c26a-1214-427c-998e-a9be561e160b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f446270d-87a1-4212-9171-a49584b351d2", "name": "network-vif-plugged", "status": "completed", "tag": "eb9996db-ff21-4e80-a9b4-5d1f3f6eddd8"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:56:58.489543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5dd8558-23da-4f13-b14d-4450171cd4e3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:58.494817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5dd8558-23da-4f13-b14d-4450171cd4e3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:58.501051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5dd8558-23da-4f13-b14d-4450171cd4e3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:58.502167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5dd8558-23da-4f13-b14d-4450171cd4e3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:58.504251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-aa939e8d-4b66-4a54-a7f5-3923ce2e0381 req-4874c26a-1214-427c-998e-a9be561e160b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:58.504737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-aa939e8d-4b66-4a54-a7f5-3923ce2e0381 req-4874c26a-1214-427c-998e-a9be561e160b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:58.505178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-aa939e8d-4b66-4a54-a7f5-3923ce2e0381 req-4874c26a-1214-427c-998e-a9be561e160b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:58.506247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5dd8558-23da-4f13-b14d-4450171cd4e3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:58.513523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d5dd8558-23da-4f13-b14d-4450171cd4e3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:58.556404 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-aa939e8d-4b66-4a54-a7f5-3923ce2e0381 req-4874c26a-1214-427c-998e-a9be561e160b service nova] Creating event network-vif-plugged:eb9996db-ff21-4e80-a9b4-5d1f3f6eddd8 for instance f446270d-87a1-4212-9171-a49584b351d2 on n-h2-844626-8 Aug 09 14:56:58.579928 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-aa939e8d-4b66-4a54-a7f5-3923ce2e0381 req-4874c26a-1214-427c-998e-a9be561e160b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117723 Aug 09 14:56:58.583710 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2401/4799] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:56:58.592648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d5dd8558-23da-4f13-b14d-4450171cd4e3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 9476f95c-fb45-4c1f-a055-43985199dc00] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:56:58.598437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:56:58.799463 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d5dd8558-23da-4f13-b14d-4450171cd4e3 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9476f95c-fb45-4c1f-a055-43985199dc00" status: 204 len: 0 microversion: 2.47 time: 0.372873 Aug 09 14:56:58.804495 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2399/4800] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:56:58 2022] DELETE /compute/v2.1/servers/9476f95c-fb45-4c1f-a055-43985199dc00 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 14:56:58.830325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c69b1e8-8c59-4810-949b-ad3e3b37ec1d tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:58.831034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c69b1e8-8c59-4810-949b-ad3e3b37ec1d tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:58.842642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d6f1f3bd-1459-40b0-bd4a-f2a7fa2bcfad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:56:58.850402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d6f1f3bd-1459-40b0-bd4a-f2a7fa2bcfad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 9476f95c-fb45-4c1f-a055-43985199dc00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:56:58.871905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c69b1e8-8c59-4810-949b-ad3e3b37ec1d tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:58.874407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c69b1e8-8c59-4810-949b-ad3e3b37ec1d tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:58.879156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6f1f3bd-1459-40b0-bd4a-f2a7fa2bcfad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:58.880209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6f1f3bd-1459-40b0-bd4a-f2a7fa2bcfad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:58.882104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6f1f3bd-1459-40b0-bd4a-f2a7fa2bcfad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:58.882499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c69b1e8-8c59-4810-949b-ad3e3b37ec1d tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:58.882925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6f1f3bd-1459-40b0-bd4a-f2a7fa2bcfad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:58.883405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6f1f3bd-1459-40b0-bd4a-f2a7fa2bcfad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:58.883835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6f1f3bd-1459-40b0-bd4a-f2a7fa2bcfad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:58.885959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c69b1e8-8c59-4810-949b-ad3e3b37ec1d tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:56:58.887803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c69b1e8-8c59-4810-949b-ad3e3b37ec1d tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:56:58.888566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c69b1e8-8c59-4810-949b-ad3e3b37ec1d tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:56:59.107120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d6f1f3bd-1459-40b0-bd4a-f2a7fa2bcfad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:59.117757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d6f1f3bd-1459-40b0-bd4a-f2a7fa2bcfad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:59.119626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d6f1f3bd-1459-40b0-bd4a-f2a7fa2bcfad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:59.121085 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d6f1f3bd-1459-40b0-bd4a-f2a7fa2bcfad tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/9476f95c-fb45-4c1f-a055-43985199dc00" status: 200 len: 1362 microversion: 2.47 time: 0.305815 Aug 09 14:56:59.122797 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2400/4801] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:56:58 2022] GET /compute/v2.1/servers/9476f95c-fb45-4c1f-a055-43985199dc00 => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:56:59.198896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c69b1e8-8c59-4810-949b-ad3e3b37ec1d tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:56:59.210403 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c69b1e8-8c59-4810-949b-ad3e3b37ec1d tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1315 microversion: 2.1 time: 0.391689 Aug 09 14:56:59.224577 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2402/4802] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:56:58 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:00.151550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3230d040-d82c-42eb-b1f4-0cd0c064fef1 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:00.155237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3230d040-d82c-42eb-b1f4-0cd0c064fef1 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 9476f95c-fb45-4c1f-a055-43985199dc00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:00.203283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3230d040-d82c-42eb-b1f4-0cd0c064fef1 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:00.204309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3230d040-d82c-42eb-b1f4-0cd0c064fef1 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:00.204989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3230d040-d82c-42eb-b1f4-0cd0c064fef1 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:00.212322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3230d040-d82c-42eb-b1f4-0cd0c064fef1 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:00.213073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3230d040-d82c-42eb-b1f4-0cd0c064fef1 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:00.217693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3230d040-d82c-42eb-b1f4-0cd0c064fef1 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:00.238199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41644a46-c1b9-4991-8148-306ba258b17e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:00.241570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-41644a46-c1b9-4991-8148-306ba258b17e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:00.288970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:57:00.304800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41644a46-c1b9-4991-8148-306ba258b17e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:00.305819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41644a46-c1b9-4991-8148-306ba258b17e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:00.306858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41644a46-c1b9-4991-8148-306ba258b17e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:00.312202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41644a46-c1b9-4991-8148-306ba258b17e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:00.315718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41644a46-c1b9-4991-8148-306ba258b17e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:00.318825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41644a46-c1b9-4991-8148-306ba258b17e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:00.422892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:57:00.522155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3230d040-d82c-42eb-b1f4-0cd0c064fef1 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:00.554859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3230d040-d82c-42eb-b1f4-0cd0c064fef1 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:00.562559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3230d040-d82c-42eb-b1f4-0cd0c064fef1 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aeecd7a11194ae7bd58ce80db75365c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '808e29814b7946febc8610a17314fe8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:00.599925 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3230d040-d82c-42eb-b1f4-0cd0c064fef1 tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/9476f95c-fb45-4c1f-a055-43985199dc00" status: 200 len: 1362 microversion: 2.47 time: 0.457318 Aug 09 14:57:00.624578 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2401/4803] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:57:00 2022] GET /compute/v2.1/servers/9476f95c-fb45-4c1f-a055-43985199dc00 => generated 1362 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 14:57:00.882051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-41644a46-c1b9-4991-8148-306ba258b17e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:00.896562 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-41644a46-c1b9-4991-8148-306ba258b17e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1502 microversion: 2.1 time: 0.665963 Aug 09 14:57:00.897750 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2403/4804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:00 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1502 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:00.928511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07795249-b694-4786-9c5a-7568c7bc1ff8 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:00.929658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07795249-b694-4786-9c5a-7568c7bc1ff8 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:00.946870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07795249-b694-4786-9c5a-7568c7bc1ff8 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:00.950190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07795249-b694-4786-9c5a-7568c7bc1ff8 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:00.950844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07795249-b694-4786-9c5a-7568c7bc1ff8 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:00.953397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07795249-b694-4786-9c5a-7568c7bc1ff8 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:00.955255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07795249-b694-4786-9c5a-7568c7bc1ff8 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:00.957032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07795249-b694-4786-9c5a-7568c7bc1ff8 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:01.434114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07795249-b694-4786-9c5a-7568c7bc1ff8 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:01.449707 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07795249-b694-4786-9c5a-7568c7bc1ff8 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1502 microversion: 2.1 time: 0.527753 Aug 09 14:57:01.450334 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2402/4805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:00 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1502 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:57:01.473091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4402f3aa-785b-4cc5-80e6-25b3d24e18f2 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:57:01.473912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4402f3aa-785b-4cc5-80e6-25b3d24e18f2 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:01.482272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4402f3aa-785b-4cc5-80e6-25b3d24e18f2 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:01.483043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4402f3aa-785b-4cc5-80e6-25b3d24e18f2 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:01.484068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4402f3aa-785b-4cc5-80e6-25b3d24e18f2 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:01.485123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4402f3aa-785b-4cc5-80e6-25b3d24e18f2 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:01.485733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4402f3aa-785b-4cc5-80e6-25b3d24e18f2 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:01.486311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4402f3aa-785b-4cc5-80e6-25b3d24e18f2 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:01.535614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-4402f3aa-785b-4cc5-80e6-25b3d24e18f2 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lazy-loading 'flavor' on Instance uuid f446270d-87a1-4212-9171-a49584b351d2 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:57:01.633871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d99977b1-9706-4c0a-a95b-abe00769a29d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:01.634495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d99977b1-9706-4c0a-a95b-abe00769a29d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] [instance: 9476f95c-fb45-4c1f-a055-43985199dc00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:01.643519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d99977b1-9706-4c0a-a95b-abe00769a29d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:01.644567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d99977b1-9706-4c0a-a95b-abe00769a29d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:01.646050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d99977b1-9706-4c0a-a95b-abe00769a29d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:01.647994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d99977b1-9706-4c0a-a95b-abe00769a29d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:01.650002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d99977b1-9706-4c0a-a95b-abe00769a29d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:01.650689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d99977b1-9706-4c0a-a95b-abe00769a29d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:01.703390 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-d99977b1-9706-4c0a-a95b-abe00769a29d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] HTTP exception thrown: Instance 9476f95c-fb45-4c1f-a055-43985199dc00 could not be found. Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d99977b1-9706-4c0a-a95b-abe00769a29d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Request method failure captured: Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/9476f95c-fb45-4c1f-a055-43985199dc00 HTTP/1.1 Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nWHBtqvFCorxXWqJX-AroZfbK8s1yY8MPnW8qodTtcwI11-Jx6UOXuDwKvXR0wtLIW_3JpKbPaUsuQD1ghjOM2VjD33EDo555vTK06pxLr4vbUawM-T1AF1PulwqN5D36mdiijNK9QgLOxjmBYdWanW89kKMuVgtmQFNjsPrx5uWts Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.47 Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 808e29814b7946febc8610a17314fe8a Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerShowV247Test-1915217664 Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_808e29814b7946febc8610a17314fe8a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/808e29814b7946febc8610a17314fe8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/808e29814b7946febc8610a17314fe8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/808e29814b7946febc8610a17314fe8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerShowV247Test-1915217664 Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 808e29814b7946febc8610a17314fe8a Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerShowV247Test-1915217664 Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerShowV247Test-1915217664-project Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 8aeecd7a11194ae7bd58ce80db75365c Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerShowV247Test-1915217664-project Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 9476f95c-fb45-4c1f-a055-43985199dc00 could not be found. Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '9476f95c-fb45-4c1f-a055-43985199dc00'} Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9476f95c-fb45-4c1f-a055-43985199dc00 could not be found. Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9476f95c-fb45-4c1f-a055-43985199dc00 could not be found. Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:57:01.708137 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:01.711597 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:57:01.711597 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:57:01.711597 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:57:01.711597 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:57:01.711597 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:57:01.711597 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9476f95c-fb45-4c1f-a055-43985199dc00 could not be found. Aug 09 14:57:01.711597 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:01.717388 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4402f3aa-785b-4cc5-80e6-25b3d24e18f2 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "POST /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2/action" status: 202 len: 0 microversion: 2.1 time: 0.246626 Aug 09 14:57:01.722463 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2404/4806] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:57:01 2022] POST /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:57:01.723769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d99977b1-9706-4c0a-a95b-abe00769a29d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] Returning 404 to user: Instance 9476f95c-fb45-4c1f-a055-43985199dc00 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:57:01.725167 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d99977b1-9706-4c0a-a95b-abe00769a29d tempest-ServerShowV247Test-1915217664 tempest-ServerShowV247Test-1915217664-project] 10.222.0.50 "GET /compute/v2.1/servers/9476f95c-fb45-4c1f-a055-43985199dc00" status: 404 len: 111 microversion: 2.47 time: 0.095492 Aug 09 14:57:01.731363 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2403/4807] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:57:01 2022] GET /compute/v2.1/servers/9476f95c-fb45-4c1f-a055-43985199dc00 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:57:01.738672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-befdcc67-8101-493d-92b2-cc215fbb5423 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:01.743236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-befdcc67-8101-493d-92b2-cc215fbb5423 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:01.767366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-befdcc67-8101-493d-92b2-cc215fbb5423 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:01.768275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-befdcc67-8101-493d-92b2-cc215fbb5423 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:01.769335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-befdcc67-8101-493d-92b2-cc215fbb5423 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:01.770309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-befdcc67-8101-493d-92b2-cc215fbb5423 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:01.770943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-befdcc67-8101-493d-92b2-cc215fbb5423 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:01.771549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-befdcc67-8101-493d-92b2-cc215fbb5423 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:02.195920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-befdcc67-8101-493d-92b2-cc215fbb5423 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:02.207807 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-befdcc67-8101-493d-92b2-cc215fbb5423 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1510 microversion: 2.1 time: 0.483354 Aug 09 14:57:02.209542 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2405/4808] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:01 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1510 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:03.233458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ce57ffbe-3a4a-4447-997e-044222a6e0b4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:03.234165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ce57ffbe-3a4a-4447-997e-044222a6e0b4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:03.244673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce57ffbe-3a4a-4447-997e-044222a6e0b4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:03.245385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce57ffbe-3a4a-4447-997e-044222a6e0b4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:03.246085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce57ffbe-3a4a-4447-997e-044222a6e0b4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:03.247202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce57ffbe-3a4a-4447-997e-044222a6e0b4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:03.248164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce57ffbe-3a4a-4447-997e-044222a6e0b4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:03.249552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce57ffbe-3a4a-4447-997e-044222a6e0b4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:03.617832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:57:03.907169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce57ffbe-3a4a-4447-997e-044222a6e0b4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:03.909823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:57:03.919037 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ce57ffbe-3a4a-4447-997e-044222a6e0b4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1493 microversion: 2.1 time: 0.689848 Aug 09 14:57:03.920292 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2404/4809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:03 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1493 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:03.941908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f712f12-d024-4e13-a99b-561521bdfd55 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:57:03.942580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f712f12-d024-4e13-a99b-561521bdfd55 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:03.955754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f712f12-d024-4e13-a99b-561521bdfd55 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:03.956379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f712f12-d024-4e13-a99b-561521bdfd55 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:03.959489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f712f12-d024-4e13-a99b-561521bdfd55 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:03.960349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f712f12-d024-4e13-a99b-561521bdfd55 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:03.963171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f712f12-d024-4e13-a99b-561521bdfd55 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:03.964171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f712f12-d024-4e13-a99b-561521bdfd55 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:04.120240 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f712f12-d024-4e13-a99b-561521bdfd55 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "POST /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2/action" status: 202 len: 0 microversion: 2.1 time: 0.182330 Aug 09 14:57:04.139884 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2406/4810] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:57:03 2022] POST /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:57:04.143037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9769ba51-5c7d-4570-a783-a11ec495505f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:04.146980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9769ba51-5c7d-4570-a783-a11ec495505f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:04.149238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-802bac8b-525e-4edc-bb2e-317034bf63bb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:04.150263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-802bac8b-525e-4edc-bb2e-317034bf63bb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:04.158284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-802bac8b-525e-4edc-bb2e-317034bf63bb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:04.158999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-802bac8b-525e-4edc-bb2e-317034bf63bb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:04.159608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-802bac8b-525e-4edc-bb2e-317034bf63bb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:04.160992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-802bac8b-525e-4edc-bb2e-317034bf63bb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:04.162016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-802bac8b-525e-4edc-bb2e-317034bf63bb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:04.162874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-802bac8b-525e-4edc-bb2e-317034bf63bb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:04.168574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9769ba51-5c7d-4570-a783-a11ec495505f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:04.177222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9769ba51-5c7d-4570-a783-a11ec495505f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:04.177932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9769ba51-5c7d-4570-a783-a11ec495505f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:04.180093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9769ba51-5c7d-4570-a783-a11ec495505f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:04.183071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9769ba51-5c7d-4570-a783-a11ec495505f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:04.183821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9769ba51-5c7d-4570-a783-a11ec495505f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:04.231477 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-9769ba51-5c7d-4570-a783-a11ec495505f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] HTTP exception thrown: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9769ba51-5c7d-4570-a783-a11ec495505f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Request method failure captured: Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 HTTP/1.1 Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nQOSaoEYj4cMAB5vHvSq5IB-HTj3SleBQ98gjGLrPK0SpHSBfTySOyHkGlJR81e8S9jbhv6k76vogy1hbV50-XY2KyQVc2stRJvp9dAZgOjNv0o4iUFyZW0KQ-du8nO1jYd1t6eXo0uUsQJibmbOeL34EkwexDW0DA6dnLsJBO5c3w Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.32 Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: ea6c164a34094b61a233eb90f5826bdb Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TaggedBootDevicesTest-44154871 Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea6c164a34094b61a233eb90f5826bdb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea6c164a34094b61a233eb90f5826bdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea6c164a34094b61a233eb90f5826bdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea6c164a34094b61a233eb90f5826bdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TaggedBootDevicesTest-44154871 Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: ea6c164a34094b61a233eb90f5826bdb Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TaggedBootDevicesTest-44154871 Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TaggedBootDevicesTest-44154871-project Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e8811057cd0b41f8b19133f759c51fa6 Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TaggedBootDevicesTest-44154871-project Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '7ec868ce-9219-4e7d-88fd-0740de733a00'} Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:57:04.236077 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:57:04.240582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:57:04.240582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:04.240582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:57:04.240582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:04.240582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:57:04.240582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:57:04.240582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:57:04.240582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:57:04.240582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:57:04.240582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:57:04.240582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:04.245352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9769ba51-5c7d-4570-a783-a11ec495505f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Returning 404 to user: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:57:04.246633 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9769ba51-5c7d-4570-a783-a11ec495505f tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 404 len: 111 microversion: 2.32 time: 0.110583 Aug 09 14:57:04.251262 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2405/4811] 10.222.0.50 () {60 vars in 1280 bytes} [Tue Aug 9 14:57:04 2022] DELETE /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:57:04.257929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-313470be-c3bf-463e-916d-944b7e095de9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:04.262630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-313470be-c3bf-463e-916d-944b7e095de9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] [instance: 7ec868ce-9219-4e7d-88fd-0740de733a00] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:04.274829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-313470be-c3bf-463e-916d-944b7e095de9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:04.275351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-313470be-c3bf-463e-916d-944b7e095de9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:04.275782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-313470be-c3bf-463e-916d-944b7e095de9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:04.276488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-313470be-c3bf-463e-916d-944b7e095de9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:04.276934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-313470be-c3bf-463e-916d-944b7e095de9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:04.277352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-313470be-c3bf-463e-916d-944b7e095de9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:04.337189 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-313470be-c3bf-463e-916d-944b7e095de9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] HTTP exception thrown: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-313470be-c3bf-463e-916d-944b7e095de9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Request method failure captured: Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 HTTP/1.1 Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nQOSaoEYj4cMAB5vHvSq5IB-HTj3SleBQ98gjGLrPK0SpHSBfTySOyHkGlJR81e8S9jbhv6k76vogy1hbV50-XY2KyQVc2stRJvp9dAZgOjNv0o4iUFyZW0KQ-du8nO1jYd1t6eXo0uUsQJibmbOeL34EkwexDW0DA6dnLsJBO5c3w Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Openstack-Nova-Api-Version: 2.32 Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: ea6c164a34094b61a233eb90f5826bdb Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TaggedBootDevicesTest-44154871 Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_ea6c164a34094b61a233eb90f5826bdb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/ea6c164a34094b61a233eb90f5826bdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea6c164a34094b61a233eb90f5826bdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/ea6c164a34094b61a233eb90f5826bdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TaggedBootDevicesTest-44154871 Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: ea6c164a34094b61a233eb90f5826bdb Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TaggedBootDevicesTest-44154871 Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TaggedBootDevicesTest-44154871-project Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: e8811057cd0b41f8b19133f759c51fa6 Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TaggedBootDevicesTest-44154871-project Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '7ec868ce-9219-4e7d-88fd-0740de733a00'} Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:57:04.339285 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:04.343474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:57:04.343474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:57:04.343474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:57:04.343474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:57:04.343474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:57:04.343474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. Aug 09 14:57:04.343474 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:04.353382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-313470be-c3bf-463e-916d-944b7e095de9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] Returning 404 to user: Instance 7ec868ce-9219-4e7d-88fd-0740de733a00 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:57:04.355066 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-313470be-c3bf-463e-916d-944b7e095de9 tempest-TaggedBootDevicesTest-44154871 tempest-TaggedBootDevicesTest-44154871-project] 10.222.0.50 "GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00" status: 404 len: 111 microversion: 2.32 time: 0.102312 Aug 09 14:57:04.356260 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2406/4812] 10.222.0.50 () {60 vars in 1277 bytes} [Tue Aug 9 14:57:04 2022] GET /compute/v2.1/servers/7ec868ce-9219-4e7d-88fd-0740de733a00 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 14:57:04.824841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-802bac8b-525e-4edc-bb2e-317034bf63bb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:04.834716 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-802bac8b-525e-4edc-bb2e-317034bf63bb tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1499 microversion: 2.1 time: 0.691590 Aug 09 14:57:04.835370 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2407/4813] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:04 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1499 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:05.861747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6603862a-08cb-4057-9c09-4b1d058cca8b tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:05.862422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6603862a-08cb-4057-9c09-4b1d058cca8b tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:05.876021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6603862a-08cb-4057-9c09-4b1d058cca8b tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:05.877535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6603862a-08cb-4057-9c09-4b1d058cca8b tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:05.877993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6603862a-08cb-4057-9c09-4b1d058cca8b tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:05.878719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6603862a-08cb-4057-9c09-4b1d058cca8b tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:05.879202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6603862a-08cb-4057-9c09-4b1d058cca8b tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:05.879670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6603862a-08cb-4057-9c09-4b1d058cca8b tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:06.166260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6603862a-08cb-4057-9c09-4b1d058cca8b tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:06.184895 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6603862a-08cb-4057-9c09-4b1d058cca8b tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1499 microversion: 2.1 time: 0.327889 Aug 09 14:57:06.187309 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2407/4814] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:05 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1499 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:07.209116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7170d23a-32ac-44dd-b7fc-ecad7af3065a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:07.209915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7170d23a-32ac-44dd-b7fc-ecad7af3065a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:07.222591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7170d23a-32ac-44dd-b7fc-ecad7af3065a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:07.227629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7170d23a-32ac-44dd-b7fc-ecad7af3065a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:07.228699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7170d23a-32ac-44dd-b7fc-ecad7af3065a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:07.229666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7170d23a-32ac-44dd-b7fc-ecad7af3065a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:07.233495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7170d23a-32ac-44dd-b7fc-ecad7af3065a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:07.234280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7170d23a-32ac-44dd-b7fc-ecad7af3065a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:07.497128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7170d23a-32ac-44dd-b7fc-ecad7af3065a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:07.511620 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7170d23a-32ac-44dd-b7fc-ecad7af3065a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1502 microversion: 2.1 time: 0.306490 Aug 09 14:57:07.527414 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2408/4815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:07 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:07.534867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3816352c-d497-47cf-84d8-3e8c1e96f6e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:57:07.535491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3816352c-d497-47cf-84d8-3e8c1e96f6e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:07.553032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3816352c-d497-47cf-84d8-3e8c1e96f6e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:07.553749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3816352c-d497-47cf-84d8-3e8c1e96f6e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:07.554351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3816352c-d497-47cf-84d8-3e8c1e96f6e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:07.555259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3816352c-d497-47cf-84d8-3e8c1e96f6e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:07.555888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3816352c-d497-47cf-84d8-3e8c1e96f6e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:07.556481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3816352c-d497-47cf-84d8-3e8c1e96f6e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:07.602969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-3816352c-d497-47cf-84d8-3e8c1e96f6e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lazy-loading 'flavor' on Instance uuid f446270d-87a1-4212-9171-a49584b351d2 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:57:07.764333 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3816352c-d497-47cf-84d8-3e8c1e96f6e6 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "POST /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2/action" status: 202 len: 0 microversion: 2.1 time: 0.232922 Aug 09 14:57:07.765786 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2408/4816] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:57:07 2022] POST /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:57:07.786437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9c5ea609-1b9d-435a-b792-b680258323ea tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:07.787524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9c5ea609-1b9d-435a-b792-b680258323ea tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:07.804434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c5ea609-1b9d-435a-b792-b680258323ea tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:07.805244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c5ea609-1b9d-435a-b792-b680258323ea tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:07.805835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c5ea609-1b9d-435a-b792-b680258323ea tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:07.806773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c5ea609-1b9d-435a-b792-b680258323ea tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:07.807902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c5ea609-1b9d-435a-b792-b680258323ea tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:07.808750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c5ea609-1b9d-435a-b792-b680258323ea tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:08.069953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9c5ea609-1b9d-435a-b792-b680258323ea tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:08.086572 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9c5ea609-1b9d-435a-b792-b680258323ea tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1510 microversion: 2.1 time: 0.315101 Aug 09 14:57:08.088026 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2409/4817] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:07 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:09.113304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5f373c10-845d-4873-8493-7d7e156b763a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:09.114146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5f373c10-845d-4873-8493-7d7e156b763a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:09.142245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f373c10-845d-4873-8493-7d7e156b763a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:09.149761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f373c10-845d-4873-8493-7d7e156b763a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:09.153151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f373c10-845d-4873-8493-7d7e156b763a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:09.154067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f373c10-845d-4873-8493-7d7e156b763a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:09.159500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f373c10-845d-4873-8493-7d7e156b763a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:09.160098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f373c10-845d-4873-8493-7d7e156b763a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:09.628845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5f373c10-845d-4873-8493-7d7e156b763a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:09.640241 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5f373c10-845d-4873-8493-7d7e156b763a tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1493 microversion: 2.1 time: 0.532315 Aug 09 14:57:09.655389 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2409/4818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:09 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1493 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:09.683139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f47a7acc-6914-45be-b18d-be6dd74b8de5 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:57:09.684656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f47a7acc-6914-45be-b18d-be6dd74b8de5 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:09.695617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f47a7acc-6914-45be-b18d-be6dd74b8de5 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:09.697691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f47a7acc-6914-45be-b18d-be6dd74b8de5 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:09.698393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f47a7acc-6914-45be-b18d-be6dd74b8de5 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:09.702029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f47a7acc-6914-45be-b18d-be6dd74b8de5 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:09.703389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f47a7acc-6914-45be-b18d-be6dd74b8de5 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:09.705642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f47a7acc-6914-45be-b18d-be6dd74b8de5 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:09.896992 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f47a7acc-6914-45be-b18d-be6dd74b8de5 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "POST /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2/action" status: 202 len: 0 microversion: 2.1 time: 0.225702 Aug 09 14:57:09.908532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d985f4d-3ad1-41f0-b855-b135dc5d4b7c tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:09.909408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d985f4d-3ad1-41f0-b855-b135dc5d4b7c tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:09.912936 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2410/4819] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:57:09 2022] POST /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:57:09.916813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d985f4d-3ad1-41f0-b855-b135dc5d4b7c tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:09.917594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d985f4d-3ad1-41f0-b855-b135dc5d4b7c tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:09.918237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d985f4d-3ad1-41f0-b855-b135dc5d4b7c tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:09.919253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d985f4d-3ad1-41f0-b855-b135dc5d4b7c tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:09.919903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d985f4d-3ad1-41f0-b855-b135dc5d4b7c tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:09.920574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d985f4d-3ad1-41f0-b855-b135dc5d4b7c tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:10.753272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d985f4d-3ad1-41f0-b855-b135dc5d4b7c tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:10.774088 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d985f4d-3ad1-41f0-b855-b135dc5d4b7c tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1499 microversion: 2.1 time: 0.867830 Aug 09 14:57:10.794674 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2410/4820] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:09 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1499 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:11.802247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-710a6702-b812-4370-87e6-1daaaeb7d2d4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:11.803561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-710a6702-b812-4370-87e6-1daaaeb7d2d4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:11.815658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-710a6702-b812-4370-87e6-1daaaeb7d2d4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:11.825550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-710a6702-b812-4370-87e6-1daaaeb7d2d4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:11.826012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-710a6702-b812-4370-87e6-1daaaeb7d2d4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:11.832186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-710a6702-b812-4370-87e6-1daaaeb7d2d4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:11.832922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-710a6702-b812-4370-87e6-1daaaeb7d2d4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:11.835480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-710a6702-b812-4370-87e6-1daaaeb7d2d4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:12.388585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-710a6702-b812-4370-87e6-1daaaeb7d2d4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:12.414249 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-710a6702-b812-4370-87e6-1daaaeb7d2d4 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1499 microversion: 2.1 time: 0.616308 Aug 09 14:57:12.415264 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2411/4821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:11 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1499 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:13.438558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9aacd748-ca19-4ead-a5e9-85be3d57a13e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:13.439398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9aacd748-ca19-4ead-a5e9-85be3d57a13e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:13.451683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aacd748-ca19-4ead-a5e9-85be3d57a13e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:13.452463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aacd748-ca19-4ead-a5e9-85be3d57a13e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:13.453194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aacd748-ca19-4ead-a5e9-85be3d57a13e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:13.454313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aacd748-ca19-4ead-a5e9-85be3d57a13e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:13.455762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aacd748-ca19-4ead-a5e9-85be3d57a13e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:13.456374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aacd748-ca19-4ead-a5e9-85be3d57a13e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:13.872728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9aacd748-ca19-4ead-a5e9-85be3d57a13e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:13.889584 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9aacd748-ca19-4ead-a5e9-85be3d57a13e tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1502 microversion: 2.1 time: 0.450301 Aug 09 14:57:13.915594 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2411/4822] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:13 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1502 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:13.916909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-72f7a89d-eb74-4977-867e-a33f2ec01b77 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:13.917349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-72f7a89d-eb74-4977-867e-a33f2ec01b77 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:13.926854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72f7a89d-eb74-4977-867e-a33f2ec01b77 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:13.927378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72f7a89d-eb74-4977-867e-a33f2ec01b77 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:13.927829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72f7a89d-eb74-4977-867e-a33f2ec01b77 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:13.928530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72f7a89d-eb74-4977-867e-a33f2ec01b77 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:13.928986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72f7a89d-eb74-4977-867e-a33f2ec01b77 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:13.929407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72f7a89d-eb74-4977-867e-a33f2ec01b77 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:14.005882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-72f7a89d-eb74-4977-867e-a33f2ec01b77 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:57:14.222026 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-72f7a89d-eb74-4977-867e-a33f2ec01b77 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 204 len: 0 microversion: 2.1 time: 0.312181 Aug 09 14:57:14.223165 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2412/4823] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:57:13 2022] DELETE /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:57:14.231651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-482b7396-d882-4fcb-8fcb-30e97aac1c82 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:14.232346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-482b7396-d882-4fcb-8fcb-30e97aac1c82 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:14.243043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-482b7396-d882-4fcb-8fcb-30e97aac1c82 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:14.243605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-482b7396-d882-4fcb-8fcb-30e97aac1c82 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:14.245016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-482b7396-d882-4fcb-8fcb-30e97aac1c82 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:14.247477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-482b7396-d882-4fcb-8fcb-30e97aac1c82 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:14.248615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-482b7396-d882-4fcb-8fcb-30e97aac1c82 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:14.249312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-482b7396-d882-4fcb-8fcb-30e97aac1c82 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:15.532510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-482b7396-d882-4fcb-8fcb-30e97aac1c82 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:15.555749 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-482b7396-d882-4fcb-8fcb-30e97aac1c82 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1508 microversion: 2.1 time: 1.319648 Aug 09 14:57:15.574601 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2412/4824] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:14 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1508 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:16.588307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4319e137-887e-48b3-af1d-876fff02bad1 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:16.589384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4319e137-887e-48b3-af1d-876fff02bad1 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:16.621155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4319e137-887e-48b3-af1d-876fff02bad1 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:16.621155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4319e137-887e-48b3-af1d-876fff02bad1 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:16.621155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4319e137-887e-48b3-af1d-876fff02bad1 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:16.621855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4319e137-887e-48b3-af1d-876fff02bad1 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:16.622357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4319e137-887e-48b3-af1d-876fff02bad1 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:16.622791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4319e137-887e-48b3-af1d-876fff02bad1 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:17.517280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4319e137-887e-48b3-af1d-876fff02bad1 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:17.527978 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4319e137-887e-48b3-af1d-876fff02bad1 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1508 microversion: 2.1 time: 0.946519 Aug 09 14:57:17.552904 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2413/4825] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:16 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1508 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:17.982890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-54286739-a26b-4457-9acd-9a185a35f811 req-342bd981-c289-4c2a-bdc8-1d674aa0496d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f446270d-87a1-4212-9171-a49584b351d2", "name": "network-vif-deleted", "tag": "eb9996db-ff21-4e80-a9b4-5d1f3f6eddd8"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:57:18.019543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-54286739-a26b-4457-9acd-9a185a35f811 req-342bd981-c289-4c2a-bdc8-1d674aa0496d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:18.020029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-54286739-a26b-4457-9acd-9a185a35f811 req-342bd981-c289-4c2a-bdc8-1d674aa0496d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:18.020460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-54286739-a26b-4457-9acd-9a185a35f811 req-342bd981-c289-4c2a-bdc8-1d674aa0496d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:18.064550 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-54286739-a26b-4457-9acd-9a185a35f811 req-342bd981-c289-4c2a-bdc8-1d674aa0496d service nova] Creating event network-vif-deleted:eb9996db-ff21-4e80-a9b4-5d1f3f6eddd8 for instance f446270d-87a1-4212-9171-a49584b351d2 on n-h2-844626-8 Aug 09 14:57:18.084770 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-54286739-a26b-4457-9acd-9a185a35f811 req-342bd981-c289-4c2a-bdc8-1d674aa0496d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108614 Aug 09 14:57:18.093174 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2413/4826] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:57:18.556602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:18.557225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:18.581669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:18.586191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:18.586739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:18.587527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:18.589480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:18.590169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:18.637868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:18.639511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:18.640187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:18.640914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lazy-loading 'fault' on Instance uuid f446270d-87a1-4212-9171-a49584b351d2 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:57:18.646053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:57:18.799596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f005f855f5c547688f0ea3a276b398f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb56e12b0adf49a29fd10b116d76df80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:18.818571 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b9e0a9e9-10ea-4d8f-a453-757c46893576 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 200 len: 1305 microversion: 2.1 time: 0.266826 Aug 09 14:57:18.821285 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2414/4827] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:18 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 1305 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:19.844275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed4b65c7-c06f-4e22-8e78-73ae38353073 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:19.844854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed4b65c7-c06f-4e22-8e78-73ae38353073 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] [instance: f446270d-87a1-4212-9171-a49584b351d2] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:19.867818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed4b65c7-c06f-4e22-8e78-73ae38353073 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:19.868749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed4b65c7-c06f-4e22-8e78-73ae38353073 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:19.869802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed4b65c7-c06f-4e22-8e78-73ae38353073 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:19.870863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed4b65c7-c06f-4e22-8e78-73ae38353073 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:19.871552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed4b65c7-c06f-4e22-8e78-73ae38353073 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:19.872136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed4b65c7-c06f-4e22-8e78-73ae38353073 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:19.931273 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-ed4b65c7-c06f-4e22-8e78-73ae38353073 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] HTTP exception thrown: Instance f446270d-87a1-4212-9171-a49584b351d2 could not be found. Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed4b65c7-c06f-4e22-8e78-73ae38353073 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Request method failure captured: Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 HTTP/1.1 Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nWkpYo2kSRRY6tdyadoB7jsWelftIvdguaZTv9wC47aez20fd2P62Pj-7uVZAYwH_2LGwDDeZEQmY6aeZuhTmjfrcB8kYbItCEk_WuauonHoacp-seH2QNho6Q5kAO8rsDNqnbW1Bf129Wv7HSKzXNhJfD94fv1fo-UvaGC5S5ebqg Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: fb56e12b0adf49a29fd10b116d76df80 Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestServerAdvancedOps-1387966862 Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fb56e12b0adf49a29fd10b116d76df80", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fb56e12b0adf49a29fd10b116d76df80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb56e12b0adf49a29fd10b116d76df80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fb56e12b0adf49a29fd10b116d76df80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestServerAdvancedOps-1387966862 Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: fb56e12b0adf49a29fd10b116d76df80 Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestServerAdvancedOps-1387966862 Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestServerAdvancedOps-1387966862-project Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f005f855f5c547688f0ea3a276b398f1 Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestServerAdvancedOps-1387966862-project Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance f446270d-87a1-4212-9171-a49584b351d2 could not be found. Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'f446270d-87a1-4212-9171-a49584b351d2'} Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f446270d-87a1-4212-9171-a49584b351d2 could not be found. Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f446270d-87a1-4212-9171-a49584b351d2 could not be found. Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:57:19.933316 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:19.937043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:57:19.937043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:57:19.937043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:57:19.937043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:57:19.937043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:57:19.937043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f446270d-87a1-4212-9171-a49584b351d2 could not be found. Aug 09 14:57:19.937043 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:57:19.937043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed4b65c7-c06f-4e22-8e78-73ae38353073 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] Returning 404 to user: Instance f446270d-87a1-4212-9171-a49584b351d2 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:57:19.937043 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed4b65c7-c06f-4e22-8e78-73ae38353073 tempest-TestServerAdvancedOps-1387966862 tempest-TestServerAdvancedOps-1387966862-project] 10.222.0.50 "GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2" status: 404 len: 111 microversion: 2.1 time: 0.096389 Aug 09 14:57:19.942204 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2414/4828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:19 2022] GET /compute/v2.1/servers/f446270d-87a1-4212-9171-a49584b351d2 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:57:21.424343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b65a4c6-3853-4412-8b0f-603624967be6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Action: 'create', calling method: .version_select at 0x7f41dd129310>, body: {"keypair": {"name": "tempest-keypair-1125897502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxCtxWX4mpjCKbigPExwZHg2waEZsBjTJ0AOUS+eN+EUiURI4OMZb136mKH4Gw3ueY+byIIsnnzEdKH9K3dTF52oSUbw4Bj3dYe7Fi5Ws00Ii8FlqWWeAp7DnWSwT35kw=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:57:21.477269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-0b65a4c6-3853-4412-8b0f-603624967be6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Getting quotas for project f63d01743846420d9f081b7f8b73c5d2. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:57:21.517433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-0b65a4c6-3853-4412-8b0f-603624967be6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Getting quotas for user 9b8154cdb1a64b4894811af2cea904cb and project f63d01743846420d9f081b7f8b73c5d2. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:57:21.639747 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b65a4c6-3853-4412-8b0f-603624967be6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.594949 Aug 09 14:57:21.644490 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2415/4829] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:57:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:57:26.621742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1416751124", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f58928e-b011-49a1-a149-3916a89eb6d7"}], "security_groups": [{"name": "tempest-securitygroup--1261949472"}], "key_name": "tempest-keypair-1125897502", "user_data": "}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:57:26.654495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:57:26.869022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] validate_networks() for [('5f58928e-b011-49a1-a149-3916a89eb6d7', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:57:28.035033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:57:28.036473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:57:28.037140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:57:28.037690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:57:28.038317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:57:28.068750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:28.071491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:28.072371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:28.076222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:28.077738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:28.078267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:28.139211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Getting quotas for project f63d01743846420d9f081b7f8b73c5d2. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:57:28.160724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Getting quotas for user 9b8154cdb1a64b4894811af2cea904cb and project f63d01743846420d9f081b7f8b73c5d2. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:57:28.200940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:57:28.207510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:57:28.317193 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d04bf7a6-0bf9-41ce-a2a0-9b47d044f011 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.701315 Aug 09 14:57:28.323290 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2415/4830] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:57:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:57:28.338541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf56a361-1058-46cc-a2c1-9487cdc78308 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:28.339251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf56a361-1058-46cc-a2c1-9487cdc78308 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:28.472678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bf56a361-1058-46cc-a2c1-9487cdc78308 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:28.483660 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf56a361-1058-46cc-a2c1-9487cdc78308 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1238 microversion: 2.1 time: 0.150673 Aug 09 14:57:28.498971 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2416/4831] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:28 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1238 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:29.506102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a64763f2-8163-4b4e-a771-85bc20c644e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:29.507229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a64763f2-8163-4b4e-a771-85bc20c644e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:29.532423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64763f2-8163-4b4e-a771-85bc20c644e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:29.532915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64763f2-8163-4b4e-a771-85bc20c644e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:29.533358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64763f2-8163-4b4e-a771-85bc20c644e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:29.534080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64763f2-8163-4b4e-a771-85bc20c644e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:29.534566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64763f2-8163-4b4e-a771-85bc20c644e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:29.534994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64763f2-8163-4b4e-a771-85bc20c644e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:29.558308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:57:29.784993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a64763f2-8163-4b4e-a771-85bc20c644e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:29.795967 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a64763f2-8163-4b4e-a771-85bc20c644e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1234 microversion: 2.1 time: 0.293720 Aug 09 14:57:29.812260 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2416/4832] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:29 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1234 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:30.822761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eef57a61-02ab-4ec1-bf0b-ab3be772b6f7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:30.825579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eef57a61-02ab-4ec1-bf0b-ab3be772b6f7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:30.832670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:57:30.846930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:57:30.855244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eef57a61-02ab-4ec1-bf0b-ab3be772b6f7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:30.858923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eef57a61-02ab-4ec1-bf0b-ab3be772b6f7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:30.862825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eef57a61-02ab-4ec1-bf0b-ab3be772b6f7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:30.863824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eef57a61-02ab-4ec1-bf0b-ab3be772b6f7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:30.864447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eef57a61-02ab-4ec1-bf0b-ab3be772b6f7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:30.866818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eef57a61-02ab-4ec1-bf0b-ab3be772b6f7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:31.103874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eef57a61-02ab-4ec1-bf0b-ab3be772b6f7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:31.114252 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eef57a61-02ab-4ec1-bf0b-ab3be772b6f7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1296 microversion: 2.1 time: 0.297523 Aug 09 14:57:31.132536 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2417/4833] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:30 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1296 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:32.139401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63ef7361-e7b0-48db-a1c0-2cfe8e567ed8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:32.140078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-63ef7361-e7b0-48db-a1c0-2cfe8e567ed8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:32.155811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63ef7361-e7b0-48db-a1c0-2cfe8e567ed8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:32.156448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63ef7361-e7b0-48db-a1c0-2cfe8e567ed8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:32.157091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63ef7361-e7b0-48db-a1c0-2cfe8e567ed8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:32.159221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63ef7361-e7b0-48db-a1c0-2cfe8e567ed8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:32.159910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63ef7361-e7b0-48db-a1c0-2cfe8e567ed8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:32.161160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63ef7361-e7b0-48db-a1c0-2cfe8e567ed8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:32.350168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-63ef7361-e7b0-48db-a1c0-2cfe8e567ed8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:32.380997 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63ef7361-e7b0-48db-a1c0-2cfe8e567ed8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1296 microversion: 2.1 time: 0.242031 Aug 09 14:57:32.383951 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2417/4834] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:32 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1296 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:33.420136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63e6578e-4d38-4b08-9bbb-0bee9f76d84d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:33.428091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63e6578e-4d38-4b08-9bbb-0bee9f76d84d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:33.491793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e6578e-4d38-4b08-9bbb-0bee9f76d84d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:33.493001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e6578e-4d38-4b08-9bbb-0bee9f76d84d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:33.503326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e6578e-4d38-4b08-9bbb-0bee9f76d84d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:33.509833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e6578e-4d38-4b08-9bbb-0bee9f76d84d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:33.519363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e6578e-4d38-4b08-9bbb-0bee9f76d84d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:33.524484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e6578e-4d38-4b08-9bbb-0bee9f76d84d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:34.444806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63e6578e-4d38-4b08-9bbb-0bee9f76d84d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:34.456859 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63e6578e-4d38-4b08-9bbb-0bee9f76d84d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1364 microversion: 2.1 time: 1.041727 Aug 09 14:57:34.474216 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2418/4835] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:33 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1364 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:35.480842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d00f3205-a33e-4747-b350-b40f2c95d803 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:35.481532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d00f3205-a33e-4747-b350-b40f2c95d803 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:35.498223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d00f3205-a33e-4747-b350-b40f2c95d803 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:35.500362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d00f3205-a33e-4747-b350-b40f2c95d803 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:35.501824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d00f3205-a33e-4747-b350-b40f2c95d803 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:35.503940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d00f3205-a33e-4747-b350-b40f2c95d803 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:35.507783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d00f3205-a33e-4747-b350-b40f2c95d803 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:35.508375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d00f3205-a33e-4747-b350-b40f2c95d803 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:36.782412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d00f3205-a33e-4747-b350-b40f2c95d803 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:36.794118 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d00f3205-a33e-4747-b350-b40f2c95d803 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1364 microversion: 2.1 time: 1.317418 Aug 09 14:57:36.815353 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2418/4836] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:35 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1364 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:36.998809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-3e9cd2b1-8d13-4d45-882e-2f32ba3dfd4b req-664a5fd4-377e-4470-8b5c-cb37042ba282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ec66f1-8b80-40ad-8cfe-95852fda1792", "tag": "77439503-b833-4326-891e-d1c12af8d4ef"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:57:37.020761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3e9cd2b1-8d13-4d45-882e-2f32ba3dfd4b req-664a5fd4-377e-4470-8b5c-cb37042ba282 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:37.021622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3e9cd2b1-8d13-4d45-882e-2f32ba3dfd4b req-664a5fd4-377e-4470-8b5c-cb37042ba282 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:37.024886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3e9cd2b1-8d13-4d45-882e-2f32ba3dfd4b req-664a5fd4-377e-4470-8b5c-cb37042ba282 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:37.063643 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3e9cd2b1-8d13-4d45-882e-2f32ba3dfd4b req-664a5fd4-377e-4470-8b5c-cb37042ba282 service nova] Creating event network-changed:77439503-b833-4326-891e-d1c12af8d4ef for instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 on n-h2-844626-8 Aug 09 14:57:37.077177 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-3e9cd2b1-8d13-4d45-882e-2f32ba3dfd4b req-664a5fd4-377e-4470-8b5c-cb37042ba282 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082019 Aug 09 14:57:37.082107 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2419/4837] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:57:37.819375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cdf7457c-ff19-4729-aa8a-febc5392a59c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:37.820083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cdf7457c-ff19-4729-aa8a-febc5392a59c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:37.837305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdf7457c-ff19-4729-aa8a-febc5392a59c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:37.837894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdf7457c-ff19-4729-aa8a-febc5392a59c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:37.848824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdf7457c-ff19-4729-aa8a-febc5392a59c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:37.851346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdf7457c-ff19-4729-aa8a-febc5392a59c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:37.857839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdf7457c-ff19-4729-aa8a-febc5392a59c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:37.859899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdf7457c-ff19-4729-aa8a-febc5392a59c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:38.111574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:57:38.184462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:57:38.493727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cdf7457c-ff19-4729-aa8a-febc5392a59c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:38.507481 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cdf7457c-ff19-4729-aa8a-febc5392a59c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1364 microversion: 2.1 time: 0.692261 Aug 09 14:57:38.508701 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2419/4838] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:37 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1364 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:39.543037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:57:39.548072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db4bfd44-49e3-4a7e-b14f-01c019f0318b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:39.549610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db4bfd44-49e3-4a7e-b14f-01c019f0318b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:39.580005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4bfd44-49e3-4a7e-b14f-01c019f0318b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:39.580536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4bfd44-49e3-4a7e-b14f-01c019f0318b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:39.580977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4bfd44-49e3-4a7e-b14f-01c019f0318b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:39.585562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4bfd44-49e3-4a7e-b14f-01c019f0318b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:39.587520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4bfd44-49e3-4a7e-b14f-01c019f0318b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:39.587965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db4bfd44-49e3-4a7e-b14f-01c019f0318b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:40.397920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-db4bfd44-49e3-4a7e-b14f-01c019f0318b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:40.408374 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db4bfd44-49e3-4a7e-b14f-01c019f0318b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1364 microversion: 2.1 time: 0.867703 Aug 09 14:57:40.415981 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2420/4839] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:39 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1364 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:41.429822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2725809e-ef47-4bf0-a1ec-bdc330ffbd69 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:41.430433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2725809e-ef47-4bf0-a1ec-bdc330ffbd69 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:41.442773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2725809e-ef47-4bf0-a1ec-bdc330ffbd69 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:41.444639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2725809e-ef47-4bf0-a1ec-bdc330ffbd69 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:41.445570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2725809e-ef47-4bf0-a1ec-bdc330ffbd69 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:41.446768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2725809e-ef47-4bf0-a1ec-bdc330ffbd69 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:41.450654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2725809e-ef47-4bf0-a1ec-bdc330ffbd69 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:41.471916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2725809e-ef47-4bf0-a1ec-bdc330ffbd69 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:42.485831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2725809e-ef47-4bf0-a1ec-bdc330ffbd69 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:42.495925 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2725809e-ef47-4bf0-a1ec-bdc330ffbd69 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1364 microversion: 2.1 time: 1.070045 Aug 09 14:57:42.499164 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2420/4840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:41 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1364 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:57:43.525851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-927a8c07-ff12-4323-ad81-1ec545257a27 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:43.526678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-927a8c07-ff12-4323-ad81-1ec545257a27 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:43.548861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-927a8c07-ff12-4323-ad81-1ec545257a27 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:43.553663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-927a8c07-ff12-4323-ad81-1ec545257a27 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:43.554749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-927a8c07-ff12-4323-ad81-1ec545257a27 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:43.560224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-927a8c07-ff12-4323-ad81-1ec545257a27 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:43.567962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-927a8c07-ff12-4323-ad81-1ec545257a27 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:43.570416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-927a8c07-ff12-4323-ad81-1ec545257a27 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:44.062689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-927a8c07-ff12-4323-ad81-1ec545257a27 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:44.075586 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-927a8c07-ff12-4323-ad81-1ec545257a27 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1364 microversion: 2.1 time: 0.561861 Aug 09 14:57:44.078920 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2421/4841] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:43 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1364 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:45.102960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c823aa9-c6d3-4834-862c-223dddd95f17 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:45.103782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c823aa9-c6d3-4834-862c-223dddd95f17 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:45.125909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c823aa9-c6d3-4834-862c-223dddd95f17 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:45.126403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c823aa9-c6d3-4834-862c-223dddd95f17 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:45.127249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c823aa9-c6d3-4834-862c-223dddd95f17 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:45.131124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c823aa9-c6d3-4834-862c-223dddd95f17 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:45.131856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c823aa9-c6d3-4834-862c-223dddd95f17 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:45.132297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c823aa9-c6d3-4834-862c-223dddd95f17 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:45.509245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5a09f0af-0935-4509-aa4b-e0c8e7d19da0 req-10b6e4f3-e7d0-4830-b39f-eda4b86f7e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ec66f1-8b80-40ad-8cfe-95852fda1792", "name": "network-vif-plugged", "status": "completed", "tag": "77439503-b833-4326-891e-d1c12af8d4ef"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:57:45.523417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5a09f0af-0935-4509-aa4b-e0c8e7d19da0 req-10b6e4f3-e7d0-4830-b39f-eda4b86f7e6b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:45.524174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5a09f0af-0935-4509-aa4b-e0c8e7d19da0 req-10b6e4f3-e7d0-4830-b39f-eda4b86f7e6b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:45.524758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5a09f0af-0935-4509-aa4b-e0c8e7d19da0 req-10b6e4f3-e7d0-4830-b39f-eda4b86f7e6b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:45.542422 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5a09f0af-0935-4509-aa4b-e0c8e7d19da0 req-10b6e4f3-e7d0-4830-b39f-eda4b86f7e6b service nova] Creating event network-vif-plugged:77439503-b833-4326-891e-d1c12af8d4ef for instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 on n-h2-844626-8 Aug 09 14:57:45.551259 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5a09f0af-0935-4509-aa4b-e0c8e7d19da0 req-10b6e4f3-e7d0-4830-b39f-eda4b86f7e6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.641475 Aug 09 14:57:45.552999 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2421/4842] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:57:45.875687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c823aa9-c6d3-4834-862c-223dddd95f17 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:45.890359 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c823aa9-c6d3-4834-862c-223dddd95f17 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1364 microversion: 2.1 time: 0.793594 Aug 09 14:57:45.894394 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2422/4843] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:45 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1364 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:46.916875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1a017d57-147b-46ad-af7a-a6ea14c99f5f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:46.918281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1a017d57-147b-46ad-af7a-a6ea14c99f5f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:46.932129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a017d57-147b-46ad-af7a-a6ea14c99f5f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:46.935767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a017d57-147b-46ad-af7a-a6ea14c99f5f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:46.936615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a017d57-147b-46ad-af7a-a6ea14c99f5f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:46.939738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a017d57-147b-46ad-af7a-a6ea14c99f5f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:46.940897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a017d57-147b-46ad-af7a-a6ea14c99f5f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:46.942260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a017d57-147b-46ad-af7a-a6ea14c99f5f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:47.459273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1a017d57-147b-46ad-af7a-a6ea14c99f5f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:47.493831 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1a017d57-147b-46ad-af7a-a6ea14c99f5f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1364 microversion: 2.1 time: 0.580157 Aug 09 14:57:47.495685 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2422/4844] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:46 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1364 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:57:48.524571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9872625b-5eff-466f-b944-f04c5a8147de tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:48.525982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9872625b-5eff-466f-b944-f04c5a8147de tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:48.552762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9872625b-5eff-466f-b944-f04c5a8147de tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:48.555912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9872625b-5eff-466f-b944-f04c5a8147de tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:48.556592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9872625b-5eff-466f-b944-f04c5a8147de tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:48.559524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9872625b-5eff-466f-b944-f04c5a8147de tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:48.562363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9872625b-5eff-466f-b944-f04c5a8147de tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:48.568592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9872625b-5eff-466f-b944-f04c5a8147de tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:49.657920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9872625b-5eff-466f-b944-f04c5a8147de tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:57:49.671321 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9872625b-5eff-466f-b944-f04c5a8147de tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1551 microversion: 2.1 time: 1.150176 Aug 09 14:57:49.671972 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2423/4845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:57:48 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1551 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:57:49.707377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-57ba709b-dc4e-48c7-8a7b-ae6b5b18af66 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:57:49.709921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-57ba709b-dc4e-48c7-8a7b-ae6b5b18af66 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:57:49.719339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57ba709b-dc4e-48c7-8a7b-ae6b5b18af66 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:49.720179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57ba709b-dc4e-48c7-8a7b-ae6b5b18af66 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:49.720859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57ba709b-dc4e-48c7-8a7b-ae6b5b18af66 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:49.721811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57ba709b-dc4e-48c7-8a7b-ae6b5b18af66 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:49.728442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57ba709b-dc4e-48c7-8a7b-ae6b5b18af66 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:49.729852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57ba709b-dc4e-48c7-8a7b-ae6b5b18af66 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:50.138078 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-57ba709b-dc4e-48c7-8a7b-ae6b5b18af66 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.447791 Aug 09 14:57:50.139174 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2423/4846] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:57:49 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/os-interface => generated 285 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:57:54.645146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-03737f6b-8828-4554-95fc-3c746c17e106 req-a91e0722-5c37-475b-ab1a-08f21a979baa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ec66f1-8b80-40ad-8cfe-95852fda1792", "tag": "77439503-b833-4326-891e-d1c12af8d4ef"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:57:54.681701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-03737f6b-8828-4554-95fc-3c746c17e106 req-a91e0722-5c37-475b-ab1a-08f21a979baa service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:57:54.682725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-03737f6b-8828-4554-95fc-3c746c17e106 req-a91e0722-5c37-475b-ab1a-08f21a979baa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:57:54.683826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-03737f6b-8828-4554-95fc-3c746c17e106 req-a91e0722-5c37-475b-ab1a-08f21a979baa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:57:54.713600 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-03737f6b-8828-4554-95fc-3c746c17e106 req-a91e0722-5c37-475b-ab1a-08f21a979baa service nova] Creating event network-changed:77439503-b833-4326-891e-d1c12af8d4ef for instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 on n-h2-844626-8 Aug 09 14:57:54.730367 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-03737f6b-8828-4554-95fc-3c746c17e106 req-a91e0722-5c37-475b-ab1a-08f21a979baa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091841 Aug 09 14:57:54.732083 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2424/4847] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:02.407797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-890451523", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:02.432010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:02.432717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=41 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:02.576331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:58:03.545742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:58:03.546368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:58:03.551675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:58:03.552659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:58:03.553417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:58:03.585380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:03.589696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:03.590368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:03.593130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:03.595439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:03.598530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:03.648267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Getting quotas for project c9dbe96af304479eae264d98a6a4abcb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:58:03.665070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Getting quotas for user 9b462e4f2c2148bba8ee8c069d7a2533 and project c9dbe96af304479eae264d98a6a4abcb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:58:03.703893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:58:03.709856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:58:03.807666 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-720e84c0-3c10-4242-a5a9-746767c690bf tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.404112 Aug 09 14:58:03.809216 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2424/4848] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 14:58:03.820978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2d42e625-1c46-4783-b5f1-2d54dc91c1c7 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:03.821834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2d42e625-1c46-4783-b5f1-2d54dc91c1c7 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:03.833818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=16 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:03.968152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2d42e625-1c46-4783-b5f1-2d54dc91c1c7 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:03.975678 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2d42e625-1c46-4783-b5f1-2d54dc91c1c7 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1214 microversion: 2.1 time: 0.159179 Aug 09 14:58:03.983275 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2425/4849] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:03 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1214 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:05.013319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a81916a-d310-4642-b695-87f411e7441b tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:05.013965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a81916a-d310-4642-b695-87f411e7441b tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:05.054852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a81916a-d310-4642-b695-87f411e7441b tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:05.059578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a81916a-d310-4642-b695-87f411e7441b tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:05.060422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a81916a-d310-4642-b695-87f411e7441b tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:05.069984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a81916a-d310-4642-b695-87f411e7441b tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:05.070802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a81916a-d310-4642-b695-87f411e7441b tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:05.071454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a81916a-d310-4642-b695-87f411e7441b tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:05.360225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2a81916a-d310-4642-b695-87f411e7441b tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:05.369203 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a81916a-d310-4642-b695-87f411e7441b tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1218 microversion: 2.1 time: 0.372212 Aug 09 14:58:05.384898 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2425/4850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:04 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1218 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:06.395296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-16d838bc-ea9f-4eab-9667-e812ad803702 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:06.396326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-16d838bc-ea9f-4eab-9667-e812ad803702 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:06.422663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=40 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:06.426212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16d838bc-ea9f-4eab-9667-e812ad803702 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:06.426914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16d838bc-ea9f-4eab-9667-e812ad803702 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:06.431738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16d838bc-ea9f-4eab-9667-e812ad803702 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:06.432721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16d838bc-ea9f-4eab-9667-e812ad803702 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:06.433421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16d838bc-ea9f-4eab-9667-e812ad803702 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:06.433991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16d838bc-ea9f-4eab-9667-e812ad803702 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:06.583745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-16d838bc-ea9f-4eab-9667-e812ad803702 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:06.601717 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-16d838bc-ea9f-4eab-9667-e812ad803702 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1272 microversion: 2.1 time: 0.212046 Aug 09 14:58:06.604071 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2426/4851] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:06 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:07.629030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0faf630-b056-4917-9736-63b99e03bd58 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:07.629803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0faf630-b056-4917-9736-63b99e03bd58 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:07.641453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0faf630-b056-4917-9736-63b99e03bd58 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:07.641862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0faf630-b056-4917-9736-63b99e03bd58 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:07.642626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0faf630-b056-4917-9736-63b99e03bd58 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:07.647601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0faf630-b056-4917-9736-63b99e03bd58 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:07.648533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0faf630-b056-4917-9736-63b99e03bd58 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:07.649091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0faf630-b056-4917-9736-63b99e03bd58 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:08.210593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c0faf630-b056-4917-9736-63b99e03bd58 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:08.233793 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0faf630-b056-4917-9736-63b99e03bd58 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1314 microversion: 2.1 time: 0.609408 Aug 09 14:58:08.251817 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2426/4852] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:07 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:09.258167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-854bcd55-a855-43e2-a9b0-14f11bca41ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:09.258827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-854bcd55-a855-43e2-a9b0-14f11bca41ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:09.281926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-854bcd55-a855-43e2-a9b0-14f11bca41ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:09.282902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-854bcd55-a855-43e2-a9b0-14f11bca41ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:09.283616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-854bcd55-a855-43e2-a9b0-14f11bca41ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:09.285310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-854bcd55-a855-43e2-a9b0-14f11bca41ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:09.289564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-854bcd55-a855-43e2-a9b0-14f11bca41ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:09.299118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-854bcd55-a855-43e2-a9b0-14f11bca41ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:09.854682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-854bcd55-a855-43e2-a9b0-14f11bca41ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:09.866338 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-854bcd55-a855-43e2-a9b0-14f11bca41ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1314 microversion: 2.1 time: 0.611831 Aug 09 14:58:09.869722 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2427/4853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:09 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1314 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:10.389828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-940b98fc-8835-47ec-8cca-4327b9657d0c req-da29be9c-2670-4e29-9967-6eab27ad2c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ff4ca8-b6b0-4748-a19c-5bfb752a45f1", "tag": "325df046-13d1-494e-b60f-d81f144a6e18"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:10.409963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-940b98fc-8835-47ec-8cca-4327b9657d0c req-da29be9c-2670-4e29-9967-6eab27ad2c73 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:10.410445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-940b98fc-8835-47ec-8cca-4327b9657d0c req-da29be9c-2670-4e29-9967-6eab27ad2c73 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:10.410874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-940b98fc-8835-47ec-8cca-4327b9657d0c req-da29be9c-2670-4e29-9967-6eab27ad2c73 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:10.444407 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-940b98fc-8835-47ec-8cca-4327b9657d0c req-da29be9c-2670-4e29-9967-6eab27ad2c73 service nova] Creating event network-changed:325df046-13d1-494e-b60f-d81f144a6e18 for instance 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 on n-h1-844626-8 Aug 09 14:58:10.449902 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-940b98fc-8835-47ec-8cca-4327b9657d0c req-da29be9c-2670-4e29-9967-6eab27ad2c73 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.537666 Aug 09 14:58:10.450996 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2427/4854] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:10.902924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bd17c93e-5f41-4c3d-9927-ac4cf920b2ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:10.903907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bd17c93e-5f41-4c3d-9927-ac4cf920b2ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:10.913234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd17c93e-5f41-4c3d-9927-ac4cf920b2ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:10.914037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd17c93e-5f41-4c3d-9927-ac4cf920b2ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:10.914765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd17c93e-5f41-4c3d-9927-ac4cf920b2ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:10.915967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd17c93e-5f41-4c3d-9927-ac4cf920b2ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:10.916792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd17c93e-5f41-4c3d-9927-ac4cf920b2ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:10.917607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd17c93e-5f41-4c3d-9927-ac4cf920b2ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:11.633333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bd17c93e-5f41-4c3d-9927-ac4cf920b2ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:11.648318 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bd17c93e-5f41-4c3d-9927-ac4cf920b2ff tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1314 microversion: 2.1 time: 0.755246 Aug 09 14:58:11.651431 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2428/4855] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:10 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:58:12.674901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-235926da-98ea-469f-8874-52765155c000 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:12.676482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-235926da-98ea-469f-8874-52765155c000 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:12.690071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235926da-98ea-469f-8874-52765155c000 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:12.690715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235926da-98ea-469f-8874-52765155c000 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:12.693502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235926da-98ea-469f-8874-52765155c000 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:12.694765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235926da-98ea-469f-8874-52765155c000 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:12.696043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235926da-98ea-469f-8874-52765155c000 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:12.698452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235926da-98ea-469f-8874-52765155c000 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:12.922114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c257e0ef-dd89-463a-8715-fb2ac3f10351 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'create', calling method: .version_select at 0x7f41dcb66ee0>, body: {"keypair": {"name": "tempest-keypair-1527002213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMloxxaBthytkvyf36CYzZ9w83hlgA9l/epzhPJNpbVkYBO0HQEGK6/E+/Kp6mcDg3v+9zMHYOXeLX/1o0DM/kx4lcQm1RBlA81C+WjM1SA0Zp3Ypia1SpVvKJlfy+RL1A=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:12.990739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c257e0ef-dd89-463a-8715-fb2ac3f10351 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Getting quotas for project 891029e759ac441f8a08c38bca92be81. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:58:13.011535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c257e0ef-dd89-463a-8715-fb2ac3f10351 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Getting quotas for user 3da785ddf56e4b028c6647643d97c952 and project 891029e759ac441f8a08c38bca92be81. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:58:13.067280 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c257e0ef-dd89-463a-8715-fb2ac3f10351 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.778230 Aug 09 14:58:13.068224 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2428/4856] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 14:58:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:13.242933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-235926da-98ea-469f-8874-52765155c000 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:13.253864 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-235926da-98ea-469f-8874-52765155c000 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1314 microversion: 2.1 time: 0.587978 Aug 09 14:58:13.254464 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2429/4857] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:12 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:58:14.280976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f10fb042-5091-40df-bf58-292edff33113 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:14.281785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f10fb042-5091-40df-bf58-292edff33113 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:14.285263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:14.304117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10fb042-5091-40df-bf58-292edff33113 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:14.305223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10fb042-5091-40df-bf58-292edff33113 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:14.306665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10fb042-5091-40df-bf58-292edff33113 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:14.307631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10fb042-5091-40df-bf58-292edff33113 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:14.308103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10fb042-5091-40df-bf58-292edff33113 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:14.308607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10fb042-5091-40df-bf58-292edff33113 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:15.107941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f10fb042-5091-40df-bf58-292edff33113 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:15.120600 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f10fb042-5091-40df-bf58-292edff33113 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1314 microversion: 2.1 time: 0.845212 Aug 09 14:58:15.138049 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2429/4858] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:14 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1314 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:16.142418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee171289-d7ac-4022-a147-e52a22ad9cb0 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:16.143045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee171289-d7ac-4022-a147-e52a22ad9cb0 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:16.155277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:16.158985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee171289-d7ac-4022-a147-e52a22ad9cb0 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:16.159979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee171289-d7ac-4022-a147-e52a22ad9cb0 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:16.162089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee171289-d7ac-4022-a147-e52a22ad9cb0 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:16.165410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee171289-d7ac-4022-a147-e52a22ad9cb0 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:16.166386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee171289-d7ac-4022-a147-e52a22ad9cb0 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:16.168157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee171289-d7ac-4022-a147-e52a22ad9cb0 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:16.690552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2a09054-3147-4793-933d-e6bbbf26e75b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018-project-admin] Calling method '.version_select at 0x7f41dd59ce50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:16.691639 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 14:58:16.691639 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 14:58:16.693303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a09054-3147-4793-933d-e6bbbf26e75b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:16.693946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a09054-3147-4793-933d-e6bbbf26e75b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:16.694508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a09054-3147-4793-933d-e6bbbf26e75b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:16.721151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a09054-3147-4793-933d-e6bbbf26e75b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:16.722496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a09054-3147-4793-933d-e6bbbf26e75b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:16.723565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a09054-3147-4793-933d-e6bbbf26e75b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:16.775593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a09054-3147-4793-933d-e6bbbf26e75b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:16.777043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a09054-3147-4793-933d-e6bbbf26e75b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:16.779691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a09054-3147-4793-933d-e6bbbf26e75b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:16.797578 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2a09054-3147-4793-933d-e6bbbf26e75b tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1804419018-project-admin] 10.222.0.50 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.528648 Aug 09 14:58:16.798572 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2430/4859] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 14:58:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:16.962108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1122004017", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aac61d64-db55-4d08-906a-2788d0f45a74"}], "security_groups": [{"name": "tempest-securitygroup--976078494"}], "key_name": "tempest-keypair-1527002213", "user_data": "}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:17.323378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] validate_networks() for [('aac61d64-db55-4d08-906a-2788d0f45a74', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:58:17.354238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ee171289-d7ac-4022-a147-e52a22ad9cb0 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:17.369661 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee171289-d7ac-4022-a147-e52a22ad9cb0 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1314 microversion: 2.1 time: 1.230898 Aug 09 14:58:17.372677 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2430/4860] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:16 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1314 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:18.392644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec219e38-053d-4dc5-8e38-a7a25899c776 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:18.393245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ec219e38-053d-4dc5-8e38-a7a25899c776 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:18.407172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec219e38-053d-4dc5-8e38-a7a25899c776 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:18.408410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec219e38-053d-4dc5-8e38-a7a25899c776 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:18.415854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec219e38-053d-4dc5-8e38-a7a25899c776 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:18.416974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec219e38-053d-4dc5-8e38-a7a25899c776 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:18.417608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec219e38-053d-4dc5-8e38-a7a25899c776 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:18.418305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec219e38-053d-4dc5-8e38-a7a25899c776 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:18.628902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:58:18.630118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:58:18.630796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:58:18.631734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:58:18.632911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:58:18.656187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:18.657234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:18.657833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:18.658729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:18.659363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:18.661266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:18.693134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Getting quotas for project 891029e759ac441f8a08c38bca92be81. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:58:18.709806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Getting quotas for user 3da785ddf56e4b028c6647643d97c952 and project 891029e759ac441f8a08c38bca92be81. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:58:18.732018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:58:18.736653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:58:18.782016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ec219e38-053d-4dc5-8e38-a7a25899c776 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:18.794355 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec219e38-053d-4dc5-8e38-a7a25899c776 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1314 microversion: 2.1 time: 0.406337 Aug 09 14:58:18.800062 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2431/4861] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:18 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:58:18.869686 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1a0dc1ea-84c3-4c61-abf0-b2a61e0dfa33 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.912954 Aug 09 14:58:18.884257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e576367-0ce3-4351-b3bd-688bfe554870 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:18.884868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5e576367-0ce3-4351-b3bd-688bfe554870 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:18.894798 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2431/4862] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:58:16 2022] POST /compute/v2.1/servers => generated 408 bytes in 1937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:58:19.155930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2c1c0fdf-0609-4d75-a663-66de85180196 req-8da93224-a6c3-4373-bdc6-12acf1224059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ff4ca8-b6b0-4748-a19c-5bfb752a45f1", "name": "network-vif-plugged", "status": "completed", "tag": "325df046-13d1-494e-b60f-d81f144a6e18"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:19.173583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2c1c0fdf-0609-4d75-a663-66de85180196 req-8da93224-a6c3-4373-bdc6-12acf1224059 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:19.173887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2c1c0fdf-0609-4d75-a663-66de85180196 req-8da93224-a6c3-4373-bdc6-12acf1224059 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:19.174335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2c1c0fdf-0609-4d75-a663-66de85180196 req-8da93224-a6c3-4373-bdc6-12acf1224059 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:19.208880 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2c1c0fdf-0609-4d75-a663-66de85180196 req-8da93224-a6c3-4373-bdc6-12acf1224059 service nova] Creating event network-vif-plugged:325df046-13d1-494e-b60f-d81f144a6e18 for instance 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 on n-h1-844626-8 Aug 09 14:58:19.215418 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2c1c0fdf-0609-4d75-a663-66de85180196 req-8da93224-a6c3-4373-bdc6-12acf1224059 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064007 Aug 09 14:58:19.216832 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2432/4863] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:19.292178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5e576367-0ce3-4351-b3bd-688bfe554870 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:19.317805 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5e576367-0ce3-4351-b3bd-688bfe554870 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1239 microversion: 2.1 time: 0.438436 Aug 09 14:58:19.329077 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2432/4864] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:18 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1239 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:19.833269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb5e5012-67d3-4e2a-8611-202376eceed2 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:19.833269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb5e5012-67d3-4e2a-8611-202376eceed2 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:19.855695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb5e5012-67d3-4e2a-8611-202376eceed2 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:19.857323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb5e5012-67d3-4e2a-8611-202376eceed2 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:19.858116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb5e5012-67d3-4e2a-8611-202376eceed2 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:19.859344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb5e5012-67d3-4e2a-8611-202376eceed2 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:19.860117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb5e5012-67d3-4e2a-8611-202376eceed2 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:19.861652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb5e5012-67d3-4e2a-8611-202376eceed2 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:20.284656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fb5e5012-67d3-4e2a-8611-202376eceed2 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:20.293120 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb5e5012-67d3-4e2a-8611-202376eceed2 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1314 microversion: 2.1 time: 0.475245 Aug 09 14:58:20.294360 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2433/4865] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:19 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:20.348256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-147543b8-0b96-40fc-aeb4-d58bdf330e45 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:20.350089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-147543b8-0b96-40fc-aeb4-d58bdf330e45 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:20.362045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147543b8-0b96-40fc-aeb4-d58bdf330e45 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:20.362757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147543b8-0b96-40fc-aeb4-d58bdf330e45 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:20.363379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147543b8-0b96-40fc-aeb4-d58bdf330e45 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:20.364272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147543b8-0b96-40fc-aeb4-d58bdf330e45 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:20.364734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147543b8-0b96-40fc-aeb4-d58bdf330e45 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:20.365214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-147543b8-0b96-40fc-aeb4-d58bdf330e45 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:20.491024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-147543b8-0b96-40fc-aeb4-d58bdf330e45 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:20.505397 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-147543b8-0b96-40fc-aeb4-d58bdf330e45 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1291 microversion: 2.1 time: 0.160922 Aug 09 14:58:20.506019 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2433/4866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:20 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1291 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:21.317105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-83656a48-4e62-4ca2-be74-5dbbe85d5077 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:21.317869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-83656a48-4e62-4ca2-be74-5dbbe85d5077 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:21.334416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83656a48-4e62-4ca2-be74-5dbbe85d5077 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:21.337188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83656a48-4e62-4ca2-be74-5dbbe85d5077 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:21.337380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83656a48-4e62-4ca2-be74-5dbbe85d5077 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:21.339843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83656a48-4e62-4ca2-be74-5dbbe85d5077 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:21.340329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83656a48-4e62-4ca2-be74-5dbbe85d5077 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:21.341963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83656a48-4e62-4ca2-be74-5dbbe85d5077 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:21.532411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f44dfa02-5db2-4c88-aa23-f0b5beed4701 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:21.534387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f44dfa02-5db2-4c88-aa23-f0b5beed4701 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:21.550143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f44dfa02-5db2-4c88-aa23-f0b5beed4701 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:21.552298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f44dfa02-5db2-4c88-aa23-f0b5beed4701 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:21.552849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f44dfa02-5db2-4c88-aa23-f0b5beed4701 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:21.553830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f44dfa02-5db2-4c88-aa23-f0b5beed4701 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:21.554503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f44dfa02-5db2-4c88-aa23-f0b5beed4701 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:21.555284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f44dfa02-5db2-4c88-aa23-f0b5beed4701 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:21.694914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f44dfa02-5db2-4c88-aa23-f0b5beed4701 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:21.717175 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f44dfa02-5db2-4c88-aa23-f0b5beed4701 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1297 microversion: 2.1 time: 0.189298 Aug 09 14:58:21.741177 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2434/4867] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:21 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1297 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:58:21.742649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-83656a48-4e62-4ca2-be74-5dbbe85d5077 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:21.750901 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-83656a48-4e62-4ca2-be74-5dbbe85d5077 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1464 microversion: 2.1 time: 0.440544 Aug 09 14:58:21.751540 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2434/4868] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:21 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1464 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:21.807356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e40ad0ce-486b-4522-a325-dd109f7d863d tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:21.808284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e40ad0ce-486b-4522-a325-dd109f7d863d tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:21.823172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e40ad0ce-486b-4522-a325-dd109f7d863d tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:21.834952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e40ad0ce-486b-4522-a325-dd109f7d863d tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:21.834952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e40ad0ce-486b-4522-a325-dd109f7d863d tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:21.834952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e40ad0ce-486b-4522-a325-dd109f7d863d tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:21.834952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e40ad0ce-486b-4522-a325-dd109f7d863d tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:21.834952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e40ad0ce-486b-4522-a325-dd109f7d863d tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:21.895321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e40ad0ce-486b-4522-a325-dd109f7d863d tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:58:22.148610 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e40ad0ce-486b-4522-a325-dd109f7d863d tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "DELETE /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 204 len: 0 microversion: 2.1 time: 0.344487 Aug 09 14:58:22.151705 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2435/4869] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:58:21 2022] DELETE /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:58:22.164620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fbf16f56-369d-4610-8400-b35192f4eecd tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:22.165405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fbf16f56-369d-4610-8400-b35192f4eecd tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:22.172681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbf16f56-369d-4610-8400-b35192f4eecd tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:22.173165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbf16f56-369d-4610-8400-b35192f4eecd tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:22.173591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbf16f56-369d-4610-8400-b35192f4eecd tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:22.174290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbf16f56-369d-4610-8400-b35192f4eecd tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:22.174755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbf16f56-369d-4610-8400-b35192f4eecd tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:22.175388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fbf16f56-369d-4610-8400-b35192f4eecd tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:22.508126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1387174954", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "d331077f-30ba-46ff-a1f3-ae0d6b30278c"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:22.591244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] validate_networks() for [('d331077f-30ba-46ff-a1f3-ae0d6b30278c', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 14:58:22.607940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fbf16f56-369d-4610-8400-b35192f4eecd tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:22.622625 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fbf16f56-369d-4610-8400-b35192f4eecd tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1470 microversion: 2.1 time: 0.466485 Aug 09 14:58:22.625251 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2435/4870] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:22 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1470 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:22.740120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0fad02aa-8634-4f6b-a815-7a0652d6c463 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:22.741139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0fad02aa-8634-4f6b-a815-7a0652d6c463 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:22.749039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fad02aa-8634-4f6b-a815-7a0652d6c463 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:22.756892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fad02aa-8634-4f6b-a815-7a0652d6c463 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:22.758545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fad02aa-8634-4f6b-a815-7a0652d6c463 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:22.758545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fad02aa-8634-4f6b-a815-7a0652d6c463 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:22.759006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fad02aa-8634-4f6b-a815-7a0652d6c463 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:22.759544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fad02aa-8634-4f6b-a815-7a0652d6c463 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:22.915122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0fad02aa-8634-4f6b-a815-7a0652d6c463 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:22.929334 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0fad02aa-8634-4f6b-a815-7a0652d6c463 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1297 microversion: 2.1 time: 0.189965 Aug 09 14:58:22.930391 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2436/4871] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:22 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1297 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:23.650344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-edac017a-e051-434e-b1ba-d7eaf328b918 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:23.652311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-edac017a-e051-434e-b1ba-d7eaf328b918 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:23.660125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edac017a-e051-434e-b1ba-d7eaf328b918 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:23.660605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edac017a-e051-434e-b1ba-d7eaf328b918 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:23.661421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edac017a-e051-434e-b1ba-d7eaf328b918 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:23.662316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edac017a-e051-434e-b1ba-d7eaf328b918 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:23.662857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edac017a-e051-434e-b1ba-d7eaf328b918 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:23.663275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edac017a-e051-434e-b1ba-d7eaf328b918 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:24.011254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 14:58:24.011728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 14:58:24.012623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-edac017a-e051-434e-b1ba-d7eaf328b918 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:24.013641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 14:58:24.014781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 14:58:24.015385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 14:58:24.025712 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-edac017a-e051-434e-b1ba-d7eaf328b918 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1470 microversion: 2.1 time: 0.380514 Aug 09 14:58:24.030388 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2437/4872] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:23 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1470 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:58:24.031234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:24.032713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:24.032883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:24.033895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:24.034352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:24.035233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:24.051365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-999c3d85-c063-425e-b602-b12050607428 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:24.051912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-999c3d85-c063-425e-b602-b12050607428 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:24.064654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-999c3d85-c063-425e-b602-b12050607428 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:24.065487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Getting quotas for project c382ee52720344179434ee5a70eaef6d. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 14:58:24.067830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-999c3d85-c063-425e-b602-b12050607428 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:24.068297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-999c3d85-c063-425e-b602-b12050607428 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:24.070096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-999c3d85-c063-425e-b602-b12050607428 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:24.071736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-999c3d85-c063-425e-b602-b12050607428 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:24.073878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-999c3d85-c063-425e-b602-b12050607428 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:24.079787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Getting quotas for user 8c3698cc439f4ba2a316210c01b8713c and project c382ee52720344179434ee5a70eaef6d. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 14:58:24.108319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 14:58:24.112006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 14:58:24.209617 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c703952-5fbd-4f56-8b05-17c476c29460 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.941362 Aug 09 14:58:24.212244 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2436/4873] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 14:58:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 14:58:24.224317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f61a94f-7e50-4cab-bd1a-6f907f7c13a9 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:24.225676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f61a94f-7e50-4cab-bd1a-6f907f7c13a9 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:24.346301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f61a94f-7e50-4cab-bd1a-6f907f7c13a9 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:24.385912 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f61a94f-7e50-4cab-bd1a-6f907f7c13a9 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1214 microversion: 2.1 time: 0.166066 Aug 09 14:58:24.388331 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2437/4874] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:24 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:58:24.402566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-999c3d85-c063-425e-b602-b12050607428 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:24.416286 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-999c3d85-c063-425e-b602-b12050607428 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1364 microversion: 2.1 time: 0.375876 Aug 09 14:58:24.416905 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2438/4875] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:24 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1364 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:24.555015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b46bf39d-87fe-40b2-a22c-3c49f42ef531 req-5f407f2e-ff2f-4914-9ef6-46b20088d099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ff4ca8-b6b0-4748-a19c-5bfb752a45f1", "name": "network-vif-deleted", "tag": "325df046-13d1-494e-b60f-d81f144a6e18"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:24.593631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b46bf39d-87fe-40b2-a22c-3c49f42ef531 req-5f407f2e-ff2f-4914-9ef6-46b20088d099 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:24.595749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b46bf39d-87fe-40b2-a22c-3c49f42ef531 req-5f407f2e-ff2f-4914-9ef6-46b20088d099 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:24.596375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b46bf39d-87fe-40b2-a22c-3c49f42ef531 req-5f407f2e-ff2f-4914-9ef6-46b20088d099 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:24.612746 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b46bf39d-87fe-40b2-a22c-3c49f42ef531 req-5f407f2e-ff2f-4914-9ef6-46b20088d099 service nova] Creating event network-vif-deleted:325df046-13d1-494e-b60f-d81f144a6e18 for instance 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 on n-h1-844626-8 Aug 09 14:58:24.619853 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b46bf39d-87fe-40b2-a22c-3c49f42ef531 req-5f407f2e-ff2f-4914-9ef6-46b20088d099 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070798 Aug 09 14:58:24.621333 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2438/4876] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:24.972965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-d08fdf9e-6ebf-4792-af23-50f402f650e1 req-3683abd8-520a-4612-b06e-ea7444629b70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a67196-2e15-47e5-8877-e75e8d4609c7", "tag": "d15f67e8-ba7f-4681-bd12-a57303ad56da"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:25.002906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d08fdf9e-6ebf-4792-af23-50f402f650e1 req-3683abd8-520a-4612-b06e-ea7444629b70 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:25.015531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d08fdf9e-6ebf-4792-af23-50f402f650e1 req-3683abd8-520a-4612-b06e-ea7444629b70 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:25.016326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d08fdf9e-6ebf-4792-af23-50f402f650e1 req-3683abd8-520a-4612-b06e-ea7444629b70 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:25.054422 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d08fdf9e-6ebf-4792-af23-50f402f650e1 req-3683abd8-520a-4612-b06e-ea7444629b70 service nova] Creating event network-changed:d15f67e8-ba7f-4681-bd12-a57303ad56da for instance f6a67196-2e15-47e5-8877-e75e8d4609c7 on n-h2-844626-8 Aug 09 14:58:25.057070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:25.058895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:25.067422 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-d08fdf9e-6ebf-4792-af23-50f402f650e1 req-3683abd8-520a-4612-b06e-ea7444629b70 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098396 Aug 09 14:58:25.068517 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2439/4877] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:25.083667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:25.084284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:25.084739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:25.093884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:25.094427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:25.094883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:25.165256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:25.166098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:25.166689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:25.167664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lazy-loading 'fault' on Instance uuid 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 14:58:25.271984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b462e4f2c2148bba8ee8c069d7a2533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dbe96af304479eae264d98a6a4abcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:25.281692 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-76207211-e457-4aa0-af72-cc2b0b794021 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 200 len: 1304 microversion: 2.1 time: 0.229760 Aug 09 14:58:25.285028 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2439/4878] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:25 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 1304 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:58:25.408311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21cde49f-d9e6-4fe3-9a4f-9859812b1c0f tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:25.409120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-21cde49f-d9e6-4fe3-9a4f-9859812b1c0f tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:25.421113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21cde49f-d9e6-4fe3-9a4f-9859812b1c0f tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:25.424046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21cde49f-d9e6-4fe3-9a4f-9859812b1c0f tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:25.424560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21cde49f-d9e6-4fe3-9a4f-9859812b1c0f tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:25.425286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21cde49f-d9e6-4fe3-9a4f-9859812b1c0f tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:25.428375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21cde49f-d9e6-4fe3-9a4f-9859812b1c0f tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:25.430465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21cde49f-d9e6-4fe3-9a4f-9859812b1c0f tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:25.438546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d11c0886-aaea-4436-8ffc-1a1f6bdee08a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:25.438889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d11c0886-aaea-4436-8ffc-1a1f6bdee08a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:25.449104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d11c0886-aaea-4436-8ffc-1a1f6bdee08a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:25.449606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d11c0886-aaea-4436-8ffc-1a1f6bdee08a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:25.450081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d11c0886-aaea-4436-8ffc-1a1f6bdee08a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:25.450832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d11c0886-aaea-4436-8ffc-1a1f6bdee08a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:25.451327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d11c0886-aaea-4436-8ffc-1a1f6bdee08a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:25.459843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d11c0886-aaea-4436-8ffc-1a1f6bdee08a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:25.565791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-21cde49f-d9e6-4fe3-9a4f-9859812b1c0f tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:25.576119 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-21cde49f-d9e6-4fe3-9a4f-9859812b1c0f tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1210 microversion: 2.1 time: 0.172915 Aug 09 14:58:25.576759 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2440/4879] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:25 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1210 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:25.737538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d11c0886-aaea-4436-8ffc-1a1f6bdee08a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:25.749375 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d11c0886-aaea-4436-8ffc-1a1f6bdee08a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1364 microversion: 2.1 time: 0.315746 Aug 09 14:58:25.750625 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2440/4880] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:25 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1364 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:58:26.308302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4699c0ba-5956-4ef4-97fd-14acef02b5f3 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:26.308922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4699c0ba-5956-4ef4-97fd-14acef02b5f3 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] [instance: 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:26.324357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4699c0ba-5956-4ef4-97fd-14acef02b5f3 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:26.325144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4699c0ba-5956-4ef4-97fd-14acef02b5f3 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:26.325757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4699c0ba-5956-4ef4-97fd-14acef02b5f3 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:26.326651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4699c0ba-5956-4ef4-97fd-14acef02b5f3 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:26.327301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4699c0ba-5956-4ef4-97fd-14acef02b5f3 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:26.327898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4699c0ba-5956-4ef4-97fd-14acef02b5f3 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:26.343843 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-4699c0ba-5956-4ef4-97fd-14acef02b5f3 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] HTTP exception thrown: Instance 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 could not be found. Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4699c0ba-5956-4ef4-97fd-14acef02b5f3 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Request method failure captured: Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 HTTP/1.1 Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nX2DKxe_D861eQPqdaOGXbG5Ka72avrx0aQfe61Gm584zO_fi-eEe9Rofl5W7nQSoQBDtHYB0gqDvkrGFusl02U_Sthmx961z2KaATgKUusd4HnTBV0RPYn2XUjlikZObWrTmeWfXk482tFI9fHB-ibwOzazVF2S_lkWeWHHWORQ1Q Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: c9dbe96af304479eae264d98a6a4abcb Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesNegativeTest-885579578 Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c9dbe96af304479eae264d98a6a4abcb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c9dbe96af304479eae264d98a6a4abcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c9dbe96af304479eae264d98a6a4abcb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c9dbe96af304479eae264d98a6a4abcb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-VolumesNegativeTest-885579578 Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: c9dbe96af304479eae264d98a6a4abcb Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesNegativeTest-885579578 Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-VolumesNegativeTest-885579578-project Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 9b462e4f2c2148bba8ee8c069d7a2533 Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-VolumesNegativeTest-885579578-project Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 could not be found. Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '37ff4ca8-b6b0-4748-a19c-5bfb752a45f1'} Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 could not be found. Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 could not be found. Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:58:26.345845 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:58:26.350448 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:58:26.350448 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:58:26.350448 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:58:26.350448 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:58:26.350448 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:58:26.350448 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 could not be found. Aug 09 14:58:26.350448 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 14:58:26.351990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4699c0ba-5956-4ef4-97fd-14acef02b5f3 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] Returning 404 to user: Instance 37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:58:26.353057 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4699c0ba-5956-4ef4-97fd-14acef02b5f3 tempest-VolumesNegativeTest-885579578 tempest-VolumesNegativeTest-885579578-project] 10.222.0.50 "GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1" status: 404 len: 111 microversion: 2.1 time: 0.048748 Aug 09 14:58:26.354194 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2441/4881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:26 2022] GET /compute/v2.1/servers/37ff4ca8-b6b0-4748-a19c-5bfb752a45f1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 14:58:26.602846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8db87b65-43bf-4585-81c3-317e5db0d8e6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:26.653247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8db87b65-43bf-4585-81c3-317e5db0d8e6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:26.679353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8db87b65-43bf-4585-81c3-317e5db0d8e6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:26.680754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8db87b65-43bf-4585-81c3-317e5db0d8e6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:26.681597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8db87b65-43bf-4585-81c3-317e5db0d8e6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:26.682742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8db87b65-43bf-4585-81c3-317e5db0d8e6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:26.686090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8db87b65-43bf-4585-81c3-317e5db0d8e6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:26.686859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8db87b65-43bf-4585-81c3-317e5db0d8e6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:26.737339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f7ea31a5-884a-4d28-b32f-f5bfe6b3d02a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:26.738149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7ea31a5-884a-4d28-b32f-f5bfe6b3d02a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:26.748063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7ea31a5-884a-4d28-b32f-f5bfe6b3d02a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:26.748780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7ea31a5-884a-4d28-b32f-f5bfe6b3d02a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:26.749392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7ea31a5-884a-4d28-b32f-f5bfe6b3d02a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:26.750268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7ea31a5-884a-4d28-b32f-f5bfe6b3d02a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:26.750888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7ea31a5-884a-4d28-b32f-f5bfe6b3d02a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:26.751485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7ea31a5-884a-4d28-b32f-f5bfe6b3d02a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:26.831905 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f7ea31a5-884a-4d28-b32f-f5bfe6b3d02a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/ips" status: 200 len: 145 microversion: 2.1 time: 0.106208 Aug 09 14:58:26.844244 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2442/4882] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 14:58:26 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/ips => generated 145 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:26.852399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d502ec31-2c11-465a-a0f7-3f68b8622474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:26.860035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d502ec31-2c11-465a-a0f7-3f68b8622474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:26.879658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d502ec31-2c11-465a-a0f7-3f68b8622474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:26.880412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d502ec31-2c11-465a-a0f7-3f68b8622474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:26.881009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d502ec31-2c11-465a-a0f7-3f68b8622474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:26.881981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d502ec31-2c11-465a-a0f7-3f68b8622474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:26.882597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d502ec31-2c11-465a-a0f7-3f68b8622474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:26.883291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d502ec31-2c11-465a-a0f7-3f68b8622474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:27.085662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8db87b65-43bf-4585-81c3-317e5db0d8e6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:27.116076 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8db87b65-43bf-4585-81c3-317e5db0d8e6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1272 microversion: 2.1 time: 0.522640 Aug 09 14:58:27.118140 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2441/4883] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:26 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1272 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:58:27.321333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d502ec31-2c11-465a-a0f7-3f68b8622474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:27.338169 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d502ec31-2c11-465a-a0f7-3f68b8622474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1364 microversion: 2.1 time: 0.491652 Aug 09 14:58:27.339515 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2443/4884] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:26 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1364 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:28.144136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1340ea23-63ad-4785-ae87-8764500b8127 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:28.145307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1340ea23-63ad-4785-ae87-8764500b8127 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:28.156689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1340ea23-63ad-4785-ae87-8764500b8127 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:28.157600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1340ea23-63ad-4785-ae87-8764500b8127 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:28.162761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1340ea23-63ad-4785-ae87-8764500b8127 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:28.163863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1340ea23-63ad-4785-ae87-8764500b8127 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:28.164598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1340ea23-63ad-4785-ae87-8764500b8127 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:28.165199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1340ea23-63ad-4785-ae87-8764500b8127 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:28.362732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b5ab9211-bbd2-4c57-9d1b-0a1f2e59d474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:28.363379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b5ab9211-bbd2-4c57-9d1b-0a1f2e59d474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:28.385578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ab9211-bbd2-4c57-9d1b-0a1f2e59d474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:28.387397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ab9211-bbd2-4c57-9d1b-0a1f2e59d474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:28.388075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ab9211-bbd2-4c57-9d1b-0a1f2e59d474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:28.389177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ab9211-bbd2-4c57-9d1b-0a1f2e59d474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:28.391342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ab9211-bbd2-4c57-9d1b-0a1f2e59d474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:28.392594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ab9211-bbd2-4c57-9d1b-0a1f2e59d474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:28.576107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1340ea23-63ad-4785-ae87-8764500b8127 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:28.586273 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1340ea23-63ad-4785-ae87-8764500b8127 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1314 microversion: 2.1 time: 0.446287 Aug 09 14:58:28.586887 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2442/4885] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:28 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:28.681435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:28.712099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b5ab9211-bbd2-4c57-9d1b-0a1f2e59d474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:28.722212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=16 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:28.731643 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b5ab9211-bbd2-4c57-9d1b-0a1f2e59d474 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1364 microversion: 2.1 time: 0.373793 Aug 09 14:58:28.735594 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2444/4886] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:28 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1364 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:29.607615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1043ba4e-d769-4033-8fcd-df16805f48bb tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:29.608772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1043ba4e-d769-4033-8fcd-df16805f48bb tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:29.621753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1043ba4e-d769-4033-8fcd-df16805f48bb tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:29.622437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1043ba4e-d769-4033-8fcd-df16805f48bb tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:29.625684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1043ba4e-d769-4033-8fcd-df16805f48bb tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:29.628344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1043ba4e-d769-4033-8fcd-df16805f48bb tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:29.630126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1043ba4e-d769-4033-8fcd-df16805f48bb tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:29.632650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1043ba4e-d769-4033-8fcd-df16805f48bb tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:29.722765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-dd2f4b35-648d-4e6c-9e38-81530ef9ec2e req-5e802344-58a4-4591-b31f-8d03870e6b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad5d93e-33bb-4fdd-bda3-a5bef867153f", "tag": "32dcf88f-9ef5-452b-a4b0-75ec73a5a314"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:29.757681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dd2f4b35-648d-4e6c-9e38-81530ef9ec2e req-5e802344-58a4-4591-b31f-8d03870e6b84 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:29.758994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dd2f4b35-648d-4e6c-9e38-81530ef9ec2e req-5e802344-58a4-4591-b31f-8d03870e6b84 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:29.760604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dd2f4b35-648d-4e6c-9e38-81530ef9ec2e req-5e802344-58a4-4591-b31f-8d03870e6b84 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:29.810869 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-dd2f4b35-648d-4e6c-9e38-81530ef9ec2e req-5e802344-58a4-4591-b31f-8d03870e6b84 service nova] Creating event network-changed:32dcf88f-9ef5-452b-a4b0-75ec73a5a314 for instance 2ad5d93e-33bb-4fdd-bda3-a5bef867153f on n-h1-844626-8 Aug 09 14:58:29.826289 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-dd2f4b35-648d-4e6c-9e38-81530ef9ec2e req-5e802344-58a4-4591-b31f-8d03870e6b84 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105998 Aug 09 14:58:29.827958 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2445/4887] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:58:29.849347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2a69be7-b3fa-421c-9a0e-7c0822dbcf56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:29.851618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b2a69be7-b3fa-421c-9a0e-7c0822dbcf56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:29.869020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2a69be7-b3fa-421c-9a0e-7c0822dbcf56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:29.869295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2a69be7-b3fa-421c-9a0e-7c0822dbcf56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:29.869741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2a69be7-b3fa-421c-9a0e-7c0822dbcf56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:29.870483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2a69be7-b3fa-421c-9a0e-7c0822dbcf56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:29.874002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2a69be7-b3fa-421c-9a0e-7c0822dbcf56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:29.875125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2a69be7-b3fa-421c-9a0e-7c0822dbcf56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:29.914476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:30.005128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1043ba4e-d769-4033-8fcd-df16805f48bb tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:30.009428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:30.014534 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1043ba4e-d769-4033-8fcd-df16805f48bb tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1314 microversion: 2.1 time: 0.411804 Aug 09 14:58:30.020236 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2443/4888] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:29 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:30.145972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2a69be7-b3fa-421c-9a0e-7c0822dbcf56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:30.183235 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2a69be7-b3fa-421c-9a0e-7c0822dbcf56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1364 microversion: 2.1 time: 0.351851 Aug 09 14:58:30.185253 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2446/4889] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:29 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1364 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:30.674800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d2bd0c1d-64c4-4b55-bee6-ab0178c7f432 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a648f87-9874-4018-af3a-79495bea63be"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:30.681477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d2bd0c1d-64c4-4b55-bee6-ab0178c7f432 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:30.707028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2bd0c1d-64c4-4b55-bee6-ab0178c7f432 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:30.708882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2bd0c1d-64c4-4b55-bee6-ab0178c7f432 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:30.716493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2bd0c1d-64c4-4b55-bee6-ab0178c7f432 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:30.717498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2bd0c1d-64c4-4b55-bee6-ab0178c7f432 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:30.718145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2bd0c1d-64c4-4b55-bee6-ab0178c7f432 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:30.718740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2bd0c1d-64c4-4b55-bee6-ab0178c7f432 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:31.036194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-720043fe-586f-4463-9463-0de23175aac7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:31.036987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-720043fe-586f-4463-9463-0de23175aac7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:31.048934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720043fe-586f-4463-9463-0de23175aac7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:31.050303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720043fe-586f-4463-9463-0de23175aac7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:31.050786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720043fe-586f-4463-9463-0de23175aac7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:31.052406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720043fe-586f-4463-9463-0de23175aac7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:31.053254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720043fe-586f-4463-9463-0de23175aac7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:31.058861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-720043fe-586f-4463-9463-0de23175aac7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:31.303150 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d2bd0c1d-64c4-4b55-bee6-ab0178c7f432 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "POST /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637086 Aug 09 14:58:31.304026 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2444/4890] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 14:58:30 2022] POST /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/os-volume_attachments => generated 194 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 14:58:31.343883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b7f812b9-a680-4dad-b923-091b9197fce9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:31.346219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b7f812b9-a680-4dad-b923-091b9197fce9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:31.351162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-720043fe-586f-4463-9463-0de23175aac7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:31.360520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7f812b9-a680-4dad-b923-091b9197fce9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:31.361410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7f812b9-a680-4dad-b923-091b9197fce9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:31.365407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7f812b9-a680-4dad-b923-091b9197fce9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:31.366341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7f812b9-a680-4dad-b923-091b9197fce9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:31.366958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7f812b9-a680-4dad-b923-091b9197fce9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:31.369874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7f812b9-a680-4dad-b923-091b9197fce9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:31.389484 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-720043fe-586f-4463-9463-0de23175aac7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1314 microversion: 2.1 time: 0.350136 Aug 09 14:58:31.402676 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2447/4891] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:31 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:31.402676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0ad70211-e2f6-4478-ace9-f921d1c41db0 req-3a0f1d2c-cbb6-4cdb-8279-aac6458d8627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a67196-2e15-47e5-8877-e75e8d4609c7", "name": "network-vif-plugged", "status": "completed", "tag": "d15f67e8-ba7f-4681-bd12-a57303ad56da"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:31.412324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0ad70211-e2f6-4478-ace9-f921d1c41db0 req-3a0f1d2c-cbb6-4cdb-8279-aac6458d8627 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:31.412803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0ad70211-e2f6-4478-ace9-f921d1c41db0 req-3a0f1d2c-cbb6-4cdb-8279-aac6458d8627 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:31.413231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0ad70211-e2f6-4478-ace9-f921d1c41db0 req-3a0f1d2c-cbb6-4cdb-8279-aac6458d8627 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:31.436939 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0ad70211-e2f6-4478-ace9-f921d1c41db0 req-3a0f1d2c-cbb6-4cdb-8279-aac6458d8627 service nova] Creating event network-vif-plugged:d15f67e8-ba7f-4681-bd12-a57303ad56da for instance f6a67196-2e15-47e5-8877-e75e8d4609c7 on n-h2-844626-8 Aug 09 14:58:31.437395 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0ad70211-e2f6-4478-ace9-f921d1c41db0 req-3a0f1d2c-cbb6-4cdb-8279-aac6458d8627 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043144 Aug 09 14:58:31.438172 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2448/4892] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:31.704962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b7f812b9-a680-4dad-b923-091b9197fce9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:31.719995 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b7f812b9-a680-4dad-b923-091b9197fce9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1364 microversion: 2.1 time: 0.386441 Aug 09 14:58:31.723954 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2445/4893] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:31 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1364 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:32.412151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-127df0f6-3526-43b1-b207-22b524b01411 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:32.413520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-127df0f6-3526-43b1-b207-22b524b01411 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:32.430065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-127df0f6-3526-43b1-b207-22b524b01411 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:32.430835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-127df0f6-3526-43b1-b207-22b524b01411 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:32.431704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-127df0f6-3526-43b1-b207-22b524b01411 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:32.432586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-127df0f6-3526-43b1-b207-22b524b01411 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:32.433212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-127df0f6-3526-43b1-b207-22b524b01411 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:32.433785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-127df0f6-3526-43b1-b207-22b524b01411 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:32.747122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40dcd4da-d419-4f4c-94d9-5b738ca9e293 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:32.748346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40dcd4da-d419-4f4c-94d9-5b738ca9e293 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:32.764191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40dcd4da-d419-4f4c-94d9-5b738ca9e293 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:32.782520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40dcd4da-d419-4f4c-94d9-5b738ca9e293 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:32.784985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40dcd4da-d419-4f4c-94d9-5b738ca9e293 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:32.792513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40dcd4da-d419-4f4c-94d9-5b738ca9e293 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:32.796595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40dcd4da-d419-4f4c-94d9-5b738ca9e293 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:32.797389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40dcd4da-d419-4f4c-94d9-5b738ca9e293 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:33.039181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-127df0f6-3526-43b1-b207-22b524b01411 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:33.050924 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-127df0f6-3526-43b1-b207-22b524b01411 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1314 microversion: 2.1 time: 0.644677 Aug 09 14:58:33.055599 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2449/4894] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:32 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:33.245283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-40dcd4da-d419-4f4c-94d9-5b738ca9e293 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:33.269902 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40dcd4da-d419-4f4c-94d9-5b738ca9e293 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1364 microversion: 2.1 time: 0.519816 Aug 09 14:58:33.270879 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2446/4895] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:32 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1364 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:34.074562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0e86a47-738e-4f91-8d66-f6b020037113 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:34.075273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0e86a47-738e-4f91-8d66-f6b020037113 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:34.094586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:34.096344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e86a47-738e-4f91-8d66-f6b020037113 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:34.096849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e86a47-738e-4f91-8d66-f6b020037113 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:34.097835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e86a47-738e-4f91-8d66-f6b020037113 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:34.098585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e86a47-738e-4f91-8d66-f6b020037113 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:34.099046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e86a47-738e-4f91-8d66-f6b020037113 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:34.099540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0e86a47-738e-4f91-8d66-f6b020037113 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:34.291624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-844ce5ca-4631-4718-99aa-42d94ca6bd6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:34.292904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-844ce5ca-4631-4718-99aa-42d94ca6bd6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:34.324128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:34.330350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:34.332331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-844ce5ca-4631-4718-99aa-42d94ca6bd6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:34.333016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-844ce5ca-4631-4718-99aa-42d94ca6bd6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:34.347924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-844ce5ca-4631-4718-99aa-42d94ca6bd6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:34.348951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-844ce5ca-4631-4718-99aa-42d94ca6bd6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:34.349611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-844ce5ca-4631-4718-99aa-42d94ca6bd6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:34.350191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-844ce5ca-4631-4718-99aa-42d94ca6bd6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:34.382844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0e86a47-738e-4f91-8d66-f6b020037113 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:34.401477 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0e86a47-738e-4f91-8d66-f6b020037113 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1314 microversion: 2.1 time: 0.330773 Aug 09 14:58:34.402355 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2450/4896] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:34 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:34.422549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=10 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:58:35.177437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-844ce5ca-4631-4718-99aa-42d94ca6bd6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:35.187057 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-844ce5ca-4631-4718-99aa-42d94ca6bd6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1547 microversion: 2.1 time: 0.899496 Aug 09 14:58:35.188101 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2447/4897] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:34 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1547 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:58:35.210686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8fe01109-6abc-4b00-a94f-9c3fb533e118 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:35.211278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8fe01109-6abc-4b00-a94f-9c3fb533e118 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:35.225451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe01109-6abc-4b00-a94f-9c3fb533e118 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:35.227378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe01109-6abc-4b00-a94f-9c3fb533e118 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:35.227860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe01109-6abc-4b00-a94f-9c3fb533e118 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:35.230482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe01109-6abc-4b00-a94f-9c3fb533e118 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:35.231241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe01109-6abc-4b00-a94f-9c3fb533e118 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:35.231711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fe01109-6abc-4b00-a94f-9c3fb533e118 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:35.422096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8ec87b71-1eaf-4158-8476-c26b8569e4f6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:35.422742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8ec87b71-1eaf-4158-8476-c26b8569e4f6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:35.435602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ec87b71-1eaf-4158-8476-c26b8569e4f6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:35.436104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ec87b71-1eaf-4158-8476-c26b8569e4f6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:35.439172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ec87b71-1eaf-4158-8476-c26b8569e4f6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:35.439954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ec87b71-1eaf-4158-8476-c26b8569e4f6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:35.440431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ec87b71-1eaf-4158-8476-c26b8569e4f6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:35.440864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ec87b71-1eaf-4158-8476-c26b8569e4f6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:36.582690 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8fe01109-6abc-4b00-a94f-9c3fb533e118 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.377265 Aug 09 14:58:36.584263 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2451/4898] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 14:58:35 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/os-interface => generated 284 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:36.767632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8ec87b71-1eaf-4158-8476-c26b8569e4f6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:36.782965 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8ec87b71-1eaf-4158-8476-c26b8569e4f6 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1314 microversion: 2.1 time: 1.364884 Aug 09 14:58:36.797911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2448/4899] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:35 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1314 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:37.852921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07d56ddb-20e4-47b0-b375-0facc36c79b7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:37.867116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07d56ddb-20e4-47b0-b375-0facc36c79b7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:37.883146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07d56ddb-20e4-47b0-b375-0facc36c79b7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:37.890332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07d56ddb-20e4-47b0-b375-0facc36c79b7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:37.892202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07d56ddb-20e4-47b0-b375-0facc36c79b7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:37.893516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07d56ddb-20e4-47b0-b375-0facc36c79b7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:37.901005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07d56ddb-20e4-47b0-b375-0facc36c79b7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:37.903559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07d56ddb-20e4-47b0-b375-0facc36c79b7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:38.494091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07d56ddb-20e4-47b0-b375-0facc36c79b7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:38.506239 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07d56ddb-20e4-47b0-b375-0facc36c79b7 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1314 microversion: 2.1 time: 0.683910 Aug 09 14:58:38.508899 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2452/4900] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:37 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:39.227792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-dc1f932c-4e35-4085-9c73-93838c4810dc req-a90ae599-5391-4c43-a24c-831649467fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad5d93e-33bb-4fdd-bda3-a5bef867153f", "name": "network-vif-plugged", "status": "completed", "tag": "32dcf88f-9ef5-452b-a4b0-75ec73a5a314"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:39.282952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dc1f932c-4e35-4085-9c73-93838c4810dc req-a90ae599-5391-4c43-a24c-831649467fb0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:39.284622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dc1f932c-4e35-4085-9c73-93838c4810dc req-a90ae599-5391-4c43-a24c-831649467fb0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:39.287316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dc1f932c-4e35-4085-9c73-93838c4810dc req-a90ae599-5391-4c43-a24c-831649467fb0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:39.328698 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-dc1f932c-4e35-4085-9c73-93838c4810dc req-a90ae599-5391-4c43-a24c-831649467fb0 service nova] Creating event network-vif-plugged:32dcf88f-9ef5-452b-a4b0-75ec73a5a314 for instance 2ad5d93e-33bb-4fdd-bda3-a5bef867153f on n-h1-844626-8 Aug 09 14:58:39.345874 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-dc1f932c-4e35-4085-9c73-93838c4810dc req-a90ae599-5391-4c43-a24c-831649467fb0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122816 Aug 09 14:58:39.348784 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2449/4901] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:39.530575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-88ebe389-10ed-4241-8da1-1f5a0b1b7597 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:39.531987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-88ebe389-10ed-4241-8da1-1f5a0b1b7597 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:39.543324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88ebe389-10ed-4241-8da1-1f5a0b1b7597 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:39.547795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88ebe389-10ed-4241-8da1-1f5a0b1b7597 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:39.553260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88ebe389-10ed-4241-8da1-1f5a0b1b7597 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:39.554281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88ebe389-10ed-4241-8da1-1f5a0b1b7597 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:39.554962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88ebe389-10ed-4241-8da1-1f5a0b1b7597 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:39.555643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88ebe389-10ed-4241-8da1-1f5a0b1b7597 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:40.571057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b84f19bb-c760-45f7-972d-5b3c0284cbda req-946feef9-55c5-447a-9f1d-a6eae766fa24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6a67196-2e15-47e5-8877-e75e8d4609c7", "tag": "d15f67e8-ba7f-4681-bd12-a57303ad56da"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:40.588589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-88ebe389-10ed-4241-8da1-1f5a0b1b7597 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:40.621280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b84f19bb-c760-45f7-972d-5b3c0284cbda req-946feef9-55c5-447a-9f1d-a6eae766fa24 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:40.626708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b84f19bb-c760-45f7-972d-5b3c0284cbda req-946feef9-55c5-447a-9f1d-a6eae766fa24 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:40.628152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b84f19bb-c760-45f7-972d-5b3c0284cbda req-946feef9-55c5-447a-9f1d-a6eae766fa24 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:40.634489 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-88ebe389-10ed-4241-8da1-1f5a0b1b7597 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1314 microversion: 2.1 time: 1.108235 Aug 09 14:58:40.653262 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2453/4902] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:39 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1314 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:40.664315 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b84f19bb-c760-45f7-972d-5b3c0284cbda req-946feef9-55c5-447a-9f1d-a6eae766fa24 service nova] Creating event network-changed:d15f67e8-ba7f-4681-bd12-a57303ad56da for instance f6a67196-2e15-47e5-8877-e75e8d4609c7 on n-h2-844626-8 Aug 09 14:58:40.682959 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b84f19bb-c760-45f7-972d-5b3c0284cbda req-946feef9-55c5-447a-9f1d-a6eae766fa24 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118819 Aug 09 14:58:40.690057 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2450/4903] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:41.660929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34b421be-bc20-423b-a4b9-ab5cd6eadb27 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:41.665126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34b421be-bc20-423b-a4b9-ab5cd6eadb27 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:41.697362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34b421be-bc20-423b-a4b9-ab5cd6eadb27 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:41.700521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34b421be-bc20-423b-a4b9-ab5cd6eadb27 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:41.702313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34b421be-bc20-423b-a4b9-ab5cd6eadb27 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:41.705297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34b421be-bc20-423b-a4b9-ab5cd6eadb27 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:41.711945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34b421be-bc20-423b-a4b9-ab5cd6eadb27 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:41.712658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34b421be-bc20-423b-a4b9-ab5cd6eadb27 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:42.519042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-34b421be-bc20-423b-a4b9-ab5cd6eadb27 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:42.532034 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34b421be-bc20-423b-a4b9-ab5cd6eadb27 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1497 microversion: 2.1 time: 0.879349 Aug 09 14:58:42.548530 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2454/4904] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:41 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1497 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:47.659068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-54de834b-a741-4190-9379-cdd0f9b45a55 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:47.659717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-54de834b-a741-4190-9379-cdd0f9b45a55 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:47.672540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54de834b-a741-4190-9379-cdd0f9b45a55 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:47.677722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54de834b-a741-4190-9379-cdd0f9b45a55 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:47.679596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54de834b-a741-4190-9379-cdd0f9b45a55 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:47.680453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54de834b-a741-4190-9379-cdd0f9b45a55 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:47.683688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54de834b-a741-4190-9379-cdd0f9b45a55 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:47.684335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-54de834b-a741-4190-9379-cdd0f9b45a55 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:47.734666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-54de834b-a741-4190-9379-cdd0f9b45a55 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 14:58:47.879649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ffa382e-d62a-4f7e-ab62-475840730466 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:47.885298 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-54de834b-a741-4190-9379-cdd0f9b45a55 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 204 len: 0 microversion: 2.1 time: 0.231310 Aug 09 14:58:47.886521 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2451/4905] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 14:58:47 2022] DELETE /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 14:58:47.895710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a47afc68-7463-422a-a455-cd8c5985dee2 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:47.896572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a47afc68-7463-422a-a455-cd8c5985dee2 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:47.900649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ffa382e-d62a-4f7e-ab62-475840730466 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:47.901134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ffa382e-d62a-4f7e-ab62-475840730466 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:47.901762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ffa382e-d62a-4f7e-ab62-475840730466 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:47.912987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a47afc68-7463-422a-a455-cd8c5985dee2 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:47.915743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a47afc68-7463-422a-a455-cd8c5985dee2 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:47.916358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a47afc68-7463-422a-a455-cd8c5985dee2 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:47.917086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a47afc68-7463-422a-a455-cd8c5985dee2 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:47.917561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a47afc68-7463-422a-a455-cd8c5985dee2 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:47.917931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a47afc68-7463-422a-a455-cd8c5985dee2 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:47.955505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9ffa382e-d62a-4f7e-ab62-475840730466 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Going to try to stop instance {{(pid=119407) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 14:58:48.061910 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ffa382e-d62a-4f7e-ab62-475840730466 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "POST /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/action" status: 202 len: 0 microversion: 2.1 time: 0.186546 Aug 09 14:58:48.063207 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2455/4906] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:58:47 2022] POST /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:58:48.071635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c9b20c31-4096-4c20-a086-726dd5b3547e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:48.075875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c9b20c31-4096-4c20-a086-726dd5b3547e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:48.101506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b20c31-4096-4c20-a086-726dd5b3547e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:48.102261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b20c31-4096-4c20-a086-726dd5b3547e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:48.102905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b20c31-4096-4c20-a086-726dd5b3547e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:48.103838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b20c31-4096-4c20-a086-726dd5b3547e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:48.104480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b20c31-4096-4c20-a086-726dd5b3547e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:48.108143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b20c31-4096-4c20-a086-726dd5b3547e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:48.628210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a47afc68-7463-422a-a455-cd8c5985dee2 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:48.644375 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a47afc68-7463-422a-a455-cd8c5985dee2 tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1503 microversion: 2.1 time: 0.753340 Aug 09 14:58:48.670153 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2452/4907] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:47 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1503 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:48.710971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c9b20c31-4096-4c20-a086-726dd5b3547e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:48.723614 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c9b20c31-4096-4c20-a086-726dd5b3547e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.655149 Aug 09 14:58:48.738537 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2456/4908] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:48 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:58:49.669466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9eea3f7-d1b2-47b6-ad0a-6843d936651c tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:49.670088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9eea3f7-d1b2-47b6-ad0a-6843d936651c tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:49.678247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9eea3f7-d1b2-47b6-ad0a-6843d936651c tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:49.679796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9eea3f7-d1b2-47b6-ad0a-6843d936651c tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:49.681636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9eea3f7-d1b2-47b6-ad0a-6843d936651c tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:49.685823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9eea3f7-d1b2-47b6-ad0a-6843d936651c tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:49.686660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9eea3f7-d1b2-47b6-ad0a-6843d936651c tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:49.688871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9eea3f7-d1b2-47b6-ad0a-6843d936651c tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:49.745810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1e968640-aad4-4c07-b02d-7d4824267372 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:49.746512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1e968640-aad4-4c07-b02d-7d4824267372 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:49.759198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e968640-aad4-4c07-b02d-7d4824267372 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:49.768529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e968640-aad4-4c07-b02d-7d4824267372 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:49.768987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e968640-aad4-4c07-b02d-7d4824267372 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:49.770606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e968640-aad4-4c07-b02d-7d4824267372 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:49.770606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e968640-aad4-4c07-b02d-7d4824267372 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:49.770606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e968640-aad4-4c07-b02d-7d4824267372 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:50.540762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9eea3f7-d1b2-47b6-ad0a-6843d936651c tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c3698cc439f4ba2a316210c01b8713c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c382ee52720344179434ee5a70eaef6d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:50.551980 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9eea3f7-d1b2-47b6-ad0a-6843d936651c tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 200 len: 1503 microversion: 2.1 time: 0.887261 Aug 09 14:58:50.566012 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2453/4909] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:49 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 1503 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:50.566012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-4e1a9dd6-1e96-420f-ac57-4e86498ab98a req-1d92c70f-8446-4ade-9c59-e6049467b0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad5d93e-33bb-4fdd-bda3-a5bef867153f", "name": "network-vif-deleted", "tag": "32dcf88f-9ef5-452b-a4b0-75ec73a5a314"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:58:50.593726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4e1a9dd6-1e96-420f-ac57-4e86498ab98a req-1d92c70f-8446-4ade-9c59-e6049467b0b0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:50.594207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4e1a9dd6-1e96-420f-ac57-4e86498ab98a req-1d92c70f-8446-4ade-9c59-e6049467b0b0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:50.595117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4e1a9dd6-1e96-420f-ac57-4e86498ab98a req-1d92c70f-8446-4ade-9c59-e6049467b0b0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:50.619404 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4e1a9dd6-1e96-420f-ac57-4e86498ab98a req-1d92c70f-8446-4ade-9c59-e6049467b0b0 service nova] Creating event network-vif-deleted:32dcf88f-9ef5-452b-a4b0-75ec73a5a314 for instance 2ad5d93e-33bb-4fdd-bda3-a5bef867153f on n-h1-844626-8 Aug 09 14:58:50.626418 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-4e1a9dd6-1e96-420f-ac57-4e86498ab98a req-1d92c70f-8446-4ade-9c59-e6049467b0b0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067878 Aug 09 14:58:50.627047 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2454/4910] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:58:50.677265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e968640-aad4-4c07-b02d-7d4824267372 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:50.688931 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1e968640-aad4-4c07-b02d-7d4824267372 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.946915 Aug 09 14:58:50.697779 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2457/4911] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:49 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 14:58:51.579825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4054db75-94cd-4001-9dd8-a2426713342d tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:51.580615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4054db75-94cd-4001-9dd8-a2426713342d tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] [instance: 2ad5d93e-33bb-4fdd-bda3-a5bef867153f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:51.594661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4054db75-94cd-4001-9dd8-a2426713342d tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:51.595943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4054db75-94cd-4001-9dd8-a2426713342d tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:51.598312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4054db75-94cd-4001-9dd8-a2426713342d tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:51.599951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4054db75-94cd-4001-9dd8-a2426713342d tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:51.600999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4054db75-94cd-4001-9dd8-a2426713342d tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:51.603228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4054db75-94cd-4001-9dd8-a2426713342d tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:51.633518 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4054db75-94cd-4001-9dd8-a2426713342d tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] HTTP exception thrown: Instance 2ad5d93e-33bb-4fdd-bda3-a5bef867153f could not be found. Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4054db75-94cd-4001-9dd8-a2426713342d tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Request method failure captured: Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f HTTP/1.1 Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nYKTWJjC0TYYdlitH8-uiTGXSVNF2RmYMXXJcBT7aLlt5GX_oOVAWPXOeg8ws1PCtn1T1GbendI3L31vjtgJcPvP8rvqu3CThjuHl6RiOPCnW0yrG4V-dGeu5FBNqw9QSd8fqqXWCqMyJBplepW0XQ4oxHbEcLvcxLoLQ743-d5BUE Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: c382ee52720344179434ee5a70eaef6d Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesActionsTest-111034876 Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c382ee52720344179434ee5a70eaef6d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c382ee52720344179434ee5a70eaef6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c382ee52720344179434ee5a70eaef6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c382ee52720344179434ee5a70eaef6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-VolumesActionsTest-111034876 Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: c382ee52720344179434ee5a70eaef6d Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesActionsTest-111034876 Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-VolumesActionsTest-111034876-project Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 8c3698cc439f4ba2a316210c01b8713c Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-VolumesActionsTest-111034876-project Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 2ad5d93e-33bb-4fdd-bda3-a5bef867153f could not be found. Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '2ad5d93e-33bb-4fdd-bda3-a5bef867153f'} Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad5d93e-33bb-4fdd-bda3-a5bef867153f could not be found. Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad5d93e-33bb-4fdd-bda3-a5bef867153f could not be found. Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 14:58:51.636298 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:58:51.641062 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 14:58:51.641062 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 14:58:51.641062 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 14:58:51.641062 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 14:58:51.641062 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 14:58:51.641062 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad5d93e-33bb-4fdd-bda3-a5bef867153f could not be found. Aug 09 14:58:51.641062 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 14:58:51.643567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4054db75-94cd-4001-9dd8-a2426713342d tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] Returning 404 to user: Instance 2ad5d93e-33bb-4fdd-bda3-a5bef867153f could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 14:58:51.644667 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4054db75-94cd-4001-9dd8-a2426713342d tempest-VolumesActionsTest-111034876 tempest-VolumesActionsTest-111034876-project] 10.222.0.50 "GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f" status: 404 len: 111 microversion: 2.1 time: 0.074868 Aug 09 14:58:51.645297 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2455/4912] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:51 2022] GET /compute/v2.1/servers/2ad5d93e-33bb-4fdd-bda3-a5bef867153f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 14:58:51.710886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cf4fc28c-c0ec-4727-b669-074772400c89 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:51.711621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cf4fc28c-c0ec-4727-b669-074772400c89 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:51.719470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf4fc28c-c0ec-4727-b669-074772400c89 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:51.720075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf4fc28c-c0ec-4727-b669-074772400c89 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:51.720719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf4fc28c-c0ec-4727-b669-074772400c89 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:51.722039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf4fc28c-c0ec-4727-b669-074772400c89 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:51.722680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf4fc28c-c0ec-4727-b669-074772400c89 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:51.723356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cf4fc28c-c0ec-4727-b669-074772400c89 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:51.939281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cf4fc28c-c0ec-4727-b669-074772400c89 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:51.953844 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cf4fc28c-c0ec-4727-b669-074772400c89 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.246783 Aug 09 14:58:51.957804 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2458/4913] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:51 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:52.977231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5ec0554-b4cd-4c18-9461-5dd6b6bcf3b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:52.977894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c5ec0554-b4cd-4c18-9461-5dd6b6bcf3b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:52.994610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5ec0554-b4cd-4c18-9461-5dd6b6bcf3b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:52.996451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5ec0554-b4cd-4c18-9461-5dd6b6bcf3b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:52.997122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5ec0554-b4cd-4c18-9461-5dd6b6bcf3b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:53.000483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5ec0554-b4cd-4c18-9461-5dd6b6bcf3b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:53.000986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5ec0554-b4cd-4c18-9461-5dd6b6bcf3b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:53.001434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5ec0554-b4cd-4c18-9461-5dd6b6bcf3b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:53.445353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5ec0554-b4cd-4c18-9461-5dd6b6bcf3b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:53.462322 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c5ec0554-b4cd-4c18-9461-5dd6b6bcf3b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.489870 Aug 09 14:58:53.462940 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2456/4914] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:52 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:54.487069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94cde18e-ba26-4c1e-acdf-2a3a48826757 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:54.487778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94cde18e-ba26-4c1e-acdf-2a3a48826757 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:54.502923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94cde18e-ba26-4c1e-acdf-2a3a48826757 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:54.503449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94cde18e-ba26-4c1e-acdf-2a3a48826757 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:54.503863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94cde18e-ba26-4c1e-acdf-2a3a48826757 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:54.504565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94cde18e-ba26-4c1e-acdf-2a3a48826757 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:54.505013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94cde18e-ba26-4c1e-acdf-2a3a48826757 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:54.505427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94cde18e-ba26-4c1e-acdf-2a3a48826757 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:55.046497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-94cde18e-ba26-4c1e-acdf-2a3a48826757 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:55.089040 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94cde18e-ba26-4c1e-acdf-2a3a48826757 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.607165 Aug 09 14:58:55.096659 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2459/4915] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:54 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:56.126101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-05a06aaa-2dd1-4a04-92a0-48fff7bebdbb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:56.131130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-05a06aaa-2dd1-4a04-92a0-48fff7bebdbb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:56.188443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05a06aaa-2dd1-4a04-92a0-48fff7bebdbb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:56.189541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05a06aaa-2dd1-4a04-92a0-48fff7bebdbb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:56.190540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05a06aaa-2dd1-4a04-92a0-48fff7bebdbb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:56.194077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05a06aaa-2dd1-4a04-92a0-48fff7bebdbb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:56.195051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05a06aaa-2dd1-4a04-92a0-48fff7bebdbb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:56.196185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05a06aaa-2dd1-4a04-92a0-48fff7bebdbb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:56.846441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-05a06aaa-2dd1-4a04-92a0-48fff7bebdbb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:56.880242 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-05a06aaa-2dd1-4a04-92a0-48fff7bebdbb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.739755 Aug 09 14:58:56.882840 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2457/4916] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:56 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:57.920206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d6160cf1-eaf3-4752-b2df-02111cdd67d7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:57.921487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d6160cf1-eaf3-4752-b2df-02111cdd67d7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:57.932615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6160cf1-eaf3-4752-b2df-02111cdd67d7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:57.933779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6160cf1-eaf3-4752-b2df-02111cdd67d7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:57.936870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6160cf1-eaf3-4752-b2df-02111cdd67d7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:57.940250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6160cf1-eaf3-4752-b2df-02111cdd67d7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:57.942549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6160cf1-eaf3-4752-b2df-02111cdd67d7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:57.944012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d6160cf1-eaf3-4752-b2df-02111cdd67d7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:58.439517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d6160cf1-eaf3-4752-b2df-02111cdd67d7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:58:58.461692 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d6160cf1-eaf3-4752-b2df-02111cdd67d7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.545794 Aug 09 14:58:58.464238 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2460/4917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:57 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:58:59.512261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc010b2a-bcb4-4349-8e3a-2e7711929042 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:58:59.513277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc010b2a-bcb4-4349-8e3a-2e7711929042 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:58:59.542768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc010b2a-bcb4-4349-8e3a-2e7711929042 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:59.543348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc010b2a-bcb4-4349-8e3a-2e7711929042 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:59.543797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc010b2a-bcb4-4349-8e3a-2e7711929042 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:58:59.544523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc010b2a-bcb4-4349-8e3a-2e7711929042 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:58:59.555667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc010b2a-bcb4-4349-8e3a-2e7711929042 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:58:59.560721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc010b2a-bcb4-4349-8e3a-2e7711929042 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:00.554040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bc010b2a-bcb4-4349-8e3a-2e7711929042 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:00.621732 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc010b2a-bcb4-4349-8e3a-2e7711929042 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 1.119893 Aug 09 14:59:00.624924 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2458/4918] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:58:59 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:01.656470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81235bbc-5f95-4b67-9b59-64019c774366 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:01.657752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-81235bbc-5f95-4b67-9b59-64019c774366 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:01.671564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81235bbc-5f95-4b67-9b59-64019c774366 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:01.672051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81235bbc-5f95-4b67-9b59-64019c774366 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:01.674594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81235bbc-5f95-4b67-9b59-64019c774366 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:01.678187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81235bbc-5f95-4b67-9b59-64019c774366 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:01.679195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81235bbc-5f95-4b67-9b59-64019c774366 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:01.681648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81235bbc-5f95-4b67-9b59-64019c774366 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:01.693641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:59:02.351551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-81235bbc-5f95-4b67-9b59-64019c774366 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:02.369368 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81235bbc-5f95-4b67-9b59-64019c774366 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.718876 Aug 09 14:59:02.372084 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2461/4919] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:01 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:03.409330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be7686cc-8f6b-480b-ae46-993c1ce01cbf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:03.410514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be7686cc-8f6b-480b-ae46-993c1ce01cbf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:03.417827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be7686cc-8f6b-480b-ae46-993c1ce01cbf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:03.432154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be7686cc-8f6b-480b-ae46-993c1ce01cbf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:03.432884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be7686cc-8f6b-480b-ae46-993c1ce01cbf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:03.433914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be7686cc-8f6b-480b-ae46-993c1ce01cbf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:03.434525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be7686cc-8f6b-480b-ae46-993c1ce01cbf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:03.435129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be7686cc-8f6b-480b-ae46-993c1ce01cbf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:03.461590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:59:03.905686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-be7686cc-8f6b-480b-ae46-993c1ce01cbf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:03.917994 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be7686cc-8f6b-480b-ae46-993c1ce01cbf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.512182 Aug 09 14:59:03.921552 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2459/4920] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:03 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:04.941594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-904fcadf-7b7c-4b97-9855-354a93537154 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:04.942209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-904fcadf-7b7c-4b97-9855-354a93537154 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:04.952510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=24 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:59:04.956214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-904fcadf-7b7c-4b97-9855-354a93537154 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:04.958477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-904fcadf-7b7c-4b97-9855-354a93537154 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:04.961181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-904fcadf-7b7c-4b97-9855-354a93537154 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:04.962188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-904fcadf-7b7c-4b97-9855-354a93537154 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:04.962825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-904fcadf-7b7c-4b97-9855-354a93537154 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:04.964402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-904fcadf-7b7c-4b97-9855-354a93537154 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:05.528389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-904fcadf-7b7c-4b97-9855-354a93537154 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:05.547678 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-904fcadf-7b7c-4b97-9855-354a93537154 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.606230 Aug 09 14:59:05.563223 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2462/4921] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:04 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:06.573060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a00dd8c-3b8c-49a1-9ea4-56e5309c319e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:06.573785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5a00dd8c-3b8c-49a1-9ea4-56e5309c319e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:06.577932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:59:06.588525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a00dd8c-3b8c-49a1-9ea4-56e5309c319e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:06.596499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a00dd8c-3b8c-49a1-9ea4-56e5309c319e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:06.597530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a00dd8c-3b8c-49a1-9ea4-56e5309c319e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:06.599318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a00dd8c-3b8c-49a1-9ea4-56e5309c319e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:06.602053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a00dd8c-3b8c-49a1-9ea4-56e5309c319e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:06.602580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a00dd8c-3b8c-49a1-9ea4-56e5309c319e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:07.037000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5a00dd8c-3b8c-49a1-9ea4-56e5309c319e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:07.050086 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5a00dd8c-3b8c-49a1-9ea4-56e5309c319e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.481708 Aug 09 14:59:07.056184 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2460/4922] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:06 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:08.074045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67197857-3690-4f65-b82f-9ab98cf24ab0 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:08.075385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-67197857-3690-4f65-b82f-9ab98cf24ab0 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:08.102827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67197857-3690-4f65-b82f-9ab98cf24ab0 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:08.103800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67197857-3690-4f65-b82f-9ab98cf24ab0 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:08.104511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67197857-3690-4f65-b82f-9ab98cf24ab0 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:08.105674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67197857-3690-4f65-b82f-9ab98cf24ab0 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:08.108825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67197857-3690-4f65-b82f-9ab98cf24ab0 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:08.109548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67197857-3690-4f65-b82f-9ab98cf24ab0 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:08.654256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-67197857-3690-4f65-b82f-9ab98cf24ab0 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:08.715445 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67197857-3690-4f65-b82f-9ab98cf24ab0 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.629642 Aug 09 14:59:08.720096 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2463/4923] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:08 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:09.737710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-56d32bfb-23c9-40c1-a375-7fd341dc27f3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:09.738572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-56d32bfb-23c9-40c1-a375-7fd341dc27f3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:09.761870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d32bfb-23c9-40c1-a375-7fd341dc27f3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:09.763757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d32bfb-23c9-40c1-a375-7fd341dc27f3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:09.768866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d32bfb-23c9-40c1-a375-7fd341dc27f3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:09.770907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d32bfb-23c9-40c1-a375-7fd341dc27f3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:09.774027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d32bfb-23c9-40c1-a375-7fd341dc27f3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:09.776094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d32bfb-23c9-40c1-a375-7fd341dc27f3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:10.436890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-56d32bfb-23c9-40c1-a375-7fd341dc27f3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:10.461447 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-56d32bfb-23c9-40c1-a375-7fd341dc27f3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.728298 Aug 09 14:59:10.462387 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2461/4924] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:09 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:11.496045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34374676-bcb2-4bee-8087-44707796e8d9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:11.497420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-715c5282-5fe7-41b0-9ad4-6c8ec8897c20 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:11.499433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34374676-bcb2-4bee-8087-44707796e8d9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:11.499669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-715c5282-5fe7-41b0-9ad4-6c8ec8897c20 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:11.524466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-715c5282-5fe7-41b0-9ad4-6c8ec8897c20 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:11.524735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34374676-bcb2-4bee-8087-44707796e8d9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:11.525232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34374676-bcb2-4bee-8087-44707796e8d9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:11.526177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-715c5282-5fe7-41b0-9ad4-6c8ec8897c20 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:11.526606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-715c5282-5fe7-41b0-9ad4-6c8ec8897c20 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:11.526784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34374676-bcb2-4bee-8087-44707796e8d9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:11.528452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34374676-bcb2-4bee-8087-44707796e8d9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:11.528876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-715c5282-5fe7-41b0-9ad4-6c8ec8897c20 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:11.530826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-715c5282-5fe7-41b0-9ad4-6c8ec8897c20 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:11.531570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34374676-bcb2-4bee-8087-44707796e8d9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:11.532512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-715c5282-5fe7-41b0-9ad4-6c8ec8897c20 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:11.532970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34374676-bcb2-4bee-8087-44707796e8d9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:12.084838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-715c5282-5fe7-41b0-9ad4-6c8ec8897c20 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:12.097301 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-715c5282-5fe7-41b0-9ad4-6c8ec8897c20 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.610221 Aug 09 14:59:12.097950 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2464/4925] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:11 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:12.126948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1597f2d3-a41c-48cf-9f78-5071861166d0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:12.130105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1597f2d3-a41c-48cf-9f78-5071861166d0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:12.142123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1597f2d3-a41c-48cf-9f78-5071861166d0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:12.152379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1597f2d3-a41c-48cf-9f78-5071861166d0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:12.154528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1597f2d3-a41c-48cf-9f78-5071861166d0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:12.156735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1597f2d3-a41c-48cf-9f78-5071861166d0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:12.158446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1597f2d3-a41c-48cf-9f78-5071861166d0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:12.161625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34374676-bcb2-4bee-8087-44707796e8d9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:12.161857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1597f2d3-a41c-48cf-9f78-5071861166d0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:12.181079 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34374676-bcb2-4bee-8087-44707796e8d9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.697075 Aug 09 14:59:12.199450 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2462/4926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:11 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:12.868845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1597f2d3-a41c-48cf-9f78-5071861166d0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:12.878098 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1597f2d3-a41c-48cf-9f78-5071861166d0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.761615 Aug 09 14:59:12.887183 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2465/4927] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:12 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:12.911664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0534c20e-b7d3-4cd9-b34c-4e662a7b007f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:12.913132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0534c20e-b7d3-4cd9-b34c-4e662a7b007f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:12.927723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0534c20e-b7d3-4cd9-b34c-4e662a7b007f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:12.931273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0534c20e-b7d3-4cd9-b34c-4e662a7b007f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:12.932414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0534c20e-b7d3-4cd9-b34c-4e662a7b007f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:12.934037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0534c20e-b7d3-4cd9-b34c-4e662a7b007f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:12.936091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0534c20e-b7d3-4cd9-b34c-4e662a7b007f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:12.939348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0534c20e-b7d3-4cd9-b34c-4e662a7b007f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:13.224439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-88b764ca-c97d-4543-b851-ca2852de3a9e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:13.225062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-88b764ca-c97d-4543-b851-ca2852de3a9e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:13.239456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88b764ca-c97d-4543-b851-ca2852de3a9e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:13.240166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88b764ca-c97d-4543-b851-ca2852de3a9e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:13.244643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88b764ca-c97d-4543-b851-ca2852de3a9e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:13.245661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88b764ca-c97d-4543-b851-ca2852de3a9e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:13.246840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88b764ca-c97d-4543-b851-ca2852de3a9e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:13.247663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88b764ca-c97d-4543-b851-ca2852de3a9e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:13.376800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0534c20e-b7d3-4cd9-b34c-4e662a7b007f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:13.391373 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0534c20e-b7d3-4cd9-b34c-4e662a7b007f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.483190 Aug 09 14:59:13.394343 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2463/4928] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:12 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:13.421540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-95c4e6a2-3c4a-4848-967d-16391c3bed6d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-316124097"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:59:13.426508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-95c4e6a2-3c4a-4848-967d-16391c3bed6d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:13.443987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95c4e6a2-3c4a-4848-967d-16391c3bed6d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:13.444573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95c4e6a2-3c4a-4848-967d-16391c3bed6d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:13.445029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95c4e6a2-3c4a-4848-967d-16391c3bed6d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:13.445832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95c4e6a2-3c4a-4848-967d-16391c3bed6d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:13.450795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95c4e6a2-3c4a-4848-967d-16391c3bed6d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:13.451419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-95c4e6a2-3c4a-4848-967d-16391c3bed6d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:13.788286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-88b764ca-c97d-4543-b851-ca2852de3a9e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:13.811682 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-88b764ca-c97d-4543-b851-ca2852de3a9e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1724 microversion: 2.1 time: 0.588668 Aug 09 14:59:13.828947 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2466/4929] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:13 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1724 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:13.933466 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-95c4e6a2-3c4a-4848-967d-16391c3bed6d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.519361 Aug 09 14:59:13.935855 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2464/4930] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:59:13 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 09 14:59:14.838574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0fcb66be-fb47-4d7a-9669-3102f218d09a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:14.840078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0fcb66be-fb47-4d7a-9669-3102f218d09a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:14.856652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fcb66be-fb47-4d7a-9669-3102f218d09a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:14.860574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fcb66be-fb47-4d7a-9669-3102f218d09a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:14.861809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fcb66be-fb47-4d7a-9669-3102f218d09a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:14.865505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fcb66be-fb47-4d7a-9669-3102f218d09a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:14.866859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fcb66be-fb47-4d7a-9669-3102f218d09a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:14.867888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0fcb66be-fb47-4d7a-9669-3102f218d09a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:15.862013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0fcb66be-fb47-4d7a-9669-3102f218d09a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:15.875527 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0fcb66be-fb47-4d7a-9669-3102f218d09a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1701 microversion: 2.1 time: 1.042073 Aug 09 14:59:15.893738 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2467/4931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:14 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1701 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:15.904823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eea63eac-c736-443e-9c12-90a74e3bd2ff tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:59:15.920575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eea63eac-c736-443e-9c12-90a74e3bd2ff tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:15.922889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eea63eac-c736-443e-9c12-90a74e3bd2ff tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:15.926216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eea63eac-c736-443e-9c12-90a74e3bd2ff tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:15.994718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eea63eac-c736-443e-9c12-90a74e3bd2ff tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Going to try to start instance {{(pid=119406) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 14:59:16.095625 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eea63eac-c736-443e-9c12-90a74e3bd2ff tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "POST /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/action" status: 202 len: 0 microversion: 2.1 time: 0.197943 Aug 09 14:59:16.098808 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2465/4932] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:59:15 2022] POST /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 14:59:16.107294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-59397331-1926-46c5-888f-036a3599a35b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:16.109109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-59397331-1926-46c5-888f-036a3599a35b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:16.120625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59397331-1926-46c5-888f-036a3599a35b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:16.123509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59397331-1926-46c5-888f-036a3599a35b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:16.124950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59397331-1926-46c5-888f-036a3599a35b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:16.127530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59397331-1926-46c5-888f-036a3599a35b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:16.129592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59397331-1926-46c5-888f-036a3599a35b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:16.130280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59397331-1926-46c5-888f-036a3599a35b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:18.436994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-59397331-1926-46c5-888f-036a3599a35b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:18.469784 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-59397331-1926-46c5-888f-036a3599a35b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1710 microversion: 2.1 time: 2.366630 Aug 09 14:59:18.486920 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2468/4933] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:16 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1710 bytes in 2385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:19.508899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b925939b-b31e-44f2-9066-9cb0c1981755 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:19.510831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b925939b-b31e-44f2-9066-9cb0c1981755 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:19.537503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b925939b-b31e-44f2-9066-9cb0c1981755 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:19.539841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b925939b-b31e-44f2-9066-9cb0c1981755 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:19.540790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b925939b-b31e-44f2-9066-9cb0c1981755 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:19.544814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b925939b-b31e-44f2-9066-9cb0c1981755 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:19.546309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b925939b-b31e-44f2-9066-9cb0c1981755 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:19.547617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b925939b-b31e-44f2-9066-9cb0c1981755 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:20.270089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b925939b-b31e-44f2-9066-9cb0c1981755 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:20.288416 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b925939b-b31e-44f2-9066-9cb0c1981755 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1710 microversion: 2.1 time: 0.783965 Aug 09 14:59:20.290218 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2466/4934] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:19 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1710 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:21.316530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f3e4458d-59c2-4e08-8854-4656aba497c2 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:21.321514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f3e4458d-59c2-4e08-8854-4656aba497c2 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:21.346563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3e4458d-59c2-4e08-8854-4656aba497c2 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:21.354163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3e4458d-59c2-4e08-8854-4656aba497c2 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:21.355510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3e4458d-59c2-4e08-8854-4656aba497c2 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:21.359035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3e4458d-59c2-4e08-8854-4656aba497c2 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:21.388947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3e4458d-59c2-4e08-8854-4656aba497c2 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:21.391422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f3e4458d-59c2-4e08-8854-4656aba497c2 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:21.949645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f3e4458d-59c2-4e08-8854-4656aba497c2 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:21.972571 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f3e4458d-59c2-4e08-8854-4656aba497c2 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1714 microversion: 2.1 time: 0.664140 Aug 09 14:59:21.978423 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2469/4935] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:21 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1714 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:25.726127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c8ea3864-ed6f-414c-aa71-b64809f303b4 req-33dd3ba0-55fc-446f-b68b-406acfa07ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a67196-2e15-47e5-8877-e75e8d4609c7", "name": "network-vif-plugged", "status": "completed", "tag": "d15f67e8-ba7f-4681-bd12-a57303ad56da"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:59:25.757336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c8ea3864-ed6f-414c-aa71-b64809f303b4 req-33dd3ba0-55fc-446f-b68b-406acfa07ca2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:25.757844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c8ea3864-ed6f-414c-aa71-b64809f303b4 req-33dd3ba0-55fc-446f-b68b-406acfa07ca2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:25.770805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c8ea3864-ed6f-414c-aa71-b64809f303b4 req-33dd3ba0-55fc-446f-b68b-406acfa07ca2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:25.846095 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-c8ea3864-ed6f-414c-aa71-b64809f303b4 req-33dd3ba0-55fc-446f-b68b-406acfa07ca2 service nova] Creating event network-vif-plugged:d15f67e8-ba7f-4681-bd12-a57303ad56da for instance f6a67196-2e15-47e5-8877-e75e8d4609c7 on n-h2-844626-8 Aug 09 14:59:25.874720 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c8ea3864-ed6f-414c-aa71-b64809f303b4 req-33dd3ba0-55fc-446f-b68b-406acfa07ca2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147867 Aug 09 14:59:25.885465 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2467/4936] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:59:51.379817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5686b072-775d-46ed-a9e3-2d8a8204b838 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 14:59:51.383874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5686b072-775d-46ed-a9e3-2d8a8204b838 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:51.403698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=15 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:59:51.404623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=53 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:59:51.408062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5686b072-775d-46ed-a9e3-2d8a8204b838 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:51.413779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5686b072-775d-46ed-a9e3-2d8a8204b838 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:51.414392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5686b072-775d-46ed-a9e3-2d8a8204b838 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:51.415404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5686b072-775d-46ed-a9e3-2d8a8204b838 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:51.416034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5686b072-775d-46ed-a9e3-2d8a8204b838 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:51.416699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5686b072-775d-46ed-a9e3-2d8a8204b838 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:51.752719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5686b072-775d-46ed-a9e3-2d8a8204b838 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 14:59:51.763611 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5686b072-775d-46ed-a9e3-2d8a8204b838 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.399936 Aug 09 14:59:51.764622 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2470/4937] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 14:59:51 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 14:59:51.788638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-347447f3-ffef-44ef-9528-e690a0042ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-135861405"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:59:51.793015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-347447f3-ffef-44ef-9528-e690a0042ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 14:59:51.798426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=15 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:59:51.799351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 14:59:51.813709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-347447f3-ffef-44ef-9528-e690a0042ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:51.816736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-347447f3-ffef-44ef-9528-e690a0042ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:51.817412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-347447f3-ffef-44ef-9528-e690a0042ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:51.819681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-347447f3-ffef-44ef-9528-e690a0042ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:51.820280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-347447f3-ffef-44ef-9528-e690a0042ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:51.820787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-347447f3-ffef-44ef-9528-e690a0042ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:52.165971 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-347447f3-ffef-44ef-9528-e690a0042ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.381421 Aug 09 14:59:52.170395 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2468/4938] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 14:59:51 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 09 14:59:54.308181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-c0f48d00-55cf-4f80-8466-3e0059effa4b req-0fe6b8d4-91f8-4216-b6c7-d87abe1176a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a67196-2e15-47e5-8877-e75e8d4609c7", "name": "network-vif-unplugged", "status": "completed", "tag": "d15f67e8-ba7f-4681-bd12-a57303ad56da"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:59:54.331099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c0f48d00-55cf-4f80-8466-3e0059effa4b req-0fe6b8d4-91f8-4216-b6c7-d87abe1176a0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:54.336388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c0f48d00-55cf-4f80-8466-3e0059effa4b req-0fe6b8d4-91f8-4216-b6c7-d87abe1176a0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:54.337031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c0f48d00-55cf-4f80-8466-3e0059effa4b req-0fe6b8d4-91f8-4216-b6c7-d87abe1176a0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:54.358029 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-c0f48d00-55cf-4f80-8466-3e0059effa4b req-0fe6b8d4-91f8-4216-b6c7-d87abe1176a0 service nova] Creating event network-vif-unplugged:d15f67e8-ba7f-4681-bd12-a57303ad56da for instance f6a67196-2e15-47e5-8877-e75e8d4609c7 on n-h2-844626-8 Aug 09 14:59:54.375867 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-c0f48d00-55cf-4f80-8466-3e0059effa4b req-0fe6b8d4-91f8-4216-b6c7-d87abe1176a0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071875 Aug 09 14:59:54.382157 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2471/4939] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 14:59:57.943239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d96b7fb1-4819-4c7b-a76c-55bb46a677ff req-db23637c-d6bc-478d-930d-403bc8639b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a67196-2e15-47e5-8877-e75e8d4609c7", "name": "network-vif-plugged", "status": "completed", "tag": "d15f67e8-ba7f-4681-bd12-a57303ad56da"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 14:59:57.959614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d96b7fb1-4819-4c7b-a76c-55bb46a677ff req-db23637c-d6bc-478d-930d-403bc8639b87 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 14:59:57.962608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d96b7fb1-4819-4c7b-a76c-55bb46a677ff req-db23637c-d6bc-478d-930d-403bc8639b87 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 14:59:57.965377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d96b7fb1-4819-4c7b-a76c-55bb46a677ff req-db23637c-d6bc-478d-930d-403bc8639b87 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 14:59:57.993888 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d96b7fb1-4819-4c7b-a76c-55bb46a677ff req-db23637c-d6bc-478d-930d-403bc8639b87 service nova] Creating event network-vif-plugged:d15f67e8-ba7f-4681-bd12-a57303ad56da for instance f6a67196-2e15-47e5-8877-e75e8d4609c7 on n-h2-844626-8 Aug 09 14:59:58.007982 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d96b7fb1-4819-4c7b-a76c-55bb46a677ff req-db23637c-d6bc-478d-930d-403bc8639b87 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106230 Aug 09 14:59:58.008783 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2469/4940] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 14:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:00:00.718065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f910fb12-6221-4739-b29b-a6b17cde9d6e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:00.718822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f910fb12-6221-4739-b29b-a6b17cde9d6e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:00.762579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f910fb12-6221-4739-b29b-a6b17cde9d6e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:00.763546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f910fb12-6221-4739-b29b-a6b17cde9d6e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:00.764264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f910fb12-6221-4739-b29b-a6b17cde9d6e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:00.768679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f910fb12-6221-4739-b29b-a6b17cde9d6e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:00.769543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f910fb12-6221-4739-b29b-a6b17cde9d6e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:00.770202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f910fb12-6221-4739-b29b-a6b17cde9d6e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:01.061277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-f910fb12-6221-4739-b29b-a6b17cde9d6e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lazy-loading 'services' on Instance uuid 22ec66f1-8b80-40ad-8cfe-95852fda1792 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:00:01.260381 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f910fb12-6221-4739-b29b-a6b17cde9d6e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "DELETE /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/os-volume_attachments/1a648f87-9874-4018-af3a-79495bea63be" status: 202 len: 0 microversion: 2.1 time: 0.547667 Aug 09 15:00:01.261597 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2472/4941] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:00:00 2022] DELETE /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/os-volume_attachments/1a648f87-9874-4018-af3a-79495bea63be => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:00:13.561215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:00:13.562631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:00:13.567951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b535ded9-e48f-4290-ad40-fa074ce208d1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:00:13.588784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b535ded9-e48f-4290-ad40-fa074ce208d1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:13.605744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b535ded9-e48f-4290-ad40-fa074ce208d1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:13.606313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b535ded9-e48f-4290-ad40-fa074ce208d1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:13.701351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b535ded9-e48f-4290-ad40-fa074ce208d1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Going to try to stop instance {{(pid=119406) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 15:00:13.854892 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b535ded9-e48f-4290-ad40-fa074ce208d1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "POST /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/action" status: 202 len: 0 microversion: 2.1 time: 0.295691 Aug 09 15:00:13.857635 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2470/4942] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:00:13 2022] POST /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 15:00:13.862580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:00:13.863454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:00:13.868214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60b16b60-02c3-405a-83cb-6f614e6d7f2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:13.869100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-60b16b60-02c3-405a-83cb-6f614e6d7f2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:13.898241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60b16b60-02c3-405a-83cb-6f614e6d7f2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:13.898724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60b16b60-02c3-405a-83cb-6f614e6d7f2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:13.915409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60b16b60-02c3-405a-83cb-6f614e6d7f2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:13.917158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60b16b60-02c3-405a-83cb-6f614e6d7f2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:13.917158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60b16b60-02c3-405a-83cb-6f614e6d7f2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:13.917404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60b16b60-02c3-405a-83cb-6f614e6d7f2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:14.304118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60b16b60-02c3-405a-83cb-6f614e6d7f2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:14.348091 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60b16b60-02c3-405a-83cb-6f614e6d7f2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1678 microversion: 2.1 time: 0.486914 Aug 09 15:00:14.356034 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2473/4943] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:13 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1678 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:15.385338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dc87c0e6-3484-44b3-b1bc-9ad92a6d967c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:15.389516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dc87c0e6-3484-44b3-b1bc-9ad92a6d967c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:15.428105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc87c0e6-3484-44b3-b1bc-9ad92a6d967c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:15.428906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc87c0e6-3484-44b3-b1bc-9ad92a6d967c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:15.438726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc87c0e6-3484-44b3-b1bc-9ad92a6d967c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:15.440307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc87c0e6-3484-44b3-b1bc-9ad92a6d967c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:15.441994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc87c0e6-3484-44b3-b1bc-9ad92a6d967c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:15.443027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc87c0e6-3484-44b3-b1bc-9ad92a6d967c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:17.073033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dc87c0e6-3484-44b3-b1bc-9ad92a6d967c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:17.089056 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dc87c0e6-3484-44b3-b1bc-9ad92a6d967c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1678 microversion: 2.1 time: 1.711003 Aug 09 15:00:17.089689 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2471/4944] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:15 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1678 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:18.120241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-394dd914-c5f2-4c15-9d94-422b8401868b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:18.121604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-394dd914-c5f2-4c15-9d94-422b8401868b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:18.133868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-394dd914-c5f2-4c15-9d94-422b8401868b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:18.137104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-394dd914-c5f2-4c15-9d94-422b8401868b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:18.137743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-394dd914-c5f2-4c15-9d94-422b8401868b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:18.139984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-394dd914-c5f2-4c15-9d94-422b8401868b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:18.143122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-394dd914-c5f2-4c15-9d94-422b8401868b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:18.143749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-394dd914-c5f2-4c15-9d94-422b8401868b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:18.573081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-394dd914-c5f2-4c15-9d94-422b8401868b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:18.583844 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-394dd914-c5f2-4c15-9d94-422b8401868b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1678 microversion: 2.1 time: 0.467847 Aug 09 15:00:18.584389 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2474/4945] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:18 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1678 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:19.616344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d24d6cf-28fc-496e-9c93-a2d99918ea4e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:19.619400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d24d6cf-28fc-496e-9c93-a2d99918ea4e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:19.656690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d24d6cf-28fc-496e-9c93-a2d99918ea4e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:19.657476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d24d6cf-28fc-496e-9c93-a2d99918ea4e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:19.662660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d24d6cf-28fc-496e-9c93-a2d99918ea4e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:19.672815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d24d6cf-28fc-496e-9c93-a2d99918ea4e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:19.679265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d24d6cf-28fc-496e-9c93-a2d99918ea4e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:19.680146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d24d6cf-28fc-496e-9c93-a2d99918ea4e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:20.150467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6d24d6cf-28fc-496e-9c93-a2d99918ea4e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:20.161863 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d24d6cf-28fc-496e-9c93-a2d99918ea4e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1678 microversion: 2.1 time: 0.556269 Aug 09 15:00:20.162469 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2472/4946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:19 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1678 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:21.183355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-407efa85-f870-4e77-ae89-e45af22c3d86 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:21.184966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-407efa85-f870-4e77-ae89-e45af22c3d86 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:21.202866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-407efa85-f870-4e77-ae89-e45af22c3d86 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:21.205535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-407efa85-f870-4e77-ae89-e45af22c3d86 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:21.210889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-407efa85-f870-4e77-ae89-e45af22c3d86 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:21.212015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-407efa85-f870-4e77-ae89-e45af22c3d86 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:21.212657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-407efa85-f870-4e77-ae89-e45af22c3d86 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:21.214197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-407efa85-f870-4e77-ae89-e45af22c3d86 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:21.499740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-407efa85-f870-4e77-ae89-e45af22c3d86 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:21.521749 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-407efa85-f870-4e77-ae89-e45af22c3d86 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1678 microversion: 2.1 time: 0.342520 Aug 09 15:00:21.523642 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2475/4947] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:21 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1678 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:22.547297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f30e46dd-ab13-41ce-9cb7-d929c9303c7d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:22.548683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f30e46dd-ab13-41ce-9cb7-d929c9303c7d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:22.574999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f30e46dd-ab13-41ce-9cb7-d929c9303c7d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:22.576335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f30e46dd-ab13-41ce-9cb7-d929c9303c7d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:22.583661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f30e46dd-ab13-41ce-9cb7-d929c9303c7d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:22.591756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f30e46dd-ab13-41ce-9cb7-d929c9303c7d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:22.593438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f30e46dd-ab13-41ce-9cb7-d929c9303c7d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:22.599763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f30e46dd-ab13-41ce-9cb7-d929c9303c7d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:23.096635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f30e46dd-ab13-41ce-9cb7-d929c9303c7d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:23.113057 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f30e46dd-ab13-41ce-9cb7-d929c9303c7d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1678 microversion: 2.1 time: 0.568754 Aug 09 15:00:23.115953 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2473/4948] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:22 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1678 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:24.138730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf6b7888-933d-4df8-87d8-86266cb48e2c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:24.140378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf6b7888-933d-4df8-87d8-86266cb48e2c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:24.164200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf6b7888-933d-4df8-87d8-86266cb48e2c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:24.164739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf6b7888-933d-4df8-87d8-86266cb48e2c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:24.165182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf6b7888-933d-4df8-87d8-86266cb48e2c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:24.165992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf6b7888-933d-4df8-87d8-86266cb48e2c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:24.174241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf6b7888-933d-4df8-87d8-86266cb48e2c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:24.174872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf6b7888-933d-4df8-87d8-86266cb48e2c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:24.656908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bf6b7888-933d-4df8-87d8-86266cb48e2c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:24.669912 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf6b7888-933d-4df8-87d8-86266cb48e2c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1678 microversion: 2.1 time: 0.534910 Aug 09 15:00:24.673548 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2476/4949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:24 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1678 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:25.695801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8ff5e1c9-d463-455c-8a6a-e81cb52d417f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:25.696639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8ff5e1c9-d463-455c-8a6a-e81cb52d417f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:25.716141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ff5e1c9-d463-455c-8a6a-e81cb52d417f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:25.716728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ff5e1c9-d463-455c-8a6a-e81cb52d417f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:25.718313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ff5e1c9-d463-455c-8a6a-e81cb52d417f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:25.720145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ff5e1c9-d463-455c-8a6a-e81cb52d417f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:25.720836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ff5e1c9-d463-455c-8a6a-e81cb52d417f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:25.722994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8ff5e1c9-d463-455c-8a6a-e81cb52d417f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:26.193195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8ff5e1c9-d463-455c-8a6a-e81cb52d417f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:26.202362 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8ff5e1c9-d463-455c-8a6a-e81cb52d417f tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1655 microversion: 2.1 time: 0.510582 Aug 09 15:00:26.202964 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2474/4950] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:25 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1655 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:26.226604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef44bfd7-354a-449a-bf87-aa4acb876167 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:00:26.242425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef44bfd7-354a-449a-bf87-aa4acb876167 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:26.242852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef44bfd7-354a-449a-bf87-aa4acb876167 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:26.247839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef44bfd7-354a-449a-bf87-aa4acb876167 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:26.310414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ef44bfd7-354a-449a-bf87-aa4acb876167 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Going to try to start instance {{(pid=119407) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 15:00:26.412591 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ef44bfd7-354a-449a-bf87-aa4acb876167 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "POST /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/action" status: 202 len: 0 microversion: 2.1 time: 0.190208 Aug 09 15:00:26.413405 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2477/4951] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:00:26 2022] POST /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:00:26.422422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e964cdf-dc9f-429e-922a-3cb4e1144522 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:26.423347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8e964cdf-dc9f-429e-922a-3cb4e1144522 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:26.439544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e964cdf-dc9f-429e-922a-3cb4e1144522 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:26.444006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e964cdf-dc9f-429e-922a-3cb4e1144522 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:26.444649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e964cdf-dc9f-429e-922a-3cb4e1144522 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:26.452161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e964cdf-dc9f-429e-922a-3cb4e1144522 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:26.452935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e964cdf-dc9f-429e-922a-3cb4e1144522 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:26.453529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e964cdf-dc9f-429e-922a-3cb4e1144522 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:26.968643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e964cdf-dc9f-429e-922a-3cb4e1144522 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:26.977697 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e964cdf-dc9f-429e-922a-3cb4e1144522 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1664 microversion: 2.1 time: 0.559414 Aug 09 15:00:26.983471 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2475/4952] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:26 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1664 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:00:27.270738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f4ecbf1a-2c54-4109-b395-619904236174 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:27.271479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f4ecbf1a-2c54-4109-b395-619904236174 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:27.293617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4ecbf1a-2c54-4109-b395-619904236174 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:27.293617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4ecbf1a-2c54-4109-b395-619904236174 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:27.293617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4ecbf1a-2c54-4109-b395-619904236174 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:27.293617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4ecbf1a-2c54-4109-b395-619904236174 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:27.305019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4ecbf1a-2c54-4109-b395-619904236174 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:27.305509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f4ecbf1a-2c54-4109-b395-619904236174 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:27.586629 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:00:27.587145 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:00:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:00:27.674928 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:00:27.675169 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:00:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:00:27.758129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f4ecbf1a-2c54-4109-b395-619904236174 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:27.790142 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f4ecbf1a-2c54-4109-b395-619904236174 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.526066 Aug 09 15:00:27.790831 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2478/4953] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:27 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:27.998757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12bacd9c-1508-43c9-8a64-a76b9e778c5e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:28.004040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-12bacd9c-1508-43c9-8a64-a76b9e778c5e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:28.024458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12bacd9c-1508-43c9-8a64-a76b9e778c5e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:28.029493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12bacd9c-1508-43c9-8a64-a76b9e778c5e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:28.030117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12bacd9c-1508-43c9-8a64-a76b9e778c5e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:28.034654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12bacd9c-1508-43c9-8a64-a76b9e778c5e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:28.035637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12bacd9c-1508-43c9-8a64-a76b9e778c5e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:28.036234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12bacd9c-1508-43c9-8a64-a76b9e778c5e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:28.466940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-12bacd9c-1508-43c9-8a64-a76b9e778c5e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:28.481938 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-12bacd9c-1508-43c9-8a64-a76b9e778c5e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1664 microversion: 2.1 time: 0.486698 Aug 09 15:00:28.485938 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2476/4954] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:27 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1664 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:28.819499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf805c27-9706-4d42-9286-b8d027baada9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:28.825847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf805c27-9706-4d42-9286-b8d027baada9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:28.842581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf805c27-9706-4d42-9286-b8d027baada9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:28.843840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf805c27-9706-4d42-9286-b8d027baada9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:28.844693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf805c27-9706-4d42-9286-b8d027baada9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:28.846100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf805c27-9706-4d42-9286-b8d027baada9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:28.847250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf805c27-9706-4d42-9286-b8d027baada9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:28.848625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf805c27-9706-4d42-9286-b8d027baada9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:29.133527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bf805c27-9706-4d42-9286-b8d027baada9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:29.149406 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf805c27-9706-4d42-9286-b8d027baada9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.335760 Aug 09 15:00:29.161380 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2479/4955] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:28 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:29.177559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-752dd185-9a15-4c68-8d45-21873cc877e1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-539958417"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:00:29.191771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-752dd185-9a15-4c68-8d45-21873cc877e1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:29.214339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752dd185-9a15-4c68-8d45-21873cc877e1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:29.215029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752dd185-9a15-4c68-8d45-21873cc877e1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:29.215664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752dd185-9a15-4c68-8d45-21873cc877e1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:29.217588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752dd185-9a15-4c68-8d45-21873cc877e1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:29.218267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752dd185-9a15-4c68-8d45-21873cc877e1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:29.218842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752dd185-9a15-4c68-8d45-21873cc877e1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:29.505635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2d957fb-3b97-48ad-9732-801d7bc086ed tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:29.507459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2d957fb-3b97-48ad-9732-801d7bc086ed tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:29.516962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d957fb-3b97-48ad-9732-801d7bc086ed tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:29.520776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d957fb-3b97-48ad-9732-801d7bc086ed tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:29.523574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d957fb-3b97-48ad-9732-801d7bc086ed tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:29.524411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d957fb-3b97-48ad-9732-801d7bc086ed tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:29.525255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d957fb-3b97-48ad-9732-801d7bc086ed tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:29.527803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2d957fb-3b97-48ad-9732-801d7bc086ed tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:29.749267 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-752dd185-9a15-4c68-8d45-21873cc877e1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.578991 Aug 09 15:00:29.750345 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2477/4956] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:00:29 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 09 15:00:29.758743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b7f6a2a8-7b77-463b-ac30-faadc965db17 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:29.759920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b7f6a2a8-7b77-463b-ac30-faadc965db17 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:29.778048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7f6a2a8-7b77-463b-ac30-faadc965db17 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:29.778550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7f6a2a8-7b77-463b-ac30-faadc965db17 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:29.778985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7f6a2a8-7b77-463b-ac30-faadc965db17 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:29.780184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7f6a2a8-7b77-463b-ac30-faadc965db17 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:29.782012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7f6a2a8-7b77-463b-ac30-faadc965db17 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:29.783728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b7f6a2a8-7b77-463b-ac30-faadc965db17 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:29.868793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2d957fb-3b97-48ad-9732-801d7bc086ed tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:29.878312 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2d957fb-3b97-48ad-9732-801d7bc086ed tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1668 microversion: 2.1 time: 0.376614 Aug 09 15:00:29.892661 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2480/4957] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:29 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1668 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:30.095866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b7f6a2a8-7b77-463b-ac30-faadc965db17 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:30.107285 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b7f6a2a8-7b77-463b-ac30-faadc965db17 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.352746 Aug 09 15:00:30.108236 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2478/4958] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:29 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:00:31.133698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf1bae6d-d427-4b7c-a1d4-b31f79b3d3bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:31.135371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf1bae6d-d427-4b7c-a1d4-b31f79b3d3bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:31.165242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf1bae6d-d427-4b7c-a1d4-b31f79b3d3bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:31.167707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf1bae6d-d427-4b7c-a1d4-b31f79b3d3bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:31.168369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf1bae6d-d427-4b7c-a1d4-b31f79b3d3bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:31.170644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf1bae6d-d427-4b7c-a1d4-b31f79b3d3bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:31.171258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf1bae6d-d427-4b7c-a1d4-b31f79b3d3bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:31.171953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf1bae6d-d427-4b7c-a1d4-b31f79b3d3bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:31.236031 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:00:31.236216 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 (ip 10.222.0.50) !!! Aug 09 15:00:31.812820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7f0332a2-0946-4972-95c4-58fa53b3d84b req-91b16ac3-d46d-4bf6-a1ce-383122387725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a67196-2e15-47e5-8877-e75e8d4609c7", "name": "network-vif-unplugged", "status": "completed", "tag": "d15f67e8-ba7f-4681-bd12-a57303ad56da"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:00:31.848140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7f0332a2-0946-4972-95c4-58fa53b3d84b req-91b16ac3-d46d-4bf6-a1ce-383122387725 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:31.848899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7f0332a2-0946-4972-95c4-58fa53b3d84b req-91b16ac3-d46d-4bf6-a1ce-383122387725 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:31.849344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7f0332a2-0946-4972-95c4-58fa53b3d84b req-91b16ac3-d46d-4bf6-a1ce-383122387725 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:31.878280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bf1bae6d-d427-4b7c-a1d4-b31f79b3d3bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:31.890063 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf1bae6d-d427-4b7c-a1d4-b31f79b3d3bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.764368 Aug 09 15:00:31.896096 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2481/4959] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:31 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:31.954636 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7f0332a2-0946-4972-95c4-58fa53b3d84b req-91b16ac3-d46d-4bf6-a1ce-383122387725 service nova] Creating event network-vif-unplugged:d15f67e8-ba7f-4681-bd12-a57303ad56da for instance f6a67196-2e15-47e5-8877-e75e8d4609c7 on n-h2-844626-8 Aug 09 15:00:31.972235 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7f0332a2-0946-4972-95c4-58fa53b3d84b req-91b16ac3-d46d-4bf6-a1ce-383122387725 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.175550 Aug 09 15:00:31.973475 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2479/4960] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:00:32.279858 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:00:32.280332 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:00:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:00:32.919480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-709ad3fb-f83a-4a02-b683-4a224dbef49f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:32.920295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-709ad3fb-f83a-4a02-b683-4a224dbef49f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:32.936758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-709ad3fb-f83a-4a02-b683-4a224dbef49f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:32.937372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-709ad3fb-f83a-4a02-b683-4a224dbef49f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:32.937885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-709ad3fb-f83a-4a02-b683-4a224dbef49f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:32.943622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-709ad3fb-f83a-4a02-b683-4a224dbef49f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:32.945326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-709ad3fb-f83a-4a02-b683-4a224dbef49f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:32.946476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-709ad3fb-f83a-4a02-b683-4a224dbef49f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:33.624995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-709ad3fb-f83a-4a02-b683-4a224dbef49f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:33.633118 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-709ad3fb-f83a-4a02-b683-4a224dbef49f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1683 microversion: 2.1 time: 0.718367 Aug 09 15:00:33.636024 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2482/4961] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:32 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1683 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:34.196493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1002363924", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "1e50f350-54a1-4361-a79b-284911b81354"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:00:34.658261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5710298d-dfb0-4e59-ad51-9e48fcedca5d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:34.659596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5710298d-dfb0-4e59-ad51-9e48fcedca5d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:34.702061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5710298d-dfb0-4e59-ad51-9e48fcedca5d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:34.702611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5710298d-dfb0-4e59-ad51-9e48fcedca5d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:34.703157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5710298d-dfb0-4e59-ad51-9e48fcedca5d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:34.708939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5710298d-dfb0-4e59-ad51-9e48fcedca5d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:34.709449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5710298d-dfb0-4e59-ad51-9e48fcedca5d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:34.715604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5710298d-dfb0-4e59-ad51-9e48fcedca5d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:34.747178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] validate_networks() for [('1e50f350-54a1-4361-a79b-284911b81354', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:00:35.429894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5710298d-dfb0-4e59-ad51-9e48fcedca5d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:35.447123 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5710298d-dfb0-4e59-ad51-9e48fcedca5d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.787977 Aug 09 15:00:35.449177 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2483/4962] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:34 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:35.885729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8b128deb-d93f-4b88-a028-e67b5b7cda96 req-9eb47ed9-b769-4bbf-b28f-b6186cdf9644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a67196-2e15-47e5-8877-e75e8d4609c7", "name": "network-vif-plugged", "status": "completed", "tag": "d15f67e8-ba7f-4681-bd12-a57303ad56da"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:00:35.910197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8b128deb-d93f-4b88-a028-e67b5b7cda96 req-9eb47ed9-b769-4bbf-b28f-b6186cdf9644 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:35.916096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8b128deb-d93f-4b88-a028-e67b5b7cda96 req-9eb47ed9-b769-4bbf-b28f-b6186cdf9644 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:35.921183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8b128deb-d93f-4b88-a028-e67b5b7cda96 req-9eb47ed9-b769-4bbf-b28f-b6186cdf9644 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:35.973111 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8b128deb-d93f-4b88-a028-e67b5b7cda96 req-9eb47ed9-b769-4bbf-b28f-b6186cdf9644 service nova] Creating event network-vif-plugged:d15f67e8-ba7f-4681-bd12-a57303ad56da for instance f6a67196-2e15-47e5-8877-e75e8d4609c7 on n-h2-844626-8 Aug 09 15:00:35.975549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:00:35.976147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:00:35.976916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:00:35.979330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:00:35.979882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:00:35.993221 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8b128deb-d93f-4b88-a028-e67b5b7cda96 req-9eb47ed9-b769-4bbf-b28f-b6186cdf9644 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111148 Aug 09 15:00:35.999183 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2484/4963] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:00:36.035225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:36.037266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:36.037904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:36.039549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:36.043622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:36.044349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:36.101607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Getting quotas for project 9fbd4a7083a34b02910cb4e4b7d4aca0. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:00:36.131722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Getting quotas for user 94ab820ec1384350b9cab506cf75df22 and project 9fbd4a7083a34b02910cb4e4b7d4aca0. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:00:36.151960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:00:36.154918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:00:36.303224 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d2af8d91-c8b2-4eb7-9664-375c8214b491 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.101879 Aug 09 15:00:36.304643 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2480/4964] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:00:36.318035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64a0811c-611a-4a58-85fd-77e720950f1c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:36.318931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-64a0811c-611a-4a58-85fd-77e720950f1c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:36.454365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-64a0811c-611a-4a58-85fd-77e720950f1c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:36.472222 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-64a0811c-611a-4a58-85fd-77e720950f1c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1219 microversion: 2.1 time: 0.159444 Aug 09 15:00:36.481233 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2485/4965] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:36 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1219 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:36.483475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-26f5743c-8ac9-410e-9323-249fa1165332 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:36.484730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-26f5743c-8ac9-410e-9323-249fa1165332 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:36.515287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26f5743c-8ac9-410e-9323-249fa1165332 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:36.516115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26f5743c-8ac9-410e-9323-249fa1165332 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:36.526007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26f5743c-8ac9-410e-9323-249fa1165332 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:36.528195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26f5743c-8ac9-410e-9323-249fa1165332 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:36.529122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26f5743c-8ac9-410e-9323-249fa1165332 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:36.529755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26f5743c-8ac9-410e-9323-249fa1165332 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:37.090132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-26f5743c-8ac9-410e-9323-249fa1165332 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:37.106622 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-26f5743c-8ac9-410e-9323-249fa1165332 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.629067 Aug 09 15:00:37.108858 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2481/4966] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:36 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:37.502695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e36164e5-2093-463a-bf26-35ec2d92ddc8 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:37.503427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e36164e5-2093-463a-bf26-35ec2d92ddc8 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:37.526026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e36164e5-2093-463a-bf26-35ec2d92ddc8 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:37.526811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e36164e5-2093-463a-bf26-35ec2d92ddc8 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:37.527461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e36164e5-2093-463a-bf26-35ec2d92ddc8 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:37.528796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e36164e5-2093-463a-bf26-35ec2d92ddc8 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:37.529742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e36164e5-2093-463a-bf26-35ec2d92ddc8 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:37.530380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e36164e5-2093-463a-bf26-35ec2d92ddc8 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:37.609097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e36164e5-2093-463a-bf26-35ec2d92ddc8 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:37.617630 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e36164e5-2093-463a-bf26-35ec2d92ddc8 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1271 microversion: 2.1 time: 0.121557 Aug 09 15:00:37.618856 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2486/4967] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:37 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:38.133104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-993ae11c-1b2b-4681-92e6-c154bbf6172c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:38.135021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-993ae11c-1b2b-4681-92e6-c154bbf6172c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:38.152862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-993ae11c-1b2b-4681-92e6-c154bbf6172c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:38.153852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-993ae11c-1b2b-4681-92e6-c154bbf6172c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:38.154478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-993ae11c-1b2b-4681-92e6-c154bbf6172c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:38.155539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-993ae11c-1b2b-4681-92e6-c154bbf6172c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:38.156153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-993ae11c-1b2b-4681-92e6-c154bbf6172c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:38.156731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-993ae11c-1b2b-4681-92e6-c154bbf6172c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:38.472119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-993ae11c-1b2b-4681-92e6-c154bbf6172c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:38.486297 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-993ae11c-1b2b-4681-92e6-c154bbf6172c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.358694 Aug 09 15:00:38.491232 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2482/4968] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:38 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:38.644035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d41c3b2-8686-44f0-b19c-282043345954 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:38.645270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d41c3b2-8686-44f0-b19c-282043345954 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:38.660493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d41c3b2-8686-44f0-b19c-282043345954 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:38.662335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d41c3b2-8686-44f0-b19c-282043345954 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:38.663193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d41c3b2-8686-44f0-b19c-282043345954 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:38.668011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d41c3b2-8686-44f0-b19c-282043345954 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:38.668711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d41c3b2-8686-44f0-b19c-282043345954 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:38.669460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d41c3b2-8686-44f0-b19c-282043345954 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:38.830811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9d41c3b2-8686-44f0-b19c-282043345954 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:38.843111 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d41c3b2-8686-44f0-b19c-282043345954 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1277 microversion: 2.1 time: 0.204799 Aug 09 15:00:38.848634 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2487/4969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:38 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:39.507784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-78f09345-6b3e-43f5-88a8-92c07a618ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:39.508410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-78f09345-6b3e-43f5-88a8-92c07a618ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:39.521377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78f09345-6b3e-43f5-88a8-92c07a618ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:39.528293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78f09345-6b3e-43f5-88a8-92c07a618ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:39.529149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78f09345-6b3e-43f5-88a8-92c07a618ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:39.533443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78f09345-6b3e-43f5-88a8-92c07a618ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:39.535456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78f09345-6b3e-43f5-88a8-92c07a618ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:39.537958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78f09345-6b3e-43f5-88a8-92c07a618ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:39.867705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-78f09345-6b3e-43f5-88a8-92c07a618ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:39.869168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23055bfc-6a98-41dc-a87e-095093e4e589 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:39.869861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-23055bfc-6a98-41dc-a87e-095093e4e589 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:39.880399 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-78f09345-6b3e-43f5-88a8-92c07a618ceb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.377127 Aug 09 15:00:39.883453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23055bfc-6a98-41dc-a87e-095093e4e589 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:39.884629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23055bfc-6a98-41dc-a87e-095093e4e589 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:39.887881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23055bfc-6a98-41dc-a87e-095093e4e589 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:39.889210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23055bfc-6a98-41dc-a87e-095093e4e589 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:39.889928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23055bfc-6a98-41dc-a87e-095093e4e589 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:39.890774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23055bfc-6a98-41dc-a87e-095093e4e589 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:39.902832 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2483/4970] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:39 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:40.200546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-23055bfc-6a98-41dc-a87e-095093e4e589 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:40.212125 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23055bfc-6a98-41dc-a87e-095093e4e589 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1319 microversion: 2.1 time: 0.346553 Aug 09 15:00:40.213572 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2488/4971] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:39 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:00:40.697706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-eb6eb3d7-a53c-434a-bd7b-a7e4260f3d5e req-7f912c06-7b29-4f19-b9b7-f1fd05494263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e6e74ae-a240-4ba4-b7c9-9112244ac190", "tag": "c4bf5853-ae26-4769-900e-f67523acb66d"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:00:40.734412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-eb6eb3d7-a53c-434a-bd7b-a7e4260f3d5e req-7f912c06-7b29-4f19-b9b7-f1fd05494263 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:40.734949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-eb6eb3d7-a53c-434a-bd7b-a7e4260f3d5e req-7f912c06-7b29-4f19-b9b7-f1fd05494263 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:40.736195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-eb6eb3d7-a53c-434a-bd7b-a7e4260f3d5e req-7f912c06-7b29-4f19-b9b7-f1fd05494263 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:40.771019 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-eb6eb3d7-a53c-434a-bd7b-a7e4260f3d5e req-7f912c06-7b29-4f19-b9b7-f1fd05494263 service nova] Creating event network-changed:c4bf5853-ae26-4769-900e-f67523acb66d for instance 5e6e74ae-a240-4ba4-b7c9-9112244ac190 on n-h1-844626-8 Aug 09 15:00:40.783069 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-eb6eb3d7-a53c-434a-bd7b-a7e4260f3d5e req-7f912c06-7b29-4f19-b9b7-f1fd05494263 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085258 Aug 09 15:00:40.786423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2484/4972] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:00:40.909649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5d8e5bb0-78b7-4dd1-a507-cf7a882eeea6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:40.911115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5d8e5bb0-78b7-4dd1-a507-cf7a882eeea6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:40.931884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d8e5bb0-78b7-4dd1-a507-cf7a882eeea6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:40.932965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d8e5bb0-78b7-4dd1-a507-cf7a882eeea6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:40.933764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d8e5bb0-78b7-4dd1-a507-cf7a882eeea6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:40.934816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d8e5bb0-78b7-4dd1-a507-cf7a882eeea6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:40.936852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d8e5bb0-78b7-4dd1-a507-cf7a882eeea6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:40.937733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5d8e5bb0-78b7-4dd1-a507-cf7a882eeea6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:41.235341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d51a927f-e621-491b-bb8e-42ed14052dec tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:41.236890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d51a927f-e621-491b-bb8e-42ed14052dec tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:41.256716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d51a927f-e621-491b-bb8e-42ed14052dec tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:41.260005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d51a927f-e621-491b-bb8e-42ed14052dec tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:41.260741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d51a927f-e621-491b-bb8e-42ed14052dec tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:41.263336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d51a927f-e621-491b-bb8e-42ed14052dec tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:41.264936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d51a927f-e621-491b-bb8e-42ed14052dec tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:41.266891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d51a927f-e621-491b-bb8e-42ed14052dec tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:41.492374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5d8e5bb0-78b7-4dd1-a507-cf7a882eeea6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:41.508502 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5d8e5bb0-78b7-4dd1-a507-cf7a882eeea6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.606455 Aug 09 15:00:41.511274 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2489/4973] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:40 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:41.770053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d51a927f-e621-491b-bb8e-42ed14052dec tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:41.781475 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d51a927f-e621-491b-bb8e-42ed14052dec tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1319 microversion: 2.1 time: 0.551563 Aug 09 15:00:41.795144 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2485/4974] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:41 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1319 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:42.534676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f7f89dd2-df64-4cd0-8428-1244be639fcd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:42.535346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7f89dd2-df64-4cd0-8428-1244be639fcd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:42.553346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7f89dd2-df64-4cd0-8428-1244be639fcd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:42.554031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7f89dd2-df64-4cd0-8428-1244be639fcd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:42.554489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7f89dd2-df64-4cd0-8428-1244be639fcd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:42.555270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7f89dd2-df64-4cd0-8428-1244be639fcd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:42.558800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7f89dd2-df64-4cd0-8428-1244be639fcd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:42.564376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7f89dd2-df64-4cd0-8428-1244be639fcd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:42.588672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:00:42.803352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-018528bb-3cda-4e52-a5f3-1ebdf41730cd tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:42.804597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-018528bb-3cda-4e52-a5f3-1ebdf41730cd tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:42.829561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-018528bb-3cda-4e52-a5f3-1ebdf41730cd tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:42.831639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-018528bb-3cda-4e52-a5f3-1ebdf41730cd tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:42.833830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-018528bb-3cda-4e52-a5f3-1ebdf41730cd tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:42.836280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-018528bb-3cda-4e52-a5f3-1ebdf41730cd tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:42.840674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-018528bb-3cda-4e52-a5f3-1ebdf41730cd tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:42.844258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-018528bb-3cda-4e52-a5f3-1ebdf41730cd tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:42.865169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:00:43.187669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f7f89dd2-df64-4cd0-8428-1244be639fcd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:43.208525 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f7f89dd2-df64-4cd0-8428-1244be639fcd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.675272 Aug 09 15:00:43.212732 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2490/4975] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:42 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:43.344495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-018528bb-3cda-4e52-a5f3-1ebdf41730cd tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:43.354390 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-018528bb-3cda-4e52-a5f3-1ebdf41730cd tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1319 microversion: 2.1 time: 0.555358 Aug 09 15:00:43.358862 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2486/4976] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:42 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1319 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:00:44.242241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-522d0672-7f94-44f2-9682-54008d002c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:44.243804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-522d0672-7f94-44f2-9682-54008d002c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:44.253824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=39 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:00:44.256371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-522d0672-7f94-44f2-9682-54008d002c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:44.257998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-522d0672-7f94-44f2-9682-54008d002c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:44.257998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-522d0672-7f94-44f2-9682-54008d002c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:44.258632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-522d0672-7f94-44f2-9682-54008d002c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:44.259504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-522d0672-7f94-44f2-9682-54008d002c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:44.260211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-522d0672-7f94-44f2-9682-54008d002c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:44.383284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ad48d42-1f1a-4ac4-a0b6-13222f82e75d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:44.385316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ad48d42-1f1a-4ac4-a0b6-13222f82e75d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:44.422729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:00:44.440980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ad48d42-1f1a-4ac4-a0b6-13222f82e75d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:44.442343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ad48d42-1f1a-4ac4-a0b6-13222f82e75d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:44.446542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ad48d42-1f1a-4ac4-a0b6-13222f82e75d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:44.450072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ad48d42-1f1a-4ac4-a0b6-13222f82e75d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:44.455933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ad48d42-1f1a-4ac4-a0b6-13222f82e75d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:44.455933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ad48d42-1f1a-4ac4-a0b6-13222f82e75d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:45.069448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-522d0672-7f94-44f2-9682-54008d002c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:45.079550 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-522d0672-7f94-44f2-9682-54008d002c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.845865 Aug 09 15:00:45.093250 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2491/4977] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:44 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:45.140532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ad48d42-1f1a-4ac4-a0b6-13222f82e75d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:45.151630 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ad48d42-1f1a-4ac4-a0b6-13222f82e75d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1319 microversion: 2.1 time: 0.774273 Aug 09 15:00:45.160607 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2487/4978] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:44 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1319 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:46.101903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b3a20c4-f2a9-4b6b-b540-1099faa09b30 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:46.102958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b3a20c4-f2a9-4b6b-b540-1099faa09b30 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:46.110685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b3a20c4-f2a9-4b6b-b540-1099faa09b30 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:46.111211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b3a20c4-f2a9-4b6b-b540-1099faa09b30 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:46.111657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b3a20c4-f2a9-4b6b-b540-1099faa09b30 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:46.112376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b3a20c4-f2a9-4b6b-b540-1099faa09b30 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:46.123577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b3a20c4-f2a9-4b6b-b540-1099faa09b30 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:46.124153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b3a20c4-f2a9-4b6b-b540-1099faa09b30 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:46.190793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f453e453-82b4-4ce8-b128-e98283354e63 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:46.191869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f453e453-82b4-4ce8-b128-e98283354e63 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:46.201026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:00:46.203884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:00:46.221083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f453e453-82b4-4ce8-b128-e98283354e63 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:46.221991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f453e453-82b4-4ce8-b128-e98283354e63 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:46.227176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f453e453-82b4-4ce8-b128-e98283354e63 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:46.231448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f453e453-82b4-4ce8-b128-e98283354e63 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:46.232193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f453e453-82b4-4ce8-b128-e98283354e63 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:46.232791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f453e453-82b4-4ce8-b128-e98283354e63 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:46.463872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:00:46.695681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f453e453-82b4-4ce8-b128-e98283354e63 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:46.706634 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f453e453-82b4-4ce8-b128-e98283354e63 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1319 microversion: 2.1 time: 0.526253 Aug 09 15:00:46.715952 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2488/4979] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:46 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1319 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:00:46.769586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b3a20c4-f2a9-4b6b-b540-1099faa09b30 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:46.785746 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b3a20c4-f2a9-4b6b-b540-1099faa09b30 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.684050 Aug 09 15:00:46.786519 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2492/4980] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:46 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:47.736792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-209d37d8-3975-4e30-bc28-3c9abb97eaf7 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:47.737397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-209d37d8-3975-4e30-bc28-3c9abb97eaf7 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:47.752079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-209d37d8-3975-4e30-bc28-3c9abb97eaf7 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:47.752756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-209d37d8-3975-4e30-bc28-3c9abb97eaf7 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:47.755014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-209d37d8-3975-4e30-bc28-3c9abb97eaf7 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:47.756189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-209d37d8-3975-4e30-bc28-3c9abb97eaf7 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:47.757480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-209d37d8-3975-4e30-bc28-3c9abb97eaf7 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:47.758525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-209d37d8-3975-4e30-bc28-3c9abb97eaf7 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:47.767009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-c1fed5db-f4a8-41b7-b8f8-012666600d8b req-7ec1846a-28d5-4095-b5f2-174edb73d18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6e74ae-a240-4ba4-b7c9-9112244ac190", "name": "network-vif-plugged", "status": "completed", "tag": "c4bf5853-ae26-4769-900e-f67523acb66d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:00:47.812432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c1fed5db-f4a8-41b7-b8f8-012666600d8b req-7ec1846a-28d5-4095-b5f2-174edb73d18c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:47.818959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c1fed5db-f4a8-41b7-b8f8-012666600d8b req-7ec1846a-28d5-4095-b5f2-174edb73d18c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:47.820303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c1fed5db-f4a8-41b7-b8f8-012666600d8b req-7ec1846a-28d5-4095-b5f2-174edb73d18c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:47.877422 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-c1fed5db-f4a8-41b7-b8f8-012666600d8b req-7ec1846a-28d5-4095-b5f2-174edb73d18c service nova] Creating event network-vif-plugged:c4bf5853-ae26-4769-900e-f67523acb66d for instance 5e6e74ae-a240-4ba4-b7c9-9112244ac190 on n-h1-844626-8 Aug 09 15:00:47.892953 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-c1fed5db-f4a8-41b7-b8f8-012666600d8b req-7ec1846a-28d5-4095-b5f2-174edb73d18c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131038 Aug 09 15:00:47.896309 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2493/4981] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:00:47.904153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dcc15ef7-4518-4660-b60d-35cb2d1c1069 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:47.905846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dcc15ef7-4518-4660-b60d-35cb2d1c1069 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:47.914974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc15ef7-4518-4660-b60d-35cb2d1c1069 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:47.916116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc15ef7-4518-4660-b60d-35cb2d1c1069 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:47.916754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc15ef7-4518-4660-b60d-35cb2d1c1069 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:47.917658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc15ef7-4518-4660-b60d-35cb2d1c1069 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:47.918274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc15ef7-4518-4660-b60d-35cb2d1c1069 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:47.918852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcc15ef7-4518-4660-b60d-35cb2d1c1069 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:48.213954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-209d37d8-3975-4e30-bc28-3c9abb97eaf7 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:48.232574 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-209d37d8-3975-4e30-bc28-3c9abb97eaf7 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1319 microversion: 2.1 time: 0.499558 Aug 09 15:00:48.235217 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2489/4982] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:47 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1319 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:48.254321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dcc15ef7-4518-4660-b60d-35cb2d1c1069 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:48.263024 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dcc15ef7-4518-4660-b60d-35cb2d1c1069 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.364335 Aug 09 15:00:48.264933 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2494/4983] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:47 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:49.262023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-46528d86-1eb5-4a88-9bf4-3cca82938202 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:49.262647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-46528d86-1eb5-4a88-9bf4-3cca82938202 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:49.282662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46528d86-1eb5-4a88-9bf4-3cca82938202 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:49.283476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46528d86-1eb5-4a88-9bf4-3cca82938202 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:49.284117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46528d86-1eb5-4a88-9bf4-3cca82938202 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:49.285224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46528d86-1eb5-4a88-9bf4-3cca82938202 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:49.285842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46528d86-1eb5-4a88-9bf4-3cca82938202 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:49.286090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e74814f3-194d-4d1d-bb01-b3a1a17d3a56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:49.289545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e74814f3-194d-4d1d-bb01-b3a1a17d3a56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:49.293525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46528d86-1eb5-4a88-9bf4-3cca82938202 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:49.312994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e74814f3-194d-4d1d-bb01-b3a1a17d3a56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:49.313480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e74814f3-194d-4d1d-bb01-b3a1a17d3a56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:49.313913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e74814f3-194d-4d1d-bb01-b3a1a17d3a56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:49.326059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e74814f3-194d-4d1d-bb01-b3a1a17d3a56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:49.326541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e74814f3-194d-4d1d-bb01-b3a1a17d3a56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:49.326968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e74814f3-194d-4d1d-bb01-b3a1a17d3a56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:49.870192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46528d86-1eb5-4a88-9bf4-3cca82938202 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:49.884118 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-46528d86-1eb5-4a88-9bf4-3cca82938202 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1319 microversion: 2.1 time: 0.628545 Aug 09 15:00:49.887691 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2490/4984] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:49 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1319 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:49.910933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e74814f3-194d-4d1d-bb01-b3a1a17d3a56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:49.928687 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e74814f3-194d-4d1d-bb01-b3a1a17d3a56 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.647031 Aug 09 15:00:49.951598 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2495/4985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:49 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:00:50.910249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef9ec4a4-0251-4f60-8b2a-965b654672f3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:50.911046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef9ec4a4-0251-4f60-8b2a-965b654672f3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:50.927318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef9ec4a4-0251-4f60-8b2a-965b654672f3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:50.928219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef9ec4a4-0251-4f60-8b2a-965b654672f3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:50.930498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef9ec4a4-0251-4f60-8b2a-965b654672f3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:50.933760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef9ec4a4-0251-4f60-8b2a-965b654672f3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:50.934678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef9ec4a4-0251-4f60-8b2a-965b654672f3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:50.935599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef9ec4a4-0251-4f60-8b2a-965b654672f3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:50.951030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d3785e7-cc0b-4904-b861-41b049316067 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:50.952715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d3785e7-cc0b-4904-b861-41b049316067 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:50.966929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d3785e7-cc0b-4904-b861-41b049316067 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:50.967860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d3785e7-cc0b-4904-b861-41b049316067 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:50.969288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d3785e7-cc0b-4904-b861-41b049316067 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:50.973026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d3785e7-cc0b-4904-b861-41b049316067 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:50.974143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d3785e7-cc0b-4904-b861-41b049316067 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:50.975724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d3785e7-cc0b-4904-b861-41b049316067 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:51.435504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d3785e7-cc0b-4904-b861-41b049316067 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:51.448087 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d3785e7-cc0b-4904-b861-41b049316067 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.501702 Aug 09 15:00:51.458467 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2496/4986] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:50 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:00:51.476837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef9ec4a4-0251-4f60-8b2a-965b654672f3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:51.488108 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef9ec4a4-0251-4f60-8b2a-965b654672f3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1508 microversion: 2.1 time: 0.582072 Aug 09 15:00:51.493846 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2491/4987] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:50 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1508 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:52.482122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9212bd4c-efab-4517-ac5a-4eaf7410c41b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:52.483501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9212bd4c-efab-4517-ac5a-4eaf7410c41b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:52.497734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9212bd4c-efab-4517-ac5a-4eaf7410c41b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:52.499646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9212bd4c-efab-4517-ac5a-4eaf7410c41b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:52.501488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9212bd4c-efab-4517-ac5a-4eaf7410c41b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:52.503043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9212bd4c-efab-4517-ac5a-4eaf7410c41b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:52.504971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9212bd4c-efab-4517-ac5a-4eaf7410c41b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:52.506223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9212bd4c-efab-4517-ac5a-4eaf7410c41b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:52.819991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9212bd4c-efab-4517-ac5a-4eaf7410c41b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:52.837640 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9212bd4c-efab-4517-ac5a-4eaf7410c41b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.359472 Aug 09 15:00:52.839529 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2497/4988] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:52 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:53.866764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-635b922e-4575-4f89-a6e2-938738df73a9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:53.867422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-635b922e-4575-4f89-a6e2-938738df73a9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:53.893146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-635b922e-4575-4f89-a6e2-938738df73a9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:53.912565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-635b922e-4575-4f89-a6e2-938738df73a9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:53.913218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-635b922e-4575-4f89-a6e2-938738df73a9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:53.919648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-635b922e-4575-4f89-a6e2-938738df73a9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:53.920818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-635b922e-4575-4f89-a6e2-938738df73a9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:53.927920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-635b922e-4575-4f89-a6e2-938738df73a9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:54.574847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-635b922e-4575-4f89-a6e2-938738df73a9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:54.642002 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-635b922e-4575-4f89-a6e2-938738df73a9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.779522 Aug 09 15:00:54.651375 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2492/4989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:53 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:55.673195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d020fc3-9ef2-4657-a82e-cbd2728e299c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:55.674130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3d020fc3-9ef2-4657-a82e-cbd2728e299c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:55.687830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d020fc3-9ef2-4657-a82e-cbd2728e299c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:55.688313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d020fc3-9ef2-4657-a82e-cbd2728e299c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:55.700581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d020fc3-9ef2-4657-a82e-cbd2728e299c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:55.701717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d020fc3-9ef2-4657-a82e-cbd2728e299c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:55.705603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d020fc3-9ef2-4657-a82e-cbd2728e299c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:55.706291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d020fc3-9ef2-4657-a82e-cbd2728e299c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:56.053726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3d020fc3-9ef2-4657-a82e-cbd2728e299c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:56.070306 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3d020fc3-9ef2-4657-a82e-cbd2728e299c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1678 microversion: 2.1 time: 0.398878 Aug 09 15:00:56.071733 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2498/4990] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:55 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1678 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:57.105317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-68aeb527-4af8-4249-86ff-0f7716a8be57 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:57.106127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-68aeb527-4af8-4249-86ff-0f7716a8be57 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:57.145597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68aeb527-4af8-4249-86ff-0f7716a8be57 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:57.148156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68aeb527-4af8-4249-86ff-0f7716a8be57 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:57.150179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68aeb527-4af8-4249-86ff-0f7716a8be57 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:57.151343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68aeb527-4af8-4249-86ff-0f7716a8be57 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:57.153079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68aeb527-4af8-4249-86ff-0f7716a8be57 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:57.155198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68aeb527-4af8-4249-86ff-0f7716a8be57 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:57.568908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-68aeb527-4af8-4249-86ff-0f7716a8be57 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:57.577598 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-68aeb527-4af8-4249-86ff-0f7716a8be57 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.486199 Aug 09 15:00:57.601015 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2493/4991] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:57 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:00:59.027255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7916dc7e-f9a6-46be-9cd1-e310629f5bc6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:00:59.029004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7916dc7e-f9a6-46be-9cd1-e310629f5bc6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:00:59.047074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7916dc7e-f9a6-46be-9cd1-e310629f5bc6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:59.048050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7916dc7e-f9a6-46be-9cd1-e310629f5bc6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:59.049991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7916dc7e-f9a6-46be-9cd1-e310629f5bc6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:59.055006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7916dc7e-f9a6-46be-9cd1-e310629f5bc6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:00:59.067167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7916dc7e-f9a6-46be-9cd1-e310629f5bc6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:00:59.067725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7916dc7e-f9a6-46be-9cd1-e310629f5bc6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:00:59.353936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7916dc7e-f9a6-46be-9cd1-e310629f5bc6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:00:59.364079 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7916dc7e-f9a6-46be-9cd1-e310629f5bc6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.340866 Aug 09 15:00:59.365018 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2499/4992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:00:59 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:00.924467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b0d1a6c0-6da7-4a26-86ed-a64291fa3908 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:00.925223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b0d1a6c0-6da7-4a26-86ed-a64291fa3908 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:00.938819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0d1a6c0-6da7-4a26-86ed-a64291fa3908 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:00.940354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0d1a6c0-6da7-4a26-86ed-a64291fa3908 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:00.942199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0d1a6c0-6da7-4a26-86ed-a64291fa3908 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:00.944952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0d1a6c0-6da7-4a26-86ed-a64291fa3908 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:00.946329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0d1a6c0-6da7-4a26-86ed-a64291fa3908 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:00.946678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b0d1a6c0-6da7-4a26-86ed-a64291fa3908 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:01.189021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b0d1a6c0-6da7-4a26-86ed-a64291fa3908 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:01.205492 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b0d1a6c0-6da7-4a26-86ed-a64291fa3908 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.286450 Aug 09 15:01:01.206103 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2494/4993] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:00 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:01.232393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7173c4cc-c538-4f6b-a1a0-5a66a61c581f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:01.234605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7173c4cc-c538-4f6b-a1a0-5a66a61c581f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:01.248403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7173c4cc-c538-4f6b-a1a0-5a66a61c581f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:01.248987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7173c4cc-c538-4f6b-a1a0-5a66a61c581f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:01.250426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7173c4cc-c538-4f6b-a1a0-5a66a61c581f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:01.252294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7173c4cc-c538-4f6b-a1a0-5a66a61c581f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:01.252975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7173c4cc-c538-4f6b-a1a0-5a66a61c581f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:01.253809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7173c4cc-c538-4f6b-a1a0-5a66a61c581f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:01.507385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7173c4cc-c538-4f6b-a1a0-5a66a61c581f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:01.519416 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7173c4cc-c538-4f6b-a1a0-5a66a61c581f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.293626 Aug 09 15:01:01.523191 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2500/4994] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:01 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:01.547553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c6eb74b-4274-4cd6-928a-5fde9ddcb127 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:01.559832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c6eb74b-4274-4cd6-928a-5fde9ddcb127 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:01.584154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c6eb74b-4274-4cd6-928a-5fde9ddcb127 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:01.587276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c6eb74b-4274-4cd6-928a-5fde9ddcb127 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:01.588373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c6eb74b-4274-4cd6-928a-5fde9ddcb127 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:01.591333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c6eb74b-4274-4cd6-928a-5fde9ddcb127 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:01.604300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c6eb74b-4274-4cd6-928a-5fde9ddcb127 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:01.605293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c6eb74b-4274-4cd6-928a-5fde9ddcb127 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:01.865242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-fd0772a8-edca-4635-a92a-54f18bed3223 req-d92163e4-2dab-471a-946d-a9e0ce368712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a67196-2e15-47e5-8877-e75e8d4609c7", "name": "network-vif-unplugged", "status": "completed", "tag": "d15f67e8-ba7f-4681-bd12-a57303ad56da"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:01.885994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fd0772a8-edca-4635-a92a-54f18bed3223 req-d92163e4-2dab-471a-946d-a9e0ce368712 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:01.886760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fd0772a8-edca-4635-a92a-54f18bed3223 req-d92163e4-2dab-471a-946d-a9e0ce368712 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:01.888464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fd0772a8-edca-4635-a92a-54f18bed3223 req-d92163e4-2dab-471a-946d-a9e0ce368712 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:01.932649 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-fd0772a8-edca-4635-a92a-54f18bed3223 req-d92163e4-2dab-471a-946d-a9e0ce368712 service nova] Creating event network-vif-unplugged:d15f67e8-ba7f-4681-bd12-a57303ad56da for instance f6a67196-2e15-47e5-8877-e75e8d4609c7 on n-h2-844626-8 Aug 09 15:01:01.940958 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-fd0772a8-edca-4635-a92a-54f18bed3223 req-d92163e4-2dab-471a-946d-a9e0ce368712 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086548 Aug 09 15:01:01.942151 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2501/4995] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:01:02.012040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c6eb74b-4274-4cd6-928a-5fde9ddcb127 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:02.028239 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c6eb74b-4274-4cd6-928a-5fde9ddcb127 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.485609 Aug 09 15:01:02.029576 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2495/4996] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:01 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:02.055078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0f05c128-28fd-49ea-bbaf-0e64bcfa07b7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:02.060916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0f05c128-28fd-49ea-bbaf-0e64bcfa07b7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:02.079335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f05c128-28fd-49ea-bbaf-0e64bcfa07b7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:02.079463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f05c128-28fd-49ea-bbaf-0e64bcfa07b7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:02.079810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f05c128-28fd-49ea-bbaf-0e64bcfa07b7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:02.080514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f05c128-28fd-49ea-bbaf-0e64bcfa07b7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:02.080959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f05c128-28fd-49ea-bbaf-0e64bcfa07b7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:02.081380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0f05c128-28fd-49ea-bbaf-0e64bcfa07b7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:02.194087 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0f05c128-28fd-49ea-bbaf-0e64bcfa07b7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.142987 Aug 09 15:01:02.198122 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2502/4997] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:01:02 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:01:02.208078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-611beb9f-7810-419a-959e-3cf9a920155a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:02.209742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-611beb9f-7810-419a-959e-3cf9a920155a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:02.221186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-611beb9f-7810-419a-959e-3cf9a920155a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:02.222060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-611beb9f-7810-419a-959e-3cf9a920155a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:02.222705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-611beb9f-7810-419a-959e-3cf9a920155a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:02.224452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-611beb9f-7810-419a-959e-3cf9a920155a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:02.225128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-611beb9f-7810-419a-959e-3cf9a920155a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:02.225715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-611beb9f-7810-419a-959e-3cf9a920155a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:02.767426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-611beb9f-7810-419a-959e-3cf9a920155a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:02.778121 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-611beb9f-7810-419a-959e-3cf9a920155a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1667 microversion: 2.1 time: 0.576972 Aug 09 15:01:02.779059 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2496/4998] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:02 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1667 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:01:03.801436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2744d3f2-da25-4c68-9c7c-3ea491b7b3cf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:03.802803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2744d3f2-da25-4c68-9c7c-3ea491b7b3cf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:03.818551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2744d3f2-da25-4c68-9c7c-3ea491b7b3cf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:03.819118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2744d3f2-da25-4c68-9c7c-3ea491b7b3cf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:03.832180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2744d3f2-da25-4c68-9c7c-3ea491b7b3cf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:03.833051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2744d3f2-da25-4c68-9c7c-3ea491b7b3cf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:03.833705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2744d3f2-da25-4c68-9c7c-3ea491b7b3cf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:03.834214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2744d3f2-da25-4c68-9c7c-3ea491b7b3cf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:04.187530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2744d3f2-da25-4c68-9c7c-3ea491b7b3cf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:04.203954 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2744d3f2-da25-4c68-9c7c-3ea491b7b3cf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1667 microversion: 2.1 time: 0.407652 Aug 09 15:01:04.204639 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2503/4999] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:03 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1667 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:05.197479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a516772-a858-408d-aa50-e32487fbca02 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:05.201788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a516772-a858-408d-aa50-e32487fbca02 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:05.222114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a516772-a858-408d-aa50-e32487fbca02 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:05.222837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a516772-a858-408d-aa50-e32487fbca02 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:05.223774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a516772-a858-408d-aa50-e32487fbca02 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:05.225988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a516772-a858-408d-aa50-e32487fbca02 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:05.226397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f24ffd16-d90e-47b3-8389-35f007bb0361 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:05.226881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a516772-a858-408d-aa50-e32487fbca02 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:05.226988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a516772-a858-408d-aa50-e32487fbca02 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:05.227077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f24ffd16-d90e-47b3-8389-35f007bb0361 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:05.251966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f24ffd16-d90e-47b3-8389-35f007bb0361 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:05.252467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f24ffd16-d90e-47b3-8389-35f007bb0361 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:05.252905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f24ffd16-d90e-47b3-8389-35f007bb0361 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:05.253627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f24ffd16-d90e-47b3-8389-35f007bb0361 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:05.254080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f24ffd16-d90e-47b3-8389-35f007bb0361 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:05.254504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f24ffd16-d90e-47b3-8389-35f007bb0361 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:05.315740 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a516772-a858-408d-aa50-e32487fbca02 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126218 Aug 09 15:01:05.316691 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2497/5000] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:01:05 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:01:05.410087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a3d0cc9-49d6-4c2d-b44e-0c40f4485775 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:05.410654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a3d0cc9-49d6-4c2d-b44e-0c40f4485775 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:05.424941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a3d0cc9-49d6-4c2d-b44e-0c40f4485775 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:05.428375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a3d0cc9-49d6-4c2d-b44e-0c40f4485775 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:05.428932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a3d0cc9-49d6-4c2d-b44e-0c40f4485775 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:05.430824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a3d0cc9-49d6-4c2d-b44e-0c40f4485775 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:05.433295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a3d0cc9-49d6-4c2d-b44e-0c40f4485775 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:05.434121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a3d0cc9-49d6-4c2d-b44e-0c40f4485775 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:05.488037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a3d0cc9-49d6-4c2d-b44e-0c40f4485775 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:01:05.583991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f24ffd16-d90e-47b3-8389-35f007bb0361 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:05.598574 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f24ffd16-d90e-47b3-8389-35f007bb0361 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.374078 Aug 09 15:01:05.599505 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2504/5001] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:05 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:05.624974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72ff17fd-ca6a-48c3-8428-d8671bb2ee75 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:05.634656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-72ff17fd-ca6a-48c3-8428-d8671bb2ee75 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:05.642094 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a3d0cc9-49d6-4c2d-b44e-0c40f4485775 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "DELETE /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 204 len: 0 microversion: 2.1 time: 0.236744 Aug 09 15:01:05.643357 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2498/5002] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:01:05 2022] DELETE /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 15:01:05.652060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72ff17fd-ca6a-48c3-8428-d8671bb2ee75 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:05.653500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72ff17fd-ca6a-48c3-8428-d8671bb2ee75 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:05.655400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ea46e4d-8a6f-4177-a649-560728435861 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:05.656024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72ff17fd-ca6a-48c3-8428-d8671bb2ee75 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:05.657044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72ff17fd-ca6a-48c3-8428-d8671bb2ee75 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:05.657898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1ea46e4d-8a6f-4177-a649-560728435861 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:05.658614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72ff17fd-ca6a-48c3-8428-d8671bb2ee75 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:05.659735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72ff17fd-ca6a-48c3-8428-d8671bb2ee75 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:05.674378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ea46e4d-8a6f-4177-a649-560728435861 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:05.675254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ea46e4d-8a6f-4177-a649-560728435861 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:05.676579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ea46e4d-8a6f-4177-a649-560728435861 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:05.680394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ea46e4d-8a6f-4177-a649-560728435861 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:05.681194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ea46e4d-8a6f-4177-a649-560728435861 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:05.681874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ea46e4d-8a6f-4177-a649-560728435861 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:05.909867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1ea46e4d-8a6f-4177-a649-560728435861 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:05.923862 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1ea46e4d-8a6f-4177-a649-560728435861 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1674 microversion: 2.1 time: 0.274841 Aug 09 15:01:05.924697 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2499/5003] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:05 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1674 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:01:06.946559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca8cf49c-3ddd-4be5-9d92-cb480f86f3a3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:06.947273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca8cf49c-3ddd-4be5-9d92-cb480f86f3a3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:06.960061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca8cf49c-3ddd-4be5-9d92-cb480f86f3a3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:06.960884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca8cf49c-3ddd-4be5-9d92-cb480f86f3a3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:06.966600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca8cf49c-3ddd-4be5-9d92-cb480f86f3a3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:06.967509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca8cf49c-3ddd-4be5-9d92-cb480f86f3a3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:06.967976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca8cf49c-3ddd-4be5-9d92-cb480f86f3a3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:06.981171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca8cf49c-3ddd-4be5-9d92-cb480f86f3a3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:07.360010 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72ff17fd-ca6a-48c3-8428-d8671bb2ee75 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 200 len: 322 microversion: 2.1 time: 1.739206 Aug 09 15:01:07.365176 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2505/5004] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:01:05 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 322 bytes in 1742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:01:07.370367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca8cf49c-3ddd-4be5-9d92-cb480f86f3a3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:07.371449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f557a2fc-6dba-4bb7-ae35-7c212b6d77bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:07.374206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f557a2fc-6dba-4bb7-ae35-7c212b6d77bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:07.386604 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca8cf49c-3ddd-4be5-9d92-cb480f86f3a3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1674 microversion: 2.1 time: 0.442794 Aug 09 15:01:07.391852 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2500/5005] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:06 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1674 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:07.397169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f557a2fc-6dba-4bb7-ae35-7c212b6d77bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:07.399531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f557a2fc-6dba-4bb7-ae35-7c212b6d77bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:07.402283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f557a2fc-6dba-4bb7-ae35-7c212b6d77bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:07.403346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f557a2fc-6dba-4bb7-ae35-7c212b6d77bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:07.406614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f557a2fc-6dba-4bb7-ae35-7c212b6d77bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:07.407336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f557a2fc-6dba-4bb7-ae35-7c212b6d77bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:07.599618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f557a2fc-6dba-4bb7-ae35-7c212b6d77bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:07.612786 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f557a2fc-6dba-4bb7-ae35-7c212b6d77bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.246030 Aug 09 15:01:07.614092 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2506/5006] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:07 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:07.637376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7e4c85ba-d594-442c-9830-9cfe518af5df tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:07.638359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7e4c85ba-d594-442c-9830-9cfe518af5df tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:07.649833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e4c85ba-d594-442c-9830-9cfe518af5df tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:07.650339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e4c85ba-d594-442c-9830-9cfe518af5df tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:07.650773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e4c85ba-d594-442c-9830-9cfe518af5df tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:07.653590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e4c85ba-d594-442c-9830-9cfe518af5df tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:07.655052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e4c85ba-d594-442c-9830-9cfe518af5df tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:07.656531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e4c85ba-d594-442c-9830-9cfe518af5df tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:07.664162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:01:08.192961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7e4c85ba-d594-442c-9830-9cfe518af5df tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:08.203476 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7e4c85ba-d594-442c-9830-9cfe518af5df tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.570407 Aug 09 15:01:08.204245 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2501/5007] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:07 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:08.236662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6dc449c5-3cbf-471b-8697-7c4c367535e7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:08.237283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6dc449c5-3cbf-471b-8697-7c4c367535e7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:08.257221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6dc449c5-3cbf-471b-8697-7c4c367535e7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:08.261730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6dc449c5-3cbf-471b-8697-7c4c367535e7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:08.262454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6dc449c5-3cbf-471b-8697-7c4c367535e7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:08.263902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6dc449c5-3cbf-471b-8697-7c4c367535e7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:08.264736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6dc449c5-3cbf-471b-8697-7c4c367535e7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:08.266752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6dc449c5-3cbf-471b-8697-7c4c367535e7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:08.320015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:01:08.413410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-92df2915-bbd8-48d1-8637-3f08f31821b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:08.414058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-92df2915-bbd8-48d1-8637-3f08f31821b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:08.424529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92df2915-bbd8-48d1-8637-3f08f31821b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:08.430031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92df2915-bbd8-48d1-8637-3f08f31821b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:08.430606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92df2915-bbd8-48d1-8637-3f08f31821b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:08.431365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92df2915-bbd8-48d1-8637-3f08f31821b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:08.437269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92df2915-bbd8-48d1-8637-3f08f31821b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:08.442811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92df2915-bbd8-48d1-8637-3f08f31821b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:09.366815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6dc449c5-3cbf-471b-8697-7c4c367535e7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:09.384597 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6dc449c5-3cbf-471b-8697-7c4c367535e7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 1.154737 Aug 09 15:01:09.398664 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2507/5008] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:08 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:09.412819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-55f82571-c33f-4b55-9d42-e154b516babb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:09.413695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-55f82571-c33f-4b55-9d42-e154b516babb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:09.425302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55f82571-c33f-4b55-9d42-e154b516babb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:09.427034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55f82571-c33f-4b55-9d42-e154b516babb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:09.428673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55f82571-c33f-4b55-9d42-e154b516babb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:09.429582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55f82571-c33f-4b55-9d42-e154b516babb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:09.432451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55f82571-c33f-4b55-9d42-e154b516babb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:09.433160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-55f82571-c33f-4b55-9d42-e154b516babb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:09.498494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-92df2915-bbd8-48d1-8637-3f08f31821b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:09.512190 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-92df2915-bbd8-48d1-8637-3f08f31821b5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1674 microversion: 2.1 time: 1.103575 Aug 09 15:01:09.522217 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2502/5009] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:08 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1674 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:09.828852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-55f82571-c33f-4b55-9d42-e154b516babb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:09.837182 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-55f82571-c33f-4b55-9d42-e154b516babb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.430773 Aug 09 15:01:09.845948 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2508/5010] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:09 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:10.166417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1066207627", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "aac61d64-db55-4d08-906a-2788d0f45a74"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:10.336901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] validate_networks() for [('aac61d64-db55-4d08-906a-2788d0f45a74', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:01:10.538138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-76d6c346-21d5-40fc-b21d-260d5a5593ba tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:10.538755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-76d6c346-21d5-40fc-b21d-260d5a5593ba tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:10.558595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76d6c346-21d5-40fc-b21d-260d5a5593ba tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:10.567667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76d6c346-21d5-40fc-b21d-260d5a5593ba tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:10.569074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76d6c346-21d5-40fc-b21d-260d5a5593ba tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:10.570526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76d6c346-21d5-40fc-b21d-260d5a5593ba tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:10.572773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76d6c346-21d5-40fc-b21d-260d5a5593ba tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:10.583846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76d6c346-21d5-40fc-b21d-260d5a5593ba tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:10.939387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-76d6c346-21d5-40fc-b21d-260d5a5593ba tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:10.986566 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-76d6c346-21d5-40fc-b21d-260d5a5593ba tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 200 len: 1606 microversion: 2.1 time: 0.452575 Aug 09 15:01:10.988590 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2509/5011] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:10 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 1606 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:11.225687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2535ff4f-421b-4ffc-897e-ba664f7e75d3 req-5f104deb-ccea-4769-ac4a-7633ae301c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ec66f1-8b80-40ad-8cfe-95852fda1792", "name": "network-vif-deleted", "tag": "77439503-b833-4326-891e-d1c12af8d4ef"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:11.255020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2535ff4f-421b-4ffc-897e-ba664f7e75d3 req-5f104deb-ccea-4769-ac4a-7633ae301c97 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:11.257140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2535ff4f-421b-4ffc-897e-ba664f7e75d3 req-5f104deb-ccea-4769-ac4a-7633ae301c97 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:11.257527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2535ff4f-421b-4ffc-897e-ba664f7e75d3 req-5f104deb-ccea-4769-ac4a-7633ae301c97 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:11.288129 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2535ff4f-421b-4ffc-897e-ba664f7e75d3 req-5f104deb-ccea-4769-ac4a-7633ae301c97 service nova] Creating event network-vif-deleted:77439503-b833-4326-891e-d1c12af8d4ef for instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 on n-h2-844626-8 Aug 09 15:01:11.302204 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2535ff4f-421b-4ffc-897e-ba664f7e75d3 req-5f104deb-ccea-4769-ac4a-7633ae301c97 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080386 Aug 09 15:01:11.305172 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2510/5012] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:01:11.541218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:01:11.541786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:01:11.542419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:01:11.543131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:01:11.543749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:01:11.563206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:11.563968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:11.564635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:11.565630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:11.566272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:11.566881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:11.612853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Getting quotas for project 891029e759ac441f8a08c38bca92be81. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:01:11.628235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Getting quotas for user 3da785ddf56e4b028c6647643d97c952 and project 891029e759ac441f8a08c38bca92be81. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:01:11.665314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:01:11.685310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:01:11.787227 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9655a5bd-6727-4cba-9cfb-83429240f186 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.623358 Aug 09 15:01:11.793619 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2503/5013] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:01:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:01:11.801948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d945dea3-6892-45d5-abd1-799a86741275 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:11.803385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d945dea3-6892-45d5-abd1-799a86741275 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:12.012695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6079acbe-bdb2-487e-9d37-0bf8ff59435e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:12.013675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6079acbe-bdb2-487e-9d37-0bf8ff59435e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:12.015430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d945dea3-6892-45d5-abd1-799a86741275 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:12.024674 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d945dea3-6892-45d5-abd1-799a86741275 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1215 microversion: 2.1 time: 0.228469 Aug 09 15:01:12.036589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6079acbe-bdb2-487e-9d37-0bf8ff59435e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:12.036589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6079acbe-bdb2-487e-9d37-0bf8ff59435e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:12.037477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6079acbe-bdb2-487e-9d37-0bf8ff59435e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:12.037897 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2511/5014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:11 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:12.043333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6079acbe-bdb2-487e-9d37-0bf8ff59435e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:12.049479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6079acbe-bdb2-487e-9d37-0bf8ff59435e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:12.049944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6079acbe-bdb2-487e-9d37-0bf8ff59435e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:12.097395 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6079acbe-bdb2-487e-9d37-0bf8ff59435e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] HTTP exception thrown: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6079acbe-bdb2-487e-9d37-0bf8ff59435e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Request method failure captured: Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 HTTP/1.1 Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nXQWH6g5t52QIlGq_543lnbQi7Dsjdih208ynSgQf3qtVZv5fmEGnGOJI53RPi6MTHKAW03j5SNiiuLg-taeOlbbVXg6xFuvkek88Wj3FldkHhnmoT4YkomKWMKcPHhAZ_W34ZwfYslfvRFwcdlqrlpiruA7er3Ase8S2W426qJy9Q Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f63d01743846420d9f081b7f8b73c5d2 Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f63d01743846420d9f081b7f8b73c5d2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f63d01743846420d9f081b7f8b73c5d2 Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AttachVolumeTestJSON-391021225-project Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 9b8154cdb1a64b4894811af2cea904cb Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeTestJSON-391021225-project Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '22ec66f1-8b80-40ad-8cfe-95852fda1792'} Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:01:12.098169 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:01:12.102575 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:01:12.102575 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:01:12.102575 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:01:12.102575 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:01:12.102575 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:01:12.102575 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:01:12.102575 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:01:12.102575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6079acbe-bdb2-487e-9d37-0bf8ff59435e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Returning 404 to user: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:01:12.102575 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6079acbe-bdb2-487e-9d37-0bf8ff59435e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 404 len: 111 microversion: 2.1 time: 0.091789 Aug 09 15:01:12.104106 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2504/5015] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:12 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:01:12.110342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f4896cb5-a760-4dca-bc27-046260f7372e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '.version_select at 0x7f41dd40bee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:12.167481 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f4896cb5-a760-4dca-bc27-046260f7372e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125897502" status: 202 len: 0 microversion: 2.1 time: 0.061783 Aug 09 15:01:12.171337 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2512/5016] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 15:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125897502 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:01:13.047945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c378e4fd-8ccd-4370-9152-adef118183f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:13.048575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c378e4fd-8ccd-4370-9152-adef118183f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:13.335244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c378e4fd-8ccd-4370-9152-adef118183f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:13.360775 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c378e4fd-8ccd-4370-9152-adef118183f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1215 microversion: 2.1 time: 0.314265 Aug 09 15:01:13.381512 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2505/5017] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:13 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1215 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:13.718331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2386cd5-3b57-4821-a873-b68ec4bff21a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Action: 'create', calling method: .version_select at 0x7f41dd337ca0>, body: {"keypair": {"name": "tempest-keypair-271422482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChprpv0WHVe9FdX3JCtXw5XES/F5Nu+a9UFJ6O2iHuVTU5Gk0PUZa/hL8W/YAtGgw4sGZVqgW6+3yPRUKmPHTX0jTf9tkdFx2C/3r9teqZQYL1kemX+DEazDmE4/Aizlg=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:13.744401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c2386cd5-3b57-4821-a873-b68ec4bff21a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Getting quotas for project f63d01743846420d9f081b7f8b73c5d2. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:01:13.751045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c2386cd5-3b57-4821-a873-b68ec4bff21a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Getting quotas for user 9b8154cdb1a64b4894811af2cea904cb and project f63d01743846420d9f081b7f8b73c5d2. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:01:13.795396 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2386cd5-3b57-4821-a873-b68ec4bff21a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078489 Aug 09 15:01:13.797111 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2513/5018] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:01:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:01:14.389000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a543d2c9-4fbe-4ad0-8454-d9b2ed56f4dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:14.390531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a543d2c9-4fbe-4ad0-8454-d9b2ed56f4dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:15.286571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:01:15.308161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a543d2c9-4fbe-4ad0-8454-d9b2ed56f4dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:15.309486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a543d2c9-4fbe-4ad0-8454-d9b2ed56f4dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:15.311160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a543d2c9-4fbe-4ad0-8454-d9b2ed56f4dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:15.314662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a543d2c9-4fbe-4ad0-8454-d9b2ed56f4dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:15.315614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a543d2c9-4fbe-4ad0-8454-d9b2ed56f4dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:15.316782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a543d2c9-4fbe-4ad0-8454-d9b2ed56f4dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:15.618070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a543d2c9-4fbe-4ad0-8454-d9b2ed56f4dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:15.636413 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a543d2c9-4fbe-4ad0-8454-d9b2ed56f4dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1273 microversion: 2.1 time: 1.247069 Aug 09 15:01:15.655055 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2506/5019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:14 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1273 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:16.663054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d395eab0-2f86-45af-b88e-3f5c05d2f6a2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:16.663862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d395eab0-2f86-45af-b88e-3f5c05d2f6a2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:16.666470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:01:16.679180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d395eab0-2f86-45af-b88e-3f5c05d2f6a2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:16.679678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d395eab0-2f86-45af-b88e-3f5c05d2f6a2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:16.680184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d395eab0-2f86-45af-b88e-3f5c05d2f6a2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:16.680934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d395eab0-2f86-45af-b88e-3f5c05d2f6a2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:16.681387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d395eab0-2f86-45af-b88e-3f5c05d2f6a2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:16.681812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d395eab0-2f86-45af-b88e-3f5c05d2f6a2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:17.262179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-117577030", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5f58928e-b011-49a1-a149-3916a89eb6d7"}], "security_groups": [{"name": "tempest-securitygroup--82915147"}], "key_name": "tempest-keypair-271422482", "user_data": "}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:17.551554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] validate_networks() for [('5f58928e-b011-49a1-a149-3916a89eb6d7', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:01:17.566333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d395eab0-2f86-45af-b88e-3f5c05d2f6a2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:17.579452 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d395eab0-2f86-45af-b88e-3f5c05d2f6a2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1315 microversion: 2.1 time: 0.920910 Aug 09 15:01:17.581057 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2514/5020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:16 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1315 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:18.607314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6bff70d4-a625-420b-802d-c4febfe7b85c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:18.608816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6bff70d4-a625-420b-802d-c4febfe7b85c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:18.618526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bff70d4-a625-420b-802d-c4febfe7b85c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:18.627980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bff70d4-a625-420b-802d-c4febfe7b85c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:18.629532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bff70d4-a625-420b-802d-c4febfe7b85c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:18.633205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bff70d4-a625-420b-802d-c4febfe7b85c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:18.634353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bff70d4-a625-420b-802d-c4febfe7b85c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:18.635329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bff70d4-a625-420b-802d-c4febfe7b85c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:18.782408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:01:18.784227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:01:18.785627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:01:18.786567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:01:18.787001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:01:18.829190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:18.837240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:18.838039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:18.842400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:18.844525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:18.848595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:18.943131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Getting quotas for project f63d01743846420d9f081b7f8b73c5d2. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:01:18.950140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Getting quotas for user 9b8154cdb1a64b4894811af2cea904cb and project f63d01743846420d9f081b7f8b73c5d2. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:01:18.992459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:01:18.995436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:01:19.081163 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8b63d0e-4954-4a17-9d64-88c9130eafc5 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.824224 Aug 09 15:01:19.088469 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2507/5021] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:01:17 2022] POST /compute/v2.1/servers => generated 400 bytes in 1827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:01:19.096360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0c35762-5595-43e8-ac6b-97b1d00d4d2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:19.097089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e0c35762-5595-43e8-ac6b-97b1d00d4d2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:19.428420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e0c35762-5595-43e8-ac6b-97b1d00d4d2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:19.440448 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e0c35762-5595-43e8-ac6b-97b1d00d4d2d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1236 microversion: 2.1 time: 0.348730 Aug 09 15:01:19.454425 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2508/5022] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:19 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1236 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:19.495371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6bff70d4-a625-420b-802d-c4febfe7b85c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:19.516112 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6bff70d4-a625-420b-802d-c4febfe7b85c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1315 microversion: 2.1 time: 0.915878 Aug 09 15:01:19.531199 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2515/5023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:18 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:19.918252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-958a0ce6-47bb-4483-900e-ac2d209cb8ac req-434c59ae-9097-418c-865b-a2b1c5b7907a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3017401-936b-4537-a0c4-e0a80c1c7316", "tag": "323bd9ce-f64e-4972-896f-1bedffe09a38"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:19.945264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-958a0ce6-47bb-4483-900e-ac2d209cb8ac req-434c59ae-9097-418c-865b-a2b1c5b7907a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:19.945951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-958a0ce6-47bb-4483-900e-ac2d209cb8ac req-434c59ae-9097-418c-865b-a2b1c5b7907a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:19.946372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-958a0ce6-47bb-4483-900e-ac2d209cb8ac req-434c59ae-9097-418c-865b-a2b1c5b7907a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:19.981159 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-958a0ce6-47bb-4483-900e-ac2d209cb8ac req-434c59ae-9097-418c-865b-a2b1c5b7907a service nova] Creating event network-changed:323bd9ce-f64e-4972-896f-1bedffe09a38 for instance f3017401-936b-4537-a0c4-e0a80c1c7316 on n-h2-844626-8 Aug 09 15:01:19.990246 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-958a0ce6-47bb-4483-900e-ac2d209cb8ac req-434c59ae-9097-418c-865b-a2b1c5b7907a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.545185 Aug 09 15:01:19.990860 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2509/5024] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:01:20.461626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d524114-81ba-4cd2-ab21-665277d23767 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:20.466406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d524114-81ba-4cd2-ab21-665277d23767 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:20.485582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d524114-81ba-4cd2-ab21-665277d23767 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:20.491462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d524114-81ba-4cd2-ab21-665277d23767 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:20.492186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d524114-81ba-4cd2-ab21-665277d23767 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:20.493159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d524114-81ba-4cd2-ab21-665277d23767 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:20.496765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d524114-81ba-4cd2-ab21-665277d23767 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:20.498856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d524114-81ba-4cd2-ab21-665277d23767 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:20.547495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-296e25f3-bad3-4988-b429-daccf471ea05 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:20.549055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-296e25f3-bad3-4988-b429-daccf471ea05 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:20.562317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-296e25f3-bad3-4988-b429-daccf471ea05 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:20.562767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-296e25f3-bad3-4988-b429-daccf471ea05 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:20.567905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-296e25f3-bad3-4988-b429-daccf471ea05 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:20.569290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-296e25f3-bad3-4988-b429-daccf471ea05 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:20.574724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-296e25f3-bad3-4988-b429-daccf471ea05 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:20.579797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-296e25f3-bad3-4988-b429-daccf471ea05 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:21.032408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d524114-81ba-4cd2-ab21-665277d23767 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:21.048414 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d524114-81ba-4cd2-ab21-665277d23767 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1232 microversion: 2.1 time: 0.590579 Aug 09 15:01:21.049661 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2516/5025] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:20 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1232 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:21.195063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-296e25f3-bad3-4988-b429-daccf471ea05 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:21.211554 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-296e25f3-bad3-4988-b429-daccf471ea05 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1315 microversion: 2.1 time: 0.668314 Aug 09 15:01:21.212445 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2510/5026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:20 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:22.071352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c41f97b8-5cae-4eda-9437-19cea7a5d822 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:22.072121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c41f97b8-5cae-4eda-9437-19cea7a5d822 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:22.082739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c41f97b8-5cae-4eda-9437-19cea7a5d822 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:22.087200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c41f97b8-5cae-4eda-9437-19cea7a5d822 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:22.094773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c41f97b8-5cae-4eda-9437-19cea7a5d822 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:22.096801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c41f97b8-5cae-4eda-9437-19cea7a5d822 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:22.097618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c41f97b8-5cae-4eda-9437-19cea7a5d822 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:22.099610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c41f97b8-5cae-4eda-9437-19cea7a5d822 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:22.233981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63402861-a0c3-4de2-8585-21097e2df497 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:22.234752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63402861-a0c3-4de2-8585-21097e2df497 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:22.246094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63402861-a0c3-4de2-8585-21097e2df497 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:22.254193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63402861-a0c3-4de2-8585-21097e2df497 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:22.254940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63402861-a0c3-4de2-8585-21097e2df497 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:22.255857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63402861-a0c3-4de2-8585-21097e2df497 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:22.256447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63402861-a0c3-4de2-8585-21097e2df497 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:22.256986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63402861-a0c3-4de2-8585-21097e2df497 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:22.488636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c41f97b8-5cae-4eda-9437-19cea7a5d822 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:22.491744 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c41f97b8-5cae-4eda-9437-19cea7a5d822 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1294 microversion: 2.1 time: 0.425020 Aug 09 15:01:22.492354 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2517/5027] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:22 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1294 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:22.823408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63402861-a0c3-4de2-8585-21097e2df497 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:22.846638 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63402861-a0c3-4de2-8585-21097e2df497 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1315 microversion: 2.1 time: 0.616551 Aug 09 15:01:22.847998 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2511/5028] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:22 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:23.518326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28235f03-d6bc-4c4c-9da8-1402d6525036 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:23.520920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28235f03-d6bc-4c4c-9da8-1402d6525036 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:23.532553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28235f03-d6bc-4c4c-9da8-1402d6525036 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:23.533292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28235f03-d6bc-4c4c-9da8-1402d6525036 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:23.533875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28235f03-d6bc-4c4c-9da8-1402d6525036 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:23.534993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28235f03-d6bc-4c4c-9da8-1402d6525036 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:23.535677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28235f03-d6bc-4c4c-9da8-1402d6525036 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:23.536964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28235f03-d6bc-4c4c-9da8-1402d6525036 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:23.763402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:01:23.882567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d14144c-eedc-4e4a-81b9-7bccd5bc23ad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:23.885080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d14144c-eedc-4e4a-81b9-7bccd5bc23ad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:23.903318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-28235f03-d6bc-4c4c-9da8-1402d6525036 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:23.922827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d14144c-eedc-4e4a-81b9-7bccd5bc23ad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:23.926248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d14144c-eedc-4e4a-81b9-7bccd5bc23ad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:23.929487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d14144c-eedc-4e4a-81b9-7bccd5bc23ad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:23.930807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d14144c-eedc-4e4a-81b9-7bccd5bc23ad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:23.932749 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28235f03-d6bc-4c4c-9da8-1402d6525036 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1360 microversion: 2.1 time: 0.422724 Aug 09 15:01:23.934178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d14144c-eedc-4e4a-81b9-7bccd5bc23ad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:23.934785 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2518/5029] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:23 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1360 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:23.936084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d14144c-eedc-4e4a-81b9-7bccd5bc23ad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:24.346538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d14144c-eedc-4e4a-81b9-7bccd5bc23ad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:24.357093 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d14144c-eedc-4e4a-81b9-7bccd5bc23ad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1315 microversion: 2.1 time: 0.491658 Aug 09 15:01:24.363184 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2512/5030] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:23 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:24.956417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7f249d67-68ea-40ab-afa0-5752e3674aeb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:24.958495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7f249d67-68ea-40ab-afa0-5752e3674aeb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:24.986358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f249d67-68ea-40ab-afa0-5752e3674aeb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:24.989296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f249d67-68ea-40ab-afa0-5752e3674aeb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:24.990634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f249d67-68ea-40ab-afa0-5752e3674aeb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:24.994761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f249d67-68ea-40ab-afa0-5752e3674aeb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:24.997470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f249d67-68ea-40ab-afa0-5752e3674aeb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:25.000980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7f249d67-68ea-40ab-afa0-5752e3674aeb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:25.383721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cc23bd23-45d9-4511-936c-f9bd1b63ef95 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:25.385982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cc23bd23-45d9-4511-936c-f9bd1b63ef95 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:25.405800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc23bd23-45d9-4511-936c-f9bd1b63ef95 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:25.406785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc23bd23-45d9-4511-936c-f9bd1b63ef95 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:25.407470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc23bd23-45d9-4511-936c-f9bd1b63ef95 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:25.408383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc23bd23-45d9-4511-936c-f9bd1b63ef95 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:25.410859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc23bd23-45d9-4511-936c-f9bd1b63ef95 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:25.416024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc23bd23-45d9-4511-936c-f9bd1b63ef95 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:25.522992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7f249d67-68ea-40ab-afa0-5752e3674aeb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:25.531784 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7f249d67-68ea-40ab-afa0-5752e3674aeb tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1360 microversion: 2.1 time: 0.581588 Aug 09 15:01:25.532390 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2519/5031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:24 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1360 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:25.832353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cc23bd23-45d9-4511-936c-f9bd1b63ef95 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:25.866745 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cc23bd23-45d9-4511-936c-f9bd1b63ef95 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1315 microversion: 2.1 time: 0.489061 Aug 09 15:01:25.867649 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2513/5032] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:25 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:26.557411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ea3c6db9-108b-4769-becd-f9f4c6fd9b34 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:26.558168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ea3c6db9-108b-4769-becd-f9f4c6fd9b34 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:26.574893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea3c6db9-108b-4769-becd-f9f4c6fd9b34 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:26.577337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea3c6db9-108b-4769-becd-f9f4c6fd9b34 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:26.577783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea3c6db9-108b-4769-becd-f9f4c6fd9b34 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:26.578466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea3c6db9-108b-4769-becd-f9f4c6fd9b34 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:26.578926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea3c6db9-108b-4769-becd-f9f4c6fd9b34 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:26.579384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ea3c6db9-108b-4769-becd-f9f4c6fd9b34 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:26.897528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dff91c13-401d-46a6-b9a1-8167b4eeec5a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:26.898159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dff91c13-401d-46a6-b9a1-8167b4eeec5a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:26.922513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dff91c13-401d-46a6-b9a1-8167b4eeec5a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:26.923152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dff91c13-401d-46a6-b9a1-8167b4eeec5a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:26.923545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dff91c13-401d-46a6-b9a1-8167b4eeec5a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:26.924677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dff91c13-401d-46a6-b9a1-8167b4eeec5a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:26.925177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dff91c13-401d-46a6-b9a1-8167b4eeec5a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:26.925624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dff91c13-401d-46a6-b9a1-8167b4eeec5a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:26.951480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ea3c6db9-108b-4769-becd-f9f4c6fd9b34 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:26.961206 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ea3c6db9-108b-4769-becd-f9f4c6fd9b34 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1360 microversion: 2.1 time: 0.407864 Aug 09 15:01:26.976290 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2520/5033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:26 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1360 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:27.023817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-052c3d9a-73bd-4690-94b2-bd4b37343be6 req-5e1ec3d5-04f4-4d15-ad7a-7a8c6446ec5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb0f976-1636-4b67-ac31-dd6ca3bcf531", "tag": "40227e90-8532-4037-96b7-3bb881bdff9c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:27.085022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-052c3d9a-73bd-4690-94b2-bd4b37343be6 req-5e1ec3d5-04f4-4d15-ad7a-7a8c6446ec5b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:27.086402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-052c3d9a-73bd-4690-94b2-bd4b37343be6 req-5e1ec3d5-04f4-4d15-ad7a-7a8c6446ec5b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:27.094727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-052c3d9a-73bd-4690-94b2-bd4b37343be6 req-5e1ec3d5-04f4-4d15-ad7a-7a8c6446ec5b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:27.126869 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-052c3d9a-73bd-4690-94b2-bd4b37343be6 req-5e1ec3d5-04f4-4d15-ad7a-7a8c6446ec5b service nova] Creating event network-changed:40227e90-8532-4037-96b7-3bb881bdff9c for instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 on n-h1-844626-8 Aug 09 15:01:27.138673 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-052c3d9a-73bd-4690-94b2-bd4b37343be6 req-5e1ec3d5-04f4-4d15-ad7a-7a8c6446ec5b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157136 Aug 09 15:01:27.139461 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2521/5034] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:01:27.229685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dff91c13-401d-46a6-b9a1-8167b4eeec5a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:27.238512 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dff91c13-401d-46a6-b9a1-8167b4eeec5a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1315 microversion: 2.1 time: 0.351716 Aug 09 15:01:27.240068 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2514/5035] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:26 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:01:28.011420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-101251a5-31bd-4f6a-849f-747cc24d74fe tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:28.013029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-101251a5-31bd-4f6a-849f-747cc24d74fe tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:28.050504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-101251a5-31bd-4f6a-849f-747cc24d74fe tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:28.084300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-101251a5-31bd-4f6a-849f-747cc24d74fe tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:28.085306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-101251a5-31bd-4f6a-849f-747cc24d74fe tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:28.086548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-101251a5-31bd-4f6a-849f-747cc24d74fe tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:28.087507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-101251a5-31bd-4f6a-849f-747cc24d74fe tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:28.088240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-101251a5-31bd-4f6a-849f-747cc24d74fe tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:28.261197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-979798b6-73f3-4284-a17e-cf0147e52295 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:28.261810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-979798b6-73f3-4284-a17e-cf0147e52295 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:28.271238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-979798b6-73f3-4284-a17e-cf0147e52295 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:28.272044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-979798b6-73f3-4284-a17e-cf0147e52295 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:28.272736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-979798b6-73f3-4284-a17e-cf0147e52295 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:28.274224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-979798b6-73f3-4284-a17e-cf0147e52295 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:28.275278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-979798b6-73f3-4284-a17e-cf0147e52295 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:28.277773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-979798b6-73f3-4284-a17e-cf0147e52295 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:28.554257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-101251a5-31bd-4f6a-849f-747cc24d74fe tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:28.563390 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-101251a5-31bd-4f6a-849f-747cc24d74fe tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1360 microversion: 2.1 time: 0.583319 Aug 09 15:01:28.571505 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2522/5036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:27 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1360 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:28.576408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-1db93191-3c79-4f5c-94e3-0b88187c5a9a req-43d45311-12ab-44f5-8ec9-54f4ab26dd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3017401-936b-4537-a0c4-e0a80c1c7316", "name": "network-vif-plugged", "status": "completed", "tag": "323bd9ce-f64e-4972-896f-1bedffe09a38"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:28.608777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1db93191-3c79-4f5c-94e3-0b88187c5a9a req-43d45311-12ab-44f5-8ec9-54f4ab26dd68 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:28.618226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1db93191-3c79-4f5c-94e3-0b88187c5a9a req-43d45311-12ab-44f5-8ec9-54f4ab26dd68 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:28.620935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1db93191-3c79-4f5c-94e3-0b88187c5a9a req-43d45311-12ab-44f5-8ec9-54f4ab26dd68 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:28.645651 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1db93191-3c79-4f5c-94e3-0b88187c5a9a req-43d45311-12ab-44f5-8ec9-54f4ab26dd68 service nova] Creating event network-vif-plugged:323bd9ce-f64e-4972-896f-1bedffe09a38 for instance f3017401-936b-4537-a0c4-e0a80c1c7316 on n-h2-844626-8 Aug 09 15:01:28.654536 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-1db93191-3c79-4f5c-94e3-0b88187c5a9a req-43d45311-12ab-44f5-8ec9-54f4ab26dd68 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081656 Aug 09 15:01:28.655490 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2523/5037] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:01:28.665016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1be57c1f-0e1b-4535-aff1-04fc2bb94132 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c224dd1c-bbca-4521-956a-2d9f021642c5", "device": "/dev/sdb"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:28.669397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1be57c1f-0e1b-4535-aff1-04fc2bb94132 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:28.678869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1be57c1f-0e1b-4535-aff1-04fc2bb94132 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:28.692148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-979798b6-73f3-4284-a17e-cf0147e52295 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:28.721986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1be57c1f-0e1b-4535-aff1-04fc2bb94132 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:28.726253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1be57c1f-0e1b-4535-aff1-04fc2bb94132 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.043s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:28.731125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1be57c1f-0e1b-4535-aff1-04fc2bb94132 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:28.732910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1be57c1f-0e1b-4535-aff1-04fc2bb94132 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:28.734926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1be57c1f-0e1b-4535-aff1-04fc2bb94132 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:28.739452 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-979798b6-73f3-4284-a17e-cf0147e52295 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1315 microversion: 2.1 time: 0.481192 Aug 09 15:01:28.743718 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2515/5038] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:28 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:01:29.588993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce17f8c7-3313-4a56-bb05-f354797033e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:29.590622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ce17f8c7-3313-4a56-bb05-f354797033e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:29.600235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:01:29.606854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=16 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:01:29.609713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce17f8c7-3313-4a56-bb05-f354797033e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:29.610442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce17f8c7-3313-4a56-bb05-f354797033e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:29.611480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce17f8c7-3313-4a56-bb05-f354797033e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:29.612690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce17f8c7-3313-4a56-bb05-f354797033e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:29.613444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce17f8c7-3313-4a56-bb05-f354797033e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:29.614849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce17f8c7-3313-4a56-bb05-f354797033e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:29.863868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ce17f8c7-3313-4a56-bb05-f354797033e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:29.896500 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ce17f8c7-3313-4a56-bb05-f354797033e6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1360 microversion: 2.1 time: 0.312992 Aug 09 15:01:29.935238 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2516/5039] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:29 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1360 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:01:29.955546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-674b07ac-32e8-44fb-8bdd-0369300a344d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:29.957099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-674b07ac-32e8-44fb-8bdd-0369300a344d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:29.999200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-674b07ac-32e8-44fb-8bdd-0369300a344d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:30.028949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-674b07ac-32e8-44fb-8bdd-0369300a344d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:30.031557 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1be57c1f-0e1b-4535-aff1-04fc2bb94132 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "POST /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.371880 Aug 09 15:01:30.032607 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2524/5040] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 15:01:28 2022] POST /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190/os-volume_attachments => generated 194 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:01:30.034224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-674b07ac-32e8-44fb-8bdd-0369300a344d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:30.035598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-674b07ac-32e8-44fb-8bdd-0369300a344d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:30.039034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-674b07ac-32e8-44fb-8bdd-0369300a344d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:30.041202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-674b07ac-32e8-44fb-8bdd-0369300a344d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:30.364166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-674b07ac-32e8-44fb-8bdd-0369300a344d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:30.391746 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-674b07ac-32e8-44fb-8bdd-0369300a344d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1315 microversion: 2.1 time: 0.454122 Aug 09 15:01:30.401669 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2517/5041] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:29 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:30.933978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-896cc12b-e683-47c3-ba56-4d14b5feccd4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:30.935100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-896cc12b-e683-47c3-ba56-4d14b5feccd4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:30.955689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-896cc12b-e683-47c3-ba56-4d14b5feccd4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:30.959133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-896cc12b-e683-47c3-ba56-4d14b5feccd4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:30.960056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-896cc12b-e683-47c3-ba56-4d14b5feccd4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:30.962763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-896cc12b-e683-47c3-ba56-4d14b5feccd4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:30.966782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-896cc12b-e683-47c3-ba56-4d14b5feccd4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:30.969936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-896cc12b-e683-47c3-ba56-4d14b5feccd4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:31.384510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-896cc12b-e683-47c3-ba56-4d14b5feccd4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:31.393753 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-896cc12b-e683-47c3-ba56-4d14b5feccd4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1360 microversion: 2.1 time: 0.465097 Aug 09 15:01:31.394372 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2525/5042] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:30 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1360 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:31.418190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57dbe483-11c4-4c83-a5b6-7142087fb2c0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:31.419425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57dbe483-11c4-4c83-a5b6-7142087fb2c0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:31.427351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57dbe483-11c4-4c83-a5b6-7142087fb2c0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:31.428230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57dbe483-11c4-4c83-a5b6-7142087fb2c0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:31.428923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57dbe483-11c4-4c83-a5b6-7142087fb2c0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:31.429937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57dbe483-11c4-4c83-a5b6-7142087fb2c0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:31.430643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57dbe483-11c4-4c83-a5b6-7142087fb2c0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:31.431373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57dbe483-11c4-4c83-a5b6-7142087fb2c0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:31.637148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-57dbe483-11c4-4c83-a5b6-7142087fb2c0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:31.646825 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57dbe483-11c4-4c83-a5b6-7142087fb2c0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1499 microversion: 2.1 time: 0.232565 Aug 09 15:01:31.647473 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2518/5043] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:31 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1499 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:31.684924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2b6d8701-2438-4ada-befe-12810c3638e9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:31.702634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b6d8701-2438-4ada-befe-12810c3638e9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:31.704139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b6d8701-2438-4ada-befe-12810c3638e9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:31.706019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b6d8701-2438-4ada-befe-12810c3638e9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:31.777110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2b6d8701-2438-4ada-befe-12810c3638e9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Going to try to stop instance {{(pid=119407) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 15:01:31.862083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:01:31.892018 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2b6d8701-2438-4ada-befe-12810c3638e9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316/action" status: 202 len: 0 microversion: 2.1 time: 0.225935 Aug 09 15:01:31.892904 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2526/5044] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:01:31 2022] POST /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:01:31.903367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55581c22-f625-48f0-9292-c4c32a1937e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:31.904166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55581c22-f625-48f0-9292-c4c32a1937e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:31.912978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55581c22-f625-48f0-9292-c4c32a1937e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:31.917201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55581c22-f625-48f0-9292-c4c32a1937e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:31.917992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55581c22-f625-48f0-9292-c4c32a1937e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:31.920890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55581c22-f625-48f0-9292-c4c32a1937e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:31.922775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55581c22-f625-48f0-9292-c4c32a1937e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:31.925326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55581c22-f625-48f0-9292-c4c32a1937e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:32.135993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-55581c22-f625-48f0-9292-c4c32a1937e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:32.147776 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-55581c22-f625-48f0-9292-c4c32a1937e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.248747 Aug 09 15:01:32.162954 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2519/5045] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:31 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:32.480181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36b7d305-18d2-4a39-9dea-e5f95a10d2f6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:32.505862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36b7d305-18d2-4a39-9dea-e5f95a10d2f6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:32.554519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b7d305-18d2-4a39-9dea-e5f95a10d2f6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:32.557188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b7d305-18d2-4a39-9dea-e5f95a10d2f6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:32.557827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b7d305-18d2-4a39-9dea-e5f95a10d2f6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:32.585636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b7d305-18d2-4a39-9dea-e5f95a10d2f6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:32.589688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b7d305-18d2-4a39-9dea-e5f95a10d2f6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:32.591730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b7d305-18d2-4a39-9dea-e5f95a10d2f6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:33.134231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-36b7d305-18d2-4a39-9dea-e5f95a10d2f6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:33.149379 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36b7d305-18d2-4a39-9dea-e5f95a10d2f6 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1360 microversion: 2.1 time: 0.719448 Aug 09 15:01:33.150102 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2527/5046] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:32 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1360 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:33.172559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b0bca3e-eff4-4466-9170-65cbf058c8d4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:33.174786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b0bca3e-eff4-4466-9170-65cbf058c8d4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:33.188591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b0bca3e-eff4-4466-9170-65cbf058c8d4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:33.190697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b0bca3e-eff4-4466-9170-65cbf058c8d4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:33.191392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b0bca3e-eff4-4466-9170-65cbf058c8d4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:33.194903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b0bca3e-eff4-4466-9170-65cbf058c8d4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:33.195891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b0bca3e-eff4-4466-9170-65cbf058c8d4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:33.196569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b0bca3e-eff4-4466-9170-65cbf058c8d4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:33.491051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b0bca3e-eff4-4466-9170-65cbf058c8d4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:33.500332 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b0bca3e-eff4-4466-9170-65cbf058c8d4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.332103 Aug 09 15:01:33.502879 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2520/5047] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:33 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:33.863858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-31c71ab1-9b97-4e01-8ec7-39230ff65117 req-dc075e8e-fefd-4a05-bd86-f86e48434a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb0f976-1636-4b67-ac31-dd6ca3bcf531", "name": "network-vif-plugged", "status": "completed", "tag": "40227e90-8532-4037-96b7-3bb881bdff9c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:33.884791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-31c71ab1-9b97-4e01-8ec7-39230ff65117 req-dc075e8e-fefd-4a05-bd86-f86e48434a56 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:33.888319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-31c71ab1-9b97-4e01-8ec7-39230ff65117 req-dc075e8e-fefd-4a05-bd86-f86e48434a56 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:33.889188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-31c71ab1-9b97-4e01-8ec7-39230ff65117 req-dc075e8e-fefd-4a05-bd86-f86e48434a56 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:33.920167 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-31c71ab1-9b97-4e01-8ec7-39230ff65117 req-dc075e8e-fefd-4a05-bd86-f86e48434a56 service nova] Creating event network-vif-plugged:40227e90-8532-4037-96b7-3bb881bdff9c for instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 on n-h1-844626-8 Aug 09 15:01:33.939843 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-31c71ab1-9b97-4e01-8ec7-39230ff65117 req-dc075e8e-fefd-4a05-bd86-f86e48434a56 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079877 Aug 09 15:01:33.941207 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2528/5048] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:01:34.181739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b107c4de-855f-4cde-a702-c07ace659c25 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:34.184690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b107c4de-855f-4cde-a702-c07ace659c25 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:34.223220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b107c4de-855f-4cde-a702-c07ace659c25 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:34.223825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b107c4de-855f-4cde-a702-c07ace659c25 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:34.224276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b107c4de-855f-4cde-a702-c07ace659c25 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:34.225431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b107c4de-855f-4cde-a702-c07ace659c25 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:34.226114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b107c4de-855f-4cde-a702-c07ace659c25 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:34.230723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b107c4de-855f-4cde-a702-c07ace659c25 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:34.524494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3fb536de-2b87-4c16-80fd-bacc927c58cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:34.525395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fb536de-2b87-4c16-80fd-bacc927c58cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:34.537118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fb536de-2b87-4c16-80fd-bacc927c58cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:34.537762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fb536de-2b87-4c16-80fd-bacc927c58cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:34.538302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fb536de-2b87-4c16-80fd-bacc927c58cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:34.541928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fb536de-2b87-4c16-80fd-bacc927c58cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:34.542557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fb536de-2b87-4c16-80fd-bacc927c58cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:34.543123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fb536de-2b87-4c16-80fd-bacc927c58cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:34.562371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b107c4de-855f-4cde-a702-c07ace659c25 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:34.575917 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b107c4de-855f-4cde-a702-c07ace659c25 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1360 microversion: 2.1 time: 0.402364 Aug 09 15:01:34.576841 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2521/5049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:34 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1360 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:34.859142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3fb536de-2b87-4c16-80fd-bacc927c58cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:34.870754 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3fb536de-2b87-4c16-80fd-bacc927c58cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.350395 Aug 09 15:01:34.871800 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2529/5050] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:34 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:35.603241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0708bd27-e5fe-4c7b-b0e1-46a9c04b05dc tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:35.604832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0708bd27-e5fe-4c7b-b0e1-46a9c04b05dc tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:35.620903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0708bd27-e5fe-4c7b-b0e1-46a9c04b05dc tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:35.621702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0708bd27-e5fe-4c7b-b0e1-46a9c04b05dc tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:35.623660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0708bd27-e5fe-4c7b-b0e1-46a9c04b05dc tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:35.624571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0708bd27-e5fe-4c7b-b0e1-46a9c04b05dc tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:35.625973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0708bd27-e5fe-4c7b-b0e1-46a9c04b05dc tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:35.627858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0708bd27-e5fe-4c7b-b0e1-46a9c04b05dc tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:35.707730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:01:35.894494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7505edc-4aac-45c5-a8c2-b20634045a07 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:35.895389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b7505edc-4aac-45c5-a8c2-b20634045a07 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:35.921579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7505edc-4aac-45c5-a8c2-b20634045a07 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:35.923883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7505edc-4aac-45c5-a8c2-b20634045a07 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:35.924440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7505edc-4aac-45c5-a8c2-b20634045a07 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:35.929912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7505edc-4aac-45c5-a8c2-b20634045a07 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:35.931037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7505edc-4aac-45c5-a8c2-b20634045a07 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:35.950254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7505edc-4aac-45c5-a8c2-b20634045a07 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:36.003659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0708bd27-e5fe-4c7b-b0e1-46a9c04b05dc tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:36.016655 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0708bd27-e5fe-4c7b-b0e1-46a9c04b05dc tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1546 microversion: 2.1 time: 0.419756 Aug 09 15:01:36.028436 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2522/5051] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:35 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1546 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:36.041587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5263cd05-4c36-435d-9151-a0919adcb4c4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:36.046348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5263cd05-4c36-435d-9151-a0919adcb4c4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:36.052914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5263cd05-4c36-435d-9151-a0919adcb4c4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:36.053637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5263cd05-4c36-435d-9151-a0919adcb4c4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:36.054219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5263cd05-4c36-435d-9151-a0919adcb4c4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:36.055154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5263cd05-4c36-435d-9151-a0919adcb4c4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:36.055774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5263cd05-4c36-435d-9151-a0919adcb4c4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:36.056351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5263cd05-4c36-435d-9151-a0919adcb4c4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:36.291602 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5263cd05-4c36-435d-9151-a0919adcb4c4 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.253908 Aug 09 15:01:36.299753 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2523/5052] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 15:01:36 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-interface => generated 284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:01:36.501368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b7505edc-4aac-45c5-a8c2-b20634045a07 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:36.514216 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7505edc-4aac-45c5-a8c2-b20634045a07 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.625511 Aug 09 15:01:36.526425 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2530/5053] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:35 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:37.542819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d2df1f9-672e-4e7c-b76c-8f7d9817e4d8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:37.543448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4d2df1f9-672e-4e7c-b76c-8f7d9817e4d8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:37.576427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d2df1f9-672e-4e7c-b76c-8f7d9817e4d8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:37.588996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d2df1f9-672e-4e7c-b76c-8f7d9817e4d8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:37.598448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d2df1f9-672e-4e7c-b76c-8f7d9817e4d8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:37.612371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d2df1f9-672e-4e7c-b76c-8f7d9817e4d8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:37.613317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d2df1f9-672e-4e7c-b76c-8f7d9817e4d8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:37.613950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d2df1f9-672e-4e7c-b76c-8f7d9817e4d8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:37.968843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d2df1f9-672e-4e7c-b76c-8f7d9817e4d8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:37.982804 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4d2df1f9-672e-4e7c-b76c-8f7d9817e4d8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.443984 Aug 09 15:01:38.002081 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2524/5054] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:37 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:38.917106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ccb42223-d16b-494f-be75-0f7b21db227d req-1edd335b-133e-4a79-ac7b-2adeac87688d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb0f976-1636-4b67-ac31-dd6ca3bcf531", "tag": "40227e90-8532-4037-96b7-3bb881bdff9c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:38.930373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ccb42223-d16b-494f-be75-0f7b21db227d req-1edd335b-133e-4a79-ac7b-2adeac87688d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:38.931070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ccb42223-d16b-494f-be75-0f7b21db227d req-1edd335b-133e-4a79-ac7b-2adeac87688d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:38.931690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ccb42223-d16b-494f-be75-0f7b21db227d req-1edd335b-133e-4a79-ac7b-2adeac87688d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:38.945426 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ccb42223-d16b-494f-be75-0f7b21db227d req-1edd335b-133e-4a79-ac7b-2adeac87688d service nova] Creating event network-changed:40227e90-8532-4037-96b7-3bb881bdff9c for instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 on n-h1-844626-8 Aug 09 15:01:38.963423 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ccb42223-d16b-494f-be75-0f7b21db227d req-1edd335b-133e-4a79-ac7b-2adeac87688d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049028 Aug 09 15:01:38.964537 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2531/5055] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:01:39.012021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0497ee98-cf14-40ea-8fdd-355cbae33861 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:39.015448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0497ee98-cf14-40ea-8fdd-355cbae33861 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:39.045629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0497ee98-cf14-40ea-8fdd-355cbae33861 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:39.046434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0497ee98-cf14-40ea-8fdd-355cbae33861 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:39.047050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0497ee98-cf14-40ea-8fdd-355cbae33861 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:39.049447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0497ee98-cf14-40ea-8fdd-355cbae33861 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:39.050705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0497ee98-cf14-40ea-8fdd-355cbae33861 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:39.051354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0497ee98-cf14-40ea-8fdd-355cbae33861 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:39.635582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0497ee98-cf14-40ea-8fdd-355cbae33861 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:39.643830 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0497ee98-cf14-40ea-8fdd-355cbae33861 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.638258 Aug 09 15:01:39.657145 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2525/5056] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:39 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:40.667635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-83cb9514-3db9-44cd-85fe-7b7c8f2f2d85 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:40.668268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-83cb9514-3db9-44cd-85fe-7b7c8f2f2d85 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:40.702013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83cb9514-3db9-44cd-85fe-7b7c8f2f2d85 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:40.703059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83cb9514-3db9-44cd-85fe-7b7c8f2f2d85 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:40.703723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83cb9514-3db9-44cd-85fe-7b7c8f2f2d85 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:40.708758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83cb9514-3db9-44cd-85fe-7b7c8f2f2d85 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:40.709840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83cb9514-3db9-44cd-85fe-7b7c8f2f2d85 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:40.710676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83cb9514-3db9-44cd-85fe-7b7c8f2f2d85 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:41.544789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-83cb9514-3db9-44cd-85fe-7b7c8f2f2d85 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:41.560266 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-83cb9514-3db9-44cd-85fe-7b7c8f2f2d85 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.898440 Aug 09 15:01:41.561089 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2532/5057] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:40 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:42.587209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-738b653a-640e-4ea6-a7b1-4144373ae1cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:42.588799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-738b653a-640e-4ea6-a7b1-4144373ae1cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:42.600495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-738b653a-640e-4ea6-a7b1-4144373ae1cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:42.602380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-738b653a-640e-4ea6-a7b1-4144373ae1cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:42.605647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-738b653a-640e-4ea6-a7b1-4144373ae1cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:42.606673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-738b653a-640e-4ea6-a7b1-4144373ae1cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:42.607405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-738b653a-640e-4ea6-a7b1-4144373ae1cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:42.608108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-738b653a-640e-4ea6-a7b1-4144373ae1cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:42.830758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-738b653a-640e-4ea6-a7b1-4144373ae1cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:42.847849 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-738b653a-640e-4ea6-a7b1-4144373ae1cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.265519 Aug 09 15:01:42.863667 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2526/5058] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:42 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:43.871694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6980ea92-698c-465b-8181-8700308f95c5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:43.872285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6980ea92-698c-465b-8181-8700308f95c5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:43.887666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6980ea92-698c-465b-8181-8700308f95c5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:43.888519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6980ea92-698c-465b-8181-8700308f95c5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:43.889124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6980ea92-698c-465b-8181-8700308f95c5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:43.899594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6980ea92-698c-465b-8181-8700308f95c5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:43.900111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6980ea92-698c-465b-8181-8700308f95c5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:43.902236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6980ea92-698c-465b-8181-8700308f95c5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:44.231306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6980ea92-698c-465b-8181-8700308f95c5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:44.247187 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6980ea92-698c-465b-8181-8700308f95c5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.379289 Aug 09 15:01:44.247791 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2533/5059] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:43 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:45.269147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3e5cae30-a39d-461b-9631-03b8f47a9161 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:45.273033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3e5cae30-a39d-461b-9631-03b8f47a9161 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:45.282077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e5cae30-a39d-461b-9631-03b8f47a9161 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:45.282385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e5cae30-a39d-461b-9631-03b8f47a9161 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:45.282996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e5cae30-a39d-461b-9631-03b8f47a9161 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:45.298773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e5cae30-a39d-461b-9631-03b8f47a9161 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:45.299366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e5cae30-a39d-461b-9631-03b8f47a9161 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:45.301309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e5cae30-a39d-461b-9631-03b8f47a9161 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:45.622818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3e5cae30-a39d-461b-9631-03b8f47a9161 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:45.632068 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3e5cae30-a39d-461b-9631-03b8f47a9161 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.366904 Aug 09 15:01:45.648503 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2527/5060] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:45 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:46.655668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5cdf269-5519-4989-ab79-d3c5fde9a70f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:46.656970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5cdf269-5519-4989-ab79-d3c5fde9a70f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:46.672118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5cdf269-5519-4989-ab79-d3c5fde9a70f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:46.673515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5cdf269-5519-4989-ab79-d3c5fde9a70f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:46.674114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5cdf269-5519-4989-ab79-d3c5fde9a70f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:46.674982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5cdf269-5519-4989-ab79-d3c5fde9a70f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:46.675635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5cdf269-5519-4989-ab79-d3c5fde9a70f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:46.676212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5cdf269-5519-4989-ab79-d3c5fde9a70f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:47.416298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5cdf269-5519-4989-ab79-d3c5fde9a70f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:47.425254 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5cdf269-5519-4989-ab79-d3c5fde9a70f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.773533 Aug 09 15:01:47.426019 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2534/5061] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:46 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:48.448341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-53443f67-e2d1-43a5-9a40-ee4508ece670 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:48.450244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53443f67-e2d1-43a5-9a40-ee4508ece670 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:48.459603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:01:48.462871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53443f67-e2d1-43a5-9a40-ee4508ece670 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:48.463648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53443f67-e2d1-43a5-9a40-ee4508ece670 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:48.464082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53443f67-e2d1-43a5-9a40-ee4508ece670 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:48.464790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53443f67-e2d1-43a5-9a40-ee4508ece670 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:48.465239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53443f67-e2d1-43a5-9a40-ee4508ece670 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:48.465657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53443f67-e2d1-43a5-9a40-ee4508ece670 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:48.834147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-53443f67-e2d1-43a5-9a40-ee4508ece670 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:48.843505 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-53443f67-e2d1-43a5-9a40-ee4508ece670 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.401154 Aug 09 15:01:48.845395 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2528/5062] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:48 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:49.867827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f067f4c7-b2ff-459d-a27d-15414b925ce4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:49.869055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f067f4c7-b2ff-459d-a27d-15414b925ce4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:49.879814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=42 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:01:49.883677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f067f4c7-b2ff-459d-a27d-15414b925ce4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:49.886507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f067f4c7-b2ff-459d-a27d-15414b925ce4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:49.892960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f067f4c7-b2ff-459d-a27d-15414b925ce4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:49.894089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f067f4c7-b2ff-459d-a27d-15414b925ce4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:49.894861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f067f4c7-b2ff-459d-a27d-15414b925ce4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:49.896484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f067f4c7-b2ff-459d-a27d-15414b925ce4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:50.505346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f067f4c7-b2ff-459d-a27d-15414b925ce4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:50.518373 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f067f4c7-b2ff-459d-a27d-15414b925ce4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.655822 Aug 09 15:01:50.523441 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2535/5063] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:49 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:51.555938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9bc6e1f-7a6b-4f2a-a1f9-758befe9bc8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:51.559453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9bc6e1f-7a6b-4f2a-a1f9-758befe9bc8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:51.573344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9bc6e1f-7a6b-4f2a-a1f9-758befe9bc8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:51.575740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9bc6e1f-7a6b-4f2a-a1f9-758befe9bc8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:51.584917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9bc6e1f-7a6b-4f2a-a1f9-758befe9bc8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:51.586260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9bc6e1f-7a6b-4f2a-a1f9-758befe9bc8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:51.586931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9bc6e1f-7a6b-4f2a-a1f9-758befe9bc8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:51.587660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9bc6e1f-7a6b-4f2a-a1f9-758befe9bc8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:51.995841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9bc6e1f-7a6b-4f2a-a1f9-758befe9bc8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:52.006178 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9bc6e1f-7a6b-4f2a-a1f9-758befe9bc8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.457398 Aug 09 15:01:52.007440 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2529/5064] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:51 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:53.032243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f58ccbb9-c16f-45d8-b8d9-45075ccffe4e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:53.033183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f58ccbb9-c16f-45d8-b8d9-45075ccffe4e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:53.047451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f58ccbb9-c16f-45d8-b8d9-45075ccffe4e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:53.047882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f58ccbb9-c16f-45d8-b8d9-45075ccffe4e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:53.048497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f58ccbb9-c16f-45d8-b8d9-45075ccffe4e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:53.049359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f58ccbb9-c16f-45d8-b8d9-45075ccffe4e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:53.049963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f58ccbb9-c16f-45d8-b8d9-45075ccffe4e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:53.050533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f58ccbb9-c16f-45d8-b8d9-45075ccffe4e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:53.288741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f58ccbb9-c16f-45d8-b8d9-45075ccffe4e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:53.299523 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f58ccbb9-c16f-45d8-b8d9-45075ccffe4e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.271557 Aug 09 15:01:53.300106 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2536/5065] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:53 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:54.326789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-27552531-0b23-49b7-93f1-c7f62d596cc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:54.328928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-27552531-0b23-49b7-93f1-c7f62d596cc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:54.349801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27552531-0b23-49b7-93f1-c7f62d596cc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:54.352962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27552531-0b23-49b7-93f1-c7f62d596cc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:54.353944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27552531-0b23-49b7-93f1-c7f62d596cc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:54.356835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27552531-0b23-49b7-93f1-c7f62d596cc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:54.359013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27552531-0b23-49b7-93f1-c7f62d596cc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:54.359872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27552531-0b23-49b7-93f1-c7f62d596cc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:54.802636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-27552531-0b23-49b7-93f1-c7f62d596cc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:54.811811 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-27552531-0b23-49b7-93f1-c7f62d596cc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.492488 Aug 09 15:01:54.812423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2530/5066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:54 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:55.846524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-478cf59f-c288-48da-9d18-6fe4123b30a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:55.851674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-478cf59f-c288-48da-9d18-6fe4123b30a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:55.873506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-478cf59f-c288-48da-9d18-6fe4123b30a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:55.894581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-478cf59f-c288-48da-9d18-6fe4123b30a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:55.895259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-478cf59f-c288-48da-9d18-6fe4123b30a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:55.896225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-478cf59f-c288-48da-9d18-6fe4123b30a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:55.899264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-478cf59f-c288-48da-9d18-6fe4123b30a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:55.900369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-478cf59f-c288-48da-9d18-6fe4123b30a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:56.284360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-478cf59f-c288-48da-9d18-6fe4123b30a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:56.296973 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-478cf59f-c288-48da-9d18-6fe4123b30a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1509 microversion: 2.1 time: 0.459213 Aug 09 15:01:56.297982 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2537/5067] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:55 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1509 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:57.319767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c7c8aa7-ba85-4307-936e-965f960f6b59 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:57.319767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2c7c8aa7-ba85-4307-936e-965f960f6b59 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:57.324564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-703159621", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:57.352228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c7c8aa7-ba85-4307-936e-965f960f6b59 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:57.352856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c7c8aa7-ba85-4307-936e-965f960f6b59 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:57.354741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c7c8aa7-ba85-4307-936e-965f960f6b59 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:57.357815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c7c8aa7-ba85-4307-936e-965f960f6b59 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:57.358858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c7c8aa7-ba85-4307-936e-965f960f6b59 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:57.361343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c7c8aa7-ba85-4307-936e-965f960f6b59 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:57.440868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:01:58.207021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2c7c8aa7-ba85-4307-936e-965f960f6b59 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:58.215538 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2c7c8aa7-ba85-4307-936e-965f960f6b59 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1486 microversion: 2.1 time: 0.901256 Aug 09 15:01:58.219393 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2531/5068] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:57 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1486 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:58.253896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c6a4bc73-cac3-4d2d-bf49-bb666aa38f0e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:01:58.256622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c6a4bc73-cac3-4d2d-bf49-bb666aa38f0e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:58.269751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6a4bc73-cac3-4d2d-bf49-bb666aa38f0e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:58.270250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6a4bc73-cac3-4d2d-bf49-bb666aa38f0e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:58.270728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6a4bc73-cac3-4d2d-bf49-bb666aa38f0e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:58.271482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6a4bc73-cac3-4d2d-bf49-bb666aa38f0e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:58.271937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6a4bc73-cac3-4d2d-bf49-bb666aa38f0e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:58.272366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c6a4bc73-cac3-4d2d-bf49-bb666aa38f0e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:58.374391 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c6a4bc73-cac3-4d2d-bf49-bb666aa38f0e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 200 len: 131 microversion: 2.1 time: 0.129424 Aug 09 15:01:58.376219 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2532/5069] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:01:58 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 131 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:01:58.387036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ad7f2ab-287f-4a4b-9ae2-f9753fa5f2a3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:58.388070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ad7f2ab-287f-4a4b-9ae2-f9753fa5f2a3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:58.402014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ad7f2ab-287f-4a4b-9ae2-f9753fa5f2a3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:58.402956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ad7f2ab-287f-4a4b-9ae2-f9753fa5f2a3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:58.404232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ad7f2ab-287f-4a4b-9ae2-f9753fa5f2a3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:58.405676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ad7f2ab-287f-4a4b-9ae2-f9753fa5f2a3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:58.408459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ad7f2ab-287f-4a4b-9ae2-f9753fa5f2a3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:58.410403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ad7f2ab-287f-4a4b-9ae2-f9753fa5f2a3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:58.718422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:01:58.720924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:01:58.721560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:01:58.722066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:01:58.722883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:01:58.740796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:58.742479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:58.745418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:58.750564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:58.752885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:58.754882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:58.817242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Getting quotas for project b6d7bdb660c344ebb848f9fb035f5e1b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:01:58.825901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Getting quotas for user cb5802fdcb18482181a5b795949f94d2 and project b6d7bdb660c344ebb848f9fb035f5e1b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:01:58.845685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ad7f2ab-287f-4a4b-9ae2-f9753fa5f2a3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:58.850115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:01:58.853773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:01:58.859103 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ad7f2ab-287f-4a4b-9ae2-f9753fa5f2a3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.476838 Aug 09 15:01:58.871450 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2533/5070] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:58 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:58.895831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0ffc722-a9ed-4d8d-be3a-7ae4b8d21fd2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:58.897168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0ffc722-a9ed-4d8d-be3a-7ae4b8d21fd2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:58.906392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ffc722-a9ed-4d8d-be3a-7ae4b8d21fd2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:58.907477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ffc722-a9ed-4d8d-be3a-7ae4b8d21fd2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:58.908456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ffc722-a9ed-4d8d-be3a-7ae4b8d21fd2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:58.909430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ffc722-a9ed-4d8d-be3a-7ae4b8d21fd2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:58.910069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ffc722-a9ed-4d8d-be3a-7ae4b8d21fd2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:58.910650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0ffc722-a9ed-4d8d-be3a-7ae4b8d21fd2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:58.950277 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d2147bb0-5aac-4344-a238-4c42d80335d7 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.629559 Aug 09 15:01:58.951182 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2538/5071] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:01:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:01:59.005827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4200be49-9ea4-4642-a4d4-0d06725040f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:59.006903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4200be49-9ea4-4642-a4d4-0d06725040f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:59.156042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4200be49-9ea4-4642-a4d4-0d06725040f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:59.170615 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4200be49-9ea4-4642-a4d4-0d06725040f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1213 microversion: 2.1 time: 0.176282 Aug 09 15:01:59.171629 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2539/5072] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:58 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1213 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:59.211749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0ffc722-a9ed-4d8d-be3a-7ae4b8d21fd2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:59.221176 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0ffc722-a9ed-4d8d-be3a-7ae4b8d21fd2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.331816 Aug 09 15:01:59.224765 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2534/5073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:58 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:01:59.250366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21d8b579-c38d-4b52-89ad-e54598de11e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:59.251020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-21d8b579-c38d-4b52-89ad-e54598de11e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:59.261033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21d8b579-c38d-4b52-89ad-e54598de11e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:59.261530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21d8b579-c38d-4b52-89ad-e54598de11e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:59.262330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21d8b579-c38d-4b52-89ad-e54598de11e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:59.267917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21d8b579-c38d-4b52-89ad-e54598de11e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:59.268323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21d8b579-c38d-4b52-89ad-e54598de11e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:59.273625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21d8b579-c38d-4b52-89ad-e54598de11e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:59.533694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-21d8b579-c38d-4b52-89ad-e54598de11e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:59.546751 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-21d8b579-c38d-4b52-89ad-e54598de11e5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.302032 Aug 09 15:01:59.548179 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2540/5074] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:59 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:01:59.571744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d37a2b94-bb94-4af1-badb-dd0d0f87d940 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:01:59.573074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d37a2b94-bb94-4af1-badb-dd0d0f87d940 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:01:59.586086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d37a2b94-bb94-4af1-badb-dd0d0f87d940 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:59.589829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d37a2b94-bb94-4af1-badb-dd0d0f87d940 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:59.590511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d37a2b94-bb94-4af1-badb-dd0d0f87d940 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:59.591504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d37a2b94-bb94-4af1-badb-dd0d0f87d940 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:01:59.598289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d37a2b94-bb94-4af1-badb-dd0d0f87d940 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:01:59.599121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d37a2b94-bb94-4af1-badb-dd0d0f87d940 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:01:59.878466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d37a2b94-bb94-4af1-badb-dd0d0f87d940 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:01:59.892942 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d37a2b94-bb94-4af1-badb-dd0d0f87d940 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.328307 Aug 09 15:01:59.894058 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2535/5075] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:01:59 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:00.172217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1776066975", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "aac61d64-db55-4d08-906a-2788d0f45a74"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:00.196289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b05a0ac1-677d-4f6e-a91d-1823cb84b763 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:00.198026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b05a0ac1-677d-4f6e-a91d-1823cb84b763 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:00.205380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05a0ac1-677d-4f6e-a91d-1823cb84b763 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:00.211162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05a0ac1-677d-4f6e-a91d-1823cb84b763 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:00.211389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05a0ac1-677d-4f6e-a91d-1823cb84b763 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:00.212093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05a0ac1-677d-4f6e-a91d-1823cb84b763 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:00.222032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05a0ac1-677d-4f6e-a91d-1823cb84b763 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:00.225519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05a0ac1-677d-4f6e-a91d-1823cb84b763 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:00.320446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] validate_networks() for [('aac61d64-db55-4d08-906a-2788d0f45a74', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:02:00.403352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b05a0ac1-677d-4f6e-a91d-1823cb84b763 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:00.416722 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b05a0ac1-677d-4f6e-a91d-1823cb84b763 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1265 microversion: 2.1 time: 0.224734 Aug 09 15:02:00.423132 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2536/5076] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:00 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:01.438185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-80f36a0c-77bc-4d94-981c-5291f409609e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:01.440495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-80f36a0c-77bc-4d94-981c-5291f409609e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:01.450150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f36a0c-77bc-4d94-981c-5291f409609e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:01.450942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f36a0c-77bc-4d94-981c-5291f409609e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:01.451562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f36a0c-77bc-4d94-981c-5291f409609e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:01.453042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f36a0c-77bc-4d94-981c-5291f409609e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:01.453673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f36a0c-77bc-4d94-981c-5291f409609e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:01.454263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f36a0c-77bc-4d94-981c-5291f409609e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:01.617212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-80f36a0c-77bc-4d94-981c-5291f409609e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:01.628605 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-80f36a0c-77bc-4d94-981c-5291f409609e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1271 microversion: 2.1 time: 0.193848 Aug 09 15:02:01.629880 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2537/5077] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:01 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:02:01.767828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:02:01.768411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:02:01.769313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:02:01.769751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:02:01.770475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:02:01.791693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:01.792287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:01.792993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:01.793744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:01.794287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:01.794625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:01.823931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Getting quotas for project 891029e759ac441f8a08c38bca92be81. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:02:01.829913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Getting quotas for user 3da785ddf56e4b028c6647643d97c952 and project 891029e759ac441f8a08c38bca92be81. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:02:01.852350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:02:01.856356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:02:01.935830 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ce73bd2e-07ca-4f41-b628-0124bbacf314 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.768581 Aug 09 15:02:01.951916 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2541/5078] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:02:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:02:01.965434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-499def6b-4250-4cb9-9763-2c1cb7266c3f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:01.967468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-499def6b-4250-4cb9-9763-2c1cb7266c3f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:02.052781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-499def6b-4250-4cb9-9763-2c1cb7266c3f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:02.060830 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-499def6b-4250-4cb9-9763-2c1cb7266c3f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1215 microversion: 2.1 time: 0.102338 Aug 09 15:02:02.065266 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2538/5079] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:01 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:02.659255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44a0eb41-0cbf-47ce-8750-c0010870a518 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:02.668058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44a0eb41-0cbf-47ce-8750-c0010870a518 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:02.687724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44a0eb41-0cbf-47ce-8750-c0010870a518 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:02.691190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44a0eb41-0cbf-47ce-8750-c0010870a518 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:02.691640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44a0eb41-0cbf-47ce-8750-c0010870a518 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:02.692398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44a0eb41-0cbf-47ce-8750-c0010870a518 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:02.692861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44a0eb41-0cbf-47ce-8750-c0010870a518 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:02.693288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44a0eb41-0cbf-47ce-8750-c0010870a518 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:03.087362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5b6ff165-c1d7-46e6-8606-448f1d7114a8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:03.088155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b6ff165-c1d7-46e6-8606-448f1d7114a8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:03.105563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b6ff165-c1d7-46e6-8606-448f1d7114a8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:03.106206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b6ff165-c1d7-46e6-8606-448f1d7114a8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:03.107732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b6ff165-c1d7-46e6-8606-448f1d7114a8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:03.111976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b6ff165-c1d7-46e6-8606-448f1d7114a8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:03.112647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b6ff165-c1d7-46e6-8606-448f1d7114a8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:03.113205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b6ff165-c1d7-46e6-8606-448f1d7114a8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:03.138319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-44a0eb41-0cbf-47ce-8750-c0010870a518 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:03.140832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=73 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:03.169123 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44a0eb41-0cbf-47ce-8750-c0010870a518 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1313 microversion: 2.1 time: 0.504190 Aug 09 15:02:03.174542 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2542/5080] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:02 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:03.338327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5b6ff165-c1d7-46e6-8606-448f1d7114a8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:03.346978 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5b6ff165-c1d7-46e6-8606-448f1d7114a8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1211 microversion: 2.1 time: 0.263944 Aug 09 15:02:03.347618 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2539/5081] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:03 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1211 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:02:04.197213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b75931dc-b90f-4c56-a259-777a6393a6f8 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:04.198859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b75931dc-b90f-4c56-a259-777a6393a6f8 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:04.210265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b75931dc-b90f-4c56-a259-777a6393a6f8 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:04.216079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b75931dc-b90f-4c56-a259-777a6393a6f8 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:04.216530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b75931dc-b90f-4c56-a259-777a6393a6f8 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:04.217628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b75931dc-b90f-4c56-a259-777a6393a6f8 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:04.218556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b75931dc-b90f-4c56-a259-777a6393a6f8 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:04.218979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b75931dc-b90f-4c56-a259-777a6393a6f8 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:04.369406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a157c5f-6d89-4b0c-a515-1c37255dedea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:04.370023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a157c5f-6d89-4b0c-a515-1c37255dedea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:04.397528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a157c5f-6d89-4b0c-a515-1c37255dedea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:04.398104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a157c5f-6d89-4b0c-a515-1c37255dedea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:04.398540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a157c5f-6d89-4b0c-a515-1c37255dedea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:04.407670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a157c5f-6d89-4b0c-a515-1c37255dedea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:04.408280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a157c5f-6d89-4b0c-a515-1c37255dedea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:04.408739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a157c5f-6d89-4b0c-a515-1c37255dedea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:04.585264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9a157c5f-6d89-4b0c-a515-1c37255dedea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:04.589900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:04.597704 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a157c5f-6d89-4b0c-a515-1c37255dedea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1273 microversion: 2.1 time: 0.232342 Aug 09 15:02:04.598686 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2540/5082] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:04 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:02:04.632604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b75931dc-b90f-4c56-a259-777a6393a6f8 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:04.647138 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b75931dc-b90f-4c56-a259-777a6393a6f8 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1313 microversion: 2.1 time: 0.453671 Aug 09 15:02:04.650205 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2543/5083] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:04 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:05.175668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-981f58a2-4e38-4ac0-8677-bbdcbd18c046 req-287d8f8d-eef3-4cb7-8b80-e94b35915c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c967ab-05c2-411f-804f-789ac8257cae", "tag": "8e81559c-7f6b-49d5-bd09-2cca4d9636ca"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:05.202494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-981f58a2-4e38-4ac0-8677-bbdcbd18c046 req-287d8f8d-eef3-4cb7-8b80-e94b35915c94 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:05.203322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-981f58a2-4e38-4ac0-8677-bbdcbd18c046 req-287d8f8d-eef3-4cb7-8b80-e94b35915c94 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:05.204186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-981f58a2-4e38-4ac0-8677-bbdcbd18c046 req-287d8f8d-eef3-4cb7-8b80-e94b35915c94 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:05.223232 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-981f58a2-4e38-4ac0-8677-bbdcbd18c046 req-287d8f8d-eef3-4cb7-8b80-e94b35915c94 service nova] Creating event network-changed:8e81559c-7f6b-49d5-bd09-2cca4d9636ca for instance f9c967ab-05c2-411f-804f-789ac8257cae on n-h2-844626-8 Aug 09 15:02:05.241993 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-981f58a2-4e38-4ac0-8677-bbdcbd18c046 req-287d8f8d-eef3-4cb7-8b80-e94b35915c94 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060705 Aug 09 15:02:05.244794 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2541/5084] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:05.562666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d368a719-7ba3-4a81-ac32-1dac1a697973 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:05.563310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d368a719-7ba3-4a81-ac32-1dac1a697973 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:05.578828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d368a719-7ba3-4a81-ac32-1dac1a697973 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:05.580874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d368a719-7ba3-4a81-ac32-1dac1a697973 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:05.581483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d368a719-7ba3-4a81-ac32-1dac1a697973 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:05.582350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d368a719-7ba3-4a81-ac32-1dac1a697973 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:05.588477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d368a719-7ba3-4a81-ac32-1dac1a697973 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:05.589324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d368a719-7ba3-4a81-ac32-1dac1a697973 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:05.623057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d8eb5901-95c1-40f6-9810-0e48bedfc16c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:05.624632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d8eb5901-95c1-40f6-9810-0e48bedfc16c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:05.642326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8eb5901-95c1-40f6-9810-0e48bedfc16c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:05.648601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8eb5901-95c1-40f6-9810-0e48bedfc16c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:05.649437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8eb5901-95c1-40f6-9810-0e48bedfc16c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:05.650452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8eb5901-95c1-40f6-9810-0e48bedfc16c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:05.651204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8eb5901-95c1-40f6-9810-0e48bedfc16c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:05.651880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d8eb5901-95c1-40f6-9810-0e48bedfc16c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:05.775650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-d368a719-7ba3-4a81-ac32-1dac1a697973 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lazy-loading 'services' on Instance uuid 5e6e74ae-a240-4ba4-b7c9-9112244ac190 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:02:05.948534 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d368a719-7ba3-4a81-ac32-1dac1a697973 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190/os-volume_attachments/c224dd1c-bbca-4521-956a-2d9f021642c5" status: 202 len: 0 microversion: 2.1 time: 0.390466 Aug 09 15:02:05.951803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d8eb5901-95c1-40f6-9810-0e48bedfc16c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:05.962760 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2544/5085] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:02:05 2022] DELETE /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190/os-volume_attachments/c224dd1c-bbca-4521-956a-2d9f021642c5 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:02:05.964719 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d8eb5901-95c1-40f6-9810-0e48bedfc16c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1315 microversion: 2.1 time: 0.348448 Aug 09 15:02:05.968465 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2542/5086] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:05 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:02:05.975121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d61fc88b-1ac6-45ec-a07e-54e4cbc0a039 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:05.981668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d61fc88b-1ac6-45ec-a07e-54e4cbc0a039 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:05.982607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d82e6f2f-5777-4c56-af9f-663fdc9d0a78 req-d83739be-7f54-4c8f-ae55-17882a433002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18943b03-73fd-47cf-bd10-0a11a0b7ada1", "tag": "c242588e-55cf-4148-a3c1-a7cb408d7679"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:05.996833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d61fc88b-1ac6-45ec-a07e-54e4cbc0a039 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:05.997331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d61fc88b-1ac6-45ec-a07e-54e4cbc0a039 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:05.997766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d61fc88b-1ac6-45ec-a07e-54e4cbc0a039 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:05.998501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d61fc88b-1ac6-45ec-a07e-54e4cbc0a039 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:05.998946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d61fc88b-1ac6-45ec-a07e-54e4cbc0a039 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:05.999591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d61fc88b-1ac6-45ec-a07e-54e4cbc0a039 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:06.018846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d82e6f2f-5777-4c56-af9f-663fdc9d0a78 req-d83739be-7f54-4c8f-ae55-17882a433002 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:06.019499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d82e6f2f-5777-4c56-af9f-663fdc9d0a78 req-d83739be-7f54-4c8f-ae55-17882a433002 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:06.023723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d82e6f2f-5777-4c56-af9f-663fdc9d0a78 req-d83739be-7f54-4c8f-ae55-17882a433002 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:06.061700 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d82e6f2f-5777-4c56-af9f-663fdc9d0a78 req-d83739be-7f54-4c8f-ae55-17882a433002 service nova] Creating event network-changed:c242588e-55cf-4148-a3c1-a7cb408d7679 for instance 18943b03-73fd-47cf-bd10-0a11a0b7ada1 on n-h1-844626-8 Aug 09 15:02:06.076405 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d82e6f2f-5777-4c56-af9f-663fdc9d0a78 req-d83739be-7f54-4c8f-ae55-17882a433002 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102591 Aug 09 15:02:06.079571 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2543/5087] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:06.405025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d61fc88b-1ac6-45ec-a07e-54e4cbc0a039 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:06.417692 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d61fc88b-1ac6-45ec-a07e-54e4cbc0a039 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1313 microversion: 2.1 time: 0.446885 Aug 09 15:02:06.418661 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2545/5088] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:05 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:06.996920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3882a80c-934e-4663-81f2-240a8d34d4bf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:06.998908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3882a80c-934e-4663-81f2-240a8d34d4bf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:07.007324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3882a80c-934e-4663-81f2-240a8d34d4bf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:07.008553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3882a80c-934e-4663-81f2-240a8d34d4bf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:07.009195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3882a80c-934e-4663-81f2-240a8d34d4bf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:07.010527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3882a80c-934e-4663-81f2-240a8d34d4bf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:07.011303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3882a80c-934e-4663-81f2-240a8d34d4bf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:07.012249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3882a80c-934e-4663-81f2-240a8d34d4bf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:07.311577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3882a80c-934e-4663-81f2-240a8d34d4bf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:07.321272 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3882a80c-934e-4663-81f2-240a8d34d4bf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1315 microversion: 2.1 time: 0.334709 Aug 09 15:02:07.334640 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2544/5089] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:06 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:07.438669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-35d36a93-e4ec-425f-b301-d8242fd114fd tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:07.439294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-35d36a93-e4ec-425f-b301-d8242fd114fd tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:07.448954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d36a93-e4ec-425f-b301-d8242fd114fd tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:07.450369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d36a93-e4ec-425f-b301-d8242fd114fd tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:07.451025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d36a93-e4ec-425f-b301-d8242fd114fd tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:07.452436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d36a93-e4ec-425f-b301-d8242fd114fd tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:07.453244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d36a93-e4ec-425f-b301-d8242fd114fd tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:07.454038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d36a93-e4ec-425f-b301-d8242fd114fd tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:07.911858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-35d36a93-e4ec-425f-b301-d8242fd114fd tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:07.924826 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-35d36a93-e4ec-425f-b301-d8242fd114fd tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1313 microversion: 2.1 time: 0.488980 Aug 09 15:02:07.935611 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2546/5090] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:07 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:08.343897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-38f4aafb-e918-40d8-9c31-6c86bc51aa67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:08.345148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-38f4aafb-e918-40d8-9c31-6c86bc51aa67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:08.356134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38f4aafb-e918-40d8-9c31-6c86bc51aa67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:08.357142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38f4aafb-e918-40d8-9c31-6c86bc51aa67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:08.358184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38f4aafb-e918-40d8-9c31-6c86bc51aa67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:08.372180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38f4aafb-e918-40d8-9c31-6c86bc51aa67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:08.373215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38f4aafb-e918-40d8-9c31-6c86bc51aa67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:08.374336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38f4aafb-e918-40d8-9c31-6c86bc51aa67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:08.855561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-38f4aafb-e918-40d8-9c31-6c86bc51aa67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:08.864862 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-38f4aafb-e918-40d8-9c31-6c86bc51aa67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1315 microversion: 2.1 time: 0.526342 Aug 09 15:02:08.866188 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2545/5091] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:08 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:08.956338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-600c1e64-3823-428e-a129-78fb8bfec10c tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:08.956952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-600c1e64-3823-428e-a129-78fb8bfec10c tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:08.966572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-600c1e64-3823-428e-a129-78fb8bfec10c tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:08.967067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-600c1e64-3823-428e-a129-78fb8bfec10c tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:08.967747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-600c1e64-3823-428e-a129-78fb8bfec10c tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:08.968664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-600c1e64-3823-428e-a129-78fb8bfec10c tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:08.969280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-600c1e64-3823-428e-a129-78fb8bfec10c tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:08.969854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-600c1e64-3823-428e-a129-78fb8bfec10c tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:09.208550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-600c1e64-3823-428e-a129-78fb8bfec10c tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:09.219756 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-600c1e64-3823-428e-a129-78fb8bfec10c tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1313 microversion: 2.1 time: 0.267103 Aug 09 15:02:09.221300 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2547/5092] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:08 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:09.888826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b88043ef-fe43-457e-aaac-751054a2f83d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:09.889562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b88043ef-fe43-457e-aaac-751054a2f83d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:09.906751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b88043ef-fe43-457e-aaac-751054a2f83d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:09.907363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b88043ef-fe43-457e-aaac-751054a2f83d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:09.907876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b88043ef-fe43-457e-aaac-751054a2f83d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:09.908794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b88043ef-fe43-457e-aaac-751054a2f83d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:09.909415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b88043ef-fe43-457e-aaac-751054a2f83d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:09.910025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b88043ef-fe43-457e-aaac-751054a2f83d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:10.174228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b88043ef-fe43-457e-aaac-751054a2f83d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:10.186279 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b88043ef-fe43-457e-aaac-751054a2f83d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1315 microversion: 2.1 time: 0.301641 Aug 09 15:02:10.187390 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2546/5093] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:09 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:10.242618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-175b1f31-83de-4c5e-98d5-e162ca0d0edc tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:10.243432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-175b1f31-83de-4c5e-98d5-e162ca0d0edc tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:10.256934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-175b1f31-83de-4c5e-98d5-e162ca0d0edc tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:10.258868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-175b1f31-83de-4c5e-98d5-e162ca0d0edc tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:10.259572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-175b1f31-83de-4c5e-98d5-e162ca0d0edc tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:10.261830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-175b1f31-83de-4c5e-98d5-e162ca0d0edc tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:10.262663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-175b1f31-83de-4c5e-98d5-e162ca0d0edc tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:10.263523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-175b1f31-83de-4c5e-98d5-e162ca0d0edc tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:10.573668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-175b1f31-83de-4c5e-98d5-e162ca0d0edc tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:10.583632 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-175b1f31-83de-4c5e-98d5-e162ca0d0edc tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1313 microversion: 2.1 time: 0.345410 Aug 09 15:02:10.598378 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2548/5094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:10 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:10.672242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-083f25fa-35a0-4912-9b70-f19edaf2ec3f req-82168d4d-3744-4061-b243-45a6d8225df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c967ab-05c2-411f-804f-789ac8257cae", "name": "network-vif-plugged", "status": "completed", "tag": "8e81559c-7f6b-49d5-bd09-2cca4d9636ca"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:10.688506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-083f25fa-35a0-4912-9b70-f19edaf2ec3f req-82168d4d-3744-4061-b243-45a6d8225df4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:10.689277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-083f25fa-35a0-4912-9b70-f19edaf2ec3f req-82168d4d-3744-4061-b243-45a6d8225df4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:10.689859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-083f25fa-35a0-4912-9b70-f19edaf2ec3f req-82168d4d-3744-4061-b243-45a6d8225df4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:10.713566 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-083f25fa-35a0-4912-9b70-f19edaf2ec3f req-82168d4d-3744-4061-b243-45a6d8225df4 service nova] Creating event network-vif-plugged:8e81559c-7f6b-49d5-bd09-2cca4d9636ca for instance f9c967ab-05c2-411f-804f-789ac8257cae on n-h2-844626-8 Aug 09 15:02:10.726408 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-083f25fa-35a0-4912-9b70-f19edaf2ec3f req-82168d4d-3744-4061-b243-45a6d8225df4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057755 Aug 09 15:02:10.729482 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2547/5095] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:11.211601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b73cd2cc-9e19-4ca1-8582-23e611940c0d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:11.212982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b73cd2cc-9e19-4ca1-8582-23e611940c0d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:11.226017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b73cd2cc-9e19-4ca1-8582-23e611940c0d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:11.227435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b73cd2cc-9e19-4ca1-8582-23e611940c0d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:11.231263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b73cd2cc-9e19-4ca1-8582-23e611940c0d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:11.232629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b73cd2cc-9e19-4ca1-8582-23e611940c0d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:11.234341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b73cd2cc-9e19-4ca1-8582-23e611940c0d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:11.234986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b73cd2cc-9e19-4ca1-8582-23e611940c0d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:11.541481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b73cd2cc-9e19-4ca1-8582-23e611940c0d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:11.554349 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b73cd2cc-9e19-4ca1-8582-23e611940c0d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1315 microversion: 2.1 time: 0.349339 Aug 09 15:02:11.554956 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2549/5096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:11 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:11.608250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b5c150eb-3c30-409a-a000-2efa46cd9fd2 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:11.610494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b5c150eb-3c30-409a-a000-2efa46cd9fd2 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:11.625698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5c150eb-3c30-409a-a000-2efa46cd9fd2 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:11.626167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5c150eb-3c30-409a-a000-2efa46cd9fd2 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:11.626817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5c150eb-3c30-409a-a000-2efa46cd9fd2 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:11.627970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5c150eb-3c30-409a-a000-2efa46cd9fd2 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:11.632339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5c150eb-3c30-409a-a000-2efa46cd9fd2 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:11.633145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5c150eb-3c30-409a-a000-2efa46cd9fd2 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:11.870976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b5c150eb-3c30-409a-a000-2efa46cd9fd2 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:11.884429 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b5c150eb-3c30-409a-a000-2efa46cd9fd2 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1313 microversion: 2.1 time: 0.280773 Aug 09 15:02:11.890527 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2548/5097] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:11 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:12.396546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee6b9ed1-c96f-4803-8279-7fe8ff40cf4c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:12.397347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee6b9ed1-c96f-4803-8279-7fe8ff40cf4c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:12.404324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:12.406027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=14 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:12.409371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee6b9ed1-c96f-4803-8279-7fe8ff40cf4c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:12.410795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee6b9ed1-c96f-4803-8279-7fe8ff40cf4c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:12.411501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee6b9ed1-c96f-4803-8279-7fe8ff40cf4c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:12.412439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee6b9ed1-c96f-4803-8279-7fe8ff40cf4c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:12.413181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee6b9ed1-c96f-4803-8279-7fe8ff40cf4c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:12.413791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee6b9ed1-c96f-4803-8279-7fe8ff40cf4c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:12.450573 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee6b9ed1-c96f-4803-8279-7fe8ff40cf4c tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/ips" status: 200 len: 146 microversion: 2.1 time: 0.058708 Aug 09 15:02:12.451511 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2550/5098] 10.222.0.50 () {58 vars in 1248 bytes} [Tue Aug 9 15:02:12 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/ips => generated 146 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:12.583222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-944c75c7-eca7-45b5-b09e-fbb10c0ab20e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:12.585627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-944c75c7-eca7-45b5-b09e-fbb10c0ab20e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:12.594536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:12.608972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-944c75c7-eca7-45b5-b09e-fbb10c0ab20e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:12.628056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-944c75c7-eca7-45b5-b09e-fbb10c0ab20e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:12.628518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-944c75c7-eca7-45b5-b09e-fbb10c0ab20e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:12.632728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-944c75c7-eca7-45b5-b09e-fbb10c0ab20e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:12.633519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-944c75c7-eca7-45b5-b09e-fbb10c0ab20e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:12.634287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-944c75c7-eca7-45b5-b09e-fbb10c0ab20e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:12.762640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-250442f7-a967-4fe5-acc4-e78a3bcb25da req-45bd0fff-e27a-4d5e-9c30-814239666f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18943b03-73fd-47cf-bd10-0a11a0b7ada1", "name": "network-vif-plugged", "status": "completed", "tag": "c242588e-55cf-4148-a3c1-a7cb408d7679"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:12.787218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-250442f7-a967-4fe5-acc4-e78a3bcb25da req-45bd0fff-e27a-4d5e-9c30-814239666f9c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:12.790234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-250442f7-a967-4fe5-acc4-e78a3bcb25da req-45bd0fff-e27a-4d5e-9c30-814239666f9c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:12.790946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-250442f7-a967-4fe5-acc4-e78a3bcb25da req-45bd0fff-e27a-4d5e-9c30-814239666f9c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:12.828909 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-250442f7-a967-4fe5-acc4-e78a3bcb25da req-45bd0fff-e27a-4d5e-9c30-814239666f9c service nova] Creating event network-vif-plugged:c242588e-55cf-4148-a3c1-a7cb408d7679 for instance 18943b03-73fd-47cf-bd10-0a11a0b7ada1 on n-h1-844626-8 Aug 09 15:02:12.839849 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-250442f7-a967-4fe5-acc4-e78a3bcb25da req-45bd0fff-e27a-4d5e-9c30-814239666f9c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080486 Aug 09 15:02:12.841386 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2551/5099] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:02:12.870285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8745a5ec-6ee8-48c6-ab42-660a2312236b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:12.871999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8745a5ec-6ee8-48c6-ab42-660a2312236b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:12.892839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8745a5ec-6ee8-48c6-ab42-660a2312236b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:12.893386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8745a5ec-6ee8-48c6-ab42-660a2312236b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:12.893809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8745a5ec-6ee8-48c6-ab42-660a2312236b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:12.924303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8745a5ec-6ee8-48c6-ab42-660a2312236b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:12.926969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8745a5ec-6ee8-48c6-ab42-660a2312236b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:12.927691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8745a5ec-6ee8-48c6-ab42-660a2312236b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:12.985344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-944c75c7-eca7-45b5-b09e-fbb10c0ab20e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:13.002327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8745a5ec-6ee8-48c6-ab42-660a2312236b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:02:13.005090 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-944c75c7-eca7-45b5-b09e-fbb10c0ab20e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1315 microversion: 2.1 time: 0.428433 Aug 09 15:02:13.009886 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2549/5100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:12 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:13.019722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b20cc5e2-04e8-48f4-bff7-e4a3276e02f1 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:13.021394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b20cc5e2-04e8-48f4-bff7-e4a3276e02f1 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:13.043268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b20cc5e2-04e8-48f4-bff7-e4a3276e02f1 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:13.046434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b20cc5e2-04e8-48f4-bff7-e4a3276e02f1 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:13.047147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b20cc5e2-04e8-48f4-bff7-e4a3276e02f1 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:13.051322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b20cc5e2-04e8-48f4-bff7-e4a3276e02f1 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:13.052254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b20cc5e2-04e8-48f4-bff7-e4a3276e02f1 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:13.052901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b20cc5e2-04e8-48f4-bff7-e4a3276e02f1 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:13.233626 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8745a5ec-6ee8-48c6-ab42-660a2312236b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 204 len: 0 microversion: 2.1 time: 0.387264 Aug 09 15:02:13.234606 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2552/5101] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:02:12 2022] DELETE /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:02:13.243603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a4ebfffd-0793-46b3-a0dc-a64a537e4690 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:13.244577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a4ebfffd-0793-46b3-a0dc-a64a537e4690 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:13.261849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4ebfffd-0793-46b3-a0dc-a64a537e4690 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:13.262595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4ebfffd-0793-46b3-a0dc-a64a537e4690 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:13.263236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4ebfffd-0793-46b3-a0dc-a64a537e4690 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:13.264119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4ebfffd-0793-46b3-a0dc-a64a537e4690 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:13.265665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4ebfffd-0793-46b3-a0dc-a64a537e4690 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:13.266280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4ebfffd-0793-46b3-a0dc-a64a537e4690 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:13.619998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a4ebfffd-0793-46b3-a0dc-a64a537e4690 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:13.624331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b20cc5e2-04e8-48f4-bff7-e4a3276e02f1 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:13.631173 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a4ebfffd-0793-46b3-a0dc-a64a537e4690 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1514 microversion: 2.1 time: 0.391113 Aug 09 15:02:13.632756 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2553/5102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:13 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1514 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:02:13.648747 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b20cc5e2-04e8-48f4-bff7-e4a3276e02f1 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1462 microversion: 2.1 time: 0.636843 Aug 09 15:02:13.663662 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2550/5103] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:13 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1462 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:13.672982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05b1ab58-e620-46e3-9754-e018b1f12d2e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88604f2d-1766-4865-aabb-347202a59dc9", "device": "/dev/sdb"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:13.677445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05b1ab58-e620-46e3-9754-e018b1f12d2e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:13.692267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b1ab58-e620-46e3-9754-e018b1f12d2e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:13.693656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b1ab58-e620-46e3-9754-e018b1f12d2e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:13.695038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b1ab58-e620-46e3-9754-e018b1f12d2e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:13.696859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b1ab58-e620-46e3-9754-e018b1f12d2e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:13.698182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b1ab58-e620-46e3-9754-e018b1f12d2e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:13.699520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05b1ab58-e620-46e3-9754-e018b1f12d2e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:14.034994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-261bb31c-def8-4eec-9fa0-98cea7118c67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:14.035972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-261bb31c-def8-4eec-9fa0-98cea7118c67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:14.053917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261bb31c-def8-4eec-9fa0-98cea7118c67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:14.054414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261bb31c-def8-4eec-9fa0-98cea7118c67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:14.056650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261bb31c-def8-4eec-9fa0-98cea7118c67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:14.057419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261bb31c-def8-4eec-9fa0-98cea7118c67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:14.057899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261bb31c-def8-4eec-9fa0-98cea7118c67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:14.058332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-261bb31c-def8-4eec-9fa0-98cea7118c67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:14.200879 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05b1ab58-e620-46e3-9754-e018b1f12d2e tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "POST /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532518 Aug 09 15:02:14.207466 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2554/5104] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 15:02:13 2022] POST /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae/os-volume_attachments => generated 194 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:14.458329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-261bb31c-def8-4eec-9fa0-98cea7118c67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:14.468702 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-261bb31c-def8-4eec-9fa0-98cea7118c67 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1315 microversion: 2.1 time: 0.437783 Aug 09 15:02:14.471419 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2551/5105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:14 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:14.662901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1763cc35-cbbd-4c55-9793-0a8471ad266e tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:14.665295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1763cc35-cbbd-4c55-9793-0a8471ad266e tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:14.676170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1763cc35-cbbd-4c55-9793-0a8471ad266e tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:14.677384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1763cc35-cbbd-4c55-9793-0a8471ad266e tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:14.678029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1763cc35-cbbd-4c55-9793-0a8471ad266e tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:14.680163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1763cc35-cbbd-4c55-9793-0a8471ad266e tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:14.680856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1763cc35-cbbd-4c55-9793-0a8471ad266e tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:14.681570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1763cc35-cbbd-4c55-9793-0a8471ad266e tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:14.988950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1763cc35-cbbd-4c55-9793-0a8471ad266e tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:15.002837 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1763cc35-cbbd-4c55-9793-0a8471ad266e tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1514 microversion: 2.1 time: 0.352201 Aug 09 15:02:15.004522 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2555/5106] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:14 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1514 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:15.284448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d43e947-fa86-4df8-b542-72e51a80f6db tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "470eca90-7d95-4a8e-9c15-a22c3e516c57"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:15.289933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d43e947-fa86-4df8-b542-72e51a80f6db tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:15.307032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d43e947-fa86-4df8-b542-72e51a80f6db tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:15.308187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d43e947-fa86-4df8-b542-72e51a80f6db tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:15.308683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d43e947-fa86-4df8-b542-72e51a80f6db tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:15.309499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d43e947-fa86-4df8-b542-72e51a80f6db tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:15.309849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d43e947-fa86-4df8-b542-72e51a80f6db tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:15.310271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d43e947-fa86-4df8-b542-72e51a80f6db tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:15.498868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-409336ae-5858-4eb3-a9fa-b98d72326e98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:15.499595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-409336ae-5858-4eb3-a9fa-b98d72326e98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:15.537496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-409336ae-5858-4eb3-a9fa-b98d72326e98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:15.540159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-409336ae-5858-4eb3-a9fa-b98d72326e98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:15.540682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-409336ae-5858-4eb3-a9fa-b98d72326e98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:15.544002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-409336ae-5858-4eb3-a9fa-b98d72326e98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:15.545999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-409336ae-5858-4eb3-a9fa-b98d72326e98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:15.549456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-409336ae-5858-4eb3-a9fa-b98d72326e98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:15.817961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-409336ae-5858-4eb3-a9fa-b98d72326e98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:15.821087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:15.828401 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-409336ae-5858-4eb3-a9fa-b98d72326e98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1498 microversion: 2.1 time: 0.336128 Aug 09 15:02:15.832402 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2556/5107] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:15 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1498 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:15.851480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f7e7b122-3b1b-4fa2-852a-17184deec7e3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:15.854707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7e7b122-3b1b-4fa2-852a-17184deec7e3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:15.862008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7e7b122-3b1b-4fa2-852a-17184deec7e3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:15.863200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7e7b122-3b1b-4fa2-852a-17184deec7e3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:15.864182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7e7b122-3b1b-4fa2-852a-17184deec7e3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:15.865067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7e7b122-3b1b-4fa2-852a-17184deec7e3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:15.865668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7e7b122-3b1b-4fa2-852a-17184deec7e3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:15.866294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7e7b122-3b1b-4fa2-852a-17184deec7e3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:15.921424 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d43e947-fa86-4df8-b542-72e51a80f6db tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "POST /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.644876 Aug 09 15:02:15.922367 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2552/5108] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 15:02:15 2022] POST /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:15.954160 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f7e7b122-3b1b-4fa2-852a-17184deec7e3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action" status: 200 len: 14 microversion: 2.1 time: 0.106742 Aug 09 15:02:15.958050 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2557/5109] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:15 2022] POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:02:16.025933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-536542a4-f975-41ca-8087-3f6b9dba7ccc tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:16.026774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-536542a4-f975-41ca-8087-3f6b9dba7ccc tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:16.044300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536542a4-f975-41ca-8087-3f6b9dba7ccc tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:16.044805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536542a4-f975-41ca-8087-3f6b9dba7ccc tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:16.045245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536542a4-f975-41ca-8087-3f6b9dba7ccc tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:16.053144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536542a4-f975-41ca-8087-3f6b9dba7ccc tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:16.053745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536542a4-f975-41ca-8087-3f6b9dba7ccc tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:16.054199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-536542a4-f975-41ca-8087-3f6b9dba7ccc tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:16.437377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-536542a4-f975-41ca-8087-3f6b9dba7ccc tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:16.460093 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-536542a4-f975-41ca-8087-3f6b9dba7ccc tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 200 len: 1514 microversion: 2.1 time: 0.437146 Aug 09 15:02:16.476625 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2553/5110] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:16 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 1514 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:16.599478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3a84ccb9-2423-44de-b4de-17d88487ad5c req-22d633c5-edad-4b38-ac06-abf1bb8a2efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e6e74ae-a240-4ba4-b7c9-9112244ac190", "name": "network-vif-deleted", "tag": "c4bf5853-ae26-4769-900e-f67523acb66d"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:16.610217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3a84ccb9-2423-44de-b4de-17d88487ad5c req-22d633c5-edad-4b38-ac06-abf1bb8a2efa service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:16.623957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3a84ccb9-2423-44de-b4de-17d88487ad5c req-22d633c5-edad-4b38-ac06-abf1bb8a2efa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:16.624725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3a84ccb9-2423-44de-b4de-17d88487ad5c req-22d633c5-edad-4b38-ac06-abf1bb8a2efa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:16.647373 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3a84ccb9-2423-44de-b4de-17d88487ad5c req-22d633c5-edad-4b38-ac06-abf1bb8a2efa service nova] Creating event network-vif-deleted:c4bf5853-ae26-4769-900e-f67523acb66d for instance 5e6e74ae-a240-4ba4-b7c9-9112244ac190 on n-h1-844626-8 Aug 09 15:02:16.654103 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3a84ccb9-2423-44de-b4de-17d88487ad5c req-22d633c5-edad-4b38-ac06-abf1bb8a2efa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058266 Aug 09 15:02:16.656029 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2558/5111] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:16.966200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-176aca25-7ffe-4d16-a414-ae0d6fe5b152 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:16.971486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-176aca25-7ffe-4d16-a414-ae0d6fe5b152 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:16.987842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-176aca25-7ffe-4d16-a414-ae0d6fe5b152 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:16.988343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-176aca25-7ffe-4d16-a414-ae0d6fe5b152 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:16.988787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-176aca25-7ffe-4d16-a414-ae0d6fe5b152 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:16.989498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-176aca25-7ffe-4d16-a414-ae0d6fe5b152 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:16.989954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-176aca25-7ffe-4d16-a414-ae0d6fe5b152 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:16.990379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-176aca25-7ffe-4d16-a414-ae0d6fe5b152 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:17.069015 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-176aca25-7ffe-4d16-a414-ae0d6fe5b152 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action" status: 200 len: 14 microversion: 2.1 time: 0.106566 Aug 09 15:02:17.070092 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2554/5112] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:16 2022] POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 15:02:17.489791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ff4690a-988e-4878-8747-b2179c17834d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:17.490681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0ff4690a-988e-4878-8747-b2179c17834d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: 5e6e74ae-a240-4ba4-b7c9-9112244ac190] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:17.499578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ff4690a-988e-4878-8747-b2179c17834d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:17.500074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ff4690a-988e-4878-8747-b2179c17834d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:17.500581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ff4690a-988e-4878-8747-b2179c17834d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:17.501295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ff4690a-988e-4878-8747-b2179c17834d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:17.501744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ff4690a-988e-4878-8747-b2179c17834d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:17.502164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ff4690a-988e-4878-8747-b2179c17834d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:17.522110 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-0ff4690a-988e-4878-8747-b2179c17834d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] HTTP exception thrown: Instance 5e6e74ae-a240-4ba4-b7c9-9112244ac190 could not be found. Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ff4690a-988e-4878-8747-b2179c17834d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Request method failure captured: Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 HTTP/1.1 Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nYivwnHgKH2L-gVNywShRfD_Xl3V9JyE1bXnfGFE2KC0K6zVAC0__I7c4oiY6WWCw0yIkLnTJUuiFlbAoBeY0kXkOXtpZVeHsHTb6-HboplnCKVpdqnYX3RIIV3YhVZY_xOSwKDuu0ypRcnmCX5pail-YA7QeMHJPEI10EPit-SuaQ Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9fbd4a7083a34b02910cb4e4b7d4aca0 Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesSnapshotTestJSON-830142703 Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9fbd4a7083a34b02910cb4e4b7d4aca0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9fbd4a7083a34b02910cb4e4b7d4aca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9fbd4a7083a34b02910cb4e4b7d4aca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9fbd4a7083a34b02910cb4e4b7d4aca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-VolumesSnapshotTestJSON-830142703 Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9fbd4a7083a34b02910cb4e4b7d4aca0 Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-830142703 Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-VolumesSnapshotTestJSON-830142703-project Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 94ab820ec1384350b9cab506cf75df22 Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-VolumesSnapshotTestJSON-830142703-project Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 5e6e74ae-a240-4ba4-b7c9-9112244ac190 could not be found. Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '5e6e74ae-a240-4ba4-b7c9-9112244ac190'} Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e6e74ae-a240-4ba4-b7c9-9112244ac190 could not be found. Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e6e74ae-a240-4ba4-b7c9-9112244ac190 could not be found. Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:02:17.524682 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:02:17.529877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:02:17.529877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:02:17.529877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:02:17.529877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:02:17.529877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:02:17.529877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e6e74ae-a240-4ba4-b7c9-9112244ac190 could not be found. Aug 09 15:02:17.529877 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:02:17.531244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ff4690a-988e-4878-8747-b2179c17834d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Returning 404 to user: Instance 5e6e74ae-a240-4ba4-b7c9-9112244ac190 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:02:17.532305 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0ff4690a-988e-4878-8747-b2179c17834d tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190" status: 404 len: 111 microversion: 2.1 time: 0.054075 Aug 09 15:02:17.533239 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2559/5113] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:17 2022] GET /compute/v2.1/servers/5e6e74ae-a240-4ba4-b7c9-9112244ac190 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:02:18.083191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dddf15fe-31f3-456e-80b8-65e7d734b76b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:18.088220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dddf15fe-31f3-456e-80b8-65e7d734b76b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:18.104158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dddf15fe-31f3-456e-80b8-65e7d734b76b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:18.104961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dddf15fe-31f3-456e-80b8-65e7d734b76b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:18.106039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dddf15fe-31f3-456e-80b8-65e7d734b76b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:18.107013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dddf15fe-31f3-456e-80b8-65e7d734b76b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:18.107715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dddf15fe-31f3-456e-80b8-65e7d734b76b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:18.108384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dddf15fe-31f3-456e-80b8-65e7d734b76b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:18.151628 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dddf15fe-31f3-456e-80b8-65e7d734b76b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action" status: 200 len: 14 microversion: 2.1 time: 0.073745 Aug 09 15:02:18.155990 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2555/5114] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:18 2022] POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:02:19.164831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eb6b452f-aea1-4453-959b-71f077744e9a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:19.168218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eb6b452f-aea1-4453-959b-71f077744e9a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:19.177931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb6b452f-aea1-4453-959b-71f077744e9a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:19.178736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb6b452f-aea1-4453-959b-71f077744e9a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:19.179388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb6b452f-aea1-4453-959b-71f077744e9a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:19.180500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb6b452f-aea1-4453-959b-71f077744e9a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:19.181334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb6b452f-aea1-4453-959b-71f077744e9a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:19.181984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb6b452f-aea1-4453-959b-71f077744e9a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:19.230718 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eb6b452f-aea1-4453-959b-71f077744e9a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action" status: 200 len: 14 microversion: 2.1 time: 0.067438 Aug 09 15:02:19.231753 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2560/5115] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:19 2022] POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 15:02:20.243254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4c480eca-25d8-464a-86c6-59b8bfb6c2bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:20.245653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4c480eca-25d8-464a-86c6-59b8bfb6c2bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:20.253221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=58 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:20.255815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c480eca-25d8-464a-86c6-59b8bfb6c2bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:20.256278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c480eca-25d8-464a-86c6-59b8bfb6c2bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:20.256972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c480eca-25d8-464a-86c6-59b8bfb6c2bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:20.258201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c480eca-25d8-464a-86c6-59b8bfb6c2bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:20.258201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c480eca-25d8-464a-86c6-59b8bfb6c2bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:20.258594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c480eca-25d8-464a-86c6-59b8bfb6c2bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:20.302457 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4c480eca-25d8-464a-86c6-59b8bfb6c2bb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action" status: 200 len: 14 microversion: 2.1 time: 0.063334 Aug 09 15:02:20.303249 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2556/5116] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:20 2022] POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:02:21.315924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-651a09bb-a4de-45e7-8e40-8535f2dbca80 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:21.318504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-651a09bb-a4de-45e7-8e40-8535f2dbca80 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:21.329086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:21.334237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-651a09bb-a4de-45e7-8e40-8535f2dbca80 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:21.335079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-651a09bb-a4de-45e7-8e40-8535f2dbca80 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:21.335555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-651a09bb-a4de-45e7-8e40-8535f2dbca80 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:21.336221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-651a09bb-a4de-45e7-8e40-8535f2dbca80 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:21.336816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-651a09bb-a4de-45e7-8e40-8535f2dbca80 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:21.337232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-651a09bb-a4de-45e7-8e40-8535f2dbca80 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:21.387723 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-651a09bb-a4de-45e7-8e40-8535f2dbca80 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action" status: 200 len: 14 microversion: 2.1 time: 0.076502 Aug 09 15:02:21.388392 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2561/5117] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:21 2022] POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:02:22.399505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-93822d6b-e806-4947-9d08-a442eb82255f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:22.401852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-93822d6b-e806-4947-9d08-a442eb82255f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:22.409716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93822d6b-e806-4947-9d08-a442eb82255f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:22.410201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93822d6b-e806-4947-9d08-a442eb82255f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:22.410636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93822d6b-e806-4947-9d08-a442eb82255f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:22.411366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93822d6b-e806-4947-9d08-a442eb82255f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:22.411804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93822d6b-e806-4947-9d08-a442eb82255f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:22.412229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93822d6b-e806-4947-9d08-a442eb82255f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:22.452150 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-93822d6b-e806-4947-9d08-a442eb82255f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action" status: 200 len: 14 microversion: 2.1 time: 0.056966 Aug 09 15:02:22.455926 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2557/5118] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:22 2022] POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:02:23.464214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7974f717-c6e4-4044-a03a-52aeb0220ff7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:23.466716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7974f717-c6e4-4044-a03a-52aeb0220ff7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:23.476123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7974f717-c6e4-4044-a03a-52aeb0220ff7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:23.476863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7974f717-c6e4-4044-a03a-52aeb0220ff7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:23.477477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7974f717-c6e4-4044-a03a-52aeb0220ff7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:23.478361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7974f717-c6e4-4044-a03a-52aeb0220ff7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:23.478983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7974f717-c6e4-4044-a03a-52aeb0220ff7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:23.479833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7974f717-c6e4-4044-a03a-52aeb0220ff7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:23.536778 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7974f717-c6e4-4044-a03a-52aeb0220ff7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action" status: 200 len: 14 microversion: 2.1 time: 0.076524 Aug 09 15:02:23.541328 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2562/5119] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:23 2022] POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:02:24.549590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9510cdce-94d8-4af9-b3d2-776725f1a2d5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:24.553199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9510cdce-94d8-4af9-b3d2-776725f1a2d5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:24.561700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9510cdce-94d8-4af9-b3d2-776725f1a2d5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:24.562792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9510cdce-94d8-4af9-b3d2-776725f1a2d5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:24.563488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9510cdce-94d8-4af9-b3d2-776725f1a2d5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:24.564411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9510cdce-94d8-4af9-b3d2-776725f1a2d5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:24.565076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9510cdce-94d8-4af9-b3d2-776725f1a2d5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:24.565507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9510cdce-94d8-4af9-b3d2-776725f1a2d5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:24.614740 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9510cdce-94d8-4af9-b3d2-776725f1a2d5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action" status: 200 len: 14 microversion: 2.1 time: 0.069690 Aug 09 15:02:24.615688 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2558/5120] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:24 2022] POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:02:25.628497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1d3a138-6273-40bc-bcf8-980ad1c836fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:25.630826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1d3a138-6273-40bc-bcf8-980ad1c836fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:25.644080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1d3a138-6273-40bc-bcf8-980ad1c836fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:25.644556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1d3a138-6273-40bc-bcf8-980ad1c836fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:25.644989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1d3a138-6273-40bc-bcf8-980ad1c836fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:25.645688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1d3a138-6273-40bc-bcf8-980ad1c836fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:25.646129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1d3a138-6273-40bc-bcf8-980ad1c836fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:25.646525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1d3a138-6273-40bc-bcf8-980ad1c836fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:25.692034 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1d3a138-6273-40bc-bcf8-980ad1c836fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action" status: 200 len: 14 microversion: 2.1 time: 0.069068 Aug 09 15:02:25.693055 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2563/5121] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:25 2022] POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:02:26.707516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7f909b6-622e-459e-b256-991ad4d9548d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:26.710792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7f909b6-622e-459e-b256-991ad4d9548d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:26.720702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7f909b6-622e-459e-b256-991ad4d9548d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:26.721518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7f909b6-622e-459e-b256-991ad4d9548d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:26.722358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7f909b6-622e-459e-b256-991ad4d9548d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:26.723350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7f909b6-622e-459e-b256-991ad4d9548d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:26.724044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7f909b6-622e-459e-b256-991ad4d9548d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:26.724682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7f909b6-622e-459e-b256-991ad4d9548d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:26.790360 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7f909b6-622e-459e-b256-991ad4d9548d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action" status: 200 len: 14 microversion: 2.1 time: 0.089974 Aug 09 15:02:26.796816 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2559/5122] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:26 2022] POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:02:27.811098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b91c3ac3-327a-4e83-9f83-531c31dbf079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:27.811098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b91c3ac3-327a-4e83-9f83-531c31dbf079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:27.814903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b91c3ac3-327a-4e83-9f83-531c31dbf079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:27.815387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b91c3ac3-327a-4e83-9f83-531c31dbf079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:27.815819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b91c3ac3-327a-4e83-9f83-531c31dbf079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:27.816514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b91c3ac3-327a-4e83-9f83-531c31dbf079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:27.816958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b91c3ac3-327a-4e83-9f83-531c31dbf079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:27.817375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b91c3ac3-327a-4e83-9f83-531c31dbf079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:27.868475 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b91c3ac3-327a-4e83-9f83-531c31dbf079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action" status: 200 len: 8206 microversion: 2.1 time: 0.067915 Aug 09 15:02:27.869138 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2564/5123] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:27 2022] POST /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1/action => generated 8206 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:27.881204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d66893a9-ca8b-45a1-b8b3-a6ac02e68038 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:27.881987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d66893a9-ca8b-45a1-b8b3-a6ac02e68038 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:27.891241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d66893a9-ca8b-45a1-b8b3-a6ac02e68038 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:27.892149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d66893a9-ca8b-45a1-b8b3-a6ac02e68038 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:27.893148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d66893a9-ca8b-45a1-b8b3-a6ac02e68038 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:27.893440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d66893a9-ca8b-45a1-b8b3-a6ac02e68038 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:27.894051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d66893a9-ca8b-45a1-b8b3-a6ac02e68038 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:27.894622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d66893a9-ca8b-45a1-b8b3-a6ac02e68038 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:27.900223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:28.097019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d66893a9-ca8b-45a1-b8b3-a6ac02e68038 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:28.105441 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d66893a9-ca8b-45a1-b8b3-a6ac02e68038 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.229846 Aug 09 15:02:28.106085 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2560/5124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:27 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:28.132339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f978a5fc-2afd-4ee0-a953-49af708f27dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:28.133350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f978a5fc-2afd-4ee0-a953-49af708f27dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:28.141819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f978a5fc-2afd-4ee0-a953-49af708f27dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:28.142596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f978a5fc-2afd-4ee0-a953-49af708f27dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:28.143272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f978a5fc-2afd-4ee0-a953-49af708f27dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:28.144251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f978a5fc-2afd-4ee0-a953-49af708f27dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:28.144918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f978a5fc-2afd-4ee0-a953-49af708f27dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:28.145701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f978a5fc-2afd-4ee0-a953-49af708f27dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:28.359148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f978a5fc-2afd-4ee0-a953-49af708f27dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:28.372896 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f978a5fc-2afd-4ee0-a953-49af708f27dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.244817 Aug 09 15:02:28.394309 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2565/5125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:28 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:28.400604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-38136e6d-6249-457b-b28c-bab1844f16b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:28.401696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-38136e6d-6249-457b-b28c-bab1844f16b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:28.416939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38136e6d-6249-457b-b28c-bab1844f16b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:28.418077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38136e6d-6249-457b-b28c-bab1844f16b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:28.418876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38136e6d-6249-457b-b28c-bab1844f16b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:28.420247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38136e6d-6249-457b-b28c-bab1844f16b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:28.421000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38136e6d-6249-457b-b28c-bab1844f16b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:28.421648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-38136e6d-6249-457b-b28c-bab1844f16b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:28.610198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-38136e6d-6249-457b-b28c-bab1844f16b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:28.631254 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-38136e6d-6249-457b-b28c-bab1844f16b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.236207 Aug 09 15:02:28.642756 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2561/5126] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:28 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:28.661340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40700a62-87e1-43f5-9a7f-887d85fdd68f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:28.661972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40700a62-87e1-43f5-9a7f-887d85fdd68f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:28.674531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40700a62-87e1-43f5-9a7f-887d85fdd68f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:28.675069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40700a62-87e1-43f5-9a7f-887d85fdd68f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:28.675551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40700a62-87e1-43f5-9a7f-887d85fdd68f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:28.676334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40700a62-87e1-43f5-9a7f-887d85fdd68f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:28.676778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40700a62-87e1-43f5-9a7f-887d85fdd68f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:28.677235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40700a62-87e1-43f5-9a7f-887d85fdd68f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:28.904200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40700a62-87e1-43f5-9a7f-887d85fdd68f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:28.919698 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40700a62-87e1-43f5-9a7f-887d85fdd68f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.260937 Aug 09 15:02:28.920885 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2566/5127] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:28 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:28.941346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4eb8f7e1-98cd-4ac3-ae58-c88ab11102fb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:28.942548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4eb8f7e1-98cd-4ac3-ae58-c88ab11102fb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:28.952198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eb8f7e1-98cd-4ac3-ae58-c88ab11102fb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:28.953061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eb8f7e1-98cd-4ac3-ae58-c88ab11102fb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:28.953663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eb8f7e1-98cd-4ac3-ae58-c88ab11102fb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:28.954612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eb8f7e1-98cd-4ac3-ae58-c88ab11102fb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:28.955361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eb8f7e1-98cd-4ac3-ae58-c88ab11102fb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:28.955963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eb8f7e1-98cd-4ac3-ae58-c88ab11102fb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:29.058801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4eb8f7e1-98cd-4ac3-ae58-c88ab11102fb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Locking {{(pid=119406) lock /opt/stack/nova/nova/compute/api.py:4794}} Aug 09 15:02:29.150939 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4eb8f7e1-98cd-4ac3-ae58-c88ab11102fb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.213652 Aug 09 15:02:29.154951 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2562/5128] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:28 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:02:29.161427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-97a497df-e362-4fd8-8f4b-95b22423feb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:29.162415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-97a497df-e362-4fd8-8f4b-95b22423feb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:29.171160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a497df-e362-4fd8-8f4b-95b22423feb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:29.171963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a497df-e362-4fd8-8f4b-95b22423feb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:29.172657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a497df-e362-4fd8-8f4b-95b22423feb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:29.173588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a497df-e362-4fd8-8f4b-95b22423feb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:29.174230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a497df-e362-4fd8-8f4b-95b22423feb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:29.174891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97a497df-e362-4fd8-8f4b-95b22423feb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:29.381707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-97a497df-e362-4fd8-8f4b-95b22423feb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:29.397312 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-97a497df-e362-4fd8-8f4b-95b22423feb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.240571 Aug 09 15:02:29.397922 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2567/5129] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:29 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:29.423953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63abae82-feeb-45b9-82b8-38070300676d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:29.431860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63abae82-feeb-45b9-82b8-38070300676d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:29.432441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63abae82-feeb-45b9-82b8-38070300676d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:29.433189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63abae82-feeb-45b9-82b8-38070300676d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:29.463473 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-63abae82-feeb-45b9-82b8-38070300676d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] HTTP exception thrown: Instance f6a67196-2e15-47e5-8877-e75e8d4609c7 is locked Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63abae82-feeb-45b9-82b8-38070300676d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Request method failure captured: Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action HTTP/1.1 Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 15 Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nYEf9bYbaWm9LpfA_LfwfUAPPg3KiAcIP0FvUZa5q3lW1cxsq_VEWuea_CUOz5st4geKgSqeruMxTrCCG4yN7K5xPHcsvFJ9uo_ztCad5wmGGhupiyzg1AjNhOoCjxRWlcQTxcsGTT3hxXSJl2NJVAtQ8LITGkETiM4QQ4BkISsF8I Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 891029e759ac441f8a08c38bca92be81 Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerActionsTestJSON-673566527 Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_891029e759ac441f8a08c38bca92be81", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/891029e759ac441f8a08c38bca92be81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/891029e759ac441f8a08c38bca92be81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/891029e759ac441f8a08c38bca92be81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerActionsTestJSON-673566527 Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 891029e759ac441f8a08c38bca92be81 Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerActionsTestJSON-673566527 Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerActionsTestJSON-673566527-project Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3da785ddf56e4b028c6647643d97c952 Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerActionsTestJSON-673566527-project Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: {"os-stop": {}} Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance f6a67196-2e15-47e5-8877-e75e8d4609c7 is locked Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'f6a67196-2e15-47e5-8877-e75e8d4609c7', 'body': {'os-stop': {}}} Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance f6a67196-2e15-47e5-8877-e75e8d4609c7 is locked Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance f6a67196-2e15-47e5-8877-e75e8d4609c7 is locked Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6a67196-2e15-47e5-8877-e75e8d4609c7 is locked Aug 09 15:02:29.468196 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:02:29.474769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63abae82-feeb-45b9-82b8-38070300676d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Returning 409 to user: Instance f6a67196-2e15-47e5-8877-e75e8d4609c7 is locked {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:02:29.476299 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63abae82-feeb-45b9-82b8-38070300676d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 409 len: 107 microversion: 2.1 time: 0.058111 Aug 09 15:02:29.477268 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2563/5130] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:29 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 107 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 15:02:29.485963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d7a191a-263e-439a-8b77-21e42bc3244c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:29.486499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d7a191a-263e-439a-8b77-21e42bc3244c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:29.492873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d7a191a-263e-439a-8b77-21e42bc3244c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:29.493357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d7a191a-263e-439a-8b77-21e42bc3244c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:29.493788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d7a191a-263e-439a-8b77-21e42bc3244c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:29.494463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d7a191a-263e-439a-8b77-21e42bc3244c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:29.494906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d7a191a-263e-439a-8b77-21e42bc3244c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:29.499875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d7a191a-263e-439a-8b77-21e42bc3244c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:29.607288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d7a191a-263e-439a-8b77-21e42bc3244c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Unlocking {{(pid=119407) unlock /opt/stack/nova/nova/compute/api.py:4823}} Aug 09 15:02:29.728987 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d7a191a-263e-439a-8b77-21e42bc3244c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.246900 Aug 09 15:02:29.732947 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2568/5131] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:29 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:02:29.739631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dcbe1d96-05d1-406f-8d53-a00ecfc9c230 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:29.746844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcbe1d96-05d1-406f-8d53-a00ecfc9c230 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:29.747455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcbe1d96-05d1-406f-8d53-a00ecfc9c230 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:29.747955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcbe1d96-05d1-406f-8d53-a00ecfc9c230 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:29.788092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dcbe1d96-05d1-406f-8d53-a00ecfc9c230 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Going to try to stop instance {{(pid=119406) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 15:02:29.869269 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dcbe1d96-05d1-406f-8d53-a00ecfc9c230 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.132972 Aug 09 15:02:29.870599 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2564/5132] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:29 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:02:29.883671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e75a5ed6-148d-4ccd-8cdc-cbd46f7506bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:29.884719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e75a5ed6-148d-4ccd-8cdc-cbd46f7506bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:29.895003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e75a5ed6-148d-4ccd-8cdc-cbd46f7506bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:29.895707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e75a5ed6-148d-4ccd-8cdc-cbd46f7506bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:29.896208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e75a5ed6-148d-4ccd-8cdc-cbd46f7506bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:29.897027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e75a5ed6-148d-4ccd-8cdc-cbd46f7506bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:29.921160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e75a5ed6-148d-4ccd-8cdc-cbd46f7506bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:29.921762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e75a5ed6-148d-4ccd-8cdc-cbd46f7506bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:30.381942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e75a5ed6-148d-4ccd-8cdc-cbd46f7506bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:30.398959 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e75a5ed6-148d-4ccd-8cdc-cbd46f7506bc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.523303 Aug 09 15:02:30.401893 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2569/5133] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:29 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:30.949793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4751cca-1221-4b1f-b116-8a0f30686f8d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:30.953241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4751cca-1221-4b1f-b116-8a0f30686f8d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:30.963869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4751cca-1221-4b1f-b116-8a0f30686f8d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:30.965289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4751cca-1221-4b1f-b116-8a0f30686f8d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:30.965970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4751cca-1221-4b1f-b116-8a0f30686f8d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:30.968709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4751cca-1221-4b1f-b116-8a0f30686f8d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:30.969188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4751cca-1221-4b1f-b116-8a0f30686f8d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:30.969626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4751cca-1221-4b1f-b116-8a0f30686f8d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:31.009884 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4751cca-1221-4b1f-b116-8a0f30686f8d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065316 Aug 09 15:02:31.011345 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2565/5134] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:02:30 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:31.024340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22ebcb34-1cbf-4934-941a-351e2c6f74ea tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:31.025185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22ebcb34-1cbf-4934-941a-351e2c6f74ea tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:31.035025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ebcb34-1cbf-4934-941a-351e2c6f74ea tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:31.035841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ebcb34-1cbf-4934-941a-351e2c6f74ea tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:31.036383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ebcb34-1cbf-4934-941a-351e2c6f74ea tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:31.037621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ebcb34-1cbf-4934-941a-351e2c6f74ea tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:31.038556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ebcb34-1cbf-4934-941a-351e2c6f74ea tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:31.039160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22ebcb34-1cbf-4934-941a-351e2c6f74ea tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:31.074179 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22ebcb34-1cbf-4934-941a-351e2c6f74ea tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments/470eca90-7d95-4a8e-9c15-a22c3e516c57" status: 200 len: 194 microversion: 2.1 time: 0.055830 Aug 09 15:02:31.074844 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2570/5135] 10.222.0.50 () {58 vars in 1413 bytes} [Tue Aug 9 15:02:31 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments/470eca90-7d95-4a8e-9c15-a22c3e516c57 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:31.425523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79a7fb0c-4ef9-4e89-9584-825e769327ef tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:31.426466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-79a7fb0c-4ef9-4e89-9584-825e769327ef tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:31.440292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79a7fb0c-4ef9-4e89-9584-825e769327ef tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:31.444548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79a7fb0c-4ef9-4e89-9584-825e769327ef tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:31.446340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79a7fb0c-4ef9-4e89-9584-825e769327ef tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:31.447429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79a7fb0c-4ef9-4e89-9584-825e769327ef tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:31.450791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79a7fb0c-4ef9-4e89-9584-825e769327ef tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:31.451629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79a7fb0c-4ef9-4e89-9584-825e769327ef tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:31.641627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1392510234", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "1e50f350-54a1-4361-a79b-284911b81354"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:31.699226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-79a7fb0c-4ef9-4e89-9584-825e769327ef tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:31.708424 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-79a7fb0c-4ef9-4e89-9584-825e769327ef tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.287515 Aug 09 15:02:31.720996 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2566/5136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:31 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:31.742116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] validate_networks() for [('1e50f350-54a1-4361-a79b-284911b81354', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:02:32.479037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:02:32.480264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:02:32.480945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:02:32.481540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:02:32.482127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:02:32.504887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:32.505669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:32.506314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:32.507342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:32.507964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:32.508542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:32.548510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Getting quotas for project 9fbd4a7083a34b02910cb4e4b7d4aca0. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:02:32.561390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Getting quotas for user 94ab820ec1384350b9cab506cf75df22 and project 9fbd4a7083a34b02910cb4e4b7d4aca0. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:02:32.579172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:02:32.582068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:02:32.637011 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aba523b9-bf34-465b-9a68-7c6297741d0a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999197 Aug 09 15:02:32.638547 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2571/5137] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:02:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:02:32.649231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e7f989b-e094-4435-b69c-bcfeb80cd504 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:32.649841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5e7f989b-e094-4435-b69c-bcfeb80cd504 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:32.733905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-adc77298-a33d-49c2-83a0-89bf3e3c42be tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:32.735626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-adc77298-a33d-49c2-83a0-89bf3e3c42be tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:32.753573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adc77298-a33d-49c2-83a0-89bf3e3c42be tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:32.754680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adc77298-a33d-49c2-83a0-89bf3e3c42be tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:32.757622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adc77298-a33d-49c2-83a0-89bf3e3c42be tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:32.759725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adc77298-a33d-49c2-83a0-89bf3e3c42be tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:32.761268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adc77298-a33d-49c2-83a0-89bf3e3c42be tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:32.766288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adc77298-a33d-49c2-83a0-89bf3e3c42be tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:32.803809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5e7f989b-e094-4435-b69c-bcfeb80cd504 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:32.822443 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5e7f989b-e094-4435-b69c-bcfeb80cd504 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1219 microversion: 2.1 time: 0.176951 Aug 09 15:02:32.831776 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2567/5138] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:32 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:33.086461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-adc77298-a33d-49c2-83a0-89bf3e3c42be tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:33.110965 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-adc77298-a33d-49c2-83a0-89bf3e3c42be tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.381238 Aug 09 15:02:33.117178 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2572/5139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:32 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:33.773992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bd681d12-f0f1-4afb-a0c1-e88742e6fac9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fdf751a-5fac-4ec0-a197-ec84953d939d"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:33.777410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bd681d12-f0f1-4afb-a0c1-e88742e6fac9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:33.799038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd681d12-f0f1-4afb-a0c1-e88742e6fac9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:33.801074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd681d12-f0f1-4afb-a0c1-e88742e6fac9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:33.801811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd681d12-f0f1-4afb-a0c1-e88742e6fac9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:33.808548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd681d12-f0f1-4afb-a0c1-e88742e6fac9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:33.809387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd681d12-f0f1-4afb-a0c1-e88742e6fac9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:33.810308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd681d12-f0f1-4afb-a0c1-e88742e6fac9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:33.854648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1fd965f6-fb6e-4ac4-8f95-d220a9d8b5e2 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:33.855977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1fd965f6-fb6e-4ac4-8f95-d220a9d8b5e2 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:33.866957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fd965f6-fb6e-4ac4-8f95-d220a9d8b5e2 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:33.868528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fd965f6-fb6e-4ac4-8f95-d220a9d8b5e2 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:33.870092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fd965f6-fb6e-4ac4-8f95-d220a9d8b5e2 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:33.871889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fd965f6-fb6e-4ac4-8f95-d220a9d8b5e2 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:33.873030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fd965f6-fb6e-4ac4-8f95-d220a9d8b5e2 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:33.874516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fd965f6-fb6e-4ac4-8f95-d220a9d8b5e2 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:34.034139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1fd965f6-fb6e-4ac4-8f95-d220a9d8b5e2 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:34.050134 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1fd965f6-fb6e-4ac4-8f95-d220a9d8b5e2 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1223 microversion: 2.1 time: 0.200069 Aug 09 15:02:34.054173 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2573/5140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:33 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1223 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:02:34.134609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96c7b885-b4ae-48cb-9076-c403157ff8a4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:34.135498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-96c7b885-b4ae-48cb-9076-c403157ff8a4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:34.150641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96c7b885-b4ae-48cb-9076-c403157ff8a4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:34.151168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96c7b885-b4ae-48cb-9076-c403157ff8a4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:34.151607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96c7b885-b4ae-48cb-9076-c403157ff8a4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:34.159121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96c7b885-b4ae-48cb-9076-c403157ff8a4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:34.159754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96c7b885-b4ae-48cb-9076-c403157ff8a4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:34.160199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96c7b885-b4ae-48cb-9076-c403157ff8a4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:34.439901 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bd681d12-f0f1-4afb-a0c1-e88742e6fac9 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "POST /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.670096 Aug 09 15:02:34.445643 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2568/5141] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 15:02:33 2022] POST /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:34.487811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-96c7b885-b4ae-48cb-9076-c403157ff8a4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:34.491708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:34.502315 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-96c7b885-b4ae-48cb-9076-c403157ff8a4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.369675 Aug 09 15:02:34.503112 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2574/5142] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:34 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:35.078565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-02aa407c-adc8-4c42-a72f-47a90637a2e4 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:35.079944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-02aa407c-adc8-4c42-a72f-47a90637a2e4 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:35.092757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa407c-adc8-4c42-a72f-47a90637a2e4 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:35.093282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa407c-adc8-4c42-a72f-47a90637a2e4 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:35.095166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa407c-adc8-4c42-a72f-47a90637a2e4 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:35.096083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa407c-adc8-4c42-a72f-47a90637a2e4 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:35.104240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa407c-adc8-4c42-a72f-47a90637a2e4 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:35.104703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa407c-adc8-4c42-a72f-47a90637a2e4 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:35.226576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-02aa407c-adc8-4c42-a72f-47a90637a2e4 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:35.244595 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-02aa407c-adc8-4c42-a72f-47a90637a2e4 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1277 microversion: 2.1 time: 0.169877 Aug 09 15:02:35.248593 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2569/5143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:35 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:35.525908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-00c7c257-3bdf-4952-ba5d-ad8133768585 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:35.526544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-00c7c257-3bdf-4952-ba5d-ad8133768585 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:35.538364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00c7c257-3bdf-4952-ba5d-ad8133768585 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:35.538858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00c7c257-3bdf-4952-ba5d-ad8133768585 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:35.539325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00c7c257-3bdf-4952-ba5d-ad8133768585 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:35.540046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00c7c257-3bdf-4952-ba5d-ad8133768585 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:35.540495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00c7c257-3bdf-4952-ba5d-ad8133768585 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:35.540922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00c7c257-3bdf-4952-ba5d-ad8133768585 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:35.765819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-00c7c257-3bdf-4952-ba5d-ad8133768585 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:35.775367 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-00c7c257-3bdf-4952-ba5d-ad8133768585 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.254390 Aug 09 15:02:35.776879 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2575/5144] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:35 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:36.270578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d6edaf3-d3b0-41e3-8a9a-d12c1ef60be0 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:36.271256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d6edaf3-d3b0-41e3-8a9a-d12c1ef60be0 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:36.285555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d6edaf3-d3b0-41e3-8a9a-d12c1ef60be0 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:36.288325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d6edaf3-d3b0-41e3-8a9a-d12c1ef60be0 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:36.289409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d6edaf3-d3b0-41e3-8a9a-d12c1ef60be0 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:36.291176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d6edaf3-d3b0-41e3-8a9a-d12c1ef60be0 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:36.291594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d6edaf3-d3b0-41e3-8a9a-d12c1ef60be0 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:36.292309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d6edaf3-d3b0-41e3-8a9a-d12c1ef60be0 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:36.637337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d6edaf3-d3b0-41e3-8a9a-d12c1ef60be0 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:36.653779 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d6edaf3-d3b0-41e3-8a9a-d12c1ef60be0 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1319 microversion: 2.1 time: 0.385476 Aug 09 15:02:36.654901 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2570/5145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:36 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:36.797308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5961d764-3cca-45c7-ba90-2c916582857d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:36.798479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5961d764-3cca-45c7-ba90-2c916582857d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:36.812992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5961d764-3cca-45c7-ba90-2c916582857d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:36.813987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5961d764-3cca-45c7-ba90-2c916582857d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:36.814564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5961d764-3cca-45c7-ba90-2c916582857d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:36.815639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5961d764-3cca-45c7-ba90-2c916582857d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:36.816256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5961d764-3cca-45c7-ba90-2c916582857d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:36.816825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5961d764-3cca-45c7-ba90-2c916582857d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:37.075396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-cc7464db-40c9-4d14-bdd1-4fd07cd6a61a req-62f048d4-189d-4065-833e-e9147feb216a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe220fa9-3aed-47c5-9c5e-0da3c245a3b1", "tag": "ee078eea-f410-4b17-8355-1e2e025c47e1"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:37.112959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cc7464db-40c9-4d14-bdd1-4fd07cd6a61a req-62f048d4-189d-4065-833e-e9147feb216a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:37.113466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cc7464db-40c9-4d14-bdd1-4fd07cd6a61a req-62f048d4-189d-4065-833e-e9147feb216a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:37.113910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cc7464db-40c9-4d14-bdd1-4fd07cd6a61a req-62f048d4-189d-4065-833e-e9147feb216a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:37.155407 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-cc7464db-40c9-4d14-bdd1-4fd07cd6a61a req-62f048d4-189d-4065-833e-e9147feb216a service nova] Creating event network-changed:ee078eea-f410-4b17-8355-1e2e025c47e1 for instance fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 on n-h1-844626-8 Aug 09 15:02:37.155684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5961d764-3cca-45c7-ba90-2c916582857d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:37.167840 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5961d764-3cca-45c7-ba90-2c916582857d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.374535 Aug 09 15:02:37.168444 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2576/5146] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:36 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:37.170779 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-cc7464db-40c9-4d14-bdd1-4fd07cd6a61a req-62f048d4-189d-4065-833e-e9147feb216a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101276 Aug 09 15:02:37.173032 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2571/5147] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:02:37.683260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79fd25f8-8d71-4261-8c7b-ab2c095010bb tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:37.684384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79fd25f8-8d71-4261-8c7b-ab2c095010bb tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:37.698538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79fd25f8-8d71-4261-8c7b-ab2c095010bb tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:37.699129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79fd25f8-8d71-4261-8c7b-ab2c095010bb tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:37.699704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79fd25f8-8d71-4261-8c7b-ab2c095010bb tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:37.701238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79fd25f8-8d71-4261-8c7b-ab2c095010bb tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:37.701238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79fd25f8-8d71-4261-8c7b-ab2c095010bb tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:37.701238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79fd25f8-8d71-4261-8c7b-ab2c095010bb tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:38.076507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-79fd25f8-8d71-4261-8c7b-ab2c095010bb tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:38.100436 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79fd25f8-8d71-4261-8c7b-ab2c095010bb tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1319 microversion: 2.1 time: 0.423652 Aug 09 15:02:38.116408 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2577/5148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:37 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1319 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:38.204986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b51df35e-6cc4-4fa8-971c-3142eb5d5250 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:38.209351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b51df35e-6cc4-4fa8-971c-3142eb5d5250 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:38.238562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b51df35e-6cc4-4fa8-971c-3142eb5d5250 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:38.248354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b51df35e-6cc4-4fa8-971c-3142eb5d5250 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:38.255402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b51df35e-6cc4-4fa8-971c-3142eb5d5250 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:38.268914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b51df35e-6cc4-4fa8-971c-3142eb5d5250 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:38.271344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b51df35e-6cc4-4fa8-971c-3142eb5d5250 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:38.276241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b51df35e-6cc4-4fa8-971c-3142eb5d5250 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:38.610593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b51df35e-6cc4-4fa8-971c-3142eb5d5250 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:38.630164 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b51df35e-6cc4-4fa8-971c-3142eb5d5250 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.443815 Aug 09 15:02:38.638345 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2572/5149] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:38 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:39.126048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c08ab8d0-6f02-4fd3-bb6b-0b03d10435af tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:39.126852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c08ab8d0-6f02-4fd3-bb6b-0b03d10435af tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:39.137880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c08ab8d0-6f02-4fd3-bb6b-0b03d10435af tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:39.139788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c08ab8d0-6f02-4fd3-bb6b-0b03d10435af tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:39.140415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c08ab8d0-6f02-4fd3-bb6b-0b03d10435af tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:39.141449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c08ab8d0-6f02-4fd3-bb6b-0b03d10435af tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:39.142067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c08ab8d0-6f02-4fd3-bb6b-0b03d10435af tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:39.142665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c08ab8d0-6f02-4fd3-bb6b-0b03d10435af tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:39.430070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c08ab8d0-6f02-4fd3-bb6b-0b03d10435af tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:39.449260 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c08ab8d0-6f02-4fd3-bb6b-0b03d10435af tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1319 microversion: 2.1 time: 0.327105 Aug 09 15:02:39.450123 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2578/5150] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:39 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:39.658127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57ef91a7-44ed-47ca-b1d8-25c07a9a0e8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:39.659413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57ef91a7-44ed-47ca-b1d8-25c07a9a0e8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:39.681337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57ef91a7-44ed-47ca-b1d8-25c07a9a0e8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:39.692092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57ef91a7-44ed-47ca-b1d8-25c07a9a0e8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:39.696282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57ef91a7-44ed-47ca-b1d8-25c07a9a0e8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:39.699564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57ef91a7-44ed-47ca-b1d8-25c07a9a0e8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:39.703058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57ef91a7-44ed-47ca-b1d8-25c07a9a0e8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:39.711216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57ef91a7-44ed-47ca-b1d8-25c07a9a0e8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:40.075059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-57ef91a7-44ed-47ca-b1d8-25c07a9a0e8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:40.084163 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57ef91a7-44ed-47ca-b1d8-25c07a9a0e8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.430115 Aug 09 15:02:40.088780 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2573/5151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:39 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:02:40.476414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22e4c6e8-8fa2-4ab3-9ad4-89ee3a8e6bc9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:40.477890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22e4c6e8-8fa2-4ab3-9ad4-89ee3a8e6bc9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:40.520644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22e4c6e8-8fa2-4ab3-9ad4-89ee3a8e6bc9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:40.521069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22e4c6e8-8fa2-4ab3-9ad4-89ee3a8e6bc9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:40.529543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22e4c6e8-8fa2-4ab3-9ad4-89ee3a8e6bc9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:40.536408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22e4c6e8-8fa2-4ab3-9ad4-89ee3a8e6bc9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:40.537623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22e4c6e8-8fa2-4ab3-9ad4-89ee3a8e6bc9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:40.541321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22e4c6e8-8fa2-4ab3-9ad4-89ee3a8e6bc9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:40.980706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22e4c6e8-8fa2-4ab3-9ad4-89ee3a8e6bc9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:41.004972 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22e4c6e8-8fa2-4ab3-9ad4-89ee3a8e6bc9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1319 microversion: 2.1 time: 0.528945 Aug 09 15:02:41.006453 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2579/5152] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:40 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1319 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:41.124251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ecf6822-5a5a-473d-8672-5d228b836d8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:41.125661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ecf6822-5a5a-473d-8672-5d228b836d8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:41.139791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ecf6822-5a5a-473d-8672-5d228b836d8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:41.140713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ecf6822-5a5a-473d-8672-5d228b836d8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:41.141421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ecf6822-5a5a-473d-8672-5d228b836d8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:41.146005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ecf6822-5a5a-473d-8672-5d228b836d8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:41.158270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ecf6822-5a5a-473d-8672-5d228b836d8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:41.159304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ecf6822-5a5a-473d-8672-5d228b836d8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:41.168585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:41.400972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ecf6822-5a5a-473d-8672-5d228b836d8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:41.409190 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ecf6822-5a5a-473d-8672-5d228b836d8c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1652 microversion: 2.1 time: 0.288766 Aug 09 15:02:41.416143 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2574/5153] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:41 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1652 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:41.434143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8eb553f1-9808-45af-bba1-5538d94f90c3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:41.441489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8eb553f1-9808-45af-bba1-5538d94f90c3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:41.442112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8eb553f1-9808-45af-bba1-5538d94f90c3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:41.442646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8eb553f1-9808-45af-bba1-5538d94f90c3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:41.470872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8eb553f1-9808-45af-bba1-5538d94f90c3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Going to try to start instance {{(pid=119407) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 15:02:41.559203 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8eb553f1-9808-45af-bba1-5538d94f90c3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.126292 Aug 09 15:02:41.591594 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2580/5154] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:41 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:02:41.601441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0a4d8b0-0382-498a-bf46-c6ad4f8785fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:41.602051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e0a4d8b0-0382-498a-bf46-c6ad4f8785fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:41.611211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0a4d8b0-0382-498a-bf46-c6ad4f8785fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:41.612380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0a4d8b0-0382-498a-bf46-c6ad4f8785fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:41.613124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0a4d8b0-0382-498a-bf46-c6ad4f8785fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:41.614030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0a4d8b0-0382-498a-bf46-c6ad4f8785fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:41.614671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0a4d8b0-0382-498a-bf46-c6ad4f8785fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:41.615320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0a4d8b0-0382-498a-bf46-c6ad4f8785fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:41.892318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e0a4d8b0-0382-498a-bf46-c6ad4f8785fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:41.904938 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e0a4d8b0-0382-498a-bf46-c6ad4f8785fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1661 microversion: 2.1 time: 0.310193 Aug 09 15:02:41.906122 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2575/5155] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:41 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1661 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:42.009579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9bb0dfa-7065-49e5-96ac-24d3515e43ed tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'create', calling method: .version_select at 0x7f41dd353670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1585709441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO23jqeYKE5lgmMHoj+zbEKkNrG37+NaAxOckD3R/QynvrNq+nv6p0A0jzZ5G6u8Xx73gBcxj5cDZgcgdWtMPPt2RqnZtmEVq6Gyn2+PqU5Khzx3ccviUtMQ8pEpt1j1xw=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:42.027106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e88bc536-83d4-481f-8537-96549d529030 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:42.027717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e88bc536-83d4-481f-8537-96549d529030 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:42.051045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e88bc536-83d4-481f-8537-96549d529030 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:42.082102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e88bc536-83d4-481f-8537-96549d529030 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:42.082835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e88bc536-83d4-481f-8537-96549d529030 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:42.083775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e88bc536-83d4-481f-8537-96549d529030 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:42.084474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e88bc536-83d4-481f-8537-96549d529030 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:42.087365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e88bc536-83d4-481f-8537-96549d529030 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:42.101829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-f9bb0dfa-7065-49e5-96ac-24d3515e43ed tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for project 889fa240e1f5494d9c11803acd77f74b. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:02:42.116031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-f9bb0dfa-7065-49e5-96ac-24d3515e43ed tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for user 9ff3b746851a4414ba60cb76ac07056b and project 889fa240e1f5494d9c11803acd77f74b. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:02:42.168153 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9bb0dfa-7065-49e5-96ac-24d3515e43ed tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.451110 Aug 09 15:02:42.168849 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2581/5156] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:02:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:42.423587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e88bc536-83d4-481f-8537-96549d529030 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:42.432720 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e88bc536-83d4-481f-8537-96549d529030 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1319 microversion: 2.1 time: 0.409470 Aug 09 15:02:42.434057 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2576/5157] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:42 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:42.928062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:42.933719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e582ca1-a41d-4526-aeed-e690b620d69f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:42.934631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9e582ca1-a41d-4526-aeed-e690b620d69f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:42.962504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e582ca1-a41d-4526-aeed-e690b620d69f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:42.963132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e582ca1-a41d-4526-aeed-e690b620d69f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:42.963589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e582ca1-a41d-4526-aeed-e690b620d69f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:42.964440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e582ca1-a41d-4526-aeed-e690b620d69f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:42.969081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e582ca1-a41d-4526-aeed-e690b620d69f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:42.975322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e582ca1-a41d-4526-aeed-e690b620d69f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:43.351802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9e582ca1-a41d-4526-aeed-e690b620d69f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:43.360222 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e582ca1-a41d-4526-aeed-e690b620d69f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1661 microversion: 2.1 time: 0.433918 Aug 09 15:02:43.360812 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2582/5158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:42 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1661 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:43.458019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f69f7c6-7d13-462d-8f14-9725584d2cb9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:43.459772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f69f7c6-7d13-462d-8f14-9725584d2cb9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:43.463283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:43.471112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f69f7c6-7d13-462d-8f14-9725584d2cb9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:43.472117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f69f7c6-7d13-462d-8f14-9725584d2cb9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:43.472740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f69f7c6-7d13-462d-8f14-9725584d2cb9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:43.474984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f69f7c6-7d13-462d-8f14-9725584d2cb9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:43.475669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f69f7c6-7d13-462d-8f14-9725584d2cb9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:43.476265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f69f7c6-7d13-462d-8f14-9725584d2cb9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:43.805101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f69f7c6-7d13-462d-8f14-9725584d2cb9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:43.825495 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f69f7c6-7d13-462d-8f14-9725584d2cb9 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1319 microversion: 2.1 time: 0.373749 Aug 09 15:02:43.826111 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2577/5159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:43 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:44.156027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-1ed767f3-ac52-410d-9cce-268898b4b4d9 req-6541f3a2-542b-40ba-bcba-ac64aa607862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe220fa9-3aed-47c5-9c5e-0da3c245a3b1", "name": "network-vif-plugged", "status": "completed", "tag": "ee078eea-f410-4b17-8355-1e2e025c47e1"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:44.172164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1ed767f3-ac52-410d-9cce-268898b4b4d9 req-6541f3a2-542b-40ba-bcba-ac64aa607862 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:44.173632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1ed767f3-ac52-410d-9cce-268898b4b4d9 req-6541f3a2-542b-40ba-bcba-ac64aa607862 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:44.174603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1ed767f3-ac52-410d-9cce-268898b4b4d9 req-6541f3a2-542b-40ba-bcba-ac64aa607862 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:44.194976 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1ed767f3-ac52-410d-9cce-268898b4b4d9 req-6541f3a2-542b-40ba-bcba-ac64aa607862 service nova] Creating event network-vif-plugged:ee078eea-f410-4b17-8355-1e2e025c47e1 for instance fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 on n-h1-844626-8 Aug 09 15:02:44.202853 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-1ed767f3-ac52-410d-9cce-268898b4b4d9 req-6541f3a2-542b-40ba-bcba-ac64aa607862 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061643 Aug 09 15:02:44.204119 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2583/5160] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:44.382343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f59e2d6-0f2d-4451-b594-da66cbbbde29 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:44.382963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3f59e2d6-0f2d-4451-b594-da66cbbbde29 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:44.389597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f59e2d6-0f2d-4451-b594-da66cbbbde29 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:44.390099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f59e2d6-0f2d-4451-b594-da66cbbbde29 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:44.390541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f59e2d6-0f2d-4451-b594-da66cbbbde29 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:44.391288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f59e2d6-0f2d-4451-b594-da66cbbbde29 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:44.391730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f59e2d6-0f2d-4451-b594-da66cbbbde29 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:44.392365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f59e2d6-0f2d-4451-b594-da66cbbbde29 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:44.545388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3f59e2d6-0f2d-4451-b594-da66cbbbde29 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:44.555280 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3f59e2d6-0f2d-4451-b594-da66cbbbde29 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.176989 Aug 09 15:02:44.556881 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2578/5161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:44 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:44.581843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e5f8dbd-5d86-484c-b38a-b16644a45ad5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:44.582939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9e5f8dbd-5d86-484c-b38a-b16644a45ad5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:44.591302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e5f8dbd-5d86-484c-b38a-b16644a45ad5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:44.592058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e5f8dbd-5d86-484c-b38a-b16644a45ad5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:44.592805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e5f8dbd-5d86-484c-b38a-b16644a45ad5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:44.593685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e5f8dbd-5d86-484c-b38a-b16644a45ad5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:44.594287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e5f8dbd-5d86-484c-b38a-b16644a45ad5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:44.594842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e5f8dbd-5d86-484c-b38a-b16644a45ad5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:44.751905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9e5f8dbd-5d86-484c-b38a-b16644a45ad5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:44.766421 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e5f8dbd-5d86-484c-b38a-b16644a45ad5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.189337 Aug 09 15:02:44.767865 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2584/5162] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:44 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:02:44.789592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-53d7c897-6977-466e-90b4-d742561bf7a6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:44.790155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53d7c897-6977-466e-90b4-d742561bf7a6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:44.797106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53d7c897-6977-466e-90b4-d742561bf7a6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:44.798076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53d7c897-6977-466e-90b4-d742561bf7a6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:44.798666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53d7c897-6977-466e-90b4-d742561bf7a6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:44.799564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53d7c897-6977-466e-90b4-d742561bf7a6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:44.800014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53d7c897-6977-466e-90b4-d742561bf7a6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:44.800584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53d7c897-6977-466e-90b4-d742561bf7a6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:44.852676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-280fc2d0-ee88-4b0a-a363-36d63c14053c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:44.853886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-280fc2d0-ee88-4b0a-a363-36d63c14053c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:44.861431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53d7c897-6977-466e-90b4-d742561bf7a6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Unlocking {{(pid=119406) unlock /opt/stack/nova/nova/compute/api.py:4823}} Aug 09 15:02:44.861773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-280fc2d0-ee88-4b0a-a363-36d63c14053c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:44.862471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-280fc2d0-ee88-4b0a-a363-36d63c14053c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:44.863159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-280fc2d0-ee88-4b0a-a363-36d63c14053c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:44.864256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-280fc2d0-ee88-4b0a-a363-36d63c14053c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:44.865205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-280fc2d0-ee88-4b0a-a363-36d63c14053c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:44.866550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-280fc2d0-ee88-4b0a-a363-36d63c14053c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:44.935255 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-53d7c897-6977-466e-90b4-d742561bf7a6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.150518 Aug 09 15:02:44.936604 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2579/5163] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:44 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:02:44.953300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-195b34d1-d1a3-4959-80c5-cd111e29960d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:44.954814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-195b34d1-d1a3-4959-80c5-cd111e29960d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:44.963614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-195b34d1-d1a3-4959-80c5-cd111e29960d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:44.964990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-195b34d1-d1a3-4959-80c5-cd111e29960d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:44.965620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-195b34d1-d1a3-4959-80c5-cd111e29960d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:44.966735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-195b34d1-d1a3-4959-80c5-cd111e29960d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:44.967422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-195b34d1-d1a3-4959-80c5-cd111e29960d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:44.968030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-195b34d1-d1a3-4959-80c5-cd111e29960d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:45.142137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-280fc2d0-ee88-4b0a-a363-36d63c14053c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:45.154993 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-280fc2d0-ee88-4b0a-a363-36d63c14053c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1319 microversion: 2.1 time: 0.310227 Aug 09 15:02:45.160205 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2585/5164] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:44 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:02:45.196921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-195b34d1-d1a3-4959-80c5-cd111e29960d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:45.206041 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-195b34d1-d1a3-4959-80c5-cd111e29960d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.259861 Aug 09 15:02:45.207043 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2580/5165] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:44 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:45.230189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0207f6f-3545-4be6-bb46-ab069a682727 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:45.230840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0207f6f-3545-4be6-bb46-ab069a682727 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:45.246831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0207f6f-3545-4be6-bb46-ab069a682727 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:45.247358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0207f6f-3545-4be6-bb46-ab069a682727 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:45.248046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0207f6f-3545-4be6-bb46-ab069a682727 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:45.248498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0207f6f-3545-4be6-bb46-ab069a682727 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:45.249735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0207f6f-3545-4be6-bb46-ab069a682727 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:45.250869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0207f6f-3545-4be6-bb46-ab069a682727 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:45.467463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0207f6f-3545-4be6-bb46-ab069a682727 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:45.486776 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0207f6f-3545-4be6-bb46-ab069a682727 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.262075 Aug 09 15:02:45.487494 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2586/5166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:45 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:45.512489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1cc75933-266a-4b69-8c5b-c87e108e8053 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:45.513116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1cc75933-266a-4b69-8c5b-c87e108e8053 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:45.520366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cc75933-266a-4b69-8c5b-c87e108e8053 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:45.520940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cc75933-266a-4b69-8c5b-c87e108e8053 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:45.521442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cc75933-266a-4b69-8c5b-c87e108e8053 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:45.522467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cc75933-266a-4b69-8c5b-c87e108e8053 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:45.523208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cc75933-266a-4b69-8c5b-c87e108e8053 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:45.525296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1cc75933-266a-4b69-8c5b-c87e108e8053 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:45.738060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1cc75933-266a-4b69-8c5b-c87e108e8053 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:45.751266 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1cc75933-266a-4b69-8c5b-c87e108e8053 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.243161 Aug 09 15:02:45.752253 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2581/5167] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:45 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:45.784094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1414453d-63e6-4d59-97bb-f85e7d8d6dad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:45.786052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1414453d-63e6-4d59-97bb-f85e7d8d6dad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:45.805445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1414453d-63e6-4d59-97bb-f85e7d8d6dad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:45.805994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1414453d-63e6-4d59-97bb-f85e7d8d6dad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:45.806497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1414453d-63e6-4d59-97bb-f85e7d8d6dad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:45.807295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1414453d-63e6-4d59-97bb-f85e7d8d6dad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:45.807806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1414453d-63e6-4d59-97bb-f85e7d8d6dad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:45.808240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1414453d-63e6-4d59-97bb-f85e7d8d6dad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:45.895888 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1414453d-63e6-4d59-97bb-f85e7d8d6dad tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.122627 Aug 09 15:02:45.897869 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2587/5168] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:45 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:02:45.906867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ead94d6-9e66-4720-a154-50a01eb3d285 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:45.908485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ead94d6-9e66-4720-a154-50a01eb3d285 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:45.925827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ead94d6-9e66-4720-a154-50a01eb3d285 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:45.926737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ead94d6-9e66-4720-a154-50a01eb3d285 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:45.927507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ead94d6-9e66-4720-a154-50a01eb3d285 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:45.928646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ead94d6-9e66-4720-a154-50a01eb3d285 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:45.929213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ead94d6-9e66-4720-a154-50a01eb3d285 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:45.929708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6ead94d6-9e66-4720-a154-50a01eb3d285 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:46.100388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ead94d6-9e66-4720-a154-50a01eb3d285 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:46.112067 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ead94d6-9e66-4720-a154-50a01eb3d285 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1670 microversion: 2.1 time: 0.209944 Aug 09 15:02:46.113611 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2582/5169] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:45 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1670 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:46.181929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8a88b4a7-bd2e-4366-b4a3-1a8c6e81736b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:46.182824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8a88b4a7-bd2e-4366-b4a3-1a8c6e81736b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:46.189924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a88b4a7-bd2e-4366-b4a3-1a8c6e81736b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:46.190682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a88b4a7-bd2e-4366-b4a3-1a8c6e81736b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:46.191725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a88b4a7-bd2e-4366-b4a3-1a8c6e81736b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:46.192595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a88b4a7-bd2e-4366-b4a3-1a8c6e81736b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:46.193612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a88b4a7-bd2e-4366-b4a3-1a8c6e81736b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:46.194196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a88b4a7-bd2e-4366-b4a3-1a8c6e81736b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:46.386432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8a88b4a7-bd2e-4366-b4a3-1a8c6e81736b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:46.394676 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8a88b4a7-bd2e-4366-b4a3-1a8c6e81736b tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1509 microversion: 2.1 time: 0.217408 Aug 09 15:02:46.395740 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2588/5170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:46 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:46.415634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eb398bf3-1b0f-415b-936d-1ce51cb20ff6 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a991526-8fe4-46f6-85fb-1dc5ed7a21dd", "device": "/dev/sdb"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:46.419292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eb398bf3-1b0f-415b-936d-1ce51cb20ff6 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:46.426379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb398bf3-1b0f-415b-936d-1ce51cb20ff6 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:46.427235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb398bf3-1b0f-415b-936d-1ce51cb20ff6 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:46.427939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb398bf3-1b0f-415b-936d-1ce51cb20ff6 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:46.429303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb398bf3-1b0f-415b-936d-1ce51cb20ff6 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:46.429828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb398bf3-1b0f-415b-936d-1ce51cb20ff6 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:46.430523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eb398bf3-1b0f-415b-936d-1ce51cb20ff6 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:46.758130 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eb398bf3-1b0f-415b-936d-1ce51cb20ff6 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "POST /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346477 Aug 09 15:02:46.760029 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2583/5171] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 15:02:46 2022] POST /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:47.141946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ceb106d1-7c48-4625-ba47-f96c619b6c68 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:47.142681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ceb106d1-7c48-4625-ba47-f96c619b6c68 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:47.154220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ceb106d1-7c48-4625-ba47-f96c619b6c68 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:47.156141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ceb106d1-7c48-4625-ba47-f96c619b6c68 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:47.158457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ceb106d1-7c48-4625-ba47-f96c619b6c68 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:47.159414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ceb106d1-7c48-4625-ba47-f96c619b6c68 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:47.162294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ceb106d1-7c48-4625-ba47-f96c619b6c68 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:47.163077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ceb106d1-7c48-4625-ba47-f96c619b6c68 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:47.732606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ceb106d1-7c48-4625-ba47-f96c619b6c68 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:47.732606 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ceb106d1-7c48-4625-ba47-f96c619b6c68 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1650 microversion: 2.1 time: 0.592764 Aug 09 15:02:47.732606 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2589/5172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:47 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1650 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:47.756270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0c3146cc-56ea-47b6-8ea1-44db2a8bae16 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:47.756920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0c3146cc-56ea-47b6-8ea1-44db2a8bae16 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:47.771211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c3146cc-56ea-47b6-8ea1-44db2a8bae16 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:47.776654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c3146cc-56ea-47b6-8ea1-44db2a8bae16 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:47.777196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c3146cc-56ea-47b6-8ea1-44db2a8bae16 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:47.777979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c3146cc-56ea-47b6-8ea1-44db2a8bae16 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:47.778461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c3146cc-56ea-47b6-8ea1-44db2a8bae16 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:47.778896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c3146cc-56ea-47b6-8ea1-44db2a8bae16 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:47.943028 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0c3146cc-56ea-47b6-8ea1-44db2a8bae16 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.190425 Aug 09 15:02:47.949219 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2584/5173] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:02:47 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:02:47.967392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df80e9b6-b99e-47c1-9c68-bf1f48a63338 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:47.967392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df80e9b6-b99e-47c1-9c68-bf1f48a63338 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:47.983886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df80e9b6-b99e-47c1-9c68-bf1f48a63338 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:47.991745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df80e9b6-b99e-47c1-9c68-bf1f48a63338 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:47.994708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df80e9b6-b99e-47c1-9c68-bf1f48a63338 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:47.995693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df80e9b6-b99e-47c1-9c68-bf1f48a63338 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:47.996189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df80e9b6-b99e-47c1-9c68-bf1f48a63338 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:47.996649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df80e9b6-b99e-47c1-9c68-bf1f48a63338 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:48.384683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-df80e9b6-b99e-47c1-9c68-bf1f48a63338 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:48.402261 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df80e9b6-b99e-47c1-9c68-bf1f48a63338 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1657 microversion: 2.1 time: 0.449256 Aug 09 15:02:48.411127 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2590/5174] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:47 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1657 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:49.430191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b941e1d5-d212-4216-89b1-005cf3ece826 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:49.430722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b941e1d5-d212-4216-89b1-005cf3ece826 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:49.446984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b941e1d5-d212-4216-89b1-005cf3ece826 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:49.456237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b941e1d5-d212-4216-89b1-005cf3ece826 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:49.456699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b941e1d5-d212-4216-89b1-005cf3ece826 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:49.463973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b941e1d5-d212-4216-89b1-005cf3ece826 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:49.470568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b941e1d5-d212-4216-89b1-005cf3ece826 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:49.471299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b941e1d5-d212-4216-89b1-005cf3ece826 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:49.913741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-84c67007-b2c1-4227-acd4-dff5c8b70eb8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:49.916141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-84c67007-b2c1-4227-acd4-dff5c8b70eb8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:49.924127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84c67007-b2c1-4227-acd4-dff5c8b70eb8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:49.924894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84c67007-b2c1-4227-acd4-dff5c8b70eb8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:49.925638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84c67007-b2c1-4227-acd4-dff5c8b70eb8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:49.926906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84c67007-b2c1-4227-acd4-dff5c8b70eb8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:49.928574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84c67007-b2c1-4227-acd4-dff5c8b70eb8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:49.929145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-84c67007-b2c1-4227-acd4-dff5c8b70eb8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:49.941777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:50.040539 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-84c67007-b2c1-4227-acd4-dff5c8b70eb8 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.130793 Aug 09 15:02:50.050019 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2591/5175] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:02:49 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments => generated 371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:50.184432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dfd44119-6f61-4d01-aed7-1f54053dc1c3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:50.184934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dfd44119-6f61-4d01-aed7-1f54053dc1c3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:50.193202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfd44119-6f61-4d01-aed7-1f54053dc1c3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:50.193781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfd44119-6f61-4d01-aed7-1f54053dc1c3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:50.194208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfd44119-6f61-4d01-aed7-1f54053dc1c3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:50.194906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfd44119-6f61-4d01-aed7-1f54053dc1c3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:50.217407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfd44119-6f61-4d01-aed7-1f54053dc1c3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:50.217947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dfd44119-6f61-4d01-aed7-1f54053dc1c3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:50.343058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b941e1d5-d212-4216-89b1-005cf3ece826 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:50.352956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:50.362909 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dfd44119-6f61-4d01-aed7-1f54053dc1c3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments/470eca90-7d95-4a8e-9c15-a22c3e516c57" status: 200 len: 194 microversion: 2.1 time: 0.177076 Aug 09 15:02:50.366308 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b941e1d5-d212-4216-89b1-005cf3ece826 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.942182 Aug 09 15:02:50.366864 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2592/5176] 10.222.0.50 () {58 vars in 1413 bytes} [Tue Aug 9 15:02:50 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments/470eca90-7d95-4a8e-9c15-a22c3e516c57 => generated 194 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:50.368857 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2585/5177] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:49 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:50.381177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c9e93db-6e5e-4dd7-95de-1e7ebd8eb9ad tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:50.382043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c9e93db-6e5e-4dd7-95de-1e7ebd8eb9ad tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:50.392533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2033d723-8fb7-443b-9480-565bf04fd043 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:50.393518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2033d723-8fb7-443b-9480-565bf04fd043 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:50.413095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c9e93db-6e5e-4dd7-95de-1e7ebd8eb9ad tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:50.414144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c9e93db-6e5e-4dd7-95de-1e7ebd8eb9ad tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:50.414880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=62 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:50.416471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c9e93db-6e5e-4dd7-95de-1e7ebd8eb9ad tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:50.420331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c9e93db-6e5e-4dd7-95de-1e7ebd8eb9ad tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:50.420502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c9e93db-6e5e-4dd7-95de-1e7ebd8eb9ad tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:50.423338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2033d723-8fb7-443b-9480-565bf04fd043 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:50.424536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2033d723-8fb7-443b-9480-565bf04fd043 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:50.425168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c9e93db-6e5e-4dd7-95de-1e7ebd8eb9ad tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:50.428546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2033d723-8fb7-443b-9480-565bf04fd043 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:50.435120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2033d723-8fb7-443b-9480-565bf04fd043 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:50.436232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2033d723-8fb7-443b-9480-565bf04fd043 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:50.439651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2033d723-8fb7-443b-9480-565bf04fd043 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:50.640667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-7c9e93db-6e5e-4dd7-95de-1e7ebd8eb9ad tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lazy-loading 'services' on Instance uuid 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:02:50.807883 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c9e93db-6e5e-4dd7-95de-1e7ebd8eb9ad tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments/470eca90-7d95-4a8e-9c15-a22c3e516c57" status: 202 len: 0 microversion: 2.1 time: 0.434134 Aug 09 15:02:50.809564 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2593/5178] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:02:50 2022] DELETE /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments/470eca90-7d95-4a8e-9c15-a22c3e516c57 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:02:51.039122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2033d723-8fb7-443b-9480-565bf04fd043 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:51.047064 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2033d723-8fb7-443b-9480-565bf04fd043 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.658470 Aug 09 15:02:51.054612 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2586/5179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:50 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:51.069967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2396d665-422b-46f0-b5a5-32955119d7cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:51.070741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2396d665-422b-46f0-b5a5-32955119d7cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:51.080219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2396d665-422b-46f0-b5a5-32955119d7cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:51.080705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2396d665-422b-46f0-b5a5-32955119d7cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:51.081135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2396d665-422b-46f0-b5a5-32955119d7cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:51.081839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2396d665-422b-46f0-b5a5-32955119d7cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:51.082285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2396d665-422b-46f0-b5a5-32955119d7cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:51.082706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2396d665-422b-46f0-b5a5-32955119d7cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:51.440995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2396d665-422b-46f0-b5a5-32955119d7cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:51.450483 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2396d665-422b-46f0-b5a5-32955119d7cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.384764 Aug 09 15:02:51.451646 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2594/5180] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:51 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:51.473298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a44cc876-b90c-4695-ad0a-945a55bc2451 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:51.474079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a44cc876-b90c-4695-ad0a-945a55bc2451 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:51.485712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a44cc876-b90c-4695-ad0a-945a55bc2451 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:51.489796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a44cc876-b90c-4695-ad0a-945a55bc2451 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:51.490589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a44cc876-b90c-4695-ad0a-945a55bc2451 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:51.494917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a44cc876-b90c-4695-ad0a-945a55bc2451 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:51.496292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a44cc876-b90c-4695-ad0a-945a55bc2451 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:51.497457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a44cc876-b90c-4695-ad0a-945a55bc2451 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:52.025799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a44cc876-b90c-4695-ad0a-945a55bc2451 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:52.036522 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a44cc876-b90c-4695-ad0a-945a55bc2451 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.567067 Aug 09 15:02:52.044686 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2587/5181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:51 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:52.059135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7bf04148-4e5a-4956-8d5d-acfc9d2bca1f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:52.060088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7bf04148-4e5a-4956-8d5d-acfc9d2bca1f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:52.071357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:52.075607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bf04148-4e5a-4956-8d5d-acfc9d2bca1f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:52.076808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bf04148-4e5a-4956-8d5d-acfc9d2bca1f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:52.077257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bf04148-4e5a-4956-8d5d-acfc9d2bca1f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:52.078003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bf04148-4e5a-4956-8d5d-acfc9d2bca1f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:52.078453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bf04148-4e5a-4956-8d5d-acfc9d2bca1f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:52.080922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bf04148-4e5a-4956-8d5d-acfc9d2bca1f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:52.148136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=10 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:02:52.343838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7bf04148-4e5a-4956-8d5d-acfc9d2bca1f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:52.352037 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7bf04148-4e5a-4956-8d5d-acfc9d2bca1f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.297370 Aug 09 15:02:52.355637 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2595/5182] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:52 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:52.379758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-021b34ad-40d5-49fe-85be-a01b4167ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:52.380427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-021b34ad-40d5-49fe-85be-a01b4167ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:52.390849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-021b34ad-40d5-49fe-85be-a01b4167ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:52.391390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-021b34ad-40d5-49fe-85be-a01b4167ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:52.391824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-021b34ad-40d5-49fe-85be-a01b4167ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:52.392545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-021b34ad-40d5-49fe-85be-a01b4167ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:52.392994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-021b34ad-40d5-49fe-85be-a01b4167ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:52.393411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-021b34ad-40d5-49fe-85be-a01b4167ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:52.692217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-021b34ad-40d5-49fe-85be-a01b4167ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:52.707955 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-021b34ad-40d5-49fe-85be-a01b4167ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.331929 Aug 09 15:02:52.709187 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2588/5183] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:52 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:53.480282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-794586442", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "7237766a-83c3-4ec0-80cb-e5de7fba3c02"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1585709441", "security_groups": [{"name": "tempest-secgroup-smoke-1055395032"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:53.664839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] validate_networks() for [('7237766a-83c3-4ec0-80cb-e5de7fba3c02', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:02:54.454861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:02:54.455305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:02:54.455780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:02:54.456177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:02:54.457810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:02:54.465587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:54.466071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:54.466497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:54.467251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:54.467698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:54.468112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:54.485583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for project 889fa240e1f5494d9c11803acd77f74b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:02:54.491352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for user 9ff3b746851a4414ba60cb76ac07056b and project 889fa240e1f5494d9c11803acd77f74b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:02:54.504865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:02:54.507624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:02:54.557318 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-258119d1-33a1-401f-bde6-b6af4a04ddb6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.087714 Aug 09 15:02:54.564959 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2596/5184] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:02:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:02:54.571766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-daffb57a-74c4-4357-8799-e26a005a41a8 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:54.573170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-daffb57a-74c4-4357-8799-e26a005a41a8 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:54.647079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-daffb57a-74c4-4357-8799-e26a005a41a8 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:54.657897 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-daffb57a-74c4-4357-8799-e26a005a41a8 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1266 microversion: 2.1 time: 0.088346 Aug 09 15:02:54.674015 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2589/5185] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:54 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:55.691151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dce6ada4-f4eb-4530-962e-cbedb5cdd188 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:55.692482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dce6ada4-f4eb-4530-962e-cbedb5cdd188 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:55.709481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dce6ada4-f4eb-4530-962e-cbedb5cdd188 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:55.710350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dce6ada4-f4eb-4530-962e-cbedb5cdd188 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:55.710965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dce6ada4-f4eb-4530-962e-cbedb5cdd188 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:55.711914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dce6ada4-f4eb-4530-962e-cbedb5cdd188 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:55.712542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dce6ada4-f4eb-4530-962e-cbedb5cdd188 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:55.713140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dce6ada4-f4eb-4530-962e-cbedb5cdd188 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:55.788032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dce6ada4-f4eb-4530-962e-cbedb5cdd188 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:55.798482 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dce6ada4-f4eb-4530-962e-cbedb5cdd188 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1318 microversion: 2.1 time: 0.122160 Aug 09 15:02:55.799830 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2597/5186] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:55 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1318 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:56.821291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-673a00ef-ca17-4f70-a009-182e7fa2095c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:56.822159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-673a00ef-ca17-4f70-a009-182e7fa2095c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:56.832297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-673a00ef-ca17-4f70-a009-182e7fa2095c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:56.832941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-673a00ef-ca17-4f70-a009-182e7fa2095c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:56.833472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-673a00ef-ca17-4f70-a009-182e7fa2095c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:56.834348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-673a00ef-ca17-4f70-a009-182e7fa2095c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:56.835230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-673a00ef-ca17-4f70-a009-182e7fa2095c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:56.835769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-673a00ef-ca17-4f70-a009-182e7fa2095c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:57.104705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-673a00ef-ca17-4f70-a009-182e7fa2095c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:57.113692 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-673a00ef-ca17-4f70-a009-182e7fa2095c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1392 microversion: 2.1 time: 0.296896 Aug 09 15:02:57.114539 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2590/5187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:56 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1392 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:57.362145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-d1ecc9b6-d445-4f33-bf3d-36491f4da39f req-f5a6d9ff-7c79-40f0-842a-edfa3ee99f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582fe71a-5bc9-4b44-b82d-a8d8e403f553", "tag": "58108270-1f4d-4960-8a75-59ca080644bc"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:02:57.385605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d1ecc9b6-d445-4f33-bf3d-36491f4da39f req-f5a6d9ff-7c79-40f0-842a-edfa3ee99f35 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:57.389577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d1ecc9b6-d445-4f33-bf3d-36491f4da39f req-f5a6d9ff-7c79-40f0-842a-edfa3ee99f35 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:57.391924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d1ecc9b6-d445-4f33-bf3d-36491f4da39f req-f5a6d9ff-7c79-40f0-842a-edfa3ee99f35 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:57.420892 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d1ecc9b6-d445-4f33-bf3d-36491f4da39f req-f5a6d9ff-7c79-40f0-842a-edfa3ee99f35 service nova] Creating event network-changed:58108270-1f4d-4960-8a75-59ca080644bc for instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 on n-h2-844626-8 Aug 09 15:02:57.429654 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-d1ecc9b6-d445-4f33-bf3d-36491f4da39f req-f5a6d9ff-7c79-40f0-842a-edfa3ee99f35 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071890 Aug 09 15:02:57.432675 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2598/5188] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:58.134958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e1ef613-211b-41a2-a3d8-909dab676ab9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:58.135906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2e1ef613-211b-41a2-a3d8-909dab676ab9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:58.143493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e1ef613-211b-41a2-a3d8-909dab676ab9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:58.144050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e1ef613-211b-41a2-a3d8-909dab676ab9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:58.144492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e1ef613-211b-41a2-a3d8-909dab676ab9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:58.145205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e1ef613-211b-41a2-a3d8-909dab676ab9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:58.145661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e1ef613-211b-41a2-a3d8-909dab676ab9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:58.146090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e1ef613-211b-41a2-a3d8-909dab676ab9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:58.290125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2e1ef613-211b-41a2-a3d8-909dab676ab9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:58.302936 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2e1ef613-211b-41a2-a3d8-909dab676ab9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1392 microversion: 2.1 time: 0.171563 Aug 09 15:02:58.303560 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2591/5189] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:58 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:59.323618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79b42b23-e87d-406c-97d2-67279e4c8750 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:59.324959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79b42b23-e87d-406c-97d2-67279e4c8750 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:59.332608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79b42b23-e87d-406c-97d2-67279e4c8750 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:59.333085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79b42b23-e87d-406c-97d2-67279e4c8750 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:59.333513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79b42b23-e87d-406c-97d2-67279e4c8750 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:59.334256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79b42b23-e87d-406c-97d2-67279e4c8750 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:59.334694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79b42b23-e87d-406c-97d2-67279e4c8750 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:59.335119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79b42b23-e87d-406c-97d2-67279e4c8750 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:59.365295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44672675-47f8-49aa-ae1a-5c07e5c7c379 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:59.366334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44672675-47f8-49aa-ae1a-5c07e5c7c379 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:59.374100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44672675-47f8-49aa-ae1a-5c07e5c7c379 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:59.375250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44672675-47f8-49aa-ae1a-5c07e5c7c379 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:59.375876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44672675-47f8-49aa-ae1a-5c07e5c7c379 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:59.376770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44672675-47f8-49aa-ae1a-5c07e5c7c379 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:59.377472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44672675-47f8-49aa-ae1a-5c07e5c7c379 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:59.378285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44672675-47f8-49aa-ae1a-5c07e5c7c379 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:59.421296 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44672675-47f8-49aa-ae1a-5c07e5c7c379 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments/1fdf751a-5fac-4ec0-a197-ec84953d939d" status: 200 len: 194 microversion: 2.1 time: 0.060219 Aug 09 15:02:59.429155 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2592/5190] 10.222.0.50 () {58 vars in 1413 bytes} [Tue Aug 9 15:02:59 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments/1fdf751a-5fac-4ec0-a197-ec84953d939d => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:02:59.435212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a860576-4940-4e38-958b-484c4c86460b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:02:59.438458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a860576-4940-4e38-958b-484c4c86460b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:02:59.445741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a860576-4940-4e38-958b-484c4c86460b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:59.446547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a860576-4940-4e38-958b-484c4c86460b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:59.447204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a860576-4940-4e38-958b-484c4c86460b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:59.448111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a860576-4940-4e38-958b-484c4c86460b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:02:59.448744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a860576-4940-4e38-958b-484c4c86460b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:02:59.449338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a860576-4940-4e38-958b-484c4c86460b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:02:59.532768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-79b42b23-e87d-406c-97d2-67279e4c8750 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:02:59.542527 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79b42b23-e87d-406c-97d2-67279e4c8750 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1392 microversion: 2.1 time: 0.223011 Aug 09 15:02:59.543446 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2599/5191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:02:59 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1392 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:02:59.577732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-9a860576-4940-4e38-958b-484c4c86460b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lazy-loading 'services' on Instance uuid 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:02:59.689835 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a860576-4940-4e38-958b-484c4c86460b tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments/1fdf751a-5fac-4ec0-a197-ec84953d939d" status: 202 len: 0 microversion: 2.1 time: 0.258534 Aug 09 15:02:59.690509 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2593/5192] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:02:59 2022] DELETE /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments/1fdf751a-5fac-4ec0-a197-ec84953d939d => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:03:00.564789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67c95513-0fa8-440c-88a8-ea5651909e6b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:00.567176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-67c95513-0fa8-440c-88a8-ea5651909e6b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:00.575267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67c95513-0fa8-440c-88a8-ea5651909e6b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:00.575850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67c95513-0fa8-440c-88a8-ea5651909e6b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:00.576350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67c95513-0fa8-440c-88a8-ea5651909e6b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:00.577211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67c95513-0fa8-440c-88a8-ea5651909e6b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:00.577732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67c95513-0fa8-440c-88a8-ea5651909e6b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:00.578223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67c95513-0fa8-440c-88a8-ea5651909e6b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:00.784233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-67c95513-0fa8-440c-88a8-ea5651909e6b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:00.793201 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67c95513-0fa8-440c-88a8-ea5651909e6b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1392 microversion: 2.1 time: 0.232493 Aug 09 15:03:00.794529 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2600/5193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:00 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:01.816462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bafa3c72-075c-4b45-b257-38e1bf70386a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:01.817498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bafa3c72-075c-4b45-b257-38e1bf70386a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:01.824692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bafa3c72-075c-4b45-b257-38e1bf70386a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:01.825993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bafa3c72-075c-4b45-b257-38e1bf70386a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:01.825993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bafa3c72-075c-4b45-b257-38e1bf70386a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:01.826987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bafa3c72-075c-4b45-b257-38e1bf70386a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:01.827138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bafa3c72-075c-4b45-b257-38e1bf70386a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:01.827757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bafa3c72-075c-4b45-b257-38e1bf70386a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:01.995569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bafa3c72-075c-4b45-b257-38e1bf70386a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:02.005627 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bafa3c72-075c-4b45-b257-38e1bf70386a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1392 microversion: 2.1 time: 0.194553 Aug 09 15:03:02.006587 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2594/5194] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:01 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:02.528437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3f7c3f64-ba0e-4625-bf59-8d842bd70e5c req-19b38ee6-1730-4f16-9632-e969cc2dc34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582fe71a-5bc9-4b44-b82d-a8d8e403f553", "name": "network-vif-plugged", "status": "completed", "tag": "58108270-1f4d-4960-8a75-59ca080644bc"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:03:02.539889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3f7c3f64-ba0e-4625-bf59-8d842bd70e5c req-19b38ee6-1730-4f16-9632-e969cc2dc34c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:02.540377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3f7c3f64-ba0e-4625-bf59-8d842bd70e5c req-19b38ee6-1730-4f16-9632-e969cc2dc34c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:02.540812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3f7c3f64-ba0e-4625-bf59-8d842bd70e5c req-19b38ee6-1730-4f16-9632-e969cc2dc34c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:02.568619 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3f7c3f64-ba0e-4625-bf59-8d842bd70e5c req-19b38ee6-1730-4f16-9632-e969cc2dc34c service nova] Creating event network-vif-plugged:58108270-1f4d-4960-8a75-59ca080644bc for instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 on n-h2-844626-8 Aug 09 15:03:02.580542 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3f7c3f64-ba0e-4625-bf59-8d842bd70e5c req-19b38ee6-1730-4f16-9632-e969cc2dc34c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302338 Aug 09 15:03:02.582131 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2601/5195] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:03:03.033818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce827b2e-c7a6-42df-9546-9644b193f6f2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:03.034603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ce827b2e-c7a6-42df-9546-9644b193f6f2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:03.049268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce827b2e-c7a6-42df-9546-9644b193f6f2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:03.049778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce827b2e-c7a6-42df-9546-9644b193f6f2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:03.050213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce827b2e-c7a6-42df-9546-9644b193f6f2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:03.050940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce827b2e-c7a6-42df-9546-9644b193f6f2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:03.051427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce827b2e-c7a6-42df-9546-9644b193f6f2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:03.051855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce827b2e-c7a6-42df-9546-9644b193f6f2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:03.248759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ce827b2e-c7a6-42df-9546-9644b193f6f2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:03.259214 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ce827b2e-c7a6-42df-9546-9644b193f6f2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1392 microversion: 2.1 time: 0.235132 Aug 09 15:03:03.260678 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2595/5196] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:03 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1392 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:03:04.283413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-248ad363-676a-4013-b61f-22048dacb336 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:04.284737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-248ad363-676a-4013-b61f-22048dacb336 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:04.291935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-248ad363-676a-4013-b61f-22048dacb336 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:04.292415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-248ad363-676a-4013-b61f-22048dacb336 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:04.292839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-248ad363-676a-4013-b61f-22048dacb336 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:04.293527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-248ad363-676a-4013-b61f-22048dacb336 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:04.294129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-248ad363-676a-4013-b61f-22048dacb336 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:04.294546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-248ad363-676a-4013-b61f-22048dacb336 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:04.445800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-248ad363-676a-4013-b61f-22048dacb336 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:04.455071 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-248ad363-676a-4013-b61f-22048dacb336 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1564 microversion: 2.1 time: 0.177198 Aug 09 15:03:04.456063 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2602/5197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:04 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:04.475828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a60e84b9-fa8f-45d3-9e8c-90789eb2b379 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:04.476559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a60e84b9-fa8f-45d3-9e8c-90789eb2b379 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:04.483808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a60e84b9-fa8f-45d3-9e8c-90789eb2b379 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:04.484422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a60e84b9-fa8f-45d3-9e8c-90789eb2b379 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:04.484964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a60e84b9-fa8f-45d3-9e8c-90789eb2b379 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:04.485767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a60e84b9-fa8f-45d3-9e8c-90789eb2b379 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:04.486323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a60e84b9-fa8f-45d3-9e8c-90789eb2b379 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:04.486872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a60e84b9-fa8f-45d3-9e8c-90789eb2b379 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:04.656381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a60e84b9-fa8f-45d3-9e8c-90789eb2b379 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:04.659022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:03:04.673783 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a60e84b9-fa8f-45d3-9e8c-90789eb2b379 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1564 microversion: 2.1 time: 0.201962 Aug 09 15:03:04.678590 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2596/5198] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:04 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1564 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:07.449117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-16bd1515-d041-4d19-9e27-1c45c55787db tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:07.450468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-16bd1515-d041-4d19-9e27-1c45c55787db tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:07.453987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-82f585d8-6ada-44b8-b606-b9a2939dda5e req-6a686667-6d67-43a1-8069-ec4af7f9f1c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582fe71a-5bc9-4b44-b82d-a8d8e403f553", "tag": "58108270-1f4d-4960-8a75-59ca080644bc"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:03:07.460067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:03:07.464741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:03:07.469943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16bd1515-d041-4d19-9e27-1c45c55787db tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:07.471524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16bd1515-d041-4d19-9e27-1c45c55787db tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:07.473039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16bd1515-d041-4d19-9e27-1c45c55787db tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:07.475861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-82f585d8-6ada-44b8-b606-b9a2939dda5e req-6a686667-6d67-43a1-8069-ec4af7f9f1c6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:07.476810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-82f585d8-6ada-44b8-b606-b9a2939dda5e req-6a686667-6d67-43a1-8069-ec4af7f9f1c6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:07.477421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-82f585d8-6ada-44b8-b606-b9a2939dda5e req-6a686667-6d67-43a1-8069-ec4af7f9f1c6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:07.478616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16bd1515-d041-4d19-9e27-1c45c55787db tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:07.485854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16bd1515-d041-4d19-9e27-1c45c55787db tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:07.486983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-16bd1515-d041-4d19-9e27-1c45c55787db tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:07.494734 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-82f585d8-6ada-44b8-b606-b9a2939dda5e req-6a686667-6d67-43a1-8069-ec4af7f9f1c6 service nova] Creating event network-changed:58108270-1f4d-4960-8a75-59ca080644bc for instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 on n-h2-844626-8 Aug 09 15:03:07.501059 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-82f585d8-6ada-44b8-b606-b9a2939dda5e req-6a686667-6d67-43a1-8069-ec4af7f9f1c6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051145 Aug 09 15:03:07.505212 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2597/5199] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:03:07.920799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-16bd1515-d041-4d19-9e27-1c45c55787db tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:07.931840 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-16bd1515-d041-4d19-9e27-1c45c55787db tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1564 microversion: 2.1 time: 0.487198 Aug 09 15:03:07.934885 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2603/5200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:07 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1564 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:09.118442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0518f491-03dc-4486-8e9a-b160ab3e02b3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:09.121371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0518f491-03dc-4486-8e9a-b160ab3e02b3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:09.134085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0518f491-03dc-4486-8e9a-b160ab3e02b3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:09.135816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0518f491-03dc-4486-8e9a-b160ab3e02b3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:09.136441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0518f491-03dc-4486-8e9a-b160ab3e02b3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:09.137331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0518f491-03dc-4486-8e9a-b160ab3e02b3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:09.138182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0518f491-03dc-4486-8e9a-b160ab3e02b3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:09.139100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0518f491-03dc-4486-8e9a-b160ab3e02b3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:09.239666 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0518f491-03dc-4486-8e9a-b160ab3e02b3 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127292 Aug 09 15:03:09.244739 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2598/5201] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:03:09 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:03:09.460669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d52ef06f-f166-4ec1-a265-3ab52a95657a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:09.463062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d52ef06f-f166-4ec1-a265-3ab52a95657a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:09.471186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d52ef06f-f166-4ec1-a265-3ab52a95657a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:09.471774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d52ef06f-f166-4ec1-a265-3ab52a95657a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:09.472326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d52ef06f-f166-4ec1-a265-3ab52a95657a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:09.473103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d52ef06f-f166-4ec1-a265-3ab52a95657a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:09.473702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d52ef06f-f166-4ec1-a265-3ab52a95657a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:09.477002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d52ef06f-f166-4ec1-a265-3ab52a95657a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:09.515702 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d52ef06f-f166-4ec1-a265-3ab52a95657a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059401 Aug 09 15:03:09.516379 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2604/5202] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:03:09 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:03:09.585608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef18ed98-324d-4030-9783-b3d48a2f6662 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:09.586358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef18ed98-324d-4030-9783-b3d48a2f6662 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:09.593276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef18ed98-324d-4030-9783-b3d48a2f6662 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:09.593783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef18ed98-324d-4030-9783-b3d48a2f6662 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:09.594295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef18ed98-324d-4030-9783-b3d48a2f6662 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:09.595072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef18ed98-324d-4030-9783-b3d48a2f6662 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:09.595640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef18ed98-324d-4030-9783-b3d48a2f6662 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:09.596137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef18ed98-324d-4030-9783-b3d48a2f6662 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:09.642445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef18ed98-324d-4030-9783-b3d48a2f6662 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:03:09.740748 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef18ed98-324d-4030-9783-b3d48a2f6662 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 204 len: 0 microversion: 2.1 time: 0.158438 Aug 09 15:03:09.747028 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2599/5203] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:03:09 2022] DELETE /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:03:09.750399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3f87682d-d492-4dfc-9e7c-c3029b19095d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:09.751023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3f87682d-d492-4dfc-9e7c-c3029b19095d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:09.757460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f87682d-d492-4dfc-9e7c-c3029b19095d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:09.757959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f87682d-d492-4dfc-9e7c-c3029b19095d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:09.758392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f87682d-d492-4dfc-9e7c-c3029b19095d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:09.759114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f87682d-d492-4dfc-9e7c-c3029b19095d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:09.759575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f87682d-d492-4dfc-9e7c-c3029b19095d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:09.760353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f87682d-d492-4dfc-9e7c-c3029b19095d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:09.985414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3f87682d-d492-4dfc-9e7c-c3029b19095d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:10.003673 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3f87682d-d492-4dfc-9e7c-c3029b19095d tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1671 microversion: 2.1 time: 0.257273 Aug 09 15:03:10.004761 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2605/5204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:09 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1671 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:03:11.029004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bd24811e-9b70-4b82-8563-022d80d447c1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:11.030370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bd24811e-9b70-4b82-8563-022d80d447c1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:11.039236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd24811e-9b70-4b82-8563-022d80d447c1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:11.039807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd24811e-9b70-4b82-8563-022d80d447c1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:11.040317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd24811e-9b70-4b82-8563-022d80d447c1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:11.041131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd24811e-9b70-4b82-8563-022d80d447c1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:11.041662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd24811e-9b70-4b82-8563-022d80d447c1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:11.042160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd24811e-9b70-4b82-8563-022d80d447c1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:11.204396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bd24811e-9b70-4b82-8563-022d80d447c1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:11.214508 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bd24811e-9b70-4b82-8563-022d80d447c1 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1671 microversion: 2.1 time: 0.189872 Aug 09 15:03:11.215837 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2600/5205] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:11 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1671 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:12.244580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30df0901-8d19-422b-94c4-eb7f0b8a0d10 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:12.245190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30df0901-8d19-422b-94c4-eb7f0b8a0d10 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:12.254758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30df0901-8d19-422b-94c4-eb7f0b8a0d10 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:12.255383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30df0901-8d19-422b-94c4-eb7f0b8a0d10 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:12.255826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30df0901-8d19-422b-94c4-eb7f0b8a0d10 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:12.258356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30df0901-8d19-422b-94c4-eb7f0b8a0d10 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:12.258969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30df0901-8d19-422b-94c4-eb7f0b8a0d10 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:12.259835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30df0901-8d19-422b-94c4-eb7f0b8a0d10 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:12.455061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30df0901-8d19-422b-94c4-eb7f0b8a0d10 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:12.465382 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30df0901-8d19-422b-94c4-eb7f0b8a0d10 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1671 microversion: 2.1 time: 0.230248 Aug 09 15:03:12.467633 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2606/5206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:12 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1671 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:13.441661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-9825ca32-6fa4-4da1-bf63-7a2d0d6a2500 req-f066df32-ee6b-4a17-aca4-46ae84f82118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb0f976-1636-4b67-ac31-dd6ca3bcf531", "name": "network-vif-deleted", "tag": "40227e90-8532-4037-96b7-3bb881bdff9c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:03:13.473042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9825ca32-6fa4-4da1-bf63-7a2d0d6a2500 req-f066df32-ee6b-4a17-aca4-46ae84f82118 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:13.477093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9825ca32-6fa4-4da1-bf63-7a2d0d6a2500 req-f066df32-ee6b-4a17-aca4-46ae84f82118 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:13.481052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9825ca32-6fa4-4da1-bf63-7a2d0d6a2500 req-f066df32-ee6b-4a17-aca4-46ae84f82118 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:13.500142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:13.502316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:13.524353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:13.524843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:13.525282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:13.526026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:13.526438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:13.526912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:13.535898 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9825ca32-6fa4-4da1-bf63-7a2d0d6a2500 req-f066df32-ee6b-4a17-aca4-46ae84f82118 service nova] Creating event network-vif-deleted:40227e90-8532-4037-96b7-3bb881bdff9c for instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 on n-h1-844626-8 Aug 09 15:03:13.550515 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-9825ca32-6fa4-4da1-bf63-7a2d0d6a2500 req-f066df32-ee6b-4a17-aca4-46ae84f82118 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.623240 Aug 09 15:03:13.555272 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2601/5207] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:03:13.660109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:13.664500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:13.668749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:13.669492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lazy-loading 'fault' on Instance uuid 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:03:13.744367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b8154cdb1a64b4894811af2cea904cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63d01743846420d9f081b7f8b73c5d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:13.753043 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-95d95690-52c0-431c-b6ad-6b9cc91e99cf tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 200 len: 1326 microversion: 2.1 time: 0.258154 Aug 09 15:03:13.753754 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2607/5208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:13 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 1326 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:03:14.779295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e346500-6397-4b71-af55-6581aeeff89e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:14.779928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e346500-6397-4b71-af55-6581aeeff89e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:14.796691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e346500-6397-4b71-af55-6581aeeff89e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:14.797437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e346500-6397-4b71-af55-6581aeeff89e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:14.798035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e346500-6397-4b71-af55-6581aeeff89e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:14.799026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e346500-6397-4b71-af55-6581aeeff89e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:14.810781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e346500-6397-4b71-af55-6581aeeff89e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:14.812651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e346500-6397-4b71-af55-6581aeeff89e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:14.846185 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-1e346500-6397-4b71-af55-6581aeeff89e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] HTTP exception thrown: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e346500-6397-4b71-af55-6581aeeff89e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Request method failure captured: Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 HTTP/1.1 Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nXQWH6g5t52QIlGq_543lnbQi7Dsjdih208ynSgQf3qtVZv5fmEGnGOJI53RPi6MTHKAW03j5SNiiuLg-taeOlbbVXg6xFuvkek88Wj3FldkHhnmoT4YkomKWMKcPHhAZ_W34ZwfYslfvRFwcdlqrlpiruA7er3Ase8S2W426qJy9Q Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f63d01743846420d9f081b7f8b73c5d2 Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f63d01743846420d9f081b7f8b73c5d2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f63d01743846420d9f081b7f8b73c5d2 Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AttachVolumeTestJSON-391021225-project Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 9b8154cdb1a64b4894811af2cea904cb Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeTestJSON-391021225-project Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '2cb0f976-1636-4b67-ac31-dd6ca3bcf531'} Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:03:14.848353 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:14.853385 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:14.853385 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:03:14.853385 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:03:14.853385 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:03:14.853385 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:03:14.853385 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:14.853385 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:14.855224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e346500-6397-4b71-af55-6581aeeff89e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Returning 404 to user: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:03:14.857131 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e346500-6397-4b71-af55-6581aeeff89e tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 404 len: 111 microversion: 2.1 time: 0.083244 Aug 09 15:03:14.871476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-56505fd9-cafe-4724-9c79-7c7380af535a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '.version_select at 0x7f41e7507ee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:14.876132 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2602/5209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:14 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:03:14.930030 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-56505fd9-cafe-4724-9c79-7c7380af535a tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-271422482" status: 202 len: 0 microversion: 2.1 time: 0.060295 Aug 09 15:03:14.935642 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2608/5210] 10.222.0.50 () {58 vars in 1218 bytes} [Tue Aug 9 15:03:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-271422482 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:03:21.400781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9c41a890-e9ef-4244-9166-02474c20010c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:21.401374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9c41a890-e9ef-4244-9166-02474c20010c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:21.411704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:03:21.416577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c41a890-e9ef-4244-9166-02474c20010c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:21.417240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c41a890-e9ef-4244-9166-02474c20010c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:21.417684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c41a890-e9ef-4244-9166-02474c20010c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:21.418400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c41a890-e9ef-4244-9166-02474c20010c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:21.418849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c41a890-e9ef-4244-9166-02474c20010c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:21.419301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c41a890-e9ef-4244-9166-02474c20010c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:21.430507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:03:21.531169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-9c41a890-e9ef-4244-9166-02474c20010c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lazy-loading 'services' on Instance uuid fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:03:21.623710 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9c41a890-e9ef-4244-9166-02474c20010c tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1/os-volume_attachments/5a991526-8fe4-46f6-85fb-1dc5ed7a21dd" status: 202 len: 0 microversion: 2.1 time: 0.225658 Aug 09 15:03:21.625131 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2603/5211] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:03:21 2022] DELETE /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1/os-volume_attachments/5a991526-8fe4-46f6-85fb-1dc5ed7a21dd => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:03:22.959132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0db1918e-b888-469e-b6b9-c98d527d2e92 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:03:22.961485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0db1918e-b888-469e-b6b9-c98d527d2e92 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:22.968728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:03:22.978345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db1918e-b888-469e-b6b9-c98d527d2e92 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:22.978838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db1918e-b888-469e-b6b9-c98d527d2e92 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:22.979303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db1918e-b888-469e-b6b9-c98d527d2e92 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:22.980014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db1918e-b888-469e-b6b9-c98d527d2e92 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:22.980468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db1918e-b888-469e-b6b9-c98d527d2e92 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:22.980896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0db1918e-b888-469e-b6b9-c98d527d2e92 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:23.001778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:03:23.109050 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0db1918e-b888-469e-b6b9-c98d527d2e92 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.367942 Aug 09 15:03:23.139440 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2609/5212] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:03:22 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:03:23.145673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a27b77ff-faf3-4d67-b7ea-f14df6d306cd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:23.146517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a27b77ff-faf3-4d67-b7ea-f14df6d306cd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:23.158109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a27b77ff-faf3-4d67-b7ea-f14df6d306cd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:23.164180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a27b77ff-faf3-4d67-b7ea-f14df6d306cd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:23.164833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a27b77ff-faf3-4d67-b7ea-f14df6d306cd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:23.166245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a27b77ff-faf3-4d67-b7ea-f14df6d306cd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:23.181840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a27b77ff-faf3-4d67-b7ea-f14df6d306cd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:23.184654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a27b77ff-faf3-4d67-b7ea-f14df6d306cd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:23.483880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a27b77ff-faf3-4d67-b7ea-f14df6d306cd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:23.493159 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a27b77ff-faf3-4d67-b7ea-f14df6d306cd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1667 microversion: 2.1 time: 0.354231 Aug 09 15:03:23.496906 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2604/5213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:23 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1667 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:03:24.532456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-830a8bb0-1cc6-4626-9570-3b1f0d5f8fdf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:24.545119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-830a8bb0-1cc6-4626-9570-3b1f0d5f8fdf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:24.559509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-830a8bb0-1cc6-4626-9570-3b1f0d5f8fdf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:24.562439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-830a8bb0-1cc6-4626-9570-3b1f0d5f8fdf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:24.563059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-830a8bb0-1cc6-4626-9570-3b1f0d5f8fdf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:24.564004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-830a8bb0-1cc6-4626-9570-3b1f0d5f8fdf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:24.564671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-830a8bb0-1cc6-4626-9570-3b1f0d5f8fdf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:24.565241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-830a8bb0-1cc6-4626-9570-3b1f0d5f8fdf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:24.768948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-830a8bb0-1cc6-4626-9570-3b1f0d5f8fdf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:24.788147 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-830a8bb0-1cc6-4626-9570-3b1f0d5f8fdf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1672 microversion: 2.1 time: 0.267715 Aug 09 15:03:24.791628 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2610/5214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:24 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1672 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:25.028991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d2ddd5d-e245-48a9-a016-f8e3324c2130 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:25.031872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d2ddd5d-e245-48a9-a016-f8e3324c2130 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:25.043193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d2ddd5d-e245-48a9-a016-f8e3324c2130 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:25.047733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d2ddd5d-e245-48a9-a016-f8e3324c2130 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:25.048184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d2ddd5d-e245-48a9-a016-f8e3324c2130 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:25.048913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d2ddd5d-e245-48a9-a016-f8e3324c2130 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:25.049365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d2ddd5d-e245-48a9-a016-f8e3324c2130 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:25.049786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d2ddd5d-e245-48a9-a016-f8e3324c2130 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:25.066045 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-0d2ddd5d-e245-48a9-a016-f8e3324c2130 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] HTTP exception thrown: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d2ddd5d-e245-48a9-a016-f8e3324c2130 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Request method failure captured: Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 HTTP/1.1 Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nXQWH6g5t52QIlGq_543lnbQi7Dsjdih208ynSgQf3qtVZv5fmEGnGOJI53RPi6MTHKAW03j5SNiiuLg-taeOlbbVXg6xFuvkek88Wj3FldkHhnmoT4YkomKWMKcPHhAZ_W34ZwfYslfvRFwcdlqrlpiruA7er3Ase8S2W426qJy9Q Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f63d01743846420d9f081b7f8b73c5d2 Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f63d01743846420d9f081b7f8b73c5d2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f63d01743846420d9f081b7f8b73c5d2 Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AttachVolumeTestJSON-391021225-project Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 9b8154cdb1a64b4894811af2cea904cb Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeTestJSON-391021225-project Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '2cb0f976-1636-4b67-ac31-dd6ca3bcf531'} Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:03:25.067869 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d2ddd5d-e245-48a9-a016-f8e3324c2130 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Returning 404 to user: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d2ddd5d-e245-48a9-a016-f8e3324c2130 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 404 len: 111 microversion: 2.1 time: 0.044951 Aug 09 15:03:25.072718 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2605/5215] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:03:25 2022] DELETE /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:03:25.078603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-17159e1f-7f27-4d2a-ba9f-f1f4b97bdce7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:25.079368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-17159e1f-7f27-4d2a-ba9f-f1f4b97bdce7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 2cb0f976-1636-4b67-ac31-dd6ca3bcf531] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:25.108425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17159e1f-7f27-4d2a-ba9f-f1f4b97bdce7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:25.109027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17159e1f-7f27-4d2a-ba9f-f1f4b97bdce7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:25.109562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17159e1f-7f27-4d2a-ba9f-f1f4b97bdce7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:25.110400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17159e1f-7f27-4d2a-ba9f-f1f4b97bdce7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:25.110952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17159e1f-7f27-4d2a-ba9f-f1f4b97bdce7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:25.111690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17159e1f-7f27-4d2a-ba9f-f1f4b97bdce7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:25.138603 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-17159e1f-7f27-4d2a-ba9f-f1f4b97bdce7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] HTTP exception thrown: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-17159e1f-7f27-4d2a-ba9f-f1f4b97bdce7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Request method failure captured: Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 HTTP/1.1 Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nXQWH6g5t52QIlGq_543lnbQi7Dsjdih208ynSgQf3qtVZv5fmEGnGOJI53RPi6MTHKAW03j5SNiiuLg-taeOlbbVXg6xFuvkek88Wj3FldkHhnmoT4YkomKWMKcPHhAZ_W34ZwfYslfvRFwcdlqrlpiruA7er3Ase8S2W426qJy9Q Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f63d01743846420d9f081b7f8b73c5d2 Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f63d01743846420d9f081b7f8b73c5d2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f63d01743846420d9f081b7f8b73c5d2 Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeTestJSON-391021225-project Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 9b8154cdb1a64b4894811af2cea904cb Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeTestJSON-391021225-project Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '2cb0f976-1636-4b67-ac31-dd6ca3bcf531'} Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:03:25.140539 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:25.145505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:25.145505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:03:25.145505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:03:25.145505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:03:25.145505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:03:25.145505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. Aug 09 15:03:25.145505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:25.146429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-17159e1f-7f27-4d2a-ba9f-f1f4b97bdce7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Returning 404 to user: Instance 2cb0f976-1636-4b67-ac31-dd6ca3bcf531 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:03:25.152515 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-17159e1f-7f27-4d2a-ba9f-f1f4b97bdce7 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531" status: 404 len: 111 microversion: 2.1 time: 0.077302 Aug 09 15:03:25.153553 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2611/5216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:25 2022] GET /compute/v2.1/servers/2cb0f976-1636-4b67-ac31-dd6ca3bcf531 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:03:25.814007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8d75f5a-3c93-4d7a-ad80-cbc40f22c269 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:25.814622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b8d75f5a-3c93-4d7a-ad80-cbc40f22c269 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:25.827970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8d75f5a-3c93-4d7a-ad80-cbc40f22c269 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:25.828474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8d75f5a-3c93-4d7a-ad80-cbc40f22c269 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:25.828909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8d75f5a-3c93-4d7a-ad80-cbc40f22c269 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:25.829827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8d75f5a-3c93-4d7a-ad80-cbc40f22c269 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:25.830445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8d75f5a-3c93-4d7a-ad80-cbc40f22c269 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:25.831032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8d75f5a-3c93-4d7a-ad80-cbc40f22c269 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:26.122993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8d75f5a-3c93-4d7a-ad80-cbc40f22c269 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:26.131961 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8d75f5a-3c93-4d7a-ad80-cbc40f22c269 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.321839 Aug 09 15:03:26.137281 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2606/5217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:25 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:28.227538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9a5ac6f1-90ee-4ae7-8389-f3a5a488ab1a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:28.228849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9a5ac6f1-90ee-4ae7-8389-f3a5a488ab1a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:28.236655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a5ac6f1-90ee-4ae7-8389-f3a5a488ab1a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:28.237472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a5ac6f1-90ee-4ae7-8389-f3a5a488ab1a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:28.238061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a5ac6f1-90ee-4ae7-8389-f3a5a488ab1a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:28.239147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a5ac6f1-90ee-4ae7-8389-f3a5a488ab1a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:28.240110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a5ac6f1-90ee-4ae7-8389-f3a5a488ab1a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:28.240695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a5ac6f1-90ee-4ae7-8389-f3a5a488ab1a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:28.274829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9a5ac6f1-90ee-4ae7-8389-f3a5a488ab1a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:03:28.388374 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9a5ac6f1-90ee-4ae7-8389-f3a5a488ab1a tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 204 len: 0 microversion: 2.1 time: 0.165191 Aug 09 15:03:28.392745 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2612/5218] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:03:28 2022] DELETE /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:03:28.400295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-51560438-8527-41d2-bc6d-5b408fd079d3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:28.401327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-51560438-8527-41d2-bc6d-5b408fd079d3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:28.410751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51560438-8527-41d2-bc6d-5b408fd079d3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:28.411642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51560438-8527-41d2-bc6d-5b408fd079d3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:28.412244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51560438-8527-41d2-bc6d-5b408fd079d3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:28.412984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51560438-8527-41d2-bc6d-5b408fd079d3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:28.413542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51560438-8527-41d2-bc6d-5b408fd079d3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:28.414168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51560438-8527-41d2-bc6d-5b408fd079d3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:28.599286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-51560438-8527-41d2-bc6d-5b408fd079d3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:28.609376 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-51560438-8527-41d2-bc6d-5b408fd079d3 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1515 microversion: 2.1 time: 0.215199 Aug 09 15:03:28.610558 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2607/5219] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:28 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1515 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:03:29.632913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-730b1d94-c84d-4cdd-9e2a-f7de6245be85 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:29.633607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-730b1d94-c84d-4cdd-9e2a-f7de6245be85 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:29.642396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-730b1d94-c84d-4cdd-9e2a-f7de6245be85 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:29.642886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-730b1d94-c84d-4cdd-9e2a-f7de6245be85 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:29.643338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-730b1d94-c84d-4cdd-9e2a-f7de6245be85 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:29.644239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-730b1d94-c84d-4cdd-9e2a-f7de6245be85 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:29.644842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-730b1d94-c84d-4cdd-9e2a-f7de6245be85 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:29.645475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-730b1d94-c84d-4cdd-9e2a-f7de6245be85 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:29.836327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-730b1d94-c84d-4cdd-9e2a-f7de6245be85 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:29.844497 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-730b1d94-c84d-4cdd-9e2a-f7de6245be85 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1515 microversion: 2.1 time: 0.215701 Aug 09 15:03:29.858924 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2613/5220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:29 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1515 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:30.472912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e5e9b4c-e45d-4fc4-aa91-8fb591b7d578 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:03:30.476314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e5e9b4c-e45d-4fc4-aa91-8fb591b7d578 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:30.490189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e5e9b4c-e45d-4fc4-aa91-8fb591b7d578 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:30.492980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e5e9b4c-e45d-4fc4-aa91-8fb591b7d578 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:30.493616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e5e9b4c-e45d-4fc4-aa91-8fb591b7d578 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:30.494518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e5e9b4c-e45d-4fc4-aa91-8fb591b7d578 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:30.499886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e5e9b4c-e45d-4fc4-aa91-8fb591b7d578 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:30.500578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e5e9b4c-e45d-4fc4-aa91-8fb591b7d578 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:30.600116 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e5e9b4c-e45d-4fc4-aa91-8fb591b7d578 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553/action" status: 200 len: 24528 microversion: 2.1 time: 0.127809 Aug 09 15:03:30.602497 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2608/5221] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:03:30 2022] POST /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553/action => generated 24528 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:03:30.618913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-abe2676e-25a3-40be-a44d-18bde77df353 req-fc0c3e75-2aac-41c3-98fd-6e19604f6a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe220fa9-3aed-47c5-9c5e-0da3c245a3b1", "name": "network-vif-deleted", "tag": "ee078eea-f410-4b17-8355-1e2e025c47e1"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:03:30.634200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-abe2676e-25a3-40be-a44d-18bde77df353 req-fc0c3e75-2aac-41c3-98fd-6e19604f6a27 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:30.635890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-abe2676e-25a3-40be-a44d-18bde77df353 req-fc0c3e75-2aac-41c3-98fd-6e19604f6a27 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:30.636338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-abe2676e-25a3-40be-a44d-18bde77df353 req-fc0c3e75-2aac-41c3-98fd-6e19604f6a27 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:30.655079 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-abe2676e-25a3-40be-a44d-18bde77df353 req-fc0c3e75-2aac-41c3-98fd-6e19604f6a27 service nova] Creating event network-vif-deleted:ee078eea-f410-4b17-8355-1e2e025c47e1 for instance fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 on n-h1-844626-8 Aug 09 15:03:30.664917 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-abe2676e-25a3-40be-a44d-18bde77df353 req-fc0c3e75-2aac-41c3-98fd-6e19604f6a27 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050683 Aug 09 15:03:30.666352 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2614/5222] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:03:30.869568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:30.870747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:30.883898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:30.884988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:30.885622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:30.887623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:30.888289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:30.889573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:30.940756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:30.941260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:30.942487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:30.943119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lazy-loading 'fault' on Instance uuid fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:03:31.016234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ab820ec1384350b9cab506cf75df22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fbd4a7083a34b02910cb4e4b7d4aca0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:31.039691 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-41d60256-e1a4-4e6b-8deb-3bab32e98f43 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 200 len: 1309 microversion: 2.1 time: 0.177439 Aug 09 15:03:31.040605 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2609/5223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:30 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 1309 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:31.810741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7651db91-8187-4261-82a0-afba5c889753 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:31.811373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7651db91-8187-4261-82a0-afba5c889753 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:31.818887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7651db91-8187-4261-82a0-afba5c889753 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:31.819422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7651db91-8187-4261-82a0-afba5c889753 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:31.819862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7651db91-8187-4261-82a0-afba5c889753 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:31.820572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7651db91-8187-4261-82a0-afba5c889753 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:31.821029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7651db91-8187-4261-82a0-afba5c889753 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:31.821458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7651db91-8187-4261-82a0-afba5c889753 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:31.836016 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-7651db91-8187-4261-82a0-afba5c889753 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] HTTP exception thrown: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7651db91-8187-4261-82a0-afba5c889753 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Request method failure captured: Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 HTTP/1.1 Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nXQWH6g5t52QIlGq_543lnbQi7Dsjdih208ynSgQf3qtVZv5fmEGnGOJI53RPi6MTHKAW03j5SNiiuLg-taeOlbbVXg6xFuvkek88Wj3FldkHhnmoT4YkomKWMKcPHhAZ_W34ZwfYslfvRFwcdlqrlpiruA7er3Ase8S2W426qJy9Q Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f63d01743846420d9f081b7f8b73c5d2 Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f63d01743846420d9f081b7f8b73c5d2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f63d01743846420d9f081b7f8b73c5d2 Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-AttachVolumeTestJSON-391021225-project Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 9b8154cdb1a64b4894811af2cea904cb Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-AttachVolumeTestJSON-391021225-project Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '22ec66f1-8b80-40ad-8cfe-95852fda1792'} Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:03:31.837717 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7651db91-8187-4261-82a0-afba5c889753 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Returning 404 to user: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7651db91-8187-4261-82a0-afba5c889753 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "DELETE /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 404 len: 111 microversion: 2.1 time: 0.032811 Aug 09 15:03:31.842414 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2615/5224] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:03:31 2022] DELETE /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:03:31.848901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e020ec86-344d-4f84-ae6f-314980887615 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:31.849615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e020ec86-344d-4f84-ae6f-314980887615 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] [instance: 22ec66f1-8b80-40ad-8cfe-95852fda1792] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:31.857873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e020ec86-344d-4f84-ae6f-314980887615 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:31.858360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e020ec86-344d-4f84-ae6f-314980887615 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:31.858792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e020ec86-344d-4f84-ae6f-314980887615 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:31.859530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e020ec86-344d-4f84-ae6f-314980887615 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:31.859979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e020ec86-344d-4f84-ae6f-314980887615 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:31.860858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e020ec86-344d-4f84-ae6f-314980887615 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:31.878399 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-e020ec86-344d-4f84-ae6f-314980887615 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] HTTP exception thrown: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e020ec86-344d-4f84-ae6f-314980887615 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Request method failure captured: Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 HTTP/1.1 Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nXQWH6g5t52QIlGq_543lnbQi7Dsjdih208ynSgQf3qtVZv5fmEGnGOJI53RPi6MTHKAW03j5SNiiuLg-taeOlbbVXg6xFuvkek88Wj3FldkHhnmoT4YkomKWMKcPHhAZ_W34ZwfYslfvRFwcdlqrlpiruA7er3Ase8S2W426qJy9Q Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f63d01743846420d9f081b7f8b73c5d2 Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f63d01743846420d9f081b7f8b73c5d2", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f63d01743846420d9f081b7f8b73c5d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f63d01743846420d9f081b7f8b73c5d2 Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-AttachVolumeTestJSON-391021225 Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-AttachVolumeTestJSON-391021225-project Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 9b8154cdb1a64b4894811af2cea904cb Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-AttachVolumeTestJSON-391021225-project Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '22ec66f1-8b80-40ad-8cfe-95852fda1792'} Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:03:31.880031 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:31.884976 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:31.884976 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:03:31.884976 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:03:31.884976 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:03:31.884976 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:03:31.884976 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. Aug 09 15:03:31.884976 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:03:31.884976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e020ec86-344d-4f84-ae6f-314980887615 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] Returning 404 to user: Instance 22ec66f1-8b80-40ad-8cfe-95852fda1792 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:03:31.884976 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e020ec86-344d-4f84-ae6f-314980887615 tempest-AttachVolumeTestJSON-391021225 tempest-AttachVolumeTestJSON-391021225-project] 10.222.0.50 "GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792" status: 404 len: 111 microversion: 2.1 time: 0.037019 Aug 09 15:03:31.886335 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2610/5225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:31 2022] GET /compute/v2.1/servers/22ec66f1-8b80-40ad-8cfe-95852fda1792 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:03:32.062151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-31f398d8-e2c3-4588-82a2-9f17828aca76 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:32.062929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-31f398d8-e2c3-4588-82a2-9f17828aca76 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] [instance: fe220fa9-3aed-47c5-9c5e-0da3c245a3b1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:32.071764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31f398d8-e2c3-4588-82a2-9f17828aca76 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:32.073809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31f398d8-e2c3-4588-82a2-9f17828aca76 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:32.075486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31f398d8-e2c3-4588-82a2-9f17828aca76 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:32.077517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31f398d8-e2c3-4588-82a2-9f17828aca76 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:32.078235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31f398d8-e2c3-4588-82a2-9f17828aca76 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:32.078980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31f398d8-e2c3-4588-82a2-9f17828aca76 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:32.098312 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-31f398d8-e2c3-4588-82a2-9f17828aca76 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] HTTP exception thrown: Instance fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 could not be found. Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-31f398d8-e2c3-4588-82a2-9f17828aca76 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Request method failure captured: Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 HTTP/1.1 Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nYivwnHgKH2L-gVNywShRfD_Xl3V9JyE1bXnfGFE2KC0K6zVAC0__I7c4oiY6WWCw0yIkLnTJUuiFlbAoBeY0kXkOXtpZVeHsHTb6-HboplnCKVpdqnYX3RIIV3YhVZY_xOSwKDuu0ypRcnmCX5pail-YA7QeMHJPEI10EPit-SuaQ Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9fbd4a7083a34b02910cb4e4b7d4aca0 Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesSnapshotTestJSON-830142703 Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9fbd4a7083a34b02910cb4e4b7d4aca0", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9fbd4a7083a34b02910cb4e4b7d4aca0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9fbd4a7083a34b02910cb4e4b7d4aca0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9fbd4a7083a34b02910cb4e4b7d4aca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-VolumesSnapshotTestJSON-830142703 Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9fbd4a7083a34b02910cb4e4b7d4aca0 Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-830142703 Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-VolumesSnapshotTestJSON-830142703-project Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 94ab820ec1384350b9cab506cf75df22 Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-VolumesSnapshotTestJSON-830142703-project Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 could not be found. Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'fe220fa9-3aed-47c5-9c5e-0da3c245a3b1'} Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 could not be found. Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 could not be found. Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:03:32.100934 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:32.106319 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:03:32.106319 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:03:32.106319 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:03:32.106319 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:03:32.106319 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:03:32.106319 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 could not be found. Aug 09 15:03:32.106319 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:03:32.107922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-31f398d8-e2c3-4588-82a2-9f17828aca76 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] Returning 404 to user: Instance fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:03:32.109030 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-31f398d8-e2c3-4588-82a2-9f17828aca76 tempest-VolumesSnapshotTestJSON-830142703 tempest-VolumesSnapshotTestJSON-830142703-project] 10.222.0.50 "GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1" status: 404 len: 111 microversion: 2.1 time: 0.051251 Aug 09 15:03:32.123674 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2616/5226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:32 2022] GET /compute/v2.1/servers/fe220fa9-3aed-47c5-9c5e-0da3c245a3b1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:03:41.482163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd98f840-2d47-4443-8d3b-b937e3c4e56a tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:41.482775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd98f840-2d47-4443-8d3b-b937e3c4e56a tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:41.494274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd98f840-2d47-4443-8d3b-b937e3c4e56a tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:41.498776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd98f840-2d47-4443-8d3b-b937e3c4e56a tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:41.502516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd98f840-2d47-4443-8d3b-b937e3c4e56a tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:41.503684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd98f840-2d47-4443-8d3b-b937e3c4e56a tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:41.504330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd98f840-2d47-4443-8d3b-b937e3c4e56a tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:41.504964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd98f840-2d47-4443-8d3b-b937e3c4e56a tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:42.178107 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd98f840-2d47-4443-8d3b-b937e3c4e56a tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1834 microversion: 2.1 time: 0.699865 Aug 09 15:03:42.196048 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2611/5227] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:41 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1834 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:42.208289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-905b9621-664b-4e6e-a0a2-bb1002552713 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:42.208909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-905b9621-664b-4e6e-a0a2-bb1002552713 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:42.219940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:03:42.220651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:03:42.222072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-905b9621-664b-4e6e-a0a2-bb1002552713 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:42.222564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-905b9621-664b-4e6e-a0a2-bb1002552713 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:42.223004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-905b9621-664b-4e6e-a0a2-bb1002552713 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:42.223935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-905b9621-664b-4e6e-a0a2-bb1002552713 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:42.224530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-905b9621-664b-4e6e-a0a2-bb1002552713 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:42.233115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-905b9621-664b-4e6e-a0a2-bb1002552713 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:42.569267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-905b9621-664b-4e6e-a0a2-bb1002552713 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:42.581113 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-905b9621-664b-4e6e-a0a2-bb1002552713 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1683 microversion: 2.1 time: 0.377680 Aug 09 15:03:42.581706 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2617/5228] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:42 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1683 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:42.705990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1751c12-9aa7-4f36-b0d6-b16a3ff7e81a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:03:42.709876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1751c12-9aa7-4f36-b0d6-b16a3ff7e81a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:42.718592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1751c12-9aa7-4f36-b0d6-b16a3ff7e81a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:42.718837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1751c12-9aa7-4f36-b0d6-b16a3ff7e81a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:42.719124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1751c12-9aa7-4f36-b0d6-b16a3ff7e81a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:42.721518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1751c12-9aa7-4f36-b0d6-b16a3ff7e81a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:42.722160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1751c12-9aa7-4f36-b0d6-b16a3ff7e81a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:42.722798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1751c12-9aa7-4f36-b0d6-b16a3ff7e81a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:42.801660 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b1751c12-9aa7-4f36-b0d6-b16a3ff7e81a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553/action" status: 200 len: 32598 microversion: 2.1 time: 0.099479 Aug 09 15:03:42.810790 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2612/5229] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:03:42 2022] POST /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553/action => generated 32598 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:03:42.930930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-31cb2ce4-5044-4fff-b11e-7236a7b7c899 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:03:42.932362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-31cb2ce4-5044-4fff-b11e-7236a7b7c899 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:42.970394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31cb2ce4-5044-4fff-b11e-7236a7b7c899 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:42.977015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31cb2ce4-5044-4fff-b11e-7236a7b7c899 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:42.978826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31cb2ce4-5044-4fff-b11e-7236a7b7c899 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:42.982206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31cb2ce4-5044-4fff-b11e-7236a7b7c899 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:42.984318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31cb2ce4-5044-4fff-b11e-7236a7b7c899 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:42.986469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31cb2ce4-5044-4fff-b11e-7236a7b7c899 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:43.105148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-31cb2ce4-5044-4fff-b11e-7236a7b7c899 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '437f80d789a54fc992b664dceff04d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670c22e06ca6437ba8571aaf6998ca77', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:43.106001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-31cb2ce4-5044-4fff-b11e-7236a7b7c899 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] flavor_id is None. Assuming migration. {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 09 15:03:43.106441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-31cb2ce4-5044-4fff-b11e-7236a7b7c899 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 15:03:43.965449 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-31cb2ce4-5044-4fff-b11e-7236a7b7c899 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553/action" status: 202 len: 0 microversion: 2.1 time: 1.039629 Aug 09 15:03:43.966830 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2618/5230] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:03:42 2022] POST /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553/action => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:03:43.977985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d911b48e-5a9c-4601-8aa3-09dcf3e02fe1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:43.978839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d911b48e-5a9c-4601-8aa3-09dcf3e02fe1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:43.996788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d911b48e-5a9c-4601-8aa3-09dcf3e02fe1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:43.998558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d911b48e-5a9c-4601-8aa3-09dcf3e02fe1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:44.000174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d911b48e-5a9c-4601-8aa3-09dcf3e02fe1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:44.001674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d911b48e-5a9c-4601-8aa3-09dcf3e02fe1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:44.006542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d911b48e-5a9c-4601-8aa3-09dcf3e02fe1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:44.007322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d911b48e-5a9c-4601-8aa3-09dcf3e02fe1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:44.228748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d911b48e-5a9c-4601-8aa3-09dcf3e02fe1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:44.240262 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d911b48e-5a9c-4601-8aa3-09dcf3e02fe1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1692 microversion: 2.1 time: 0.267496 Aug 09 15:03:44.241967 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2613/5231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:43 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1692 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:45.285625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f89c4d55-c5d2-48df-a945-5b360b30d370 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:45.286298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f89c4d55-c5d2-48df-a945-5b360b30d370 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:45.296600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f89c4d55-c5d2-48df-a945-5b360b30d370 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:45.296894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f89c4d55-c5d2-48df-a945-5b360b30d370 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:45.298490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f89c4d55-c5d2-48df-a945-5b360b30d370 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:45.300787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f89c4d55-c5d2-48df-a945-5b360b30d370 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:45.302292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f89c4d55-c5d2-48df-a945-5b360b30d370 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:45.302653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f89c4d55-c5d2-48df-a945-5b360b30d370 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:45.639218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f89c4d55-c5d2-48df-a945-5b360b30d370 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:45.649346 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f89c4d55-c5d2-48df-a945-5b360b30d370 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1692 microversion: 2.1 time: 0.371246 Aug 09 15:03:45.650188 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2619/5232] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:45 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1692 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:46.674573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fdce6c19-cdc5-4cca-8fbb-adbaaf20a60d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:46.675196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fdce6c19-cdc5-4cca-8fbb-adbaaf20a60d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:46.697385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdce6c19-cdc5-4cca-8fbb-adbaaf20a60d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:46.699048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdce6c19-cdc5-4cca-8fbb-adbaaf20a60d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:46.699919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdce6c19-cdc5-4cca-8fbb-adbaaf20a60d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:46.706188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdce6c19-cdc5-4cca-8fbb-adbaaf20a60d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:46.706685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdce6c19-cdc5-4cca-8fbb-adbaaf20a60d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:46.707194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdce6c19-cdc5-4cca-8fbb-adbaaf20a60d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:47.038130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fdce6c19-cdc5-4cca-8fbb-adbaaf20a60d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:47.048809 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fdce6c19-cdc5-4cca-8fbb-adbaaf20a60d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1692 microversion: 2.1 time: 0.378118 Aug 09 15:03:47.077418 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2614/5233] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:46 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1692 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:47.600231 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:03:47.601078 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:03:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:03:47.689407 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:03:47.689993 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:03:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:03:48.069980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f581030a-6058-4067-8a20-3767ea451034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:48.071762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f581030a-6058-4067-8a20-3767ea451034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:48.088156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f581030a-6058-4067-8a20-3767ea451034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:48.090248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f581030a-6058-4067-8a20-3767ea451034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:48.091926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f581030a-6058-4067-8a20-3767ea451034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:48.092903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f581030a-6058-4067-8a20-3767ea451034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:48.096333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f581030a-6058-4067-8a20-3767ea451034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:48.098317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f581030a-6058-4067-8a20-3767ea451034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:48.510942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f581030a-6058-4067-8a20-3767ea451034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:48.519439 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f581030a-6058-4067-8a20-3767ea451034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1692 microversion: 2.1 time: 0.453311 Aug 09 15:03:48.539421 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2620/5234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:48 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1692 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:49.550629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37aaee2a-44db-44b8-b414-ce802a553e97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:49.561646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37aaee2a-44db-44b8-b414-ce802a553e97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:49.587536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37aaee2a-44db-44b8-b414-ce802a553e97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:49.602489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37aaee2a-44db-44b8-b414-ce802a553e97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:49.602704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37aaee2a-44db-44b8-b414-ce802a553e97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:49.603703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37aaee2a-44db-44b8-b414-ce802a553e97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:49.604171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37aaee2a-44db-44b8-b414-ce802a553e97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:49.604653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37aaee2a-44db-44b8-b414-ce802a553e97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:49.901601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-37aaee2a-44db-44b8-b414-ce802a553e97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:49.921539 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37aaee2a-44db-44b8-b414-ce802a553e97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1697 microversion: 2.1 time: 0.379256 Aug 09 15:03:49.922196 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2615/5235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:49 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1697 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:50.956655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a254409d-df23-47c5-8ce3-96df183b3f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:50.958821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a254409d-df23-47c5-8ce3-96df183b3f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:50.971498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a254409d-df23-47c5-8ce3-96df183b3f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:50.972274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a254409d-df23-47c5-8ce3-96df183b3f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:50.972885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a254409d-df23-47c5-8ce3-96df183b3f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:50.974960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a254409d-df23-47c5-8ce3-96df183b3f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:50.975867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a254409d-df23-47c5-8ce3-96df183b3f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:50.976497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a254409d-df23-47c5-8ce3-96df183b3f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:51.360136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a254409d-df23-47c5-8ce3-96df183b3f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:51.376144 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a254409d-df23-47c5-8ce3-96df183b3f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1697 microversion: 2.1 time: 0.428641 Aug 09 15:03:51.387695 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2621/5236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:50 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1697 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:52.024544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-162005c3-12d4-42a4-9fce-bfe9c2d84e19 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:52.025077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-162005c3-12d4-42a4-9fce-bfe9c2d84e19 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:52.029144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=28 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:03:52.034841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-162005c3-12d4-42a4-9fce-bfe9c2d84e19 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:52.035545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-162005c3-12d4-42a4-9fce-bfe9c2d84e19 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:52.036249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-162005c3-12d4-42a4-9fce-bfe9c2d84e19 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:52.037022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-162005c3-12d4-42a4-9fce-bfe9c2d84e19 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:52.037512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-162005c3-12d4-42a4-9fce-bfe9c2d84e19 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:52.038042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-162005c3-12d4-42a4-9fce-bfe9c2d84e19 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:52.043886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:03:52.182146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-162005c3-12d4-42a4-9fce-bfe9c2d84e19 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lazy-loading 'services' on Instance uuid f9c967ab-05c2-411f-804f-789ac8257cae {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:03:52.313936 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-162005c3-12d4-42a4-9fce-bfe9c2d84e19 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae/os-volume_attachments/88604f2d-1766-4865-aabb-347202a59dc9" status: 202 len: 0 microversion: 2.1 time: 0.292749 Aug 09 15:03:52.317432 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2616/5237] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:03:52 2022] DELETE /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae/os-volume_attachments/88604f2d-1766-4865-aabb-347202a59dc9 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 15:03:52.401550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-46e44ede-104e-46ad-a4a6-3e4938896e9f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:52.402335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-46e44ede-104e-46ad-a4a6-3e4938896e9f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:52.419377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46e44ede-104e-46ad-a4a6-3e4938896e9f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:52.419377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46e44ede-104e-46ad-a4a6-3e4938896e9f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:52.419377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46e44ede-104e-46ad-a4a6-3e4938896e9f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:52.423894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46e44ede-104e-46ad-a4a6-3e4938896e9f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:52.425376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46e44ede-104e-46ad-a4a6-3e4938896e9f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:52.425831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46e44ede-104e-46ad-a4a6-3e4938896e9f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:52.716736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-46e44ede-104e-46ad-a4a6-3e4938896e9f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:52.725580 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-46e44ede-104e-46ad-a4a6-3e4938896e9f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1697 microversion: 2.1 time: 0.328971 Aug 09 15:03:52.726923 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2622/5238] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:52 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1697 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:53.750081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e209335d-5630-4d3c-8268-1efbc3ea4555 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:53.750815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e209335d-5630-4d3c-8268-1efbc3ea4555 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:53.761078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e209335d-5630-4d3c-8268-1efbc3ea4555 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:53.761574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e209335d-5630-4d3c-8268-1efbc3ea4555 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:53.771476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e209335d-5630-4d3c-8268-1efbc3ea4555 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:53.772356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e209335d-5630-4d3c-8268-1efbc3ea4555 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:53.776121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e209335d-5630-4d3c-8268-1efbc3ea4555 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:53.776689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e209335d-5630-4d3c-8268-1efbc3ea4555 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:54.071796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e209335d-5630-4d3c-8268-1efbc3ea4555 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:54.100406 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e209335d-5630-4d3c-8268-1efbc3ea4555 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1697 microversion: 2.1 time: 0.355508 Aug 09 15:03:54.111789 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2617/5239] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:53 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1697 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:55.123618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-496f0b3a-5777-437a-b585-5ef19ab9e0e7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:55.124979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-496f0b3a-5777-437a-b585-5ef19ab9e0e7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:55.143997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-496f0b3a-5777-437a-b585-5ef19ab9e0e7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:55.145086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-496f0b3a-5777-437a-b585-5ef19ab9e0e7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:55.145787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-496f0b3a-5777-437a-b585-5ef19ab9e0e7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:55.146755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-496f0b3a-5777-437a-b585-5ef19ab9e0e7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:55.147477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-496f0b3a-5777-437a-b585-5ef19ab9e0e7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:55.154490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-496f0b3a-5777-437a-b585-5ef19ab9e0e7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:55.417122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-496f0b3a-5777-437a-b585-5ef19ab9e0e7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:55.427915 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-496f0b3a-5777-437a-b585-5ef19ab9e0e7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1697 microversion: 2.1 time: 0.308354 Aug 09 15:03:55.439181 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2623/5240] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:55 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1697 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:56.453695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-83c72872-8e09-4f1e-a99b-488dc925d8b1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:56.454335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-83c72872-8e09-4f1e-a99b-488dc925d8b1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:56.468246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83c72872-8e09-4f1e-a99b-488dc925d8b1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:56.478555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83c72872-8e09-4f1e-a99b-488dc925d8b1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:56.479183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83c72872-8e09-4f1e-a99b-488dc925d8b1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:56.480016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83c72872-8e09-4f1e-a99b-488dc925d8b1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:56.480549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83c72872-8e09-4f1e-a99b-488dc925d8b1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:56.481042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-83c72872-8e09-4f1e-a99b-488dc925d8b1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:56.780604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-83c72872-8e09-4f1e-a99b-488dc925d8b1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:56.789139 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-83c72872-8e09-4f1e-a99b-488dc925d8b1 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1697 microversion: 2.1 time: 0.339255 Aug 09 15:03:56.803780 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2618/5241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:56 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1697 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:57.813783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afe9b761-3d4e-4df6-8d6e-b041dd0d1ee6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:57.814578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-afe9b761-3d4e-4df6-8d6e-b041dd0d1ee6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:57.834428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afe9b761-3d4e-4df6-8d6e-b041dd0d1ee6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:57.836979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afe9b761-3d4e-4df6-8d6e-b041dd0d1ee6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:57.837561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afe9b761-3d4e-4df6-8d6e-b041dd0d1ee6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:57.838413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afe9b761-3d4e-4df6-8d6e-b041dd0d1ee6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:57.841288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afe9b761-3d4e-4df6-8d6e-b041dd0d1ee6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:57.841847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afe9b761-3d4e-4df6-8d6e-b041dd0d1ee6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:58.141466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-afe9b761-3d4e-4df6-8d6e-b041dd0d1ee6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:58.156105 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afe9b761-3d4e-4df6-8d6e-b041dd0d1ee6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1697 microversion: 2.1 time: 0.346732 Aug 09 15:03:58.156852 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2624/5242] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:57 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1697 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:59.043476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0c4b7e8-5898-4789-b78c-0581716ff921 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:59.044260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0c4b7e8-5898-4789-b78c-0581716ff921 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:59.052621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c4b7e8-5898-4789-b78c-0581716ff921 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:59.053339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c4b7e8-5898-4789-b78c-0581716ff921 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:59.053972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c4b7e8-5898-4789-b78c-0581716ff921 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:59.055225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c4b7e8-5898-4789-b78c-0581716ff921 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:59.055758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c4b7e8-5898-4789-b78c-0581716ff921 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:59.056174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0c4b7e8-5898-4789-b78c-0581716ff921 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:59.194235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-37a21ea5-1d85-4f74-bb08-4abd79d855f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:59.198462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37a21ea5-1d85-4f74-bb08-4abd79d855f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:59.216114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37a21ea5-1d85-4f74-bb08-4abd79d855f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:59.217125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37a21ea5-1d85-4f74-bb08-4abd79d855f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:59.218111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37a21ea5-1d85-4f74-bb08-4abd79d855f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:59.219482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37a21ea5-1d85-4f74-bb08-4abd79d855f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:59.220566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37a21ea5-1d85-4f74-bb08-4abd79d855f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:59.222661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-37a21ea5-1d85-4f74-bb08-4abd79d855f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:59.241130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0c4b7e8-5898-4789-b78c-0581716ff921 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:59.257736 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0c4b7e8-5898-4789-b78c-0581716ff921 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.233147 Aug 09 15:03:59.260456 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2619/5243] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:59 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:59.261788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-37a21ea5-1d85-4f74-bb08-4abd79d855f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:03:59.268821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5722563f-ae5b-4634-becb-62e7f516b015 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:59.270385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5722563f-ae5b-4634-becb-62e7f516b015 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:59.288486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5722563f-ae5b-4634-becb-62e7f516b015 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:59.289753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5722563f-ae5b-4634-becb-62e7f516b015 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:59.291017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5722563f-ae5b-4634-becb-62e7f516b015 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:59.292789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5722563f-ae5b-4634-becb-62e7f516b015 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:59.294065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5722563f-ae5b-4634-becb-62e7f516b015 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:59.294979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5722563f-ae5b-4634-becb-62e7f516b015 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:59.403286 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-37a21ea5-1d85-4f74-bb08-4abd79d855f3 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 204 len: 0 microversion: 2.1 time: 0.221782 Aug 09 15:03:59.407603 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2625/5244] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:03:59 2022] DELETE /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:03:59.426369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0524f1b-5cbd-4fd3-b4a9-b9540296ebb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:59.439477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0524f1b-5cbd-4fd3-b4a9-b9540296ebb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:59.455079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0524f1b-5cbd-4fd3-b4a9-b9540296ebb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:59.455079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0524f1b-5cbd-4fd3-b4a9-b9540296ebb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:59.455079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0524f1b-5cbd-4fd3-b4a9-b9540296ebb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:59.455079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0524f1b-5cbd-4fd3-b4a9-b9540296ebb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:59.455079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0524f1b-5cbd-4fd3-b4a9-b9540296ebb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:59.455079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0524f1b-5cbd-4fd3-b4a9-b9540296ebb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:59.672906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5722563f-ae5b-4634-becb-62e7f516b015 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:59.683826 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5722563f-ae5b-4634-becb-62e7f516b015 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1697 microversion: 2.1 time: 0.419623 Aug 09 15:03:59.686743 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2620/5245] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:59 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1697 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:59.697961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ff6e51a6-894f-42e9-a646-16b48b603f1f tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:59.698864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ff6e51a6-894f-42e9-a646-16b48b603f1f tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:59.705597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff6e51a6-894f-42e9-a646-16b48b603f1f tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:59.706310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff6e51a6-894f-42e9-a646-16b48b603f1f tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:59.707019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff6e51a6-894f-42e9-a646-16b48b603f1f tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:59.708146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff6e51a6-894f-42e9-a646-16b48b603f1f tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:59.709604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff6e51a6-894f-42e9-a646-16b48b603f1f tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:59.710209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ff6e51a6-894f-42e9-a646-16b48b603f1f tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:59.744475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0524f1b-5cbd-4fd3-b4a9-b9540296ebb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:59.753327 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0524f1b-5cbd-4fd3-b4a9-b9540296ebb8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.343843 Aug 09 15:03:59.757051 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2626/5246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:59 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:03:59.778096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ca05147-386f-4404-bd4b-b133c04e8c96 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:03:59.778721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ca05147-386f-4404-bd4b-b133c04e8c96 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:03:59.786014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ca05147-386f-4404-bd4b-b133c04e8c96 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:59.786496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ca05147-386f-4404-bd4b-b133c04e8c96 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:59.787339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ca05147-386f-4404-bd4b-b133c04e8c96 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:59.788329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ca05147-386f-4404-bd4b-b133c04e8c96 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:03:59.788933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ca05147-386f-4404-bd4b-b133c04e8c96 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:03:59.789712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ca05147-386f-4404-bd4b-b133c04e8c96 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:03:59.957789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ff6e51a6-894f-42e9-a646-16b48b603f1f tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:03:59.970281 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ff6e51a6-894f-42e9-a646-16b48b603f1f tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1468 microversion: 2.1 time: 0.282213 Aug 09 15:03:59.974619 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2621/5247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:59 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1468 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:00.030755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ca05147-386f-4404-bd4b-b133c04e8c96 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:00.038944 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ca05147-386f-4404-bd4b-b133c04e8c96 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.265519 Aug 09 15:04:00.039857 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2627/5248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:03:59 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:00.060781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-25102140-d63b-40a4-abd5-e4c26194eb84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:00.060781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-25102140-d63b-40a4-abd5-e4c26194eb84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:00.067945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25102140-d63b-40a4-abd5-e4c26194eb84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:00.068439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25102140-d63b-40a4-abd5-e4c26194eb84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:00.068935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25102140-d63b-40a4-abd5-e4c26194eb84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:00.069649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25102140-d63b-40a4-abd5-e4c26194eb84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:00.070342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25102140-d63b-40a4-abd5-e4c26194eb84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:00.070630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-25102140-d63b-40a4-abd5-e4c26194eb84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:00.292709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-25102140-d63b-40a4-abd5-e4c26194eb84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:00.307388 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-25102140-d63b-40a4-abd5-e4c26194eb84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.251248 Aug 09 15:04:00.312776 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2622/5249] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:00 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:00.468948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2106405569", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "aac61d64-db55-4d08-906a-2788d0f45a74"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:00.566471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] validate_networks() for [('aac61d64-db55-4d08-906a-2788d0f45a74', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:04:00.711415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b497248d-2ab8-4259-98f3-a0e68fd03c52 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:00.712373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b497248d-2ab8-4259-98f3-a0e68fd03c52 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:00.722677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b497248d-2ab8-4259-98f3-a0e68fd03c52 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:00.723327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b497248d-2ab8-4259-98f3-a0e68fd03c52 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:00.723777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b497248d-2ab8-4259-98f3-a0e68fd03c52 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:00.724514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b497248d-2ab8-4259-98f3-a0e68fd03c52 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:00.724981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b497248d-2ab8-4259-98f3-a0e68fd03c52 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:00.731230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b497248d-2ab8-4259-98f3-a0e68fd03c52 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:00.998883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b497248d-2ab8-4259-98f3-a0e68fd03c52 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:01.010464 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b497248d-2ab8-4259-98f3-a0e68fd03c52 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1697 microversion: 2.1 time: 0.304205 Aug 09 15:04:01.012843 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2623/5250] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:00 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1697 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:01.021098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a8ed92c-5304-41b6-b114-85eae7b4f28b tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:01.021720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a8ed92c-5304-41b6-b114-85eae7b4f28b tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:01.063575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a8ed92c-5304-41b6-b114-85eae7b4f28b tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:01.064513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a8ed92c-5304-41b6-b114-85eae7b4f28b tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:01.064513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a8ed92c-5304-41b6-b114-85eae7b4f28b tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:01.065204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a8ed92c-5304-41b6-b114-85eae7b4f28b tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:01.065650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a8ed92c-5304-41b6-b114-85eae7b4f28b tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:01.066067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a8ed92c-5304-41b6-b114-85eae7b4f28b tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:01.190804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:04:01.191326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:04:01.191858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:04:01.192269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:04:01.192681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:04:01.202722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:01.203602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:01.204263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:01.205229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:01.206028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:01.206706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:01.228205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Getting quotas for project 891029e759ac441f8a08c38bca92be81. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:04:01.234380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Getting quotas for user 3da785ddf56e4b028c6647643d97c952 and project 891029e759ac441f8a08c38bca92be81. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:04:01.256177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:04:01.260243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:04:01.335906 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e91c16cd-177c-4998-b5b9-dbc0e423c60f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870888 Aug 09 15:04:01.337009 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2628/5251] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:04:01.349421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2b09e751-9da0-4b61-b19c-95ef06e1d57c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:01.350321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2b09e751-9da0-4b61-b19c-95ef06e1d57c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:01.356932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4a8ed92c-5304-41b6-b114-85eae7b4f28b tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:01.366369 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a8ed92c-5304-41b6-b114-85eae7b4f28b tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1468 microversion: 2.1 time: 0.352413 Aug 09 15:04:01.367324 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2624/5252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:01 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1468 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:01.422514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b09e751-9da0-4b61-b19c-95ef06e1d57c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:01.431581 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2b09e751-9da0-4b61-b19c-95ef06e1d57c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1215 microversion: 2.1 time: 0.086420 Aug 09 15:04:01.435175 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2629/5253] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:01 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:02.042709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-86466ac7-9e54-4977-a7b2-efbc6e5d2037 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:02.043439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-86466ac7-9e54-4977-a7b2-efbc6e5d2037 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:02.058275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86466ac7-9e54-4977-a7b2-efbc6e5d2037 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:02.065335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86466ac7-9e54-4977-a7b2-efbc6e5d2037 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:02.066004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86466ac7-9e54-4977-a7b2-efbc6e5d2037 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:02.066596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86466ac7-9e54-4977-a7b2-efbc6e5d2037 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:02.067119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86466ac7-9e54-4977-a7b2-efbc6e5d2037 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:02.067532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86466ac7-9e54-4977-a7b2-efbc6e5d2037 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:02.391214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7bd2715-3c42-410e-b304-8cd335fdd1d6 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:02.391829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e7bd2715-3c42-410e-b304-8cd335fdd1d6 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:02.410798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bd2715-3c42-410e-b304-8cd335fdd1d6 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:02.411592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bd2715-3c42-410e-b304-8cd335fdd1d6 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:02.412220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bd2715-3c42-410e-b304-8cd335fdd1d6 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:02.413134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bd2715-3c42-410e-b304-8cd335fdd1d6 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:02.413949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bd2715-3c42-410e-b304-8cd335fdd1d6 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:02.414546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bd2715-3c42-410e-b304-8cd335fdd1d6 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:02.446665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-86466ac7-9e54-4977-a7b2-efbc6e5d2037 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:02.463422 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-86466ac7-9e54-4977-a7b2-efbc6e5d2037 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1697 microversion: 2.1 time: 0.426515 Aug 09 15:04:02.465165 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2625/5254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:02 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1697 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:02.473309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-662ed659-2bbf-48af-abb3-7906016aa511 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:02.477618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-662ed659-2bbf-48af-abb3-7906016aa511 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:02.492186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-662ed659-2bbf-48af-abb3-7906016aa511 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:02.495732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-662ed659-2bbf-48af-abb3-7906016aa511 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:02.496728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-662ed659-2bbf-48af-abb3-7906016aa511 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:02.497694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-662ed659-2bbf-48af-abb3-7906016aa511 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:02.500272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-662ed659-2bbf-48af-abb3-7906016aa511 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:02.502748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-662ed659-2bbf-48af-abb3-7906016aa511 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:02.758488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-662ed659-2bbf-48af-abb3-7906016aa511 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:02.771301 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-662ed659-2bbf-48af-abb3-7906016aa511 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1267 microversion: 2.1 time: 0.304104 Aug 09 15:04:02.775803 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2626/5255] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:02 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1267 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:02.802647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e7bd2715-3c42-410e-b304-8cd335fdd1d6 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:02.819575 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e7bd2715-3c42-410e-b304-8cd335fdd1d6 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1468 microversion: 2.1 time: 0.432483 Aug 09 15:04:02.821036 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2630/5256] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:02 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1468 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:04:03.487329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9354c4f2-211a-4853-a43f-ed37a887379a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:03.488037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9354c4f2-211a-4853-a43f-ed37a887379a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:03.496911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9354c4f2-211a-4853-a43f-ed37a887379a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:03.498247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9354c4f2-211a-4853-a43f-ed37a887379a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:03.499423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9354c4f2-211a-4853-a43f-ed37a887379a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:03.501365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9354c4f2-211a-4853-a43f-ed37a887379a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:03.502541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9354c4f2-211a-4853-a43f-ed37a887379a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:03.503704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9354c4f2-211a-4853-a43f-ed37a887379a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:03.691337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9354c4f2-211a-4853-a43f-ed37a887379a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:03.702026 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9354c4f2-211a-4853-a43f-ed37a887379a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1696 microversion: 2.1 time: 0.218742 Aug 09 15:04:03.703820 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2627/5257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:03 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1696 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:03.796282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-90b7d5e8-fbf8-45a6-8ffc-d34d646aea6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:03.797672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-90b7d5e8-fbf8-45a6-8ffc-d34d646aea6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:03.807624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90b7d5e8-fbf8-45a6-8ffc-d34d646aea6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:03.808952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90b7d5e8-fbf8-45a6-8ffc-d34d646aea6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:03.809497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90b7d5e8-fbf8-45a6-8ffc-d34d646aea6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:03.810739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90b7d5e8-fbf8-45a6-8ffc-d34d646aea6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:03.811573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90b7d5e8-fbf8-45a6-8ffc-d34d646aea6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:03.812219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90b7d5e8-fbf8-45a6-8ffc-d34d646aea6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:03.851114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12ebe04e-f804-45c9-bb1e-4c9c550b6a82 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:03.854754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-12ebe04e-f804-45c9-bb1e-4c9c550b6a82 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:03.863677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12ebe04e-f804-45c9-bb1e-4c9c550b6a82 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:03.864844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12ebe04e-f804-45c9-bb1e-4c9c550b6a82 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:03.865519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12ebe04e-f804-45c9-bb1e-4c9c550b6a82 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:03.866683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12ebe04e-f804-45c9-bb1e-4c9c550b6a82 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:03.867446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12ebe04e-f804-45c9-bb1e-4c9c550b6a82 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:03.868114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12ebe04e-f804-45c9-bb1e-4c9c550b6a82 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:03.958134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-90b7d5e8-fbf8-45a6-8ffc-d34d646aea6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:03.962030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:03.974216 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-90b7d5e8-fbf8-45a6-8ffc-d34d646aea6b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1273 microversion: 2.1 time: 0.181836 Aug 09 15:04:03.974824 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2631/5258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:03 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:04.141781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-12ebe04e-f804-45c9-bb1e-4c9c550b6a82 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:04.149836 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-12ebe04e-f804-45c9-bb1e-4c9c550b6a82 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1468 microversion: 2.1 time: 0.308020 Aug 09 15:04:04.150441 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2628/5259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:03 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1468 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:04:04.326488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f00e8345-97d2-4936-b8a3-0ce0e179b49c req-c0e1d43e-f8c7-4a87-94d5-284242ff0ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582fe71a-5bc9-4b44-b82d-a8d8e403f553", "name": "network-vif-unplugged", "status": "completed", "tag": "58108270-1f4d-4960-8a75-59ca080644bc"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:04.345868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f00e8345-97d2-4936-b8a3-0ce0e179b49c req-c0e1d43e-f8c7-4a87-94d5-284242ff0ca9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:04.346834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f00e8345-97d2-4936-b8a3-0ce0e179b49c req-c0e1d43e-f8c7-4a87-94d5-284242ff0ca9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:04.347503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f00e8345-97d2-4936-b8a3-0ce0e179b49c req-c0e1d43e-f8c7-4a87-94d5-284242ff0ca9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:04.365795 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f00e8345-97d2-4936-b8a3-0ce0e179b49c req-c0e1d43e-f8c7-4a87-94d5-284242ff0ca9 service nova] Creating event network-vif-unplugged:58108270-1f4d-4960-8a75-59ca080644bc for instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 on n-h1-844626-8 Aug 09 15:04:04.375284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-f00e8345-97d2-4936-b8a3-0ce0e179b49c req-c0e1d43e-f8c7-4a87-94d5-284242ff0ca9 service nova] Instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:04:04.398011 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f00e8345-97d2-4936-b8a3-0ce0e179b49c req-c0e1d43e-f8c7-4a87-94d5-284242ff0ca9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079234 Aug 09 15:04:04.399929 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2632/5260] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:04:04.728294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bd75c08d-634f-4d54-8492-bb1583e138dd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:04.729612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bd75c08d-634f-4d54-8492-bb1583e138dd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:04.743277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd75c08d-634f-4d54-8492-bb1583e138dd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:04.743797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd75c08d-634f-4d54-8492-bb1583e138dd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:04.744219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd75c08d-634f-4d54-8492-bb1583e138dd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:04.744992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd75c08d-634f-4d54-8492-bb1583e138dd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:04.745397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd75c08d-634f-4d54-8492-bb1583e138dd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:04.745822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd75c08d-634f-4d54-8492-bb1583e138dd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:05.008516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89e4f55e-4f20-48d2-bb6d-7caa08ee4c47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:05.010237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-89e4f55e-4f20-48d2-bb6d-7caa08ee4c47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:05.015109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bd75c08d-634f-4d54-8492-bb1583e138dd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:05.025190 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bd75c08d-634f-4d54-8492-bb1583e138dd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1696 microversion: 2.1 time: 0.300597 Aug 09 15:04:05.026627 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2629/5261] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:04 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1696 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:05.071523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89e4f55e-4f20-48d2-bb6d-7caa08ee4c47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:05.074962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89e4f55e-4f20-48d2-bb6d-7caa08ee4c47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:05.078665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89e4f55e-4f20-48d2-bb6d-7caa08ee4c47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:05.085490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89e4f55e-4f20-48d2-bb6d-7caa08ee4c47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:05.088079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89e4f55e-4f20-48d2-bb6d-7caa08ee4c47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:05.089498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89e4f55e-4f20-48d2-bb6d-7caa08ee4c47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:05.172432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:05.173322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:05.187939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:05.197052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:05.198696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:05.216524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:05.217321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:05.220462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:05.271193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:05.272039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:05.272706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:05.273432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lazy-loading 'fault' on Instance uuid f9c967ab-05c2-411f-804f-789ac8257cae {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:04:05.425044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-89e4f55e-4f20-48d2-bb6d-7caa08ee4c47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:05.436573 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-89e4f55e-4f20-48d2-bb6d-7caa08ee4c47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1273 microversion: 2.1 time: 0.439464 Aug 09 15:04:05.438136 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2633/5262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:04 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1273 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:05.449515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb5802fdcb18482181a5b795949f94d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6d7bdb660c344ebb848f9fb035f5e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:05.461411 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8bca8c9-ed9b-41b9-9946-6ae76813b479 tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 200 len: 1303 microversion: 2.1 time: 0.293135 Aug 09 15:04:05.463916 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2630/5263] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:05 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 1303 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:04:06.050613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60787449-608b-48d8-bcf4-ce9b5f29fb3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:06.051877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-60787449-608b-48d8-bcf4-ce9b5f29fb3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:06.066015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60787449-608b-48d8-bcf4-ce9b5f29fb3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:06.067065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60787449-608b-48d8-bcf4-ce9b5f29fb3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:06.083514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60787449-608b-48d8-bcf4-ce9b5f29fb3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:06.084730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60787449-608b-48d8-bcf4-ce9b5f29fb3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:06.085401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60787449-608b-48d8-bcf4-ce9b5f29fb3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:06.086042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60787449-608b-48d8-bcf4-ce9b5f29fb3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:06.438396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-61d22195-754b-4145-8762-e0643b002e86 req-d78353f3-b430-4089-9d70-29eb482057d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c967ab-05c2-411f-804f-789ac8257cae", "name": "network-vif-deleted", "tag": "8e81559c-7f6b-49d5-bd09-2cca4d9636ca"}, {"name": "network-changed", "server_uuid": "582fe71a-5bc9-4b44-b82d-a8d8e403f553", "tag": "58108270-1f4d-4960-8a75-59ca080644bc"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:06.461370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-61d22195-754b-4145-8762-e0643b002e86 req-d78353f3-b430-4089-9d70-29eb482057d3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:06.467210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-61d22195-754b-4145-8762-e0643b002e86 req-d78353f3-b430-4089-9d70-29eb482057d3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:06.467664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-61d22195-754b-4145-8762-e0643b002e86 req-d78353f3-b430-4089-9d70-29eb482057d3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:06.508319 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-61d22195-754b-4145-8762-e0643b002e86 req-d78353f3-b430-4089-9d70-29eb482057d3 service nova] Creating event network-vif-deleted:8e81559c-7f6b-49d5-bd09-2cca4d9636ca for instance f9c967ab-05c2-411f-804f-789ac8257cae on n-h2-844626-8 Aug 09 15:04:06.509194 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-61d22195-754b-4145-8762-e0643b002e86 req-d78353f3-b430-4089-9d70-29eb482057d3 service nova] Creating event network-changed:58108270-1f4d-4960-8a75-59ca080644bc for instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 on n-h1-844626-8 Aug 09 15:04:06.516438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-61d22195-754b-4145-8762-e0643b002e86 req-d78353f3-b430-4089-9d70-29eb482057d3 service nova] Instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:04:06.552924 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-61d22195-754b-4145-8762-e0643b002e86 req-d78353f3-b430-4089-9d70-29eb482057d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.118991 Aug 09 15:04:06.553868 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2631/5264] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:04:06.564487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-214f19d5-4aac-41df-b8a9-726dd1429c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:06.565610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-214f19d5-4aac-41df-b8a9-726dd1429c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:06.583244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-214f19d5-4aac-41df-b8a9-726dd1429c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:06.583751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-214f19d5-4aac-41df-b8a9-726dd1429c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:06.584522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-214f19d5-4aac-41df-b8a9-726dd1429c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:06.584922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-214f19d5-4aac-41df-b8a9-726dd1429c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:06.585372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-214f19d5-4aac-41df-b8a9-726dd1429c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:06.592668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-214f19d5-4aac-41df-b8a9-726dd1429c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:06.598835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:06.900693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-214f19d5-4aac-41df-b8a9-726dd1429c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:06.916107 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-214f19d5-4aac-41df-b8a9-726dd1429c2b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1315 microversion: 2.1 time: 0.360965 Aug 09 15:04:06.917105 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2632/5265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:06 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:06.922102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08948d29-7d0d-423a-a6e8-3dded5b496ba tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:06.930847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-08948d29-7d0d-423a-a6e8-3dded5b496ba tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] [instance: f9c967ab-05c2-411f-804f-789ac8257cae] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:06.938219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08948d29-7d0d-423a-a6e8-3dded5b496ba tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:06.939903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08948d29-7d0d-423a-a6e8-3dded5b496ba tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:06.940938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08948d29-7d0d-423a-a6e8-3dded5b496ba tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:06.948154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08948d29-7d0d-423a-a6e8-3dded5b496ba tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:06.948889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08948d29-7d0d-423a-a6e8-3dded5b496ba tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:06.949545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08948d29-7d0d-423a-a6e8-3dded5b496ba tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:06.959464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60787449-608b-48d8-bcf4-ce9b5f29fb3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:06.969490 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60787449-608b-48d8-bcf4-ce9b5f29fb3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1696 microversion: 2.1 time: 0.922937 Aug 09 15:04:06.972549 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-08948d29-7d0d-423a-a6e8-3dded5b496ba tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] HTTP exception thrown: Instance f9c967ab-05c2-411f-804f-789ac8257cae could not be found. Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08948d29-7d0d-423a-a6e8-3dded5b496ba tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Request method failure captured: Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae HTTP/1.1 Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nbhbeRBCHG1uDrbmkGjFDsJVWgNdG_hfYozUFe1-MY7tFef4dkwXT6EgU0nuu-fgKi3TjMYxZRtpOyjHPv_0T5uPFW_g4iWhrWonc0sL09Viz4VWpX3iPr4xBHHw25iJ6SHjn6oYpa8GDdYLH3IuANBpaIoJsGBCC75auBTkgnOpbM Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: b6d7bdb660c344ebb848f9fb035f5e1b Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-VolumesBackupsTest-258945317 Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_b6d7bdb660c344ebb848f9fb035f5e1b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/b6d7bdb660c344ebb848f9fb035f5e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b6d7bdb660c344ebb848f9fb035f5e1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/b6d7bdb660c344ebb848f9fb035f5e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-VolumesBackupsTest-258945317 Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: b6d7bdb660c344ebb848f9fb035f5e1b Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-VolumesBackupsTest-258945317 Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-VolumesBackupsTest-258945317-project Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cb5802fdcb18482181a5b795949f94d2 Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-VolumesBackupsTest-258945317-project Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance f9c967ab-05c2-411f-804f-789ac8257cae could not be found. Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'f9c967ab-05c2-411f-804f-789ac8257cae'} Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c967ab-05c2-411f-804f-789ac8257cae could not be found. Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c967ab-05c2-411f-804f-789ac8257cae could not be found. Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:04:06.976911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:04:06.982377 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:04:06.982377 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:04:06.982377 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:04:06.982377 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:04:06.982377 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:04:06.982377 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c967ab-05c2-411f-804f-789ac8257cae could not be found. Aug 09 15:04:06.982377 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:04:06.984868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08948d29-7d0d-423a-a6e8-3dded5b496ba tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] Returning 404 to user: Instance f9c967ab-05c2-411f-804f-789ac8257cae could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:04:06.987873 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2634/5266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:06 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1696 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:04:06.992290 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-08948d29-7d0d-423a-a6e8-3dded5b496ba tempest-VolumesBackupsTest-258945317 tempest-VolumesBackupsTest-258945317-project] 10.222.0.50 "GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae" status: 404 len: 111 microversion: 2.1 time: 0.073735 Aug 09 15:04:06.993047 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2633/5267] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:06 2022] GET /compute/v2.1/servers/f9c967ab-05c2-411f-804f-789ac8257cae => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:04:07.937749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f46ca3e9-0e76-4ac0-a968-58d090c91d83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:07.939933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f46ca3e9-0e76-4ac0-a968-58d090c91d83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:07.961077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f46ca3e9-0e76-4ac0-a968-58d090c91d83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:07.962157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f46ca3e9-0e76-4ac0-a968-58d090c91d83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:07.962791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f46ca3e9-0e76-4ac0-a968-58d090c91d83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:07.963784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f46ca3e9-0e76-4ac0-a968-58d090c91d83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:07.964481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f46ca3e9-0e76-4ac0-a968-58d090c91d83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:07.965123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f46ca3e9-0e76-4ac0-a968-58d090c91d83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:08.004060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7fa5be7d-21fd-47e1-9540-b7ab80cd0a90 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:08.007820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7fa5be7d-21fd-47e1-9540-b7ab80cd0a90 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:08.039431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fa5be7d-21fd-47e1-9540-b7ab80cd0a90 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:08.045453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fa5be7d-21fd-47e1-9540-b7ab80cd0a90 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:08.050478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fa5be7d-21fd-47e1-9540-b7ab80cd0a90 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:08.052416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fa5be7d-21fd-47e1-9540-b7ab80cd0a90 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:08.055772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fa5be7d-21fd-47e1-9540-b7ab80cd0a90 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:08.059979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fa5be7d-21fd-47e1-9540-b7ab80cd0a90 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:08.420034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7fa5be7d-21fd-47e1-9540-b7ab80cd0a90 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:08.433410 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7fa5be7d-21fd-47e1-9540-b7ab80cd0a90 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1694 microversion: 2.1 time: 0.440032 Aug 09 15:04:08.434901 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2634/5268] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:07 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1694 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:08.631242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f46ca3e9-0e76-4ac0-a968-58d090c91d83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:08.647179 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f46ca3e9-0e76-4ac0-a968-58d090c91d83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1315 microversion: 2.1 time: 0.707856 Aug 09 15:04:08.668268 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2635/5269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:07 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1315 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:08.793867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-543f7231-aa5a-48e4-a5e5-2cbffe1b66f8 req-97d67d6c-2b2d-4de0-95b0-8bb7e5c65801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "792ae721-3b19-4713-bcf0-79ee402eff02", "tag": "d9c9cd0d-ffdf-4c44-a5be-c482bea7adfa"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:08.818713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-543f7231-aa5a-48e4-a5e5-2cbffe1b66f8 req-97d67d6c-2b2d-4de0-95b0-8bb7e5c65801 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:08.819567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-543f7231-aa5a-48e4-a5e5-2cbffe1b66f8 req-97d67d6c-2b2d-4de0-95b0-8bb7e5c65801 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:08.820230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-543f7231-aa5a-48e4-a5e5-2cbffe1b66f8 req-97d67d6c-2b2d-4de0-95b0-8bb7e5c65801 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:08.841142 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-543f7231-aa5a-48e4-a5e5-2cbffe1b66f8 req-97d67d6c-2b2d-4de0-95b0-8bb7e5c65801 service nova] Creating event network-changed:d9c9cd0d-ffdf-4c44-a5be-c482bea7adfa for instance 792ae721-3b19-4713-bcf0-79ee402eff02 on n-h1-844626-8 Aug 09 15:04:08.869356 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-543f7231-aa5a-48e4-a5e5-2cbffe1b66f8 req-97d67d6c-2b2d-4de0-95b0-8bb7e5c65801 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079031 Aug 09 15:04:08.871806 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2635/5270] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:04:09.470091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c33dd0b2-a130-4315-a57a-0542e9b59c6e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:09.470687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c33dd0b2-a130-4315-a57a-0542e9b59c6e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:09.482035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c33dd0b2-a130-4315-a57a-0542e9b59c6e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:09.486779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c33dd0b2-a130-4315-a57a-0542e9b59c6e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:09.487899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c33dd0b2-a130-4315-a57a-0542e9b59c6e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:09.489380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c33dd0b2-a130-4315-a57a-0542e9b59c6e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:09.490035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c33dd0b2-a130-4315-a57a-0542e9b59c6e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:09.495162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c33dd0b2-a130-4315-a57a-0542e9b59c6e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:09.670788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8e63513-510a-4cd6-909c-997cce5829fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:09.672880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8e63513-510a-4cd6-909c-997cce5829fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:09.687022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8e63513-510a-4cd6-909c-997cce5829fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:09.687801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8e63513-510a-4cd6-909c-997cce5829fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:09.688481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8e63513-510a-4cd6-909c-997cce5829fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:09.695825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8e63513-510a-4cd6-909c-997cce5829fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:09.696624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8e63513-510a-4cd6-909c-997cce5829fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:09.698378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8e63513-510a-4cd6-909c-997cce5829fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:09.752175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c33dd0b2-a130-4315-a57a-0542e9b59c6e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:09.783406 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c33dd0b2-a130-4315-a57a-0542e9b59c6e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1691 microversion: 2.1 time: 0.316348 Aug 09 15:04:09.792595 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2636/5271] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:09 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1691 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:09.806388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-57d2e82b-04c8-4cce-ad2d-430ed4c76a3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:09.816624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-57d2e82b-04c8-4cce-ad2d-430ed4c76a3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:09.870362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57d2e82b-04c8-4cce-ad2d-430ed4c76a3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:09.874704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57d2e82b-04c8-4cce-ad2d-430ed4c76a3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:09.877534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57d2e82b-04c8-4cce-ad2d-430ed4c76a3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:09.880601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57d2e82b-04c8-4cce-ad2d-430ed4c76a3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:09.884437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57d2e82b-04c8-4cce-ad2d-430ed4c76a3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:09.890335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57d2e82b-04c8-4cce-ad2d-430ed4c76a3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:10.155706 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-57d2e82b-04c8-4cce-ad2d-430ed4c76a3f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553/action" status: 204 len: 0 microversion: 2.1 time: 0.352154 Aug 09 15:04:10.162697 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2637/5272] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:04:09 2022] POST /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553/action => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:04:10.196505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a7b9c020-8fb7-424b-9d4a-7b87f7587e89 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:10.197229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a7b9c020-8fb7-424b-9d4a-7b87f7587e89 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:10.205471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7b9c020-8fb7-424b-9d4a-7b87f7587e89 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:10.206221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7b9c020-8fb7-424b-9d4a-7b87f7587e89 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:10.206667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7b9c020-8fb7-424b-9d4a-7b87f7587e89 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:10.207780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7b9c020-8fb7-424b-9d4a-7b87f7587e89 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:10.208969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7b9c020-8fb7-424b-9d4a-7b87f7587e89 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:10.209481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7b9c020-8fb7-424b-9d4a-7b87f7587e89 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:10.346422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8e63513-510a-4cd6-909c-997cce5829fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:10.368101 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e8e63513-510a-4cd6-909c-997cce5829fe tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1315 microversion: 2.1 time: 0.700990 Aug 09 15:04:10.374043 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2636/5273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:09 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1315 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:04:10.681823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a7b9c020-8fb7-424b-9d4a-7b87f7587e89 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:10.692770 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a7b9c020-8fb7-424b-9d4a-7b87f7587e89 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1691 microversion: 2.1 time: 0.524632 Aug 09 15:04:10.707616 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2638/5274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:10 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1691 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:11.394948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b268223-e792-4aef-a818-cf36e2e64876 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:11.395612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b268223-e792-4aef-a818-cf36e2e64876 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:11.414839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b268223-e792-4aef-a818-cf36e2e64876 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:11.415901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b268223-e792-4aef-a818-cf36e2e64876 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:11.416537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b268223-e792-4aef-a818-cf36e2e64876 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:11.418762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b268223-e792-4aef-a818-cf36e2e64876 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:11.420498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b268223-e792-4aef-a818-cf36e2e64876 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:11.421497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b268223-e792-4aef-a818-cf36e2e64876 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:11.717289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aceba88d-a2d8-4b69-9ea5-2ec57d7fd941 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:11.717885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aceba88d-a2d8-4b69-9ea5-2ec57d7fd941 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:11.721779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:11.723280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:11.745043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aceba88d-a2d8-4b69-9ea5-2ec57d7fd941 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:11.745935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aceba88d-a2d8-4b69-9ea5-2ec57d7fd941 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:11.746610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aceba88d-a2d8-4b69-9ea5-2ec57d7fd941 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:11.747617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b268223-e792-4aef-a818-cf36e2e64876 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:11.748765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aceba88d-a2d8-4b69-9ea5-2ec57d7fd941 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:11.749486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aceba88d-a2d8-4b69-9ea5-2ec57d7fd941 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:11.750116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aceba88d-a2d8-4b69-9ea5-2ec57d7fd941 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:11.757680 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b268223-e792-4aef-a818-cf36e2e64876 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1315 microversion: 2.1 time: 0.367620 Aug 09 15:04:11.758301 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2637/5275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:11 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:04:12.060926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aceba88d-a2d8-4b69-9ea5-2ec57d7fd941 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:12.070296 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aceba88d-a2d8-4b69-9ea5-2ec57d7fd941 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1691 microversion: 2.1 time: 0.357159 Aug 09 15:04:12.073585 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2639/5276] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:11 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1691 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:12.785819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6577a985-ef54-4328-b82c-7872c27ce190 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:12.786509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6577a985-ef54-4328-b82c-7872c27ce190 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:12.805758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6577a985-ef54-4328-b82c-7872c27ce190 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:12.806264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6577a985-ef54-4328-b82c-7872c27ce190 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:12.806709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6577a985-ef54-4328-b82c-7872c27ce190 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:12.813485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6577a985-ef54-4328-b82c-7872c27ce190 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:12.815829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6577a985-ef54-4328-b82c-7872c27ce190 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:12.816589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6577a985-ef54-4328-b82c-7872c27ce190 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:12.889958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-eccf7b80-571e-4a78-a33f-64d375c31883 req-d2553392-73d6-44a7-92da-ce82f240f54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582fe71a-5bc9-4b44-b82d-a8d8e403f553", "name": "network-vif-plugged", "status": "completed", "tag": "58108270-1f4d-4960-8a75-59ca080644bc"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:12.892344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:12.916904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eccf7b80-571e-4a78-a33f-64d375c31883 req-d2553392-73d6-44a7-92da-ce82f240f54b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:12.917872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eccf7b80-571e-4a78-a33f-64d375c31883 req-d2553392-73d6-44a7-92da-ce82f240f54b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:12.919918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eccf7b80-571e-4a78-a33f-64d375c31883 req-d2553392-73d6-44a7-92da-ce82f240f54b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:12.949884 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-eccf7b80-571e-4a78-a33f-64d375c31883 req-d2553392-73d6-44a7-92da-ce82f240f54b service nova] Creating event network-vif-plugged:58108270-1f4d-4960-8a75-59ca080644bc for instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 on n-h1-844626-8 Aug 09 15:04:12.968272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-eccf7b80-571e-4a78-a33f-64d375c31883 req-d2553392-73d6-44a7-92da-ce82f240f54b service nova] Instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:04:13.005597 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-eccf7b80-571e-4a78-a33f-64d375c31883 req-d2553392-73d6-44a7-92da-ce82f240f54b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127274 Aug 09 15:04:13.015381 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2640/5277] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:04:13.094781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9483f1db-c596-401a-b1d5-caeb495e9b57 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:13.105869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9483f1db-c596-401a-b1d5-caeb495e9b57 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:13.126397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9483f1db-c596-401a-b1d5-caeb495e9b57 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:13.129899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9483f1db-c596-401a-b1d5-caeb495e9b57 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:13.135841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9483f1db-c596-401a-b1d5-caeb495e9b57 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:13.137848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9483f1db-c596-401a-b1d5-caeb495e9b57 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:13.141232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9483f1db-c596-401a-b1d5-caeb495e9b57 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:13.142504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9483f1db-c596-401a-b1d5-caeb495e9b57 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:14.118798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6577a985-ef54-4328-b82c-7872c27ce190 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:14.142242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9483f1db-c596-401a-b1d5-caeb495e9b57 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:14.145727 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6577a985-ef54-4328-b82c-7872c27ce190 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1315 microversion: 2.1 time: 1.364758 Aug 09 15:04:14.151726 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2638/5278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:12 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1315 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:14.156541 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9483f1db-c596-401a-b1d5-caeb495e9b57 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1691 microversion: 2.1 time: 1.067590 Aug 09 15:04:14.164696 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2641/5279] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:13 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1691 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:04:15.180092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04a7f6dc-35ce-48f0-aca1-fee9a2b39110 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:15.181333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-04a7f6dc-35ce-48f0-aca1-fee9a2b39110 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:15.193262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04a7f6dc-35ce-48f0-aca1-fee9a2b39110 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:15.195768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a6bf24e-5402-4074-8fcf-234d3630ddea tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:15.197028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0a6bf24e-5402-4074-8fcf-234d3630ddea tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:15.197377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04a7f6dc-35ce-48f0-aca1-fee9a2b39110 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:15.197990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04a7f6dc-35ce-48f0-aca1-fee9a2b39110 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:15.198894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04a7f6dc-35ce-48f0-aca1-fee9a2b39110 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:15.200970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04a7f6dc-35ce-48f0-aca1-fee9a2b39110 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:15.201618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04a7f6dc-35ce-48f0-aca1-fee9a2b39110 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:15.223766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a6bf24e-5402-4074-8fcf-234d3630ddea tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:15.224297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a6bf24e-5402-4074-8fcf-234d3630ddea tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:15.224746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a6bf24e-5402-4074-8fcf-234d3630ddea tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:15.225556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a6bf24e-5402-4074-8fcf-234d3630ddea tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:15.226017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a6bf24e-5402-4074-8fcf-234d3630ddea tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:15.226441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a6bf24e-5402-4074-8fcf-234d3630ddea tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:15.515378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0a6bf24e-5402-4074-8fcf-234d3630ddea tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:15.530083 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0a6bf24e-5402-4074-8fcf-234d3630ddea tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1683 microversion: 2.1 time: 0.342883 Aug 09 15:04:15.533647 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2642/5280] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:15 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1683 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:15.540341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-04a7f6dc-35ce-48f0-aca1-fee9a2b39110 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:15.556986 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-04a7f6dc-35ce-48f0-aca1-fee9a2b39110 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1315 microversion: 2.1 time: 0.376796 Aug 09 15:04:15.558054 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2639/5281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:15 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:16.548886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-70ebc326-142a-43ef-a13c-0cb4ad5bdce2 req-a61bc37e-5cf8-4eab-a3de-4c3dccd1e4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792ae721-3b19-4713-bcf0-79ee402eff02", "name": "network-vif-plugged", "status": "completed", "tag": "d9c9cd0d-ffdf-4c44-a5be-c482bea7adfa"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:16.570872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-70ebc326-142a-43ef-a13c-0cb4ad5bdce2 req-a61bc37e-5cf8-4eab-a3de-4c3dccd1e4d0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:16.578112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5dad6b86-afd4-451b-94a8-a8248123c242 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:16.579490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5dad6b86-afd4-451b-94a8-a8248123c242 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:16.586672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5dad6b86-afd4-451b-94a8-a8248123c242 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:16.587595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-70ebc326-142a-43ef-a13c-0cb4ad5bdce2 req-a61bc37e-5cf8-4eab-a3de-4c3dccd1e4d0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:16.588236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-70ebc326-142a-43ef-a13c-0cb4ad5bdce2 req-a61bc37e-5cf8-4eab-a3de-4c3dccd1e4d0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:16.601571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5dad6b86-afd4-451b-94a8-a8248123c242 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:16.602035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5dad6b86-afd4-451b-94a8-a8248123c242 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:16.603484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5dad6b86-afd4-451b-94a8-a8248123c242 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:16.603484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5dad6b86-afd4-451b-94a8-a8248123c242 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:16.603692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5dad6b86-afd4-451b-94a8-a8248123c242 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:16.618089 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-70ebc326-142a-43ef-a13c-0cb4ad5bdce2 req-a61bc37e-5cf8-4eab-a3de-4c3dccd1e4d0 service nova] Creating event network-vif-plugged:d9c9cd0d-ffdf-4c44-a5be-c482bea7adfa for instance 792ae721-3b19-4713-bcf0-79ee402eff02 on n-h1-844626-8 Aug 09 15:04:16.643278 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-70ebc326-142a-43ef-a13c-0cb4ad5bdce2 req-a61bc37e-5cf8-4eab-a3de-4c3dccd1e4d0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098874 Aug 09 15:04:16.644370 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2643/5282] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:04:16.901403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5dad6b86-afd4-451b-94a8-a8248123c242 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:16.913106 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5dad6b86-afd4-451b-94a8-a8248123c242 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1315 microversion: 2.1 time: 0.338827 Aug 09 15:04:16.923505 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2640/5283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:16 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:04:17.942017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-20fd01e5-e82f-43b4-b6d9-4e66ef316f36 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:17.950211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-20fd01e5-e82f-43b4-b6d9-4e66ef316f36 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:17.961523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20fd01e5-e82f-43b4-b6d9-4e66ef316f36 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:17.962324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20fd01e5-e82f-43b4-b6d9-4e66ef316f36 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:17.962950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20fd01e5-e82f-43b4-b6d9-4e66ef316f36 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:17.970559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20fd01e5-e82f-43b4-b6d9-4e66ef316f36 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:17.971435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20fd01e5-e82f-43b4-b6d9-4e66ef316f36 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:17.972048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20fd01e5-e82f-43b4-b6d9-4e66ef316f36 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:18.309890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-20fd01e5-e82f-43b4-b6d9-4e66ef316f36 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:18.319775 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-20fd01e5-e82f-43b4-b6d9-4e66ef316f36 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1315 microversion: 2.1 time: 0.388515 Aug 09 15:04:18.321673 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2644/5284] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:17 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:19.343712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-89621254-ee66-42e0-a2eb-ef9640108e5e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:19.345284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-89621254-ee66-42e0-a2eb-ef9640108e5e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:19.358791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89621254-ee66-42e0-a2eb-ef9640108e5e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:19.359762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89621254-ee66-42e0-a2eb-ef9640108e5e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:19.361212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89621254-ee66-42e0-a2eb-ef9640108e5e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:19.362954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89621254-ee66-42e0-a2eb-ef9640108e5e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:19.363851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89621254-ee66-42e0-a2eb-ef9640108e5e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:19.364658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89621254-ee66-42e0-a2eb-ef9640108e5e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:19.679841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-89621254-ee66-42e0-a2eb-ef9640108e5e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:19.692327 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-89621254-ee66-42e0-a2eb-ef9640108e5e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1498 microversion: 2.1 time: 0.354256 Aug 09 15:04:19.692925 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2641/5285] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:19 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1498 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:19.721433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-659ac9b3-f6b2-41de-aaf9-bc5bd823b4d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:19.722042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-659ac9b3-f6b2-41de-aaf9-bc5bd823b4d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:19.730238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-659ac9b3-f6b2-41de-aaf9-bc5bd823b4d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:19.730866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-659ac9b3-f6b2-41de-aaf9-bc5bd823b4d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:19.731424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-659ac9b3-f6b2-41de-aaf9-bc5bd823b4d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:19.732218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-659ac9b3-f6b2-41de-aaf9-bc5bd823b4d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:19.732913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-659ac9b3-f6b2-41de-aaf9-bc5bd823b4d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:19.733555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-659ac9b3-f6b2-41de-aaf9-bc5bd823b4d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:19.914537 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.network.security_group_api [None req-659ac9b3-f6b2-41de-aaf9-bc5bd823b4d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Removing security group 611b9c5a-b25c-4781-9be5-7d385bfba94d from port d9c9cd0d-ffdf-4c44-a5be-c482bea7adfa Aug 09 15:04:20.306293 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-659ac9b3-f6b2-41de-aaf9-bc5bd823b4d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02/action" status: 202 len: 0 microversion: 2.1 time: 0.589075 Aug 09 15:04:20.307633 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2645/5286] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:04:19 2022] POST /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:04:20.316721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e6b49a10-dddc-498f-b1fb-d4720f658858 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:20.317555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e6b49a10-dddc-498f-b1fb-d4720f658858 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:20.325282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-854006de-441c-4629-9b86-ad6dad1b3ba2 req-f75ab5ae-d98c-41e8-a621-cc30326615ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "792ae721-3b19-4713-bcf0-79ee402eff02", "tag": "d9c9cd0d-ffdf-4c44-a5be-c482bea7adfa"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:20.333233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6b49a10-dddc-498f-b1fb-d4720f658858 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:20.335829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6b49a10-dddc-498f-b1fb-d4720f658858 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:20.339216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6b49a10-dddc-498f-b1fb-d4720f658858 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:20.340170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6b49a10-dddc-498f-b1fb-d4720f658858 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:20.340787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6b49a10-dddc-498f-b1fb-d4720f658858 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:20.341378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e6b49a10-dddc-498f-b1fb-d4720f658858 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:20.354276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-854006de-441c-4629-9b86-ad6dad1b3ba2 req-f75ab5ae-d98c-41e8-a621-cc30326615ad service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:20.354757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-854006de-441c-4629-9b86-ad6dad1b3ba2 req-f75ab5ae-d98c-41e8-a621-cc30326615ad service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:20.355210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-854006de-441c-4629-9b86-ad6dad1b3ba2 req-f75ab5ae-d98c-41e8-a621-cc30326615ad service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:20.389877 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-854006de-441c-4629-9b86-ad6dad1b3ba2 req-f75ab5ae-d98c-41e8-a621-cc30326615ad service nova] Creating event network-changed:d9c9cd0d-ffdf-4c44-a5be-c482bea7adfa for instance 792ae721-3b19-4713-bcf0-79ee402eff02 on n-h1-844626-8 Aug 09 15:04:20.424086 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-854006de-441c-4629-9b86-ad6dad1b3ba2 req-f75ab5ae-d98c-41e8-a621-cc30326615ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103168 Aug 09 15:04:20.425004 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2646/5287] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:04:20.617714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e6b49a10-dddc-498f-b1fb-d4720f658858 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:20.628062 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e6b49a10-dddc-498f-b1fb-d4720f658858 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1456 microversion: 2.1 time: 0.315747 Aug 09 15:04:20.638066 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2642/5288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:20 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1456 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:20.650432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ae0e425-2a0b-4b39-8585-cd7c25e65d86 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:20.651914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ae0e425-2a0b-4b39-8585-cd7c25e65d86 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:20.677006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ae0e425-2a0b-4b39-8585-cd7c25e65d86 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:20.679469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ae0e425-2a0b-4b39-8585-cd7c25e65d86 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:20.682250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ae0e425-2a0b-4b39-8585-cd7c25e65d86 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:20.684361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ae0e425-2a0b-4b39-8585-cd7c25e65d86 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:20.684911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ae0e425-2a0b-4b39-8585-cd7c25e65d86 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:20.685411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ae0e425-2a0b-4b39-8585-cd7c25e65d86 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:20.913319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ae0e425-2a0b-4b39-8585-cd7c25e65d86 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:20.922619 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ae0e425-2a0b-4b39-8585-cd7c25e65d86 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.277656 Aug 09 15:04:20.941385 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2647/5289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:20 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:04:20.948721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0a38307-3804-4b5b-8935-24e35ad881d9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:20.949350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0a38307-3804-4b5b-8935-24e35ad881d9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:20.957531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a38307-3804-4b5b-8935-24e35ad881d9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:20.958039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a38307-3804-4b5b-8935-24e35ad881d9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:20.958482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a38307-3804-4b5b-8935-24e35ad881d9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:20.959420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a38307-3804-4b5b-8935-24e35ad881d9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:20.959881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a38307-3804-4b5b-8935-24e35ad881d9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:20.960451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0a38307-3804-4b5b-8935-24e35ad881d9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:21.144494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0a38307-3804-4b5b-8935-24e35ad881d9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:21.164915 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0a38307-3804-4b5b-8935-24e35ad881d9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.220761 Aug 09 15:04:21.165945 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2643/5290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:20 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:21.187845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4db93f4f-9b1e-452d-89db-ceb012410f1a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:21.188714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4db93f4f-9b1e-452d-89db-ceb012410f1a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:21.195759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4db93f4f-9b1e-452d-89db-ceb012410f1a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:21.196521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4db93f4f-9b1e-452d-89db-ceb012410f1a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:21.197209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4db93f4f-9b1e-452d-89db-ceb012410f1a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:21.198114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4db93f4f-9b1e-452d-89db-ceb012410f1a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:21.198762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4db93f4f-9b1e-452d-89db-ceb012410f1a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:21.199421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4db93f4f-9b1e-452d-89db-ceb012410f1a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:21.887288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4db93f4f-9b1e-452d-89db-ceb012410f1a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:21.898487 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4db93f4f-9b1e-452d-89db-ceb012410f1a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.714355 Aug 09 15:04:21.899469 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2648/5291] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:21 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:21.919228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4338d47d-69e6-4bc4-9b06-7656c04da2a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:21.920121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4338d47d-69e6-4bc4-9b06-7656c04da2a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:21.928822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4338d47d-69e6-4bc4-9b06-7656c04da2a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:21.929491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4338d47d-69e6-4bc4-9b06-7656c04da2a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:21.930279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4338d47d-69e6-4bc4-9b06-7656c04da2a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:21.930833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4338d47d-69e6-4bc4-9b06-7656c04da2a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:21.931443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4338d47d-69e6-4bc4-9b06-7656c04da2a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:21.932008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4338d47d-69e6-4bc4-9b06-7656c04da2a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:22.205735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4338d47d-69e6-4bc4-9b06-7656c04da2a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:22.220338 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4338d47d-69e6-4bc4-9b06-7656c04da2a7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.303301 Aug 09 15:04:22.222280 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2644/5292] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:21 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:22.373129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1413360594", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "aac61d64-db55-4d08-906a-2788d0f45a74"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:24.795600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] validate_networks() for [('aac61d64-db55-4d08-906a-2788d0f45a74', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:04:25.521449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:04:25.521872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:04:25.522341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:04:25.522747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:04:25.523180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:04:25.541835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:25.544353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:25.544979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:25.545921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:25.547678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:25.548412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:25.572794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Getting quotas for project 891029e759ac441f8a08c38bca92be81. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:04:25.586608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Getting quotas for user 3da785ddf56e4b028c6647643d97c952 and project 891029e759ac441f8a08c38bca92be81. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:04:25.608812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:04:25.612066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:04:25.785731 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36a1078c-b3cd-4a61-8081-53699266e5f5 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.417649 Aug 09 15:04:25.786747 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2649/5293] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:04:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:04:25.815419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef5775fd-95b3-4c38-9e78-36b857932a69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:25.816019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef5775fd-95b3-4c38-9e78-36b857932a69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:25.818880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=60 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:25.938081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef5775fd-95b3-4c38-9e78-36b857932a69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:25.946616 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef5775fd-95b3-4c38-9e78-36b857932a69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1215 microversion: 2.1 time: 0.152406 Aug 09 15:04:25.960293 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2645/5294] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:25 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:26.971029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94ea4513-31c5-494e-b271-106de85328ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:26.972456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94ea4513-31c5-494e-b271-106de85328ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:26.983373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94ea4513-31c5-494e-b271-106de85328ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:26.990048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94ea4513-31c5-494e-b271-106de85328ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:26.990821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94ea4513-31c5-494e-b271-106de85328ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:26.993743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94ea4513-31c5-494e-b271-106de85328ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:26.995458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94ea4513-31c5-494e-b271-106de85328ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:27.000317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94ea4513-31c5-494e-b271-106de85328ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:27.063433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:27.176226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-94ea4513-31c5-494e-b271-106de85328ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:27.192556 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94ea4513-31c5-494e-b271-106de85328ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1211 microversion: 2.1 time: 0.225514 Aug 09 15:04:27.194354 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2650/5295] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:26 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1211 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:28.215882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a82c3b89-f60d-4c16-b11f-ee674048255e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:28.216498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a82c3b89-f60d-4c16-b11f-ee674048255e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:28.234745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a82c3b89-f60d-4c16-b11f-ee674048255e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:28.238794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a82c3b89-f60d-4c16-b11f-ee674048255e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:28.240511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a82c3b89-f60d-4c16-b11f-ee674048255e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:28.240511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a82c3b89-f60d-4c16-b11f-ee674048255e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:28.240859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a82c3b89-f60d-4c16-b11f-ee674048255e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:28.241342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a82c3b89-f60d-4c16-b11f-ee674048255e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:28.489645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a82c3b89-f60d-4c16-b11f-ee674048255e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:28.505453 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a82c3b89-f60d-4c16-b11f-ee674048255e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1273 microversion: 2.1 time: 0.293446 Aug 09 15:04:28.507100 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2646/5296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:28 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1273 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:29.531344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32ebb573-bb1e-4cdc-8a05-e0247166de18 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:29.531860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32ebb573-bb1e-4cdc-8a05-e0247166de18 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:29.554045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32ebb573-bb1e-4cdc-8a05-e0247166de18 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:29.554855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32ebb573-bb1e-4cdc-8a05-e0247166de18 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:29.555490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32ebb573-bb1e-4cdc-8a05-e0247166de18 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:29.556394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32ebb573-bb1e-4cdc-8a05-e0247166de18 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:29.557034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32ebb573-bb1e-4cdc-8a05-e0247166de18 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:29.557631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32ebb573-bb1e-4cdc-8a05-e0247166de18 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:29.810773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-32ebb573-bb1e-4cdc-8a05-e0247166de18 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:29.824195 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32ebb573-bb1e-4cdc-8a05-e0247166de18 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1315 microversion: 2.1 time: 0.299324 Aug 09 15:04:29.830297 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2651/5297] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:29 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:30.854503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c9f23584-6782-43a5-8e72-13ffc8852008 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:30.856508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c9f23584-6782-43a5-8e72-13ffc8852008 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:30.881094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9f23584-6782-43a5-8e72-13ffc8852008 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:30.881596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9f23584-6782-43a5-8e72-13ffc8852008 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:30.885194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9f23584-6782-43a5-8e72-13ffc8852008 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:30.886794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9f23584-6782-43a5-8e72-13ffc8852008 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:30.895924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9f23584-6782-43a5-8e72-13ffc8852008 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:30.897306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c9f23584-6782-43a5-8e72-13ffc8852008 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:31.031194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-bd3bf583-adb5-4251-9e17-872bf3d72a38 req-d31d95ea-f149-47b1-99d4-a13c4d6561d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09c13197-2b16-4472-8f3f-c144ffc8879a", "tag": "9c19066d-e8b5-408b-b063-5288762ff74f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:31.062623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bd3bf583-adb5-4251-9e17-872bf3d72a38 req-d31d95ea-f149-47b1-99d4-a13c4d6561d7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:31.073531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bd3bf583-adb5-4251-9e17-872bf3d72a38 req-d31d95ea-f149-47b1-99d4-a13c4d6561d7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:31.075407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bd3bf583-adb5-4251-9e17-872bf3d72a38 req-d31d95ea-f149-47b1-99d4-a13c4d6561d7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:31.102000 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-bd3bf583-adb5-4251-9e17-872bf3d72a38 req-d31d95ea-f149-47b1-99d4-a13c4d6561d7 service nova] Creating event network-changed:9c19066d-e8b5-408b-b063-5288762ff74f for instance 09c13197-2b16-4472-8f3f-c144ffc8879a on n-h2-844626-8 Aug 09 15:04:31.113082 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-bd3bf583-adb5-4251-9e17-872bf3d72a38 req-d31d95ea-f149-47b1-99d4-a13c4d6561d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086965 Aug 09 15:04:31.115612 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2652/5298] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:04:31.289545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c9f23584-6782-43a5-8e72-13ffc8852008 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:31.298933 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c9f23584-6782-43a5-8e72-13ffc8852008 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1315 microversion: 2.1 time: 0.450143 Aug 09 15:04:31.299601 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2647/5299] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:30 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:32.328980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-61e25f10-2b80-46ad-ba37-8a1d0591cd0f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:32.331395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-61e25f10-2b80-46ad-ba37-8a1d0591cd0f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:32.341228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61e25f10-2b80-46ad-ba37-8a1d0591cd0f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:32.341857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61e25f10-2b80-46ad-ba37-8a1d0591cd0f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:32.342712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61e25f10-2b80-46ad-ba37-8a1d0591cd0f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:32.348789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61e25f10-2b80-46ad-ba37-8a1d0591cd0f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:32.351599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61e25f10-2b80-46ad-ba37-8a1d0591cd0f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:32.352526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61e25f10-2b80-46ad-ba37-8a1d0591cd0f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:32.699577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-61e25f10-2b80-46ad-ba37-8a1d0591cd0f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:32.715588 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-61e25f10-2b80-46ad-ba37-8a1d0591cd0f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1315 microversion: 2.1 time: 0.395160 Aug 09 15:04:32.724548 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2653/5300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:32 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:33.741913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7ca777b-d026-4d24-9062-89b1583869f2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:33.743392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7ca777b-d026-4d24-9062-89b1583869f2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:33.755619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7ca777b-d026-4d24-9062-89b1583869f2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:33.759833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7ca777b-d026-4d24-9062-89b1583869f2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:33.761479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7ca777b-d026-4d24-9062-89b1583869f2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:33.768490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7ca777b-d026-4d24-9062-89b1583869f2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:33.770678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7ca777b-d026-4d24-9062-89b1583869f2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:33.774949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7ca777b-d026-4d24-9062-89b1583869f2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:34.140459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7ca777b-d026-4d24-9062-89b1583869f2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:34.154702 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7ca777b-d026-4d24-9062-89b1583869f2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1315 microversion: 2.1 time: 0.417578 Aug 09 15:04:34.167163 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2648/5301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:33 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:35.204288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-50c0d357-5e98-48ff-be92-98b2d203d079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:35.205650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-50c0d357-5e98-48ff-be92-98b2d203d079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:35.213331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50c0d357-5e98-48ff-be92-98b2d203d079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:35.214203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50c0d357-5e98-48ff-be92-98b2d203d079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:35.214858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50c0d357-5e98-48ff-be92-98b2d203d079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:35.215819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50c0d357-5e98-48ff-be92-98b2d203d079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:35.216485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50c0d357-5e98-48ff-be92-98b2d203d079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:35.217135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50c0d357-5e98-48ff-be92-98b2d203d079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:35.454152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-50c0d357-5e98-48ff-be92-98b2d203d079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:35.463796 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50c0d357-5e98-48ff-be92-98b2d203d079 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1315 microversion: 2.1 time: 0.263103 Aug 09 15:04:35.465205 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2654/5302] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:35 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:35.759829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2ebdaff-eec0-4999-a4d4-2e084b198c7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:35.762302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b2ebdaff-eec0-4999-a4d4-2e084b198c7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:35.782450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2ebdaff-eec0-4999-a4d4-2e084b198c7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:35.782914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2ebdaff-eec0-4999-a4d4-2e084b198c7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:35.783356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2ebdaff-eec0-4999-a4d4-2e084b198c7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:35.784294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2ebdaff-eec0-4999-a4d4-2e084b198c7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:35.784950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2ebdaff-eec0-4999-a4d4-2e084b198c7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:35.785544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2ebdaff-eec0-4999-a4d4-2e084b198c7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:35.875680 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b2ebdaff-eec0-4999-a4d4-2e084b198c7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553/action" status: 200 len: 24576 microversion: 2.1 time: 0.120306 Aug 09 15:04:35.881026 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2649/5303] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:04:35 2022] POST /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553/action => generated 24576 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:04:36.492008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8a7eb00a-3f50-475f-93bc-023ff94d5c97 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:36.494675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8a7eb00a-3f50-475f-93bc-023ff94d5c97 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:36.502611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:36.503855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:36.508503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a7eb00a-3f50-475f-93bc-023ff94d5c97 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:36.509422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a7eb00a-3f50-475f-93bc-023ff94d5c97 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:36.510474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a7eb00a-3f50-475f-93bc-023ff94d5c97 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:36.511595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a7eb00a-3f50-475f-93bc-023ff94d5c97 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:36.512668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a7eb00a-3f50-475f-93bc-023ff94d5c97 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:36.513492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8a7eb00a-3f50-475f-93bc-023ff94d5c97 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:36.805160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8a7eb00a-3f50-475f-93bc-023ff94d5c97 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:36.816248 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8a7eb00a-3f50-475f-93bc-023ff94d5c97 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1315 microversion: 2.1 time: 0.334150 Aug 09 15:04:36.829792 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2655/5304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:36 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:37.838441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81843868-171f-4b56-8198-ded70955b243 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:37.839358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81843868-171f-4b56-8198-ded70955b243 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:37.848751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:37.852451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81843868-171f-4b56-8198-ded70955b243 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:37.853815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81843868-171f-4b56-8198-ded70955b243 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:37.854441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81843868-171f-4b56-8198-ded70955b243 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:37.855367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81843868-171f-4b56-8198-ded70955b243 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:37.856456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81843868-171f-4b56-8198-ded70955b243 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:37.857594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81843868-171f-4b56-8198-ded70955b243 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:37.915510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=92 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:38.860475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-81843868-171f-4b56-8198-ded70955b243 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:38.875183 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81843868-171f-4b56-8198-ded70955b243 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1315 microversion: 2.1 time: 1.041137 Aug 09 15:04:38.875807 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2650/5305] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:37 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1315 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:39.006659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-e67bcc87-b499-470d-99b2-c9ee1d26c219 req-8e0d77d6-f0bd-4752-a930-6bea552595ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c13197-2b16-4472-8f3f-c144ffc8879a", "name": "network-vif-plugged", "status": "completed", "tag": "9c19066d-e8b5-408b-b063-5288762ff74f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:39.037194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e67bcc87-b499-470d-99b2-c9ee1d26c219 req-8e0d77d6-f0bd-4752-a930-6bea552595ef service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:39.040575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e67bcc87-b499-470d-99b2-c9ee1d26c219 req-8e0d77d6-f0bd-4752-a930-6bea552595ef service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:39.042631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-e67bcc87-b499-470d-99b2-c9ee1d26c219 req-8e0d77d6-f0bd-4752-a930-6bea552595ef service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:39.084452 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-e67bcc87-b499-470d-99b2-c9ee1d26c219 req-8e0d77d6-f0bd-4752-a930-6bea552595ef service nova] Creating event network-vif-plugged:9c19066d-e8b5-408b-b063-5288762ff74f for instance 09c13197-2b16-4472-8f3f-c144ffc8879a on n-h2-844626-8 Aug 09 15:04:39.091851 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-e67bcc87-b499-470d-99b2-c9ee1d26c219 req-8e0d77d6-f0bd-4752-a930-6bea552595ef service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089485 Aug 09 15:04:39.098394 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2656/5306] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:04:39.896991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a3725e1-6066-4db1-972a-547ca01fa5cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:39.897718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a3725e1-6066-4db1-972a-547ca01fa5cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:39.908263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a3725e1-6066-4db1-972a-547ca01fa5cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:39.909351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a3725e1-6066-4db1-972a-547ca01fa5cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:39.910208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a3725e1-6066-4db1-972a-547ca01fa5cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:39.911312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a3725e1-6066-4db1-972a-547ca01fa5cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:39.911993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a3725e1-6066-4db1-972a-547ca01fa5cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:39.912639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0a3725e1-6066-4db1-972a-547ca01fa5cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:40.203738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a3725e1-6066-4db1-972a-547ca01fa5cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:40.215018 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a3725e1-6066-4db1-972a-547ca01fa5cc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1315 microversion: 2.1 time: 0.322523 Aug 09 15:04:40.218490 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2651/5307] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:39 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:41.241974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c4ccba39-5f5c-4c23-860e-5c41a64298f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:41.243350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c4ccba39-5f5c-4c23-860e-5c41a64298f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:41.251352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4ccba39-5f5c-4c23-860e-5c41a64298f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:41.252096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4ccba39-5f5c-4c23-860e-5c41a64298f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:41.252708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4ccba39-5f5c-4c23-860e-5c41a64298f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:41.253855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4ccba39-5f5c-4c23-860e-5c41a64298f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:41.254480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4ccba39-5f5c-4c23-860e-5c41a64298f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:41.255051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4ccba39-5f5c-4c23-860e-5c41a64298f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:41.453224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c4ccba39-5f5c-4c23-860e-5c41a64298f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:41.473324 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c4ccba39-5f5c-4c23-860e-5c41a64298f0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1498 microversion: 2.1 time: 0.236595 Aug 09 15:04:41.475790 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2657/5308] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:41 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:41.498396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-073ab812-077a-448a-8018-847e4a97919d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:41.499394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-073ab812-077a-448a-8018-847e4a97919d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:41.516174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-073ab812-077a-448a-8018-847e4a97919d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:41.516704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-073ab812-077a-448a-8018-847e4a97919d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:41.517093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-073ab812-077a-448a-8018-847e4a97919d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:41.517813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-073ab812-077a-448a-8018-847e4a97919d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:41.518266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-073ab812-077a-448a-8018-847e4a97919d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:41.518766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-073ab812-077a-448a-8018-847e4a97919d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:41.614686 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-073ab812-077a-448a-8018-847e4a97919d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a/action" status: 202 len: 0 microversion: 2.1 time: 0.120327 Aug 09 15:04:41.620794 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2652/5309] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:04:41 2022] POST /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:04:41.623872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c7ae78fe-67a1-4516-bbd7-77e37b455f88 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:41.624487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c7ae78fe-67a1-4516-bbd7-77e37b455f88 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:41.635630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7ae78fe-67a1-4516-bbd7-77e37b455f88 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:41.636347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7ae78fe-67a1-4516-bbd7-77e37b455f88 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:41.636800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7ae78fe-67a1-4516-bbd7-77e37b455f88 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:41.637482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7ae78fe-67a1-4516-bbd7-77e37b455f88 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:41.638030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7ae78fe-67a1-4516-bbd7-77e37b455f88 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:41.638353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7ae78fe-67a1-4516-bbd7-77e37b455f88 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:41.904859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c7ae78fe-67a1-4516-bbd7-77e37b455f88 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:41.922638 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c7ae78fe-67a1-4516-bbd7-77e37b455f88 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1503 microversion: 2.1 time: 0.294312 Aug 09 15:04:41.923700 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2658/5310] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:41 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1503 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:42.167876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19b68405-4302-4ba9-b31f-5c27fb117c20 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:42.169006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-19b68405-4302-4ba9-b31f-5c27fb117c20 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:42.199511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19b68405-4302-4ba9-b31f-5c27fb117c20 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:42.200080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19b68405-4302-4ba9-b31f-5c27fb117c20 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:42.200513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19b68405-4302-4ba9-b31f-5c27fb117c20 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:42.201650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19b68405-4302-4ba9-b31f-5c27fb117c20 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:42.203241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19b68405-4302-4ba9-b31f-5c27fb117c20 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:42.206943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19b68405-4302-4ba9-b31f-5c27fb117c20 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:42.661571 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-19b68405-4302-4ba9-b31f-5c27fb117c20 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1834 microversion: 2.1 time: 0.515484 Aug 09 15:04:42.662888 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2653/5311] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:42 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1834 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:42.958307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-50cbab34-6ab7-486b-b90d-096b6fbffe3c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:42.958981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-50cbab34-6ab7-486b-b90d-096b6fbffe3c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:42.994638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:43.006221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50cbab34-6ab7-486b-b90d-096b6fbffe3c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:43.010275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50cbab34-6ab7-486b-b90d-096b6fbffe3c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:43.016624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50cbab34-6ab7-486b-b90d-096b6fbffe3c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:43.017536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50cbab34-6ab7-486b-b90d-096b6fbffe3c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:43.021024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50cbab34-6ab7-486b-b90d-096b6fbffe3c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:43.024938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50cbab34-6ab7-486b-b90d-096b6fbffe3c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:43.621052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-50cbab34-6ab7-486b-b90d-096b6fbffe3c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:43.681041 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50cbab34-6ab7-486b-b90d-096b6fbffe3c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1483 microversion: 2.1 time: 0.726558 Aug 09 15:04:43.683071 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2659/5312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:42 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1483 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:43.725309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7cdac768-eb15-42da-956d-f662b403766c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:43.728716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7cdac768-eb15-42da-956d-f662b403766c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:43.740348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cdac768-eb15-42da-956d-f662b403766c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:43.741909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cdac768-eb15-42da-956d-f662b403766c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:43.742879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cdac768-eb15-42da-956d-f662b403766c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:43.746241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cdac768-eb15-42da-956d-f662b403766c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:43.747706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cdac768-eb15-42da-956d-f662b403766c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:43.756138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cdac768-eb15-42da-956d-f662b403766c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:43.825953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-7cdac768-eb15-42da-956d-f662b403766c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lazy-loading 'flavor' on Instance uuid 09c13197-2b16-4472-8f3f-c144ffc8879a {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:04:44.347747 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7cdac768-eb15-42da-956d-f662b403766c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a/action" status: 202 len: 0 microversion: 2.1 time: 0.629368 Aug 09 15:04:44.350095 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2654/5313] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:04:43 2022] POST /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:04:44.365598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-70d52066-f77f-44db-bc56-0c2a59230c51 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:44.367765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-70d52066-f77f-44db-bc56-0c2a59230c51 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:44.383244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70d52066-f77f-44db-bc56-0c2a59230c51 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:44.384579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70d52066-f77f-44db-bc56-0c2a59230c51 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:44.385778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70d52066-f77f-44db-bc56-0c2a59230c51 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:44.387371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70d52066-f77f-44db-bc56-0c2a59230c51 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:44.389784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70d52066-f77f-44db-bc56-0c2a59230c51 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:44.390915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-70d52066-f77f-44db-bc56-0c2a59230c51 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:44.648177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-70d52066-f77f-44db-bc56-0c2a59230c51 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:44.659290 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-70d52066-f77f-44db-bc56-0c2a59230c51 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1489 microversion: 2.1 time: 0.303186 Aug 09 15:04:44.660217 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2660/5314] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:44 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1489 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:45.695775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-226f729c-2672-4731-a517-cd840ac5c856 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:45.696508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-226f729c-2672-4731-a517-cd840ac5c856 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:45.706605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-226f729c-2672-4731-a517-cd840ac5c856 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:45.708925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-226f729c-2672-4731-a517-cd840ac5c856 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:45.709716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-226f729c-2672-4731-a517-cd840ac5c856 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:45.711358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-226f729c-2672-4731-a517-cd840ac5c856 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:45.712047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-226f729c-2672-4731-a517-cd840ac5c856 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:45.715460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-226f729c-2672-4731-a517-cd840ac5c856 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:45.927416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b51bb896-e21d-44c9-8e5a-e325de89d846 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:45.928009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b51bb896-e21d-44c9-8e5a-e325de89d846 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:45.942056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b51bb896-e21d-44c9-8e5a-e325de89d846 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:45.942481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b51bb896-e21d-44c9-8e5a-e325de89d846 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:45.942925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b51bb896-e21d-44c9-8e5a-e325de89d846 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:45.943758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b51bb896-e21d-44c9-8e5a-e325de89d846 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:45.944208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b51bb896-e21d-44c9-8e5a-e325de89d846 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:45.944631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b51bb896-e21d-44c9-8e5a-e325de89d846 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:46.006924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b51bb896-e21d-44c9-8e5a-e325de89d846 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:04:46.086660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-226f729c-2672-4731-a517-cd840ac5c856 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:46.097236 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-226f729c-2672-4731-a517-cd840ac5c856 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1510 microversion: 2.1 time: 0.416081 Aug 09 15:04:46.103840 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2655/5315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:45 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:46.111050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ee9623e0-7159-4592-a547-41a86d68a6b9 req-722b6bd1-4582-4b5e-b07d-26b5bc1e7936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "582fe71a-5bc9-4b44-b82d-a8d8e403f553", "tag": "58108270-1f4d-4960-8a75-59ca080644bc"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:46.134994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ee9623e0-7159-4592-a547-41a86d68a6b9 req-722b6bd1-4582-4b5e-b07d-26b5bc1e7936 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:46.137185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ee9623e0-7159-4592-a547-41a86d68a6b9 req-722b6bd1-4582-4b5e-b07d-26b5bc1e7936 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:46.140806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ee9623e0-7159-4592-a547-41a86d68a6b9 req-722b6bd1-4582-4b5e-b07d-26b5bc1e7936 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:46.179481 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ee9623e0-7159-4592-a547-41a86d68a6b9 req-722b6bd1-4582-4b5e-b07d-26b5bc1e7936 service nova] Creating event network-changed:58108270-1f4d-4960-8a75-59ca080644bc for instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 on n-h1-844626-8 Aug 09 15:04:46.194789 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ee9623e0-7159-4592-a547-41a86d68a6b9 req-722b6bd1-4582-4b5e-b07d-26b5bc1e7936 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087846 Aug 09 15:04:46.195381 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2656/5316] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:04:46.212569 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b51bb896-e21d-44c9-8e5a-e325de89d846 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "DELETE /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 204 len: 0 microversion: 2.1 time: 0.289071 Aug 09 15:04:46.213833 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2661/5317] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:04:45 2022] DELETE /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:04:46.224246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-16e3b8cd-b0eb-4902-a047-e1fce8f6a720 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:46.224946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-16e3b8cd-b0eb-4902-a047-e1fce8f6a720 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:46.232654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16e3b8cd-b0eb-4902-a047-e1fce8f6a720 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:46.233137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16e3b8cd-b0eb-4902-a047-e1fce8f6a720 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:46.233571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16e3b8cd-b0eb-4902-a047-e1fce8f6a720 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:46.234260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16e3b8cd-b0eb-4902-a047-e1fce8f6a720 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:46.234704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16e3b8cd-b0eb-4902-a047-e1fce8f6a720 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:46.235144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16e3b8cd-b0eb-4902-a047-e1fce8f6a720 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:46.729750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-16e3b8cd-b0eb-4902-a047-e1fce8f6a720 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:46.746662 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-16e3b8cd-b0eb-4902-a047-e1fce8f6a720 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1689 microversion: 2.1 time: 0.526607 Aug 09 15:04:46.750650 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2657/5318] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:46 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1689 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:47.128618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d4bc0dd-6b31-4dc4-b482-d2b4fee6bcb4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:47.129481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d4bc0dd-6b31-4dc4-b482-d2b4fee6bcb4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:47.147446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d4bc0dd-6b31-4dc4-b482-d2b4fee6bcb4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:47.149549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d4bc0dd-6b31-4dc4-b482-d2b4fee6bcb4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:47.150310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d4bc0dd-6b31-4dc4-b482-d2b4fee6bcb4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:47.151443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d4bc0dd-6b31-4dc4-b482-d2b4fee6bcb4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:47.153248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d4bc0dd-6b31-4dc4-b482-d2b4fee6bcb4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:47.154593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d4bc0dd-6b31-4dc4-b482-d2b4fee6bcb4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:47.644479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d4bc0dd-6b31-4dc4-b482-d2b4fee6bcb4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:47.658894 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d4bc0dd-6b31-4dc4-b482-d2b4fee6bcb4 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 0.534894 Aug 09 15:04:47.665730 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2662/5319] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:47 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:47.770412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a57a0a77-8fc0-4d7e-bf13-d269b5edaa81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:47.771028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a57a0a77-8fc0-4d7e-bf13-d269b5edaa81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:47.784649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a57a0a77-8fc0-4d7e-bf13-d269b5edaa81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:47.790745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a57a0a77-8fc0-4d7e-bf13-d269b5edaa81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:47.791481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a57a0a77-8fc0-4d7e-bf13-d269b5edaa81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:47.794889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a57a0a77-8fc0-4d7e-bf13-d269b5edaa81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:47.794889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a57a0a77-8fc0-4d7e-bf13-d269b5edaa81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:47.795495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a57a0a77-8fc0-4d7e-bf13-d269b5edaa81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:48.681229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba4cc6ec-f0cd-4ee9-8d5c-8956888dfd9d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:48.682022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba4cc6ec-f0cd-4ee9-8d5c-8956888dfd9d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:48.706214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba4cc6ec-f0cd-4ee9-8d5c-8956888dfd9d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:48.707892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba4cc6ec-f0cd-4ee9-8d5c-8956888dfd9d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:48.708364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba4cc6ec-f0cd-4ee9-8d5c-8956888dfd9d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:48.709125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba4cc6ec-f0cd-4ee9-8d5c-8956888dfd9d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:48.715400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba4cc6ec-f0cd-4ee9-8d5c-8956888dfd9d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:48.715967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba4cc6ec-f0cd-4ee9-8d5c-8956888dfd9d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:49.328355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a57a0a77-8fc0-4d7e-bf13-d269b5edaa81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:49.342849 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a57a0a77-8fc0-4d7e-bf13-d269b5edaa81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1689 microversion: 2.1 time: 1.576433 Aug 09 15:04:49.348205 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2658/5320] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:47 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1689 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:49.545054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba4cc6ec-f0cd-4ee9-8d5c-8956888dfd9d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:49.553025 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba4cc6ec-f0cd-4ee9-8d5c-8956888dfd9d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 0.875941 Aug 09 15:04:49.564524 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2663/5321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:48 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:04:50.371171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-727520e2-0cbd-4d63-bf60-3c0c69328f6f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:50.371987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-727520e2-0cbd-4d63-bf60-3c0c69328f6f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:50.405856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-727520e2-0cbd-4d63-bf60-3c0c69328f6f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:50.406859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-727520e2-0cbd-4d63-bf60-3c0c69328f6f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:50.407805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-727520e2-0cbd-4d63-bf60-3c0c69328f6f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:50.411740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-727520e2-0cbd-4d63-bf60-3c0c69328f6f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:50.412548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-727520e2-0cbd-4d63-bf60-3c0c69328f6f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:50.422272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-727520e2-0cbd-4d63-bf60-3c0c69328f6f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:50.475901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b217e226-cbc2-40d4-9510-1e408741e320 req-9a6b780b-091e-45c3-a6bd-3f6a1083d265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "582fe71a-5bc9-4b44-b82d-a8d8e403f553", "name": "network-vif-deleted", "tag": "58108270-1f4d-4960-8a75-59ca080644bc"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:50.525885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b217e226-cbc2-40d4-9510-1e408741e320 req-9a6b780b-091e-45c3-a6bd-3f6a1083d265 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:50.526750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b217e226-cbc2-40d4-9510-1e408741e320 req-9a6b780b-091e-45c3-a6bd-3f6a1083d265 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:50.527407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b217e226-cbc2-40d4-9510-1e408741e320 req-9a6b780b-091e-45c3-a6bd-3f6a1083d265 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:50.593664 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b217e226-cbc2-40d4-9510-1e408741e320 req-9a6b780b-091e-45c3-a6bd-3f6a1083d265 service nova] Creating event network-vif-deleted:58108270-1f4d-4960-8a75-59ca080644bc for instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 on n-h1-844626-8 Aug 09 15:04:50.616072 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b217e226-cbc2-40d4-9510-1e408741e320 req-9a6b780b-091e-45c3-a6bd-3f6a1083d265 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144076 Aug 09 15:04:50.617304 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2664/5322] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:04:50.647750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-20ab2f55-af9c-41a0-b48e-a96170de7f84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:50.657422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-20ab2f55-af9c-41a0-b48e-a96170de7f84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:50.694456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20ab2f55-af9c-41a0-b48e-a96170de7f84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:50.698815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20ab2f55-af9c-41a0-b48e-a96170de7f84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:50.708316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20ab2f55-af9c-41a0-b48e-a96170de7f84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:50.709460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20ab2f55-af9c-41a0-b48e-a96170de7f84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:50.711132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20ab2f55-af9c-41a0-b48e-a96170de7f84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:50.716054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20ab2f55-af9c-41a0-b48e-a96170de7f84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:50.726229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-727520e2-0cbd-4d63-bf60-3c0c69328f6f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:50.748361 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-727520e2-0cbd-4d63-bf60-3c0c69328f6f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 200 len: 1502 microversion: 2.1 time: 0.382943 Aug 09 15:04:50.752077 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2659/5323] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:50 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 1502 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:51.601156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-20ab2f55-af9c-41a0-b48e-a96170de7f84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:51.617932 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-20ab2f55-af9c-41a0-b48e-a96170de7f84 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 0.991720 Aug 09 15:04:51.632276 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2665/5324] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:50 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:51.772000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8f20fba2-b654-4198-a77b-64c52631cbf5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:51.772771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8f20fba2-b654-4198-a77b-64c52631cbf5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 582fe71a-5bc9-4b44-b82d-a8d8e403f553] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:51.796763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f20fba2-b654-4198-a77b-64c52631cbf5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:51.797504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f20fba2-b654-4198-a77b-64c52631cbf5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:51.798080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f20fba2-b654-4198-a77b-64c52631cbf5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:51.798959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f20fba2-b654-4198-a77b-64c52631cbf5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:51.799581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f20fba2-b654-4198-a77b-64c52631cbf5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:51.807827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f20fba2-b654-4198-a77b-64c52631cbf5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:51.861199 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-8f20fba2-b654-4198-a77b-64c52631cbf5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] HTTP exception thrown: Instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 could not be found. Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8f20fba2-b654-4198-a77b-64c52631cbf5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Request method failure captured: Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 HTTP/1.1 Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8ncQl_OhnXzPfN37y_gQhZaTw8hyB7aUw1NVxqhnUDpImauOwqDZAMMA42Q0FA5K7BfkHzf96pPtBJHzwEloK0wLejr0pDUs8uplO9kHt2X-z743m5Z_VT211uUGD7Pn_KaW3ovVx3B-Ge_U1JFiW4MIUR6sycWgiLcRVamLUpSKu6I Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 889fa240e1f5494d9c11803acd77f74b Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-543221961 Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_889fa240e1f5494d9c11803acd77f74b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/889fa240e1f5494d9c11803acd77f74b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/889fa240e1f5494d9c11803acd77f74b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/889fa240e1f5494d9c11803acd77f74b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-543221961 Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 889fa240e1f5494d9c11803acd77f74b Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-543221961 Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestNetworkAdvancedServerOps-543221961-project Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 9ff3b746851a4414ba60cb76ac07056b Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-543221961-project Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 could not be found. Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '582fe71a-5bc9-4b44-b82d-a8d8e403f553'} Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 could not be found. Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 could not be found. Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:04:51.863065 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:04:51.868338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:04:51.868338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:04:51.868338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:04:51.868338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:04:51.868338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:04:51.868338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:04:51.868338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 could not be found. Aug 09 15:04:51.868338 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:04:51.868338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8f20fba2-b654-4198-a77b-64c52631cbf5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Returning 404 to user: Instance 582fe71a-5bc9-4b44-b82d-a8d8e403f553 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:04:51.870870 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8f20fba2-b654-4198-a77b-64c52631cbf5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553" status: 404 len: 111 microversion: 2.1 time: 0.104491 Aug 09 15:04:51.872988 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2660/5325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:51 2022] GET /compute/v2.1/servers/582fe71a-5bc9-4b44-b82d-a8d8e403f553 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:04:52.640712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f8a6170-def1-4b96-91fa-ef9cec25d6d3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:52.641427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f8a6170-def1-4b96-91fa-ef9cec25d6d3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:52.656026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8a6170-def1-4b96-91fa-ef9cec25d6d3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:52.657165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8a6170-def1-4b96-91fa-ef9cec25d6d3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:52.661847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8a6170-def1-4b96-91fa-ef9cec25d6d3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:52.664860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8a6170-def1-4b96-91fa-ef9cec25d6d3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:52.667594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8a6170-def1-4b96-91fa-ef9cec25d6d3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:52.668860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8a6170-def1-4b96-91fa-ef9cec25d6d3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:53.190531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-9bd751da-8090-4001-ba2f-c836866ec61f req-56fe6184-4948-44a6-83ae-907623e4a6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c13197-2b16-4472-8f3f-c144ffc8879a", "name": "network-vif-plugged", "status": "completed", "tag": "9c19066d-e8b5-408b-b063-5288762ff74f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:04:53.250374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9bd751da-8090-4001-ba2f-c836866ec61f req-56fe6184-4948-44a6-83ae-907623e4a6f5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:53.251690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9bd751da-8090-4001-ba2f-c836866ec61f req-56fe6184-4948-44a6-83ae-907623e4a6f5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:53.260530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9bd751da-8090-4001-ba2f-c836866ec61f req-56fe6184-4948-44a6-83ae-907623e4a6f5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:53.290397 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9bd751da-8090-4001-ba2f-c836866ec61f req-56fe6184-4948-44a6-83ae-907623e4a6f5 service nova] Creating event network-vif-plugged:9c19066d-e8b5-408b-b063-5288762ff74f for instance 09c13197-2b16-4472-8f3f-c144ffc8879a on n-h2-844626-8 Aug 09 15:04:53.305180 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-9bd751da-8090-4001-ba2f-c836866ec61f req-56fe6184-4948-44a6-83ae-907623e4a6f5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124759 Aug 09 15:04:53.306296 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2661/5326] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:04:53.585556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f8a6170-def1-4b96-91fa-ef9cec25d6d3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:53.598939 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4f8a6170-def1-4b96-91fa-ef9cec25d6d3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 0.959365 Aug 09 15:04:53.603017 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2666/5327] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:52 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:54.628218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-554b8b1a-6112-4e44-bdbd-0feba9e58832 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:54.629291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-554b8b1a-6112-4e44-bdbd-0feba9e58832 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:54.650727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-554b8b1a-6112-4e44-bdbd-0feba9e58832 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:54.651421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-554b8b1a-6112-4e44-bdbd-0feba9e58832 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:54.651981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-554b8b1a-6112-4e44-bdbd-0feba9e58832 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:54.652835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-554b8b1a-6112-4e44-bdbd-0feba9e58832 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:54.653709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-554b8b1a-6112-4e44-bdbd-0feba9e58832 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:54.654265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-554b8b1a-6112-4e44-bdbd-0feba9e58832 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:55.568938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-554b8b1a-6112-4e44-bdbd-0feba9e58832 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:55.577833 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-554b8b1a-6112-4e44-bdbd-0feba9e58832 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 0.954254 Aug 09 15:04:55.582634 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2662/5328] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:54 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:56.606086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-486922b9-da1d-4d08-a5bb-f6d18757b48e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:56.606720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-486922b9-da1d-4d08-a5bb-f6d18757b48e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:56.644282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-486922b9-da1d-4d08-a5bb-f6d18757b48e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:56.644793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-486922b9-da1d-4d08-a5bb-f6d18757b48e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:56.651782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-486922b9-da1d-4d08-a5bb-f6d18757b48e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:56.655940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-486922b9-da1d-4d08-a5bb-f6d18757b48e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:56.657969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-486922b9-da1d-4d08-a5bb-f6d18757b48e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:56.658434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-486922b9-da1d-4d08-a5bb-f6d18757b48e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:56.725166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:57.769303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-486922b9-da1d-4d08-a5bb-f6d18757b48e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:57.781991 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-486922b9-da1d-4d08-a5bb-f6d18757b48e tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 1.181875 Aug 09 15:04:57.801404 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2667/5329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:56 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:04:58.827441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c582bcd1-a593-48a9-bdd5-feaee6a0a11f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:04:58.827891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c582bcd1-a593-48a9-bdd5-feaee6a0a11f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:04:58.834682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=38 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:04:58.836634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c582bcd1-a593-48a9-bdd5-feaee6a0a11f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:58.837389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c582bcd1-a593-48a9-bdd5-feaee6a0a11f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:58.838006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c582bcd1-a593-48a9-bdd5-feaee6a0a11f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:58.838910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c582bcd1-a593-48a9-bdd5-feaee6a0a11f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:04:58.839637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c582bcd1-a593-48a9-bdd5-feaee6a0a11f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:04:58.840251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c582bcd1-a593-48a9-bdd5-feaee6a0a11f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:04:59.834661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c582bcd1-a593-48a9-bdd5-feaee6a0a11f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:04:59.858676 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c582bcd1-a593-48a9-bdd5-feaee6a0a11f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 1.041230 Aug 09 15:04:59.859721 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2663/5330] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:04:58 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:00.884431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1202967d-1973-4dd5-a768-e32ed1ae778d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:00.885530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1202967d-1973-4dd5-a768-e32ed1ae778d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:00.894760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1202967d-1973-4dd5-a768-e32ed1ae778d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:00.895321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1202967d-1973-4dd5-a768-e32ed1ae778d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:00.895764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1202967d-1973-4dd5-a768-e32ed1ae778d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:00.896493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1202967d-1973-4dd5-a768-e32ed1ae778d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:00.897109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1202967d-1973-4dd5-a768-e32ed1ae778d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:00.898019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1202967d-1973-4dd5-a768-e32ed1ae778d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:01.965073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1202967d-1973-4dd5-a768-e32ed1ae778d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:01.977888 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1202967d-1973-4dd5-a768-e32ed1ae778d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 1.097918 Aug 09 15:05:01.978493 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2668/5331] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:00 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:03.001708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c3906a9e-c265-46ed-9457-c4ee5776cb02 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:03.002389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c3906a9e-c265-46ed-9457-c4ee5776cb02 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:03.046034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3906a9e-c265-46ed-9457-c4ee5776cb02 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:03.067431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3906a9e-c265-46ed-9457-c4ee5776cb02 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:03.067895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3906a9e-c265-46ed-9457-c4ee5776cb02 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:03.068835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3906a9e-c265-46ed-9457-c4ee5776cb02 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:03.069464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3906a9e-c265-46ed-9457-c4ee5776cb02 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:03.070080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3906a9e-c265-46ed-9457-c4ee5776cb02 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:03.606152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c3906a9e-c265-46ed-9457-c4ee5776cb02 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:03.614136 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c3906a9e-c265-46ed-9457-c4ee5776cb02 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 0.616355 Aug 09 15:05:03.635462 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2664/5332] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:02 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:03.707045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-74532217-9638-4c12-9538-17599735b65b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '.version_select at 0x7f41dc790f70>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:03.736650 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-74532217-9638-4c12-9538-17599735b65b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1585709441" status: 202 len: 0 microversion: 2.1 time: 0.033637 Aug 09 15:05:03.738325 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2669/5333] 10.222.0.50 () {58 vars in 1284 bytes} [Tue Aug 9 15:05:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1585709441 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:05:03.784227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2fc14120-ae98-4a4a-85d4-99fdc51a5f37 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'create', calling method: .version_select at 0x7f41ddd7ed30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-473763367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDGYgafpfghfI8GOdoITLv9MGByMiRCWzhP3EgvYjhM67ty8tvRHTmR+lZGABLXkHufW/KK7DtgrHMS3zPW6haUIjmjBEzzCOeqU4a2MHhRDpPcEG/DZghpc6LzMh3Qog=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:03.856157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-2fc14120-ae98-4a4a-85d4-99fdc51a5f37 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for project 889fa240e1f5494d9c11803acd77f74b. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:05:03.875020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-2fc14120-ae98-4a4a-85d4-99fdc51a5f37 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for user 9ff3b746851a4414ba60cb76ac07056b and project 889fa240e1f5494d9c11803acd77f74b. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:05:03.937424 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2fc14120-ae98-4a4a-85d4-99fdc51a5f37 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.156879 Aug 09 15:05:03.938769 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2665/5334] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:05:03 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:05:04.642716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-650c567c-1bb4-453e-963b-713ddaec3e83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:04.643664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-650c567c-1bb4-453e-963b-713ddaec3e83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:04.672273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-650c567c-1bb4-453e-963b-713ddaec3e83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:04.674473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-650c567c-1bb4-453e-963b-713ddaec3e83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:04.676014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-650c567c-1bb4-453e-963b-713ddaec3e83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:04.680567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-650c567c-1bb4-453e-963b-713ddaec3e83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:04.681687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-650c567c-1bb4-453e-963b-713ddaec3e83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:04.683614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-650c567c-1bb4-453e-963b-713ddaec3e83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:05.360316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-650c567c-1bb4-453e-963b-713ddaec3e83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:05.369565 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-650c567c-1bb4-453e-963b-713ddaec3e83 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 0.731465 Aug 09 15:05:05.377747 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2670/5335] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:04 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:06.411856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-469f4a2e-aede-473c-a3fb-4cc9eaa64568 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:06.412515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-469f4a2e-aede-473c-a3fb-4cc9eaa64568 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:06.437086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469f4a2e-aede-473c-a3fb-4cc9eaa64568 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:06.437616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469f4a2e-aede-473c-a3fb-4cc9eaa64568 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:06.438263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469f4a2e-aede-473c-a3fb-4cc9eaa64568 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:06.447891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469f4a2e-aede-473c-a3fb-4cc9eaa64568 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:06.448775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469f4a2e-aede-473c-a3fb-4cc9eaa64568 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:06.450255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-469f4a2e-aede-473c-a3fb-4cc9eaa64568 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:07.117785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-469f4a2e-aede-473c-a3fb-4cc9eaa64568 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:07.126997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:07.137388 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-469f4a2e-aede-473c-a3fb-4cc9eaa64568 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 0.738459 Aug 09 15:05:07.153594 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2666/5336] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:06 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:08.167573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07503477-be6c-47e7-bbca-006720f0c4a1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:08.168864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07503477-be6c-47e7-bbca-006720f0c4a1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:08.184167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07503477-be6c-47e7-bbca-006720f0c4a1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:08.184941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07503477-be6c-47e7-bbca-006720f0c4a1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:08.185582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07503477-be6c-47e7-bbca-006720f0c4a1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:08.186724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07503477-be6c-47e7-bbca-006720f0c4a1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:08.193047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07503477-be6c-47e7-bbca-006720f0c4a1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:08.196819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07503477-be6c-47e7-bbca-006720f0c4a1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:09.401279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07503477-be6c-47e7-bbca-006720f0c4a1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:09.416896 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07503477-be6c-47e7-bbca-006720f0c4a1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 1.253467 Aug 09 15:05:09.417555 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2671/5337] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:08 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:10.445830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cfb25f21-dcf8-43b4-bf12-eb319cd3d646 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:10.446568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cfb25f21-dcf8-43b4-bf12-eb319cd3d646 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:10.462587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfb25f21-dcf8-43b4-bf12-eb319cd3d646 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:10.463263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfb25f21-dcf8-43b4-bf12-eb319cd3d646 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:10.465257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfb25f21-dcf8-43b4-bf12-eb319cd3d646 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:10.468575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfb25f21-dcf8-43b4-bf12-eb319cd3d646 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:10.470069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfb25f21-dcf8-43b4-bf12-eb319cd3d646 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:10.471331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfb25f21-dcf8-43b4-bf12-eb319cd3d646 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:11.168905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cfb25f21-dcf8-43b4-bf12-eb319cd3d646 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:11.193918 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cfb25f21-dcf8-43b4-bf12-eb319cd3d646 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 0.758079 Aug 09 15:05:11.213226 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2667/5338] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:10 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:12.219278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-74a51846-9788-4f11-8de2-3bb0830bc76d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:12.219827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-74a51846-9788-4f11-8de2-3bb0830bc76d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:12.254480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74a51846-9788-4f11-8de2-3bb0830bc76d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:12.257593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74a51846-9788-4f11-8de2-3bb0830bc76d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:12.258299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74a51846-9788-4f11-8de2-3bb0830bc76d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:12.259240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74a51846-9788-4f11-8de2-3bb0830bc76d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:12.260413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74a51846-9788-4f11-8de2-3bb0830bc76d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:12.261078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-74a51846-9788-4f11-8de2-3bb0830bc76d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:12.817491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-74a51846-9788-4f11-8de2-3bb0830bc76d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:12.832425 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-74a51846-9788-4f11-8de2-3bb0830bc76d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 0.617536 Aug 09 15:05:12.834842 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2672/5339] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:12 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:13.858118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4cc9e1d-73ec-48bc-8ff1-62e2c3d95c9b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:13.859426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4cc9e1d-73ec-48bc-8ff1-62e2c3d95c9b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:13.873077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4cc9e1d-73ec-48bc-8ff1-62e2c3d95c9b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:13.877038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4cc9e1d-73ec-48bc-8ff1-62e2c3d95c9b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:13.877762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4cc9e1d-73ec-48bc-8ff1-62e2c3d95c9b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:13.878719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4cc9e1d-73ec-48bc-8ff1-62e2c3d95c9b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:13.882629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4cc9e1d-73ec-48bc-8ff1-62e2c3d95c9b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:13.884231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4cc9e1d-73ec-48bc-8ff1-62e2c3d95c9b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:13.953980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:14.457134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4cc9e1d-73ec-48bc-8ff1-62e2c3d95c9b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:14.467635 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4cc9e1d-73ec-48bc-8ff1-62e2c3d95c9b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 0.613351 Aug 09 15:05:14.474232 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2668/5340] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:13 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:15.497900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e25ec825-76bc-478d-a834-95f243e7a6ab tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:15.498532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e25ec825-76bc-478d-a834-95f243e7a6ab tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:15.505305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:15.553072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e25ec825-76bc-478d-a834-95f243e7a6ab tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:15.573981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e25ec825-76bc-478d-a834-95f243e7a6ab tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:15.578215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e25ec825-76bc-478d-a834-95f243e7a6ab tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:15.579062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e25ec825-76bc-478d-a834-95f243e7a6ab tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:15.579588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e25ec825-76bc-478d-a834-95f243e7a6ab tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:15.580022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e25ec825-76bc-478d-a834-95f243e7a6ab tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:16.265607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e25ec825-76bc-478d-a834-95f243e7a6ab tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:16.294965 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e25ec825-76bc-478d-a834-95f243e7a6ab tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1505 microversion: 2.1 time: 0.804593 Aug 09 15:05:16.297135 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2673/5341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:15 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1505 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:17.320627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d485fc37-33aa-4e19-a800-5063a1c25b82 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:17.321371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d485fc37-33aa-4e19-a800-5063a1c25b82 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:17.333225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d485fc37-33aa-4e19-a800-5063a1c25b82 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:17.333958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d485fc37-33aa-4e19-a800-5063a1c25b82 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:17.334606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d485fc37-33aa-4e19-a800-5063a1c25b82 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:17.336111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d485fc37-33aa-4e19-a800-5063a1c25b82 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:17.336921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d485fc37-33aa-4e19-a800-5063a1c25b82 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:17.337575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d485fc37-33aa-4e19-a800-5063a1c25b82 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:17.555645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d485fc37-33aa-4e19-a800-5063a1c25b82 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:17.555645 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d485fc37-33aa-4e19-a800-5063a1c25b82 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1502 microversion: 2.1 time: 0.239850 Aug 09 15:05:17.556260 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2669/5342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:17 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:18.576824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bfd40c4c-063e-4e2a-b8fb-181252950d53 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:18.577613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bfd40c4c-063e-4e2a-b8fb-181252950d53 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:18.593924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfd40c4c-063e-4e2a-b8fb-181252950d53 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:18.594731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfd40c4c-063e-4e2a-b8fb-181252950d53 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:18.595282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfd40c4c-063e-4e2a-b8fb-181252950d53 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:18.596871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfd40c4c-063e-4e2a-b8fb-181252950d53 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:18.597831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfd40c4c-063e-4e2a-b8fb-181252950d53 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:18.598803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bfd40c4c-063e-4e2a-b8fb-181252950d53 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:19.010518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bfd40c4c-063e-4e2a-b8fb-181252950d53 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:19.035898 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bfd40c4c-063e-4e2a-b8fb-181252950d53 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1502 microversion: 2.1 time: 0.462298 Aug 09 15:05:19.037642 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2674/5343] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:18 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1502 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:20.058686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-48153015-4e72-41aa-bc7a-63d10ece87cb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:20.059580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-48153015-4e72-41aa-bc7a-63d10ece87cb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:20.071139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48153015-4e72-41aa-bc7a-63d10ece87cb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:20.071650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48153015-4e72-41aa-bc7a-63d10ece87cb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:20.072105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48153015-4e72-41aa-bc7a-63d10ece87cb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:20.072832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48153015-4e72-41aa-bc7a-63d10ece87cb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:20.073288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48153015-4e72-41aa-bc7a-63d10ece87cb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:20.073714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48153015-4e72-41aa-bc7a-63d10ece87cb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:20.118579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1415494070", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "9f1b5d20-7fdf-467f-94c0-40673ac1cb6a"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:20.227536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] validate_networks() for [('9f1b5d20-7fdf-467f-94c0-40673ac1cb6a', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:05:20.651749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-48153015-4e72-41aa-bc7a-63d10ece87cb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:20.665934 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-48153015-4e72-41aa-bc7a-63d10ece87cb tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1502 microversion: 2.1 time: 0.611279 Aug 09 15:05:20.667123 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2670/5344] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:20 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1502 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:21.549679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-9c3f8e0d-0000-42a4-9d13-9cd00ed54844 req-e781f519-9061-4340-936c-c5e4c31dcce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c13197-2b16-4472-8f3f-c144ffc8879a", "name": "network-vif-unplugged", "status": "completed", "tag": "9c19066d-e8b5-408b-b063-5288762ff74f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:21.581488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9c3f8e0d-0000-42a4-9d13-9cd00ed54844 req-e781f519-9061-4340-936c-c5e4c31dcce3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:21.581973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9c3f8e0d-0000-42a4-9d13-9cd00ed54844 req-e781f519-9061-4340-936c-c5e4c31dcce3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:21.582408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9c3f8e0d-0000-42a4-9d13-9cd00ed54844 req-e781f519-9061-4340-936c-c5e4c31dcce3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:21.615696 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9c3f8e0d-0000-42a4-9d13-9cd00ed54844 req-e781f519-9061-4340-936c-c5e4c31dcce3 service nova] Creating event network-vif-unplugged:9c19066d-e8b5-408b-b063-5288762ff74f for instance 09c13197-2b16-4472-8f3f-c144ffc8879a on n-h2-844626-8 Aug 09 15:05:21.635277 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-9c3f8e0d-0000-42a4-9d13-9cd00ed54844 req-e781f519-9061-4340-936c-c5e4c31dcce3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089642 Aug 09 15:05:21.636212 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2671/5345] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:05:21.688963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34212c5f-3f3c-4de6-ae86-f185a8c19cb0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:21.689651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34212c5f-3f3c-4de6-ae86-f185a8c19cb0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:21.723779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34212c5f-3f3c-4de6-ae86-f185a8c19cb0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:21.724259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34212c5f-3f3c-4de6-ae86-f185a8c19cb0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:21.724726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34212c5f-3f3c-4de6-ae86-f185a8c19cb0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:21.725494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34212c5f-3f3c-4de6-ae86-f185a8c19cb0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:21.725942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34212c5f-3f3c-4de6-ae86-f185a8c19cb0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:21.726370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34212c5f-3f3c-4de6-ae86-f185a8c19cb0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:22.453042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34212c5f-3f3c-4de6-ae86-f185a8c19cb0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:22.461253 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34212c5f-3f3c-4de6-ae86-f185a8c19cb0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1502 microversion: 2.1 time: 0.776719 Aug 09 15:05:22.464911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2672/5346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:21 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1502 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:22.826417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:05:22.826928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:05:22.833916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:05:22.834555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:05:22.834991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:05:22.872648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:22.880116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:22.880659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:22.881602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:22.882427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:22.883135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:22.967656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Getting quotas for project e0ec11da657342d2aea2dcbedc2735bb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:05:22.985828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Getting quotas for user 033310d1a41c4cefa3d905f65dc6c67e and project e0ec11da657342d2aea2dcbedc2735bb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:05:23.028506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:05:23.036711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:05:23.191456 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-249e4ee2-617b-4035-94c7-0d10f0f82567 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.076496 Aug 09 15:05:23.193772 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2675/5347] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:05:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:05:23.203141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-150600d9-164a-4f67-9eb5-34c8beb85c5c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:23.210106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-150600d9-164a-4f67-9eb5-34c8beb85c5c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:23.367398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-150600d9-164a-4f67-9eb5-34c8beb85c5c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:23.377443 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-150600d9-164a-4f67-9eb5-34c8beb85c5c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1214 microversion: 2.1 time: 0.178008 Aug 09 15:05:23.387244 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2673/5348] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:23 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:23.491689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd9405be-d960-401a-bd55-1b3676db77ec tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:23.494893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd9405be-d960-401a-bd55-1b3676db77ec tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:23.514277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd9405be-d960-401a-bd55-1b3676db77ec tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:23.514882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd9405be-d960-401a-bd55-1b3676db77ec tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:23.515382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd9405be-d960-401a-bd55-1b3676db77ec tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:23.516653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd9405be-d960-401a-bd55-1b3676db77ec tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:23.517141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd9405be-d960-401a-bd55-1b3676db77ec tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:23.518682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd9405be-d960-401a-bd55-1b3676db77ec tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:24.242203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-724345211", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c3cd0241-8e4e-4183-bbe2-c2cd5781a263", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:24.385412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] validate_networks() for [('1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:05:24.810524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd9405be-d960-401a-bd55-1b3676db77ec tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:24.824552 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd9405be-d960-401a-bd55-1b3676db77ec tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 200 len: 1445 microversion: 2.1 time: 1.344710 Aug 09 15:05:24.851767 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2676/5349] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:23 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 1445 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:24.862201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40505029-e221-4608-940e-cb0316312a56 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:24.867005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40505029-e221-4608-940e-cb0316312a56 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:24.914190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40505029-e221-4608-940e-cb0316312a56 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:24.919953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40505029-e221-4608-940e-cb0316312a56 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:24.920397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40505029-e221-4608-940e-cb0316312a56 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:24.922300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40505029-e221-4608-940e-cb0316312a56 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:24.922745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40505029-e221-4608-940e-cb0316312a56 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:24.925699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40505029-e221-4608-940e-cb0316312a56 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:25.181644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40505029-e221-4608-940e-cb0316312a56 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:25.193301 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40505029-e221-4608-940e-cb0316312a56 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1210 microversion: 2.1 time: 0.340010 Aug 09 15:05:25.203298 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2677/5350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:24 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1210 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:25.222670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1ef318a9-dbbe-4dc4-ace3-477c788df9d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:25.258751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1ef318a9-dbbe-4dc4-ace3-477c788df9d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:25.279052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ef318a9-dbbe-4dc4-ace3-477c788df9d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:25.289793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ef318a9-dbbe-4dc4-ace3-477c788df9d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:25.291784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ef318a9-dbbe-4dc4-ace3-477c788df9d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:25.293687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ef318a9-dbbe-4dc4-ace3-477c788df9d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:25.295591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ef318a9-dbbe-4dc4-ace3-477c788df9d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:25.299426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1ef318a9-dbbe-4dc4-ace3-477c788df9d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:25.901510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1ef318a9-dbbe-4dc4-ace3-477c788df9d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:25.916477 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1ef318a9-dbbe-4dc4-ace3-477c788df9d7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.713624 Aug 09 15:05:25.917539 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2678/5351] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:25 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:25.948919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-61bcc6d0-691a-42b5-ada0-f4ebef6cca47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:25.949549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-61bcc6d0-691a-42b5-ada0-f4ebef6cca47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:25.957697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61bcc6d0-691a-42b5-ada0-f4ebef6cca47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:25.958175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61bcc6d0-691a-42b5-ada0-f4ebef6cca47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:25.958602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61bcc6d0-691a-42b5-ada0-f4ebef6cca47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:25.959329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61bcc6d0-691a-42b5-ada0-f4ebef6cca47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:25.959775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61bcc6d0-691a-42b5-ada0-f4ebef6cca47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:25.960274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61bcc6d0-691a-42b5-ada0-f4ebef6cca47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:26.500429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:05:26.501225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:05:26.501715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:05:26.502300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:05:26.502719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:05:26.507929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-61bcc6d0-691a-42b5-ada0-f4ebef6cca47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:26.524082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:26.524569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:26.524998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:26.525714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:26.526159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:26.526575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:26.532457 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-61bcc6d0-691a-42b5-ada0-f4ebef6cca47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.587030 Aug 09 15:05:26.535292 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2679/5352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:25 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:26.554131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0bcd4fd4-869d-43d4-9a4b-062ac306479c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:26.557097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0bcd4fd4-869d-43d4-9a4b-062ac306479c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:26.571624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bcd4fd4-869d-43d4-9a4b-062ac306479c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:26.573978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bcd4fd4-869d-43d4-9a4b-062ac306479c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:26.575468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bcd4fd4-869d-43d4-9a4b-062ac306479c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:26.577843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bcd4fd4-869d-43d4-9a4b-062ac306479c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:26.579779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bcd4fd4-869d-43d4-9a4b-062ac306479c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:26.582414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bcd4fd4-869d-43d4-9a4b-062ac306479c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:26.586347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:05:26.595247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for user f99b0693d22442ffa84b9c845d7cbc58 and project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:05:26.721162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:05:26.724130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c3cd0241-8e4e-4183-bbe2-c2cd5781a263',volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:05:26.760943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0bcd4fd4-869d-43d4-9a4b-062ac306479c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:26.782079 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0bcd4fd4-869d-43d4-9a4b-062ac306479c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1272 microversion: 2.1 time: 0.245291 Aug 09 15:05:26.786314 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2680/5353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:26 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:26.801508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e9c9570-a34a-41f6-bb1e-3526dbda9329 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:26.804080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e9c9570-a34a-41f6-bb1e-3526dbda9329 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:26.828542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e9c9570-a34a-41f6-bb1e-3526dbda9329 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:26.829923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e9c9570-a34a-41f6-bb1e-3526dbda9329 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:26.834114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e9c9570-a34a-41f6-bb1e-3526dbda9329 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:26.837328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e9c9570-a34a-41f6-bb1e-3526dbda9329 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:26.839203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e9c9570-a34a-41f6-bb1e-3526dbda9329 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:26.841384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e9c9570-a34a-41f6-bb1e-3526dbda9329 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:26.851704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=72 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:27.053217 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03089394-1e64-4ed1-a9fb-9288d196fd51 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.817884 Aug 09 15:05:27.054743 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2674/5354] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:05:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:05:27.066421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-61573cd9-63ec-4908-82cd-646479270296 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:27.067427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-61573cd9-63ec-4908-82cd-646479270296 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:27.244803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-61573cd9-63ec-4908-82cd-646479270296 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:27.257989 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-61573cd9-63ec-4908-82cd-646479270296 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1056 microversion: 2.1 time: 0.194024 Aug 09 15:05:27.274667 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2675/5355] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:27 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1056 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:27.396261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5e9c9570-a34a-41f6-bb1e-3526dbda9329 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:27.418534 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e9c9570-a34a-41f6-bb1e-3526dbda9329 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.622869 Aug 09 15:05:27.448843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52c88ac3-e0b4-40ca-86b6-a3dbf68aeb8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:27.449667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52c88ac3-e0b4-40ca-86b6-a3dbf68aeb8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:27.458246 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2681/5356] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:26 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:27.461591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52c88ac3-e0b4-40ca-86b6-a3dbf68aeb8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:27.463278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52c88ac3-e0b4-40ca-86b6-a3dbf68aeb8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:27.463972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52c88ac3-e0b4-40ca-86b6-a3dbf68aeb8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:27.465327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52c88ac3-e0b4-40ca-86b6-a3dbf68aeb8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:27.467467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52c88ac3-e0b4-40ca-86b6-a3dbf68aeb8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:27.469141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52c88ac3-e0b4-40ca-86b6-a3dbf68aeb8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:27.804728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eb43eaa0-f424-4f9d-838f-0f517f495e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:27.805664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eb43eaa0-f424-4f9d-838f-0f517f495e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:27.818083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb43eaa0-f424-4f9d-838f-0f517f495e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:27.819680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb43eaa0-f424-4f9d-838f-0f517f495e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:27.822491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb43eaa0-f424-4f9d-838f-0f517f495e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:27.827300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb43eaa0-f424-4f9d-838f-0f517f495e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:27.828323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb43eaa0-f424-4f9d-838f-0f517f495e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:27.828997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb43eaa0-f424-4f9d-838f-0f517f495e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:27.900361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-52c88ac3-e0b4-40ca-86b6-a3dbf68aeb8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:27.911010 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52c88ac3-e0b4-40ca-86b6-a3dbf68aeb8a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.467217 Aug 09 15:05:27.913828 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2676/5357] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:27 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:27.935587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-22417c73-81de-4f81-a29f-5bdafa766809 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:27.945560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22417c73-81de-4f81-a29f-5bdafa766809 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:27.947821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22417c73-81de-4f81-a29f-5bdafa766809 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:27.951574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-22417c73-81de-4f81-a29f-5bdafa766809 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:28.006011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-22417c73-81de-4f81-a29f-5bdafa766809 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Going to try to stop instance {{(pid=119406) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 15:05:28.092498 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-22417c73-81de-4f81-a29f-5bdafa766809 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.161502 Aug 09 15:05:28.094493 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2677/5358] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:05:27 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:05:28.133408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d9025f5-0a28-4503-a1d5-7c1c4b99ec47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:28.134950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3d9025f5-0a28-4503-a1d5-7c1c4b99ec47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:28.143456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d9025f5-0a28-4503-a1d5-7c1c4b99ec47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:28.145077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d9025f5-0a28-4503-a1d5-7c1c4b99ec47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:28.145845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d9025f5-0a28-4503-a1d5-7c1c4b99ec47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:28.147210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d9025f5-0a28-4503-a1d5-7c1c4b99ec47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:28.149547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d9025f5-0a28-4503-a1d5-7c1c4b99ec47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:28.150168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d9025f5-0a28-4503-a1d5-7c1c4b99ec47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:28.685192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d9025f5-0a28-4503-a1d5-7c1c4b99ec47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:28.694197 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d9025f5-0a28-4503-a1d5-7c1c4b99ec47 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.573382 Aug 09 15:05:28.700420 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2678/5359] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:28 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:28.709934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3e6f4650-3f62-4a9e-8a2d-5ee0db77fb04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:28.721351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3e6f4650-3f62-4a9e-8a2d-5ee0db77fb04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:28.730401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e6f4650-3f62-4a9e-8a2d-5ee0db77fb04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:28.731321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e6f4650-3f62-4a9e-8a2d-5ee0db77fb04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:28.733678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e6f4650-3f62-4a9e-8a2d-5ee0db77fb04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:28.737961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e6f4650-3f62-4a9e-8a2d-5ee0db77fb04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:28.738736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e6f4650-3f62-4a9e-8a2d-5ee0db77fb04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:28.739492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e6f4650-3f62-4a9e-8a2d-5ee0db77fb04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:28.882512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eb43eaa0-f424-4f9d-838f-0f517f495e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:28.891827 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eb43eaa0-f424-4f9d-838f-0f517f495e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1314 microversion: 2.1 time: 1.092118 Aug 09 15:05:28.901167 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2682/5360] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:27 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1314 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:28.924587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3e6f4650-3f62-4a9e-8a2d-5ee0db77fb04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:28.935704 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3e6f4650-3f62-4a9e-8a2d-5ee0db77fb04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1154 microversion: 2.1 time: 0.233624 Aug 09 15:05:28.937890 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2679/5361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:28 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1154 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:29.687900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1532597818", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "e887ae5e-6436-4c9e-9eb9-30fe904acb9f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-473763367", "security_groups": [{"name": "tempest-secgroup-smoke-890039788"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:29.721743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a9739a3e-7c6e-4889-bdb9-849404edfb55 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:29.722557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a9739a3e-7c6e-4889-bdb9-849404edfb55 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:29.735432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:29.737006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9739a3e-7c6e-4889-bdb9-849404edfb55 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:29.737576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9739a3e-7c6e-4889-bdb9-849404edfb55 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:29.738018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9739a3e-7c6e-4889-bdb9-849404edfb55 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:29.738735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9739a3e-7c6e-4889-bdb9-849404edfb55 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:29.739254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9739a3e-7c6e-4889-bdb9-849404edfb55 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:29.742498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a9739a3e-7c6e-4889-bdb9-849404edfb55 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:30.100263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] validate_networks() for [('e887ae5e-6436-4c9e-9eb9-30fe904acb9f', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:05:30.409391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a9739a3e-7c6e-4889-bdb9-849404edfb55 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:30.431955 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a9739a3e-7c6e-4889-bdb9-849404edfb55 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.710666 Aug 09 15:05:30.432758 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2680/5362] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:29 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:30.444330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c365fa8-516d-40e0-90b1-d147b7522397 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:30.445187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c365fa8-516d-40e0-90b1-d147b7522397 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:30.467502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c365fa8-516d-40e0-90b1-d147b7522397 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:30.468186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c365fa8-516d-40e0-90b1-d147b7522397 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:30.469744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c365fa8-516d-40e0-90b1-d147b7522397 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:30.470746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c365fa8-516d-40e0-90b1-d147b7522397 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:30.471403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c365fa8-516d-40e0-90b1-d147b7522397 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:30.471982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c365fa8-516d-40e0-90b1-d147b7522397 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:30.782978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c365fa8-516d-40e0-90b1-d147b7522397 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:30.796511 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c365fa8-516d-40e0-90b1-d147b7522397 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1314 microversion: 2.1 time: 0.362304 Aug 09 15:05:30.797524 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2681/5363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:30 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:30.805395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-89ffcbd6-e28d-47ff-8b47-7900de0fdb43 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:30.809069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-89ffcbd6-e28d-47ff-8b47-7900de0fdb43 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:30.822016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89ffcbd6-e28d-47ff-8b47-7900de0fdb43 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:30.824829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89ffcbd6-e28d-47ff-8b47-7900de0fdb43 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:30.827970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89ffcbd6-e28d-47ff-8b47-7900de0fdb43 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:30.829162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89ffcbd6-e28d-47ff-8b47-7900de0fdb43 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:30.829852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89ffcbd6-e28d-47ff-8b47-7900de0fdb43 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:30.832931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89ffcbd6-e28d-47ff-8b47-7900de0fdb43 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:31.207679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:05:31.208853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:05:31.209488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:05:31.210152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:05:31.210711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:05:31.242144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:31.245314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:31.246968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:31.250057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:31.252299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:31.254873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:31.271402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-89ffcbd6-e28d-47ff-8b47-7900de0fdb43 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:31.281304 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-89ffcbd6-e28d-47ff-8b47-7900de0fdb43 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1214 microversion: 2.1 time: 0.481425 Aug 09 15:05:31.296140 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2682/5364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:30 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1214 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:31.301503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-520891f8-fa9b-4069-a145-c537098e5d31 req-f5addbd6-686c-459a-90ae-9e9b2b7bf3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "587291ca-a958-46d1-8264-90c8ffcea29e", "tag": "8ad08cca-8029-4bca-8e76-72d6fa7b7bf7"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:31.308062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for project 889fa240e1f5494d9c11803acd77f74b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:05:31.313808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-520891f8-fa9b-4069-a145-c537098e5d31 req-f5addbd6-686c-459a-90ae-9e9b2b7bf3b1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:31.314590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-520891f8-fa9b-4069-a145-c537098e5d31 req-f5addbd6-686c-459a-90ae-9e9b2b7bf3b1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:31.315246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-520891f8-fa9b-4069-a145-c537098e5d31 req-f5addbd6-686c-459a-90ae-9e9b2b7bf3b1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:31.325533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for user 9ff3b746851a4414ba60cb76ac07056b and project 889fa240e1f5494d9c11803acd77f74b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:05:31.330189 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-520891f8-fa9b-4069-a145-c537098e5d31 req-f5addbd6-686c-459a-90ae-9e9b2b7bf3b1 service nova] Creating event network-changed:8ad08cca-8029-4bca-8e76-72d6fa7b7bf7 for instance 587291ca-a958-46d1-8264-90c8ffcea29e on n-h2-844626-8 Aug 09 15:05:31.335844 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-520891f8-fa9b-4069-a145-c537098e5d31 req-f5addbd6-686c-459a-90ae-9e9b2b7bf3b1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038098 Aug 09 15:05:31.337383 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2683/5365] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:05:31.354515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:05:31.357216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:05:31.457563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06adac24-1e8a-4ca4-b10d-2a1c5f0cd3dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:31.459148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-06adac24-1e8a-4ca4-b10d-2a1c5f0cd3dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:31.474461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06adac24-1e8a-4ca4-b10d-2a1c5f0cd3dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:31.475313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06adac24-1e8a-4ca4-b10d-2a1c5f0cd3dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:31.475915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06adac24-1e8a-4ca4-b10d-2a1c5f0cd3dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:31.476850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06adac24-1e8a-4ca4-b10d-2a1c5f0cd3dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:31.477829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06adac24-1e8a-4ca4-b10d-2a1c5f0cd3dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:31.478507 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-093b5de0-9cd0-4a00-a1e8-057838e3aa97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.793469 Aug 09 15:05:31.478973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06adac24-1e8a-4ca4-b10d-2a1c5f0cd3dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:31.484180 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2683/5366] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:05:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:05:31.495272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14b6ed51-d3c5-4304-904d-0111f54be80f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:31.499747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14b6ed51-d3c5-4304-904d-0111f54be80f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:31.632940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14b6ed51-d3c5-4304-904d-0111f54be80f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:31.642199 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14b6ed51-d3c5-4304-904d-0111f54be80f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1266 microversion: 2.1 time: 0.150786 Aug 09 15:05:31.642971 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2684/5367] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:31 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:31.775195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-06adac24-1e8a-4ca4-b10d-2a1c5f0cd3dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:31.788439 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-06adac24-1e8a-4ca4-b10d-2a1c5f0cd3dc tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.335497 Aug 09 15:05:31.792543 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2684/5368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:31 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:31.823994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fadcc8c1-5e95-4c70-9ff2-7d709ac203b8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:31.824955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fadcc8c1-5e95-4c70-9ff2-7d709ac203b8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:31.841344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fadcc8c1-5e95-4c70-9ff2-7d709ac203b8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:31.841941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fadcc8c1-5e95-4c70-9ff2-7d709ac203b8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:31.842481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fadcc8c1-5e95-4c70-9ff2-7d709ac203b8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:31.843320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fadcc8c1-5e95-4c70-9ff2-7d709ac203b8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:31.843873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fadcc8c1-5e95-4c70-9ff2-7d709ac203b8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:31.854647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fadcc8c1-5e95-4c70-9ff2-7d709ac203b8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:32.121794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fadcc8c1-5e95-4c70-9ff2-7d709ac203b8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:32.130883 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fadcc8c1-5e95-4c70-9ff2-7d709ac203b8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1314 microversion: 2.1 time: 0.311024 Aug 09 15:05:32.133581 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2685/5369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:31 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:32.303621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ab33e1bf-9b2a-4a52-be8c-5ab692487410 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:32.304626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ab33e1bf-9b2a-4a52-be8c-5ab692487410 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:32.313216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab33e1bf-9b2a-4a52-be8c-5ab692487410 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:32.314446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab33e1bf-9b2a-4a52-be8c-5ab692487410 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:32.315531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab33e1bf-9b2a-4a52-be8c-5ab692487410 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:32.316970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab33e1bf-9b2a-4a52-be8c-5ab692487410 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:32.319312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab33e1bf-9b2a-4a52-be8c-5ab692487410 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:32.319991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab33e1bf-9b2a-4a52-be8c-5ab692487410 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:32.662829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee157c16-7fbf-4276-a477-bc58497256ff tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:32.663780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee157c16-7fbf-4276-a477-bc58497256ff tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:32.676427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee157c16-7fbf-4276-a477-bc58497256ff tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:32.679608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee157c16-7fbf-4276-a477-bc58497256ff tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:32.687499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee157c16-7fbf-4276-a477-bc58497256ff tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:32.688878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee157c16-7fbf-4276-a477-bc58497256ff tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:32.691505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee157c16-7fbf-4276-a477-bc58497256ff tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:32.692459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee157c16-7fbf-4276-a477-bc58497256ff tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:33.628126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee157c16-7fbf-4276-a477-bc58497256ff tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:33.637233 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee157c16-7fbf-4276-a477-bc58497256ff tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1262 microversion: 2.1 time: 0.978394 Aug 09 15:05:33.645106 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2686/5370] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:32 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1262 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:33.666409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dcab074a-572f-46d7-bb7a-dbb20c916553 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:33.667116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dcab074a-572f-46d7-bb7a-dbb20c916553 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:33.677839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcab074a-572f-46d7-bb7a-dbb20c916553 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:33.678327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcab074a-572f-46d7-bb7a-dbb20c916553 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:33.678757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcab074a-572f-46d7-bb7a-dbb20c916553 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:33.684082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcab074a-572f-46d7-bb7a-dbb20c916553 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:33.687048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcab074a-572f-46d7-bb7a-dbb20c916553 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:33.687724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dcab074a-572f-46d7-bb7a-dbb20c916553 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:33.739343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ab33e1bf-9b2a-4a52-be8c-5ab692487410 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:33.753384 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ab33e1bf-9b2a-4a52-be8c-5ab692487410 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1214 microversion: 2.1 time: 1.454116 Aug 09 15:05:33.770111 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2685/5371] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:32 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1214 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:33.779557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2567cea2-744c-4c06-a66f-3465cc670183 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:33.780523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2567cea2-744c-4c06-a66f-3465cc670183 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:33.787672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2567cea2-744c-4c06-a66f-3465cc670183 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:33.790105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2567cea2-744c-4c06-a66f-3465cc670183 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:33.796583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2567cea2-744c-4c06-a66f-3465cc670183 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:33.797366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2567cea2-744c-4c06-a66f-3465cc670183 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:33.797840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2567cea2-744c-4c06-a66f-3465cc670183 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:33.798273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2567cea2-744c-4c06-a66f-3465cc670183 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:33.851453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:34.182828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dcab074a-572f-46d7-bb7a-dbb20c916553 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:34.195690 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dcab074a-572f-46d7-bb7a-dbb20c916553 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.548773 Aug 09 15:05:34.196285 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2687/5372] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:33 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:34.202822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-bdc8a861-dbcd-4deb-b31d-da30c835ff5a req-8c1f34b6-ffc5-49ae-8235-f1bee168ca10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2dd98462-10c0-47f0-93a9-eb59730f6871", "tag": "03176526-0a12-4f15-8e80-6c0a4903cd9b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:34.212845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bdc8a861-dbcd-4deb-b31d-da30c835ff5a req-8c1f34b6-ffc5-49ae-8235-f1bee168ca10 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:34.213592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bdc8a861-dbcd-4deb-b31d-da30c835ff5a req-8c1f34b6-ffc5-49ae-8235-f1bee168ca10 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:34.219896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bdc8a861-dbcd-4deb-b31d-da30c835ff5a req-8c1f34b6-ffc5-49ae-8235-f1bee168ca10 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:34.238701 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-bdc8a861-dbcd-4deb-b31d-da30c835ff5a req-8c1f34b6-ffc5-49ae-8235-f1bee168ca10 service nova] Creating event network-changed:03176526-0a12-4f15-8e80-6c0a4903cd9b for instance 2dd98462-10c0-47f0-93a9-eb59730f6871 on n-h1-844626-8 Aug 09 15:05:34.260027 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-bdc8a861-dbcd-4deb-b31d-da30c835ff5a req-8c1f34b6-ffc5-49ae-8235-f1bee168ca10 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062186 Aug 09 15:05:34.266945 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2688/5373] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:05:34.315967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2567cea2-744c-4c06-a66f-3465cc670183 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:34.356029 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2567cea2-744c-4c06-a66f-3465cc670183 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1314 microversion: 2.1 time: 0.584157 Aug 09 15:05:34.361768 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2686/5374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:33 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:34.662829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c6d636a4-d2be-44f2-b9bc-b64d233d4fc4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:34.663926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c6d636a4-d2be-44f2-b9bc-b64d233d4fc4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:34.675419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6d636a4-d2be-44f2-b9bc-b64d233d4fc4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:34.676158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6d636a4-d2be-44f2-b9bc-b64d233d4fc4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:34.676532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6d636a4-d2be-44f2-b9bc-b64d233d4fc4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:34.677303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6d636a4-d2be-44f2-b9bc-b64d233d4fc4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:34.677763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6d636a4-d2be-44f2-b9bc-b64d233d4fc4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:34.678213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6d636a4-d2be-44f2-b9bc-b64d233d4fc4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:34.775345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b43ac6af-ac07-41af-b253-889212ed4c11 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:34.776910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b43ac6af-ac07-41af-b253-889212ed4c11 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:34.792170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b43ac6af-ac07-41af-b253-889212ed4c11 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:34.792945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b43ac6af-ac07-41af-b253-889212ed4c11 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:34.793561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b43ac6af-ac07-41af-b253-889212ed4c11 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:34.794442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b43ac6af-ac07-41af-b253-889212ed4c11 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:34.795588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b43ac6af-ac07-41af-b253-889212ed4c11 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:34.797186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b43ac6af-ac07-41af-b253-889212ed4c11 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:34.818033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c6d636a4-d2be-44f2-b9bc-b64d233d4fc4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:34.829879 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c6d636a4-d2be-44f2-b9bc-b64d233d4fc4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1324 microversion: 2.1 time: 0.171340 Aug 09 15:05:34.830938 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2689/5375] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:34 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1324 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:35.214158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b43ac6af-ac07-41af-b253-889212ed4c11 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:35.219030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a1103b0c-cbf4-4873-a481-1357813cc2b3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:35.219870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a1103b0c-cbf4-4873-a481-1357813cc2b3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:35.225948 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b43ac6af-ac07-41af-b253-889212ed4c11 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1214 microversion: 2.1 time: 0.454687 Aug 09 15:05:35.227254 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2687/5376] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:34 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1214 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:35.252556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1103b0c-cbf4-4873-a481-1357813cc2b3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:35.253168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1103b0c-cbf4-4873-a481-1357813cc2b3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:35.255484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1103b0c-cbf4-4873-a481-1357813cc2b3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:35.267927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1103b0c-cbf4-4873-a481-1357813cc2b3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:35.268594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1103b0c-cbf4-4873-a481-1357813cc2b3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:35.269294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1103b0c-cbf4-4873-a481-1357813cc2b3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:35.380612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f70cf5a5-c4e8-44a7-903e-b70f3e5e269d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:35.381299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f70cf5a5-c4e8-44a7-903e-b70f3e5e269d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:35.389757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f70cf5a5-c4e8-44a7-903e-b70f3e5e269d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:35.390554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f70cf5a5-c4e8-44a7-903e-b70f3e5e269d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:35.392054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f70cf5a5-c4e8-44a7-903e-b70f3e5e269d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:35.393053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f70cf5a5-c4e8-44a7-903e-b70f3e5e269d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:35.393692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f70cf5a5-c4e8-44a7-903e-b70f3e5e269d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:35.394290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f70cf5a5-c4e8-44a7-903e-b70f3e5e269d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:35.902839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f70cf5a5-c4e8-44a7-903e-b70f3e5e269d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:35.915054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a1103b0c-cbf4-4873-a481-1357813cc2b3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:35.920143 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f70cf5a5-c4e8-44a7-903e-b70f3e5e269d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1314 microversion: 2.1 time: 0.544798 Aug 09 15:05:35.921306 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2688/5377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:35 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:35.927783 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a1103b0c-cbf4-4873-a481-1357813cc2b3 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.714714 Aug 09 15:05:35.942344 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2690/5378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:35 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:35.944517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-929fa696-643c-40f6-a7df-89ea41897950 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:35.945366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-929fa696-643c-40f6-a7df-89ea41897950 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:35.963871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-929fa696-643c-40f6-a7df-89ea41897950 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:35.966657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-929fa696-643c-40f6-a7df-89ea41897950 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:35.967357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-929fa696-643c-40f6-a7df-89ea41897950 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:35.968289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-929fa696-643c-40f6-a7df-89ea41897950 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:35.973743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-929fa696-643c-40f6-a7df-89ea41897950 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:35.981475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-929fa696-643c-40f6-a7df-89ea41897950 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:36.250668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a15559dc-98b8-4f76-9a12-25929a594f4f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:36.251349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a15559dc-98b8-4f76-9a12-25929a594f4f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:36.286998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a15559dc-98b8-4f76-9a12-25929a594f4f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:36.287517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a15559dc-98b8-4f76-9a12-25929a594f4f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:36.288466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a15559dc-98b8-4f76-9a12-25929a594f4f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:36.288727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a15559dc-98b8-4f76-9a12-25929a594f4f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:36.289083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a15559dc-98b8-4f76-9a12-25929a594f4f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:36.289494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a15559dc-98b8-4f76-9a12-25929a594f4f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:36.380367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-929fa696-643c-40f6-a7df-89ea41897950 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:36.405898 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-929fa696-643c-40f6-a7df-89ea41897950 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1391 microversion: 2.1 time: 0.479736 Aug 09 15:05:36.411499 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2689/5379] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:35 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1391 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:36.910650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a15559dc-98b8-4f76-9a12-25929a594f4f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:36.928014 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a15559dc-98b8-4f76-9a12-25929a594f4f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1214 microversion: 2.1 time: 0.683081 Aug 09 15:05:36.930645 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2691/5380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:36 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1214 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:36.944150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5bae580e-9bb7-4956-a419-55d1dbb68c86 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:36.947954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5bae580e-9bb7-4956-a419-55d1dbb68c86 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:36.959756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33fcd232-7388-412a-ae82-4415602d493f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:36.963584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-33fcd232-7388-412a-ae82-4415602d493f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:36.969268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:36.980697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bae580e-9bb7-4956-a419-55d1dbb68c86 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:36.985531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bae580e-9bb7-4956-a419-55d1dbb68c86 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:36.986854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bae580e-9bb7-4956-a419-55d1dbb68c86 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:36.991235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bae580e-9bb7-4956-a419-55d1dbb68c86 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:36.992723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33fcd232-7388-412a-ae82-4415602d493f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:36.994955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bae580e-9bb7-4956-a419-55d1dbb68c86 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:36.995908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33fcd232-7388-412a-ae82-4415602d493f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:36.997557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5bae580e-9bb7-4956-a419-55d1dbb68c86 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:36.999308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33fcd232-7388-412a-ae82-4415602d493f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:37.001191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33fcd232-7388-412a-ae82-4415602d493f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:37.002418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33fcd232-7388-412a-ae82-4415602d493f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:37.003584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33fcd232-7388-412a-ae82-4415602d493f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:37.254292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=10 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:37.481046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-33fcd232-7388-412a-ae82-4415602d493f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:37.494069 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-33fcd232-7388-412a-ae82-4415602d493f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1675 microversion: 2.1 time: 0.548021 Aug 09 15:05:37.502022 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2692/5381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:36 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1675 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:37.509274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2cb1842a-c21e-4199-947f-96032209348b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:37.510608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2cb1842a-c21e-4199-947f-96032209348b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:37.519688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cb1842a-c21e-4199-947f-96032209348b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:37.520795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cb1842a-c21e-4199-947f-96032209348b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:37.521474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cb1842a-c21e-4199-947f-96032209348b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:37.523589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cb1842a-c21e-4199-947f-96032209348b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:37.524313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cb1842a-c21e-4199-947f-96032209348b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:37.524917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cb1842a-c21e-4199-947f-96032209348b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:37.534935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5bae580e-9bb7-4956-a419-55d1dbb68c86 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:37.554668 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5bae580e-9bb7-4956-a419-55d1dbb68c86 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1314 microversion: 2.1 time: 0.616190 Aug 09 15:05:37.558713 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2690/5382] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:36 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:37.853730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f7671e3a-e8c1-4aaf-873f-d71e89d106cd req-8b1f25e2-8b5b-4d97-bdd0-be0a8e863203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caaadba4-bf8c-4e32-b86f-a6e0e68bbd93", "tag": "90f33f03-4270-4292-a57d-108d8d490b0a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:37.876784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f7671e3a-e8c1-4aaf-873f-d71e89d106cd req-8b1f25e2-8b5b-4d97-bdd0-be0a8e863203 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:37.877389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f7671e3a-e8c1-4aaf-873f-d71e89d106cd req-8b1f25e2-8b5b-4d97-bdd0-be0a8e863203 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:37.878027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f7671e3a-e8c1-4aaf-873f-d71e89d106cd req-8b1f25e2-8b5b-4d97-bdd0-be0a8e863203 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:37.904034 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f7671e3a-e8c1-4aaf-873f-d71e89d106cd req-8b1f25e2-8b5b-4d97-bdd0-be0a8e863203 service nova] Creating event network-changed:90f33f03-4270-4292-a57d-108d8d490b0a for instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 on n-h2-844626-8 Aug 09 15:05:37.910966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2cb1842a-c21e-4199-947f-96032209348b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:37.920093 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f7671e3a-e8c1-4aaf-873f-d71e89d106cd req-8b1f25e2-8b5b-4d97-bdd0-be0a8e863203 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069942 Aug 09 15:05:37.921447 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2691/5383] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:05:37.927430 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2cb1842a-c21e-4199-947f-96032209348b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1391 microversion: 2.1 time: 0.423806 Aug 09 15:05:37.941841 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2693/5384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:37 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1391 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:37.961856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e72b03c-b213-4e05-af47-8520e5269f3d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:37.962561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2e72b03c-b213-4e05-af47-8520e5269f3d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:37.980821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e72b03c-b213-4e05-af47-8520e5269f3d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:37.981661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e72b03c-b213-4e05-af47-8520e5269f3d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:37.983462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e72b03c-b213-4e05-af47-8520e5269f3d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:37.984973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e72b03c-b213-4e05-af47-8520e5269f3d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:37.985655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e72b03c-b213-4e05-af47-8520e5269f3d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:37.986925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e72b03c-b213-4e05-af47-8520e5269f3d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:38.342845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2e72b03c-b213-4e05-af47-8520e5269f3d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:38.355494 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2e72b03c-b213-4e05-af47-8520e5269f3d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1214 microversion: 2.1 time: 0.397357 Aug 09 15:05:38.357402 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2692/5385] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:37 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1214 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:38.530144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f59da5a4-a6ba-4dd6-a2d1-561c49167a64 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:38.531843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f59da5a4-a6ba-4dd6-a2d1-561c49167a64 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:38.544616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f59da5a4-a6ba-4dd6-a2d1-561c49167a64 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:38.547674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f59da5a4-a6ba-4dd6-a2d1-561c49167a64 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:38.557214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f59da5a4-a6ba-4dd6-a2d1-561c49167a64 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:38.558145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f59da5a4-a6ba-4dd6-a2d1-561c49167a64 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:38.558889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f59da5a4-a6ba-4dd6-a2d1-561c49167a64 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:38.559688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f59da5a4-a6ba-4dd6-a2d1-561c49167a64 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:38.579837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-61e3e0a8-9553-429e-9267-cd88ddcfe00c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:38.580926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-61e3e0a8-9553-429e-9267-cd88ddcfe00c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:38.588394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61e3e0a8-9553-429e-9267-cd88ddcfe00c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:38.594148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61e3e0a8-9553-429e-9267-cd88ddcfe00c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:38.594943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61e3e0a8-9553-429e-9267-cd88ddcfe00c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:38.596132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61e3e0a8-9553-429e-9267-cd88ddcfe00c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:38.596816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61e3e0a8-9553-429e-9267-cd88ddcfe00c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:38.597498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61e3e0a8-9553-429e-9267-cd88ddcfe00c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:38.888254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-61e3e0a8-9553-429e-9267-cd88ddcfe00c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:38.901320 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-61e3e0a8-9553-429e-9267-cd88ddcfe00c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1314 microversion: 2.1 time: 0.326995 Aug 09 15:05:38.901908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f59da5a4-a6ba-4dd6-a2d1-561c49167a64 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:38.904041 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2693/5386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:38 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:38.911387 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f59da5a4-a6ba-4dd6-a2d1-561c49167a64 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1652 microversion: 2.1 time: 0.386131 Aug 09 15:05:38.923668 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2694/5387] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:38 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1652 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:38.933841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-116cec88-bdb7-48c1-b268-1f0c447e4a98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:38.942800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-116cec88-bdb7-48c1-b268-1f0c447e4a98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:38.948092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-116cec88-bdb7-48c1-b268-1f0c447e4a98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:38.950100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-116cec88-bdb7-48c1-b268-1f0c447e4a98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:38.952703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-400717a7-7a06-4cfd-8b64-ac5c8ff363cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:38.956083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-400717a7-7a06-4cfd-8b64-ac5c8ff363cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:38.981889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400717a7-7a06-4cfd-8b64-ac5c8ff363cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:38.983862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400717a7-7a06-4cfd-8b64-ac5c8ff363cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:38.985800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400717a7-7a06-4cfd-8b64-ac5c8ff363cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:38.985800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400717a7-7a06-4cfd-8b64-ac5c8ff363cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:38.990889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400717a7-7a06-4cfd-8b64-ac5c8ff363cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:38.992251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-400717a7-7a06-4cfd-8b64-ac5c8ff363cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:39.027789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-116cec88-bdb7-48c1-b268-1f0c447e4a98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Going to try to start instance {{(pid=119406) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 15:05:39.098231 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-116cec88-bdb7-48c1-b268-1f0c447e4a98 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.168908 Aug 09 15:05:39.104548 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2694/5388] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:05:38 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:05:39.112432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7e328099-4ebc-43e7-82be-441f964ba69b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:39.113504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7e328099-4ebc-43e7-82be-441f964ba69b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:39.121544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e328099-4ebc-43e7-82be-441f964ba69b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:39.123233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e328099-4ebc-43e7-82be-441f964ba69b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:39.123939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e328099-4ebc-43e7-82be-441f964ba69b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:39.125227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e328099-4ebc-43e7-82be-441f964ba69b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:39.125968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e328099-4ebc-43e7-82be-441f964ba69b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:39.126725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e328099-4ebc-43e7-82be-441f964ba69b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:39.672522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-400717a7-7a06-4cfd-8b64-ac5c8ff363cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:39.686406 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-400717a7-7a06-4cfd-8b64-ac5c8ff363cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1391 microversion: 2.1 time: 0.741323 Aug 09 15:05:39.687618 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2695/5389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:38 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1391 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:39.688068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7e328099-4ebc-43e7-82be-441f964ba69b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:39.699276 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7e328099-4ebc-43e7-82be-441f964ba69b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1661 microversion: 2.1 time: 0.592846 Aug 09 15:05:39.701183 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2695/5390] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:39 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1661 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:39.706072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8d08222f-6a04-4fb0-b9b8-d2dadb0c4eb6 req-b957cc2c-6abf-4bf1-a826-1756828ac9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587291ca-a958-46d1-8264-90c8ffcea29e", "name": "network-vif-plugged", "status": "completed", "tag": "8ad08cca-8029-4bca-8e76-72d6fa7b7bf7"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:39.707862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef7506f6-1c66-4ff1-86d4-e286ec4c4a39 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:39.708702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef7506f6-1c66-4ff1-86d4-e286ec4c4a39 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:39.716308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef7506f6-1c66-4ff1-86d4-e286ec4c4a39 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:39.717171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef7506f6-1c66-4ff1-86d4-e286ec4c4a39 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:39.717841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef7506f6-1c66-4ff1-86d4-e286ec4c4a39 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:39.718769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef7506f6-1c66-4ff1-86d4-e286ec4c4a39 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:39.719499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef7506f6-1c66-4ff1-86d4-e286ec4c4a39 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:39.720167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef7506f6-1c66-4ff1-86d4-e286ec4c4a39 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:39.724762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8d08222f-6a04-4fb0-b9b8-d2dadb0c4eb6 req-b957cc2c-6abf-4bf1-a826-1756828ac9c6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:39.725597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8d08222f-6a04-4fb0-b9b8-d2dadb0c4eb6 req-b957cc2c-6abf-4bf1-a826-1756828ac9c6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:39.726641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8d08222f-6a04-4fb0-b9b8-d2dadb0c4eb6 req-b957cc2c-6abf-4bf1-a826-1756828ac9c6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:39.750714 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8d08222f-6a04-4fb0-b9b8-d2dadb0c4eb6 req-b957cc2c-6abf-4bf1-a826-1756828ac9c6 service nova] Creating event network-vif-plugged:8ad08cca-8029-4bca-8e76-72d6fa7b7bf7 for instance 587291ca-a958-46d1-8264-90c8ffcea29e on n-h2-844626-8 Aug 09 15:05:39.760801 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8d08222f-6a04-4fb0-b9b8-d2dadb0c4eb6 req-b957cc2c-6abf-4bf1-a826-1756828ac9c6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070702 Aug 09 15:05:39.762118 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2696/5391] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:05:39.941299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1deabf2c-9793-4737-bab5-6c8dd1b73120 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:39.943128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1deabf2c-9793-4737-bab5-6c8dd1b73120 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:39.954521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1deabf2c-9793-4737-bab5-6c8dd1b73120 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:39.957228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1deabf2c-9793-4737-bab5-6c8dd1b73120 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:39.958275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1deabf2c-9793-4737-bab5-6c8dd1b73120 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:39.959834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1deabf2c-9793-4737-bab5-6c8dd1b73120 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:39.960655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1deabf2c-9793-4737-bab5-6c8dd1b73120 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:39.961328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1deabf2c-9793-4737-bab5-6c8dd1b73120 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:39.963193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef7506f6-1c66-4ff1-86d4-e286ec4c4a39 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:39.982689 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef7506f6-1c66-4ff1-86d4-e286ec4c4a39 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1202 microversion: 2.1 time: 0.279784 Aug 09 15:05:40.002266 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2696/5392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:39 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1202 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:40.341287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1deabf2c-9793-4737-bab5-6c8dd1b73120 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:40.357129 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1deabf2c-9793-4737-bab5-6c8dd1b73120 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1314 microversion: 2.1 time: 0.435460 Aug 09 15:05:40.358282 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2697/5393] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:39 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:40.719218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-008070be-1512-4201-b3c3-b51b91831943 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:40.719812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-008070be-1512-4201-b3c3-b51b91831943 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:40.727717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008070be-1512-4201-b3c3-b51b91831943 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:40.728203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008070be-1512-4201-b3c3-b51b91831943 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:40.728643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008070be-1512-4201-b3c3-b51b91831943 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:40.729970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008070be-1512-4201-b3c3-b51b91831943 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:40.730428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008070be-1512-4201-b3c3-b51b91831943 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:40.730915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008070be-1512-4201-b3c3-b51b91831943 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:40.731625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-062c490c-75da-4b70-bf1d-3c0d76226138 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:40.732617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-062c490c-75da-4b70-bf1d-3c0d76226138 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:40.740792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-062c490c-75da-4b70-bf1d-3c0d76226138 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:40.741545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-062c490c-75da-4b70-bf1d-3c0d76226138 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:40.742230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-062c490c-75da-4b70-bf1d-3c0d76226138 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:40.743161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-062c490c-75da-4b70-bf1d-3c0d76226138 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:40.743774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-062c490c-75da-4b70-bf1d-3c0d76226138 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:40.744359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-062c490c-75da-4b70-bf1d-3c0d76226138 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:40.955671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-008070be-1512-4201-b3c3-b51b91831943 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:40.958555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-062c490c-75da-4b70-bf1d-3c0d76226138 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:40.970225 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-062c490c-75da-4b70-bf1d-3c0d76226138 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1661 microversion: 2.1 time: 0.244411 Aug 09 15:05:40.971576 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2698/5394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:40 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1661 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:40.989141 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-008070be-1512-4201-b3c3-b51b91831943 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1391 microversion: 2.1 time: 0.273598 Aug 09 15:05:41.011487 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2697/5395] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:40 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1391 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:41.033861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a74023b7-67a2-4492-b3b9-d7182d59f801 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:41.034755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a74023b7-67a2-4492-b3b9-d7182d59f801 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:41.042694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a74023b7-67a2-4492-b3b9-d7182d59f801 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:41.043640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a74023b7-67a2-4492-b3b9-d7182d59f801 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:41.044375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a74023b7-67a2-4492-b3b9-d7182d59f801 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:41.045296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a74023b7-67a2-4492-b3b9-d7182d59f801 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:41.045963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a74023b7-67a2-4492-b3b9-d7182d59f801 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:41.046591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a74023b7-67a2-4492-b3b9-d7182d59f801 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:41.281062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:41.344607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a74023b7-67a2-4492-b3b9-d7182d59f801 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:41.355395 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a74023b7-67a2-4492-b3b9-d7182d59f801 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1202 microversion: 2.1 time: 0.346927 Aug 09 15:05:41.360574 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2699/5396] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:41 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1202 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:41.389425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99b2fd6a-6f53-49ad-a482-331aaee1e723 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:41.390472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-99b2fd6a-6f53-49ad-a482-331aaee1e723 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:41.398797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99b2fd6a-6f53-49ad-a482-331aaee1e723 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:41.399682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99b2fd6a-6f53-49ad-a482-331aaee1e723 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:41.400505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99b2fd6a-6f53-49ad-a482-331aaee1e723 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:41.406299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99b2fd6a-6f53-49ad-a482-331aaee1e723 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:41.407213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99b2fd6a-6f53-49ad-a482-331aaee1e723 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:41.408006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-99b2fd6a-6f53-49ad-a482-331aaee1e723 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:41.717073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-99b2fd6a-6f53-49ad-a482-331aaee1e723 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:41.732433 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-99b2fd6a-6f53-49ad-a482-331aaee1e723 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1314 microversion: 2.1 time: 0.349007 Aug 09 15:05:41.744041 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2698/5397] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:41 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:41.994188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06aa4e6e-012d-495f-a530-889caf6718b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:41.994934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06aa4e6e-012d-495f-a530-889caf6718b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:42.000103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=14 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:42.003525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06aa4e6e-012d-495f-a530-889caf6718b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:42.003955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06aa4e6e-012d-495f-a530-889caf6718b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:42.004387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06aa4e6e-012d-495f-a530-889caf6718b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:42.005130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06aa4e6e-012d-495f-a530-889caf6718b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:42.005736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06aa4e6e-012d-495f-a530-889caf6718b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:42.006148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06aa4e6e-012d-495f-a530-889caf6718b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:42.011812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-72dbbdf1-b448-4360-96ca-df25ac2fb9af tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:42.014019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-72dbbdf1-b448-4360-96ca-df25ac2fb9af tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:42.023817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72dbbdf1-b448-4360-96ca-df25ac2fb9af tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:42.024850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72dbbdf1-b448-4360-96ca-df25ac2fb9af tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:42.025602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72dbbdf1-b448-4360-96ca-df25ac2fb9af tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:42.026588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72dbbdf1-b448-4360-96ca-df25ac2fb9af tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:42.028890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72dbbdf1-b448-4360-96ca-df25ac2fb9af tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:42.029586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72dbbdf1-b448-4360-96ca-df25ac2fb9af tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:42.258984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-06aa4e6e-012d-495f-a530-889caf6718b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:42.263534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-72dbbdf1-b448-4360-96ca-df25ac2fb9af tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:42.268976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:42.279579 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-72dbbdf1-b448-4360-96ca-df25ac2fb9af tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1391 microversion: 2.1 time: 0.271952 Aug 09 15:05:42.282953 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06aa4e6e-012d-495f-a530-889caf6718b9 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1661 microversion: 2.1 time: 0.292750 Aug 09 15:05:42.283911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2699/5398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:42 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:42.295910 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2700/5399] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:41 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1661 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:42.383021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d128a8ef-7f27-40c9-92d3-855ea9a2d209 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:42.383985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d128a8ef-7f27-40c9-92d3-855ea9a2d209 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:42.393238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d128a8ef-7f27-40c9-92d3-855ea9a2d209 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:42.394633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d128a8ef-7f27-40c9-92d3-855ea9a2d209 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:42.395325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d128a8ef-7f27-40c9-92d3-855ea9a2d209 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:42.396273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d128a8ef-7f27-40c9-92d3-855ea9a2d209 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:42.396898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d128a8ef-7f27-40c9-92d3-855ea9a2d209 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:42.397522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d128a8ef-7f27-40c9-92d3-855ea9a2d209 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:42.584166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d128a8ef-7f27-40c9-92d3-855ea9a2d209 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:42.594015 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d128a8ef-7f27-40c9-92d3-855ea9a2d209 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1202 microversion: 2.1 time: 0.216307 Aug 09 15:05:42.595032 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2700/5400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:42 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1202 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:42.757325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d148f72-d297-4c5c-a488-cbe7f425cfee tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:42.758437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1d148f72-d297-4c5c-a488-cbe7f425cfee tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:42.766011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d148f72-d297-4c5c-a488-cbe7f425cfee tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:42.766909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d148f72-d297-4c5c-a488-cbe7f425cfee tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:42.767657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d148f72-d297-4c5c-a488-cbe7f425cfee tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:42.768456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d148f72-d297-4c5c-a488-cbe7f425cfee tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:42.768997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d148f72-d297-4c5c-a488-cbe7f425cfee tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:42.769549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d148f72-d297-4c5c-a488-cbe7f425cfee tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:42.962206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1d148f72-d297-4c5c-a488-cbe7f425cfee tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:42.973076 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1d148f72-d297-4c5c-a488-cbe7f425cfee tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1496 microversion: 2.1 time: 0.219158 Aug 09 15:05:42.974415 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2701/5401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:42 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1496 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:43.307699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-76dc3efa-006f-4f1a-8324-d4e640371bc3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:43.308434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-76dc3efa-006f-4f1a-8324-d4e640371bc3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:43.317783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc1faf10-a99f-40ef-85df-95e9a950919f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:43.318514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bc1faf10-a99f-40ef-85df-95e9a950919f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:43.335603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc1faf10-a99f-40ef-85df-95e9a950919f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:43.336932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76dc3efa-006f-4f1a-8324-d4e640371bc3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:43.337434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76dc3efa-006f-4f1a-8324-d4e640371bc3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:43.338219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc1faf10-a99f-40ef-85df-95e9a950919f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:43.338660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc1faf10-a99f-40ef-85df-95e9a950919f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:43.339445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc1faf10-a99f-40ef-85df-95e9a950919f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:43.339909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc1faf10-a99f-40ef-85df-95e9a950919f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:43.340670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76dc3efa-006f-4f1a-8324-d4e640371bc3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:43.341416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76dc3efa-006f-4f1a-8324-d4e640371bc3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:43.342892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76dc3efa-006f-4f1a-8324-d4e640371bc3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:43.343274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc1faf10-a99f-40ef-85df-95e9a950919f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:43.348069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76dc3efa-006f-4f1a-8324-d4e640371bc3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:43.622846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bc1faf10-a99f-40ef-85df-95e9a950919f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:43.635775 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc1faf10-a99f-40ef-85df-95e9a950919f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.322923 Aug 09 15:05:43.640808 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2702/5402] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:43 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:43.648579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-87e6d5f2-12c1-4ae5-bb52-a3b34c1dce43 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:43.649108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-87e6d5f2-12c1-4ae5-bb52-a3b34c1dce43 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:43.658415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-76dc3efa-006f-4f1a-8324-d4e640371bc3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:43.663937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87e6d5f2-12c1-4ae5-bb52-a3b34c1dce43 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:43.664699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87e6d5f2-12c1-4ae5-bb52-a3b34c1dce43 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:43.665300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87e6d5f2-12c1-4ae5-bb52-a3b34c1dce43 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:43.666181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87e6d5f2-12c1-4ae5-bb52-a3b34c1dce43 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:43.666922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87e6d5f2-12c1-4ae5-bb52-a3b34c1dce43 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:43.668118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87e6d5f2-12c1-4ae5-bb52-a3b34c1dce43 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:43.673139 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-76dc3efa-006f-4f1a-8324-d4e640371bc3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1391 microversion: 2.1 time: 0.371193 Aug 09 15:05:43.674369 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2701/5403] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:43 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1391 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:43.695885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac1b4c74-35e9-46c9-9e55-d628b62d727a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:43.696784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ac1b4c74-35e9-46c9-9e55-d628b62d727a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:43.703198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac1b4c74-35e9-46c9-9e55-d628b62d727a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:43.703954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac1b4c74-35e9-46c9-9e55-d628b62d727a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:43.704153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-87e6d5f2-12c1-4ae5-bb52-a3b34c1dce43 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:05:43.704831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac1b4c74-35e9-46c9-9e55-d628b62d727a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:43.705731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac1b4c74-35e9-46c9-9e55-d628b62d727a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:43.706357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac1b4c74-35e9-46c9-9e55-d628b62d727a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:43.707347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac1b4c74-35e9-46c9-9e55-d628b62d727a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:43.885155 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-87e6d5f2-12c1-4ae5-bb52-a3b34c1dce43 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "DELETE /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 204 len: 0 microversion: 2.1 time: 0.242980 Aug 09 15:05:43.890430 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2703/5404] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:05:43 2022] DELETE /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:05:43.896825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ef9b7693-0599-4971-b377-4ef21577aaca tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:43.898130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ef9b7693-0599-4971-b377-4ef21577aaca tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:43.899598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:43.912532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9b7693-0599-4971-b377-4ef21577aaca tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:43.912924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9b7693-0599-4971-b377-4ef21577aaca tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:43.913424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9b7693-0599-4971-b377-4ef21577aaca tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:43.914143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9b7693-0599-4971-b377-4ef21577aaca tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:43.915269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9b7693-0599-4971-b377-4ef21577aaca tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:43.915269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ef9b7693-0599-4971-b377-4ef21577aaca tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:43.958690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ac1b4c74-35e9-46c9-9e55-d628b62d727a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:43.963686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:43.974327 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ac1b4c74-35e9-46c9-9e55-d628b62d727a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1202 microversion: 2.1 time: 0.284210 Aug 09 15:05:43.984100 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2702/5405] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:43 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1202 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:43.989722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8b6bc761-9114-4895-b0fe-eb17df5c3523 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:43.991101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8b6bc761-9114-4895-b0fe-eb17df5c3523 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:44.000306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b6bc761-9114-4895-b0fe-eb17df5c3523 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:44.001131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b6bc761-9114-4895-b0fe-eb17df5c3523 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:44.005797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b6bc761-9114-4895-b0fe-eb17df5c3523 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:44.007241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b6bc761-9114-4895-b0fe-eb17df5c3523 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:44.008236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b6bc761-9114-4895-b0fe-eb17df5c3523 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:44.008837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b6bc761-9114-4895-b0fe-eb17df5c3523 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:44.210951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ef9b7693-0599-4971-b377-4ef21577aaca tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:44.219618 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ef9b7693-0599-4971-b377-4ef21577aaca tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.327465 Aug 09 15:05:44.220272 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2704/5406] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:43 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:44.243770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8b6bc761-9114-4895-b0fe-eb17df5c3523 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:44.247553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-829bc472-5204-4348-bf29-6f44792165ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:44.248186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-829bc472-5204-4348-bf29-6f44792165ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:44.255128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-829bc472-5204-4348-bf29-6f44792165ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:44.255887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-829bc472-5204-4348-bf29-6f44792165ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:44.256829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-829bc472-5204-4348-bf29-6f44792165ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:44.256988 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8b6bc761-9114-4895-b0fe-eb17df5c3523 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1502 microversion: 2.1 time: 0.271012 Aug 09 15:05:44.263287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-829bc472-5204-4348-bf29-6f44792165ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:44.263478 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2703/5407] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:43 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1502 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:44.263616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-829bc472-5204-4348-bf29-6f44792165ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:44.263616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-829bc472-5204-4348-bf29-6f44792165ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:44.417506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-829bc472-5204-4348-bf29-6f44792165ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:44.432544 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-829bc472-5204-4348-bf29-6f44792165ea tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.189175 Aug 09 15:05:44.447131 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2705/5408] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:44 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:44.456338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e695d8e3-22df-4385-a8d5-5e5e5f11ffb2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:44.456951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e695d8e3-22df-4385-a8d5-5e5e5f11ffb2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:44.464230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e695d8e3-22df-4385-a8d5-5e5e5f11ffb2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:44.464783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e695d8e3-22df-4385-a8d5-5e5e5f11ffb2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:44.465226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e695d8e3-22df-4385-a8d5-5e5e5f11ffb2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:44.465935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e695d8e3-22df-4385-a8d5-5e5e5f11ffb2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:44.466382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e695d8e3-22df-4385-a8d5-5e5e5f11ffb2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:44.466811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e695d8e3-22df-4385-a8d5-5e5e5f11ffb2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:44.696897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1024b96c-ff90-4a3b-83aa-1d815307d28e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:44.697913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1024b96c-ff90-4a3b-83aa-1d815307d28e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:44.705063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1024b96c-ff90-4a3b-83aa-1d815307d28e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:44.708509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e695d8e3-22df-4385-a8d5-5e5e5f11ffb2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:44.712311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1024b96c-ff90-4a3b-83aa-1d815307d28e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:44.715362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1024b96c-ff90-4a3b-83aa-1d815307d28e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:44.716093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1024b96c-ff90-4a3b-83aa-1d815307d28e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:44.718723 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e695d8e3-22df-4385-a8d5-5e5e5f11ffb2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.266354 Aug 09 15:05:44.719335 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2704/5409] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:44 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:44.720067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1024b96c-ff90-4a3b-83aa-1d815307d28e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:44.720675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1024b96c-ff90-4a3b-83aa-1d815307d28e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:44.739312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07dc4627-86be-4ce3-830b-69e9c1ff3b2a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:44.740242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07dc4627-86be-4ce3-830b-69e9c1ff3b2a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:44.746620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07dc4627-86be-4ce3-830b-69e9c1ff3b2a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:44.747468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07dc4627-86be-4ce3-830b-69e9c1ff3b2a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:44.748120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07dc4627-86be-4ce3-830b-69e9c1ff3b2a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:44.749059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07dc4627-86be-4ce3-830b-69e9c1ff3b2a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:44.749757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07dc4627-86be-4ce3-830b-69e9c1ff3b2a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:44.750394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07dc4627-86be-4ce3-830b-69e9c1ff3b2a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:45.023229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1024b96c-ff90-4a3b-83aa-1d815307d28e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:45.031378 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1024b96c-ff90-4a3b-83aa-1d815307d28e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1391 microversion: 2.1 time: 0.338357 Aug 09 15:05:45.032991 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2706/5410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:44 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1391 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:45.037849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7efa700f-0eb9-4b24-95cf-95dc9ad34aef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:45.038704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7efa700f-0eb9-4b24-95cf-95dc9ad34aef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:45.048314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07dc4627-86be-4ce3-830b-69e9c1ff3b2a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:45.049164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7efa700f-0eb9-4b24-95cf-95dc9ad34aef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:45.049385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7efa700f-0eb9-4b24-95cf-95dc9ad34aef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:45.049815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7efa700f-0eb9-4b24-95cf-95dc9ad34aef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:45.050523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7efa700f-0eb9-4b24-95cf-95dc9ad34aef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:45.050971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7efa700f-0eb9-4b24-95cf-95dc9ad34aef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:45.051425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7efa700f-0eb9-4b24-95cf-95dc9ad34aef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:45.071707 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07dc4627-86be-4ce3-830b-69e9c1ff3b2a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.336360 Aug 09 15:05:45.075257 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2705/5411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:44 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:45.094023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-acacc877-1d18-4e93-b99f-115c6053443f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:45.094632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-acacc877-1d18-4e93-b99f-115c6053443f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:45.105621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acacc877-1d18-4e93-b99f-115c6053443f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:45.106124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acacc877-1d18-4e93-b99f-115c6053443f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:45.106565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acacc877-1d18-4e93-b99f-115c6053443f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:45.107350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acacc877-1d18-4e93-b99f-115c6053443f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:45.107831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acacc877-1d18-4e93-b99f-115c6053443f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:45.108263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acacc877-1d18-4e93-b99f-115c6053443f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:45.176360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-acacc877-1d18-4e93-b99f-115c6053443f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lazy-loading 'flavor' on Instance uuid f6a67196-2e15-47e5-8877-e75e8d4609c7 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:05:45.337260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7efa700f-0eb9-4b24-95cf-95dc9ad34aef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:45.348006 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7efa700f-0eb9-4b24-95cf-95dc9ad34aef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1202 microversion: 2.1 time: 0.313742 Aug 09 15:05:45.351962 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2707/5412] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:45 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1202 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:45.354308 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-acacc877-1d18-4e93-b99f-115c6053443f tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.265685 Aug 09 15:05:45.358624 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2706/5413] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:05:45 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 15:05:45.360322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-339b4fca-4c53-43f9-8de6-da5ba3989240 req-a839a729-7f50-45be-8086-1d2e3218477a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caaadba4-bf8c-4e32-b86f-a6e0e68bbd93", "name": "network-vif-plugged", "status": "completed", "tag": "90f33f03-4270-4292-a57d-108d8d490b0a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:45.384714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-339b4fca-4c53-43f9-8de6-da5ba3989240 req-a839a729-7f50-45be-8086-1d2e3218477a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:45.387822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-339b4fca-4c53-43f9-8de6-da5ba3989240 req-a839a729-7f50-45be-8086-1d2e3218477a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:45.389737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b742b08-d555-4a06-8a88-cd20c61f3d6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:45.390444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-339b4fca-4c53-43f9-8de6-da5ba3989240 req-a839a729-7f50-45be-8086-1d2e3218477a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:45.390790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b742b08-d555-4a06-8a88-cd20c61f3d6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:45.406679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b742b08-d555-4a06-8a88-cd20c61f3d6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:45.407921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b742b08-d555-4a06-8a88-cd20c61f3d6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:45.408658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b742b08-d555-4a06-8a88-cd20c61f3d6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:45.410165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b742b08-d555-4a06-8a88-cd20c61f3d6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:45.411388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b742b08-d555-4a06-8a88-cd20c61f3d6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:45.412049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b742b08-d555-4a06-8a88-cd20c61f3d6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:45.415355 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-339b4fca-4c53-43f9-8de6-da5ba3989240 req-a839a729-7f50-45be-8086-1d2e3218477a service nova] Creating event network-vif-plugged:90f33f03-4270-4292-a57d-108d8d490b0a for instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 on n-h2-844626-8 Aug 09 15:05:45.421728 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-339b4fca-4c53-43f9-8de6-da5ba3989240 req-a839a729-7f50-45be-8086-1d2e3218477a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068262 Aug 09 15:05:45.423151 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2708/5414] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:05:45.431649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d2a7fed-bfb0-4b99-b51e-8942cab42f8b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:45.433056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3d2a7fed-bfb0-4b99-b51e-8942cab42f8b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:45.440567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d2a7fed-bfb0-4b99-b51e-8942cab42f8b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:45.441345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d2a7fed-bfb0-4b99-b51e-8942cab42f8b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:45.460684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d2a7fed-bfb0-4b99-b51e-8942cab42f8b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:45.462377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d2a7fed-bfb0-4b99-b51e-8942cab42f8b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:45.465698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d2a7fed-bfb0-4b99-b51e-8942cab42f8b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:45.466331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d2a7fed-bfb0-4b99-b51e-8942cab42f8b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:45.941943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3d2a7fed-bfb0-4b99-b51e-8942cab42f8b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:45.967816 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3d2a7fed-bfb0-4b99-b51e-8942cab42f8b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1673 microversion: 2.1 time: 0.541306 Aug 09 15:05:45.975673 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2709/5415] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:45 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1673 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:46.056177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af0d94d8-8bb5-46cc-b0c0-a23cb5fcbdee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:46.057453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-af0d94d8-8bb5-46cc-b0c0-a23cb5fcbdee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:46.080459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af0d94d8-8bb5-46cc-b0c0-a23cb5fcbdee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:46.081205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af0d94d8-8bb5-46cc-b0c0-a23cb5fcbdee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:46.081855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af0d94d8-8bb5-46cc-b0c0-a23cb5fcbdee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:46.082847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af0d94d8-8bb5-46cc-b0c0-a23cb5fcbdee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:46.083541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af0d94d8-8bb5-46cc-b0c0-a23cb5fcbdee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:46.084669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af0d94d8-8bb5-46cc-b0c0-a23cb5fcbdee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:46.102181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0b742b08-d555-4a06-8a88-cd20c61f3d6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:46.113441 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b742b08-d555-4a06-8a88-cd20c61f3d6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1502 microversion: 2.1 time: 0.755658 Aug 09 15:05:46.115017 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2707/5416] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:45 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1502 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:46.374520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cc9563b7-964b-4b98-a960-165581b620c0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:46.375350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cc9563b7-964b-4b98-a960-165581b620c0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:46.383340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc9563b7-964b-4b98-a960-165581b620c0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:46.383834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc9563b7-964b-4b98-a960-165581b620c0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:46.384266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc9563b7-964b-4b98-a960-165581b620c0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:46.385043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc9563b7-964b-4b98-a960-165581b620c0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:46.385640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc9563b7-964b-4b98-a960-165581b620c0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:46.386062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc9563b7-964b-4b98-a960-165581b620c0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:46.864251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-af0d94d8-8bb5-46cc-b0c0-a23cb5fcbdee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:46.874499 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af0d94d8-8bb5-46cc-b0c0-a23cb5fcbdee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1391 microversion: 2.1 time: 0.824240 Aug 09 15:05:46.880410 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2710/5417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:46 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1391 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:46.933581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cc9563b7-964b-4b98-a960-165581b620c0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:46.944212 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cc9563b7-964b-4b98-a960-165581b620c0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1202 microversion: 2.1 time: 0.576609 Aug 09 15:05:46.945112 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2708/5418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:46 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1202 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:47.017668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e79bada-f28c-4c2d-8259-60b2985692e8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:47.018363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e79bada-f28c-4c2d-8259-60b2985692e8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:47.027459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e79bada-f28c-4c2d-8259-60b2985692e8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.027950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e79bada-f28c-4c2d-8259-60b2985692e8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.028383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e79bada-f28c-4c2d-8259-60b2985692e8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:47.029078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e79bada-f28c-4c2d-8259-60b2985692e8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.029714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e79bada-f28c-4c2d-8259-60b2985692e8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.030300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e79bada-f28c-4c2d-8259-60b2985692e8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:47.150650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8bd1dc6-50c9-4f45-9737-1f1e2740be7d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:47.151432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8bd1dc6-50c9-4f45-9737-1f1e2740be7d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:47.177586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8bd1dc6-50c9-4f45-9737-1f1e2740be7d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.178240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8bd1dc6-50c9-4f45-9737-1f1e2740be7d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.178887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8bd1dc6-50c9-4f45-9737-1f1e2740be7d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:47.179799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8bd1dc6-50c9-4f45-9737-1f1e2740be7d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.180383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8bd1dc6-50c9-4f45-9737-1f1e2740be7d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.182108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8bd1dc6-50c9-4f45-9737-1f1e2740be7d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:47.274014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2e79bada-f28c-4c2d-8259-60b2985692e8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:47.282116 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e79bada-f28c-4c2d-8259-60b2985692e8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1656 microversion: 2.1 time: 0.269321 Aug 09 15:05:47.283492 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2711/5419] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:47 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1656 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:47.297886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8bd1dc6-50c9-4f45-9737-1f1e2740be7d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:47.308035 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e8bd1dc6-50c9-4f45-9737-1f1e2740be7d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 200 len: 1299 microversion: 2.1 time: 0.162001 Aug 09 15:05:47.308183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9f2ae015-a6c1-4a1f-bb9d-50fd604c512f req-adb0fabf-4540-40bc-a91f-599f76f44af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "587291ca-a958-46d1-8264-90c8ffcea29e", "name": "network-vif-deleted", "tag": "8ad08cca-8029-4bca-8e76-72d6fa7b7bf7"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:47.317286 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2709/5420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:47 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 1299 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:47.322511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c4693cd-eb1f-4e49-b6d7-aa9d2b36ae69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:47.323328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c4693cd-eb1f-4e49-b6d7-aa9d2b36ae69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:47.330696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c4693cd-eb1f-4e49-b6d7-aa9d2b36ae69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.331567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c4693cd-eb1f-4e49-b6d7-aa9d2b36ae69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.332167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c4693cd-eb1f-4e49-b6d7-aa9d2b36ae69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:47.333039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c4693cd-eb1f-4e49-b6d7-aa9d2b36ae69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.333894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c4693cd-eb1f-4e49-b6d7-aa9d2b36ae69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.334383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c4693cd-eb1f-4e49-b6d7-aa9d2b36ae69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:47.359333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9f2ae015-a6c1-4a1f-bb9d-50fd604c512f req-adb0fabf-4540-40bc-a91f-599f76f44af8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.359630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9f2ae015-a6c1-4a1f-bb9d-50fd604c512f req-adb0fabf-4540-40bc-a91f-599f76f44af8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.363584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9f2ae015-a6c1-4a1f-bb9d-50fd604c512f req-adb0fabf-4540-40bc-a91f-599f76f44af8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:47.390811 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9f2ae015-a6c1-4a1f-bb9d-50fd604c512f req-adb0fabf-4540-40bc-a91f-599f76f44af8 service nova] Creating event network-vif-deleted:8ad08cca-8029-4bca-8e76-72d6fa7b7bf7 for instance 587291ca-a958-46d1-8264-90c8ffcea29e on n-h2-844626-8 Aug 09 15:05:47.399044 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9f2ae015-a6c1-4a1f-bb9d-50fd604c512f req-adb0fabf-4540-40bc-a91f-599f76f44af8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113806 Aug 09 15:05:47.400016 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2712/5421] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:05:47.461757 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c4693cd-eb1f-4e49-b6d7-aa9d2b36ae69 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action" status: 202 len: 0 microversion: 2.1 time: 0.142484 Aug 09 15:05:47.476664 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2710/5422] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:05:47 2022] POST /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:05:47.480823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-809d290a-56b4-4761-85dd-4c98ef35ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:47.481747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-809d290a-56b4-4761-85dd-4c98ef35ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:47.496015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-809d290a-56b4-4761-85dd-4c98ef35ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.496497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-809d290a-56b4-4761-85dd-4c98ef35ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.497119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-809d290a-56b4-4761-85dd-4c98ef35ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:47.497998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-809d290a-56b4-4761-85dd-4c98ef35ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.500029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-809d290a-56b4-4761-85dd-4c98ef35ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.501640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-809d290a-56b4-4761-85dd-4c98ef35ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:47.693801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-809d290a-56b4-4761-85dd-4c98ef35ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:47.703635 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-809d290a-56b4-4761-85dd-4c98ef35ee23 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1662 microversion: 2.1 time: 0.227562 Aug 09 15:05:47.707165 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2713/5423] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:47 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1662 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:47.901826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cb8e1482-e3fe-45b8-a647-6190cf7cb15b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:47.902812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cb8e1482-e3fe-45b8-a647-6190cf7cb15b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:47.912545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb8e1482-e3fe-45b8-a647-6190cf7cb15b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.913035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb8e1482-e3fe-45b8-a647-6190cf7cb15b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.913526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb8e1482-e3fe-45b8-a647-6190cf7cb15b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:47.914514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb8e1482-e3fe-45b8-a647-6190cf7cb15b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.914975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb8e1482-e3fe-45b8-a647-6190cf7cb15b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.915434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb8e1482-e3fe-45b8-a647-6190cf7cb15b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:47.966124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-51340721-e925-4615-a3c9-ec370112e06a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:47.967307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-51340721-e925-4615-a3c9-ec370112e06a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:47.979053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51340721-e925-4615-a3c9-ec370112e06a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.979774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51340721-e925-4615-a3c9-ec370112e06a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.980375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51340721-e925-4615-a3c9-ec370112e06a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:47.981244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51340721-e925-4615-a3c9-ec370112e06a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:47.982281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51340721-e925-4615-a3c9-ec370112e06a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:47.982865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-51340721-e925-4615-a3c9-ec370112e06a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:48.268334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cb8e1482-e3fe-45b8-a647-6190cf7cb15b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:48.285235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-51340721-e925-4615-a3c9-ec370112e06a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:48.289996 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cb8e1482-e3fe-45b8-a647-6190cf7cb15b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1562 microversion: 2.1 time: 0.394235 Aug 09 15:05:48.290619 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2711/5424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:47 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1562 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:48.305446 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-51340721-e925-4615-a3c9-ec370112e06a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1202 microversion: 2.1 time: 0.344285 Aug 09 15:05:48.313308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1f8830ac-cde8-48cb-8ad7-995a83e434d0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:48.314330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1f8830ac-cde8-48cb-8ad7-995a83e434d0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:48.319725 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2714/5425] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:47 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1202 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:48.328066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f8830ac-cde8-48cb-8ad7-995a83e434d0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:48.329893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d04e62d-4b9b-4dd8-81cf-31e9a8653e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:48.330509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3d04e62d-4b9b-4dd8-81cf-31e9a8653e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: 587291ca-a958-46d1-8264-90c8ffcea29e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:48.330843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f8830ac-cde8-48cb-8ad7-995a83e434d0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:48.333563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f8830ac-cde8-48cb-8ad7-995a83e434d0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:48.334347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f8830ac-cde8-48cb-8ad7-995a83e434d0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:48.334842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f8830ac-cde8-48cb-8ad7-995a83e434d0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:48.335533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f8830ac-cde8-48cb-8ad7-995a83e434d0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:48.340632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d04e62d-4b9b-4dd8-81cf-31e9a8653e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:48.341206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d04e62d-4b9b-4dd8-81cf-31e9a8653e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:48.341660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d04e62d-4b9b-4dd8-81cf-31e9a8653e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:48.342345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d04e62d-4b9b-4dd8-81cf-31e9a8653e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:48.342794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d04e62d-4b9b-4dd8-81cf-31e9a8653e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:48.343230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d04e62d-4b9b-4dd8-81cf-31e9a8653e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:48.376928 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-3d04e62d-4b9b-4dd8-81cf-31e9a8653e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] HTTP exception thrown: Instance 587291ca-a958-46d1-8264-90c8ffcea29e could not be found. Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d04e62d-4b9b-4dd8-81cf-31e9a8653e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Request method failure captured: Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e HTTP/1.1 Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nesPlYGA0iCG9FN7nrEPQ4Qin8m2trHPVn2pyaKFA2IntytwtZ9ZV-NROFlx4IN9XQ5yZobN9c-K59Mu3oDRjle8wG61VOPDfMnohASqQNCriqnzQsrvoKf8FX4nTEcpdq5jL_eDNC-fCirouCYTZEsCA11bMdKhJfQMr3puzh4QSY Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: e0ec11da657342d2aea2dcbedc2735bb Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesActionsTest-1669049742 Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0ec11da657342d2aea2dcbedc2735bb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0ec11da657342d2aea2dcbedc2735bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0ec11da657342d2aea2dcbedc2735bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0ec11da657342d2aea2dcbedc2735bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-VolumesActionsTest-1669049742 Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: e0ec11da657342d2aea2dcbedc2735bb Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesActionsTest-1669049742 Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-VolumesActionsTest-1669049742-project Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 033310d1a41c4cefa3d905f65dc6c67e Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-VolumesActionsTest-1669049742-project Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 587291ca-a958-46d1-8264-90c8ffcea29e could not be found. Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '587291ca-a958-46d1-8264-90c8ffcea29e'} Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 587291ca-a958-46d1-8264-90c8ffcea29e could not be found. Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 587291ca-a958-46d1-8264-90c8ffcea29e could not be found. Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:05:48.385531 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:05:48.390710 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:05:48.390710 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:05:48.390710 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:05:48.390710 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:05:48.390710 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:05:48.390710 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 587291ca-a958-46d1-8264-90c8ffcea29e could not be found. Aug 09 15:05:48.390710 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:05:48.395812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d04e62d-4b9b-4dd8-81cf-31e9a8653e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Returning 404 to user: Instance 587291ca-a958-46d1-8264-90c8ffcea29e could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:05:48.399012 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3d04e62d-4b9b-4dd8-81cf-31e9a8653e6b tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e" status: 404 len: 111 microversion: 2.1 time: 0.070788 Aug 09 15:05:48.401210 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2715/5426] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:48 2022] GET /compute/v2.1/servers/587291ca-a958-46d1-8264-90c8ffcea29e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:05:48.571378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1602393645", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "9f1b5d20-7fdf-467f-94c0-40673ac1cb6a"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:48.627548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] validate_networks() for [('9f1b5d20-7fdf-467f-94c0-40673ac1cb6a', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:05:48.662013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1f8830ac-cde8-48cb-8ad7-995a83e434d0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:48.671871 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1f8830ac-cde8-48cb-8ad7-995a83e434d0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1562 microversion: 2.1 time: 0.364339 Aug 09 15:05:48.673050 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2712/5427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:48 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1562 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:48.726519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-77007311-3dfa-4ef4-839e-fa241e52a431 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:48.727822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77007311-3dfa-4ef4-839e-fa241e52a431 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:48.735508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77007311-3dfa-4ef4-839e-fa241e52a431 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:48.736345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77007311-3dfa-4ef4-839e-fa241e52a431 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:48.737055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77007311-3dfa-4ef4-839e-fa241e52a431 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:48.738224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77007311-3dfa-4ef4-839e-fa241e52a431 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:48.738908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77007311-3dfa-4ef4-839e-fa241e52a431 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:48.739839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77007311-3dfa-4ef4-839e-fa241e52a431 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:49.036057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-77007311-3dfa-4ef4-839e-fa241e52a431 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:49.050849 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-77007311-3dfa-4ef4-839e-fa241e52a431 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1662 microversion: 2.1 time: 0.327314 Aug 09 15:05:49.054086 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2713/5428] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:48 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1662 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:49.076551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0a2723f8-0c89-4ffc-8180-e32437edcd26 req-8388cc82-85db-48f7-b9ec-b81e73c93ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd98462-10c0-47f0-93a9-eb59730f6871", "name": "network-vif-plugged", "status": "completed", "tag": "03176526-0a12-4f15-8e80-6c0a4903cd9b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:49.089169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0a2723f8-0c89-4ffc-8180-e32437edcd26 req-8388cc82-85db-48f7-b9ec-b81e73c93ae5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:49.090057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0a2723f8-0c89-4ffc-8180-e32437edcd26 req-8388cc82-85db-48f7-b9ec-b81e73c93ae5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:49.090738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0a2723f8-0c89-4ffc-8180-e32437edcd26 req-8388cc82-85db-48f7-b9ec-b81e73c93ae5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:49.105961 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0a2723f8-0c89-4ffc-8180-e32437edcd26 req-8388cc82-85db-48f7-b9ec-b81e73c93ae5 service nova] Creating event network-vif-plugged:03176526-0a12-4f15-8e80-6c0a4903cd9b for instance 2dd98462-10c0-47f0-93a9-eb59730f6871 on n-h1-844626-8 Aug 09 15:05:49.114682 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0a2723f8-0c89-4ffc-8180-e32437edcd26 req-8388cc82-85db-48f7-b9ec-b81e73c93ae5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043227 Aug 09 15:05:49.116059 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2714/5429] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:05:49.333750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70d71746-5cb3-4a8c-8c35-e10c4d14667f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:49.335019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-70d71746-5cb3-4a8c-8c35-e10c4d14667f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:49.347259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70d71746-5cb3-4a8c-8c35-e10c4d14667f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:49.347765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70d71746-5cb3-4a8c-8c35-e10c4d14667f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:49.352177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70d71746-5cb3-4a8c-8c35-e10c4d14667f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:49.353012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70d71746-5cb3-4a8c-8c35-e10c4d14667f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:49.353501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70d71746-5cb3-4a8c-8c35-e10c4d14667f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:49.358859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70d71746-5cb3-4a8c-8c35-e10c4d14667f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:49.718908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:05:49.722356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:05:49.723446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:05:49.725384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:05:49.726042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:05:49.741585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:49.742887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:49.743613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:49.745148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:49.745978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:49.746783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:49.777746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Getting quotas for project e0ec11da657342d2aea2dcbedc2735bb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:05:49.786830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Getting quotas for user 033310d1a41c4cefa3d905f65dc6c67e and project e0ec11da657342d2aea2dcbedc2735bb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:05:49.804956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:05:49.808017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:05:49.826360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-70d71746-5cb3-4a8c-8c35-e10c4d14667f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:49.834742 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70d71746-5cb3-4a8c-8c35-e10c4d14667f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1202 microversion: 2.1 time: 0.506827 Aug 09 15:05:49.843878 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2715/5430] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:49 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1202 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:49.872323 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-333085c8-dfb5-4de1-90d7-bc6be77d9e51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.313238 Aug 09 15:05:49.873988 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2716/5431] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:05:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:05:49.885496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ea43734-1a62-4d29-8144-04700eabcf51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:49.886158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ea43734-1a62-4d29-8144-04700eabcf51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:49.983844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ea43734-1a62-4d29-8144-04700eabcf51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:49.998553 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ea43734-1a62-4d29-8144-04700eabcf51 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1214 microversion: 2.1 time: 0.117607 Aug 09 15:05:49.999812 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2716/5432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:49 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:50.076140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ea41ca0-c270-4707-b5ee-08a3e8ae01e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:50.076765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9ea41ca0-c270-4707-b5ee-08a3e8ae01e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:50.084455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ea41ca0-c270-4707-b5ee-08a3e8ae01e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:50.084875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ea41ca0-c270-4707-b5ee-08a3e8ae01e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:50.085603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ea41ca0-c270-4707-b5ee-08a3e8ae01e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:50.086772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ea41ca0-c270-4707-b5ee-08a3e8ae01e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:50.087969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ea41ca0-c270-4707-b5ee-08a3e8ae01e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:50.088634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ea41ca0-c270-4707-b5ee-08a3e8ae01e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:50.477984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9ea41ca0-c270-4707-b5ee-08a3e8ae01e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:50.499508 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ea41ca0-c270-4707-b5ee-08a3e8ae01e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.425072 Aug 09 15:05:50.513373 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2717/5433] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:50 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:50.531809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-922e461d-ef2c-41a4-83c0-e6cae8913626 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:50.533333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-922e461d-ef2c-41a4-83c0-e6cae8913626 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:50.542667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922e461d-ef2c-41a4-83c0-e6cae8913626 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:50.543434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922e461d-ef2c-41a4-83c0-e6cae8913626 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:50.544097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922e461d-ef2c-41a4-83c0-e6cae8913626 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:50.545485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922e461d-ef2c-41a4-83c0-e6cae8913626 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:50.546167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922e461d-ef2c-41a4-83c0-e6cae8913626 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:50.546893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-922e461d-ef2c-41a4-83c0-e6cae8913626 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:50.872475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2d5347e-48df-4185-b5a7-df9d7a6144fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:50.874285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b2d5347e-48df-4185-b5a7-df9d7a6144fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:50.882142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2d5347e-48df-4185-b5a7-df9d7a6144fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:50.882724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2d5347e-48df-4185-b5a7-df9d7a6144fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:50.883335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2d5347e-48df-4185-b5a7-df9d7a6144fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:50.884330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2d5347e-48df-4185-b5a7-df9d7a6144fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:50.884888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2d5347e-48df-4185-b5a7-df9d7a6144fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:50.885344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2d5347e-48df-4185-b5a7-df9d7a6144fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:50.910643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:50.941450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-922e461d-ef2c-41a4-83c0-e6cae8913626 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:50.952911 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-922e461d-ef2c-41a4-83c0-e6cae8913626 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1665 microversion: 2.1 time: 0.425376 Aug 09 15:05:50.963120 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2717/5434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:50 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1665 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:50.986921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:50.987805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:50.995074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:50.996499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:50.997259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:50.998070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:50.998932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:50.999467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:51.040138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:51.057190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:05:51.066403 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.compute.api [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Working on deleting snapshot 20cf011b-1260-4ed2-b930-f3d286307fea from shelved instance... Aug 09 15:05:51.764882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2d5347e-48df-4185-b5a7-df9d7a6144fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:51.779623 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2d5347e-48df-4185-b5a7-df9d7a6144fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1389 microversion: 2.1 time: 0.914055 Aug 09 15:05:51.785443 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2718/5435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:50 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1389 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:51.793399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-281924e2-4d69-4391-8ba1-05a62087f85e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:51.800027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-281924e2-4d69-4391-8ba1-05a62087f85e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:51.817523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-281924e2-4d69-4391-8ba1-05a62087f85e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:51.818011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-281924e2-4d69-4391-8ba1-05a62087f85e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:51.818442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-281924e2-4d69-4391-8ba1-05a62087f85e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:51.819899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-281924e2-4d69-4391-8ba1-05a62087f85e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:51.820549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-281924e2-4d69-4391-8ba1-05a62087f85e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:51.823936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-281924e2-4d69-4391-8ba1-05a62087f85e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:51.998541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-281924e2-4d69-4391-8ba1-05a62087f85e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:52.017247 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-281924e2-4d69-4391-8ba1-05a62087f85e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1272 microversion: 2.1 time: 0.229483 Aug 09 15:05:52.017977 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2719/5436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:51 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1272 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:52.031494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4fb97591-03b1-47a8-82e5-cefec0874b54 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:52.031494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4fb97591-03b1-47a8-82e5-cefec0874b54 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:52.046498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fb97591-03b1-47a8-82e5-cefec0874b54 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:52.046995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fb97591-03b1-47a8-82e5-cefec0874b54 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:52.047454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fb97591-03b1-47a8-82e5-cefec0874b54 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:52.048226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fb97591-03b1-47a8-82e5-cefec0874b54 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:52.052600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fb97591-03b1-47a8-82e5-cefec0874b54 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:52.053052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fb97591-03b1-47a8-82e5-cefec0874b54 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:52.098064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Doing local delete in cell ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0(cell1) {{(pid=119406) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 09 15:05:52.099035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:52.099650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:52.100150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:52.100835 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.compute.api [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 09 15:05:52.105307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] deallocate_for_instance() {{(pid=119406) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 09 15:05:52.667755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4fb97591-03b1-47a8-82e5-cefec0874b54 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:52.677150 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4fb97591-03b1-47a8-82e5-cefec0874b54 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1389 microversion: 2.1 time: 0.656793 Aug 09 15:05:52.677662 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2720/5437] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:52 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1389 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:52.702785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-683181b9-6b67-48ad-8a3f-8fa6f0e7e8c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:52.703426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-683181b9-6b67-48ad-8a3f-8fa6f0e7e8c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:52.711767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683181b9-6b67-48ad-8a3f-8fa6f0e7e8c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:52.712687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683181b9-6b67-48ad-8a3f-8fa6f0e7e8c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:52.713250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683181b9-6b67-48ad-8a3f-8fa6f0e7e8c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:52.714920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683181b9-6b67-48ad-8a3f-8fa6f0e7e8c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:52.715536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683181b9-6b67-48ad-8a3f-8fa6f0e7e8c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:52.716523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683181b9-6b67-48ad-8a3f-8fa6f0e7e8c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:53.193400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-683181b9-6b67-48ad-8a3f-8fa6f0e7e8c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:53.209317 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-683181b9-6b67-48ad-8a3f-8fa6f0e7e8c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1389 microversion: 2.1 time: 0.510648 Aug 09 15:05:53.210757 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2721/5438] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:52 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1389 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:53.215941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05373d6a-a490-42a1-9cd3-9566d4b19cd4 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:53.223423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05373d6a-a490-42a1-9cd3-9566d4b19cd4 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:53.235009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05373d6a-a490-42a1-9cd3-9566d4b19cd4 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:53.235867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05373d6a-a490-42a1-9cd3-9566d4b19cd4 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:53.243917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05373d6a-a490-42a1-9cd3-9566d4b19cd4 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:53.245026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05373d6a-a490-42a1-9cd3-9566d4b19cd4 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:53.245706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05373d6a-a490-42a1-9cd3-9566d4b19cd4 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:53.246334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05373d6a-a490-42a1-9cd3-9566d4b19cd4 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:53.396612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05373d6a-a490-42a1-9cd3-9566d4b19cd4 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:53.416310 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05373d6a-a490-42a1-9cd3-9566d4b19cd4 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1272 microversion: 2.1 time: 0.204095 Aug 09 15:05:53.418279 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2722/5439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:53 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1272 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:53.428612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-787be621-cdbc-4709-8f7e-30e3fddb93de tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:53.429465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-787be621-cdbc-4709-8f7e-30e3fddb93de tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:53.440836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-787be621-cdbc-4709-8f7e-30e3fddb93de tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:53.441781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-787be621-cdbc-4709-8f7e-30e3fddb93de tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:53.443056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-787be621-cdbc-4709-8f7e-30e3fddb93de tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:53.446437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-787be621-cdbc-4709-8f7e-30e3fddb93de tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:53.447266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-787be621-cdbc-4709-8f7e-30e3fddb93de tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:53.447906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-787be621-cdbc-4709-8f7e-30e3fddb93de tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:53.534897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-787be621-cdbc-4709-8f7e-30e3fddb93de tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:05:53.701571 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-787be621-cdbc-4709-8f7e-30e3fddb93de tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 204 len: 0 microversion: 2.1 time: 0.279368 Aug 09 15:05:53.704320 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2723/5440] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:05:53 2022] DELETE /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:05:53.714221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-80734017-c48b-4be6-a00c-75ff7bba8400 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:53.715390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-80734017-c48b-4be6-a00c-75ff7bba8400 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:53.723410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80734017-c48b-4be6-a00c-75ff7bba8400 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:53.724176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80734017-c48b-4be6-a00c-75ff7bba8400 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:53.724973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80734017-c48b-4be6-a00c-75ff7bba8400 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:53.725919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80734017-c48b-4be6-a00c-75ff7bba8400 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:53.726845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80734017-c48b-4be6-a00c-75ff7bba8400 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:53.727502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80734017-c48b-4be6-a00c-75ff7bba8400 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:54.197819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Updating instance_info_cache with network_info: [] {{(pid=119406) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 09 15:05:54.488910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-80734017-c48b-4be6-a00c-75ff7bba8400 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:54.504885 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-80734017-c48b-4be6-a00c-75ff7bba8400 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1395 microversion: 2.1 time: 0.789660 Aug 09 15:05:54.505600 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2724/5441] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:53 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1395 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:54.516275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5ca87960-cd05-4cc5-8a01-c61ba5365959 req-b4720ac4-675b-4b78-918d-6f233a5a8706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09c13197-2b16-4472-8f3f-c144ffc8879a", "name": "network-vif-deleted", "tag": "9c19066d-e8b5-408b-b063-5288762ff74f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:54.538632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5ca87960-cd05-4cc5-8a01-c61ba5365959 req-b4720ac4-675b-4b78-918d-6f233a5a8706 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:54.539147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5ca87960-cd05-4cc5-8a01-c61ba5365959 req-b4720ac4-675b-4b78-918d-6f233a5a8706 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:54.539588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5ca87960-cd05-4cc5-8a01-c61ba5365959 req-b4720ac4-675b-4b78-918d-6f233a5a8706 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:54.569688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.compute.server_external_events [req-5ca87960-cd05-4cc5-8a01-c61ba5365959 req-b4720ac4-675b-4b78-918d-6f233a5a8706 service nova] Unable to find a host for instance 09c13197-2b16-4472-8f3f-c144ffc8879a. Dropping event network-vif-deleted {{(pid=119407) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 15:05:54.570520 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5ca87960-cd05-4cc5-8a01-c61ba5365959 req-b4720ac4-675b-4b78-918d-6f233a5a8706 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.063591 Aug 09 15:05:54.573322 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2725/5442] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 15:05:54.578220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21a59ca9-3b72-462c-8cba-d3a3f15c6e62 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:54.578832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-21a59ca9-3b72-462c-8cba-d3a3f15c6e62 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:54.594667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21a59ca9-3b72-462c-8cba-d3a3f15c6e62 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:54.595752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21a59ca9-3b72-462c-8cba-d3a3f15c6e62 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:54.596605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21a59ca9-3b72-462c-8cba-d3a3f15c6e62 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:54.597611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21a59ca9-3b72-462c-8cba-d3a3f15c6e62 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:54.598290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21a59ca9-3b72-462c-8cba-d3a3f15c6e62 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:54.599014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21a59ca9-3b72-462c-8cba-d3a3f15c6e62 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:54.814011 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b1f05e2b-b92a-4bef-8a50-d2a22ad17d7b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "DELETE /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 204 len: 0 microversion: 2.1 time: 3.832401 Aug 09 15:05:54.819478 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2718/5443] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:05:50 2022] DELETE /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 0 bytes in 3835 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:05:54.827598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a70c0288-41af-4929-b7c3-bcd67490f228 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:54.829698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a70c0288-41af-4929-b7c3-bcd67490f228 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 09c13197-2b16-4472-8f3f-c144ffc8879a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:54.838761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a70c0288-41af-4929-b7c3-bcd67490f228 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:54.841375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a70c0288-41af-4929-b7c3-bcd67490f228 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:54.842177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a70c0288-41af-4929-b7c3-bcd67490f228 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:54.843321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a70c0288-41af-4929-b7c3-bcd67490f228 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:54.844844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a70c0288-41af-4929-b7c3-bcd67490f228 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:54.845700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a70c0288-41af-4929-b7c3-bcd67490f228 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:54.869787 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-a70c0288-41af-4929-b7c3-bcd67490f228 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] HTTP exception thrown: Instance 09c13197-2b16-4472-8f3f-c144ffc8879a could not be found. Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a70c0288-41af-4929-b7c3-bcd67490f228 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Request method failure captured: Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a HTTP/1.1 Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nYEf9bYbaWm9LpfA_LfwfUAPPg3KiAcIP0FvUZa5q3lW1cxsq_VEWuea_CUOz5st4geKgSqeruMxTrCCG4yN7K5xPHcsvFJ9uo_ztCad5wmGGhupiyzg1AjNhOoCjxRWlcQTxcsGTT3hxXSJl2NJVAtQ8LITGkETiM4QQ4BkISsF8I Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 891029e759ac441f8a08c38bca92be81 Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerActionsTestJSON-673566527 Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_891029e759ac441f8a08c38bca92be81", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/891029e759ac441f8a08c38bca92be81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/891029e759ac441f8a08c38bca92be81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/891029e759ac441f8a08c38bca92be81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerActionsTestJSON-673566527 Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 891029e759ac441f8a08c38bca92be81 Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerActionsTestJSON-673566527 Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerActionsTestJSON-673566527-project Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3da785ddf56e4b028c6647643d97c952 Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerActionsTestJSON-673566527-project Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 09c13197-2b16-4472-8f3f-c144ffc8879a could not be found. Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '09c13197-2b16-4472-8f3f-c144ffc8879a'} Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09c13197-2b16-4472-8f3f-c144ffc8879a could not be found. Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09c13197-2b16-4472-8f3f-c144ffc8879a could not be found. Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:05:54.872489 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:05:54.877514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:05:54.877514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:05:54.877514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:05:54.877514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:05:54.877514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:05:54.877514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09c13197-2b16-4472-8f3f-c144ffc8879a could not be found. Aug 09 15:05:54.877514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:05:54.877514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a70c0288-41af-4929-b7c3-bcd67490f228 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Returning 404 to user: Instance 09c13197-2b16-4472-8f3f-c144ffc8879a could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:05:54.877514 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a70c0288-41af-4929-b7c3-bcd67490f228 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a" status: 404 len: 111 microversion: 2.1 time: 0.052984 Aug 09 15:05:54.877514 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2719/5444] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:54 2022] GET /compute/v2.1/servers/09c13197-2b16-4472-8f3f-c144ffc8879a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:05:54.887394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4eb40e9f-81e1-48d5-854d-cf520f78a889 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:54.887996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4eb40e9f-81e1-48d5-854d-cf520f78a889 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:54.898951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eb40e9f-81e1-48d5-854d-cf520f78a889 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:54.900306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eb40e9f-81e1-48d5-854d-cf520f78a889 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:54.900870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eb40e9f-81e1-48d5-854d-cf520f78a889 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:54.902906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eb40e9f-81e1-48d5-854d-cf520f78a889 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:54.903475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eb40e9f-81e1-48d5-854d-cf520f78a889 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:54.904072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eb40e9f-81e1-48d5-854d-cf520f78a889 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:54.945219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4eb40e9f-81e1-48d5-854d-cf520f78a889 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:05:55.065787 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4eb40e9f-81e1-48d5-854d-cf520f78a889 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "DELETE /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 204 len: 0 microversion: 2.1 time: 0.182338 Aug 09 15:05:55.069925 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2720/5445] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:05:54 2022] DELETE /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 15:05:55.078347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9ef0e624-04c9-464e-84b3-68c2f0b8758a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:55.079458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9ef0e624-04c9-464e-84b3-68c2f0b8758a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:55.088150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ef0e624-04c9-464e-84b3-68c2f0b8758a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:55.088922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ef0e624-04c9-464e-84b3-68c2f0b8758a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:55.089458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ef0e624-04c9-464e-84b3-68c2f0b8758a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:55.090601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ef0e624-04c9-464e-84b3-68c2f0b8758a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:55.091482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ef0e624-04c9-464e-84b3-68c2f0b8758a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:55.092195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9ef0e624-04c9-464e-84b3-68c2f0b8758a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:55.431104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9ef0e624-04c9-464e-84b3-68c2f0b8758a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:55.449221 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9ef0e624-04c9-464e-84b3-68c2f0b8758a tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1462 microversion: 2.1 time: 0.377273 Aug 09 15:05:55.457593 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2721/5446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:55 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1462 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:55.522975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-21a59ca9-3b72-462c-8cba-d3a3f15c6e62 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:55.526049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9219fd6c-1650-47f6-956d-59b29b2cfc9a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:55.526669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9219fd6c-1650-47f6-956d-59b29b2cfc9a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:55.529174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:05:55.537534 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-21a59ca9-3b72-462c-8cba-d3a3f15c6e62 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1314 microversion: 2.1 time: 0.962305 Aug 09 15:05:55.541446 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2726/5447] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:54 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:55.552765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9219fd6c-1650-47f6-956d-59b29b2cfc9a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:55.555270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9219fd6c-1650-47f6-956d-59b29b2cfc9a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:55.555841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9219fd6c-1650-47f6-956d-59b29b2cfc9a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:55.556789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9219fd6c-1650-47f6-956d-59b29b2cfc9a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:55.557091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9219fd6c-1650-47f6-956d-59b29b2cfc9a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:55.557522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9219fd6c-1650-47f6-956d-59b29b2cfc9a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:55.688448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ccea48e6-1032-489a-b5c4-35f69e74c1ac tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:55.689267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ccea48e6-1032-489a-b5c4-35f69e74c1ac tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:55.713018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccea48e6-1032-489a-b5c4-35f69e74c1ac tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:55.713814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccea48e6-1032-489a-b5c4-35f69e74c1ac tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:55.714632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccea48e6-1032-489a-b5c4-35f69e74c1ac tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:55.729903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccea48e6-1032-489a-b5c4-35f69e74c1ac tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:55.733784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccea48e6-1032-489a-b5c4-35f69e74c1ac tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:55.734636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ccea48e6-1032-489a-b5c4-35f69e74c1ac tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:56.019829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9219fd6c-1650-47f6-956d-59b29b2cfc9a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:56.059110 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9219fd6c-1650-47f6-956d-59b29b2cfc9a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1395 microversion: 2.1 time: 0.536863 Aug 09 15:05:56.075469 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2722/5448] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:55 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1395 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:05:56.247038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ccea48e6-1032-489a-b5c4-35f69e74c1ac tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:56.287197 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ccea48e6-1032-489a-b5c4-35f69e74c1ac tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1562 microversion: 2.1 time: 0.578315 Aug 09 15:05:56.287197 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2727/5449] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:55 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1562 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:56.471641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9721faa3-75cf-4ada-8744-f219f22ccbc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:56.473173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9721faa3-75cf-4ada-8744-f219f22ccbc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:56.493934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9721faa3-75cf-4ada-8744-f219f22ccbc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:56.494923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9721faa3-75cf-4ada-8744-f219f22ccbc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:56.495721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9721faa3-75cf-4ada-8744-f219f22ccbc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:56.496887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9721faa3-75cf-4ada-8744-f219f22ccbc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:56.497506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9721faa3-75cf-4ada-8744-f219f22ccbc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:56.498017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9721faa3-75cf-4ada-8744-f219f22ccbc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:56.562917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6fa1144f-f5be-48ae-8d42-ceae5b9cb037 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:56.565242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6fa1144f-f5be-48ae-8d42-ceae5b9cb037 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:56.596980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6fa1144f-f5be-48ae-8d42-ceae5b9cb037 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:56.598721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6fa1144f-f5be-48ae-8d42-ceae5b9cb037 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:56.602697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6fa1144f-f5be-48ae-8d42-ceae5b9cb037 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:56.603851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6fa1144f-f5be-48ae-8d42-ceae5b9cb037 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:56.604527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6fa1144f-f5be-48ae-8d42-ceae5b9cb037 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:56.606702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6fa1144f-f5be-48ae-8d42-ceae5b9cb037 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:56.997544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9721faa3-75cf-4ada-8744-f219f22ccbc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:57.015538 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9721faa3-75cf-4ada-8744-f219f22ccbc1 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1462 microversion: 2.1 time: 0.548641 Aug 09 15:05:57.041306 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2723/5450] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:56 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1462 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:57.046725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b9074a3a-877e-44a8-a1e5-f51b723a2ed5 req-ebe25791-ecb5-4ef8-9581-455d7585c613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caaadba4-bf8c-4e32-b86f-a6e0e68bbd93", "tag": "90f33f03-4270-4292-a57d-108d8d490b0a"}, {"name": "network-changed", "server_uuid": "c5f4a6a1-7cd3-4957-aa49-ebea9726d182", "tag": "e89c0b1a-b60f-4b94-8015-a438b6b457de"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:57.067223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b9074a3a-877e-44a8-a1e5-f51b723a2ed5 req-ebe25791-ecb5-4ef8-9581-455d7585c613 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:57.067823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b9074a3a-877e-44a8-a1e5-f51b723a2ed5 req-ebe25791-ecb5-4ef8-9581-455d7585c613 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:57.069340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b9074a3a-877e-44a8-a1e5-f51b723a2ed5 req-ebe25791-ecb5-4ef8-9581-455d7585c613 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:57.086643 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b9074a3a-877e-44a8-a1e5-f51b723a2ed5 req-ebe25791-ecb5-4ef8-9581-455d7585c613 service nova] Creating event network-changed:90f33f03-4270-4292-a57d-108d8d490b0a for instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 on n-h2-844626-8 Aug 09 15:05:57.087238 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b9074a3a-877e-44a8-a1e5-f51b723a2ed5 req-ebe25791-ecb5-4ef8-9581-455d7585c613 service nova] Creating event network-changed:e89c0b1a-b60f-4b94-8015-a438b6b457de for instance c5f4a6a1-7cd3-4957-aa49-ebea9726d182 on n-h2-844626-8 Aug 09 15:05:57.094904 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b9074a3a-877e-44a8-a1e5-f51b723a2ed5 req-ebe25791-ecb5-4ef8-9581-455d7585c613 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052147 Aug 09 15:05:57.095723 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2724/5451] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:05:57.116398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bec21a22-abca-48c7-b560-bcafb7ca665b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:57.121827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bec21a22-abca-48c7-b560-bcafb7ca665b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:57.133966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bec21a22-abca-48c7-b560-bcafb7ca665b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:57.134333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bec21a22-abca-48c7-b560-bcafb7ca665b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:57.134779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bec21a22-abca-48c7-b560-bcafb7ca665b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:57.135538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bec21a22-abca-48c7-b560-bcafb7ca665b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:57.136003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bec21a22-abca-48c7-b560-bcafb7ca665b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:57.144403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bec21a22-abca-48c7-b560-bcafb7ca665b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:57.518913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6fa1144f-f5be-48ae-8d42-ceae5b9cb037 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:57.532199 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6fa1144f-f5be-48ae-8d42-ceae5b9cb037 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1314 microversion: 2.1 time: 0.973445 Aug 09 15:05:57.533195 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2728/5452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:56 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1314 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:57.700456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bec21a22-abca-48c7-b560-bcafb7ca665b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:57.709698 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bec21a22-abca-48c7-b560-bcafb7ca665b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1395 microversion: 2.1 time: 0.612767 Aug 09 15:05:57.710302 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2725/5453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:57 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1395 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:58.041537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78166d3a-1a5b-4bce-b24b-607d18e032ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:58.042198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-78166d3a-1a5b-4bce-b24b-607d18e032ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:58.051455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78166d3a-1a5b-4bce-b24b-607d18e032ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:58.052410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78166d3a-1a5b-4bce-b24b-607d18e032ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:58.053100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78166d3a-1a5b-4bce-b24b-607d18e032ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:58.054057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78166d3a-1a5b-4bce-b24b-607d18e032ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:58.054735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78166d3a-1a5b-4bce-b24b-607d18e032ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:58.055427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78166d3a-1a5b-4bce-b24b-607d18e032ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:58.199673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-78166d3a-1a5b-4bce-b24b-607d18e032ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:58.210455 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78166d3a-1a5b-4bce-b24b-607d18e032ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 200 len: 1462 microversion: 2.1 time: 0.171818 Aug 09 15:05:58.211374 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2729/5454] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:58 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 1462 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:58.377357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1162d3db-b4a4-4766-8778-eecbd54f4f5c req-c90dd23c-7d6d-4e34-ae22-f454756339d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792ae721-3b19-4713-bcf0-79ee402eff02", "name": "network-vif-deleted", "tag": "d9c9cd0d-ffdf-4c44-a5be-c482bea7adfa"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:05:58.411896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1162d3db-b4a4-4766-8778-eecbd54f4f5c req-c90dd23c-7d6d-4e34-ae22-f454756339d1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:58.416474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1162d3db-b4a4-4766-8778-eecbd54f4f5c req-c90dd23c-7d6d-4e34-ae22-f454756339d1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:58.418726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1162d3db-b4a4-4766-8778-eecbd54f4f5c req-c90dd23c-7d6d-4e34-ae22-f454756339d1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:58.458311 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1162d3db-b4a4-4766-8778-eecbd54f4f5c req-c90dd23c-7d6d-4e34-ae22-f454756339d1 service nova] Creating event network-vif-deleted:d9c9cd0d-ffdf-4c44-a5be-c482bea7adfa for instance 792ae721-3b19-4713-bcf0-79ee402eff02 on n-h1-844626-8 Aug 09 15:05:58.474164 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1162d3db-b4a4-4766-8778-eecbd54f4f5c req-c90dd23c-7d6d-4e34-ae22-f454756339d1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100387 Aug 09 15:05:58.477328 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2726/5455] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:05:58.553596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0368e53c-0cd7-4e3d-8bcd-250abbe14a6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:58.554219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0368e53c-0cd7-4e3d-8bcd-250abbe14a6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:58.567570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0368e53c-0cd7-4e3d-8bcd-250abbe14a6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:58.567997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0368e53c-0cd7-4e3d-8bcd-250abbe14a6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:58.568431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0368e53c-0cd7-4e3d-8bcd-250abbe14a6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:58.569135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0368e53c-0cd7-4e3d-8bcd-250abbe14a6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:58.570901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0368e53c-0cd7-4e3d-8bcd-250abbe14a6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:58.572146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0368e53c-0cd7-4e3d-8bcd-250abbe14a6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:58.733283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fae78755-6cd3-4dd3-b7b4-42b0cee155bd tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:58.734008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fae78755-6cd3-4dd3-b7b4-42b0cee155bd tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:58.754443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fae78755-6cd3-4dd3-b7b4-42b0cee155bd tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:58.755045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fae78755-6cd3-4dd3-b7b4-42b0cee155bd tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:58.755520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fae78755-6cd3-4dd3-b7b4-42b0cee155bd tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:58.756768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fae78755-6cd3-4dd3-b7b4-42b0cee155bd tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:58.757139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fae78755-6cd3-4dd3-b7b4-42b0cee155bd tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:58.757623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fae78755-6cd3-4dd3-b7b4-42b0cee155bd tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:58.990709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fae78755-6cd3-4dd3-b7b4-42b0cee155bd tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:59.004454 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fae78755-6cd3-4dd3-b7b4-42b0cee155bd tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1353 microversion: 2.1 time: 0.276752 Aug 09 15:05:59.005589 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2727/5456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:58 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1353 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:59.232760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b4389de-366c-4852-a925-39bc89fbb6ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:59.233378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b4389de-366c-4852-a925-39bc89fbb6ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 792ae721-3b19-4713-bcf0-79ee402eff02] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:59.250756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b4389de-366c-4852-a925-39bc89fbb6ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:59.251564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b4389de-366c-4852-a925-39bc89fbb6ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:59.252529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b4389de-366c-4852-a925-39bc89fbb6ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:59.253638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b4389de-366c-4852-a925-39bc89fbb6ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:59.254677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b4389de-366c-4852-a925-39bc89fbb6ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:59.255473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b4389de-366c-4852-a925-39bc89fbb6ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:59.259303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0368e53c-0cd7-4e3d-8bcd-250abbe14a6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:05:59.271855 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0368e53c-0cd7-4e3d-8bcd-250abbe14a6e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1314 microversion: 2.1 time: 0.722044 Aug 09 15:05:59.274927 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2730/5457] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:58 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:05:59.298552 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-7b4389de-366c-4852-a925-39bc89fbb6ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] HTTP exception thrown: Instance 792ae721-3b19-4713-bcf0-79ee402eff02 could not be found. Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b4389de-366c-4852-a925-39bc89fbb6ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Request method failure captured: Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 HTTP/1.1 Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nYEf9bYbaWm9LpfA_LfwfUAPPg3KiAcIP0FvUZa5q3lW1cxsq_VEWuea_CUOz5st4geKgSqeruMxTrCCG4yN7K5xPHcsvFJ9uo_ztCad5wmGGhupiyzg1AjNhOoCjxRWlcQTxcsGTT3hxXSJl2NJVAtQ8LITGkETiM4QQ4BkISsF8I Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 891029e759ac441f8a08c38bca92be81 Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerActionsTestJSON-673566527 Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_891029e759ac441f8a08c38bca92be81", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/891029e759ac441f8a08c38bca92be81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/891029e759ac441f8a08c38bca92be81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/891029e759ac441f8a08c38bca92be81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerActionsTestJSON-673566527 Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 891029e759ac441f8a08c38bca92be81 Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerActionsTestJSON-673566527 Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerActionsTestJSON-673566527-project Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3da785ddf56e4b028c6647643d97c952 Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerActionsTestJSON-673566527-project Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 792ae721-3b19-4713-bcf0-79ee402eff02 could not be found. Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '792ae721-3b19-4713-bcf0-79ee402eff02'} Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 792ae721-3b19-4713-bcf0-79ee402eff02 could not be found. Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 792ae721-3b19-4713-bcf0-79ee402eff02 could not be found. Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:05:59.310703 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:05:59.315978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:05:59.315978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:05:59.315978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:05:59.315978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:05:59.315978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:05:59.315978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 792ae721-3b19-4713-bcf0-79ee402eff02 could not be found. Aug 09 15:05:59.315978 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:05:59.315978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b4389de-366c-4852-a925-39bc89fbb6ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Returning 404 to user: Instance 792ae721-3b19-4713-bcf0-79ee402eff02 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:05:59.315978 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b4389de-366c-4852-a925-39bc89fbb6ac tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02" status: 404 len: 111 microversion: 2.1 time: 0.083540 Aug 09 15:05:59.320916 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2728/5458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:59 2022] GET /compute/v2.1/servers/792ae721-3b19-4713-bcf0-79ee402eff02 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:05:59.321273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ba96af4-500b-421a-9c6d-54a86dbb906c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:59.321669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ba96af4-500b-421a-9c6d-54a86dbb906c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:59.335343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba96af4-500b-421a-9c6d-54a86dbb906c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:59.336092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba96af4-500b-421a-9c6d-54a86dbb906c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:59.336720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba96af4-500b-421a-9c6d-54a86dbb906c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:59.340525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba96af4-500b-421a-9c6d-54a86dbb906c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:59.341184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba96af4-500b-421a-9c6d-54a86dbb906c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:59.341777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ba96af4-500b-421a-9c6d-54a86dbb906c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:59.386552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ba96af4-500b-421a-9c6d-54a86dbb906c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:05:59.531069 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ba96af4-500b-421a-9c6d-54a86dbb906c tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "DELETE /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 204 len: 0 microversion: 2.1 time: 0.213554 Aug 09 15:05:59.532078 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2731/5459] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:05:59 2022] DELETE /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:05:59.540039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-96b2524c-f18f-462f-b06b-79abad2bb5e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:05:59.540657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-96b2524c-f18f-462f-b06b-79abad2bb5e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:05:59.550999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96b2524c-f18f-462f-b06b-79abad2bb5e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:59.551890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96b2524c-f18f-462f-b06b-79abad2bb5e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:59.552342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96b2524c-f18f-462f-b06b-79abad2bb5e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:59.553087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96b2524c-f18f-462f-b06b-79abad2bb5e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:05:59.553538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96b2524c-f18f-462f-b06b-79abad2bb5e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:05:59.553969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96b2524c-f18f-462f-b06b-79abad2bb5e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:05:59.991192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:00.013700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-96b2524c-f18f-462f-b06b-79abad2bb5e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:00.020799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:00.029187 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-96b2524c-f18f-462f-b06b-79abad2bb5e6 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1504 microversion: 2.1 time: 0.493001 Aug 09 15:06:00.030153 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2729/5460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:05:59 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1504 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:00.052453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2e65e8c-7744-4daa-bee7-266f01d578ae tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:00.053488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c2e65e8c-7744-4daa-bee7-266f01d578ae tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:00.060959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:00.063860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:00.070292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2e65e8c-7744-4daa-bee7-266f01d578ae tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:00.074996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2e65e8c-7744-4daa-bee7-266f01d578ae tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:00.075757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2e65e8c-7744-4daa-bee7-266f01d578ae tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:00.076709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2e65e8c-7744-4daa-bee7-266f01d578ae tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:00.078937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2e65e8c-7744-4daa-bee7-266f01d578ae tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:00.079667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2e65e8c-7744-4daa-bee7-266f01d578ae tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:00.115723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:00.283876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2e65e8c-7744-4daa-bee7-266f01d578ae tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:00.297446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-86297ba3-20b1-4916-a8d0-c79b1e95813c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:00.298140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-86297ba3-20b1-4916-a8d0-c79b1e95813c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:00.311967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86297ba3-20b1-4916-a8d0-c79b1e95813c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:00.312457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86297ba3-20b1-4916-a8d0-c79b1e95813c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:00.312895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86297ba3-20b1-4916-a8d0-c79b1e95813c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:00.313641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86297ba3-20b1-4916-a8d0-c79b1e95813c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:00.314111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86297ba3-20b1-4916-a8d0-c79b1e95813c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:00.314520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-86297ba3-20b1-4916-a8d0-c79b1e95813c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:00.320209 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2e65e8c-7744-4daa-bee7-266f01d578ae tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1187 microversion: 2.1 time: 0.272320 Aug 09 15:06:00.325468 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2732/5461] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:00 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1187 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:00.546622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a169dcf9-82b4-4d61-9dfd-b4cc025d8f3d req-b24bb304-cf53-4d04-97b2-3c7d170d0648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2dd98462-10c0-47f0-93a9-eb59730f6871", "name": "network-vif-deleted", "tag": "03176526-0a12-4f15-8e80-6c0a4903cd9b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:00.570279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a169dcf9-82b4-4d61-9dfd-b4cc025d8f3d req-b24bb304-cf53-4d04-97b2-3c7d170d0648 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:00.570762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a169dcf9-82b4-4d61-9dfd-b4cc025d8f3d req-b24bb304-cf53-4d04-97b2-3c7d170d0648 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:00.571225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a169dcf9-82b4-4d61-9dfd-b4cc025d8f3d req-b24bb304-cf53-4d04-97b2-3c7d170d0648 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:00.606898 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a169dcf9-82b4-4d61-9dfd-b4cc025d8f3d req-b24bb304-cf53-4d04-97b2-3c7d170d0648 service nova] Creating event network-vif-deleted:03176526-0a12-4f15-8e80-6c0a4903cd9b for instance 2dd98462-10c0-47f0-93a9-eb59730f6871 on n-h1-844626-8 Aug 09 15:06:00.629060 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a169dcf9-82b4-4d61-9dfd-b4cc025d8f3d req-b24bb304-cf53-4d04-97b2-3c7d170d0648 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086874 Aug 09 15:06:00.629747 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2733/5462] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:06:00.889453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-86297ba3-20b1-4916-a8d0-c79b1e95813c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:00.898615 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-86297ba3-20b1-4916-a8d0-c79b1e95813c tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1314 microversion: 2.1 time: 0.606076 Aug 09 15:06:00.913508 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2730/5463] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:00 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:01.051266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9010cb5c-ba6e-4116-9479-5346b05e1fa0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:01.052518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9010cb5c-ba6e-4116-9479-5346b05e1fa0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:01.064882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9010cb5c-ba6e-4116-9479-5346b05e1fa0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:01.069615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9010cb5c-ba6e-4116-9479-5346b05e1fa0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:01.070701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9010cb5c-ba6e-4116-9479-5346b05e1fa0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:01.074244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9010cb5c-ba6e-4116-9479-5346b05e1fa0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:01.074881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9010cb5c-ba6e-4116-9479-5346b05e1fa0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:01.075668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9010cb5c-ba6e-4116-9479-5346b05e1fa0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:01.342939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-80f6a9d5-fb8f-477e-96bd-0248ba8aba19 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:01.344428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-80f6a9d5-fb8f-477e-96bd-0248ba8aba19 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:01.354605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9010cb5c-ba6e-4116-9479-5346b05e1fa0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:01.369750 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9010cb5c-ba6e-4116-9479-5346b05e1fa0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1504 microversion: 2.1 time: 0.323373 Aug 09 15:06:01.372387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f6a9d5-fb8f-477e-96bd-0248ba8aba19 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:01.373157 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2734/5464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:01 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:01.388599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f6a9d5-fb8f-477e-96bd-0248ba8aba19 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:01.389955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f6a9d5-fb8f-477e-96bd-0248ba8aba19 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:01.391119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f6a9d5-fb8f-477e-96bd-0248ba8aba19 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:01.391877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f6a9d5-fb8f-477e-96bd-0248ba8aba19 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:01.392539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80f6a9d5-fb8f-477e-96bd-0248ba8aba19 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:01.523390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-80f6a9d5-fb8f-477e-96bd-0248ba8aba19 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:01.536689 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-80f6a9d5-fb8f-477e-96bd-0248ba8aba19 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1187 microversion: 2.1 time: 0.197825 Aug 09 15:06:01.541543 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2731/5465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:01 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1187 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:01.923592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f207ba7a-3974-4692-99e5-d8f1875f039e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:01.925085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f207ba7a-3974-4692-99e5-d8f1875f039e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:01.938165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f207ba7a-3974-4692-99e5-d8f1875f039e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:01.942091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f207ba7a-3974-4692-99e5-d8f1875f039e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:01.945596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f207ba7a-3974-4692-99e5-d8f1875f039e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:01.946936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f207ba7a-3974-4692-99e5-d8f1875f039e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:01.947630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f207ba7a-3974-4692-99e5-d8f1875f039e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:01.948166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f207ba7a-3974-4692-99e5-d8f1875f039e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:02.394004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:02.394626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:02.419766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:02.422177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:02.422910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:02.423930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:02.427650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:02.428293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:02.558772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:02.559336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:02.559771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:02.561021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lazy-loading 'fault' on Instance uuid 18943b03-73fd-47cf-bd10-0a11a0b7ada1 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:06:02.896146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:02.899943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f207ba7a-3974-4692-99e5-d8f1875f039e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:02.907291 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-041eb2bd-ed50-4e71-8e9f-7f12c1d928e2 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 200 len: 1305 microversion: 2.1 time: 0.517144 Aug 09 15:06:02.909832 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f207ba7a-3974-4692-99e5-d8f1875f039e tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1314 microversion: 2.1 time: 0.991903 Aug 09 15:06:02.913047 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2732/5466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:02 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 1305 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:02.920349 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2735/5467] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:01 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1314 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:02.924499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fc529194-adb8-4224-a0cb-4c1799590af3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:02.925323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fc529194-adb8-4224-a0cb-4c1799590af3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:02.938047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-54d4964f-5b72-4e74-82d8-5dd6a7ee50b9 req-1bd0f7e8-5b4a-4cf0-baff-cdaea71605a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18943b03-73fd-47cf-bd10-0a11a0b7ada1", "name": "network-vif-deleted", "tag": "c242588e-55cf-4148-a3c1-a7cb408d7679"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:02.942724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc529194-adb8-4224-a0cb-4c1799590af3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:02.943244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc529194-adb8-4224-a0cb-4c1799590af3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:02.943678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc529194-adb8-4224-a0cb-4c1799590af3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:02.945563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc529194-adb8-4224-a0cb-4c1799590af3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:02.946192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc529194-adb8-4224-a0cb-4c1799590af3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:02.946776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc529194-adb8-4224-a0cb-4c1799590af3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:02.964080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-54d4964f-5b72-4e74-82d8-5dd6a7ee50b9 req-1bd0f7e8-5b4a-4cf0-baff-cdaea71605a8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:02.964926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-54d4964f-5b72-4e74-82d8-5dd6a7ee50b9 req-1bd0f7e8-5b4a-4cf0-baff-cdaea71605a8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:02.965554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-54d4964f-5b72-4e74-82d8-5dd6a7ee50b9 req-1bd0f7e8-5b4a-4cf0-baff-cdaea71605a8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:02.981004 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-54d4964f-5b72-4e74-82d8-5dd6a7ee50b9 req-1bd0f7e8-5b4a-4cf0-baff-cdaea71605a8 service nova] Creating event network-vif-deleted:c242588e-55cf-4148-a3c1-a7cb408d7679 for instance 18943b03-73fd-47cf-bd10-0a11a0b7ada1 on n-h1-844626-8 Aug 09 15:06:02.988040 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-54d4964f-5b72-4e74-82d8-5dd6a7ee50b9 req-1bd0f7e8-5b4a-4cf0-baff-cdaea71605a8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065585 Aug 09 15:06:02.990324 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2736/5468] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:06:03.102152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fc529194-adb8-4224-a0cb-4c1799590af3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:03.121644 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fc529194-adb8-4224-a0cb-4c1799590af3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1187 microversion: 2.1 time: 0.207302 Aug 09 15:06:03.128135 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2733/5469] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:02 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1187 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:03.476268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5c75e796-57d0-4653-b4c4-6a3fc630c47c req-6faec322-69d9-43d8-8536-c8dd21cac7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f4a6a1-7cd3-4957-aa49-ebea9726d182", "name": "network-vif-plugged", "status": "completed", "tag": "e89c0b1a-b60f-4b94-8015-a438b6b457de"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:03.503904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5c75e796-57d0-4653-b4c4-6a3fc630c47c req-6faec322-69d9-43d8-8536-c8dd21cac7e6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:03.504815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5c75e796-57d0-4653-b4c4-6a3fc630c47c req-6faec322-69d9-43d8-8536-c8dd21cac7e6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:03.505580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5c75e796-57d0-4653-b4c4-6a3fc630c47c req-6faec322-69d9-43d8-8536-c8dd21cac7e6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:03.524716 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5c75e796-57d0-4653-b4c4-6a3fc630c47c req-6faec322-69d9-43d8-8536-c8dd21cac7e6 service nova] Creating event network-vif-plugged:e89c0b1a-b60f-4b94-8015-a438b6b457de for instance c5f4a6a1-7cd3-4957-aa49-ebea9726d182 on n-h2-844626-8 Aug 09 15:06:03.533599 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5c75e796-57d0-4653-b4c4-6a3fc630c47c req-6faec322-69d9-43d8-8536-c8dd21cac7e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080400 Aug 09 15:06:03.535047 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2737/5470] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:06:03.933376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dcf76019-d783-4f3f-9df7-be619b15a3d2 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:03.934114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dcf76019-d783-4f3f-9df7-be619b15a3d2 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:03.938138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85f80d5e-0c98-4df8-acf2-3b1bfd3caba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:03.939212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85f80d5e-0c98-4df8-acf2-3b1bfd3caba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: 18943b03-73fd-47cf-bd10-0a11a0b7ada1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:03.942387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcf76019-d783-4f3f-9df7-be619b15a3d2 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:03.943140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcf76019-d783-4f3f-9df7-be619b15a3d2 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:03.943768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcf76019-d783-4f3f-9df7-be619b15a3d2 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:03.944646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcf76019-d783-4f3f-9df7-be619b15a3d2 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:03.945268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcf76019-d783-4f3f-9df7-be619b15a3d2 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:03.945867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dcf76019-d783-4f3f-9df7-be619b15a3d2 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:03.951758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85f80d5e-0c98-4df8-acf2-3b1bfd3caba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:03.952273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85f80d5e-0c98-4df8-acf2-3b1bfd3caba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:03.952717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85f80d5e-0c98-4df8-acf2-3b1bfd3caba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:03.953457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85f80d5e-0c98-4df8-acf2-3b1bfd3caba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:03.956134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85f80d5e-0c98-4df8-acf2-3b1bfd3caba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:03.957062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85f80d5e-0c98-4df8-acf2-3b1bfd3caba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:03.982388 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-85f80d5e-0c98-4df8-acf2-3b1bfd3caba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] HTTP exception thrown: Instance 18943b03-73fd-47cf-bd10-0a11a0b7ada1 could not be found. Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85f80d5e-0c98-4df8-acf2-3b1bfd3caba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Request method failure captured: Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 HTTP/1.1 Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nYEf9bYbaWm9LpfA_LfwfUAPPg3KiAcIP0FvUZa5q3lW1cxsq_VEWuea_CUOz5st4geKgSqeruMxTrCCG4yN7K5xPHcsvFJ9uo_ztCad5wmGGhupiyzg1AjNhOoCjxRWlcQTxcsGTT3hxXSJl2NJVAtQ8LITGkETiM4QQ4BkISsF8I Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 891029e759ac441f8a08c38bca92be81 Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerActionsTestJSON-673566527 Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_891029e759ac441f8a08c38bca92be81", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/891029e759ac441f8a08c38bca92be81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/891029e759ac441f8a08c38bca92be81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/891029e759ac441f8a08c38bca92be81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerActionsTestJSON-673566527 Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 891029e759ac441f8a08c38bca92be81 Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerActionsTestJSON-673566527 Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerActionsTestJSON-673566527-project Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 3da785ddf56e4b028c6647643d97c952 Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerActionsTestJSON-673566527-project Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 18943b03-73fd-47cf-bd10-0a11a0b7ada1 could not be found. Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '18943b03-73fd-47cf-bd10-0a11a0b7ada1'} Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18943b03-73fd-47cf-bd10-0a11a0b7ada1 could not be found. Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18943b03-73fd-47cf-bd10-0a11a0b7ada1 could not be found. Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:06:03.988071 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:03.993986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:03.993986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:06:03.993986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:06:03.993986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:06:03.993986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:06:03.993986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18943b03-73fd-47cf-bd10-0a11a0b7ada1 could not be found. Aug 09 15:06:03.993986 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:03.995763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85f80d5e-0c98-4df8-acf2-3b1bfd3caba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Returning 404 to user: Instance 18943b03-73fd-47cf-bd10-0a11a0b7ada1 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:06:03.996847 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85f80d5e-0c98-4df8-acf2-3b1bfd3caba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1" status: 404 len: 111 microversion: 2.1 time: 0.063553 Aug 09 15:06:03.997606 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2738/5471] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:03 2022] GET /compute/v2.1/servers/18943b03-73fd-47cf-bd10-0a11a0b7ada1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:06:04.008037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cbc7ef81-059d-475a-a100-56fb2fa4fead tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:04.008803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cbc7ef81-059d-475a-a100-56fb2fa4fead tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:04.021855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cbc7ef81-059d-475a-a100-56fb2fa4fead tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:04.022629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cbc7ef81-059d-475a-a100-56fb2fa4fead tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:04.023350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cbc7ef81-059d-475a-a100-56fb2fa4fead tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:04.024236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cbc7ef81-059d-475a-a100-56fb2fa4fead tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:04.024857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cbc7ef81-059d-475a-a100-56fb2fa4fead tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:04.028398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cbc7ef81-059d-475a-a100-56fb2fa4fead tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:04.076440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cbc7ef81-059d-475a-a100-56fb2fa4fead tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:06:04.206343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:04.233016 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cbc7ef81-059d-475a-a100-56fb2fa4fead tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 204 len: 0 microversion: 2.1 time: 0.229528 Aug 09 15:06:04.243667 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2739/5472] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:06:04 2022] DELETE /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:06:04.253625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-538d13d5-35ae-4d67-b6a2-15c4617185d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:04.255292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-538d13d5-35ae-4d67-b6a2-15c4617185d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:04.269160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-538d13d5-35ae-4d67-b6a2-15c4617185d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:04.270395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-538d13d5-35ae-4d67-b6a2-15c4617185d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:04.271335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-538d13d5-35ae-4d67-b6a2-15c4617185d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:04.272800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-538d13d5-35ae-4d67-b6a2-15c4617185d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:04.273657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-538d13d5-35ae-4d67-b6a2-15c4617185d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:04.274526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-538d13d5-35ae-4d67-b6a2-15c4617185d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:04.358630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dcf76019-d783-4f3f-9df7-be619b15a3d2 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:04.384716 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dcf76019-d783-4f3f-9df7-be619b15a3d2 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1314 microversion: 2.1 time: 0.454771 Aug 09 15:06:04.389792 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2734/5473] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:03 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:04.405454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-352b6e10-208a-45fb-80c8-8f5db29eb08b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:04.409600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-352b6e10-208a-45fb-80c8-8f5db29eb08b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:04.434027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-352b6e10-208a-45fb-80c8-8f5db29eb08b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:04.435586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-352b6e10-208a-45fb-80c8-8f5db29eb08b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:04.436740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-352b6e10-208a-45fb-80c8-8f5db29eb08b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:04.438554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-352b6e10-208a-45fb-80c8-8f5db29eb08b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:04.439917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-352b6e10-208a-45fb-80c8-8f5db29eb08b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:04.441047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-352b6e10-208a-45fb-80c8-8f5db29eb08b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:04.488851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-538d13d5-35ae-4d67-b6a2-15c4617185d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:04.533666 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-538d13d5-35ae-4d67-b6a2-15c4617185d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1187 microversion: 2.1 time: 0.287738 Aug 09 15:06:04.559684 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2740/5474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:04 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1187 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:04.858765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-352b6e10-208a-45fb-80c8-8f5db29eb08b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:04.867644 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-352b6e10-208a-45fb-80c8-8f5db29eb08b tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1492 microversion: 2.1 time: 0.476192 Aug 09 15:06:04.868925 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2735/5475] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:04 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1492 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:05.420287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93005ba4-40cb-4128-bb3d-f82c54492e37 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:05.423843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93005ba4-40cb-4128-bb3d-f82c54492e37 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:05.431973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93005ba4-40cb-4128-bb3d-f82c54492e37 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:05.433091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93005ba4-40cb-4128-bb3d-f82c54492e37 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:05.434006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93005ba4-40cb-4128-bb3d-f82c54492e37 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:05.435326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93005ba4-40cb-4128-bb3d-f82c54492e37 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:05.436403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93005ba4-40cb-4128-bb3d-f82c54492e37 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:05.439544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93005ba4-40cb-4128-bb3d-f82c54492e37 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:05.574376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:05.575291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:05.596424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:05.597812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:05.599506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:05.600834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:05.601814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:05.602502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:05.673813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:05.675212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:05.676210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:05.677193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lazy-loading 'fault' on Instance uuid 2dd98462-10c0-47f0-93a9-eb59730f6871 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:06:05.793615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:05.817246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-93005ba4-40cb-4128-bb3d-f82c54492e37 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:05.821349 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5a06f329-c25a-492f-8e5a-ba4d8771802d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 200 len: 1192 microversion: 2.1 time: 0.250894 Aug 09 15:06:05.828468 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93005ba4-40cb-4128-bb3d-f82c54492e37 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1314 microversion: 2.1 time: 0.421404 Aug 09 15:06:05.835443 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2741/5476] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:05 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:05.838654 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2736/5477] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:05 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 1192 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:05.892282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-352b1347-15a0-42bf-9672-873746c962ba tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:05.892858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-352b1347-15a0-42bf-9672-873746c962ba tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:05.919672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-352b1347-15a0-42bf-9672-873746c962ba tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:05.924674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-352b1347-15a0-42bf-9672-873746c962ba tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:05.933879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-352b1347-15a0-42bf-9672-873746c962ba tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:05.939955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-352b1347-15a0-42bf-9672-873746c962ba tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:05.941668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-352b1347-15a0-42bf-9672-873746c962ba tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:05.942383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-352b1347-15a0-42bf-9672-873746c962ba tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:06.377379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-352b1347-15a0-42bf-9672-873746c962ba tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:06.412361 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-352b1347-15a0-42bf-9672-873746c962ba tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1492 microversion: 2.1 time: 0.509029 Aug 09 15:06:06.416038 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2742/5478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:05 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1492 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:06.851589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33004469-35e2-4943-a35a-d8adab10dd21 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:06.853764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-33004469-35e2-4943-a35a-d8adab10dd21 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 2dd98462-10c0-47f0-93a9-eb59730f6871] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:06.878008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62421897-fab2-4b96-bcba-3987e1976fd8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:06.886446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-62421897-fab2-4b96-bcba-3987e1976fd8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:06.903612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33004469-35e2-4943-a35a-d8adab10dd21 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:06.909662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33004469-35e2-4943-a35a-d8adab10dd21 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:06.918548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33004469-35e2-4943-a35a-d8adab10dd21 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:06.921732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33004469-35e2-4943-a35a-d8adab10dd21 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:06.928404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62421897-fab2-4b96-bcba-3987e1976fd8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:06.930089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33004469-35e2-4943-a35a-d8adab10dd21 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:06.931156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-33004469-35e2-4943-a35a-d8adab10dd21 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:06.939379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62421897-fab2-4b96-bcba-3987e1976fd8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:06.940679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62421897-fab2-4b96-bcba-3987e1976fd8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:06.942195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62421897-fab2-4b96-bcba-3987e1976fd8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:06.943454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62421897-fab2-4b96-bcba-3987e1976fd8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:06.944484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62421897-fab2-4b96-bcba-3987e1976fd8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:06.996872 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-33004469-35e2-4943-a35a-d8adab10dd21 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance 2dd98462-10c0-47f0-93a9-eb59730f6871 could not be found. Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33004469-35e2-4943-a35a-d8adab10dd21 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 HTTP/1.1 Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 2dd98462-10c0-47f0-93a9-eb59730f6871 could not be found. Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '2dd98462-10c0-47f0-93a9-eb59730f6871'} Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2dd98462-10c0-47f0-93a9-eb59730f6871 could not be found. Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2dd98462-10c0-47f0-93a9-eb59730f6871 could not be found. Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:06:07.007053 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:06:07.027315 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:07.027315 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:06:07.027315 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:06:07.027315 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:06:07.027315 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:06:07.027315 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2dd98462-10c0-47f0-93a9-eb59730f6871 could not be found. Aug 09 15:06:07.027315 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:06:07.030404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-33004469-35e2-4943-a35a-d8adab10dd21 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance 2dd98462-10c0-47f0-93a9-eb59730f6871 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:06:07.037738 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-33004469-35e2-4943-a35a-d8adab10dd21 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871" status: 404 len: 111 microversion: 2.1 time: 0.193941 Aug 09 15:06:07.051856 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2737/5479] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:06 2022] GET /compute/v2.1/servers/2dd98462-10c0-47f0-93a9-eb59730f6871 => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:06:07.418924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-62421897-fab2-4b96-bcba-3987e1976fd8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:07.450931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6df9b759-2813-4f33-b8c8-bbfa7eb591af tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:07.451924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6df9b759-2813-4f33-b8c8-bbfa7eb591af tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:07.457922 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-62421897-fab2-4b96-bcba-3987e1976fd8 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1497 microversion: 2.1 time: 0.586495 Aug 09 15:06:07.458819 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2743/5480] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:06 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1497 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:07.482210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6df9b759-2813-4f33-b8c8-bbfa7eb591af tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:07.483522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6df9b759-2813-4f33-b8c8-bbfa7eb591af tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:07.484514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6df9b759-2813-4f33-b8c8-bbfa7eb591af tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:07.486067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6df9b759-2813-4f33-b8c8-bbfa7eb591af tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:07.487164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6df9b759-2813-4f33-b8c8-bbfa7eb591af tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:07.488088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6df9b759-2813-4f33-b8c8-bbfa7eb591af tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:07.724334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-85d36832-ff49-4389-8740-93b374169225 req-f65abd14-d5af-437d-8987-c8df8591d435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3017401-936b-4537-a0c4-e0a80c1c7316", "name": "network-vif-deleted", "tag": "323bd9ce-f64e-4972-896f-1bedffe09a38"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:07.802251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-85d36832-ff49-4389-8740-93b374169225 req-f65abd14-d5af-437d-8987-c8df8591d435 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:07.807789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-85d36832-ff49-4389-8740-93b374169225 req-f65abd14-d5af-437d-8987-c8df8591d435 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:07.808700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-85d36832-ff49-4389-8740-93b374169225 req-f65abd14-d5af-437d-8987-c8df8591d435 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:07.853979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6df9b759-2813-4f33-b8c8-bbfa7eb591af tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:07.882830 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-85d36832-ff49-4389-8740-93b374169225 req-f65abd14-d5af-437d-8987-c8df8591d435 service nova] Creating event network-vif-deleted:323bd9ce-f64e-4972-896f-1bedffe09a38 for instance f3017401-936b-4537-a0c4-e0a80c1c7316 on n-h2-844626-8 Aug 09 15:06:07.939976 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6df9b759-2813-4f33-b8c8-bbfa7eb591af tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 200 len: 1450 microversion: 2.1 time: 0.441952 Aug 09 15:06:07.939976 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2738/5481] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:07 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 1450 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:07.944823 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-85d36832-ff49-4389-8740-93b374169225 req-f65abd14-d5af-437d-8987-c8df8591d435 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220586 Aug 09 15:06:07.944823 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2744/5482] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:06:08.644451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-97b466c6-c77d-480b-8a8c-35c5bdde3959 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:08.645621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-97b466c6-c77d-480b-8a8c-35c5bdde3959 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:08.671897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97b466c6-c77d-480b-8a8c-35c5bdde3959 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:08.674002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97b466c6-c77d-480b-8a8c-35c5bdde3959 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:08.678460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97b466c6-c77d-480b-8a8c-35c5bdde3959 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:08.680504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97b466c6-c77d-480b-8a8c-35c5bdde3959 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:08.681401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97b466c6-c77d-480b-8a8c-35c5bdde3959 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:08.687617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97b466c6-c77d-480b-8a8c-35c5bdde3959 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:08.773782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-97b466c6-c77d-480b-8a8c-35c5bdde3959 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:06:08.902364 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-97b466c6-c77d-480b-8a8c-35c5bdde3959 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 204 len: 0 microversion: 2.1 time: 0.267623 Aug 09 15:06:08.904296 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2739/5483] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:06:08 2022] DELETE /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:06:08.915345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5f6b114-dcc8-4e0a-aeb6-d4e681d9ccdb tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:08.916606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5f6b114-dcc8-4e0a-aeb6-d4e681d9ccdb tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:08.928867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82334af7-fc0d-474f-b96e-8fc26d542ba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:08.929567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-82334af7-fc0d-474f-b96e-8fc26d542ba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f3017401-936b-4537-a0c4-e0a80c1c7316] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:08.933840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5f6b114-dcc8-4e0a-aeb6-d4e681d9ccdb tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:08.934327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5f6b114-dcc8-4e0a-aeb6-d4e681d9ccdb tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:08.934753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5f6b114-dcc8-4e0a-aeb6-d4e681d9ccdb tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:08.935493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5f6b114-dcc8-4e0a-aeb6-d4e681d9ccdb tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:08.935936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5f6b114-dcc8-4e0a-aeb6-d4e681d9ccdb tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:08.938184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5f6b114-dcc8-4e0a-aeb6-d4e681d9ccdb tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:08.948175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82334af7-fc0d-474f-b96e-8fc26d542ba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:08.953812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82334af7-fc0d-474f-b96e-8fc26d542ba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:08.954639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82334af7-fc0d-474f-b96e-8fc26d542ba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:08.955564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82334af7-fc0d-474f-b96e-8fc26d542ba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:08.959521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82334af7-fc0d-474f-b96e-8fc26d542ba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:08.960171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82334af7-fc0d-474f-b96e-8fc26d542ba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:08.985347 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-82334af7-fc0d-474f-b96e-8fc26d542ba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] HTTP exception thrown: Instance f3017401-936b-4537-a0c4-e0a80c1c7316 could not be found. Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82334af7-fc0d-474f-b96e-8fc26d542ba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Request method failure captured: Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 HTTP/1.1 Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nYEf9bYbaWm9LpfA_LfwfUAPPg3KiAcIP0FvUZa5q3lW1cxsq_VEWuea_CUOz5st4geKgSqeruMxTrCCG4yN7K5xPHcsvFJ9uo_ztCad5wmGGhupiyzg1AjNhOoCjxRWlcQTxcsGTT3hxXSJl2NJVAtQ8LITGkETiM4QQ4BkISsF8I Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 891029e759ac441f8a08c38bca92be81 Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerActionsTestJSON-673566527 Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_891029e759ac441f8a08c38bca92be81", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/891029e759ac441f8a08c38bca92be81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/891029e759ac441f8a08c38bca92be81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/891029e759ac441f8a08c38bca92be81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerActionsTestJSON-673566527 Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 891029e759ac441f8a08c38bca92be81 Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerActionsTestJSON-673566527 Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerActionsTestJSON-673566527-project Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3da785ddf56e4b028c6647643d97c952 Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerActionsTestJSON-673566527-project Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance f3017401-936b-4537-a0c4-e0a80c1c7316 could not be found. Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'f3017401-936b-4537-a0c4-e0a80c1c7316'} Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3017401-936b-4537-a0c4-e0a80c1c7316 could not be found. Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3017401-936b-4537-a0c4-e0a80c1c7316 could not be found. Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:06:08.994118 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:06:08.997797 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:08.997797 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:06:08.997797 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:06:08.997797 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:06:08.997797 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:06:08.997797 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3017401-936b-4537-a0c4-e0a80c1c7316 could not be found. Aug 09 15:06:08.997797 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:06:08.997797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82334af7-fc0d-474f-b96e-8fc26d542ba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Returning 404 to user: Instance f3017401-936b-4537-a0c4-e0a80c1c7316 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:06:08.999989 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-82334af7-fc0d-474f-b96e-8fc26d542ba8 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316" status: 404 len: 111 microversion: 2.1 time: 0.073738 Aug 09 15:06:09.004902 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2740/5484] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:08 2022] GET /compute/v2.1/servers/f3017401-936b-4537-a0c4-e0a80c1c7316 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:06:09.024399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ad43374-5302-46c1-9d1f-64f34a2ce375 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:09.025089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1ad43374-5302-46c1-9d1f-64f34a2ce375 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:09.040064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ad43374-5302-46c1-9d1f-64f34a2ce375 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:09.040567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ad43374-5302-46c1-9d1f-64f34a2ce375 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:09.041197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ad43374-5302-46c1-9d1f-64f34a2ce375 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:09.041989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ad43374-5302-46c1-9d1f-64f34a2ce375 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:09.042459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ad43374-5302-46c1-9d1f-64f34a2ce375 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:09.042918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ad43374-5302-46c1-9d1f-64f34a2ce375 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:09.080573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1ad43374-5302-46c1-9d1f-64f34a2ce375 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:06:09.190495 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1ad43374-5302-46c1-9d1f-64f34a2ce375 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "DELETE /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 204 len: 0 microversion: 2.1 time: 0.181193 Aug 09 15:06:09.195921 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2741/5485] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:06:09 2022] DELETE /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:06:09.203560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a007cba8-9b38-4f8d-aeec-d6c8421e3fc0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:09.204644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a007cba8-9b38-4f8d-aeec-d6c8421e3fc0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:09.213726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a007cba8-9b38-4f8d-aeec-d6c8421e3fc0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:09.214951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a007cba8-9b38-4f8d-aeec-d6c8421e3fc0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:09.216494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a007cba8-9b38-4f8d-aeec-d6c8421e3fc0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:09.218315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a007cba8-9b38-4f8d-aeec-d6c8421e3fc0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:09.219437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a007cba8-9b38-4f8d-aeec-d6c8421e3fc0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:09.220659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a007cba8-9b38-4f8d-aeec-d6c8421e3fc0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:09.306758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5f6b114-dcc8-4e0a-aeb6-d4e681d9ccdb tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:09.317565 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5f6b114-dcc8-4e0a-aeb6-d4e681d9ccdb tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1503 microversion: 2.1 time: 0.406879 Aug 09 15:06:09.328870 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2745/5486] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:08 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1503 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:09.466913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a007cba8-9b38-4f8d-aeec-d6c8421e3fc0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:09.475291 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a007cba8-9b38-4f8d-aeec-d6c8421e3fc0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1671 microversion: 2.1 time: 0.277307 Aug 09 15:06:09.480684 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2742/5487] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:09 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1671 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:10.368546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f940fcae-06cc-456b-8245-5da8b55739cd tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:10.373864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f940fcae-06cc-456b-8245-5da8b55739cd tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:10.388487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f940fcae-06cc-456b-8245-5da8b55739cd tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:10.395011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f940fcae-06cc-456b-8245-5da8b55739cd tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:10.395672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f940fcae-06cc-456b-8245-5da8b55739cd tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:10.396593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f940fcae-06cc-456b-8245-5da8b55739cd tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:10.397287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f940fcae-06cc-456b-8245-5da8b55739cd tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:10.399588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f940fcae-06cc-456b-8245-5da8b55739cd tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:10.515967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d4ae7582-d046-490a-8720-3a85b465cd26 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:10.516653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d4ae7582-d046-490a-8720-3a85b465cd26 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:10.544470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4ae7582-d046-490a-8720-3a85b465cd26 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:10.545118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4ae7582-d046-490a-8720-3a85b465cd26 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:10.545688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4ae7582-d046-490a-8720-3a85b465cd26 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:10.546545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4ae7582-d046-490a-8720-3a85b465cd26 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:10.551867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4ae7582-d046-490a-8720-3a85b465cd26 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:10.552540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4ae7582-d046-490a-8720-3a85b465cd26 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:10.757423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f940fcae-06cc-456b-8245-5da8b55739cd tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:10.769014 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f940fcae-06cc-456b-8245-5da8b55739cd tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1503 microversion: 2.1 time: 0.407575 Aug 09 15:06:10.783547 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2746/5488] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:10 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1503 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:10.953728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d4ae7582-d046-490a-8720-3a85b465cd26 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:10.957135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:10.968497 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d4ae7582-d046-490a-8720-3a85b465cd26 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1671 microversion: 2.1 time: 0.456455 Aug 09 15:06:10.970112 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2743/5489] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:10 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1671 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:11.805236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c3e9f353-ea8a-4b15-94ec-2eaa50ac78c6 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:11.806338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c3e9f353-ea8a-4b15-94ec-2eaa50ac78c6 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:11.822547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e9f353-ea8a-4b15-94ec-2eaa50ac78c6 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:11.823460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e9f353-ea8a-4b15-94ec-2eaa50ac78c6 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:11.824811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e9f353-ea8a-4b15-94ec-2eaa50ac78c6 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:11.826372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e9f353-ea8a-4b15-94ec-2eaa50ac78c6 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:11.827983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e9f353-ea8a-4b15-94ec-2eaa50ac78c6 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:11.829102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3e9f353-ea8a-4b15-94ec-2eaa50ac78c6 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:12.002781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d1c3b8ba-dd2d-4f8e-933b-8d47a6540fe7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:12.003431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d1c3b8ba-dd2d-4f8e-933b-8d47a6540fe7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:12.037462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1c3b8ba-dd2d-4f8e-933b-8d47a6540fe7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:12.038569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1c3b8ba-dd2d-4f8e-933b-8d47a6540fe7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:12.040918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1c3b8ba-dd2d-4f8e-933b-8d47a6540fe7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:12.053983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1c3b8ba-dd2d-4f8e-933b-8d47a6540fe7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:12.055724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1c3b8ba-dd2d-4f8e-933b-8d47a6540fe7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:12.056731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1c3b8ba-dd2d-4f8e-933b-8d47a6540fe7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:12.809075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c3e9f353-ea8a-4b15-94ec-2eaa50ac78c6 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:12.827108 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c3e9f353-ea8a-4b15-94ec-2eaa50ac78c6 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1503 microversion: 2.1 time: 1.033232 Aug 09 15:06:12.827925 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2747/5490] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:11 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1503 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:13.064058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d1c3b8ba-dd2d-4f8e-933b-8d47a6540fe7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:13.074423 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d1c3b8ba-dd2d-4f8e-933b-8d47a6540fe7 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1671 microversion: 2.1 time: 1.087641 Aug 09 15:06:13.076016 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2744/5491] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:11 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1671 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:13.576923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8301779a-e4d0-42ab-b971-5225ae4a7351 req-5eeea650-cce2-48e6-acec-246da940a56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f4a6a1-7cd3-4957-aa49-ebea9726d182", "name": "network-vif-deleted", "tag": "e89c0b1a-b60f-4b94-8015-a438b6b457de"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:13.603633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8301779a-e4d0-42ab-b971-5225ae4a7351 req-5eeea650-cce2-48e6-acec-246da940a56d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:13.604128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8301779a-e4d0-42ab-b971-5225ae4a7351 req-5eeea650-cce2-48e6-acec-246da940a56d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:13.610324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8301779a-e4d0-42ab-b971-5225ae4a7351 req-5eeea650-cce2-48e6-acec-246da940a56d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:13.649055 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8301779a-e4d0-42ab-b971-5225ae4a7351 req-5eeea650-cce2-48e6-acec-246da940a56d service nova] Creating event network-vif-deleted:e89c0b1a-b60f-4b94-8015-a438b6b457de for instance c5f4a6a1-7cd3-4957-aa49-ebea9726d182 on n-h2-844626-8 Aug 09 15:06:13.654890 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8301779a-e4d0-42ab-b971-5225ae4a7351 req-5eeea650-cce2-48e6-acec-246da940a56d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081701 Aug 09 15:06:13.656750 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2748/5492] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:06:13.852517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:13.853662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:13.863314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:13.864033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:13.864608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:13.865488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:13.866080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:13.866665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:13.929897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:13.930420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:13.930854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:13.931495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lazy-loading 'fault' on Instance uuid c5f4a6a1-7cd3-4957-aa49-ebea9726d182 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:06:14.030839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033310d1a41c4cefa3d905f65dc6c67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0ec11da657342d2aea2dcbedc2735bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:14.045062 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d3f7a7e6-4d89-4ad3-8e12-d81260e04d30 tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 200 len: 1304 microversion: 2.1 time: 0.197877 Aug 09 15:06:14.061124 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2745/5493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:13 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 1304 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:14.098037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e35269f9-d3c2-4389-97e9-c07089e2571d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:14.098729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e35269f9-d3c2-4389-97e9-c07089e2571d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:14.113765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e35269f9-d3c2-4389-97e9-c07089e2571d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:14.114276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e35269f9-d3c2-4389-97e9-c07089e2571d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:14.114760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e35269f9-d3c2-4389-97e9-c07089e2571d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:14.115646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e35269f9-d3c2-4389-97e9-c07089e2571d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:14.116058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e35269f9-d3c2-4389-97e9-c07089e2571d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:14.116532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e35269f9-d3c2-4389-97e9-c07089e2571d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:14.202434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1669315215", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "65b65592-4404-436e-89e0-c8e1ed95df43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:14.354204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] validate_networks() for [('1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:06:14.403070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e35269f9-d3c2-4389-97e9-c07089e2571d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:14.415283 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e35269f9-d3c2-4389-97e9-c07089e2571d tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1604 microversion: 2.1 time: 0.321402 Aug 09 15:06:14.425588 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2749/5494] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:14 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:15.039610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f904eb0d-a763-4408-835a-095ccc641039 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:15.044141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f904eb0d-a763-4408-835a-095ccc641039 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:15.061271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f904eb0d-a763-4408-835a-095ccc641039 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:15.063785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f904eb0d-a763-4408-835a-095ccc641039 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:15.066626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f904eb0d-a763-4408-835a-095ccc641039 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:15.067676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f904eb0d-a763-4408-835a-095ccc641039 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:15.068283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f904eb0d-a763-4408-835a-095ccc641039 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:15.070423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f904eb0d-a763-4408-835a-095ccc641039 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:15.081364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:06:15.082199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:06:15.083112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:06:15.083776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:06:15.084496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:06:15.098950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:15.117144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:15.121010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:15.122157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:15.123824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:15.125487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:15.156635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:06:15.158040 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f904eb0d-a763-4408-835a-095ccc641039 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93/action" status: 200 len: 24565 microversion: 2.1 time: 0.122291 Aug 09 15:06:15.165791 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2750/5495] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:06:15 2022] POST /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93/action => generated 24565 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 15:06:15.166196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for user f99b0693d22442ffa84b9c845d7cbc58 and project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:06:15.185658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-053697ff-354a-40cb-bbad-d7d026ad8b3d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:15.186375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-053697ff-354a-40cb-bbad-d7d026ad8b3d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] [instance: c5f4a6a1-7cd3-4957-aa49-ebea9726d182] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:15.219219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-053697ff-354a-40cb-bbad-d7d026ad8b3d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:15.219816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-053697ff-354a-40cb-bbad-d7d026ad8b3d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:15.220261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-053697ff-354a-40cb-bbad-d7d026ad8b3d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:15.224026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-053697ff-354a-40cb-bbad-d7d026ad8b3d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:15.224647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-053697ff-354a-40cb-bbad-d7d026ad8b3d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:15.225146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-053697ff-354a-40cb-bbad-d7d026ad8b3d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:15.256953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:06:15.260257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='65b65592-4404-436e-89e0-c8e1ed95df43',volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:06:15.263456 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-053697ff-354a-40cb-bbad-d7d026ad8b3d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] HTTP exception thrown: Instance c5f4a6a1-7cd3-4957-aa49-ebea9726d182 could not be found. Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-053697ff-354a-40cb-bbad-d7d026ad8b3d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Request method failure captured: Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 HTTP/1.1 Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nesPlYGA0iCG9FN7nrEPQ4Qin8m2trHPVn2pyaKFA2IntytwtZ9ZV-NROFlx4IN9XQ5yZobN9c-K59Mu3oDRjle8wG61VOPDfMnohASqQNCriqnzQsrvoKf8FX4nTEcpdq5jL_eDNC-fCirouCYTZEsCA11bMdKhJfQMr3puzh4QSY Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: e0ec11da657342d2aea2dcbedc2735bb Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-VolumesActionsTest-1669049742 Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e0ec11da657342d2aea2dcbedc2735bb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e0ec11da657342d2aea2dcbedc2735bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0ec11da657342d2aea2dcbedc2735bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e0ec11da657342d2aea2dcbedc2735bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-VolumesActionsTest-1669049742 Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: e0ec11da657342d2aea2dcbedc2735bb Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-VolumesActionsTest-1669049742 Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-VolumesActionsTest-1669049742-project Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 033310d1a41c4cefa3d905f65dc6c67e Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-VolumesActionsTest-1669049742-project Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance c5f4a6a1-7cd3-4957-aa49-ebea9726d182 could not be found. Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'c5f4a6a1-7cd3-4957-aa49-ebea9726d182'} Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5f4a6a1-7cd3-4957-aa49-ebea9726d182 could not be found. Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5f4a6a1-7cd3-4957-aa49-ebea9726d182 could not be found. Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:06:15.271582 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:15.275671 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:15.275671 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:06:15.275671 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:06:15.275671 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:06:15.275671 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:06:15.275671 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5f4a6a1-7cd3-4957-aa49-ebea9726d182 could not be found. Aug 09 15:06:15.275671 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:15.275671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-053697ff-354a-40cb-bbad-d7d026ad8b3d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] Returning 404 to user: Instance c5f4a6a1-7cd3-4957-aa49-ebea9726d182 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:06:15.276427 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-053697ff-354a-40cb-bbad-d7d026ad8b3d tempest-VolumesActionsTest-1669049742 tempest-VolumesActionsTest-1669049742-project] 10.222.0.50 "GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182" status: 404 len: 111 microversion: 2.1 time: 0.115756 Aug 09 15:06:15.279605 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2751/5496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:15 2022] GET /compute/v2.1/servers/c5f4a6a1-7cd3-4957-aa49-ebea9726d182 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:06:15.436871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:15.437922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:15.480979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:15.485174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:15.499110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:15.502894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:15.507613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:15.508065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:15.613917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:15.668942 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-72eb76d9-a07b-4541-a429-4c4a02212d2a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.466137 Aug 09 15:06:15.672797 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2746/5497] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:06:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:06:15.680165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:15.683817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:15.685449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:15.687734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lazy-loading 'fault' on Instance uuid f6a67196-2e15-47e5-8877-e75e8d4609c7 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:06:15.694501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-cc02d513-5973-4ef5-af5a-d922427c4c3b req-d159acf8-ea52-40d0-8b95-477069196625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6a67196-2e15-47e5-8877-e75e8d4609c7", "name": "network-vif-deleted", "tag": "d15f67e8-ba7f-4681-bd12-a57303ad56da"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:15.742487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cc02d513-5973-4ef5-af5a-d922427c4c3b req-d159acf8-ea52-40d0-8b95-477069196625 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:15.746334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cc02d513-5973-4ef5-af5a-d922427c4c3b req-d159acf8-ea52-40d0-8b95-477069196625 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:15.746948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cc02d513-5973-4ef5-af5a-d922427c4c3b req-d159acf8-ea52-40d0-8b95-477069196625 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:15.772975 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-cc02d513-5973-4ef5-af5a-d922427c4c3b req-d159acf8-ea52-40d0-8b95-477069196625 service nova] Creating event network-vif-deleted:d15f67e8-ba7f-4681-bd12-a57303ad56da for instance f6a67196-2e15-47e5-8877-e75e8d4609c7 on n-h2-844626-8 Aug 09 15:06:15.780232 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-cc02d513-5973-4ef5-af5a-d922427c4c3b req-d159acf8-ea52-40d0-8b95-477069196625 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103538 Aug 09 15:06:15.781214 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2747/5498] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:06:15.791308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8129c506-82a0-44e6-b214-48a8d43f2839 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:15.792436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8129c506-82a0-44e6-b214-48a8d43f2839 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:15.874476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3da785ddf56e4b028c6647643d97c952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891029e759ac441f8a08c38bca92be81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:15.893267 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1bd881c0-b8e0-4d81-8178-42a1d30aaeaf tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 200 len: 1329 microversion: 2.1 time: 0.460483 Aug 09 15:06:15.906934 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2752/5499] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:15 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 1329 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:15.953164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8129c506-82a0-44e6-b214-48a8d43f2839 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:15.963132 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8129c506-82a0-44e6-b214-48a8d43f2839 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1057 microversion: 2.1 time: 0.179006 Aug 09 15:06:15.975119 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2748/5500] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:15 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1057 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:16.915732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de16b508-be90-415e-bc23-ca14c10298fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:16.916361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de16b508-be90-415e-bc23-ca14c10298fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] [instance: f6a67196-2e15-47e5-8877-e75e8d4609c7] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:16.936630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de16b508-be90-415e-bc23-ca14c10298fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:16.937762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de16b508-be90-415e-bc23-ca14c10298fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:16.938898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de16b508-be90-415e-bc23-ca14c10298fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:16.939819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de16b508-be90-415e-bc23-ca14c10298fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:16.940414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de16b508-be90-415e-bc23-ca14c10298fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:16.940974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de16b508-be90-415e-bc23-ca14c10298fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:16.957651 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-de16b508-be90-415e-bc23-ca14c10298fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] HTTP exception thrown: Instance f6a67196-2e15-47e5-8877-e75e8d4609c7 could not be found. Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de16b508-be90-415e-bc23-ca14c10298fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Request method failure captured: Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 HTTP/1.1 Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nYEf9bYbaWm9LpfA_LfwfUAPPg3KiAcIP0FvUZa5q3lW1cxsq_VEWuea_CUOz5st4geKgSqeruMxTrCCG4yN7K5xPHcsvFJ9uo_ztCad5wmGGhupiyzg1AjNhOoCjxRWlcQTxcsGTT3hxXSJl2NJVAtQ8LITGkETiM4QQ4BkISsF8I Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 891029e759ac441f8a08c38bca92be81 Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerActionsTestJSON-673566527 Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_891029e759ac441f8a08c38bca92be81", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/891029e759ac441f8a08c38bca92be81"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/891029e759ac441f8a08c38bca92be81"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/891029e759ac441f8a08c38bca92be81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerActionsTestJSON-673566527 Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 891029e759ac441f8a08c38bca92be81 Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerActionsTestJSON-673566527 Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerActionsTestJSON-673566527-project Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 3da785ddf56e4b028c6647643d97c952 Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerActionsTestJSON-673566527-project Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance f6a67196-2e15-47e5-8877-e75e8d4609c7 could not be found. Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'f6a67196-2e15-47e5-8877-e75e8d4609c7'} Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6a67196-2e15-47e5-8877-e75e8d4609c7 could not be found. Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6a67196-2e15-47e5-8877-e75e8d4609c7 could not be found. Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:06:16.960291 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:16.970422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:06:16.970422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:06:16.970422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:06:16.970422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:06:16.970422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:06:16.970422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6a67196-2e15-47e5-8877-e75e8d4609c7 could not be found. Aug 09 15:06:16.970422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:06:16.970422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de16b508-be90-415e-bc23-ca14c10298fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Returning 404 to user: Instance f6a67196-2e15-47e5-8877-e75e8d4609c7 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:06:16.970422 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de16b508-be90-415e-bc23-ca14c10298fd tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7" status: 404 len: 111 microversion: 2.1 time: 0.054909 Aug 09 15:06:16.970422 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2753/5501] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:16 2022] GET /compute/v2.1/servers/f6a67196-2e15-47e5-8877-e75e8d4609c7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:06:16.978931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d4bfa717-0eca-4fcd-9a84-be55887e1ba0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] Calling method '.version_select at 0x7f41dda6a3a0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:16.996335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c56668ac-19b0-45f0-aa99-ef0f1f7e5b9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:16.999591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c56668ac-19b0-45f0-aa99-ef0f1f7e5b9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:17.013558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56668ac-19b0-45f0-aa99-ef0f1f7e5b9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:17.014586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56668ac-19b0-45f0-aa99-ef0f1f7e5b9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:17.015261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56668ac-19b0-45f0-aa99-ef0f1f7e5b9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:17.016573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56668ac-19b0-45f0-aa99-ef0f1f7e5b9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:17.017272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56668ac-19b0-45f0-aa99-ef0f1f7e5b9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:17.017898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56668ac-19b0-45f0-aa99-ef0f1f7e5b9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:17.023383 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d4bfa717-0eca-4fcd-9a84-be55887e1ba0 tempest-ServerActionsTestJSON-673566527 tempest-ServerActionsTestJSON-673566527-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527002213" status: 202 len: 0 microversion: 2.1 time: 0.048732 Aug 09 15:06:17.024705 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2749/5502] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 15:06:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527002213 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:06:17.254189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c56668ac-19b0-45f0-aa99-ef0f1f7e5b9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:17.269593 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c56668ac-19b0-45f0-aa99-ef0f1f7e5b9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1107 microversion: 2.1 time: 0.282605 Aug 09 15:06:17.282978 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2754/5503] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:16 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1107 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:18.292933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe94316c-7a4c-40de-8bf5-4e5caac3bb31 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:18.297018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fe94316c-7a4c-40de-8bf5-4e5caac3bb31 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:18.328701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe94316c-7a4c-40de-8bf5-4e5caac3bb31 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:18.329169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe94316c-7a4c-40de-8bf5-4e5caac3bb31 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:18.329612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe94316c-7a4c-40de-8bf5-4e5caac3bb31 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:18.333318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe94316c-7a4c-40de-8bf5-4e5caac3bb31 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:18.333889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe94316c-7a4c-40de-8bf5-4e5caac3bb31 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:18.334338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe94316c-7a4c-40de-8bf5-4e5caac3bb31 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:18.593626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fe94316c-7a4c-40de-8bf5-4e5caac3bb31 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:18.608536 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fe94316c-7a4c-40de-8bf5-4e5caac3bb31 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1173 microversion: 2.1 time: 0.321204 Aug 09 15:06:18.613876 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2750/5504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:18 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1173 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:19.629950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d242059-1c6a-4534-a20f-f4c73638f500 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:19.631566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d242059-1c6a-4534-a20f-f4c73638f500 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:19.645966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d242059-1c6a-4534-a20f-f4c73638f500 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:19.646753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d242059-1c6a-4534-a20f-f4c73638f500 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:19.647443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d242059-1c6a-4534-a20f-f4c73638f500 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:19.648312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d242059-1c6a-4534-a20f-f4c73638f500 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:19.650502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d242059-1c6a-4534-a20f-f4c73638f500 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:19.655563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d242059-1c6a-4534-a20f-f4c73638f500 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:19.932367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d242059-1c6a-4534-a20f-f4c73638f500 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:19.944023 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d242059-1c6a-4534-a20f-f4c73638f500 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1173 microversion: 2.1 time: 0.317823 Aug 09 15:06:19.944874 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2755/5505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:19 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1173 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:20.980619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be321244-9b5d-4280-a64b-2100f1190b4d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:20.982252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be321244-9b5d-4280-a64b-2100f1190b4d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:21.008666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be321244-9b5d-4280-a64b-2100f1190b4d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:21.035979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be321244-9b5d-4280-a64b-2100f1190b4d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:21.036757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be321244-9b5d-4280-a64b-2100f1190b4d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:21.038154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be321244-9b5d-4280-a64b-2100f1190b4d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:21.041686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be321244-9b5d-4280-a64b-2100f1190b4d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:21.045094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be321244-9b5d-4280-a64b-2100f1190b4d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:21.690465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-be321244-9b5d-4280-a64b-2100f1190b4d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:21.712140 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be321244-9b5d-4280-a64b-2100f1190b4d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1215 microversion: 2.1 time: 0.737083 Aug 09 15:06:21.713189 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2751/5506] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:20 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1215 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:22.734639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6e0c4230-a400-410f-8e7e-76e88a89f76e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:22.735635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6e0c4230-a400-410f-8e7e-76e88a89f76e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:22.756792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e0c4230-a400-410f-8e7e-76e88a89f76e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:22.760340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e0c4230-a400-410f-8e7e-76e88a89f76e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:22.761969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e0c4230-a400-410f-8e7e-76e88a89f76e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:22.765140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e0c4230-a400-410f-8e7e-76e88a89f76e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:22.766521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e0c4230-a400-410f-8e7e-76e88a89f76e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:22.769904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e0c4230-a400-410f-8e7e-76e88a89f76e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:23.209108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6e0c4230-a400-410f-8e7e-76e88a89f76e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:23.217679 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6e0c4230-a400-410f-8e7e-76e88a89f76e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1215 microversion: 2.1 time: 0.487951 Aug 09 15:06:23.223922 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2756/5507] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:22 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1215 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:24.247642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e7141d63-f182-4510-b0a8-ef18c97cf0f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:24.249074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e7141d63-f182-4510-b0a8-ef18c97cf0f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:24.273954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7141d63-f182-4510-b0a8-ef18c97cf0f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:24.275805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7141d63-f182-4510-b0a8-ef18c97cf0f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:24.280661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7141d63-f182-4510-b0a8-ef18c97cf0f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:24.282874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-bc6fe2a4-794a-4c04-ad57-f7ba6db45f13 req-ed0ca396-817f-46fe-b912-2121c96188c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7127301a-4e35-4ab7-956d-3246b1000341", "tag": "669fb23f-4126-40cf-ba4d-d8eb21ba7044"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:24.284244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7141d63-f182-4510-b0a8-ef18c97cf0f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:24.284496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7141d63-f182-4510-b0a8-ef18c97cf0f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:24.284941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7141d63-f182-4510-b0a8-ef18c97cf0f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:24.304916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bc6fe2a4-794a-4c04-ad57-f7ba6db45f13 req-ed0ca396-817f-46fe-b912-2121c96188c8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:24.305669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bc6fe2a4-794a-4c04-ad57-f7ba6db45f13 req-ed0ca396-817f-46fe-b912-2121c96188c8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:24.306255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bc6fe2a4-794a-4c04-ad57-f7ba6db45f13 req-ed0ca396-817f-46fe-b912-2121c96188c8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:24.336821 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-bc6fe2a4-794a-4c04-ad57-f7ba6db45f13 req-ed0ca396-817f-46fe-b912-2121c96188c8 service nova] Creating event network-changed:669fb23f-4126-40cf-ba4d-d8eb21ba7044 for instance 7127301a-4e35-4ab7-956d-3246b1000341 on n-h1-844626-8 Aug 09 15:06:24.352812 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-bc6fe2a4-794a-4c04-ad57-f7ba6db45f13 req-ed0ca396-817f-46fe-b912-2121c96188c8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074929 Aug 09 15:06:24.353455 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2757/5508] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:06:24.890078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e7141d63-f182-4510-b0a8-ef18c97cf0f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:24.902512 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e7141d63-f182-4510-b0a8-ef18c97cf0f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1215 microversion: 2.1 time: 0.659181 Aug 09 15:06:24.912495 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2752/5509] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:24 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1215 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:25.938393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-676161fd-ab80-48d9-bdf1-b704c7777d40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:25.939971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-676161fd-ab80-48d9-bdf1-b704c7777d40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:25.973149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-676161fd-ab80-48d9-bdf1-b704c7777d40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:25.973674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-676161fd-ab80-48d9-bdf1-b704c7777d40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:25.974129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-676161fd-ab80-48d9-bdf1-b704c7777d40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:25.974890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-676161fd-ab80-48d9-bdf1-b704c7777d40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:25.975414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-676161fd-ab80-48d9-bdf1-b704c7777d40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:25.976188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-676161fd-ab80-48d9-bdf1-b704c7777d40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:26.109238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6787e495-782b-491b-b9ee-41dbd7908171 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:26.111399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6787e495-782b-491b-b9ee-41dbd7908171 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:26.120661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:26.131410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:26.135873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:26.158097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6787e495-782b-491b-b9ee-41dbd7908171 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:26.159289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6787e495-782b-491b-b9ee-41dbd7908171 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:26.160311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6787e495-782b-491b-b9ee-41dbd7908171 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:26.161961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6787e495-782b-491b-b9ee-41dbd7908171 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:26.163030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6787e495-782b-491b-b9ee-41dbd7908171 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:26.164075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6787e495-782b-491b-b9ee-41dbd7908171 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:26.733165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-676161fd-ab80-48d9-bdf1-b704c7777d40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:26.751539 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-676161fd-ab80-48d9-bdf1-b704c7777d40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1215 microversion: 2.1 time: 0.821113 Aug 09 15:06:26.752464 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2758/5510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:25 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1215 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:27.142311 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6787e495-782b-491b-b9ee-41dbd7908171 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1832 microversion: 2.1 time: 1.043567 Aug 09 15:06:27.147600 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2753/5511] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:26 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1832 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:27.168538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a684db90-d7fc-4cb1-a3ea-68bec2a7cb7d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:27.169066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a684db90-d7fc-4cb1-a3ea-68bec2a7cb7d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:27.179002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a684db90-d7fc-4cb1-a3ea-68bec2a7cb7d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:27.183296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a684db90-d7fc-4cb1-a3ea-68bec2a7cb7d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:27.183904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a684db90-d7fc-4cb1-a3ea-68bec2a7cb7d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:27.184801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a684db90-d7fc-4cb1-a3ea-68bec2a7cb7d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:27.191807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a684db90-d7fc-4cb1-a3ea-68bec2a7cb7d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:27.192545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a684db90-d7fc-4cb1-a3ea-68bec2a7cb7d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:27.778545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dbdf1369-2ece-47ec-b9c9-96da84239c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:27.799515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dbdf1369-2ece-47ec-b9c9-96da84239c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:27.818604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbdf1369-2ece-47ec-b9c9-96da84239c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:27.820564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbdf1369-2ece-47ec-b9c9-96da84239c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:27.825861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbdf1369-2ece-47ec-b9c9-96da84239c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:27.828112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbdf1369-2ece-47ec-b9c9-96da84239c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:27.832526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbdf1369-2ece-47ec-b9c9-96da84239c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:27.834804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbdf1369-2ece-47ec-b9c9-96da84239c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:28.266371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dbdf1369-2ece-47ec-b9c9-96da84239c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:28.290434 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dbdf1369-2ece-47ec-b9c9-96da84239c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1215 microversion: 2.1 time: 0.517584 Aug 09 15:06:28.307863 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2754/5512] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:27 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1215 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:28.534817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a684db90-d7fc-4cb1-a3ea-68bec2a7cb7d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:28.543013 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a684db90-d7fc-4cb1-a3ea-68bec2a7cb7d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1681 microversion: 2.1 time: 1.378423 Aug 09 15:06:28.543654 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2759/5513] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:27 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1681 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:28.795037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84bef2bc-c23d-4d9d-9c33-a49a600ff54a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:28.797490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84bef2bc-c23d-4d9d-9c33-a49a600ff54a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:28.817555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bef2bc-c23d-4d9d-9c33-a49a600ff54a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:28.818243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bef2bc-c23d-4d9d-9c33-a49a600ff54a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:28.820794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bef2bc-c23d-4d9d-9c33-a49a600ff54a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:28.821914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bef2bc-c23d-4d9d-9c33-a49a600ff54a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:28.822655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bef2bc-c23d-4d9d-9c33-a49a600ff54a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:28.826045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bef2bc-c23d-4d9d-9c33-a49a600ff54a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:28.997154 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84bef2bc-c23d-4d9d-9c33-a49a600ff54a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93/action" status: 200 len: 32631 microversion: 2.1 time: 0.205860 Aug 09 15:06:29.003563 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2755/5514] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:06:28 2022] POST /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93/action => generated 32631 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:06:29.164995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ff5297c-f333-4172-80a7-a16ad9f663f6 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:29.165581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ff5297c-f333-4172-80a7-a16ad9f663f6 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:29.176390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ff5297c-f333-4172-80a7-a16ad9f663f6 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:29.176804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ff5297c-f333-4172-80a7-a16ad9f663f6 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:29.177244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ff5297c-f333-4172-80a7-a16ad9f663f6 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:29.177964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ff5297c-f333-4172-80a7-a16ad9f663f6 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:29.178418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ff5297c-f333-4172-80a7-a16ad9f663f6 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:29.189211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ff5297c-f333-4172-80a7-a16ad9f663f6 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:29.297304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ff5297c-f333-4172-80a7-a16ad9f663f6 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '437f80d789a54fc992b664dceff04d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670c22e06ca6437ba8571aaf6998ca77', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:29.297924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ff5297c-f333-4172-80a7-a16ad9f663f6 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] flavor_id is None. Assuming migration. {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 09 15:06:29.298438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ff5297c-f333-4172-80a7-a16ad9f663f6 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 15:06:29.317964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34bbd787-848a-4998-be5a-f3adcf5be337 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:29.318959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-34bbd787-848a-4998-be5a-f3adcf5be337 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:29.341057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34bbd787-848a-4998-be5a-f3adcf5be337 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:29.341554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34bbd787-848a-4998-be5a-f3adcf5be337 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:29.349095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34bbd787-848a-4998-be5a-f3adcf5be337 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:29.350224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34bbd787-848a-4998-be5a-f3adcf5be337 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:29.350945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34bbd787-848a-4998-be5a-f3adcf5be337 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:29.352169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-34bbd787-848a-4998-be5a-f3adcf5be337 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:29.652846 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ff5297c-f333-4172-80a7-a16ad9f663f6 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93/action" status: 202 len: 0 microversion: 2.1 time: 0.491773 Aug 09 15:06:29.662219 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2760/5515] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:06:29 2022] POST /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:06:29.672698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6146df52-5c01-4409-961b-a8ce6116f8d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:29.673298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6146df52-5c01-4409-961b-a8ce6116f8d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:29.718703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6146df52-5c01-4409-961b-a8ce6116f8d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:29.719287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6146df52-5c01-4409-961b-a8ce6116f8d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:29.719730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6146df52-5c01-4409-961b-a8ce6116f8d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:29.720462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6146df52-5c01-4409-961b-a8ce6116f8d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:29.720923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6146df52-5c01-4409-961b-a8ce6116f8d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:29.721348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6146df52-5c01-4409-961b-a8ce6116f8d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:30.492304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-34bbd787-848a-4998-be5a-f3adcf5be337 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:30.512033 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34bbd787-848a-4998-be5a-f3adcf5be337 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1215 microversion: 2.1 time: 1.199413 Aug 09 15:06:30.519596 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2756/5516] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:29 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1215 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:30.802267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6146df52-5c01-4409-961b-a8ce6116f8d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:30.844516 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6146df52-5c01-4409-961b-a8ce6116f8d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1690 microversion: 2.1 time: 1.178176 Aug 09 15:06:30.846623 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2761/5517] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:29 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1690 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:31.533615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b6c13285-bec5-46b7-a27d-cb8359db4d97 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:31.535144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6c13285-bec5-46b7-a27d-cb8359db4d97 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:31.574545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6c13285-bec5-46b7-a27d-cb8359db4d97 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:31.575379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6c13285-bec5-46b7-a27d-cb8359db4d97 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:31.576454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6c13285-bec5-46b7-a27d-cb8359db4d97 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:31.578863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6c13285-bec5-46b7-a27d-cb8359db4d97 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:31.579380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6c13285-bec5-46b7-a27d-cb8359db4d97 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:31.587110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6c13285-bec5-46b7-a27d-cb8359db4d97 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:31.887616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93ebae90-a492-436f-8eee-a97846c5728c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:31.893056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93ebae90-a492-436f-8eee-a97846c5728c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:31.951191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ebae90-a492-436f-8eee-a97846c5728c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:31.967956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ebae90-a492-436f-8eee-a97846c5728c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:31.970220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ebae90-a492-436f-8eee-a97846c5728c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:31.973697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ebae90-a492-436f-8eee-a97846c5728c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:31.974181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ebae90-a492-436f-8eee-a97846c5728c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:31.991927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93ebae90-a492-436f-8eee-a97846c5728c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:32.592472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b6c13285-bec5-46b7-a27d-cb8359db4d97 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:32.618135 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b6c13285-bec5-46b7-a27d-cb8359db4d97 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1215 microversion: 2.1 time: 1.089598 Aug 09 15:06:32.624805 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2757/5518] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:31 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1215 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:32.925599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-93ebae90-a492-436f-8eee-a97846c5728c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:32.939859 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93ebae90-a492-436f-8eee-a97846c5728c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1690 microversion: 2.1 time: 1.067824 Aug 09 15:06:32.955281 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2762/5519] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:31 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1690 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:33.645672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d33d4cfc-522a-4b9b-8eb0-5a9b0176dea6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:33.648434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d33d4cfc-522a-4b9b-8eb0-5a9b0176dea6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:33.670917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d33d4cfc-522a-4b9b-8eb0-5a9b0176dea6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:33.671444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d33d4cfc-522a-4b9b-8eb0-5a9b0176dea6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:33.671881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d33d4cfc-522a-4b9b-8eb0-5a9b0176dea6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:33.683043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d33d4cfc-522a-4b9b-8eb0-5a9b0176dea6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:33.683659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d33d4cfc-522a-4b9b-8eb0-5a9b0176dea6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:33.684107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d33d4cfc-522a-4b9b-8eb0-5a9b0176dea6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:33.964367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-98874f7a-4467-4b0e-8a7c-f921f0cc8849 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:33.964985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-98874f7a-4467-4b0e-8a7c-f921f0cc8849 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:33.980146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98874f7a-4467-4b0e-8a7c-f921f0cc8849 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:33.983962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98874f7a-4467-4b0e-8a7c-f921f0cc8849 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:33.984561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98874f7a-4467-4b0e-8a7c-f921f0cc8849 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:33.989496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98874f7a-4467-4b0e-8a7c-f921f0cc8849 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:33.990547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98874f7a-4467-4b0e-8a7c-f921f0cc8849 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:33.992651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98874f7a-4467-4b0e-8a7c-f921f0cc8849 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:34.792830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d33d4cfc-522a-4b9b-8eb0-5a9b0176dea6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:34.810112 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d33d4cfc-522a-4b9b-8eb0-5a9b0176dea6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1203 microversion: 2.1 time: 1.168655 Aug 09 15:06:34.814931 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2758/5520] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:33 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1203 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:34.855569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-98874f7a-4467-4b0e-8a7c-f921f0cc8849 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:34.870272 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-98874f7a-4467-4b0e-8a7c-f921f0cc8849 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1690 microversion: 2.1 time: 0.909704 Aug 09 15:06:34.871451 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2763/5521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:33 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1690 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:35.835735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b75a365-6e40-4dc0-b66b-312c607d6895 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:35.836347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b75a365-6e40-4dc0-b66b-312c607d6895 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:35.856197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b75a365-6e40-4dc0-b66b-312c607d6895 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:35.856789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b75a365-6e40-4dc0-b66b-312c607d6895 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:35.857235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b75a365-6e40-4dc0-b66b-312c607d6895 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:35.857971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b75a365-6e40-4dc0-b66b-312c607d6895 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:35.858419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b75a365-6e40-4dc0-b66b-312c607d6895 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:35.858835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b75a365-6e40-4dc0-b66b-312c607d6895 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:35.904047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d9ee28c8-0208-42e3-bcd6-9bed72c0953a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:35.906130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d9ee28c8-0208-42e3-bcd6-9bed72c0953a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:35.926768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:35.950555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9ee28c8-0208-42e3-bcd6-9bed72c0953a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:35.953359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9ee28c8-0208-42e3-bcd6-9bed72c0953a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:35.955691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9ee28c8-0208-42e3-bcd6-9bed72c0953a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:35.964963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9ee28c8-0208-42e3-bcd6-9bed72c0953a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:35.966068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9ee28c8-0208-42e3-bcd6-9bed72c0953a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:35.968350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9ee28c8-0208-42e3-bcd6-9bed72c0953a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:36.381536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d9ee28c8-0208-42e3-bcd6-9bed72c0953a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:36.413464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6b75a365-6e40-4dc0-b66b-312c607d6895 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:36.431772 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d9ee28c8-0208-42e3-bcd6-9bed72c0953a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1695 microversion: 2.1 time: 0.543611 Aug 09 15:06:36.432422 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2764/5522] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:35 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1695 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:36.452833 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b75a365-6e40-4dc0-b66b-312c607d6895 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1203 microversion: 2.1 time: 0.603138 Aug 09 15:06:36.452833 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2759/5523] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:35 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1203 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:37.477004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f5409d1-e128-4e65-98d7-51e1589ff33b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:37.477609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3f5409d1-e128-4e65-98d7-51e1589ff33b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:37.481288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6df58e98-70e4-499d-b5e2-2743fff68a84 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:37.481900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6df58e98-70e4-499d-b5e2-2743fff68a84 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:37.513414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f5409d1-e128-4e65-98d7-51e1589ff33b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:37.514158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f5409d1-e128-4e65-98d7-51e1589ff33b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:37.514935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f5409d1-e128-4e65-98d7-51e1589ff33b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:37.515943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f5409d1-e128-4e65-98d7-51e1589ff33b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:37.516568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f5409d1-e128-4e65-98d7-51e1589ff33b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:37.517144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f5409d1-e128-4e65-98d7-51e1589ff33b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:37.536678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df58e98-70e4-499d-b5e2-2743fff68a84 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:37.557605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df58e98-70e4-499d-b5e2-2743fff68a84 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:37.564599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df58e98-70e4-499d-b5e2-2743fff68a84 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:37.571016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df58e98-70e4-499d-b5e2-2743fff68a84 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:37.603098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df58e98-70e4-499d-b5e2-2743fff68a84 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:37.615753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6df58e98-70e4-499d-b5e2-2743fff68a84 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:39.318446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3f5409d1-e128-4e65-98d7-51e1589ff33b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:39.341645 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3f5409d1-e128-4e65-98d7-51e1589ff33b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1695 microversion: 2.1 time: 1.876764 Aug 09 15:06:39.348911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2760/5524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:37 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1695 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:39.426235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6df58e98-70e4-499d-b5e2-2743fff68a84 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:39.440703 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6df58e98-70e4-499d-b5e2-2743fff68a84 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1203 microversion: 2.1 time: 1.974908 Aug 09 15:06:39.444693 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2765/5525] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:37 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1203 bytes in 1981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:40.366932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06039577-7595-421c-8869-59cf690b310e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:40.369769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-06039577-7595-421c-8869-59cf690b310e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:40.383253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06039577-7595-421c-8869-59cf690b310e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:40.384719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06039577-7595-421c-8869-59cf690b310e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:40.385746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06039577-7595-421c-8869-59cf690b310e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:40.387805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06039577-7595-421c-8869-59cf690b310e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:40.389620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06039577-7595-421c-8869-59cf690b310e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:40.390697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06039577-7595-421c-8869-59cf690b310e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:40.472050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-202caecb-ab88-4076-9e29-0315623c2b7a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:40.473962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-202caecb-ab88-4076-9e29-0315623c2b7a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:40.489577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-202caecb-ab88-4076-9e29-0315623c2b7a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:40.490074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-202caecb-ab88-4076-9e29-0315623c2b7a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:40.494038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-202caecb-ab88-4076-9e29-0315623c2b7a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:40.495132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-202caecb-ab88-4076-9e29-0315623c2b7a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:40.495779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-202caecb-ab88-4076-9e29-0315623c2b7a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:40.503617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-202caecb-ab88-4076-9e29-0315623c2b7a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:41.042133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-06039577-7595-421c-8869-59cf690b310e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:41.055273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-202caecb-ab88-4076-9e29-0315623c2b7a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:41.057994 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-06039577-7595-421c-8869-59cf690b310e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1695 microversion: 2.1 time: 0.691245 Aug 09 15:06:41.078168 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2761/5526] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:40 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1695 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:41.080103 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-202caecb-ab88-4076-9e29-0315623c2b7a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1203 microversion: 2.1 time: 0.612798 Aug 09 15:06:41.082195 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2766/5527] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:40 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1203 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:41.318281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-07b517ce-ddfe-47a4-ba14-a9ad353b7e26 req-3d355335-a043-4b34-b3e9-a3851aa627ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7127301a-4e35-4ab7-956d-3246b1000341", "name": "network-vif-plugged", "status": "completed", "tag": "669fb23f-4126-40cf-ba4d-d8eb21ba7044"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:41.336892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-07b517ce-ddfe-47a4-ba14-a9ad353b7e26 req-3d355335-a043-4b34-b3e9-a3851aa627ae service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:41.340949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-07b517ce-ddfe-47a4-ba14-a9ad353b7e26 req-3d355335-a043-4b34-b3e9-a3851aa627ae service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:41.341762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-07b517ce-ddfe-47a4-ba14-a9ad353b7e26 req-3d355335-a043-4b34-b3e9-a3851aa627ae service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:41.382054 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-07b517ce-ddfe-47a4-ba14-a9ad353b7e26 req-3d355335-a043-4b34-b3e9-a3851aa627ae service nova] Creating event network-vif-plugged:669fb23f-4126-40cf-ba4d-d8eb21ba7044 for instance 7127301a-4e35-4ab7-956d-3246b1000341 on n-h1-844626-8 Aug 09 15:06:41.398864 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-07b517ce-ddfe-47a4-ba14-a9ad353b7e26 req-3d355335-a043-4b34-b3e9-a3851aa627ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085168 Aug 09 15:06:41.399908 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2762/5528] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:06:42.085055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ab5648aa-ab18-4ea5-be01-2004323c4570 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:42.086213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ab5648aa-ab18-4ea5-be01-2004323c4570 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:42.104137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab5648aa-ab18-4ea5-be01-2004323c4570 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:42.106619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-61ee6147-b199-4504-af7b-c48aa06389fe tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:42.107579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-61ee6147-b199-4504-af7b-c48aa06389fe tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:42.110424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab5648aa-ab18-4ea5-be01-2004323c4570 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:42.114009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab5648aa-ab18-4ea5-be01-2004323c4570 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:42.114782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab5648aa-ab18-4ea5-be01-2004323c4570 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:42.115288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab5648aa-ab18-4ea5-be01-2004323c4570 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:42.115722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab5648aa-ab18-4ea5-be01-2004323c4570 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:42.126286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61ee6147-b199-4504-af7b-c48aa06389fe tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:42.127767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61ee6147-b199-4504-af7b-c48aa06389fe tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:42.129058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61ee6147-b199-4504-af7b-c48aa06389fe tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:42.145126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61ee6147-b199-4504-af7b-c48aa06389fe tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:42.149471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61ee6147-b199-4504-af7b-c48aa06389fe tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:42.161951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61ee6147-b199-4504-af7b-c48aa06389fe tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:42.227769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=92 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:42.650145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ab5648aa-ab18-4ea5-be01-2004323c4570 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:42.658911 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ab5648aa-ab18-4ea5-be01-2004323c4570 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1695 microversion: 2.1 time: 0.577605 Aug 09 15:06:42.676708 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2767/5529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:42 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1695 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:42.700056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-61ee6147-b199-4504-af7b-c48aa06389fe tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:42.742108 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-61ee6147-b199-4504-af7b-c48aa06389fe tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1203 microversion: 2.1 time: 0.643421 Aug 09 15:06:42.746194 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2763/5530] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:42 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1203 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:43.684362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ce796591-b01d-44cc-ae79-2a6f9a3e4554 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:43.685208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ce796591-b01d-44cc-ae79-2a6f9a3e4554 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:43.699471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce796591-b01d-44cc-ae79-2a6f9a3e4554 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:43.699471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce796591-b01d-44cc-ae79-2a6f9a3e4554 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:43.699471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce796591-b01d-44cc-ae79-2a6f9a3e4554 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:43.699471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce796591-b01d-44cc-ae79-2a6f9a3e4554 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:43.699471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce796591-b01d-44cc-ae79-2a6f9a3e4554 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:43.699471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce796591-b01d-44cc-ae79-2a6f9a3e4554 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:43.735495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:43.770276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a96b282b-6f01-4842-928c-1ffa5da0913d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:43.772467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a96b282b-6f01-4842-928c-1ffa5da0913d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:43.818471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a96b282b-6f01-4842-928c-1ffa5da0913d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:43.819039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a96b282b-6f01-4842-928c-1ffa5da0913d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:43.819502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a96b282b-6f01-4842-928c-1ffa5da0913d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:43.820227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a96b282b-6f01-4842-928c-1ffa5da0913d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:43.820683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a96b282b-6f01-4842-928c-1ffa5da0913d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:43.821107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a96b282b-6f01-4842-928c-1ffa5da0913d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:44.225581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce796591-b01d-44cc-ae79-2a6f9a3e4554 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:44.240300 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ce796591-b01d-44cc-ae79-2a6f9a3e4554 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1695 microversion: 2.1 time: 0.562518 Aug 09 15:06:44.240922 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2768/5531] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:43 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1695 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:44.461906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a96b282b-6f01-4842-928c-1ffa5da0913d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:44.470433 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a96b282b-6f01-4842-928c-1ffa5da0913d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1390 microversion: 2.1 time: 0.708803 Aug 09 15:06:44.490619 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2764/5532] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:43 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1390 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:44.492783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f2e85288-6413-4ab3-8a61-e9e7e32c21b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:44.493568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f2e85288-6413-4ab3-8a61-e9e7e32c21b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:44.504191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2e85288-6413-4ab3-8a61-e9e7e32c21b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:44.505269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2e85288-6413-4ab3-8a61-e9e7e32c21b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:44.509119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2e85288-6413-4ab3-8a61-e9e7e32c21b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:44.510052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2e85288-6413-4ab3-8a61-e9e7e32c21b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:44.510647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2e85288-6413-4ab3-8a61-e9e7e32c21b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:44.511250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2e85288-6413-4ab3-8a61-e9e7e32c21b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:45.069007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f2e85288-6413-4ab3-8a61-e9e7e32c21b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:45.100904 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f2e85288-6413-4ab3-8a61-e9e7e32c21b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1390 microversion: 2.1 time: 0.613224 Aug 09 15:06:45.103459 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2769/5533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:44 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1390 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:45.130779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d788b24-e8f9-40ad-ad99-1eb66e79e926 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:45.134585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d788b24-e8f9-40ad-ad99-1eb66e79e926 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:45.166350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d788b24-e8f9-40ad-ad99-1eb66e79e926 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:45.168732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d788b24-e8f9-40ad-ad99-1eb66e79e926 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:45.173197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d788b24-e8f9-40ad-ad99-1eb66e79e926 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:45.177759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d788b24-e8f9-40ad-ad99-1eb66e79e926 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:45.178506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d788b24-e8f9-40ad-ad99-1eb66e79e926 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:45.179669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d788b24-e8f9-40ad-ad99-1eb66e79e926 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:45.266994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dee6eaf9-9f3f-4181-9054-170569094787 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:45.268406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dee6eaf9-9f3f-4181-9054-170569094787 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:45.285993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee6eaf9-9f3f-4181-9054-170569094787 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:45.287263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee6eaf9-9f3f-4181-9054-170569094787 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:45.289428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee6eaf9-9f3f-4181-9054-170569094787 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:45.292286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee6eaf9-9f3f-4181-9054-170569094787 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:45.293371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee6eaf9-9f3f-4181-9054-170569094787 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:45.294560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee6eaf9-9f3f-4181-9054-170569094787 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:46.712031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dee6eaf9-9f3f-4181-9054-170569094787 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:46.729993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6d788b24-e8f9-40ad-ad99-1eb66e79e926 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:46.737748 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dee6eaf9-9f3f-4181-9054-170569094787 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1695 microversion: 2.1 time: 1.474658 Aug 09 15:06:46.739870 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2770/5534] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:45 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1695 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:46.758787 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d788b24-e8f9-40ad-ad99-1eb66e79e926 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1390 microversion: 2.1 time: 1.638036 Aug 09 15:06:46.760598 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2765/5535] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:45 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1390 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:46.785375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-17e392a5-a9af-4e3b-b03d-9add4516529c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:46.786126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-17e392a5-a9af-4e3b-b03d-9add4516529c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:46.801264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17e392a5-a9af-4e3b-b03d-9add4516529c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:46.802399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17e392a5-a9af-4e3b-b03d-9add4516529c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:46.803210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17e392a5-a9af-4e3b-b03d-9add4516529c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:46.804104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17e392a5-a9af-4e3b-b03d-9add4516529c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:46.806188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17e392a5-a9af-4e3b-b03d-9add4516529c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:46.806811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-17e392a5-a9af-4e3b-b03d-9add4516529c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:46.848808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-17e392a5-a9af-4e3b-b03d-9add4516529c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:06:47.042030 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-17e392a5-a9af-4e3b-b03d-9add4516529c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 204 len: 0 microversion: 2.1 time: 0.243048 Aug 09 15:06:47.048009 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2771/5536] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:06:46 2022] DELETE /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:06:47.055189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3140f75d-605e-4689-a475-fd303baa373c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:47.056555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3140f75d-605e-4689-a475-fd303baa373c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:47.086349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3140f75d-605e-4689-a475-fd303baa373c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:47.087315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3140f75d-605e-4689-a475-fd303baa373c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:47.088905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3140f75d-605e-4689-a475-fd303baa373c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:47.090890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3140f75d-605e-4689-a475-fd303baa373c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:47.093115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3140f75d-605e-4689-a475-fd303baa373c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:47.095612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3140f75d-605e-4689-a475-fd303baa373c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:47.532716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3140f75d-605e-4689-a475-fd303baa373c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:47.574130 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3140f75d-605e-4689-a475-fd303baa373c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1396 microversion: 2.1 time: 0.524495 Aug 09 15:06:47.576352 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2766/5537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:47 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1396 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:47.764307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f7c9019b-cfb0-4ab4-b7ad-89d58493216c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:47.765292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f7c9019b-cfb0-4ab4-b7ad-89d58493216c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:47.804892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c9019b-cfb0-4ab4-b7ad-89d58493216c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:47.806127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c9019b-cfb0-4ab4-b7ad-89d58493216c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:47.809090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c9019b-cfb0-4ab4-b7ad-89d58493216c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:47.811480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c9019b-cfb0-4ab4-b7ad-89d58493216c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:47.813940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c9019b-cfb0-4ab4-b7ad-89d58493216c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:47.814825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f7c9019b-cfb0-4ab4-b7ad-89d58493216c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:48.289019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f7c9019b-cfb0-4ab4-b7ad-89d58493216c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:48.315941 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f7c9019b-cfb0-4ab4-b7ad-89d58493216c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1695 microversion: 2.1 time: 0.553925 Aug 09 15:06:48.339157 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2772/5538] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:47 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1695 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:48.603221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-48cbcbcc-a9b7-4bf5-b190-bd6efbabb2e1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:48.604957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-48cbcbcc-a9b7-4bf5-b190-bd6efbabb2e1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:48.637741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48cbcbcc-a9b7-4bf5-b190-bd6efbabb2e1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:48.639534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48cbcbcc-a9b7-4bf5-b190-bd6efbabb2e1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:48.640556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48cbcbcc-a9b7-4bf5-b190-bd6efbabb2e1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:48.641967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48cbcbcc-a9b7-4bf5-b190-bd6efbabb2e1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:48.643893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48cbcbcc-a9b7-4bf5-b190-bd6efbabb2e1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:48.651795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48cbcbcc-a9b7-4bf5-b190-bd6efbabb2e1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:49.351866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9002fc45-420e-43a1-82b3-6070618a4a6c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:49.353493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9002fc45-420e-43a1-82b3-6070618a4a6c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:49.378231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9002fc45-420e-43a1-82b3-6070618a4a6c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:49.386952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9002fc45-420e-43a1-82b3-6070618a4a6c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:49.387591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9002fc45-420e-43a1-82b3-6070618a4a6c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:49.392597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9002fc45-420e-43a1-82b3-6070618a4a6c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:49.393090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9002fc45-420e-43a1-82b3-6070618a4a6c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:49.404098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9002fc45-420e-43a1-82b3-6070618a4a6c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:49.525142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-48cbcbcc-a9b7-4bf5-b190-bd6efbabb2e1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:49.545650 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-48cbcbcc-a9b7-4bf5-b190-bd6efbabb2e1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1396 microversion: 2.1 time: 0.947505 Aug 09 15:06:49.568692 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2767/5539] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:48 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1396 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:50.193198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9002fc45-420e-43a1-82b3-6070618a4a6c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:50.206401 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9002fc45-420e-43a1-82b3-6070618a4a6c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1694 microversion: 2.1 time: 0.859642 Aug 09 15:06:50.214658 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2773/5540] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:49 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1694 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:50.570081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf960a03-d3b6-4955-a16d-3c6772e82b74 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:50.570699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf960a03-d3b6-4955-a16d-3c6772e82b74 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:50.595997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf960a03-d3b6-4955-a16d-3c6772e82b74 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:50.597803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf960a03-d3b6-4955-a16d-3c6772e82b74 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:50.598255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf960a03-d3b6-4955-a16d-3c6772e82b74 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:50.603662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf960a03-d3b6-4955-a16d-3c6772e82b74 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:50.606602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf960a03-d3b6-4955-a16d-3c6772e82b74 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:50.607376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf960a03-d3b6-4955-a16d-3c6772e82b74 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:50.856749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bf960a03-d3b6-4955-a16d-3c6772e82b74 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:50.884127 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf960a03-d3b6-4955-a16d-3c6772e82b74 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1354 microversion: 2.1 time: 0.317980 Aug 09 15:06:50.884740 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2768/5541] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:50 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1354 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:51.005956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-a77b0071-3c45-4854-bf26-2a380da39e96 req-816ebc45-d809-4a13-a423-48bd89dd28bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7127301a-4e35-4ab7-956d-3246b1000341", "name": "network-vif-deleted", "tag": "669fb23f-4126-40cf-ba4d-d8eb21ba7044"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:51.047458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a77b0071-3c45-4854-bf26-2a380da39e96 req-816ebc45-d809-4a13-a423-48bd89dd28bc service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:51.052778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a77b0071-3c45-4854-bf26-2a380da39e96 req-816ebc45-d809-4a13-a423-48bd89dd28bc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:51.055448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a77b0071-3c45-4854-bf26-2a380da39e96 req-816ebc45-d809-4a13-a423-48bd89dd28bc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:51.121599 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-a77b0071-3c45-4854-bf26-2a380da39e96 req-816ebc45-d809-4a13-a423-48bd89dd28bc service nova] Creating event network-vif-deleted:669fb23f-4126-40cf-ba4d-d8eb21ba7044 for instance 7127301a-4e35-4ab7-956d-3246b1000341 on n-h1-844626-8 Aug 09 15:06:51.143295 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-a77b0071-3c45-4854-bf26-2a380da39e96 req-816ebc45-d809-4a13-a423-48bd89dd28bc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141352 Aug 09 15:06:51.167310 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2769/5542] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:06:51.236752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f341c6e2-44c7-4fad-9790-8a561464f79f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:51.237468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f341c6e2-44c7-4fad-9790-8a561464f79f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:51.259019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f341c6e2-44c7-4fad-9790-8a561464f79f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:51.260427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f341c6e2-44c7-4fad-9790-8a561464f79f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:51.260880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f341c6e2-44c7-4fad-9790-8a561464f79f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:51.261618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f341c6e2-44c7-4fad-9790-8a561464f79f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:51.262056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f341c6e2-44c7-4fad-9790-8a561464f79f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:51.262475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f341c6e2-44c7-4fad-9790-8a561464f79f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:51.330104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-905739543", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:51.490002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] validate_networks() for [('f5d4e844-7248-4667-9003-c807b93f15e6', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:06:51.970211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f341c6e2-44c7-4fad-9790-8a561464f79f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:51.981649 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f341c6e2-44c7-4fad-9790-8a561464f79f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1694 microversion: 2.1 time: 0.749541 Aug 09 15:06:51.983290 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2770/5543] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:51 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1694 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:51.994914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8aea68d6-04a4-43b3-8da5-d09bc1171cc4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:52.002549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8aea68d6-04a4-43b3-8da5-d09bc1171cc4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:52.020864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8aea68d6-04a4-43b3-8da5-d09bc1171cc4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:52.025099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8aea68d6-04a4-43b3-8da5-d09bc1171cc4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:52.026964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8aea68d6-04a4-43b3-8da5-d09bc1171cc4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:52.030111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8aea68d6-04a4-43b3-8da5-d09bc1171cc4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:52.030741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8aea68d6-04a4-43b3-8da5-d09bc1171cc4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:52.031404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8aea68d6-04a4-43b3-8da5-d09bc1171cc4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:52.365623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8aea68d6-04a4-43b3-8da5-d09bc1171cc4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:52.380148 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8aea68d6-04a4-43b3-8da5-d09bc1171cc4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1188 microversion: 2.1 time: 0.392122 Aug 09 15:06:52.384331 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2771/5544] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:51 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1188 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:53.007404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c33cd53b-9f91-4bd9-a150-0d6952ff0a04 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:53.009825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:06:53.010261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:06:53.010725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c33cd53b-9f91-4bd9-a150-0d6952ff0a04 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:53.010902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:06:53.011534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:06:53.012103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:06:53.032028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:53.032958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:53.033551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:53.034439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:53.035050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:53.035637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:53.057292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c33cd53b-9f91-4bd9-a150-0d6952ff0a04 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:53.060292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c33cd53b-9f91-4bd9-a150-0d6952ff0a04 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:53.061376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c33cd53b-9f91-4bd9-a150-0d6952ff0a04 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:53.067874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c33cd53b-9f91-4bd9-a150-0d6952ff0a04 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:53.069656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c33cd53b-9f91-4bd9-a150-0d6952ff0a04 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:53.071030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c33cd53b-9f91-4bd9-a150-0d6952ff0a04 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:53.083357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Getting quotas for project 97e991340cea46afb3937ddb5e4402ef. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:06:53.093804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Getting quotas for user ae70e5a181dc4d079015a0c7c1a2154e and project 97e991340cea46afb3937ddb5e4402ef. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:06:53.153898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:06:53.177115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:06:53.305770 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-35d03f75-8444-4440-8b88-3a9317647611 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.440949 Aug 09 15:06:53.307325 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2774/5545] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:06:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:06:53.321600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8d0c2ab-3387-42dc-a705-cc9dd4b71793 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:53.325191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b8d0c2ab-3387-42dc-a705-cc9dd4b71793 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:53.388559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c33cd53b-9f91-4bd9-a150-0d6952ff0a04 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:53.406005 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c33cd53b-9f91-4bd9-a150-0d6952ff0a04 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1694 microversion: 2.1 time: 0.402759 Aug 09 15:06:53.406625 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2772/5546] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:53 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1694 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:53.419709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bda423ea-d226-47e7-8551-3a944a641ece tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:53.420340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bda423ea-d226-47e7-8551-3a944a641ece tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:53.436916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bda423ea-d226-47e7-8551-3a944a641ece tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:53.437509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bda423ea-d226-47e7-8551-3a944a641ece tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:53.437948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bda423ea-d226-47e7-8551-3a944a641ece tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:53.456194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bda423ea-d226-47e7-8551-3a944a641ece tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:53.456964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bda423ea-d226-47e7-8551-3a944a641ece tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:53.457557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bda423ea-d226-47e7-8551-3a944a641ece tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:53.493954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8d0c2ab-3387-42dc-a705-cc9dd4b71793 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:53.507918 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8d0c2ab-3387-42dc-a705-cc9dd4b71793 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1213 microversion: 2.1 time: 0.192384 Aug 09 15:06:53.517215 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2775/5547] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:53 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1213 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:53.679806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bda423ea-d226-47e7-8551-3a944a641ece tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:53.692884 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bda423ea-d226-47e7-8551-3a944a641ece tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1188 microversion: 2.1 time: 0.276980 Aug 09 15:06:53.702622 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2773/5548] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:53 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1188 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:53.824458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-c28ea961-c28e-4ca9-a7fb-fbcf6aac1123 req-5ce28ded-b220-47d5-b07d-9663796ce9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caaadba4-bf8c-4e32-b86f-a6e0e68bbd93", "name": "network-vif-unplugged", "status": "completed", "tag": "90f33f03-4270-4292-a57d-108d8d490b0a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:53.844454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c28ea961-c28e-4ca9-a7fb-fbcf6aac1123 req-5ce28ded-b220-47d5-b07d-9663796ce9f9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:53.850249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c28ea961-c28e-4ca9-a7fb-fbcf6aac1123 req-5ce28ded-b220-47d5-b07d-9663796ce9f9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:53.850730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c28ea961-c28e-4ca9-a7fb-fbcf6aac1123 req-5ce28ded-b220-47d5-b07d-9663796ce9f9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:53.895740 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-c28ea961-c28e-4ca9-a7fb-fbcf6aac1123 req-5ce28ded-b220-47d5-b07d-9663796ce9f9 service nova] Creating event network-vif-unplugged:90f33f03-4270-4292-a57d-108d8d490b0a for instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 on n-h1-844626-8 Aug 09 15:06:53.911854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-c28ea961-c28e-4ca9-a7fb-fbcf6aac1123 req-5ce28ded-b220-47d5-b07d-9663796ce9f9 service nova] Instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:06:53.964382 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-c28ea961-c28e-4ca9-a7fb-fbcf6aac1123 req-5ce28ded-b220-47d5-b07d-9663796ce9f9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.143356 Aug 09 15:06:53.968011 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2776/5549] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:06:54.431144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e10caca1-bf5d-405a-b42e-a5103159bbe6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:54.432632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e10caca1-bf5d-405a-b42e-a5103159bbe6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:54.445607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e10caca1-bf5d-405a-b42e-a5103159bbe6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:54.449656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e10caca1-bf5d-405a-b42e-a5103159bbe6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:54.451329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e10caca1-bf5d-405a-b42e-a5103159bbe6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:54.456947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e10caca1-bf5d-405a-b42e-a5103159bbe6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:54.457776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e10caca1-bf5d-405a-b42e-a5103159bbe6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:54.459689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e10caca1-bf5d-405a-b42e-a5103159bbe6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:54.534788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-861c38a2-9a30-431d-b749-ea3fb7ca57e8 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:54.536941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-861c38a2-9a30-431d-b749-ea3fb7ca57e8 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:54.566331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-861c38a2-9a30-431d-b749-ea3fb7ca57e8 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:54.567724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-861c38a2-9a30-431d-b749-ea3fb7ca57e8 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:54.568726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-861c38a2-9a30-431d-b749-ea3fb7ca57e8 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:54.570103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-861c38a2-9a30-431d-b749-ea3fb7ca57e8 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:54.571647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-861c38a2-9a30-431d-b749-ea3fb7ca57e8 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:54.573035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-861c38a2-9a30-431d-b749-ea3fb7ca57e8 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:54.702197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-861c38a2-9a30-431d-b749-ea3fb7ca57e8 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:54.719342 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-861c38a2-9a30-431d-b749-ea3fb7ca57e8 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1217 microversion: 2.1 time: 0.189008 Aug 09 15:06:54.737664 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2777/5550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:54 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1217 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:54.749208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7c136f8d-32a1-41b8-848d-465416e0ac18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:54.752165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7c136f8d-32a1-41b8-848d-465416e0ac18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:54.766855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c136f8d-32a1-41b8-848d-465416e0ac18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:54.773594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c136f8d-32a1-41b8-848d-465416e0ac18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:54.774451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c136f8d-32a1-41b8-848d-465416e0ac18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:54.775537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c136f8d-32a1-41b8-848d-465416e0ac18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:54.776307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c136f8d-32a1-41b8-848d-465416e0ac18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:54.777042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7c136f8d-32a1-41b8-848d-465416e0ac18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:55.040497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7c136f8d-32a1-41b8-848d-465416e0ac18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:55.051172 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7c136f8d-32a1-41b8-848d-465416e0ac18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1188 microversion: 2.1 time: 0.312007 Aug 09 15:06:55.061676 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2778/5551] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:54 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:55.201450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e10caca1-bf5d-405a-b42e-a5103159bbe6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:55.219522 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e10caca1-bf5d-405a-b42e-a5103159bbe6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1694 microversion: 2.1 time: 0.792569 Aug 09 15:06:55.226210 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2774/5552] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:54 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1694 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:55.802877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba3723a0-a872-45bc-87a7-2d9d9b5084ca tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:55.811564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba3723a0-a872-45bc-87a7-2d9d9b5084ca tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:55.848021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba3723a0-a872-45bc-87a7-2d9d9b5084ca tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:55.854939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba3723a0-a872-45bc-87a7-2d9d9b5084ca tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:55.857338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba3723a0-a872-45bc-87a7-2d9d9b5084ca tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:55.858639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba3723a0-a872-45bc-87a7-2d9d9b5084ca tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:55.859686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba3723a0-a872-45bc-87a7-2d9d9b5084ca tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:55.873979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba3723a0-a872-45bc-87a7-2d9d9b5084ca tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:56.094568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63e2f85d-d283-4255-935e-e148f09914e9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:56.096047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63e2f85d-d283-4255-935e-e148f09914e9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:56.124885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e2f85d-d283-4255-935e-e148f09914e9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:56.125397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e2f85d-d283-4255-935e-e148f09914e9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:56.131809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e2f85d-d283-4255-935e-e148f09914e9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:56.134588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e2f85d-d283-4255-935e-e148f09914e9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:56.135119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e2f85d-d283-4255-935e-e148f09914e9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:56.135571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e2f85d-d283-4255-935e-e148f09914e9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:56.207383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba3723a0-a872-45bc-87a7-2d9d9b5084ca tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:56.235870 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba3723a0-a872-45bc-87a7-2d9d9b5084ca tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1283 microversion: 2.1 time: 0.483927 Aug 09 15:06:56.248700 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2779/5553] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:55 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1283 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:56.274300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af8d4801-2c43-41df-862b-ec152a0a5aca tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:56.290484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-af8d4801-2c43-41df-862b-ec152a0a5aca tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:56.315263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af8d4801-2c43-41df-862b-ec152a0a5aca tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:56.316135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af8d4801-2c43-41df-862b-ec152a0a5aca tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:56.316914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af8d4801-2c43-41df-862b-ec152a0a5aca tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:56.318170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af8d4801-2c43-41df-862b-ec152a0a5aca tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:56.318990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af8d4801-2c43-41df-862b-ec152a0a5aca tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:56.329174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af8d4801-2c43-41df-862b-ec152a0a5aca tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:57.101554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63e2f85d-d283-4255-935e-e148f09914e9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:57.114931 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63e2f85d-d283-4255-935e-e148f09914e9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1188 microversion: 2.1 time: 1.034628 Aug 09 15:06:57.119912 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2775/5554] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:56 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1188 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:06:57.132211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f7200fb7-130e-4fda-8f30-dbf7a1ae66f7 req-c4e42e01-4e44-4aae-82a3-0c20be2a88b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caaadba4-bf8c-4e32-b86f-a6e0e68bbd93", "tag": "90f33f03-4270-4292-a57d-108d8d490b0a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:06:57.154121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=46 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:06:57.163486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f7200fb7-130e-4fda-8f30-dbf7a1ae66f7 req-c4e42e01-4e44-4aae-82a3-0c20be2a88b7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:57.164621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f7200fb7-130e-4fda-8f30-dbf7a1ae66f7 req-c4e42e01-4e44-4aae-82a3-0c20be2a88b7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:57.166166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f7200fb7-130e-4fda-8f30-dbf7a1ae66f7 req-c4e42e01-4e44-4aae-82a3-0c20be2a88b7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:57.211933 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f7200fb7-130e-4fda-8f30-dbf7a1ae66f7 req-c4e42e01-4e44-4aae-82a3-0c20be2a88b7 service nova] Creating event network-changed:90f33f03-4270-4292-a57d-108d8d490b0a for instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 on n-h1-844626-8 Aug 09 15:06:57.242041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-f7200fb7-130e-4fda-8f30-dbf7a1ae66f7 req-c4e42e01-4e44-4aae-82a3-0c20be2a88b7 service nova] Instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:06:57.285285 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f7200fb7-130e-4fda-8f30-dbf7a1ae66f7 req-c4e42e01-4e44-4aae-82a3-0c20be2a88b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162227 Aug 09 15:06:57.287481 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2776/5555] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:06:57.296295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-654858ad-501a-4c00-92de-9d982daf0b2c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:57.297718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-654858ad-501a-4c00-92de-9d982daf0b2c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:57.332061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654858ad-501a-4c00-92de-9d982daf0b2c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:57.353825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654858ad-501a-4c00-92de-9d982daf0b2c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:57.354643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654858ad-501a-4c00-92de-9d982daf0b2c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:57.356961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654858ad-501a-4c00-92de-9d982daf0b2c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:57.357881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654858ad-501a-4c00-92de-9d982daf0b2c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:57.359616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-654858ad-501a-4c00-92de-9d982daf0b2c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:57.770708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-af8d4801-2c43-41df-862b-ec152a0a5aca tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:57.791711 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af8d4801-2c43-41df-862b-ec152a0a5aca tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1694 microversion: 2.1 time: 1.529932 Aug 09 15:06:57.793003 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2780/5556] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:56 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1694 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:57.830923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-654858ad-501a-4c00-92de-9d982daf0b2c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:57.843109 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-654858ad-501a-4c00-92de-9d982daf0b2c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1271 microversion: 2.1 time: 0.551217 Aug 09 15:06:57.844466 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2777/5557] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:57 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1271 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:58.142196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cdd1f874-898e-4724-8aef-9415a22a96ce tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:58.142774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cdd1f874-898e-4724-8aef-9415a22a96ce tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:58.158895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdd1f874-898e-4724-8aef-9415a22a96ce tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:58.159428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdd1f874-898e-4724-8aef-9415a22a96ce tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:58.159866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdd1f874-898e-4724-8aef-9415a22a96ce tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:58.160572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdd1f874-898e-4724-8aef-9415a22a96ce tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:58.162593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdd1f874-898e-4724-8aef-9415a22a96ce tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:58.163041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdd1f874-898e-4724-8aef-9415a22a96ce tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:58.287287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cdd1f874-898e-4724-8aef-9415a22a96ce tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:58.307392 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cdd1f874-898e-4724-8aef-9415a22a96ce tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1188 microversion: 2.1 time: 0.170764 Aug 09 15:06:58.308029 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2781/5558] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:58 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1188 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:58.813289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57c986e4-7a4e-4e85-a90b-4835cc3b1bfe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:58.814513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57c986e4-7a4e-4e85-a90b-4835cc3b1bfe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:58.830148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57c986e4-7a4e-4e85-a90b-4835cc3b1bfe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:58.839899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57c986e4-7a4e-4e85-a90b-4835cc3b1bfe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:58.840581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57c986e4-7a4e-4e85-a90b-4835cc3b1bfe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:58.841502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57c986e4-7a4e-4e85-a90b-4835cc3b1bfe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:58.842090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57c986e4-7a4e-4e85-a90b-4835cc3b1bfe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:58.842663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57c986e4-7a4e-4e85-a90b-4835cc3b1bfe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:58.865666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5475652e-8a24-422e-9998-8b4111ad707e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:58.867022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5475652e-8a24-422e-9998-8b4111ad707e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:58.874814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5475652e-8a24-422e-9998-8b4111ad707e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:58.887868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5475652e-8a24-422e-9998-8b4111ad707e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:58.892010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5475652e-8a24-422e-9998-8b4111ad707e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:58.892918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5475652e-8a24-422e-9998-8b4111ad707e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:58.899053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5475652e-8a24-422e-9998-8b4111ad707e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:58.902132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5475652e-8a24-422e-9998-8b4111ad707e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:59.451052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-57c986e4-7a4e-4e85-a90b-4835cc3b1bfe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:59.484403 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57c986e4-7a4e-4e85-a90b-4835cc3b1bfe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1694 microversion: 2.1 time: 0.674727 Aug 09 15:06:59.485116 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2778/5559] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:58 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1694 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:59.495917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-26aef24c-ec44-4ea6-92d5-cebd4b1162f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:06:59.505769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-26aef24c-ec44-4ea6-92d5-cebd4b1162f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:06:59.527949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26aef24c-ec44-4ea6-92d5-cebd4b1162f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:59.528906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26aef24c-ec44-4ea6-92d5-cebd4b1162f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:59.529904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26aef24c-ec44-4ea6-92d5-cebd4b1162f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:59.537422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26aef24c-ec44-4ea6-92d5-cebd4b1162f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:06:59.539524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26aef24c-ec44-4ea6-92d5-cebd4b1162f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:06:59.543874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26aef24c-ec44-4ea6-92d5-cebd4b1162f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:06:59.714984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-26aef24c-ec44-4ea6-92d5-cebd4b1162f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:59.732551 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-26aef24c-ec44-4ea6-92d5-cebd4b1162f4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1188 microversion: 2.1 time: 0.241995 Aug 09 15:06:59.743294 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2779/5560] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:59 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1188 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:06:59.804963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5475652e-8a24-422e-9998-8b4111ad707e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:06:59.815643 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5475652e-8a24-422e-9998-8b4111ad707e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1313 microversion: 2.1 time: 0.953684 Aug 09 15:06:59.827116 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2782/5561] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:06:58 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1313 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:07:00.507303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-603f193e-370a-4ff4-8c76-2098ed16f735 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:00.508782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-603f193e-370a-4ff4-8c76-2098ed16f735 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:00.509490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ac60d4a5-b69a-4b99-9765-324b9cff9ada req-3b345850-3a2a-4c8f-9e91-950e0bc31dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1", "tag": "91063dcb-f7ed-4ec6-9d32-907a7080a9dd"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:00.517585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-603f193e-370a-4ff4-8c76-2098ed16f735 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:00.518484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-603f193e-370a-4ff4-8c76-2098ed16f735 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:00.519309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-603f193e-370a-4ff4-8c76-2098ed16f735 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:00.520346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-603f193e-370a-4ff4-8c76-2098ed16f735 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:00.521028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-603f193e-370a-4ff4-8c76-2098ed16f735 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:00.521681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-603f193e-370a-4ff4-8c76-2098ed16f735 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:00.540121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ac60d4a5-b69a-4b99-9765-324b9cff9ada req-3b345850-3a2a-4c8f-9e91-950e0bc31dda service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:00.540938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ac60d4a5-b69a-4b99-9765-324b9cff9ada req-3b345850-3a2a-4c8f-9e91-950e0bc31dda service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:00.541540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ac60d4a5-b69a-4b99-9765-324b9cff9ada req-3b345850-3a2a-4c8f-9e91-950e0bc31dda service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:00.573020 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ac60d4a5-b69a-4b99-9765-324b9cff9ada req-3b345850-3a2a-4c8f-9e91-950e0bc31dda service nova] Creating event network-changed:91063dcb-f7ed-4ec6-9d32-907a7080a9dd for instance ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 on n-h2-844626-8 Aug 09 15:07:00.592039 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ac60d4a5-b69a-4b99-9765-324b9cff9ada req-3b345850-3a2a-4c8f-9e91-950e0bc31dda service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221183 Aug 09 15:07:00.593711 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2780/5562] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:07:00.760166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9fd3fac2-6764-4821-9bf9-66f23f7015ca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:00.761210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9fd3fac2-6764-4821-9bf9-66f23f7015ca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:00.778684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fd3fac2-6764-4821-9bf9-66f23f7015ca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:00.779651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fd3fac2-6764-4821-9bf9-66f23f7015ca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:00.780304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fd3fac2-6764-4821-9bf9-66f23f7015ca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:00.781386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fd3fac2-6764-4821-9bf9-66f23f7015ca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:00.782078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fd3fac2-6764-4821-9bf9-66f23f7015ca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:00.782726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fd3fac2-6764-4821-9bf9-66f23f7015ca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:00.822627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:00.937988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9fd3fac2-6764-4821-9bf9-66f23f7015ca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:00.946649 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9fd3fac2-6764-4821-9bf9-66f23f7015ca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 200 len: 1188 microversion: 2.1 time: 0.192460 Aug 09 15:07:00.947674 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2781/5563] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:00 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 1188 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:07:00.953654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fcbb4ac6-9003-40b3-89d2-6599055b34f0 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:00.954476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fcbb4ac6-9003-40b3-89d2-6599055b34f0 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:00.962389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcbb4ac6-9003-40b3-89d2-6599055b34f0 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:00.962904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcbb4ac6-9003-40b3-89d2-6599055b34f0 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:00.963370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcbb4ac6-9003-40b3-89d2-6599055b34f0 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:00.964090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcbb4ac6-9003-40b3-89d2-6599055b34f0 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:00.964539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcbb4ac6-9003-40b3-89d2-6599055b34f0 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:00.966002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcbb4ac6-9003-40b3-89d2-6599055b34f0 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:01.289749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-603f193e-370a-4ff4-8c76-2098ed16f735 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:01.311785 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-603f193e-370a-4ff4-8c76-2098ed16f735 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1692 microversion: 2.1 time: 0.808210 Aug 09 15:07:01.313952 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2783/5564] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:00 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1692 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:07:01.546195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fcbb4ac6-9003-40b3-89d2-6599055b34f0 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:01.561380 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fcbb4ac6-9003-40b3-89d2-6599055b34f0 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1313 microversion: 2.1 time: 0.612244 Aug 09 15:07:01.565435 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2782/5565] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:00 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:01.979218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91b29fad-80b0-4cde-bd5b-844aed8a49c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:01.980825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-91b29fad-80b0-4cde-bd5b-844aed8a49c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 7127301a-4e35-4ab7-956d-3246b1000341] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:01.999661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91b29fad-80b0-4cde-bd5b-844aed8a49c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:02.000671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91b29fad-80b0-4cde-bd5b-844aed8a49c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:02.001317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91b29fad-80b0-4cde-bd5b-844aed8a49c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:02.002339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91b29fad-80b0-4cde-bd5b-844aed8a49c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:02.003605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91b29fad-80b0-4cde-bd5b-844aed8a49c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:02.009878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-91b29fad-80b0-4cde-bd5b-844aed8a49c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:02.045524 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-91b29fad-80b0-4cde-bd5b-844aed8a49c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance 7127301a-4e35-4ab7-956d-3246b1000341 could not be found. Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91b29fad-80b0-4cde-bd5b-844aed8a49c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 HTTP/1.1 Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 7127301a-4e35-4ab7-956d-3246b1000341 could not be found. Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '7127301a-4e35-4ab7-956d-3246b1000341'} Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7127301a-4e35-4ab7-956d-3246b1000341 could not be found. Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7127301a-4e35-4ab7-956d-3246b1000341 could not be found. Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:07:02.047726 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:07:02.051754 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:07:02.051754 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:07:02.051754 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:07:02.051754 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:07:02.051754 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:07:02.051754 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7127301a-4e35-4ab7-956d-3246b1000341 could not be found. Aug 09 15:07:02.051754 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:07:02.053048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91b29fad-80b0-4cde-bd5b-844aed8a49c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance 7127301a-4e35-4ab7-956d-3246b1000341 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:07:02.054120 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91b29fad-80b0-4cde-bd5b-844aed8a49c7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341" status: 404 len: 111 microversion: 2.1 time: 0.084460 Aug 09 15:07:02.055235 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2784/5566] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:01 2022] GET /compute/v2.1/servers/7127301a-4e35-4ab7-956d-3246b1000341 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:07:02.333358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-839718b1-8203-4e79-a2ba-c4feef9b5e85 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:02.335120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-839718b1-8203-4e79-a2ba-c4feef9b5e85 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:02.341516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839718b1-8203-4e79-a2ba-c4feef9b5e85 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:02.342089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839718b1-8203-4e79-a2ba-c4feef9b5e85 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:02.342595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839718b1-8203-4e79-a2ba-c4feef9b5e85 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:02.343610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839718b1-8203-4e79-a2ba-c4feef9b5e85 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:02.344134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839718b1-8203-4e79-a2ba-c4feef9b5e85 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:02.344648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-839718b1-8203-4e79-a2ba-c4feef9b5e85 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:02.533246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-839718b1-8203-4e79-a2ba-c4feef9b5e85 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:02.546079 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-839718b1-8203-4e79-a2ba-c4feef9b5e85 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1689 microversion: 2.1 time: 0.216613 Aug 09 15:07:02.547408 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2783/5567] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:02 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1689 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:02.567037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c7afc33-c5e5-4452-b8f0-498c1b7defde tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:02.567884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6c7afc33-c5e5-4452-b8f0-498c1b7defde tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:02.574559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c7afc33-c5e5-4452-b8f0-498c1b7defde tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:02.575350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c7afc33-c5e5-4452-b8f0-498c1b7defde tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:02.575945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c7afc33-c5e5-4452-b8f0-498c1b7defde tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:02.576846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c7afc33-c5e5-4452-b8f0-498c1b7defde tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:02.577460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c7afc33-c5e5-4452-b8f0-498c1b7defde tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:02.578116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c7afc33-c5e5-4452-b8f0-498c1b7defde tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:02.585574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1db74d54-63d3-4127-8ea5-21172e4d12ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:02.586454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1db74d54-63d3-4127-8ea5-21172e4d12ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:02.597699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1db74d54-63d3-4127-8ea5-21172e4d12ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:02.598560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1db74d54-63d3-4127-8ea5-21172e4d12ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:02.599210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1db74d54-63d3-4127-8ea5-21172e4d12ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:02.607618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1db74d54-63d3-4127-8ea5-21172e4d12ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:02.607618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1db74d54-63d3-4127-8ea5-21172e4d12ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:02.607618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1db74d54-63d3-4127-8ea5-21172e4d12ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:02.712642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:02.905019 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6c7afc33-c5e5-4452-b8f0-498c1b7defde tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93/action" status: 202 len: 0 microversion: 2.1 time: 0.340344 Aug 09 15:07:02.928947 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2785/5568] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:07:02 2022] POST /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:07:02.937781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1db74d54-63d3-4127-8ea5-21172e4d12ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:02.955781 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1db74d54-63d3-4127-8ea5-21172e4d12ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1313 microversion: 2.1 time: 0.373582 Aug 09 15:07:02.956486 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2784/5569] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:02 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:07:02.969179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-34610960-1bef-49c6-8bcc-6cf7e72b95da tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:02.973433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-34610960-1bef-49c6-8bcc-6cf7e72b95da tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:03.009272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34610960-1bef-49c6-8bcc-6cf7e72b95da tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:03.020381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34610960-1bef-49c6-8bcc-6cf7e72b95da tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:03.020895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34610960-1bef-49c6-8bcc-6cf7e72b95da tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:03.021887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34610960-1bef-49c6-8bcc-6cf7e72b95da tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:03.022484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34610960-1bef-49c6-8bcc-6cf7e72b95da tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:03.022925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-34610960-1bef-49c6-8bcc-6cf7e72b95da tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:03.061514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:03.499886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:03.652112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8681efa9-e60d-4c28-b8a1-4e3e87e30e00 req-9e58c68e-5a26-4316-9a8e-9bdf121712ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caaadba4-bf8c-4e32-b86f-a6e0e68bbd93", "name": "network-vif-plugged", "status": "completed", "tag": "90f33f03-4270-4292-a57d-108d8d490b0a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:03.669145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8681efa9-e60d-4c28-b8a1-4e3e87e30e00 req-9e58c68e-5a26-4316-9a8e-9bdf121712ec service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:03.669936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8681efa9-e60d-4c28-b8a1-4e3e87e30e00 req-9e58c68e-5a26-4316-9a8e-9bdf121712ec service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:03.670552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8681efa9-e60d-4c28-b8a1-4e3e87e30e00 req-9e58c68e-5a26-4316-9a8e-9bdf121712ec service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:03.694082 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8681efa9-e60d-4c28-b8a1-4e3e87e30e00 req-9e58c68e-5a26-4316-9a8e-9bdf121712ec service nova] Creating event network-vif-plugged:90f33f03-4270-4292-a57d-108d8d490b0a for instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 on n-h1-844626-8 Aug 09 15:07:03.704165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-34610960-1bef-49c6-8bcc-6cf7e72b95da tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:03.718456 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-34610960-1bef-49c6-8bcc-6cf7e72b95da tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1688 microversion: 2.1 time: 0.784404 Aug 09 15:07:03.721248 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2786/5570] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:02 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1688 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:03.726629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-8681efa9-e60d-4c28-b8a1-4e3e87e30e00 req-9e58c68e-5a26-4316-9a8e-9bdf121712ec service nova] Instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:07:03.763066 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8681efa9-e60d-4c28-b8a1-4e3e87e30e00 req-9e58c68e-5a26-4316-9a8e-9bdf121712ec service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114674 Aug 09 15:07:03.764247 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2785/5571] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:07:03.977322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8213f139-73de-4eaf-a627-e1be7ed72432 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:03.977931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8213f139-73de-4eaf-a627-e1be7ed72432 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:03.988081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8213f139-73de-4eaf-a627-e1be7ed72432 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:03.990315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8213f139-73de-4eaf-a627-e1be7ed72432 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:03.993385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8213f139-73de-4eaf-a627-e1be7ed72432 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:03.994286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8213f139-73de-4eaf-a627-e1be7ed72432 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:03.994922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8213f139-73de-4eaf-a627-e1be7ed72432 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:03.995476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8213f139-73de-4eaf-a627-e1be7ed72432 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:04.756041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7d62643-5495-4230-85f3-826d20d169f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:04.759997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7d62643-5495-4230-85f3-826d20d169f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:04.777997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d62643-5495-4230-85f3-826d20d169f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:04.781629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d62643-5495-4230-85f3-826d20d169f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:04.782099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d62643-5495-4230-85f3-826d20d169f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:04.782860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d62643-5495-4230-85f3-826d20d169f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:04.783349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d62643-5495-4230-85f3-826d20d169f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:04.783848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7d62643-5495-4230-85f3-826d20d169f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:04.804725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8213f139-73de-4eaf-a627-e1be7ed72432 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:04.826077 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8213f139-73de-4eaf-a627-e1be7ed72432 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1313 microversion: 2.1 time: 0.852566 Aug 09 15:07:04.830000 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2787/5572] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:03 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1313 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:05.376750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7d62643-5495-4230-85f3-826d20d169f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:05.387985 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7d62643-5495-4230-85f3-826d20d169f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1688 microversion: 2.1 time: 0.645673 Aug 09 15:07:05.391006 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2786/5573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:04 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1688 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:05.849167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cef105b5-4ce9-4077-ae8e-cbee65f7b537 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:05.849913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cef105b5-4ce9-4077-ae8e-cbee65f7b537 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:05.857402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cef105b5-4ce9-4077-ae8e-cbee65f7b537 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:05.858476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cef105b5-4ce9-4077-ae8e-cbee65f7b537 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:05.859488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cef105b5-4ce9-4077-ae8e-cbee65f7b537 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:05.860504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cef105b5-4ce9-4077-ae8e-cbee65f7b537 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:05.861170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cef105b5-4ce9-4077-ae8e-cbee65f7b537 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:05.861944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cef105b5-4ce9-4077-ae8e-cbee65f7b537 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:06.202464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cef105b5-4ce9-4077-ae8e-cbee65f7b537 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:06.227533 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cef105b5-4ce9-4077-ae8e-cbee65f7b537 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1313 microversion: 2.1 time: 0.380944 Aug 09 15:07:06.229771 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2788/5574] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:05 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:06.414972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82c75184-8e08-4943-99e2-7a38f8383842 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:06.416283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-82c75184-8e08-4943-99e2-7a38f8383842 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:06.459606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82c75184-8e08-4943-99e2-7a38f8383842 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:06.461462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82c75184-8e08-4943-99e2-7a38f8383842 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:06.465510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82c75184-8e08-4943-99e2-7a38f8383842 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:06.468562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82c75184-8e08-4943-99e2-7a38f8383842 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:06.471855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82c75184-8e08-4943-99e2-7a38f8383842 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:06.474769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82c75184-8e08-4943-99e2-7a38f8383842 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:06.996096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-82c75184-8e08-4943-99e2-7a38f8383842 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:07.012473 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-82c75184-8e08-4943-99e2-7a38f8383842 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1688 microversion: 2.1 time: 0.602956 Aug 09 15:07:07.033600 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2787/5575] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:06 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1688 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:07.256515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-67c3b3d5-989b-4705-8c59-4a4b66cc6a9d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:07.257223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-67c3b3d5-989b-4705-8c59-4a4b66cc6a9d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:07.269095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:07.282252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67c3b3d5-989b-4705-8c59-4a4b66cc6a9d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:07.291988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67c3b3d5-989b-4705-8c59-4a4b66cc6a9d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:07.292691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67c3b3d5-989b-4705-8c59-4a4b66cc6a9d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:07.293734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67c3b3d5-989b-4705-8c59-4a4b66cc6a9d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:07.294498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67c3b3d5-989b-4705-8c59-4a4b66cc6a9d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:07.295788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-67c3b3d5-989b-4705-8c59-4a4b66cc6a9d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:08.040741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fb98ac37-5ba1-4798-841f-2954f4da8b0a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:08.042002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fb98ac37-5ba1-4798-841f-2954f4da8b0a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:08.063200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb98ac37-5ba1-4798-841f-2954f4da8b0a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:08.063859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb98ac37-5ba1-4798-841f-2954f4da8b0a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:08.064586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb98ac37-5ba1-4798-841f-2954f4da8b0a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:08.065482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb98ac37-5ba1-4798-841f-2954f4da8b0a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:08.066085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb98ac37-5ba1-4798-841f-2954f4da8b0a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:08.066677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb98ac37-5ba1-4798-841f-2954f4da8b0a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:08.544563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-67c3b3d5-989b-4705-8c59-4a4b66cc6a9d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:08.559165 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-67c3b3d5-989b-4705-8c59-4a4b66cc6a9d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1313 microversion: 2.1 time: 1.308170 Aug 09 15:07:08.560762 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2789/5576] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:07 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1313 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:08.572204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-7cb5b97d-29f1-42de-99b9-81f5cc6820ba req-da754b1b-d95d-4916-8913-a74ad3db6312 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1", "name": "network-vif-plugged", "status": "completed", "tag": "91063dcb-f7ed-4ec6-9d32-907a7080a9dd"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:08.604112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7cb5b97d-29f1-42de-99b9-81f5cc6820ba req-da754b1b-d95d-4916-8913-a74ad3db6312 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:08.604818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7cb5b97d-29f1-42de-99b9-81f5cc6820ba req-da754b1b-d95d-4916-8913-a74ad3db6312 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:08.605557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7cb5b97d-29f1-42de-99b9-81f5cc6820ba req-da754b1b-d95d-4916-8913-a74ad3db6312 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:08.620241 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-7cb5b97d-29f1-42de-99b9-81f5cc6820ba req-da754b1b-d95d-4916-8913-a74ad3db6312 service nova] Creating event network-vif-plugged:91063dcb-f7ed-4ec6-9d32-907a7080a9dd for instance ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 on n-h2-844626-8 Aug 09 15:07:08.627270 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-7cb5b97d-29f1-42de-99b9-81f5cc6820ba req-da754b1b-d95d-4916-8913-a74ad3db6312 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063168 Aug 09 15:07:08.628295 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2790/5577] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:07:08.635951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-09ec2bdc-d967-44b6-922d-9e462c80f063 req-0c338966-f6a2-47b6-a4cd-7fcd2a98282c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caaadba4-bf8c-4e32-b86f-a6e0e68bbd93", "name": "network-vif-unplugged", "status": "completed", "tag": "90f33f03-4270-4292-a57d-108d8d490b0a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:08.648815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-09ec2bdc-d967-44b6-922d-9e462c80f063 req-0c338966-f6a2-47b6-a4cd-7fcd2a98282c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:08.649558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-09ec2bdc-d967-44b6-922d-9e462c80f063 req-0c338966-f6a2-47b6-a4cd-7fcd2a98282c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:08.650122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-09ec2bdc-d967-44b6-922d-9e462c80f063 req-0c338966-f6a2-47b6-a4cd-7fcd2a98282c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:08.678265 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-09ec2bdc-d967-44b6-922d-9e462c80f063 req-0c338966-f6a2-47b6-a4cd-7fcd2a98282c service nova] Creating event network-vif-unplugged:90f33f03-4270-4292-a57d-108d8d490b0a for instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 on n-h2-844626-8 Aug 09 15:07:08.690996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-09ec2bdc-d967-44b6-922d-9e462c80f063 req-0c338966-f6a2-47b6-a4cd-7fcd2a98282c service nova] Instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:07:08.718658 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-09ec2bdc-d967-44b6-922d-9e462c80f063 req-0c338966-f6a2-47b6-a4cd-7fcd2a98282c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088517 Aug 09 15:07:08.719868 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2791/5578] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:07:09.106221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fb98ac37-5ba1-4798-841f-2954f4da8b0a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:09.122485 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fb98ac37-5ba1-4798-841f-2954f4da8b0a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1688 microversion: 2.1 time: 1.083881 Aug 09 15:07:09.123930 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2788/5579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:08 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1688 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:07:09.581546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f21f6614-ee3b-4117-8ef3-650bd9c85244 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:09.582899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f21f6614-ee3b-4117-8ef3-650bd9c85244 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:09.590541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f21f6614-ee3b-4117-8ef3-650bd9c85244 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:09.591518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f21f6614-ee3b-4117-8ef3-650bd9c85244 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:09.592405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f21f6614-ee3b-4117-8ef3-650bd9c85244 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:09.593267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f21f6614-ee3b-4117-8ef3-650bd9c85244 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:09.593787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f21f6614-ee3b-4117-8ef3-650bd9c85244 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:09.594437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f21f6614-ee3b-4117-8ef3-650bd9c85244 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:09.972694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f21f6614-ee3b-4117-8ef3-650bd9c85244 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:09.983225 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f21f6614-ee3b-4117-8ef3-650bd9c85244 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1313 microversion: 2.1 time: 0.405836 Aug 09 15:07:09.985311 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2792/5580] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:09 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:10.145559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a590f074-87c0-4391-ab24-9fcf267fd88b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:10.146184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a590f074-87c0-4391-ab24-9fcf267fd88b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:10.153765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a590f074-87c0-4391-ab24-9fcf267fd88b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:10.154531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a590f074-87c0-4391-ab24-9fcf267fd88b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:10.155182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a590f074-87c0-4391-ab24-9fcf267fd88b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:10.156304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a590f074-87c0-4391-ab24-9fcf267fd88b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:10.156953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a590f074-87c0-4391-ab24-9fcf267fd88b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:10.157710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a590f074-87c0-4391-ab24-9fcf267fd88b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:10.806730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a590f074-87c0-4391-ab24-9fcf267fd88b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:10.817297 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a590f074-87c0-4391-ab24-9fcf267fd88b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1688 microversion: 2.1 time: 0.675912 Aug 09 15:07:10.818765 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2789/5581] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:10 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1688 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:10.898997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-d501e6fd-38b1-40c5-8b6e-ed03204c7ea5 req-c0324550-5957-4de9-a87b-c7303059e501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caaadba4-bf8c-4e32-b86f-a6e0e68bbd93", "tag": "90f33f03-4270-4292-a57d-108d8d490b0a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:10.922432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d501e6fd-38b1-40c5-8b6e-ed03204c7ea5 req-c0324550-5957-4de9-a87b-c7303059e501 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:10.923418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d501e6fd-38b1-40c5-8b6e-ed03204c7ea5 req-c0324550-5957-4de9-a87b-c7303059e501 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:10.924819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d501e6fd-38b1-40c5-8b6e-ed03204c7ea5 req-c0324550-5957-4de9-a87b-c7303059e501 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:10.948605 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d501e6fd-38b1-40c5-8b6e-ed03204c7ea5 req-c0324550-5957-4de9-a87b-c7303059e501 service nova] Creating event network-changed:90f33f03-4270-4292-a57d-108d8d490b0a for instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 on n-h2-844626-8 Aug 09 15:07:10.956747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-d501e6fd-38b1-40c5-8b6e-ed03204c7ea5 req-c0324550-5957-4de9-a87b-c7303059e501 service nova] Instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:07:10.970158 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-d501e6fd-38b1-40c5-8b6e-ed03204c7ea5 req-c0324550-5957-4de9-a87b-c7303059e501 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076593 Aug 09 15:07:10.971330 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2793/5582] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:07:11.009713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-48cb2546-d4a4-4c09-8509-f66d6f8b33ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:11.013244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-48cb2546-d4a4-4c09-8509-f66d6f8b33ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:11.041934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48cb2546-d4a4-4c09-8509-f66d6f8b33ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:11.042823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48cb2546-d4a4-4c09-8509-f66d6f8b33ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:11.044266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48cb2546-d4a4-4c09-8509-f66d6f8b33ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:11.048880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48cb2546-d4a4-4c09-8509-f66d6f8b33ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:11.049858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48cb2546-d4a4-4c09-8509-f66d6f8b33ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:11.051986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48cb2546-d4a4-4c09-8509-f66d6f8b33ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:11.839862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-edd28f8b-61aa-4534-abe3-d21739435fa0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:11.840879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-edd28f8b-61aa-4534-abe3-d21739435fa0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:11.852030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edd28f8b-61aa-4534-abe3-d21739435fa0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:11.854230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edd28f8b-61aa-4534-abe3-d21739435fa0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:11.855892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edd28f8b-61aa-4534-abe3-d21739435fa0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:11.858511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edd28f8b-61aa-4534-abe3-d21739435fa0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:11.860380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edd28f8b-61aa-4534-abe3-d21739435fa0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:11.861006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-edd28f8b-61aa-4534-abe3-d21739435fa0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:12.065686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-48cb2546-d4a4-4c09-8509-f66d6f8b33ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:12.074903 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-48cb2546-d4a4-4c09-8509-f66d6f8b33ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1500 microversion: 2.1 time: 1.072701 Aug 09 15:07:12.084397 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2790/5583] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:11 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1500 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:12.121250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a89a3aca-9295-41e5-949f-ab884a2f3623 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:12.129831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a89a3aca-9295-41e5-949f-ab884a2f3623 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:12.146687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a89a3aca-9295-41e5-949f-ab884a2f3623 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:12.147223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a89a3aca-9295-41e5-949f-ab884a2f3623 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:12.147717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a89a3aca-9295-41e5-949f-ab884a2f3623 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:12.148722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a89a3aca-9295-41e5-949f-ab884a2f3623 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:12.150751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a89a3aca-9295-41e5-949f-ab884a2f3623 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:12.151995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a89a3aca-9295-41e5-949f-ab884a2f3623 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:12.210264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-a89a3aca-9295-41e5-949f-ab884a2f3623 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lazy-loading 'flavor' on Instance uuid ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:07:12.212169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-edd28f8b-61aa-4534-abe3-d21739435fa0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:12.225722 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-edd28f8b-61aa-4534-abe3-d21739435fa0 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1688 microversion: 2.1 time: 0.390081 Aug 09 15:07:12.244354 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2794/5584] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:11 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1688 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:07:12.399417 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a89a3aca-9295-41e5-949f-ab884a2f3623 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "POST /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1/action" status: 200 len: 32 microversion: 2.1 time: 0.295943 Aug 09 15:07:12.404704 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2791/5585] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:07:12 2022] POST /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1/action => generated 32 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:07:12.411010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9aec0a6b-640b-475f-8903-80e2cc799a94 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:12.412298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9aec0a6b-640b-475f-8903-80e2cc799a94 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:12.422421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aec0a6b-640b-475f-8903-80e2cc799a94 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:12.432231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aec0a6b-640b-475f-8903-80e2cc799a94 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:12.432713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aec0a6b-640b-475f-8903-80e2cc799a94 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:12.433810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aec0a6b-640b-475f-8903-80e2cc799a94 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:12.434426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aec0a6b-640b-475f-8903-80e2cc799a94 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:12.435118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9aec0a6b-640b-475f-8903-80e2cc799a94 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:12.813837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9aec0a6b-640b-475f-8903-80e2cc799a94 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:12.824060 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9aec0a6b-640b-475f-8903-80e2cc799a94 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.416991 Aug 09 15:07:12.845019 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2795/5586] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:12 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:13.249839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a036bf0d-3264-4688-acb5-e657ad8e0608 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:13.251594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a036bf0d-3264-4688-acb5-e657ad8e0608 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:13.259677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a036bf0d-3264-4688-acb5-e657ad8e0608 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:13.260621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a036bf0d-3264-4688-acb5-e657ad8e0608 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:13.261303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a036bf0d-3264-4688-acb5-e657ad8e0608 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:13.262335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a036bf0d-3264-4688-acb5-e657ad8e0608 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:13.263000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a036bf0d-3264-4688-acb5-e657ad8e0608 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:13.263647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a036bf0d-3264-4688-acb5-e657ad8e0608 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:13.546433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a036bf0d-3264-4688-acb5-e657ad8e0608 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:13.559022 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a036bf0d-3264-4688-acb5-e657ad8e0608 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1688 microversion: 2.1 time: 0.315475 Aug 09 15:07:13.564468 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2792/5587] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:13 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1688 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:13.852839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ddc7a521-89d4-4914-94e4-7e0107c1b165 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:13.854069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ddc7a521-89d4-4914-94e4-7e0107c1b165 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:13.874058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddc7a521-89d4-4914-94e4-7e0107c1b165 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:13.874606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddc7a521-89d4-4914-94e4-7e0107c1b165 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:13.875046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddc7a521-89d4-4914-94e4-7e0107c1b165 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:13.875841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddc7a521-89d4-4914-94e4-7e0107c1b165 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:13.881639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddc7a521-89d4-4914-94e4-7e0107c1b165 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:13.883857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ddc7a521-89d4-4914-94e4-7e0107c1b165 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:14.585970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dc779c1e-3f45-4d1b-b3b6-b38dbc1c0d81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:14.586928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dc779c1e-3f45-4d1b-b3b6-b38dbc1c0d81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:14.607274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc779c1e-3f45-4d1b-b3b6-b38dbc1c0d81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:14.610249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc779c1e-3f45-4d1b-b3b6-b38dbc1c0d81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:14.615168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc779c1e-3f45-4d1b-b3b6-b38dbc1c0d81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:14.617511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc779c1e-3f45-4d1b-b3b6-b38dbc1c0d81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:14.618406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc779c1e-3f45-4d1b-b3b6-b38dbc1c0d81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:14.622805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc779c1e-3f45-4d1b-b3b6-b38dbc1c0d81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:15.271527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ddc7a521-89d4-4914-94e4-7e0107c1b165 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:15.285283 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ddc7a521-89d4-4914-94e4-7e0107c1b165 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 1.436744 Aug 09 15:07:15.303163 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2796/5588] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:13 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:15.337765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dc779c1e-3f45-4d1b-b3b6-b38dbc1c0d81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:15.352851 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dc779c1e-3f45-4d1b-b3b6-b38dbc1c0d81 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1681 microversion: 2.1 time: 0.767785 Aug 09 15:07:15.354101 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2793/5589] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:14 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1681 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:16.315578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c7b4328d-bee5-4e0a-9f6c-24aabd5cb78f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:16.317404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c7b4328d-bee5-4e0a-9f6c-24aabd5cb78f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:16.355386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7b4328d-bee5-4e0a-9f6c-24aabd5cb78f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:16.356747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7b4328d-bee5-4e0a-9f6c-24aabd5cb78f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:16.358745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7b4328d-bee5-4e0a-9f6c-24aabd5cb78f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:16.359799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7b4328d-bee5-4e0a-9f6c-24aabd5cb78f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:16.395497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7b4328d-bee5-4e0a-9f6c-24aabd5cb78f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:16.403245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7b4328d-bee5-4e0a-9f6c-24aabd5cb78f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:16.807249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c7b4328d-bee5-4e0a-9f6c-24aabd5cb78f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:16.820324 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c7b4328d-bee5-4e0a-9f6c-24aabd5cb78f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.513074 Aug 09 15:07:16.821723 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2797/5590] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:16 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:17.841915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8e6130b-a5d7-4058-952c-6289cf93fe21 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:17.842597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b8e6130b-a5d7-4058-952c-6289cf93fe21 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:17.851178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e6130b-a5d7-4058-952c-6289cf93fe21 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:17.864192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e6130b-a5d7-4058-952c-6289cf93fe21 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:17.865147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e6130b-a5d7-4058-952c-6289cf93fe21 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:17.866109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e6130b-a5d7-4058-952c-6289cf93fe21 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:17.866767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e6130b-a5d7-4058-952c-6289cf93fe21 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:17.867472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8e6130b-a5d7-4058-952c-6289cf93fe21 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:18.159606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b79d00ae-fbef-40b8-9264-4f14ce19f6a6 req-81fbf55b-fcef-4380-b150-9413147d06d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caaadba4-bf8c-4e32-b86f-a6e0e68bbd93", "name": "network-vif-plugged", "status": "completed", "tag": "90f33f03-4270-4292-a57d-108d8d490b0a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:18.193766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b79d00ae-fbef-40b8-9264-4f14ce19f6a6 req-81fbf55b-fcef-4380-b150-9413147d06d8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:18.201219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b79d00ae-fbef-40b8-9264-4f14ce19f6a6 req-81fbf55b-fcef-4380-b150-9413147d06d8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:18.201979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b79d00ae-fbef-40b8-9264-4f14ce19f6a6 req-81fbf55b-fcef-4380-b150-9413147d06d8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:18.222922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8e6130b-a5d7-4058-952c-6289cf93fe21 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:18.239682 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8e6130b-a5d7-4058-952c-6289cf93fe21 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.401890 Aug 09 15:07:18.242892 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2794/5591] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:17 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:18.245452 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b79d00ae-fbef-40b8-9264-4f14ce19f6a6 req-81fbf55b-fcef-4380-b150-9413147d06d8 service nova] Creating event network-vif-plugged:90f33f03-4270-4292-a57d-108d8d490b0a for instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 on n-h2-844626-8 Aug 09 15:07:18.259888 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b79d00ae-fbef-40b8-9264-4f14ce19f6a6 req-81fbf55b-fcef-4380-b150-9413147d06d8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104157 Aug 09 15:07:18.262040 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2798/5592] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:07:19.266323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c123e34-aa7f-4c6b-99a1-44e30b2de207 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:19.269715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c123e34-aa7f-4c6b-99a1-44e30b2de207 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:19.283744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c123e34-aa7f-4c6b-99a1-44e30b2de207 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:19.285129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c123e34-aa7f-4c6b-99a1-44e30b2de207 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:19.285972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c123e34-aa7f-4c6b-99a1-44e30b2de207 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:19.286767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c123e34-aa7f-4c6b-99a1-44e30b2de207 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:19.287453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c123e34-aa7f-4c6b-99a1-44e30b2de207 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:19.288224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c123e34-aa7f-4c6b-99a1-44e30b2de207 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:19.514101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8c123e34-aa7f-4c6b-99a1-44e30b2de207 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:19.531122 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c123e34-aa7f-4c6b-99a1-44e30b2de207 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.272447 Aug 09 15:07:19.547894 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2795/5593] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:19 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:20.555685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-977f6650-7958-4a36-a154-76a5c4b527df tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:20.556399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-977f6650-7958-4a36-a154-76a5c4b527df tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:20.569106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-977f6650-7958-4a36-a154-76a5c4b527df tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:20.572578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-977f6650-7958-4a36-a154-76a5c4b527df tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:20.575236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-977f6650-7958-4a36-a154-76a5c4b527df tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:20.577157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-977f6650-7958-4a36-a154-76a5c4b527df tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:20.579685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-977f6650-7958-4a36-a154-76a5c4b527df tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:20.582418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-977f6650-7958-4a36-a154-76a5c4b527df tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:20.914985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-977f6650-7958-4a36-a154-76a5c4b527df tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:20.931893 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-977f6650-7958-4a36-a154-76a5c4b527df tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.380341 Aug 09 15:07:20.936199 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2799/5594] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:20 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:21.961850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-51818076-06f7-4c24-8224-749a417c9d24 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:21.966683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-51818076-06f7-4c24-8224-749a417c9d24 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:22.011851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51818076-06f7-4c24-8224-749a417c9d24 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:22.012535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51818076-06f7-4c24-8224-749a417c9d24 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:22.040312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51818076-06f7-4c24-8224-749a417c9d24 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:22.046052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51818076-06f7-4c24-8224-749a417c9d24 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:22.050905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51818076-06f7-4c24-8224-749a417c9d24 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:22.051612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51818076-06f7-4c24-8224-749a417c9d24 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:22.091935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:22.436378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-51818076-06f7-4c24-8224-749a417c9d24 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:22.448616 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-51818076-06f7-4c24-8224-749a417c9d24 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.491002 Aug 09 15:07:22.449156 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2796/5595] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:21 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:23.493312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-117ae366-c11e-4805-8f62-e626f26c9af7 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:23.495903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-117ae366-c11e-4805-8f62-e626f26c9af7 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:23.528970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-117ae366-c11e-4805-8f62-e626f26c9af7 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:23.554651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-117ae366-c11e-4805-8f62-e626f26c9af7 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:23.560166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-117ae366-c11e-4805-8f62-e626f26c9af7 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:23.562738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-117ae366-c11e-4805-8f62-e626f26c9af7 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:23.563547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-117ae366-c11e-4805-8f62-e626f26c9af7 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:23.566199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-117ae366-c11e-4805-8f62-e626f26c9af7 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:23.847326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-117ae366-c11e-4805-8f62-e626f26c9af7 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:23.860913 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-117ae366-c11e-4805-8f62-e626f26c9af7 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.391433 Aug 09 15:07:23.861705 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2800/5596] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:23 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:24.893124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-652eda49-1b8e-4d1c-9277-7411a367a8ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:24.899928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-652eda49-1b8e-4d1c-9277-7411a367a8ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:24.917911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-652eda49-1b8e-4d1c-9277-7411a367a8ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:24.924198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-652eda49-1b8e-4d1c-9277-7411a367a8ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:24.925337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-652eda49-1b8e-4d1c-9277-7411a367a8ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:24.928376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-652eda49-1b8e-4d1c-9277-7411a367a8ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:24.936811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-652eda49-1b8e-4d1c-9277-7411a367a8ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:24.938056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-652eda49-1b8e-4d1c-9277-7411a367a8ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:25.483811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-652eda49-1b8e-4d1c-9277-7411a367a8ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:25.534889 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-652eda49-1b8e-4d1c-9277-7411a367a8ce tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.649064 Aug 09 15:07:25.537465 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2797/5597] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:24 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:26.565952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-41496beb-c6eb-4acb-b17a-a36e1d7da861 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:26.570934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-41496beb-c6eb-4acb-b17a-a36e1d7da861 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:26.587474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41496beb-c6eb-4acb-b17a-a36e1d7da861 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:26.588758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41496beb-c6eb-4acb-b17a-a36e1d7da861 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:26.590111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41496beb-c6eb-4acb-b17a-a36e1d7da861 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:26.592673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41496beb-c6eb-4acb-b17a-a36e1d7da861 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:26.593987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41496beb-c6eb-4acb-b17a-a36e1d7da861 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:26.595060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41496beb-c6eb-4acb-b17a-a36e1d7da861 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:27.006115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-41496beb-c6eb-4acb-b17a-a36e1d7da861 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:27.024005 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-41496beb-c6eb-4acb-b17a-a36e1d7da861 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.468473 Aug 09 15:07:27.026826 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2801/5598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:26 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:28.052989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc9dde68-669c-4347-be0f-1b9fc3dd1694 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:28.055059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc9dde68-669c-4347-be0f-1b9fc3dd1694 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:28.066276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=44 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:28.069569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc9dde68-669c-4347-be0f-1b9fc3dd1694 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:28.071835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc9dde68-669c-4347-be0f-1b9fc3dd1694 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:28.073578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc9dde68-669c-4347-be0f-1b9fc3dd1694 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:28.078125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc9dde68-669c-4347-be0f-1b9fc3dd1694 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:28.079277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc9dde68-669c-4347-be0f-1b9fc3dd1694 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:28.080344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc9dde68-669c-4347-be0f-1b9fc3dd1694 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:28.547848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bc9dde68-669c-4347-be0f-1b9fc3dd1694 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:28.573832 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc9dde68-669c-4347-be0f-1b9fc3dd1694 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.527649 Aug 09 15:07:28.587275 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2798/5599] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:28 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:29.620375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e1d907a0-faee-43d2-a3a7-25e872825b6e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:29.622392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e1d907a0-faee-43d2-a3a7-25e872825b6e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:29.634603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1d907a0-faee-43d2-a3a7-25e872825b6e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:29.635248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1d907a0-faee-43d2-a3a7-25e872825b6e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:29.635782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1d907a0-faee-43d2-a3a7-25e872825b6e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:29.636599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1d907a0-faee-43d2-a3a7-25e872825b6e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:29.637152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1d907a0-faee-43d2-a3a7-25e872825b6e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:29.637668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1d907a0-faee-43d2-a3a7-25e872825b6e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:30.083606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e1d907a0-faee-43d2-a3a7-25e872825b6e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:30.087885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:30.102384 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e1d907a0-faee-43d2-a3a7-25e872825b6e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.485185 Aug 09 15:07:30.103110 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2802/5600] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:29 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:31.130477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-23855e6a-6a0f-4b40-83e5-7473d57df5ab tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:31.131250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-23855e6a-6a0f-4b40-83e5-7473d57df5ab tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:31.150763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23855e6a-6a0f-4b40-83e5-7473d57df5ab tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:31.151280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23855e6a-6a0f-4b40-83e5-7473d57df5ab tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:31.151710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23855e6a-6a0f-4b40-83e5-7473d57df5ab tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:31.152589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23855e6a-6a0f-4b40-83e5-7473d57df5ab tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:31.153041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23855e6a-6a0f-4b40-83e5-7473d57df5ab tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:31.153464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-23855e6a-6a0f-4b40-83e5-7473d57df5ab tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:32.125218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-23855e6a-6a0f-4b40-83e5-7473d57df5ab tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:32.138173 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-23855e6a-6a0f-4b40-83e5-7473d57df5ab tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 1.012363 Aug 09 15:07:32.140506 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2799/5601] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:31 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:33.165354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0be156c-cb52-452c-87f4-16ea91687d1a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:33.167150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0be156c-cb52-452c-87f4-16ea91687d1a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:33.189308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0be156c-cb52-452c-87f4-16ea91687d1a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:33.190575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0be156c-cb52-452c-87f4-16ea91687d1a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:33.191052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0be156c-cb52-452c-87f4-16ea91687d1a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:33.193352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0be156c-cb52-452c-87f4-16ea91687d1a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:33.195416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0be156c-cb52-452c-87f4-16ea91687d1a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:33.197230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0be156c-cb52-452c-87f4-16ea91687d1a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:33.611123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c0be156c-cb52-452c-87f4-16ea91687d1a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:33.620245 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0be156c-cb52-452c-87f4-16ea91687d1a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.462283 Aug 09 15:07:33.624206 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2803/5602] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:33 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:34.646000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-088ad33f-b598-42f0-90e8-4bcb139a659a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:34.646682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-088ad33f-b598-42f0-90e8-4bcb139a659a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:34.660197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-088ad33f-b598-42f0-90e8-4bcb139a659a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:34.661120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-088ad33f-b598-42f0-90e8-4bcb139a659a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:34.666024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-088ad33f-b598-42f0-90e8-4bcb139a659a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:34.667167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-088ad33f-b598-42f0-90e8-4bcb139a659a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:34.667865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-088ad33f-b598-42f0-90e8-4bcb139a659a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:34.668487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-088ad33f-b598-42f0-90e8-4bcb139a659a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:35.380376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-088ad33f-b598-42f0-90e8-4bcb139a659a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:35.404265 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-088ad33f-b598-42f0-90e8-4bcb139a659a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.760752 Aug 09 15:07:35.406408 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2800/5603] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:34 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:36.426183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ba3605a-aca5-4955-bd01-5959314a5718 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:36.426786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0ba3605a-aca5-4955-bd01-5959314a5718 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:36.441113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ba3605a-aca5-4955-bd01-5959314a5718 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:36.441477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ba3605a-aca5-4955-bd01-5959314a5718 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:36.442148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ba3605a-aca5-4955-bd01-5959314a5718 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:36.449404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ba3605a-aca5-4955-bd01-5959314a5718 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:36.450122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ba3605a-aca5-4955-bd01-5959314a5718 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:36.450838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0ba3605a-aca5-4955-bd01-5959314a5718 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:36.845939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0ba3605a-aca5-4955-bd01-5959314a5718 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:36.859623 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0ba3605a-aca5-4955-bd01-5959314a5718 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.433147 Aug 09 15:07:36.873253 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2804/5604] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:36 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:37.882498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-793f9806-b454-403e-9e68-6018c3a81a3e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:37.889914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-793f9806-b454-403e-9e68-6018c3a81a3e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:37.920094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-793f9806-b454-403e-9e68-6018c3a81a3e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:37.920755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-793f9806-b454-403e-9e68-6018c3a81a3e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:37.927930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-793f9806-b454-403e-9e68-6018c3a81a3e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:37.928785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-793f9806-b454-403e-9e68-6018c3a81a3e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:37.929271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-793f9806-b454-403e-9e68-6018c3a81a3e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:37.929707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-793f9806-b454-403e-9e68-6018c3a81a3e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:38.713880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-793f9806-b454-403e-9e68-6018c3a81a3e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:38.722364 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-793f9806-b454-403e-9e68-6018c3a81a3e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.844663 Aug 09 15:07:38.735519 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2801/5605] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:37 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:39.749116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2dd9ccb-b649-4163-9868-2bc5979e86a1 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:39.750636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b2dd9ccb-b649-4163-9868-2bc5979e86a1 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:39.768657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=32 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:39.773076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2dd9ccb-b649-4163-9868-2bc5979e86a1 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:39.777422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2dd9ccb-b649-4163-9868-2bc5979e86a1 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:39.779273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2dd9ccb-b649-4163-9868-2bc5979e86a1 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:39.781537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2dd9ccb-b649-4163-9868-2bc5979e86a1 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:39.784947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2dd9ccb-b649-4163-9868-2bc5979e86a1 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:39.787697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2dd9ccb-b649-4163-9868-2bc5979e86a1 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:39.925013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ddf59707-fa32-437c-8d06-21808629e00b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:39.943578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ddf59707-fa32-437c-8d06-21808629e00b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:39.994450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddf59707-fa32-437c-8d06-21808629e00b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:39.995189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddf59707-fa32-437c-8d06-21808629e00b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:39.995942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddf59707-fa32-437c-8d06-21808629e00b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:39.997161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddf59707-fa32-437c-8d06-21808629e00b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:39.997914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddf59707-fa32-437c-8d06-21808629e00b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:39.998631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddf59707-fa32-437c-8d06-21808629e00b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:40.267158 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ddf59707-fa32-437c-8d06-21808629e00b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93/action" status: 200 len: 63239 microversion: 2.1 time: 0.352139 Aug 09 15:07:40.283571 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2802/5606] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:07:39 2022] POST /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93/action => generated 63239 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 15:07:40.304471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2dd9ccb-b649-4163-9868-2bc5979e86a1 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:40.329349 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2dd9ccb-b649-4163-9868-2bc5979e86a1 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.584584 Aug 09 15:07:40.330657 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2805/5607] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:39 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:41.401905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7cd3d3c4-af0f-4aaf-9816-a0db94920b16 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:41.403443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7cd3d3c4-af0f-4aaf-9816-a0db94920b16 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:41.449025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cd3d3c4-af0f-4aaf-9816-a0db94920b16 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:41.454788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cd3d3c4-af0f-4aaf-9816-a0db94920b16 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:41.456854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cd3d3c4-af0f-4aaf-9816-a0db94920b16 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:41.457870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cd3d3c4-af0f-4aaf-9816-a0db94920b16 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:41.458837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cd3d3c4-af0f-4aaf-9816-a0db94920b16 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:41.461888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cd3d3c4-af0f-4aaf-9816-a0db94920b16 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:42.043428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7cd3d3c4-af0f-4aaf-9816-a0db94920b16 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:42.056749 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7cd3d3c4-af0f-4aaf-9816-a0db94920b16 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.686764 Aug 09 15:07:42.061620 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2803/5608] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:41 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:42.398204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af543ead-3f18-4982-8582-8edcf3786127 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Action: 'create', calling method: .version_select at 0x7f41dc5eaa60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1138984101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG5rE6Ma0CmRtB6AIgsbAeAAxTAFKxOvjNiXZW6BxFNKyltPx9SagzHuh1zue+DkOcfbj0EGAQx7rv1FGeo759XJ713yxWLwmmCKMezjTS7qMI36Qz+3CJM6A14TG64MA=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:42.424065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-af543ead-3f18-4982-8582-8edcf3786127 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Getting quotas for project f459e237ba2d464c8feeb733393804a9. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:07:42.435542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-af543ead-3f18-4982-8582-8edcf3786127 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Getting quotas for user 7808d57a047f4fdfa852f71ff632619a and project f459e237ba2d464c8feeb733393804a9. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:07:42.477059 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af543ead-3f18-4982-8582-8edcf3786127 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.083091 Aug 09 15:07:42.478079 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2806/5609] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:07:42 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:07:43.083060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b01cfff4-4e07-48b3-b69c-5966c5bd31c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:43.084354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b01cfff4-4e07-48b3-b69c-5966c5bd31c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:43.096545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b01cfff4-4e07-48b3-b69c-5966c5bd31c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:43.100129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b01cfff4-4e07-48b3-b69c-5966c5bd31c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:43.104936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b01cfff4-4e07-48b3-b69c-5966c5bd31c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:43.106074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b01cfff4-4e07-48b3-b69c-5966c5bd31c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:43.106746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b01cfff4-4e07-48b3-b69c-5966c5bd31c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:43.107602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b01cfff4-4e07-48b3-b69c-5966c5bd31c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:43.605956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b01cfff4-4e07-48b3-b69c-5966c5bd31c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:43.621022 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b01cfff4-4e07-48b3-b69c-5966c5bd31c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1506 microversion: 2.1 time: 0.542626 Aug 09 15:07:43.629094 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2804/5610] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:43 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:44.650010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07c8fc40-8641-4241-bd5d-02d422da32be tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:44.652118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07c8fc40-8641-4241-bd5d-02d422da32be tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:44.672811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07c8fc40-8641-4241-bd5d-02d422da32be tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:44.681842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07c8fc40-8641-4241-bd5d-02d422da32be tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:44.682610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07c8fc40-8641-4241-bd5d-02d422da32be tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:44.683583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07c8fc40-8641-4241-bd5d-02d422da32be tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:44.684306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07c8fc40-8641-4241-bd5d-02d422da32be tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:44.684894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07c8fc40-8641-4241-bd5d-02d422da32be tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:45.422398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07c8fc40-8641-4241-bd5d-02d422da32be tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:45.460087 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07c8fc40-8641-4241-bd5d-02d422da32be tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1486 microversion: 2.1 time: 0.813679 Aug 09 15:07:45.464863 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2807/5611] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:44 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1486 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:45.666990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1984954619", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "edf6f8e3-4116-4d8b-886a-ab54c2db883c"}], "key_name": "tempest-TestNetworkBasicOps-1138984101", "security_groups": [{"name": "tempest-secgroup-smoke-555048001"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:45.842748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-386986025", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:45.921919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] validate_networks() for [('edf6f8e3-4116-4d8b-886a-ab54c2db883c', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:07:45.977020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] validate_networks() for [('f5d4e844-7248-4667-9003-c807b93f15e6', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:07:46.913578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:07:46.914127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:07:46.914465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:07:46.914876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:07:46.915334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:07:46.938777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:46.939688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:46.939986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:46.940737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:46.941193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:46.941615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:46.985482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Getting quotas for project f459e237ba2d464c8feeb733393804a9. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:07:46.993610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Getting quotas for user 7808d57a047f4fdfa852f71ff632619a and project f459e237ba2d464c8feeb733393804a9. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:07:47.012879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:07:47.015814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:07:47.117765 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5211b8c-ffc7-49d7-9122-95b8e2e5c49a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.449656 Aug 09 15:07:47.136218 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2805/5612] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:07:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:07:47.444352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-123a3725-8152-4e7c-a4f9-4fc710343d09 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:47.451948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-123a3725-8152-4e7c-a4f9-4fc710343d09 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:47.518383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-123a3725-8152-4e7c-a4f9-4fc710343d09 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:47.519301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-123a3725-8152-4e7c-a4f9-4fc710343d09 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:47.520065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-123a3725-8152-4e7c-a4f9-4fc710343d09 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:47.521295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-123a3725-8152-4e7c-a4f9-4fc710343d09 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:47.525620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-123a3725-8152-4e7c-a4f9-4fc710343d09 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:47.526430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-123a3725-8152-4e7c-a4f9-4fc710343d09 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:47.619845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:07:47.620625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:07:47.621024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:07:47.621544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:07:47.622061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:07:47.640403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:47.641277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:47.643695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:47.644750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:47.645790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:47.649326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:47.734554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Getting quotas for project 97e991340cea46afb3937ddb5e4402ef. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:07:47.751964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Getting quotas for user ae70e5a181dc4d079015a0c7c1a2154e and project 97e991340cea46afb3937ddb5e4402ef. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:07:47.780299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:07:47.786628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:07:47.953035 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a7731a6b-0ade-455c-a068-860e6dd7316b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.119809 Aug 09 15:07:47.954116 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2808/5613] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:07:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:07:47.959380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bce49aa0-a7dc-41d4-a976-ab03d83bf892 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:47.967916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bce49aa0-a7dc-41d4-a976-ab03d83bf892 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:48.234298 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-123a3725-8152-4e7c-a4f9-4fc710343d09 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1832 microversion: 2.1 time: 1.095891 Aug 09 15:07:48.255826 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2806/5614] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:47 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1832 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:48.273456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6ae7f4be-dd19-44f7-8023-46cca6312c89 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:48.279837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bce49aa0-a7dc-41d4-a976-ab03d83bf892 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:48.308897 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bce49aa0-a7dc-41d4-a976-ab03d83bf892 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1249 microversion: 2.1 time: 0.353422 Aug 09 15:07:48.311855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6ae7f4be-dd19-44f7-8023-46cca6312c89 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:48.312974 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2809/5615] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:47 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1249 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:48.743023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6ae7f4be-dd19-44f7-8023-46cca6312c89 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:48.758855 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6ae7f4be-dd19-44f7-8023-46cca6312c89 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1213 microversion: 2.1 time: 0.500406 Aug 09 15:07:48.759367 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2807/5616] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:48 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1213 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:49.322287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-874768297", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "133f5ae2-be6b-435e-a82c-de2a28aae294", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:49.353030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-68af7c5b-a96b-4354-9257-49265368b405 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:49.354533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-68af7c5b-a96b-4354-9257-49265368b405 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:49.367481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68af7c5b-a96b-4354-9257-49265368b405 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:49.367998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68af7c5b-a96b-4354-9257-49265368b405 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:49.368464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68af7c5b-a96b-4354-9257-49265368b405 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:49.383614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68af7c5b-a96b-4354-9257-49265368b405 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:49.384589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68af7c5b-a96b-4354-9257-49265368b405 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:49.386846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68af7c5b-a96b-4354-9257-49265368b405 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:49.533230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] validate_networks() for [('1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:07:49.928408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-68af7c5b-a96b-4354-9257-49265368b405 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:49.944802 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-68af7c5b-a96b-4354-9257-49265368b405 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1301 microversion: 2.1 time: 0.595542 Aug 09 15:07:49.947965 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2808/5617] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:49 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1301 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:49.975766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5862f9b5-cf63-4bc6-b943-39d7fef8517d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:49.979220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5862f9b5-cf63-4bc6-b943-39d7fef8517d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:50.014357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5862f9b5-cf63-4bc6-b943-39d7fef8517d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:50.016762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5862f9b5-cf63-4bc6-b943-39d7fef8517d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:50.018524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5862f9b5-cf63-4bc6-b943-39d7fef8517d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:50.024299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5862f9b5-cf63-4bc6-b943-39d7fef8517d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:50.024939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5862f9b5-cf63-4bc6-b943-39d7fef8517d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:50.025404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5862f9b5-cf63-4bc6-b943-39d7fef8517d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:50.392908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5862f9b5-cf63-4bc6-b943-39d7fef8517d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:50.425448 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5862f9b5-cf63-4bc6-b943-39d7fef8517d tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1209 microversion: 2.1 time: 0.472503 Aug 09 15:07:50.438451 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2809/5618] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:49 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1209 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:50.791317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:07:50.791820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:07:50.792334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:07:50.792621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:07:50.793036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:07:50.829793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:50.830169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:50.832144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:50.835548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:50.836312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:50.836758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:50.886219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:07:50.894790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for user f99b0693d22442ffa84b9c845d7cbc58 and project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:07:50.916323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:07:50.923177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='133f5ae2-be6b-435e-a82c-de2a28aae294',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:07:50.987582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cfbefa36-6284-4b18-a3e7-eeeab00399d4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:50.994815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cfbefa36-6284-4b18-a3e7-eeeab00399d4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:51.026760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfbefa36-6284-4b18-a3e7-eeeab00399d4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:51.027639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfbefa36-6284-4b18-a3e7-eeeab00399d4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:51.028235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfbefa36-6284-4b18-a3e7-eeeab00399d4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:51.032338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfbefa36-6284-4b18-a3e7-eeeab00399d4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:51.033097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfbefa36-6284-4b18-a3e7-eeeab00399d4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:51.033701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfbefa36-6284-4b18-a3e7-eeeab00399d4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:51.051701 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-47add9c1-ed05-43cb-abe1-a28d7ae75c28 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.733385 Aug 09 15:07:51.055241 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2810/5619] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:07:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:07:51.068291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79e637f0-d7b4-40d1-96b5-575484ad512e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:51.069430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79e637f0-d7b4-40d1-96b5-575484ad512e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:51.198014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cfbefa36-6284-4b18-a3e7-eeeab00399d4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:51.222507 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cfbefa36-6284-4b18-a3e7-eeeab00399d4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1307 microversion: 2.1 time: 0.238890 Aug 09 15:07:51.235293 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2810/5620] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:50 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1307 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:51.272826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-79e637f0-d7b4-40d1-96b5-575484ad512e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:51.288738 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79e637f0-d7b4-40d1-96b5-575484ad512e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1056 microversion: 2.1 time: 0.228331 Aug 09 15:07:51.289374 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2811/5621] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:51 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1056 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:07:51.480691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52e16983-e143-40f1-8e1d-accfce801b90 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:51.481379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52e16983-e143-40f1-8e1d-accfce801b90 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:51.505721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52e16983-e143-40f1-8e1d-accfce801b90 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:51.508057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52e16983-e143-40f1-8e1d-accfce801b90 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:51.513500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52e16983-e143-40f1-8e1d-accfce801b90 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:51.514699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52e16983-e143-40f1-8e1d-accfce801b90 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:51.517433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52e16983-e143-40f1-8e1d-accfce801b90 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:51.520169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52e16983-e143-40f1-8e1d-accfce801b90 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:51.809350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-52e16983-e143-40f1-8e1d-accfce801b90 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:51.854736 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52e16983-e143-40f1-8e1d-accfce801b90 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1283 microversion: 2.1 time: 0.379506 Aug 09 15:07:51.875127 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2811/5622] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:51 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1283 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:52.267986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-03a03e6e-1a0a-4e6c-8c19-4eef2721a2f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:52.269075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-03a03e6e-1a0a-4e6c-8c19-4eef2721a2f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:52.288819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03a03e6e-1a0a-4e6c-8c19-4eef2721a2f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:52.289683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03a03e6e-1a0a-4e6c-8c19-4eef2721a2f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:52.290705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03a03e6e-1a0a-4e6c-8c19-4eef2721a2f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:52.293192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03a03e6e-1a0a-4e6c-8c19-4eef2721a2f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:52.293807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03a03e6e-1a0a-4e6c-8c19-4eef2721a2f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:52.294958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-03a03e6e-1a0a-4e6c-8c19-4eef2721a2f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:52.347907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-435cbe57-ddfb-4b19-8fd4-c679f4dd4e95 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:52.350070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-435cbe57-ddfb-4b19-8fd4-c679f4dd4e95 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:52.380536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-435cbe57-ddfb-4b19-8fd4-c679f4dd4e95 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:52.381619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-435cbe57-ddfb-4b19-8fd4-c679f4dd4e95 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:52.382371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-435cbe57-ddfb-4b19-8fd4-c679f4dd4e95 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:52.383680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-435cbe57-ddfb-4b19-8fd4-c679f4dd4e95 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:52.384447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-435cbe57-ddfb-4b19-8fd4-c679f4dd4e95 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:52.385150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-435cbe57-ddfb-4b19-8fd4-c679f4dd4e95 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:52.404494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=82 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:52.437817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-03a03e6e-1a0a-4e6c-8c19-4eef2721a2f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:52.449514 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-03a03e6e-1a0a-4e6c-8c19-4eef2721a2f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1307 microversion: 2.1 time: 0.188386 Aug 09 15:07:52.451650 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2812/5623] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:52 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:07:52.605805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-435cbe57-ddfb-4b19-8fd4-c679f4dd4e95 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:52.652149 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-435cbe57-ddfb-4b19-8fd4-c679f4dd4e95 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1060 microversion: 2.1 time: 0.314269 Aug 09 15:07:52.652149 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2812/5624] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:52 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1060 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:52.904308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72e8029c-ff4c-448e-ac8b-b3b6a8fddf32 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:52.905017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-72e8029c-ff4c-448e-ac8b-b3b6a8fddf32 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:52.920616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e8029c-ff4c-448e-ac8b-b3b6a8fddf32 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:52.921398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e8029c-ff4c-448e-ac8b-b3b6a8fddf32 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:52.925066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e8029c-ff4c-448e-ac8b-b3b6a8fddf32 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:52.926983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e8029c-ff4c-448e-ac8b-b3b6a8fddf32 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:52.928281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e8029c-ff4c-448e-ac8b-b3b6a8fddf32 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:52.929356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72e8029c-ff4c-448e-ac8b-b3b6a8fddf32 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:53.068047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-72e8029c-ff4c-448e-ac8b-b3b6a8fddf32 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:53.086564 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72e8029c-ff4c-448e-ac8b-b3b6a8fddf32 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1271 microversion: 2.1 time: 0.190751 Aug 09 15:07:53.089366 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2813/5625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:52 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1271 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:53.493639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13ea8a38-a955-48f2-beb6-97f8dd19b6d6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:53.494531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-13ea8a38-a955-48f2-beb6-97f8dd19b6d6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:53.524981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13ea8a38-a955-48f2-beb6-97f8dd19b6d6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:53.525582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13ea8a38-a955-48f2-beb6-97f8dd19b6d6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:53.526077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13ea8a38-a955-48f2-beb6-97f8dd19b6d6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:53.526831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13ea8a38-a955-48f2-beb6-97f8dd19b6d6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:53.527486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13ea8a38-a955-48f2-beb6-97f8dd19b6d6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:53.527897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13ea8a38-a955-48f2-beb6-97f8dd19b6d6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:53.682595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1329cdb8-8a6d-418c-bfd5-b0d1faedf8a4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:53.686883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1329cdb8-8a6d-418c-bfd5-b0d1faedf8a4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:53.704042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1329cdb8-8a6d-418c-bfd5-b0d1faedf8a4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:53.705142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1329cdb8-8a6d-418c-bfd5-b0d1faedf8a4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:53.706482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1329cdb8-8a6d-418c-bfd5-b0d1faedf8a4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:53.708629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1329cdb8-8a6d-418c-bfd5-b0d1faedf8a4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:53.709717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1329cdb8-8a6d-418c-bfd5-b0d1faedf8a4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:53.710973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1329cdb8-8a6d-418c-bfd5-b0d1faedf8a4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:53.757734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-13ea8a38-a955-48f2-beb6-97f8dd19b6d6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:53.795404 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-13ea8a38-a955-48f2-beb6-97f8dd19b6d6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1307 microversion: 2.1 time: 0.306649 Aug 09 15:07:53.803304 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2813/5626] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:53 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1307 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:53.868586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1329cdb8-8a6d-418c-bfd5-b0d1faedf8a4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:53.886848 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1329cdb8-8a6d-418c-bfd5-b0d1faedf8a4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1126 microversion: 2.1 time: 0.215683 Aug 09 15:07:53.887944 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2814/5627] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:53 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1126 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:07:54.128077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a0d14c84-bbf4-49dc-a63f-6ec8b65b3dfa tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:54.131017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a0d14c84-bbf4-49dc-a63f-6ec8b65b3dfa tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:54.156423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0d14c84-bbf4-49dc-a63f-6ec8b65b3dfa tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:54.157522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0d14c84-bbf4-49dc-a63f-6ec8b65b3dfa tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:54.160074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0d14c84-bbf4-49dc-a63f-6ec8b65b3dfa tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:54.164544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0d14c84-bbf4-49dc-a63f-6ec8b65b3dfa tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:54.165541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0d14c84-bbf4-49dc-a63f-6ec8b65b3dfa tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:54.175776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a0d14c84-bbf4-49dc-a63f-6ec8b65b3dfa tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:54.302593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1fb01a72-7d70-4f15-ac32-1baf056c0804 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:54.303297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1fb01a72-7d70-4f15-ac32-1baf056c0804 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:54.317130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fb01a72-7d70-4f15-ac32-1baf056c0804 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:54.317819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fb01a72-7d70-4f15-ac32-1baf056c0804 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:54.318404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fb01a72-7d70-4f15-ac32-1baf056c0804 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:54.319940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fb01a72-7d70-4f15-ac32-1baf056c0804 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:54.323658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fb01a72-7d70-4f15-ac32-1baf056c0804 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:54.324214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fb01a72-7d70-4f15-ac32-1baf056c0804 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:54.381655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1fb01a72-7d70-4f15-ac32-1baf056c0804 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:07:54.571964 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1fb01a72-7d70-4f15-ac32-1baf056c0804 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "DELETE /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 204 len: 0 microversion: 2.1 time: 0.273236 Aug 09 15:07:54.576888 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2815/5628] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:07:54 2022] DELETE /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:07:54.582856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9ca0a69b-ed58-4ec6-a94a-f96ab76a4f8a req-e5303d1f-8578-43f6-b7d1-8e35562b1023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caaadba4-bf8c-4e32-b86f-a6e0e68bbd93", "tag": "90f33f03-4270-4292-a57d-108d8d490b0a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:54.594790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9ca0a69b-ed58-4ec6-a94a-f96ab76a4f8a req-e5303d1f-8578-43f6-b7d1-8e35562b1023 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:54.595486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9ca0a69b-ed58-4ec6-a94a-f96ab76a4f8a req-e5303d1f-8578-43f6-b7d1-8e35562b1023 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:54.596069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9ca0a69b-ed58-4ec6-a94a-f96ab76a4f8a req-e5303d1f-8578-43f6-b7d1-8e35562b1023 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:54.611819 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9ca0a69b-ed58-4ec6-a94a-f96ab76a4f8a req-e5303d1f-8578-43f6-b7d1-8e35562b1023 service nova] Creating event network-changed:90f33f03-4270-4292-a57d-108d8d490b0a for instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 on n-h2-844626-8 Aug 09 15:07:54.618106 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9ca0a69b-ed58-4ec6-a94a-f96ab76a4f8a req-e5303d1f-8578-43f6-b7d1-8e35562b1023 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039470 Aug 09 15:07:54.619608 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2816/5629] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:07:54.625121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-29f96270-594b-4516-ba0d-f4c07d4bc977 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:54.625841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-29f96270-594b-4516-ba0d-f4c07d4bc977 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:54.633352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29f96270-594b-4516-ba0d-f4c07d4bc977 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:54.634208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29f96270-594b-4516-ba0d-f4c07d4bc977 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:54.635141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29f96270-594b-4516-ba0d-f4c07d4bc977 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:54.636032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29f96270-594b-4516-ba0d-f4c07d4bc977 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:54.636645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29f96270-594b-4516-ba0d-f4c07d4bc977 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:54.637224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-29f96270-594b-4516-ba0d-f4c07d4bc977 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:55.373578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a0d14c84-bbf4-49dc-a63f-6ec8b65b3dfa tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:55.387925 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a0d14c84-bbf4-49dc-a63f-6ec8b65b3dfa tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1271 microversion: 2.1 time: 1.266906 Aug 09 15:07:55.402552 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2814/5630] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:54 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1271 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:55.409493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a605b9f7-a58d-4689-acf0-7411cac6621b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:55.411219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a605b9f7-a58d-4689-acf0-7411cac6621b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:55.418295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a605b9f7-a58d-4689-acf0-7411cac6621b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:55.418977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a605b9f7-a58d-4689-acf0-7411cac6621b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:55.419886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a605b9f7-a58d-4689-acf0-7411cac6621b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:55.420968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a605b9f7-a58d-4689-acf0-7411cac6621b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:55.422141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a605b9f7-a58d-4689-acf0-7411cac6621b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:55.422894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a605b9f7-a58d-4689-acf0-7411cac6621b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:55.733658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-29f96270-594b-4516-ba0d-f4c07d4bc977 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:55.764968 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-29f96270-594b-4516-ba0d-f4c07d4bc977 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1687 microversion: 2.1 time: 1.143804 Aug 09 15:07:55.767187 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2817/5631] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:54 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1687 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:55.834616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-213c59b8-5e8a-4b39-bee4-e93d69bf6a91 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:55.838741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-213c59b8-5e8a-4b39-bee4-e93d69bf6a91 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:55.873341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-213c59b8-5e8a-4b39-bee4-e93d69bf6a91 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:55.880465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-213c59b8-5e8a-4b39-bee4-e93d69bf6a91 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:55.881828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-213c59b8-5e8a-4b39-bee4-e93d69bf6a91 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:55.888143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-213c59b8-5e8a-4b39-bee4-e93d69bf6a91 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:55.889839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-213c59b8-5e8a-4b39-bee4-e93d69bf6a91 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:55.898860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-213c59b8-5e8a-4b39-bee4-e93d69bf6a91 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:56.131728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a605b9f7-a58d-4689-acf0-7411cac6621b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:56.157550 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a605b9f7-a58d-4689-acf0-7411cac6621b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1374 microversion: 2.1 time: 0.753313 Aug 09 15:07:56.158938 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2815/5632] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:55 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1374 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:56.202803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-213c59b8-5e8a-4b39-bee4-e93d69bf6a91 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:56.228892 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-213c59b8-5e8a-4b39-bee4-e93d69bf6a91 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1126 microversion: 2.1 time: 0.439150 Aug 09 15:07:56.232474 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2818/5633] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:55 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1126 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:56.409812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7850888-d466-4a92-a09f-8e5dc044e853 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:56.410424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f7850888-d466-4a92-a09f-8e5dc044e853 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:56.425733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7850888-d466-4a92-a09f-8e5dc044e853 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:56.426483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7850888-d466-4a92-a09f-8e5dc044e853 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:56.426810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7850888-d466-4a92-a09f-8e5dc044e853 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:56.427630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7850888-d466-4a92-a09f-8e5dc044e853 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:56.428095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7850888-d466-4a92-a09f-8e5dc044e853 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:56.428524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7850888-d466-4a92-a09f-8e5dc044e853 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:56.792563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9f1acab-4b08-479c-86d1-fdc002091cd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:56.795979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9f1acab-4b08-479c-86d1-fdc002091cd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:56.839735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9f1acab-4b08-479c-86d1-fdc002091cd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:56.842721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9f1acab-4b08-479c-86d1-fdc002091cd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:56.843779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9f1acab-4b08-479c-86d1-fdc002091cd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:56.851521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9f1acab-4b08-479c-86d1-fdc002091cd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:56.854137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9f1acab-4b08-479c-86d1-fdc002091cd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:56.855277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9f1acab-4b08-479c-86d1-fdc002091cd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:56.969654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:57.492734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f7850888-d466-4a92-a09f-8e5dc044e853 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:57.506961 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f7850888-d466-4a92-a09f-8e5dc044e853 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1313 microversion: 2.1 time: 1.099554 Aug 09 15:07:57.509429 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2816/5634] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:56 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1313 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:07:57.514513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5164852a-7da4-4ed6-ab8d-8bc0d5e17066 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:57.527442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5164852a-7da4-4ed6-ab8d-8bc0d5e17066 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:57.543505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5164852a-7da4-4ed6-ab8d-8bc0d5e17066 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:57.544290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5164852a-7da4-4ed6-ab8d-8bc0d5e17066 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:57.545668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5164852a-7da4-4ed6-ab8d-8bc0d5e17066 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:57.549325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5164852a-7da4-4ed6-ab8d-8bc0d5e17066 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:57.550221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5164852a-7da4-4ed6-ab8d-8bc0d5e17066 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:57.550811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5164852a-7da4-4ed6-ab8d-8bc0d5e17066 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:58.233518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9f1acab-4b08-479c-86d1-fdc002091cd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:58.269015 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9f1acab-4b08-479c-86d1-fdc002091cd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1687 microversion: 2.1 time: 1.483118 Aug 09 15:07:58.270333 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2819/5635] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:56 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1687 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:58.296905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-781ef5a7-e0ad-4870-a5c8-a6c2220dfd87 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:58.298024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-781ef5a7-e0ad-4870-a5c8-a6c2220dfd87 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:58.323705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-781ef5a7-e0ad-4870-a5c8-a6c2220dfd87 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:58.323705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-781ef5a7-e0ad-4870-a5c8-a6c2220dfd87 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:58.323705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-781ef5a7-e0ad-4870-a5c8-a6c2220dfd87 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:58.323705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-781ef5a7-e0ad-4870-a5c8-a6c2220dfd87 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:58.323705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-781ef5a7-e0ad-4870-a5c8-a6c2220dfd87 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:58.323705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-781ef5a7-e0ad-4870-a5c8-a6c2220dfd87 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:58.444339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5164852a-7da4-4ed6-ab8d-8bc0d5e17066 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:58.455519 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5164852a-7da4-4ed6-ab8d-8bc0d5e17066 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1374 microversion: 2.1 time: 0.944350 Aug 09 15:07:58.459456 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2817/5636] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:57 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1374 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:58.529380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-587bcbfe-8236-49a2-9aee-e14e4bf3b211 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:58.530875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-587bcbfe-8236-49a2-9aee-e14e4bf3b211 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:58.534216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:58.551431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-587bcbfe-8236-49a2-9aee-e14e4bf3b211 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:58.552327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-587bcbfe-8236-49a2-9aee-e14e4bf3b211 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:58.552748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-587bcbfe-8236-49a2-9aee-e14e4bf3b211 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:58.553605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-587bcbfe-8236-49a2-9aee-e14e4bf3b211 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:58.554184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-587bcbfe-8236-49a2-9aee-e14e4bf3b211 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:58.557199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-587bcbfe-8236-49a2-9aee-e14e4bf3b211 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:58.754205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:07:58.932419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-781ef5a7-e0ad-4870-a5c8-a6c2220dfd87 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:58.942699 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-781ef5a7-e0ad-4870-a5c8-a6c2220dfd87 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.670000 Aug 09 15:07:58.948587 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2820/5637] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:58 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:59.035568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-587bcbfe-8236-49a2-9aee-e14e4bf3b211 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:59.046675 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-587bcbfe-8236-49a2-9aee-e14e4bf3b211 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1313 microversion: 2.1 time: 0.521420 Aug 09 15:07:59.047690 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2818/5638] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:58 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:07:59.102746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-1d2c5c97-76aa-4ad1-b395-dab77e041bcf req-7afa9c1f-0f4d-4041-8689-585933d64bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caaadba4-bf8c-4e32-b86f-a6e0e68bbd93", "name": "network-vif-deleted", "tag": "90f33f03-4270-4292-a57d-108d8d490b0a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:07:59.124709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1d2c5c97-76aa-4ad1-b395-dab77e041bcf req-7afa9c1f-0f4d-4041-8689-585933d64bf8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:59.125489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1d2c5c97-76aa-4ad1-b395-dab77e041bcf req-7afa9c1f-0f4d-4041-8689-585933d64bf8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:59.126179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1d2c5c97-76aa-4ad1-b395-dab77e041bcf req-7afa9c1f-0f4d-4041-8689-585933d64bf8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:59.208337 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1d2c5c97-76aa-4ad1-b395-dab77e041bcf req-7afa9c1f-0f4d-4041-8689-585933d64bf8 service nova] Creating event network-vif-deleted:90f33f03-4270-4292-a57d-108d8d490b0a for instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 on n-h2-844626-8 Aug 09 15:07:59.237425 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-1d2c5c97-76aa-4ad1-b395-dab77e041bcf req-7afa9c1f-0f4d-4041-8689-585933d64bf8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140342 Aug 09 15:07:59.248861 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2821/5639] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:07:59.308933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-92e42cdd-51b8-497f-ae6e-8531671be144 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:59.309651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-92e42cdd-51b8-497f-ae6e-8531671be144 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:59.329261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92e42cdd-51b8-497f-ae6e-8531671be144 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:59.330117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92e42cdd-51b8-497f-ae6e-8531671be144 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:59.330749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92e42cdd-51b8-497f-ae6e-8531671be144 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:59.331703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92e42cdd-51b8-497f-ae6e-8531671be144 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:59.332385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92e42cdd-51b8-497f-ae6e-8531671be144 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:59.333010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92e42cdd-51b8-497f-ae6e-8531671be144 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:59.481858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e5a8766-9187-4d52-904f-abcca45625f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:59.483749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8e5a8766-9187-4d52-904f-abcca45625f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:59.502384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e5a8766-9187-4d52-904f-abcca45625f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:59.503629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e5a8766-9187-4d52-904f-abcca45625f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:59.504835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e5a8766-9187-4d52-904f-abcca45625f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:59.505787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e5a8766-9187-4d52-904f-abcca45625f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:59.512353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e5a8766-9187-4d52-904f-abcca45625f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:59.513137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e5a8766-9187-4d52-904f-abcca45625f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:59.817143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-92e42cdd-51b8-497f-ae6e-8531671be144 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:07:59.837894 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-92e42cdd-51b8-497f-ae6e-8531671be144 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 200 len: 1351 microversion: 2.1 time: 0.533589 Aug 09 15:07:59.839313 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2819/5640] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:59 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 1351 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:07:59.970425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73026d3c-c746-4307-8d34-cf0f100e33e4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:07:59.972014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-73026d3c-c746-4307-8d34-cf0f100e33e4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:07:59.986035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73026d3c-c746-4307-8d34-cf0f100e33e4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:59.988861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73026d3c-c746-4307-8d34-cf0f100e33e4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:59.990517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73026d3c-c746-4307-8d34-cf0f100e33e4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:07:59.994672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73026d3c-c746-4307-8d34-cf0f100e33e4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:07:59.995191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73026d3c-c746-4307-8d34-cf0f100e33e4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:07:59.998675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73026d3c-c746-4307-8d34-cf0f100e33e4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:00.073433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8e5a8766-9187-4d52-904f-abcca45625f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:00.087183 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8e5a8766-9187-4d52-904f-abcca45625f2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1374 microversion: 2.1 time: 0.610376 Aug 09 15:08:00.088048 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2822/5641] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:59 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1374 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:00.093429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42bd1f32-5d5e-4744-8555-f5663ba2c71e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:00.103568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-42bd1f32-5d5e-4744-8555-f5663ba2c71e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:00.113872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42bd1f32-5d5e-4744-8555-f5663ba2c71e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:00.115568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42bd1f32-5d5e-4744-8555-f5663ba2c71e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:00.117193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42bd1f32-5d5e-4744-8555-f5663ba2c71e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:00.122501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42bd1f32-5d5e-4744-8555-f5663ba2c71e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:00.125168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42bd1f32-5d5e-4744-8555-f5663ba2c71e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:00.126015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42bd1f32-5d5e-4744-8555-f5663ba2c71e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:00.154831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:00.571206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-73026d3c-c746-4307-8d34-cf0f100e33e4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:00.584232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-42bd1f32-5d5e-4744-8555-f5663ba2c71e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:00.610105 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-73026d3c-c746-4307-8d34-cf0f100e33e4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.646208 Aug 09 15:08:00.612597 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-42bd1f32-5d5e-4744-8555-f5663ba2c71e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1313 microversion: 2.1 time: 0.522748 Aug 09 15:08:00.614069 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2823/5642] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:00 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:00.614879 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2820/5643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:07:59 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:00.747899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2acd3640-cb2e-47f7-a4b7-02dfe66d6af4 req-bda74e82-b278-4773-9f18-750827bae417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011", "tag": "2cea8391-0e11-488a-acf1-fd55b99ee13a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:00.784410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2acd3640-cb2e-47f7-a4b7-02dfe66d6af4 req-bda74e82-b278-4773-9f18-750827bae417 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:00.785441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2acd3640-cb2e-47f7-a4b7-02dfe66d6af4 req-bda74e82-b278-4773-9f18-750827bae417 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:00.786098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2acd3640-cb2e-47f7-a4b7-02dfe66d6af4 req-bda74e82-b278-4773-9f18-750827bae417 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:00.812043 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2acd3640-cb2e-47f7-a4b7-02dfe66d6af4 req-bda74e82-b278-4773-9f18-750827bae417 service nova] Creating event network-changed:2cea8391-0e11-488a-acf1-fd55b99ee13a for instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 on n-h2-844626-8 Aug 09 15:08:00.817937 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2acd3640-cb2e-47f7-a4b7-02dfe66d6af4 req-bda74e82-b278-4773-9f18-750827bae417 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112664 Aug 09 15:08:00.818971 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2824/5644] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:08:00.864070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6eaa24c1-4bc9-4b77-b1cd-3b19841604f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:00.865316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6eaa24c1-4bc9-4b77-b1cd-3b19841604f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: caaadba4-bf8c-4e32-b86f-a6e0e68bbd93] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:00.874982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6eaa24c1-4bc9-4b77-b1cd-3b19841604f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:00.875921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6eaa24c1-4bc9-4b77-b1cd-3b19841604f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:00.876617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6eaa24c1-4bc9-4b77-b1cd-3b19841604f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:00.877761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6eaa24c1-4bc9-4b77-b1cd-3b19841604f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:00.878840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6eaa24c1-4bc9-4b77-b1cd-3b19841604f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:00.879525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6eaa24c1-4bc9-4b77-b1cd-3b19841604f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:00.897950 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6eaa24c1-4bc9-4b77-b1cd-3b19841604f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] HTTP exception thrown: Instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 could not be found. Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6eaa24c1-4bc9-4b77-b1cd-3b19841604f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Request method failure captured: Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 HTTP/1.1 Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8ncQl_OhnXzPfN37y_gQhZaTw8hyB7aUw1NVxqhnUDpImauOwqDZAMMA42Q0FA5K7BfkHzf96pPtBJHzwEloK0wLejr0pDUs8uplO9kHt2X-z743m5Z_VT211uUGD7Pn_KaW3ovVx3B-Ge_U1JFiW4MIUR6sycWgiLcRVamLUpSKu6I Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 889fa240e1f5494d9c11803acd77f74b Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-543221961 Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_889fa240e1f5494d9c11803acd77f74b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/889fa240e1f5494d9c11803acd77f74b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/889fa240e1f5494d9c11803acd77f74b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/889fa240e1f5494d9c11803acd77f74b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-543221961 Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 889fa240e1f5494d9c11803acd77f74b Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-543221961 Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestNetworkAdvancedServerOps-543221961-project Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 9ff3b746851a4414ba60cb76ac07056b Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-543221961-project Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 could not be found. Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'caaadba4-bf8c-4e32-b86f-a6e0e68bbd93'} Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 could not be found. Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 could not be found. Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:00.900190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:08:00.904856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:00.904856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:00.904856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:08:00.904856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:08:00.904856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:08:00.904856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:08:00.904856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 could not be found. Aug 09 15:08:00.904856 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:00.916087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6eaa24c1-4bc9-4b77-b1cd-3b19841604f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Returning 404 to user: Instance caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:08:00.920470 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6eaa24c1-4bc9-4b77-b1cd-3b19841604f7 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93" status: 404 len: 111 microversion: 2.1 time: 0.060122 Aug 09 15:08:00.928475 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2821/5645] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:00 2022] GET /compute/v2.1/servers/caaadba4-bf8c-4e32-b86f-a6e0e68bbd93 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:08:01.118901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:01.146809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9db7586a-0e58-4a20-bf35-84f1361d72d7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:01.153939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9db7586a-0e58-4a20-bf35-84f1361d72d7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:01.200119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9db7586a-0e58-4a20-bf35-84f1361d72d7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:01.201349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9db7586a-0e58-4a20-bf35-84f1361d72d7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:01.202069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9db7586a-0e58-4a20-bf35-84f1361d72d7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:01.202973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9db7586a-0e58-4a20-bf35-84f1361d72d7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:01.203640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9db7586a-0e58-4a20-bf35-84f1361d72d7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:01.204421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9db7586a-0e58-4a20-bf35-84f1361d72d7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:01.277769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=20 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:01.341574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-6d8a69ba-f4a8-4005-93d3-d9bd235e7b83 req-5078816a-71b5-4a14-a18c-0924cd45c7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcbfdaea-fc59-4a69-8de6-4c48a477a150", "tag": "b20da0ff-f9d3-45c8-a5c6-394da9a531ad"}, {"name": "network-changed", "server_uuid": "7ff9f9a2-2871-42e5-988c-bd15cc759edc", "tag": "4c929778-d5b6-4bc4-bc31-3e32d80c0b5b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:01.393714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6d8a69ba-f4a8-4005-93d3-d9bd235e7b83 req-5078816a-71b5-4a14-a18c-0924cd45c7b4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:01.394576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6d8a69ba-f4a8-4005-93d3-d9bd235e7b83 req-5078816a-71b5-4a14-a18c-0924cd45c7b4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:01.395483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6d8a69ba-f4a8-4005-93d3-d9bd235e7b83 req-5078816a-71b5-4a14-a18c-0924cd45c7b4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:01.465601 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-6d8a69ba-f4a8-4005-93d3-d9bd235e7b83 req-5078816a-71b5-4a14-a18c-0924cd45c7b4 service nova] Creating event network-changed:b20da0ff-f9d3-45c8-a5c6-394da9a531ad for instance bcbfdaea-fc59-4a69-8de6-4c48a477a150 on n-h1-844626-8 Aug 09 15:08:01.468712 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-6d8a69ba-f4a8-4005-93d3-d9bd235e7b83 req-5078816a-71b5-4a14-a18c-0924cd45c7b4 service nova] Creating event network-changed:4c929778-d5b6-4bc4-bc31-3e32d80c0b5b for instance 7ff9f9a2-2871-42e5-988c-bd15cc759edc on n-h1-844626-8 Aug 09 15:08:01.496562 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-6d8a69ba-f4a8-4005-93d3-d9bd235e7b83 req-5078816a-71b5-4a14-a18c-0924cd45c7b4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.161932 Aug 09 15:08:01.499678 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2822/5646] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:08:01.642412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e12b31a0-6e2a-4e05-8a12-0392e1028a98 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:01.644222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e12b31a0-6e2a-4e05-8a12-0392e1028a98 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:01.674118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e12b31a0-6e2a-4e05-8a12-0392e1028a98 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:01.675488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e12b31a0-6e2a-4e05-8a12-0392e1028a98 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:01.676590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e12b31a0-6e2a-4e05-8a12-0392e1028a98 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:01.679827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e12b31a0-6e2a-4e05-8a12-0392e1028a98 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:01.686168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e12b31a0-6e2a-4e05-8a12-0392e1028a98 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:01.686168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e12b31a0-6e2a-4e05-8a12-0392e1028a98 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:02.695780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e12b31a0-6e2a-4e05-8a12-0392e1028a98 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:02.736742 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e12b31a0-6e2a-4e05-8a12-0392e1028a98 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1313 microversion: 2.1 time: 1.103953 Aug 09 15:08:02.737854 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2823/5647] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:01 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1313 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:02.768357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9db7586a-0e58-4a20-bf35-84f1361d72d7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:02.782417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-48ee3904-b588-4bd7-93ad-832b20966dac tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:02.784026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-48ee3904-b588-4bd7-93ad-832b20966dac tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:02.794533 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9db7586a-0e58-4a20-bf35-84f1361d72d7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1374 microversion: 2.1 time: 1.683636 Aug 09 15:08:02.830134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48ee3904-b588-4bd7-93ad-832b20966dac tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:02.831506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48ee3904-b588-4bd7-93ad-832b20966dac tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:02.832421 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2825/5648] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:01 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1374 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:02.837450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48ee3904-b588-4bd7-93ad-832b20966dac tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:02.847921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48ee3904-b588-4bd7-93ad-832b20966dac tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:02.849321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48ee3904-b588-4bd7-93ad-832b20966dac tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:02.850460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48ee3904-b588-4bd7-93ad-832b20966dac tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:03.780110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2cfae184-4ae0-424f-a9f7-05531800f6f2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:03.780797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2cfae184-4ae0-424f-a9f7-05531800f6f2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:03.800870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cfae184-4ae0-424f-a9f7-05531800f6f2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:03.801368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cfae184-4ae0-424f-a9f7-05531800f6f2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:03.801782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cfae184-4ae0-424f-a9f7-05531800f6f2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:03.816983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cfae184-4ae0-424f-a9f7-05531800f6f2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:03.816983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cfae184-4ae0-424f-a9f7-05531800f6f2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:03.816983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2cfae184-4ae0-424f-a9f7-05531800f6f2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:03.858382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-48ee3904-b588-4bd7-93ad-832b20966dac tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:03.888314 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-48ee3904-b588-4bd7-93ad-832b20966dac tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 1.140527 Aug 09 15:08:03.910948 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2824/5649] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:02 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:03.930564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84f1a33b-979e-403f-876c-2e262c189174 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:03.936577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84f1a33b-979e-403f-876c-2e262c189174 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:03.956576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f1a33b-979e-403f-876c-2e262c189174 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:03.957562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f1a33b-979e-403f-876c-2e262c189174 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:03.958232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f1a33b-979e-403f-876c-2e262c189174 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:03.960757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f1a33b-979e-403f-876c-2e262c189174 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:03.963177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f1a33b-979e-403f-876c-2e262c189174 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:03.966379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84f1a33b-979e-403f-876c-2e262c189174 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:04.748293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2cfae184-4ae0-424f-a9f7-05531800f6f2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:04.765588 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2cfae184-4ae0-424f-a9f7-05531800f6f2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1313 microversion: 2.1 time: 0.990082 Aug 09 15:08:04.779541 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2826/5650] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:03 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1313 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:04.852599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-84f1a33b-979e-403f-876c-2e262c189174 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:04.861860 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84f1a33b-979e-403f-876c-2e262c189174 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1374 microversion: 2.1 time: 0.949491 Aug 09 15:08:04.862887 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2825/5651] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:03 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1374 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:04.930450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-068cc704-fcb3-432a-8dc9-2edf3cb42311 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:04.931254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-068cc704-fcb3-432a-8dc9-2edf3cb42311 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:04.953533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-068cc704-fcb3-432a-8dc9-2edf3cb42311 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:04.960004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-068cc704-fcb3-432a-8dc9-2edf3cb42311 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:04.961398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-068cc704-fcb3-432a-8dc9-2edf3cb42311 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:04.962342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-068cc704-fcb3-432a-8dc9-2edf3cb42311 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:04.963003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-068cc704-fcb3-432a-8dc9-2edf3cb42311 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:04.966805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-068cc704-fcb3-432a-8dc9-2edf3cb42311 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:05.393308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-068cc704-fcb3-432a-8dc9-2edf3cb42311 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:05.409920 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-068cc704-fcb3-432a-8dc9-2edf3cb42311 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.483656 Aug 09 15:08:05.411013 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2827/5652] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:04 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:05.801487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-20415882-b6f1-460b-953a-2e7dc8ccd711 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:05.808210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-20415882-b6f1-460b-953a-2e7dc8ccd711 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:05.824951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20415882-b6f1-460b-953a-2e7dc8ccd711 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:05.826243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20415882-b6f1-460b-953a-2e7dc8ccd711 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:05.826665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20415882-b6f1-460b-953a-2e7dc8ccd711 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:05.828133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20415882-b6f1-460b-953a-2e7dc8ccd711 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:05.829226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20415882-b6f1-460b-953a-2e7dc8ccd711 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:05.831900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-20415882-b6f1-460b-953a-2e7dc8ccd711 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:05.894392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0de5e87b-dc46-4f7f-8ad1-e37c2e13b46d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:05.902825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0de5e87b-dc46-4f7f-8ad1-e37c2e13b46d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:05.922988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0de5e87b-dc46-4f7f-8ad1-e37c2e13b46d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:05.926483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0de5e87b-dc46-4f7f-8ad1-e37c2e13b46d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:05.931426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0de5e87b-dc46-4f7f-8ad1-e37c2e13b46d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:05.933231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0de5e87b-dc46-4f7f-8ad1-e37c2e13b46d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:05.934192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0de5e87b-dc46-4f7f-8ad1-e37c2e13b46d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:05.943299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0de5e87b-dc46-4f7f-8ad1-e37c2e13b46d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:07.065974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0de5e87b-dc46-4f7f-8ad1-e37c2e13b46d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:07.074200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-20415882-b6f1-460b-953a-2e7dc8ccd711 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:07.101454 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-20415882-b6f1-460b-953a-2e7dc8ccd711 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1313 microversion: 2.1 time: 1.315032 Aug 09 15:08:07.103907 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2826/5653] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:05 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1313 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:07.107561 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0de5e87b-dc46-4f7f-8ad1-e37c2e13b46d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1374 microversion: 2.1 time: 1.220088 Aug 09 15:08:07.147857 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2828/5654] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:05 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1374 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:07.171212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-358e6f5d-6bf6-4aa5-be29-e567e5d7bd33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:07.178674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-358e6f5d-6bf6-4aa5-be29-e567e5d7bd33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:07.202936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-358e6f5d-6bf6-4aa5-be29-e567e5d7bd33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:07.204253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-358e6f5d-6bf6-4aa5-be29-e567e5d7bd33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:07.205444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-358e6f5d-6bf6-4aa5-be29-e567e5d7bd33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:07.207208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-358e6f5d-6bf6-4aa5-be29-e567e5d7bd33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:07.209193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-358e6f5d-6bf6-4aa5-be29-e567e5d7bd33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:07.210257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-358e6f5d-6bf6-4aa5-be29-e567e5d7bd33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:07.543997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5ba9ef9c-617a-4553-8176-77bab98faaa6 req-9d377795-e1b7-4911-887e-5eea1d954d55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcbfdaea-fc59-4a69-8de6-4c48a477a150", "name": "network-vif-plugged", "status": "completed", "tag": "b20da0ff-f9d3-45c8-a5c6-394da9a531ad"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:07.565070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5ba9ef9c-617a-4553-8176-77bab98faaa6 req-9d377795-e1b7-4911-887e-5eea1d954d55 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:07.566442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5ba9ef9c-617a-4553-8176-77bab98faaa6 req-9d377795-e1b7-4911-887e-5eea1d954d55 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:07.567426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5ba9ef9c-617a-4553-8176-77bab98faaa6 req-9d377795-e1b7-4911-887e-5eea1d954d55 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:07.601826 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5ba9ef9c-617a-4553-8176-77bab98faaa6 req-9d377795-e1b7-4911-887e-5eea1d954d55 service nova] Creating event network-vif-plugged:b20da0ff-f9d3-45c8-a5c6-394da9a531ad for instance bcbfdaea-fc59-4a69-8de6-4c48a477a150 on n-h1-844626-8 Aug 09 15:08:07.618851 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5ba9ef9c-617a-4553-8176-77bab98faaa6 req-9d377795-e1b7-4911-887e-5eea1d954d55 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.510854 Aug 09 15:08:07.621503 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2827/5655] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:08:07.772419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-358e6f5d-6bf6-4aa5-be29-e567e5d7bd33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:07.799056 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-358e6f5d-6bf6-4aa5-be29-e567e5d7bd33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.648753 Aug 09 15:08:07.799925 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2829/5656] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:07 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:08.163641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-800a08b2-77c6-4b69-9ae9-99db75ccf782 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:08.164983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-800a08b2-77c6-4b69-9ae9-99db75ccf782 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:08.168914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a6a37e1-023b-4a19-a9d8-9e19a6faa615 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:08.177586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a6a37e1-023b-4a19-a9d8-9e19a6faa615 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:08.201891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-800a08b2-77c6-4b69-9ae9-99db75ccf782 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:08.213985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-800a08b2-77c6-4b69-9ae9-99db75ccf782 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:08.214251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a6a37e1-023b-4a19-a9d8-9e19a6faa615 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:08.214962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a6a37e1-023b-4a19-a9d8-9e19a6faa615 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:08.215714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a6a37e1-023b-4a19-a9d8-9e19a6faa615 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:08.216248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-800a08b2-77c6-4b69-9ae9-99db75ccf782 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:08.217335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a6a37e1-023b-4a19-a9d8-9e19a6faa615 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:08.219423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-800a08b2-77c6-4b69-9ae9-99db75ccf782 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:08.220583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-800a08b2-77c6-4b69-9ae9-99db75ccf782 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:08.221699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-800a08b2-77c6-4b69-9ae9-99db75ccf782 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:08.222319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a6a37e1-023b-4a19-a9d8-9e19a6faa615 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:08.224241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a6a37e1-023b-4a19-a9d8-9e19a6faa615 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:09.134936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-800a08b2-77c6-4b69-9ae9-99db75ccf782 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:09.153388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1a6a37e1-023b-4a19-a9d8-9e19a6faa615 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:09.168396 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-800a08b2-77c6-4b69-9ae9-99db75ccf782 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1374 microversion: 2.1 time: 1.018237 Aug 09 15:08:09.176103 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2830/5657] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:08 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1374 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:09.217276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0d605c7c-2f5c-4ac3-baf8-d24afb8ccb33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:09.218592 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a6a37e1-023b-4a19-a9d8-9e19a6faa615 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1313 microversion: 2.1 time: 1.071760 Aug 09 15:08:09.219357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0d605c7c-2f5c-4ac3-baf8-d24afb8ccb33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:09.225967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:09.227802 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2828/5658] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:08 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1313 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:09.255845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d605c7c-2f5c-4ac3-baf8-d24afb8ccb33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:09.256345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d605c7c-2f5c-4ac3-baf8-d24afb8ccb33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:09.256787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d605c7c-2f5c-4ac3-baf8-d24afb8ccb33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:09.257716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d605c7c-2f5c-4ac3-baf8-d24afb8ccb33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:09.258195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d605c7c-2f5c-4ac3-baf8-d24afb8ccb33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:09.258645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0d605c7c-2f5c-4ac3-baf8-d24afb8ccb33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:09.654941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0d605c7c-2f5c-4ac3-baf8-d24afb8ccb33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:09.675971 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0d605c7c-2f5c-4ac3-baf8-d24afb8ccb33 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.469520 Aug 09 15:08:09.710739 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2831/5659] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:09 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:10.209416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2942513-1138-45b3-8219-5107d8b03c3b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:10.211105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c2942513-1138-45b3-8219-5107d8b03c3b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:10.224581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2942513-1138-45b3-8219-5107d8b03c3b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:10.227419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2942513-1138-45b3-8219-5107d8b03c3b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:10.228906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2942513-1138-45b3-8219-5107d8b03c3b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:10.229845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2942513-1138-45b3-8219-5107d8b03c3b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:10.231811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2942513-1138-45b3-8219-5107d8b03c3b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:10.233430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2942513-1138-45b3-8219-5107d8b03c3b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:10.267719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-26e206d2-6159-4d5c-8c4f-5bf3603d7e3b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:10.269672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-26e206d2-6159-4d5c-8c4f-5bf3603d7e3b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:10.321923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e206d2-6159-4d5c-8c4f-5bf3603d7e3b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:10.323404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e206d2-6159-4d5c-8c4f-5bf3603d7e3b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:10.324219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e206d2-6159-4d5c-8c4f-5bf3603d7e3b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:10.333716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e206d2-6159-4d5c-8c4f-5bf3603d7e3b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:10.336011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e206d2-6159-4d5c-8c4f-5bf3603d7e3b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:10.337368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26e206d2-6159-4d5c-8c4f-5bf3603d7e3b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:10.731348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c2942513-1138-45b3-8219-5107d8b03c3b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:10.745477 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2942513-1138-45b3-8219-5107d8b03c3b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1374 microversion: 2.1 time: 0.534961 Aug 09 15:08:10.760079 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2829/5660] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:10 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1374 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:10.760079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9224d50-a60b-4c22-b035-e80fdc16abdc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:10.760079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e9224d50-a60b-4c22-b035-e80fdc16abdc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:10.773259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9224d50-a60b-4c22-b035-e80fdc16abdc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:10.773777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9224d50-a60b-4c22-b035-e80fdc16abdc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:10.774229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9224d50-a60b-4c22-b035-e80fdc16abdc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:10.774997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9224d50-a60b-4c22-b035-e80fdc16abdc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:10.776208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9224d50-a60b-4c22-b035-e80fdc16abdc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:10.795863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9224d50-a60b-4c22-b035-e80fdc16abdc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:11.000479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-26e206d2-6159-4d5c-8c4f-5bf3603d7e3b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:11.010185 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-26e206d2-6159-4d5c-8c4f-5bf3603d7e3b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1499 microversion: 2.1 time: 0.761305 Aug 09 15:08:11.010802 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2832/5661] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:10 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1499 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:11.049081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-121616d5-893e-467e-9599-f7550ded6907 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:11.061839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-121616d5-893e-467e-9599-f7550ded6907 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:11.089845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-121616d5-893e-467e-9599-f7550ded6907 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:11.090336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-121616d5-893e-467e-9599-f7550ded6907 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:11.090770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-121616d5-893e-467e-9599-f7550ded6907 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:11.091648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-121616d5-893e-467e-9599-f7550ded6907 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:11.092083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-121616d5-893e-467e-9599-f7550ded6907 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:11.092500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-121616d5-893e-467e-9599-f7550ded6907 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:11.147515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-121616d5-893e-467e-9599-f7550ded6907 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lazy-loading 'flavor' on Instance uuid bcbfdaea-fc59-4a69-8de6-4c48a477a150 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:08:11.333573 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-121616d5-893e-467e-9599-f7550ded6907 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "POST /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150/action" status: 200 len: 32 microversion: 2.1 time: 0.294328 Aug 09 15:08:11.336337 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2833/5662] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:08:11 2022] POST /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150/action => generated 32 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:08:11.372466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e204b588-cadb-461f-9a0e-a4c9dfbdd818 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:11.381200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e204b588-cadb-461f-9a0e-a4c9dfbdd818 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:11.431273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e204b588-cadb-461f-9a0e-a4c9dfbdd818 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:11.436218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e204b588-cadb-461f-9a0e-a4c9dfbdd818 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:11.437544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e204b588-cadb-461f-9a0e-a4c9dfbdd818 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:11.456031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e204b588-cadb-461f-9a0e-a4c9dfbdd818 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:11.458720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e204b588-cadb-461f-9a0e-a4c9dfbdd818 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:11.459948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e204b588-cadb-461f-9a0e-a4c9dfbdd818 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:11.640058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e9224d50-a60b-4c22-b035-e80fdc16abdc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:11.655215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:11.668260 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9224d50-a60b-4c22-b035-e80fdc16abdc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.920307 Aug 09 15:08:11.668870 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2830/5663] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:10 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:11.768106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6448dae8-2c49-498b-81c2-c3144f69e306 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:11.768908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6448dae8-2c49-498b-81c2-c3144f69e306 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:11.779076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6448dae8-2c49-498b-81c2-c3144f69e306 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:11.783960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6448dae8-2c49-498b-81c2-c3144f69e306 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:11.784652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6448dae8-2c49-498b-81c2-c3144f69e306 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:11.785606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6448dae8-2c49-498b-81c2-c3144f69e306 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:11.786232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6448dae8-2c49-498b-81c2-c3144f69e306 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:11.786832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6448dae8-2c49-498b-81c2-c3144f69e306 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:12.332287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6448dae8-2c49-498b-81c2-c3144f69e306 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:12.363474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e204b588-cadb-461f-9a0e-a4c9dfbdd818 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:12.365822 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6448dae8-2c49-498b-81c2-c3144f69e306 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1374 microversion: 2.1 time: 0.601877 Aug 09 15:08:12.380759 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2831/5664] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:11 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1374 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:12.387581 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e204b588-cadb-461f-9a0e-a4c9dfbdd818 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 1.040777 Aug 09 15:08:12.412597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-4afc9866-24d9-4b48-b7b6-8e5910ab042c req-8365bea5-acb3-4867-aa59-ef3e4fc45e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff9f9a2-2871-42e5-988c-bd15cc759edc", "name": "network-vif-plugged", "status": "completed", "tag": "4c929778-d5b6-4bc4-bc31-3e32d80c0b5b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:12.415693 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2834/5665] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:11 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:12.447677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4afc9866-24d9-4b48-b7b6-8e5910ab042c req-8365bea5-acb3-4867-aa59-ef3e4fc45e50 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:12.448602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4afc9866-24d9-4b48-b7b6-8e5910ab042c req-8365bea5-acb3-4867-aa59-ef3e4fc45e50 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:12.449396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4afc9866-24d9-4b48-b7b6-8e5910ab042c req-8365bea5-acb3-4867-aa59-ef3e4fc45e50 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:12.512242 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4afc9866-24d9-4b48-b7b6-8e5910ab042c req-8365bea5-acb3-4867-aa59-ef3e4fc45e50 service nova] Creating event network-vif-plugged:4c929778-d5b6-4bc4-bc31-3e32d80c0b5b for instance 7ff9f9a2-2871-42e5-988c-bd15cc759edc on n-h1-844626-8 Aug 09 15:08:12.550134 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-4afc9866-24d9-4b48-b7b6-8e5910ab042c req-8365bea5-acb3-4867-aa59-ef3e4fc45e50 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143101 Aug 09 15:08:12.555423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2832/5666] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:08:12.719546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f798b40f-f896-4744-91c3-ae9679fa126f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:12.726767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f798b40f-f896-4744-91c3-ae9679fa126f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:12.745741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f798b40f-f896-4744-91c3-ae9679fa126f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:12.746662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f798b40f-f896-4744-91c3-ae9679fa126f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:12.747544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f798b40f-f896-4744-91c3-ae9679fa126f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:12.749646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f798b40f-f896-4744-91c3-ae9679fa126f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:12.750546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f798b40f-f896-4744-91c3-ae9679fa126f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:12.751342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f798b40f-f896-4744-91c3-ae9679fa126f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:13.358203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f798b40f-f896-4744-91c3-ae9679fa126f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:13.374313 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f798b40f-f896-4744-91c3-ae9679fa126f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.673185 Aug 09 15:08:13.376368 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2835/5667] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:12 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:13.417828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73c52ed1-feef-49a2-806e-7d209010d501 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:13.418952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-73c52ed1-feef-49a2-806e-7d209010d501 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:13.434007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73c52ed1-feef-49a2-806e-7d209010d501 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:13.436049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73c52ed1-feef-49a2-806e-7d209010d501 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:13.437129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73c52ed1-feef-49a2-806e-7d209010d501 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:13.439200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5509720d-381e-4146-8193-38867316f051 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:13.443986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5509720d-381e-4146-8193-38867316f051 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:13.446048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73c52ed1-feef-49a2-806e-7d209010d501 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:13.447966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73c52ed1-feef-49a2-806e-7d209010d501 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:13.449553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73c52ed1-feef-49a2-806e-7d209010d501 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:13.454802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5509720d-381e-4146-8193-38867316f051 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:13.455336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5509720d-381e-4146-8193-38867316f051 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:13.455928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5509720d-381e-4146-8193-38867316f051 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:13.456478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5509720d-381e-4146-8193-38867316f051 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:13.456930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5509720d-381e-4146-8193-38867316f051 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:13.457372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5509720d-381e-4146-8193-38867316f051 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:13.914069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-73c52ed1-feef-49a2-806e-7d209010d501 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:13.917733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5509720d-381e-4146-8193-38867316f051 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:13.933631 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5509720d-381e-4146-8193-38867316f051 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.500803 Aug 09 15:08:13.935655 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2836/5668] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:13 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:13.938951 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-73c52ed1-feef-49a2-806e-7d209010d501 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1374 microversion: 2.1 time: 0.530718 Aug 09 15:08:13.951127 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2833/5669] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:13 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1374 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:14.396148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05a29fed-49ab-4320-8505-af968a59e0a3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '.version_select at 0x7f41dc5ef3a0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:14.406883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-56d6e2c1-e547-4041-8c01-199d7b66bfd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:14.407704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-56d6e2c1-e547-4041-8c01-199d7b66bfd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:14.419267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d6e2c1-e547-4041-8c01-199d7b66bfd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:14.421232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d6e2c1-e547-4041-8c01-199d7b66bfd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:14.421736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d6e2c1-e547-4041-8c01-199d7b66bfd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:14.425012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d6e2c1-e547-4041-8c01-199d7b66bfd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:14.425515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d6e2c1-e547-4041-8c01-199d7b66bfd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:14.425988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56d6e2c1-e547-4041-8c01-199d7b66bfd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:14.443400 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05a29fed-49ab-4320-8505-af968a59e0a3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-473763367" status: 202 len: 0 microversion: 2.1 time: 0.052085 Aug 09 15:08:14.460609 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2837/5670] 10.222.0.50 () {58 vars in 1281 bytes} [Tue Aug 9 15:08:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-473763367 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:08:14.501914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d421759e-285f-46bd-9a34-950d177fbf8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'create', calling method: .version_select at 0x7f41dc550e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1761620597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEeeXj2ZZV+lNQ3k1G2DijJwceERF3HRJhZPGfowBhgE/e0IT9Bxh0O9jdYEfsdyg1eMHh6kuUPfZIxopDJPvH0mcDs4qiSQEnTb1GTw2Yq5ZlJV1uFrLtjyo8WVwAiEA=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:14.544371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d421759e-285f-46bd-9a34-950d177fbf8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for project 889fa240e1f5494d9c11803acd77f74b. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:08:14.556875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d421759e-285f-46bd-9a34-950d177fbf8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for user 9ff3b746851a4414ba60cb76ac07056b and project 889fa240e1f5494d9c11803acd77f74b. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:08:14.672142 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d421759e-285f-46bd-9a34-950d177fbf8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.184024 Aug 09 15:08:14.673011 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2838/5671] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:08:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:08:14.838287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-56d6e2c1-e547-4041-8c01-199d7b66bfd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:14.852856 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-56d6e2c1-e547-4041-8c01-199d7b66bfd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.450491 Aug 09 15:08:14.853489 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2834/5672] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:14 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:14.962675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a43c9743-9278-4b51-ab3f-5fcd461b7e99 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:14.966862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a43c9743-9278-4b51-ab3f-5fcd461b7e99 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:14.978878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5040531e-f764-44e3-b229-3e9f3e651078 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:14.981261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5040531e-f764-44e3-b229-3e9f3e651078 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:15.042474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a43c9743-9278-4b51-ab3f-5fcd461b7e99 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:15.046463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a43c9743-9278-4b51-ab3f-5fcd461b7e99 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:15.048257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5040531e-f764-44e3-b229-3e9f3e651078 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:15.049147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5040531e-f764-44e3-b229-3e9f3e651078 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:15.050633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a43c9743-9278-4b51-ab3f-5fcd461b7e99 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:15.051530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5040531e-f764-44e3-b229-3e9f3e651078 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:15.053332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a43c9743-9278-4b51-ab3f-5fcd461b7e99 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:15.056538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a43c9743-9278-4b51-ab3f-5fcd461b7e99 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:15.058328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5040531e-f764-44e3-b229-3e9f3e651078 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:15.059160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a43c9743-9278-4b51-ab3f-5fcd461b7e99 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:15.061432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5040531e-f764-44e3-b229-3e9f3e651078 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:15.063924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5040531e-f764-44e3-b229-3e9f3e651078 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:15.545133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a43c9743-9278-4b51-ab3f-5fcd461b7e99 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:15.561380 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a43c9743-9278-4b51-ab3f-5fcd461b7e99 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.607624 Aug 09 15:08:15.592110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5040531e-f764-44e3-b229-3e9f3e651078 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:15.595650 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2839/5673] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:14 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:15.607554 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5040531e-f764-44e3-b229-3e9f3e651078 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1546 microversion: 2.1 time: 0.635920 Aug 09 15:08:15.610987 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2835/5674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:14 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1546 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:15.649408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7e69ce74-b431-4b76-acac-4424d69060fb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:15.651047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7e69ce74-b431-4b76-acac-4424d69060fb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:15.664825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e69ce74-b431-4b76-acac-4424d69060fb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:15.666149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e69ce74-b431-4b76-acac-4424d69060fb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:15.667232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e69ce74-b431-4b76-acac-4424d69060fb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:15.668839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e69ce74-b431-4b76-acac-4424d69060fb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:15.669975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e69ce74-b431-4b76-acac-4424d69060fb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:15.671034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e69ce74-b431-4b76-acac-4424d69060fb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:15.874419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bb6a5fa6-5b83-47f9-b631-7842288260d9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:15.875074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bb6a5fa6-5b83-47f9-b631-7842288260d9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:15.884891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb6a5fa6-5b83-47f9-b631-7842288260d9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:15.885402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb6a5fa6-5b83-47f9-b631-7842288260d9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:15.885847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb6a5fa6-5b83-47f9-b631-7842288260d9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:15.886581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb6a5fa6-5b83-47f9-b631-7842288260d9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:15.887041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb6a5fa6-5b83-47f9-b631-7842288260d9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:15.887508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bb6a5fa6-5b83-47f9-b631-7842288260d9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:15.971653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7e69ce74-b431-4b76-acac-4424d69060fb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:15.978317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:15.981066 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7e69ce74-b431-4b76-acac-4424d69060fb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1546 microversion: 2.1 time: 0.340180 Aug 09 15:08:15.984353 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2840/5675] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:15 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1546 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:16.364898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bb6a5fa6-5b83-47f9-b631-7842288260d9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:16.374995 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bb6a5fa6-5b83-47f9-b631-7842288260d9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.504629 Aug 09 15:08:16.388257 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2836/5676] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:15 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:16.602923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0818de99-ff53-43cb-9c3e-01ab08875eb4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:16.603769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0818de99-ff53-43cb-9c3e-01ab08875eb4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:16.620221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0818de99-ff53-43cb-9c3e-01ab08875eb4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:16.622206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0818de99-ff53-43cb-9c3e-01ab08875eb4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:16.624028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0818de99-ff53-43cb-9c3e-01ab08875eb4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:16.625902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0818de99-ff53-43cb-9c3e-01ab08875eb4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:16.627022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0818de99-ff53-43cb-9c3e-01ab08875eb4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:16.628463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0818de99-ff53-43cb-9c3e-01ab08875eb4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:17.243240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0818de99-ff53-43cb-9c3e-01ab08875eb4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:17.273980 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0818de99-ff53-43cb-9c3e-01ab08875eb4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.676370 Aug 09 15:08:17.275602 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2841/5677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:16 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:17.400640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8122c880-e139-4eaf-9d24-d768b11cae53 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:17.402048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8122c880-e139-4eaf-9d24-d768b11cae53 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:17.422003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8122c880-e139-4eaf-9d24-d768b11cae53 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:17.422669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8122c880-e139-4eaf-9d24-d768b11cae53 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:17.423463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8122c880-e139-4eaf-9d24-d768b11cae53 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:17.424507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8122c880-e139-4eaf-9d24-d768b11cae53 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:17.425234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8122c880-e139-4eaf-9d24-d768b11cae53 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:17.425856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8122c880-e139-4eaf-9d24-d768b11cae53 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:18.186386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8122c880-e139-4eaf-9d24-d768b11cae53 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:18.206243 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8122c880-e139-4eaf-9d24-d768b11cae53 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.811693 Aug 09 15:08:18.219298 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2837/5678] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:17 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:18.298783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c8724b1-1791-4119-9db3-5c756779725b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:18.299816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3c8724b1-1791-4119-9db3-5c756779725b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:18.315067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c8724b1-1791-4119-9db3-5c756779725b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:18.317642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c8724b1-1791-4119-9db3-5c756779725b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:18.318238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c8724b1-1791-4119-9db3-5c756779725b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:18.319128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c8724b1-1791-4119-9db3-5c756779725b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:18.320654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c8724b1-1791-4119-9db3-5c756779725b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:18.323820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c8724b1-1791-4119-9db3-5c756779725b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:19.175170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3c8724b1-1791-4119-9db3-5c756779725b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:19.201246 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3c8724b1-1791-4119-9db3-5c756779725b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.907156 Aug 09 15:08:19.201866 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2842/5679] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:18 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:19.228569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-61fb74af-8acf-4bb7-aa76-99e5b596d5df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:19.229798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-61fb74af-8acf-4bb7-aa76-99e5b596d5df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:19.239550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61fb74af-8acf-4bb7-aa76-99e5b596d5df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:19.242067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61fb74af-8acf-4bb7-aa76-99e5b596d5df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:19.242900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61fb74af-8acf-4bb7-aa76-99e5b596d5df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:19.244455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61fb74af-8acf-4bb7-aa76-99e5b596d5df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:19.247051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61fb74af-8acf-4bb7-aa76-99e5b596d5df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:19.248753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-61fb74af-8acf-4bb7-aa76-99e5b596d5df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:19.686858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-61fb74af-8acf-4bb7-aa76-99e5b596d5df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:19.707272 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-61fb74af-8acf-4bb7-aa76-99e5b596d5df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.482592 Aug 09 15:08:19.713540 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2838/5680] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:19 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:20.241235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3ace828f-e4c1-4644-bd55-6a3eb9e650c4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:20.245729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3ace828f-e4c1-4644-bd55-6a3eb9e650c4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:20.292195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ace828f-e4c1-4644-bd55-6a3eb9e650c4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:20.295973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ace828f-e4c1-4644-bd55-6a3eb9e650c4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:20.296899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ace828f-e4c1-4644-bd55-6a3eb9e650c4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:20.300101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ace828f-e4c1-4644-bd55-6a3eb9e650c4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:20.300698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ace828f-e4c1-4644-bd55-6a3eb9e650c4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:20.301529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ace828f-e4c1-4644-bd55-6a3eb9e650c4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:20.577707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3ace828f-e4c1-4644-bd55-6a3eb9e650c4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:20.586401 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3ace828f-e4c1-4644-bd55-6a3eb9e650c4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.359007 Aug 09 15:08:20.587008 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2843/5681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:20 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:20.731363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2f6d9594-8d2e-4092-80c5-3a0cec763f6c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:20.732113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2f6d9594-8d2e-4092-80c5-3a0cec763f6c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:20.750743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f6d9594-8d2e-4092-80c5-3a0cec763f6c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:20.751281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f6d9594-8d2e-4092-80c5-3a0cec763f6c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:20.751730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f6d9594-8d2e-4092-80c5-3a0cec763f6c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:20.752489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f6d9594-8d2e-4092-80c5-3a0cec763f6c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:20.753258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f6d9594-8d2e-4092-80c5-3a0cec763f6c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:20.753690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2f6d9594-8d2e-4092-80c5-3a0cec763f6c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:21.071813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2f6d9594-8d2e-4092-80c5-3a0cec763f6c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:21.080299 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2f6d9594-8d2e-4092-80c5-3a0cec763f6c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.353227 Aug 09 15:08:21.092010 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2839/5682] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:20 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:21.240280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9c8bd789-e493-4d14-84b3-e7b8778c0f66 req-59e8f755-2243-4b55-ab3f-7fe2f15c5e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff9f9a2-2871-42e5-988c-bd15cc759edc", "tag": "4c929778-d5b6-4bc4-bc31-3e32d80c0b5b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:21.272781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9c8bd789-e493-4d14-84b3-e7b8778c0f66 req-59e8f755-2243-4b55-ab3f-7fe2f15c5e86 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:21.277847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9c8bd789-e493-4d14-84b3-e7b8778c0f66 req-59e8f755-2243-4b55-ab3f-7fe2f15c5e86 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:21.278584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9c8bd789-e493-4d14-84b3-e7b8778c0f66 req-59e8f755-2243-4b55-ab3f-7fe2f15c5e86 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:21.315056 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9c8bd789-e493-4d14-84b3-e7b8778c0f66 req-59e8f755-2243-4b55-ab3f-7fe2f15c5e86 service nova] Creating event network-changed:4c929778-d5b6-4bc4-bc31-3e32d80c0b5b for instance 7ff9f9a2-2871-42e5-988c-bd15cc759edc on n-h1-844626-8 Aug 09 15:08:21.327822 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9c8bd789-e493-4d14-84b3-e7b8778c0f66 req-59e8f755-2243-4b55-ab3f-7fe2f15c5e86 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087375 Aug 09 15:08:21.331619 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2844/5683] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:08:21.622981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a644b7bb-e0e2-46d9-8032-25e6c76c5e63 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:21.623464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a644b7bb-e0e2-46d9-8032-25e6c76c5e63 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:21.635555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a644b7bb-e0e2-46d9-8032-25e6c76c5e63 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:21.636104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a644b7bb-e0e2-46d9-8032-25e6c76c5e63 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:21.636540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a644b7bb-e0e2-46d9-8032-25e6c76c5e63 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:21.643517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a644b7bb-e0e2-46d9-8032-25e6c76c5e63 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:21.644329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a644b7bb-e0e2-46d9-8032-25e6c76c5e63 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:21.644942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a644b7bb-e0e2-46d9-8032-25e6c76c5e63 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:22.069550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a644b7bb-e0e2-46d9-8032-25e6c76c5e63 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:22.083936 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a644b7bb-e0e2-46d9-8032-25e6c76c5e63 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.470173 Aug 09 15:08:22.084946 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2840/5684] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:21 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:22.140985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fec50963-7ef0-4d90-b0b4-6f43447e5635 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:22.168192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fec50963-7ef0-4d90-b0b4-6f43447e5635 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:22.197501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec50963-7ef0-4d90-b0b4-6f43447e5635 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:22.198010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec50963-7ef0-4d90-b0b4-6f43447e5635 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:22.198462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec50963-7ef0-4d90-b0b4-6f43447e5635 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:22.199397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec50963-7ef0-4d90-b0b4-6f43447e5635 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:22.199867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec50963-7ef0-4d90-b0b4-6f43447e5635 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:22.200296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fec50963-7ef0-4d90-b0b4-6f43447e5635 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:22.678816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fec50963-7ef0-4d90-b0b4-6f43447e5635 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:22.706839 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fec50963-7ef0-4d90-b0b4-6f43447e5635 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1168 microversion: 2.1 time: 0.580928 Aug 09 15:08:22.713584 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2845/5685] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:22 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1168 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:23.129737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e56c8d99-0ed3-490b-8328-8b12e69a358e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:23.136075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e56c8d99-0ed3-490b-8328-8b12e69a358e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:23.169191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e56c8d99-0ed3-490b-8328-8b12e69a358e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:23.169737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e56c8d99-0ed3-490b-8328-8b12e69a358e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:23.171894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e56c8d99-0ed3-490b-8328-8b12e69a358e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:23.173638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e56c8d99-0ed3-490b-8328-8b12e69a358e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:23.175342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e56c8d99-0ed3-490b-8328-8b12e69a358e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:23.176457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e56c8d99-0ed3-490b-8328-8b12e69a358e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:23.549226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e56c8d99-0ed3-490b-8328-8b12e69a358e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:23.567428 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e56c8d99-0ed3-490b-8328-8b12e69a358e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.462196 Aug 09 15:08:23.568656 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2841/5686] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:23 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:23.778053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-41505f31-c576-4a1c-838d-d8269589e788 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:23.779196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-41505f31-c576-4a1c-838d-d8269589e788 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:23.820054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41505f31-c576-4a1c-838d-d8269589e788 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:23.824833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41505f31-c576-4a1c-838d-d8269589e788 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:23.826559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41505f31-c576-4a1c-838d-d8269589e788 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:23.827354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41505f31-c576-4a1c-838d-d8269589e788 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:23.827817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41505f31-c576-4a1c-838d-d8269589e788 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:23.828235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41505f31-c576-4a1c-838d-d8269589e788 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:24.481432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-41505f31-c576-4a1c-838d-d8269589e788 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:24.494842 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-41505f31-c576-4a1c-838d-d8269589e788 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1214 microversion: 2.1 time: 0.747385 Aug 09 15:08:24.495968 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2846/5687] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:23 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1214 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:24.610980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dc6d9904-90f9-4ff8-b99e-b773bb6d422f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:24.612892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dc6d9904-90f9-4ff8-b99e-b773bb6d422f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:24.625914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc6d9904-90f9-4ff8-b99e-b773bb6d422f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:24.630831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc6d9904-90f9-4ff8-b99e-b773bb6d422f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:24.631787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc6d9904-90f9-4ff8-b99e-b773bb6d422f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:24.633201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc6d9904-90f9-4ff8-b99e-b773bb6d422f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:24.634360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc6d9904-90f9-4ff8-b99e-b773bb6d422f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:24.635622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc6d9904-90f9-4ff8-b99e-b773bb6d422f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:25.132784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dc6d9904-90f9-4ff8-b99e-b773bb6d422f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:25.147196 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dc6d9904-90f9-4ff8-b99e-b773bb6d422f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.540798 Aug 09 15:08:25.148438 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2842/5688] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:24 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:25.516760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0914d689-1498-4c86-a9fd-dcd7b8ad97b2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:25.517485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0914d689-1498-4c86-a9fd-dcd7b8ad97b2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:25.519626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:25.530699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0914d689-1498-4c86-a9fd-dcd7b8ad97b2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:25.531212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0914d689-1498-4c86-a9fd-dcd7b8ad97b2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:25.531656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0914d689-1498-4c86-a9fd-dcd7b8ad97b2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:25.532380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0914d689-1498-4c86-a9fd-dcd7b8ad97b2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:25.532836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0914d689-1498-4c86-a9fd-dcd7b8ad97b2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:25.533254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0914d689-1498-4c86-a9fd-dcd7b8ad97b2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:25.926542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0914d689-1498-4c86-a9fd-dcd7b8ad97b2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:25.968876 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0914d689-1498-4c86-a9fd-dcd7b8ad97b2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1202 microversion: 2.1 time: 0.455642 Aug 09 15:08:25.970294 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2847/5689] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:25 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1202 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:26.194429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5449a47d-c5c4-4f11-8853-b44345a5fda5 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:26.197980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5449a47d-c5c4-4f11-8853-b44345a5fda5 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:26.222985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5449a47d-c5c4-4f11-8853-b44345a5fda5 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:26.224125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5449a47d-c5c4-4f11-8853-b44345a5fda5 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:26.224568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5449a47d-c5c4-4f11-8853-b44345a5fda5 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:26.225312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5449a47d-c5c4-4f11-8853-b44345a5fda5 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:26.225774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5449a47d-c5c4-4f11-8853-b44345a5fda5 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:26.226195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5449a47d-c5c4-4f11-8853-b44345a5fda5 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:26.716723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5449a47d-c5c4-4f11-8853-b44345a5fda5 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:26.727331 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5449a47d-c5c4-4f11-8853-b44345a5fda5 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.537632 Aug 09 15:08:26.728363 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2843/5690] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:26 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:26.993757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5949d42a-d3ea-49d4-873b-51ea1c482f8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:26.994390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5949d42a-d3ea-49d4-873b-51ea1c482f8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:27.006547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5949d42a-d3ea-49d4-873b-51ea1c482f8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:27.010091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5949d42a-d3ea-49d4-873b-51ea1c482f8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:27.011008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5949d42a-d3ea-49d4-873b-51ea1c482f8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:27.012228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5949d42a-d3ea-49d4-873b-51ea1c482f8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:27.012931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5949d42a-d3ea-49d4-873b-51ea1c482f8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:27.013913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5949d42a-d3ea-49d4-873b-51ea1c482f8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:27.671897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5949d42a-d3ea-49d4-873b-51ea1c482f8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:27.690262 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5949d42a-d3ea-49d4-873b-51ea1c482f8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1202 microversion: 2.1 time: 0.702545 Aug 09 15:08:27.690873 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2848/5691] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:26 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1202 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:27.763316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f40de0ed-6a2e-4b5a-a5f8-9586858c4421 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:27.763969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f40de0ed-6a2e-4b5a-a5f8-9586858c4421 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:27.771214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f40de0ed-6a2e-4b5a-a5f8-9586858c4421 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:27.771706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f40de0ed-6a2e-4b5a-a5f8-9586858c4421 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:27.772139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f40de0ed-6a2e-4b5a-a5f8-9586858c4421 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:27.781879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f40de0ed-6a2e-4b5a-a5f8-9586858c4421 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:27.782819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f40de0ed-6a2e-4b5a-a5f8-9586858c4421 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:27.783439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f40de0ed-6a2e-4b5a-a5f8-9586858c4421 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:28.514898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f40de0ed-6a2e-4b5a-a5f8-9586858c4421 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:28.550040 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f40de0ed-6a2e-4b5a-a5f8-9586858c4421 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.790848 Aug 09 15:08:28.551920 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2844/5692] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:27 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:28.730713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-686662bf-ddd2-465a-84e6-00385ce19066 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:28.735178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-686662bf-ddd2-465a-84e6-00385ce19066 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:28.753070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686662bf-ddd2-465a-84e6-00385ce19066 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:28.753663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686662bf-ddd2-465a-84e6-00385ce19066 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:28.754470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686662bf-ddd2-465a-84e6-00385ce19066 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:28.756332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686662bf-ddd2-465a-84e6-00385ce19066 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:28.757017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686662bf-ddd2-465a-84e6-00385ce19066 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:28.757530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686662bf-ddd2-465a-84e6-00385ce19066 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:29.020735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-686662bf-ddd2-465a-84e6-00385ce19066 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:29.037553 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-686662bf-ddd2-465a-84e6-00385ce19066 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1202 microversion: 2.1 time: 0.321384 Aug 09 15:08:29.041995 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2849/5693] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:28 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1202 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:29.580900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d7814dc2-4926-4f4a-9b9a-d336bdf455e4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:29.582562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d7814dc2-4926-4f4a-9b9a-d336bdf455e4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:29.591737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=54 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:29.602515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7814dc2-4926-4f4a-9b9a-d336bdf455e4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:29.603377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7814dc2-4926-4f4a-9b9a-d336bdf455e4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:29.603832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7814dc2-4926-4f4a-9b9a-d336bdf455e4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:29.604595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7814dc2-4926-4f4a-9b9a-d336bdf455e4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:29.605055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7814dc2-4926-4f4a-9b9a-d336bdf455e4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:29.605504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7814dc2-4926-4f4a-9b9a-d336bdf455e4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:29.938313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d7814dc2-4926-4f4a-9b9a-d336bdf455e4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:29.949376 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d7814dc2-4926-4f4a-9b9a-d336bdf455e4 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.377186 Aug 09 15:08:29.951917 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2845/5694] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:29 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:30.066544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1919298411", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "1549bf3f-bcb9-4f4a-b904-a21683eca80b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1761620597", "security_groups": [{"name": "tempest-secgroup-smoke-1512070238"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:30.080728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6761d700-a2b8-4c88-94da-51b4ec8b3ea2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:30.082851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6761d700-a2b8-4c88-94da-51b4ec8b3ea2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:30.099629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6761d700-a2b8-4c88-94da-51b4ec8b3ea2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:30.100886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6761d700-a2b8-4c88-94da-51b4ec8b3ea2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:30.102595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6761d700-a2b8-4c88-94da-51b4ec8b3ea2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:30.104143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6761d700-a2b8-4c88-94da-51b4ec8b3ea2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:30.104957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6761d700-a2b8-4c88-94da-51b4ec8b3ea2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:30.105974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6761d700-a2b8-4c88-94da-51b4ec8b3ea2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:30.324169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] validate_networks() for [('1549bf3f-bcb9-4f4a-b904-a21683eca80b', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:08:30.941527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6761d700-a2b8-4c88-94da-51b4ec8b3ea2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:30.957925 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6761d700-a2b8-4c88-94da-51b4ec8b3ea2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1202 microversion: 2.1 time: 0.885331 Aug 09 15:08:30.960124 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2846/5695] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:30 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1202 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:30.975476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e163f8e8-5944-4c94-99f1-871afd1dba43 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:30.976561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e163f8e8-5944-4c94-99f1-871afd1dba43 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:30.994536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e163f8e8-5944-4c94-99f1-871afd1dba43 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:30.995899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e163f8e8-5944-4c94-99f1-871afd1dba43 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:30.996890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e163f8e8-5944-4c94-99f1-871afd1dba43 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:31.003225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e163f8e8-5944-4c94-99f1-871afd1dba43 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:31.004361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e163f8e8-5944-4c94-99f1-871afd1dba43 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:31.008033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e163f8e8-5944-4c94-99f1-871afd1dba43 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:31.330811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e163f8e8-5944-4c94-99f1-871afd1dba43 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:31.362733 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e163f8e8-5944-4c94-99f1-871afd1dba43 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.391806 Aug 09 15:08:31.364063 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2847/5696] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:30 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:31.634905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:08:31.635895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:08:31.637253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:08:31.638309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:08:31.639293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:08:31.660207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:31.661038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:31.662267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:31.664056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:31.664887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:31.665655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:31.709039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for project 889fa240e1f5494d9c11803acd77f74b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:08:31.722164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for user 9ff3b746851a4414ba60cb76ac07056b and project 889fa240e1f5494d9c11803acd77f74b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:08:31.754112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:08:31.760991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:08:31.921125 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-678741c7-6e5c-4971-9fea-ab3f145ba448 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.859764 Aug 09 15:08:31.922359 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2850/5697] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:08:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:08:31.942044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-832a2332-df6e-44ef-bde8-fe4d661bd1df tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:31.944757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-832a2332-df6e-44ef-bde8-fe4d661bd1df tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:32.006453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed909333-a9a0-4ba4-80a6-001ae067c3b9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:32.007652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed909333-a9a0-4ba4-80a6-001ae067c3b9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:32.090691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed909333-a9a0-4ba4-80a6-001ae067c3b9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:32.091425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed909333-a9a0-4ba4-80a6-001ae067c3b9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:32.092196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed909333-a9a0-4ba4-80a6-001ae067c3b9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:32.093156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed909333-a9a0-4ba4-80a6-001ae067c3b9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:32.093814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed909333-a9a0-4ba4-80a6-001ae067c3b9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:32.094426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed909333-a9a0-4ba4-80a6-001ae067c3b9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:32.237809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-832a2332-df6e-44ef-bde8-fe4d661bd1df tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:32.253665 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-832a2332-df6e-44ef-bde8-fe4d661bd1df tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1267 microversion: 2.1 time: 0.319852 Aug 09 15:08:32.263182 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2848/5698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:31 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1267 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:32.341474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed909333-a9a0-4ba4-80a6-001ae067c3b9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:32.358787 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed909333-a9a0-4ba4-80a6-001ae067c3b9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1202 microversion: 2.1 time: 0.367628 Aug 09 15:08:32.359859 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2851/5699] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:31 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1202 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:32.408995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0e60865-fa5b-4d33-8b80-20f6c312c07a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:32.411587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e0e60865-fa5b-4d33-8b80-20f6c312c07a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:32.429057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e60865-fa5b-4d33-8b80-20f6c312c07a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:32.430307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e60865-fa5b-4d33-8b80-20f6c312c07a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:32.431341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e60865-fa5b-4d33-8b80-20f6c312c07a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:32.433748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e60865-fa5b-4d33-8b80-20f6c312c07a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:32.434907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e60865-fa5b-4d33-8b80-20f6c312c07a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:32.435961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e60865-fa5b-4d33-8b80-20f6c312c07a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:32.450042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:32.905187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e0e60865-fa5b-4d33-8b80-20f6c312c07a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:32.924297 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e0e60865-fa5b-4d33-8b80-20f6c312c07a tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.524708 Aug 09 15:08:32.940114 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2849/5700] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:32 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:33.289194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-00eead80-f42d-47a3-89a6-4bde0a757fbe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:33.292274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-00eead80-f42d-47a3-89a6-4bde0a757fbe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:33.337977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00eead80-f42d-47a3-89a6-4bde0a757fbe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:33.344410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00eead80-f42d-47a3-89a6-4bde0a757fbe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:33.345250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00eead80-f42d-47a3-89a6-4bde0a757fbe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:33.353972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00eead80-f42d-47a3-89a6-4bde0a757fbe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:33.354921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00eead80-f42d-47a3-89a6-4bde0a757fbe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:33.355838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-00eead80-f42d-47a3-89a6-4bde0a757fbe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:33.406486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cbe8dfbe-c205-47d2-8d91-712c9504e156 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:33.420605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cbe8dfbe-c205-47d2-8d91-712c9504e156 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:33.441620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbe8dfbe-c205-47d2-8d91-712c9504e156 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:33.442891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbe8dfbe-c205-47d2-8d91-712c9504e156 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:33.452759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbe8dfbe-c205-47d2-8d91-712c9504e156 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:33.454509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbe8dfbe-c205-47d2-8d91-712c9504e156 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:33.455978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbe8dfbe-c205-47d2-8d91-712c9504e156 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:33.456719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cbe8dfbe-c205-47d2-8d91-712c9504e156 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:33.610337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-00eead80-f42d-47a3-89a6-4bde0a757fbe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:33.643287 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-00eead80-f42d-47a3-89a6-4bde0a757fbe tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1263 microversion: 2.1 time: 0.363639 Aug 09 15:08:33.657267 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2852/5701] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:33 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1263 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:33.859147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cbe8dfbe-c205-47d2-8d91-712c9504e156 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:33.868976 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cbe8dfbe-c205-47d2-8d91-712c9504e156 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1202 microversion: 2.1 time: 0.475617 Aug 09 15:08:33.870510 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2850/5702] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:33 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1202 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:33.971447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d0a1f2e-bfec-4185-b457-172acc1d4d5c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:33.972676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d0a1f2e-bfec-4185-b457-172acc1d4d5c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:33.987778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d0a1f2e-bfec-4185-b457-172acc1d4d5c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:33.988858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d0a1f2e-bfec-4185-b457-172acc1d4d5c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:33.989496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d0a1f2e-bfec-4185-b457-172acc1d4d5c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:33.992895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d0a1f2e-bfec-4185-b457-172acc1d4d5c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:33.995840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d0a1f2e-bfec-4185-b457-172acc1d4d5c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:33.997200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d0a1f2e-bfec-4185-b457-172acc1d4d5c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:34.270128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-44521f3c-7745-4b84-9562-21cd270cdcd1 req-36e01785-3237-4f37-8e3f-39472001b815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011", "name": "network-vif-plugged", "status": "completed", "tag": "2cea8391-0e11-488a-acf1-fd55b99ee13a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:34.317840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-44521f3c-7745-4b84-9562-21cd270cdcd1 req-36e01785-3237-4f37-8e3f-39472001b815 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:34.318789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-44521f3c-7745-4b84-9562-21cd270cdcd1 req-36e01785-3237-4f37-8e3f-39472001b815 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:34.319878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-44521f3c-7745-4b84-9562-21cd270cdcd1 req-36e01785-3237-4f37-8e3f-39472001b815 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:34.355603 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-44521f3c-7745-4b84-9562-21cd270cdcd1 req-36e01785-3237-4f37-8e3f-39472001b815 service nova] Creating event network-vif-plugged:2cea8391-0e11-488a-acf1-fd55b99ee13a for instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 on n-h2-844626-8 Aug 09 15:08:34.374632 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-44521f3c-7745-4b84-9562-21cd270cdcd1 req-36e01785-3237-4f37-8e3f-39472001b815 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110435 Aug 09 15:08:34.379545 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2851/5703] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:08:34.666247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-49eb20ae-bdb5-450b-bbd2-09a95a81eb13 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:34.667408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-49eb20ae-bdb5-450b-bbd2-09a95a81eb13 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:34.675565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49eb20ae-bdb5-450b-bbd2-09a95a81eb13 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:34.676068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49eb20ae-bdb5-450b-bbd2-09a95a81eb13 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:34.676515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49eb20ae-bdb5-450b-bbd2-09a95a81eb13 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:34.677253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49eb20ae-bdb5-450b-bbd2-09a95a81eb13 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:34.677905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49eb20ae-bdb5-450b-bbd2-09a95a81eb13 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:34.678337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49eb20ae-bdb5-450b-bbd2-09a95a81eb13 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:34.856346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-49eb20ae-bdb5-450b-bbd2-09a95a81eb13 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:34.884682 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-49eb20ae-bdb5-450b-bbd2-09a95a81eb13 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1325 microversion: 2.1 time: 0.222903 Aug 09 15:08:34.888630 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2852/5704] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:34 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1325 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:34.915731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-640a12c0-41fa-434d-a8ff-c747a5764217 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:34.923216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-640a12c0-41fa-434d-a8ff-c747a5764217 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:34.936232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-640a12c0-41fa-434d-a8ff-c747a5764217 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:34.936818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-640a12c0-41fa-434d-a8ff-c747a5764217 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:34.938164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-640a12c0-41fa-434d-a8ff-c747a5764217 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:34.938164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-640a12c0-41fa-434d-a8ff-c747a5764217 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:34.938725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-640a12c0-41fa-434d-a8ff-c747a5764217 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:34.939329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-640a12c0-41fa-434d-a8ff-c747a5764217 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:34.962916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d0a1f2e-bfec-4185-b457-172acc1d4d5c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:34.986652 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d0a1f2e-bfec-4185-b457-172acc1d4d5c tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 1.019530 Aug 09 15:08:34.990187 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2853/5705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:33 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:35.473001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-640a12c0-41fa-434d-a8ff-c747a5764217 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:35.495588 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-640a12c0-41fa-434d-a8ff-c747a5764217 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1202 microversion: 2.1 time: 0.583121 Aug 09 15:08:35.497869 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2853/5706] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:34 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1202 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:35.918154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62112909-d9c6-4b86-baec-15418573de7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:35.919990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-62112909-d9c6-4b86-baec-15418573de7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:35.956068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62112909-d9c6-4b86-baec-15418573de7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:35.957337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62112909-d9c6-4b86-baec-15418573de7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:35.958330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62112909-d9c6-4b86-baec-15418573de7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:35.960198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62112909-d9c6-4b86-baec-15418573de7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:35.961306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62112909-d9c6-4b86-baec-15418573de7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:35.962488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62112909-d9c6-4b86-baec-15418573de7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:36.038615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6088c66e-c562-4e2a-8670-172c468533bc tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:36.040475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6088c66e-c562-4e2a-8670-172c468533bc tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:36.080544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6088c66e-c562-4e2a-8670-172c468533bc tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:36.082318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6088c66e-c562-4e2a-8670-172c468533bc tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:36.083527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6088c66e-c562-4e2a-8670-172c468533bc tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:36.085196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6088c66e-c562-4e2a-8670-172c468533bc tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:36.086825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6088c66e-c562-4e2a-8670-172c468533bc tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:36.089094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6088c66e-c562-4e2a-8670-172c468533bc tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:36.186303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-62112909-d9c6-4b86-baec-15418573de7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:36.202503 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-62112909-d9c6-4b86-baec-15418573de7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1325 microversion: 2.1 time: 0.294748 Aug 09 15:08:36.220047 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2854/5707] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:35 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1325 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:36.489423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6088c66e-c562-4e2a-8670-172c468533bc tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:36.508672 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6088c66e-c562-4e2a-8670-172c468533bc tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.480397 Aug 09 15:08:36.509621 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2854/5708] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:36 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:36.528813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd792c90-050b-40f5-9773-e8d4a90eb77c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:36.529666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd792c90-050b-40f5-9773-e8d4a90eb77c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:36.537329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd792c90-050b-40f5-9773-e8d4a90eb77c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:36.537974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd792c90-050b-40f5-9773-e8d4a90eb77c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:36.538542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd792c90-050b-40f5-9773-e8d4a90eb77c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:36.539415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd792c90-050b-40f5-9773-e8d4a90eb77c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:36.540139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd792c90-050b-40f5-9773-e8d4a90eb77c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:36.540921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd792c90-050b-40f5-9773-e8d4a90eb77c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:36.962034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd792c90-050b-40f5-9773-e8d4a90eb77c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:37.006735 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd792c90-050b-40f5-9773-e8d4a90eb77c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1390 microversion: 2.1 time: 0.481402 Aug 09 15:08:37.008185 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2855/5709] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:36 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1390 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:37.050449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-05d5f866-1b68-4074-8ea2-83c68b96b733 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:37.051303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-05d5f866-1b68-4074-8ea2-83c68b96b733 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:37.058733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05d5f866-1b68-4074-8ea2-83c68b96b733 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:37.059407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05d5f866-1b68-4074-8ea2-83c68b96b733 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:37.062590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05d5f866-1b68-4074-8ea2-83c68b96b733 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:37.063537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05d5f866-1b68-4074-8ea2-83c68b96b733 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:37.064026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05d5f866-1b68-4074-8ea2-83c68b96b733 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:37.064468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05d5f866-1b68-4074-8ea2-83c68b96b733 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:37.238891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06361984-aaec-4e29-a337-084fb5f993c9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:37.256193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06361984-aaec-4e29-a337-084fb5f993c9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:37.270303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06361984-aaec-4e29-a337-084fb5f993c9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:37.271210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06361984-aaec-4e29-a337-084fb5f993c9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:37.272013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06361984-aaec-4e29-a337-084fb5f993c9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:37.291148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06361984-aaec-4e29-a337-084fb5f993c9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:37.292016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06361984-aaec-4e29-a337-084fb5f993c9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:37.292820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06361984-aaec-4e29-a337-084fb5f993c9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:37.457891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-05d5f866-1b68-4074-8ea2-83c68b96b733 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:37.473695 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-05d5f866-1b68-4074-8ea2-83c68b96b733 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1390 microversion: 2.1 time: 0.431645 Aug 09 15:08:37.476388 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2855/5710] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:37 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1390 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:37.502533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3e78865c-0627-4492-ad6c-794cc42e35fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:37.504052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3e78865c-0627-4492-ad6c-794cc42e35fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:37.515703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e78865c-0627-4492-ad6c-794cc42e35fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:37.516839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e78865c-0627-4492-ad6c-794cc42e35fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:37.517856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e78865c-0627-4492-ad6c-794cc42e35fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:37.520033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e78865c-0627-4492-ad6c-794cc42e35fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:37.521252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e78865c-0627-4492-ad6c-794cc42e35fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:37.522287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e78865c-0627-4492-ad6c-794cc42e35fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:37.723424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-06361984-aaec-4e29-a337-084fb5f993c9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:37.757166 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06361984-aaec-4e29-a337-084fb5f993c9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1393 microversion: 2.1 time: 0.520978 Aug 09 15:08:37.758220 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2856/5711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:37 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1393 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:37.781076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a3e56724-723e-441c-a2a6-c6b300d3ee53 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:37.787765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a3e56724-723e-441c-a2a6-c6b300d3ee53 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:37.795451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3e56724-723e-441c-a2a6-c6b300d3ee53 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:37.796442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3e56724-723e-441c-a2a6-c6b300d3ee53 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:37.797251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3e56724-723e-441c-a2a6-c6b300d3ee53 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:37.798188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3e56724-723e-441c-a2a6-c6b300d3ee53 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:37.798837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3e56724-723e-441c-a2a6-c6b300d3ee53 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:37.799513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3e56724-723e-441c-a2a6-c6b300d3ee53 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:38.054967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3e78865c-0627-4492-ad6c-794cc42e35fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:38.083765 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3e78865c-0627-4492-ad6c-794cc42e35fb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1390 microversion: 2.1 time: 0.591308 Aug 09 15:08:38.084851 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2856/5712] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:37 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1390 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:38.243415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91be555c-9c63-4633-986c-52b8d98b8b05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:38.254661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91be555c-9c63-4633-986c-52b8d98b8b05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:38.272791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91be555c-9c63-4633-986c-52b8d98b8b05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:38.274389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91be555c-9c63-4633-986c-52b8d98b8b05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:38.275785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91be555c-9c63-4633-986c-52b8d98b8b05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:38.277647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91be555c-9c63-4633-986c-52b8d98b8b05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:38.278881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91be555c-9c63-4633-986c-52b8d98b8b05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:38.288897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91be555c-9c63-4633-986c-52b8d98b8b05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:38.375887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91be555c-9c63-4633-986c-52b8d98b8b05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:08:38.455344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a3e56724-723e-441c-a2a6-c6b300d3ee53 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:38.523256 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a3e56724-723e-441c-a2a6-c6b300d3ee53 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.761379 Aug 09 15:08:38.531610 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2857/5713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:37 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:38.565164 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91be555c-9c63-4633-986c-52b8d98b8b05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 204 len: 0 microversion: 2.1 time: 0.325540 Aug 09 15:08:38.572284 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2857/5714] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:08:38 2022] DELETE /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:08:38.582326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3722f8c6-ff2c-44c2-9caf-54469ce87a2c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:38.583508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3722f8c6-ff2c-44c2-9caf-54469ce87a2c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:38.623658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3722f8c6-ff2c-44c2-9caf-54469ce87a2c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:38.623658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3722f8c6-ff2c-44c2-9caf-54469ce87a2c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:38.623658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3722f8c6-ff2c-44c2-9caf-54469ce87a2c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:38.623658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3722f8c6-ff2c-44c2-9caf-54469ce87a2c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:38.623658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3722f8c6-ff2c-44c2-9caf-54469ce87a2c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:38.623658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3722f8c6-ff2c-44c2-9caf-54469ce87a2c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:38.785946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-687fe11f-2175-4936-ae40-68ba969e6db2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:38.788051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-687fe11f-2175-4936-ae40-68ba969e6db2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:38.836059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-687fe11f-2175-4936-ae40-68ba969e6db2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:38.853573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-687fe11f-2175-4936-ae40-68ba969e6db2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:38.855424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-687fe11f-2175-4936-ae40-68ba969e6db2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:38.857169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-687fe11f-2175-4936-ae40-68ba969e6db2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:38.858401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-687fe11f-2175-4936-ae40-68ba969e6db2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:38.859499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-687fe11f-2175-4936-ae40-68ba969e6db2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:38.932209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3722f8c6-ff2c-44c2-9caf-54469ce87a2c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:38.945744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:38.959930 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3722f8c6-ff2c-44c2-9caf-54469ce87a2c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1396 microversion: 2.1 time: 0.384957 Aug 09 15:08:38.960932 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2858/5715] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:38 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1396 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:38.982970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ce9e7095-c191-4e07-b485-cd18b0cd8e94 req-8dddbe1d-9427-467f-877e-a37199570a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f69872-0228-4e22-9375-4c882f72f742", "tag": "bf1a7c3c-6a1c-474c-8361-842291ae8347"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:39.009867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ce9e7095-c191-4e07-b485-cd18b0cd8e94 req-8dddbe1d-9427-467f-877e-a37199570a38 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:39.010932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ce9e7095-c191-4e07-b485-cd18b0cd8e94 req-8dddbe1d-9427-467f-877e-a37199570a38 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:39.011789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ce9e7095-c191-4e07-b485-cd18b0cd8e94 req-8dddbe1d-9427-467f-877e-a37199570a38 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:39.060356 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ce9e7095-c191-4e07-b485-cd18b0cd8e94 req-8dddbe1d-9427-467f-877e-a37199570a38 service nova] Creating event network-changed:bf1a7c3c-6a1c-474c-8361-842291ae8347 for instance d4f69872-0228-4e22-9375-4c882f72f742 on n-h2-844626-8 Aug 09 15:08:39.070119 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ce9e7095-c191-4e07-b485-cd18b0cd8e94 req-8dddbe1d-9427-467f-877e-a37199570a38 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091461 Aug 09 15:08:39.071968 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2859/5716] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:08:39.220359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-687fe11f-2175-4936-ae40-68ba969e6db2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:39.229753 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-687fe11f-2175-4936-ae40-68ba969e6db2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1393 microversion: 2.1 time: 0.454562 Aug 09 15:08:39.230129 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2858/5717] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:38 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1393 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:39.558460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd50e983-b96a-407f-9914-3ea593c87490 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:39.559722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd50e983-b96a-407f-9914-3ea593c87490 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:39.562565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:39.570445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd50e983-b96a-407f-9914-3ea593c87490 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:39.571778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd50e983-b96a-407f-9914-3ea593c87490 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:39.572725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd50e983-b96a-407f-9914-3ea593c87490 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:39.573971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd50e983-b96a-407f-9914-3ea593c87490 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:39.574804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd50e983-b96a-407f-9914-3ea593c87490 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:39.575553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd50e983-b96a-407f-9914-3ea593c87490 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:39.942311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7b1b08f-1f57-458a-8e55-6a9ffcdb5d44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:39.948906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7b1b08f-1f57-458a-8e55-6a9ffcdb5d44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:39.955755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7b1b08f-1f57-458a-8e55-6a9ffcdb5d44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:39.956259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7b1b08f-1f57-458a-8e55-6a9ffcdb5d44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:39.956700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7b1b08f-1f57-458a-8e55-6a9ffcdb5d44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:39.962131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7b1b08f-1f57-458a-8e55-6a9ffcdb5d44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:39.965065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7b1b08f-1f57-458a-8e55-6a9ffcdb5d44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:39.965936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7b1b08f-1f57-458a-8e55-6a9ffcdb5d44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:40.038482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd50e983-b96a-407f-9914-3ea593c87490 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:40.049926 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd50e983-b96a-407f-9914-3ea593c87490 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.498236 Aug 09 15:08:40.051401 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2860/5718] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:39 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:40.073651 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7b1b08f-1f57-458a-8e55-6a9ffcdb5d44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "POST /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc/action" status: 200 len: 24561 microversion: 2.1 time: 0.134582 Aug 09 15:08:40.076063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d14dd55-2d0f-4e2f-b43a-62dba4842ea9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:40.076938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d14dd55-2d0f-4e2f-b43a-62dba4842ea9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:40.079807 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2859/5719] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:08:39 2022] POST /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc/action => generated 24561 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:08:40.089177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d14dd55-2d0f-4e2f-b43a-62dba4842ea9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:40.090104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d14dd55-2d0f-4e2f-b43a-62dba4842ea9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:40.090811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d14dd55-2d0f-4e2f-b43a-62dba4842ea9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:40.091884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d14dd55-2d0f-4e2f-b43a-62dba4842ea9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:40.092562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d14dd55-2d0f-4e2f-b43a-62dba4842ea9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:40.093166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d14dd55-2d0f-4e2f-b43a-62dba4842ea9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:40.253821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-97951a64-d6c3-484b-8100-c34f70f842b6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:40.254844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-97951a64-d6c3-484b-8100-c34f70f842b6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:40.272857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97951a64-d6c3-484b-8100-c34f70f842b6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:40.275103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97951a64-d6c3-484b-8100-c34f70f842b6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:40.275898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97951a64-d6c3-484b-8100-c34f70f842b6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:40.277218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97951a64-d6c3-484b-8100-c34f70f842b6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:40.277861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97951a64-d6c3-484b-8100-c34f70f842b6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:40.278495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97951a64-d6c3-484b-8100-c34f70f842b6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:40.501229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d14dd55-2d0f-4e2f-b43a-62dba4842ea9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:40.514659 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d14dd55-2d0f-4e2f-b43a-62dba4842ea9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1396 microversion: 2.1 time: 0.450324 Aug 09 15:08:40.515219 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2861/5720] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:40 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1396 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:40.638688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-97951a64-d6c3-484b-8100-c34f70f842b6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:40.657922 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-97951a64-d6c3-484b-8100-c34f70f842b6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1393 microversion: 2.1 time: 0.409364 Aug 09 15:08:40.660156 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2860/5721] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:40 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1393 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:41.097710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7de148f-6a0f-4f1c-b000-c716579a6ad2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:41.101053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7de148f-6a0f-4f1c-b000-c716579a6ad2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:41.125279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7de148f-6a0f-4f1c-b000-c716579a6ad2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:41.131190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7de148f-6a0f-4f1c-b000-c716579a6ad2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:41.146978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7de148f-6a0f-4f1c-b000-c716579a6ad2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:41.148372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7de148f-6a0f-4f1c-b000-c716579a6ad2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:41.153677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7de148f-6a0f-4f1c-b000-c716579a6ad2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:41.156510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7de148f-6a0f-4f1c-b000-c716579a6ad2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:41.472522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7de148f-6a0f-4f1c-b000-c716579a6ad2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:41.493588 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7de148f-6a0f-4f1c-b000-c716579a6ad2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1485 microversion: 2.1 time: 0.407508 Aug 09 15:08:41.495101 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2861/5722] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:41 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1485 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:41.508823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3981fcf9-30b3-45f0-aa1c-66b70859abc2 req-88928b47-29eb-4a00-a9b6-46639aa6968d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011", "name": "network-vif-deleted", "tag": "2cea8391-0e11-488a-acf1-fd55b99ee13a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:41.519142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-962291bc-8989-442d-b9a2-6d3a786d0c61 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:41.520034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-962291bc-8989-442d-b9a2-6d3a786d0c61 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:41.531644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-962291bc-8989-442d-b9a2-6d3a786d0c61 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:41.532706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-962291bc-8989-442d-b9a2-6d3a786d0c61 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:41.533546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-962291bc-8989-442d-b9a2-6d3a786d0c61 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:41.534576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-962291bc-8989-442d-b9a2-6d3a786d0c61 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:41.535346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-962291bc-8989-442d-b9a2-6d3a786d0c61 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:41.535926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-962291bc-8989-442d-b9a2-6d3a786d0c61 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:41.546149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3981fcf9-30b3-45f0-aa1c-66b70859abc2 req-88928b47-29eb-4a00-a9b6-46639aa6968d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:41.546963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3981fcf9-30b3-45f0-aa1c-66b70859abc2 req-88928b47-29eb-4a00-a9b6-46639aa6968d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:41.547900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3981fcf9-30b3-45f0-aa1c-66b70859abc2 req-88928b47-29eb-4a00-a9b6-46639aa6968d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:41.600045 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3981fcf9-30b3-45f0-aa1c-66b70859abc2 req-88928b47-29eb-4a00-a9b6-46639aa6968d service nova] Creating event network-vif-deleted:2cea8391-0e11-488a-acf1-fd55b99ee13a for instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 on n-h2-844626-8 Aug 09 15:08:41.620922 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3981fcf9-30b3-45f0-aa1c-66b70859abc2 req-88928b47-29eb-4a00-a9b6-46639aa6968d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.662934 Aug 09 15:08:41.623056 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2862/5723] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:08:41.642737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-686ef73e-7119-4f64-820b-5c9ac20b7944 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:41.644537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-686ef73e-7119-4f64-820b-5c9ac20b7944 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:41.653268 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-962291bc-8989-442d-b9a2-6d3a786d0c61 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "POST /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150/action" status: 202 len: 0 microversion: 2.1 time: 0.139229 Aug 09 15:08:41.654730 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2862/5724] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:08:41 2022] POST /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 15:08:41.658334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686ef73e-7119-4f64-820b-5c9ac20b7944 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:41.658952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686ef73e-7119-4f64-820b-5c9ac20b7944 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:41.659764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686ef73e-7119-4f64-820b-5c9ac20b7944 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:41.660711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686ef73e-7119-4f64-820b-5c9ac20b7944 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:41.661394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686ef73e-7119-4f64-820b-5c9ac20b7944 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:41.662031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-686ef73e-7119-4f64-820b-5c9ac20b7944 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:41.680486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ab3b7b8-12ec-4967-a05e-3051054957c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:41.681922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ab3b7b8-12ec-4967-a05e-3051054957c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:41.685171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:41.724930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ab3b7b8-12ec-4967-a05e-3051054957c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:41.725760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ab3b7b8-12ec-4967-a05e-3051054957c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:41.729615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ab3b7b8-12ec-4967-a05e-3051054957c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:41.737551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ab3b7b8-12ec-4967-a05e-3051054957c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:41.740216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ab3b7b8-12ec-4967-a05e-3051054957c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:41.741256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ab3b7b8-12ec-4967-a05e-3051054957c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:41.744104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:41.778647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-686ef73e-7119-4f64-820b-5c9ac20b7944 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:41.794366 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-686ef73e-7119-4f64-820b-5c9ac20b7944 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1187 microversion: 2.1 time: 0.168225 Aug 09 15:08:41.796274 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2863/5725] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:41 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1187 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:41.814015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81b7da92-48d2-4972-b223-765ef6e26f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:41.816778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-81b7da92-48d2-4972-b223-765ef6e26f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:41.834344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81b7da92-48d2-4972-b223-765ef6e26f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:41.838185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81b7da92-48d2-4972-b223-765ef6e26f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:41.844510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81b7da92-48d2-4972-b223-765ef6e26f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:41.844510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81b7da92-48d2-4972-b223-765ef6e26f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:41.844510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81b7da92-48d2-4972-b223-765ef6e26f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:41.844510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81b7da92-48d2-4972-b223-765ef6e26f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:42.250045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ab3b7b8-12ec-4967-a05e-3051054957c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:42.256782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-81b7da92-48d2-4972-b223-765ef6e26f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:42.261909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:42.266574 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ab3b7b8-12ec-4967-a05e-3051054957c2 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1493 microversion: 2.1 time: 0.600074 Aug 09 15:08:42.267814 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2863/5726] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:41 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1493 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:42.272039 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81b7da92-48d2-4972-b223-765ef6e26f1a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1393 microversion: 2.1 time: 0.469157 Aug 09 15:08:42.272941 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2864/5727] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:41 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1393 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:42.833976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2e262e4-e0fa-4ed8-9290-69b574876da9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:42.836659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f2e262e4-e0fa-4ed8-9290-69b574876da9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:42.845553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2e262e4-e0fa-4ed8-9290-69b574876da9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:42.846168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2e262e4-e0fa-4ed8-9290-69b574876da9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:42.846467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2e262e4-e0fa-4ed8-9290-69b574876da9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:42.847199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2e262e4-e0fa-4ed8-9290-69b574876da9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:42.847648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2e262e4-e0fa-4ed8-9290-69b574876da9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:42.849461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2e262e4-e0fa-4ed8-9290-69b574876da9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:42.853777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:42.986405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f2e262e4-e0fa-4ed8-9290-69b574876da9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:42.996580 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f2e262e4-e0fa-4ed8-9290-69b574876da9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1187 microversion: 2.1 time: 0.169092 Aug 09 15:08:42.998091 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2864/5728] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:42 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1187 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:43.307032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7236248e-55f1-4002-b884-1489bb25220b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:43.310046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bba6bde-6c91-4c19-a8f5-2797e159e4eb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:43.314669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7236248e-55f1-4002-b884-1489bb25220b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:43.315460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8bba6bde-6c91-4c19-a8f5-2797e159e4eb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:43.328560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7236248e-55f1-4002-b884-1489bb25220b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:43.331396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7236248e-55f1-4002-b884-1489bb25220b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:43.332770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7236248e-55f1-4002-b884-1489bb25220b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:43.335713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7236248e-55f1-4002-b884-1489bb25220b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:43.336839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7236248e-55f1-4002-b884-1489bb25220b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:43.338187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7236248e-55f1-4002-b884-1489bb25220b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:43.341017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bba6bde-6c91-4c19-a8f5-2797e159e4eb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:43.355465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bba6bde-6c91-4c19-a8f5-2797e159e4eb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:43.355465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bba6bde-6c91-4c19-a8f5-2797e159e4eb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:43.355465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bba6bde-6c91-4c19-a8f5-2797e159e4eb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:43.355465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bba6bde-6c91-4c19-a8f5-2797e159e4eb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:43.355465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bba6bde-6c91-4c19-a8f5-2797e159e4eb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:43.763457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7236248e-55f1-4002-b884-1489bb25220b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:43.772337 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7236248e-55f1-4002-b884-1489bb25220b tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1493 microversion: 2.1 time: 0.487145 Aug 09 15:08:43.772940 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2865/5729] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:43 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1493 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:43.795841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8bba6bde-6c91-4c19-a8f5-2797e159e4eb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:43.804259 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8bba6bde-6c91-4c19-a8f5-2797e159e4eb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1393 microversion: 2.1 time: 0.502439 Aug 09 15:08:43.805222 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2865/5730] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:43 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1393 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:44.019454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ce3f2306-f675-438b-9467-6a19a52282a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:44.020302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ce3f2306-f675-438b-9467-6a19a52282a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:44.034667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce3f2306-f675-438b-9467-6a19a52282a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:44.037903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce3f2306-f675-438b-9467-6a19a52282a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:44.038708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce3f2306-f675-438b-9467-6a19a52282a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:44.039643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce3f2306-f675-438b-9467-6a19a52282a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:44.040252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce3f2306-f675-438b-9467-6a19a52282a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:44.040813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ce3f2306-f675-438b-9467-6a19a52282a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:44.181942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ce3f2306-f675-438b-9467-6a19a52282a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:44.206486 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ce3f2306-f675-438b-9467-6a19a52282a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1187 microversion: 2.1 time: 0.189962 Aug 09 15:08:44.208400 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2866/5731] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:44 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1187 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:44.799222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ea50c31-854c-432a-abd0-b702ab9c0809 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:44.800530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ea50c31-854c-432a-abd0-b702ab9c0809 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:44.830772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e36bf743-a528-4ec6-9151-22c39630e034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:44.834311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e36bf743-a528-4ec6-9151-22c39630e034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:44.835596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ea50c31-854c-432a-abd0-b702ab9c0809 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:44.840390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ea50c31-854c-432a-abd0-b702ab9c0809 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:44.841018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ea50c31-854c-432a-abd0-b702ab9c0809 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:44.841775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ea50c31-854c-432a-abd0-b702ab9c0809 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:44.842240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ea50c31-854c-432a-abd0-b702ab9c0809 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:44.842665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ea50c31-854c-432a-abd0-b702ab9c0809 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:44.867504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e36bf743-a528-4ec6-9151-22c39630e034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:44.868299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e36bf743-a528-4ec6-9151-22c39630e034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:44.868850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e36bf743-a528-4ec6-9151-22c39630e034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:44.869706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e36bf743-a528-4ec6-9151-22c39630e034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:44.870278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e36bf743-a528-4ec6-9151-22c39630e034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:44.870812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e36bf743-a528-4ec6-9151-22c39630e034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:45.236620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ea50c31-854c-432a-abd0-b702ab9c0809 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:45.255767 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ea50c31-854c-432a-abd0-b702ab9c0809 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1499 microversion: 2.1 time: 0.464626 Aug 09 15:08:45.270695 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2866/5732] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:44 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1499 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:45.291611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a08dc4a8-4193-44b6-808a-964e8a674089 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:45.293040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a08dc4a8-4193-44b6-808a-964e8a674089 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:45.319255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a08dc4a8-4193-44b6-808a-964e8a674089 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:45.320099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a08dc4a8-4193-44b6-808a-964e8a674089 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:45.321678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a08dc4a8-4193-44b6-808a-964e8a674089 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:45.323262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a08dc4a8-4193-44b6-808a-964e8a674089 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:45.324172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a08dc4a8-4193-44b6-808a-964e8a674089 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:45.324952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a08dc4a8-4193-44b6-808a-964e8a674089 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:45.360089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e36bf743-a528-4ec6-9151-22c39630e034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:45.370123 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e36bf743-a528-4ec6-9151-22c39630e034 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1393 microversion: 2.1 time: 0.547436 Aug 09 15:08:45.385579 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2867/5733] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:44 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1393 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:45.395636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b056a1de-0c2f-4400-8f34-af52ca4e3f50 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:45.396863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b056a1de-0c2f-4400-8f34-af52ca4e3f50 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:45.412506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b056a1de-0c2f-4400-8f34-af52ca4e3f50 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:45.413334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b056a1de-0c2f-4400-8f34-af52ca4e3f50 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:45.414292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b056a1de-0c2f-4400-8f34-af52ca4e3f50 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:45.415404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b056a1de-0c2f-4400-8f34-af52ca4e3f50 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:45.416236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b056a1de-0c2f-4400-8f34-af52ca4e3f50 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:45.416851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b056a1de-0c2f-4400-8f34-af52ca4e3f50 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:45.460151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b056a1de-0c2f-4400-8f34-af52ca4e3f50 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:08:45.477361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a08dc4a8-4193-44b6-808a-964e8a674089 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:45.485792 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a08dc4a8-4193-44b6-808a-964e8a674089 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1187 microversion: 2.1 time: 0.213226 Aug 09 15:08:45.486392 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2867/5734] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:45 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1187 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:45.653667 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b056a1de-0c2f-4400-8f34-af52ca4e3f50 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "DELETE /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 204 len: 0 microversion: 2.1 time: 0.262439 Aug 09 15:08:45.654819 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2868/5735] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:08:45 2022] DELETE /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:08:45.663416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cceb9292-b521-48c9-9e1a-1381b863bf0e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:45.664298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cceb9292-b521-48c9-9e1a-1381b863bf0e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:45.671478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cceb9292-b521-48c9-9e1a-1381b863bf0e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:45.672275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cceb9292-b521-48c9-9e1a-1381b863bf0e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:45.672863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cceb9292-b521-48c9-9e1a-1381b863bf0e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:45.673765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cceb9292-b521-48c9-9e1a-1381b863bf0e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:45.674374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cceb9292-b521-48c9-9e1a-1381b863bf0e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:45.674944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cceb9292-b521-48c9-9e1a-1381b863bf0e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:45.884970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cceb9292-b521-48c9-9e1a-1381b863bf0e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:45.897834 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cceb9292-b521-48c9-9e1a-1381b863bf0e tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.238412 Aug 09 15:08:45.899418 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2868/5736] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:45 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:46.266803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-915a221d-14e9-43d6-8a74-0306a539c7f4 req-c97b804f-5081-4455-865a-5b16f6cbf8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f69872-0228-4e22-9375-4c882f72f742", "name": "network-vif-plugged", "status": "completed", "tag": "bf1a7c3c-6a1c-474c-8361-842291ae8347"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:46.292429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-915a221d-14e9-43d6-8a74-0306a539c7f4 req-c97b804f-5081-4455-865a-5b16f6cbf8ae service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:46.315999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-915a221d-14e9-43d6-8a74-0306a539c7f4 req-c97b804f-5081-4455-865a-5b16f6cbf8ae service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:46.316872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-915a221d-14e9-43d6-8a74-0306a539c7f4 req-c97b804f-5081-4455-865a-5b16f6cbf8ae service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:46.350759 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-915a221d-14e9-43d6-8a74-0306a539c7f4 req-c97b804f-5081-4455-865a-5b16f6cbf8ae service nova] Creating event network-vif-plugged:bf1a7c3c-6a1c-474c-8361-842291ae8347 for instance d4f69872-0228-4e22-9375-4c882f72f742 on n-h2-844626-8 Aug 09 15:08:46.357944 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-915a221d-14e9-43d6-8a74-0306a539c7f4 req-c97b804f-5081-4455-865a-5b16f6cbf8ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104578 Aug 09 15:08:46.359465 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2869/5737] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:08:46.393747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9872dcc5-5a16-4ce8-a614-6bfd1f8503ee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:46.394727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9872dcc5-5a16-4ce8-a614-6bfd1f8503ee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:46.414187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9872dcc5-5a16-4ce8-a614-6bfd1f8503ee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:46.416243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9872dcc5-5a16-4ce8-a614-6bfd1f8503ee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:46.417227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9872dcc5-5a16-4ce8-a614-6bfd1f8503ee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:46.418893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9872dcc5-5a16-4ce8-a614-6bfd1f8503ee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:46.419701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9872dcc5-5a16-4ce8-a614-6bfd1f8503ee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:46.420510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9872dcc5-5a16-4ce8-a614-6bfd1f8503ee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:46.510234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a5d1b10-d86f-49c6-b901-a1cbc02b007f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:46.511401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0a5d1b10-d86f-49c6-b901-a1cbc02b007f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:46.520644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a5d1b10-d86f-49c6-b901-a1cbc02b007f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:46.521236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a5d1b10-d86f-49c6-b901-a1cbc02b007f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:46.521741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a5d1b10-d86f-49c6-b901-a1cbc02b007f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:46.522556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a5d1b10-d86f-49c6-b901-a1cbc02b007f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:46.523061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a5d1b10-d86f-49c6-b901-a1cbc02b007f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:46.523755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0a5d1b10-d86f-49c6-b901-a1cbc02b007f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:46.644239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0a5d1b10-d86f-49c6-b901-a1cbc02b007f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:46.663363 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0a5d1b10-d86f-49c6-b901-a1cbc02b007f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1187 microversion: 2.1 time: 0.156870 Aug 09 15:08:46.674190 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2870/5738] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:46 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1187 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:46.716309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9872dcc5-5a16-4ce8-a614-6bfd1f8503ee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:46.727317 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9872dcc5-5a16-4ce8-a614-6bfd1f8503ee tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1393 microversion: 2.1 time: 0.338147 Aug 09 15:08:46.728114 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2869/5739] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:46 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1393 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:46.924900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64ab5af1-7467-4db5-b18f-199e185554ba tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:46.925884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-64ab5af1-7467-4db5-b18f-199e185554ba tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:46.935680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64ab5af1-7467-4db5-b18f-199e185554ba tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:46.936887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64ab5af1-7467-4db5-b18f-199e185554ba tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:46.937821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64ab5af1-7467-4db5-b18f-199e185554ba tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:46.939120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64ab5af1-7467-4db5-b18f-199e185554ba tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:46.940013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64ab5af1-7467-4db5-b18f-199e185554ba tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:46.940821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64ab5af1-7467-4db5-b18f-199e185554ba tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:47.253514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-64ab5af1-7467-4db5-b18f-199e185554ba tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:47.269366 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-64ab5af1-7467-4db5-b18f-199e185554ba tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.349902 Aug 09 15:08:47.271691 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2871/5740] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:46 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:47.617213 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:08:47.618376 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:08:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:08:47.689906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a90df58b-5197-40aa-84e3-05139c64aa63 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:47.692538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a90df58b-5197-40aa-84e3-05139c64aa63 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:47.724606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a90df58b-5197-40aa-84e3-05139c64aa63 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:47.725253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a90df58b-5197-40aa-84e3-05139c64aa63 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:47.725716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a90df58b-5197-40aa-84e3-05139c64aa63 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:47.732398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a90df58b-5197-40aa-84e3-05139c64aa63 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:47.733048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a90df58b-5197-40aa-84e3-05139c64aa63 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:47.733517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a90df58b-5197-40aa-84e3-05139c64aa63 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:47.768085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df4c2ba1-e83a-43af-a361-bcd45999f35e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:47.772904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df4c2ba1-e83a-43af-a361-bcd45999f35e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:47.791116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4c2ba1-e83a-43af-a361-bcd45999f35e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:47.792146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4c2ba1-e83a-43af-a361-bcd45999f35e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:47.792801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4c2ba1-e83a-43af-a361-bcd45999f35e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:47.794090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4c2ba1-e83a-43af-a361-bcd45999f35e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:47.794819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4c2ba1-e83a-43af-a361-bcd45999f35e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:47.795567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-df4c2ba1-e83a-43af-a361-bcd45999f35e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:47.831489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a90df58b-5197-40aa-84e3-05139c64aa63 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:47.841016 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a90df58b-5197-40aa-84e3-05139c64aa63 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1187 microversion: 2.1 time: 0.158405 Aug 09 15:08:47.842174 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2870/5741] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:47 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1187 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:48.293928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8b0e0e6-71ec-45b7-bcbd-a8b80ca5df38 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:48.294825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8b0e0e6-71ec-45b7-bcbd-a8b80ca5df38 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:48.302901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b0e0e6-71ec-45b7-bcbd-a8b80ca5df38 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:48.303858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b0e0e6-71ec-45b7-bcbd-a8b80ca5df38 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:48.304710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b0e0e6-71ec-45b7-bcbd-a8b80ca5df38 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:48.305822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b0e0e6-71ec-45b7-bcbd-a8b80ca5df38 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:48.306668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b0e0e6-71ec-45b7-bcbd-a8b80ca5df38 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:48.307687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b0e0e6-71ec-45b7-bcbd-a8b80ca5df38 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:48.804429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-df4c2ba1-e83a-43af-a361-bcd45999f35e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:48.814369 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df4c2ba1-e83a-43af-a361-bcd45999f35e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1393 microversion: 2.1 time: 1.056155 Aug 09 15:08:48.834027 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2872/5742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:47 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1393 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:48.883478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:48.884177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:48.910634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:48.918377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:48.918876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:48.920303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:48.922615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:48.923817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:48.924791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f8b0e0e6-71ec-45b7-bcbd-a8b80ca5df38 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:48.933235 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8b0e0e6-71ec-45b7-bcbd-a8b80ca5df38 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1505 microversion: 2.1 time: 0.643613 Aug 09 15:08:48.943417 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2871/5743] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:48 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1505 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:49.086156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:49.086925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:49.087700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:49.088525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lazy-loading 'fault' on Instance uuid b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:08:49.201035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:49.209554 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4fbf32fc-bebf-4910-9e94-ea4566769104 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 200 len: 1146 microversion: 2.1 time: 0.337826 Aug 09 15:08:49.210162 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2873/5744] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:48 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 1146 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:49.551119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5edb877b-e860-4f8d-8c10-165dec64ad8b req-fc94bc2b-90eb-469e-bdc6-f72dff62a88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcbfdaea-fc59-4a69-8de6-4c48a477a150", "name": "network-vif-deleted", "tag": "b20da0ff-f9d3-45c8-a5c6-394da9a531ad"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:49.573660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5edb877b-e860-4f8d-8c10-165dec64ad8b req-fc94bc2b-90eb-469e-bdc6-f72dff62a88b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:49.578013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5edb877b-e860-4f8d-8c10-165dec64ad8b req-fc94bc2b-90eb-469e-bdc6-f72dff62a88b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:49.578670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5edb877b-e860-4f8d-8c10-165dec64ad8b req-fc94bc2b-90eb-469e-bdc6-f72dff62a88b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:49.617845 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5edb877b-e860-4f8d-8c10-165dec64ad8b req-fc94bc2b-90eb-469e-bdc6-f72dff62a88b service nova] Creating event network-vif-deleted:b20da0ff-f9d3-45c8-a5c6-394da9a531ad for instance bcbfdaea-fc59-4a69-8de6-4c48a477a150 on n-h1-844626-8 Aug 09 15:08:49.624318 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5edb877b-e860-4f8d-8c10-165dec64ad8b req-fc94bc2b-90eb-469e-bdc6-f72dff62a88b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079904 Aug 09 15:08:49.629737 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2872/5745] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:08:49.856962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-56301661-2236-4e62-af3f-7456d130121e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:49.862871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-56301661-2236-4e62-af3f-7456d130121e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:49.880997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56301661-2236-4e62-af3f-7456d130121e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:49.883814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56301661-2236-4e62-af3f-7456d130121e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:49.886001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56301661-2236-4e62-af3f-7456d130121e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:49.889494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56301661-2236-4e62-af3f-7456d130121e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:49.890490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56301661-2236-4e62-af3f-7456d130121e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:49.891437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56301661-2236-4e62-af3f-7456d130121e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:49.958686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:49.960084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:49.978696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:49.986110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:49.986839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:49.987825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:49.988456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:49.989041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:50.100298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:50.101049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:50.101657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:50.103294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lazy-loading 'fault' on Instance uuid bcbfdaea-fc59-4a69-8de6-4c48a477a150 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:08:50.308801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:50.331828 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee66a54a-2e6a-407d-9266-e04e976fa80f tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 200 len: 1303 microversion: 2.1 time: 0.375880 Aug 09 15:08:50.333940 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2873/5746] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:49 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 1303 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:50.343137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0e3f0b8d-dbea-4d3c-af29-76a2cd7b1d69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:50.344848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0e3f0b8d-dbea-4d3c-af29-76a2cd7b1d69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:50.358846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e3f0b8d-dbea-4d3c-af29-76a2cd7b1d69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:50.360241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e3f0b8d-dbea-4d3c-af29-76a2cd7b1d69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:50.362402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e3f0b8d-dbea-4d3c-af29-76a2cd7b1d69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:50.364068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e3f0b8d-dbea-4d3c-af29-76a2cd7b1d69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:50.365235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e3f0b8d-dbea-4d3c-af29-76a2cd7b1d69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:50.366330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e3f0b8d-dbea-4d3c-af29-76a2cd7b1d69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:50.388433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-56301661-2236-4e62-af3f-7456d130121e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:50.411061 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-0e3f0b8d-dbea-4d3c-af29-76a2cd7b1d69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:50.413115 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-56301661-2236-4e62-af3f-7456d130121e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1566 microversion: 2.1 time: 0.565895 Aug 09 15:08:50.413753 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2874/5747] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:49 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1566 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0e3f0b8d-dbea-4d3c-af29-76a2cd7b1d69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 HTTP/1.1 Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011'} Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:08:50.415860 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:50.420006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:50.420006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:08:50.420006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:08:50.420006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:08:50.420006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:08:50.420006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:50.420006 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:50.420006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0e3f0b8d-dbea-4d3c-af29-76a2cd7b1d69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:08:50.420006 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0e3f0b8d-dbea-4d3c-af29-76a2cd7b1d69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 404 len: 111 microversion: 2.1 time: 0.082238 Aug 09 15:08:50.420006 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2874/5748] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:50 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:08:50.434629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efd14054-c159-49a1-981e-e0507250c23d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:50.435596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-efd14054-c159-49a1-981e-e0507250c23d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:50.445544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efd14054-c159-49a1-981e-e0507250c23d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:50.446198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efd14054-c159-49a1-981e-e0507250c23d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:50.447143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efd14054-c159-49a1-981e-e0507250c23d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:50.448051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efd14054-c159-49a1-981e-e0507250c23d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:50.449137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efd14054-c159-49a1-981e-e0507250c23d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:50.450202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efd14054-c159-49a1-981e-e0507250c23d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:50.477427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:08:50.644512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-efd14054-c159-49a1-981e-e0507250c23d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:50.653557 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-efd14054-c159-49a1-981e-e0507250c23d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1566 microversion: 2.1 time: 0.223202 Aug 09 15:08:50.663593 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2875/5749] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:50 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:51.364357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06b506a7-1059-4bcb-9167-68a533546f33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:51.365442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-06b506a7-1059-4bcb-9167-68a533546f33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: bcbfdaea-fc59-4a69-8de6-4c48a477a150] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:51.395359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06b506a7-1059-4bcb-9167-68a533546f33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:51.396220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06b506a7-1059-4bcb-9167-68a533546f33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:51.398855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06b506a7-1059-4bcb-9167-68a533546f33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:51.401668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06b506a7-1059-4bcb-9167-68a533546f33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:51.411475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06b506a7-1059-4bcb-9167-68a533546f33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:51.412850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06b506a7-1059-4bcb-9167-68a533546f33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:51.508594 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-06b506a7-1059-4bcb-9167-68a533546f33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] HTTP exception thrown: Instance bcbfdaea-fc59-4a69-8de6-4c48a477a150 could not be found. Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06b506a7-1059-4bcb-9167-68a533546f33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Request method failure captured: Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 HTTP/1.1 Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8ngKfDOAZCRJNY2kf0iMmJMShEn64ppfIdt77xM9Lgts1tEyKDynYPLiu_BpBtCR4TGxVyixwGhRQyPTgYiZjh5g42IwUvhCOUkpB-5524Jv639_T6ebd0diTy8HwEiTqbf5Jq8li-uJHIIFkVMotEX3cdEUMqaeXkXs688vP1KjywE Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 97e991340cea46afb3937ddb5e4402ef Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerRescueTestJSON-331963000 Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_97e991340cea46afb3937ddb5e4402ef", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/97e991340cea46afb3937ddb5e4402ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97e991340cea46afb3937ddb5e4402ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97e991340cea46afb3937ddb5e4402ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerRescueTestJSON-331963000 Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 97e991340cea46afb3937ddb5e4402ef Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerRescueTestJSON-331963000 Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerRescueTestJSON-331963000-project Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: ae70e5a181dc4d079015a0c7c1a2154e Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerRescueTestJSON-331963000-project Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance bcbfdaea-fc59-4a69-8de6-4c48a477a150 could not be found. Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'bcbfdaea-fc59-4a69-8de6-4c48a477a150'} Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcbfdaea-fc59-4a69-8de6-4c48a477a150 could not be found. Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcbfdaea-fc59-4a69-8de6-4c48a477a150 could not be found. Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:08:51.517928 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:51.522651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:51.522651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:08:51.522651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:08:51.522651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:08:51.522651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:08:51.522651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcbfdaea-fc59-4a69-8de6-4c48a477a150 could not be found. Aug 09 15:08:51.522651 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:08:51.522651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06b506a7-1059-4bcb-9167-68a533546f33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Returning 404 to user: Instance bcbfdaea-fc59-4a69-8de6-4c48a477a150 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:08:51.526857 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-06b506a7-1059-4bcb-9167-68a533546f33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150" status: 404 len: 111 microversion: 2.1 time: 0.166739 Aug 09 15:08:51.532424 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2875/5750] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:51 2022] GET /compute/v2.1/servers/bcbfdaea-fc59-4a69-8de6-4c48a477a150 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:08:51.549075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6da5c70c-931b-43c8-95af-8d894f319f65 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:51.549909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6da5c70c-931b-43c8-95af-8d894f319f65 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:51.601387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6da5c70c-931b-43c8-95af-8d894f319f65 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:51.608752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6da5c70c-931b-43c8-95af-8d894f319f65 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:51.610670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6da5c70c-931b-43c8-95af-8d894f319f65 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:51.622427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6da5c70c-931b-43c8-95af-8d894f319f65 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:51.641920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6da5c70c-931b-43c8-95af-8d894f319f65 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:51.646574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6da5c70c-931b-43c8-95af-8d894f319f65 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:51.724703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6da5c70c-931b-43c8-95af-8d894f319f65 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:08:51.985516 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6da5c70c-931b-43c8-95af-8d894f319f65 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 204 len: 0 microversion: 2.1 time: 0.446373 Aug 09 15:08:51.989264 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2876/5751] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:08:51 2022] DELETE /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:08:52.002595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e792db9-906b-466e-b54f-27aea227aaac tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:52.004008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5e792db9-906b-466e-b54f-27aea227aaac tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:52.030489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e792db9-906b-466e-b54f-27aea227aaac tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:52.036798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e792db9-906b-466e-b54f-27aea227aaac tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:52.037268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e792db9-906b-466e-b54f-27aea227aaac tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:52.041140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e792db9-906b-466e-b54f-27aea227aaac tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:52.042604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e792db9-906b-466e-b54f-27aea227aaac tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:52.043158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e792db9-906b-466e-b54f-27aea227aaac tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:52.284302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5e792db9-906b-466e-b54f-27aea227aaac tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:52.313631 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5e792db9-906b-466e-b54f-27aea227aaac tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1492 microversion: 2.1 time: 0.319562 Aug 09 15:08:52.315577 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2876/5752] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:51 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1492 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:53.377939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f545ca1a-9982-41cb-99d5-7a097a05df47 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:53.385434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f545ca1a-9982-41cb-99d5-7a097a05df47 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:53.407976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f545ca1a-9982-41cb-99d5-7a097a05df47 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:53.408780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f545ca1a-9982-41cb-99d5-7a097a05df47 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:53.409750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f545ca1a-9982-41cb-99d5-7a097a05df47 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:53.419382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f545ca1a-9982-41cb-99d5-7a097a05df47 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:53.420267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f545ca1a-9982-41cb-99d5-7a097a05df47 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:53.420922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f545ca1a-9982-41cb-99d5-7a097a05df47 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:53.706232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f545ca1a-9982-41cb-99d5-7a097a05df47 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:53.714901 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f545ca1a-9982-41cb-99d5-7a097a05df47 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1492 microversion: 2.1 time: 0.357172 Aug 09 15:08:53.716259 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2877/5753] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:53 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1492 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:08:54.744225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6bd393e0-60a8-4652-938e-9301daf736ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:54.751717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6bd393e0-60a8-4652-938e-9301daf736ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:54.774330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bd393e0-60a8-4652-938e-9301daf736ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:54.774867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bd393e0-60a8-4652-938e-9301daf736ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:54.775535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bd393e0-60a8-4652-938e-9301daf736ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:54.776341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bd393e0-60a8-4652-938e-9301daf736ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:54.776869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bd393e0-60a8-4652-938e-9301daf736ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:54.778718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6bd393e0-60a8-4652-938e-9301daf736ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:54.994206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-77183520-8cbe-4b4a-8c76-04afb385d059 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:54.995356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-77183520-8cbe-4b4a-8c76-04afb385d059 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:55.007503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77183520-8cbe-4b4a-8c76-04afb385d059 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:55.008400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77183520-8cbe-4b4a-8c76-04afb385d059 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:55.009203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77183520-8cbe-4b4a-8c76-04afb385d059 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:55.010451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77183520-8cbe-4b4a-8c76-04afb385d059 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:55.011315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77183520-8cbe-4b4a-8c76-04afb385d059 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:55.013480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77183520-8cbe-4b4a-8c76-04afb385d059 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:55.056770 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-77183520-8cbe-4b4a-8c76-04afb385d059 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-77183520-8cbe-4b4a-8c76-04afb385d059 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 HTTP/1.1 Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011'} Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:08:55.059028 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:08:55.062789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:55.062789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:55.062789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:08:55.062789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:55.062789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:55.062789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:08:55.062789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:08:55.062789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:08:55.062789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:08:55.062789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:55.062789 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:55.068076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-77183520-8cbe-4b4a-8c76-04afb385d059 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:08:55.072108 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-77183520-8cbe-4b4a-8c76-04afb385d059 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 404 len: 111 microversion: 2.1 time: 0.084269 Aug 09 15:08:55.075614 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2878/5754] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:08:54 2022] DELETE /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:08:55.087816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-46b0c63e-6daf-443c-8d31-0b628f081d1f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:55.093137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-46b0c63e-6daf-443c-8d31-0b628f081d1f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:55.110232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46b0c63e-6daf-443c-8d31-0b628f081d1f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:55.114575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46b0c63e-6daf-443c-8d31-0b628f081d1f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:55.115995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46b0c63e-6daf-443c-8d31-0b628f081d1f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:55.121789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46b0c63e-6daf-443c-8d31-0b628f081d1f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:55.124609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46b0c63e-6daf-443c-8d31-0b628f081d1f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:55.126624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46b0c63e-6daf-443c-8d31-0b628f081d1f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:55.207422 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-46b0c63e-6daf-443c-8d31-0b628f081d1f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-46b0c63e-6daf-443c-8d31-0b628f081d1f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 HTTP/1.1 Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011'} Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:08:55.209576 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:55.215061 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:55.215061 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:08:55.215061 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:08:55.215061 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:08:55.215061 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:08:55.215061 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. Aug 09 15:08:55.215061 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:55.215061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-46b0c63e-6daf-443c-8d31-0b628f081d1f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:08:55.219113 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-46b0c63e-6daf-443c-8d31-0b628f081d1f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011" status: 404 len: 111 microversion: 2.1 time: 0.131384 Aug 09 15:08:55.219113 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2879/5755] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:55 2022] GET /compute/v2.1/servers/b9d1ffd5-d7b1-484c-bbb6-b2ad9f0a3011 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:08:55.397192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6bd393e0-60a8-4652-938e-9301daf736ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:55.419926 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6bd393e0-60a8-4652-938e-9301daf736ee tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1492 microversion: 2.1 time: 0.685215 Aug 09 15:08:55.426051 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2877/5756] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:54 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1492 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:55.725095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7145dfb-8d49-48fd-8823-d433af917d7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:55.726219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e7145dfb-8d49-48fd-8823-d433af917d7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:55.744828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7145dfb-8d49-48fd-8823-d433af917d7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:55.746831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7145dfb-8d49-48fd-8823-d433af917d7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:55.747614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7145dfb-8d49-48fd-8823-d433af917d7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:55.759178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7145dfb-8d49-48fd-8823-d433af917d7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:55.760269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7145dfb-8d49-48fd-8823-d433af917d7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:55.760428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e784d92e-afd0-4c87-810e-87b4aa0d7382 req-8933cec3-dc47-4bd1-b241-21a3fe99ead4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f69872-0228-4e22-9375-4c882f72f742", "tag": "bf1a7c3c-6a1c-474c-8361-842291ae8347"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:55.763044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7145dfb-8d49-48fd-8823-d433af917d7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:55.789932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e784d92e-afd0-4c87-810e-87b4aa0d7382 req-8933cec3-dc47-4bd1-b241-21a3fe99ead4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:55.790417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e784d92e-afd0-4c87-810e-87b4aa0d7382 req-8933cec3-dc47-4bd1-b241-21a3fe99ead4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:55.790855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e784d92e-afd0-4c87-810e-87b4aa0d7382 req-8933cec3-dc47-4bd1-b241-21a3fe99ead4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:55.849030 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e784d92e-afd0-4c87-810e-87b4aa0d7382 req-8933cec3-dc47-4bd1-b241-21a3fe99ead4 service nova] Creating event network-changed:bf1a7c3c-6a1c-474c-8361-842291ae8347 for instance d4f69872-0228-4e22-9375-4c882f72f742 on n-h2-844626-8 Aug 09 15:08:55.861148 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e784d92e-afd0-4c87-810e-87b4aa0d7382 req-8933cec3-dc47-4bd1-b241-21a3fe99ead4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104370 Aug 09 15:08:55.861742 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2878/5757] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:08:56.344252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7a509520-f977-4349-b26c-ba4a3f549849 req-cd80f805-f255-40c5-8de5-54314645dd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1", "name": "network-vif-deleted", "tag": "91063dcb-f7ed-4ec6-9d32-907a7080a9dd"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:56.397976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7a509520-f977-4349-b26c-ba4a3f549849 req-cd80f805-f255-40c5-8de5-54314645dd68 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:56.398922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7a509520-f977-4349-b26c-ba4a3f549849 req-cd80f805-f255-40c5-8de5-54314645dd68 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:56.400918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7a509520-f977-4349-b26c-ba4a3f549849 req-cd80f805-f255-40c5-8de5-54314645dd68 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:56.448251 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7a509520-f977-4349-b26c-ba4a3f549849 req-cd80f805-f255-40c5-8de5-54314645dd68 service nova] Creating event network-vif-deleted:91063dcb-f7ed-4ec6-9d32-907a7080a9dd for instance ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 on n-h2-844626-8 Aug 09 15:08:56.462121 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7a509520-f977-4349-b26c-ba4a3f549849 req-cd80f805-f255-40c5-8de5-54314645dd68 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123058 Aug 09 15:08:56.467060 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2879/5758] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:08:56.481939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:56.484938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:56.510417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:56.516095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:56.516929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:56.518153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:56.530397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:56.532396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:56.566004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e7145dfb-8d49-48fd-8823-d433af917d7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:56.584654 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e7145dfb-8d49-48fd-8823-d433af917d7f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1566 microversion: 2.1 time: 0.855568 Aug 09 15:08:56.600608 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2880/5759] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:55 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1566 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:56.628250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:56.630398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:56.632228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:56.632882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lazy-loading 'fault' on Instance uuid ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:08:56.811947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae70e5a181dc4d079015a0c7c1a2154e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e991340cea46afb3937ddb5e4402ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:08:56.824855 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-56e5c07a-cc1f-40e2-9da3-ec81be970c33 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 200 len: 1303 microversion: 2.1 time: 0.356167 Aug 09 15:08:56.825808 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2880/5760] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:56 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 1303 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:08:57.854552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf895cfa-60c1-423f-a107-99b2b9349985 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:08:57.855887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf895cfa-60c1-423f-a107-99b2b9349985 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] [instance: ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:08:57.869861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf895cfa-60c1-423f-a107-99b2b9349985 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:57.875437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf895cfa-60c1-423f-a107-99b2b9349985 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:57.876147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf895cfa-60c1-423f-a107-99b2b9349985 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:57.877620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf895cfa-60c1-423f-a107-99b2b9349985 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:08:57.881184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf895cfa-60c1-423f-a107-99b2b9349985 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:08:57.884407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf895cfa-60c1-423f-a107-99b2b9349985 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:08:57.899705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-819b3f9f-9b82-4172-89ff-16953e5ed6cc tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Action: 'create', calling method: .version_select at 0x7f41ddd96430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1553863038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3ueS0+11RqDerX3p+6Fm7MOjDiaEwMngCDdI8X8vbWhafZSE3xjMQGAFQPSB7NaPG6v0zwqTN+Ox/wX0xVgOP+TifY3UOcRWoNsRh9OQVNqJdAP0uRojSkvVm60Z/PuQ=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:08:57.953384 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-bf895cfa-60c1-423f-a107-99b2b9349985 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] HTTP exception thrown: Instance ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 could not be found. Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf895cfa-60c1-423f-a107-99b2b9349985 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Request method failure captured: Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 HTTP/1.1 Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8ngKfDOAZCRJNY2kf0iMmJMShEn64ppfIdt77xM9Lgts1tEyKDynYPLiu_BpBtCR4TGxVyixwGhRQyPTgYiZjh5g42IwUvhCOUkpB-5524Jv639_T6ebd0diTy8HwEiTqbf5Jq8li-uJHIIFkVMotEX3cdEUMqaeXkXs688vP1KjywE Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 97e991340cea46afb3937ddb5e4402ef Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerRescueTestJSON-331963000 Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_97e991340cea46afb3937ddb5e4402ef", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/97e991340cea46afb3937ddb5e4402ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97e991340cea46afb3937ddb5e4402ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/97e991340cea46afb3937ddb5e4402ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerRescueTestJSON-331963000 Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 97e991340cea46afb3937ddb5e4402ef Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerRescueTestJSON-331963000 Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerRescueTestJSON-331963000-project Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: ae70e5a181dc4d079015a0c7c1a2154e Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerRescueTestJSON-331963000-project Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 could not be found. Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1'} Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 could not be found. Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 could not be found. Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:08:57.959913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:57.964920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:08:57.964920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:08:57.964920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:08:57.964920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:08:57.964920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:08:57.964920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 could not be found. Aug 09 15:08:57.964920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:08:57.964920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf895cfa-60c1-423f-a107-99b2b9349985 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] Returning 404 to user: Instance ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:08:57.964920 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf895cfa-60c1-423f-a107-99b2b9349985 tempest-ServerRescueTestJSON-331963000 tempest-ServerRescueTestJSON-331963000-project] 10.222.0.50 "GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1" status: 404 len: 111 microversion: 2.1 time: 0.113302 Aug 09 15:08:57.964920 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2881/5761] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:08:57 2022] GET /compute/v2.1/servers/ef0e47de-2b54-48f6-b9bf-8925bdd6f6f1 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:08:57.973954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-819b3f9f-9b82-4172-89ff-16953e5ed6cc tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Getting quotas for project f459e237ba2d464c8feeb733393804a9. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:08:57.992550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-819b3f9f-9b82-4172-89ff-16953e5ed6cc tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Getting quotas for user 7808d57a047f4fdfa852f71ff632619a and project f459e237ba2d464c8feeb733393804a9. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:08:58.041657 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-819b3f9f-9b82-4172-89ff-16953e5ed6cc tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.146976 Aug 09 15:08:58.042457 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2881/5762] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:08:57 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:09:00.850019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1133229462", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "31b26651-7281-4a38-a014-fea53c84d002"}], "key_name": "tempest-TestNetworkBasicOps-1553863038", "security_groups": [{"name": "tempest-secgroup-smoke-641427745"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:01.263984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] validate_networks() for [('31b26651-7281-4a38-a014-fea53c84d002', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:09:02.388904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:09:02.389507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:09:02.390207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:09:02.390877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:09:02.391626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:09:02.410653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:02.414239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:02.415318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:02.416393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:02.418084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:02.420979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:02.486358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Getting quotas for project f459e237ba2d464c8feeb733393804a9. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:09:02.499922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Getting quotas for user 7808d57a047f4fdfa852f71ff632619a and project f459e237ba2d464c8feeb733393804a9. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:09:02.540014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:09:02.542433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:09:02.644621 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c95eef2c-ef02-4461-89ad-c6b799ae7fad tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.794076 Aug 09 15:09:02.646056 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2882/5763] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:09:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:09:02.657049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4dbcd20-e31a-49bd-82d1-e800e53afb44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:02.657736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4dbcd20-e31a-49bd-82d1-e800e53afb44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:02.660874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:02.787648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c4dbcd20-e31a-49bd-82d1-e800e53afb44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:02.798720 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4dbcd20-e31a-49bd-82d1-e800e53afb44 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1249 microversion: 2.1 time: 0.144941 Aug 09 15:09:02.799995 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2882/5764] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:02 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1249 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:03.821059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d56143d5-8de8-4ad8-bb44-d3a21f494373 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:03.821821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d56143d5-8de8-4ad8-bb44-d3a21f494373 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:04.142954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d56143d5-8de8-4ad8-bb44-d3a21f494373 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:04.158789 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d56143d5-8de8-4ad8-bb44-d3a21f494373 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1249 microversion: 2.1 time: 0.342146 Aug 09 15:09:04.176778 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2883/5765] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:03 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1249 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:05.190584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a62cebc-effa-43dd-9b25-340e6cbde63e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:05.190584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a62cebc-effa-43dd-9b25-340e6cbde63e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:05.219386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a62cebc-effa-43dd-9b25-340e6cbde63e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:05.220742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a62cebc-effa-43dd-9b25-340e6cbde63e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:05.227693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a62cebc-effa-43dd-9b25-340e6cbde63e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:05.231382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a62cebc-effa-43dd-9b25-340e6cbde63e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:05.232281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a62cebc-effa-43dd-9b25-340e6cbde63e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:05.239044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a62cebc-effa-43dd-9b25-340e6cbde63e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:05.478208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6a62cebc-effa-43dd-9b25-340e6cbde63e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:05.491247 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a62cebc-effa-43dd-9b25-340e6cbde63e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1319 microversion: 2.1 time: 0.307236 Aug 09 15:09:05.492197 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2883/5766] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:05 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:06.518534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e19fef04-1029-4622-9caa-073fc1b583c5 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:06.520984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e19fef04-1029-4622-9caa-073fc1b583c5 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:06.537087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e19fef04-1029-4622-9caa-073fc1b583c5 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:06.537749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e19fef04-1029-4622-9caa-073fc1b583c5 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:06.538308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e19fef04-1029-4622-9caa-073fc1b583c5 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:06.539237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e19fef04-1029-4622-9caa-073fc1b583c5 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:06.540322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e19fef04-1029-4622-9caa-073fc1b583c5 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:06.541120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e19fef04-1029-4622-9caa-073fc1b583c5 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:06.659600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e19fef04-1029-4622-9caa-073fc1b583c5 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:06.679800 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e19fef04-1029-4622-9caa-073fc1b583c5 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1307 microversion: 2.1 time: 0.166763 Aug 09 15:09:06.685453 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2884/5767] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:06 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1307 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:07.713698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc38656b-1bdd-4332-a8ec-d2ff46a8a872 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:07.718234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc38656b-1bdd-4332-a8ec-d2ff46a8a872 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:07.754954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc38656b-1bdd-4332-a8ec-d2ff46a8a872 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:07.756204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc38656b-1bdd-4332-a8ec-d2ff46a8a872 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:07.757317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc38656b-1bdd-4332-a8ec-d2ff46a8a872 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:07.758806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc38656b-1bdd-4332-a8ec-d2ff46a8a872 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:07.762968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc38656b-1bdd-4332-a8ec-d2ff46a8a872 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:07.764236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc38656b-1bdd-4332-a8ec-d2ff46a8a872 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:08.246511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bc38656b-1bdd-4332-a8ec-d2ff46a8a872 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:08.262943 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc38656b-1bdd-4332-a8ec-d2ff46a8a872 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1374 microversion: 2.1 time: 0.559569 Aug 09 15:09:08.265876 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2884/5768] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:07 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1374 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:09.303158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d0c2365b-c54d-4c3a-b85a-2dbff1b8f01e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:09.308081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d0c2365b-c54d-4c3a-b85a-2dbff1b8f01e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:09.348917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0c2365b-c54d-4c3a-b85a-2dbff1b8f01e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:09.351076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0c2365b-c54d-4c3a-b85a-2dbff1b8f01e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:09.351945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0c2365b-c54d-4c3a-b85a-2dbff1b8f01e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:09.358396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0c2365b-c54d-4c3a-b85a-2dbff1b8f01e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:09.359688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0c2365b-c54d-4c3a-b85a-2dbff1b8f01e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:09.360850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d0c2365b-c54d-4c3a-b85a-2dbff1b8f01e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:09.384014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-2144df46-6afe-41e4-8add-40a0ba028509 req-6395bdd8-c7a0-4827-b85b-c9532229e44f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c5e345-411f-4280-8be5-2cde9dc6b349", "tag": "f3653f5a-4bd9-481f-9734-866260175fe8"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:09.509128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2144df46-6afe-41e4-8add-40a0ba028509 req-6395bdd8-c7a0-4827-b85b-c9532229e44f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:09.514269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2144df46-6afe-41e4-8add-40a0ba028509 req-6395bdd8-c7a0-4827-b85b-c9532229e44f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:09.516865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2144df46-6afe-41e4-8add-40a0ba028509 req-6395bdd8-c7a0-4827-b85b-c9532229e44f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:09.598941 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-2144df46-6afe-41e4-8add-40a0ba028509 req-6395bdd8-c7a0-4827-b85b-c9532229e44f service nova] Creating event network-changed:f3653f5a-4bd9-481f-9734-866260175fe8 for instance d3c5e345-411f-4280-8be5-2cde9dc6b349 on n-h1-844626-8 Aug 09 15:09:09.616123 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-2144df46-6afe-41e4-8add-40a0ba028509 req-6395bdd8-c7a0-4827-b85b-c9532229e44f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240675 Aug 09 15:09:09.618342 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2885/5769] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:09:10.683279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d0c2365b-c54d-4c3a-b85a-2dbff1b8f01e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:10.697873 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d0c2365b-c54d-4c3a-b85a-2dbff1b8f01e tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1374 microversion: 2.1 time: 1.405342 Aug 09 15:09:10.701912 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2885/5770] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:09 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1374 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:11.730786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36b86520-7aae-4bfd-90bf-4ac7a8b66cd0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:11.732466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-36b86520-7aae-4bfd-90bf-4ac7a8b66cd0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:11.750534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b86520-7aae-4bfd-90bf-4ac7a8b66cd0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:11.751045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b86520-7aae-4bfd-90bf-4ac7a8b66cd0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:11.756108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b86520-7aae-4bfd-90bf-4ac7a8b66cd0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:11.757365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b86520-7aae-4bfd-90bf-4ac7a8b66cd0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:11.758782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b86520-7aae-4bfd-90bf-4ac7a8b66cd0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:11.760680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b86520-7aae-4bfd-90bf-4ac7a8b66cd0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:11.770429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:12.258776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-36b86520-7aae-4bfd-90bf-4ac7a8b66cd0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:12.271798 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36b86520-7aae-4bfd-90bf-4ac7a8b66cd0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1374 microversion: 2.1 time: 0.549197 Aug 09 15:09:12.276674 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2886/5771] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:11 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1374 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:13.299735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-acb6d2c0-7bb7-48a3-91d1-590a16322eb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:13.301352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-acb6d2c0-7bb7-48a3-91d1-590a16322eb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:13.306476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:13.310267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:13.333113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acb6d2c0-7bb7-48a3-91d1-590a16322eb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:13.340619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acb6d2c0-7bb7-48a3-91d1-590a16322eb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:13.343012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acb6d2c0-7bb7-48a3-91d1-590a16322eb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:13.343939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acb6d2c0-7bb7-48a3-91d1-590a16322eb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:13.348198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acb6d2c0-7bb7-48a3-91d1-590a16322eb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:13.349467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-acb6d2c0-7bb7-48a3-91d1-590a16322eb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:13.706564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-acb6d2c0-7bb7-48a3-91d1-590a16322eb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:13.720790 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-acb6d2c0-7bb7-48a3-91d1-590a16322eb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1374 microversion: 2.1 time: 0.424831 Aug 09 15:09:13.725579 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2886/5772] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:13 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1374 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:14.752971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d2b1e82b-fb73-4c3e-8247-e86cf30ddda9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:14.753770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d2b1e82b-fb73-4c3e-8247-e86cf30ddda9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:14.763618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:14.766589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2b1e82b-fb73-4c3e-8247-e86cf30ddda9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:14.767534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2b1e82b-fb73-4c3e-8247-e86cf30ddda9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:14.768206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2b1e82b-fb73-4c3e-8247-e86cf30ddda9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:14.769149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2b1e82b-fb73-4c3e-8247-e86cf30ddda9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:14.769829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2b1e82b-fb73-4c3e-8247-e86cf30ddda9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:14.770476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d2b1e82b-fb73-4c3e-8247-e86cf30ddda9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:15.095760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75a5718a-c679-4512-9a87-bb3d6f15a07e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:15.099620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75a5718a-c679-4512-9a87-bb3d6f15a07e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:15.113405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:15.118151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75a5718a-c679-4512-9a87-bb3d6f15a07e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:15.125475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d2b1e82b-fb73-4c3e-8247-e86cf30ddda9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:15.134445 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d2b1e82b-fb73-4c3e-8247-e86cf30ddda9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1374 microversion: 2.1 time: 0.386545 Aug 09 15:09:15.135303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75a5718a-c679-4512-9a87-bb3d6f15a07e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:15.135865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75a5718a-c679-4512-9a87-bb3d6f15a07e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:15.137617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75a5718a-c679-4512-9a87-bb3d6f15a07e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:15.152139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75a5718a-c679-4512-9a87-bb3d6f15a07e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:15.154091 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2887/5773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:14 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1374 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:15.154884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75a5718a-c679-4512-9a87-bb3d6f15a07e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:15.215726 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75a5718a-c679-4512-9a87-bb3d6f15a07e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742/action" status: 200 len: 24555 microversion: 2.1 time: 0.128978 Aug 09 15:09:15.217572 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2887/5774] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:09:15 2022] POST /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742/action => generated 24555 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:09:16.169674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c12153c-00cf-48ef-b2cc-42837138eb38 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:16.170507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c12153c-00cf-48ef-b2cc-42837138eb38 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:16.192796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c12153c-00cf-48ef-b2cc-42837138eb38 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:16.194469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c12153c-00cf-48ef-b2cc-42837138eb38 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:16.195980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c12153c-00cf-48ef-b2cc-42837138eb38 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:16.197690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c12153c-00cf-48ef-b2cc-42837138eb38 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:16.198998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c12153c-00cf-48ef-b2cc-42837138eb38 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:16.200321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c12153c-00cf-48ef-b2cc-42837138eb38 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:16.701294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1c12153c-00cf-48ef-b2cc-42837138eb38 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:16.717645 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c12153c-00cf-48ef-b2cc-42837138eb38 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1374 microversion: 2.1 time: 0.554729 Aug 09 15:09:16.736372 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2888/5775] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:16 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1374 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:17.765118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2b4282a8-81b6-4842-a931-a8908513bac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:17.768027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2b4282a8-81b6-4842-a931-a8908513bac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:17.813277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b4282a8-81b6-4842-a931-a8908513bac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:17.817245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b4282a8-81b6-4842-a931-a8908513bac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:17.821519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b4282a8-81b6-4842-a931-a8908513bac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:17.824503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b4282a8-81b6-4842-a931-a8908513bac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:17.835997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b4282a8-81b6-4842-a931-a8908513bac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:17.836897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b4282a8-81b6-4842-a931-a8908513bac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:18.183772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b4282a8-81b6-4842-a931-a8908513bac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:18.196407 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2b4282a8-81b6-4842-a931-a8908513bac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1374 microversion: 2.1 time: 0.447198 Aug 09 15:09:18.197391 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2888/5776] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:17 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1374 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:18.547118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-693afe53-8e63-4dab-b237-c207a4449530 req-492f33e7-e5ca-4092-b5fd-5378048bb855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c5e345-411f-4280-8be5-2cde9dc6b349", "name": "network-vif-plugged", "status": "completed", "tag": "f3653f5a-4bd9-481f-9734-866260175fe8"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:18.570901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-693afe53-8e63-4dab-b237-c207a4449530 req-492f33e7-e5ca-4092-b5fd-5378048bb855 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:18.574608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-693afe53-8e63-4dab-b237-c207a4449530 req-492f33e7-e5ca-4092-b5fd-5378048bb855 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:18.575138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-693afe53-8e63-4dab-b237-c207a4449530 req-492f33e7-e5ca-4092-b5fd-5378048bb855 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:18.605085 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-693afe53-8e63-4dab-b237-c207a4449530 req-492f33e7-e5ca-4092-b5fd-5378048bb855 service nova] Creating event network-vif-plugged:f3653f5a-4bd9-481f-9734-866260175fe8 for instance d3c5e345-411f-4280-8be5-2cde9dc6b349 on n-h1-844626-8 Aug 09 15:09:18.622939 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-693afe53-8e63-4dab-b237-c207a4449530 req-492f33e7-e5ca-4092-b5fd-5378048bb855 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080351 Aug 09 15:09:18.624103 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2889/5777] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:09:18.778024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-866085825", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:18.975861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] validate_networks() for [('86b6caed-197b-49d6-8fc8-b79923fc2960', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:09:19.237184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c276dbd1-4c9b-474b-8223-c5e9731f257b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:19.239653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c276dbd1-4c9b-474b-8223-c5e9731f257b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:19.255532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c276dbd1-4c9b-474b-8223-c5e9731f257b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:19.257014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c276dbd1-4c9b-474b-8223-c5e9731f257b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:19.258445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c276dbd1-4c9b-474b-8223-c5e9731f257b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:19.259414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c276dbd1-4c9b-474b-8223-c5e9731f257b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:19.273834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c276dbd1-4c9b-474b-8223-c5e9731f257b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:19.276050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c276dbd1-4c9b-474b-8223-c5e9731f257b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:19.737696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c276dbd1-4c9b-474b-8223-c5e9731f257b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:19.755498 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c276dbd1-4c9b-474b-8223-c5e9731f257b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1374 microversion: 2.1 time: 0.537280 Aug 09 15:09:19.768665 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2890/5778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:19 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1374 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:19.893123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:09:19.893692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:09:19.894272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:09:19.894743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:09:19.895917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:09:19.906672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:19.907393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:19.907985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:19.908890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:19.909720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:19.910323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:19.935770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Getting quotas for project 9d3cad59c0d546bf8b851b3da589b21a. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:09:19.943993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Getting quotas for user cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 and project 9d3cad59c0d546bf8b851b3da589b21a. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:09:19.960191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:09:19.962506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:09:20.032230 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a1fa8aa-3745-4346-b129-ddd8ccd69b72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576632 Aug 09 15:09:20.033540 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2889/5779] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:09:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:09:20.051730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-02d7d901-b02b-495d-b7cf-ff1bdbb2205c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:20.053086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-02d7d901-b02b-495d-b7cf-ff1bdbb2205c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:20.240503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-02d7d901-b02b-495d-b7cf-ff1bdbb2205c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:20.261868 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-02d7d901-b02b-495d-b7cf-ff1bdbb2205c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1216 microversion: 2.1 time: 0.214954 Aug 09 15:09:20.262683 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2891/5780] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:20 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1216 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:20.780141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7635ff5c-f829-49a0-8566-f786944eb968 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:20.780802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7635ff5c-f829-49a0-8566-f786944eb968 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:20.793347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7635ff5c-f829-49a0-8566-f786944eb968 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:20.793845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7635ff5c-f829-49a0-8566-f786944eb968 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:20.794433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7635ff5c-f829-49a0-8566-f786944eb968 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:20.795201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7635ff5c-f829-49a0-8566-f786944eb968 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:20.795658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7635ff5c-f829-49a0-8566-f786944eb968 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:20.796086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7635ff5c-f829-49a0-8566-f786944eb968 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:21.054981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7635ff5c-f829-49a0-8566-f786944eb968 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:21.073862 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7635ff5c-f829-49a0-8566-f786944eb968 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1547 microversion: 2.1 time: 0.299657 Aug 09 15:09:21.074965 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2890/5781] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:20 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1547 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:21.124426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0a53623-1e1e-495a-92f6-0d7a5cebe7e1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:21.126574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0a53623-1e1e-495a-92f6-0d7a5cebe7e1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:21.151624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0a53623-1e1e-495a-92f6-0d7a5cebe7e1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:21.152524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0a53623-1e1e-495a-92f6-0d7a5cebe7e1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:21.153343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0a53623-1e1e-495a-92f6-0d7a5cebe7e1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:21.154706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0a53623-1e1e-495a-92f6-0d7a5cebe7e1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:21.155607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0a53623-1e1e-495a-92f6-0d7a5cebe7e1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:21.156679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0a53623-1e1e-495a-92f6-0d7a5cebe7e1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:21.163770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:21.296633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b899dd77-9403-46a0-992f-b3aebce68f93 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:21.297665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b899dd77-9403-46a0-992f-b3aebce68f93 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:21.316907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b899dd77-9403-46a0-992f-b3aebce68f93 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:21.317419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b899dd77-9403-46a0-992f-b3aebce68f93 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:21.319173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b899dd77-9403-46a0-992f-b3aebce68f93 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:21.320045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b899dd77-9403-46a0-992f-b3aebce68f93 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:21.321466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b899dd77-9403-46a0-992f-b3aebce68f93 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:21.322023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b899dd77-9403-46a0-992f-b3aebce68f93 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:21.454742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b899dd77-9403-46a0-992f-b3aebce68f93 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:21.463645 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b899dd77-9403-46a0-992f-b3aebce68f93 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1268 microversion: 2.1 time: 0.171067 Aug 09 15:09:21.464675 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2891/5782] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:21 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:09:21.500281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a0a53623-1e1e-495a-92f6-0d7a5cebe7e1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:21.509941 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0a53623-1e1e-495a-92f6-0d7a5cebe7e1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1547 microversion: 2.1 time: 0.397910 Aug 09 15:09:21.511437 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2892/5783] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:21 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1547 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:22.505437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-613bd953-461c-4364-ad68-82c56af6a717 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:22.506443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-613bd953-461c-4364-ad68-82c56af6a717 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:22.532146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-613bd953-461c-4364-ad68-82c56af6a717 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:22.532993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-613bd953-461c-4364-ad68-82c56af6a717 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:22.534547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-613bd953-461c-4364-ad68-82c56af6a717 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:22.536615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-613bd953-461c-4364-ad68-82c56af6a717 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:22.538192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-613bd953-461c-4364-ad68-82c56af6a717 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:22.539849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-613bd953-461c-4364-ad68-82c56af6a717 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:22.699730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-613bd953-461c-4364-ad68-82c56af6a717 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:22.722017 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-613bd953-461c-4364-ad68-82c56af6a717 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1274 microversion: 2.1 time: 0.227335 Aug 09 15:09:22.751765 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2892/5784] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:22 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1274 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:23.764771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30537cdb-5966-44b0-ad44-a206dc5dae8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:23.768019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30537cdb-5966-44b0-ad44-a206dc5dae8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:23.808141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30537cdb-5966-44b0-ad44-a206dc5dae8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:23.809310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30537cdb-5966-44b0-ad44-a206dc5dae8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:23.812310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30537cdb-5966-44b0-ad44-a206dc5dae8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:23.813610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30537cdb-5966-44b0-ad44-a206dc5dae8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:23.831906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30537cdb-5966-44b0-ad44-a206dc5dae8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:23.833104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30537cdb-5966-44b0-ad44-a206dc5dae8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:24.733851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-30537cdb-5966-44b0-ad44-a206dc5dae8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:24.745082 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30537cdb-5966-44b0-ad44-a206dc5dae8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1316 microversion: 2.1 time: 0.991347 Aug 09 15:09:24.756128 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2893/5785] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:23 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1316 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:25.241817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-884e7fbb-a3f7-4e42-9b20-2e2aed316722 req-cdb64348-74b2-437c-b33d-fc1adbce116d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45050cee-c0fb-4f05-a875-a43d4b834957", "tag": "d4da00d3-9767-424e-b34c-366c17cf1305"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:25.303198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-884e7fbb-a3f7-4e42-9b20-2e2aed316722 req-cdb64348-74b2-437c-b33d-fc1adbce116d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:25.306072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-884e7fbb-a3f7-4e42-9b20-2e2aed316722 req-cdb64348-74b2-437c-b33d-fc1adbce116d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:25.307517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-884e7fbb-a3f7-4e42-9b20-2e2aed316722 req-cdb64348-74b2-437c-b33d-fc1adbce116d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:25.360182 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-884e7fbb-a3f7-4e42-9b20-2e2aed316722 req-cdb64348-74b2-437c-b33d-fc1adbce116d service nova] Creating event network-changed:d4da00d3-9767-424e-b34c-366c17cf1305 for instance 45050cee-c0fb-4f05-a875-a43d4b834957 on n-h2-844626-8 Aug 09 15:09:25.379543 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-884e7fbb-a3f7-4e42-9b20-2e2aed316722 req-cdb64348-74b2-437c-b33d-fc1adbce116d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152033 Aug 09 15:09:25.381780 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2893/5786] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:09:25.794228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2552db7-1231-4ba2-8991-7cfe5a762f16 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:25.795596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2552db7-1231-4ba2-8991-7cfe5a762f16 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:25.823652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2552db7-1231-4ba2-8991-7cfe5a762f16 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:25.824225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2552db7-1231-4ba2-8991-7cfe5a762f16 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:25.826789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2552db7-1231-4ba2-8991-7cfe5a762f16 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:25.827871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2552db7-1231-4ba2-8991-7cfe5a762f16 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:25.828537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2552db7-1231-4ba2-8991-7cfe5a762f16 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:25.829129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2552db7-1231-4ba2-8991-7cfe5a762f16 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:26.146908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9495dce2-26a1-4a8c-85f9-2f516eb0056c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:26.148777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9495dce2-26a1-4a8c-85f9-2f516eb0056c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:26.170989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9495dce2-26a1-4a8c-85f9-2f516eb0056c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:26.172207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9495dce2-26a1-4a8c-85f9-2f516eb0056c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:26.173038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9495dce2-26a1-4a8c-85f9-2f516eb0056c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:26.174401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9495dce2-26a1-4a8c-85f9-2f516eb0056c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:26.180417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9495dce2-26a1-4a8c-85f9-2f516eb0056c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:26.181909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9495dce2-26a1-4a8c-85f9-2f516eb0056c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:26.288142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2552db7-1231-4ba2-8991-7cfe5a762f16 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:26.310884 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2552db7-1231-4ba2-8991-7cfe5a762f16 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1316 microversion: 2.1 time: 0.520946 Aug 09 15:09:26.331742 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2894/5787] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:25 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:27.002056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9495dce2-26a1-4a8c-85f9-2f516eb0056c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:27.044593 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9495dce2-26a1-4a8c-85f9-2f516eb0056c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1685 microversion: 2.1 time: 0.906030 Aug 09 15:09:27.046461 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2894/5788] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:26 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1685 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:27.276696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1c2d72b0-5849-4ac4-8625-5986f4f6d101 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:27.287817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1c2d72b0-5849-4ac4-8625-5986f4f6d101 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:27.319965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c2d72b0-5849-4ac4-8625-5986f4f6d101 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:27.323199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c2d72b0-5849-4ac4-8625-5986f4f6d101 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:27.328088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c2d72b0-5849-4ac4-8625-5986f4f6d101 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:27.334708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c2d72b0-5849-4ac4-8625-5986f4f6d101 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:27.336012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c2d72b0-5849-4ac4-8625-5986f4f6d101 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:27.338216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c2d72b0-5849-4ac4-8625-5986f4f6d101 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:27.358214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b797b7ba-1261-4982-aefa-2047d897fc72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:27.361470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b797b7ba-1261-4982-aefa-2047d897fc72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:27.394963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b797b7ba-1261-4982-aefa-2047d897fc72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:27.395618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b797b7ba-1261-4982-aefa-2047d897fc72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:27.396081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b797b7ba-1261-4982-aefa-2047d897fc72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:27.396842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b797b7ba-1261-4982-aefa-2047d897fc72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:27.397302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b797b7ba-1261-4982-aefa-2047d897fc72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:27.397730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b797b7ba-1261-4982-aefa-2047d897fc72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:27.488931 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1c2d72b0-5849-4ac4-8625-5986f4f6d101 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742/action" status: 200 len: 32618 microversion: 2.1 time: 0.220871 Aug 09 15:09:27.499161 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2895/5789] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:09:27 2022] POST /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742/action => generated 32618 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:09:27.687962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c6dc1811-a74e-49bb-aca4-79ea35679505 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:27.689005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c6dc1811-a74e-49bb-aca4-79ea35679505 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:27.706492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6dc1811-a74e-49bb-aca4-79ea35679505 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:27.706984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6dc1811-a74e-49bb-aca4-79ea35679505 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:27.707450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6dc1811-a74e-49bb-aca4-79ea35679505 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:27.708466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6dc1811-a74e-49bb-aca4-79ea35679505 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:27.708928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6dc1811-a74e-49bb-aca4-79ea35679505 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:27.709355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c6dc1811-a74e-49bb-aca4-79ea35679505 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:27.742043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b797b7ba-1261-4982-aefa-2047d897fc72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:27.754225 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b797b7ba-1261-4982-aefa-2047d897fc72 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1316 microversion: 2.1 time: 0.404408 Aug 09 15:09:27.755735 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2895/5790] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:27 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:28.055293 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c6dc1811-a74e-49bb-aca4-79ea35679505 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1836 microversion: 2.1 time: 0.371675 Aug 09 15:09:28.068056 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2896/5791] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:27 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1836 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:09:28.091077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e3363428-416a-4e5a-a572-42ca0b865e64 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:28.100180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e3363428-416a-4e5a-a572-42ca0b865e64 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:28.131993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3363428-416a-4e5a-a572-42ca0b865e64 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:28.132509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3363428-416a-4e5a-a572-42ca0b865e64 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:28.135399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3363428-416a-4e5a-a572-42ca0b865e64 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:28.136252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3363428-416a-4e5a-a572-42ca0b865e64 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:28.136889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3363428-416a-4e5a-a572-42ca0b865e64 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:28.137430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e3363428-416a-4e5a-a572-42ca0b865e64 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:28.280990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-e3363428-416a-4e5a-a572-42ca0b865e64 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lazy-loading 'flavor' on Instance uuid d4f69872-0228-4e22-9375-4c882f72f742 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:09:28.302498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e3363428-416a-4e5a-a572-42ca0b865e64 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Going to try to live migrate instance to another host {{(pid=119406) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 09 15:09:28.790751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0e11400-dee7-4966-890a-289223be0d81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:28.791860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0e11400-dee7-4966-890a-289223be0d81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:28.805893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e11400-dee7-4966-890a-289223be0d81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:28.806542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e11400-dee7-4966-890a-289223be0d81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:28.807158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e11400-dee7-4966-890a-289223be0d81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:28.808032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e11400-dee7-4966-890a-289223be0d81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:28.808977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e11400-dee7-4966-890a-289223be0d81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:28.809535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0e11400-dee7-4966-890a-289223be0d81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:29.088651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a0e11400-dee7-4966-890a-289223be0d81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:29.104268 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0e11400-dee7-4966-890a-289223be0d81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1316 microversion: 2.1 time: 0.318836 Aug 09 15:09:29.105473 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2897/5792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:28 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:29.923803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:29.955175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:30.126992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ec850b45-1cbd-4abd-a505-366118ba9b50 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:30.127851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ec850b45-1cbd-4abd-a505-366118ba9b50 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:30.141828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec850b45-1cbd-4abd-a505-366118ba9b50 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:30.142436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec850b45-1cbd-4abd-a505-366118ba9b50 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:30.142954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec850b45-1cbd-4abd-a505-366118ba9b50 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:30.149617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec850b45-1cbd-4abd-a505-366118ba9b50 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:30.150662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec850b45-1cbd-4abd-a505-366118ba9b50 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:30.151389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ec850b45-1cbd-4abd-a505-366118ba9b50 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:30.247304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:30.349196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ec850b45-1cbd-4abd-a505-366118ba9b50 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:30.358940 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ec850b45-1cbd-4abd-a505-366118ba9b50 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1316 microversion: 2.1 time: 0.236609 Aug 09 15:09:30.359885 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2898/5793] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:30 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:31.064469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-337d56a1-22e0-4d3b-9cd7-5b341dc117eb req-10167458-2749-4030-840c-d7946ec0e05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45050cee-c0fb-4f05-a875-a43d4b834957", "name": "network-vif-plugged", "status": "completed", "tag": "d4da00d3-9767-424e-b34c-366c17cf1305"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:31.106874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-337d56a1-22e0-4d3b-9cd7-5b341dc117eb req-10167458-2749-4030-840c-d7946ec0e05a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:31.109094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-337d56a1-22e0-4d3b-9cd7-5b341dc117eb req-10167458-2749-4030-840c-d7946ec0e05a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:31.111124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-337d56a1-22e0-4d3b-9cd7-5b341dc117eb req-10167458-2749-4030-840c-d7946ec0e05a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:31.161920 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-337d56a1-22e0-4d3b-9cd7-5b341dc117eb req-10167458-2749-4030-840c-d7946ec0e05a service nova] Creating event network-vif-plugged:d4da00d3-9767-424e-b34c-366c17cf1305 for instance 45050cee-c0fb-4f05-a875-a43d4b834957 on n-h2-844626-8 Aug 09 15:09:31.171885 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-337d56a1-22e0-4d3b-9cd7-5b341dc117eb req-10167458-2749-4030-840c-d7946ec0e05a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114855 Aug 09 15:09:31.174000 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2899/5794] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:09:31.392627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a344885b-475d-45b6-87a9-80f9038077d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:31.394874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a344885b-475d-45b6-87a9-80f9038077d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:31.440089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a344885b-475d-45b6-87a9-80f9038077d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:31.441340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a344885b-475d-45b6-87a9-80f9038077d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:31.442259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a344885b-475d-45b6-87a9-80f9038077d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:31.447436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a344885b-475d-45b6-87a9-80f9038077d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:31.452153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a344885b-475d-45b6-87a9-80f9038077d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:31.456956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a344885b-475d-45b6-87a9-80f9038077d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:31.539776 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e3363428-416a-4e5a-a572-42ca0b865e64 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742/action" status: 202 len: 0 microversion: 2.1 time: 3.455473 Aug 09 15:09:31.544415 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2896/5795] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:09:28 2022] POST /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742/action => generated 0 bytes in 3458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:09:31.556394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63cc638d-eca7-45d6-9156-b4df49c07e5f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:31.557009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63cc638d-eca7-45d6-9156-b4df49c07e5f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:31.616466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63cc638d-eca7-45d6-9156-b4df49c07e5f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:31.618256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63cc638d-eca7-45d6-9156-b4df49c07e5f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:31.624254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63cc638d-eca7-45d6-9156-b4df49c07e5f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:31.627102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63cc638d-eca7-45d6-9156-b4df49c07e5f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:31.631403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63cc638d-eca7-45d6-9156-b4df49c07e5f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:31.633554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63cc638d-eca7-45d6-9156-b4df49c07e5f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:31.959434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63cc638d-eca7-45d6-9156-b4df49c07e5f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:31.965848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a344885b-475d-45b6-87a9-80f9038077d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:31.991306 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63cc638d-eca7-45d6-9156-b4df49c07e5f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1695 microversion: 2.1 time: 0.443602 Aug 09 15:09:32.007143 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a344885b-475d-45b6-87a9-80f9038077d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1316 microversion: 2.1 time: 0.622664 Aug 09 15:09:32.007565 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2897/5796] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:31 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1695 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:32.014436 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2900/5797] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:31 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1316 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:09:33.025166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01a2a7a7-812d-468a-b619-03762ab69b4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:33.027621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01a2a7a7-812d-468a-b619-03762ab69b4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:33.031598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f8a442f-85d7-4edd-8a74-c6bf130a58e2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:33.032256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f8a442f-85d7-4edd-8a74-c6bf130a58e2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:33.035967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:33.057774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8a442f-85d7-4edd-8a74-c6bf130a58e2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:33.058341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8a442f-85d7-4edd-8a74-c6bf130a58e2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:33.058782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8a442f-85d7-4edd-8a74-c6bf130a58e2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:33.059576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8a442f-85d7-4edd-8a74-c6bf130a58e2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:33.066892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8a442f-85d7-4edd-8a74-c6bf130a58e2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:33.071826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a2a7a7-812d-468a-b619-03762ab69b4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:33.074110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a2a7a7-812d-468a-b619-03762ab69b4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:33.075168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a2a7a7-812d-468a-b619-03762ab69b4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:33.077546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a2a7a7-812d-468a-b619-03762ab69b4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:33.078774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a2a7a7-812d-468a-b619-03762ab69b4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:33.079178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f8a442f-85d7-4edd-8a74-c6bf130a58e2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:33.080481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01a2a7a7-812d-468a-b619-03762ab69b4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:33.591822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-01a2a7a7-812d-468a-b619-03762ab69b4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:33.613502 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01a2a7a7-812d-468a-b619-03762ab69b4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1695 microversion: 2.1 time: 0.597733 Aug 09 15:09:33.625095 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2898/5798] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:33 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1695 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:33.668087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f8a442f-85d7-4edd-8a74-c6bf130a58e2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:33.684602 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4f8a442f-85d7-4edd-8a74-c6bf130a58e2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.657648 Aug 09 15:09:33.686571 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2901/5799] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:33 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:33.797537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1456562667", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:33.941719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a5cab18a-9a63-472f-ad78-0070ee19a383 req-12b05c3c-1506-48ae-9a87-868840116db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f69872-0228-4e22-9375-4c882f72f742", "name": "network-vif-unplugged", "status": "completed", "tag": "bf1a7c3c-6a1c-474c-8361-842291ae8347"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:33.980068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] validate_networks() for [('86b6caed-197b-49d6-8fc8-b79923fc2960', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:09:34.002130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a5cab18a-9a63-472f-ad78-0070ee19a383 req-12b05c3c-1506-48ae-9a87-868840116db3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:34.023697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a5cab18a-9a63-472f-ad78-0070ee19a383 req-12b05c3c-1506-48ae-9a87-868840116db3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:34.024804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a5cab18a-9a63-472f-ad78-0070ee19a383 req-12b05c3c-1506-48ae-9a87-868840116db3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:34.081010 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a5cab18a-9a63-472f-ad78-0070ee19a383 req-12b05c3c-1506-48ae-9a87-868840116db3 service nova] Creating event network-vif-unplugged:bf1a7c3c-6a1c-474c-8361-842291ae8347 for instance d4f69872-0228-4e22-9375-4c882f72f742 on n-h2-844626-8 Aug 09 15:09:34.086945 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a5cab18a-9a63-472f-ad78-0070ee19a383 req-12b05c3c-1506-48ae-9a87-868840116db3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151722 Aug 09 15:09:34.087721 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2902/5800] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:09:34.669266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e71bf35-5053-48e1-a7d7-858ead809fbb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:34.670399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8e71bf35-5053-48e1-a7d7-858ead809fbb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:34.679138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e71bf35-5053-48e1-a7d7-858ead809fbb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:34.680165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e71bf35-5053-48e1-a7d7-858ead809fbb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:34.680802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e71bf35-5053-48e1-a7d7-858ead809fbb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:34.689267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e71bf35-5053-48e1-a7d7-858ead809fbb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:34.692488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e71bf35-5053-48e1-a7d7-858ead809fbb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:34.708905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e71bf35-5053-48e1-a7d7-858ead809fbb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:34.791021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:09:34.792931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:09:34.793787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:09:34.794009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:09:34.794412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:09:34.820330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:34.825140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:34.845571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:34.846422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:34.848617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:34.849088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:34.887259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Getting quotas for project 9d3cad59c0d546bf8b851b3da589b21a. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:09:34.915623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Getting quotas for user cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 and project 9d3cad59c0d546bf8b851b3da589b21a. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:09:34.950735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:09:34.966800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:09:34.975625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8e71bf35-5053-48e1-a7d7-858ead809fbb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:34.992937 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8e71bf35-5053-48e1-a7d7-858ead809fbb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1695 microversion: 2.1 time: 0.328882 Aug 09 15:09:34.994353 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2903/5801] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:34 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1695 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:35.093815 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2e3f9f3b-3b41-40f6-a28f-13f6f977305f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302489 Aug 09 15:09:35.115139 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2899/5802] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:09:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1322 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:09:35.123344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a193e74-9341-468e-82ae-8e2aa00c2906 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:35.124431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7a193e74-9341-468e-82ae-8e2aa00c2906 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:35.253184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7a193e74-9341-468e-82ae-8e2aa00c2906 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:35.268323 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a193e74-9341-468e-82ae-8e2aa00c2906 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1217 microversion: 2.1 time: 0.151193 Aug 09 15:09:35.269057 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2904/5803] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:35 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:36.042838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e2343e4-5f07-4852-b637-94c6fe4f1e9b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:36.051439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8e2343e4-5f07-4852-b637-94c6fe4f1e9b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:36.063170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e2343e4-5f07-4852-b637-94c6fe4f1e9b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:36.064239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e2343e4-5f07-4852-b637-94c6fe4f1e9b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:36.065320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e2343e4-5f07-4852-b637-94c6fe4f1e9b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:36.066639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e2343e4-5f07-4852-b637-94c6fe4f1e9b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:36.068493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e2343e4-5f07-4852-b637-94c6fe4f1e9b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:36.069491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e2343e4-5f07-4852-b637-94c6fe4f1e9b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:36.322678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49d83c96-a156-4b48-9c55-95c6ce219a3b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:36.326699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49d83c96-a156-4b48-9c55-95c6ce219a3b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:36.345379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49d83c96-a156-4b48-9c55-95c6ce219a3b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:36.347193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49d83c96-a156-4b48-9c55-95c6ce219a3b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:36.348379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49d83c96-a156-4b48-9c55-95c6ce219a3b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:36.350099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49d83c96-a156-4b48-9c55-95c6ce219a3b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:36.354375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e2343e4-5f07-4852-b637-94c6fe4f1e9b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:36.358783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49d83c96-a156-4b48-9c55-95c6ce219a3b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:36.359644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49d83c96-a156-4b48-9c55-95c6ce219a3b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:36.369632 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e2343e4-5f07-4852-b637-94c6fe4f1e9b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1695 microversion: 2.1 time: 0.337855 Aug 09 15:09:36.371145 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2900/5804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:36 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1695 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:36.486359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-49d83c96-a156-4b48-9c55-95c6ce219a3b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:36.500145 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49d83c96-a156-4b48-9c55-95c6ce219a3b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1269 microversion: 2.1 time: 0.185411 Aug 09 15:09:36.502208 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2905/5805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:36 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:09:36.517477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8cc12341-7f4d-4e5a-9432-1976a86c5e16 req-27623338-bcf9-472d-b5b7-83a407f2b1ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f69872-0228-4e22-9375-4c882f72f742", "tag": "bf1a7c3c-6a1c-474c-8361-842291ae8347"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:36.539019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8cc12341-7f4d-4e5a-9432-1976a86c5e16 req-27623338-bcf9-472d-b5b7-83a407f2b1ad service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:36.539909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8cc12341-7f4d-4e5a-9432-1976a86c5e16 req-27623338-bcf9-472d-b5b7-83a407f2b1ad service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:36.543287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8cc12341-7f4d-4e5a-9432-1976a86c5e16 req-27623338-bcf9-472d-b5b7-83a407f2b1ad service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:36.577601 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8cc12341-7f4d-4e5a-9432-1976a86c5e16 req-27623338-bcf9-472d-b5b7-83a407f2b1ad service nova] Creating event network-changed:bf1a7c3c-6a1c-474c-8361-842291ae8347 for instance d4f69872-0228-4e22-9375-4c882f72f742 on n-h2-844626-8 Aug 09 15:09:36.592501 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8cc12341-7f4d-4e5a-9432-1976a86c5e16 req-27623338-bcf9-472d-b5b7-83a407f2b1ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095896 Aug 09 15:09:36.593555 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2901/5806] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:09:37.397587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba5bdbbc-b94a-45c8-bf57-d0f4e8882180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:37.399394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba5bdbbc-b94a-45c8-bf57-d0f4e8882180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:37.410846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5bdbbc-b94a-45c8-bf57-d0f4e8882180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:37.412108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5bdbbc-b94a-45c8-bf57-d0f4e8882180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:37.413130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5bdbbc-b94a-45c8-bf57-d0f4e8882180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:37.414387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5bdbbc-b94a-45c8-bf57-d0f4e8882180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:37.415219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5bdbbc-b94a-45c8-bf57-d0f4e8882180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:37.416298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba5bdbbc-b94a-45c8-bf57-d0f4e8882180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:37.547975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f366568-e569-432a-84a1-b6c50a9e0ac7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:37.549167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6f366568-e569-432a-84a1-b6c50a9e0ac7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:37.567826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f366568-e569-432a-84a1-b6c50a9e0ac7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:37.568687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f366568-e569-432a-84a1-b6c50a9e0ac7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:37.569448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f366568-e569-432a-84a1-b6c50a9e0ac7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:37.570870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f366568-e569-432a-84a1-b6c50a9e0ac7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:37.571972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f366568-e569-432a-84a1-b6c50a9e0ac7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:37.572991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f366568-e569-432a-84a1-b6c50a9e0ac7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:37.760204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f366568-e569-432a-84a1-b6c50a9e0ac7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:37.782599 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f366568-e569-432a-84a1-b6c50a9e0ac7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1275 microversion: 2.1 time: 0.252124 Aug 09 15:09:37.819583 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2902/5807] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:37 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:37.885459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba5bdbbc-b94a-45c8-bf57-d0f4e8882180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:37.903576 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba5bdbbc-b94a-45c8-bf57-d0f4e8882180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1695 microversion: 2.1 time: 0.513267 Aug 09 15:09:37.905913 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2906/5808] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:37 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1695 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:38.064539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-630221625", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "23cf82fd-49d5-4bf0-a527-343335d8eff7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:38.149105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] validate_networks() for [('1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:09:38.831472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e11c3a94-735c-48e3-9c9d-3d19af4b433b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:38.833784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e11c3a94-735c-48e3-9c9d-3d19af4b433b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:38.846828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e11c3a94-735c-48e3-9c9d-3d19af4b433b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:38.848027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e11c3a94-735c-48e3-9c9d-3d19af4b433b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:38.849099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e11c3a94-735c-48e3-9c9d-3d19af4b433b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:38.850228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e11c3a94-735c-48e3-9c9d-3d19af4b433b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:38.851437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e11c3a94-735c-48e3-9c9d-3d19af4b433b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:38.852295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e11c3a94-735c-48e3-9c9d-3d19af4b433b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:38.910727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:09:38.912344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:09:38.913221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:09:38.913784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:09:38.914434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:09:38.930184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:38.930678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:38.931136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:38.931873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:38.932383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:38.933287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:38.957706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:09:38.966678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for user f99b0693d22442ffa84b9c845d7cbc58 and project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:09:39.070853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e11c3a94-735c-48e3-9c9d-3d19af4b433b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:39.081252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:09:39.083531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='23cf82fd-49d5-4bf0-a527-343335d8eff7',volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:09:39.084861 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e11c3a94-735c-48e3-9c9d-3d19af4b433b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1317 microversion: 2.1 time: 0.261226 Aug 09 15:09:39.085481 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2907/5809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:38 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:39.095261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3661051c-99ad-46f1-b7f5-05810fde217e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:39.098244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3661051c-99ad-46f1-b7f5-05810fde217e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:39.112150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3661051c-99ad-46f1-b7f5-05810fde217e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:39.112651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3661051c-99ad-46f1-b7f5-05810fde217e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:39.113090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3661051c-99ad-46f1-b7f5-05810fde217e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:39.113980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3661051c-99ad-46f1-b7f5-05810fde217e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:39.114445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3661051c-99ad-46f1-b7f5-05810fde217e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:39.114868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3661051c-99ad-46f1-b7f5-05810fde217e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:39.309439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3661051c-99ad-46f1-b7f5-05810fde217e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:39.317929 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f92d75a1-d325-46b1-9e26-34b36f8c8bfb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257278 Aug 09 15:09:39.319196 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2903/5810] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:09:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:09:39.320073 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3661051c-99ad-46f1-b7f5-05810fde217e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1695 microversion: 2.1 time: 0.233360 Aug 09 15:09:39.320876 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2908/5811] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:39 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1695 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:39.341366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-efdfb7d9-8ac0-42ed-a599-2a20f2664cd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:39.341918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-efdfb7d9-8ac0-42ed-a599-2a20f2664cd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:39.445343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-efdfb7d9-8ac0-42ed-a599-2a20f2664cd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:39.453563 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-efdfb7d9-8ac0-42ed-a599-2a20f2664cd9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1070 microversion: 2.1 time: 0.117305 Aug 09 15:09:39.454133 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2904/5812] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:39 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1070 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:39.633622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-59c13901-c015-4960-b7a5-3bbebfd8f1bc req-e98e1c3e-e06e-46ce-a1be-2c72fbba0274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18649c3a-2c5b-41d2-8863-6a2c232ba535", "tag": "b9155cb3-b522-4cf8-b4fa-8c746eb1e87c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:39.662360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-59c13901-c015-4960-b7a5-3bbebfd8f1bc req-e98e1c3e-e06e-46ce-a1be-2c72fbba0274 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:39.668671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-59c13901-c015-4960-b7a5-3bbebfd8f1bc req-e98e1c3e-e06e-46ce-a1be-2c72fbba0274 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:39.669430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-59c13901-c015-4960-b7a5-3bbebfd8f1bc req-e98e1c3e-e06e-46ce-a1be-2c72fbba0274 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:39.695337 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-59c13901-c015-4960-b7a5-3bbebfd8f1bc req-e98e1c3e-e06e-46ce-a1be-2c72fbba0274 service nova] Creating event network-changed:b9155cb3-b522-4cf8-b4fa-8c746eb1e87c for instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 on n-h1-844626-8 Aug 09 15:09:39.706651 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-59c13901-c015-4960-b7a5-3bbebfd8f1bc req-e98e1c3e-e06e-46ce-a1be-2c72fbba0274 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078519 Aug 09 15:09:39.709421 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2909/5813] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:09:40.109147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0c8a81ff-e2d7-499a-a986-4bbce76ad2a5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:40.110183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0c8a81ff-e2d7-499a-a986-4bbce76ad2a5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:40.125105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c8a81ff-e2d7-499a-a986-4bbce76ad2a5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:40.126768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c8a81ff-e2d7-499a-a986-4bbce76ad2a5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:40.127841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c8a81ff-e2d7-499a-a986-4bbce76ad2a5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:40.129800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c8a81ff-e2d7-499a-a986-4bbce76ad2a5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:40.131140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c8a81ff-e2d7-499a-a986-4bbce76ad2a5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:40.132164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0c8a81ff-e2d7-499a-a986-4bbce76ad2a5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:40.174232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:40.352796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e2a96f4a-f3b9-4b56-a444-279dea3e15f6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:40.355290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e2a96f4a-f3b9-4b56-a444-279dea3e15f6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:40.374967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2a96f4a-f3b9-4b56-a444-279dea3e15f6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:40.378653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2a96f4a-f3b9-4b56-a444-279dea3e15f6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:40.379851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2a96f4a-f3b9-4b56-a444-279dea3e15f6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:40.381653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2a96f4a-f3b9-4b56-a444-279dea3e15f6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:40.382703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2a96f4a-f3b9-4b56-a444-279dea3e15f6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:40.383203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0c8a81ff-e2d7-499a-a986-4bbce76ad2a5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:40.384128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2a96f4a-f3b9-4b56-a444-279dea3e15f6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:40.398314 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0c8a81ff-e2d7-499a-a986-4bbce76ad2a5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1317 microversion: 2.1 time: 0.294139 Aug 09 15:09:40.399364 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2905/5814] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:40 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:40.490359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f36024df-ee9d-40c2-98ab-07309b19f37a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:40.491334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f36024df-ee9d-40c2-98ab-07309b19f37a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:40.502645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f36024df-ee9d-40c2-98ab-07309b19f37a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:40.503196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f36024df-ee9d-40c2-98ab-07309b19f37a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:40.503914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f36024df-ee9d-40c2-98ab-07309b19f37a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:40.504660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f36024df-ee9d-40c2-98ab-07309b19f37a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:40.505120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f36024df-ee9d-40c2-98ab-07309b19f37a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:40.505612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f36024df-ee9d-40c2-98ab-07309b19f37a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:40.596318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f36024df-ee9d-40c2-98ab-07309b19f37a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:40.624029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e2a96f4a-f3b9-4b56-a444-279dea3e15f6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:40.625089 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f36024df-ee9d-40c2-98ab-07309b19f37a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1168 microversion: 2.1 time: 0.140311 Aug 09 15:09:40.627924 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2906/5815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:40 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:40.640548 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e2a96f4a-f3b9-4b56-a444-279dea3e15f6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1695 microversion: 2.1 time: 0.298453 Aug 09 15:09:40.641924 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2910/5816] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:40 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1695 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:41.422421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-75b764b7-09aa-4b40-989c-cc27ea6a4624 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:41.423266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-75b764b7-09aa-4b40-989c-cc27ea6a4624 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:41.439855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75b764b7-09aa-4b40-989c-cc27ea6a4624 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:41.440710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75b764b7-09aa-4b40-989c-cc27ea6a4624 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:41.441379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75b764b7-09aa-4b40-989c-cc27ea6a4624 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:41.442353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75b764b7-09aa-4b40-989c-cc27ea6a4624 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:41.443007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75b764b7-09aa-4b40-989c-cc27ea6a4624 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:41.443738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-75b764b7-09aa-4b40-989c-cc27ea6a4624 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:41.649812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81c8ff7e-c0d3-42ca-98e7-458c51075d6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:41.650678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-81c8ff7e-c0d3-42ca-98e7-458c51075d6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:41.663709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c8ff7e-c0d3-42ca-98e7-458c51075d6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:41.668175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c8ff7e-c0d3-42ca-98e7-458c51075d6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:41.669014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c8ff7e-c0d3-42ca-98e7-458c51075d6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:41.672674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c8ff7e-c0d3-42ca-98e7-458c51075d6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:41.680006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c8ff7e-c0d3-42ca-98e7-458c51075d6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:41.680968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81c8ff7e-c0d3-42ca-98e7-458c51075d6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:41.820524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-81c8ff7e-c0d3-42ca-98e7-458c51075d6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:41.834022 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81c8ff7e-c0d3-42ca-98e7-458c51075d6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1186 microversion: 2.1 time: 0.187683 Aug 09 15:09:41.850407 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2911/5817] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:41 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1186 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:41.863841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-86dd4d98-bf0e-45f1-ae2a-9eda58f00627 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:41.864482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-86dd4d98-bf0e-45f1-ae2a-9eda58f00627 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:41.882196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86dd4d98-bf0e-45f1-ae2a-9eda58f00627 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:41.887573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86dd4d98-bf0e-45f1-ae2a-9eda58f00627 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:41.888328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86dd4d98-bf0e-45f1-ae2a-9eda58f00627 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:41.889301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86dd4d98-bf0e-45f1-ae2a-9eda58f00627 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:41.896955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86dd4d98-bf0e-45f1-ae2a-9eda58f00627 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:41.897697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-86dd4d98-bf0e-45f1-ae2a-9eda58f00627 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:41.937150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-75b764b7-09aa-4b40-989c-cc27ea6a4624 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:41.945795 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-75b764b7-09aa-4b40-989c-cc27ea6a4624 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1317 microversion: 2.1 time: 0.528111 Aug 09 15:09:41.953366 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2907/5818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:41 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:41.954965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:42.276122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-86dd4d98-bf0e-45f1-ae2a-9eda58f00627 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:42.292522 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-86dd4d98-bf0e-45f1-ae2a-9eda58f00627 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1695 microversion: 2.1 time: 0.434387 Aug 09 15:09:42.294128 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2912/5819] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:41 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1695 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:42.863730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bd81161c-8848-48cd-95b3-84e4409c1dd4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:42.864391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bd81161c-8848-48cd-95b3-84e4409c1dd4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:42.871904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd81161c-8848-48cd-95b3-84e4409c1dd4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:42.877989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd81161c-8848-48cd-95b3-84e4409c1dd4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:42.879743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd81161c-8848-48cd-95b3-84e4409c1dd4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:42.880744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd81161c-8848-48cd-95b3-84e4409c1dd4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:42.882873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd81161c-8848-48cd-95b3-84e4409c1dd4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:42.883535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bd81161c-8848-48cd-95b3-84e4409c1dd4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:42.993533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e2ea2676-3fd2-4ba9-8942-f9f06e69355c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:42.994226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e2ea2676-3fd2-4ba9-8942-f9f06e69355c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:43.013495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2ea2676-3fd2-4ba9-8942-f9f06e69355c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:43.014508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2ea2676-3fd2-4ba9-8942-f9f06e69355c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:43.015144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2ea2676-3fd2-4ba9-8942-f9f06e69355c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:43.016044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2ea2676-3fd2-4ba9-8942-f9f06e69355c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:43.016646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2ea2676-3fd2-4ba9-8942-f9f06e69355c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:43.017212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2ea2676-3fd2-4ba9-8942-f9f06e69355c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:43.369680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bd81161c-8848-48cd-95b3-84e4409c1dd4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:43.378617 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bd81161c-8848-48cd-95b3-84e4409c1dd4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1228 microversion: 2.1 time: 0.519819 Aug 09 15:09:43.391948 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2908/5820] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:42 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1228 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:09:43.397775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3daffe7b-c5ea-4448-9379-961e1923121a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:43.398647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3daffe7b-c5ea-4448-9379-961e1923121a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:43.416194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3daffe7b-c5ea-4448-9379-961e1923121a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:43.416962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3daffe7b-c5ea-4448-9379-961e1923121a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:43.417861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3daffe7b-c5ea-4448-9379-961e1923121a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:43.418765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3daffe7b-c5ea-4448-9379-961e1923121a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:43.419405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3daffe7b-c5ea-4448-9379-961e1923121a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:43.420159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3daffe7b-c5ea-4448-9379-961e1923121a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:43.669824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e2ea2676-3fd2-4ba9-8942-f9f06e69355c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:43.692658 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e2ea2676-3fd2-4ba9-8942-f9f06e69355c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1317 microversion: 2.1 time: 0.704673 Aug 09 15:09:43.707922 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2913/5821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:42 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1317 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:43.758738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3daffe7b-c5ea-4448-9379-961e1923121a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:43.767830 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3daffe7b-c5ea-4448-9379-961e1923121a tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1695 microversion: 2.1 time: 0.374468 Aug 09 15:09:43.782324 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2909/5822] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:43 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1695 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:43.908413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-cc0f6cf3-11c5-42e1-ba47-4173b693a01e req-8671c0aa-3b34-40fb-92fb-d3165ab01dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e", "tag": "20b724ce-5a2a-405e-aeb2-48c469b3dbaa"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:43.939632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=60 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:43.944497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-cc0f6cf3-11c5-42e1-ba47-4173b693a01e req-8671c0aa-3b34-40fb-92fb-d3165ab01dc7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:43.945893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-cc0f6cf3-11c5-42e1-ba47-4173b693a01e req-8671c0aa-3b34-40fb-92fb-d3165ab01dc7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:43.947431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-cc0f6cf3-11c5-42e1-ba47-4173b693a01e req-8671c0aa-3b34-40fb-92fb-d3165ab01dc7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:44.002453 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-cc0f6cf3-11c5-42e1-ba47-4173b693a01e req-8671c0aa-3b34-40fb-92fb-d3165ab01dc7 service nova] Creating event network-changed:20b724ce-5a2a-405e-aeb2-48c469b3dbaa for instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e on n-h2-844626-8 Aug 09 15:09:44.021548 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-cc0f6cf3-11c5-42e1-ba47-4173b693a01e req-8671c0aa-3b34-40fb-92fb-d3165ab01dc7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119811 Aug 09 15:09:44.026348 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2914/5823] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:09:44.144523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-49212670-9cce-4977-b522-4e91d91adb5f req-6124b874-4c9b-4520-84b7-a963c737b2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18649c3a-2c5b-41d2-8863-6a2c232ba535", "name": "network-vif-plugged", "status": "completed", "tag": "b9155cb3-b522-4cf8-b4fa-8c746eb1e87c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:44.197693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-49212670-9cce-4977-b522-4e91d91adb5f req-6124b874-4c9b-4520-84b7-a963c737b2db service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:44.205757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-49212670-9cce-4977-b522-4e91d91adb5f req-6124b874-4c9b-4520-84b7-a963c737b2db service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:44.208151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-49212670-9cce-4977-b522-4e91d91adb5f req-6124b874-4c9b-4520-84b7-a963c737b2db service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:44.254205 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-49212670-9cce-4977-b522-4e91d91adb5f req-6124b874-4c9b-4520-84b7-a963c737b2db service nova] Creating event network-vif-plugged:b9155cb3-b522-4cf8-b4fa-8c746eb1e87c for instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 on n-h1-844626-8 Aug 09 15:09:44.281970 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-49212670-9cce-4977-b522-4e91d91adb5f req-6124b874-4c9b-4520-84b7-a963c737b2db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146569 Aug 09 15:09:44.301569 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2910/5824] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:09:44.422641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c300d65-a4cb-427e-a11c-985626d66b32 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:44.424353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c300d65-a4cb-427e-a11c-985626d66b32 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:44.466717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c300d65-a4cb-427e-a11c-985626d66b32 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:44.467399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c300d65-a4cb-427e-a11c-985626d66b32 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:44.486245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c300d65-a4cb-427e-a11c-985626d66b32 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:44.491188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c300d65-a4cb-427e-a11c-985626d66b32 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:44.492010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c300d65-a4cb-427e-a11c-985626d66b32 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:44.492673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c300d65-a4cb-427e-a11c-985626d66b32 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:44.724675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-beb240fd-21ca-45ff-bfa3-6d8d8325b377 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:44.725386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-beb240fd-21ca-45ff-bfa3-6d8d8325b377 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:44.742239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beb240fd-21ca-45ff-bfa3-6d8d8325b377 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:44.742770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beb240fd-21ca-45ff-bfa3-6d8d8325b377 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:44.743261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beb240fd-21ca-45ff-bfa3-6d8d8325b377 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:44.743989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beb240fd-21ca-45ff-bfa3-6d8d8325b377 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:44.744444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beb240fd-21ca-45ff-bfa3-6d8d8325b377 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:44.744868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beb240fd-21ca-45ff-bfa3-6d8d8325b377 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:45.259739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:45.558451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c300d65-a4cb-427e-a11c-985626d66b32 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:45.574059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-beb240fd-21ca-45ff-bfa3-6d8d8325b377 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:45.577892 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c300d65-a4cb-427e-a11c-985626d66b32 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1228 microversion: 2.1 time: 1.168359 Aug 09 15:09:45.578525 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2915/5825] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:44 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1228 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:45.589582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b55d6f87-b64b-420b-ac6d-b7e9e971b7d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:45.590487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b55d6f87-b64b-420b-ac6d-b7e9e971b7d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:45.599769 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-beb240fd-21ca-45ff-bfa3-6d8d8325b377 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1317 microversion: 2.1 time: 0.879325 Aug 09 15:09:45.611813 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2911/5826] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:44 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1317 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:45.642557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b55d6f87-b64b-420b-ac6d-b7e9e971b7d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:45.646772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b55d6f87-b64b-420b-ac6d-b7e9e971b7d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:45.647388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b55d6f87-b64b-420b-ac6d-b7e9e971b7d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:45.648751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b55d6f87-b64b-420b-ac6d-b7e9e971b7d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:45.649227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b55d6f87-b64b-420b-ac6d-b7e9e971b7d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:45.649657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b55d6f87-b64b-420b-ac6d-b7e9e971b7d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:45.957167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b55d6f87-b64b-420b-ac6d-b7e9e971b7d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:45.973121 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b55d6f87-b64b-420b-ac6d-b7e9e971b7d3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1685 microversion: 2.1 time: 0.392732 Aug 09 15:09:45.975130 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2916/5827] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:45 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1685 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:45.995123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0118c304-f99c-496f-8082-a3e99773c092 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:45.996009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0118c304-f99c-496f-8082-a3e99773c092 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:46.005628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0118c304-f99c-496f-8082-a3e99773c092 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:46.006122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0118c304-f99c-496f-8082-a3e99773c092 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:46.006619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0118c304-f99c-496f-8082-a3e99773c092 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:46.007367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0118c304-f99c-496f-8082-a3e99773c092 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:46.008057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0118c304-f99c-496f-8082-a3e99773c092 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:46.008716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0118c304-f99c-496f-8082-a3e99773c092 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:46.520883 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0118c304-f99c-496f-8082-a3e99773c092 tempest-TestNetworkAdvancedServerOps-1622163148 tempest-TestNetworkAdvancedServerOps-1622163148-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1836 microversion: 2.1 time: 0.510922 Aug 09 15:09:46.522578 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2912/5828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:45 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1836 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:46.547461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba70d010-43ea-44f8-862b-a250b23ef8b4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:46.548171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba70d010-43ea-44f8-862b-a250b23ef8b4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:46.555709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba70d010-43ea-44f8-862b-a250b23ef8b4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:46.556191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba70d010-43ea-44f8-862b-a250b23ef8b4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:46.556840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba70d010-43ea-44f8-862b-a250b23ef8b4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:46.557729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba70d010-43ea-44f8-862b-a250b23ef8b4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:46.558425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba70d010-43ea-44f8-862b-a250b23ef8b4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:46.559003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba70d010-43ea-44f8-862b-a250b23ef8b4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:46.618404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f1a52cd-aaee-4cd5-a17e-a392165ca522 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:46.622285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6f1a52cd-aaee-4cd5-a17e-a392165ca522 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:46.652673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f1a52cd-aaee-4cd5-a17e-a392165ca522 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:46.653933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f1a52cd-aaee-4cd5-a17e-a392165ca522 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:46.654969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f1a52cd-aaee-4cd5-a17e-a392165ca522 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:46.657708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f1a52cd-aaee-4cd5-a17e-a392165ca522 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:46.659151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f1a52cd-aaee-4cd5-a17e-a392165ca522 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:46.660359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f1a52cd-aaee-4cd5-a17e-a392165ca522 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:47.219394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba70d010-43ea-44f8-862b-a250b23ef8b4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:47.221637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f1a52cd-aaee-4cd5-a17e-a392165ca522 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:47.232895 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f1a52cd-aaee-4cd5-a17e-a392165ca522 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1228 microversion: 2.1 time: 0.626114 Aug 09 15:09:47.233521 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2913/5829] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:46 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1228 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:47.242953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dfe7d092-9d9c-43f8-9e16-795ad52ec1f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:47.249911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dfe7d092-9d9c-43f8-9e16-795ad52ec1f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:47.256728 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba70d010-43ea-44f8-862b-a250b23ef8b4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1685 microversion: 2.1 time: 0.713467 Aug 09 15:09:47.258722 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2917/5830] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:46 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1685 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:09:47.262901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfe7d092-9d9c-43f8-9e16-795ad52ec1f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:47.264368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfe7d092-9d9c-43f8-9e16-795ad52ec1f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:47.264368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfe7d092-9d9c-43f8-9e16-795ad52ec1f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:47.265257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfe7d092-9d9c-43f8-9e16-795ad52ec1f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:47.265257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfe7d092-9d9c-43f8-9e16-795ad52ec1f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:47.265568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfe7d092-9d9c-43f8-9e16-795ad52ec1f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:47.396309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-376d1fc9-7224-4f5f-a6df-9f72c963520f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:47.402461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-376d1fc9-7224-4f5f-a6df-9f72c963520f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:47.415217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-376d1fc9-7224-4f5f-a6df-9f72c963520f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:47.416865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-376d1fc9-7224-4f5f-a6df-9f72c963520f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:47.417874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-376d1fc9-7224-4f5f-a6df-9f72c963520f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:47.419787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-376d1fc9-7224-4f5f-a6df-9f72c963520f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:47.420712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-376d1fc9-7224-4f5f-a6df-9f72c963520f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:47.421599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-376d1fc9-7224-4f5f-a6df-9f72c963520f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:47.535645 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-376d1fc9-7224-4f5f-a6df-9f72c963520f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742/action" status: 200 len: 38629 microversion: 2.1 time: 0.153436 Aug 09 15:09:47.538522 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2918/5831] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:09:47 2022] POST /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742/action => generated 38629 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 15:09:47.709634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dfe7d092-9d9c-43f8-9e16-795ad52ec1f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:47.744495 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dfe7d092-9d9c-43f8-9e16-795ad52ec1f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1506 microversion: 2.1 time: 0.502480 Aug 09 15:09:47.747429 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2914/5832] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:47 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1506 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:47.780990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc15cea4-4666-4f19-802e-ee4daee4971c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:47.785249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bc15cea4-4666-4f19-802e-ee4daee4971c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:47.828020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc15cea4-4666-4f19-802e-ee4daee4971c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:47.828540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc15cea4-4666-4f19-802e-ee4daee4971c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:47.828982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc15cea4-4666-4f19-802e-ee4daee4971c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:47.831073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc15cea4-4666-4f19-802e-ee4daee4971c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:47.834591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc15cea4-4666-4f19-802e-ee4daee4971c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:47.836356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc15cea4-4666-4f19-802e-ee4daee4971c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:47.946374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bc15cea4-4666-4f19-802e-ee4daee4971c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:09:48.142591 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc15cea4-4666-4f19-802e-ee4daee4971c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "DELETE /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 204 len: 0 microversion: 2.1 time: 0.372648 Aug 09 15:09:48.149132 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2919/5833] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:09:47 2022] DELETE /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:09:48.162679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36ec7b63-6741-41f0-be36-777578b60cba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:48.164384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-36ec7b63-6741-41f0-be36-777578b60cba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:48.179534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36ec7b63-6741-41f0-be36-777578b60cba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:48.181236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36ec7b63-6741-41f0-be36-777578b60cba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:48.182491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36ec7b63-6741-41f0-be36-777578b60cba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:48.184413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36ec7b63-6741-41f0-be36-777578b60cba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:48.185723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36ec7b63-6741-41f0-be36-777578b60cba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:48.187183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36ec7b63-6741-41f0-be36-777578b60cba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:48.257016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-043298d7-ace3-4870-b77c-3b83203f56b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:48.257878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-043298d7-ace3-4870-b77c-3b83203f56b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:48.272981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-043298d7-ace3-4870-b77c-3b83203f56b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:48.276177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-043298d7-ace3-4870-b77c-3b83203f56b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:48.276974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-043298d7-ace3-4870-b77c-3b83203f56b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:48.278612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-043298d7-ace3-4870-b77c-3b83203f56b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:48.278937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-043298d7-ace3-4870-b77c-3b83203f56b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:48.279669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-043298d7-ace3-4870-b77c-3b83203f56b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:48.874544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-36ec7b63-6741-41f0-be36-777578b60cba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:48.891855 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36ec7b63-6741-41f0-be36-777578b60cba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1512 microversion: 2.1 time: 0.735639 Aug 09 15:09:48.892808 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2915/5834] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:48 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1512 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:09:48.954199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-043298d7-ace3-4870-b77c-3b83203f56b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:48.963003 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-043298d7-ace3-4870-b77c-3b83203f56b5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1228 microversion: 2.1 time: 0.710636 Aug 09 15:09:48.966437 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2920/5835] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:48 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1228 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:09:49.639731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7313dd2f-cfc3-4123-beff-dc4ef0d364cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:49.641075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7313dd2f-cfc3-4123-beff-dc4ef0d364cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:49.649031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:49.658215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=14 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:49.699494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7313dd2f-cfc3-4123-beff-dc4ef0d364cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:49.701778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-c81e6521-68ae-43f7-8cb6-c2e3ef6e4e25 req-90e24ab3-b579-437a-902e-06ac78ce53d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f69872-0228-4e22-9375-4c882f72f742", "tag": "bf1a7c3c-6a1c-474c-8361-842291ae8347"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:49.713236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7313dd2f-cfc3-4123-beff-dc4ef0d364cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:49.718379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7313dd2f-cfc3-4123-beff-dc4ef0d364cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:49.724295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7313dd2f-cfc3-4123-beff-dc4ef0d364cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:49.726257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7313dd2f-cfc3-4123-beff-dc4ef0d364cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:49.730028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7313dd2f-cfc3-4123-beff-dc4ef0d364cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:49.743597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c81e6521-68ae-43f7-8cb6-c2e3ef6e4e25 req-90e24ab3-b579-437a-902e-06ac78ce53d7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:49.746802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c81e6521-68ae-43f7-8cb6-c2e3ef6e4e25 req-90e24ab3-b579-437a-902e-06ac78ce53d7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:49.747437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c81e6521-68ae-43f7-8cb6-c2e3ef6e4e25 req-90e24ab3-b579-437a-902e-06ac78ce53d7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:49.779392 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-c81e6521-68ae-43f7-8cb6-c2e3ef6e4e25 req-90e24ab3-b579-437a-902e-06ac78ce53d7 service nova] Creating event network-changed:bf1a7c3c-6a1c-474c-8361-842291ae8347 for instance d4f69872-0228-4e22-9375-4c882f72f742 on n-h1-844626-8 Aug 09 15:09:49.791766 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-c81e6521-68ae-43f7-8cb6-c2e3ef6e4e25 req-90e24ab3-b579-437a-902e-06ac78ce53d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100875 Aug 09 15:09:49.793557 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2921/5836] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:09:49.898748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7313dd2f-cfc3-4123-beff-dc4ef0d364cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:09:49.947675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93e27c04-96d6-415b-8837-34c1c1dad49e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:49.948702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93e27c04-96d6-415b-8837-34c1c1dad49e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:49.969572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93e27c04-96d6-415b-8837-34c1c1dad49e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:49.971671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93e27c04-96d6-415b-8837-34c1c1dad49e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:49.972260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93e27c04-96d6-415b-8837-34c1c1dad49e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:49.977141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93e27c04-96d6-415b-8837-34c1c1dad49e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:49.979060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93e27c04-96d6-415b-8837-34c1c1dad49e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:49.983804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93e27c04-96d6-415b-8837-34c1c1dad49e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:50.238073 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7313dd2f-cfc3-4123-beff-dc4ef0d364cd tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 204 len: 0 microversion: 2.1 time: 0.610443 Aug 09 15:09:50.239244 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2916/5837] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:09:49 2022] DELETE /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:09:50.245301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0e1ea9a4-3eb2-4327-9fc5-aea08bff53e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:50.246096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0e1ea9a4-3eb2-4327-9fc5-aea08bff53e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:50.264794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e1ea9a4-3eb2-4327-9fc5-aea08bff53e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:50.265635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e1ea9a4-3eb2-4327-9fc5-aea08bff53e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:50.266288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e1ea9a4-3eb2-4327-9fc5-aea08bff53e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:50.267245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e1ea9a4-3eb2-4327-9fc5-aea08bff53e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:50.267893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e1ea9a4-3eb2-4327-9fc5-aea08bff53e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:50.268540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e1ea9a4-3eb2-4327-9fc5-aea08bff53e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:50.632383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-93e27c04-96d6-415b-8837-34c1c1dad49e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:50.649561 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93e27c04-96d6-415b-8837-34c1c1dad49e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1512 microversion: 2.1 time: 0.704585 Aug 09 15:09:50.654201 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2922/5838] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:49 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1512 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:50.684995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d997b12-8b03-4402-bb1a-13037fe0ab49 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:50.686605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d997b12-8b03-4402-bb1a-13037fe0ab49 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:50.707872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d997b12-8b03-4402-bb1a-13037fe0ab49 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:50.709531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d997b12-8b03-4402-bb1a-13037fe0ab49 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:50.710150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d997b12-8b03-4402-bb1a-13037fe0ab49 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:50.717158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d997b12-8b03-4402-bb1a-13037fe0ab49 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:50.718403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d997b12-8b03-4402-bb1a-13037fe0ab49 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:50.722069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d997b12-8b03-4402-bb1a-13037fe0ab49 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:50.967075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0e1ea9a4-3eb2-4327-9fc5-aea08bff53e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:50.979989 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0e1ea9a4-3eb2-4327-9fc5-aea08bff53e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1228 microversion: 2.1 time: 0.739302 Aug 09 15:09:50.991777 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2917/5839] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:50 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1228 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:50.997159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4eca29a4-f590-48b9-bc31-81609e920fd2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:50.998017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4eca29a4-f590-48b9-bc31-81609e920fd2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:51.016688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eca29a4-f590-48b9-bc31-81609e920fd2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:51.017606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eca29a4-f590-48b9-bc31-81609e920fd2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:51.018275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eca29a4-f590-48b9-bc31-81609e920fd2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:51.019289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eca29a4-f590-48b9-bc31-81609e920fd2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:51.019991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eca29a4-f590-48b9-bc31-81609e920fd2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:51.020637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4eca29a4-f590-48b9-bc31-81609e920fd2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:51.087658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4eca29a4-f590-48b9-bc31-81609e920fd2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:09:51.230108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d997b12-8b03-4402-bb1a-13037fe0ab49 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:51.248230 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d997b12-8b03-4402-bb1a-13037fe0ab49 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1691 microversion: 2.1 time: 0.573347 Aug 09 15:09:51.249287 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2923/5840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:50 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1691 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:51.273858 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4eca29a4-f590-48b9-bc31-81609e920fd2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 204 len: 0 microversion: 2.1 time: 0.280225 Aug 09 15:09:51.275442 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2918/5841] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:09:50 2022] DELETE /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:09:51.286384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0bd0c788-d0ec-4309-9a6c-bd67921a935a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:51.287433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0bd0c788-d0ec-4309-9a6c-bd67921a935a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:51.297856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bd0c788-d0ec-4309-9a6c-bd67921a935a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:51.298925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bd0c788-d0ec-4309-9a6c-bd67921a935a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:51.299551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bd0c788-d0ec-4309-9a6c-bd67921a935a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:51.301157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bd0c788-d0ec-4309-9a6c-bd67921a935a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:51.301771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bd0c788-d0ec-4309-9a6c-bd67921a935a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:51.303465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bd0c788-d0ec-4309-9a6c-bd67921a935a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:51.679714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eac52d31-44ca-4a18-929c-bca24c00f9d5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:51.681286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eac52d31-44ca-4a18-929c-bca24c00f9d5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:51.697998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac52d31-44ca-4a18-929c-bca24c00f9d5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:51.701023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac52d31-44ca-4a18-929c-bca24c00f9d5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:51.704122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac52d31-44ca-4a18-929c-bca24c00f9d5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:51.708236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac52d31-44ca-4a18-929c-bca24c00f9d5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:51.709428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac52d31-44ca-4a18-929c-bca24c00f9d5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:51.711230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eac52d31-44ca-4a18-929c-bca24c00f9d5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:51.803998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:51.912105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0bd0c788-d0ec-4309-9a6c-bd67921a935a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:51.930891 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0bd0c788-d0ec-4309-9a6c-bd67921a935a tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1553 microversion: 2.1 time: 0.646301 Aug 09 15:09:51.931596 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2924/5842] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:51 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1553 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:51.958030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-34977592-820d-49e3-baad-028b26118628 req-eb255272-163a-4a7a-8e26-7d00acfd4492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18649c3a-2c5b-41d2-8863-6a2c232ba535", "name": "network-vif-deleted", "tag": "b9155cb3-b522-4cf8-b4fa-8c746eb1e87c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:51.997468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-34977592-820d-49e3-baad-028b26118628 req-eb255272-163a-4a7a-8e26-7d00acfd4492 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:52.002067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-34977592-820d-49e3-baad-028b26118628 req-eb255272-163a-4a7a-8e26-7d00acfd4492 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:52.003415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-34977592-820d-49e3-baad-028b26118628 req-eb255272-163a-4a7a-8e26-7d00acfd4492 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:52.028344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eac52d31-44ca-4a18-929c-bca24c00f9d5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:52.041637 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eac52d31-44ca-4a18-929c-bca24c00f9d5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1470 microversion: 2.1 time: 0.366870 Aug 09 15:09:52.043131 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2919/5843] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:51 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1470 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:09:52.048845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71951b82-8bfe-4cc1-b696-1189f3e20a05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:52.049751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-71951b82-8bfe-4cc1-b696-1189f3e20a05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:52.056568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71951b82-8bfe-4cc1-b696-1189f3e20a05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:52.059395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71951b82-8bfe-4cc1-b696-1189f3e20a05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:52.068529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71951b82-8bfe-4cc1-b696-1189f3e20a05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:52.069751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71951b82-8bfe-4cc1-b696-1189f3e20a05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:52.070572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71951b82-8bfe-4cc1-b696-1189f3e20a05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:52.071323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71951b82-8bfe-4cc1-b696-1189f3e20a05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:52.075695 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-34977592-820d-49e3-baad-028b26118628 req-eb255272-163a-4a7a-8e26-7d00acfd4492 service nova] Creating event network-vif-deleted:b9155cb3-b522-4cf8-b4fa-8c746eb1e87c for instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 on n-h1-844626-8 Aug 09 15:09:52.081451 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-34977592-820d-49e3-baad-028b26118628 req-eb255272-163a-4a7a-8e26-7d00acfd4492 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134065 Aug 09 15:09:52.082671 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2925/5844] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:09:52.272285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cdb04575-34e9-4cfa-a56d-f3e14dbb85cb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:52.273190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cdb04575-34e9-4cfa-a56d-f3e14dbb85cb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:52.293283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdb04575-34e9-4cfa-a56d-f3e14dbb85cb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:52.299831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdb04575-34e9-4cfa-a56d-f3e14dbb85cb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:52.300567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdb04575-34e9-4cfa-a56d-f3e14dbb85cb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:52.301433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdb04575-34e9-4cfa-a56d-f3e14dbb85cb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:52.311527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdb04575-34e9-4cfa-a56d-f3e14dbb85cb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:52.314674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cdb04575-34e9-4cfa-a56d-f3e14dbb85cb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:52.476734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-71951b82-8bfe-4cc1-b696-1189f3e20a05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:52.493665 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-71951b82-8bfe-4cc1-b696-1189f3e20a05 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1216 microversion: 2.1 time: 0.448664 Aug 09 15:09:52.499603 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2920/5845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:52 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1216 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:52.521118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cdb04575-34e9-4cfa-a56d-f3e14dbb85cb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:52.534320 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cdb04575-34e9-4cfa-a56d-f3e14dbb85cb tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1623 microversion: 2.1 time: 0.265833 Aug 09 15:09:52.535747 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2926/5846] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:52 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1623 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:09:52.957104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8f70e5f1-da26-4fe3-a111-a4deb705d8aa tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:52.965549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8f70e5f1-da26-4fe3-a111-a4deb705d8aa tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:53.002051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f70e5f1-da26-4fe3-a111-a4deb705d8aa tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:53.003379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f70e5f1-da26-4fe3-a111-a4deb705d8aa tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:53.004936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f70e5f1-da26-4fe3-a111-a4deb705d8aa tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:53.006825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f70e5f1-da26-4fe3-a111-a4deb705d8aa tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:53.008054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f70e5f1-da26-4fe3-a111-a4deb705d8aa tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:53.010349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f70e5f1-da26-4fe3-a111-a4deb705d8aa tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:53.064123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:53.064755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:53.091524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:53.098780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:53.099647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:53.101274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:53.105014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:53.107058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:53.211048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:53.211921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:53.213176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:53.213915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lazy-loading 'fault' on Instance uuid 18649c3a-2c5b-41d2-8863-6a2c232ba535 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:09:53.312577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:53.321626 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e6fccbb4-efa6-4e9e-acf0-856e067d22c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 200 len: 1307 microversion: 2.1 time: 0.261649 Aug 09 15:09:53.336438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8f70e5f1-da26-4fe3-a111-a4deb705d8aa tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:53.337174 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2927/5847] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:53 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 1307 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:53.341995 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8f70e5f1-da26-4fe3-a111-a4deb705d8aa tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1553 microversion: 2.1 time: 0.392573 Aug 09 15:09:53.342968 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2921/5848] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:52 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1553 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:53.526135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afab0440-25fc-4978-8b68-f0159ae67a6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:53.527000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-afab0440-25fc-4978-8b68-f0159ae67a6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:53.537590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afab0440-25fc-4978-8b68-f0159ae67a6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:53.538671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afab0440-25fc-4978-8b68-f0159ae67a6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:53.539829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afab0440-25fc-4978-8b68-f0159ae67a6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:53.540748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afab0440-25fc-4978-8b68-f0159ae67a6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:53.541209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afab0440-25fc-4978-8b68-f0159ae67a6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:53.541633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afab0440-25fc-4978-8b68-f0159ae67a6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:53.564099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:53.564762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:53.581193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:53.587478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:53.588087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:53.590067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:53.591171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:53.591699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:53.652503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:53.653263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:53.653862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:53.654473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lazy-loading 'fault' on Instance uuid d4f69872-0228-4e22-9375-4c882f72f742 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:09:53.778091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:53.790618 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-555e6c2b-deb3-4c50-b063-eda60d062329 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 200 len: 1509 microversion: 2.1 time: 0.237194 Aug 09 15:09:53.791350 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2922/5849] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:53 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 1509 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:53.949380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-afab0440-25fc-4978-8b68-f0159ae67a6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:53.967036 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afab0440-25fc-4978-8b68-f0159ae67a6d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1216 microversion: 2.1 time: 0.444618 Aug 09 15:09:53.968565 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2928/5850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:53 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1216 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:09:54.114962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-90d6a82f-4c66-4ff7-ab54-eeebe3bda3cf req-e56a060a-8df4-412c-9201-9f3a296ae1c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f69872-0228-4e22-9375-4c882f72f742", "name": "network-vif-deleted", "tag": "bf1a7c3c-6a1c-474c-8361-842291ae8347"}, {"server_uuid": "d3c5e345-411f-4280-8be5-2cde9dc6b349", "name": "network-vif-deleted", "tag": "f3653f5a-4bd9-481f-9734-866260175fe8"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:54.127680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-90d6a82f-4c66-4ff7-ab54-eeebe3bda3cf req-e56a060a-8df4-412c-9201-9f3a296ae1c1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:54.128467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-90d6a82f-4c66-4ff7-ab54-eeebe3bda3cf req-e56a060a-8df4-412c-9201-9f3a296ae1c1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:54.129067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-90d6a82f-4c66-4ff7-ab54-eeebe3bda3cf req-e56a060a-8df4-412c-9201-9f3a296ae1c1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:54.143454 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-90d6a82f-4c66-4ff7-ab54-eeebe3bda3cf req-e56a060a-8df4-412c-9201-9f3a296ae1c1 service nova] Creating event network-vif-deleted:bf1a7c3c-6a1c-474c-8361-842291ae8347 for instance d4f69872-0228-4e22-9375-4c882f72f742 on n-h1-844626-8 Aug 09 15:09:54.144122 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-90d6a82f-4c66-4ff7-ab54-eeebe3bda3cf req-e56a060a-8df4-412c-9201-9f3a296ae1c1 service nova] Creating event network-vif-deleted:f3653f5a-4bd9-481f-9734-866260175fe8 for instance d3c5e345-411f-4280-8be5-2cde9dc6b349 on n-h1-844626-8 Aug 09 15:09:54.151528 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-90d6a82f-4c66-4ff7-ab54-eeebe3bda3cf req-e56a060a-8df4-412c-9201-9f3a296ae1c1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041179 Aug 09 15:09:54.152591 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2923/5851] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:09:54.347944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a6ca39e4-2d60-4334-87f1-5a82dbe40dd4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:54.348945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a6ca39e4-2d60-4334-87f1-5a82dbe40dd4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:54.359303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ca39e4-2d60-4334-87f1-5a82dbe40dd4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:54.359961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ca39e4-2d60-4334-87f1-5a82dbe40dd4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:54.360530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ca39e4-2d60-4334-87f1-5a82dbe40dd4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:54.361457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ca39e4-2d60-4334-87f1-5a82dbe40dd4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:54.362069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ca39e4-2d60-4334-87f1-5a82dbe40dd4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:54.362614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a6ca39e4-2d60-4334-87f1-5a82dbe40dd4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:54.364074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:54.364824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:54.370320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:54.376316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:54.376998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:54.377445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:54.378681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:54.379182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:54.379700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:54.390296 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-a6ca39e4-2d60-4334-87f1-5a82dbe40dd4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a6ca39e4-2d60-4334-87f1-5a82dbe40dd4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 HTTP/1.1 Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '18649c3a-2c5b-41d2-8863-6a2c232ba535'} Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:09:54.393835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.412338 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:54.412338 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:09:54.412338 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:09:54.412338 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:09:54.412338 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:09:54.412338 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:09:54.412338 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.412338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a6ca39e4-2d60-4334-87f1-5a82dbe40dd4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:09:54.412338 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a6ca39e4-2d60-4334-87f1-5a82dbe40dd4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 404 len: 111 microversion: 2.1 time: 0.064744 Aug 09 15:09:54.420906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:54.421401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:54.421920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:54.422379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lazy-loading 'fault' on Instance uuid d3c5e345-411f-4280-8be5-2cde9dc6b349 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:09:54.427578 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2929/5852] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:54 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:09:54.434046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-146593b0-6edf-46dd-9d4a-6e4b99ba1a53 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:54.434913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-146593b0-6edf-46dd-9d4a-6e4b99ba1a53 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:54.448751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146593b0-6edf-46dd-9d4a-6e4b99ba1a53 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:54.450794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146593b0-6edf-46dd-9d4a-6e4b99ba1a53 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:54.451837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146593b0-6edf-46dd-9d4a-6e4b99ba1a53 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:54.453137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146593b0-6edf-46dd-9d4a-6e4b99ba1a53 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:54.453983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146593b0-6edf-46dd-9d4a-6e4b99ba1a53 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:54.454975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-146593b0-6edf-46dd-9d4a-6e4b99ba1a53 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:54.512259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:54.523207 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7f674415-1cf9-4431-aa38-5ebd8a6005e4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 200 len: 1339 microversion: 2.1 time: 0.164191 Aug 09 15:09:54.537546 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2924/5853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:54 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:54.651400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-146593b0-6edf-46dd-9d4a-6e4b99ba1a53 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:54.679342 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-146593b0-6edf-46dd-9d4a-6e4b99ba1a53 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.247301 Aug 09 15:09:54.681103 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2930/5854] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:54 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:54.743203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6befeaad-c306-477c-bdb3-c1c5d17f06f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6befeaad-c306-477c-bdb3-c1c5d17f06f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 163 Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": 12345, "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'networks': [{'uuid': '86b6caed-197b-49d6-8fc8-b79923fc2960'}]}}} Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 12345 Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 15:09:54.751999 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6befeaad-c306-477c-bdb3-c1c5d17f06f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6befeaad-c306-477c-bdb3-c1c5d17f06f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.015393 Aug 09 15:09:54.761580 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2925/5855] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:09:54 2022] POST /compute/v2.1/servers => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:09:54.769087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7e61f22a-946f-4a05-81c4-bb04742aebc4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:54.769815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7e61f22a-946f-4a05-81c4-bb04742aebc4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:54.776633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e61f22a-946f-4a05-81c4-bb04742aebc4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:54.777116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e61f22a-946f-4a05-81c4-bb04742aebc4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:54.777656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e61f22a-946f-4a05-81c4-bb04742aebc4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:54.778505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e61f22a-946f-4a05-81c4-bb04742aebc4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:54.778957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e61f22a-946f-4a05-81c4-bb04742aebc4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:54.779405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7e61f22a-946f-4a05-81c4-bb04742aebc4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:54.816206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8459236e-7c25-42c3-ac59-e9b1964e0792 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:54.817288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8459236e-7c25-42c3-ac59-e9b1964e0792 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: d4f69872-0228-4e22-9375-4c882f72f742] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:54.821194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:09:54.832412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8459236e-7c25-42c3-ac59-e9b1964e0792 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:54.833263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8459236e-7c25-42c3-ac59-e9b1964e0792 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:54.833975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8459236e-7c25-42c3-ac59-e9b1964e0792 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:54.834876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8459236e-7c25-42c3-ac59-e9b1964e0792 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:54.835512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8459236e-7c25-42c3-ac59-e9b1964e0792 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:54.836239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8459236e-7c25-42c3-ac59-e9b1964e0792 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:54.869962 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-8459236e-7c25-42c3-ac59-e9b1964e0792 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] HTTP exception thrown: Instance d4f69872-0228-4e22-9375-4c882f72f742 could not be found. Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8459236e-7c25-42c3-ac59-e9b1964e0792 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Request method failure captured: Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 HTTP/1.1 Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8ncQl_OhnXzPfN37y_gQhZaTw8hyB7aUw1NVxqhnUDpImauOwqDZAMMA42Q0FA5K7BfkHzf96pPtBJHzwEloK0wLejr0pDUs8uplO9kHt2X-z743m5Z_VT211uUGD7Pn_KaW3ovVx3B-Ge_U1JFiW4MIUR6sycWgiLcRVamLUpSKu6I Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 889fa240e1f5494d9c11803acd77f74b Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-543221961 Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_889fa240e1f5494d9c11803acd77f74b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/889fa240e1f5494d9c11803acd77f74b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/889fa240e1f5494d9c11803acd77f74b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/889fa240e1f5494d9c11803acd77f74b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-543221961 Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 889fa240e1f5494d9c11803acd77f74b Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-543221961 Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestNetworkAdvancedServerOps-543221961-project Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 9ff3b746851a4414ba60cb76ac07056b Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-543221961-project Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance d4f69872-0228-4e22-9375-4c882f72f742 could not be found. Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'd4f69872-0228-4e22-9375-4c882f72f742'} Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f69872-0228-4e22-9375-4c882f72f742 could not be found. Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f69872-0228-4e22-9375-4c882f72f742 could not be found. Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.873083 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:09:54.878451 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.878451 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:54.878451 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:09:54.878451 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:09:54.878451 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:09:54.878451 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:09:54.878451 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f69872-0228-4e22-9375-4c882f72f742 could not be found. Aug 09 15:09:54.878451 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:09:54.878451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8459236e-7c25-42c3-ac59-e9b1964e0792 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Returning 404 to user: Instance d4f69872-0228-4e22-9375-4c882f72f742 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:09:54.878451 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8459236e-7c25-42c3-ac59-e9b1964e0792 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742" status: 404 len: 111 microversion: 2.1 time: 0.064381 Aug 09 15:09:54.878451 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2926/5856] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:54 2022] GET /compute/v2.1/servers/d4f69872-0228-4e22-9375-4c882f72f742 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:09:54.970472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7e61f22a-946f-4a05-81c4-bb04742aebc4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:54.986384 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7e61f22a-946f-4a05-81c4-bb04742aebc4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.221487 Aug 09 15:09:54.987755 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2931/5857] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:54 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:55.008645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7f3e3eb-75b8-4ca5-a231-af79fb1c5622 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:55.012698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f7f3e3eb-75b8-4ca5-a231-af79fb1c5622 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:55.014568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b6a926af-2d7f-472c-b63e-aee194d19eb8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:55.016577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b6a926af-2d7f-472c-b63e-aee194d19eb8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:55.034851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6a926af-2d7f-472c-b63e-aee194d19eb8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:55.036268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6a926af-2d7f-472c-b63e-aee194d19eb8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:55.037281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6a926af-2d7f-472c-b63e-aee194d19eb8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:55.040367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6a926af-2d7f-472c-b63e-aee194d19eb8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:55.041678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6a926af-2d7f-472c-b63e-aee194d19eb8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:55.042708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b6a926af-2d7f-472c-b63e-aee194d19eb8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:55.046702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7f3e3eb-75b8-4ca5-a231-af79fb1c5622 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:55.048412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7f3e3eb-75b8-4ca5-a231-af79fb1c5622 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:55.048412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7f3e3eb-75b8-4ca5-a231-af79fb1c5622 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:55.049166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7f3e3eb-75b8-4ca5-a231-af79fb1c5622 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:55.049362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7f3e3eb-75b8-4ca5-a231-af79fb1c5622 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:55.050017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7f3e3eb-75b8-4ca5-a231-af79fb1c5622 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:55.290176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f7f3e3eb-75b8-4ca5-a231-af79fb1c5622 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:55.290522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b6a926af-2d7f-472c-b63e-aee194d19eb8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:55.299596 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b6a926af-2d7f-472c-b63e-aee194d19eb8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.292459 Aug 09 15:09:55.300205 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2932/5858] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:55 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:55.313640 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f7f3e3eb-75b8-4ca5-a231-af79fb1c5622 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1216 microversion: 2.1 time: 0.312048 Aug 09 15:09:55.316083 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2927/5859] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:54 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1216 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:55.548109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dccca830-9d1f-4ef9-83d6-53320ee78253 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:55.549041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dccca830-9d1f-4ef9-83d6-53320ee78253 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: d3c5e345-411f-4280-8be5-2cde9dc6b349] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:55.556445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dccca830-9d1f-4ef9-83d6-53320ee78253 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:55.557036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dccca830-9d1f-4ef9-83d6-53320ee78253 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:55.558149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dccca830-9d1f-4ef9-83d6-53320ee78253 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:55.569799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dccca830-9d1f-4ef9-83d6-53320ee78253 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:55.570606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dccca830-9d1f-4ef9-83d6-53320ee78253 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:55.571290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dccca830-9d1f-4ef9-83d6-53320ee78253 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:55.589318 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-dccca830-9d1f-4ef9-83d6-53320ee78253 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] HTTP exception thrown: Instance d3c5e345-411f-4280-8be5-2cde9dc6b349 could not be found. Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dccca830-9d1f-4ef9-83d6-53320ee78253 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Request method failure captured: Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 HTTP/1.1 Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8ngx8srneDmbfWLjF0Eas36v7-mn_6AxXgo1b6xWmO_40N6IWbeI7jJi04naCa4ppbWtqiN8DEejm1hXjBR4zAyZtl9kJIk9WI0oTs0FGvX9161BtN6hpbm8fr5H5ft0uc0HhoOEjIzOQfWQ8XUHyQdS2SxSlSo4X7BkUMmCXCp6mjg Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f459e237ba2d464c8feeb733393804a9 Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestNetworkBasicOps-718665264 Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f459e237ba2d464c8feeb733393804a9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f459e237ba2d464c8feeb733393804a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f459e237ba2d464c8feeb733393804a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f459e237ba2d464c8feeb733393804a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestNetworkBasicOps-718665264 Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f459e237ba2d464c8feeb733393804a9 Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestNetworkBasicOps-718665264 Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestNetworkBasicOps-718665264-project Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 7808d57a047f4fdfa852f71ff632619a Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestNetworkBasicOps-718665264-project Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance d3c5e345-411f-4280-8be5-2cde9dc6b349 could not be found. Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'd3c5e345-411f-4280-8be5-2cde9dc6b349'} Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c5e345-411f-4280-8be5-2cde9dc6b349 could not be found. Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c5e345-411f-4280-8be5-2cde9dc6b349 could not be found. Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:09:55.591112 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:55.595910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:55.595910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:09:55.595910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:09:55.595910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:09:55.595910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:09:55.595910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c5e345-411f-4280-8be5-2cde9dc6b349 could not be found. Aug 09 15:09:55.595910 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:55.598166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dccca830-9d1f-4ef9-83d6-53320ee78253 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Returning 404 to user: Instance d3c5e345-411f-4280-8be5-2cde9dc6b349 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:09:55.599307 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dccca830-9d1f-4ef9-83d6-53320ee78253 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349" status: 404 len: 111 microversion: 2.1 time: 0.056307 Aug 09 15:09:55.603733 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2933/5860] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:55 2022] GET /compute/v2.1/servers/d3c5e345-411f-4280-8be5-2cde9dc6b349 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:09:55.948606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9deae4df-8757-4635-8ff6-2693949bd7de tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '.version_select at 0x7f41dd0494c0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:56.015795 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9deae4df-8757-4635-8ff6-2693949bd7de tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1553863038" status: 202 len: 0 microversion: 2.1 time: 0.074533 Aug 09 15:09:56.017515 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2928/5861] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 9 15:09:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1553863038 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 15:09:56.358945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e5323ce2-a8e7-4b70-9175-aa3f7667b29d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:56.359436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e5323ce2-a8e7-4b70-9175-aa3f7667b29d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:56.370989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5323ce2-a8e7-4b70-9175-aa3f7667b29d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:56.371547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5323ce2-a8e7-4b70-9175-aa3f7667b29d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:56.371980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5323ce2-a8e7-4b70-9175-aa3f7667b29d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:56.378847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5323ce2-a8e7-4b70-9175-aa3f7667b29d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:56.379393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5323ce2-a8e7-4b70-9175-aa3f7667b29d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:56.379836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5323ce2-a8e7-4b70-9175-aa3f7667b29d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:56.787596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e5323ce2-a8e7-4b70-9175-aa3f7667b29d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:56.797550 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e5323ce2-a8e7-4b70-9175-aa3f7667b29d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1216 microversion: 2.1 time: 0.443650 Aug 09 15:09:56.803712 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2934/5862] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:56 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1216 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:57.835001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e468278-4b47-4379-ae52-bb3fdc78f241 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:57.843930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5e468278-4b47-4379-ae52-bb3fdc78f241 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:57.852601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e468278-4b47-4379-ae52-bb3fdc78f241 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:57.853247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e468278-4b47-4379-ae52-bb3fdc78f241 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:57.853691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e468278-4b47-4379-ae52-bb3fdc78f241 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:57.854454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e468278-4b47-4379-ae52-bb3fdc78f241 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:57.854912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e468278-4b47-4379-ae52-bb3fdc78f241 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:57.855442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e468278-4b47-4379-ae52-bb3fdc78f241 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:58.143708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5e468278-4b47-4379-ae52-bb3fdc78f241 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:58.178398 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5e468278-4b47-4379-ae52-bb3fdc78f241 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1216 microversion: 2.1 time: 0.349636 Aug 09 15:09:58.195867 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2929/5863] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:57 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1216 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:58.201421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3bf19f35-e397-467c-ad2b-bf02b0c7aa4e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2092127732", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fa8808b1-fc58-41c6-95db-32072f5a0ad0", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:09:58.321058 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-3bf19f35-e397-467c-ad2b-bf02b0c7aa4e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Block Device fa8808b1-fc58-41c6-95db-32072f5a0ad0 is not bootable. Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3bf19f35-e397-467c-ad2b-bf02b0c7aa4e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 358 Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2092127732", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fa8808b1-fc58-41c6-95db-32072f5a0ad0", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: exception: Block Device fa8808b1-fc58-41c6-95db-32072f5a0ad0 is not bootable. Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2092127732', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'fa8808b1-fc58-41c6-95db-32072f5a0ad0'}], 'networks': [{'uuid': '86b6caed-197b-49d6-8fc8-b79923fc2960'}]}}} Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device fa8808b1-fc58-41c6-95db-32072f5a0ad0 is not bootable. Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:09:58.343736 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device fa8808b1-fc58-41c6-95db-32072f5a0ad0 is not bootable. Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device fa8808b1-fc58-41c6-95db-32072f5a0ad0 is not bootable. Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3bf19f35-e397-467c-ad2b-bf02b0c7aa4e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Block Device fa8808b1-fc58-41c6-95db-32072f5a0ad0 is not bootable. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3bf19f35-e397-467c-ad2b-bf02b0c7aa4e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.154039 Aug 09 15:09:58.354223 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2935/5864] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:09:58 2022] POST /compute/v2.1/servers => generated 110 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 15:09:58.362221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1fac610-693b-425a-b28f-c8884c266aee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:58.363269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1fac610-693b-425a-b28f-c8884c266aee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:58.370271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1fac610-693b-425a-b28f-c8884c266aee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:58.370828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1fac610-693b-425a-b28f-c8884c266aee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:58.371337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1fac610-693b-425a-b28f-c8884c266aee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:58.372089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1fac610-693b-425a-b28f-c8884c266aee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:58.372551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1fac610-693b-425a-b28f-c8884c266aee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:58.372984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1fac610-693b-425a-b28f-c8884c266aee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:58.615938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b1fac610-693b-425a-b28f-c8884c266aee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:58.624463 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b1fac610-693b-425a-b28f-c8884c266aee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.266586 Aug 09 15:09:58.626173 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2930/5865] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:58 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:58.653699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c44f21aa-d27c-43d2-a963-638193a303f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:58.655228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c44f21aa-d27c-43d2-a963-638193a303f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:58.669532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c44f21aa-d27c-43d2-a963-638193a303f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:58.670780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c44f21aa-d27c-43d2-a963-638193a303f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:58.671858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c44f21aa-d27c-43d2-a963-638193a303f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:58.673448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c44f21aa-d27c-43d2-a963-638193a303f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:58.674565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c44f21aa-d27c-43d2-a963-638193a303f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:58.675727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c44f21aa-d27c-43d2-a963-638193a303f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:58.886358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c44f21aa-d27c-43d2-a963-638193a303f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:58.901983 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c44f21aa-d27c-43d2-a963-638193a303f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.257502 Aug 09 15:09:58.903431 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2936/5866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:58 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:09:59.219879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-875302b5-f8eb-45f0-a414-90653b4a4ba1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:09:59.220468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-875302b5-f8eb-45f0-a414-90653b4a4ba1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:09:59.251976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-875302b5-f8eb-45f0-a414-90653b4a4ba1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:59.255137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-875302b5-f8eb-45f0-a414-90653b4a4ba1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:59.258294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-875302b5-f8eb-45f0-a414-90653b4a4ba1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:59.261761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-875302b5-f8eb-45f0-a414-90653b4a4ba1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:09:59.263941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-875302b5-f8eb-45f0-a414-90653b4a4ba1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:09:59.264970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-875302b5-f8eb-45f0-a414-90653b4a4ba1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:09:59.656576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-875302b5-f8eb-45f0-a414-90653b4a4ba1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:09:59.693890 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-875302b5-f8eb-45f0-a414-90653b4a4ba1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1216 microversion: 2.1 time: 0.474722 Aug 09 15:09:59.696316 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2931/5867] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:09:59 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1216 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:00.318167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eb783e6d-8688-49b0-aa01-1bef9f7cdf4b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:00.321537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eb783e6d-8688-49b0-aa01-1bef9f7cdf4b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:00.327664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-15823919-0067-43f7-8ac4-3dffe4b4eef1 req-988f931d-d083-4b05-b104-790bcc9a719d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff9f9a2-2871-42e5-988c-bd15cc759edc", "tag": "4c929778-d5b6-4bc4-bc31-3e32d80c0b5b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:00.358469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb783e6d-8688-49b0-aa01-1bef9f7cdf4b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:00.362279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb783e6d-8688-49b0-aa01-1bef9f7cdf4b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:00.363203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb783e6d-8688-49b0-aa01-1bef9f7cdf4b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:00.367481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb783e6d-8688-49b0-aa01-1bef9f7cdf4b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:00.368470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb783e6d-8688-49b0-aa01-1bef9f7cdf4b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:00.369210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb783e6d-8688-49b0-aa01-1bef9f7cdf4b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:00.372998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-15823919-0067-43f7-8ac4-3dffe4b4eef1 req-988f931d-d083-4b05-b104-790bcc9a719d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:00.378815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-15823919-0067-43f7-8ac4-3dffe4b4eef1 req-988f931d-d083-4b05-b104-790bcc9a719d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:00.380099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-15823919-0067-43f7-8ac4-3dffe4b4eef1 req-988f931d-d083-4b05-b104-790bcc9a719d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:00.422224 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-15823919-0067-43f7-8ac4-3dffe4b4eef1 req-988f931d-d083-4b05-b104-790bcc9a719d service nova] Creating event network-changed:4c929778-d5b6-4bc4-bc31-3e32d80c0b5b for instance 7ff9f9a2-2871-42e5-988c-bd15cc759edc on n-h1-844626-8 Aug 09 15:10:00.454380 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-15823919-0067-43f7-8ac4-3dffe4b4eef1 req-988f931d-d083-4b05-b104-790bcc9a719d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132661 Aug 09 15:10:00.456593 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2932/5868] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:10:00.502337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eb783e6d-8688-49b0-aa01-1bef9f7cdf4b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:10:00.721269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8465be1d-23fb-4092-a284-2b6034cf5a2b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:00.735702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8465be1d-23fb-4092-a284-2b6034cf5a2b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:00.765066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8465be1d-23fb-4092-a284-2b6034cf5a2b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:00.766687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8465be1d-23fb-4092-a284-2b6034cf5a2b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:00.771056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8465be1d-23fb-4092-a284-2b6034cf5a2b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:00.772061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8465be1d-23fb-4092-a284-2b6034cf5a2b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:00.772680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8465be1d-23fb-4092-a284-2b6034cf5a2b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:00.773216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8465be1d-23fb-4092-a284-2b6034cf5a2b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:00.862758 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eb783e6d-8688-49b0-aa01-1bef9f7cdf4b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 204 len: 0 microversion: 2.1 time: 0.552281 Aug 09 15:10:00.865872 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2937/5869] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:10:00 2022] DELETE /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 15:10:00.891349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b144f894-6854-4768-bc9e-4c82854d2bc6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:00.893079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b144f894-6854-4768-bc9e-4c82854d2bc6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:00.922656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b144f894-6854-4768-bc9e-4c82854d2bc6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:00.924533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b144f894-6854-4768-bc9e-4c82854d2bc6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:00.928531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b144f894-6854-4768-bc9e-4c82854d2bc6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:00.930024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b144f894-6854-4768-bc9e-4c82854d2bc6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:00.930997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b144f894-6854-4768-bc9e-4c82854d2bc6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:00.932129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b144f894-6854-4768-bc9e-4c82854d2bc6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:01.755385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8465be1d-23fb-4092-a284-2b6034cf5a2b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:01.777704 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8465be1d-23fb-4092-a284-2b6034cf5a2b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1216 microversion: 2.1 time: 1.063373 Aug 09 15:10:01.794614 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2933/5870] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:00 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1216 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:01.984921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-98ff1f35-31c3-46d5-a9cd-15e3dcd6a686 req-2ede9e3d-7964-4be7-848c-8433d6c5e165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e", "name": "network-vif-plugged", "status": "completed", "tag": "20b724ce-5a2a-405e-aeb2-48c469b3dbaa"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:02.037429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-98ff1f35-31c3-46d5-a9cd-15e3dcd6a686 req-2ede9e3d-7964-4be7-848c-8433d6c5e165 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:02.038511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-98ff1f35-31c3-46d5-a9cd-15e3dcd6a686 req-2ede9e3d-7964-4be7-848c-8433d6c5e165 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:02.042759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-98ff1f35-31c3-46d5-a9cd-15e3dcd6a686 req-2ede9e3d-7964-4be7-848c-8433d6c5e165 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:02.064588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b144f894-6854-4768-bc9e-4c82854d2bc6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:02.080073 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b144f894-6854-4768-bc9e-4c82854d2bc6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1671 microversion: 2.1 time: 1.206777 Aug 09 15:10:02.081336 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2938/5871] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:00 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1671 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:02.117358 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-98ff1f35-31c3-46d5-a9cd-15e3dcd6a686 req-2ede9e3d-7964-4be7-848c-8433d6c5e165 service nova] Creating event network-vif-plugged:20b724ce-5a2a-405e-aeb2-48c469b3dbaa for instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e on n-h2-844626-8 Aug 09 15:10:02.134709 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-98ff1f35-31c3-46d5-a9cd-15e3dcd6a686 req-2ede9e3d-7964-4be7-848c-8433d6c5e165 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153992 Aug 09 15:10:02.138122 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2934/5872] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:10:02.803460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-259d6cab-6cf9-4178-a829-55b5b9c81670 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:02.804075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-259d6cab-6cf9-4178-a829-55b5b9c81670 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:02.831946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-259d6cab-6cf9-4178-a829-55b5b9c81670 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:02.832472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-259d6cab-6cf9-4178-a829-55b5b9c81670 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:02.833106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-259d6cab-6cf9-4178-a829-55b5b9c81670 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:02.834069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-259d6cab-6cf9-4178-a829-55b5b9c81670 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:02.834532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-259d6cab-6cf9-4178-a829-55b5b9c81670 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:02.834955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-259d6cab-6cf9-4178-a829-55b5b9c81670 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:03.120491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4c1625f9-05fb-4e21-8be0-28893a74ffca tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:03.121263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4c1625f9-05fb-4e21-8be0-28893a74ffca tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:03.151431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c1625f9-05fb-4e21-8be0-28893a74ffca tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:03.152136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c1625f9-05fb-4e21-8be0-28893a74ffca tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:03.152605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c1625f9-05fb-4e21-8be0-28893a74ffca tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:03.158930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c1625f9-05fb-4e21-8be0-28893a74ffca tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:03.159631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c1625f9-05fb-4e21-8be0-28893a74ffca tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:03.160368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4c1625f9-05fb-4e21-8be0-28893a74ffca tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:03.285520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-259d6cab-6cf9-4178-a829-55b5b9c81670 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:03.310297 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-259d6cab-6cf9-4178-a829-55b5b9c81670 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1216 microversion: 2.1 time: 0.504933 Aug 09 15:10:03.313216 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2939/5873] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:02 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1216 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:03.328067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc6e47b1-a83b-4ee1-9906-dda5caeead12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2055141390", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "destination_type": "local"}, {"source_type": "volume", "uuid": "ea9d5ba7-606b-4cc8-9b9e-e854ef165624", "destination_type": "invalid"}], "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc6e47b1-a83b-4ee1-9906-dda5caeead12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 495 Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2055141390", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "destination_type": "local"}, {"source_type": "volume", "uuid": "ea9d5ba7-606b-4cc8-9b9e-e854ef165624", "destination_type": "invalid"}], "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2055141390', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'ea9d5ba7-606b-4cc8-9b9e-e854ef165624', 'destination_type': 'invalid'}], 'networks': [{'uuid': '86b6caed-197b-49d6-8fc8-b79923fc2960'}]}}} Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'invalid' Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:03.341184 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc6e47b1-a83b-4ee1-9906-dda5caeead12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc6e47b1-a83b-4ee1-9906-dda5caeead12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.031324 Aug 09 15:10:03.352402 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2940/5874] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:03 2022] POST /compute/v2.1/servers => generated 155 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:10:03.363744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4ee58dd-fa73-413e-a1a0-c5c71216c781 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:03.366567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4ee58dd-fa73-413e-a1a0-c5c71216c781 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:03.381201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4ee58dd-fa73-413e-a1a0-c5c71216c781 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:03.385983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4ee58dd-fa73-413e-a1a0-c5c71216c781 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:03.387243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4ee58dd-fa73-413e-a1a0-c5c71216c781 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:03.394130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4ee58dd-fa73-413e-a1a0-c5c71216c781 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:03.399201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4ee58dd-fa73-413e-a1a0-c5c71216c781 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:03.399769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4ee58dd-fa73-413e-a1a0-c5c71216c781 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:03.489601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4c1625f9-05fb-4e21-8be0-28893a74ffca tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:03.505285 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4c1625f9-05fb-4e21-8be0-28893a74ffca tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 200 len: 1604 microversion: 2.1 time: 0.388054 Aug 09 15:10:03.519935 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2935/5875] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:03 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 1604 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:03.610357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-458591dc-fb4b-4c88-a760-b860e44c9fda req-5ca0a430-9ce0-45ac-bb76-c7ba663b4fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff9f9a2-2871-42e5-988c-bd15cc759edc", "name": "network-vif-deleted", "tag": "4c929778-d5b6-4bc4-bc31-3e32d80c0b5b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:03.636837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-458591dc-fb4b-4c88-a760-b860e44c9fda req-5ca0a430-9ce0-45ac-bb76-c7ba663b4fd6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:03.646488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-458591dc-fb4b-4c88-a760-b860e44c9fda req-5ca0a430-9ce0-45ac-bb76-c7ba663b4fd6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:03.653330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-458591dc-fb4b-4c88-a760-b860e44c9fda req-5ca0a430-9ce0-45ac-bb76-c7ba663b4fd6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:03.696099 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-458591dc-fb4b-4c88-a760-b860e44c9fda req-5ca0a430-9ce0-45ac-bb76-c7ba663b4fd6 service nova] Creating event network-vif-deleted:4c929778-d5b6-4bc4-bc31-3e32d80c0b5b for instance 7ff9f9a2-2871-42e5-988c-bd15cc759edc on n-h1-844626-8 Aug 09 15:10:03.704325 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-458591dc-fb4b-4c88-a760-b860e44c9fda req-5ca0a430-9ce0-45ac-bb76-c7ba663b4fd6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099603 Aug 09 15:10:03.704973 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2936/5876] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:10:03.983604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b4ee58dd-fa73-413e-a1a0-c5c71216c781 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:04.006383 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4ee58dd-fa73-413e-a1a0-c5c71216c781 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.652820 Aug 09 15:10:04.007596 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2941/5877] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:03 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:04.039641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3e80de6c-faf3-411a-b27b-7932d434dbd9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:04.043826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3e80de6c-faf3-411a-b27b-7932d434dbd9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:04.058470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e80de6c-faf3-411a-b27b-7932d434dbd9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:04.059154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e80de6c-faf3-411a-b27b-7932d434dbd9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:04.059784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e80de6c-faf3-411a-b27b-7932d434dbd9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:04.060686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e80de6c-faf3-411a-b27b-7932d434dbd9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:04.061565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e80de6c-faf3-411a-b27b-7932d434dbd9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:04.062206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e80de6c-faf3-411a-b27b-7932d434dbd9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:04.351172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b27362f0-18af-4b28-ac65-6a3a8dcf9222 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:04.351172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b27362f0-18af-4b28-ac65-6a3a8dcf9222 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:04.372930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b27362f0-18af-4b28-ac65-6a3a8dcf9222 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:04.373753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b27362f0-18af-4b28-ac65-6a3a8dcf9222 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:04.384432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b27362f0-18af-4b28-ac65-6a3a8dcf9222 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:04.385620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b27362f0-18af-4b28-ac65-6a3a8dcf9222 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:04.387306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b27362f0-18af-4b28-ac65-6a3a8dcf9222 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:04.387971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b27362f0-18af-4b28-ac65-6a3a8dcf9222 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:04.639928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3e80de6c-faf3-411a-b27b-7932d434dbd9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:04.658080 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3e80de6c-faf3-411a-b27b-7932d434dbd9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.627487 Aug 09 15:10:04.659125 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2937/5878] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:04 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:04.684187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63f10bec-4569-4e1a-81db-5d312dcdd851 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:04.685677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63f10bec-4569-4e1a-81db-5d312dcdd851 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 7ff9f9a2-2871-42e5-988c-bd15cc759edc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:04.697130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63f10bec-4569-4e1a-81db-5d312dcdd851 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:04.698330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63f10bec-4569-4e1a-81db-5d312dcdd851 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:04.699316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63f10bec-4569-4e1a-81db-5d312dcdd851 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:04.701881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63f10bec-4569-4e1a-81db-5d312dcdd851 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:04.702841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63f10bec-4569-4e1a-81db-5d312dcdd851 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:04.704188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63f10bec-4569-4e1a-81db-5d312dcdd851 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:04.732203 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-63f10bec-4569-4e1a-81db-5d312dcdd851 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] HTTP exception thrown: Instance 7ff9f9a2-2871-42e5-988c-bd15cc759edc could not be found. Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63f10bec-4569-4e1a-81db-5d312dcdd851 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Request method failure captured: Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc HTTP/1.1 Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8ngx8srneDmbfWLjF0Eas36v7-mn_6AxXgo1b6xWmO_40N6IWbeI7jJi04naCa4ppbWtqiN8DEejm1hXjBR4zAyZtl9kJIk9WI0oTs0FGvX9161BtN6hpbm8fr5H5ft0uc0HhoOEjIzOQfWQ8XUHyQdS2SxSlSo4X7BkUMmCXCp6mjg Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f459e237ba2d464c8feeb733393804a9 Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestNetworkBasicOps-718665264 Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f459e237ba2d464c8feeb733393804a9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f459e237ba2d464c8feeb733393804a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f459e237ba2d464c8feeb733393804a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f459e237ba2d464c8feeb733393804a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestNetworkBasicOps-718665264 Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f459e237ba2d464c8feeb733393804a9 Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestNetworkBasicOps-718665264 Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestNetworkBasicOps-718665264-project Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 7808d57a047f4fdfa852f71ff632619a Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestNetworkBasicOps-718665264-project Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 7ff9f9a2-2871-42e5-988c-bd15cc759edc could not be found. Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '7ff9f9a2-2871-42e5-988c-bd15cc759edc'} Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ff9f9a2-2871-42e5-988c-bd15cc759edc could not be found. Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ff9f9a2-2871-42e5-988c-bd15cc759edc could not be found. Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:04.735492 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:04.741190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:04.741190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:04.741190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:04.741190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:04.741190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:04.741190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ff9f9a2-2871-42e5-988c-bd15cc759edc could not be found. Aug 09 15:10:04.741190 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:04.741190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63f10bec-4569-4e1a-81db-5d312dcdd851 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Returning 404 to user: Instance 7ff9f9a2-2871-42e5-988c-bd15cc759edc could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:04.741190 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63f10bec-4569-4e1a-81db-5d312dcdd851 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc" status: 404 len: 111 microversion: 2.1 time: 0.069064 Aug 09 15:10:04.741190 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2938/5879] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:04 2022] GET /compute/v2.1/servers/7ff9f9a2-2871-42e5-988c-bd15cc759edc => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:10:04.771970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f0bece0-bde7-4b03-8c82-97415402974b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-415593918", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f0bece0-bde7-4b03-8c82-97415402974b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 491 Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-415593918", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-415593918', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '86b6caed-197b-49d6-8fc8-b79923fc2960'}]}}} Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:04.782470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f0bece0-bde7-4b03-8c82-97415402974b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f0bece0-bde7-4b03-8c82-97415402974b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.019491 Aug 09 15:10:04.788863 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2939/5880] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:04 2022] POST /compute/v2.1/servers => generated 624 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:10:04.797261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b27362f0-18af-4b28-ac65-6a3a8dcf9222 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:04.802671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57c31e3c-1ce1-417a-846c-abec2c28423b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:04.804501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57c31e3c-1ce1-417a-846c-abec2c28423b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:04.818855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57c31e3c-1ce1-417a-846c-abec2c28423b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:04.819726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57c31e3c-1ce1-417a-846c-abec2c28423b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:04.820479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57c31e3c-1ce1-417a-846c-abec2c28423b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:04.829707 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b27362f0-18af-4b28-ac65-6a3a8dcf9222 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1403 microversion: 2.1 time: 0.497521 Aug 09 15:10:04.831732 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2942/5881] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:04 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1403 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:04.834482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57c31e3c-1ce1-417a-846c-abec2c28423b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:04.835598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57c31e3c-1ce1-417a-846c-abec2c28423b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:04.836862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57c31e3c-1ce1-417a-846c-abec2c28423b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:04.863069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4a7c75a-50f9-4f42-86c0-9a514e5603df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:04.864136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4a7c75a-50f9-4f42-86c0-9a514e5603df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:04.879832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4a7c75a-50f9-4f42-86c0-9a514e5603df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:04.879832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4a7c75a-50f9-4f42-86c0-9a514e5603df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:04.879832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4a7c75a-50f9-4f42-86c0-9a514e5603df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:04.884526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4a7c75a-50f9-4f42-86c0-9a514e5603df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:04.897652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4a7c75a-50f9-4f42-86c0-9a514e5603df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:04.898161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4a7c75a-50f9-4f42-86c0-9a514e5603df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:05.244140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-57c31e3c-1ce1-417a-846c-abec2c28423b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:05.259158 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57c31e3c-1ce1-417a-846c-abec2c28423b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.464018 Aug 09 15:10:05.261026 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2940/5882] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:04 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:05.268763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b4a7c75a-50f9-4f42-86c0-9a514e5603df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:05.274707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-34c3af60-a1a0-425a-a807-714395c74859 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '.version_select at 0x7f41dd0a48b0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:05.279102 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4a7c75a-50f9-4f42-86c0-9a514e5603df tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1403 microversion: 2.1 time: 0.423609 Aug 09 15:10:05.280837 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2943/5883] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:04 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1403 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:05.285566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-182122cf-78bf-45b4-8bdd-2ec419653c35 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '.version_select at 0x7f41dd21d790>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:05.314285 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-34c3af60-a1a0-425a-a807-714395c74859 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1761620597" status: 202 len: 0 microversion: 2.1 time: 0.051005 Aug 09 15:10:05.315175 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2941/5884] 10.222.0.50 () {58 vars in 1284 bytes} [Tue Aug 9 15:10:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1761620597 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:10:05.315332 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-182122cf-78bf-45b4-8bdd-2ec419653c35 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1138984101" status: 202 len: 0 microversion: 2.1 time: 0.033140 Aug 09 15:10:05.321305 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2944/5885] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 9 15:10:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1138984101 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:10:05.329359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-09366eac-1d3c-4da6-bd40-5c68959f383e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:05.330220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-09366eac-1d3c-4da6-bd40-5c68959f383e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:05.337654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09366eac-1d3c-4da6-bd40-5c68959f383e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:05.338394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09366eac-1d3c-4da6-bd40-5c68959f383e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:05.339026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09366eac-1d3c-4da6-bd40-5c68959f383e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:05.339921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09366eac-1d3c-4da6-bd40-5c68959f383e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:05.340533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09366eac-1d3c-4da6-bd40-5c68959f383e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:05.341034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-09366eac-1d3c-4da6-bd40-5c68959f383e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:05.352149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c4385d5d-6e40-4a69-ab9c-eda30deeb77a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-659935527"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:05.356507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4385d5d-6e40-4a69-ab9c-eda30deeb77a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:05.378407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4385d5d-6e40-4a69-ab9c-eda30deeb77a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:05.380291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4385d5d-6e40-4a69-ab9c-eda30deeb77a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:05.381425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4385d5d-6e40-4a69-ab9c-eda30deeb77a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:05.382930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4385d5d-6e40-4a69-ab9c-eda30deeb77a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:05.385189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4385d5d-6e40-4a69-ab9c-eda30deeb77a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:05.385189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c4385d5d-6e40-4a69-ab9c-eda30deeb77a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:05.534335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-09366eac-1d3c-4da6-bd40-5c68959f383e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:05.544956 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-09366eac-1d3c-4da6-bd40-5c68959f383e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.227900 Aug 09 15:10:05.547005 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2945/5886] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:05 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:05.566415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8b7e836a-ffc1-47f2-bef5-ae5066baf33f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'create', calling method: .version_select at 0x7f41dc5ed1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1538523278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOffAQBZmHvai/l3WIyO3ZcfFlsWUeXwiIAZ4gQKo9nml2Szv+0ynLRO8f9nLNe+KHSu18lVFTYeAj97Vp8e/KkazzhLdNCvnNCJR0pPL9sQ2LswHaZiG8auByrwxBGDQ=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:05.594153 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.compute.api [None req-c4385d5d-6e40-4a69-ab9c-eda30deeb77a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Attempting to quiesce instance before volume snapshot. Aug 09 15:10:05.609798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-8b7e836a-ffc1-47f2-bef5-ae5066baf33f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for project 889fa240e1f5494d9c11803acd77f74b. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:10:05.617051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-8b7e836a-ffc1-47f2-bef5-ae5066baf33f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for user 9ff3b746851a4414ba60cb76ac07056b and project 889fa240e1f5494d9c11803acd77f74b. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:10:05.652365 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8b7e836a-ffc1-47f2-bef5-ae5066baf33f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.103635 Aug 09 15:10:05.652937 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2946/5887] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:10:05 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:10:05.667716 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.compute.api [None req-c4385d5d-6e40-4a69-ab9c-eda30deeb77a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 09 15:10:05.675882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:05.685325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d70e23c4-a4f0-4163-bc4a-6876e0709e0f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d70e23c4-a4f0-4163-bc4a-6876e0709e0f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 416 Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'networks': [{'uuid': '86b6caed-197b-49d6-8fc8-b79923fc2960'}]}}} Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:05.693487 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d70e23c4-a4f0-4163-bc4a-6876e0709e0f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:05.697360 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d70e23c4-a4f0-4163-bc4a-6876e0709e0f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.023560 Aug 09 15:10:05.699414 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2947/5888] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:05 2022] POST /compute/v2.1/servers => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:10:05.717225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a72643fb-36fe-4530-81ea-0f426fef72e1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:05.726475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a72643fb-36fe-4530-81ea-0f426fef72e1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:05.745563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a72643fb-36fe-4530-81ea-0f426fef72e1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:05.745957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a72643fb-36fe-4530-81ea-0f426fef72e1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:05.746364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a72643fb-36fe-4530-81ea-0f426fef72e1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:05.747120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a72643fb-36fe-4530-81ea-0f426fef72e1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:05.747582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a72643fb-36fe-4530-81ea-0f426fef72e1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:05.748003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a72643fb-36fe-4530-81ea-0f426fef72e1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:05.791899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c4385d5d-6e40-4a69-ab9c-eda30deeb77a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Creating snapshot from volume 23cf82fd-49d5-4bf0-a527-343335d8eff7. {{(pid=119406) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Aug 09 15:10:06.027207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a72643fb-36fe-4530-81ea-0f426fef72e1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:06.060327 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a72643fb-36fe-4530-81ea-0f426fef72e1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.351015 Aug 09 15:10:06.066955 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2948/5889] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:05 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:06.099021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c6f1309-d452-464d-abd3-a8fb520cd1af tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:06.100083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c6f1309-d452-464d-abd3-a8fb520cd1af tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:06.111782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c6f1309-d452-464d-abd3-a8fb520cd1af tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:06.112652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c6f1309-d452-464d-abd3-a8fb520cd1af tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:06.113688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c6f1309-d452-464d-abd3-a8fb520cd1af tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:06.114974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c6f1309-d452-464d-abd3-a8fb520cd1af tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:06.116105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c6f1309-d452-464d-abd3-a8fb520cd1af tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:06.117112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c6f1309-d452-464d-abd3-a8fb520cd1af tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:06.385748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c6f1309-d452-464d-abd3-a8fb520cd1af tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:06.396786 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c6f1309-d452-464d-abd3-a8fb520cd1af tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.305009 Aug 09 15:10:06.411274 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2949/5890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:06 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:06.535563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ca06e0c-8e00-47cf-9379-181cc7f89364 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-862925053", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": -1, "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:06.553784 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-0ca06e0c-8e00-47cf-9379-181cc7f89364 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Flavor -1 could not be found. Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ca06e0c-8e00-47cf-9379-181cc7f89364 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 205 Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-862925053", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": -1, "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: exception: Flavor -1 could not be found. Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-862925053', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': -1, 'networks': [{'uuid': '86b6caed-197b-49d6-8fc8-b79923fc2960'}]}}} Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:06.555692 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0ca06e0c-8e00-47cf-9379-181cc7f89364 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0ca06e0c-8e00-47cf-9379-181cc7f89364 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.031091 Aug 09 15:10:06.569015 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2950/5891] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:06 2022] POST /compute/v2.1/servers => generated 73 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 15:10:06.575381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c25d9aab-8edc-42b6-94e7-834fa737cdc9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:06.575381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c25d9aab-8edc-42b6-94e7-834fa737cdc9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:06.579147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c25d9aab-8edc-42b6-94e7-834fa737cdc9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:06.579758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c25d9aab-8edc-42b6-94e7-834fa737cdc9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:06.580343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c25d9aab-8edc-42b6-94e7-834fa737cdc9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:06.581608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c25d9aab-8edc-42b6-94e7-834fa737cdc9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:06.581921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c25d9aab-8edc-42b6-94e7-834fa737cdc9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:06.582633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c25d9aab-8edc-42b6-94e7-834fa737cdc9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:06.685418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:07.002057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c25d9aab-8edc-42b6-94e7-834fa737cdc9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:07.026158 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c25d9aab-8edc-42b6-94e7-834fa737cdc9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.461722 Aug 09 15:10:07.027357 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2951/5892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:06 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:07.061589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf609f9a-29bc-4b82-a7a2-c744699c5a99 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:07.062702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf609f9a-29bc-4b82-a7a2-c744699c5a99 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:07.074451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf609f9a-29bc-4b82-a7a2-c744699c5a99 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:07.074946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf609f9a-29bc-4b82-a7a2-c744699c5a99 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:07.075432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf609f9a-29bc-4b82-a7a2-c744699c5a99 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:07.076148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf609f9a-29bc-4b82-a7a2-c744699c5a99 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:07.076800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf609f9a-29bc-4b82-a7a2-c744699c5a99 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:07.080077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf609f9a-29bc-4b82-a7a2-c744699c5a99 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:07.471341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bf609f9a-29bc-4b82-a7a2-c744699c5a99 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:07.524530 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf609f9a-29bc-4b82-a7a2-c744699c5a99 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.463413 Aug 09 15:10:07.546072 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2952/5893] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:07 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:07.665150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eeb4d995-aca3-4d3f-8df2-08a215d9aaa0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1539554695", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eeb4d995-aca3-4d3f-8df2-08a215d9aaa0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 173 Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1539554695", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1539554695', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '86b6caed-197b-49d6-8fc8-b79923fc2960'}]}}} Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi -1 Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 15:10:07.686585 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 09 15:10:07.698990 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:07.705562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eeb4d995-aca3-4d3f-8df2-08a215d9aaa0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:07.707538 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eeb4d995-aca3-4d3f-8df2-08a215d9aaa0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.052468 Aug 09 15:10:07.709413 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2953/5894] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:07 2022] POST /compute/v2.1/servers => generated 145 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:10:07.735474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-13fc175a-9e57-4b8e-93c4-73764e153066 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:07.739135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-13fc175a-9e57-4b8e-93c4-73764e153066 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:07.744679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:07.786137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13fc175a-9e57-4b8e-93c4-73764e153066 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:07.787263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13fc175a-9e57-4b8e-93c4-73764e153066 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:07.791154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13fc175a-9e57-4b8e-93c4-73764e153066 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:07.795387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13fc175a-9e57-4b8e-93c4-73764e153066 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:07.799567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13fc175a-9e57-4b8e-93c4-73764e153066 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:07.801919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13fc175a-9e57-4b8e-93c4-73764e153066 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:07.860053 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c4385d5d-6e40-4a69-ab9c-eda30deeb77a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "POST /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e/action" status: 202 len: 0 microversion: 2.1 time: 2.534484 Aug 09 15:10:07.862427 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2942/5895] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:05 2022] POST /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e/action => generated 0 bytes in 2538 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 15:10:08.182108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-13fc175a-9e57-4b8e-93c4-73764e153066 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:08.202536 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-13fc175a-9e57-4b8e-93c4-73764e153066 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.485928 Aug 09 15:10:08.204747 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2954/5896] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:07 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:08.243721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a185d7f5-d4c3-47e7-bfb4-0ba3962a9a8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:08.244663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a185d7f5-d4c3-47e7-bfb4-0ba3962a9a8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:08.255682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a185d7f5-d4c3-47e7-bfb4-0ba3962a9a8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:08.256395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a185d7f5-d4c3-47e7-bfb4-0ba3962a9a8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:08.256898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a185d7f5-d4c3-47e7-bfb4-0ba3962a9a8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:08.257899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a185d7f5-d4c3-47e7-bfb4-0ba3962a9a8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:08.258658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a185d7f5-d4c3-47e7-bfb4-0ba3962a9a8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:08.260071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a185d7f5-d4c3-47e7-bfb4-0ba3962a9a8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:08.514906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a185d7f5-d4c3-47e7-bfb4-0ba3962a9a8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:08.646419 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a185d7f5-d4c3-47e7-bfb4-0ba3962a9a8c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.417494 Aug 09 15:10:08.649573 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2943/5897] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:08 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:08.754485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8d5fd30-57cc-405f-ad4c-2e1bd89ef9c2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-395552649", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:08.782980 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-b8d5fd30-57cc-405f-ad4c-2e1bd89ef9c2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8d5fd30-57cc-405f-ad4c-2e1bd89ef9c2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 215 Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-395552649", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-395552649', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:08.786202 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:08.794521 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:08.794521 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:08.794521 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:08.794521 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:08.794521 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:08.794521 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 09 15:10:08.794521 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:08.794521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8d5fd30-57cc-405f-ad4c-2e1bd89ef9c2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:08.794521 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8d5fd30-57cc-405f-ad4c-2e1bd89ef9c2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.052002 Aug 09 15:10:08.797686 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2955/5898] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:08 2022] POST /compute/v2.1/servers => generated 123 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:10:08.808993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9aedb68-71f7-476c-b7da-8f2486739b44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:08.811000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e9aedb68-71f7-476c-b7da-8f2486739b44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:08.842883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9aedb68-71f7-476c-b7da-8f2486739b44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:08.843630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9aedb68-71f7-476c-b7da-8f2486739b44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:08.844196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9aedb68-71f7-476c-b7da-8f2486739b44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:08.845063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9aedb68-71f7-476c-b7da-8f2486739b44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:08.845830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9aedb68-71f7-476c-b7da-8f2486739b44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:08.846882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9aedb68-71f7-476c-b7da-8f2486739b44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:09.267844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e9aedb68-71f7-476c-b7da-8f2486739b44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:09.281268 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9aedb68-71f7-476c-b7da-8f2486739b44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.479656 Aug 09 15:10:09.283266 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2944/5899] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:08 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:09.285519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-734800886", "imageRef": "273155b0-97f1-427b-889f-2c2450ebb304", "flavorRef": "452", "networks": [{"uuid": "1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:09.317877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70770696-9a2c-407f-a353-0967c2aa2bd7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:09.320536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-70770696-9a2c-407f-a353-0967c2aa2bd7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:09.334045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70770696-9a2c-407f-a353-0967c2aa2bd7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:09.335220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70770696-9a2c-407f-a353-0967c2aa2bd7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:09.338626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70770696-9a2c-407f-a353-0967c2aa2bd7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:09.342962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70770696-9a2c-407f-a353-0967c2aa2bd7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:09.345783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70770696-9a2c-407f-a353-0967c2aa2bd7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:09.347079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70770696-9a2c-407f-a353-0967c2aa2bd7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:09.415000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] validate_networks() for [('1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:10:09.903910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-70770696-9a2c-407f-a353-0967c2aa2bd7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:09.938425 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70770696-9a2c-407f-a353-0967c2aa2bd7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.636808 Aug 09 15:10:09.941045 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2945/5900] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:09 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:10.051472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-24a5da45-bba1-4373-8a05-aa51a83f2009 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-471489452", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "key_name": "tempest-key-226508567", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:10.203817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-24a5da45-bba1-4373-8a05-aa51a83f2009 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] validate_networks() for [('86b6caed-197b-49d6-8fc8-b79923fc2960', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:10:10.633959 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-24a5da45-bba1-4373-8a05-aa51a83f2009 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Invalid key_name provided. Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-24a5da45-bba1-4373-8a05-aa51a83f2009 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 245 Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-471489452", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "key_name": "tempest-key-226508567", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid key_name provided. Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-471489452', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'key_name': 'tempest-key-226508567', 'networks': [{'uuid': '86b6caed-197b-49d6-8fc8-b79923fc2960'}]}}} Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-226508567 not found for user cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:10.643035 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 09 15:10:10.657564 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:10.663830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-24a5da45-bba1-4373-8a05-aa51a83f2009 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Invalid key_name provided. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:10.663830 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-24a5da45-bba1-4373-8a05-aa51a83f2009 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.622384 Aug 09 15:10:10.664428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:10:10.665188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:10:10.665392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:10:10.665537 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2946/5901] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:10 2022] POST /compute/v2.1/servers => generated 70 bytes in 630 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 09 15:10:10.667279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:10:10.667708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:10:10.678197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c59816d1-217f-49e1-8d98-e9aa7a1ce1a9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:10.678197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c59816d1-217f-49e1-8d98-e9aa7a1ce1a9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:10.684672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:10.685116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c59816d1-217f-49e1-8d98-e9aa7a1ce1a9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:10.685722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c59816d1-217f-49e1-8d98-e9aa7a1ce1a9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:10.686254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c59816d1-217f-49e1-8d98-e9aa7a1ce1a9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:10.687266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c59816d1-217f-49e1-8d98-e9aa7a1ce1a9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:10.687956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c59816d1-217f-49e1-8d98-e9aa7a1ce1a9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:10.688618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c59816d1-217f-49e1-8d98-e9aa7a1ce1a9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:10.689803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:10.690619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:10.694119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:10.695167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:10.696172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:10.744800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:10:10.764825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for user f99b0693d22442ffa84b9c845d7cbc58 and project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:10:10.810430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:10:10.827368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='eec34ff9-aacd-4e41-9452-7f98a067de1f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:10:10.968425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c59816d1-217f-49e1-8d98-e9aa7a1ce1a9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:10.985088 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c59816d1-217f-49e1-8d98-e9aa7a1ce1a9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.311417 Aug 09 15:10:10.988638 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2947/5902] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:10 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:11.014154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-35b8b6b6-470c-42ec-9909-b30421bc84f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:11.018068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-35b8b6b6-470c-42ec-9909-b30421bc84f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:11.042099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35b8b6b6-470c-42ec-9909-b30421bc84f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:11.044198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35b8b6b6-470c-42ec-9909-b30421bc84f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:11.047295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35b8b6b6-470c-42ec-9909-b30421bc84f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:11.053016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35b8b6b6-470c-42ec-9909-b30421bc84f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:11.054392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35b8b6b6-470c-42ec-9909-b30421bc84f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:11.057904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-35b8b6b6-470c-42ec-9909-b30421bc84f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:11.100036 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a5f2a69-9f06-4ec2-bd14-0b75abfc861c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.828001 Aug 09 15:10:11.117878 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2956/5903] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:10:11.133259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5819b998-89a0-41b7-97ed-f11296df80e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:11.135545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5819b998-89a0-41b7-97ed-f11296df80e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:11.304884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5819b998-89a0-41b7-97ed-f11296df80e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:11.327161 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5819b998-89a0-41b7-97ed-f11296df80e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1229 microversion: 2.1 time: 0.203676 Aug 09 15:10:11.329383 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2957/5904] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:11 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1229 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:12.178235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-35b8b6b6-470c-42ec-9909-b30421bc84f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:12.191930 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-35b8b6b6-470c-42ec-9909-b30421bc84f1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 1.182656 Aug 09 15:10:12.194814 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2948/5905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:11 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:12.294775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c575217-5252-4fb8-bd23-c7a6abe9743b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-262110655", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:12.370772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cd0a840a-4cd6-43b7-9c07-31d3c0ee1ee3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:12.372450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cd0a840a-4cd6-43b7-9c07-31d3c0ee1ee3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:12.400393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd0a840a-4cd6-43b7-9c07-31d3c0ee1ee3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:12.404866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd0a840a-4cd6-43b7-9c07-31d3c0ee1ee3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:12.406065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd0a840a-4cd6-43b7-9c07-31d3c0ee1ee3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:12.408153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd0a840a-4cd6-43b7-9c07-31d3c0ee1ee3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:12.409377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd0a840a-4cd6-43b7-9c07-31d3c0ee1ee3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:12.410216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cd0a840a-4cd6-43b7-9c07-31d3c0ee1ee3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:12.619306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cd0a840a-4cd6-43b7-9c07-31d3c0ee1ee3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:12.633723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.security_group_api [None req-2c575217-5252-4fb8-bd23-c7a6abe9743b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Neutron security group does_not_exist not found {{(pid=119407) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 09 15:10:12.634308 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-2c575217-5252-4fb8-bd23-c7a6abe9743b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 09 15:10:12.636898 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cd0a840a-4cd6-43b7-9c07-31d3c0ee1ee3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1225 microversion: 2.1 time: 0.273156 Aug 09 15:10:12.640130 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2949/5906] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:12 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1225 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c575217-5252-4fb8-bd23-c7a6abe9743b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 257 Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-262110655", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-262110655', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '86b6caed-197b-49d6-8fc8-b79923fc2960'}]}}} Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 09 15:10:12.676082 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 09 15:10:12.680415 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:12.685647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c575217-5252-4fb8-bd23-c7a6abe9743b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:12.686568 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2c575217-5252-4fb8-bd23-c7a6abe9743b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.396476 Aug 09 15:10:12.687268 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2958/5907] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:12 2022] POST /compute/v2.1/servers => generated 106 bytes in 398 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:10:12.696697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-46e7f0e1-7bb6-437e-944d-215018638119 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:12.697322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-46e7f0e1-7bb6-437e-944d-215018638119 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:12.706051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46e7f0e1-7bb6-437e-944d-215018638119 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:12.706564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46e7f0e1-7bb6-437e-944d-215018638119 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:12.707000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46e7f0e1-7bb6-437e-944d-215018638119 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:12.707764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46e7f0e1-7bb6-437e-944d-215018638119 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:12.708221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46e7f0e1-7bb6-437e-944d-215018638119 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:12.708791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46e7f0e1-7bb6-437e-944d-215018638119 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:13.040718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46e7f0e1-7bb6-437e-944d-215018638119 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:13.049244 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-46e7f0e1-7bb6-437e-944d-215018638119 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.356532 Aug 09 15:10:13.050912 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2950/5908] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:12 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:13.074875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-80acf909-7704-4b08-bcc6-a228cf8457a7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:13.075806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-80acf909-7704-4b08-bcc6-a228cf8457a7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:13.096525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80acf909-7704-4b08-bcc6-a228cf8457a7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:13.100413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80acf909-7704-4b08-bcc6-a228cf8457a7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:13.101447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80acf909-7704-4b08-bcc6-a228cf8457a7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:13.102702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80acf909-7704-4b08-bcc6-a228cf8457a7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:13.103462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80acf909-7704-4b08-bcc6-a228cf8457a7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:13.104186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-80acf909-7704-4b08-bcc6-a228cf8457a7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:13.357519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-80acf909-7704-4b08-bcc6-a228cf8457a7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:13.370025 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-80acf909-7704-4b08-bcc6-a228cf8457a7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.300980 Aug 09 15:10:13.371851 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2959/5909] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:13 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:13.391893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2930dc7-d717-4f92-af81-f2f4f51f4cd5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:13.392488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b2930dc7-d717-4f92-af81-f2f4f51f4cd5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 9955414f-f988-4c68-be94-acaff0a678e1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:13.398071 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b2930dc7-d717-4f92-af81-f2f4f51f4cd5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 9955414f-f988-4c68-be94-acaff0a678e1 could not be found. Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2930dc7-d717-4f92-af81-f2f4f51f4cd5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/9955414f-f988-4c68-be94-acaff0a678e1 HTTP/1.1 Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 9955414f-f988-4c68-be94-acaff0a678e1 could not be found. Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '9955414f-f988-4c68-be94-acaff0a678e1'} Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9955414f-f988-4c68-be94-acaff0a678e1 could not be found. Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9955414f-f988-4c68-be94-acaff0a678e1 could not be found. Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:13.399672 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:13.403653 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:13.403653 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:13.403653 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:13.403653 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:13.403653 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:13.403653 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:13.403653 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9955414f-f988-4c68-be94-acaff0a678e1 could not be found. Aug 09 15:10:13.403653 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:13.406623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2930dc7-d717-4f92-af81-f2f4f51f4cd5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 9955414f-f988-4c68-be94-acaff0a678e1 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:13.407778 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b2930dc7-d717-4f92-af81-f2f4f51f4cd5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9955414f-f988-4c68-be94-acaff0a678e1" status: 404 len: 111 microversion: 2.1 time: 0.019874 Aug 09 15:10:13.408878 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2951/5910] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:10:13 2022] DELETE /compute/v2.1/servers/9955414f-f988-4c68-be94-acaff0a678e1 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:10:13.417791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d44bc70-adf2-48dd-8c89-be19cb67da3d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:13.418904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6d44bc70-adf2-48dd-8c89-be19cb67da3d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:13.425835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d44bc70-adf2-48dd-8c89-be19cb67da3d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:13.427250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d44bc70-adf2-48dd-8c89-be19cb67da3d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:13.427938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d44bc70-adf2-48dd-8c89-be19cb67da3d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:13.429016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d44bc70-adf2-48dd-8c89-be19cb67da3d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:13.429691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d44bc70-adf2-48dd-8c89-be19cb67da3d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:13.430343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d44bc70-adf2-48dd-8c89-be19cb67da3d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:13.666913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7cddaeb0-ba46-4004-beac-03f97a11662f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:13.667784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7cddaeb0-ba46-4004-beac-03f97a11662f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:13.691837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cddaeb0-ba46-4004-beac-03f97a11662f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:13.692342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cddaeb0-ba46-4004-beac-03f97a11662f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:13.692786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cddaeb0-ba46-4004-beac-03f97a11662f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:13.693509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cddaeb0-ba46-4004-beac-03f97a11662f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:13.693968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cddaeb0-ba46-4004-beac-03f97a11662f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:13.694399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7cddaeb0-ba46-4004-beac-03f97a11662f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:13.711692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6d44bc70-adf2-48dd-8c89-be19cb67da3d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:13.727003 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6d44bc70-adf2-48dd-8c89-be19cb67da3d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.311561 Aug 09 15:10:13.731406 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2960/5911] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:13 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:13.757808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-040f1582-bd1e-404a-beb8-283b86d59230 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:13.758697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-040f1582-bd1e-404a-beb8-283b86d59230 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:13.788332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-040f1582-bd1e-404a-beb8-283b86d59230 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:13.790642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-040f1582-bd1e-404a-beb8-283b86d59230 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:13.791637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-040f1582-bd1e-404a-beb8-283b86d59230 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:13.793769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-040f1582-bd1e-404a-beb8-283b86d59230 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:13.795827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-040f1582-bd1e-404a-beb8-283b86d59230 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:13.796575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-040f1582-bd1e-404a-beb8-283b86d59230 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:13.838252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7cddaeb0-ba46-4004-beac-03f97a11662f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:13.856291 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7cddaeb0-ba46-4004-beac-03f97a11662f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1299 microversion: 2.1 time: 0.193588 Aug 09 15:10:13.863540 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2952/5912] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:13 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1299 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:14.217909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-040f1582-bd1e-404a-beb8-283b86d59230 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:14.238438 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-040f1582-bd1e-404a-beb8-283b86d59230 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.486125 Aug 09 15:10:14.240251 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2961/5913] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:13 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:14.265984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f67a372-34f6-4023-856f-a721f54a0f87 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:14.266797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3f67a372-34f6-4023-856f-a721f54a0f87 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Failed to fetch instance by id 9223372036854775808 {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 15:10:14.267742 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-3f67a372-34f6-4023-856f-a721f54a0f87 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f67a372-34f6-4023-856f-a721f54a0f87 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 9223372036854775808 could not be found. Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '9223372036854775808'} Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:14.269736 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:14.273656 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:14.273656 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:14.273656 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:14.273656 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 09 15:10:14.273656 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:14.275737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f67a372-34f6-4023-856f-a721f54a0f87 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:14.279407 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3f67a372-34f6-4023-856f-a721f54a0f87 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.017426 Aug 09 15:10:14.283730 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2953/5914] 10.222.0.50 () {58 vars in 1188 bytes} [Tue Aug 9 15:10:14 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 15:10:14.294825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-15a14aef-3f96-4fad-bbd8-45eb4bce25ec tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:14.295552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-15a14aef-3f96-4fad-bbd8-45eb4bce25ec tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:14.317755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15a14aef-3f96-4fad-bbd8-45eb4bce25ec tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:14.319621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15a14aef-3f96-4fad-bbd8-45eb4bce25ec tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:14.320073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15a14aef-3f96-4fad-bbd8-45eb4bce25ec tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:14.323606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15a14aef-3f96-4fad-bbd8-45eb4bce25ec tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:14.324214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15a14aef-3f96-4fad-bbd8-45eb4bce25ec tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:14.326235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15a14aef-3f96-4fad-bbd8-45eb4bce25ec tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:14.593560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-15a14aef-3f96-4fad-bbd8-45eb4bce25ec tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:14.609670 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-15a14aef-3f96-4fad-bbd8-45eb4bce25ec tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.321433 Aug 09 15:10:14.610640 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2962/5915] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:14 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:14.636497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d22fedea-350b-4076-a98c-ff3466c24646 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:14.637432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d22fedea-350b-4076-a98c-ff3466c24646 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:14.651154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d22fedea-350b-4076-a98c-ff3466c24646 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:14.651681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d22fedea-350b-4076-a98c-ff3466c24646 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:14.652251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d22fedea-350b-4076-a98c-ff3466c24646 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:14.653106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d22fedea-350b-4076-a98c-ff3466c24646 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:14.653568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d22fedea-350b-4076-a98c-ff3466c24646 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:14.653994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d22fedea-350b-4076-a98c-ff3466c24646 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:14.906243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-459c531a-652f-4f5f-89b3-5372e50a3eca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:14.907186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-459c531a-652f-4f5f-89b3-5372e50a3eca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:14.916412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-459c531a-652f-4f5f-89b3-5372e50a3eca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:14.923299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-459c531a-652f-4f5f-89b3-5372e50a3eca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:14.924110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-459c531a-652f-4f5f-89b3-5372e50a3eca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:14.931852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-459c531a-652f-4f5f-89b3-5372e50a3eca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:14.932709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-459c531a-652f-4f5f-89b3-5372e50a3eca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:14.933399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-459c531a-652f-4f5f-89b3-5372e50a3eca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:15.209684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-459c531a-652f-4f5f-89b3-5372e50a3eca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:15.222910 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-459c531a-652f-4f5f-89b3-5372e50a3eca tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1299 microversion: 2.1 time: 0.321582 Aug 09 15:10:15.236258 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2963/5916] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:14 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1299 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:15.426984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d22fedea-350b-4076-a98c-ff3466c24646 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:15.444141 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d22fedea-350b-4076-a98c-ff3466c24646 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.810974 Aug 09 15:10:15.447458 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2954/5917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:14 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:15.470388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1efaf14c-605d-4efd-a37f-9c3c5490fe92 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:15.471433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1efaf14c-605d-4efd-a37f-9c3c5490fe92 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Failed to fetch instance by id -1 {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 09 15:10:15.472450 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-1efaf14c-605d-4efd-a37f-9c3c5490fe92 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance -1 could not be found. Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1efaf14c-605d-4efd-a37f-9c3c5490fe92 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance -1 could not be found. Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '-1'} Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:15.474486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:15.479171 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:15.479171 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:15.479171 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 09 15:10:15.479171 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:15.482849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1efaf14c-605d-4efd-a37f-9c3c5490fe92 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance -1 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:15.484115 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1efaf14c-605d-4efd-a37f-9c3c5490fe92 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.021203 Aug 09 15:10:15.486624 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2964/5918] 10.222.0.50 () {58 vars in 1137 bytes} [Tue Aug 9 15:10:15 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 15:10:15.495673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9acdb3ec-afac-472a-89b5-811c2bdeeb46 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:15.496309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9acdb3ec-afac-472a-89b5-811c2bdeeb46 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:15.503663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acdb3ec-afac-472a-89b5-811c2bdeeb46 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:15.504173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acdb3ec-afac-472a-89b5-811c2bdeeb46 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:15.504626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acdb3ec-afac-472a-89b5-811c2bdeeb46 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:15.505362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acdb3ec-afac-472a-89b5-811c2bdeeb46 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:15.505825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acdb3ec-afac-472a-89b5-811c2bdeeb46 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:15.506261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9acdb3ec-afac-472a-89b5-811c2bdeeb46 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:15.985517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9acdb3ec-afac-472a-89b5-811c2bdeeb46 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:16.000931 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9acdb3ec-afac-472a-89b5-811c2bdeeb46 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.508112 Aug 09 15:10:16.054736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7ea54135-36f9-4524-b4e0-437cd8031d45 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:16.055745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7ea54135-36f9-4524-b4e0-437cd8031d45 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:16.061782 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2955/5919] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:15 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:16.076017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ea54135-36f9-4524-b4e0-437cd8031d45 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:16.077605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ea54135-36f9-4524-b4e0-437cd8031d45 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:16.079995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ea54135-36f9-4524-b4e0-437cd8031d45 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:16.081059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ea54135-36f9-4524-b4e0-437cd8031d45 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:16.083696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ea54135-36f9-4524-b4e0-437cd8031d45 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:16.084459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ea54135-36f9-4524-b4e0-437cd8031d45 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:16.254894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60c5d0f4-804d-4961-91ee-e239d11be6b8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:16.255646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60c5d0f4-804d-4961-91ee-e239d11be6b8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:16.265061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60c5d0f4-804d-4961-91ee-e239d11be6b8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:16.265598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60c5d0f4-804d-4961-91ee-e239d11be6b8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:16.266023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60c5d0f4-804d-4961-91ee-e239d11be6b8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:16.278823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60c5d0f4-804d-4961-91ee-e239d11be6b8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:16.279798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60c5d0f4-804d-4961-91ee-e239d11be6b8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:16.280421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60c5d0f4-804d-4961-91ee-e239d11be6b8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:16.721554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7ea54135-36f9-4524-b4e0-437cd8031d45 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:16.736313 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7ea54135-36f9-4524-b4e0-437cd8031d45 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.701303 Aug 09 15:10:16.737859 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2965/5920] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:16 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:16.752316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60c5d0f4-804d-4961-91ee-e239d11be6b8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:16.760298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3627b6a4-4957-4c9f-bc70-051443e138d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:16.761305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3627b6a4-4957-4c9f-bc70-051443e138d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: ad11241d-34f8-4d88-aef3-4d9dd61d0404] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:16.770056 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-3627b6a4-4957-4c9f-bc70-051443e138d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance ad11241d-34f8-4d88-aef3-4d9dd61d0404 could not be found. Aug 09 15:10:16.771698 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60c5d0f4-804d-4961-91ee-e239d11be6b8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.521355 Aug 09 15:10:16.774893 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2956/5921] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:16 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3627b6a4-4957-4c9f-bc70-051443e138d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/ad11241d-34f8-4d88-aef3-4d9dd61d0404/action HTTP/1.1 Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 19 Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: {"forceDelete": {}} Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance ad11241d-34f8-4d88-aef3-4d9dd61d0404 could not be found. Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'ad11241d-34f8-4d88-aef3-4d9dd61d0404', 'body': {'forceDelete': {}}} Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad11241d-34f8-4d88-aef3-4d9dd61d0404 could not be found. Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad11241d-34f8-4d88-aef3-4d9dd61d0404 could not be found. Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:16.787248 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:16.791408 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:16.791408 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:16.791408 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad11241d-34f8-4d88-aef3-4d9dd61d0404 could not be found. Aug 09 15:10:16.791408 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:16.792654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3627b6a4-4957-4c9f-bc70-051443e138d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance ad11241d-34f8-4d88-aef3-4d9dd61d0404 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:16.794859 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3627b6a4-4957-4c9f-bc70-051443e138d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/ad11241d-34f8-4d88-aef3-4d9dd61d0404/action" status: 404 len: 111 microversion: 2.1 time: 0.040123 Aug 09 15:10:16.795822 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2966/5922] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:16 2022] POST /compute/v2.1/servers/ad11241d-34f8-4d88-aef3-4d9dd61d0404/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:10:16.804762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87f2fb22-5244-45f7-b1f3-abfd907d2622 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:16.805501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-87f2fb22-5244-45f7-b1f3-abfd907d2622 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:16.817015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87f2fb22-5244-45f7-b1f3-abfd907d2622 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:16.817525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87f2fb22-5244-45f7-b1f3-abfd907d2622 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:16.817975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87f2fb22-5244-45f7-b1f3-abfd907d2622 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:16.818723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87f2fb22-5244-45f7-b1f3-abfd907d2622 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:16.828636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87f2fb22-5244-45f7-b1f3-abfd907d2622 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:16.830116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87f2fb22-5244-45f7-b1f3-abfd907d2622 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:17.289380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-87f2fb22-5244-45f7-b1f3-abfd907d2622 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:17.308446 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87f2fb22-5244-45f7-b1f3-abfd907d2622 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.499763 Aug 09 15:10:17.309131 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2957/5923] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:16 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:17.340234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8925428-2981-41f3-90f9-4866e9f6d1f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:17.341901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8925428-2981-41f3-90f9-4866e9f6d1f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:17.392884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8925428-2981-41f3-90f9-4866e9f6d1f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:17.398059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8925428-2981-41f3-90f9-4866e9f6d1f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:17.399405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8925428-2981-41f3-90f9-4866e9f6d1f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:17.403349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8925428-2981-41f3-90f9-4866e9f6d1f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:17.406769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8925428-2981-41f3-90f9-4866e9f6d1f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:17.412404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8925428-2981-41f3-90f9-4866e9f6d1f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:17.420572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-30dff8e3-c038-442b-9b38-7cb904c11001 req-dc51ac6c-0ae1-4bac-b1ba-f0d3070ab3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "729b22ab-4269-4135-aca0-2603ca95b46c", "tag": "ad452073-9418-4262-96fa-79ef15d5ad1b"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:17.449505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-30dff8e3-c038-442b-9b38-7cb904c11001 req-dc51ac6c-0ae1-4bac-b1ba-f0d3070ab3d4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:17.450216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-30dff8e3-c038-442b-9b38-7cb904c11001 req-dc51ac6c-0ae1-4bac-b1ba-f0d3070ab3d4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:17.452794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-30dff8e3-c038-442b-9b38-7cb904c11001 req-dc51ac6c-0ae1-4bac-b1ba-f0d3070ab3d4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:17.501059 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-30dff8e3-c038-442b-9b38-7cb904c11001 req-dc51ac6c-0ae1-4bac-b1ba-f0d3070ab3d4 service nova] Creating event network-changed:ad452073-9418-4262-96fa-79ef15d5ad1b for instance 729b22ab-4269-4135-aca0-2603ca95b46c on n-h1-844626-8 Aug 09 15:10:17.517652 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-30dff8e3-c038-442b-9b38-7cb904c11001 req-dc51ac6c-0ae1-4bac-b1ba-f0d3070ab3d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102447 Aug 09 15:10:17.524845 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2958/5924] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:10:17.816873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d5e56b5c-2abc-4b6a-a3dd-94fb6388ecfc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:17.817890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d5e56b5c-2abc-4b6a-a3dd-94fb6388ecfc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:17.830731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5e56b5c-2abc-4b6a-a3dd-94fb6388ecfc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:17.831468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5e56b5c-2abc-4b6a-a3dd-94fb6388ecfc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:17.832093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5e56b5c-2abc-4b6a-a3dd-94fb6388ecfc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:17.833212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5e56b5c-2abc-4b6a-a3dd-94fb6388ecfc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:17.833848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5e56b5c-2abc-4b6a-a3dd-94fb6388ecfc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:17.834438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5e56b5c-2abc-4b6a-a3dd-94fb6388ecfc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:18.351791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d5e56b5c-2abc-4b6a-a3dd-94fb6388ecfc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:18.363986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e8925428-2981-41f3-90f9-4866e9f6d1f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:18.379018 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d5e56b5c-2abc-4b6a-a3dd-94fb6388ecfc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.557209 Aug 09 15:10:18.379018 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2959/5925] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:17 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:18.379712 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8925428-2981-41f3-90f9-4866e9f6d1f4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 1.042832 Aug 09 15:10:18.382016 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2967/5926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:17 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:18.402639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99925ed3-4f78-4fd2-ad74-6d58234a21e0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:18.405011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-99925ed3-4f78-4fd2-ad74-6d58234a21e0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 215763a4-5930-4fd4-ae6f-75aaa0b0f177] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:18.418124 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-99925ed3-4f78-4fd2-ad74-6d58234a21e0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 215763a4-5930-4fd4-ae6f-75aaa0b0f177 could not be found. Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99925ed3-4f78-4fd2-ad74-6d58234a21e0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/215763a4-5930-4fd4-ae6f-75aaa0b0f177/action HTTP/1.1 Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 39 Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: {"os-getConsoleOutput": {"length": 10}} Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 215763a4-5930-4fd4-ae6f-75aaa0b0f177 could not be found. Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '215763a4-5930-4fd4-ae6f-75aaa0b0f177', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215763a4-5930-4fd4-ae6f-75aaa0b0f177 could not be found. Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215763a4-5930-4fd4-ae6f-75aaa0b0f177 could not be found. Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:18.427587 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:18.431744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:18.431744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:18.431744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:18.431744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:18.431744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215763a4-5930-4fd4-ae6f-75aaa0b0f177 could not be found. Aug 09 15:10:18.431744 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:18.431744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-99925ed3-4f78-4fd2-ad74-6d58234a21e0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 215763a4-5930-4fd4-ae6f-75aaa0b0f177 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:18.431744 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-99925ed3-4f78-4fd2-ad74-6d58234a21e0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/215763a4-5930-4fd4-ae6f-75aaa0b0f177/action" status: 404 len: 111 microversion: 2.1 time: 0.031205 Aug 09 15:10:18.431744 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2960/5927] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:18 2022] POST /compute/v2.1/servers/215763a4-5930-4fd4-ae6f-75aaa0b0f177/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:10:18.442195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dd8af33b-6255-4581-8dd7-5ddacfef510a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:18.442830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dd8af33b-6255-4581-8dd7-5ddacfef510a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:18.465462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd8af33b-6255-4581-8dd7-5ddacfef510a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:18.466211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd8af33b-6255-4581-8dd7-5ddacfef510a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:18.466942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd8af33b-6255-4581-8dd7-5ddacfef510a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:18.467873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd8af33b-6255-4581-8dd7-5ddacfef510a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:18.475385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd8af33b-6255-4581-8dd7-5ddacfef510a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:18.476763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dd8af33b-6255-4581-8dd7-5ddacfef510a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:18.970452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dd8af33b-6255-4581-8dd7-5ddacfef510a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:18.994377 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dd8af33b-6255-4581-8dd7-5ddacfef510a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.555985 Aug 09 15:10:18.996177 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2968/5928] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:18 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:19.051137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63daffb2-e210-4fe1-8ac8-ac629e1de07b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:19.061137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63daffb2-e210-4fe1-8ac8-ac629e1de07b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:19.122283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63daffb2-e210-4fe1-8ac8-ac629e1de07b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:19.123213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63daffb2-e210-4fe1-8ac8-ac629e1de07b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:19.124077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63daffb2-e210-4fe1-8ac8-ac629e1de07b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:19.134710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63daffb2-e210-4fe1-8ac8-ac629e1de07b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:19.141962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63daffb2-e210-4fe1-8ac8-ac629e1de07b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:19.148381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63daffb2-e210-4fe1-8ac8-ac629e1de07b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:19.397222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40dc126d-fc31-4a50-86f8-acc578c50e5f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:19.398146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40dc126d-fc31-4a50-86f8-acc578c50e5f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:19.423319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40dc126d-fc31-4a50-86f8-acc578c50e5f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:19.423978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40dc126d-fc31-4a50-86f8-acc578c50e5f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:19.424516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40dc126d-fc31-4a50-86f8-acc578c50e5f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:19.429443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40dc126d-fc31-4a50-86f8-acc578c50e5f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:19.430775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40dc126d-fc31-4a50-86f8-acc578c50e5f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:19.431545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40dc126d-fc31-4a50-86f8-acc578c50e5f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:20.555199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63daffb2-e210-4fe1-8ac8-ac629e1de07b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:20.573453 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63daffb2-e210-4fe1-8ac8-ac629e1de07b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 1.555956 Aug 09 15:10:20.576305 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2961/5929] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:19 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:20.600938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9f65257-b69f-4a8c-b460-2ed2d0b8b9c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:20.601742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e9f65257-b69f-4a8c-b460-2ed2d0b8b9c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: ded27929-67d7-417f-ad65-51cf326fab0c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:20.603179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40dc126d-fc31-4a50-86f8-acc578c50e5f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:20.612897 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40dc126d-fc31-4a50-86f8-acc578c50e5f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 1.223269 Aug 09 15:10:20.615067 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-e9f65257-b69f-4a8c-b460-2ed2d0b8b9c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance ded27929-67d7-417f-ad65-51cf326fab0c could not be found. Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9f65257-b69f-4a8c-b460-2ed2d0b8b9c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/ded27929-67d7-417f-ad65-51cf326fab0c HTTP/1.1 Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance ded27929-67d7-417f-ad65-51cf326fab0c could not be found. Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'ded27929-67d7-417f-ad65-51cf326fab0c'} Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded27929-67d7-417f-ad65-51cf326fab0c could not be found. Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded27929-67d7-417f-ad65-51cf326fab0c could not be found. Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:20.617078 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:20.621676 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:20.621676 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:20.621676 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:20.621676 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded27929-67d7-417f-ad65-51cf326fab0c could not be found. Aug 09 15:10:20.621676 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:20.622852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9f65257-b69f-4a8c-b460-2ed2d0b8b9c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance ded27929-67d7-417f-ad65-51cf326fab0c could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:20.623955 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9f65257-b69f-4a8c-b460-2ed2d0b8b9c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/ded27929-67d7-417f-ad65-51cf326fab0c" status: 404 len: 111 microversion: 2.1 time: 0.027380 Aug 09 15:10:20.626834 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2962/5930] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:20 2022] GET /compute/v2.1/servers/ded27929-67d7-417f-ad65-51cf326fab0c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:10:20.632977 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2969/5931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:19 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:20.635838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7b7e55d-cf3a-404c-a966-2d6524bb35b4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:20.639922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7b7e55d-cf3a-404c-a966-2d6524bb35b4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:20.648969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7b7e55d-cf3a-404c-a966-2d6524bb35b4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:20.649749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7b7e55d-cf3a-404c-a966-2d6524bb35b4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:20.650361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7b7e55d-cf3a-404c-a966-2d6524bb35b4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:20.651307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7b7e55d-cf3a-404c-a966-2d6524bb35b4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:20.651989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7b7e55d-cf3a-404c-a966-2d6524bb35b4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:20.652608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7b7e55d-cf3a-404c-a966-2d6524bb35b4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:20.685894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:21.262588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7b7e55d-cf3a-404c-a966-2d6524bb35b4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:21.273995 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7b7e55d-cf3a-404c-a966-2d6524bb35b4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.642312 Aug 09 15:10:21.279472 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2963/5932] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:20 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:21.305448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-433d121a-5cb0-4074-a62b-0925dcffea8e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:21.306191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-433d121a-5cb0-4074-a62b-0925dcffea8e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:21.308996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:21.313740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=12 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:21.342270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-433d121a-5cb0-4074-a62b-0925dcffea8e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:21.342620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-433d121a-5cb0-4074-a62b-0925dcffea8e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:21.348911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-433d121a-5cb0-4074-a62b-0925dcffea8e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:21.355630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-433d121a-5cb0-4074-a62b-0925dcffea8e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:21.357892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-433d121a-5cb0-4074-a62b-0925dcffea8e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:21.358585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-433d121a-5cb0-4074-a62b-0925dcffea8e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:21.772174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-433d121a-5cb0-4074-a62b-0925dcffea8e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:21.809875 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-433d121a-5cb0-4074-a62b-0925dcffea8e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.508718 Aug 09 15:10:21.811451 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2970/5933] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:21 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:22.268424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f84623b-72fc-4331-a505-739e3fa9e74c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:22.269258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f84623b-72fc-4331-a505-739e3fa9e74c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:22.285325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f84623b-72fc-4331-a505-739e3fa9e74c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:22.285850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f84623b-72fc-4331-a505-739e3fa9e74c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:22.286634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f84623b-72fc-4331-a505-739e3fa9e74c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:22.292401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f84623b-72fc-4331-a505-739e3fa9e74c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:22.302728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f84623b-72fc-4331-a505-739e3fa9e74c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:22.303683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f84623b-72fc-4331-a505-739e3fa9e74c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:22.324407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05dc30cb-819d-4202-ae2b-ebc8d4ae4170 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-740165201", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05dc30cb-819d-4202-ae2b-ebc8d4ae4170 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 237 Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-740165201", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-740165201', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '86b6caed-197b-49d6-8fc8-b79923fc2960'}]}}} Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:22.390550 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 09 15:10:22.399603 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:22.408961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05dc30cb-819d-4202-ae2b-ebc8d4ae4170 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:22.408961 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05dc30cb-819d-4202-ae2b-ebc8d4ae4170 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.088065 Aug 09 15:10:22.420474 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2971/5934] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 09 15:10:22.445757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a98d46d-b408-439d-a812-75de230d5cca tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:22.446776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a98d46d-b408-439d-a812-75de230d5cca tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:22.477310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a98d46d-b408-439d-a812-75de230d5cca tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:22.477884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a98d46d-b408-439d-a812-75de230d5cca tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:22.479832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a98d46d-b408-439d-a812-75de230d5cca tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:22.487105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a98d46d-b408-439d-a812-75de230d5cca tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:22.490530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a98d46d-b408-439d-a812-75de230d5cca tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:22.496085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a98d46d-b408-439d-a812-75de230d5cca tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:22.933590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f84623b-72fc-4331-a505-739e3fa9e74c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:22.951602 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f84623b-72fc-4331-a505-739e3fa9e74c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 1.301097 Aug 09 15:10:22.960359 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2964/5935] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:21 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:22.984068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4a98d46d-b408-439d-a812-75de230d5cca tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:22.998719 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a98d46d-b408-439d-a812-75de230d5cca tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.574872 Aug 09 15:10:23.004229 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2972/5936] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:22 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:23.052185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85165b98-b4cf-4bdc-b9c5-1f89a2163a0c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:23.053113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-85165b98-b4cf-4bdc-b9c5-1f89a2163a0c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:23.067637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85165b98-b4cf-4bdc-b9c5-1f89a2163a0c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:23.068452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85165b98-b4cf-4bdc-b9c5-1f89a2163a0c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:23.072079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85165b98-b4cf-4bdc-b9c5-1f89a2163a0c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:23.074395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85165b98-b4cf-4bdc-b9c5-1f89a2163a0c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:23.075402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85165b98-b4cf-4bdc-b9c5-1f89a2163a0c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:23.076227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85165b98-b4cf-4bdc-b9c5-1f89a2163a0c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:23.554446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-85165b98-b4cf-4bdc-b9c5-1f89a2163a0c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:23.571867 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-85165b98-b4cf-4bdc-b9c5-1f89a2163a0c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.524127 Aug 09 15:10:23.574987 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2965/5937] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:23 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:23.699575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ad75dca-2675-4253-803a-647c6b2356ba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-108087309", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ad75dca-2675-4253-803a-647c6b2356ba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 234 Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-108087309", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-108087309', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '86b6caed-197b-49d6-8fc8-b79923fc2960'}]}}} Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:23.716059 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 09 15:10:23.720270 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:23.721909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ad75dca-2675-4253-803a-647c6b2356ba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:23.722601 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5ad75dca-2675-4253-803a-647c6b2356ba tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.030031 Aug 09 15:10:23.725406 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2973/5938] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:23 2022] POST /compute/v2.1/servers => generated 133 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:10:23.739840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd61b2fb-a543-488a-95ed-d4e38641d0d0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:23.743114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd61b2fb-a543-488a-95ed-d4e38641d0d0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:23.770897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd61b2fb-a543-488a-95ed-d4e38641d0d0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:23.771978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd61b2fb-a543-488a-95ed-d4e38641d0d0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:23.775462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd61b2fb-a543-488a-95ed-d4e38641d0d0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:23.777219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd61b2fb-a543-488a-95ed-d4e38641d0d0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:23.782884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd61b2fb-a543-488a-95ed-d4e38641d0d0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:23.794946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd61b2fb-a543-488a-95ed-d4e38641d0d0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:24.008976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32662e48-3779-40a8-9a51-aed0c943973d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:24.010202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32662e48-3779-40a8-9a51-aed0c943973d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:24.035593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32662e48-3779-40a8-9a51-aed0c943973d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:24.040798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32662e48-3779-40a8-9a51-aed0c943973d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:24.041394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32662e48-3779-40a8-9a51-aed0c943973d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:24.042190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32662e48-3779-40a8-9a51-aed0c943973d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:24.042673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32662e48-3779-40a8-9a51-aed0c943973d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:24.043156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32662e48-3779-40a8-9a51-aed0c943973d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:24.196611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fd61b2fb-a543-488a-95ed-d4e38641d0d0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:24.214968 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd61b2fb-a543-488a-95ed-d4e38641d0d0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.483061 Aug 09 15:10:24.217519 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2966/5939] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:23 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:24.255170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d97d7abf-e945-4988-9b14-b84cbacd81df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:24.264313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d97d7abf-e945-4988-9b14-b84cbacd81df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:24.282573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d97d7abf-e945-4988-9b14-b84cbacd81df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:24.288696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d97d7abf-e945-4988-9b14-b84cbacd81df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:24.290890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d97d7abf-e945-4988-9b14-b84cbacd81df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:24.293002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d97d7abf-e945-4988-9b14-b84cbacd81df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:24.297221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d97d7abf-e945-4988-9b14-b84cbacd81df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:24.298016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d97d7abf-e945-4988-9b14-b84cbacd81df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:24.570417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-32662e48-3779-40a8-9a51-aed0c943973d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:24.579244 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32662e48-3779-40a8-9a51-aed0c943973d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.585410 Aug 09 15:10:24.579861 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2974/5940] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:23 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:24.719471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d97d7abf-e945-4988-9b14-b84cbacd81df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:24.728651 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d97d7abf-e945-4988-9b14-b84cbacd81df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.491463 Aug 09 15:10:24.746353 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2967/5941] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:24 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:24.751557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c58873ab-f05a-4adf-9304-23a2128b5790 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:24.752319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c58873ab-f05a-4adf-9304-23a2128b5790 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 10950c1a-2413-4822-af0a-eebcc321ca31] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:24.767163 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-c58873ab-f05a-4adf-9304-23a2128b5790 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 10950c1a-2413-4822-af0a-eebcc321ca31 could not be found. Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c58873ab-f05a-4adf-9304-23a2128b5790 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/10950c1a-2413-4822-af0a-eebcc321ca31/action HTTP/1.1 Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 13 Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: {"pause": {}} Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 10950c1a-2413-4822-af0a-eebcc321ca31 could not be found. Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '10950c1a-2413-4822-af0a-eebcc321ca31', 'body': {'pause': {}}} Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10950c1a-2413-4822-af0a-eebcc321ca31 could not be found. Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10950c1a-2413-4822-af0a-eebcc321ca31 could not be found. Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:24.778486 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:24.782587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:24.782587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:24.782587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10950c1a-2413-4822-af0a-eebcc321ca31 could not be found. Aug 09 15:10:24.782587 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:24.785219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c58873ab-f05a-4adf-9304-23a2128b5790 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 10950c1a-2413-4822-af0a-eebcc321ca31 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:24.786308 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c58873ab-f05a-4adf-9304-23a2128b5790 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/10950c1a-2413-4822-af0a-eebcc321ca31/action" status: 404 len: 111 microversion: 2.1 time: 0.040477 Aug 09 15:10:24.787163 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2975/5942] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:24 2022] POST /compute/v2.1/servers/10950c1a-2413-4822-af0a-eebcc321ca31/action => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:10:24.797006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eaddcf60-5948-4e4c-8a4e-3c0da777f54a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:24.797646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eaddcf60-5948-4e4c-8a4e-3c0da777f54a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:24.823307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eaddcf60-5948-4e4c-8a4e-3c0da777f54a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:24.826043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eaddcf60-5948-4e4c-8a4e-3c0da777f54a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:24.827860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eaddcf60-5948-4e4c-8a4e-3c0da777f54a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:24.828647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eaddcf60-5948-4e4c-8a4e-3c0da777f54a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:24.829130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eaddcf60-5948-4e4c-8a4e-3c0da777f54a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:24.829611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eaddcf60-5948-4e4c-8a4e-3c0da777f54a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:25.168619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eaddcf60-5948-4e4c-8a4e-3c0da777f54a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:25.178236 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eaddcf60-5948-4e4c-8a4e-3c0da777f54a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.385927 Aug 09 15:10:25.180147 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2968/5943] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:24 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:25.213313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b117b717-166a-43c8-b612-8153bffd34b1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:25.214624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b117b717-166a-43c8-b612-8153bffd34b1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:25.275598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b117b717-166a-43c8-b612-8153bffd34b1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:25.276752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b117b717-166a-43c8-b612-8153bffd34b1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:25.277454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b117b717-166a-43c8-b612-8153bffd34b1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:25.279046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b117b717-166a-43c8-b612-8153bffd34b1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:25.279046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b117b717-166a-43c8-b612-8153bffd34b1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:25.279787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b117b717-166a-43c8-b612-8153bffd34b1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:25.610651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cfe4d34d-0d82-4760-bf2d-25a089aa9248 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:25.611216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cfe4d34d-0d82-4760-bf2d-25a089aa9248 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:25.628081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:25.653425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfe4d34d-0d82-4760-bf2d-25a089aa9248 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:25.662741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfe4d34d-0d82-4760-bf2d-25a089aa9248 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:25.664080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfe4d34d-0d82-4760-bf2d-25a089aa9248 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:25.665463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfe4d34d-0d82-4760-bf2d-25a089aa9248 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:25.666361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfe4d34d-0d82-4760-bf2d-25a089aa9248 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:25.673902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cfe4d34d-0d82-4760-bf2d-25a089aa9248 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:25.717158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b117b717-166a-43c8-b612-8153bffd34b1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:25.729074 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b117b717-166a-43c8-b612-8153bffd34b1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.517446 Aug 09 15:10:25.729744 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2976/5944] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:25 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:25.763773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e93be4de-5c63-42bd-a087-dc98c993e305 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:25.763773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e93be4de-5c63-42bd-a087-dc98c993e305 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:25.781869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e93be4de-5c63-42bd-a087-dc98c993e305 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:25.793536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e93be4de-5c63-42bd-a087-dc98c993e305 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:25.797190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e93be4de-5c63-42bd-a087-dc98c993e305 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:25.798291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e93be4de-5c63-42bd-a087-dc98c993e305 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:25.798992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e93be4de-5c63-42bd-a087-dc98c993e305 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:25.804219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e93be4de-5c63-42bd-a087-dc98c993e305 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:25.911200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:26.101856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cfe4d34d-0d82-4760-bf2d-25a089aa9248 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:26.137572 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e93be4de-5c63-42bd-a087-dc98c993e305 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 202 len: 0 microversion: 2.1 time: 0.377568 Aug 09 15:10:26.138885 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cfe4d34d-0d82-4760-bf2d-25a089aa9248 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.538798 Aug 09 15:10:26.147560 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2969/5946] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:25 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:26.147948 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2977/5946] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:25 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 15:10:26.159439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b81cd4a-5d29-494e-b43d-7f8349e08cc3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:26.160757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b81cd4a-5d29-494e-b43d-7f8349e08cc3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:26.198439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b81cd4a-5d29-494e-b43d-7f8349e08cc3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:26.200826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b81cd4a-5d29-494e-b43d-7f8349e08cc3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:26.201715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b81cd4a-5d29-494e-b43d-7f8349e08cc3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:26.203161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b81cd4a-5d29-494e-b43d-7f8349e08cc3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:26.204705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b81cd4a-5d29-494e-b43d-7f8349e08cc3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:26.205833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b81cd4a-5d29-494e-b43d-7f8349e08cc3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:26.544914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b81cd4a-5d29-494e-b43d-7f8349e08cc3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:26.557753 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b81cd4a-5d29-494e-b43d-7f8349e08cc3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1510 microversion: 2.1 time: 0.404505 Aug 09 15:10:26.558810 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2978/5947] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:26 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1510 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:27.183165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f73888f9-0259-4ff5-a85d-6847f8e73d9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:27.189515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f73888f9-0259-4ff5-a85d-6847f8e73d9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:27.223378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f73888f9-0259-4ff5-a85d-6847f8e73d9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:27.224206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f73888f9-0259-4ff5-a85d-6847f8e73d9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:27.224962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f73888f9-0259-4ff5-a85d-6847f8e73d9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:27.233656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f73888f9-0259-4ff5-a85d-6847f8e73d9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:27.234474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f73888f9-0259-4ff5-a85d-6847f8e73d9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:27.235264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f73888f9-0259-4ff5-a85d-6847f8e73d9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:27.589660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6456d48f-1165-4f32-846f-fee7f9048699 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:27.590674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6456d48f-1165-4f32-846f-fee7f9048699 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:27.618084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6456d48f-1165-4f32-846f-fee7f9048699 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:27.618730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6456d48f-1165-4f32-846f-fee7f9048699 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:27.619633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6456d48f-1165-4f32-846f-fee7f9048699 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:27.620882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6456d48f-1165-4f32-846f-fee7f9048699 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:27.621661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6456d48f-1165-4f32-846f-fee7f9048699 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:27.638702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6456d48f-1165-4f32-846f-fee7f9048699 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:27.768402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f73888f9-0259-4ff5-a85d-6847f8e73d9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:27.777909 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f73888f9-0259-4ff5-a85d-6847f8e73d9b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.603638 Aug 09 15:10:27.779140 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2970/5948] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:27 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:28.088025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6456d48f-1165-4f32-846f-fee7f9048699 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:28.101142 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6456d48f-1165-4f32-846f-fee7f9048699 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1490 microversion: 2.1 time: 0.521716 Aug 09 15:10:28.102698 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2979/5949] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:27 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1490 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:28.123684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0575769-cfff-45a6-bf1b-0b56e10ad887 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:28.124978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0575769-cfff-45a6-bf1b-0b56e10ad887 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:28.146290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0575769-cfff-45a6-bf1b-0b56e10ad887 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:28.147420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0575769-cfff-45a6-bf1b-0b56e10ad887 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:28.147972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0575769-cfff-45a6-bf1b-0b56e10ad887 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:28.149401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0575769-cfff-45a6-bf1b-0b56e10ad887 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:28.150234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0575769-cfff-45a6-bf1b-0b56e10ad887 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:28.150898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0575769-cfff-45a6-bf1b-0b56e10ad887 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:28.199658 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-c0575769-cfff-45a6-bf1b-0b56e10ad887 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Cannot 'pause' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state paused Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0575769-cfff-45a6-bf1b-0b56e10ad887 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action HTTP/1.1 Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 13 Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: {"pause": {}} Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: exception: Cannot 'pause' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state paused Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '45050cee-c0fb-4f05-a875-a43d4b834957', 'body': {'pause': {}}} Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 in vm_state paused. Cannot pause while the instance is in this state. Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state paused Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:28.202406 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:28.209112 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:28.209112 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:28.209112 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:28.209112 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state paused Aug 09 15:10:28.209112 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:28.211377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0575769-cfff-45a6-bf1b-0b56e10ad887 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 409 to user: Cannot 'pause' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state paused {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:28.215328 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0575769-cfff-45a6-bf1b-0b56e10ad887 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 409 len: 143 microversion: 2.1 time: 0.096355 Aug 09 15:10:28.217636 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2971/5950] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:28 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 143 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 15:10:28.230206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa5f493d-623b-417a-8e85-3f6874d1571b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:28.231233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa5f493d-623b-417a-8e85-3f6874d1571b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:28.241403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa5f493d-623b-417a-8e85-3f6874d1571b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:28.242312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa5f493d-623b-417a-8e85-3f6874d1571b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:28.242537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa5f493d-623b-417a-8e85-3f6874d1571b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:28.243456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa5f493d-623b-417a-8e85-3f6874d1571b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:28.244193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa5f493d-623b-417a-8e85-3f6874d1571b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:28.244845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa5f493d-623b-417a-8e85-3f6874d1571b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:28.371249 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa5f493d-623b-417a-8e85-3f6874d1571b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 202 len: 0 microversion: 2.1 time: 0.145233 Aug 09 15:10:28.381592 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2980/5951] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:28 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:10:28.383644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e34bb573-3e86-4838-9aae-c04da5e1fb35 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:28.384225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e34bb573-3e86-4838-9aae-c04da5e1fb35 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:28.405921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e34bb573-3e86-4838-9aae-c04da5e1fb35 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:28.406851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e34bb573-3e86-4838-9aae-c04da5e1fb35 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:28.407740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e34bb573-3e86-4838-9aae-c04da5e1fb35 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:28.410190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e34bb573-3e86-4838-9aae-c04da5e1fb35 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:28.422377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e34bb573-3e86-4838-9aae-c04da5e1fb35 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:28.423110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e34bb573-3e86-4838-9aae-c04da5e1fb35 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:28.818250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b2570ff-5152-412d-9be4-8089db5be247 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:28.821638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5b2570ff-5152-412d-9be4-8089db5be247 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:28.879902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b2570ff-5152-412d-9be4-8089db5be247 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:28.880712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b2570ff-5152-412d-9be4-8089db5be247 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:28.886183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b2570ff-5152-412d-9be4-8089db5be247 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:28.891403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b2570ff-5152-412d-9be4-8089db5be247 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:28.901220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b2570ff-5152-412d-9be4-8089db5be247 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:28.903668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b2570ff-5152-412d-9be4-8089db5be247 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:29.028390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e34bb573-3e86-4838-9aae-c04da5e1fb35 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:29.041805 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e34bb573-3e86-4838-9aae-c04da5e1fb35 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1497 microversion: 2.1 time: 0.663496 Aug 09 15:10:29.049665 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2972/5952] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:28 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1497 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:29.082895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-165886085", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "82d523cc-e9b0-42fb-aef1-a0719f676b99"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1538523278", "security_groups": [{"name": "tempest-secgroup-smoke-987044892"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:29.302106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5b2570ff-5152-412d-9be4-8089db5be247 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:29.331915 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5b2570ff-5152-412d-9be4-8089db5be247 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.532067 Aug 09 15:10:29.334358 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2981/5953] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:28 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:29.355405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] validate_networks() for [('82d523cc-e9b0-42fb-aef1-a0719f676b99', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:10:30.093861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b17fb994-afb3-4bab-a1cd-650785a224c9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:30.094447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b17fb994-afb3-4bab-a1cd-650785a224c9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:30.141568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17fb994-afb3-4bab-a1cd-650785a224c9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:30.146571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17fb994-afb3-4bab-a1cd-650785a224c9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:30.147716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17fb994-afb3-4bab-a1cd-650785a224c9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:30.153198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17fb994-afb3-4bab-a1cd-650785a224c9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:30.154375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17fb994-afb3-4bab-a1cd-650785a224c9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:30.161820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17fb994-afb3-4bab-a1cd-650785a224c9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:30.567843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:10:30.570246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:10:30.572347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:10:30.573874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:10:30.575362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:10:30.612950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:30.615202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:30.616189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:30.621215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:30.622783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:30.623806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:30.668223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for project 889fa240e1f5494d9c11803acd77f74b. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:10:30.671931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b17fb994-afb3-4bab-a1cd-650785a224c9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:30.688882 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b17fb994-afb3-4bab-a1cd-650785a224c9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.599736 Aug 09 15:10:30.689842 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2982/5954] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:30 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:30.691572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Getting quotas for user 9ff3b746851a4414ba60cb76ac07056b and project 889fa240e1f5494d9c11803acd77f74b. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:10:30.704693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a265c1ac-89f0-4c0f-a816-60010840589c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:30.705495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a265c1ac-89f0-4c0f-a816-60010840589c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:30.720441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a265c1ac-89f0-4c0f-a816-60010840589c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:30.722664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:10:30.723895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a265c1ac-89f0-4c0f-a816-60010840589c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:30.724604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a265c1ac-89f0-4c0f-a816-60010840589c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:30.727602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a265c1ac-89f0-4c0f-a816-60010840589c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:30.728523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a265c1ac-89f0-4c0f-a816-60010840589c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:30.730366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:10:30.730621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a265c1ac-89f0-4c0f-a816-60010840589c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:30.820471 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b51a2de-ab8e-426f-a190-239f53960f08 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.769220 Aug 09 15:10:30.821647 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2973/5955] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 1771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:10:30.828034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-416f5dac-2070-478a-ad8a-de5f8fa76d03 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:30.829487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-416f5dac-2070-478a-ad8a-de5f8fa76d03 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:30.839131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-416f5dac-2070-478a-ad8a-de5f8fa76d03 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:30.840202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-416f5dac-2070-478a-ad8a-de5f8fa76d03 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:30.840981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-416f5dac-2070-478a-ad8a-de5f8fa76d03 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:30.842212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-416f5dac-2070-478a-ad8a-de5f8fa76d03 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:30.842950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-416f5dac-2070-478a-ad8a-de5f8fa76d03 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:30.843686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-416f5dac-2070-478a-ad8a-de5f8fa76d03 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:31.126091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a265c1ac-89f0-4c0f-a816-60010840589c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:31.145565 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a265c1ac-89f0-4c0f-a816-60010840589c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.453399 Aug 09 15:10:31.149399 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2983/5956] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:30 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:31.158696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-416f5dac-2070-478a-ad8a-de5f8fa76d03 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:31.163553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8760141d-eb6a-4d14-9b6e-3a26f1c9388d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:31.164374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8760141d-eb6a-4d14-9b6e-3a26f1c9388d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:31.168262 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-416f5dac-2070-478a-ad8a-de5f8fa76d03 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.345115 Aug 09 15:10:31.169339 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2974/5957] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:30 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:31.191308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3abb6929-1cf1-4412-a210-0672bbcf00c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:31.194119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3abb6929-1cf1-4412-a210-0672bbcf00c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:31.201723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3abb6929-1cf1-4412-a210-0672bbcf00c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:31.202526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3abb6929-1cf1-4412-a210-0672bbcf00c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:31.203182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3abb6929-1cf1-4412-a210-0672bbcf00c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:31.204242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3abb6929-1cf1-4412-a210-0672bbcf00c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:31.205136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3abb6929-1cf1-4412-a210-0672bbcf00c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:31.205730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3abb6929-1cf1-4412-a210-0672bbcf00c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:31.295554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8760141d-eb6a-4d14-9b6e-3a26f1c9388d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:31.307324 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8760141d-eb6a-4d14-9b6e-3a26f1c9388d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1266 microversion: 2.1 time: 0.155401 Aug 09 15:10:31.323967 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2984/5958] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:31 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:31.559065 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-3abb6929-1cf1-4412-a210-0672bbcf00c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3abb6929-1cf1-4412-a210-0672bbcf00c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535/action HTTP/1.1 Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 28 Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: {"reboot": {"type": "SOFT"}} Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '18649c3a-2c5b-41d2-8863-6a2c232ba535', 'body': {'reboot': {'type': 'SOFT'}}} Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:31.561313 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3abb6929-1cf1-4412-a210-0672bbcf00c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:31.566944 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3abb6929-1cf1-4412-a210-0672bbcf00c8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535/action" status: 404 len: 111 microversion: 2.1 time: 0.376230 Aug 09 15:10:31.570364 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2975/5959] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:31 2022] POST /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535/action => generated 111 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:10:31.578957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dee862a2-8bea-4c7f-be3e-24d39bf097e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:31.579978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dee862a2-8bea-4c7f-be3e-24d39bf097e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:31.621093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee862a2-8bea-4c7f-be3e-24d39bf097e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:31.625083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee862a2-8bea-4c7f-be3e-24d39bf097e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:31.626673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee862a2-8bea-4c7f-be3e-24d39bf097e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:31.628578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee862a2-8bea-4c7f-be3e-24d39bf097e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:31.629390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee862a2-8bea-4c7f-be3e-24d39bf097e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:31.630153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dee862a2-8bea-4c7f-be3e-24d39bf097e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:32.060300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dee862a2-8bea-4c7f-be3e-24d39bf097e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:32.074541 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dee862a2-8bea-4c7f-be3e-24d39bf097e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.501627 Aug 09 15:10:32.075217 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2985/5960] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:31 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:32.103689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fcd9bfc8-bf1d-46cb-a3ed-d9ce4c07ae44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:32.111693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fcd9bfc8-bf1d-46cb-a3ed-d9ce4c07ae44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:32.133232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcd9bfc8-bf1d-46cb-a3ed-d9ce4c07ae44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:32.135677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcd9bfc8-bf1d-46cb-a3ed-d9ce4c07ae44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:32.136737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcd9bfc8-bf1d-46cb-a3ed-d9ce4c07ae44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:32.137996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcd9bfc8-bf1d-46cb-a3ed-d9ce4c07ae44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:32.138639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcd9bfc8-bf1d-46cb-a3ed-d9ce4c07ae44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:32.139511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fcd9bfc8-bf1d-46cb-a3ed-d9ce4c07ae44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:32.177665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-279842ba-f328-475f-9cbb-dff47ed416a1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:32.179034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-279842ba-f328-475f-9cbb-dff47ed416a1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:32.200442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-279842ba-f328-475f-9cbb-dff47ed416a1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:32.204049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-279842ba-f328-475f-9cbb-dff47ed416a1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:32.204546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-279842ba-f328-475f-9cbb-dff47ed416a1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:32.205606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-279842ba-f328-475f-9cbb-dff47ed416a1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:32.206070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-279842ba-f328-475f-9cbb-dff47ed416a1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:32.207761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-279842ba-f328-475f-9cbb-dff47ed416a1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:32.778536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fcd9bfc8-bf1d-46cb-a3ed-d9ce4c07ae44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:32.798602 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fcd9bfc8-bf1d-46cb-a3ed-d9ce4c07ae44 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.699322 Aug 09 15:10:32.804847 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2976/5961] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:32 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:32.820371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f37773b-e0e9-437f-8738-bb10a0211ef4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:32.822794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6f37773b-e0e9-437f-8738-bb10a0211ef4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:32.840219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f37773b-e0e9-437f-8738-bb10a0211ef4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:32.842995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f37773b-e0e9-437f-8738-bb10a0211ef4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:32.843903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f37773b-e0e9-437f-8738-bb10a0211ef4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:32.846359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f37773b-e0e9-437f-8738-bb10a0211ef4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:32.846863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f37773b-e0e9-437f-8738-bb10a0211ef4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:32.849556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f37773b-e0e9-437f-8738-bb10a0211ef4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:33.004784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-279842ba-f328-475f-9cbb-dff47ed416a1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:33.019683 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-279842ba-f328-475f-9cbb-dff47ed416a1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.853658 Aug 09 15:10:33.024249 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2986/5962] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:32 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:33.041876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d31088bb-1d29-4da4-9c60-d9314b307e38 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:33.049777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d31088bb-1d29-4da4-9c60-d9314b307e38 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: ba53dec7-1a4b-415f-b201-89e72fe99122] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:33.066845 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-d31088bb-1d29-4da4-9c60-d9314b307e38 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance ba53dec7-1a4b-415f-b201-89e72fe99122 could not be found. Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d31088bb-1d29-4da4-9c60-d9314b307e38 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/ba53dec7-1a4b-415f-b201-89e72fe99122/action HTTP/1.1 Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 28 Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: {"reboot": {"type": "SOFT"}} Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance ba53dec7-1a4b-415f-b201-89e72fe99122 could not be found. Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'ba53dec7-1a4b-415f-b201-89e72fe99122', 'body': {'reboot': {'type': 'SOFT'}}} Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba53dec7-1a4b-415f-b201-89e72fe99122 could not be found. Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba53dec7-1a4b-415f-b201-89e72fe99122 could not be found. Aug 09 15:10:33.069150 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:33.074176 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:33.074176 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:33.074176 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:33.074176 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:33.074176 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:33.074176 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:33.074176 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:33.074176 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba53dec7-1a4b-415f-b201-89e72fe99122 could not be found. Aug 09 15:10:33.074176 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:33.076303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d31088bb-1d29-4da4-9c60-d9314b307e38 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance ba53dec7-1a4b-415f-b201-89e72fe99122 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:33.077449 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d31088bb-1d29-4da4-9c60-d9314b307e38 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/ba53dec7-1a4b-415f-b201-89e72fe99122/action" status: 404 len: 111 microversion: 2.1 time: 0.051774 Aug 09 15:10:33.082287 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2987/5963] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:33 2022] POST /compute/v2.1/servers/ba53dec7-1a4b-415f-b201-89e72fe99122/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:10:33.101574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fac5c3a6-126e-48ea-84bd-5452c3a7ed6a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:33.102597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fac5c3a6-126e-48ea-84bd-5452c3a7ed6a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:33.113547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fac5c3a6-126e-48ea-84bd-5452c3a7ed6a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:33.114178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fac5c3a6-126e-48ea-84bd-5452c3a7ed6a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:33.114679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fac5c3a6-126e-48ea-84bd-5452c3a7ed6a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:33.115655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fac5c3a6-126e-48ea-84bd-5452c3a7ed6a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:33.116289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fac5c3a6-126e-48ea-84bd-5452c3a7ed6a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:33.120744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fac5c3a6-126e-48ea-84bd-5452c3a7ed6a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:33.183692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f37773b-e0e9-437f-8738-bb10a0211ef4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:33.193044 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f37773b-e0e9-437f-8738-bb10a0211ef4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1324 microversion: 2.1 time: 0.385952 Aug 09 15:10:33.213461 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2977/5964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:32 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:33.658585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b80abf44-664e-4175-9332-92b0b85700e0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Action: 'create', calling method: .version_select at 0x7f41dd046040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2070038682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSDdZii+WaGnTH9uB3DRlhPjg7MH/YvMBSRp9wEIsdGfxB8t2NqsojMok1CIgFURGxseC2k8zuehi9EaNPwvC0/T0HM1IuE/+G5i9/fzN3e1O1K5jR8nHNlU8F2Mk30WA=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:33.729248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-b80abf44-664e-4175-9332-92b0b85700e0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Getting quotas for project f459e237ba2d464c8feeb733393804a9. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:10:33.758981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-b80abf44-664e-4175-9332-92b0b85700e0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Getting quotas for user 7808d57a047f4fdfa852f71ff632619a and project f459e237ba2d464c8feeb733393804a9. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:10:33.846691 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b80abf44-664e-4175-9332-92b0b85700e0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.199468 Aug 09 15:10:33.850061 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2978/5965] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:10:33 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:10:34.008357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fac5c3a6-126e-48ea-84bd-5452c3a7ed6a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:34.026235 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fac5c3a6-126e-48ea-84bd-5452c3a7ed6a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.937793 Aug 09 15:10:34.028414 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2988/5966] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:33 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:34.051169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-223cdc87-57ac-4658-abd2-62035d6bef40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:34.059988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-223cdc87-57ac-4658-abd2-62035d6bef40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:34.066236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e8da9bb-dc48-48dc-b8a8-4dc07397ad06 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:34.068009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e8da9bb-dc48-48dc-b8a8-4dc07397ad06 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:34.084609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-223cdc87-57ac-4658-abd2-62035d6bef40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:34.088154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-223cdc87-57ac-4658-abd2-62035d6bef40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:34.089899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-223cdc87-57ac-4658-abd2-62035d6bef40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:34.093096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-223cdc87-57ac-4658-abd2-62035d6bef40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:34.097143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-223cdc87-57ac-4658-abd2-62035d6bef40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:34.098084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8da9bb-dc48-48dc-b8a8-4dc07397ad06 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:34.098792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-223cdc87-57ac-4658-abd2-62035d6bef40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:34.104259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8da9bb-dc48-48dc-b8a8-4dc07397ad06 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:34.106537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8da9bb-dc48-48dc-b8a8-4dc07397ad06 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:34.110430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8da9bb-dc48-48dc-b8a8-4dc07397ad06 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:34.113965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8da9bb-dc48-48dc-b8a8-4dc07397ad06 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:34.117449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e8da9bb-dc48-48dc-b8a8-4dc07397ad06 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:34.673062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e8da9bb-dc48-48dc-b8a8-4dc07397ad06 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:34.688626 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e8da9bb-dc48-48dc-b8a8-4dc07397ad06 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.631527 Aug 09 15:10:34.694623 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2989/5967] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:34 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:34.711182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a89cde05-afab-43ef-860c-719585641c5b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:34.713392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a89cde05-afab-43ef-860c-719585641c5b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:34.741562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a89cde05-afab-43ef-860c-719585641c5b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:34.742062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a89cde05-afab-43ef-860c-719585641c5b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:34.747700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a89cde05-afab-43ef-860c-719585641c5b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:34.750946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a89cde05-afab-43ef-860c-719585641c5b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:34.751459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a89cde05-afab-43ef-860c-719585641c5b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:34.756088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a89cde05-afab-43ef-860c-719585641c5b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:34.910808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a89cde05-afab-43ef-860c-719585641c5b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:34.926054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-223cdc87-57ac-4658-abd2-62035d6bef40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:34.926832 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a89cde05-afab-43ef-860c-719585641c5b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1324 microversion: 2.1 time: 0.226822 Aug 09 15:10:34.927915 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2990/5968] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:34 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1324 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:34.938893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d29048c9-d198-4868-91c7-976f33ce27aa tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:34.943980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d29048c9-d198-4868-91c7-976f33ce27aa tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:34.945976 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-223cdc87-57ac-4658-abd2-62035d6bef40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.907221 Aug 09 15:10:34.946586 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2979/5969] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:34 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:34.960929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d29048c9-d198-4868-91c7-976f33ce27aa tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:34.967726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d29048c9-d198-4868-91c7-976f33ce27aa tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:34.968473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d29048c9-d198-4868-91c7-976f33ce27aa tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:34.969435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d29048c9-d198-4868-91c7-976f33ce27aa tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:34.970221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d29048c9-d198-4868-91c7-976f33ce27aa tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:34.970970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d29048c9-d198-4868-91c7-976f33ce27aa tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:35.012304 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-d29048c9-d198-4868-91c7-976f33ce27aa tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d29048c9-d198-4868-91c7-976f33ce27aa tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535/action HTTP/1.1 Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 65 Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '18649c3a-2c5b-41d2-8863-6a2c232ba535', 'body': {'rebuild': {'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250'}}} Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 09 15:10:35.036519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:10:35.042577 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:10:35.044732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d29048c9-d198-4868-91c7-976f33ce27aa tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:35.045897 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d29048c9-d198-4868-91c7-976f33ce27aa tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535/action" status: 404 len: 111 microversion: 2.1 time: 0.116854 Aug 09 15:10:35.050242 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2991/5970] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:34 2022] POST /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535/action => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:10:35.060067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eadbeee7-5df0-49ed-b354-4613563ba402 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:35.065085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eadbeee7-5df0-49ed-b354-4613563ba402 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:35.083662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eadbeee7-5df0-49ed-b354-4613563ba402 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:35.084172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eadbeee7-5df0-49ed-b354-4613563ba402 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:35.084637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eadbeee7-5df0-49ed-b354-4613563ba402 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:35.085458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eadbeee7-5df0-49ed-b354-4613563ba402 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:35.085932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eadbeee7-5df0-49ed-b354-4613563ba402 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:35.086379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eadbeee7-5df0-49ed-b354-4613563ba402 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:35.758127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eadbeee7-5df0-49ed-b354-4613563ba402 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:35.777997 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eadbeee7-5df0-49ed-b354-4613563ba402 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.721442 Aug 09 15:10:35.780113 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2980/5971] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:35 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:35.811542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa475c44-612c-40aa-8f8c-f16854191cb6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:35.812565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa475c44-612c-40aa-8f8c-f16854191cb6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:35.831783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa475c44-612c-40aa-8f8c-f16854191cb6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:35.834712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa475c44-612c-40aa-8f8c-f16854191cb6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:35.835459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa475c44-612c-40aa-8f8c-f16854191cb6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:35.836253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa475c44-612c-40aa-8f8c-f16854191cb6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:35.838007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa475c44-612c-40aa-8f8c-f16854191cb6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:35.839966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa475c44-612c-40aa-8f8c-f16854191cb6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:35.955131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8224280e-7489-468c-9093-99fe5e149e59 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:35.956295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8224280e-7489-468c-9093-99fe5e149e59 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:36.010151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8224280e-7489-468c-9093-99fe5e149e59 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:36.011194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8224280e-7489-468c-9093-99fe5e149e59 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:36.024610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8224280e-7489-468c-9093-99fe5e149e59 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:36.025973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8224280e-7489-468c-9093-99fe5e149e59 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:36.026689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8224280e-7489-468c-9093-99fe5e149e59 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:36.049234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8224280e-7489-468c-9093-99fe5e149e59 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:36.352903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fa475c44-612c-40aa-8f8c-f16854191cb6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:36.367662 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa475c44-612c-40aa-8f8c-f16854191cb6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.560713 Aug 09 15:10:36.370548 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2992/5972] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:35 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:36.388821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5ba26611-b340-4efc-a634-c1b9909e177b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:36.389869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5ba26611-b340-4efc-a634-c1b9909e177b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:36.402176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ba26611-b340-4efc-a634-c1b9909e177b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:36.402680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ba26611-b340-4efc-a634-c1b9909e177b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:36.403211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ba26611-b340-4efc-a634-c1b9909e177b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:36.403864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ba26611-b340-4efc-a634-c1b9909e177b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:36.404323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ba26611-b340-4efc-a634-c1b9909e177b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:36.404753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5ba26611-b340-4efc-a634-c1b9909e177b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:36.570328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8224280e-7489-468c-9093-99fe5e149e59 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:36.584272 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8224280e-7489-468c-9093-99fe5e149e59 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1391 microversion: 2.1 time: 0.637761 Aug 09 15:10:36.586815 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2981/5973] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:35 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1391 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:36.592968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-517c76ab-9747-4324-a424-567a0ff4bafb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:36.599399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-517c76ab-9747-4324-a424-567a0ff4bafb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 3456642b-5bc0-4e7c-8077-6a0fa3c9d0dc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:36.616417 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-517c76ab-9747-4324-a424-567a0ff4bafb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 3456642b-5bc0-4e7c-8077-6a0fa3c9d0dc could not be found. Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-517c76ab-9747-4324-a424-567a0ff4bafb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/3456642b-5bc0-4e7c-8077-6a0fa3c9d0dc/action HTTP/1.1 Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 65 Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 3456642b-5bc0-4e7c-8077-6a0fa3c9d0dc could not be found. Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '3456642b-5bc0-4e7c-8077-6a0fa3c9d0dc', 'body': {'rebuild': {'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250'}}} Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3456642b-5bc0-4e7c-8077-6a0fa3c9d0dc could not be found. Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 09 15:10:36.619154 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3456642b-5bc0-4e7c-8077-6a0fa3c9d0dc could not be found. Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3456642b-5bc0-4e7c-8077-6a0fa3c9d0dc could not be found. Aug 09 15:10:36.624164 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:36.627444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-517c76ab-9747-4324-a424-567a0ff4bafb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 3456642b-5bc0-4e7c-8077-6a0fa3c9d0dc could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:36.630346 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-517c76ab-9747-4324-a424-567a0ff4bafb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/3456642b-5bc0-4e7c-8077-6a0fa3c9d0dc/action" status: 404 len: 111 microversion: 2.1 time: 0.041338 Aug 09 15:10:36.635636 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2982/5974] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:36 2022] POST /compute/v2.1/servers/3456642b-5bc0-4e7c-8077-6a0fa3c9d0dc/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:10:36.643231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e7a3e042-30ab-4373-aa85-9b84f29eca81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:36.644231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e7a3e042-30ab-4373-aa85-9b84f29eca81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:36.665080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7a3e042-30ab-4373-aa85-9b84f29eca81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:36.666055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7a3e042-30ab-4373-aa85-9b84f29eca81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:36.667693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7a3e042-30ab-4373-aa85-9b84f29eca81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:36.669459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7a3e042-30ab-4373-aa85-9b84f29eca81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:36.670231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7a3e042-30ab-4373-aa85-9b84f29eca81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:36.671025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7a3e042-30ab-4373-aa85-9b84f29eca81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:36.833429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5ba26611-b340-4efc-a634-c1b9909e177b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:36.844820 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5ba26611-b340-4efc-a634-c1b9909e177b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.468543 Aug 09 15:10:36.851586 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2993/5975] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:36 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:37.035397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e7a3e042-30ab-4373-aa85-9b84f29eca81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:37.040584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:37.046715 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e7a3e042-30ab-4373-aa85-9b84f29eca81 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.408963 Aug 09 15:10:37.047579 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2983/5976] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:36 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:37.073119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a53be0c-7d61-4a8d-8b46-b971b231ec39 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:37.073718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a53be0c-7d61-4a8d-8b46-b971b231ec39 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:37.081125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a53be0c-7d61-4a8d-8b46-b971b231ec39 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:37.081730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a53be0c-7d61-4a8d-8b46-b971b231ec39 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:37.082309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a53be0c-7d61-4a8d-8b46-b971b231ec39 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:37.083192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a53be0c-7d61-4a8d-8b46-b971b231ec39 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:37.083845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a53be0c-7d61-4a8d-8b46-b971b231ec39 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:37.084358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a53be0c-7d61-4a8d-8b46-b971b231ec39 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:37.313574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2a53be0c-7d61-4a8d-8b46-b971b231ec39 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:37.330889 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a53be0c-7d61-4a8d-8b46-b971b231ec39 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.261703 Aug 09 15:10:37.352511 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2994/5977] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:37 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:37.364523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9ecb0085-7413-4cd1-8758-889f45428c7f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:37.365387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9ecb0085-7413-4cd1-8758-889f45428c7f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45cd393a-81a9-4843-9466-e41089947427] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:37.380899 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-9ecb0085-7413-4cd1-8758-889f45428c7f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 45cd393a-81a9-4843-9466-e41089947427 could not be found. Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9ecb0085-7413-4cd1-8758-889f45428c7f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/45cd393a-81a9-4843-9466-e41089947427/action HTTP/1.1 Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 15 Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: {"restore": {}} Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 45cd393a-81a9-4843-9466-e41089947427 could not be found. Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '45cd393a-81a9-4843-9466-e41089947427', 'body': {'restore': {}}} Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45cd393a-81a9-4843-9466-e41089947427 could not be found. Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45cd393a-81a9-4843-9466-e41089947427 could not be found. Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:37.385705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:37.390069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:37.390069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:37.390069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45cd393a-81a9-4843-9466-e41089947427 could not be found. Aug 09 15:10:37.390069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:37.390069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9ecb0085-7413-4cd1-8758-889f45428c7f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 45cd393a-81a9-4843-9466-e41089947427 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:37.390421 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9ecb0085-7413-4cd1-8758-889f45428c7f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45cd393a-81a9-4843-9466-e41089947427/action" status: 404 len: 111 microversion: 2.1 time: 0.034148 Aug 09 15:10:37.393405 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2984/5978] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:37 2022] POST /compute/v2.1/servers/45cd393a-81a9-4843-9466-e41089947427/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:10:37.399888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-369b673c-0d9e-478b-8aaf-d2c3bd59298f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:37.401390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-369b673c-0d9e-478b-8aaf-d2c3bd59298f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:37.435905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-369b673c-0d9e-478b-8aaf-d2c3bd59298f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:37.437044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-369b673c-0d9e-478b-8aaf-d2c3bd59298f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:37.439752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-369b673c-0d9e-478b-8aaf-d2c3bd59298f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:37.440978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-369b673c-0d9e-478b-8aaf-d2c3bd59298f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:37.449558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-369b673c-0d9e-478b-8aaf-d2c3bd59298f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:37.450553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-369b673c-0d9e-478b-8aaf-d2c3bd59298f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:37.464912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:37.608257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c9d61aa-dedc-4e9f-8140-0809326c81b3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:37.609780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6c9d61aa-dedc-4e9f-8140-0809326c81b3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:37.620763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c9d61aa-dedc-4e9f-8140-0809326c81b3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:37.621460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c9d61aa-dedc-4e9f-8140-0809326c81b3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:37.622074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c9d61aa-dedc-4e9f-8140-0809326c81b3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:37.623620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c9d61aa-dedc-4e9f-8140-0809326c81b3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:37.624256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c9d61aa-dedc-4e9f-8140-0809326c81b3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:37.625435 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c9d61aa-dedc-4e9f-8140-0809326c81b3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:37.909551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-369b673c-0d9e-478b-8aaf-d2c3bd59298f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:37.924886 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-369b673c-0d9e-478b-8aaf-d2c3bd59298f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.523039 Aug 09 15:10:37.926128 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2995/5979] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:37 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:37.944350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9252fe8f-0ae0-427e-bae1-95c4ebff2258 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:37.945414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9252fe8f-0ae0-427e-bae1-95c4ebff2258 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:37.955652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:37.959183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9252fe8f-0ae0-427e-bae1-95c4ebff2258 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:37.960893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9252fe8f-0ae0-427e-bae1-95c4ebff2258 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:37.963045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9252fe8f-0ae0-427e-bae1-95c4ebff2258 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:37.966213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9252fe8f-0ae0-427e-bae1-95c4ebff2258 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:37.966914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9252fe8f-0ae0-427e-bae1-95c4ebff2258 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:37.967607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9252fe8f-0ae0-427e-bae1-95c4ebff2258 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:38.200403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6c9d61aa-dedc-4e9f-8140-0809326c81b3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:38.213446 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6c9d61aa-dedc-4e9f-8140-0809326c81b3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1391 microversion: 2.1 time: 0.609954 Aug 09 15:10:38.216928 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2985/5980] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:37 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1391 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:38.243658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-26466814-1c20-4a35-af31-b3b3f991fde5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:38.246664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-26466814-1c20-4a35-af31-b3b3f991fde5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:38.284662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26466814-1c20-4a35-af31-b3b3f991fde5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:38.293485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26466814-1c20-4a35-af31-b3b3f991fde5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:38.295747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26466814-1c20-4a35-af31-b3b3f991fde5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:38.300139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26466814-1c20-4a35-af31-b3b3f991fde5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:38.301319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26466814-1c20-4a35-af31-b3b3f991fde5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:38.307872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26466814-1c20-4a35-af31-b3b3f991fde5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:38.398566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9252fe8f-0ae0-427e-bae1-95c4ebff2258 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:38.414525 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9252fe8f-0ae0-427e-bae1-95c4ebff2258 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.487130 Aug 09 15:10:38.443345 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2996/5981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:37 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:38.548451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2113731119", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "7f3c00fc-f9e4-44dc-9720-c38754c7053c"}], "key_name": "tempest-TestNetworkBasicOps-2070038682", "security_groups": [{"name": "tempest-secgroup-smoke-674657762"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:38.775989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-26466814-1c20-4a35-af31-b3b3f991fde5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:38.796483 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-26466814-1c20-4a35-af31-b3b3f991fde5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.563209 Aug 09 15:10:38.797423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2986/5982] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:38 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:38.817674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] validate_networks() for [('7f3c00fc-f9e4-44dc-9720-c38754c7053c', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:10:38.840805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-66e201f5-4bd6-4b30-9eee-debd2c1aa908 req-4c277085-e168-4440-8738-1147fe6abf0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc", "tag": "121e83ca-5774-40be-b800-5f19db460b9e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:38.864313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-66e201f5-4bd6-4b30-9eee-debd2c1aa908 req-4c277085-e168-4440-8738-1147fe6abf0c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:38.864824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-66e201f5-4bd6-4b30-9eee-debd2c1aa908 req-4c277085-e168-4440-8738-1147fe6abf0c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:38.865286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-66e201f5-4bd6-4b30-9eee-debd2c1aa908 req-4c277085-e168-4440-8738-1147fe6abf0c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:38.882063 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-66e201f5-4bd6-4b30-9eee-debd2c1aa908 req-4c277085-e168-4440-8738-1147fe6abf0c service nova] Creating event network-changed:121e83ca-5774-40be-b800-5f19db460b9e for instance 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc on n-h1-844626-8 Aug 09 15:10:38.929017 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-66e201f5-4bd6-4b30-9eee-debd2c1aa908 req-4c277085-e168-4440-8738-1147fe6abf0c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112505 Aug 09 15:10:38.931966 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2987/5983] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:10:38.946591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e4ec4d7f-0dea-49c7-a746-8e4db3578563 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:38.948300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e4ec4d7f-0dea-49c7-a746-8e4db3578563 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:38.962160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4ec4d7f-0dea-49c7-a746-8e4db3578563 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:38.962864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4ec4d7f-0dea-49c7-a746-8e4db3578563 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:38.963380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4ec4d7f-0dea-49c7-a746-8e4db3578563 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:38.964154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4ec4d7f-0dea-49c7-a746-8e4db3578563 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:38.964630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4ec4d7f-0dea-49c7-a746-8e4db3578563 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:38.965076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e4ec4d7f-0dea-49c7-a746-8e4db3578563 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:39.045334 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-e4ec4d7f-0dea-49c7-a746-8e4db3578563 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Cannot 'restore' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e4ec4d7f-0dea-49c7-a746-8e4db3578563 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action HTTP/1.1 Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 15 Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: {"restore": {}} Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: exception: Cannot 'restore' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '45050cee-c0fb-4f05-a875-a43d4b834957', 'body': {'restore': {}}} Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 in vm_state active. Cannot restore while the instance is in this state. Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:39.050475 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:39.054440 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:39.054440 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:39.054440 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:39.054440 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:10:39.054440 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:39.054440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e4ec4d7f-0dea-49c7-a746-8e4db3578563 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 409 to user: Cannot 'restore' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:39.054440 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e4ec4d7f-0dea-49c7-a746-8e4db3578563 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 409 len: 145 microversion: 2.1 time: 0.119888 Aug 09 15:10:39.054884 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2988/5984] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:38 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 145 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 15:10:39.069649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bccdd92c-5ddb-4cb9-a874-3d79b7fdcaf3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:39.071935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bccdd92c-5ddb-4cb9-a874-3d79b7fdcaf3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:39.086136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bccdd92c-5ddb-4cb9-a874-3d79b7fdcaf3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:39.087027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bccdd92c-5ddb-4cb9-a874-3d79b7fdcaf3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:39.088017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bccdd92c-5ddb-4cb9-a874-3d79b7fdcaf3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:39.089552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bccdd92c-5ddb-4cb9-a874-3d79b7fdcaf3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:39.090559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bccdd92c-5ddb-4cb9-a874-3d79b7fdcaf3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:39.092952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bccdd92c-5ddb-4cb9-a874-3d79b7fdcaf3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:39.398715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bccdd92c-5ddb-4cb9-a874-3d79b7fdcaf3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:39.427271 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bccdd92c-5ddb-4cb9-a874-3d79b7fdcaf3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.364574 Aug 09 15:10:39.428252 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2989/5985] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:39 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:39.442583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-278bb0ee-99e6-4bb3-ae67-d34d73bc8b40 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:39.443584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-278bb0ee-99e6-4bb3-ae67-d34d73bc8b40 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:39.462426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-278bb0ee-99e6-4bb3-ae67-d34d73bc8b40 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:39.463068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-278bb0ee-99e6-4bb3-ae67-d34d73bc8b40 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:39.464287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-278bb0ee-99e6-4bb3-ae67-d34d73bc8b40 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:39.467521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-278bb0ee-99e6-4bb3-ae67-d34d73bc8b40 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:39.469034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-278bb0ee-99e6-4bb3-ae67-d34d73bc8b40 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:39.469782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-278bb0ee-99e6-4bb3-ae67-d34d73bc8b40 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:39.739282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:10:39.740950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:10:39.741774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:10:39.742443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:10:39.743423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:10:39.751595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-278bb0ee-99e6-4bb3-ae67-d34d73bc8b40 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:39.770395 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-278bb0ee-99e6-4bb3-ae67-d34d73bc8b40 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1391 microversion: 2.1 time: 0.339986 Aug 09 15:10:39.793042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:39.793546 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2990/5986] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:39 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1391 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:39.794253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:39.795035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:39.796321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:39.797869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:39.798647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:39.817996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4bd7cacf-900c-43c8-a479-3be83bcb025f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:39.819968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4bd7cacf-900c-43c8-a479-3be83bcb025f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:39.830571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bd7cacf-900c-43c8-a479-3be83bcb025f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:39.831773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bd7cacf-900c-43c8-a479-3be83bcb025f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:39.832652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bd7cacf-900c-43c8-a479-3be83bcb025f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:39.833668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bd7cacf-900c-43c8-a479-3be83bcb025f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:39.834307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bd7cacf-900c-43c8-a479-3be83bcb025f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:39.834906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bd7cacf-900c-43c8-a479-3be83bcb025f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:39.842840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Getting quotas for project f459e237ba2d464c8feeb733393804a9. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:10:39.851417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Getting quotas for user 7808d57a047f4fdfa852f71ff632619a and project f459e237ba2d464c8feeb733393804a9. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:10:39.869658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:10:39.872959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:10:39.955183 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2f45c45-7807-4e22-9054-2c2f19cbf351 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.415107 Aug 09 15:10:39.963166 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2997/5987] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:10:39.969132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f701ee4a-14b4-47e4-a9d8-50eefdbc35c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:39.970123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f701ee4a-14b4-47e4-a9d8-50eefdbc35c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:39.980665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f701ee4a-14b4-47e4-a9d8-50eefdbc35c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:39.981447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f701ee4a-14b4-47e4-a9d8-50eefdbc35c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:39.982136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f701ee4a-14b4-47e4-a9d8-50eefdbc35c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:39.983337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f701ee4a-14b4-47e4-a9d8-50eefdbc35c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:39.984001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f701ee4a-14b4-47e4-a9d8-50eefdbc35c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:39.984751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f701ee4a-14b4-47e4-a9d8-50eefdbc35c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:40.058272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4bd7cacf-900c-43c8-a479-3be83bcb025f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:40.072673 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4bd7cacf-900c-43c8-a479-3be83bcb025f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.276993 Aug 09 15:10:40.074680 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2991/5988] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:39 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:40.081596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f6ebdf94-cdbc-4220-858c-7d83bd02cef4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:40.082619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f6ebdf94-cdbc-4220-858c-7d83bd02cef4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:40.218768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f6ebdf94-cdbc-4220-858c-7d83bd02cef4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:40.228787 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f6ebdf94-cdbc-4220-858c-7d83bd02cef4 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1249 microversion: 2.1 time: 0.151975 Aug 09 15:10:40.231310 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2992/5989] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:40 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1249 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:40.367599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f701ee4a-14b4-47e4-a9d8-50eefdbc35c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:40.377388 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f701ee4a-14b4-47e4-a9d8-50eefdbc35c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.412293 Aug 09 15:10:40.378716 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2998/5990] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:39 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:40.404492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-86debe3f-9cf8-4664-a2cc-ab5fc7dfa4c3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:40.406205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-86debe3f-9cf8-4664-a2cc-ab5fc7dfa4c3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: c355d3dc-9bc2-4a37-8205-ad29a7220c3d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:40.413642 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-86debe3f-9cf8-4664-a2cc-ab5fc7dfa4c3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance c355d3dc-9bc2-4a37-8205-ad29a7220c3d could not be found. Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-86debe3f-9cf8-4664-a2cc-ab5fc7dfa4c3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/c355d3dc-9bc2-4a37-8205-ad29a7220c3d/action HTTP/1.1 Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 14 Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: {"resume": {}} Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance c355d3dc-9bc2-4a37-8205-ad29a7220c3d could not be found. Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'c355d3dc-9bc2-4a37-8205-ad29a7220c3d', 'body': {'resume': {}}} Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c355d3dc-9bc2-4a37-8205-ad29a7220c3d could not be found. Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c355d3dc-9bc2-4a37-8205-ad29a7220c3d could not be found. Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:40.427650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:40.435185 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:40.435185 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:40.435185 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c355d3dc-9bc2-4a37-8205-ad29a7220c3d could not be found. Aug 09 15:10:40.435185 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:40.439473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-86debe3f-9cf8-4664-a2cc-ab5fc7dfa4c3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance c355d3dc-9bc2-4a37-8205-ad29a7220c3d could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:40.440924 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-86debe3f-9cf8-4664-a2cc-ab5fc7dfa4c3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/c355d3dc-9bc2-4a37-8205-ad29a7220c3d/action" status: 404 len: 111 microversion: 2.1 time: 0.043258 Aug 09 15:10:40.441830 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2993/5991] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:40 2022] POST /compute/v2.1/servers/c355d3dc-9bc2-4a37-8205-ad29a7220c3d/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:10:40.452441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de8d151a-87d3-45e6-831f-6884f4d7656c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:40.453735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de8d151a-87d3-45e6-831f-6884f4d7656c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:40.465466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de8d151a-87d3-45e6-831f-6884f4d7656c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:40.468383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de8d151a-87d3-45e6-831f-6884f4d7656c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:40.469243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de8d151a-87d3-45e6-831f-6884f4d7656c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:40.474852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de8d151a-87d3-45e6-831f-6884f4d7656c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:40.476916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de8d151a-87d3-45e6-831f-6884f4d7656c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:40.479884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de8d151a-87d3-45e6-831f-6884f4d7656c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:40.807767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-de8d151a-87d3-45e6-831f-6884f4d7656c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:40.821754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-456a9548-6c94-4517-8b62-9da38d5458f4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:40.825492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-456a9548-6c94-4517-8b62-9da38d5458f4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:40.849898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:40.852230 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de8d151a-87d3-45e6-831f-6884f4d7656c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.405472 Aug 09 15:10:40.856224 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 2999/5992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:40 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:40.858233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-456a9548-6c94-4517-8b62-9da38d5458f4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:40.859500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-456a9548-6c94-4517-8b62-9da38d5458f4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:40.861129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-456a9548-6c94-4517-8b62-9da38d5458f4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:40.862584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-456a9548-6c94-4517-8b62-9da38d5458f4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:40.864460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-456a9548-6c94-4517-8b62-9da38d5458f4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:40.865303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-456a9548-6c94-4517-8b62-9da38d5458f4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:40.880349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a419ea28-93be-4980-9f20-11cb1b463cd8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:40.881314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a419ea28-93be-4980-9f20-11cb1b463cd8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:40.894212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a419ea28-93be-4980-9f20-11cb1b463cd8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:40.898215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a419ea28-93be-4980-9f20-11cb1b463cd8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:40.898933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a419ea28-93be-4980-9f20-11cb1b463cd8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:40.902205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a419ea28-93be-4980-9f20-11cb1b463cd8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:40.903697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a419ea28-93be-4980-9f20-11cb1b463cd8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:40.904315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a419ea28-93be-4980-9f20-11cb1b463cd8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:41.313784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a419ea28-93be-4980-9f20-11cb1b463cd8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:41.324688 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a419ea28-93be-4980-9f20-11cb1b463cd8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.449247 Aug 09 15:10:41.334633 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3000/5993] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:40 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:41.385322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7beb6a69-2b80-4ebb-97f7-2ed89909485d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:41.389998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7beb6a69-2b80-4ebb-97f7-2ed89909485d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:41.417937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7beb6a69-2b80-4ebb-97f7-2ed89909485d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:41.418386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7beb6a69-2b80-4ebb-97f7-2ed89909485d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:41.418817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7beb6a69-2b80-4ebb-97f7-2ed89909485d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:41.422264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7beb6a69-2b80-4ebb-97f7-2ed89909485d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:41.422747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7beb6a69-2b80-4ebb-97f7-2ed89909485d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:41.423219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7beb6a69-2b80-4ebb-97f7-2ed89909485d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:41.440099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-456a9548-6c94-4517-8b62-9da38d5458f4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:41.462423 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-456a9548-6c94-4517-8b62-9da38d5458f4 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1391 microversion: 2.1 time: 0.642439 Aug 09 15:10:41.462423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2994/5994] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:40 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1391 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:41.487843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d36fe82-abd8-4b26-b7b7-96d7787d9340 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:41.489058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4d36fe82-abd8-4b26-b7b7-96d7787d9340 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:41.504590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d36fe82-abd8-4b26-b7b7-96d7787d9340 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:41.509329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d36fe82-abd8-4b26-b7b7-96d7787d9340 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:41.510712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d36fe82-abd8-4b26-b7b7-96d7787d9340 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:41.513842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d36fe82-abd8-4b26-b7b7-96d7787d9340 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:41.514458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d36fe82-abd8-4b26-b7b7-96d7787d9340 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:41.515339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d36fe82-abd8-4b26-b7b7-96d7787d9340 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:41.673986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d36fe82-abd8-4b26-b7b7-96d7787d9340 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:41.682822 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4d36fe82-abd8-4b26-b7b7-96d7787d9340 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1301 microversion: 2.1 time: 0.209047 Aug 09 15:10:41.688349 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2995/5995] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:41 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1301 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:41.694986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1202c2ee-e0db-41aa-8eda-f1decc3e7f37 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:41.701551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1202c2ee-e0db-41aa-8eda-f1decc3e7f37 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:41.705824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7beb6a69-2b80-4ebb-97f7-2ed89909485d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:41.709770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1202c2ee-e0db-41aa-8eda-f1decc3e7f37 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:41.711423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1202c2ee-e0db-41aa-8eda-f1decc3e7f37 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:41.712213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1202c2ee-e0db-41aa-8eda-f1decc3e7f37 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:41.713419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1202c2ee-e0db-41aa-8eda-f1decc3e7f37 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:41.714229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1202c2ee-e0db-41aa-8eda-f1decc3e7f37 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:41.714859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1202c2ee-e0db-41aa-8eda-f1decc3e7f37 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:41.723152 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7beb6a69-2b80-4ebb-97f7-2ed89909485d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1341 microversion: 2.1 time: 0.352677 Aug 09 15:10:41.731178 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3001/5996] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:41 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1341 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:41.768616 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-1202c2ee-e0db-41aa-8eda-f1decc3e7f37 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Cannot 'resume' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1202c2ee-e0db-41aa-8eda-f1decc3e7f37 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action HTTP/1.1 Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 14 Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: {"resume": {}} Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: exception: Cannot 'resume' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '45050cee-c0fb-4f05-a875-a43d4b834957', 'body': {'resume': {}}} Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 in vm_state active. Cannot resume while the instance is in this state. Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:41.770911 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:41.776163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:41.776163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:41.776163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:41.776163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:10:41.776163 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:41.794073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1202c2ee-e0db-41aa-8eda-f1decc3e7f37 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 409 to user: Cannot 'resume' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:41.795267 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1202c2ee-e0db-41aa-8eda-f1decc3e7f37 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 409 len: 144 microversion: 2.1 time: 0.105486 Aug 09 15:10:41.797055 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2996/5997] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:41 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 144 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 15:10:41.806017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0b09e4c-a7e2-417b-83b6-f9652d0f441b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:41.807238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0b09e4c-a7e2-417b-83b6-f9652d0f441b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:41.815566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0b09e4c-a7e2-417b-83b6-f9652d0f441b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:41.817424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0b09e4c-a7e2-417b-83b6-f9652d0f441b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:41.820218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0b09e4c-a7e2-417b-83b6-f9652d0f441b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:41.820990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0b09e4c-a7e2-417b-83b6-f9652d0f441b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:41.821638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0b09e4c-a7e2-417b-83b6-f9652d0f441b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:41.822354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0b09e4c-a7e2-417b-83b6-f9652d0f441b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:42.219574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c0b09e4c-a7e2-417b-83b6-f9652d0f441b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:42.235436 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0b09e4c-a7e2-417b-83b6-f9652d0f441b tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.432780 Aug 09 15:10:42.237542 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3002/5998] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:41 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:42.262583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d927c295-6e26-4518-912b-b902ac0a070d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:42.263490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d927c295-6e26-4518-912b-b902ac0a070d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:42.271861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d927c295-6e26-4518-912b-b902ac0a070d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:42.272708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d927c295-6e26-4518-912b-b902ac0a070d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:42.273327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d927c295-6e26-4518-912b-b902ac0a070d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:42.274291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d927c295-6e26-4518-912b-b902ac0a070d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:42.274947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d927c295-6e26-4518-912b-b902ac0a070d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:42.275727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d927c295-6e26-4518-912b-b902ac0a070d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:42.486184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9732cb50-e361-4879-b2b9-74167d2efd7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:42.487236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9732cb50-e361-4879-b2b9-74167d2efd7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:42.500197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9732cb50-e361-4879-b2b9-74167d2efd7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:42.500881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9732cb50-e361-4879-b2b9-74167d2efd7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:42.501316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9732cb50-e361-4879-b2b9-74167d2efd7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:42.502695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9732cb50-e361-4879-b2b9-74167d2efd7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:42.503466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9732cb50-e361-4879-b2b9-74167d2efd7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:42.504514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9732cb50-e361-4879-b2b9-74167d2efd7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:42.697326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d927c295-6e26-4518-912b-b902ac0a070d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:42.717902 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d927c295-6e26-4518-912b-b902ac0a070d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.460481 Aug 09 15:10:42.731871 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2997/5999] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:42 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:42.747750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4275733f-ba43-48e6-90b3-a60e5c1b5b1b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:42.748888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4275733f-ba43-48e6-90b3-a60e5c1b5b1b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:42.762362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4275733f-ba43-48e6-90b3-a60e5c1b5b1b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:42.763161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4275733f-ba43-48e6-90b3-a60e5c1b5b1b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:42.766084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4275733f-ba43-48e6-90b3-a60e5c1b5b1b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:42.767078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4275733f-ba43-48e6-90b3-a60e5c1b5b1b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:42.767907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4275733f-ba43-48e6-90b3-a60e5c1b5b1b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:42.770752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4275733f-ba43-48e6-90b3-a60e5c1b5b1b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:42.987501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9732cb50-e361-4879-b2b9-74167d2efd7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:42.996723 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9732cb50-e361-4879-b2b9-74167d2efd7b tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1391 microversion: 2.1 time: 0.516164 Aug 09 15:10:43.000810 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3003/6000] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:42 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1391 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:43.005322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4275733f-ba43-48e6-90b3-a60e5c1b5b1b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:43.006997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d5c64dc-d877-4810-ba4f-ab98b54926d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:43.019988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d5c64dc-d877-4810-ba4f-ab98b54926d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:43.020233 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4275733f-ba43-48e6-90b3-a60e5c1b5b1b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1307 microversion: 2.1 time: 0.286136 Aug 09 15:10:43.021538 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2998/6001] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:42 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1307 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:43.027211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7bdb88c5-2d6d-4e57-b1e4-90d0ed1fa370 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:43.032529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d5c64dc-d877-4810-ba4f-ab98b54926d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:43.032945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d5c64dc-d877-4810-ba4f-ab98b54926d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:43.033569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d5c64dc-d877-4810-ba4f-ab98b54926d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7bdb88c5-2d6d-4e57-b1e4-90d0ed1fa370 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 160 Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": "", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "86b6caed-197b-49d6-8fc8-b79923fc2960"}]}} Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'body': {'server': {'name': '', 'imageRef': 'f0e08d35-6013-4ff5-9f41-f40d5739b250', 'flavorRef': '452', 'networks': [{'uuid': '86b6caed-197b-49d6-8fc8-b79923fc2960'}]}}} Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi '' Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 15:10:43.033823 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7bdb88c5-2d6d-4e57-b1e4-90d0ed1fa370 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7bdb88c5-2d6d-4e57-b1e4-90d0ed1fa370 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.012655 Aug 09 15:10:43.039037 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 2999/6002] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:43 2022] POST /compute/v2.1/servers => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:10:43.040259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d5c64dc-d877-4810-ba4f-ab98b54926d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:43.040259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d5c64dc-d877-4810-ba4f-ab98b54926d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:43.040259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d5c64dc-d877-4810-ba4f-ab98b54926d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:43.049580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e9370f93-7560-4038-9069-27474bd552f2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:43.050760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e9370f93-7560-4038-9069-27474bd552f2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:43.060362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9370f93-7560-4038-9069-27474bd552f2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:43.073553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9370f93-7560-4038-9069-27474bd552f2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:43.074539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9370f93-7560-4038-9069-27474bd552f2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:43.077399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9370f93-7560-4038-9069-27474bd552f2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:43.078619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9370f93-7560-4038-9069-27474bd552f2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:43.080044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e9370f93-7560-4038-9069-27474bd552f2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:43.432464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8d5c64dc-d877-4810-ba4f-ab98b54926d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:43.447539 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d5c64dc-d877-4810-ba4f-ab98b54926d6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1375 microversion: 2.1 time: 0.442433 Aug 09 15:10:43.450566 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3004/6003] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:43 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1375 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:43.456994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e9370f93-7560-4038-9069-27474bd552f2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:43.470523 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e9370f93-7560-4038-9069-27474bd552f2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.424206 Aug 09 15:10:43.485723 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3000/6004] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:43 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:43.496358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-11998eba-2295-44f7-aab2-98de6980a113 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:43.497427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-11998eba-2295-44f7-aab2-98de6980a113 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:43.516074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11998eba-2295-44f7-aab2-98de6980a113 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:43.517273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11998eba-2295-44f7-aab2-98de6980a113 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:43.518840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11998eba-2295-44f7-aab2-98de6980a113 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:43.520668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11998eba-2295-44f7-aab2-98de6980a113 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:43.522389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11998eba-2295-44f7-aab2-98de6980a113 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:43.523000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-11998eba-2295-44f7-aab2-98de6980a113 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:43.832129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-11998eba-2295-44f7-aab2-98de6980a113 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:43.843403 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-11998eba-2295-44f7-aab2-98de6980a113 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.352859 Aug 09 15:10:43.844701 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3005/6005] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:43 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:43.865441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f2cda2e-cf59-4567-b15b-c2f806b09511 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:43.866780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f2cda2e-cf59-4567-b15b-c2f806b09511 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 0840cbff-f136-4553-862d-89cfd6a937e6] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:43.873233 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4f2cda2e-cf59-4567-b15b-c2f806b09511 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 0840cbff-f136-4553-862d-89cfd6a937e6 could not be found. Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f2cda2e-cf59-4567-b15b-c2f806b09511 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/0840cbff-f136-4553-862d-89cfd6a937e6/action HTTP/1.1 Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 14 Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: {"shelve": {}} Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 0840cbff-f136-4553-862d-89cfd6a937e6 could not be found. Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '0840cbff-f136-4553-862d-89cfd6a937e6', 'body': {'shelve': {}}} Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0840cbff-f136-4553-862d-89cfd6a937e6 could not be found. Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0840cbff-f136-4553-862d-89cfd6a937e6 could not be found. Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:10:43.877557 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:10:43.881462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:10:43.881462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:10:43.881462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0840cbff-f136-4553-862d-89cfd6a937e6 could not be found. Aug 09 15:10:43.881462 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:10:43.888709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f2cda2e-cf59-4567-b15b-c2f806b09511 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 0840cbff-f136-4553-862d-89cfd6a937e6 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:10:43.890614 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f2cda2e-cf59-4567-b15b-c2f806b09511 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/0840cbff-f136-4553-862d-89cfd6a937e6/action" status: 404 len: 111 microversion: 2.1 time: 0.029588 Aug 09 15:10:43.894836 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3001/6006] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:43 2022] POST /compute/v2.1/servers/0840cbff-f136-4553-862d-89cfd6a937e6/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:10:43.900649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e02eff24-c51d-456c-bcf8-ef39c9dca946 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:43.901630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e02eff24-c51d-456c-bcf8-ef39c9dca946 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:43.909760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e02eff24-c51d-456c-bcf8-ef39c9dca946 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:43.910632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e02eff24-c51d-456c-bcf8-ef39c9dca946 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:43.911331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e02eff24-c51d-456c-bcf8-ef39c9dca946 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:43.912321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e02eff24-c51d-456c-bcf8-ef39c9dca946 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:43.913014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e02eff24-c51d-456c-bcf8-ef39c9dca946 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:43.913615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e02eff24-c51d-456c-bcf8-ef39c9dca946 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:44.024010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f93a5bf-887e-4b42-890c-91ca1d7ad109 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:44.025088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f93a5bf-887e-4b42-890c-91ca1d7ad109 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:44.053799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f93a5bf-887e-4b42-890c-91ca1d7ad109 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:44.064660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f93a5bf-887e-4b42-890c-91ca1d7ad109 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:44.065268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f93a5bf-887e-4b42-890c-91ca1d7ad109 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:44.066125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f93a5bf-887e-4b42-890c-91ca1d7ad109 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:44.066889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f93a5bf-887e-4b42-890c-91ca1d7ad109 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:44.071504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f93a5bf-887e-4b42-890c-91ca1d7ad109 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:44.272972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e02eff24-c51d-456c-bcf8-ef39c9dca946 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:44.286986 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e02eff24-c51d-456c-bcf8-ef39c9dca946 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.388014 Aug 09 15:10:44.290287 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3006/6007] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:43 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:44.297394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9ba0efa4-c882-43ef-807d-b4db7e013d2b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:44.298519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9ba0efa4-c882-43ef-807d-b4db7e013d2b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:44.308479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ba0efa4-c882-43ef-807d-b4db7e013d2b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:44.309848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ba0efa4-c882-43ef-807d-b4db7e013d2b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:44.311779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ba0efa4-c882-43ef-807d-b4db7e013d2b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:44.312752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ba0efa4-c882-43ef-807d-b4db7e013d2b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:44.316168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ba0efa4-c882-43ef-807d-b4db7e013d2b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:44.317094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9ba0efa4-c882-43ef-807d-b4db7e013d2b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:44.592505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f93a5bf-887e-4b42-890c-91ca1d7ad109 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:44.615829 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f93a5bf-887e-4b42-890c-91ca1d7ad109 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1391 microversion: 2.1 time: 0.590181 Aug 09 15:10:44.616698 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3002/6008] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:44 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1391 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:44.623630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cb31d6f0-b89b-495c-93e4-fdf913367c1a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:44.626104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cb31d6f0-b89b-495c-93e4-fdf913367c1a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:44.640989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb31d6f0-b89b-495c-93e4-fdf913367c1a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:44.642897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb31d6f0-b89b-495c-93e4-fdf913367c1a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:44.643662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb31d6f0-b89b-495c-93e4-fdf913367c1a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:44.644938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb31d6f0-b89b-495c-93e4-fdf913367c1a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:44.646051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb31d6f0-b89b-495c-93e4-fdf913367c1a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:44.648109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb31d6f0-b89b-495c-93e4-fdf913367c1a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:44.849997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9ba0efa4-c882-43ef-807d-b4db7e013d2b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:44.862602 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9ba0efa4-c882-43ef-807d-b4db7e013d2b tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1374 microversion: 2.1 time: 0.570662 Aug 09 15:10:44.863373 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3007/6009] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:44 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1374 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:44.869075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5390f6e9-5f03-4bb6-a4df-f05c6d8e4f68 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:44.870110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5390f6e9-5f03-4bb6-a4df-f05c6d8e4f68 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:44.879674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5390f6e9-5f03-4bb6-a4df-f05c6d8e4f68 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:44.880526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5390f6e9-5f03-4bb6-a4df-f05c6d8e4f68 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:44.881337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5390f6e9-5f03-4bb6-a4df-f05c6d8e4f68 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:44.882314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5390f6e9-5f03-4bb6-a4df-f05c6d8e4f68 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:44.882995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5390f6e9-5f03-4bb6-a4df-f05c6d8e4f68 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:44.883840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5390f6e9-5f03-4bb6-a4df-f05c6d8e4f68 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:45.254001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cb31d6f0-b89b-495c-93e4-fdf913367c1a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:45.285161 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cb31d6f0-b89b-495c-93e4-fdf913367c1a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.666868 Aug 09 15:10:45.286394 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3003/6010] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:44 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:45.317410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ba2a653e-7413-4ab4-a8fd-5f54a18ae8b7 req-11a8c1af-ffc4-4901-843c-bafab566281b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc", "name": "network-vif-plugged", "status": "completed", "tag": "121e83ca-5774-40be-b800-5f19db460b9e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:45.368159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ba2a653e-7413-4ab4-a8fd-5f54a18ae8b7 req-11a8c1af-ffc4-4901-843c-bafab566281b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:45.369033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ba2a653e-7413-4ab4-a8fd-5f54a18ae8b7 req-11a8c1af-ffc4-4901-843c-bafab566281b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:45.369670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ba2a653e-7413-4ab4-a8fd-5f54a18ae8b7 req-11a8c1af-ffc4-4901-843c-bafab566281b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:45.391013 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ba2a653e-7413-4ab4-a8fd-5f54a18ae8b7 req-11a8c1af-ffc4-4901-843c-bafab566281b service nova] Creating event network-vif-plugged:121e83ca-5774-40be-b800-5f19db460b9e for instance 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc on n-h1-844626-8 Aug 09 15:10:45.397829 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ba2a653e-7413-4ab4-a8fd-5f54a18ae8b7 req-11a8c1af-ffc4-4901-843c-bafab566281b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085119 Aug 09 15:10:45.399179 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3004/6011] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:10:45.408566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-acfa6ed7-c007-4e5e-bd96-d000a7e5e56e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:45.409593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-acfa6ed7-c007-4e5e-bd96-d000a7e5e56e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:45.417049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5390f6e9-5f03-4bb6-a4df-f05c6d8e4f68 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:45.425951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acfa6ed7-c007-4e5e-bd96-d000a7e5e56e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:45.426882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acfa6ed7-c007-4e5e-bd96-d000a7e5e56e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:45.427572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acfa6ed7-c007-4e5e-bd96-d000a7e5e56e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:45.428949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acfa6ed7-c007-4e5e-bd96-d000a7e5e56e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:45.429628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acfa6ed7-c007-4e5e-bd96-d000a7e5e56e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:45.430315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acfa6ed7-c007-4e5e-bd96-d000a7e5e56e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:45.433330 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5390f6e9-5f03-4bb6-a4df-f05c6d8e4f68 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1375 microversion: 2.1 time: 0.567575 Aug 09 15:10:45.434106 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3008/6012] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:44 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1375 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:45.467011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-acfa6ed7-c007-4e5e-bd96-d000a7e5e56e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lazy-loading 'flavor' on Instance uuid 45050cee-c0fb-4f05-a875-a43d4b834957 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:10:45.603198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:45.643451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-59b3aa13-a2a2-4aae-a1db-9cde16290b18 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:45.644110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-59b3aa13-a2a2-4aae-a1db-9cde16290b18 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:45.656041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59b3aa13-a2a2-4aae-a1db-9cde16290b18 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:45.657906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59b3aa13-a2a2-4aae-a1db-9cde16290b18 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:45.659033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59b3aa13-a2a2-4aae-a1db-9cde16290b18 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:45.664326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59b3aa13-a2a2-4aae-a1db-9cde16290b18 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:45.664872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59b3aa13-a2a2-4aae-a1db-9cde16290b18 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:45.665320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-59b3aa13-a2a2-4aae-a1db-9cde16290b18 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:45.872130 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-acfa6ed7-c007-4e5e-bd96-d000a7e5e56e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 202 len: 0 microversion: 2.1 time: 0.470871 Aug 09 15:10:45.873393 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3005/6013] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:10:45 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:10:45.890060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e2e869c-c469-4436-8f74-b6c4da159f9c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:45.890984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6e2e869c-c469-4436-8f74-b6c4da159f9c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:45.893285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:45.912984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e2e869c-c469-4436-8f74-b6c4da159f9c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:45.914807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e2e869c-c469-4436-8f74-b6c4da159f9c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:45.915475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e2e869c-c469-4436-8f74-b6c4da159f9c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:45.916509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e2e869c-c469-4436-8f74-b6c4da159f9c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:45.917054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e2e869c-c469-4436-8f74-b6c4da159f9c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:45.917601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e2e869c-c469-4436-8f74-b6c4da159f9c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:46.625238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-59b3aa13-a2a2-4aae-a1db-9cde16290b18 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:46.652584 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-59b3aa13-a2a2-4aae-a1db-9cde16290b18 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1391 microversion: 2.1 time: 1.015913 Aug 09 15:10:46.657057 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3009/6014] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:45 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1391 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:46.668081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b0aaacb7-4691-4c7f-8d1a-abcd5128ce56 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:46.673067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b0aaacb7-4691-4c7f-8d1a-abcd5128ce56 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:46.693467 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0aaacb7-4691-4c7f-8d1a-abcd5128ce56 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:46.698594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0aaacb7-4691-4c7f-8d1a-abcd5128ce56 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:46.699636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0aaacb7-4691-4c7f-8d1a-abcd5128ce56 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:46.703035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0aaacb7-4691-4c7f-8d1a-abcd5128ce56 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:46.704994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0aaacb7-4691-4c7f-8d1a-abcd5128ce56 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:46.706678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b0aaacb7-4691-4c7f-8d1a-abcd5128ce56 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:46.784262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6e2e869c-c469-4436-8f74-b6c4da159f9c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:46.809536 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6e2e869c-c469-4436-8f74-b6c4da159f9c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.929870 Aug 09 15:10:46.818101 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3006/6015] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:45 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:46.831422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42db334a-0f1e-41bc-ac35-a2066c65634a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:46.833565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42db334a-0f1e-41bc-ac35-a2066c65634a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:46.850129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42db334a-0f1e-41bc-ac35-a2066c65634a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:46.850650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42db334a-0f1e-41bc-ac35-a2066c65634a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:46.853263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42db334a-0f1e-41bc-ac35-a2066c65634a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:46.854347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42db334a-0f1e-41bc-ac35-a2066c65634a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:46.855967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42db334a-0f1e-41bc-ac35-a2066c65634a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:46.857013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42db334a-0f1e-41bc-ac35-a2066c65634a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:47.179957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b0aaacb7-4691-4c7f-8d1a-abcd5128ce56 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:47.195778 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b0aaacb7-4691-4c7f-8d1a-abcd5128ce56 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1374 microversion: 2.1 time: 0.536919 Aug 09 15:10:47.198002 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3010/6016] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:46 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1374 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:47.220613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-da868f15-6d61-4ec3-b444-cc06af989d46 req-179fe24d-5d72-41f0-8fac-beb237f04f43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3b597c-be37-40c7-a923-a5226b648d0a", "tag": "84a79531-1c02-4a2e-8891-f26a5521ffc4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:47.316940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-da868f15-6d61-4ec3-b444-cc06af989d46 req-179fe24d-5d72-41f0-8fac-beb237f04f43 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:47.318808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-da868f15-6d61-4ec3-b444-cc06af989d46 req-179fe24d-5d72-41f0-8fac-beb237f04f43 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:47.320033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-da868f15-6d61-4ec3-b444-cc06af989d46 req-179fe24d-5d72-41f0-8fac-beb237f04f43 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:47.366138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42db334a-0f1e-41bc-ac35-a2066c65634a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:47.367164 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-da868f15-6d61-4ec3-b444-cc06af989d46 req-179fe24d-5d72-41f0-8fac-beb237f04f43 service nova] Creating event network-changed:84a79531-1c02-4a2e-8891-f26a5521ffc4 for instance 3e3b597c-be37-40c7-a923-a5226b648d0a on n-h2-844626-8 Aug 09 15:10:47.381914 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-da868f15-6d61-4ec3-b444-cc06af989d46 req-179fe24d-5d72-41f0-8fac-beb237f04f43 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176472 Aug 09 15:10:47.383534 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42db334a-0f1e-41bc-ac35-a2066c65634a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1375 microversion: 2.1 time: 0.562608 Aug 09 15:10:47.384347 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3011/6017] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:10:47.385216 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3007/6018] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:46 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1375 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:47.677938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8b66f545-2cdf-4a2c-92d0-e884ff15bca9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:47.678541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8b66f545-2cdf-4a2c-92d0-e884ff15bca9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:47.692849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b66f545-2cdf-4a2c-92d0-e884ff15bca9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:47.697240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b66f545-2cdf-4a2c-92d0-e884ff15bca9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:47.698042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b66f545-2cdf-4a2c-92d0-e884ff15bca9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:47.698895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b66f545-2cdf-4a2c-92d0-e884ff15bca9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:47.699600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b66f545-2cdf-4a2c-92d0-e884ff15bca9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:47.699941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b66f545-2cdf-4a2c-92d0-e884ff15bca9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:47.840551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-607c55fe-2b3c-4ccb-ad24-ff7e280d00d9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:47.841978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-607c55fe-2b3c-4ccb-ad24-ff7e280d00d9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:47.852015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-607c55fe-2b3c-4ccb-ad24-ff7e280d00d9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:47.852912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-607c55fe-2b3c-4ccb-ad24-ff7e280d00d9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:47.853764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-607c55fe-2b3c-4ccb-ad24-ff7e280d00d9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:47.865284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-607c55fe-2b3c-4ccb-ad24-ff7e280d00d9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:47.866210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-607c55fe-2b3c-4ccb-ad24-ff7e280d00d9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:47.867186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-607c55fe-2b3c-4ccb-ad24-ff7e280d00d9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:47.923145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8b66f545-2cdf-4a2c-92d0-e884ff15bca9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:47.934284 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8b66f545-2cdf-4a2c-92d0-e884ff15bca9 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1563 microversion: 2.1 time: 0.260794 Aug 09 15:10:47.934754 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3012/6019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:47 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1563 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:47.958580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c9b5cccd-c620-4c94-8fa9-8fdc73d3085f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:47.960645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c9b5cccd-c620-4c94-8fa9-8fdc73d3085f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:47.983925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b5cccd-c620-4c94-8fa9-8fdc73d3085f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:47.984867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b5cccd-c620-4c94-8fa9-8fdc73d3085f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:47.985497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b5cccd-c620-4c94-8fa9-8fdc73d3085f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:47.986400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b5cccd-c620-4c94-8fa9-8fdc73d3085f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:47.987218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b5cccd-c620-4c94-8fa9-8fdc73d3085f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:47.987880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c9b5cccd-c620-4c94-8fa9-8fdc73d3085f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:47.993913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:48.141436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-607c55fe-2b3c-4ccb-ad24-ff7e280d00d9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:48.156194 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-607c55fe-2b3c-4ccb-ad24-ff7e280d00d9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.321875 Aug 09 15:10:48.160720 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3008/6020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:47 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:48.234199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a61ccda5-1a56-41e2-98c2-174754fbecbb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:48.234746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a61ccda5-1a56-41e2-98c2-174754fbecbb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:48.252435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c9b5cccd-c620-4c94-8fa9-8fdc73d3085f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:48.253726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a61ccda5-1a56-41e2-98c2-174754fbecbb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:48.254453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a61ccda5-1a56-41e2-98c2-174754fbecbb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:48.255213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a61ccda5-1a56-41e2-98c2-174754fbecbb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:48.256119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a61ccda5-1a56-41e2-98c2-174754fbecbb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:48.256767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a61ccda5-1a56-41e2-98c2-174754fbecbb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:48.257372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a61ccda5-1a56-41e2-98c2-174754fbecbb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:48.265451 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c9b5cccd-c620-4c94-8fa9-8fdc73d3085f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1563 microversion: 2.1 time: 0.313677 Aug 09 15:10:48.280107 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3013/6021] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:47 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1563 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:48.417833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-179535a7-27f1-490e-9258-ea9de847fa9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:48.418448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-179535a7-27f1-490e-9258-ea9de847fa9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:48.434965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-179535a7-27f1-490e-9258-ea9de847fa9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:48.435502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-179535a7-27f1-490e-9258-ea9de847fa9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:48.435924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-179535a7-27f1-490e-9258-ea9de847fa9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:48.437177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-179535a7-27f1-490e-9258-ea9de847fa9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:48.437177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-179535a7-27f1-490e-9258-ea9de847fa9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:48.437562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-179535a7-27f1-490e-9258-ea9de847fa9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:48.664105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a61ccda5-1a56-41e2-98c2-174754fbecbb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:48.675473 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a61ccda5-1a56-41e2-98c2-174754fbecbb tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1374 microversion: 2.1 time: 0.445889 Aug 09 15:10:48.678320 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3009/6022] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:48 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1374 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:48.966338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-179535a7-27f1-490e-9258-ea9de847fa9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:48.978516 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-179535a7-27f1-490e-9258-ea9de847fa9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1375 microversion: 2.1 time: 0.564248 Aug 09 15:10:48.980039 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3014/6023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:48 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1375 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:49.089180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cca1ddf9-7219-447a-892c-c1e06259c18d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Action: 'create', calling method: .version_select at 0x7f41dd239820>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1549722437", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1YI6gF4aAiHloxts6BFCvHmM2LDqqN+hR9E8pvqP6WBfhFD76j7hCNf2Ca/+YExHx2tdWbectLwJ5nIS+3pKjdNZ7+t3xLj7tI+CCl4taQTylcX2LVPutovS3zrs0jKA=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:49.107391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-cca1ddf9-7219-447a-892c-c1e06259c18d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Getting quotas for project 00fe0e56b9f14c079a58ade5c138c3ed. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:10:49.113230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-cca1ddf9-7219-447a-892c-c1e06259c18d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Getting quotas for user 48d78051967a4497b5d5ff5c65c2bcd7 and project 00fe0e56b9f14c079a58ade5c138c3ed. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:10:49.151058 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cca1ddf9-7219-447a-892c-c1e06259c18d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.328410 Aug 09 15:10:49.152570 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3010/6024] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:10:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:10:49.185730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e4f0fdae-e386-439b-9b4c-602842a4a827 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:49.187302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e4f0fdae-e386-439b-9b4c-602842a4a827 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:49.194499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4f0fdae-e386-439b-9b4c-602842a4a827 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:49.194993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4f0fdae-e386-439b-9b4c-602842a4a827 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:49.195666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4f0fdae-e386-439b-9b4c-602842a4a827 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:49.196161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4f0fdae-e386-439b-9b4c-602842a4a827 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:49.196644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4f0fdae-e386-439b-9b4c-602842a4a827 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:49.197166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e4f0fdae-e386-439b-9b4c-602842a4a827 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:49.555562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e4f0fdae-e386-439b-9b4c-602842a4a827 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:49.570291 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e4f0fdae-e386-439b-9b4c-602842a4a827 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.389871 Aug 09 15:10:49.570291 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3015/6025] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:49 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:49.700532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c3b124ed-bd25-45a8-a043-689fe4598916 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:49.701159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c3b124ed-bd25-45a8-a043-689fe4598916 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:49.708551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3b124ed-bd25-45a8-a043-689fe4598916 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:49.709369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3b124ed-bd25-45a8-a043-689fe4598916 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:49.710029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3b124ed-bd25-45a8-a043-689fe4598916 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:49.711243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3b124ed-bd25-45a8-a043-689fe4598916 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:49.711925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3b124ed-bd25-45a8-a043-689fe4598916 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:49.713056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3b124ed-bd25-45a8-a043-689fe4598916 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:50.015157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-01a12382-5723-464c-b526-5e9ae793d087 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:50.016451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01a12382-5723-464c-b526-5e9ae793d087 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:50.020275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:50.023051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:50.044616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01a12382-5723-464c-b526-5e9ae793d087 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:50.045454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01a12382-5723-464c-b526-5e9ae793d087 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:50.046178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01a12382-5723-464c-b526-5e9ae793d087 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:50.048551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01a12382-5723-464c-b526-5e9ae793d087 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:50.049416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01a12382-5723-464c-b526-5e9ae793d087 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:50.051052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01a12382-5723-464c-b526-5e9ae793d087 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:50.324450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c3b124ed-bd25-45a8-a043-689fe4598916 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:50.343078 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c3b124ed-bd25-45a8-a043-689fe4598916 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1374 microversion: 2.1 time: 0.639951 Aug 09 15:10:50.367268 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3011/6026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:49 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1374 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:50.593578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9180a506-98db-4576-9eab-0b7a43a1e3bc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:50.594655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9180a506-98db-4576-9eab-0b7a43a1e3bc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:50.606721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9180a506-98db-4576-9eab-0b7a43a1e3bc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:50.615695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9180a506-98db-4576-9eab-0b7a43a1e3bc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:50.616278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9180a506-98db-4576-9eab-0b7a43a1e3bc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:50.617079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9180a506-98db-4576-9eab-0b7a43a1e3bc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:50.628271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9180a506-98db-4576-9eab-0b7a43a1e3bc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:50.628703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9180a506-98db-4576-9eab-0b7a43a1e3bc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:50.826633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-01a12382-5723-464c-b526-5e9ae793d087 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:50.859540 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-01a12382-5723-464c-b526-5e9ae793d087 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1375 microversion: 2.1 time: 0.861468 Aug 09 15:10:50.860463 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3016/6027] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:49 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1375 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:51.028927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9180a506-98db-4576-9eab-0b7a43a1e3bc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:51.043159 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9180a506-98db-4576-9eab-0b7a43a1e3bc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.452937 Aug 09 15:10:51.060024 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3012/6028] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:50 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:51.370181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-103e027b-8547-41e6-aabd-eb086577fe41 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:51.371581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-103e027b-8547-41e6-aabd-eb086577fe41 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:51.379152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-103e027b-8547-41e6-aabd-eb086577fe41 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:51.379896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-103e027b-8547-41e6-aabd-eb086577fe41 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:51.380336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-103e027b-8547-41e6-aabd-eb086577fe41 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:51.381090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-103e027b-8547-41e6-aabd-eb086577fe41 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:51.381544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-103e027b-8547-41e6-aabd-eb086577fe41 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:51.381962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-103e027b-8547-41e6-aabd-eb086577fe41 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:51.704167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-103e027b-8547-41e6-aabd-eb086577fe41 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:51.724580 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-103e027b-8547-41e6-aabd-eb086577fe41 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1374 microversion: 2.1 time: 0.354144 Aug 09 15:10:51.725296 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3017/6029] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:51 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1374 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:51.888760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ed7fad7-32f7-45c9-b3a0-44133dbb491b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:51.890271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1ed7fad7-32f7-45c9-b3a0-44133dbb491b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:51.901108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ed7fad7-32f7-45c9-b3a0-44133dbb491b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:51.902871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ed7fad7-32f7-45c9-b3a0-44133dbb491b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:51.904452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ed7fad7-32f7-45c9-b3a0-44133dbb491b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:51.905726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ed7fad7-32f7-45c9-b3a0-44133dbb491b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:51.906438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ed7fad7-32f7-45c9-b3a0-44133dbb491b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:51.907303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ed7fad7-32f7-45c9-b3a0-44133dbb491b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:52.067513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-921443f0-34df-49f6-ac7d-d769e40a0f6f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:52.068205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-921443f0-34df-49f6-ac7d-d769e40a0f6f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:52.075195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-921443f0-34df-49f6-ac7d-d769e40a0f6f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:52.075687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-921443f0-34df-49f6-ac7d-d769e40a0f6f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:52.076232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-921443f0-34df-49f6-ac7d-d769e40a0f6f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:52.081081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-921443f0-34df-49f6-ac7d-d769e40a0f6f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:52.081081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-921443f0-34df-49f6-ac7d-d769e40a0f6f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:52.081081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-921443f0-34df-49f6-ac7d-d769e40a0f6f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:52.532488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1ed7fad7-32f7-45c9-b3a0-44133dbb491b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:52.542247 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1ed7fad7-32f7-45c9-b3a0-44133dbb491b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1375 microversion: 2.1 time: 0.660315 Aug 09 15:10:52.544371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-921443f0-34df-49f6-ac7d-d769e40a0f6f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:52.556413 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3013/6030] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:51 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1375 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:52.558465 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-921443f0-34df-49f6-ac7d-d769e40a0f6f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.494829 Aug 09 15:10:52.559583 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3018/6031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:52 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:52.565616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2afd4226-addd-4158-924c-0a413f66cc74 req-01b9def5-9fa2-4914-b29d-162f2cccf1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "729b22ab-4269-4135-aca0-2603ca95b46c", "name": "network-vif-plugged", "status": "completed", "tag": "ad452073-9418-4262-96fa-79ef15d5ad1b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:52.577422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2afd4226-addd-4158-924c-0a413f66cc74 req-01b9def5-9fa2-4914-b29d-162f2cccf1e8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:52.578079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2afd4226-addd-4158-924c-0a413f66cc74 req-01b9def5-9fa2-4914-b29d-162f2cccf1e8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:52.578651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2afd4226-addd-4158-924c-0a413f66cc74 req-01b9def5-9fa2-4914-b29d-162f2cccf1e8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:52.596032 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2afd4226-addd-4158-924c-0a413f66cc74 req-01b9def5-9fa2-4914-b29d-162f2cccf1e8 service nova] Creating event network-vif-plugged:ad452073-9418-4262-96fa-79ef15d5ad1b for instance 729b22ab-4269-4135-aca0-2603ca95b46c on n-h1-844626-8 Aug 09 15:10:52.597380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-355620268", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1549722437", "security_groups": [{"name": "tempest-secgroup-smoke-754123787"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "960963a9-304e-4a97-9e04-05eeeabb5741"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:52.602111 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2afd4226-addd-4158-924c-0a413f66cc74 req-01b9def5-9fa2-4914-b29d-162f2cccf1e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041274 Aug 09 15:10:52.603791 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3019/6032] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:10:52.747710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a3edf10-edad-4319-a9ed-34912b6edcb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:52.748390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a3edf10-edad-4319-a9ed-34912b6edcb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:52.758461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a3edf10-edad-4319-a9ed-34912b6edcb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:52.758956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a3edf10-edad-4319-a9ed-34912b6edcb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:52.759572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a3edf10-edad-4319-a9ed-34912b6edcb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:52.765104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a3edf10-edad-4319-a9ed-34912b6edcb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:52.765863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a3edf10-edad-4319-a9ed-34912b6edcb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:52.766462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a3edf10-edad-4319-a9ed-34912b6edcb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:53.035757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] validate_networks() for [('960963a9-304e-4a97-9e04-05eeeabb5741', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:10:53.052376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4a3edf10-edad-4319-a9ed-34912b6edcb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:53.060632 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a3edf10-edad-4319-a9ed-34912b6edcb1 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1374 microversion: 2.1 time: 0.318297 Aug 09 15:10:53.075309 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3020/6033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:52 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1374 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:53.081421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82f0a8a2-80ab-4bb1-a06d-583a3e1cbbd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:53.082044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82f0a8a2-80ab-4bb1-a06d-583a3e1cbbd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:53.088979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82f0a8a2-80ab-4bb1-a06d-583a3e1cbbd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:53.089468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82f0a8a2-80ab-4bb1-a06d-583a3e1cbbd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:53.089966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82f0a8a2-80ab-4bb1-a06d-583a3e1cbbd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:53.090684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82f0a8a2-80ab-4bb1-a06d-583a3e1cbbd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:53.091184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82f0a8a2-80ab-4bb1-a06d-583a3e1cbbd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:53.091616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82f0a8a2-80ab-4bb1-a06d-583a3e1cbbd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:53.308434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-82f0a8a2-80ab-4bb1-a06d-583a3e1cbbd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:53.320499 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82f0a8a2-80ab-4bb1-a06d-583a3e1cbbd6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1563 microversion: 2.1 time: 0.243774 Aug 09 15:10:53.327737 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3021/6034] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:53 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:53.350232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-af7deff7-fa89-4c4b-9828-c0d84dd54b29 req-f9a1e667-363d-426c-ac0b-91dbc62c0754 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc", "tag": "121e83ca-5774-40be-b800-5f19db460b9e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:53.363416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-af7deff7-fa89-4c4b-9828-c0d84dd54b29 req-f9a1e667-363d-426c-ac0b-91dbc62c0754 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:53.372731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-af7deff7-fa89-4c4b-9828-c0d84dd54b29 req-f9a1e667-363d-426c-ac0b-91dbc62c0754 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:53.379541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-af7deff7-fa89-4c4b-9828-c0d84dd54b29 req-f9a1e667-363d-426c-ac0b-91dbc62c0754 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:53.410031 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-af7deff7-fa89-4c4b-9828-c0d84dd54b29 req-f9a1e667-363d-426c-ac0b-91dbc62c0754 service nova] Creating event network-changed:121e83ca-5774-40be-b800-5f19db460b9e for instance 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc on n-h1-844626-8 Aug 09 15:10:53.418666 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-af7deff7-fa89-4c4b-9828-c0d84dd54b29 req-f9a1e667-363d-426c-ac0b-91dbc62c0754 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087651 Aug 09 15:10:53.420055 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3022/6035] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:10:53.567616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db90e657-b3f0-48a5-8536-4d83feee5cb4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:53.568345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-db90e657-b3f0-48a5-8536-4d83feee5cb4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:53.575987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db90e657-b3f0-48a5-8536-4d83feee5cb4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:53.576815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db90e657-b3f0-48a5-8536-4d83feee5cb4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:53.577438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db90e657-b3f0-48a5-8536-4d83feee5cb4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:53.580076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db90e657-b3f0-48a5-8536-4d83feee5cb4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:53.580540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db90e657-b3f0-48a5-8536-4d83feee5cb4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:53.582478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db90e657-b3f0-48a5-8536-4d83feee5cb4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:53.731049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Getting quotas for project 00fe0e56b9f14c079a58ade5c138c3ed. Resources: dict_keys(['metadata_items']) {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:10:53.751175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Getting quotas for user 48d78051967a4497b5d5ff5c65c2bcd7 and project 00fe0e56b9f14c079a58ade5c138c3ed. Resources: dict_keys(['metadata_items']) {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:10:53.794844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:10:53.798910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:10:53.799888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:10:53.800547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:10:53.803017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:10:53.819676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:53.820460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:53.821075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:53.822218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:53.824217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:53.824894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:53.858809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Getting quotas for project 00fe0e56b9f14c079a58ade5c138c3ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:10:53.864973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-db90e657-b3f0-48a5-8536-4d83feee5cb4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:53.867502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Getting quotas for user 48d78051967a4497b5d5ff5c65c2bcd7 and project 00fe0e56b9f14c079a58ade5c138c3ed. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:10:53.880767 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-db90e657-b3f0-48a5-8536-4d83feee5cb4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1375 microversion: 2.1 time: 0.318186 Aug 09 15:10:53.885051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:10:53.888286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:10:53.900325 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3023/6036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:53 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1375 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:53.905856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f8a214f0-d161-46e6-bf26-20010ffd1af0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:53.906473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8a214f0-d161-46e6-bf26-20010ffd1af0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:53.914152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a214f0-d161-46e6-bf26-20010ffd1af0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:53.915822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a214f0-d161-46e6-bf26-20010ffd1af0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:53.916488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a214f0-d161-46e6-bf26-20010ffd1af0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:53.917894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a214f0-d161-46e6-bf26-20010ffd1af0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:53.918951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a214f0-d161-46e6-bf26-20010ffd1af0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:53.919688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8a214f0-d161-46e6-bf26-20010ffd1af0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:53.949644 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9389c9f6-902e-4413-bb73-ecb65831be56 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.363744 Aug 09 15:10:53.951024 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3014/6037] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:10:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:10:53.962251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-784ee408-3fb1-4800-aea2-f8c7d89eb5ce tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:53.963266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-784ee408-3fb1-4800-aea2-f8c7d89eb5ce tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:54.172329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8a214f0-d161-46e6-bf26-20010ffd1af0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:54.184866 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f8a214f0-d161-46e6-bf26-20010ffd1af0 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.282290 Aug 09 15:10:54.200105 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3024/6038] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:53 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:54.206282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1314b731-8a76-4894-98bb-55c0643d38c2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:54.207958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1314b731-8a76-4894-98bb-55c0643d38c2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:54.215834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1314b731-8a76-4894-98bb-55c0643d38c2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:54.216661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1314b731-8a76-4894-98bb-55c0643d38c2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:54.217554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1314b731-8a76-4894-98bb-55c0643d38c2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:54.232128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1314b731-8a76-4894-98bb-55c0643d38c2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:54.233796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1314b731-8a76-4894-98bb-55c0643d38c2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:54.235076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1314b731-8a76-4894-98bb-55c0643d38c2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:54.265591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-784ee408-3fb1-4800-aea2-f8c7d89eb5ce tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:54.281587 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-784ee408-3fb1-4800-aea2-f8c7d89eb5ce tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1302 microversion: 2.1 time: 0.323588 Aug 09 15:10:54.286891 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3015/6039] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:53 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1302 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:54.512282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1314b731-8a76-4894-98bb-55c0643d38c2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:54.544564 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1314b731-8a76-4894-98bb-55c0643d38c2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1374 microversion: 2.1 time: 0.343071 Aug 09 15:10:54.555767 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3025/6040] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:54 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1374 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:54.656999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-954b68d4-ecf3-49b0-95b8-d6a6667bf79a req-cbebece4-4574-4aea-9868-3470ca1d5408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3b597c-be37-40c7-a923-a5226b648d0a", "name": "network-vif-plugged", "status": "completed", "tag": "84a79531-1c02-4a2e-8891-f26a5521ffc4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:54.669513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-954b68d4-ecf3-49b0-95b8-d6a6667bf79a req-cbebece4-4574-4aea-9868-3470ca1d5408 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:54.670554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-954b68d4-ecf3-49b0-95b8-d6a6667bf79a req-cbebece4-4574-4aea-9868-3470ca1d5408 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:54.671300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-954b68d4-ecf3-49b0-95b8-d6a6667bf79a req-cbebece4-4574-4aea-9868-3470ca1d5408 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:54.695926 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-954b68d4-ecf3-49b0-95b8-d6a6667bf79a req-cbebece4-4574-4aea-9868-3470ca1d5408 service nova] Creating event network-vif-plugged:84a79531-1c02-4a2e-8891-f26a5521ffc4 for instance 3e3b597c-be37-40c7-a923-a5226b648d0a on n-h2-844626-8 Aug 09 15:10:54.702767 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-954b68d4-ecf3-49b0-95b8-d6a6667bf79a req-cbebece4-4574-4aea-9868-3470ca1d5408 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050509 Aug 09 15:10:54.703656 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3016/6041] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:10:54.910413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bce7a5b5-b574-4bc4-b316-ec372a24622e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:54.911186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bce7a5b5-b574-4bc4-b316-ec372a24622e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:54.957455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bce7a5b5-b574-4bc4-b316-ec372a24622e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:54.959525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bce7a5b5-b574-4bc4-b316-ec372a24622e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:54.959525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bce7a5b5-b574-4bc4-b316-ec372a24622e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:54.977387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bce7a5b5-b574-4bc4-b316-ec372a24622e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:54.978173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bce7a5b5-b574-4bc4-b316-ec372a24622e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:54.980965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bce7a5b5-b574-4bc4-b316-ec372a24622e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:55.186755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bce7a5b5-b574-4bc4-b316-ec372a24622e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:55.197469 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bce7a5b5-b574-4bc4-b316-ec372a24622e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1563 microversion: 2.1 time: 0.290843 Aug 09 15:10:55.198626 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3026/6042] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:54 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1563 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:55.213400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b496a672-20c2-4ffb-96f6-6620f90495e6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:55.214323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b496a672-20c2-4ffb-96f6-6620f90495e6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:55.221301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a64b2ac8-b2d1-47fb-8a25-2f624690e6a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:55.221914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a64b2ac8-b2d1-47fb-8a25-2f624690e6a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:55.228531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64b2ac8-b2d1-47fb-8a25-2f624690e6a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:55.229013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64b2ac8-b2d1-47fb-8a25-2f624690e6a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:55.229359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b496a672-20c2-4ffb-96f6-6620f90495e6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:55.229494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64b2ac8-b2d1-47fb-8a25-2f624690e6a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:55.229987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b496a672-20c2-4ffb-96f6-6620f90495e6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:55.230127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64b2ac8-b2d1-47fb-8a25-2f624690e6a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:55.230609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b496a672-20c2-4ffb-96f6-6620f90495e6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:55.230787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64b2ac8-b2d1-47fb-8a25-2f624690e6a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:55.231486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64b2ac8-b2d1-47fb-8a25-2f624690e6a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:55.232030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b496a672-20c2-4ffb-96f6-6620f90495e6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:55.243783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b496a672-20c2-4ffb-96f6-6620f90495e6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:55.246132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b496a672-20c2-4ffb-96f6-6620f90495e6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:55.465793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b496a672-20c2-4ffb-96f6-6620f90495e6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:55.476220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a64b2ac8-b2d1-47fb-8a25-2f624690e6a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:55.478388 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b496a672-20c2-4ffb-96f6-6620f90495e6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.270725 Aug 09 15:10:55.479947 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3017/6043] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:55 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:55.485563 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a64b2ac8-b2d1-47fb-8a25-2f624690e6a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1563 microversion: 2.1 time: 0.268290 Aug 09 15:10:55.487502 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3027/6044] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:55 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1563 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:55.487714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-93b776f8-ff51-439a-aa5c-83880a15c714 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:55.488095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-93b776f8-ff51-439a-aa5c-83880a15c714 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:55.506952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93b776f8-ff51-439a-aa5c-83880a15c714 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:55.507628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93b776f8-ff51-439a-aa5c-83880a15c714 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:55.508767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93b776f8-ff51-439a-aa5c-83880a15c714 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:55.509026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93b776f8-ff51-439a-aa5c-83880a15c714 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:55.509741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93b776f8-ff51-439a-aa5c-83880a15c714 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:55.510193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-93b776f8-ff51-439a-aa5c-83880a15c714 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:55.577694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60f9963f-8d4b-4fd8-a24a-686f6b2cac4d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:55.578472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-60f9963f-8d4b-4fd8-a24a-686f6b2cac4d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:55.587720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60f9963f-8d4b-4fd8-a24a-686f6b2cac4d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:55.588398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60f9963f-8d4b-4fd8-a24a-686f6b2cac4d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:55.589011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60f9963f-8d4b-4fd8-a24a-686f6b2cac4d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:55.589786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60f9963f-8d4b-4fd8-a24a-686f6b2cac4d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:55.590268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60f9963f-8d4b-4fd8-a24a-686f6b2cac4d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:55.590710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60f9963f-8d4b-4fd8-a24a-686f6b2cac4d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:55.618006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-93b776f8-ff51-439a-aa5c-83880a15c714 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:55.628217 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-93b776f8-ff51-439a-aa5c-83880a15c714 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1354 microversion: 2.1 time: 0.146554 Aug 09 15:10:55.642290 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3018/6045] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:55 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:55.647537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52b3114c-2086-46b7-af39-9a398be1143f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:55.647537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52b3114c-2086-46b7-af39-9a398be1143f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:55.662705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52b3114c-2086-46b7-af39-9a398be1143f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:55.663439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52b3114c-2086-46b7-af39-9a398be1143f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:55.664213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52b3114c-2086-46b7-af39-9a398be1143f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:55.665302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52b3114c-2086-46b7-af39-9a398be1143f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:55.666100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52b3114c-2086-46b7-af39-9a398be1143f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:55.666913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52b3114c-2086-46b7-af39-9a398be1143f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:55.704380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52b3114c-2086-46b7-af39-9a398be1143f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:10:55.800033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60f9963f-8d4b-4fd8-a24a-686f6b2cac4d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:55.808847 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60f9963f-8d4b-4fd8-a24a-686f6b2cac4d tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1374 microversion: 2.1 time: 0.235775 Aug 09 15:10:55.809464 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3028/6046] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:55 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1374 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:55.857844 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52b3114c-2086-46b7-af39-9a398be1143f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 204 len: 0 microversion: 2.1 time: 0.224589 Aug 09 15:10:55.858581 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3019/6047] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:10:55 2022] DELETE /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:10:55.866820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49332f9e-e3e1-4568-b1ad-efba1e7c0220 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:55.867703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49332f9e-e3e1-4568-b1ad-efba1e7c0220 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:55.875145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49332f9e-e3e1-4568-b1ad-efba1e7c0220 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:55.875632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49332f9e-e3e1-4568-b1ad-efba1e7c0220 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:55.876437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49332f9e-e3e1-4568-b1ad-efba1e7c0220 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:55.877741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49332f9e-e3e1-4568-b1ad-efba1e7c0220 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:55.878485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49332f9e-e3e1-4568-b1ad-efba1e7c0220 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:55.879295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49332f9e-e3e1-4568-b1ad-efba1e7c0220 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:56.019539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-49332f9e-e3e1-4568-b1ad-efba1e7c0220 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:56.030050 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49332f9e-e3e1-4568-b1ad-efba1e7c0220 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1569 microversion: 2.1 time: 0.167136 Aug 09 15:10:56.030661 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3029/6048] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:55 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:56.501951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c6c6621-073e-4b93-a7c4-e6c192791008 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:56.502933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2c6c6621-073e-4b93-a7c4-e6c192791008 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:56.509914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c6c6621-073e-4b93-a7c4-e6c192791008 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:56.510414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c6c6621-073e-4b93-a7c4-e6c192791008 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:56.510860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c6c6621-073e-4b93-a7c4-e6c192791008 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:56.512201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c6c6621-073e-4b93-a7c4-e6c192791008 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:56.512824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c6c6621-073e-4b93-a7c4-e6c192791008 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:56.513271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c6c6621-073e-4b93-a7c4-e6c192791008 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:56.650061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-902ba6fe-2de8-4748-b2b2-204ba7c19ac8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:56.651023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-902ba6fe-2de8-4748-b2b2-204ba7c19ac8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:56.658144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-902ba6fe-2de8-4748-b2b2-204ba7c19ac8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:56.658624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-902ba6fe-2de8-4748-b2b2-204ba7c19ac8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:56.658875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2c6c6621-073e-4b93-a7c4-e6c192791008 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:56.659024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-902ba6fe-2de8-4748-b2b2-204ba7c19ac8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:56.659764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-902ba6fe-2de8-4748-b2b2-204ba7c19ac8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:56.660204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-902ba6fe-2de8-4748-b2b2-204ba7c19ac8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:56.660614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-902ba6fe-2de8-4748-b2b2-204ba7c19ac8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:56.668910 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2c6c6621-073e-4b93-a7c4-e6c192791008 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.171618 Aug 09 15:10:56.669884 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3020/6049] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:56 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:56.724670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-902ba6fe-2de8-4748-b2b2-204ba7c19ac8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:56.732889 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-902ba6fe-2de8-4748-b2b2-204ba7c19ac8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1360 microversion: 2.1 time: 0.086764 Aug 09 15:10:56.733468 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3030/6050] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:56 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1360 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:56.834724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b9dc413-0d80-483b-a57f-faa833c4eb22 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:56.835900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b9dc413-0d80-483b-a57f-faa833c4eb22 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:56.847693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b9dc413-0d80-483b-a57f-faa833c4eb22 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:56.848589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b9dc413-0d80-483b-a57f-faa833c4eb22 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:56.849395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b9dc413-0d80-483b-a57f-faa833c4eb22 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:56.850667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b9dc413-0d80-483b-a57f-faa833c4eb22 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:56.851556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b9dc413-0d80-483b-a57f-faa833c4eb22 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:56.852376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b9dc413-0d80-483b-a57f-faa833c4eb22 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:56.993736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6b9dc413-0d80-483b-a57f-faa833c4eb22 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:57.002874 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b9dc413-0d80-483b-a57f-faa833c4eb22 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1545 microversion: 2.1 time: 0.175660 Aug 09 15:10:57.003513 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3021/6051] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:56 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1545 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:57.025756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e1426ef7-d2cc-4f57-a837-79ae6bfb79da tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:57.026385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e1426ef7-d2cc-4f57-a837-79ae6bfb79da tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:57.032811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1426ef7-d2cc-4f57-a837-79ae6bfb79da tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:57.033304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1426ef7-d2cc-4f57-a837-79ae6bfb79da tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:57.034406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1426ef7-d2cc-4f57-a837-79ae6bfb79da tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:57.035250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1426ef7-d2cc-4f57-a837-79ae6bfb79da tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:57.035640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1426ef7-d2cc-4f57-a837-79ae6bfb79da tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:57.036042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1426ef7-d2cc-4f57-a837-79ae6bfb79da tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:57.040988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:57.053429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-232c08ad-8481-4ddd-b2ec-06c3a637148e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:57.054601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-232c08ad-8481-4ddd-b2ec-06c3a637148e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:57.062625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-232c08ad-8481-4ddd-b2ec-06c3a637148e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:57.063167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-232c08ad-8481-4ddd-b2ec-06c3a637148e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:57.063615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-232c08ad-8481-4ddd-b2ec-06c3a637148e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:57.064353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-232c08ad-8481-4ddd-b2ec-06c3a637148e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:57.064852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-232c08ad-8481-4ddd-b2ec-06c3a637148e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:57.065342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-232c08ad-8481-4ddd-b2ec-06c3a637148e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:57.257638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e1426ef7-d2cc-4f57-a837-79ae6bfb79da tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:57.273776 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e1426ef7-d2cc-4f57-a837-79ae6bfb79da tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1545 microversion: 2.1 time: 0.251917 Aug 09 15:10:57.274599 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3031/6052] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:57 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1545 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:57.291210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-232c08ad-8481-4ddd-b2ec-06c3a637148e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:57.291210 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-232c08ad-8481-4ddd-b2ec-06c3a637148e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1569 microversion: 2.1 time: 0.236868 Aug 09 15:10:57.291210 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3022/6053] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:57 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:57.692195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fc1fb15a-e163-4aea-8dec-eb81cf1b6cdc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:57.692913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fc1fb15a-e163-4aea-8dec-eb81cf1b6cdc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:57.699935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc1fb15a-e163-4aea-8dec-eb81cf1b6cdc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:57.700444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc1fb15a-e163-4aea-8dec-eb81cf1b6cdc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:57.701064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc1fb15a-e163-4aea-8dec-eb81cf1b6cdc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:57.702725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc1fb15a-e163-4aea-8dec-eb81cf1b6cdc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:57.703219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc1fb15a-e163-4aea-8dec-eb81cf1b6cdc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:57.703652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fc1fb15a-e163-4aea-8dec-eb81cf1b6cdc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:57.760519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2367d3b4-2953-4754-ba21-5618ee0ad3d8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:57.761365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2367d3b4-2953-4754-ba21-5618ee0ad3d8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:57.777449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2367d3b4-2953-4754-ba21-5618ee0ad3d8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:57.778311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2367d3b4-2953-4754-ba21-5618ee0ad3d8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:57.779027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2367d3b4-2953-4754-ba21-5618ee0ad3d8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:57.780145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2367d3b4-2953-4754-ba21-5618ee0ad3d8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:57.780838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2367d3b4-2953-4754-ba21-5618ee0ad3d8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:57.781519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2367d3b4-2953-4754-ba21-5618ee0ad3d8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:58.183672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fc1fb15a-e163-4aea-8dec-eb81cf1b6cdc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:58.194997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:10:58.201995 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fc1fb15a-e163-4aea-8dec-eb81cf1b6cdc tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.513284 Aug 09 15:10:58.205715 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3023/6054] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:57 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:10:58.261276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2367d3b4-2953-4754-ba21-5618ee0ad3d8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:58.274307 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2367d3b4-2953-4754-ba21-5618ee0ad3d8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1427 microversion: 2.1 time: 0.519223 Aug 09 15:10:58.290085 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3032/6055] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:57 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1427 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:58.318330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d42090eb-1016-47f4-a502-c76eaee94f99 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:58.318951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d42090eb-1016-47f4-a502-c76eaee94f99 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:58.328929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d42090eb-1016-47f4-a502-c76eaee94f99 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:58.329481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d42090eb-1016-47f4-a502-c76eaee94f99 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:58.329941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d42090eb-1016-47f4-a502-c76eaee94f99 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:58.330899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d42090eb-1016-47f4-a502-c76eaee94f99 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:58.331409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d42090eb-1016-47f4-a502-c76eaee94f99 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:58.331831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d42090eb-1016-47f4-a502-c76eaee94f99 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:58.555003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d42090eb-1016-47f4-a502-c76eaee94f99 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:58.571970 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d42090eb-1016-47f4-a502-c76eaee94f99 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1569 microversion: 2.1 time: 0.265195 Aug 09 15:10:58.573381 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3024/6056] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:58 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1569 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:58.929340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-23ac6be0-2259-4c97-a5b3-6a5731a61b6d req-8dd1f143-14bb-41f2-a132-266fdfc208cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "729b22ab-4269-4135-aca0-2603ca95b46c", "name": "network-vif-deleted", "tag": "ad452073-9418-4262-96fa-79ef15d5ad1b"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:10:58.953642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-23ac6be0-2259-4c97-a5b3-6a5731a61b6d req-8dd1f143-14bb-41f2-a132-266fdfc208cb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:58.954145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-23ac6be0-2259-4c97-a5b3-6a5731a61b6d req-8dd1f143-14bb-41f2-a132-266fdfc208cb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:58.954762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-23ac6be0-2259-4c97-a5b3-6a5731a61b6d req-8dd1f143-14bb-41f2-a132-266fdfc208cb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:58.977936 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-23ac6be0-2259-4c97-a5b3-6a5731a61b6d req-8dd1f143-14bb-41f2-a132-266fdfc208cb service nova] Creating event network-vif-deleted:ad452073-9418-4262-96fa-79ef15d5ad1b for instance 729b22ab-4269-4135-aca0-2603ca95b46c on n-h1-844626-8 Aug 09 15:10:58.983642 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-23ac6be0-2259-4c97-a5b3-6a5731a61b6d req-8dd1f143-14bb-41f2-a132-266fdfc208cb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061207 Aug 09 15:10:58.984543 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3033/6057] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:10:59.239705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5193675b-65d7-4a28-af9b-3bed0359b682 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:59.240347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5193675b-65d7-4a28-af9b-3bed0359b682 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:59.255471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5193675b-65d7-4a28-af9b-3bed0359b682 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:59.256590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5193675b-65d7-4a28-af9b-3bed0359b682 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:59.257316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5193675b-65d7-4a28-af9b-3bed0359b682 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:59.259266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5193675b-65d7-4a28-af9b-3bed0359b682 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:59.259977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5193675b-65d7-4a28-af9b-3bed0359b682 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:59.260601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5193675b-65d7-4a28-af9b-3bed0359b682 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:59.301848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-12473d97-287b-4fdc-8f24-b0a9c24ac5a8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:59.302739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-12473d97-287b-4fdc-8f24-b0a9c24ac5a8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:59.320929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12473d97-287b-4fdc-8f24-b0a9c24ac5a8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:59.322462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12473d97-287b-4fdc-8f24-b0a9c24ac5a8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:59.324449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12473d97-287b-4fdc-8f24-b0a9c24ac5a8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:59.328852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12473d97-287b-4fdc-8f24-b0a9c24ac5a8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:59.329531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12473d97-287b-4fdc-8f24-b0a9c24ac5a8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:59.330145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12473d97-287b-4fdc-8f24-b0a9c24ac5a8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:59.649189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5193675b-65d7-4a28-af9b-3bed0359b682 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:59.657184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-12473d97-287b-4fdc-8f24-b0a9c24ac5a8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:59.659959 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5193675b-65d7-4a28-af9b-3bed0359b682 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.429505 Aug 09 15:10:59.662506 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3025/6058] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:59 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:59.667999 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-12473d97-287b-4fdc-8f24-b0a9c24ac5a8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1427 microversion: 2.1 time: 0.372226 Aug 09 15:10:59.668604 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3034/6059] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:59 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1427 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:10:59.670006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-18042b2d-3b7d-4e57-bf79-b7fee4570a93 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:10:59.670841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-18042b2d-3b7d-4e57-bf79-b7fee4570a93 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:10:59.680891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18042b2d-3b7d-4e57-bf79-b7fee4570a93 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:59.681469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18042b2d-3b7d-4e57-bf79-b7fee4570a93 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:59.681922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18042b2d-3b7d-4e57-bf79-b7fee4570a93 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:59.682870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18042b2d-3b7d-4e57-bf79-b7fee4570a93 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:10:59.683530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18042b2d-3b7d-4e57-bf79-b7fee4570a93 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:10:59.684127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18042b2d-3b7d-4e57-bf79-b7fee4570a93 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:10:59.765128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-18042b2d-3b7d-4e57-bf79-b7fee4570a93 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:10:59.773897 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-18042b2d-3b7d-4e57-bf79-b7fee4570a93 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1360 microversion: 2.1 time: 0.109691 Aug 09 15:10:59.782749 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3026/6060] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:10:59 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1360 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:00.066505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-777112d7-9620-4097-b756-e78bbc8452a4 req-264e7c0a-4242-48ee-9ac2-1b2bdda375dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3b597c-be37-40c7-a923-a5226b648d0a", "tag": "84a79531-1c02-4a2e-8891-f26a5521ffc4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:00.089847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-777112d7-9620-4097-b756-e78bbc8452a4 req-264e7c0a-4242-48ee-9ac2-1b2bdda375dc service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:00.090605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-777112d7-9620-4097-b756-e78bbc8452a4 req-264e7c0a-4242-48ee-9ac2-1b2bdda375dc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:00.091212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-777112d7-9620-4097-b756-e78bbc8452a4 req-264e7c0a-4242-48ee-9ac2-1b2bdda375dc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:00.108793 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-777112d7-9620-4097-b756-e78bbc8452a4 req-264e7c0a-4242-48ee-9ac2-1b2bdda375dc service nova] Creating event network-changed:84a79531-1c02-4a2e-8891-f26a5521ffc4 for instance 3e3b597c-be37-40c7-a923-a5226b648d0a on n-h2-844626-8 Aug 09 15:11:00.118482 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-777112d7-9620-4097-b756-e78bbc8452a4 req-264e7c0a-4242-48ee-9ac2-1b2bdda375dc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058256 Aug 09 15:11:00.123589 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3035/6061] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:00.685836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8132ae6-1d07-483f-b588-44482719a672 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:00.687447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b8132ae6-1d07-483f-b588-44482719a672 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:00.691214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3713b0cd-cc39-4e72-ae64-855534e93cb4 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:00.692959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3713b0cd-cc39-4e72-ae64-855534e93cb4 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:00.697289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8132ae6-1d07-483f-b588-44482719a672 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:00.698173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8132ae6-1d07-483f-b588-44482719a672 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:00.698899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8132ae6-1d07-483f-b588-44482719a672 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:00.700010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8132ae6-1d07-483f-b588-44482719a672 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:00.700633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8132ae6-1d07-483f-b588-44482719a672 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:00.701273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8132ae6-1d07-483f-b588-44482719a672 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:00.703363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3713b0cd-cc39-4e72-ae64-855534e93cb4 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:00.703872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3713b0cd-cc39-4e72-ae64-855534e93cb4 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:00.704674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3713b0cd-cc39-4e72-ae64-855534e93cb4 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:00.705868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3713b0cd-cc39-4e72-ae64-855534e93cb4 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:00.706480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3713b0cd-cc39-4e72-ae64-855534e93cb4 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:00.707246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3713b0cd-cc39-4e72-ae64-855534e93cb4 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:01.045950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8132ae6-1d07-483f-b588-44482719a672 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:01.048588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3713b0cd-cc39-4e72-ae64-855534e93cb4 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:01.056197 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8132ae6-1d07-483f-b588-44482719a672 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.375307 Aug 09 15:11:01.057192 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3027/6062] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:00 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:01.059630 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3713b0cd-cc39-4e72-ae64-855534e93cb4 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1427 microversion: 2.1 time: 0.373477 Aug 09 15:11:01.062277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-afe0c792-99bc-4e44-a219-b1c5c14e77ab tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:01.063105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-afe0c792-99bc-4e44-a219-b1c5c14e77ab tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:01.070994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afe0c792-99bc-4e44-a219-b1c5c14e77ab tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:01.071867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afe0c792-99bc-4e44-a219-b1c5c14e77ab tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:01.072463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afe0c792-99bc-4e44-a219-b1c5c14e77ab tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:01.073355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afe0c792-99bc-4e44-a219-b1c5c14e77ab tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:01.074037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afe0c792-99bc-4e44-a219-b1c5c14e77ab tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:01.074637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afe0c792-99bc-4e44-a219-b1c5c14e77ab tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:01.076249 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3036/6063] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:00 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1427 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:11:01.086992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-af7151f4-5b49-44e5-8979-03e164677c44 req-349c383e-885c-4bcd-b6dd-f34eb874df60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55473c24-f786-48cc-a7e3-7ccebeb3cf68", "tag": "5db7250f-e48a-4046-bfee-5bfb11fc4f94"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:01.104345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-af7151f4-5b49-44e5-8979-03e164677c44 req-349c383e-885c-4bcd-b6dd-f34eb874df60 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:01.105053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-af7151f4-5b49-44e5-8979-03e164677c44 req-349c383e-885c-4bcd-b6dd-f34eb874df60 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:01.105579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-af7151f4-5b49-44e5-8979-03e164677c44 req-349c383e-885c-4bcd-b6dd-f34eb874df60 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:01.123326 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-af7151f4-5b49-44e5-8979-03e164677c44 req-349c383e-885c-4bcd-b6dd-f34eb874df60 service nova] Creating event network-changed:5db7250f-e48a-4046-bfee-5bfb11fc4f94 for instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 on n-h1-844626-8 Aug 09 15:11:01.129502 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-af7151f4-5b49-44e5-8979-03e164677c44 req-349c383e-885c-4bcd-b6dd-f34eb874df60 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051448 Aug 09 15:11:01.130220 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3037/6064] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:01.171156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-afe0c792-99bc-4e44-a219-b1c5c14e77ab tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:01.181558 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-afe0c792-99bc-4e44-a219-b1c5c14e77ab tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1360 microversion: 2.1 time: 0.123142 Aug 09 15:11:01.182165 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3028/6065] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:01 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1360 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:02.078472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d25f351-2416-4657-974c-6cb118935fda tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:02.080022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d25f351-2416-4657-974c-6cb118935fda tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:02.083535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-da7e286f-ad00-463c-bee7-44c572b61d5b tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:02.084427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-da7e286f-ad00-463c-bee7-44c572b61d5b tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:02.086750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:02.088727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d25f351-2416-4657-974c-6cb118935fda tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:02.089403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d25f351-2416-4657-974c-6cb118935fda tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:02.090001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d25f351-2416-4657-974c-6cb118935fda tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:02.090869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d25f351-2416-4657-974c-6cb118935fda tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:02.091498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d25f351-2416-4657-974c-6cb118935fda tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:02.092088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d25f351-2416-4657-974c-6cb118935fda tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:02.101617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da7e286f-ad00-463c-bee7-44c572b61d5b tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:02.102223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da7e286f-ad00-463c-bee7-44c572b61d5b tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:02.107218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da7e286f-ad00-463c-bee7-44c572b61d5b tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:02.108390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da7e286f-ad00-463c-bee7-44c572b61d5b tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:02.109116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da7e286f-ad00-463c-bee7-44c572b61d5b tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:02.110348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da7e286f-ad00-463c-bee7-44c572b61d5b tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:02.323629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9d25f351-2416-4657-974c-6cb118935fda tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:02.342848 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d25f351-2416-4657-974c-6cb118935fda tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1532 microversion: 2.1 time: 0.267154 Aug 09 15:11:02.350604 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3038/6066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:02 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1532 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:02.356799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da7e286f-ad00-463c-bee7-44c572b61d5b tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:02.364782 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-da7e286f-ad00-463c-bee7-44c572b61d5b tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1427 microversion: 2.1 time: 0.285436 Aug 09 15:11:02.365379 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3029/6067] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:02 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1427 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:02.367520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-76f05e60-34e8-4f2a-b573-ef92daaa2d3b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:02.369806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-76f05e60-34e8-4f2a-b573-ef92daaa2d3b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:02.386066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f05e60-34e8-4f2a-b573-ef92daaa2d3b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:02.396118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f05e60-34e8-4f2a-b573-ef92daaa2d3b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:02.396673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f05e60-34e8-4f2a-b573-ef92daaa2d3b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:02.397524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f05e60-34e8-4f2a-b573-ef92daaa2d3b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:02.398051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f05e60-34e8-4f2a-b573-ef92daaa2d3b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:02.398541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-76f05e60-34e8-4f2a-b573-ef92daaa2d3b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:02.467947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-76f05e60-34e8-4f2a-b573-ef92daaa2d3b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:02.476534 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-76f05e60-34e8-4f2a-b573-ef92daaa2d3b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1360 microversion: 2.1 time: 0.124474 Aug 09 15:11:02.477147 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3039/6068] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:02 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1360 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:03.375284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e119c10c-8216-4759-8cf4-4ff5ccb78467 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:03.376376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e119c10c-8216-4759-8cf4-4ff5ccb78467 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:03.391837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0bf4268d-8244-400b-a1f1-ca94b4bdd03a tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:03.392673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0bf4268d-8244-400b-a1f1-ca94b4bdd03a tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:03.399442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e119c10c-8216-4759-8cf4-4ff5ccb78467 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:03.401234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e119c10c-8216-4759-8cf4-4ff5ccb78467 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:03.401843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e119c10c-8216-4759-8cf4-4ff5ccb78467 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:03.403881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e119c10c-8216-4759-8cf4-4ff5ccb78467 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:03.405415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bf4268d-8244-400b-a1f1-ca94b4bdd03a tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:03.406067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e119c10c-8216-4759-8cf4-4ff5ccb78467 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:03.406714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e119c10c-8216-4759-8cf4-4ff5ccb78467 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:03.408164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bf4268d-8244-400b-a1f1-ca94b4bdd03a tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:03.409304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bf4268d-8244-400b-a1f1-ca94b4bdd03a tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:03.410109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bf4268d-8244-400b-a1f1-ca94b4bdd03a tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:03.411867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bf4268d-8244-400b-a1f1-ca94b4bdd03a tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:03.414719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0bf4268d-8244-400b-a1f1-ca94b4bdd03a tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:03.656085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e119c10c-8216-4759-8cf4-4ff5ccb78467 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:03.669517 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e119c10c-8216-4759-8cf4-4ff5ccb78467 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1532 microversion: 2.1 time: 0.299955 Aug 09 15:11:03.670561 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3030/6069] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:03 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1532 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:03.677098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-216327ac-3fda-4138-812e-8124ca5839d7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:03.677880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-216327ac-3fda-4138-812e-8124ca5839d7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:03.686327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-216327ac-3fda-4138-812e-8124ca5839d7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:03.687072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-216327ac-3fda-4138-812e-8124ca5839d7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:03.687762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-216327ac-3fda-4138-812e-8124ca5839d7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:03.689024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-216327ac-3fda-4138-812e-8124ca5839d7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:03.690019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-216327ac-3fda-4138-812e-8124ca5839d7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:03.690776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-216327ac-3fda-4138-812e-8124ca5839d7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:03.765054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0bf4268d-8244-400b-a1f1-ca94b4bdd03a tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:03.774960 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0bf4268d-8244-400b-a1f1-ca94b4bdd03a tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1427 microversion: 2.1 time: 0.388018 Aug 09 15:11:03.777877 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3040/6070] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:03 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1427 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:03.784424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-216327ac-3fda-4138-812e-8124ca5839d7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:03.793513 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-216327ac-3fda-4138-812e-8124ca5839d7 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 200 len: 1360 microversion: 2.1 time: 0.121536 Aug 09 15:11:03.794045 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3031/6071] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:03 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 1360 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:04.296378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-7c52823c-e1a0-4c10-9ab9-e059c4bcfb5e req-b8ecc5c4-1a20-476d-852d-47404275a13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55473c24-f786-48cc-a7e3-7ccebeb3cf68", "name": "network-vif-plugged", "status": "completed", "tag": "5db7250f-e48a-4046-bfee-5bfb11fc4f94"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:04.331587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7c52823c-e1a0-4c10-9ab9-e059c4bcfb5e req-b8ecc5c4-1a20-476d-852d-47404275a13e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:04.332395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7c52823c-e1a0-4c10-9ab9-e059c4bcfb5e req-b8ecc5c4-1a20-476d-852d-47404275a13e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:04.333199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7c52823c-e1a0-4c10-9ab9-e059c4bcfb5e req-b8ecc5c4-1a20-476d-852d-47404275a13e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:04.366397 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-7c52823c-e1a0-4c10-9ab9-e059c4bcfb5e req-b8ecc5c4-1a20-476d-852d-47404275a13e service nova] Creating event network-vif-plugged:5db7250f-e48a-4046-bfee-5bfb11fc4f94 for instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 on n-h1-844626-8 Aug 09 15:11:04.377295 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-7c52823c-e1a0-4c10-9ab9-e059c4bcfb5e req-b8ecc5c4-1a20-476d-852d-47404275a13e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091497 Aug 09 15:11:04.380573 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3041/6072] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:04.694134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c7a65a6-1e91-4783-ba06-d6e78a01e20e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:04.695488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c7a65a6-1e91-4783-ba06-d6e78a01e20e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:04.702085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:04.703165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=28 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:04.706300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c7a65a6-1e91-4783-ba06-d6e78a01e20e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:04.707884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c7a65a6-1e91-4783-ba06-d6e78a01e20e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:04.708569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c7a65a6-1e91-4783-ba06-d6e78a01e20e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:04.709707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c7a65a6-1e91-4783-ba06-d6e78a01e20e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:04.710348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c7a65a6-1e91-4783-ba06-d6e78a01e20e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:04.710954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c7a65a6-1e91-4783-ba06-d6e78a01e20e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:04.799335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-111e101e-d6dc-48d2-9867-23794b88842d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:04.800048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-111e101e-d6dc-48d2-9867-23794b88842d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:04.817269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-111e101e-d6dc-48d2-9867-23794b88842d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:04.818132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-111e101e-d6dc-48d2-9867-23794b88842d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:04.818726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-111e101e-d6dc-48d2-9867-23794b88842d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:04.819995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-111e101e-d6dc-48d2-9867-23794b88842d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:04.820612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-111e101e-d6dc-48d2-9867-23794b88842d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:04.821192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-111e101e-d6dc-48d2-9867-23794b88842d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:05.353961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c7a65a6-1e91-4783-ba06-d6e78a01e20e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:05.370515 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c7a65a6-1e91-4783-ba06-d6e78a01e20e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1527 microversion: 2.1 time: 0.680322 Aug 09 15:11:05.372186 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3032/6073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:04 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1527 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:05.377883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-604a3fda-ea67-4d7c-a9c2-042991f7632f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:05.378775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-604a3fda-ea67-4d7c-a9c2-042991f7632f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:05.386097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-604a3fda-ea67-4d7c-a9c2-042991f7632f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:05.386748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-604a3fda-ea67-4d7c-a9c2-042991f7632f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:05.388542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-604a3fda-ea67-4d7c-a9c2-042991f7632f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:05.392340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-604a3fda-ea67-4d7c-a9c2-042991f7632f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:05.393208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-604a3fda-ea67-4d7c-a9c2-042991f7632f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:05.393765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-604a3fda-ea67-4d7c-a9c2-042991f7632f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:05.426766 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-604a3fda-ea67-4d7c-a9c2-042991f7632f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-604a3fda-ea67-4d7c-a9c2-042991f7632f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c HTTP/1.1 Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '729b22ab-4269-4135-aca0-2603ca95b46c'} Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:05.428834 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:05.434476 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:05.434476 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:05.434476 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:05.434476 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:05.434476 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:05.434476 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:05.434476 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:05.435127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-604a3fda-ea67-4d7c-a9c2-042991f7632f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:05.436273 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-604a3fda-ea67-4d7c-a9c2-042991f7632f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 404 len: 111 microversion: 2.1 time: 0.062671 Aug 09 15:11:05.440918 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3033/6074] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:05 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:11:05.443104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-111e101e-d6dc-48d2-9867-23794b88842d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:05.454662 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-111e101e-d6dc-48d2-9867-23794b88842d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1427 microversion: 2.1 time: 0.660028 Aug 09 15:11:05.456540 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3042/6075] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:04 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1427 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:11:06.394723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f57e35ab-6479-4391-a1f3-89c6df803fee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:06.395284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f57e35ab-6479-4391-a1f3-89c6df803fee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:06.404551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f57e35ab-6479-4391-a1f3-89c6df803fee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:06.405044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f57e35ab-6479-4391-a1f3-89c6df803fee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:06.405485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f57e35ab-6479-4391-a1f3-89c6df803fee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:06.406511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f57e35ab-6479-4391-a1f3-89c6df803fee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:06.407151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f57e35ab-6479-4391-a1f3-89c6df803fee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:06.407723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f57e35ab-6479-4391-a1f3-89c6df803fee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:06.416580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a5185293-0ef1-41e6-ba65-8e3e8d6d9cdd req-a3135f17-8054-4bbc-86af-32d28e308128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45050cee-c0fb-4f05-a875-a43d4b834957", "name": "network-vif-plugged", "status": "completed", "tag": "d4da00d3-9767-424e-b34c-366c17cf1305"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:06.439356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a5185293-0ef1-41e6-ba65-8e3e8d6d9cdd req-a3135f17-8054-4bbc-86af-32d28e308128 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:06.440110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a5185293-0ef1-41e6-ba65-8e3e8d6d9cdd req-a3135f17-8054-4bbc-86af-32d28e308128 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:06.441385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a5185293-0ef1-41e6-ba65-8e3e8d6d9cdd req-a3135f17-8054-4bbc-86af-32d28e308128 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:06.479549 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a5185293-0ef1-41e6-ba65-8e3e8d6d9cdd req-a3135f17-8054-4bbc-86af-32d28e308128 service nova] Creating event network-vif-plugged:d4da00d3-9767-424e-b34c-366c17cf1305 for instance 45050cee-c0fb-4f05-a875-a43d4b834957 on n-h2-844626-8 Aug 09 15:11:06.491303 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a5185293-0ef1-41e6-ba65-8e3e8d6d9cdd req-a3135f17-8054-4bbc-86af-32d28e308128 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079901 Aug 09 15:11:06.494403 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3043/6076] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:06.507025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9110a4f0-d822-4ce8-b5cc-21036e5bd56d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:06.508126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9110a4f0-d822-4ce8-b5cc-21036e5bd56d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:06.520520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9110a4f0-d822-4ce8-b5cc-21036e5bd56d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:06.540581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9110a4f0-d822-4ce8-b5cc-21036e5bd56d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:06.542627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9110a4f0-d822-4ce8-b5cc-21036e5bd56d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:06.546922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9110a4f0-d822-4ce8-b5cc-21036e5bd56d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:06.547747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9110a4f0-d822-4ce8-b5cc-21036e5bd56d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:06.548280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9110a4f0-d822-4ce8-b5cc-21036e5bd56d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:06.656357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f57e35ab-6479-4391-a1f3-89c6df803fee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:06.666577 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f57e35ab-6479-4391-a1f3-89c6df803fee tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1527 microversion: 2.1 time: 0.275645 Aug 09 15:11:06.676004 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3034/6077] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:06 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1527 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:06.747944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9110a4f0-d822-4ce8-b5cc-21036e5bd56d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:06.758488 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9110a4f0-d822-4ce8-b5cc-21036e5bd56d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1607 microversion: 2.1 time: 0.262022 Aug 09 15:11:06.759542 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3044/6078] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:06 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1607 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:06.779938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d09323f6-bada-44f1-8850-a4538bada5af tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:06.780680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d09323f6-bada-44f1-8850-a4538bada5af tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:06.782842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:06.793706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d09323f6-bada-44f1-8850-a4538bada5af tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:06.794773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d09323f6-bada-44f1-8850-a4538bada5af tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:06.795557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d09323f6-bada-44f1-8850-a4538bada5af tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:06.796624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d09323f6-bada-44f1-8850-a4538bada5af tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:06.797336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d09323f6-bada-44f1-8850-a4538bada5af tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:06.800645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d09323f6-bada-44f1-8850-a4538bada5af tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:07.002944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d09323f6-bada-44f1-8850-a4538bada5af tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:07.023348 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d09323f6-bada-44f1-8850-a4538bada5af tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1607 microversion: 2.1 time: 0.247518 Aug 09 15:11:07.035128 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3035/6079] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:06 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1607 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:11:07.044519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3f7a12d4-f637-49e6-8327-ec0fdce3b32e tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:07.045141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3f7a12d4-f637-49e6-8327-ec0fdce3b32e tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:07.051582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f7a12d4-f637-49e6-8327-ec0fdce3b32e tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:07.052077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f7a12d4-f637-49e6-8327-ec0fdce3b32e tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:07.052507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f7a12d4-f637-49e6-8327-ec0fdce3b32e tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:07.053208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f7a12d4-f637-49e6-8327-ec0fdce3b32e tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:07.053667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f7a12d4-f637-49e6-8327-ec0fdce3b32e tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:07.054108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f7a12d4-f637-49e6-8327-ec0fdce3b32e tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:07.247481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3f7a12d4-f637-49e6-8327-ec0fdce3b32e tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:07.256925 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3f7a12d4-f637-49e6-8327-ec0fdce3b32e tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1607 microversion: 2.1 time: 0.216392 Aug 09 15:11:07.258022 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3045/6080] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:07 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1607 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:07.698064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-458b74df-8b5c-4892-b9e0-28340ba7825d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:07.698838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-458b74df-8b5c-4892-b9e0-28340ba7825d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:07.708752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-458b74df-8b5c-4892-b9e0-28340ba7825d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:07.709268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-458b74df-8b5c-4892-b9e0-28340ba7825d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:07.709730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-458b74df-8b5c-4892-b9e0-28340ba7825d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:07.710486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-458b74df-8b5c-4892-b9e0-28340ba7825d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:07.714647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-458b74df-8b5c-4892-b9e0-28340ba7825d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:07.718428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-458b74df-8b5c-4892-b9e0-28340ba7825d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:08.069016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-458b74df-8b5c-4892-b9e0-28340ba7825d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:08.077998 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-458b74df-8b5c-4892-b9e0-28340ba7825d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1527 microversion: 2.1 time: 0.384285 Aug 09 15:11:08.081354 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3036/6081] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:07 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1527 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:09.106319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b1ec20a7-91ad-49af-9a51-23fc53ec0188 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:09.107957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b1ec20a7-91ad-49af-9a51-23fc53ec0188 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:09.135949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ec20a7-91ad-49af-9a51-23fc53ec0188 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:09.140554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ec20a7-91ad-49af-9a51-23fc53ec0188 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:09.141461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ec20a7-91ad-49af-9a51-23fc53ec0188 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:09.142434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ec20a7-91ad-49af-9a51-23fc53ec0188 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:09.143120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ec20a7-91ad-49af-9a51-23fc53ec0188 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:09.143745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1ec20a7-91ad-49af-9a51-23fc53ec0188 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:09.511789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b1ec20a7-91ad-49af-9a51-23fc53ec0188 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:09.522496 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b1ec20a7-91ad-49af-9a51-23fc53ec0188 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1527 microversion: 2.1 time: 0.420054 Aug 09 15:11:09.524153 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3046/6082] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:09 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1527 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:09.872051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8d4eb606-1984-4054-8895-91cfae176ad8 req-039c154a-e5f5-486a-ba9a-e426584dc4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55473c24-f786-48cc-a7e3-7ccebeb3cf68", "tag": "5db7250f-e48a-4046-bfee-5bfb11fc4f94"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:09.891384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2d86896-1c3c-4a66-9e3a-d9e90d47167d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:09.892264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d2d86896-1c3c-4a66-9e3a-d9e90d47167d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:09.901821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2d86896-1c3c-4a66-9e3a-d9e90d47167d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:09.903190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8d4eb606-1984-4054-8895-91cfae176ad8 req-039c154a-e5f5-486a-ba9a-e426584dc4e8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:09.904067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2d86896-1c3c-4a66-9e3a-d9e90d47167d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:09.904778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8d4eb606-1984-4054-8895-91cfae176ad8 req-039c154a-e5f5-486a-ba9a-e426584dc4e8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:09.905424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2d86896-1c3c-4a66-9e3a-d9e90d47167d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:09.906118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8d4eb606-1984-4054-8895-91cfae176ad8 req-039c154a-e5f5-486a-ba9a-e426584dc4e8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:09.907129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2d86896-1c3c-4a66-9e3a-d9e90d47167d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:09.911804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2d86896-1c3c-4a66-9e3a-d9e90d47167d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:09.912570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2d86896-1c3c-4a66-9e3a-d9e90d47167d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:09.940681 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8d4eb606-1984-4054-8895-91cfae176ad8 req-039c154a-e5f5-486a-ba9a-e426584dc4e8 service nova] Creating event network-changed:5db7250f-e48a-4046-bfee-5bfb11fc4f94 for instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 on n-h1-844626-8 Aug 09 15:11:09.950219 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8d4eb606-1984-4054-8895-91cfae176ad8 req-039c154a-e5f5-486a-ba9a-e426584dc4e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082175 Aug 09 15:11:09.951753 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3037/6083] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:09.962087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d2d86896-1c3c-4a66-9e3a-d9e90d47167d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:11:10.119572 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d2d86896-1c3c-4a66-9e3a-d9e90d47167d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 204 len: 0 microversion: 2.1 time: 0.230948 Aug 09 15:11:10.121439 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3047/6084] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:11:09 2022] DELETE /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 15:11:10.130766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b37562d1-c562-415d-ac10-a6aa2dee7207 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:10.131771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b37562d1-c562-415d-ac10-a6aa2dee7207 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:10.145827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b37562d1-c562-415d-ac10-a6aa2dee7207 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:10.146438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b37562d1-c562-415d-ac10-a6aa2dee7207 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:10.147702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b37562d1-c562-415d-ac10-a6aa2dee7207 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:10.149561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b37562d1-c562-415d-ac10-a6aa2dee7207 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:10.150359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b37562d1-c562-415d-ac10-a6aa2dee7207 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:10.151534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b37562d1-c562-415d-ac10-a6aa2dee7207 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:10.373892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b37562d1-c562-415d-ac10-a6aa2dee7207 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:10.386783 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b37562d1-c562-415d-ac10-a6aa2dee7207 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1409 microversion: 2.1 time: 0.260266 Aug 09 15:11:10.399127 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3038/6085] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:10 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1409 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:10.545570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7a9da0f8-02b3-4ff7-abc1-b93062f7dcdd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:10.546450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7a9da0f8-02b3-4ff7-abc1-b93062f7dcdd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:10.558281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9da0f8-02b3-4ff7-abc1-b93062f7dcdd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:10.564900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9da0f8-02b3-4ff7-abc1-b93062f7dcdd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:10.565685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9da0f8-02b3-4ff7-abc1-b93062f7dcdd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:10.566639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9da0f8-02b3-4ff7-abc1-b93062f7dcdd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:10.567514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9da0f8-02b3-4ff7-abc1-b93062f7dcdd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:10.568022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7a9da0f8-02b3-4ff7-abc1-b93062f7dcdd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:10.798262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7a9da0f8-02b3-4ff7-abc1-b93062f7dcdd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:10.808429 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7a9da0f8-02b3-4ff7-abc1-b93062f7dcdd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1527 microversion: 2.1 time: 0.267453 Aug 09 15:11:10.809568 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3048/6086] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:10 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1527 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:11.414444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1dc6ab24-df2b-46b9-9a54-dad00d423bb6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:11.416374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1dc6ab24-df2b-46b9-9a54-dad00d423bb6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:11.436371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc6ab24-df2b-46b9-9a54-dad00d423bb6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:11.437064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc6ab24-df2b-46b9-9a54-dad00d423bb6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:11.437485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc6ab24-df2b-46b9-9a54-dad00d423bb6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:11.438212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc6ab24-df2b-46b9-9a54-dad00d423bb6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:11.438677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc6ab24-df2b-46b9-9a54-dad00d423bb6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:11.439136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1dc6ab24-df2b-46b9-9a54-dad00d423bb6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:11.613302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1dc6ab24-df2b-46b9-9a54-dad00d423bb6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:11.626376 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1dc6ab24-df2b-46b9-9a54-dad00d423bb6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1409 microversion: 2.1 time: 0.220108 Aug 09 15:11:11.627043 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3039/6087] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:11 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1409 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:11.831290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5762e787-5b44-43b3-84d5-f233fa0a3f21 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:11.831902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5762e787-5b44-43b3-84d5-f233fa0a3f21 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:11.840836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5762e787-5b44-43b3-84d5-f233fa0a3f21 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:11.841336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5762e787-5b44-43b3-84d5-f233fa0a3f21 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:11.841785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5762e787-5b44-43b3-84d5-f233fa0a3f21 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:11.842795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5762e787-5b44-43b3-84d5-f233fa0a3f21 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:11.843605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5762e787-5b44-43b3-84d5-f233fa0a3f21 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:11.844312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5762e787-5b44-43b3-84d5-f233fa0a3f21 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:11.863183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-caa09c61-ce2f-471f-9309-3661ae0f1227 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:11.864138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:11.866208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-caa09c61-ce2f-471f-9309-3661ae0f1227 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:11.874659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caa09c61-ce2f-471f-9309-3661ae0f1227 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:11.875677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caa09c61-ce2f-471f-9309-3661ae0f1227 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:11.876404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caa09c61-ce2f-471f-9309-3661ae0f1227 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:11.877553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caa09c61-ce2f-471f-9309-3661ae0f1227 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:11.878259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caa09c61-ce2f-471f-9309-3661ae0f1227 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:11.878921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caa09c61-ce2f-471f-9309-3661ae0f1227 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:11.943226 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-caa09c61-ce2f-471f-9309-3661ae0f1227 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc/action" status: 200 len: 24575 microversion: 2.1 time: 0.084411 Aug 09 15:11:11.944844 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3040/6088] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:11 2022] POST /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc/action => generated 24575 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:11:12.032686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5762e787-5b44-43b3-84d5-f233fa0a3f21 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:12.040784 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5762e787-5b44-43b3-84d5-f233fa0a3f21 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1527 microversion: 2.1 time: 0.214662 Aug 09 15:11:12.054791 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3049/6089] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:11 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1527 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:12.618595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-a7906fa7-5a3b-433d-9335-0410843a8c52 req-765247f9-a638-4778-82d6-6b5c0cce25d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e", "name": "network-vif-deleted", "tag": "20b724ce-5a2a-405e-aeb2-48c469b3dbaa"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:12.643594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a7906fa7-5a3b-433d-9335-0410843a8c52 req-765247f9-a638-4778-82d6-6b5c0cce25d8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:12.644433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a7906fa7-5a3b-433d-9335-0410843a8c52 req-765247f9-a638-4778-82d6-6b5c0cce25d8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:12.645063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-a7906fa7-5a3b-433d-9335-0410843a8c52 req-765247f9-a638-4778-82d6-6b5c0cce25d8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:12.649175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28d27df8-0884-415f-a545-194748bc50bc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:12.650243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28d27df8-0884-415f-a545-194748bc50bc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:12.661038 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-a7906fa7-5a3b-433d-9335-0410843a8c52 req-765247f9-a638-4778-82d6-6b5c0cce25d8 service nova] Creating event network-vif-deleted:20b724ce-5a2a-405e-aeb2-48c469b3dbaa for instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e on n-h2-844626-8 Aug 09 15:11:12.662741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28d27df8-0884-415f-a545-194748bc50bc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:12.663270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28d27df8-0884-415f-a545-194748bc50bc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:12.666910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28d27df8-0884-415f-a545-194748bc50bc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:12.667341 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-a7906fa7-5a3b-433d-9335-0410843a8c52 req-765247f9-a638-4778-82d6-6b5c0cce25d8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052754 Aug 09 15:11:12.667832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28d27df8-0884-415f-a545-194748bc50bc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:12.667956 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3041/6090] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:12.668342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28d27df8-0884-415f-a545-194748bc50bc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:12.668772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28d27df8-0884-415f-a545-194748bc50bc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:12.758709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-28d27df8-0884-415f-a545-194748bc50bc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:12.768044 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28d27df8-0884-415f-a545-194748bc50bc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1201 microversion: 2.1 time: 0.123933 Aug 09 15:11:12.768662 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3050/6091] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:12 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1201 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:11:13.063457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f65c51dc-cf72-4670-bc4f-7c05cd396345 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:13.064178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f65c51dc-cf72-4670-bc4f-7c05cd396345 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:13.083288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f65c51dc-cf72-4670-bc4f-7c05cd396345 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:13.086212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f65c51dc-cf72-4670-bc4f-7c05cd396345 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:13.086786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f65c51dc-cf72-4670-bc4f-7c05cd396345 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:13.087666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f65c51dc-cf72-4670-bc4f-7c05cd396345 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:13.088148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f65c51dc-cf72-4670-bc4f-7c05cd396345 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:13.090157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f65c51dc-cf72-4670-bc4f-7c05cd396345 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:13.296557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f65c51dc-cf72-4670-bc4f-7c05cd396345 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:13.308213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:13.314540 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f65c51dc-cf72-4670-bc4f-7c05cd396345 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1527 microversion: 2.1 time: 0.255386 Aug 09 15:11:13.334910 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3042/6092] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:13 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1527 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:13.790818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8ba35242-287f-4aeb-9522-61d5554f5c78 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:13.791786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8ba35242-287f-4aeb-9522-61d5554f5c78 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:13.804085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ba35242-287f-4aeb-9522-61d5554f5c78 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:13.805116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ba35242-287f-4aeb-9522-61d5554f5c78 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:13.806267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ba35242-287f-4aeb-9522-61d5554f5c78 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:13.807314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ba35242-287f-4aeb-9522-61d5554f5c78 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:13.807946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ba35242-287f-4aeb-9522-61d5554f5c78 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:13.808534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ba35242-287f-4aeb-9522-61d5554f5c78 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:13.913320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8ba35242-287f-4aeb-9522-61d5554f5c78 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:13.922986 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8ba35242-287f-4aeb-9522-61d5554f5c78 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1201 microversion: 2.1 time: 0.136556 Aug 09 15:11:13.936990 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3051/6093] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:13 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1201 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:14.341302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca3e65c0-3c6a-439a-b128-abf893f63373 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:14.342658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca3e65c0-3c6a-439a-b128-abf893f63373 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:14.350631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca3e65c0-3c6a-439a-b128-abf893f63373 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:14.351128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca3e65c0-3c6a-439a-b128-abf893f63373 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:14.351593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca3e65c0-3c6a-439a-b128-abf893f63373 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:14.352429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca3e65c0-3c6a-439a-b128-abf893f63373 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:14.352880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca3e65c0-3c6a-439a-b128-abf893f63373 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:14.353489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca3e65c0-3c6a-439a-b128-abf893f63373 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:14.534556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca3e65c0-3c6a-439a-b128-abf893f63373 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:14.545665 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca3e65c0-3c6a-439a-b128-abf893f63373 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1527 microversion: 2.1 time: 0.208517 Aug 09 15:11:14.546845 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3043/6094] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:14 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1527 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:14.944186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-592c1a33-3e6a-4df0-958f-18261e2c512d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:14.945548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-592c1a33-3e6a-4df0-958f-18261e2c512d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:14.953085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-592c1a33-3e6a-4df0-958f-18261e2c512d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:14.953823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-592c1a33-3e6a-4df0-958f-18261e2c512d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:14.954420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-592c1a33-3e6a-4df0-958f-18261e2c512d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:14.955308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-592c1a33-3e6a-4df0-958f-18261e2c512d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:14.955929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-592c1a33-3e6a-4df0-958f-18261e2c512d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:14.956502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-592c1a33-3e6a-4df0-958f-18261e2c512d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:15.026629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-592c1a33-3e6a-4df0-958f-18261e2c512d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:15.038052 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-592c1a33-3e6a-4df0-958f-18261e2c512d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1201 microversion: 2.1 time: 0.097364 Aug 09 15:11:15.039580 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3052/6095] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:14 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1201 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:15.570813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6befa4a8-b65e-4e2f-b129-e49c1c5e79b8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:15.571484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6befa4a8-b65e-4e2f-b129-e49c1c5e79b8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:15.579335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6befa4a8-b65e-4e2f-b129-e49c1c5e79b8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:15.579836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6befa4a8-b65e-4e2f-b129-e49c1c5e79b8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:15.580293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6befa4a8-b65e-4e2f-b129-e49c1c5e79b8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:15.581040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6befa4a8-b65e-4e2f-b129-e49c1c5e79b8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:15.581529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6befa4a8-b65e-4e2f-b129-e49c1c5e79b8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:15.582004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6befa4a8-b65e-4e2f-b129-e49c1c5e79b8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:15.743334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6befa4a8-b65e-4e2f-b129-e49c1c5e79b8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:15.753274 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6befa4a8-b65e-4e2f-b129-e49c1c5e79b8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1527 microversion: 2.1 time: 0.186272 Aug 09 15:11:15.763265 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3044/6096] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:15 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1527 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:16.060442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8fa2afe-38c1-4fda-8b07-532ca10eb5f3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:16.061779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c8fa2afe-38c1-4fda-8b07-532ca10eb5f3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:16.077328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8fa2afe-38c1-4fda-8b07-532ca10eb5f3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:16.078006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8fa2afe-38c1-4fda-8b07-532ca10eb5f3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:16.078454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8fa2afe-38c1-4fda-8b07-532ca10eb5f3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:16.079248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8fa2afe-38c1-4fda-8b07-532ca10eb5f3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:16.079722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8fa2afe-38c1-4fda-8b07-532ca10eb5f3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:16.080155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8fa2afe-38c1-4fda-8b07-532ca10eb5f3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:16.158011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c8fa2afe-38c1-4fda-8b07-532ca10eb5f3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:16.170250 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8fa2afe-38c1-4fda-8b07-532ca10eb5f3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1201 microversion: 2.1 time: 0.113738 Aug 09 15:11:16.171581 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3053/6097] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:16 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1201 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:16.775302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19f8e54d-6aeb-499f-b6f9-2374f1e923e8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:16.775936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-19f8e54d-6aeb-499f-b6f9-2374f1e923e8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:16.783854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19f8e54d-6aeb-499f-b6f9-2374f1e923e8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:16.784368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19f8e54d-6aeb-499f-b6f9-2374f1e923e8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:16.784857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19f8e54d-6aeb-499f-b6f9-2374f1e923e8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:16.785569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19f8e54d-6aeb-499f-b6f9-2374f1e923e8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:16.786049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19f8e54d-6aeb-499f-b6f9-2374f1e923e8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:16.786480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19f8e54d-6aeb-499f-b6f9-2374f1e923e8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:16.927515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-19f8e54d-6aeb-499f-b6f9-2374f1e923e8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:16.935872 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-19f8e54d-6aeb-499f-b6f9-2374f1e923e8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1509 microversion: 2.1 time: 0.164577 Aug 09 15:11:16.936601 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3045/6098] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:16 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:17.191963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d8a5c08a-850f-4eb8-aeee-9cf0b4ba8a26 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:17.192548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d8a5c08a-850f-4eb8-aeee-9cf0b4ba8a26 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:17.200054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8a5c08a-850f-4eb8-aeee-9cf0b4ba8a26 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:17.200575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8a5c08a-850f-4eb8-aeee-9cf0b4ba8a26 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:17.201008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8a5c08a-850f-4eb8-aeee-9cf0b4ba8a26 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:17.201712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8a5c08a-850f-4eb8-aeee-9cf0b4ba8a26 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:17.202172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8a5c08a-850f-4eb8-aeee-9cf0b4ba8a26 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:17.202593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d8a5c08a-850f-4eb8-aeee-9cf0b4ba8a26 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:17.278360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d8a5c08a-850f-4eb8-aeee-9cf0b4ba8a26 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:17.286842 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d8a5c08a-850f-4eb8-aeee-9cf0b4ba8a26 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1201 microversion: 2.1 time: 0.098610 Aug 09 15:11:17.287414 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3054/6099] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:17 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1201 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:17.958439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-efc8bbf8-67c5-43ca-8daa-55c7a9b78112 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:17.959065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-efc8bbf8-67c5-43ca-8daa-55c7a9b78112 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:17.967214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efc8bbf8-67c5-43ca-8daa-55c7a9b78112 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:17.967678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efc8bbf8-67c5-43ca-8daa-55c7a9b78112 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:17.968289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efc8bbf8-67c5-43ca-8daa-55c7a9b78112 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:17.969027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efc8bbf8-67c5-43ca-8daa-55c7a9b78112 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:17.969524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efc8bbf8-67c5-43ca-8daa-55c7a9b78112 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:17.969956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efc8bbf8-67c5-43ca-8daa-55c7a9b78112 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:18.111670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-efc8bbf8-67c5-43ca-8daa-55c7a9b78112 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:18.120329 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-efc8bbf8-67c5-43ca-8daa-55c7a9b78112 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1509 microversion: 2.1 time: 0.165740 Aug 09 15:11:18.120966 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3046/6100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:17 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:18.307672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:18.308251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:18.315979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:18.316471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:18.317673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:18.319416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:18.320136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:18.320797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:18.369720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:18.370301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:18.370845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:18.371392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lazy-loading 'fault' on Instance uuid 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:11:18.414375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:18.422663 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-26a9d91e-664a-4af9-9a05-0a929600e0a3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 200 len: 1206 microversion: 2.1 time: 0.119168 Aug 09 15:11:18.423335 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3055/6101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:18 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 1206 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:18.823312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-561f2a13-a3ff-4f33-b1ae-50eb3fc12ffe req-3a368b74-a024-4f13-9c3f-328b26faf728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45050cee-c0fb-4f05-a875-a43d4b834957", "name": "network-vif-unplugged", "status": "completed", "tag": "d4da00d3-9767-424e-b34c-366c17cf1305"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:18.839636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-561f2a13-a3ff-4f33-b1ae-50eb3fc12ffe req-3a368b74-a024-4f13-9c3f-328b26faf728 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:18.851569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-561f2a13-a3ff-4f33-b1ae-50eb3fc12ffe req-3a368b74-a024-4f13-9c3f-328b26faf728 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:18.852261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-561f2a13-a3ff-4f33-b1ae-50eb3fc12ffe req-3a368b74-a024-4f13-9c3f-328b26faf728 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:18.865151 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-561f2a13-a3ff-4f33-b1ae-50eb3fc12ffe req-3a368b74-a024-4f13-9c3f-328b26faf728 service nova] Creating event network-vif-unplugged:d4da00d3-9767-424e-b34c-366c17cf1305 for instance 45050cee-c0fb-4f05-a875-a43d4b834957 on n-h2-844626-8 Aug 09 15:11:18.875751 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-561f2a13-a3ff-4f33-b1ae-50eb3fc12ffe req-3a368b74-a024-4f13-9c3f-328b26faf728 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055995 Aug 09 15:11:18.877014 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3047/6102] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:19.143376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05e37874-9eb1-4099-8d0f-58e4a24728d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:19.144082 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05e37874-9eb1-4099-8d0f-58e4a24728d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:19.150945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e37874-9eb1-4099-8d0f-58e4a24728d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:19.151556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e37874-9eb1-4099-8d0f-58e4a24728d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:19.152022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e37874-9eb1-4099-8d0f-58e4a24728d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:19.152722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e37874-9eb1-4099-8d0f-58e4a24728d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:19.153179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e37874-9eb1-4099-8d0f-58e4a24728d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:19.153575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05e37874-9eb1-4099-8d0f-58e4a24728d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:19.298820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05e37874-9eb1-4099-8d0f-58e4a24728d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:19.307373 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05e37874-9eb1-4099-8d0f-58e4a24728d2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1452 microversion: 2.1 time: 0.168067 Aug 09 15:11:19.307967 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3056/6103] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:19 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:19.328426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-53ac1f57-9ba5-4a71-8c50-5281ccca8e12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:19.329229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53ac1f57-9ba5-4a71-8c50-5281ccca8e12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:19.336869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53ac1f57-9ba5-4a71-8c50-5281ccca8e12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:19.337468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53ac1f57-9ba5-4a71-8c50-5281ccca8e12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:19.337918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53ac1f57-9ba5-4a71-8c50-5281ccca8e12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:19.338650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53ac1f57-9ba5-4a71-8c50-5281ccca8e12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:19.339372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53ac1f57-9ba5-4a71-8c50-5281ccca8e12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:19.339829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53ac1f57-9ba5-4a71-8c50-5281ccca8e12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:19.443547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ac3b52d-9b7e-4cf5-8cfe-3eab2545d2dc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:19.444636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4ac3b52d-9b7e-4cf5-8cfe-3eab2545d2dc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:19.451975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ac3b52d-9b7e-4cf5-8cfe-3eab2545d2dc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:19.452595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ac3b52d-9b7e-4cf5-8cfe-3eab2545d2dc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:19.456819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ac3b52d-9b7e-4cf5-8cfe-3eab2545d2dc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:19.457986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ac3b52d-9b7e-4cf5-8cfe-3eab2545d2dc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:19.458814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ac3b52d-9b7e-4cf5-8cfe-3eab2545d2dc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:19.461710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ac3b52d-9b7e-4cf5-8cfe-3eab2545d2dc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:19.480535 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-4ac3b52d-9b7e-4cf5-8cfe-3eab2545d2dc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ac3b52d-9b7e-4cf5-8cfe-3eab2545d2dc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e HTTP/1.1 Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e'} Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:19.482293 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:19.486505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:19.486505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:19.486505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:19.486505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:19.486505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:19.486505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:19.486505 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:19.486505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ac3b52d-9b7e-4cf5-8cfe-3eab2545d2dc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:19.487150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-53ac1f57-9ba5-4a71-8c50-5281ccca8e12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:19.489909 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4ac3b52d-9b7e-4cf5-8cfe-3eab2545d2dc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 404 len: 111 microversion: 2.1 time: 0.050053 Aug 09 15:11:19.490658 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3057/6104] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:19 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:11:19.495710 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-53ac1f57-9ba5-4a71-8c50-5281ccca8e12 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1452 microversion: 2.1 time: 0.171533 Aug 09 15:11:19.496573 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3048/6105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:19 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:19.545583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:19.546137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:19.552347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:19.552833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:19.553263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:19.553962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:19.554412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:19.554835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:19.579604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lazy-loading 'flavor' on Instance uuid 45050cee-c0fb-4f05-a875-a43d4b834957 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:11:19.592971 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Cannot 'shelve' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state shelved_offloaded Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action HTTP/1.1 Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 14 Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: {"shelve": {}} Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: exception: Cannot 'shelve' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state shelved_offloaded Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '45050cee-c0fb-4f05-a875-a43d4b834957', 'body': {'shelve': {}}} Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 09 15:11:19.594835 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state shelved_offloaded Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state shelved_offloaded Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 409 to user: Cannot 'shelve' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state shelved_offloaded {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b844eb2c-3400-4b43-86bb-d333be1374d6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 409 len: 155 microversion: 2.1 time: 0.054908 Aug 09 15:11:19.599551 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3058/6106] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:19 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 155 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 15:11:19.605499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dab6d0cd-5544-4a61-95c1-330d3466be6e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:19.606117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dab6d0cd-5544-4a61-95c1-330d3466be6e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:19.612339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab6d0cd-5544-4a61-95c1-330d3466be6e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:19.612841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab6d0cd-5544-4a61-95c1-330d3466be6e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:19.613290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab6d0cd-5544-4a61-95c1-330d3466be6e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:19.614002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab6d0cd-5544-4a61-95c1-330d3466be6e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:19.614465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab6d0cd-5544-4a61-95c1-330d3466be6e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:19.614899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dab6d0cd-5544-4a61-95c1-330d3466be6e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:19.657634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dab6d0cd-5544-4a61-95c1-330d3466be6e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119406) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 09 15:11:19.739938 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dab6d0cd-5544-4a61-95c1-330d3466be6e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 202 len: 0 microversion: 2.1 time: 0.138320 Aug 09 15:11:19.740642 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3049/6107] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:19 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:11:19.751556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-465ac0f1-aeb7-40d0-a0e5-96b9c519b7b9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:19.752182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-465ac0f1-aeb7-40d0-a0e5-96b9c519b7b9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:19.760124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-465ac0f1-aeb7-40d0-a0e5-96b9c519b7b9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:19.760752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-465ac0f1-aeb7-40d0-a0e5-96b9c519b7b9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:19.761199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-465ac0f1-aeb7-40d0-a0e5-96b9c519b7b9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:19.762085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-465ac0f1-aeb7-40d0-a0e5-96b9c519b7b9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:19.762714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-465ac0f1-aeb7-40d0-a0e5-96b9c519b7b9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:19.763108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-465ac0f1-aeb7-40d0-a0e5-96b9c519b7b9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:19.911359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-465ac0f1-aeb7-40d0-a0e5-96b9c519b7b9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:19.919608 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-465ac0f1-aeb7-40d0-a0e5-96b9c519b7b9 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1460 microversion: 2.1 time: 0.172638 Aug 09 15:11:19.920547 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3059/6108] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:19 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1460 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:11:20.944564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7e3dc65-bf69-4325-a92c-e26ca660c9dd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:20.945241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7e3dc65-bf69-4325-a92c-e26ca660c9dd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:20.952904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7e3dc65-bf69-4325-a92c-e26ca660c9dd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:20.953456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7e3dc65-bf69-4325-a92c-e26ca660c9dd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:20.953925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7e3dc65-bf69-4325-a92c-e26ca660c9dd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:20.954666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7e3dc65-bf69-4325-a92c-e26ca660c9dd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:20.955177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7e3dc65-bf69-4325-a92c-e26ca660c9dd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:20.955797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7e3dc65-bf69-4325-a92c-e26ca660c9dd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:21.128159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7e3dc65-bf69-4325-a92c-e26ca660c9dd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:21.139534 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7e3dc65-bf69-4325-a92c-e26ca660c9dd tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.200975 Aug 09 15:11:21.140300 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3050/6109] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:20 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:21.657814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ab04202-9b31-4853-8788-d7d66c686e98 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:21.658544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4ab04202-9b31-4853-8788-d7d66c686e98 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:21.666404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ab04202-9b31-4853-8788-d7d66c686e98 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:21.666967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ab04202-9b31-4853-8788-d7d66c686e98 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:21.667443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ab04202-9b31-4853-8788-d7d66c686e98 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:21.668363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ab04202-9b31-4853-8788-d7d66c686e98 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:21.669107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ab04202-9b31-4853-8788-d7d66c686e98 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:21.669595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ab04202-9b31-4853-8788-d7d66c686e98 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:21.685170 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-4ab04202-9b31-4853-8788-d7d66c686e98 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ab04202-9b31-4853-8788-d7d66c686e98 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c HTTP/1.1 Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '729b22ab-4269-4135-aca0-2603ca95b46c'} Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:21.686771 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ab04202-9b31-4853-8788-d7d66c686e98 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4ab04202-9b31-4853-8788-d7d66c686e98 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 404 len: 111 microversion: 2.1 time: 0.035195 Aug 09 15:11:21.697575 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3060/6110] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:11:21 2022] DELETE /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:11:21.700294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-489279cf-b377-4566-8596-08b01b3a18f8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:21.701313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-489279cf-b377-4566-8596-08b01b3a18f8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 729b22ab-4269-4135-aca0-2603ca95b46c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:21.709243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-489279cf-b377-4566-8596-08b01b3a18f8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:21.709878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-489279cf-b377-4566-8596-08b01b3a18f8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:21.710336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-489279cf-b377-4566-8596-08b01b3a18f8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:21.711544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-489279cf-b377-4566-8596-08b01b3a18f8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:21.712005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-489279cf-b377-4566-8596-08b01b3a18f8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:21.712769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-489279cf-b377-4566-8596-08b01b3a18f8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:21.732114 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-489279cf-b377-4566-8596-08b01b3a18f8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-489279cf-b377-4566-8596-08b01b3a18f8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c HTTP/1.1 Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '729b22ab-4269-4135-aca0-2603ca95b46c'} Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:21.735302 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:21.739883 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:21.739883 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:21.739883 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:21.739883 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:21.739883 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:21.739883 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. Aug 09 15:11:21.739883 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:21.739883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-489279cf-b377-4566-8596-08b01b3a18f8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance 729b22ab-4269-4135-aca0-2603ca95b46c could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:21.739883 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-489279cf-b377-4566-8596-08b01b3a18f8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c" status: 404 len: 111 microversion: 2.1 time: 0.043338 Aug 09 15:11:21.739883 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3051/6111] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:21 2022] GET /compute/v2.1/servers/729b22ab-4269-4135-aca0-2603ca95b46c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:11:22.166885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a41ca660-6a77-400f-9080-656787d0baf2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:22.168870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a41ca660-6a77-400f-9080-656787d0baf2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:22.177048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a41ca660-6a77-400f-9080-656787d0baf2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:22.177888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a41ca660-6a77-400f-9080-656787d0baf2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:22.178898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a41ca660-6a77-400f-9080-656787d0baf2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:22.180374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a41ca660-6a77-400f-9080-656787d0baf2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:22.181275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a41ca660-6a77-400f-9080-656787d0baf2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:22.182097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a41ca660-6a77-400f-9080-656787d0baf2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:22.247745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94dc5f0a-56f6-459a-b1e6-6f20bc4f6520 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:22.248692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-94dc5f0a-56f6-459a-b1e6-6f20bc4f6520 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:22.260110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94dc5f0a-56f6-459a-b1e6-6f20bc4f6520 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:22.260918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94dc5f0a-56f6-459a-b1e6-6f20bc4f6520 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:22.261577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94dc5f0a-56f6-459a-b1e6-6f20bc4f6520 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:22.262508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94dc5f0a-56f6-459a-b1e6-6f20bc4f6520 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:22.263231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94dc5f0a-56f6-459a-b1e6-6f20bc4f6520 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:22.263859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-94dc5f0a-56f6-459a-b1e6-6f20bc4f6520 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:22.285522 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-94dc5f0a-56f6-459a-b1e6-6f20bc4f6520 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94dc5f0a-56f6-459a-b1e6-6f20bc4f6520 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e HTTP/1.1 Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e'} Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:22.287886 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:22.293705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:22.293705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:22.293705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:22.293705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:22.293705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:22.293705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:22.293705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:22.293705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:22.293705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:22.293705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:22.293705 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:22.296357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-94dc5f0a-56f6-459a-b1e6-6f20bc4f6520 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:22.297658 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-94dc5f0a-56f6-459a-b1e6-6f20bc4f6520 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 404 len: 111 microversion: 2.1 time: 0.054171 Aug 09 15:11:22.302423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3052/6112] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:11:22 2022] DELETE /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:11:22.309187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f6e5966-b82c-47be-84ab-7e037ec3b1b4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:22.310237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9f6e5966-b82c-47be-84ab-7e037ec3b1b4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:22.317672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f6e5966-b82c-47be-84ab-7e037ec3b1b4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:22.318568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f6e5966-b82c-47be-84ab-7e037ec3b1b4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:22.319274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f6e5966-b82c-47be-84ab-7e037ec3b1b4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:22.320280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f6e5966-b82c-47be-84ab-7e037ec3b1b4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:22.320974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f6e5966-b82c-47be-84ab-7e037ec3b1b4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:22.321847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f6e5966-b82c-47be-84ab-7e037ec3b1b4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:22.342783 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-9f6e5966-b82c-47be-84ab-7e037ec3b1b4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f6e5966-b82c-47be-84ab-7e037ec3b1b4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e HTTP/1.1 Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e'} Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:22.346007 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:22.350334 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:22.350334 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:22.350334 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:22.350334 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:22.350334 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:22.350334 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. Aug 09 15:11:22.350334 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:22.353772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f6e5966-b82c-47be-84ab-7e037ec3b1b4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance 5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:22.355013 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f6e5966-b82c-47be-84ab-7e037ec3b1b4 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e" status: 404 len: 111 microversion: 2.1 time: 0.051248 Aug 09 15:11:22.356642 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3053/6113] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:22 2022] GET /compute/v2.1/servers/5c8bd9c4-8751-4dd9-8944-c8aa1eafdd3e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:11:22.372034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a41ca660-6a77-400f-9080-656787d0baf2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:22.383692 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a41ca660-6a77-400f-9080-656787d0baf2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.224541 Aug 09 15:11:22.386045 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3061/6114] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:22 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:22.463928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8af62f1a-4ef2-4994-b8f0-50e72a9d5d48 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Action: 'create', calling method: .version_select at 0x7f41cc77d1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1707078583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOnGsAeybE+6qQga5rcXj1J2effPFT88rkXbU0p4/hPHaxR0l2pJLmHyShU0JtyXvyV0MA1ckn7tVp05uw9nd7dajsnZadgsAbcLeAp6uErYPyWQA8SsbLrR4zvR5lCbA=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:22.483232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-8af62f1a-4ef2-4994-b8f0-50e72a9d5d48 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:11:22.493410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-8af62f1a-4ef2-4994-b8f0-50e72a9d5d48 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for user f99b0693d22442ffa84b9c845d7cbc58 and project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:11:22.541432 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8af62f1a-4ef2-4994-b8f0-50e72a9d5d48 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.081387 Aug 09 15:11:22.550991 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3054/6115] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:11:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:22.792403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:22.796634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:22.816417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:22.817169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:22.817787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:22.818909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:22.819604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:22.824642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:22.924246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:11:22.924819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:11:22.926306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:11:22.926942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:11:22.927405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:11:23.029667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:23.039870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:23.040656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:23.041362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:23.042165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:23.042832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:23.043354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:23.087308 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1d79fcad-aa8f-4cc0-b7ce-33d10de89b50 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc/action" status: 202 len: 1136 microversion: 2.1 time: 0.299896 Aug 09 15:11:23.091138 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3062/6116] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:22 2022] POST /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc/action => generated 1136 bytes in 303 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 09 15:11:23.112013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-936dd11f-e81e-4287-90a7-aa532f554aa6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:23.112983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-936dd11f-e81e-4287-90a7-aa532f554aa6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:23.120732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-936dd11f-e81e-4287-90a7-aa532f554aa6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:23.121500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-936dd11f-e81e-4287-90a7-aa532f554aa6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:23.122202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-936dd11f-e81e-4287-90a7-aa532f554aa6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:23.123570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-936dd11f-e81e-4287-90a7-aa532f554aa6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:23.124203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-936dd11f-e81e-4287-90a7-aa532f554aa6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:23.124820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-936dd11f-e81e-4287-90a7-aa532f554aa6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:23.424790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d09b68c-8d70-4d33-aa93-e45506775535 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:23.430296 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6d09b68c-8d70-4d33-aa93-e45506775535 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:23.437442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-936dd11f-e81e-4287-90a7-aa532f554aa6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:23.449340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d09b68c-8d70-4d33-aa93-e45506775535 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:23.450013 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-936dd11f-e81e-4287-90a7-aa532f554aa6 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.342342 Aug 09 15:11:23.451561 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3055/6117] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:23 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:23.457304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d09b68c-8d70-4d33-aa93-e45506775535 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:23.458131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d09b68c-8d70-4d33-aa93-e45506775535 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:23.459038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d09b68c-8d70-4d33-aa93-e45506775535 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:23.459696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d09b68c-8d70-4d33-aa93-e45506775535 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:23.460397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d09b68c-8d70-4d33-aa93-e45506775535 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:23.713262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6d09b68c-8d70-4d33-aa93-e45506775535 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:23.736642 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6d09b68c-8d70-4d33-aa93-e45506775535 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.333016 Aug 09 15:11:23.749177 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3063/6118] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:23 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:24.472451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08c07dab-dfd2-4624-8400-69148699b692 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:24.473814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-08c07dab-dfd2-4624-8400-69148699b692 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:24.481771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08c07dab-dfd2-4624-8400-69148699b692 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:24.483165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08c07dab-dfd2-4624-8400-69148699b692 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:24.483829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08c07dab-dfd2-4624-8400-69148699b692 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:24.484774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08c07dab-dfd2-4624-8400-69148699b692 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:24.485450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08c07dab-dfd2-4624-8400-69148699b692 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:24.486106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08c07dab-dfd2-4624-8400-69148699b692 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:24.650186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-08c07dab-dfd2-4624-8400-69148699b692 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:24.666209 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-08c07dab-dfd2-4624-8400-69148699b692 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.197793 Aug 09 15:11:24.667666 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3056/6119] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:24 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:24.764685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-92898109-3a4f-44ba-b608-8ffb2ae417a6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:24.765624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-92898109-3a4f-44ba-b608-8ffb2ae417a6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:24.781485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92898109-3a4f-44ba-b608-8ffb2ae417a6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:24.782590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92898109-3a4f-44ba-b608-8ffb2ae417a6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:24.783258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92898109-3a4f-44ba-b608-8ffb2ae417a6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:24.788454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92898109-3a4f-44ba-b608-8ffb2ae417a6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:24.788454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92898109-3a4f-44ba-b608-8ffb2ae417a6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:24.788454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-92898109-3a4f-44ba-b608-8ffb2ae417a6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:25.010606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-92898109-3a4f-44ba-b608-8ffb2ae417a6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:25.025043 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-92898109-3a4f-44ba-b608-8ffb2ae417a6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.265777 Aug 09 15:11:25.047361 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3064/6120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:24 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:25.688106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73f02eb4-3eef-42db-847c-3ed574e6c180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:25.688731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-73f02eb4-3eef-42db-847c-3ed574e6c180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:25.700016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73f02eb4-3eef-42db-847c-3ed574e6c180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:25.700746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73f02eb4-3eef-42db-847c-3ed574e6c180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:25.701470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73f02eb4-3eef-42db-847c-3ed574e6c180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:25.702639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73f02eb4-3eef-42db-847c-3ed574e6c180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:25.703977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73f02eb4-3eef-42db-847c-3ed574e6c180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:25.704658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73f02eb4-3eef-42db-847c-3ed574e6c180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:25.891360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-73f02eb4-3eef-42db-847c-3ed574e6c180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:25.900330 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-73f02eb4-3eef-42db-847c-3ed574e6c180 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.216150 Aug 09 15:11:25.905231 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3057/6121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:25 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:26.051370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4662a6c8-28b2-45cc-91d9-5d4ede84c236 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:26.052008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4662a6c8-28b2-45cc-91d9-5d4ede84c236 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:26.059944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4662a6c8-28b2-45cc-91d9-5d4ede84c236 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:26.060796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4662a6c8-28b2-45cc-91d9-5d4ede84c236 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:26.061392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4662a6c8-28b2-45cc-91d9-5d4ede84c236 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:26.062422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4662a6c8-28b2-45cc-91d9-5d4ede84c236 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:26.063041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4662a6c8-28b2-45cc-91d9-5d4ede84c236 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:26.063652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4662a6c8-28b2-45cc-91d9-5d4ede84c236 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:26.067256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:26.267647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4662a6c8-28b2-45cc-91d9-5d4ede84c236 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:26.278857 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4662a6c8-28b2-45cc-91d9-5d4ede84c236 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.231404 Aug 09 15:11:26.279799 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3065/6122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:26 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:11:26.529342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-30b183e3-fa9c-44e6-bcfd-9ce0be3739ef tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:26.532007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-30b183e3-fa9c-44e6-bcfd-9ce0be3739ef tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:26.538987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30b183e3-fa9c-44e6-bcfd-9ce0be3739ef tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:26.539528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30b183e3-fa9c-44e6-bcfd-9ce0be3739ef tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:26.539975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30b183e3-fa9c-44e6-bcfd-9ce0be3739ef tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:26.540755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30b183e3-fa9c-44e6-bcfd-9ce0be3739ef tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:26.541618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30b183e3-fa9c-44e6-bcfd-9ce0be3739ef tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:26.542217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30b183e3-fa9c-44e6-bcfd-9ce0be3739ef tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:26.930195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-509540f1-e233-486e-a4fa-0054bccaef8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:26.932137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-509540f1-e233-486e-a4fa-0054bccaef8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:26.940722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-509540f1-e233-486e-a4fa-0054bccaef8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:26.941301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-509540f1-e233-486e-a4fa-0054bccaef8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:26.941769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-509540f1-e233-486e-a4fa-0054bccaef8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:26.942604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-509540f1-e233-486e-a4fa-0054bccaef8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:26.943177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-509540f1-e233-486e-a4fa-0054bccaef8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:26.943609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-509540f1-e233-486e-a4fa-0054bccaef8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:27.163811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-509540f1-e233-486e-a4fa-0054bccaef8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:27.177200 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-509540f1-e233-486e-a4fa-0054bccaef8f tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.254642 Aug 09 15:11:27.178375 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3066/6123] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:26 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:27.301512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9df4ce9-9284-4156-892f-56f758e0d3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:27.302124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9df4ce9-9284-4156-892f-56f758e0d3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:27.315872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9df4ce9-9284-4156-892f-56f758e0d3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:27.320416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9df4ce9-9284-4156-892f-56f758e0d3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:27.328304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9df4ce9-9284-4156-892f-56f758e0d3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:27.331039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9df4ce9-9284-4156-892f-56f758e0d3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:27.331902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9df4ce9-9284-4156-892f-56f758e0d3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:27.332679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9df4ce9-9284-4156-892f-56f758e0d3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:27.585664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9df4ce9-9284-4156-892f-56f758e0d3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:27.594980 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9df4ce9-9284-4156-892f-56f758e0d3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.297585 Aug 09 15:11:27.599124 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3067/6124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:27 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:28.204895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-78a78503-fe4d-432f-8d7b-fbf577df3958 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:28.206851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-78a78503-fe4d-432f-8d7b-fbf577df3958 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:28.220832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78a78503-fe4d-432f-8d7b-fbf577df3958 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:28.221912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78a78503-fe4d-432f-8d7b-fbf577df3958 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:28.223204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78a78503-fe4d-432f-8d7b-fbf577df3958 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:28.225076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78a78503-fe4d-432f-8d7b-fbf577df3958 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:28.226659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78a78503-fe4d-432f-8d7b-fbf577df3958 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:28.228469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-78a78503-fe4d-432f-8d7b-fbf577df3958 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:28.513706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-78a78503-fe4d-432f-8d7b-fbf577df3958 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:28.533415 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-78a78503-fe4d-432f-8d7b-fbf577df3958 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.337062 Aug 09 15:11:28.534039 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3068/6125] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:28 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:11:28.621172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2caa76de-1ff5-43c6-a5e1-6b5328aeddc7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:28.621901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2caa76de-1ff5-43c6-a5e1-6b5328aeddc7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:28.628920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2caa76de-1ff5-43c6-a5e1-6b5328aeddc7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:28.629514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2caa76de-1ff5-43c6-a5e1-6b5328aeddc7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:28.630048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2caa76de-1ff5-43c6-a5e1-6b5328aeddc7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:28.630819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2caa76de-1ff5-43c6-a5e1-6b5328aeddc7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:28.631368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2caa76de-1ff5-43c6-a5e1-6b5328aeddc7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:28.631856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2caa76de-1ff5-43c6-a5e1-6b5328aeddc7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:28.833705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2caa76de-1ff5-43c6-a5e1-6b5328aeddc7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:28.845445 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2caa76de-1ff5-43c6-a5e1-6b5328aeddc7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.230314 Aug 09 15:11:28.859123 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3069/6126] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:28 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:29.556759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9673f680-fb7f-4671-a756-7fd16a26bea2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:29.557516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9673f680-fb7f-4671-a756-7fd16a26bea2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:29.566435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9673f680-fb7f-4671-a756-7fd16a26bea2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:29.566927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9673f680-fb7f-4671-a756-7fd16a26bea2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:29.567414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9673f680-fb7f-4671-a756-7fd16a26bea2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:29.568117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9673f680-fb7f-4671-a756-7fd16a26bea2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:29.568567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9673f680-fb7f-4671-a756-7fd16a26bea2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:29.568987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9673f680-fb7f-4671-a756-7fd16a26bea2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:29.732532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9673f680-fb7f-4671-a756-7fd16a26bea2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:29.740624 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9673f680-fb7f-4671-a756-7fd16a26bea2 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.187855 Aug 09 15:11:29.741500 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3070/6127] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:29 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:29.872142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-02a9f36d-6270-4e43-8e04-5bd862ac6daf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:29.872756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-02a9f36d-6270-4e43-8e04-5bd862ac6daf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:29.879886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02a9f36d-6270-4e43-8e04-5bd862ac6daf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:29.880432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02a9f36d-6270-4e43-8e04-5bd862ac6daf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:29.880875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02a9f36d-6270-4e43-8e04-5bd862ac6daf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:29.881574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02a9f36d-6270-4e43-8e04-5bd862ac6daf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:29.882023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02a9f36d-6270-4e43-8e04-5bd862ac6daf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:29.882448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02a9f36d-6270-4e43-8e04-5bd862ac6daf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:30.044049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-02a9f36d-6270-4e43-8e04-5bd862ac6daf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:30.051963 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-02a9f36d-6270-4e43-8e04-5bd862ac6daf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.183939 Aug 09 15:11:30.052556 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3071/6128] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:29 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:30.763978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-523d0673-183e-4a4d-9eca-f6a8f1edf2fa tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:30.764713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-523d0673-183e-4a4d-9eca-f6a8f1edf2fa tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:30.769493 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-30b183e3-fa9c-44e6-bcfd-9ce0be3739ef tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "POST /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a/action" status: 200 len: 24566 microversion: 2.1 time: 4.244313 Aug 09 15:11:30.770187 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3058/6129] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:26 2022] POST /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a/action => generated 24566 bytes in 4246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:11:30.773358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-523d0673-183e-4a4d-9eca-f6a8f1edf2fa tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:30.773867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-523d0673-183e-4a4d-9eca-f6a8f1edf2fa tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:30.774662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-523d0673-183e-4a4d-9eca-f6a8f1edf2fa tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:30.777763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-523d0673-183e-4a4d-9eca-f6a8f1edf2fa tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:30.778246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-523d0673-183e-4a4d-9eca-f6a8f1edf2fa tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:30.778704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-523d0673-183e-4a4d-9eca-f6a8f1edf2fa tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:30.930062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-523d0673-183e-4a4d-9eca-f6a8f1edf2fa tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:30.938258 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-523d0673-183e-4a4d-9eca-f6a8f1edf2fa tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.178171 Aug 09 15:11:30.939062 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3072/6130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:30 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:11:31.074209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-731d2967-923d-420b-9f39-0b18d30f3ebf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:31.074914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-731d2967-923d-420b-9f39-0b18d30f3ebf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:31.083441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-731d2967-923d-420b-9f39-0b18d30f3ebf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:31.083936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-731d2967-923d-420b-9f39-0b18d30f3ebf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:31.084374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-731d2967-923d-420b-9f39-0b18d30f3ebf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:31.085124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-731d2967-923d-420b-9f39-0b18d30f3ebf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:31.085586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-731d2967-923d-420b-9f39-0b18d30f3ebf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:31.086015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-731d2967-923d-420b-9f39-0b18d30f3ebf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:31.228902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-731d2967-923d-420b-9f39-0b18d30f3ebf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:31.236987 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-731d2967-923d-420b-9f39-0b18d30f3ebf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.167619 Aug 09 15:11:31.237584 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3059/6131] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:31 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:31.959602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f36edca4-510b-4050-9390-a1ef43489844 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:31.960277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f36edca4-510b-4050-9390-a1ef43489844 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:31.968281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f36edca4-510b-4050-9390-a1ef43489844 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:31.968776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f36edca4-510b-4050-9390-a1ef43489844 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:31.969211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f36edca4-510b-4050-9390-a1ef43489844 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:31.969941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f36edca4-510b-4050-9390-a1ef43489844 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:31.970383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f36edca4-510b-4050-9390-a1ef43489844 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:31.970808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f36edca4-510b-4050-9390-a1ef43489844 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:32.114150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f36edca4-510b-4050-9390-a1ef43489844 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:32.122958 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f36edca4-510b-4050-9390-a1ef43489844 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.167446 Aug 09 15:11:32.123941 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3073/6132] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:31 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:32.258611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ebf07d4d-f274-4084-a88c-48623a5f89ce tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:32.259553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ebf07d4d-f274-4084-a88c-48623a5f89ce tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:32.266870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebf07d4d-f274-4084-a88c-48623a5f89ce tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:32.267681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebf07d4d-f274-4084-a88c-48623a5f89ce tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:32.268139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebf07d4d-f274-4084-a88c-48623a5f89ce tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:32.268865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebf07d4d-f274-4084-a88c-48623a5f89ce tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:32.269470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebf07d4d-f274-4084-a88c-48623a5f89ce tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:32.269911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ebf07d4d-f274-4084-a88c-48623a5f89ce tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:32.433928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ebf07d4d-f274-4084-a88c-48623a5f89ce tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:32.443006 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ebf07d4d-f274-4084-a88c-48623a5f89ce tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.187315 Aug 09 15:11:32.443640 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3060/6133] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:32 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:33.144819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0b3c54a-6ce4-4da8-b846-28995e3ba72c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:33.145441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0b3c54a-6ce4-4da8-b846-28995e3ba72c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:33.150901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:33.154833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0b3c54a-6ce4-4da8-b846-28995e3ba72c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:33.155356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0b3c54a-6ce4-4da8-b846-28995e3ba72c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:33.155777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0b3c54a-6ce4-4da8-b846-28995e3ba72c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:33.156760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0b3c54a-6ce4-4da8-b846-28995e3ba72c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:33.157188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0b3c54a-6ce4-4da8-b846-28995e3ba72c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:33.157826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0b3c54a-6ce4-4da8-b846-28995e3ba72c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:33.312962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c0b3c54a-6ce4-4da8-b846-28995e3ba72c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:33.321097 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0b3c54a-6ce4-4da8-b846-28995e3ba72c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.179988 Aug 09 15:11:33.321840 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3074/6134] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:33 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:33.466147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5446509-2214-4b99-8aef-cb76b88cd371 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:33.467547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c5446509-2214-4b99-8aef-cb76b88cd371 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:33.470340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:33.482321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5446509-2214-4b99-8aef-cb76b88cd371 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:33.483117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5446509-2214-4b99-8aef-cb76b88cd371 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:33.483857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5446509-2214-4b99-8aef-cb76b88cd371 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:33.484940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5446509-2214-4b99-8aef-cb76b88cd371 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:33.485663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5446509-2214-4b99-8aef-cb76b88cd371 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:33.486438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5446509-2214-4b99-8aef-cb76b88cd371 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:33.636815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5446509-2214-4b99-8aef-cb76b88cd371 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:33.645032 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c5446509-2214-4b99-8aef-cb76b88cd371 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.183872 Aug 09 15:11:33.645620 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3061/6135] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:33 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:34.342791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9c1e27ee-7125-4c20-acc5-001df3ad1067 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:34.343452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9c1e27ee-7125-4c20-acc5-001df3ad1067 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:34.353783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c1e27ee-7125-4c20-acc5-001df3ad1067 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:34.354273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c1e27ee-7125-4c20-acc5-001df3ad1067 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:34.354712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c1e27ee-7125-4c20-acc5-001df3ad1067 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:34.355437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c1e27ee-7125-4c20-acc5-001df3ad1067 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:34.355889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c1e27ee-7125-4c20-acc5-001df3ad1067 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:34.356313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c1e27ee-7125-4c20-acc5-001df3ad1067 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:34.520866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9c1e27ee-7125-4c20-acc5-001df3ad1067 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:34.529905 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9c1e27ee-7125-4c20-acc5-001df3ad1067 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.191768 Aug 09 15:11:34.530504 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3075/6136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:34 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:34.668417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7c0ab162-3caa-45a8-b00e-407874851574 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:34.669013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7c0ab162-3caa-45a8-b00e-407874851574 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:34.676351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c0ab162-3caa-45a8-b00e-407874851574 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:34.676848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c0ab162-3caa-45a8-b00e-407874851574 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:34.677295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c0ab162-3caa-45a8-b00e-407874851574 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:34.678302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c0ab162-3caa-45a8-b00e-407874851574 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:34.678802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c0ab162-3caa-45a8-b00e-407874851574 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:34.679272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7c0ab162-3caa-45a8-b00e-407874851574 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:34.699033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:34.844582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7c0ab162-3caa-45a8-b00e-407874851574 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:34.853147 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7c0ab162-3caa-45a8-b00e-407874851574 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.189901 Aug 09 15:11:34.854236 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3062/6137] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:34 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:34.886993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0b53f0dc-6f17-4a78-9c48-8f214a47b674 req-9eeaab7e-0be8-481a-b8d1-84d2faf321df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45050cee-c0fb-4f05-a875-a43d4b834957", "name": "network-vif-plugged", "status": "completed", "tag": "d4da00d3-9767-424e-b34c-366c17cf1305"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:34.898382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0b53f0dc-6f17-4a78-9c48-8f214a47b674 req-9eeaab7e-0be8-481a-b8d1-84d2faf321df service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:34.899024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0b53f0dc-6f17-4a78-9c48-8f214a47b674 req-9eeaab7e-0be8-481a-b8d1-84d2faf321df service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:34.899583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0b53f0dc-6f17-4a78-9c48-8f214a47b674 req-9eeaab7e-0be8-481a-b8d1-84d2faf321df service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:34.914392 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0b53f0dc-6f17-4a78-9c48-8f214a47b674 req-9eeaab7e-0be8-481a-b8d1-84d2faf321df service nova] Creating event network-vif-plugged:d4da00d3-9767-424e-b34c-366c17cf1305 for instance 45050cee-c0fb-4f05-a875-a43d4b834957 on n-h2-844626-8 Aug 09 15:11:34.920760 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0b53f0dc-6f17-4a78-9c48-8f214a47b674 req-9eeaab7e-0be8-481a-b8d1-84d2faf321df service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037439 Aug 09 15:11:34.921572 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3076/6138] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:35.551605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-77bf59c8-0c79-422d-9e32-175258d9fe68 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:35.552233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77bf59c8-0c79-422d-9e32-175258d9fe68 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:35.559018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77bf59c8-0c79-422d-9e32-175258d9fe68 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:35.559533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77bf59c8-0c79-422d-9e32-175258d9fe68 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:35.559988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77bf59c8-0c79-422d-9e32-175258d9fe68 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:35.560712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77bf59c8-0c79-422d-9e32-175258d9fe68 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:35.561182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77bf59c8-0c79-422d-9e32-175258d9fe68 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:35.561623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77bf59c8-0c79-422d-9e32-175258d9fe68 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:35.702176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-77bf59c8-0c79-422d-9e32-175258d9fe68 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:35.710230 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-77bf59c8-0c79-422d-9e32-175258d9fe68 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.162705 Aug 09 15:11:35.710743 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3063/6139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:35 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:35.875988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e43e89cd-e5ed-4dba-804d-021a04d5a5c7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:35.876569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e43e89cd-e5ed-4dba-804d-021a04d5a5c7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:35.884049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e43e89cd-e5ed-4dba-804d-021a04d5a5c7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:35.884554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e43e89cd-e5ed-4dba-804d-021a04d5a5c7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:35.885018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e43e89cd-e5ed-4dba-804d-021a04d5a5c7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:35.885767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e43e89cd-e5ed-4dba-804d-021a04d5a5c7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:35.886219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e43e89cd-e5ed-4dba-804d-021a04d5a5c7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:35.886632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e43e89cd-e5ed-4dba-804d-021a04d5a5c7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:36.026911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e43e89cd-e5ed-4dba-804d-021a04d5a5c7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:36.036202 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e43e89cd-e5ed-4dba-804d-021a04d5a5c7 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1518 microversion: 2.1 time: 0.164814 Aug 09 15:11:36.036841 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3077/6140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:35 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:36.733810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef0f5b4c-6941-44ab-abf2-4dbf062a2093 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:36.734768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef0f5b4c-6941-44ab-abf2-4dbf062a2093 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:36.747760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef0f5b4c-6941-44ab-abf2-4dbf062a2093 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:36.748640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef0f5b4c-6941-44ab-abf2-4dbf062a2093 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:36.749329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef0f5b4c-6941-44ab-abf2-4dbf062a2093 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:36.750138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef0f5b4c-6941-44ab-abf2-4dbf062a2093 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:36.750760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef0f5b4c-6941-44ab-abf2-4dbf062a2093 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:36.751250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef0f5b4c-6941-44ab-abf2-4dbf062a2093 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:36.894537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef0f5b4c-6941-44ab-abf2-4dbf062a2093 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:36.904104 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef0f5b4c-6941-44ab-abf2-4dbf062a2093 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.175566 Aug 09 15:11:36.904728 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3064/6141] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:36 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:37.058099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1f18fb4e-8e0b-4915-93de-eda108fdb971 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:37.058764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1f18fb4e-8e0b-4915-93de-eda108fdb971 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:37.066362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f18fb4e-8e0b-4915-93de-eda108fdb971 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.066844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f18fb4e-8e0b-4915-93de-eda108fdb971 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.067319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f18fb4e-8e0b-4915-93de-eda108fdb971 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.068154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f18fb4e-8e0b-4915-93de-eda108fdb971 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.068635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f18fb4e-8e0b-4915-93de-eda108fdb971 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.069054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1f18fb4e-8e0b-4915-93de-eda108fdb971 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.216429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1f18fb4e-8e0b-4915-93de-eda108fdb971 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:37.228243 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1f18fb4e-8e0b-4915-93de-eda108fdb971 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.174110 Aug 09 15:11:37.229011 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3078/6142] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:37 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:37.249403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9dc4f79f-2f1b-4969-a3b7-ead8fe1fe43e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:37.250007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9dc4f79f-2f1b-4969-a3b7-ead8fe1fe43e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:37.253320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:37.257316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9dc4f79f-2f1b-4969-a3b7-ead8fe1fe43e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.257874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9dc4f79f-2f1b-4969-a3b7-ead8fe1fe43e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.258541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9dc4f79f-2f1b-4969-a3b7-ead8fe1fe43e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.259599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9dc4f79f-2f1b-4969-a3b7-ead8fe1fe43e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.260101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9dc4f79f-2f1b-4969-a3b7-ead8fe1fe43e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.260620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9dc4f79f-2f1b-4969-a3b7-ead8fe1fe43e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.413933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9dc4f79f-2f1b-4969-a3b7-ead8fe1fe43e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:37.423258 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9dc4f79f-2f1b-4969-a3b7-ead8fe1fe43e tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.178091 Aug 09 15:11:37.424289 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3065/6143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:37 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:37.452761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c3d5be0d-12b1-4e35-ad28-cb9ebbc9f70f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:37.453360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c3d5be0d-12b1-4e35-ad28-cb9ebbc9f70f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:37.459692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3d5be0d-12b1-4e35-ad28-cb9ebbc9f70f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.460437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3d5be0d-12b1-4e35-ad28-cb9ebbc9f70f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.461133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3d5be0d-12b1-4e35-ad28-cb9ebbc9f70f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.462011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3d5be0d-12b1-4e35-ad28-cb9ebbc9f70f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.462471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3d5be0d-12b1-4e35-ad28-cb9ebbc9f70f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.463251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c3d5be0d-12b1-4e35-ad28-cb9ebbc9f70f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.463774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-140a33c4-91cb-44ad-8254-3c369846c870 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:37.466192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-140a33c4-91cb-44ad-8254-3c369846c870 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:37.473122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-140a33c4-91cb-44ad-8254-3c369846c870 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.473614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-140a33c4-91cb-44ad-8254-3c369846c870 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.474296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-140a33c4-91cb-44ad-8254-3c369846c870 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.475031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-140a33c4-91cb-44ad-8254-3c369846c870 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.475558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-140a33c4-91cb-44ad-8254-3c369846c870 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.475999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-140a33c4-91cb-44ad-8254-3c369846c870 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.531064 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-140a33c4-91cb-44ad-8254-3c369846c870 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "POST /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a/action" status: 200 len: 32634 microversion: 2.1 time: 0.071096 Aug 09 15:11:37.532755 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3066/6144] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:37 2022] POST /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a/action => generated 32634 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:11:37.603566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c3d5be0d-12b1-4e35-ad28-cb9ebbc9f70f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:37.613001 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c3d5be0d-12b1-4e35-ad28-cb9ebbc9f70f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.164172 Aug 09 15:11:37.613590 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3079/6145] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:37 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:37.634454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ac9aa8e-6f68-4768-aada-7a4913a36d48 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:37.641095 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-0ac9aa8e-6f68-4768-aada-7a4913a36d48 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance b6cc97f5-22aa-491a-953d-8021a57aaedf has no mapping to a cell. Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ac9aa8e-6f68-4768-aada-7a4913a36d48 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/b6cc97f5-22aa-491a-953d-8021a57aaedf/action HTTP/1.1 Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 15 Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: {"os-stop": {}} Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance b6cc97f5-22aa-491a-953d-8021a57aaedf has no mapping to a cell. Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'b6cc97f5-22aa-491a-953d-8021a57aaedf', 'body': {'os-stop': {}}} Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance b6cc97f5-22aa-491a-953d-8021a57aaedf has no mapping to a cell. Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:37.646325 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6cc97f5-22aa-491a-953d-8021a57aaedf has no mapping to a cell. Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6cc97f5-22aa-491a-953d-8021a57aaedf has no mapping to a cell. Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ac9aa8e-6f68-4768-aada-7a4913a36d48 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance b6cc97f5-22aa-491a-953d-8021a57aaedf has no mapping to a cell. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ac9aa8e-6f68-4768-aada-7a4913a36d48 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/b6cc97f5-22aa-491a-953d-8021a57aaedf/action" status: 404 len: 117 microversion: 2.1 time: 0.018005 Aug 09 15:11:37.650904 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3067/6146] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:37 2022] POST /compute/v2.1/servers/b6cc97f5-22aa-491a-953d-8021a57aaedf/action => generated 117 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:11:37.659705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4dab3c88-7c65-4283-acc2-28e157f732f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:37.660416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4dab3c88-7c65-4283-acc2-28e157f732f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:37.667336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dab3c88-7c65-4283-acc2-28e157f732f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.667874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dab3c88-7c65-4283-acc2-28e157f732f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.668304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dab3c88-7c65-4283-acc2-28e157f732f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.669026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dab3c88-7c65-4283-acc2-28e157f732f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.669472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dab3c88-7c65-4283-acc2-28e157f732f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.669890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4dab3c88-7c65-4283-acc2-28e157f732f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.808076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4dab3c88-7c65-4283-acc2-28e157f732f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:37.816444 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4dab3c88-7c65-4283-acc2-28e157f732f3 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.161166 Aug 09 15:11:37.817004 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3080/6147] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:37 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:37.838213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7944658-4b24-4016-94ee-189669104ed5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:37.839172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7944658-4b24-4016-94ee-189669104ed5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:37.853939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7944658-4b24-4016-94ee-189669104ed5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.854509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7944658-4b24-4016-94ee-189669104ed5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.855016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7944658-4b24-4016-94ee-189669104ed5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.855902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7944658-4b24-4016-94ee-189669104ed5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.856450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7944658-4b24-4016-94ee-189669104ed5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.856966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7944658-4b24-4016-94ee-189669104ed5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.925537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-beb43b42-aa2c-4661-9943-e94af45af74e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:37.928045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-beb43b42-aa2c-4661-9943-e94af45af74e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:37.935529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-beb43b42-aa2c-4661-9943-e94af45af74e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.936013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-beb43b42-aa2c-4661-9943-e94af45af74e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.936445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-beb43b42-aa2c-4661-9943-e94af45af74e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:37.937156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-beb43b42-aa2c-4661-9943-e94af45af74e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:37.937603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-beb43b42-aa2c-4661-9943-e94af45af74e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:37.938020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-beb43b42-aa2c-4661-9943-e94af45af74e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:38.078086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7944658-4b24-4016-94ee-189669104ed5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:38.088386 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7944658-4b24-4016-94ee-189669104ed5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.254535 Aug 09 15:11:38.090176 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3068/6148] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:37 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:38.110646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db05a7bc-1b3c-4ef0-b6d9-2b793f85d196 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:38.111665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db05a7bc-1b3c-4ef0-b6d9-2b793f85d196 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: fffae6a4-c38f-497e-9e07-bc29d4ce0537] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:38.136507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-beb43b42-aa2c-4661-9943-e94af45af74e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:38.138685 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-db05a7bc-1b3c-4ef0-b6d9-2b793f85d196 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance fffae6a4-c38f-497e-9e07-bc29d4ce0537 could not be found. Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db05a7bc-1b3c-4ef0-b6d9-2b793f85d196 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/fffae6a4-c38f-497e-9e07-bc29d4ce0537/action HTTP/1.1 Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 15 Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: {"suspend": {}} Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance fffae6a4-c38f-497e-9e07-bc29d4ce0537 could not be found. Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'fffae6a4-c38f-497e-9e07-bc29d4ce0537', 'body': {'suspend': {}}} Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fffae6a4-c38f-497e-9e07-bc29d4ce0537 could not be found. Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fffae6a4-c38f-497e-9e07-bc29d4ce0537 could not be found. Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:38.141067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:38.146125 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:38.146125 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:38.146125 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fffae6a4-c38f-497e-9e07-bc29d4ce0537 could not be found. Aug 09 15:11:38.146125 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:38.146125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db05a7bc-1b3c-4ef0-b6d9-2b793f85d196 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance fffae6a4-c38f-497e-9e07-bc29d4ce0537 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:38.146125 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db05a7bc-1b3c-4ef0-b6d9-2b793f85d196 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/fffae6a4-c38f-497e-9e07-bc29d4ce0537/action" status: 404 len: 111 microversion: 2.1 time: 0.036304 Aug 09 15:11:38.146125 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3069/6149] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:38 2022] POST /compute/v2.1/servers/fffae6a4-c38f-497e-9e07-bc29d4ce0537/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:11:38.153794 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-beb43b42-aa2c-4661-9943-e94af45af74e tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.232051 Aug 09 15:11:38.154535 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3081/6150] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:37 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:38.155276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d6d74bb5-40b6-4f94-aedf-18b74fa8e3d1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:38.155922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d6d74bb5-40b6-4f94-aedf-18b74fa8e3d1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:38.163995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6d74bb5-40b6-4f94-aedf-18b74fa8e3d1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:38.164503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6d74bb5-40b6-4f94-aedf-18b74fa8e3d1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:38.164985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6d74bb5-40b6-4f94-aedf-18b74fa8e3d1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:38.165731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6d74bb5-40b6-4f94-aedf-18b74fa8e3d1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:38.166195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6d74bb5-40b6-4f94-aedf-18b74fa8e3d1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:38.166630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6d74bb5-40b6-4f94-aedf-18b74fa8e3d1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:38.651245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d6d74bb5-40b6-4f94-aedf-18b74fa8e3d1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:38.660401 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d6d74bb5-40b6-4f94-aedf-18b74fa8e3d1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.511944 Aug 09 15:11:38.661549 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3070/6151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:38 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:38.683032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d90e0f4b-5cb1-4753-ba45-dd9eccc558c4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:38.683668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d90e0f4b-5cb1-4753-ba45-dd9eccc558c4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:38.689995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d90e0f4b-5cb1-4753-ba45-dd9eccc558c4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:38.690742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d90e0f4b-5cb1-4753-ba45-dd9eccc558c4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:38.691351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d90e0f4b-5cb1-4753-ba45-dd9eccc558c4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:38.692855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d90e0f4b-5cb1-4753-ba45-dd9eccc558c4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:38.693466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d90e0f4b-5cb1-4753-ba45-dd9eccc558c4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:38.694042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d90e0f4b-5cb1-4753-ba45-dd9eccc558c4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:38.711889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:38.761326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-960893dd-3c71-42c7-be97-0a0df4b14ee9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:38.761840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-960893dd-3c71-42c7-be97-0a0df4b14ee9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:38.778708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-960893dd-3c71-42c7-be97-0a0df4b14ee9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:38.779250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-960893dd-3c71-42c7-be97-0a0df4b14ee9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:38.779701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-960893dd-3c71-42c7-be97-0a0df4b14ee9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:38.780422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-960893dd-3c71-42c7-be97-0a0df4b14ee9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:38.781094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-960893dd-3c71-42c7-be97-0a0df4b14ee9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:38.781685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-960893dd-3c71-42c7-be97-0a0df4b14ee9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:38.812532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-960893dd-3c71-42c7-be97-0a0df4b14ee9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:11:38.880228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d90e0f4b-5cb1-4753-ba45-dd9eccc558c4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:38.889029 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d90e0f4b-5cb1-4753-ba45-dd9eccc558c4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.209781 Aug 09 15:11:38.890319 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3082/6152] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:38 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:38.895319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-1edd3a6a-5b00-4507-b00e-f527bf159c08 req-f909dd95-26fb-43ef-985e-434c3964f261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e3b597c-be37-40c7-a923-a5226b648d0a", "tag": "84a79531-1c02-4a2e-8891-f26a5521ffc4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:38.907070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1edd3a6a-5b00-4507-b00e-f527bf159c08 req-f909dd95-26fb-43ef-985e-434c3964f261 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:38.907572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1edd3a6a-5b00-4507-b00e-f527bf159c08 req-f909dd95-26fb-43ef-985e-434c3964f261 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:38.908001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1edd3a6a-5b00-4507-b00e-f527bf159c08 req-f909dd95-26fb-43ef-985e-434c3964f261 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:38.922227 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1edd3a6a-5b00-4507-b00e-f527bf159c08 req-f909dd95-26fb-43ef-985e-434c3964f261 service nova] Creating event network-changed:84a79531-1c02-4a2e-8891-f26a5521ffc4 for instance 3e3b597c-be37-40c7-a923-a5226b648d0a on n-h2-844626-8 Aug 09 15:11:38.928919 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-1edd3a6a-5b00-4507-b00e-f527bf159c08 req-f909dd95-26fb-43ef-985e-434c3964f261 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036528 Aug 09 15:11:38.929834 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3083/6153] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:38.936559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1896bfaa-4a71-457b-a275-460a3c1cccdf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:38.937501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1896bfaa-4a71-457b-a275-460a3c1cccdf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:38.945047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1896bfaa-4a71-457b-a275-460a3c1cccdf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:38.946186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1896bfaa-4a71-457b-a275-460a3c1cccdf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:38.946793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1896bfaa-4a71-457b-a275-460a3c1cccdf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:38.947862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1896bfaa-4a71-457b-a275-460a3c1cccdf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:38.948530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1896bfaa-4a71-457b-a275-460a3c1cccdf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:38.949131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1896bfaa-4a71-457b-a275-460a3c1cccdf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:38.960453 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-960893dd-3c71-42c7-be97-0a0df4b14ee9 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 204 len: 0 microversion: 2.1 time: 0.202879 Aug 09 15:11:38.964964 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3071/6154] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:11:38 2022] DELETE /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 15:11:38.977057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9152e53b-812e-4695-9836-b49a028c2ac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:38.978869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9152e53b-812e-4695-9836-b49a028c2ac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:38.982091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-1896bfaa-4a71-457b-a275-460a3c1cccdf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lazy-loading 'flavor' on Instance uuid 45050cee-c0fb-4f05-a875-a43d4b834957 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:11:38.987970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9152e53b-812e-4695-9836-b49a028c2ac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:38.991199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9152e53b-812e-4695-9836-b49a028c2ac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:38.991855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9152e53b-812e-4695-9836-b49a028c2ac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:38.992761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9152e53b-812e-4695-9836-b49a028c2ac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:38.993470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9152e53b-812e-4695-9836-b49a028c2ac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:38.994057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9152e53b-812e-4695-9836-b49a028c2ac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:39.084198 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1896bfaa-4a71-457b-a275-460a3c1cccdf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 202 len: 0 microversion: 2.1 time: 0.152908 Aug 09 15:11:39.086138 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3084/6155] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:38 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:11:39.096627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-61009a25-c304-4db4-a4be-ef42c5bad309 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:39.097768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-61009a25-c304-4db4-a4be-ef42c5bad309 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:39.112752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61009a25-c304-4db4-a4be-ef42c5bad309 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:39.113523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61009a25-c304-4db4-a4be-ef42c5bad309 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:39.114105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61009a25-c304-4db4-a4be-ef42c5bad309 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:39.114972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61009a25-c304-4db4-a4be-ef42c5bad309 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:39.115740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61009a25-c304-4db4-a4be-ef42c5bad309 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:39.117421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61009a25-c304-4db4-a4be-ef42c5bad309 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:39.166527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9152e53b-812e-4695-9836-b49a028c2ac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:39.175799 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9152e53b-812e-4695-9836-b49a028c2ac2 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1669 microversion: 2.1 time: 0.208412 Aug 09 15:11:39.177025 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3072/6156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:38 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1669 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:39.194571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5b0c2e7e-aa48-4424-8624-2384886526e5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:39.195246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b0c2e7e-aa48-4424-8624-2384886526e5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:39.202336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b0c2e7e-aa48-4424-8624-2384886526e5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:39.202850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b0c2e7e-aa48-4424-8624-2384886526e5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:39.203319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b0c2e7e-aa48-4424-8624-2384886526e5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:39.204729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b0c2e7e-aa48-4424-8624-2384886526e5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:39.205215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b0c2e7e-aa48-4424-8624-2384886526e5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:39.205637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b0c2e7e-aa48-4424-8624-2384886526e5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:39.327590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-61009a25-c304-4db4-a4be-ef42c5bad309 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:39.341352 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-61009a25-c304-4db4-a4be-ef42c5bad309 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1513 microversion: 2.1 time: 0.249674 Aug 09 15:11:39.342766 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3085/6157] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:39 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:39.385996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5b0c2e7e-aa48-4424-8624-2384886526e5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:39.394429 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5b0c2e7e-aa48-4424-8624-2384886526e5 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1690 microversion: 2.1 time: 0.216010 Aug 09 15:11:39.395258 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3073/6158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:39 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1690 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:40.198777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-037a7795-8bc6-4e3d-91fc-9478913e42c7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:40.199303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-037a7795-8bc6-4e3d-91fc-9478913e42c7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:40.206787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-037a7795-8bc6-4e3d-91fc-9478913e42c7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:40.207564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-037a7795-8bc6-4e3d-91fc-9478913e42c7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:40.208178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-037a7795-8bc6-4e3d-91fc-9478913e42c7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:40.209079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-037a7795-8bc6-4e3d-91fc-9478913e42c7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:40.209730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-037a7795-8bc6-4e3d-91fc-9478913e42c7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:40.210319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-037a7795-8bc6-4e3d-91fc-9478913e42c7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:40.354135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-037a7795-8bc6-4e3d-91fc-9478913e42c7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:40.364953 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-037a7795-8bc6-4e3d-91fc-9478913e42c7 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1669 microversion: 2.1 time: 0.170378 Aug 09 15:11:40.366195 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3086/6159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:40 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:40.366671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7dbd81f-31d1-4602-9ab2-26af562f0ae2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:40.367352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7dbd81f-31d1-4602-9ab2-26af562f0ae2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:40.375416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7dbd81f-31d1-4602-9ab2-26af562f0ae2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:40.376184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7dbd81f-31d1-4602-9ab2-26af562f0ae2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:40.376708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7dbd81f-31d1-4602-9ab2-26af562f0ae2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:40.377501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7dbd81f-31d1-4602-9ab2-26af562f0ae2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:40.378038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7dbd81f-31d1-4602-9ab2-26af562f0ae2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:40.378548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7dbd81f-31d1-4602-9ab2-26af562f0ae2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:40.417531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-13506e36-e20b-4451-9964-1ccc60474247 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:40.418306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-13506e36-e20b-4451-9964-1ccc60474247 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:40.424903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13506e36-e20b-4451-9964-1ccc60474247 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:40.425957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13506e36-e20b-4451-9964-1ccc60474247 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:40.426932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13506e36-e20b-4451-9964-1ccc60474247 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:40.427866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13506e36-e20b-4451-9964-1ccc60474247 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:40.428682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13506e36-e20b-4451-9964-1ccc60474247 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:40.429291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13506e36-e20b-4451-9964-1ccc60474247 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:40.708743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7dbd81f-31d1-4602-9ab2-26af562f0ae2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:40.717268 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7dbd81f-31d1-4602-9ab2-26af562f0ae2 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1513 microversion: 2.1 time: 0.355783 Aug 09 15:11:40.729326 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3074/6160] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:40 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:40.766676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-13506e36-e20b-4451-9964-1ccc60474247 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:40.779723 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-13506e36-e20b-4451-9964-1ccc60474247 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1696 microversion: 2.1 time: 0.368168 Aug 09 15:11:40.780462 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3087/6161] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:40 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1696 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:11:41.164730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-07c490f7-0e16-4ad3-8cd6-6e3305d23359 req-6c5060fb-b275-463d-9854-9087cfcb2c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e3b597c-be37-40c7-a923-a5226b648d0a", "name": "network-vif-deleted", "tag": "84a79531-1c02-4a2e-8891-f26a5521ffc4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:41.183488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-07c490f7-0e16-4ad3-8cd6-6e3305d23359 req-6c5060fb-b275-463d-9854-9087cfcb2c2a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:41.183948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-07c490f7-0e16-4ad3-8cd6-6e3305d23359 req-6c5060fb-b275-463d-9854-9087cfcb2c2a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:41.184760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-07c490f7-0e16-4ad3-8cd6-6e3305d23359 req-6c5060fb-b275-463d-9854-9087cfcb2c2a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:41.199725 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-07c490f7-0e16-4ad3-8cd6-6e3305d23359 req-6c5060fb-b275-463d-9854-9087cfcb2c2a service nova] Creating event network-vif-deleted:84a79531-1c02-4a2e-8891-f26a5521ffc4 for instance 3e3b597c-be37-40c7-a923-a5226b648d0a on n-h2-844626-8 Aug 09 15:11:41.206865 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-07c490f7-0e16-4ad3-8cd6-6e3305d23359 req-6c5060fb-b275-463d-9854-9087cfcb2c2a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046380 Aug 09 15:11:41.208423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3075/6162] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:11:41.386867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:41.387652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:41.395412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:41.395889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:41.396521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:41.397231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:41.397983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:41.398070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:41.436354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:41.436968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:41.437402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:41.437901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lazy-loading 'fault' on Instance uuid 3e3b597c-be37-40c7-a923-a5226b648d0a {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:11:41.485990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7808d57a047f4fdfa852f71ff632619a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f459e237ba2d464c8feeb733393804a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:41.496626 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d30c133-a4ae-4be7-82c3-19a9c0bfeaf0 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 200 len: 1339 microversion: 2.1 time: 0.113746 Aug 09 15:11:41.499160 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3088/6163] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:41 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:41.743282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1bcf7716-631f-4322-85f7-bf9414b454bf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:41.744904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1bcf7716-631f-4322-85f7-bf9414b454bf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:41.753988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bcf7716-631f-4322-85f7-bf9414b454bf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:41.754878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bcf7716-631f-4322-85f7-bf9414b454bf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:41.755418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bcf7716-631f-4322-85f7-bf9414b454bf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:41.756393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bcf7716-631f-4322-85f7-bf9414b454bf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:41.757048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bcf7716-631f-4322-85f7-bf9414b454bf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:41.757548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1bcf7716-631f-4322-85f7-bf9414b454bf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:41.801476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f2d8ef83-f3f7-4abe-8ac8-c8c053b6c355 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:41.802387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f2d8ef83-f3f7-4abe-8ac8-c8c053b6c355 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:41.808790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2d8ef83-f3f7-4abe-8ac8-c8c053b6c355 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:41.809278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2d8ef83-f3f7-4abe-8ac8-c8c053b6c355 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:41.809740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2d8ef83-f3f7-4abe-8ac8-c8c053b6c355 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:41.810441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2d8ef83-f3f7-4abe-8ac8-c8c053b6c355 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:41.810860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2d8ef83-f3f7-4abe-8ac8-c8c053b6c355 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:41.811364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f2d8ef83-f3f7-4abe-8ac8-c8c053b6c355 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:41.964925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1bcf7716-631f-4322-85f7-bf9414b454bf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:41.973720 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1bcf7716-631f-4322-85f7-bf9414b454bf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1496 microversion: 2.1 time: 0.235133 Aug 09 15:11:41.974296 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3076/6164] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:41 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1496 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:41.996014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:41.996532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:42.002907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f2d8ef83-f3f7-4abe-8ac8-c8c053b6c355 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:42.004008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:42.004580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:42.005026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:42.005749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:42.006213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:42.006826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:42.011038 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f2d8ef83-f3f7-4abe-8ac8-c8c053b6c355 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1696 microversion: 2.1 time: 0.213480 Aug 09 15:11:42.011657 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3089/6165] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:41 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1696 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:42.032431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lazy-loading 'flavor' on Instance uuid 45050cee-c0fb-4f05-a875-a43d4b834957 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:11:42.045764 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Cannot 'suspend' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state suspended Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action HTTP/1.1 Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 15 Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: {"suspend": {}} Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: exception: Cannot 'suspend' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state suspended Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '45050cee-c0fb-4f05-a875-a43d4b834957', 'body': {'suspend': {}}} Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 09 15:11:42.047799 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state suspended Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state suspended Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 409 to user: Cannot 'suspend' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state suspended {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f91d0511-0460-44a9-892e-6c8d03a4b2be tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 409 len: 148 microversion: 2.1 time: 0.058212 Aug 09 15:11:42.052069 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3077/6166] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:41 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 148 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 15:11:42.059276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0470a70a-028e-4be7-92b3-5be4eefca8e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:42.059808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0470a70a-028e-4be7-92b3-5be4eefca8e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:42.065994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0470a70a-028e-4be7-92b3-5be4eefca8e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:42.066468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0470a70a-028e-4be7-92b3-5be4eefca8e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:42.066893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0470a70a-028e-4be7-92b3-5be4eefca8e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:42.067598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0470a70a-028e-4be7-92b3-5be4eefca8e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:42.068042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0470a70a-028e-4be7-92b3-5be4eefca8e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:42.068458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0470a70a-028e-4be7-92b3-5be4eefca8e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:42.137719 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0470a70a-028e-4be7-92b3-5be4eefca8e4 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 202 len: 0 microversion: 2.1 time: 0.082433 Aug 09 15:11:42.138382 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3090/6167] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:42 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:11:42.147369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e77f33f-df53-4f49-8dd9-0ab117b4f734 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:42.147984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5e77f33f-df53-4f49-8dd9-0ab117b4f734 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:42.154426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e77f33f-df53-4f49-8dd9-0ab117b4f734 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:42.155144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e77f33f-df53-4f49-8dd9-0ab117b4f734 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:42.155576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e77f33f-df53-4f49-8dd9-0ab117b4f734 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:42.156300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e77f33f-df53-4f49-8dd9-0ab117b4f734 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:42.156959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e77f33f-df53-4f49-8dd9-0ab117b4f734 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:42.157404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e77f33f-df53-4f49-8dd9-0ab117b4f734 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:42.397356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5e77f33f-df53-4f49-8dd9-0ab117b4f734 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:42.425733 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5e77f33f-df53-4f49-8dd9-0ab117b4f734 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1502 microversion: 2.1 time: 0.282341 Aug 09 15:11:42.428594 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3078/6168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:42 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1502 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:42.520701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94c69884-c2c9-4ea7-b8cd-b9f96dc99bf6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:42.521420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94c69884-c2c9-4ea7-b8cd-b9f96dc99bf6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] [instance: 3e3b597c-be37-40c7-a923-a5226b648d0a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:42.539960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94c69884-c2c9-4ea7-b8cd-b9f96dc99bf6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:42.540848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94c69884-c2c9-4ea7-b8cd-b9f96dc99bf6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:42.541640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94c69884-c2c9-4ea7-b8cd-b9f96dc99bf6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:42.542533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94c69884-c2c9-4ea7-b8cd-b9f96dc99bf6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:42.542963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94c69884-c2c9-4ea7-b8cd-b9f96dc99bf6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:42.543620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94c69884-c2c9-4ea7-b8cd-b9f96dc99bf6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:42.563708 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-94c69884-c2c9-4ea7-b8cd-b9f96dc99bf6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] HTTP exception thrown: Instance 3e3b597c-be37-40c7-a923-a5226b648d0a could not be found. Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94c69884-c2c9-4ea7-b8cd-b9f96dc99bf6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Request method failure captured: Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a HTTP/1.1 Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8ngx8srneDmbfWLjF0Eas36v7-mn_6AxXgo1b6xWmO_40N6IWbeI7jJi04naCa4ppbWtqiN8DEejm1hXjBR4zAyZtl9kJIk9WI0oTs0FGvX9161BtN6hpbm8fr5H5ft0uc0HhoOEjIzOQfWQ8XUHyQdS2SxSlSo4X7BkUMmCXCp6mjg Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f459e237ba2d464c8feeb733393804a9 Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestNetworkBasicOps-718665264 Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f459e237ba2d464c8feeb733393804a9", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f459e237ba2d464c8feeb733393804a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f459e237ba2d464c8feeb733393804a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f459e237ba2d464c8feeb733393804a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestNetworkBasicOps-718665264 Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f459e237ba2d464c8feeb733393804a9 Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestNetworkBasicOps-718665264 Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestNetworkBasicOps-718665264-project Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 7808d57a047f4fdfa852f71ff632619a Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestNetworkBasicOps-718665264-project Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 3e3b597c-be37-40c7-a923-a5226b648d0a could not be found. Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3e3b597c-be37-40c7-a923-a5226b648d0a'} Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e3b597c-be37-40c7-a923-a5226b648d0a could not be found. Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e3b597c-be37-40c7-a923-a5226b648d0a could not be found. Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:42.565418 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:42.571266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:42.571266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:42.571266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:42.571266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:42.571266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:42.571266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e3b597c-be37-40c7-a923-a5226b648d0a could not be found. Aug 09 15:11:42.571266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:42.571266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94c69884-c2c9-4ea7-b8cd-b9f96dc99bf6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Returning 404 to user: Instance 3e3b597c-be37-40c7-a923-a5226b648d0a could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:42.571266 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94c69884-c2c9-4ea7-b8cd-b9f96dc99bf6 tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a" status: 404 len: 111 microversion: 2.1 time: 0.051546 Aug 09 15:11:42.572692 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3091/6169] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:42 2022] GET /compute/v2.1/servers/3e3b597c-be37-40c7-a923-a5226b648d0a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:11:42.751610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-263fe0de-a758-4fa1-9b53-9548cfb484bd tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] Calling method '.version_select at 0x7f41ddc03040>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:42.781135 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-263fe0de-a758-4fa1-9b53-9548cfb484bd tempest-TestNetworkBasicOps-718665264 tempest-TestNetworkBasicOps-718665264-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2070038682" status: 202 len: 0 microversion: 2.1 time: 0.034045 Aug 09 15:11:42.785245 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3079/6170] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 9 15:11:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2070038682 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:11:43.034343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2b764d6f-5920-46ee-90f7-019939a28f4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:43.035117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2b764d6f-5920-46ee-90f7-019939a28f4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:43.041545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b764d6f-5920-46ee-90f7-019939a28f4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:43.042024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b764d6f-5920-46ee-90f7-019939a28f4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:43.042452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b764d6f-5920-46ee-90f7-019939a28f4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:43.043167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b764d6f-5920-46ee-90f7-019939a28f4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:43.043612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b764d6f-5920-46ee-90f7-019939a28f4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:43.044027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b764d6f-5920-46ee-90f7-019939a28f4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:43.119439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-573394863", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1707078583", "security_groups": [{"name": "tempest-secgroup-smoke-1854134793"}], "block_device_mapping_v2": [{"uuid": "0e829688-47ad-4663-8ba1-912c54e38660", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:43.197856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b764d6f-5920-46ee-90f7-019939a28f4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:43.210681 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2b764d6f-5920-46ee-90f7-019939a28f4c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1681 microversion: 2.1 time: 0.181199 Aug 09 15:11:43.212131 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3092/6171] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:43 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:43.250724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] validate_networks() for [('1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:11:43.449016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a469fd75-4da1-47a5-8863-eb9735b1e4fe tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:43.449622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a469fd75-4da1-47a5-8863-eb9735b1e4fe tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:43.456031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a469fd75-4da1-47a5-8863-eb9735b1e4fe tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:43.457302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a469fd75-4da1-47a5-8863-eb9735b1e4fe tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:43.457932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a469fd75-4da1-47a5-8863-eb9735b1e4fe tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:43.458705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a469fd75-4da1-47a5-8863-eb9735b1e4fe tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:43.459191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a469fd75-4da1-47a5-8863-eb9735b1e4fe tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:43.459592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a469fd75-4da1-47a5-8863-eb9735b1e4fe tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:43.748882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a469fd75-4da1-47a5-8863-eb9735b1e4fe tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:43.757284 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a469fd75-4da1-47a5-8863-eb9735b1e4fe tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1502 microversion: 2.1 time: 0.312154 Aug 09 15:11:43.758908 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3093/6172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:43 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1502 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:11:43.789671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:11:43.790265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:11:43.790802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:11:43.791327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:11:43.791819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:11:43.801910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:43.802501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:43.803020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:43.803967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:43.804507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:43.805008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:43.833573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:11:43.841573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for user f99b0693d22442ffa84b9c845d7cbc58 and project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:11:43.909109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:11:43.911447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e829688-47ad-4663-8ba1-912c54e38660',volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:11:44.082087 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-05db87c2-1a4b-49d9-b8ab-cfc869725373 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.966985 Aug 09 15:11:44.083398 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3080/6173] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:11:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:11:44.095391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c254c5f6-64ea-494f-9e92-a598ecda4b66 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:44.096285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c254c5f6-64ea-494f-9e92-a598ecda4b66 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:44.157911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c254c5f6-64ea-494f-9e92-a598ecda4b66 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:44.166100 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c254c5f6-64ea-494f-9e92-a598ecda4b66 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1094 microversion: 2.1 time: 0.074694 Aug 09 15:11:44.167954 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3094/6174] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:44 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:44.462104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5e56af43-53ea-40a4-91f4-e9ffc04c73b1 req-6534f123-e2b4-4377-8395-d9a7f12a00db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc", "name": "network-vif-plugged", "status": "completed", "tag": "121e83ca-5774-40be-b800-5f19db460b9e"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:44.484312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5e56af43-53ea-40a4-91f4-e9ffc04c73b1 req-6534f123-e2b4-4377-8395-d9a7f12a00db service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:44.485213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5e56af43-53ea-40a4-91f4-e9ffc04c73b1 req-6534f123-e2b4-4377-8395-d9a7f12a00db service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:44.485664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5e56af43-53ea-40a4-91f4-e9ffc04c73b1 req-6534f123-e2b4-4377-8395-d9a7f12a00db service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:44.522808 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5e56af43-53ea-40a4-91f4-e9ffc04c73b1 req-6534f123-e2b4-4377-8395-d9a7f12a00db service nova] Creating event network-vif-plugged:121e83ca-5774-40be-b800-5f19db460b9e for instance 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc on n-h1-844626-8 Aug 09 15:11:44.543184 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5e56af43-53ea-40a4-91f4-e9ffc04c73b1 req-6534f123-e2b4-4377-8395-d9a7f12a00db service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085919 Aug 09 15:11:44.544099 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3081/6175] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:44.779793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f93c727a-09d8-4224-a3aa-93ee9d16629a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:44.780583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f93c727a-09d8-4224-a3aa-93ee9d16629a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:44.793165 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f93c727a-09d8-4224-a3aa-93ee9d16629a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:44.793815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f93c727a-09d8-4224-a3aa-93ee9d16629a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:44.794470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f93c727a-09d8-4224-a3aa-93ee9d16629a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:44.795355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f93c727a-09d8-4224-a3aa-93ee9d16629a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:44.795876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f93c727a-09d8-4224-a3aa-93ee9d16629a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:44.796366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f93c727a-09d8-4224-a3aa-93ee9d16629a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:44.956182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f93c727a-09d8-4224-a3aa-93ee9d16629a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:44.970356 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f93c727a-09d8-4224-a3aa-93ee9d16629a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.194860 Aug 09 15:11:44.983198 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3095/6176] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:44 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:11:44.995377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be54d48c-12d1-42fb-bfdc-78e52f008c64 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:44.996121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be54d48c-12d1-42fb-bfdc-78e52f008c64 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:45.003228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be54d48c-12d1-42fb-bfdc-78e52f008c64 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:45.003803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be54d48c-12d1-42fb-bfdc-78e52f008c64 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:45.004261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be54d48c-12d1-42fb-bfdc-78e52f008c64 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:45.005003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be54d48c-12d1-42fb-bfdc-78e52f008c64 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:45.005664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be54d48c-12d1-42fb-bfdc-78e52f008c64 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:45.006266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be54d48c-12d1-42fb-bfdc-78e52f008c64 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:45.166156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-be54d48c-12d1-42fb-bfdc-78e52f008c64 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:45.170179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:45.175797 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be54d48c-12d1-42fb-bfdc-78e52f008c64 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.185773 Aug 09 15:11:45.188230 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3082/6177] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:44 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:45.190614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-99486a99-08aa-4fd7-a007-2617804c84e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:45.191575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-99486a99-08aa-4fd7-a007-2617804c84e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:45.199720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c814e621-9588-45d3-81cc-4d32c6feaf0d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:45.200629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c814e621-9588-45d3-81cc-4d32c6feaf0d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 4fb273b2-26aa-4089-8994-2a9df67cf85d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:45.202319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99486a99-08aa-4fd7-a007-2617804c84e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:45.203287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99486a99-08aa-4fd7-a007-2617804c84e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:45.203998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99486a99-08aa-4fd7-a007-2617804c84e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:45.205022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99486a99-08aa-4fd7-a007-2617804c84e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:45.205796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99486a99-08aa-4fd7-a007-2617804c84e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:45.206469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-99486a99-08aa-4fd7-a007-2617804c84e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:45.222022 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-c814e621-9588-45d3-81cc-4d32c6feaf0d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 4fb273b2-26aa-4089-8994-2a9df67cf85d could not be found. Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c814e621-9588-45d3-81cc-4d32c6feaf0d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/4fb273b2-26aa-4089-8994-2a9df67cf85d/action HTTP/1.1 Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 15 Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: {"unpause": {}} Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 4fb273b2-26aa-4089-8994-2a9df67cf85d could not be found. Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '4fb273b2-26aa-4089-8994-2a9df67cf85d', 'body': {'unpause': {}}} Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb273b2-26aa-4089-8994-2a9df67cf85d could not be found. Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb273b2-26aa-4089-8994-2a9df67cf85d could not be found. Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:45.227537 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:45.232868 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:45.232868 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:45.232868 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb273b2-26aa-4089-8994-2a9df67cf85d could not be found. Aug 09 15:11:45.232868 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:45.232868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c814e621-9588-45d3-81cc-4d32c6feaf0d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 4fb273b2-26aa-4089-8994-2a9df67cf85d could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:45.232868 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c814e621-9588-45d3-81cc-4d32c6feaf0d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/4fb273b2-26aa-4089-8994-2a9df67cf85d/action" status: 404 len: 111 microversion: 2.1 time: 0.036981 Aug 09 15:11:45.232868 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3083/6178] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:45 2022] POST /compute/v2.1/servers/4fb273b2-26aa-4089-8994-2a9df67cf85d/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:11:45.254419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c8e937b3-728a-436b-ae3c-ec8eea8e3288 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:45.256001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c8e937b3-728a-436b-ae3c-ec8eea8e3288 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:45.282573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8e937b3-728a-436b-ae3c-ec8eea8e3288 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:45.283116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8e937b3-728a-436b-ae3c-ec8eea8e3288 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:45.283562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8e937b3-728a-436b-ae3c-ec8eea8e3288 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:45.284481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8e937b3-728a-436b-ae3c-ec8eea8e3288 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:45.285098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8e937b3-728a-436b-ae3c-ec8eea8e3288 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:45.285816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c8e937b3-728a-436b-ae3c-ec8eea8e3288 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:45.414775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-99486a99-08aa-4fd7-a007-2617804c84e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:45.423133 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-99486a99-08aa-4fd7-a007-2617804c84e3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1200 microversion: 2.1 time: 0.236678 Aug 09 15:11:45.423738 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3096/6179] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:45 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1200 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:45.653410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c8e937b3-728a-436b-ae3c-ec8eea8e3288 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:45.667032 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c8e937b3-728a-436b-ae3c-ec8eea8e3288 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.423948 Aug 09 15:11:45.667789 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3084/6180] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:45 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:45.695677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06c138a8-665c-4573-8097-01ee43e372fe tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:45.696337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-06c138a8-665c-4573-8097-01ee43e372fe tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:45.696472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e2da4132-a2d3-48a3-b241-5f47428b4c04 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:45.697006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e2da4132-a2d3-48a3-b241-5f47428b4c04 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:45.706697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06c138a8-665c-4573-8097-01ee43e372fe tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:45.709139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06c138a8-665c-4573-8097-01ee43e372fe tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:45.709877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06c138a8-665c-4573-8097-01ee43e372fe tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:45.710665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2da4132-a2d3-48a3-b241-5f47428b4c04 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:45.712195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2da4132-a2d3-48a3-b241-5f47428b4c04 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:45.712598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2da4132-a2d3-48a3-b241-5f47428b4c04 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:45.712723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06c138a8-665c-4573-8097-01ee43e372fe tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:45.713302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06c138a8-665c-4573-8097-01ee43e372fe tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:45.713840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06c138a8-665c-4573-8097-01ee43e372fe tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:45.717244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2da4132-a2d3-48a3-b241-5f47428b4c04 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:45.717744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2da4132-a2d3-48a3-b241-5f47428b4c04 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:45.718323 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2da4132-a2d3-48a3-b241-5f47428b4c04 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:45.789352 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-06c138a8-665c-4573-8097-01ee43e372fe tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.097827 Aug 09 15:11:45.793413 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3085/6181] 10.222.0.50 () {58 vars in 1293 bytes} [Tue Aug 9 15:11:45 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68/os-server-password => generated 116 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:46.054090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e2da4132-a2d3-48a3-b241-5f47428b4c04 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:46.071164 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e2da4132-a2d3-48a3-b241-5f47428b4c04 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.379000 Aug 09 15:11:46.071826 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3097/6182] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:45 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:46.098356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ec4d525-5652-4a79-bc71-3f490ba17cff tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:46.099861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ec4d525-5652-4a79-bc71-3f490ba17cff tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:46.109941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ec4d525-5652-4a79-bc71-3f490ba17cff tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:46.110755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ec4d525-5652-4a79-bc71-3f490ba17cff tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:46.111723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ec4d525-5652-4a79-bc71-3f490ba17cff tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:46.112724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ec4d525-5652-4a79-bc71-3f490ba17cff tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:46.113443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ec4d525-5652-4a79-bc71-3f490ba17cff tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:46.114091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ec4d525-5652-4a79-bc71-3f490ba17cff tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:46.172137 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-0ec4d525-5652-4a79-bc71-3f490ba17cff tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Cannot 'unpause' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ec4d525-5652-4a79-bc71-3f490ba17cff tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action HTTP/1.1 Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 15 Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: {"unpause": {}} Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: exception: Cannot 'unpause' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '45050cee-c0fb-4f05-a875-a43d4b834957', 'body': {'unpause': {}}} Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 in vm_state active. Cannot unpause while the instance is in this state. Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:46.174270 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:46.178347 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:46.178347 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:46.178347 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:46.178347 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:11:46.178347 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:46.181878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ec4d525-5652-4a79-bc71-3f490ba17cff tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 409 to user: Cannot 'unpause' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:46.183479 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ec4d525-5652-4a79-bc71-3f490ba17cff tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 409 len: 145 microversion: 2.1 time: 0.091278 Aug 09 15:11:46.184721 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3086/6183] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:46 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 145 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 15:11:46.194210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db51f7da-4272-44ef-b62b-c8deeebb31df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:46.195514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-db51f7da-4272-44ef-b62b-c8deeebb31df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:46.218050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db51f7da-4272-44ef-b62b-c8deeebb31df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:46.219369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db51f7da-4272-44ef-b62b-c8deeebb31df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:46.219993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db51f7da-4272-44ef-b62b-c8deeebb31df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:46.220971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db51f7da-4272-44ef-b62b-c8deeebb31df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:46.221451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db51f7da-4272-44ef-b62b-c8deeebb31df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:46.221943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db51f7da-4272-44ef-b62b-c8deeebb31df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:46.248768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:46.453527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-04e533fa-8e1c-44a2-be29-52ce184ddfbb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:46.454308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-04e533fa-8e1c-44a2-be29-52ce184ddfbb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:46.465373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-db51f7da-4272-44ef-b62b-c8deeebb31df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:46.474197 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-db51f7da-4272-44ef-b62b-c8deeebb31df tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.285256 Aug 09 15:11:46.476941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04e533fa-8e1c-44a2-be29-52ce184ddfbb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:46.477931 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3098/6184] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:46 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:46.478743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04e533fa-8e1c-44a2-be29-52ce184ddfbb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:46.479638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04e533fa-8e1c-44a2-be29-52ce184ddfbb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:46.482054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04e533fa-8e1c-44a2-be29-52ce184ddfbb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:46.482637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04e533fa-8e1c-44a2-be29-52ce184ddfbb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:46.483173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-04e533fa-8e1c-44a2-be29-52ce184ddfbb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:46.506853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62f6f20e-9be4-432e-aa7e-6d9d33af7c1f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:46.507864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-62f6f20e-9be4-432e-aa7e-6d9d33af7c1f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:46.536054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62f6f20e-9be4-432e-aa7e-6d9d33af7c1f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:46.536551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62f6f20e-9be4-432e-aa7e-6d9d33af7c1f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:46.536983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62f6f20e-9be4-432e-aa7e-6d9d33af7c1f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:46.537696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62f6f20e-9be4-432e-aa7e-6d9d33af7c1f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:46.538215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62f6f20e-9be4-432e-aa7e-6d9d33af7c1f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:46.538640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62f6f20e-9be4-432e-aa7e-6d9d33af7c1f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:46.651752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-04e533fa-8e1c-44a2-be29-52ce184ddfbb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:46.662269 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-04e533fa-8e1c-44a2-be29-52ce184ddfbb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1210 microversion: 2.1 time: 0.213038 Aug 09 15:11:46.663292 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3087/6185] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:46 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1210 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:46.822578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-62f6f20e-9be4-432e-aa7e-6d9d33af7c1f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:46.832420 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-62f6f20e-9be4-432e-aa7e-6d9d33af7c1f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.332999 Aug 09 15:11:46.833560 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3099/6186] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:46 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:46.856553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7af31d4e-b63b-4e66-b06e-75a73c3ddf19 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:46.860107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7af31d4e-b63b-4e66-b06e-75a73c3ddf19 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 2d9617cf-bd9a-4165-be8c-dd58fe1c4c6b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:46.882239 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-7af31d4e-b63b-4e66-b06e-75a73c3ddf19 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 2d9617cf-bd9a-4165-be8c-dd58fe1c4c6b could not be found. Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7af31d4e-b63b-4e66-b06e-75a73c3ddf19 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/2d9617cf-bd9a-4165-be8c-dd58fe1c4c6b/action HTTP/1.1 Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 18 Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: {"unshelve": null} Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 2d9617cf-bd9a-4165-be8c-dd58fe1c4c6b could not be found. Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '2d9617cf-bd9a-4165-be8c-dd58fe1c4c6b', 'body': {'unshelve': None}} Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d9617cf-bd9a-4165-be8c-dd58fe1c4c6b could not be found. Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d9617cf-bd9a-4165-be8c-dd58fe1c4c6b could not be found. Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:46.892047 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:46.900468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:46.900468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:46.900468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:46.900468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:46.900468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:46.900468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:46.900468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d9617cf-bd9a-4165-be8c-dd58fe1c4c6b could not be found. Aug 09 15:11:46.900468 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:46.900468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7af31d4e-b63b-4e66-b06e-75a73c3ddf19 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 2d9617cf-bd9a-4165-be8c-dd58fe1c4c6b could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:46.900468 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7af31d4e-b63b-4e66-b06e-75a73c3ddf19 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/2d9617cf-bd9a-4165-be8c-dd58fe1c4c6b/action" status: 404 len: 111 microversion: 2.1 time: 0.042156 Aug 09 15:11:46.900468 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3088/6187] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:46 2022] POST /compute/v2.1/servers/2d9617cf-bd9a-4165-be8c-dd58fe1c4c6b/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:11:46.902547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8f74f48e-0be5-4559-9694-d1434107dcfb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:46.903248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8f74f48e-0be5-4559-9694-d1434107dcfb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:46.911280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f74f48e-0be5-4559-9694-d1434107dcfb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:46.911764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f74f48e-0be5-4559-9694-d1434107dcfb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:46.912196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f74f48e-0be5-4559-9694-d1434107dcfb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:46.912894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f74f48e-0be5-4559-9694-d1434107dcfb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:46.918343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f74f48e-0be5-4559-9694-d1434107dcfb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:46.921809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8f74f48e-0be5-4559-9694-d1434107dcfb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:47.508835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8f74f48e-0be5-4559-9694-d1434107dcfb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:47.517138 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8f74f48e-0be5-4559-9694-d1434107dcfb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.618370 Aug 09 15:11:47.532995 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3100/6188] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:46 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:47.541584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d3ab30d2-0258-4d2d-87ad-f19d949269c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:47.545959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3ab30d2-0258-4d2d-87ad-f19d949269c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:47.558770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3ab30d2-0258-4d2d-87ad-f19d949269c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:47.559495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3ab30d2-0258-4d2d-87ad-f19d949269c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:47.560049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3ab30d2-0258-4d2d-87ad-f19d949269c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:47.560915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3ab30d2-0258-4d2d-87ad-f19d949269c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:47.561481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3ab30d2-0258-4d2d-87ad-f19d949269c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:47.562034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3ab30d2-0258-4d2d-87ad-f19d949269c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:47.685764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-26ba96a0-632a-4f94-aa46-3c54ea79536a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:47.686458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-26ba96a0-632a-4f94-aa46-3c54ea79536a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:47.692971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26ba96a0-632a-4f94-aa46-3c54ea79536a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:47.693526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26ba96a0-632a-4f94-aa46-3c54ea79536a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:47.694027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26ba96a0-632a-4f94-aa46-3c54ea79536a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:47.694799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26ba96a0-632a-4f94-aa46-3c54ea79536a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:47.695366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26ba96a0-632a-4f94-aa46-3c54ea79536a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:47.695848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-26ba96a0-632a-4f94-aa46-3c54ea79536a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:47.893982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d3ab30d2-0258-4d2d-87ad-f19d949269c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:47.903553 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d3ab30d2-0258-4d2d-87ad-f19d949269c6 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.365920 Aug 09 15:11:47.904981 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3089/6189] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:47 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:47.926198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ddaa3ac-bff2-4590-bf0d-adaf7955b94d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:47.926198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ddaa3ac-bff2-4590-bf0d-adaf7955b94d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:47.931863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ddaa3ac-bff2-4590-bf0d-adaf7955b94d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:47.933078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ddaa3ac-bff2-4590-bf0d-adaf7955b94d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:47.934149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ddaa3ac-bff2-4590-bf0d-adaf7955b94d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:47.935198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ddaa3ac-bff2-4590-bf0d-adaf7955b94d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:47.935672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ddaa3ac-bff2-4590-bf0d-adaf7955b94d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:47.936136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ddaa3ac-bff2-4590-bf0d-adaf7955b94d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:47.961583 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-0ddaa3ac-bff2-4590-bf0d-adaf7955b94d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Cannot 'unshelve' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ddaa3ac-bff2-4590-bf0d-adaf7955b94d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action HTTP/1.1 Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 18 Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: {"unshelve": null} Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: exception: Cannot 'unshelve' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '45050cee-c0fb-4f05-a875-a43d4b834957', 'body': {'unshelve': None}} Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 in vm_state active. Cannot unshelve while the instance is in this state. Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 15:11:47.963514 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 15:11:47.968165 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:11:47.968165 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:47.968165 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:47.968165 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:47.968165 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:47.968165 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:47.968165 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:47.968165 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:47.968165 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:47.968165 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active Aug 09 15:11:47.968165 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:47.969717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ddaa3ac-bff2-4590-bf0d-adaf7955b94d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 409 to user: Cannot 'unshelve' instance 45050cee-c0fb-4f05-a875-a43d4b834957 while it is in vm_state active {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:47.970767 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ddaa3ac-bff2-4590-bf0d-adaf7955b94d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action" status: 409 len: 146 microversion: 2.1 time: 0.050071 Aug 09 15:11:47.974644 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3090/6190] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:11:47 2022] POST /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957/action => generated 146 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 15:11:47.986041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e599c12-b83a-4fd5-8b6f-3edc452f8a0a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:47.986041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e599c12-b83a-4fd5-8b6f-3edc452f8a0a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:47.993368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e599c12-b83a-4fd5-8b6f-3edc452f8a0a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:47.993571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e599c12-b83a-4fd5-8b6f-3edc452f8a0a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:47.994173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e599c12-b83a-4fd5-8b6f-3edc452f8a0a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:47.995183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e599c12-b83a-4fd5-8b6f-3edc452f8a0a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:47.995859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e599c12-b83a-4fd5-8b6f-3edc452f8a0a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:47.996533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e599c12-b83a-4fd5-8b6f-3edc452f8a0a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:48.032922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-26ba96a0-632a-4f94-aa46-3c54ea79536a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:48.050450 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-26ba96a0-632a-4f94-aa46-3c54ea79536a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1278 microversion: 2.1 time: 0.368680 Aug 09 15:11:48.063138 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3101/6191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:47 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1278 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:48.570067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1e599c12-b83a-4fd5-8b6f-3edc452f8a0a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:48.579452 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e599c12-b83a-4fd5-8b6f-3edc452f8a0a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.602601 Aug 09 15:11:48.580070 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3091/6192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:47 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:48.605057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af61d93f-c2a1-4b7e-9d8e-b8854c1c2333 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:48.606437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-af61d93f-c2a1-4b7e-9d8e-b8854c1c2333 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:48.613965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af61d93f-c2a1-4b7e-9d8e-b8854c1c2333 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:48.614817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af61d93f-c2a1-4b7e-9d8e-b8854c1c2333 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:48.616544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af61d93f-c2a1-4b7e-9d8e-b8854c1c2333 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:48.619236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af61d93f-c2a1-4b7e-9d8e-b8854c1c2333 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:48.620093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af61d93f-c2a1-4b7e-9d8e-b8854c1c2333 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:48.621085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af61d93f-c2a1-4b7e-9d8e-b8854c1c2333 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:48.898752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-af61d93f-c2a1-4b7e-9d8e-b8854c1c2333 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:48.913482 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af61d93f-c2a1-4b7e-9d8e-b8854c1c2333 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.312617 Aug 09 15:11:48.915734 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3102/6193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:48 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:48.927706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-536b0074-20e0-47bb-b61a-992677ea8c30 req-15ff5cb5-56d4-406c-bebf-c29892d4c2de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4216e1f-0e73-447c-8a58-1a5b8c3b0475", "tag": "4a6faa88-23a1-475f-a9c3-e1723e901ed4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:48.952500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42769f22-b670-425c-a1dd-445f4f7c0627 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-152214222_updated"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:48.954113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-536b0074-20e0-47bb-b61a-992677ea8c30 req-15ff5cb5-56d4-406c-bebf-c29892d4c2de service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:48.954725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-536b0074-20e0-47bb-b61a-992677ea8c30 req-15ff5cb5-56d4-406c-bebf-c29892d4c2de service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:48.956010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-536b0074-20e0-47bb-b61a-992677ea8c30 req-15ff5cb5-56d4-406c-bebf-c29892d4c2de service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:48.958831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-42769f22-b670-425c-a1dd-445f4f7c0627 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 1347cbd1-9e2c-4c1c-ad1f-6ef463d330ab] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:48.968507 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-42769f22-b670-425c-a1dd-445f4f7c0627 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 1347cbd1-9e2c-4c1c-ad1f-6ef463d330ab could not be found. Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42769f22-b670-425c-a1dd-445f4f7c0627 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/servers/1347cbd1-9e2c-4c1c-ad1f-6ef463d330ab HTTP/1.1 Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 80 Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-152214222_updated"}} Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 1347cbd1-9e2c-4c1c-ad1f-6ef463d330ab could not be found. Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '1347cbd1-9e2c-4c1c-ad1f-6ef463d330ab', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-152214222_updated'}}} Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1347cbd1-9e2c-4c1c-ad1f-6ef463d330ab could not be found. Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 09 15:11:48.970868 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1347cbd1-9e2c-4c1c-ad1f-6ef463d330ab could not be found. Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1347cbd1-9e2c-4c1c-ad1f-6ef463d330ab could not be found. Aug 09 15:11:48.975699 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:48.982683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42769f22-b670-425c-a1dd-445f4f7c0627 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 1347cbd1-9e2c-4c1c-ad1f-6ef463d330ab could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:48.984102 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-42769f22-b670-425c-a1dd-445f4f7c0627 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "PUT /compute/v2.1/servers/1347cbd1-9e2c-4c1c-ad1f-6ef463d330ab" status: 404 len: 111 microversion: 2.1 time: 0.048718 Aug 09 15:11:48.985451 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3103/6194] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 9 15:11:48 2022] PUT /compute/v2.1/servers/1347cbd1-9e2c-4c1c-ad1f-6ef463d330ab => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:11:48.992401 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-536b0074-20e0-47bb-b61a-992677ea8c30 req-15ff5cb5-56d4-406c-bebf-c29892d4c2de service nova] Creating event network-changed:4a6faa88-23a1-475f-a9c3-e1723e901ed4 for instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 on n-h2-844626-8 Aug 09 15:11:48.994473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9da84df9-5f0f-418a-ba33-e4c50d82b85d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:48.995436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9da84df9-5f0f-418a-ba33-e4c50d82b85d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:49.005089 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-536b0074-20e0-47bb-b61a-992677ea8c30 req-15ff5cb5-56d4-406c-bebf-c29892d4c2de service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081430 Aug 09 15:11:49.009901 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3092/6195] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:11:49.011300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9da84df9-5f0f-418a-ba33-e4c50d82b85d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:49.012254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9da84df9-5f0f-418a-ba33-e4c50d82b85d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:49.013072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9da84df9-5f0f-418a-ba33-e4c50d82b85d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:49.015604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9da84df9-5f0f-418a-ba33-e4c50d82b85d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:49.016667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9da84df9-5f0f-418a-ba33-e4c50d82b85d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:49.017379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9da84df9-5f0f-418a-ba33-e4c50d82b85d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:49.075664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee6730ce-561c-4da7-b022-7d3110aa56d2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:49.076453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee6730ce-561c-4da7-b022-7d3110aa56d2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:49.084391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee6730ce-561c-4da7-b022-7d3110aa56d2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:49.085166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee6730ce-561c-4da7-b022-7d3110aa56d2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:49.085817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee6730ce-561c-4da7-b022-7d3110aa56d2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:49.086636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee6730ce-561c-4da7-b022-7d3110aa56d2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:49.087156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee6730ce-561c-4da7-b022-7d3110aa56d2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:49.087573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee6730ce-561c-4da7-b022-7d3110aa56d2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:49.452489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ee6730ce-561c-4da7-b022-7d3110aa56d2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:49.454279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9da84df9-5f0f-418a-ba33-e4c50d82b85d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:49.466359 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9da84df9-5f0f-418a-ba33-e4c50d82b85d tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.476503 Aug 09 15:11:49.469417 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee6730ce-561c-4da7-b022-7d3110aa56d2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1278 microversion: 2.1 time: 0.399335 Aug 09 15:11:49.470516 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3093/6197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:49 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1278 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:49.483431 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3104/6197] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:48 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:49.496934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5543747e-1b59-4886-aa29-14c5c045e36c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:49.498306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5543747e-1b59-4886-aa29-14c5c045e36c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:49.508290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5543747e-1b59-4886-aa29-14c5c045e36c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:49.509017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5543747e-1b59-4886-aa29-14c5c045e36c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:49.509494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5543747e-1b59-4886-aa29-14c5c045e36c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:49.510255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5543747e-1b59-4886-aa29-14c5c045e36c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:49.510973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5543747e-1b59-4886-aa29-14c5c045e36c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:49.512711 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5543747e-1b59-4886-aa29-14c5c045e36c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:49.764517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5543747e-1b59-4886-aa29-14c5c045e36c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:49.774563 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5543747e-1b59-4886-aa29-14c5c045e36c tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.284791 Aug 09 15:11:49.787936 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3094/6198] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:49 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:49.798018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72db37f3-7697-40ac-adf8-d469dd46ea89 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72db37f3-7697-40ac-adf8-d469dd46ea89 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: request: PUT /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 HTTP/1.1 Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 280 Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '45050cee-c0fb-4f05-a875-a43d4b834957', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:49.804130 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 09 15:11:49.808453 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:49.811999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72db37f3-7697-40ac-adf8-d469dd46ea89 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:49.813124 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72db37f3-7697-40ac-adf8-d469dd46ea89 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "PUT /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 400 len: 619 microversion: 2.1 time: 0.020225 Aug 09 15:11:49.817393 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3105/6199] 10.222.0.50 () {60 vars in 1257 bytes} [Tue Aug 9 15:11:49 2022] PUT /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:11:49.829596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e39fa156-c1ad-45c1-91f2-f0c46e022eac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:49.836799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e39fa156-c1ad-45c1-91f2-f0c46e022eac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:49.846022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e39fa156-c1ad-45c1-91f2-f0c46e022eac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:49.846638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e39fa156-c1ad-45c1-91f2-f0c46e022eac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:49.847220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e39fa156-c1ad-45c1-91f2-f0c46e022eac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:49.848228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e39fa156-c1ad-45c1-91f2-f0c46e022eac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:49.848912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e39fa156-c1ad-45c1-91f2-f0c46e022eac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:49.849704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e39fa156-c1ad-45c1-91f2-f0c46e022eac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:50.103811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e39fa156-c1ad-45c1-91f2-f0c46e022eac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:50.115796 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e39fa156-c1ad-45c1-91f2-f0c46e022eac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.290056 Aug 09 15:11:50.117127 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3095/6200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:49 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:50.140542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf998765-ee42-4244-973e-9ba47dc0f16a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:50.141246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf998765-ee42-4244-973e-9ba47dc0f16a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:50.151543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf998765-ee42-4244-973e-9ba47dc0f16a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:50.152608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf998765-ee42-4244-973e-9ba47dc0f16a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:50.153122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf998765-ee42-4244-973e-9ba47dc0f16a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:50.154017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf998765-ee42-4244-973e-9ba47dc0f16a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:50.154562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf998765-ee42-4244-973e-9ba47dc0f16a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:50.155048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf998765-ee42-4244-973e-9ba47dc0f16a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:50.390956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bf998765-ee42-4244-973e-9ba47dc0f16a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:50.400428 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf998765-ee42-4244-973e-9ba47dc0f16a tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.263035 Aug 09 15:11:50.405136 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3106/6201] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:50 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:50.424350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2758510-7df1-4312-9f4b-b59965adff88 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2758510-7df1-4312-9f4b-b59965adff88 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: request: PUT /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 HTTP/1.1 Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 24 Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: {"server": {"name": ""}} Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '45050cee-c0fb-4f05-a875-a43d4b834957', 'body': {'server': {'name': ''}}} Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise error Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi '' Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 15:11:50.429127 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 09 15:11:50.434009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:50.434009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:50.434009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:50.434009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:50.434009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:50.434009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:50.434009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 15:11:50.434009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 15:11:50.434009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 09 15:11:50.434009 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:50.438921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2758510-7df1-4312-9f4b-b59965adff88 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:50.440237 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f2758510-7df1-4312-9f4b-b59965adff88 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "PUT /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 400 len: 108 microversion: 2.1 time: 0.020654 Aug 09 15:11:50.450741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a685ebd7-5ea2-48ce-b3f3-29079984bccf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:50.451710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a685ebd7-5ea2-48ce-b3f3-29079984bccf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:50.455662 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3096/6202] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 9 15:11:50 2022] PUT /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:11:50.460798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a685ebd7-5ea2-48ce-b3f3-29079984bccf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:50.461554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a685ebd7-5ea2-48ce-b3f3-29079984bccf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:50.462234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a685ebd7-5ea2-48ce-b3f3-29079984bccf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:50.463777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a685ebd7-5ea2-48ce-b3f3-29079984bccf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:50.464792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a685ebd7-5ea2-48ce-b3f3-29079984bccf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:50.466091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a685ebd7-5ea2-48ce-b3f3-29079984bccf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:50.507283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4509bf7a-33fc-4409-9ada-21c2dbda9f9c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:50.508195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4509bf7a-33fc-4409-9ada-21c2dbda9f9c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:50.520591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4509bf7a-33fc-4409-9ada-21c2dbda9f9c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:50.524592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4509bf7a-33fc-4409-9ada-21c2dbda9f9c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:50.525795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4509bf7a-33fc-4409-9ada-21c2dbda9f9c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:50.528390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4509bf7a-33fc-4409-9ada-21c2dbda9f9c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:50.529112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4509bf7a-33fc-4409-9ada-21c2dbda9f9c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:50.533094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4509bf7a-33fc-4409-9ada-21c2dbda9f9c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:50.824866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4509bf7a-33fc-4409-9ada-21c2dbda9f9c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:50.828255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a685ebd7-5ea2-48ce-b3f3-29079984bccf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:50.837431 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4509bf7a-33fc-4409-9ada-21c2dbda9f9c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1278 microversion: 2.1 time: 0.351229 Aug 09 15:11:50.837947 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a685ebd7-5ea2-48ce-b3f3-29079984bccf tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1505 microversion: 2.1 time: 0.392163 Aug 09 15:11:50.838295 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3097/6203] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:50 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1278 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:11:50.849810 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3107/6204] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:50 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:51.859607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6254503f-da73-4b44-adde-1fc00143302f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:51.861487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6254503f-da73-4b44-adde-1fc00143302f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:51.878661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6254503f-da73-4b44-adde-1fc00143302f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:51.879185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6254503f-da73-4b44-adde-1fc00143302f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:51.879649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6254503f-da73-4b44-adde-1fc00143302f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:51.880489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6254503f-da73-4b44-adde-1fc00143302f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:51.880967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6254503f-da73-4b44-adde-1fc00143302f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:51.881411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6254503f-da73-4b44-adde-1fc00143302f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:52.080699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6254503f-da73-4b44-adde-1fc00143302f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:52.089914 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6254503f-da73-4b44-adde-1fc00143302f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1278 microversion: 2.1 time: 0.235579 Aug 09 15:11:52.090868 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3098/6205] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:51 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:53.138155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-63410fcc-4bbe-4836-a751-8939cf1e974f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:53.138155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-63410fcc-4bbe-4836-a751-8939cf1e974f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:53.145210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63410fcc-4bbe-4836-a751-8939cf1e974f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:53.145791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63410fcc-4bbe-4836-a751-8939cf1e974f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:53.146292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63410fcc-4bbe-4836-a751-8939cf1e974f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:53.147078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63410fcc-4bbe-4836-a751-8939cf1e974f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:53.147625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63410fcc-4bbe-4836-a751-8939cf1e974f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:53.148985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-63410fcc-4bbe-4836-a751-8939cf1e974f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:53.363271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-63410fcc-4bbe-4836-a751-8939cf1e974f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:53.370978 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-63410fcc-4bbe-4836-a751-8939cf1e974f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1266 microversion: 2.1 time: 0.262783 Aug 09 15:11:53.372155 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3108/6206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:53 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1266 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:54.395020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d4ddc3de-0287-43dc-b4cb-42839d88b112 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:54.395618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d4ddc3de-0287-43dc-b4cb-42839d88b112 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:54.410858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:54.412265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:54.416917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4ddc3de-0287-43dc-b4cb-42839d88b112 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:54.417754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4ddc3de-0287-43dc-b4cb-42839d88b112 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:54.418370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4ddc3de-0287-43dc-b4cb-42839d88b112 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:54.421825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4ddc3de-0287-43dc-b4cb-42839d88b112 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:54.423293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4ddc3de-0287-43dc-b4cb-42839d88b112 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:54.423919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d4ddc3de-0287-43dc-b4cb-42839d88b112 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:54.707378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d4ddc3de-0287-43dc-b4cb-42839d88b112 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:54.716144 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d4ddc3de-0287-43dc-b4cb-42839d88b112 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1266 microversion: 2.1 time: 0.326875 Aug 09 15:11:54.716827 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3099/6207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:54 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:55.736118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:11:55.741201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a5d7266-14a9-4fe2-8b4a-2623c2ff7dd5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:55.741621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a5d7266-14a9-4fe2-8b4a-2623c2ff7dd5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:55.753160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5d7266-14a9-4fe2-8b4a-2623c2ff7dd5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:55.753656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5d7266-14a9-4fe2-8b4a-2623c2ff7dd5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:55.754108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5d7266-14a9-4fe2-8b4a-2623c2ff7dd5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:55.754805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5d7266-14a9-4fe2-8b4a-2623c2ff7dd5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:55.755295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5d7266-14a9-4fe2-8b4a-2623c2ff7dd5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:55.755721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a5d7266-14a9-4fe2-8b4a-2623c2ff7dd5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:55.981212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4a5d7266-14a9-4fe2-8b4a-2623c2ff7dd5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:55.992461 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a5d7266-14a9-4fe2-8b4a-2623c2ff7dd5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1266 microversion: 2.1 time: 0.257895 Aug 09 15:11:55.993826 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3109/6208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:55 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:57.016808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b367911d-f8e6-4b38-b9c6-9f13d24cdc9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:57.019066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b367911d-f8e6-4b38-b9c6-9f13d24cdc9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:57.032672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b367911d-f8e6-4b38-b9c6-9f13d24cdc9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:57.033469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b367911d-f8e6-4b38-b9c6-9f13d24cdc9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:57.034897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b367911d-f8e6-4b38-b9c6-9f13d24cdc9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:57.036472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b367911d-f8e6-4b38-b9c6-9f13d24cdc9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:57.038815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b367911d-f8e6-4b38-b9c6-9f13d24cdc9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:57.039605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b367911d-f8e6-4b38-b9c6-9f13d24cdc9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:57.220373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b367911d-f8e6-4b38-b9c6-9f13d24cdc9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:57.229023 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b367911d-f8e6-4b38-b9c6-9f13d24cdc9d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1266 microversion: 2.1 time: 0.218861 Aug 09 15:11:57.230005 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3100/6209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:57 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:57.581313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9414feca-4940-477b-8029-327ad29be3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:57.582587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9414feca-4940-477b-8029-327ad29be3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:57.590856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9414feca-4940-477b-8029-327ad29be3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:57.591773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9414feca-4940-477b-8029-327ad29be3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:57.592448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9414feca-4940-477b-8029-327ad29be3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:57.593252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9414feca-4940-477b-8029-327ad29be3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:57.593934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9414feca-4940-477b-8029-327ad29be3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:57.594574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9414feca-4940-477b-8029-327ad29be3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:57.617532 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-9414feca-4940-477b-8029-327ad29be3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9414feca-4940-477b-8029-327ad29be3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 HTTP/1.1 Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '18649c3a-2c5b-41d2-8863-6a2c232ba535'} Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:57.619807 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:57.624937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:11:57.624937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:57.624937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:57.624937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:57.624937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:57.624937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:57.624937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:57.624937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:57.624937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:57.624937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:11:57.624937 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:11:57.627157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9414feca-4940-477b-8029-327ad29be3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:57.628240 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9414feca-4940-477b-8029-327ad29be3c5 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "DELETE /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 404 len: 111 microversion: 2.1 time: 0.051043 Aug 09 15:11:57.629504 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3110/6210] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:11:57 2022] DELETE /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:11:57.637677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4de460df-d148-434f-9887-8e15c8d440ac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:57.638666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4de460df-d148-434f-9887-8e15c8d440ac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 18649c3a-2c5b-41d2-8863-6a2c232ba535] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:57.645468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4de460df-d148-434f-9887-8e15c8d440ac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:57.646293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4de460df-d148-434f-9887-8e15c8d440ac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:57.646948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4de460df-d148-434f-9887-8e15c8d440ac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:57.648147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4de460df-d148-434f-9887-8e15c8d440ac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:57.648965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4de460df-d148-434f-9887-8e15c8d440ac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:57.649614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4de460df-d148-434f-9887-8e15c8d440ac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:57.675923 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4de460df-d148-434f-9887-8e15c8d440ac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4de460df-d148-434f-9887-8e15c8d440ac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 HTTP/1.1 Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '18649c3a-2c5b-41d2-8863-6a2c232ba535'} Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:11:57.677892 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:57.682350 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:11:57.682350 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:11:57.682350 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:11:57.682350 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:11:57.682350 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:11:57.682350 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. Aug 09 15:11:57.682350 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:11:57.684438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4de460df-d148-434f-9887-8e15c8d440ac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 18649c3a-2c5b-41d2-8863-6a2c232ba535 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:11:57.685580 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4de460df-d148-434f-9887-8e15c8d440ac tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535" status: 404 len: 111 microversion: 2.1 time: 0.052046 Aug 09 15:11:57.689676 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3101/6211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:57 2022] GET /compute/v2.1/servers/18649c3a-2c5b-41d2-8863-6a2c232ba535 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:11:57.696133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b7eec31-2eeb-4d56-8a15-5934f23ac4c1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:57.696639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5b7eec31-2eeb-4d56-8a15-5934f23ac4c1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:57.705551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b7eec31-2eeb-4d56-8a15-5934f23ac4c1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:57.706050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b7eec31-2eeb-4d56-8a15-5934f23ac4c1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:57.706480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b7eec31-2eeb-4d56-8a15-5934f23ac4c1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:57.707385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b7eec31-2eeb-4d56-8a15-5934f23ac4c1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:57.708049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b7eec31-2eeb-4d56-8a15-5934f23ac4c1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:57.708473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b7eec31-2eeb-4d56-8a15-5934f23ac4c1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:57.737663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5b7eec31-2eeb-4d56-8a15-5934f23ac4c1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:11:57.849270 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5b7eec31-2eeb-4d56-8a15-5934f23ac4c1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "DELETE /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 204 len: 0 microversion: 2.1 time: 0.158111 Aug 09 15:11:57.853004 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3111/6212] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:11:57 2022] DELETE /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:11:57.858998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d2fa953-321f-4c8f-811d-82fe5b506beb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:57.860023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3d2fa953-321f-4c8f-811d-82fe5b506beb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:57.866553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d2fa953-321f-4c8f-811d-82fe5b506beb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:57.867512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d2fa953-321f-4c8f-811d-82fe5b506beb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:57.868448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d2fa953-321f-4c8f-811d-82fe5b506beb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:57.869464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d2fa953-321f-4c8f-811d-82fe5b506beb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:57.870210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d2fa953-321f-4c8f-811d-82fe5b506beb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:57.870941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d2fa953-321f-4c8f-811d-82fe5b506beb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:58.073522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d2fa953-321f-4c8f-811d-82fe5b506beb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:58.083034 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d2fa953-321f-4c8f-811d-82fe5b506beb tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.228113 Aug 09 15:11:58.087196 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3102/6213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:57 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:58.251259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5fdc664-ba47-4e38-bec4-1f9e439f5938 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:58.252231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5fdc664-ba47-4e38-bec4-1f9e439f5938 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:58.258961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5fdc664-ba47-4e38-bec4-1f9e439f5938 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:58.259726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5fdc664-ba47-4e38-bec4-1f9e439f5938 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:58.260335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5fdc664-ba47-4e38-bec4-1f9e439f5938 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:58.261209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5fdc664-ba47-4e38-bec4-1f9e439f5938 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:58.262029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5fdc664-ba47-4e38-bec4-1f9e439f5938 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:58.262611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5fdc664-ba47-4e38-bec4-1f9e439f5938 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:58.410600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5fdc664-ba47-4e38-bec4-1f9e439f5938 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:58.420638 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5fdc664-ba47-4e38-bec4-1f9e439f5938 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1266 microversion: 2.1 time: 0.173985 Aug 09 15:11:58.421941 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3112/6214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:58 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:59.106166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-29e34a40-e6e0-4c0a-977d-b75356d0d17f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:59.106774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-29e34a40-e6e0-4c0a-977d-b75356d0d17f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:59.114478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29e34a40-e6e0-4c0a-977d-b75356d0d17f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:59.115018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29e34a40-e6e0-4c0a-977d-b75356d0d17f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:59.115502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29e34a40-e6e0-4c0a-977d-b75356d0d17f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:59.120490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29e34a40-e6e0-4c0a-977d-b75356d0d17f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:59.120490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29e34a40-e6e0-4c0a-977d-b75356d0d17f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:59.120490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29e34a40-e6e0-4c0a-977d-b75356d0d17f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:59.272709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-29e34a40-e6e0-4c0a-977d-b75356d0d17f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:59.282095 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-29e34a40-e6e0-4c0a-977d-b75356d0d17f tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.180056 Aug 09 15:11:59.282858 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3103/6215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:59 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:11:59.445011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-46cd4154-3c98-4dfa-b6f7-08d41c73a69b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:11:59.445679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-46cd4154-3c98-4dfa-b6f7-08d41c73a69b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:11:59.453083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46cd4154-3c98-4dfa-b6f7-08d41c73a69b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:59.453569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46cd4154-3c98-4dfa-b6f7-08d41c73a69b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:59.454151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46cd4154-3c98-4dfa-b6f7-08d41c73a69b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:59.454864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46cd4154-3c98-4dfa-b6f7-08d41c73a69b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:11:59.455549 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46cd4154-3c98-4dfa-b6f7-08d41c73a69b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:11:59.455944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46cd4154-3c98-4dfa-b6f7-08d41c73a69b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:11:59.667295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-46cd4154-3c98-4dfa-b6f7-08d41c73a69b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:11:59.676714 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-46cd4154-3c98-4dfa-b6f7-08d41c73a69b tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1266 microversion: 2.1 time: 0.238281 Aug 09 15:11:59.681920 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3113/6216] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:11:59 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:00.304203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6b6b41e7-842d-4069-9383-a8828419aaa1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:00.307209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6b6b41e7-842d-4069-9383-a8828419aaa1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:12:00.311943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:12:00.318716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b6b41e7-842d-4069-9383-a8828419aaa1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:00.319411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b6b41e7-842d-4069-9383-a8828419aaa1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:00.320576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b6b41e7-842d-4069-9383-a8828419aaa1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:00.324714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b6b41e7-842d-4069-9383-a8828419aaa1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:00.327798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b6b41e7-842d-4069-9383-a8828419aaa1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:00.328332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6b6b41e7-842d-4069-9383-a8828419aaa1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:00.584239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6b6b41e7-842d-4069-9383-a8828419aaa1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc3904a6aa0a4c15ad2a0dd7fc5bb1a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d3cad59c0d546bf8b851b3da589b21a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:12:00.592652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:12:00.596473 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6b6b41e7-842d-4069-9383-a8828419aaa1 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 200 len: 1511 microversion: 2.1 time: 0.295797 Aug 09 15:12:00.607410 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3104/6217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:12:00 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 1511 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:00.699189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ac57ed86-4457-4551-8bb5-e7e2e1553a04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:00.700591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ac57ed86-4457-4551-8bb5-e7e2e1553a04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:12:00.713787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac57ed86-4457-4551-8bb5-e7e2e1553a04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:00.714282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac57ed86-4457-4551-8bb5-e7e2e1553a04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:00.714735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac57ed86-4457-4551-8bb5-e7e2e1553a04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:00.715907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac57ed86-4457-4551-8bb5-e7e2e1553a04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:00.715907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac57ed86-4457-4551-8bb5-e7e2e1553a04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:00.716306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac57ed86-4457-4551-8bb5-e7e2e1553a04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:00.984215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac57ed86-4457-4551-8bb5-e7e2e1553a04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:12:00.996364 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ac57ed86-4457-4551-8bb5-e7e2e1553a04 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1266 microversion: 2.1 time: 0.301970 Aug 09 15:12:00.998567 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3114/6218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:12:00 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:01.175576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-20060ff7-110d-44d9-bc8f-1aab4634ab93 req-05d61f3a-4f5f-46d6-b5a0-be541c075965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45050cee-c0fb-4f05-a875-a43d4b834957", "name": "network-vif-deleted", "tag": "d4da00d3-9767-424e-b34c-366c17cf1305"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:12:01.185953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-20060ff7-110d-44d9-bc8f-1aab4634ab93 req-05d61f3a-4f5f-46d6-b5a0-be541c075965 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:01.186454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-20060ff7-110d-44d9-bc8f-1aab4634ab93 req-05d61f3a-4f5f-46d6-b5a0-be541c075965 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:01.187064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-20060ff7-110d-44d9-bc8f-1aab4634ab93 req-05d61f3a-4f5f-46d6-b5a0-be541c075965 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:01.203416 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-20060ff7-110d-44d9-bc8f-1aab4634ab93 req-05d61f3a-4f5f-46d6-b5a0-be541c075965 service nova] Creating event network-vif-deleted:d4da00d3-9767-424e-b34c-366c17cf1305 for instance 45050cee-c0fb-4f05-a875-a43d4b834957 on n-h2-844626-8 Aug 09 15:12:01.209231 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-20060ff7-110d-44d9-bc8f-1aab4634ab93 req-05d61f3a-4f5f-46d6-b5a0-be541c075965 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354767 Aug 09 15:12:01.210166 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3105/6219] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:12:01.618653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e381bf14-d682-409c-a64e-7d0131734de8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:01.620288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e381bf14-d682-409c-a64e-7d0131734de8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] [instance: 45050cee-c0fb-4f05-a875-a43d4b834957] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:12:01.628576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e381bf14-d682-409c-a64e-7d0131734de8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:01.629079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e381bf14-d682-409c-a64e-7d0131734de8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:01.629637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e381bf14-d682-409c-a64e-7d0131734de8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:01.630645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e381bf14-d682-409c-a64e-7d0131734de8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:01.631194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e381bf14-d682-409c-a64e-7d0131734de8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:01.631634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e381bf14-d682-409c-a64e-7d0131734de8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:01.648550 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e381bf14-d682-409c-a64e-7d0131734de8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] HTTP exception thrown: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 could not be found. Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e381bf14-d682-409c-a64e-7d0131734de8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Request method failure captured: Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 HTTP/1.1 Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8niekXp_fgzXapJesk46FCQmtEZ4yh1PZ5iPzp-ITuinjYwgiLqjslEQNN5uJreR0S9FG_0mMIiwjrzpWrAaWkRmatmToMVxg8vjakAs0boxH_wWjpkh1FFrYP7nkWBdp8NxRypUdwCctRNDOsBXHSST4xC9MbeRFLseqXnVrARV59c Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9d3cad59c0d546bf8b851b3da589b21a", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9d3cad59c0d546bf8b851b3da589b21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9d3cad59c0d546bf8b851b3da589b21a Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-816677017 Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: cc3904a6aa0a4c15ad2a0dd7fc5bb1a4 Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-816677017-project Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 could not be found. Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '45050cee-c0fb-4f05-a875-a43d4b834957'} Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 could not be found. Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 could not be found. Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:12:01.650052 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:12:01.654716 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:12:01.654716 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:12:01.654716 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:12:01.654716 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:12:01.654716 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:12:01.654716 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 could not be found. Aug 09 15:12:01.654716 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:12:01.654716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e381bf14-d682-409c-a64e-7d0131734de8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] Returning 404 to user: Instance 45050cee-c0fb-4f05-a875-a43d4b834957 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:12:01.654716 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e381bf14-d682-409c-a64e-7d0131734de8 tempest-ServersNegativeTestJSON-816677017 tempest-ServersNegativeTestJSON-816677017-project] 10.222.0.50 "GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957" status: 404 len: 111 microversion: 2.1 time: 0.037566 Aug 09 15:12:01.654716 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3115/6220] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:12:01 2022] GET /compute/v2.1/servers/45050cee-c0fb-4f05-a875-a43d4b834957 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:12:02.020953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0562d58f-66e7-45b4-8f09-6e8208a51f9f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:02.021684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0562d58f-66e7-45b4-8f09-6e8208a51f9f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:12:02.028899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0562d58f-66e7-45b4-8f09-6e8208a51f9f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:02.029755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0562d58f-66e7-45b4-8f09-6e8208a51f9f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:02.030212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0562d58f-66e7-45b4-8f09-6e8208a51f9f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:02.030937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0562d58f-66e7-45b4-8f09-6e8208a51f9f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:02.031474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0562d58f-66e7-45b4-8f09-6e8208a51f9f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:02.031914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0562d58f-66e7-45b4-8f09-6e8208a51f9f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:02.398331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0562d58f-66e7-45b4-8f09-6e8208a51f9f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:12:02.412707 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0562d58f-66e7-45b4-8f09-6e8208a51f9f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1266 microversion: 2.1 time: 0.397147 Aug 09 15:12:02.426990 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3106/6221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:12:02 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1266 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:03.020769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-682ea4b2-9cdd-45ed-84bf-2f896a275936 req-023fc153-24e7-450d-b8e5-c8eccd3844a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4216e1f-0e73-447c-8a58-1a5b8c3b0475", "name": "network-vif-plugged", "status": "completed", "tag": "4a6faa88-23a1-475f-a9c3-e1723e901ed4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:12:03.035766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-682ea4b2-9cdd-45ed-84bf-2f896a275936 req-023fc153-24e7-450d-b8e5-c8eccd3844a3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:03.036521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-682ea4b2-9cdd-45ed-84bf-2f896a275936 req-023fc153-24e7-450d-b8e5-c8eccd3844a3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:03.037115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-682ea4b2-9cdd-45ed-84bf-2f896a275936 req-023fc153-24e7-450d-b8e5-c8eccd3844a3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:03.058931 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-682ea4b2-9cdd-45ed-84bf-2f896a275936 req-023fc153-24e7-450d-b8e5-c8eccd3844a3 service nova] Creating event network-vif-plugged:4a6faa88-23a1-475f-a9c3-e1723e901ed4 for instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 on n-h2-844626-8 Aug 09 15:12:03.066567 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-682ea4b2-9cdd-45ed-84bf-2f896a275936 req-023fc153-24e7-450d-b8e5-c8eccd3844a3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048865 Aug 09 15:12:03.067357 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3116/6222] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:12:03.434434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a3613815-a6d6-4a7e-94c2-bafc0a8d63fc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:03.435074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a3613815-a6d6-4a7e-94c2-bafc0a8d63fc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:12:03.443296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3613815-a6d6-4a7e-94c2-bafc0a8d63fc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:03.443798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3613815-a6d6-4a7e-94c2-bafc0a8d63fc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:03.444450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3613815-a6d6-4a7e-94c2-bafc0a8d63fc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:03.445374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3613815-a6d6-4a7e-94c2-bafc0a8d63fc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:03.446321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3613815-a6d6-4a7e-94c2-bafc0a8d63fc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:03.446752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a3613815-a6d6-4a7e-94c2-bafc0a8d63fc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:03.682374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a3613815-a6d6-4a7e-94c2-bafc0a8d63fc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:12:03.707391 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a3613815-a6d6-4a7e-94c2-bafc0a8d63fc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1266 microversion: 2.1 time: 0.277290 Aug 09 15:12:03.708021 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3107/6223] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:12:03 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:04.730815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32af6629-7b55-4359-bf1e-35853d24bec0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:04.731577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32af6629-7b55-4359-bf1e-35853d24bec0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:12:04.734726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:12:04.739361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32af6629-7b55-4359-bf1e-35853d24bec0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:04.739926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32af6629-7b55-4359-bf1e-35853d24bec0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:04.740267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32af6629-7b55-4359-bf1e-35853d24bec0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:04.740987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32af6629-7b55-4359-bf1e-35853d24bec0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:04.741436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32af6629-7b55-4359-bf1e-35853d24bec0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:04.741862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32af6629-7b55-4359-bf1e-35853d24bec0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:04.759314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:12:04.973316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-32af6629-7b55-4359-bf1e-35853d24bec0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:12:04.982268 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32af6629-7b55-4359-bf1e-35853d24bec0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1453 microversion: 2.1 time: 0.256836 Aug 09 15:12:04.982886 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3117/6224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:12:04 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1453 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:05.004136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c1c58fdf-4e4e-4905-b1f2-f35204c3ffed tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:05.004786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c1c58fdf-4e4e-4905-b1f2-f35204c3ffed tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:12:05.012692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c58fdf-4e4e-4905-b1f2-f35204c3ffed tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:05.013214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c58fdf-4e4e-4905-b1f2-f35204c3ffed tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:05.019383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c58fdf-4e4e-4905-b1f2-f35204c3ffed tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:05.020644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c58fdf-4e4e-4905-b1f2-f35204c3ffed tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:05.021140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c58fdf-4e4e-4905-b1f2-f35204c3ffed tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:05.021595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1c58fdf-4e4e-4905-b1f2-f35204c3ffed tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:05.281498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c1c58fdf-4e4e-4905-b1f2-f35204c3ffed tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:12:05.293596 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c1c58fdf-4e4e-4905-b1f2-f35204c3ffed tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1453 microversion: 2.1 time: 0.294068 Aug 09 15:12:05.300502 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3108/6225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:12:04 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1453 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:07.377725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-6c8ceaad-e14b-4e08-b2b3-0581a767aa14 req-3a26f7ba-4e26-41f3-b9d2-d7bd33aa43ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4216e1f-0e73-447c-8a58-1a5b8c3b0475", "tag": "4a6faa88-23a1-475f-a9c3-e1723e901ed4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:12:07.390123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6c8ceaad-e14b-4e08-b2b3-0581a767aa14 req-3a26f7ba-4e26-41f3-b9d2-d7bd33aa43ed service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:07.390600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6c8ceaad-e14b-4e08-b2b3-0581a767aa14 req-3a26f7ba-4e26-41f3-b9d2-d7bd33aa43ed service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:07.391021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6c8ceaad-e14b-4e08-b2b3-0581a767aa14 req-3a26f7ba-4e26-41f3-b9d2-d7bd33aa43ed service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:07.405951 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-6c8ceaad-e14b-4e08-b2b3-0581a767aa14 req-3a26f7ba-4e26-41f3-b9d2-d7bd33aa43ed service nova] Creating event network-changed:4a6faa88-23a1-475f-a9c3-e1723e901ed4 for instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 on n-h2-844626-8 Aug 09 15:12:07.411812 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-6c8ceaad-e14b-4e08-b2b3-0581a767aa14 req-3a26f7ba-4e26-41f3-b9d2-d7bd33aa43ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037709 Aug 09 15:12:07.412486 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3118/6226] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:12:07.496166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-16dfb6b7-6da1-47e7-be96-321493b5ef9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:12:07.500475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-16dfb6b7-6da1-47e7-be96-321493b5ef9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:12:07.508663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16dfb6b7-6da1-47e7-be96-321493b5ef9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:07.509505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16dfb6b7-6da1-47e7-be96-321493b5ef9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:07.510149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16dfb6b7-6da1-47e7-be96-321493b5ef9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:07.511021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16dfb6b7-6da1-47e7-be96-321493b5ef9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:07.511897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16dfb6b7-6da1-47e7-be96-321493b5ef9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:07.512486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-16dfb6b7-6da1-47e7-be96-321493b5ef9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:07.569604 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-16dfb6b7-6da1-47e7-be96-321493b5ef9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "POST /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc/action" status: 200 len: 24563 microversion: 2.1 time: 0.079313 Aug 09 15:12:07.571237 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3109/6227] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:12:07 2022] POST /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc/action => generated 24563 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 15:12:08.786160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d19a7a0-59dd-479b-a6a9-3c8008707665 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] Calling method '.version_select at 0x7f41dd6c6f70>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:08.834534 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3d19a7a0-59dd-479b-a6a9-3c8008707665 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/c4bb9605-d9d4-4a9b-8477-464effdbcab5" status: 200 len: 351 microversion: 2.1 time: 0.056408 Aug 09 15:12:08.835115 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3119/6228] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 15:12:08 2022] GET /compute/v2.1/os-volumes/c4bb9605-d9d4-4a9b-8477-464effdbcab5 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:12:10.217138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8ca9d13c-1e60-4622-8f29-f89f4812cdbd tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] Calling method '.version_select at 0x7f41ddaa4af0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:10.270907 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8ca9d13c-1e60-4622-8f29-f89f4812cdbd tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/cad598fe-018b-4445-8549-9526233788ef" status: 200 len: 349 microversion: 2.1 time: 0.058070 Aug 09 15:12:10.271524 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3110/6229] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 15:12:10 2022] GET /compute/v2.1/os-volumes/cad598fe-018b-4445-8549-9526233788ef => generated 349 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:12:11.676724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48a52236-c66c-4c9d-9af3-b12e5e35b9e9 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] Calling method '.version_select at 0x7f41dd72f160>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:11.728686 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48a52236-c66c-4c9d-9af3-b12e5e35b9e9 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/e31959ce-70e5-4d34-922b-78221c33c3eb" status: 200 len: 351 microversion: 2.1 time: 0.057210 Aug 09 15:12:11.729399 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3120/6230] 10.222.0.50 () {58 vars in 1245 bytes} [Tue Aug 9 15:12:11 2022] GET /compute/v2.1/os-volumes/e31959ce-70e5-4d34-922b-78221c33c3eb => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:12:11.743693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d00c44ba-2188-4f01-b500-4a877cba1184 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] Calling method '.version_select at 0x7f41dd34b1f0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:11.831295 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d00c44ba-2188-4f01-b500-4a877cba1184 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092877 Aug 09 15:12:11.831888 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3111/6231] 10.222.0.50 () {58 vars in 1134 bytes} [Tue Aug 9 15:12:11 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:11.847317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-83e469c7-4320-46d1-97df-1fb5f3662b75 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] Calling method '.version_select at 0x7f41dd6c6c10>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:11.939981 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-83e469c7-4320-46d1-97df-1fb5f3662b75 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.097129 Aug 09 15:12:11.940606 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3121/6232] 10.222.0.50 () {58 vars in 1149 bytes} [Tue Aug 9 15:12:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:12:11.960152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a5053776-451c-4fc2-8116-bf08da83e749 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] Calling method '.version_select at 0x7f41dd9ca0d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:12.056839 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a5053776-451c-4fc2-8116-bf08da83e749 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.104796 Aug 09 15:12:12.057460 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3112/6233] 10.222.0.50 () {58 vars in 1134 bytes} [Tue Aug 9 15:12:11 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:12.072392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de91d127-f580-4ef2-b4c2-6f04b280efcb tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] Calling method '.version_select at 0x7f41dd32d280>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:12.165481 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de91d127-f580-4ef2-b4c2-6f04b280efcb tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.097315 Aug 09 15:12:12.166123 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3122/6234] 10.222.0.50 () {58 vars in 1167 bytes} [Tue Aug 9 15:12:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:12:12.180823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c139e226-b5b0-41eb-9456-b37e354778f2 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] Calling method '.version_select at 0x7f41dd9820d0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:12.321797 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c139e226-b5b0-41eb-9456-b37e354778f2 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.144827 Aug 09 15:12:12.322406 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3113/6235] 10.222.0.50 () {58 vars in 1170 bytes} [Tue Aug 9 15:12:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:12:12.341547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b1d5c57-c74c-40ce-a26f-78c1d3080ef7 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] Calling method '.version_select at 0x7f41e7507310>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:12.439501 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5b1d5c57-c74c-40ce-a26f-78c1d3080ef7 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.101706 Aug 09 15:12:12.440491 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3123/6236] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 15:12:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:12.459535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0f097b3-9c97-4379-9e2e-5fc587e8b96d tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] Calling method '.version_select at 0x7f41dd1ea700>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:12.555840 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0f097b3-9c97-4379-9e2e-5fc587e8b96d tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.100440 Aug 09 15:12:12.556586 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3114/6237] 10.222.0.50 () {58 vars in 1188 bytes} [Tue Aug 9 15:12:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:12:12.572616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-602d1165-c315-40ab-b895-041afbd03f80 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] Calling method '.version_select at 0x7f41dd72fca0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:12.661683 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-602d1165-c315-40ab-b895-041afbd03f80 tempest-VolumesTestJSON-1222333771 tempest-VolumesTestJSON-1222333771-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.093521 Aug 09 15:12:12.662246 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3124/6238] 10.222.0.50 () {58 vars in 1155 bytes} [Tue Aug 9 15:12:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:15.629779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-dfb01540-7469-46ef-92d7-0b4d831e2b7b req-f63ac06c-5889-495e-bfc1-61b2355304c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc", "tag": "121e83ca-5774-40be-b800-5f19db460b9e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:12:15.637225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-58420bb0-de0e-456a-b93a-4db250e54d97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:15.638008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-58420bb0-de0e-456a-b93a-4db250e54d97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:12:15.655887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58420bb0-de0e-456a-b93a-4db250e54d97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:15.656781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58420bb0-de0e-456a-b93a-4db250e54d97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:15.657419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58420bb0-de0e-456a-b93a-4db250e54d97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:15.661936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dfb01540-7469-46ef-92d7-0b4d831e2b7b req-f63ac06c-5889-495e-bfc1-61b2355304c1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:15.662421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58420bb0-de0e-456a-b93a-4db250e54d97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:15.663277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58420bb0-de0e-456a-b93a-4db250e54d97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:15.663907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58420bb0-de0e-456a-b93a-4db250e54d97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:15.668242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dfb01540-7469-46ef-92d7-0b4d831e2b7b req-f63ac06c-5889-495e-bfc1-61b2355304c1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:15.669019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-dfb01540-7469-46ef-92d7-0b4d831e2b7b req-f63ac06c-5889-495e-bfc1-61b2355304c1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:15.692958 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-dfb01540-7469-46ef-92d7-0b4d831e2b7b req-f63ac06c-5889-495e-bfc1-61b2355304c1 service nova] Creating event network-changed:121e83ca-5774-40be-b800-5f19db460b9e for instance 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc on n-h1-844626-8 Aug 09 15:12:15.705705 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-dfb01540-7469-46ef-92d7-0b4d831e2b7b req-f63ac06c-5889-495e-bfc1-61b2355304c1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080729 Aug 09 15:12:15.709712 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3125/6239] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:12:15.716991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-58420bb0-de0e-456a-b93a-4db250e54d97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:12:15.899803 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-58420bb0-de0e-456a-b93a-4db250e54d97 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 204 len: 0 microversion: 2.1 time: 0.278936 Aug 09 15:12:15.900696 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3115/6240] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:12:15 2022] DELETE /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:12:15.915541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1904d71f-83a1-4f62-9576-4b27af27b65d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:15.916398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1904d71f-83a1-4f62-9576-4b27af27b65d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:12:15.936964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1904d71f-83a1-4f62-9576-4b27af27b65d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:15.937379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1904d71f-83a1-4f62-9576-4b27af27b65d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:15.937879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1904d71f-83a1-4f62-9576-4b27af27b65d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:15.938633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1904d71f-83a1-4f62-9576-4b27af27b65d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:15.939215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1904d71f-83a1-4f62-9576-4b27af27b65d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:15.939872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1904d71f-83a1-4f62-9576-4b27af27b65d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:16.249339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1904d71f-83a1-4f62-9576-4b27af27b65d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:12:16.286345 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1904d71f-83a1-4f62-9576-4b27af27b65d tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1687 microversion: 2.1 time: 0.375046 Aug 09 15:12:16.289037 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3126/6241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:12:15 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1687 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:17.330481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b518679-bafc-4a29-9e10-4a9fc46ece51 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:17.337964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b518679-bafc-4a29-9e10-4a9fc46ece51 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:12:17.353243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b518679-bafc-4a29-9e10-4a9fc46ece51 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:17.353690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b518679-bafc-4a29-9e10-4a9fc46ece51 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:17.354405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b518679-bafc-4a29-9e10-4a9fc46ece51 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:17.355380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b518679-bafc-4a29-9e10-4a9fc46ece51 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:17.356003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b518679-bafc-4a29-9e10-4a9fc46ece51 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:17.356719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b518679-bafc-4a29-9e10-4a9fc46ece51 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:17.561377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b518679-bafc-4a29-9e10-4a9fc46ece51 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ff3b746851a4414ba60cb76ac07056b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '889fa240e1f5494d9c11803acd77f74b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:12:17.576053 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b518679-bafc-4a29-9e10-4a9fc46ece51 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 200 len: 1687 microversion: 2.1 time: 0.253270 Aug 09 15:12:17.577363 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3116/6242] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:12:17 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 1687 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:12:18.027225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-571b4108-b50a-4fdb-950f-4115c34b1d42 req-9cb1af31-9fbd-4968-bb92-52d24d7a54d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc", "name": "network-vif-deleted", "tag": "121e83ca-5774-40be-b800-5f19db460b9e"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:12:18.046808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-571b4108-b50a-4fdb-950f-4115c34b1d42 req-9cb1af31-9fbd-4968-bb92-52d24d7a54d8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:18.048397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-571b4108-b50a-4fdb-950f-4115c34b1d42 req-9cb1af31-9fbd-4968-bb92-52d24d7a54d8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:18.049214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-571b4108-b50a-4fdb-950f-4115c34b1d42 req-9cb1af31-9fbd-4968-bb92-52d24d7a54d8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:18.075976 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-571b4108-b50a-4fdb-950f-4115c34b1d42 req-9cb1af31-9fbd-4968-bb92-52d24d7a54d8 service nova] Creating event network-vif-deleted:121e83ca-5774-40be-b800-5f19db460b9e for instance 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc on n-h1-844626-8 Aug 09 15:12:18.085609 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-571b4108-b50a-4fdb-950f-4115c34b1d42 req-9cb1af31-9fbd-4968-bb92-52d24d7a54d8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062264 Aug 09 15:12:18.087252 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3127/6243] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:12:18.600421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f1d28a8-9d2a-4cd7-a405-8e2087ebed9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:18.601631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f1d28a8-9d2a-4cd7-a405-8e2087ebed9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] [instance: 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:12:18.608857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f1d28a8-9d2a-4cd7-a405-8e2087ebed9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:18.609512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f1d28a8-9d2a-4cd7-a405-8e2087ebed9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:18.610223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f1d28a8-9d2a-4cd7-a405-8e2087ebed9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:18.611350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f1d28a8-9d2a-4cd7-a405-8e2087ebed9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:12:18.612415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f1d28a8-9d2a-4cd7-a405-8e2087ebed9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:12:18.613178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f1d28a8-9d2a-4cd7-a405-8e2087ebed9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:12:18.630872 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4f1d28a8-9d2a-4cd7-a405-8e2087ebed9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] HTTP exception thrown: Instance 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc could not be found. Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f1d28a8-9d2a-4cd7-a405-8e2087ebed9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Request method failure captured: Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc HTTP/1.1 Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8ncQl_OhnXzPfN37y_gQhZaTw8hyB7aUw1NVxqhnUDpImauOwqDZAMMA42Q0FA5K7BfkHzf96pPtBJHzwEloK0wLejr0pDUs8uplO9kHt2X-z743m5Z_VT211uUGD7Pn_KaW3ovVx3B-Ge_U1JFiW4MIUR6sycWgiLcRVamLUpSKu6I Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 889fa240e1f5494d9c11803acd77f74b Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-543221961 Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_889fa240e1f5494d9c11803acd77f74b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/889fa240e1f5494d9c11803acd77f74b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/889fa240e1f5494d9c11803acd77f74b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/889fa240e1f5494d9c11803acd77f74b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-543221961 Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 889fa240e1f5494d9c11803acd77f74b Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-543221961 Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestNetworkAdvancedServerOps-543221961-project Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 9ff3b746851a4414ba60cb76ac07056b Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-543221961-project Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc could not be found. Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc'} Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc could not be found. Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc could not be found. Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:12:18.632683 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:12:18.637811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:12:18.637811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:12:18.637811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:12:18.637811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:12:18.637811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:12:18.637811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:12:18.637811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc could not be found. Aug 09 15:12:18.637811 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:12:18.637811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f1d28a8-9d2a-4cd7-a405-8e2087ebed9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Returning 404 to user: Instance 8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:12:18.637811 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f1d28a8-9d2a-4cd7-a405-8e2087ebed9c tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc" status: 404 len: 111 microversion: 2.1 time: 0.040138 Aug 09 15:12:18.638823 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3117/6244] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:12:18 2022] GET /compute/v2.1/servers/8c13f8ff-0dc8-4a80-bb16-1efd1d7fbfdc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:12:23.163862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-91eed959-1a38-462f-9cd5-95765f1dbeb3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] Calling method '.version_select at 0x7f41dd6e2430>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:12:23.195966 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-91eed959-1a38-462f-9cd5-95765f1dbeb3 tempest-TestNetworkAdvancedServerOps-543221961 tempest-TestNetworkAdvancedServerOps-543221961-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1538523278" status: 202 len: 0 microversion: 2.1 time: 0.036542 Aug 09 15:12:23.196728 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3128/6245] 10.222.0.50 () {58 vars in 1284 bytes} [Tue Aug 9 15:12:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1538523278 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:13:47.645097 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:13:47.645097 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:13:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:13:47.709519 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:13:47.710036 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:13:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:13:51.287262 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:13:51.287888 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:13:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:14:05.908419 n-d-844626-8 devstack@n-api.service[119406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2072e827-cf31-416a-97b9-dec37834bdb2] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:14:05.910301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:05.912531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:05.918251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5ee522e6-3935-4726-a709-1b3847cb4b24 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:05.919025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ee522e6-3935-4726-a709-1b3847cb4b24 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:05.932451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee522e6-3935-4726-a709-1b3847cb4b24 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:05.933129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee522e6-3935-4726-a709-1b3847cb4b24 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:05.933741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee522e6-3935-4726-a709-1b3847cb4b24 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:05.934894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee522e6-3935-4726-a709-1b3847cb4b24 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:05.935751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee522e6-3935-4726-a709-1b3847cb4b24 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:05.936178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5ee522e6-3935-4726-a709-1b3847cb4b24 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:05.981600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5ee522e6-3935-4726-a709-1b3847cb4b24 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:14:06.100179 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5ee522e6-3935-4726-a709-1b3847cb4b24 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 204 len: 0 microversion: 2.1 time: 0.193711 Aug 09 15:14:06.101967 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3118/6246] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:14:05 2022] DELETE /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 15:14:06.113153 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96165289-31fc-4874-b2d8-1756550c06bf] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:14:06.114019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=15 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:06.115765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:06.124570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2473cd9e-07a8-4ae7-b407-fab11df09e62 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:06.125871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2473cd9e-07a8-4ae7-b407-fab11df09e62 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:06.137437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2473cd9e-07a8-4ae7-b407-fab11df09e62 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:06.138408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2473cd9e-07a8-4ae7-b407-fab11df09e62 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:06.139111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2473cd9e-07a8-4ae7-b407-fab11df09e62 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:06.140480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2473cd9e-07a8-4ae7-b407-fab11df09e62 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:06.141269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2473cd9e-07a8-4ae7-b407-fab11df09e62 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:06.142004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2473cd9e-07a8-4ae7-b407-fab11df09e62 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:06.545052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2473cd9e-07a8-4ae7-b407-fab11df09e62 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:06.556894 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2473cd9e-07a8-4ae7-b407-fab11df09e62 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1578 microversion: 2.1 time: 0.448105 Aug 09 15:14:06.559395 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3129/6247] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:06 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1578 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:07.588381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2de77a04-7a21-47f5-8ac7-b50e85b557c5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:07.589193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2de77a04-7a21-47f5-8ac7-b50e85b557c5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:07.604676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2de77a04-7a21-47f5-8ac7-b50e85b557c5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:07.605341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2de77a04-7a21-47f5-8ac7-b50e85b557c5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:07.605928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2de77a04-7a21-47f5-8ac7-b50e85b557c5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:07.606860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2de77a04-7a21-47f5-8ac7-b50e85b557c5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:07.607489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2de77a04-7a21-47f5-8ac7-b50e85b557c5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:07.608160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2de77a04-7a21-47f5-8ac7-b50e85b557c5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:07.647746 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] [2072e827-cf31-416a-97b9-dec37834bdb2] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 46404. Aug 09 15:14:07.874581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2de77a04-7a21-47f5-8ac7-b50e85b557c5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:07.889415 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2de77a04-7a21-47f5-8ac7-b50e85b557c5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1578 microversion: 2.1 time: 0.306841 Aug 09 15:14:07.890836 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3119/6248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:07 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1578 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:14:08.928227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f9938d37-8596-4136-9c56-43389d1280f5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:08.930282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f9938d37-8596-4136-9c56-43389d1280f5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:08.947621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9938d37-8596-4136-9c56-43389d1280f5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:08.948671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9938d37-8596-4136-9c56-43389d1280f5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:08.949539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9938d37-8596-4136-9c56-43389d1280f5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:08.951011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9938d37-8596-4136-9c56-43389d1280f5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:08.952156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9938d37-8596-4136-9c56-43389d1280f5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:08.953058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f9938d37-8596-4136-9c56-43389d1280f5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:09.044924 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [96165289-31fc-4874-b2d8-1756550c06bf] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 46414. Aug 09 15:14:09.145181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f9938d37-8596-4136-9c56-43389d1280f5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:09.165221 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f9938d37-8596-4136-9c56-43389d1280f5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1510 microversion: 2.1 time: 0.243798 Aug 09 15:14:09.167118 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3130/6249] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:08 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:09.631635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-224eb5c0-0d18-4443-8f2b-2e2cb0d423a3 req-cc6ff215-33e3-4e79-95fc-61cf6e856eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4216e1f-0e73-447c-8a58-1a5b8c3b0475", "name": "network-vif-deleted", "tag": "4a6faa88-23a1-475f-a9c3-e1723e901ed4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:14:09.657169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-224eb5c0-0d18-4443-8f2b-2e2cb0d423a3 req-cc6ff215-33e3-4e79-95fc-61cf6e856eae service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:09.658076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-224eb5c0-0d18-4443-8f2b-2e2cb0d423a3 req-cc6ff215-33e3-4e79-95fc-61cf6e856eae service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:09.662073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-224eb5c0-0d18-4443-8f2b-2e2cb0d423a3 req-cc6ff215-33e3-4e79-95fc-61cf6e856eae service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:09.713621 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-224eb5c0-0d18-4443-8f2b-2e2cb0d423a3 req-cc6ff215-33e3-4e79-95fc-61cf6e856eae service nova] Creating event network-vif-deleted:4a6faa88-23a1-475f-a9c3-e1723e901ed4 for instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 on n-h2-844626-8 Aug 09 15:14:09.731382 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-224eb5c0-0d18-4443-8f2b-2e2cb0d423a3 req-cc6ff215-33e3-4e79-95fc-61cf6e856eae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102802 Aug 09 15:14:09.733510 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3120/6250] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:14:10.195177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94db3685-c7f7-460c-ae9c-80d701aed6d1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:10.197378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94db3685-c7f7-460c-ae9c-80d701aed6d1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:10.215278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94db3685-c7f7-460c-ae9c-80d701aed6d1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:10.217704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94db3685-c7f7-460c-ae9c-80d701aed6d1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:10.218856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94db3685-c7f7-460c-ae9c-80d701aed6d1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:10.220863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94db3685-c7f7-460c-ae9c-80d701aed6d1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:10.222241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94db3685-c7f7-460c-ae9c-80d701aed6d1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:10.223425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94db3685-c7f7-460c-ae9c-80d701aed6d1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:10.357055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-94db3685-c7f7-460c-ae9c-80d701aed6d1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:10.370856 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94db3685-c7f7-460c-ae9c-80d701aed6d1 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1225 microversion: 2.1 time: 0.186756 Aug 09 15:14:10.372467 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3131/6251] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:10 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1225 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:11.393666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4cac4a60-7c00-4c06-b067-11b4be2b5325 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:11.394563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4cac4a60-7c00-4c06-b067-11b4be2b5325 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:11.401907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cac4a60-7c00-4c06-b067-11b4be2b5325 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:11.402605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cac4a60-7c00-4c06-b067-11b4be2b5325 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:11.403338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cac4a60-7c00-4c06-b067-11b4be2b5325 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:11.404212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cac4a60-7c00-4c06-b067-11b4be2b5325 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:11.404806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cac4a60-7c00-4c06-b067-11b4be2b5325 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:11.405343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4cac4a60-7c00-4c06-b067-11b4be2b5325 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:11.658453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4cac4a60-7c00-4c06-b067-11b4be2b5325 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:11.667350 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4cac4a60-7c00-4c06-b067-11b4be2b5325 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1225 microversion: 2.1 time: 0.278906 Aug 09 15:14:11.668113 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3121/6252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:11 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1225 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:12.689075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2ddec22f-e848-4884-88ba-7ecaa840cfef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:12.689691 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2ddec22f-e848-4884-88ba-7ecaa840cfef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:12.698952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ddec22f-e848-4884-88ba-7ecaa840cfef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:12.699778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ddec22f-e848-4884-88ba-7ecaa840cfef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:12.700420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ddec22f-e848-4884-88ba-7ecaa840cfef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:12.701351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ddec22f-e848-4884-88ba-7ecaa840cfef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:12.701964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ddec22f-e848-4884-88ba-7ecaa840cfef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:12.702578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2ddec22f-e848-4884-88ba-7ecaa840cfef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:12.809086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2ddec22f-e848-4884-88ba-7ecaa840cfef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:12.817959 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2ddec22f-e848-4884-88ba-7ecaa840cfef tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1225 microversion: 2.1 time: 0.132536 Aug 09 15:14:12.818916 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3132/6253] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:12 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1225 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:13.841116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d5ec9e12-0dd8-472e-a049-5c6e0aa40457 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:13.842531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d5ec9e12-0dd8-472e-a049-5c6e0aa40457 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:13.875063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ec9e12-0dd8-472e-a049-5c6e0aa40457 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:13.876050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ec9e12-0dd8-472e-a049-5c6e0aa40457 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:13.876685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ec9e12-0dd8-472e-a049-5c6e0aa40457 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:13.877611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ec9e12-0dd8-472e-a049-5c6e0aa40457 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:13.879783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ec9e12-0dd8-472e-a049-5c6e0aa40457 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:13.880450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d5ec9e12-0dd8-472e-a049-5c6e0aa40457 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:14.062934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d5ec9e12-0dd8-472e-a049-5c6e0aa40457 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:14.076319 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d5ec9e12-0dd8-472e-a049-5c6e0aa40457 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1225 microversion: 2.1 time: 0.236916 Aug 09 15:14:14.078190 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3122/6254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:13 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1225 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:15.099989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48447126-0352-4c66-a4c4-d7afd97a299c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:15.101417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48447126-0352-4c66-a4c4-d7afd97a299c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:15.109711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48447126-0352-4c66-a4c4-d7afd97a299c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:15.110480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48447126-0352-4c66-a4c4-d7afd97a299c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:15.111207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48447126-0352-4c66-a4c4-d7afd97a299c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:15.112403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48447126-0352-4c66-a4c4-d7afd97a299c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:15.113029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48447126-0352-4c66-a4c4-d7afd97a299c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:15.113439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48447126-0352-4c66-a4c4-d7afd97a299c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:15.444970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48447126-0352-4c66-a4c4-d7afd97a299c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:15.463018 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48447126-0352-4c66-a4c4-d7afd97a299c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1225 microversion: 2.1 time: 0.367507 Aug 09 15:14:15.479116 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3133/6255] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:15 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1225 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:16.490532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-faffb381-3b90-4a3e-84fd-07d0e6926a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:16.491202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-faffb381-3b90-4a3e-84fd-07d0e6926a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:16.498680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-faffb381-3b90-4a3e-84fd-07d0e6926a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:16.499226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-faffb381-3b90-4a3e-84fd-07d0e6926a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:16.499683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-faffb381-3b90-4a3e-84fd-07d0e6926a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:16.500402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-faffb381-3b90-4a3e-84fd-07d0e6926a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:16.500866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-faffb381-3b90-4a3e-84fd-07d0e6926a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:16.501301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-faffb381-3b90-4a3e-84fd-07d0e6926a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:16.574114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-faffb381-3b90-4a3e-84fd-07d0e6926a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:16.583121 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-faffb381-3b90-4a3e-84fd-07d0e6926a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 200 len: 1225 microversion: 2.1 time: 0.096525 Aug 09 15:14:16.583737 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3123/6256] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:16 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:17.609148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9df2dddd-89a7-4429-84ee-f753df68fae0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:17.611413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9df2dddd-89a7-4429-84ee-f753df68fae0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:17.623065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9df2dddd-89a7-4429-84ee-f753df68fae0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:17.623598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9df2dddd-89a7-4429-84ee-f753df68fae0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:17.624001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9df2dddd-89a7-4429-84ee-f753df68fae0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:17.624699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9df2dddd-89a7-4429-84ee-f753df68fae0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:17.625143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9df2dddd-89a7-4429-84ee-f753df68fae0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:17.625558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9df2dddd-89a7-4429-84ee-f753df68fae0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:17.645585 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-9df2dddd-89a7-4429-84ee-f753df68fae0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9df2dddd-89a7-4429-84ee-f753df68fae0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 HTTP/1.1 Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'a4216e1f-0e73-447c-8a58-1a5b8c3b0475'} Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:14:17.648263 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:14:17.653830 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:14:17.653830 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:14:17.653830 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:14:17.653830 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:14:17.653830 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:14:17.653830 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:14:17.653830 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:14:17.656002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9df2dddd-89a7-4429-84ee-f753df68fae0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:14:17.658326 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9df2dddd-89a7-4429-84ee-f753df68fae0 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 404 len: 111 microversion: 2.1 time: 0.052865 Aug 09 15:14:17.659291 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3134/6257] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:17 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:14:17.796040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-665431905", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1707078583", "security_groups": [{"name": "tempest-secgroup-smoke-1854134793"}], "block_device_mapping_v2": [{"uuid": "0e829688-47ad-4663-8ba1-912c54e38660", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:14:17.949425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] validate_networks() for [('1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:14:18.543055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:14:18.544322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:14:18.547431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:14:18.547860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:14:18.548515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:14:18.560946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:18.561734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:18.562338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:18.563304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:18.564412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:18.565397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:18.591245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:14:18.600605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for user f99b0693d22442ffa84b9c845d7cbc58 and project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:14:18.690158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:14:18.693040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0e829688-47ad-4663-8ba1-912c54e38660',volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:14:18.888047 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-27cacab4-48a2-42ec-9258-f2873c029068 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.095540 Aug 09 15:14:18.891208 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3124/6258] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:14:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:14:18.902783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bca6e42c-4759-4b7d-b243-c6d922c5a4eb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:18.903378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bca6e42c-4759-4b7d-b243-c6d922c5a4eb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:18.978062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bca6e42c-4759-4b7d-b243-c6d922c5a4eb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:18.986605 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bca6e42c-4759-4b7d-b243-c6d922c5a4eb tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1094 microversion: 2.1 time: 0.088039 Aug 09 15:14:18.987947 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3135/6259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:18 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:14:20.009731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-02aa3701-2354-4bb5-a2c3-ae144b16399a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:20.010998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-02aa3701-2354-4bb5-a2c3-ae144b16399a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:20.026029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa3701-2354-4bb5-a2c3-ae144b16399a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:20.026833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa3701-2354-4bb5-a2c3-ae144b16399a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:20.030169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa3701-2354-4bb5-a2c3-ae144b16399a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:20.031309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa3701-2354-4bb5-a2c3-ae144b16399a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:20.034100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa3701-2354-4bb5-a2c3-ae144b16399a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:20.035697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02aa3701-2354-4bb5-a2c3-ae144b16399a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:20.338973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-02aa3701-2354-4bb5-a2c3-ae144b16399a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:20.360618 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-02aa3701-2354-4bb5-a2c3-ae144b16399a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1192 microversion: 2.1 time: 0.356126 Aug 09 15:14:20.361880 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3125/6260] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:20 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1192 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:21.384966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0591dc00-855a-4b94-adc9-12296d4f3646 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:21.385619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0591dc00-855a-4b94-adc9-12296d4f3646 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:21.402729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0591dc00-855a-4b94-adc9-12296d4f3646 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:21.403263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0591dc00-855a-4b94-adc9-12296d4f3646 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:21.403764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0591dc00-855a-4b94-adc9-12296d4f3646 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:21.404425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0591dc00-855a-4b94-adc9-12296d4f3646 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:21.404898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0591dc00-855a-4b94-adc9-12296d4f3646 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:21.405320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0591dc00-855a-4b94-adc9-12296d4f3646 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:21.659933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0591dc00-855a-4b94-adc9-12296d4f3646 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:21.674078 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0591dc00-855a-4b94-adc9-12296d4f3646 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1278 microversion: 2.1 time: 0.294027 Aug 09 15:14:21.689966 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3136/6261] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:21 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1278 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:22.486182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-21bb45c4-a697-4a78-9351-f7d03fb55683 req-d7bae1f9-ae5a-468b-aeb8-32eb8c63aec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a", "tag": "849a5f7e-c19f-4237-9ccf-75d57b95a7c9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:14:22.505909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-21bb45c4-a697-4a78-9351-f7d03fb55683 req-d7bae1f9-ae5a-468b-aeb8-32eb8c63aec0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:22.506748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-21bb45c4-a697-4a78-9351-f7d03fb55683 req-d7bae1f9-ae5a-468b-aeb8-32eb8c63aec0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:22.507487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-21bb45c4-a697-4a78-9351-f7d03fb55683 req-d7bae1f9-ae5a-468b-aeb8-32eb8c63aec0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:22.525014 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-21bb45c4-a697-4a78-9351-f7d03fb55683 req-d7bae1f9-ae5a-468b-aeb8-32eb8c63aec0 service nova] Creating event network-changed:849a5f7e-c19f-4237-9ccf-75d57b95a7c9 for instance 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a on n-h2-844626-8 Aug 09 15:14:22.530917 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-21bb45c4-a697-4a78-9351-f7d03fb55683 req-d7bae1f9-ae5a-468b-aeb8-32eb8c63aec0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048591 Aug 09 15:14:22.531962 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3126/6262] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:14:22.697488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-601446a1-b121-4ac1-9c9b-f76a97ea13c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:22.698089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-601446a1-b121-4ac1-9c9b-f76a97ea13c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:22.706248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601446a1-b121-4ac1-9c9b-f76a97ea13c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:22.707238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601446a1-b121-4ac1-9c9b-f76a97ea13c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:22.707823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601446a1-b121-4ac1-9c9b-f76a97ea13c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:22.708675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601446a1-b121-4ac1-9c9b-f76a97ea13c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:22.709400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601446a1-b121-4ac1-9c9b-f76a97ea13c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:22.710076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601446a1-b121-4ac1-9c9b-f76a97ea13c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:23.074861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-601446a1-b121-4ac1-9c9b-f76a97ea13c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:23.084345 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-601446a1-b121-4ac1-9c9b-f76a97ea13c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1278 microversion: 2.1 time: 0.390951 Aug 09 15:14:23.085369 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3137/6263] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:22 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1278 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:24.134122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ddfe88bc-292d-4fd5-90f6-a7bd2fc5eb1c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:24.134122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ddfe88bc-292d-4fd5-90f6-a7bd2fc5eb1c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:24.134122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddfe88bc-292d-4fd5-90f6-a7bd2fc5eb1c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:24.134122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddfe88bc-292d-4fd5-90f6-a7bd2fc5eb1c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:24.134122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddfe88bc-292d-4fd5-90f6-a7bd2fc5eb1c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:24.134122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddfe88bc-292d-4fd5-90f6-a7bd2fc5eb1c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:24.134122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddfe88bc-292d-4fd5-90f6-a7bd2fc5eb1c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:24.134122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ddfe88bc-292d-4fd5-90f6-a7bd2fc5eb1c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:24.579030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ddfe88bc-292d-4fd5-90f6-a7bd2fc5eb1c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:24.588768 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ddfe88bc-292d-4fd5-90f6-a7bd2fc5eb1c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1278 microversion: 2.1 time: 0.486517 Aug 09 15:14:24.591220 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3127/6264] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:24 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1278 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:14:25.616611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db03a539-e1c7-4910-bd10-d49d113e8ab5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:25.617275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-db03a539-e1c7-4910-bd10-d49d113e8ab5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:25.631573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db03a539-e1c7-4910-bd10-d49d113e8ab5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:25.632080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db03a539-e1c7-4910-bd10-d49d113e8ab5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:25.632642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db03a539-e1c7-4910-bd10-d49d113e8ab5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:25.633384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db03a539-e1c7-4910-bd10-d49d113e8ab5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:25.633839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db03a539-e1c7-4910-bd10-d49d113e8ab5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:25.634265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db03a539-e1c7-4910-bd10-d49d113e8ab5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:25.844113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-db03a539-e1c7-4910-bd10-d49d113e8ab5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:25.860184 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-db03a539-e1c7-4910-bd10-d49d113e8ab5 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1278 microversion: 2.1 time: 0.247668 Aug 09 15:14:25.862206 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3138/6265] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:25 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1278 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:26.886531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d59e20e-8734-4ee8-855f-e3ca9d94d963 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:26.887493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d59e20e-8734-4ee8-855f-e3ca9d94d963 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:26.895926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d59e20e-8734-4ee8-855f-e3ca9d94d963 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:26.897758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d59e20e-8734-4ee8-855f-e3ca9d94d963 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:26.900712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d59e20e-8734-4ee8-855f-e3ca9d94d963 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:26.902559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d59e20e-8734-4ee8-855f-e3ca9d94d963 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:26.903544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d59e20e-8734-4ee8-855f-e3ca9d94d963 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:26.904132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d59e20e-8734-4ee8-855f-e3ca9d94d963 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:27.177806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d59e20e-8734-4ee8-855f-e3ca9d94d963 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:27.192333 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d59e20e-8734-4ee8-855f-e3ca9d94d963 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1278 microversion: 2.1 time: 0.309357 Aug 09 15:14:27.207824 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3128/6266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:26 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1278 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:28.221588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-771bfb53-ff8f-46bd-a9cf-ad8ed0d5f887 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:28.222176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-771bfb53-ff8f-46bd-a9cf-ad8ed0d5f887 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:28.230235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-771bfb53-ff8f-46bd-a9cf-ad8ed0d5f887 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:28.230837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-771bfb53-ff8f-46bd-a9cf-ad8ed0d5f887 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:28.231379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-771bfb53-ff8f-46bd-a9cf-ad8ed0d5f887 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:28.232201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-771bfb53-ff8f-46bd-a9cf-ad8ed0d5f887 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:28.232709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-771bfb53-ff8f-46bd-a9cf-ad8ed0d5f887 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:28.233230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-771bfb53-ff8f-46bd-a9cf-ad8ed0d5f887 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:28.467370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-771bfb53-ff8f-46bd-a9cf-ad8ed0d5f887 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:28.476996 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-771bfb53-ff8f-46bd-a9cf-ad8ed0d5f887 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1266 microversion: 2.1 time: 0.259431 Aug 09 15:14:28.477918 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3139/6267] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:28 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:29.498591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e86f6a4-5fd7-4af0-a24f-a4fdc0460c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:29.499305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e86f6a4-5fd7-4af0-a24f-a4fdc0460c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:29.503245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:29.503922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:29.508166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e86f6a4-5fd7-4af0-a24f-a4fdc0460c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:29.508679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e86f6a4-5fd7-4af0-a24f-a4fdc0460c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:29.509125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e86f6a4-5fd7-4af0-a24f-a4fdc0460c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:29.509884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e86f6a4-5fd7-4af0-a24f-a4fdc0460c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:29.510348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e86f6a4-5fd7-4af0-a24f-a4fdc0460c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:29.510908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e86f6a4-5fd7-4af0-a24f-a4fdc0460c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:29.697881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e86f6a4-5fd7-4af0-a24f-a4fdc0460c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:29.706703 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e86f6a4-5fd7-4af0-a24f-a4fdc0460c0a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1266 microversion: 2.1 time: 0.211901 Aug 09 15:14:29.707376 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3129/6268] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:29 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:30.730672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-93dd00ae-55ed-4842-bf14-54ec5bce8246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:30.731369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-93dd00ae-55ed-4842-bf14-54ec5bce8246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:30.733568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:30.744546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93dd00ae-55ed-4842-bf14-54ec5bce8246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:30.745535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93dd00ae-55ed-4842-bf14-54ec5bce8246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:30.746690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93dd00ae-55ed-4842-bf14-54ec5bce8246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:30.747818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93dd00ae-55ed-4842-bf14-54ec5bce8246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:30.748678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93dd00ae-55ed-4842-bf14-54ec5bce8246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:30.749147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-93dd00ae-55ed-4842-bf14-54ec5bce8246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:30.981512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-93dd00ae-55ed-4842-bf14-54ec5bce8246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:30.993452 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-93dd00ae-55ed-4842-bf14-54ec5bce8246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1266 microversion: 2.1 time: 0.268488 Aug 09 15:14:30.995171 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3140/6269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:30 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:32.022327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-66cba0bd-3940-44f2-9bfb-2821f56c30cc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:32.023289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-66cba0bd-3940-44f2-9bfb-2821f56c30cc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:32.037145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66cba0bd-3940-44f2-9bfb-2821f56c30cc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:32.037739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66cba0bd-3940-44f2-9bfb-2821f56c30cc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:32.038413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66cba0bd-3940-44f2-9bfb-2821f56c30cc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:32.039360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66cba0bd-3940-44f2-9bfb-2821f56c30cc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:32.040002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66cba0bd-3940-44f2-9bfb-2821f56c30cc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:32.040610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66cba0bd-3940-44f2-9bfb-2821f56c30cc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:32.288966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-66cba0bd-3940-44f2-9bfb-2821f56c30cc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:32.297245 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-66cba0bd-3940-44f2-9bfb-2821f56c30cc tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1266 microversion: 2.1 time: 0.279292 Aug 09 15:14:32.297988 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3130/6270] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:32 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:33.318944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-018a51c7-bb8f-4961-91a2-c5ae0b3d1a92 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:33.319756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-018a51c7-bb8f-4961-91a2-c5ae0b3d1a92 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:33.327823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-018a51c7-bb8f-4961-91a2-c5ae0b3d1a92 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:33.328283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-018a51c7-bb8f-4961-91a2-c5ae0b3d1a92 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:33.328737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-018a51c7-bb8f-4961-91a2-c5ae0b3d1a92 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:33.329444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-018a51c7-bb8f-4961-91a2-c5ae0b3d1a92 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:33.329828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-018a51c7-bb8f-4961-91a2-c5ae0b3d1a92 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:33.330238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-018a51c7-bb8f-4961-91a2-c5ae0b3d1a92 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:33.490325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-018a51c7-bb8f-4961-91a2-c5ae0b3d1a92 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:33.498754 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-018a51c7-bb8f-4961-91a2-c5ae0b3d1a92 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1266 microversion: 2.1 time: 0.184291 Aug 09 15:14:33.499381 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3141/6271] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:33 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:34.525088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-48949de7-7293-46f8-bbe1-c0d876ea4df9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:34.527164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-48949de7-7293-46f8-bbe1-c0d876ea4df9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:34.547779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48949de7-7293-46f8-bbe1-c0d876ea4df9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:34.548309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48949de7-7293-46f8-bbe1-c0d876ea4df9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:34.548812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48949de7-7293-46f8-bbe1-c0d876ea4df9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:34.549751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48949de7-7293-46f8-bbe1-c0d876ea4df9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:34.550396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48949de7-7293-46f8-bbe1-c0d876ea4df9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:34.550834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48949de7-7293-46f8-bbe1-c0d876ea4df9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:34.725307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-48949de7-7293-46f8-bbe1-c0d876ea4df9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:34.734123 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-48949de7-7293-46f8-bbe1-c0d876ea4df9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1266 microversion: 2.1 time: 0.215743 Aug 09 15:14:34.734929 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3131/6272] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:34 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:35.757422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79501698-2530-48be-b74a-5db849a6381a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:35.759325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79501698-2530-48be-b74a-5db849a6381a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:35.773198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79501698-2530-48be-b74a-5db849a6381a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:35.774525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79501698-2530-48be-b74a-5db849a6381a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:35.775177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79501698-2530-48be-b74a-5db849a6381a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:35.776529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79501698-2530-48be-b74a-5db849a6381a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:35.777152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79501698-2530-48be-b74a-5db849a6381a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:35.778102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79501698-2530-48be-b74a-5db849a6381a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:36.005000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-79501698-2530-48be-b74a-5db849a6381a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:36.022158 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79501698-2530-48be-b74a-5db849a6381a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1266 microversion: 2.1 time: 0.269516 Aug 09 15:14:36.022906 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3142/6273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:35 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:36.084974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b3f8a650-9a7b-41c5-be54-a43986f4be73 req-769f298a-b801-4358-a7a8-eadb2fc99c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a", "name": "network-vif-plugged", "status": "completed", "tag": "849a5f7e-c19f-4237-9ccf-75d57b95a7c9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:14:36.104439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:36.110624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b3f8a650-9a7b-41c5-be54-a43986f4be73 req-769f298a-b801-4358-a7a8-eadb2fc99c35 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:36.111119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b3f8a650-9a7b-41c5-be54-a43986f4be73 req-769f298a-b801-4358-a7a8-eadb2fc99c35 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:36.111770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b3f8a650-9a7b-41c5-be54-a43986f4be73 req-769f298a-b801-4358-a7a8-eadb2fc99c35 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:36.116911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:36.128221 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b3f8a650-9a7b-41c5-be54-a43986f4be73 req-769f298a-b801-4358-a7a8-eadb2fc99c35 service nova] Creating event network-vif-plugged:849a5f7e-c19f-4237-9ccf-75d57b95a7c9 for instance 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a on n-h2-844626-8 Aug 09 15:14:36.134697 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b3f8a650-9a7b-41c5-be54-a43986f4be73 req-769f298a-b801-4358-a7a8-eadb2fc99c35 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309768 Aug 09 15:14:36.135662 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3132/6274] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:14:37.043891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-47579b1b-5310-4a14-a2a9-2d0ac4eac246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:37.044686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-47579b1b-5310-4a14-a2a9-2d0ac4eac246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:37.049354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=31 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:37.054023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47579b1b-5310-4a14-a2a9-2d0ac4eac246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:37.054512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47579b1b-5310-4a14-a2a9-2d0ac4eac246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:37.054956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47579b1b-5310-4a14-a2a9-2d0ac4eac246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:37.055771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47579b1b-5310-4a14-a2a9-2d0ac4eac246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:37.056238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47579b1b-5310-4a14-a2a9-2d0ac4eac246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:37.056695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-47579b1b-5310-4a14-a2a9-2d0ac4eac246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:37.062103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=75 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:37.260780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-47579b1b-5310-4a14-a2a9-2d0ac4eac246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:37.271931 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-47579b1b-5310-4a14-a2a9-2d0ac4eac246 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1266 microversion: 2.1 time: 0.230803 Aug 09 15:14:37.273641 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3143/6275] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:37 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:38.295431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-49773f2c-d5a1-4e1c-817d-33110ce1121d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:38.296289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-49773f2c-d5a1-4e1c-817d-33110ce1121d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:38.305421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49773f2c-d5a1-4e1c-817d-33110ce1121d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:38.306089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49773f2c-d5a1-4e1c-817d-33110ce1121d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:38.306811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49773f2c-d5a1-4e1c-817d-33110ce1121d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:38.307646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49773f2c-d5a1-4e1c-817d-33110ce1121d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:38.308116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49773f2c-d5a1-4e1c-817d-33110ce1121d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:38.308554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-49773f2c-d5a1-4e1c-817d-33110ce1121d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:38.508548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-49773f2c-d5a1-4e1c-817d-33110ce1121d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:38.529871 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-49773f2c-d5a1-4e1c-817d-33110ce1121d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1453 microversion: 2.1 time: 0.240013 Aug 09 15:14:38.531641 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3133/6276] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:38 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1453 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:38.552937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1aa90d1c-aa7d-43fc-8827-f393fd23765f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:38.553835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1aa90d1c-aa7d-43fc-8827-f393fd23765f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:38.563446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1aa90d1c-aa7d-43fc-8827-f393fd23765f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:38.564192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1aa90d1c-aa7d-43fc-8827-f393fd23765f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:38.565636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1aa90d1c-aa7d-43fc-8827-f393fd23765f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:38.565636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1aa90d1c-aa7d-43fc-8827-f393fd23765f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:38.566024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1aa90d1c-aa7d-43fc-8827-f393fd23765f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:38.566745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1aa90d1c-aa7d-43fc-8827-f393fd23765f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:38.770698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1aa90d1c-aa7d-43fc-8827-f393fd23765f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:38.781270 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1aa90d1c-aa7d-43fc-8827-f393fd23765f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1453 microversion: 2.1 time: 0.232786 Aug 09 15:14:38.782290 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3144/6277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:38 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1453 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:41.453128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-60f160e1-13e4-4b60-b96d-1117a98fd942 req-7529e66d-eb14-476a-8f27-f24422745e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a", "tag": "849a5f7e-c19f-4237-9ccf-75d57b95a7c9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:14:41.469564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-60f160e1-13e4-4b60-b96d-1117a98fd942 req-7529e66d-eb14-476a-8f27-f24422745e3a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:41.470407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-60f160e1-13e4-4b60-b96d-1117a98fd942 req-7529e66d-eb14-476a-8f27-f24422745e3a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:41.471232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-60f160e1-13e4-4b60-b96d-1117a98fd942 req-7529e66d-eb14-476a-8f27-f24422745e3a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:41.484253 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-60f160e1-13e4-4b60-b96d-1117a98fd942 req-7529e66d-eb14-476a-8f27-f24422745e3a service nova] Creating event network-changed:849a5f7e-c19f-4237-9ccf-75d57b95a7c9 for instance 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a on n-h2-844626-8 Aug 09 15:14:41.490409 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-60f160e1-13e4-4b60-b96d-1117a98fd942 req-7529e66d-eb14-476a-8f27-f24422745e3a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325173 Aug 09 15:14:41.491765 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3134/6278] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:14:44.844376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7dfcca1-bc79-4927-9ffd-913838734d57 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Action: 'create', calling method: .version_select at 0x7f41dc934ca0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-972185802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDhqQOvS7xrHulc0jee3VcAVQWDXUZk8klDwA63ATnRKZ5YUGHp1z/VcINubZCiJBnri9sikZhCazuV33OSEC2SERGr6muK2OJBxawR8XSzE9deGudBkgs3s0dgSzFnzg=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:14:44.863225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b7dfcca1-bc79-4927-9ffd-913838734d57 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Getting quotas for project e4af26c4f08e42cc81d6b4c4e2f00f9d. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:14:44.870766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b7dfcca1-bc79-4927-9ffd-913838734d57 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Getting quotas for user 375ea430a3db455889741a2bc4a0f04e and project e4af26c4f08e42cc81d6b4c4e2f00f9d. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:14:44.888104 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b7dfcca1-bc79-4927-9ffd-913838734d57 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [fadd6a70-2e33-4e03-8a39-8347ea8602bf] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 15:14:45.895632 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [None req-b7dfcca1-bc79-4927-9ffd-913838734d57 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [fadd6a70-2e33-4e03-8a39-8347ea8602bf] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 47108. Aug 09 15:14:45.914543 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7dfcca1-bc79-4927-9ffd-913838734d57 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 1.074423 Aug 09 15:14:45.915204 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3145/6279] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:14:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:14:47.567503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1645752736", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b291b645-e2d4-4efb-999e-fcabdf160e0b", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-972185802", "security_groups": [{"name": "tempest-secgroup-smoke-2056868902"}], "networks": [{"uuid": "0e8ca54a-db33-4094-96f2-b823e5db1b5d"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:14:47.706862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] validate_networks() for [('0e8ca54a-db33-4094-96f2-b823e5db1b5d', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:14:48.178597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:14:48.179157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:14:48.179994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:14:48.180198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:14:48.180894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:14:48.192337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:48.192936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:48.193426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:48.194223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:48.194895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:48.195401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:48.219266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Getting quotas for project e4af26c4f08e42cc81d6b4c4e2f00f9d. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:14:48.226053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Getting quotas for user 375ea430a3db455889741a2bc4a0f04e and project e4af26c4f08e42cc81d6b4c4e2f00f9d. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:14:48.296248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:14:48.298851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b291b645-e2d4-4efb-999e-fcabdf160e0b',volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:14:48.463430 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-be2f883b-39eb-4ecb-814e-50829c3c436d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.901087 Aug 09 15:14:48.469414 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3135/6280] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:14:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:14:48.479610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6de0f3ad-0583-4038-8935-e15bb46f5e26 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:48.481341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6de0f3ad-0583-4038-8935-e15bb46f5e26 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:48.571459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6de0f3ad-0583-4038-8935-e15bb46f5e26 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:48.587441 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6de0f3ad-0583-4038-8935-e15bb46f5e26 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1098 microversion: 2.1 time: 0.112241 Aug 09 15:14:48.591485 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3146/6281] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:48 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1098 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:49.622905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-617890b3-98c3-409d-92cf-744918126fe4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:49.623717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-617890b3-98c3-409d-92cf-744918126fe4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:49.661121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-617890b3-98c3-409d-92cf-744918126fe4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:49.662776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-617890b3-98c3-409d-92cf-744918126fe4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:49.665374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-617890b3-98c3-409d-92cf-744918126fe4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:49.672207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-617890b3-98c3-409d-92cf-744918126fe4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:49.673794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-617890b3-98c3-409d-92cf-744918126fe4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:49.675510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-617890b3-98c3-409d-92cf-744918126fe4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:49.853145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-617890b3-98c3-409d-92cf-744918126fe4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:49.865915 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-617890b3-98c3-409d-92cf-744918126fe4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1204 microversion: 2.1 time: 0.258579 Aug 09 15:14:49.867466 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3136/6282] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:49 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1204 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:50.891353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a2672efd-58b9-45dd-9370-7959cbfbc7de tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:50.891991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a2672efd-58b9-45dd-9370-7959cbfbc7de tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:50.903547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=11 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:50.906397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2672efd-58b9-45dd-9370-7959cbfbc7de tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:50.906898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2672efd-58b9-45dd-9370-7959cbfbc7de tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:50.907397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2672efd-58b9-45dd-9370-7959cbfbc7de tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:50.908193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2672efd-58b9-45dd-9370-7959cbfbc7de tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:50.908658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2672efd-58b9-45dd-9370-7959cbfbc7de tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:50.909096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a2672efd-58b9-45dd-9370-7959cbfbc7de tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:51.253388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a2672efd-58b9-45dd-9370-7959cbfbc7de tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:51.261812 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a2672efd-58b9-45dd-9370-7959cbfbc7de tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1282 microversion: 2.1 time: 0.374287 Aug 09 15:14:51.262276 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3147/6283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:50 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1282 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:52.282186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-40faabb7-25f9-4864-9c98-0869d802c2d4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:52.284034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-40faabb7-25f9-4864-9c98-0869d802c2d4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:52.292113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40faabb7-25f9-4864-9c98-0869d802c2d4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:52.293088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40faabb7-25f9-4864-9c98-0869d802c2d4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:52.293858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40faabb7-25f9-4864-9c98-0869d802c2d4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:52.294952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40faabb7-25f9-4864-9c98-0869d802c2d4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:52.295787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40faabb7-25f9-4864-9c98-0869d802c2d4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:52.296448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-40faabb7-25f9-4864-9c98-0869d802c2d4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:52.481613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-40faabb7-25f9-4864-9c98-0869d802c2d4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:52.495054 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-40faabb7-25f9-4864-9c98-0869d802c2d4 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1282 microversion: 2.1 time: 0.216421 Aug 09 15:14:52.496980 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3137/6284] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:52 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1282 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:52.512027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9da96ade-003b-4040-b7eb-b2a39a99e42a req-15d6f5f0-5160-4846-9569-7b06421b2fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c542bd68-559f-4dc6-9841-2cf0b7c8f456", "tag": "5b9e018c-2330-4851-9f44-5ffbb7bc14d2"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:14:52.524282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9da96ade-003b-4040-b7eb-b2a39a99e42a req-15d6f5f0-5160-4846-9569-7b06421b2fe6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:52.525035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9da96ade-003b-4040-b7eb-b2a39a99e42a req-15d6f5f0-5160-4846-9569-7b06421b2fe6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:52.525630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9da96ade-003b-4040-b7eb-b2a39a99e42a req-15d6f5f0-5160-4846-9569-7b06421b2fe6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:52.539976 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9da96ade-003b-4040-b7eb-b2a39a99e42a req-15d6f5f0-5160-4846-9569-7b06421b2fe6 service nova] Creating event network-changed:5b9e018c-2330-4851-9f44-5ffbb7bc14d2 for instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 on n-h1-844626-8 Aug 09 15:14:52.544206 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [req-9da96ade-003b-4040-b7eb-b2a39a99e42a req-15d6f5f0-5160-4846-9569-7b06421b2fe6 service nova] [92b1b4a9-4b8a-44b2-bc10-f00a4e191b81] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 15:14:53.517551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f630048-daef-4ac7-bc81-3f6fab7c6a45 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:53.518769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f630048-daef-4ac7-bc81-3f6fab7c6a45 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:53.532167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f630048-daef-4ac7-bc81-3f6fab7c6a45 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:53.533177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f630048-daef-4ac7-bc81-3f6fab7c6a45 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:53.534061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f630048-daef-4ac7-bc81-3f6fab7c6a45 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:53.535955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f630048-daef-4ac7-bc81-3f6fab7c6a45 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:53.536756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f630048-daef-4ac7-bc81-3f6fab7c6a45 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:53.537161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f630048-daef-4ac7-bc81-3f6fab7c6a45 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:53.557378 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [req-9da96ade-003b-4040-b7eb-b2a39a99e42a req-15d6f5f0-5160-4846-9569-7b06421b2fe6 service nova] [92b1b4a9-4b8a-44b2-bc10-f00a4e191b81] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 47280. Aug 09 15:14:53.564196 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9da96ade-003b-4040-b7eb-b2a39a99e42a req-15d6f5f0-5160-4846-9569-7b06421b2fe6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.070993 Aug 09 15:14:53.567061 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3148/6285] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:14:53.743982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f630048-daef-4ac7-bc81-3f6fab7c6a45 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:53.752666 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f630048-daef-4ac7-bc81-3f6fab7c6a45 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1282 microversion: 2.1 time: 0.239138 Aug 09 15:14:53.766544 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3138/6286] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:53 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1282 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:14:54.777624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-12a5fd0f-b6e8-4c95-8ceb-4452a765286e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:54.779037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-12a5fd0f-b6e8-4c95-8ceb-4452a765286e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:54.786254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12a5fd0f-b6e8-4c95-8ceb-4452a765286e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:54.787119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12a5fd0f-b6e8-4c95-8ceb-4452a765286e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:54.787792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12a5fd0f-b6e8-4c95-8ceb-4452a765286e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:54.788753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12a5fd0f-b6e8-4c95-8ceb-4452a765286e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:54.789213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12a5fd0f-b6e8-4c95-8ceb-4452a765286e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:54.789645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-12a5fd0f-b6e8-4c95-8ceb-4452a765286e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:54.950050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-12a5fd0f-b6e8-4c95-8ceb-4452a765286e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:54.958754 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-12a5fd0f-b6e8-4c95-8ceb-4452a765286e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1282 microversion: 2.1 time: 0.187222 Aug 09 15:14:54.959731 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3149/6287] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:54 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:55.985639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dbdd1ae5-8501-4327-9902-ee04c8b5879a tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:55.986496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dbdd1ae5-8501-4327-9902-ee04c8b5879a tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:55.995608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbdd1ae5-8501-4327-9902-ee04c8b5879a tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:55.996115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbdd1ae5-8501-4327-9902-ee04c8b5879a tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:55.996554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbdd1ae5-8501-4327-9902-ee04c8b5879a tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:55.997283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbdd1ae5-8501-4327-9902-ee04c8b5879a tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:55.997743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbdd1ae5-8501-4327-9902-ee04c8b5879a tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:55.998232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dbdd1ae5-8501-4327-9902-ee04c8b5879a tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:56.180846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dbdd1ae5-8501-4327-9902-ee04c8b5879a tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:56.199975 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dbdd1ae5-8501-4327-9902-ee04c8b5879a tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1282 microversion: 2.1 time: 0.222965 Aug 09 15:14:56.200648 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3139/6288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:55 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1282 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:57.224212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-276c7807-a4a5-4922-8358-2bfbda3765c1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:57.225039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-276c7807-a4a5-4922-8358-2bfbda3765c1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:57.233294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-276c7807-a4a5-4922-8358-2bfbda3765c1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:57.234162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-276c7807-a4a5-4922-8358-2bfbda3765c1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:57.234612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-276c7807-a4a5-4922-8358-2bfbda3765c1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:57.235652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-276c7807-a4a5-4922-8358-2bfbda3765c1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:57.236170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-276c7807-a4a5-4922-8358-2bfbda3765c1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:57.236614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-276c7807-a4a5-4922-8358-2bfbda3765c1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:57.390701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-276c7807-a4a5-4922-8358-2bfbda3765c1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:57.400043 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-276c7807-a4a5-4922-8358-2bfbda3765c1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1270 microversion: 2.1 time: 0.180202 Aug 09 15:14:57.408871 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3150/6289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:57 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:58.422613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f2d1d21-56de-4f8c-a0ec-dc20390b4016 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:58.423494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f2d1d21-56de-4f8c-a0ec-dc20390b4016 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:58.426586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:58.427747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:58.435555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f2d1d21-56de-4f8c-a0ec-dc20390b4016 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:58.436306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f2d1d21-56de-4f8c-a0ec-dc20390b4016 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:58.436832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f2d1d21-56de-4f8c-a0ec-dc20390b4016 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:58.437702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f2d1d21-56de-4f8c-a0ec-dc20390b4016 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:58.438274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f2d1d21-56de-4f8c-a0ec-dc20390b4016 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:58.438985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f2d1d21-56de-4f8c-a0ec-dc20390b4016 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:58.650565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4f2d1d21-56de-4f8c-a0ec-dc20390b4016 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:58.668469 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f2d1d21-56de-4f8c-a0ec-dc20390b4016 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1270 microversion: 2.1 time: 0.249763 Aug 09 15:14:58.669611 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3140/6290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:58 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1270 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:14:59.709729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0cbd9d1-8998-4052-8b89-fb83fc23fba7 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:14:59.711242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0cbd9d1-8998-4052-8b89-fb83fc23fba7 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:14:59.716946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:14:59.731821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0cbd9d1-8998-4052-8b89-fb83fc23fba7 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:59.732672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0cbd9d1-8998-4052-8b89-fb83fc23fba7 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:59.733446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0cbd9d1-8998-4052-8b89-fb83fc23fba7 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:59.734726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0cbd9d1-8998-4052-8b89-fb83fc23fba7 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:14:59.735594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0cbd9d1-8998-4052-8b89-fb83fc23fba7 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:14:59.736546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0cbd9d1-8998-4052-8b89-fb83fc23fba7 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:14:59.942437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c0cbd9d1-8998-4052-8b89-fb83fc23fba7 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:14:59.956612 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0cbd9d1-8998-4052-8b89-fb83fc23fba7 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1270 microversion: 2.1 time: 0.254328 Aug 09 15:14:59.957581 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3151/6291] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:14:59 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1270 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:00.981189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01e03e1d-3fbc-467c-9c32-f2813507ad12 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:00.981903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01e03e1d-3fbc-467c-9c32-f2813507ad12 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:00.990242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01e03e1d-3fbc-467c-9c32-f2813507ad12 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:00.990790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01e03e1d-3fbc-467c-9c32-f2813507ad12 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:00.991288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01e03e1d-3fbc-467c-9c32-f2813507ad12 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:00.992062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01e03e1d-3fbc-467c-9c32-f2813507ad12 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:00.992536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01e03e1d-3fbc-467c-9c32-f2813507ad12 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:00.992969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01e03e1d-3fbc-467c-9c32-f2813507ad12 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:01.199031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-01e03e1d-3fbc-467c-9c32-f2813507ad12 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:01.216110 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01e03e1d-3fbc-467c-9c32-f2813507ad12 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1270 microversion: 2.1 time: 0.238704 Aug 09 15:15:01.219193 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3141/6292] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:00 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1270 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:02.244891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2fc6a22a-d5f6-4e26-ac79-1fa030e18c33 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:02.245601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2fc6a22a-d5f6-4e26-ac79-1fa030e18c33 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:02.253174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fc6a22a-d5f6-4e26-ac79-1fa030e18c33 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:02.253660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fc6a22a-d5f6-4e26-ac79-1fa030e18c33 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:02.254316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fc6a22a-d5f6-4e26-ac79-1fa030e18c33 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:02.255276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fc6a22a-d5f6-4e26-ac79-1fa030e18c33 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:02.255916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fc6a22a-d5f6-4e26-ac79-1fa030e18c33 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:02.256380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fc6a22a-d5f6-4e26-ac79-1fa030e18c33 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:02.430391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2fc6a22a-d5f6-4e26-ac79-1fa030e18c33 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:02.440149 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2fc6a22a-d5f6-4e26-ac79-1fa030e18c33 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1270 microversion: 2.1 time: 0.199749 Aug 09 15:15:02.440766 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3152/6293] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:02 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1270 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:15:03.462496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3011ec73-35f5-42d9-800d-94c4ddef43e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:03.463076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3011ec73-35f5-42d9-800d-94c4ddef43e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:03.471110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3011ec73-35f5-42d9-800d-94c4ddef43e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:03.471631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3011ec73-35f5-42d9-800d-94c4ddef43e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:03.472081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3011ec73-35f5-42d9-800d-94c4ddef43e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:03.472923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3011ec73-35f5-42d9-800d-94c4ddef43e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:03.473551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3011ec73-35f5-42d9-800d-94c4ddef43e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:03.473985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3011ec73-35f5-42d9-800d-94c4ddef43e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:03.631531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3011ec73-35f5-42d9-800d-94c4ddef43e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:03.641630 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3011ec73-35f5-42d9-800d-94c4ddef43e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1270 microversion: 2.1 time: 0.183555 Aug 09 15:15:03.642340 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3142/6294] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:03 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:04.663251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fa79d506-a07d-4964-b656-f685ce303bd8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:04.664071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fa79d506-a07d-4964-b656-f685ce303bd8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:04.672763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa79d506-a07d-4964-b656-f685ce303bd8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:04.673417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa79d506-a07d-4964-b656-f685ce303bd8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:04.673914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa79d506-a07d-4964-b656-f685ce303bd8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:04.674713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa79d506-a07d-4964-b656-f685ce303bd8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:04.675263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa79d506-a07d-4964-b656-f685ce303bd8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:04.675846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fa79d506-a07d-4964-b656-f685ce303bd8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:04.907898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fa79d506-a07d-4964-b656-f685ce303bd8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:04.924648 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fa79d506-a07d-4964-b656-f685ce303bd8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1270 microversion: 2.1 time: 0.265841 Aug 09 15:15:04.929502 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3153/6295] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:04 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1270 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:05.962756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eee56090-ae1c-4a13-a8a7-202d3102a38c tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:05.963591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eee56090-ae1c-4a13-a8a7-202d3102a38c tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:05.971531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee56090-ae1c-4a13-a8a7-202d3102a38c tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:05.972034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee56090-ae1c-4a13-a8a7-202d3102a38c tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:05.972507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee56090-ae1c-4a13-a8a7-202d3102a38c tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:05.973332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee56090-ae1c-4a13-a8a7-202d3102a38c tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:05.973843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee56090-ae1c-4a13-a8a7-202d3102a38c tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:05.974281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee56090-ae1c-4a13-a8a7-202d3102a38c tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:06.132347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eee56090-ae1c-4a13-a8a7-202d3102a38c tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:06.141126 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eee56090-ae1c-4a13-a8a7-202d3102a38c tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1270 microversion: 2.1 time: 0.182524 Aug 09 15:15:06.141767 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3143/6296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:05 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:07.162305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-481fc4cd-dfcd-474e-9a90-710304227eca tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:07.163791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-481fc4cd-dfcd-474e-9a90-710304227eca tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:07.169827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:15:07.172192 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-481fc4cd-dfcd-474e-9a90-710304227eca tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:07.172678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-481fc4cd-dfcd-474e-9a90-710304227eca tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:07.173086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-481fc4cd-dfcd-474e-9a90-710304227eca tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:07.174189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-481fc4cd-dfcd-474e-9a90-710304227eca tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:07.174974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-481fc4cd-dfcd-474e-9a90-710304227eca tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:07.175439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-481fc4cd-dfcd-474e-9a90-710304227eca tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:07.189993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-03b16785-1a3f-40c8-a2b4-cd1e00b8ea45 req-7109e5d2-2b41-4e9d-9bd5-cf006655e349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c542bd68-559f-4dc6-9841-2cf0b7c8f456", "name": "network-vif-plugged", "status": "completed", "tag": "5b9e018c-2330-4851-9f44-5ffbb7bc14d2"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:15:07.212522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-03b16785-1a3f-40c8-a2b4-cd1e00b8ea45 req-7109e5d2-2b41-4e9d-9bd5-cf006655e349 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:07.213465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-03b16785-1a3f-40c8-a2b4-cd1e00b8ea45 req-7109e5d2-2b41-4e9d-9bd5-cf006655e349 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:07.214162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-03b16785-1a3f-40c8-a2b4-cd1e00b8ea45 req-7109e5d2-2b41-4e9d-9bd5-cf006655e349 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:07.244002 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-03b16785-1a3f-40c8-a2b4-cd1e00b8ea45 req-7109e5d2-2b41-4e9d-9bd5-cf006655e349 service nova] Creating event network-vif-plugged:5b9e018c-2330-4851-9f44-5ffbb7bc14d2 for instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 on n-h1-844626-8 Aug 09 15:15:07.251703 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-03b16785-1a3f-40c8-a2b4-cd1e00b8ea45 req-7109e5d2-2b41-4e9d-9bd5-cf006655e349 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066803 Aug 09 15:15:07.252759 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3144/6297] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:15:07.362434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-481fc4cd-dfcd-474e-9a90-710304227eca tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:07.372105 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-481fc4cd-dfcd-474e-9a90-710304227eca tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1270 microversion: 2.1 time: 0.213582 Aug 09 15:15:07.372663 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3154/6298] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:07 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1270 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:08.393768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06fbaeea-911b-4dfe-a0ca-acb473315ad2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:08.395535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-06fbaeea-911b-4dfe-a0ca-acb473315ad2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:08.398686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:15:08.404761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06fbaeea-911b-4dfe-a0ca-acb473315ad2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:08.405635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06fbaeea-911b-4dfe-a0ca-acb473315ad2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:08.406300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06fbaeea-911b-4dfe-a0ca-acb473315ad2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:08.407274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06fbaeea-911b-4dfe-a0ca-acb473315ad2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:08.407965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06fbaeea-911b-4dfe-a0ca-acb473315ad2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:08.408608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06fbaeea-911b-4dfe-a0ca-acb473315ad2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:08.412131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=62 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:15:08.576187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-06fbaeea-911b-4dfe-a0ca-acb473315ad2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:08.590759 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-06fbaeea-911b-4dfe-a0ca-acb473315ad2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1270 microversion: 2.1 time: 0.201240 Aug 09 15:15:08.591902 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3145/6299] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:08 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1270 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:09.624024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1518e642-6305-4f0d-aacb-7ea0352f79e2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:09.625167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1518e642-6305-4f0d-aacb-7ea0352f79e2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:09.635243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1518e642-6305-4f0d-aacb-7ea0352f79e2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:09.636128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1518e642-6305-4f0d-aacb-7ea0352f79e2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:09.636728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1518e642-6305-4f0d-aacb-7ea0352f79e2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:09.637964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1518e642-6305-4f0d-aacb-7ea0352f79e2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:09.638859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1518e642-6305-4f0d-aacb-7ea0352f79e2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:09.648298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1518e642-6305-4f0d-aacb-7ea0352f79e2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:09.848101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1518e642-6305-4f0d-aacb-7ea0352f79e2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:09.858751 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1518e642-6305-4f0d-aacb-7ea0352f79e2 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1458 microversion: 2.1 time: 0.239450 Aug 09 15:15:09.861199 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3155/6300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:09 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1458 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:09.885111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8011dd3e-88c9-4dae-b705-2b8dd934b07d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:09.885763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8011dd3e-88c9-4dae-b705-2b8dd934b07d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:09.893500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8011dd3e-88c9-4dae-b705-2b8dd934b07d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:09.894083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8011dd3e-88c9-4dae-b705-2b8dd934b07d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:09.894561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8011dd3e-88c9-4dae-b705-2b8dd934b07d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:09.895322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8011dd3e-88c9-4dae-b705-2b8dd934b07d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:09.895792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8011dd3e-88c9-4dae-b705-2b8dd934b07d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:09.896236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8011dd3e-88c9-4dae-b705-2b8dd934b07d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:10.050001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8011dd3e-88c9-4dae-b705-2b8dd934b07d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:10.062448 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8011dd3e-88c9-4dae-b705-2b8dd934b07d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1458 microversion: 2.1 time: 0.184358 Aug 09 15:15:10.063751 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3146/6301] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:09 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1458 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:12.699493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9e5e6c9e-9c26-4566-b28f-1a1f0cdd6577 req-0f8e1d53-5171-4d3c-a959-11acd14216d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c542bd68-559f-4dc6-9841-2cf0b7c8f456", "tag": "5b9e018c-2330-4851-9f44-5ffbb7bc14d2"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:15:12.722665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9e5e6c9e-9c26-4566-b28f-1a1f0cdd6577 req-0f8e1d53-5171-4d3c-a959-11acd14216d4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:12.723739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9e5e6c9e-9c26-4566-b28f-1a1f0cdd6577 req-0f8e1d53-5171-4d3c-a959-11acd14216d4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:12.724955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9e5e6c9e-9c26-4566-b28f-1a1f0cdd6577 req-0f8e1d53-5171-4d3c-a959-11acd14216d4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:12.750285 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9e5e6c9e-9c26-4566-b28f-1a1f0cdd6577 req-0f8e1d53-5171-4d3c-a959-11acd14216d4 service nova] Creating event network-changed:5b9e018c-2330-4851-9f44-5ffbb7bc14d2 for instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 on n-h1-844626-8 Aug 09 15:15:12.765110 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9e5e6c9e-9c26-4566-b28f-1a1f0cdd6577 req-0f8e1d53-5171-4d3c-a959-11acd14216d4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073401 Aug 09 15:15:12.766367 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3156/6302] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:15:14.853757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-9b78c793-5c71-4891-9394-d7a29166e20a req-f3d2d2fd-8cb5-4e7a-aca0-cdf210e1c2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c542bd68-559f-4dc6-9841-2cf0b7c8f456", "tag": "5b9e018c-2330-4851-9f44-5ffbb7bc14d2"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:15:14.874106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9b78c793-5c71-4891-9394-d7a29166e20a req-f3d2d2fd-8cb5-4e7a-aca0-cdf210e1c2e5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:14.875061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9b78c793-5c71-4891-9394-d7a29166e20a req-f3d2d2fd-8cb5-4e7a-aca0-cdf210e1c2e5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:14.875897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-9b78c793-5c71-4891-9394-d7a29166e20a req-f3d2d2fd-8cb5-4e7a-aca0-cdf210e1c2e5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:14.889891 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-9b78c793-5c71-4891-9394-d7a29166e20a req-f3d2d2fd-8cb5-4e7a-aca0-cdf210e1c2e5 service nova] Creating event network-changed:5b9e018c-2330-4851-9f44-5ffbb7bc14d2 for instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 on n-h1-844626-8 Aug 09 15:15:14.895561 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-9b78c793-5c71-4891-9394-d7a29166e20a req-f3d2d2fd-8cb5-4e7a-aca0-cdf210e1c2e5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046823 Aug 09 15:15:14.896246 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3147/6303] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:15:16.916312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5eb9137c-66d7-4ee9-84aa-1bdbbfdeeaf5 req-61984813-6874-4dde-a898-3ebc2b81fd18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c542bd68-559f-4dc6-9841-2cf0b7c8f456", "tag": "5b9e018c-2330-4851-9f44-5ffbb7bc14d2"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:15:16.927243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5eb9137c-66d7-4ee9-84aa-1bdbbfdeeaf5 req-61984813-6874-4dde-a898-3ebc2b81fd18 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:16.927747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5eb9137c-66d7-4ee9-84aa-1bdbbfdeeaf5 req-61984813-6874-4dde-a898-3ebc2b81fd18 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:16.928150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5eb9137c-66d7-4ee9-84aa-1bdbbfdeeaf5 req-61984813-6874-4dde-a898-3ebc2b81fd18 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:16.941514 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5eb9137c-66d7-4ee9-84aa-1bdbbfdeeaf5 req-61984813-6874-4dde-a898-3ebc2b81fd18 service nova] Creating event network-changed:5b9e018c-2330-4851-9f44-5ffbb7bc14d2 for instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 on n-h1-844626-8 Aug 09 15:15:16.947608 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5eb9137c-66d7-4ee9-84aa-1bdbbfdeeaf5 req-61984813-6874-4dde-a898-3ebc2b81fd18 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037909 Aug 09 15:15:16.948402 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3157/6304] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:15:47.172681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=5 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:15:47.174378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=13 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:15:47.177681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-247cdbad-6a2b-438a-96cb-43d26c50d73a req-f1306540-9a61-4b65-9939-1f635ca50d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c542bd68-559f-4dc6-9841-2cf0b7c8f456", "tag": "5b9e018c-2330-4851-9f44-5ffbb7bc14d2"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:15:47.179614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e04ee55b-eb79-46af-a73a-ab12e15db0e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:47.181234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e04ee55b-eb79-46af-a73a-ab12e15db0e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:47.188321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=7 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:15:47.189226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=54 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:15:47.191762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-247cdbad-6a2b-438a-96cb-43d26c50d73a req-f1306540-9a61-4b65-9939-1f635ca50d5a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:47.192537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-247cdbad-6a2b-438a-96cb-43d26c50d73a req-f1306540-9a61-4b65-9939-1f635ca50d5a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:47.193158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-247cdbad-6a2b-438a-96cb-43d26c50d73a req-f1306540-9a61-4b65-9939-1f635ca50d5a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:47.193303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e04ee55b-eb79-46af-a73a-ab12e15db0e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:47.194213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e04ee55b-eb79-46af-a73a-ab12e15db0e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:47.194775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e04ee55b-eb79-46af-a73a-ab12e15db0e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:47.196057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e04ee55b-eb79-46af-a73a-ab12e15db0e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:47.196550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e04ee55b-eb79-46af-a73a-ab12e15db0e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:47.197000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e04ee55b-eb79-46af-a73a-ab12e15db0e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:47.208000 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-247cdbad-6a2b-438a-96cb-43d26c50d73a req-f1306540-9a61-4b65-9939-1f635ca50d5a service nova] Creating event network-changed:5b9e018c-2330-4851-9f44-5ffbb7bc14d2 for instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 on n-h1-844626-8 Aug 09 15:15:47.221479 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-247cdbad-6a2b-438a-96cb-43d26c50d73a req-f1306540-9a61-4b65-9939-1f635ca50d5a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047082 Aug 09 15:15:47.223950 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3158/6305] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:15:47.231639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e04ee55b-eb79-46af-a73a-ab12e15db0e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:15:47.382713 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e04ee55b-eb79-46af-a73a-ab12e15db0e0 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 204 len: 0 microversion: 2.1 time: 0.211162 Aug 09 15:15:47.400271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e97d29df-e84d-46f9-82ed-acb9d68a1262 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:47.402048 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3148/6306] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:15:47 2022] DELETE /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 15:15:47.402720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e97d29df-e84d-46f9-82ed-acb9d68a1262 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:47.410594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e97d29df-e84d-46f9-82ed-acb9d68a1262 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:47.411773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e97d29df-e84d-46f9-82ed-acb9d68a1262 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:47.412392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e97d29df-e84d-46f9-82ed-acb9d68a1262 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:47.413625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e97d29df-e84d-46f9-82ed-acb9d68a1262 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:47.414313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e97d29df-e84d-46f9-82ed-acb9d68a1262 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:47.414886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e97d29df-e84d-46f9-82ed-acb9d68a1262 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:47.850788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e97d29df-e84d-46f9-82ed-acb9d68a1262 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:47.865884 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e97d29df-e84d-46f9-82ed-acb9d68a1262 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1582 microversion: 2.1 time: 0.472073 Aug 09 15:15:47.867738 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3159/6307] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:47 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1582 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:48.907096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84864ee0-c724-42d4-a66f-9b5388b84b8d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:48.907713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84864ee0-c724-42d4-a66f-9b5388b84b8d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:48.915057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84864ee0-c724-42d4-a66f-9b5388b84b8d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:48.915680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84864ee0-c724-42d4-a66f-9b5388b84b8d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:48.916105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84864ee0-c724-42d4-a66f-9b5388b84b8d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:48.916870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84864ee0-c724-42d4-a66f-9b5388b84b8d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:48.917319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84864ee0-c724-42d4-a66f-9b5388b84b8d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:48.917753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84864ee0-c724-42d4-a66f-9b5388b84b8d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:49.183718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-84864ee0-c724-42d4-a66f-9b5388b84b8d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:49.191950 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84864ee0-c724-42d4-a66f-9b5388b84b8d tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1582 microversion: 2.1 time: 0.289275 Aug 09 15:15:49.192732 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3149/6308] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:48 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1582 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:49.391659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1793da23-4622-4ae3-8f3d-d3609409a602 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:49.393799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1793da23-4622-4ae3-8f3d-d3609409a602 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:49.402098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1793da23-4622-4ae3-8f3d-d3609409a602 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:49.402787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1793da23-4622-4ae3-8f3d-d3609409a602 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:49.403756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1793da23-4622-4ae3-8f3d-d3609409a602 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:49.404579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1793da23-4622-4ae3-8f3d-d3609409a602 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:49.405154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1793da23-4622-4ae3-8f3d-d3609409a602 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:49.405839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1793da23-4622-4ae3-8f3d-d3609409a602 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:49.445387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1793da23-4622-4ae3-8f3d-d3609409a602 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:15:49.598084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-f1cc4508-d280-43c6-9f5f-c3938fbc814f req-ddedb582-b69e-4dea-abb9-e21646428c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c542bd68-559f-4dc6-9841-2cf0b7c8f456", "name": "network-vif-deleted", "tag": "5b9e018c-2330-4851-9f44-5ffbb7bc14d2"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:15:49.624796 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1793da23-4622-4ae3-8f3d-d3609409a602 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "DELETE /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 204 len: 0 microversion: 2.1 time: 0.409538 Aug 09 15:15:49.627233 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3160/6309] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:15:49 2022] DELETE /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:15:49.635464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f1cc4508-d280-43c6-9f5f-c3938fbc814f req-ddedb582-b69e-4dea-abb9-e21646428c57 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:49.636053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f1cc4508-d280-43c6-9f5f-c3938fbc814f req-ddedb582-b69e-4dea-abb9-e21646428c57 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:49.636688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-f1cc4508-d280-43c6-9f5f-c3938fbc814f req-ddedb582-b69e-4dea-abb9-e21646428c57 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:49.645515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3983bd76-c6cc-4934-a399-22ea8b5534f2 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:49.646545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3983bd76-c6cc-4934-a399-22ea8b5534f2 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:49.657905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3983bd76-c6cc-4934-a399-22ea8b5534f2 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:49.658182 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-f1cc4508-d280-43c6-9f5f-c3938fbc814f req-ddedb582-b69e-4dea-abb9-e21646428c57 service nova] Creating event network-vif-deleted:5b9e018c-2330-4851-9f44-5ffbb7bc14d2 for instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 on n-h1-844626-8 Aug 09 15:15:49.658510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3983bd76-c6cc-4934-a399-22ea8b5534f2 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:49.659121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3983bd76-c6cc-4934-a399-22ea8b5534f2 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:49.659911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3983bd76-c6cc-4934-a399-22ea8b5534f2 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:49.660475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3983bd76-c6cc-4934-a399-22ea8b5534f2 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:49.661232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3983bd76-c6cc-4934-a399-22ea8b5534f2 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:49.664743 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-f1cc4508-d280-43c6-9f5f-c3938fbc814f req-ddedb582-b69e-4dea-abb9-e21646428c57 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077456 Aug 09 15:15:49.666016 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3150/6310] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:15:49.863678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3983bd76-c6cc-4934-a399-22ea8b5534f2 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:49.875336 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3983bd76-c6cc-4934-a399-22ea8b5534f2 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1732 microversion: 2.1 time: 0.240294 Aug 09 15:15:49.876287 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3161/6311] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:49 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1732 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:50.227954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d24bc877-d24b-446c-96c2-5280f39dcf6b tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:50.229311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d24bc877-d24b-446c-96c2-5280f39dcf6b tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:50.241029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d24bc877-d24b-446c-96c2-5280f39dcf6b tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:50.242932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d24bc877-d24b-446c-96c2-5280f39dcf6b tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:50.243776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d24bc877-d24b-446c-96c2-5280f39dcf6b tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:50.245585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d24bc877-d24b-446c-96c2-5280f39dcf6b tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:50.246288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d24bc877-d24b-446c-96c2-5280f39dcf6b tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:50.246967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d24bc877-d24b-446c-96c2-5280f39dcf6b tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:50.337120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d24bc877-d24b-446c-96c2-5280f39dcf6b tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:50.354462 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d24bc877-d24b-446c-96c2-5280f39dcf6b tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1229 microversion: 2.1 time: 0.133239 Aug 09 15:15:50.359210 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3151/6312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:50 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1229 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:50.897113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3ce389bd-ca02-4d83-b9ff-c0d03323a73d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:50.897820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3ce389bd-ca02-4d83-b9ff-c0d03323a73d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:50.914951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ce389bd-ca02-4d83-b9ff-c0d03323a73d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:50.917200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ce389bd-ca02-4d83-b9ff-c0d03323a73d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:50.917924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ce389bd-ca02-4d83-b9ff-c0d03323a73d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:50.920688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ce389bd-ca02-4d83-b9ff-c0d03323a73d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:50.923587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ce389bd-ca02-4d83-b9ff-c0d03323a73d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:50.924157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3ce389bd-ca02-4d83-b9ff-c0d03323a73d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:51.244339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3ce389bd-ca02-4d83-b9ff-c0d03323a73d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:51.254538 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3ce389bd-ca02-4d83-b9ff-c0d03323a73d tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1732 microversion: 2.1 time: 0.361347 Aug 09 15:15:51.269025 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3162/6313] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:50 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1732 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:51.381749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-965edaf6-e816-449a-bad3-545273bb8fe8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:51.383130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-965edaf6-e816-449a-bad3-545273bb8fe8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:51.403857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-965edaf6-e816-449a-bad3-545273bb8fe8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:51.404769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-965edaf6-e816-449a-bad3-545273bb8fe8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:51.405446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-965edaf6-e816-449a-bad3-545273bb8fe8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:51.406410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-965edaf6-e816-449a-bad3-545273bb8fe8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:51.407122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-965edaf6-e816-449a-bad3-545273bb8fe8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:51.407813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-965edaf6-e816-449a-bad3-545273bb8fe8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:51.459919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-761cc5e2-186b-4fbb-bbb4-25613613ac8e req-2a189e94-3a25-49dc-a0ad-84fcbc0ca93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55473c24-f786-48cc-a7e3-7ccebeb3cf68", "name": "network-vif-unplugged", "status": "completed", "tag": "5db7250f-e48a-4046-bfee-5bfb11fc4f94"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:15:51.485670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-761cc5e2-186b-4fbb-bbb4-25613613ac8e req-2a189e94-3a25-49dc-a0ad-84fcbc0ca93b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:51.486166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-761cc5e2-186b-4fbb-bbb4-25613613ac8e req-2a189e94-3a25-49dc-a0ad-84fcbc0ca93b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:51.486632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-761cc5e2-186b-4fbb-bbb4-25613613ac8e req-2a189e94-3a25-49dc-a0ad-84fcbc0ca93b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:51.509433 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-761cc5e2-186b-4fbb-bbb4-25613613ac8e req-2a189e94-3a25-49dc-a0ad-84fcbc0ca93b service nova] Creating event network-vif-unplugged:5db7250f-e48a-4046-bfee-5bfb11fc4f94 for instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 on n-h1-844626-8 Aug 09 15:15:51.514729 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-761cc5e2-186b-4fbb-bbb4-25613613ac8e req-2a189e94-3a25-49dc-a0ad-84fcbc0ca93b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058711 Aug 09 15:15:51.515394 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3163/6314] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:15:51.545819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-965edaf6-e816-449a-bad3-545273bb8fe8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:51.557777 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-965edaf6-e816-449a-bad3-545273bb8fe8 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1229 microversion: 2.1 time: 0.181690 Aug 09 15:15:51.558377 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3152/6315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:51 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1229 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:52.246454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-7a88deb6-5911-4f9f-8d63-e79ff42d7d12 req-0b2cff5a-6d0a-46c8-8c10-824876603ed5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55473c24-f786-48cc-a7e3-7ccebeb3cf68", "name": "network-vif-deleted", "tag": "5db7250f-e48a-4046-bfee-5bfb11fc4f94"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:15:52.258434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7a88deb6-5911-4f9f-8d63-e79ff42d7d12 req-0b2cff5a-6d0a-46c8-8c10-824876603ed5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:52.259227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7a88deb6-5911-4f9f-8d63-e79ff42d7d12 req-0b2cff5a-6d0a-46c8-8c10-824876603ed5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:52.259833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-7a88deb6-5911-4f9f-8d63-e79ff42d7d12 req-0b2cff5a-6d0a-46c8-8c10-824876603ed5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:52.278178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f112760c-88f6-4e2c-9998-dcebaa2a8c21 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:52.279173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f112760c-88f6-4e2c-9998-dcebaa2a8c21 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:52.289888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f112760c-88f6-4e2c-9998-dcebaa2a8c21 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:52.291676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f112760c-88f6-4e2c-9998-dcebaa2a8c21 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:52.292607 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-7a88deb6-5911-4f9f-8d63-e79ff42d7d12 req-0b2cff5a-6d0a-46c8-8c10-824876603ed5 service nova] Creating event network-vif-deleted:5db7250f-e48a-4046-bfee-5bfb11fc4f94 for instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 on n-h1-844626-8 Aug 09 15:15:52.293283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f112760c-88f6-4e2c-9998-dcebaa2a8c21 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:52.296499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f112760c-88f6-4e2c-9998-dcebaa2a8c21 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:52.297265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f112760c-88f6-4e2c-9998-dcebaa2a8c21 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:52.297906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f112760c-88f6-4e2c-9998-dcebaa2a8c21 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:52.308109 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-7a88deb6-5911-4f9f-8d63-e79ff42d7d12 req-0b2cff5a-6d0a-46c8-8c10-824876603ed5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066323 Aug 09 15:15:52.313464 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3164/6316] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:15:52.445846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f112760c-88f6-4e2c-9998-dcebaa2a8c21 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d78051967a4497b5d5ff5c65c2bcd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fe0e56b9f14c079a58ade5c138c3ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:52.465360 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f112760c-88f6-4e2c-9998-dcebaa2a8c21 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 200 len: 1665 microversion: 2.1 time: 0.193012 Aug 09 15:15:52.485064 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3153/6317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:52 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 1665 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:52.602236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7fe147b7-5a05-4b9a-b7ed-e74cab2bc212 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:52.603439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7fe147b7-5a05-4b9a-b7ed-e74cab2bc212 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:52.627719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fe147b7-5a05-4b9a-b7ed-e74cab2bc212 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:52.628534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fe147b7-5a05-4b9a-b7ed-e74cab2bc212 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:52.629233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fe147b7-5a05-4b9a-b7ed-e74cab2bc212 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:52.630412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fe147b7-5a05-4b9a-b7ed-e74cab2bc212 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:52.631204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fe147b7-5a05-4b9a-b7ed-e74cab2bc212 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:52.642510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7fe147b7-5a05-4b9a-b7ed-e74cab2bc212 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:52.871551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7fe147b7-5a05-4b9a-b7ed-e74cab2bc212 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:52.903444 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7fe147b7-5a05-4b9a-b7ed-e74cab2bc212 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1229 microversion: 2.1 time: 0.306642 Aug 09 15:15:52.904961 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3165/6318] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:52 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1229 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:53.493225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d78bd93-0cd1-414d-b149-788c03bcd829 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:53.494077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d78bd93-0cd1-414d-b149-788c03bcd829 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:53.501520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d78bd93-0cd1-414d-b149-788c03bcd829 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:53.502427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d78bd93-0cd1-414d-b149-788c03bcd829 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:53.503064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d78bd93-0cd1-414d-b149-788c03bcd829 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:53.504005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d78bd93-0cd1-414d-b149-788c03bcd829 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:53.504637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d78bd93-0cd1-414d-b149-788c03bcd829 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:53.505233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d78bd93-0cd1-414d-b149-788c03bcd829 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:53.531300 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-6d78bd93-0cd1-414d-b149-788c03bcd829 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] HTTP exception thrown: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d78bd93-0cd1-414d-b149-788c03bcd829 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Request method failure captured: Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 HTTP/1.1 Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8njwR7fGc_4DP5ZGJs0JDG_wws_LRB1ekVP7lvyRMbueGKF0WTiaaipXLVCUOtaBJ5emTlBDKeIkAXHYYbp7Lf3dK0eusTOP4VT9C7pDjTcRSFWRAacsDrbM2sKynLG4BTnHaRA5JsYb17ll_pEIe6jvs25aBA-Xis6H9mATlrc9lY8 Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 00fe0e56b9f14c079a58ade5c138c3ed Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestServerBasicOps-479809794 Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_00fe0e56b9f14c079a58ade5c138c3ed", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/00fe0e56b9f14c079a58ade5c138c3ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/00fe0e56b9f14c079a58ade5c138c3ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/00fe0e56b9f14c079a58ade5c138c3ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestServerBasicOps-479809794 Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 00fe0e56b9f14c079a58ade5c138c3ed Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestServerBasicOps-479809794 Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestServerBasicOps-479809794-project Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 48d78051967a4497b5d5ff5c65c2bcd7 Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestServerBasicOps-479809794-project Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '55473c24-f786-48cc-a7e3-7ccebeb3cf68'} Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:15:53.538022 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:15:53.543750 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:15:53.543750 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:15:53.543750 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:15:53.543750 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:15:53.543750 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:15:53.543750 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:53.543750 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:15:53.543750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d78bd93-0cd1-414d-b149-788c03bcd829 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Returning 404 to user: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:15:53.543750 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d78bd93-0cd1-414d-b149-788c03bcd829 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 404 len: 111 microversion: 2.1 time: 0.054875 Aug 09 15:15:53.548199 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3154/6319] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:53 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:15:53.934423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe34be14-a746-4255-8f1b-bd5d226927b1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:53.936181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe34be14-a746-4255-8f1b-bd5d226927b1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:53.950779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe34be14-a746-4255-8f1b-bd5d226927b1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:53.955466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe34be14-a746-4255-8f1b-bd5d226927b1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:53.956069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe34be14-a746-4255-8f1b-bd5d226927b1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:53.958312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe34be14-a746-4255-8f1b-bd5d226927b1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:53.974059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe34be14-a746-4255-8f1b-bd5d226927b1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:53.982638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe34be14-a746-4255-8f1b-bd5d226927b1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:54.114358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fe34be14-a746-4255-8f1b-bd5d226927b1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:54.133380 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe34be14-a746-4255-8f1b-bd5d226927b1 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1229 microversion: 2.1 time: 0.202959 Aug 09 15:15:54.134435 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3166/6320] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:53 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1229 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:54.262011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a6ed447-31cb-464c-b5e1-c1d9f6ed5317 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:54.262761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a6ed447-31cb-464c-b5e1-c1d9f6ed5317 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:54.273492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6ed447-31cb-464c-b5e1-c1d9f6ed5317 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:54.274322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6ed447-31cb-464c-b5e1-c1d9f6ed5317 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:54.275280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6ed447-31cb-464c-b5e1-c1d9f6ed5317 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:54.276951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6ed447-31cb-464c-b5e1-c1d9f6ed5317 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:54.277833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6ed447-31cb-464c-b5e1-c1d9f6ed5317 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:54.278633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a6ed447-31cb-464c-b5e1-c1d9f6ed5317 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:54.312315 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-3a6ed447-31cb-464c-b5e1-c1d9f6ed5317 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] HTTP exception thrown: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a6ed447-31cb-464c-b5e1-c1d9f6ed5317 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Request method failure captured: Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 HTTP/1.1 Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8njwR7fGc_4DP5ZGJs0JDG_wws_LRB1ekVP7lvyRMbueGKF0WTiaaipXLVCUOtaBJ5emTlBDKeIkAXHYYbp7Lf3dK0eusTOP4VT9C7pDjTcRSFWRAacsDrbM2sKynLG4BTnHaRA5JsYb17ll_pEIe6jvs25aBA-Xis6H9mATlrc9lY8 Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 00fe0e56b9f14c079a58ade5c138c3ed Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestServerBasicOps-479809794 Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_00fe0e56b9f14c079a58ade5c138c3ed", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/00fe0e56b9f14c079a58ade5c138c3ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/00fe0e56b9f14c079a58ade5c138c3ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/00fe0e56b9f14c079a58ade5c138c3ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestServerBasicOps-479809794 Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 00fe0e56b9f14c079a58ade5c138c3ed Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestServerBasicOps-479809794 Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestServerBasicOps-479809794-project Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 48d78051967a4497b5d5ff5c65c2bcd7 Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestServerBasicOps-479809794-project Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '55473c24-f786-48cc-a7e3-7ccebeb3cf68'} Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:15:54.314550 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a6ed447-31cb-464c-b5e1-c1d9f6ed5317 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Returning 404 to user: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a6ed447-31cb-464c-b5e1-c1d9f6ed5317 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "DELETE /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 404 len: 111 microversion: 2.1 time: 0.060651 Aug 09 15:15:54.324496 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3155/6321] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:15:54 2022] DELETE /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:15:54.326629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-580edcec-1c2a-4887-9ae1-cdec64081787 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:54.326629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-580edcec-1c2a-4887-9ae1-cdec64081787 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] [instance: 55473c24-f786-48cc-a7e3-7ccebeb3cf68] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:54.332937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-580edcec-1c2a-4887-9ae1-cdec64081787 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:54.333454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-580edcec-1c2a-4887-9ae1-cdec64081787 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:54.333862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-580edcec-1c2a-4887-9ae1-cdec64081787 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:54.335151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-580edcec-1c2a-4887-9ae1-cdec64081787 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:54.335909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-580edcec-1c2a-4887-9ae1-cdec64081787 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:54.336357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-580edcec-1c2a-4887-9ae1-cdec64081787 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:54.352073 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-580edcec-1c2a-4887-9ae1-cdec64081787 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] HTTP exception thrown: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-580edcec-1c2a-4887-9ae1-cdec64081787 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Request method failure captured: Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 HTTP/1.1 Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8njwR7fGc_4DP5ZGJs0JDG_wws_LRB1ekVP7lvyRMbueGKF0WTiaaipXLVCUOtaBJ5emTlBDKeIkAXHYYbp7Lf3dK0eusTOP4VT9C7pDjTcRSFWRAacsDrbM2sKynLG4BTnHaRA5JsYb17ll_pEIe6jvs25aBA-Xis6H9mATlrc9lY8 Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 00fe0e56b9f14c079a58ade5c138c3ed Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestServerBasicOps-479809794 Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_00fe0e56b9f14c079a58ade5c138c3ed", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/00fe0e56b9f14c079a58ade5c138c3ed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/00fe0e56b9f14c079a58ade5c138c3ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/00fe0e56b9f14c079a58ade5c138c3ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestServerBasicOps-479809794 Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 00fe0e56b9f14c079a58ade5c138c3ed Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestServerBasicOps-479809794 Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestServerBasicOps-479809794-project Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 48d78051967a4497b5d5ff5c65c2bcd7 Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestServerBasicOps-479809794-project Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '55473c24-f786-48cc-a7e3-7ccebeb3cf68'} Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:15:54.353781 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:15:54.364186 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:15:54.364186 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:15:54.364186 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:15:54.364186 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:15:54.364186 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:15:54.364186 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. Aug 09 15:15:54.364186 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:15:54.364186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-580edcec-1c2a-4887-9ae1-cdec64081787 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Returning 404 to user: Instance 55473c24-f786-48cc-a7e3-7ccebeb3cf68 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:15:54.364186 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-580edcec-1c2a-4887-9ae1-cdec64081787 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68" status: 404 len: 111 microversion: 2.1 time: 0.033484 Aug 09 15:15:54.364186 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3167/6322] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:54 2022] GET /compute/v2.1/servers/55473c24-f786-48cc-a7e3-7ccebeb3cf68 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:15:54.623761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8f45e63c-69dc-4ff2-937f-343ef48a1dd8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] Calling method '.version_select at 0x7f41dda65280>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:54.677978 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8f45e63c-69dc-4ff2-937f-343ef48a1dd8 tempest-TestServerBasicOps-479809794 tempest-TestServerBasicOps-479809794-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1549722437" status: 202 len: 0 microversion: 2.1 time: 0.060793 Aug 09 15:15:54.679378 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3156/6323] 10.222.0.50 () {58 vars in 1254 bytes} [Tue Aug 9 15:15:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1549722437 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 15:15:55.168429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b5ab3adc-4c2d-406d-8887-456443633856 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:55.170344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b5ab3adc-4c2d-406d-8887-456443633856 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:55.182287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ab3adc-4c2d-406d-8887-456443633856 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:55.183429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ab3adc-4c2d-406d-8887-456443633856 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:55.184278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ab3adc-4c2d-406d-8887-456443633856 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:55.185674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ab3adc-4c2d-406d-8887-456443633856 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:55.186416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ab3adc-4c2d-406d-8887-456443633856 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:55.187390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ab3adc-4c2d-406d-8887-456443633856 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:55.264181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b5ab3adc-4c2d-406d-8887-456443633856 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:55.272843 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b5ab3adc-4c2d-406d-8887-456443633856 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1229 microversion: 2.1 time: 0.110557 Aug 09 15:15:55.275677 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3168/6324] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:55 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1229 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:56.304351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e7043d0-8a21-45e0-9ed4-ae1c70feb302 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:56.307255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e7043d0-8a21-45e0-9ed4-ae1c70feb302 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:56.321154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e7043d0-8a21-45e0-9ed4-ae1c70feb302 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:56.322184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e7043d0-8a21-45e0-9ed4-ae1c70feb302 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:56.322973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e7043d0-8a21-45e0-9ed4-ae1c70feb302 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:56.324238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e7043d0-8a21-45e0-9ed4-ae1c70feb302 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:56.325071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e7043d0-8a21-45e0-9ed4-ae1c70feb302 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:56.325657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e7043d0-8a21-45e0-9ed4-ae1c70feb302 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:56.529241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1e7043d0-8a21-45e0-9ed4-ae1c70feb302 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '375ea430a3db455889741a2bc4a0f04e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af26c4f08e42cc81d6b4c4e2f00f9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:15:56.543885 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e7043d0-8a21-45e0-9ed4-ae1c70feb302 tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 200 len: 1229 microversion: 2.1 time: 0.254408 Aug 09 15:15:56.560220 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3157/6325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:56 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 1229 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:15:57.573184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5c964de-e383-4c14-8737-dd0ecc94e81e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:57.574558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c5c964de-e383-4c14-8737-dd0ecc94e81e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] [instance: c542bd68-559f-4dc6-9841-2cf0b7c8f456] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:15:57.584314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5c964de-e383-4c14-8737-dd0ecc94e81e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:57.585615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5c964de-e383-4c14-8737-dd0ecc94e81e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:57.586117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5c964de-e383-4c14-8737-dd0ecc94e81e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:57.587078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5c964de-e383-4c14-8737-dd0ecc94e81e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:15:57.587864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5c964de-e383-4c14-8737-dd0ecc94e81e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:15:57.588507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5c964de-e383-4c14-8737-dd0ecc94e81e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:15:57.605846 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-c5c964de-e383-4c14-8737-dd0ecc94e81e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] HTTP exception thrown: Instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 could not be found. Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5c964de-e383-4c14-8737-dd0ecc94e81e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Request method failure captured: Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 HTTP/1.1 Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nlfvIuBOEml_T72m895qFR8fDMwQ_l1x5-kfw--cPpP9D3rAgdOemSpNC-QmMsjY-PuGrAWWx7ulzRodaP8CypzW98KqoOKkkWl9JxUkJEzt792h4cDI5uVx0WXFIdYZ7oZRst-wEMHbC1aUwY-pbQbYZaHsSFa9IhpJKXAkQ1Na7M Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: e4af26c4f08e42cc81d6b4c4e2f00f9d Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestVolumeBackupRestore-790302687 Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_e4af26c4f08e42cc81d6b4c4e2f00f9d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/e4af26c4f08e42cc81d6b4c4e2f00f9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e4af26c4f08e42cc81d6b4c4e2f00f9d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/e4af26c4f08e42cc81d6b4c4e2f00f9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestVolumeBackupRestore-790302687 Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: e4af26c4f08e42cc81d6b4c4e2f00f9d Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestVolumeBackupRestore-790302687 Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestVolumeBackupRestore-790302687-project Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 375ea430a3db455889741a2bc4a0f04e Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestVolumeBackupRestore-790302687-project Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 could not be found. Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'c542bd68-559f-4dc6-9841-2cf0b7c8f456'} Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 could not be found. Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 could not be found. Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:15:57.608041 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:15:57.613512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:15:57.613512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:15:57.613512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:15:57.613512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:15:57.613512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:15:57.613512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 could not be found. Aug 09 15:15:57.613512 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:15:57.615518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5c964de-e383-4c14-8737-dd0ecc94e81e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Returning 404 to user: Instance c542bd68-559f-4dc6-9841-2cf0b7c8f456 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:15:57.616624 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c5c964de-e383-4c14-8737-dd0ecc94e81e tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456" status: 404 len: 111 microversion: 2.1 time: 0.049732 Aug 09 15:15:57.617922 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3169/6326] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:15:57 2022] GET /compute/v2.1/servers/c542bd68-559f-4dc6-9841-2cf0b7c8f456 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:15:58.006453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-98429fc8-3d80-4e4b-88ee-b43e86ead07a tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] Calling method '.version_select at 0x7f41dd982e50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:15:58.076183 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-98429fc8-3d80-4e4b-88ee-b43e86ead07a tempest-TestVolumeBackupRestore-790302687 tempest-TestVolumeBackupRestore-790302687-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-972185802" status: 202 len: 0 microversion: 2.1 time: 0.073585 Aug 09 15:15:58.077215 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3158/6327] 10.222.0.50 () {58 vars in 1266 bytes} [Tue Aug 9 15:15:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-972185802 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:16:23.840255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:23.841259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:23.978194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-53250aac-701f-4668-af5c-d8c96588405c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:23.979026 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 15:16:23.979026 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 15:16:23.980098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53250aac-701f-4668-af5c-d8c96588405c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:23.980577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53250aac-701f-4668-af5c-d8c96588405c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:23.981038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53250aac-701f-4668-af5c-d8c96588405c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:23.981760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53250aac-701f-4668-af5c-d8c96588405c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:23.982208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53250aac-701f-4668-af5c-d8c96588405c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:23.982623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-53250aac-701f-4668-af5c-d8c96588405c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:24.007004 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-53250aac-701f-4668-af5c-d8c96588405c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.172209 Aug 09 15:16:24.007601 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3170/6328] 10.222.0.50 () {58 vars in 1185 bytes} [Tue Aug 9 15:16:23 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:16:24.111451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:24.112417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:24.117465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-337993430", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "availability_zone": "nova:n-h1-844626-8", "networks": [{"uuid": "cf3d4395-86e4-4727-a66e-16d15c6a13fc"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:16:24.184205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] validate_networks() for [('cf3d4395-86e4-4727-a66e-16d15c6a13fc', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:16:24.795425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:16:24.798011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:16:24.798618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:16:24.799051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:16:24.799548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:16:24.816670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:24.817357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:24.817811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:24.818550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:24.819015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:24.819511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:24.842158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Getting quotas for project a310d463021f4bacb0d3e7623f614a9f. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:16:24.848721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Getting quotas for user dc90f318a4794108b48c046dc5d53b38 and project a310d463021f4bacb0d3e7623f614a9f. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:16:24.866495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:16:24.869446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:16:24.954214 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60daaa81-dfee-44c0-9f8c-5f3a10b96652 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844787 Aug 09 15:16:24.955259 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3159/6329] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:16:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:16:24.966175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7bc509cf-6560-4d29-b880-0444d42e9895 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:24.967569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7bc509cf-6560-4d29-b880-0444d42e9895 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:25.091602 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7bc509cf-6560-4d29-b880-0444d42e9895 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1328 microversion: 2.1 time: 0.127869 Aug 09 15:16:25.093429 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3171/6330] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:24 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1328 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:26.116607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63e3f6ea-5902-4743-ad79-b95f91671928 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:26.117244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63e3f6ea-5902-4743-ad79-b95f91671928 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:26.126607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e3f6ea-5902-4743-ad79-b95f91671928 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:26.128876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e3f6ea-5902-4743-ad79-b95f91671928 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:26.129587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e3f6ea-5902-4743-ad79-b95f91671928 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:26.130572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e3f6ea-5902-4743-ad79-b95f91671928 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:26.131289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e3f6ea-5902-4743-ad79-b95f91671928 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:26.131825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63e3f6ea-5902-4743-ad79-b95f91671928 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:26.261523 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63e3f6ea-5902-4743-ad79-b95f91671928 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1415 microversion: 2.1 time: 0.151072 Aug 09 15:16:26.262439 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3160/6331] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:26 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1415 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:27.284884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dff705b6-489a-43eb-a9d9-29b6c70d8a94 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:27.286556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dff705b6-489a-43eb-a9d9-29b6c70d8a94 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:27.306885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff705b6-489a-43eb-a9d9-29b6c70d8a94 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:27.307429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff705b6-489a-43eb-a9d9-29b6c70d8a94 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:27.307872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff705b6-489a-43eb-a9d9-29b6c70d8a94 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:27.308602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff705b6-489a-43eb-a9d9-29b6c70d8a94 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:27.309056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff705b6-489a-43eb-a9d9-29b6c70d8a94 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:27.309477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dff705b6-489a-43eb-a9d9-29b6c70d8a94 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:27.997884 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dff705b6-489a-43eb-a9d9-29b6c70d8a94 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1463 microversion: 2.1 time: 0.718515 Aug 09 15:16:28.016732 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3172/6332] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:27 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1463 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:28.445104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-85e9095b-49fd-4dec-8c96-88b42e110163 req-6532d755-2fed-4083-b665-eb67ac821eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913", "tag": "0caea712-d94c-452f-a51a-2cdbe98c3c52"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:16:28.490461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-85e9095b-49fd-4dec-8c96-88b42e110163 req-6532d755-2fed-4083-b665-eb67ac821eb3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:28.491387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-85e9095b-49fd-4dec-8c96-88b42e110163 req-6532d755-2fed-4083-b665-eb67ac821eb3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:28.491811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-85e9095b-49fd-4dec-8c96-88b42e110163 req-6532d755-2fed-4083-b665-eb67ac821eb3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:28.527394 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-85e9095b-49fd-4dec-8c96-88b42e110163 req-6532d755-2fed-4083-b665-eb67ac821eb3 service nova] Creating event network-changed:0caea712-d94c-452f-a51a-2cdbe98c3c52 for instance fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 on n-h1-844626-8 Aug 09 15:16:28.537953 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-85e9095b-49fd-4dec-8c96-88b42e110163 req-6532d755-2fed-4083-b665-eb67ac821eb3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096678 Aug 09 15:16:28.538949 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3161/6333] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:16:29.025878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aee10da8-5353-4113-96ec-ff887ab4904e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:29.027182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aee10da8-5353-4113-96ec-ff887ab4904e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:29.040500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aee10da8-5353-4113-96ec-ff887ab4904e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:29.040995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aee10da8-5353-4113-96ec-ff887ab4904e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:29.043837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aee10da8-5353-4113-96ec-ff887ab4904e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:29.045047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aee10da8-5353-4113-96ec-ff887ab4904e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:29.045873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aee10da8-5353-4113-96ec-ff887ab4904e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:29.046734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aee10da8-5353-4113-96ec-ff887ab4904e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:29.291152 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aee10da8-5353-4113-96ec-ff887ab4904e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1463 microversion: 2.1 time: 0.272400 Aug 09 15:16:29.321851 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3173/6334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:29 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:30.321635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73cbcd24-97fb-4601-9e79-f4595cd85a5f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:30.327216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-73cbcd24-97fb-4601-9e79-f4595cd85a5f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:30.351734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73cbcd24-97fb-4601-9e79-f4595cd85a5f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:30.352565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73cbcd24-97fb-4601-9e79-f4595cd85a5f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:30.353618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73cbcd24-97fb-4601-9e79-f4595cd85a5f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:30.354921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73cbcd24-97fb-4601-9e79-f4595cd85a5f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:30.355824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73cbcd24-97fb-4601-9e79-f4595cd85a5f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:30.363949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73cbcd24-97fb-4601-9e79-f4595cd85a5f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:30.611737 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-73cbcd24-97fb-4601-9e79-f4595cd85a5f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1463 microversion: 2.1 time: 0.297754 Aug 09 15:16:30.612911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3162/6335] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:30 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1463 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:31.637183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bd7432d5-209f-4ccb-83eb-70d23d80f26f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:31.638164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bd7432d5-209f-4ccb-83eb-70d23d80f26f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:31.654718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd7432d5-209f-4ccb-83eb-70d23d80f26f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:31.656324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd7432d5-209f-4ccb-83eb-70d23d80f26f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:31.656324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd7432d5-209f-4ccb-83eb-70d23d80f26f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:31.656659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd7432d5-209f-4ccb-83eb-70d23d80f26f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:31.656815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd7432d5-209f-4ccb-83eb-70d23d80f26f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:31.657381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd7432d5-209f-4ccb-83eb-70d23d80f26f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:31.896898 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bd7432d5-209f-4ccb-83eb-70d23d80f26f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1463 microversion: 2.1 time: 0.265512 Aug 09 15:16:31.899010 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3174/6336] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:31 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1463 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:32.926119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6a576ef8-5236-4512-a957-2565d533ed83 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:32.926877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6a576ef8-5236-4512-a957-2565d533ed83 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:32.935818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a576ef8-5236-4512-a957-2565d533ed83 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:32.937020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a576ef8-5236-4512-a957-2565d533ed83 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:32.937733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a576ef8-5236-4512-a957-2565d533ed83 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:32.938721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a576ef8-5236-4512-a957-2565d533ed83 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:32.939446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a576ef8-5236-4512-a957-2565d533ed83 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:32.939983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6a576ef8-5236-4512-a957-2565d533ed83 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:33.149876 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6a576ef8-5236-4512-a957-2565d533ed83 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1463 microversion: 2.1 time: 0.229630 Aug 09 15:16:33.150510 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3163/6337] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:32 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1463 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:34.178133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de07c58f-8e80-4123-9614-1af8ff28ac81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:34.179392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de07c58f-8e80-4123-9614-1af8ff28ac81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:34.198828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:34.210288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de07c58f-8e80-4123-9614-1af8ff28ac81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:34.211284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de07c58f-8e80-4123-9614-1af8ff28ac81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:34.212291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de07c58f-8e80-4123-9614-1af8ff28ac81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:34.213838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de07c58f-8e80-4123-9614-1af8ff28ac81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:34.214908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de07c58f-8e80-4123-9614-1af8ff28ac81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:34.215950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de07c58f-8e80-4123-9614-1af8ff28ac81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:34.448601 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de07c58f-8e80-4123-9614-1af8ff28ac81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1463 microversion: 2.1 time: 0.274120 Aug 09 15:16:34.449618 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3175/6338] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:34 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1463 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:35.469863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d1a78448-80a0-4be7-8f12-65bf246bf7a2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:35.470539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d1a78448-80a0-4be7-8f12-65bf246bf7a2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:35.473518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:35.474217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:35.492731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1a78448-80a0-4be7-8f12-65bf246bf7a2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:35.493823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1a78448-80a0-4be7-8f12-65bf246bf7a2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:35.494490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1a78448-80a0-4be7-8f12-65bf246bf7a2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:35.495424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1a78448-80a0-4be7-8f12-65bf246bf7a2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:35.508004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1a78448-80a0-4be7-8f12-65bf246bf7a2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:35.508424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1a78448-80a0-4be7-8f12-65bf246bf7a2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:35.751731 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d1a78448-80a0-4be7-8f12-65bf246bf7a2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1463 microversion: 2.1 time: 0.285483 Aug 09 15:16:35.770354 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3164/6339] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:35 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1463 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:35.876435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b5e5a874-764f-48bb-9e7a-1e70604959a1 req-d963f9cc-c866-4a07-85e6-defb183919e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913", "name": "network-vif-plugged", "status": "completed", "tag": "0caea712-d94c-452f-a51a-2cdbe98c3c52"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:16:35.943780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:35.947250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b5e5a874-764f-48bb-9e7a-1e70604959a1 req-d963f9cc-c866-4a07-85e6-defb183919e8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:35.947963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b5e5a874-764f-48bb-9e7a-1e70604959a1 req-d963f9cc-c866-4a07-85e6-defb183919e8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:35.948575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b5e5a874-764f-48bb-9e7a-1e70604959a1 req-d963f9cc-c866-4a07-85e6-defb183919e8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:35.983804 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b5e5a874-764f-48bb-9e7a-1e70604959a1 req-d963f9cc-c866-4a07-85e6-defb183919e8 service nova] Creating event network-vif-plugged:0caea712-d94c-452f-a51a-2cdbe98c3c52 for instance fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 on n-h1-844626-8 Aug 09 15:16:35.997719 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b5e5a874-764f-48bb-9e7a-1e70604959a1 req-d963f9cc-c866-4a07-85e6-defb183919e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133552 Aug 09 15:16:35.998881 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3176/6340] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:16:36.780470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c2ebe5e-a4d2-40ec-968c-572891ba4358 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:36.782460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c2ebe5e-a4d2-40ec-968c-572891ba4358 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:36.793104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c2ebe5e-a4d2-40ec-968c-572891ba4358 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:36.793978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c2ebe5e-a4d2-40ec-968c-572891ba4358 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:36.794432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c2ebe5e-a4d2-40ec-968c-572891ba4358 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:36.795396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c2ebe5e-a4d2-40ec-968c-572891ba4358 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:36.796033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c2ebe5e-a4d2-40ec-968c-572891ba4358 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:36.796642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c2ebe5e-a4d2-40ec-968c-572891ba4358 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:36.988327 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c2ebe5e-a4d2-40ec-968c-572891ba4358 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1463 microversion: 2.1 time: 0.213234 Aug 09 15:16:36.991311 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3165/6341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:36 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1463 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:38.029509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f823ef86-10ba-4155-9d4d-dad602bf83c6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:38.030860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f823ef86-10ba-4155-9d4d-dad602bf83c6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:38.038429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f823ef86-10ba-4155-9d4d-dad602bf83c6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:38.038911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f823ef86-10ba-4155-9d4d-dad602bf83c6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:38.039512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f823ef86-10ba-4155-9d4d-dad602bf83c6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:38.040046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f823ef86-10ba-4155-9d4d-dad602bf83c6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:38.040877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f823ef86-10ba-4155-9d4d-dad602bf83c6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:38.041297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f823ef86-10ba-4155-9d4d-dad602bf83c6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:38.194012 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f823ef86-10ba-4155-9d4d-dad602bf83c6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1648 microversion: 2.1 time: 0.173521 Aug 09 15:16:38.198259 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3177/6342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:38 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1648 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:38.216579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e0e18800-98f5-4b58-80e7-77e8317a51d9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:38.217933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e0e18800-98f5-4b58-80e7-77e8317a51d9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:38.229718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e18800-98f5-4b58-80e7-77e8317a51d9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:38.230227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e18800-98f5-4b58-80e7-77e8317a51d9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:38.230670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e18800-98f5-4b58-80e7-77e8317a51d9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:38.231416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e18800-98f5-4b58-80e7-77e8317a51d9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:38.231872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e18800-98f5-4b58-80e7-77e8317a51d9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:38.232302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e0e18800-98f5-4b58-80e7-77e8317a51d9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:38.303030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1918344794", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1707078583", "security_groups": [{"name": "tempest-secgroup-smoke-1854134793"}], "block_device_mapping_v2": [{"uuid": "b0a96852-cf29-458a-97f4-eb6c7165ab9f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:16:38.373921 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e0e18800-98f5-4b58-80e7-77e8317a51d9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1648 microversion: 2.1 time: 0.161860 Aug 09 15:16:38.383712 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3166/6343] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:38 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1648 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:38.395656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d70c2f87-9261-429b-8eb1-116e523d6c81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:38.396409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d70c2f87-9261-429b-8eb1-116e523d6c81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:38.403727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d70c2f87-9261-429b-8eb1-116e523d6c81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:38.404379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d70c2f87-9261-429b-8eb1-116e523d6c81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:38.404861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d70c2f87-9261-429b-8eb1-116e523d6c81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:38.405854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d70c2f87-9261-429b-8eb1-116e523d6c81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:38.406427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d70c2f87-9261-429b-8eb1-116e523d6c81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:38.406940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d70c2f87-9261-429b-8eb1-116e523d6c81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:38.435699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] validate_networks() for [('1bb72c01-c0a7-4ed2-b224-d4f2056ee3a8', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:16:38.658410 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d70c2f87-9261-429b-8eb1-116e523d6c81 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1648 microversion: 2.1 time: 0.266499 Aug 09 15:16:38.672287 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3167/6344] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:38 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1648 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:38.736119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1688059263", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "availability_zone": "nova:n-h2-844626-8", "networks": [{"uuid": "cf3d4395-86e4-4727-a66e-16d15c6a13fc"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:16:38.819916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] validate_networks() for [('cf3d4395-86e4-4727-a66e-16d15c6a13fc', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:16:39.150831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:16:39.151511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:16:39.152102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:16:39.152610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:16:39.153233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:16:39.165605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:39.166469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:39.166962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:39.168011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:39.168561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:39.169084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:39.188794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:16:39.194591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Getting quotas for user f99b0693d22442ffa84b9c845d7cbc58 and project da8766706c4d418cb0cc4cdadbebf0d5. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:16:39.262756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:16:39.265439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0a96852-cf29-458a-97f4-eb6c7165ab9f',volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:16:39.376061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:16:39.376595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:16:39.377414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:16:39.377847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:16:39.378262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:16:39.388966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:39.389559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:39.389995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:39.390901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:39.391502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:39.392219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:39.412375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Getting quotas for project a310d463021f4bacb0d3e7623f614a9f. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:16:39.419049 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e0e69c72-ff60-4ea5-9a66-a262ede1971c tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.121512 Aug 09 15:16:39.419666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Getting quotas for user dc90f318a4794108b48c046dc5d53b38 and project a310d463021f4bacb0d3e7623f614a9f. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:16:39.420396 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3178/6345] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:16:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:16:39.433835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5f38339-2b05-4c89-867a-d172f2657062 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:39.434245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:16:39.435227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c5f38339-2b05-4c89-867a-d172f2657062 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:39.436704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:16:39.491320 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5b126ab0-bb97-4e3b-849c-5b9582473b47 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764791 Aug 09 15:16:39.492346 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3168/6346] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:16:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:16:39.503926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-32426d2a-c50c-4197-97c3-8d75aa18f78d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:39.504536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-32426d2a-c50c-4197-97c3-8d75aa18f78d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:39.540446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c5f38339-2b05-4c89-867a-d172f2657062 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:39.556273 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c5f38339-2b05-4c89-867a-d172f2657062 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1095 microversion: 2.1 time: 0.128242 Aug 09 15:16:39.568870 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3179/6347] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:39 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1095 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:39.633143 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-32426d2a-c50c-4197-97c3-8d75aa18f78d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1329 microversion: 2.1 time: 0.133628 Aug 09 15:16:39.644878 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3169/6348] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:39 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1329 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:16:40.581084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee328779-a290-45bd-a9bd-04fc6bd90d8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:40.581802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee328779-a290-45bd-a9bd-04fc6bd90d8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:40.590120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee328779-a290-45bd-a9bd-04fc6bd90d8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:40.590609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee328779-a290-45bd-a9bd-04fc6bd90d8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:40.591035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee328779-a290-45bd-a9bd-04fc6bd90d8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:40.591760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee328779-a290-45bd-a9bd-04fc6bd90d8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:40.592209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee328779-a290-45bd-a9bd-04fc6bd90d8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:40.592636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee328779-a290-45bd-a9bd-04fc6bd90d8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:40.654293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57ede060-0d4c-4d03-b1b5-8462d73005d6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:40.655218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57ede060-0d4c-4d03-b1b5-8462d73005d6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:40.660595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee328779-a290-45bd-a9bd-04fc6bd90d8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:40.662798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57ede060-0d4c-4d03-b1b5-8462d73005d6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:40.663344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57ede060-0d4c-4d03-b1b5-8462d73005d6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:40.663792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57ede060-0d4c-4d03-b1b5-8462d73005d6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:40.664516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57ede060-0d4c-4d03-b1b5-8462d73005d6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:40.664991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57ede060-0d4c-4d03-b1b5-8462d73005d6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:40.665563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57ede060-0d4c-4d03-b1b5-8462d73005d6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:40.668868 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee328779-a290-45bd-a9bd-04fc6bd90d8a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1193 microversion: 2.1 time: 0.091832 Aug 09 15:16:40.669454 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3180/6349] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:40 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1193 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:40.739311 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57ede060-0d4c-4d03-b1b5-8462d73005d6 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1416 microversion: 2.1 time: 0.088940 Aug 09 15:16:40.739938 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3170/6350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:40 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1416 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:41.690241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1b8f9f08-9310-4b82-989b-290fa66d6a76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:41.690857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1b8f9f08-9310-4b82-989b-290fa66d6a76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:41.701868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8f9f08-9310-4b82-989b-290fa66d6a76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:41.702695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8f9f08-9310-4b82-989b-290fa66d6a76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:41.703602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8f9f08-9310-4b82-989b-290fa66d6a76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:41.704832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8f9f08-9310-4b82-989b-290fa66d6a76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:41.705451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8f9f08-9310-4b82-989b-290fa66d6a76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:41.706037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b8f9f08-9310-4b82-989b-290fa66d6a76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:41.762561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9fb8d1c8-1ddd-4699-b7c1-78e4bd7baa5c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:41.768454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9fb8d1c8-1ddd-4699-b7c1-78e4bd7baa5c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:41.781986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb8d1c8-1ddd-4699-b7c1-78e4bd7baa5c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:41.783763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb8d1c8-1ddd-4699-b7c1-78e4bd7baa5c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:41.784289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb8d1c8-1ddd-4699-b7c1-78e4bd7baa5c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:41.790382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb8d1c8-1ddd-4699-b7c1-78e4bd7baa5c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:41.796758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb8d1c8-1ddd-4699-b7c1-78e4bd7baa5c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:41.797584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb8d1c8-1ddd-4699-b7c1-78e4bd7baa5c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:42.002230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1b8f9f08-9310-4b82-989b-290fa66d6a76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:42.012732 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1b8f9f08-9310-4b82-989b-290fa66d6a76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1279 microversion: 2.1 time: 0.326529 Aug 09 15:16:42.020703 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3181/6351] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:41 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1279 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:42.131530 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9fb8d1c8-1ddd-4699-b7c1-78e4bd7baa5c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1464 microversion: 2.1 time: 0.372891 Aug 09 15:16:42.135544 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3171/6352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:41 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1464 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:42.628130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5bf6b4ea-41c3-4ba6-b0b7-7ad5480609fa req-ab3c576c-65ab-40e1-a3ad-3eeb64e4c6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26450bab-27e4-4dbd-98a7-ca78ffc2ed8b", "tag": "bca39ad8-debb-486b-bcba-fefc078b5a08"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:16:42.649335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5bf6b4ea-41c3-4ba6-b0b7-7ad5480609fa req-ab3c576c-65ab-40e1-a3ad-3eeb64e4c6cd service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:42.652546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5bf6b4ea-41c3-4ba6-b0b7-7ad5480609fa req-ab3c576c-65ab-40e1-a3ad-3eeb64e4c6cd service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:42.653315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5bf6b4ea-41c3-4ba6-b0b7-7ad5480609fa req-ab3c576c-65ab-40e1-a3ad-3eeb64e4c6cd service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:42.674324 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5bf6b4ea-41c3-4ba6-b0b7-7ad5480609fa req-ab3c576c-65ab-40e1-a3ad-3eeb64e4c6cd service nova] Creating event network-changed:bca39ad8-debb-486b-bcba-fefc078b5a08 for instance 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b on n-h2-844626-8 Aug 09 15:16:42.683058 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5bf6b4ea-41c3-4ba6-b0b7-7ad5480609fa req-ab3c576c-65ab-40e1-a3ad-3eeb64e4c6cd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058139 Aug 09 15:16:42.684731 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3182/6353] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:16:42.719120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-08a3f024-c00b-4a37-8332-7edd5c6674ad req-6abe0a26-856c-4015-9720-536edcb36ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b", "tag": "49a6b154-ff61-4d73-8292-2f795194a639"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:16:42.731911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-08a3f024-c00b-4a37-8332-7edd5c6674ad req-6abe0a26-856c-4015-9720-536edcb36ac0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:42.733125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-08a3f024-c00b-4a37-8332-7edd5c6674ad req-6abe0a26-856c-4015-9720-536edcb36ac0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:42.733826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-08a3f024-c00b-4a37-8332-7edd5c6674ad req-6abe0a26-856c-4015-9720-536edcb36ac0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:42.751344 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-08a3f024-c00b-4a37-8332-7edd5c6674ad req-6abe0a26-856c-4015-9720-536edcb36ac0 service nova] Creating event network-changed:49a6b154-ff61-4d73-8292-2f795194a639 for instance d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b on n-h2-844626-8 Aug 09 15:16:42.757149 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-08a3f024-c00b-4a37-8332-7edd5c6674ad req-6abe0a26-856c-4015-9720-536edcb36ac0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042803 Aug 09 15:16:42.758652 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3172/6354] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:16:43.040983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f8c5d13b-b059-414f-a953-f543b396a93a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:43.042438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8c5d13b-b059-414f-a953-f543b396a93a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:43.050049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8c5d13b-b059-414f-a953-f543b396a93a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:43.050618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8c5d13b-b059-414f-a953-f543b396a93a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:43.051112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8c5d13b-b059-414f-a953-f543b396a93a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:43.052072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8c5d13b-b059-414f-a953-f543b396a93a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:43.052605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8c5d13b-b059-414f-a953-f543b396a93a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:43.053073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8c5d13b-b059-414f-a953-f543b396a93a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:43.165208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2517889b-5152-462c-9b2b-ae70bf881f0f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:43.166619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2517889b-5152-462c-9b2b-ae70bf881f0f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:43.176806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2517889b-5152-462c-9b2b-ae70bf881f0f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:43.178804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2517889b-5152-462c-9b2b-ae70bf881f0f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:43.179504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2517889b-5152-462c-9b2b-ae70bf881f0f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:43.180494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2517889b-5152-462c-9b2b-ae70bf881f0f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:43.181301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2517889b-5152-462c-9b2b-ae70bf881f0f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:43.181912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2517889b-5152-462c-9b2b-ae70bf881f0f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:43.380444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8c5d13b-b059-414f-a953-f543b396a93a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:43.389536 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f8c5d13b-b059-414f-a953-f543b396a93a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1279 microversion: 2.1 time: 0.353669 Aug 09 15:16:43.390388 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3183/6355] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:43 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1279 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:16:43.440030 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2517889b-5152-462c-9b2b-ae70bf881f0f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1464 microversion: 2.1 time: 0.279766 Aug 09 15:16:43.440637 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3173/6356] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:43 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1464 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:16:44.411681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0e358955-5f4d-4bc1-a21e-08f2cb2b7483 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:44.413589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0e358955-5f4d-4bc1-a21e-08f2cb2b7483 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:44.423043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e358955-5f4d-4bc1-a21e-08f2cb2b7483 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:44.424521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e358955-5f4d-4bc1-a21e-08f2cb2b7483 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:44.425147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e358955-5f4d-4bc1-a21e-08f2cb2b7483 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:44.426065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e358955-5f4d-4bc1-a21e-08f2cb2b7483 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:44.427207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e358955-5f4d-4bc1-a21e-08f2cb2b7483 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:44.427833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0e358955-5f4d-4bc1-a21e-08f2cb2b7483 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:44.461338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8fa8ed31-5005-4cfd-92ba-9bf3e3954c32 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:44.463637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8fa8ed31-5005-4cfd-92ba-9bf3e3954c32 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:44.477040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8fa8ed31-5005-4cfd-92ba-9bf3e3954c32 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:44.483228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8fa8ed31-5005-4cfd-92ba-9bf3e3954c32 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:44.484055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8fa8ed31-5005-4cfd-92ba-9bf3e3954c32 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:44.485284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8fa8ed31-5005-4cfd-92ba-9bf3e3954c32 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:44.486102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8fa8ed31-5005-4cfd-92ba-9bf3e3954c32 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:44.486741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8fa8ed31-5005-4cfd-92ba-9bf3e3954c32 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:44.757576 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8fa8ed31-5005-4cfd-92ba-9bf3e3954c32 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1464 microversion: 2.1 time: 0.299870 Aug 09 15:16:44.759181 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3174/6357] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:44 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1464 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:44.773951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0e358955-5f4d-4bc1-a21e-08f2cb2b7483 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:44.783045 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0e358955-5f4d-4bc1-a21e-08f2cb2b7483 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1279 microversion: 2.1 time: 0.375769 Aug 09 15:16:44.795175 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3184/6358] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:44 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1279 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:45.778195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c10381c2-d20e-4503-ac19-3dc2dbbd41c1 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:45.779296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c10381c2-d20e-4503-ac19-3dc2dbbd41c1 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:45.789439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c10381c2-d20e-4503-ac19-3dc2dbbd41c1 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:45.789439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c10381c2-d20e-4503-ac19-3dc2dbbd41c1 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:45.789439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c10381c2-d20e-4503-ac19-3dc2dbbd41c1 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:45.789439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c10381c2-d20e-4503-ac19-3dc2dbbd41c1 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:45.789439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c10381c2-d20e-4503-ac19-3dc2dbbd41c1 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:45.789439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c10381c2-d20e-4503-ac19-3dc2dbbd41c1 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:45.806254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c56c8a0e-425c-4ea5-bd3d-e5c643067a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:45.807331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c56c8a0e-425c-4ea5-bd3d-e5c643067a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:45.813584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56c8a0e-425c-4ea5-bd3d-e5c643067a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:45.814202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56c8a0e-425c-4ea5-bd3d-e5c643067a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:45.814734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56c8a0e-425c-4ea5-bd3d-e5c643067a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:45.815585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56c8a0e-425c-4ea5-bd3d-e5c643067a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:45.816149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56c8a0e-425c-4ea5-bd3d-e5c643067a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:45.816737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56c8a0e-425c-4ea5-bd3d-e5c643067a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:46.019273 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c56c8a0e-425c-4ea5-bd3d-e5c643067a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:46.019840 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c10381c2-d20e-4503-ac19-3dc2dbbd41c1 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1464 microversion: 2.1 time: 0.245471 Aug 09 15:16:46.033984 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3175/6359] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:45 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1464 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:46.049438 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c56c8a0e-425c-4ea5-bd3d-e5c643067a16 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1279 microversion: 2.1 time: 0.247823 Aug 09 15:16:46.050733 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3185/6360] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:45 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:47.053612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2687a4c-9667-4a1b-8358-3d294764bf1e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:47.054373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b2687a4c-9667-4a1b-8358-3d294764bf1e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:47.062531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2687a4c-9667-4a1b-8358-3d294764bf1e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:47.063033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2687a4c-9667-4a1b-8358-3d294764bf1e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:47.063499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2687a4c-9667-4a1b-8358-3d294764bf1e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:47.064232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2687a4c-9667-4a1b-8358-3d294764bf1e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:47.064699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2687a4c-9667-4a1b-8358-3d294764bf1e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:47.065168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2687a4c-9667-4a1b-8358-3d294764bf1e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:47.072397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3584eedb-b691-42f2-8230-a133a2ccab8e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:47.073128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3584eedb-b691-42f2-8230-a133a2ccab8e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:47.079760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3584eedb-b691-42f2-8230-a133a2ccab8e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:47.080322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3584eedb-b691-42f2-8230-a133a2ccab8e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:47.080814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3584eedb-b691-42f2-8230-a133a2ccab8e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:47.081592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3584eedb-b691-42f2-8230-a133a2ccab8e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:47.082039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3584eedb-b691-42f2-8230-a133a2ccab8e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:47.082452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3584eedb-b691-42f2-8230-a133a2ccab8e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:47.567855 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b2687a4c-9667-4a1b-8358-3d294764bf1e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1464 microversion: 2.1 time: 0.518075 Aug 09 15:16:47.568457 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3176/6361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:47 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1464 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:47.580118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3584eedb-b691-42f2-8230-a133a2ccab8e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:47.588427 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3584eedb-b691-42f2-8230-a133a2ccab8e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1267 microversion: 2.1 time: 0.520700 Aug 09 15:16:47.588993 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3186/6362] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:47 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1267 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:48.168301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-0021718e-63af-4cb3-a00f-41268ccb12ac req-bcbc0343-7bfc-4e23-aad2-9dfe0e60e326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26450bab-27e4-4dbd-98a7-ca78ffc2ed8b", "name": "network-vif-plugged", "status": "completed", "tag": "bca39ad8-debb-486b-bcba-fefc078b5a08"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:16:48.181925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0021718e-63af-4cb3-a00f-41268ccb12ac req-bcbc0343-7bfc-4e23-aad2-9dfe0e60e326 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:48.182437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0021718e-63af-4cb3-a00f-41268ccb12ac req-bcbc0343-7bfc-4e23-aad2-9dfe0e60e326 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:48.182837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-0021718e-63af-4cb3-a00f-41268ccb12ac req-bcbc0343-7bfc-4e23-aad2-9dfe0e60e326 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:48.196769 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-0021718e-63af-4cb3-a00f-41268ccb12ac req-bcbc0343-7bfc-4e23-aad2-9dfe0e60e326 service nova] Creating event network-vif-plugged:bca39ad8-debb-486b-bcba-fefc078b5a08 for instance 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b on n-h2-844626-8 Aug 09 15:16:48.203188 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-0021718e-63af-4cb3-a00f-41268ccb12ac req-bcbc0343-7bfc-4e23-aad2-9dfe0e60e326 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039811 Aug 09 15:16:48.204255 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3177/6363] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:16:48.591471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a55d1d8f-5b76-4671-82de-7acefaa14132 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:48.592046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a55d1d8f-5b76-4671-82de-7acefaa14132 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:48.600279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a55d1d8f-5b76-4671-82de-7acefaa14132 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:48.600828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a55d1d8f-5b76-4671-82de-7acefaa14132 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:48.601266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a55d1d8f-5b76-4671-82de-7acefaa14132 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:48.602148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a55d1d8f-5b76-4671-82de-7acefaa14132 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:48.602607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a55d1d8f-5b76-4671-82de-7acefaa14132 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:48.603255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a55d1d8f-5b76-4671-82de-7acefaa14132 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:48.611307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08a4a518-11b0-4984-b575-81c8eacca8c6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:48.612080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-08a4a518-11b0-4984-b575-81c8eacca8c6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:48.620458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08a4a518-11b0-4984-b575-81c8eacca8c6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:48.621096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08a4a518-11b0-4984-b575-81c8eacca8c6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:48.621620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08a4a518-11b0-4984-b575-81c8eacca8c6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:48.622131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08a4a518-11b0-4984-b575-81c8eacca8c6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:48.622645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08a4a518-11b0-4984-b575-81c8eacca8c6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:48.623050 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08a4a518-11b0-4984-b575-81c8eacca8c6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:48.816899 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a55d1d8f-5b76-4671-82de-7acefaa14132 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1464 microversion: 2.1 time: 0.230017 Aug 09 15:16:48.817521 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3187/6364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:48 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1464 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:48.829892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-08a4a518-11b0-4984-b575-81c8eacca8c6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:48.838760 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-08a4a518-11b0-4984-b575-81c8eacca8c6 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1267 microversion: 2.1 time: 0.232193 Aug 09 15:16:48.852291 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3178/6365] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:48 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1267 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:16:49.839641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8cb31d1-d8f2-48af-93f5-739a4bde1a5d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:49.840347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c8cb31d1-d8f2-48af-93f5-739a4bde1a5d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:49.842542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:49.843357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:49.851391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8cb31d1-d8f2-48af-93f5-739a4bde1a5d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:49.851885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8cb31d1-d8f2-48af-93f5-739a4bde1a5d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:49.852551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8cb31d1-d8f2-48af-93f5-739a4bde1a5d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:49.853243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8cb31d1-d8f2-48af-93f5-739a4bde1a5d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:49.853697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8cb31d1-d8f2-48af-93f5-739a4bde1a5d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:49.854297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8cb31d1-d8f2-48af-93f5-739a4bde1a5d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:49.860989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c465a46e-8679-4115-aa95-b9a21434e458 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:49.863897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c465a46e-8679-4115-aa95-b9a21434e458 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:49.870897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:49.872572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:49.880347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c465a46e-8679-4115-aa95-b9a21434e458 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:49.881571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c465a46e-8679-4115-aa95-b9a21434e458 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:49.882840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c465a46e-8679-4115-aa95-b9a21434e458 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:49.884309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c465a46e-8679-4115-aa95-b9a21434e458 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:49.885401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c465a46e-8679-4115-aa95-b9a21434e458 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:49.886074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c465a46e-8679-4115-aa95-b9a21434e458 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:50.081314 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8cb31d1-d8f2-48af-93f5-739a4bde1a5d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1649 microversion: 2.1 time: 0.245733 Aug 09 15:16:50.081972 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3188/6366] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:49 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1649 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:50.106372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c465a46e-8679-4115-aa95-b9a21434e458 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:50.109626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0685a769-ce0e-4334-a911-66700692dee2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:50.110508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0685a769-ce0e-4334-a911-66700692dee2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:50.111756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=100 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:50.119550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0685a769-ce0e-4334-a911-66700692dee2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:50.120313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0685a769-ce0e-4334-a911-66700692dee2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:50.120933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0685a769-ce0e-4334-a911-66700692dee2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:50.121724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0685a769-ce0e-4334-a911-66700692dee2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:50.122178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0685a769-ce0e-4334-a911-66700692dee2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:50.122422 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c465a46e-8679-4115-aa95-b9a21434e458 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1267 microversion: 2.1 time: 0.266059 Aug 09 15:16:50.122596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0685a769-ce0e-4334-a911-66700692dee2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:50.131143 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3179/6367] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:49 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1267 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:50.274749 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0685a769-ce0e-4334-a911-66700692dee2 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1649 microversion: 2.1 time: 0.169181 Aug 09 15:16:50.275692 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3189/6368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:50 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1649 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:16:50.295200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-207cb188-58f9-4f08-ac42-e5d72e88d23d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:50.295844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-207cb188-58f9-4f08-ac42-e5d72e88d23d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:50.302475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-207cb188-58f9-4f08-ac42-e5d72e88d23d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:50.302980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-207cb188-58f9-4f08-ac42-e5d72e88d23d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:50.303461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-207cb188-58f9-4f08-ac42-e5d72e88d23d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:50.304186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-207cb188-58f9-4f08-ac42-e5d72e88d23d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:50.304672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-207cb188-58f9-4f08-ac42-e5d72e88d23d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:50.305133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-207cb188-58f9-4f08-ac42-e5d72e88d23d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:50.446083 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-207cb188-58f9-4f08-ac42-e5d72e88d23d tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1649 microversion: 2.1 time: 0.154679 Aug 09 15:16:50.446673 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3180/6369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:50 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1649 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:50.466242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40739b55-9dce-44c3-a850-7bbe4d9b1302 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:50.466695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40739b55-9dce-44c3-a850-7bbe4d9b1302 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:50.473272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40739b55-9dce-44c3-a850-7bbe4d9b1302 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:50.473755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40739b55-9dce-44c3-a850-7bbe4d9b1302 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:50.474249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40739b55-9dce-44c3-a850-7bbe4d9b1302 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:50.474859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40739b55-9dce-44c3-a850-7bbe4d9b1302 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:50.475346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40739b55-9dce-44c3-a850-7bbe4d9b1302 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:50.475764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40739b55-9dce-44c3-a850-7bbe4d9b1302 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:50.505372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40739b55-9dce-44c3-a850-7bbe4d9b1302 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:16:50.519563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:50.593005 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40739b55-9dce-44c3-a850-7bbe4d9b1302 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 204 len: 0 microversion: 2.1 time: 0.130380 Aug 09 15:16:50.593933 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3190/6370] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:16:50 2022] DELETE /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:16:50.604399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-66d6544d-0965-4063-bf6e-496defcf68f5 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:50.605143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-66d6544d-0965-4063-bf6e-496defcf68f5 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:50.612105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66d6544d-0965-4063-bf6e-496defcf68f5 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:50.612614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66d6544d-0965-4063-bf6e-496defcf68f5 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:50.613068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66d6544d-0965-4063-bf6e-496defcf68f5 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:50.613790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66d6544d-0965-4063-bf6e-496defcf68f5 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:50.614296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66d6544d-0965-4063-bf6e-496defcf68f5 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:50.614692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-66d6544d-0965-4063-bf6e-496defcf68f5 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:50.746694 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-66d6544d-0965-4063-bf6e-496defcf68f5 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1655 microversion: 2.1 time: 0.148015 Aug 09 15:16:50.747421 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3181/6371] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:50 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:16:51.146505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-620fe3a3-4214-446b-aa8e-3988b3e3bd40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:51.147258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-620fe3a3-4214-446b-aa8e-3988b3e3bd40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:51.154569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-620fe3a3-4214-446b-aa8e-3988b3e3bd40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:51.155051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-620fe3a3-4214-446b-aa8e-3988b3e3bd40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:51.155472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-620fe3a3-4214-446b-aa8e-3988b3e3bd40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:51.156167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-620fe3a3-4214-446b-aa8e-3988b3e3bd40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:51.156604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-620fe3a3-4214-446b-aa8e-3988b3e3bd40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:51.157018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-620fe3a3-4214-446b-aa8e-3988b3e3bd40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:51.300947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-620fe3a3-4214-446b-aa8e-3988b3e3bd40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:51.309561 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-620fe3a3-4214-446b-aa8e-3988b3e3bd40 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1267 microversion: 2.1 time: 0.167652 Aug 09 15:16:51.310212 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3191/6372] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:51 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:51.772420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17c8f8c4-b525-4fda-91eb-fbb47b76e4e9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:51.773065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17c8f8c4-b525-4fda-91eb-fbb47b76e4e9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:51.782798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17c8f8c4-b525-4fda-91eb-fbb47b76e4e9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:51.783747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17c8f8c4-b525-4fda-91eb-fbb47b76e4e9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:51.784839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17c8f8c4-b525-4fda-91eb-fbb47b76e4e9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:51.786129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17c8f8c4-b525-4fda-91eb-fbb47b76e4e9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:51.786932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17c8f8c4-b525-4fda-91eb-fbb47b76e4e9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:51.787777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17c8f8c4-b525-4fda-91eb-fbb47b76e4e9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:51.926384 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17c8f8c4-b525-4fda-91eb-fbb47b76e4e9 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1655 microversion: 2.1 time: 0.158381 Aug 09 15:16:51.926983 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3182/6373] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:51 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:52.330318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-190e1f2b-d789-466d-9656-bcaf688bb049 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:52.331646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-190e1f2b-d789-466d-9656-bcaf688bb049 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:52.339300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190e1f2b-d789-466d-9656-bcaf688bb049 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:52.339762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190e1f2b-d789-466d-9656-bcaf688bb049 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:52.340191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190e1f2b-d789-466d-9656-bcaf688bb049 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:52.340916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190e1f2b-d789-466d-9656-bcaf688bb049 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:52.341366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190e1f2b-d789-466d-9656-bcaf688bb049 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:52.341796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-190e1f2b-d789-466d-9656-bcaf688bb049 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:52.547665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-190e1f2b-d789-466d-9656-bcaf688bb049 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:52.556675 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-190e1f2b-d789-466d-9656-bcaf688bb049 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1267 microversion: 2.1 time: 0.229415 Aug 09 15:16:52.556675 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3192/6374] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:52 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:52.699228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-244f3f79-29b3-4be6-9495-aee38e7d3ff6 req-e8f4b89d-e349-4702-9406-652a608fc884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26450bab-27e4-4dbd-98a7-ca78ffc2ed8b", "name": "network-vif-deleted", "tag": "bca39ad8-debb-486b-bcba-fefc078b5a08"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:16:52.713570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-244f3f79-29b3-4be6-9495-aee38e7d3ff6 req-e8f4b89d-e349-4702-9406-652a608fc884 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:52.714528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-244f3f79-29b3-4be6-9495-aee38e7d3ff6 req-e8f4b89d-e349-4702-9406-652a608fc884 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:52.716001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-244f3f79-29b3-4be6-9495-aee38e7d3ff6 req-e8f4b89d-e349-4702-9406-652a608fc884 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:52.731687 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-244f3f79-29b3-4be6-9495-aee38e7d3ff6 req-e8f4b89d-e349-4702-9406-652a608fc884 service nova] Creating event network-vif-deleted:bca39ad8-debb-486b-bcba-fefc078b5a08 for instance 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b on n-h2-844626-8 Aug 09 15:16:52.738424 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-244f3f79-29b3-4be6-9495-aee38e7d3ff6 req-e8f4b89d-e349-4702-9406-652a608fc884 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045470 Aug 09 15:16:52.739710 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3183/6375] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:16:52.947170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:52.947800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:52.954564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:52.955046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:52.955495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:52.956191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:52.956628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:52.957037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:52.988062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:52.988534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:52.988957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:52.989391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lazy-loading 'fault' on Instance uuid 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:16:53.038830 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aba43bb5-b044-41fb-a80c-5827d519965e tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 200 len: 1454 microversion: 2.1 time: 0.095509 Aug 09 15:16:53.039436 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3193/6376] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:52 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:53.577665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-494a8676-012d-4799-86b9-3d90eca5443f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:53.578275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-494a8676-012d-4799-86b9-3d90eca5443f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:53.585981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-494a8676-012d-4799-86b9-3d90eca5443f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:53.586477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-494a8676-012d-4799-86b9-3d90eca5443f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:53.586917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-494a8676-012d-4799-86b9-3d90eca5443f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:53.587624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-494a8676-012d-4799-86b9-3d90eca5443f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:53.588104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-494a8676-012d-4799-86b9-3d90eca5443f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:53.588529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-494a8676-012d-4799-86b9-3d90eca5443f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:53.733755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-494a8676-012d-4799-86b9-3d90eca5443f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:53.743004 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-494a8676-012d-4799-86b9-3d90eca5443f tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1267 microversion: 2.1 time: 0.169735 Aug 09 15:16:53.743671 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3184/6377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:53 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:54.060442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e92145b-801e-4f3b-bed8-90216fdb6533 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:54.061091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8e92145b-801e-4f3b-bed8-90216fdb6533 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:54.064199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:54.070289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e92145b-801e-4f3b-bed8-90216fdb6533 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:54.070756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e92145b-801e-4f3b-bed8-90216fdb6533 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:54.071258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e92145b-801e-4f3b-bed8-90216fdb6533 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:54.071976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e92145b-801e-4f3b-bed8-90216fdb6533 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:54.072428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e92145b-801e-4f3b-bed8-90216fdb6533 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:54.072856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8e92145b-801e-4f3b-bed8-90216fdb6533 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:54.089826 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-8e92145b-801e-4f3b-bed8-90216fdb6533 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] HTTP exception thrown: Instance 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b could not be found. Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e92145b-801e-4f3b-bed8-90216fdb6533 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Request method failure captured: Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b HTTP/1.1 Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8npH--QkIlH_EdG5FlGQe8ekXFjiPz6V4DTFmiGi1tyqWSkj8iUnitEVsbgMR1QavIXUIR6z435XHNXLHvsvFw9jSXPQtIqjKXvaYpmxhDdXI1jtyQW8SOIHIEQc8O38M0FbXHItQCe2rsJkLvono6Q8M6Io0s3bvSG8uZtqjwQdJ9o Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: a310d463021f4bacb0d3e7623f614a9f Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestServerMultinode-226921406 Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a310d463021f4bacb0d3e7623f614a9f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a310d463021f4bacb0d3e7623f614a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a310d463021f4bacb0d3e7623f614a9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a310d463021f4bacb0d3e7623f614a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestServerMultinode-226921406 Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: a310d463021f4bacb0d3e7623f614a9f Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestServerMultinode-226921406 Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestServerMultinode-226921406-project-admin Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: dc90f318a4794108b48c046dc5d53b38 Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestServerMultinode-226921406-project-admin Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b could not be found. Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '26450bab-27e4-4dbd-98a7-ca78ffc2ed8b'} Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b could not be found. Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b could not be found. Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:16:54.091714 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:16:54.096804 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:16:54.096804 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:16:54.096804 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:16:54.096804 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:16:54.096804 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:16:54.096804 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b could not be found. Aug 09 15:16:54.096804 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:16:54.096804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8e92145b-801e-4f3b-bed8-90216fdb6533 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Returning 404 to user: Instance 26450bab-27e4-4dbd-98a7-ca78ffc2ed8b could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:16:54.096804 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8e92145b-801e-4f3b-bed8-90216fdb6533 tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b" status: 404 len: 111 microversion: 2.1 time: 0.036911 Aug 09 15:16:54.096804 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3194/6378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:54 2022] GET /compute/v2.1/servers/26450bab-27e4-4dbd-98a7-ca78ffc2ed8b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:16:54.102019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de6b56eb-40ac-4575-9664-b3891e7fdf1c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:54.102530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-de6b56eb-40ac-4575-9664-b3891e7fdf1c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:54.108647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de6b56eb-40ac-4575-9664-b3891e7fdf1c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:54.109151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de6b56eb-40ac-4575-9664-b3891e7fdf1c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:54.109598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de6b56eb-40ac-4575-9664-b3891e7fdf1c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:54.110314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de6b56eb-40ac-4575-9664-b3891e7fdf1c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:54.110826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de6b56eb-40ac-4575-9664-b3891e7fdf1c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:54.111287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de6b56eb-40ac-4575-9664-b3891e7fdf1c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:54.137918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-de6b56eb-40ac-4575-9664-b3891e7fdf1c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:16:54.205546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:16:54.225191 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-de6b56eb-40ac-4575-9664-b3891e7fdf1c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "DELETE /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 204 len: 0 microversion: 2.1 time: 0.126575 Aug 09 15:16:54.225842 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3185/6379] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:16:54 2022] DELETE /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:16:54.234413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-587d2417-2f27-475a-9a69-a4c4d412a57c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:54.235041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-587d2417-2f27-475a-9a69-a4c4d412a57c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:54.242117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-587d2417-2f27-475a-9a69-a4c4d412a57c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:54.242667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-587d2417-2f27-475a-9a69-a4c4d412a57c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:54.243047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-587d2417-2f27-475a-9a69-a4c4d412a57c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:54.243794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-587d2417-2f27-475a-9a69-a4c4d412a57c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:54.244248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-587d2417-2f27-475a-9a69-a4c4d412a57c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:54.244678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-587d2417-2f27-475a-9a69-a4c4d412a57c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:54.376228 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-587d2417-2f27-475a-9a69-a4c4d412a57c tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1654 microversion: 2.1 time: 0.145512 Aug 09 15:16:54.376879 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3195/6380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:54 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1654 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:54.764851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-07628099-4ba7-4a38-b47a-241ef9346c01 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:54.765559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-07628099-4ba7-4a38-b47a-241ef9346c01 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:54.772739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07628099-4ba7-4a38-b47a-241ef9346c01 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:54.773232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07628099-4ba7-4a38-b47a-241ef9346c01 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:54.773672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07628099-4ba7-4a38-b47a-241ef9346c01 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:54.774485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07628099-4ba7-4a38-b47a-241ef9346c01 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:54.774853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07628099-4ba7-4a38-b47a-241ef9346c01 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:54.775318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-07628099-4ba7-4a38-b47a-241ef9346c01 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:54.911825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-07628099-4ba7-4a38-b47a-241ef9346c01 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:54.920049 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-07628099-4ba7-4a38-b47a-241ef9346c01 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1267 microversion: 2.1 time: 0.159366 Aug 09 15:16:54.920636 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3186/6381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:54 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:55.397994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5dfe7da7-fd9f-4d54-b176-7eaa9130eedf tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:55.398571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5dfe7da7-fd9f-4d54-b176-7eaa9130eedf tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:55.405809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dfe7da7-fd9f-4d54-b176-7eaa9130eedf tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:55.406286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dfe7da7-fd9f-4d54-b176-7eaa9130eedf tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:55.406709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dfe7da7-fd9f-4d54-b176-7eaa9130eedf tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:55.407428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dfe7da7-fd9f-4d54-b176-7eaa9130eedf tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:55.407875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dfe7da7-fd9f-4d54-b176-7eaa9130eedf tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:55.408281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5dfe7da7-fd9f-4d54-b176-7eaa9130eedf tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:55.543784 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5dfe7da7-fd9f-4d54-b176-7eaa9130eedf tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 200 len: 1654 microversion: 2.1 time: 0.149801 Aug 09 15:16:55.544380 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3196/6382] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:55 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 1654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:55.944056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-db88ff4b-48cd-4b67-921f-4997c7abfc76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:55.945605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-db88ff4b-48cd-4b67-921f-4997c7abfc76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:55.958733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db88ff4b-48cd-4b67-921f-4997c7abfc76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:55.959309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db88ff4b-48cd-4b67-921f-4997c7abfc76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:55.965328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db88ff4b-48cd-4b67-921f-4997c7abfc76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:55.965328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db88ff4b-48cd-4b67-921f-4997c7abfc76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:55.965328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db88ff4b-48cd-4b67-921f-4997c7abfc76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:55.965328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-db88ff4b-48cd-4b67-921f-4997c7abfc76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:55.992233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-258200b2-5f4a-4d75-8a6b-729f66a5a388 req-a2c5736c-b00f-4a86-b3bc-42534afabd13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913", "name": "network-vif-deleted", "tag": "0caea712-d94c-452f-a51a-2cdbe98c3c52"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:16:56.013885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-258200b2-5f4a-4d75-8a6b-729f66a5a388 req-a2c5736c-b00f-4a86-b3bc-42534afabd13 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:56.014673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-258200b2-5f4a-4d75-8a6b-729f66a5a388 req-a2c5736c-b00f-4a86-b3bc-42534afabd13 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:56.015310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-258200b2-5f4a-4d75-8a6b-729f66a5a388 req-a2c5736c-b00f-4a86-b3bc-42534afabd13 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:56.046902 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-258200b2-5f4a-4d75-8a6b-729f66a5a388 req-a2c5736c-b00f-4a86-b3bc-42534afabd13 service nova] Creating event network-vif-deleted:0caea712-d94c-452f-a51a-2cdbe98c3c52 for instance fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 on n-h1-844626-8 Aug 09 15:16:56.063413 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-258200b2-5f4a-4d75-8a6b-729f66a5a388 req-a2c5736c-b00f-4a86-b3bc-42534afabd13 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075148 Aug 09 15:16:56.064713 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3197/6383] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:16:56.248358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5f3f23eb-1675-4f9a-bada-8ca0246cd259 req-a73f8e28-db10-4147-9b25-ac967f16894e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b", "name": "network-vif-plugged", "status": "completed", "tag": "49a6b154-ff61-4d73-8292-2f795194a639"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:16:56.258544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-db88ff4b-48cd-4b67-921f-4997c7abfc76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:56.260392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5f3f23eb-1675-4f9a-bada-8ca0246cd259 req-a73f8e28-db10-4147-9b25-ac967f16894e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:56.260943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5f3f23eb-1675-4f9a-bada-8ca0246cd259 req-a73f8e28-db10-4147-9b25-ac967f16894e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:56.261453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5f3f23eb-1675-4f9a-bada-8ca0246cd259 req-a73f8e28-db10-4147-9b25-ac967f16894e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:56.268992 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-db88ff4b-48cd-4b67-921f-4997c7abfc76 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1267 microversion: 2.1 time: 0.331559 Aug 09 15:16:56.270222 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3187/6384] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:55 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1267 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:56.279442 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5f3f23eb-1675-4f9a-bada-8ca0246cd259 req-a73f8e28-db10-4147-9b25-ac967f16894e service nova] Creating event network-vif-plugged:49a6b154-ff61-4d73-8292-2f795194a639 for instance d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b on n-h2-844626-8 Aug 09 15:16:56.285075 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5f3f23eb-1675-4f9a-bada-8ca0246cd259 req-a73f8e28-db10-4147-9b25-ac967f16894e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040586 Aug 09 15:16:56.286065 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3198/6385] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:16:56.565307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5970715b-04dd-4fd4-8420-838f0cd23b8f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:56.565938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5970715b-04dd-4fd4-8420-838f0cd23b8f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] [instance: fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:56.572120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5970715b-04dd-4fd4-8420-838f0cd23b8f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:56.572615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5970715b-04dd-4fd4-8420-838f0cd23b8f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:56.573265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5970715b-04dd-4fd4-8420-838f0cd23b8f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:56.573980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5970715b-04dd-4fd4-8420-838f0cd23b8f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:56.574467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5970715b-04dd-4fd4-8420-838f0cd23b8f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:56.574907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5970715b-04dd-4fd4-8420-838f0cd23b8f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:56.591714 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-5970715b-04dd-4fd4-8420-838f0cd23b8f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] HTTP exception thrown: Instance fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 could not be found. Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5970715b-04dd-4fd4-8420-838f0cd23b8f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Request method failure captured: Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 HTTP/1.1 Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8npH--QkIlH_EdG5FlGQe8ekXFjiPz6V4DTFmiGi1tyqWSkj8iUnitEVsbgMR1QavIXUIR6z435XHNXLHvsvFw9jSXPQtIqjKXvaYpmxhDdXI1jtyQW8SOIHIEQc8O38M0FbXHItQCe2rsJkLvono6Q8M6Io0s3bvSG8uZtqjwQdJ9o Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: a310d463021f4bacb0d3e7623f614a9f Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestServerMultinode-226921406 Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a310d463021f4bacb0d3e7623f614a9f", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a310d463021f4bacb0d3e7623f614a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a310d463021f4bacb0d3e7623f614a9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a310d463021f4bacb0d3e7623f614a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestServerMultinode-226921406 Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: a310d463021f4bacb0d3e7623f614a9f Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestServerMultinode-226921406 Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestServerMultinode-226921406-project-admin Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: dc90f318a4794108b48c046dc5d53b38 Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestServerMultinode-226921406-project-admin Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 could not be found. Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913'} Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 could not be found. Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 could not be found. Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:16:56.593412 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:16:56.598784 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:16:56.598784 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:16:56.598784 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:16:56.598784 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:16:56.598784 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:16:56.598784 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 could not be found. Aug 09 15:16:56.598784 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:16:56.598784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5970715b-04dd-4fd4-8420-838f0cd23b8f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] Returning 404 to user: Instance fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:16:56.598784 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5970715b-04dd-4fd4-8420-838f0cd23b8f tempest-TestServerMultinode-226921406 tempest-TestServerMultinode-226921406-project-admin] 10.222.0.50 "GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913" status: 404 len: 111 microversion: 2.1 time: 0.033483 Aug 09 15:16:56.598784 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3188/6386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:56 2022] GET /compute/v2.1/servers/fa3996bf-6eb7-4e5d-b5f2-a7130e8c3913 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:16:57.291487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7ac5601b-47e7-43a4-867e-f2bac8412e58 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:57.292243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7ac5601b-47e7-43a4-867e-f2bac8412e58 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:57.299956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ac5601b-47e7-43a4-867e-f2bac8412e58 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:57.300505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ac5601b-47e7-43a4-867e-f2bac8412e58 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:57.300933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ac5601b-47e7-43a4-867e-f2bac8412e58 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:57.302015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ac5601b-47e7-43a4-867e-f2bac8412e58 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:57.302462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ac5601b-47e7-43a4-867e-f2bac8412e58 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:57.302868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ac5601b-47e7-43a4-867e-f2bac8412e58 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:57.519563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7ac5601b-47e7-43a4-867e-f2bac8412e58 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:57.527503 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7ac5601b-47e7-43a4-867e-f2bac8412e58 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1267 microversion: 2.1 time: 0.240981 Aug 09 15:16:57.528085 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3199/6387] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:57 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:58.548935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-adafb428-6058-4939-ab4a-5cc50e32586a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:58.549671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-adafb428-6058-4939-ab4a-5cc50e32586a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:58.557156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adafb428-6058-4939-ab4a-5cc50e32586a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:58.557960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adafb428-6058-4939-ab4a-5cc50e32586a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:58.558388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adafb428-6058-4939-ab4a-5cc50e32586a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:58.559322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adafb428-6058-4939-ab4a-5cc50e32586a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:58.559984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adafb428-6058-4939-ab4a-5cc50e32586a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:58.560555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adafb428-6058-4939-ab4a-5cc50e32586a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:58.772165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-adafb428-6058-4939-ab4a-5cc50e32586a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:58.780284 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-adafb428-6058-4939-ab4a-5cc50e32586a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1454 microversion: 2.1 time: 0.235289 Aug 09 15:16:58.780893 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3189/6388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:58 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1454 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:16:58.801322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d1da5bf-a37b-4922-9ec8-0eb907f1e9a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:16:58.802303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d1da5bf-a37b-4922-9ec8-0eb907f1e9a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:16:58.809096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d1da5bf-a37b-4922-9ec8-0eb907f1e9a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:58.809576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d1da5bf-a37b-4922-9ec8-0eb907f1e9a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:58.810007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d1da5bf-a37b-4922-9ec8-0eb907f1e9a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:58.810701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d1da5bf-a37b-4922-9ec8-0eb907f1e9a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:16:58.811178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d1da5bf-a37b-4922-9ec8-0eb907f1e9a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:16:58.811592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d1da5bf-a37b-4922-9ec8-0eb907f1e9a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:16:59.382233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d1da5bf-a37b-4922-9ec8-0eb907f1e9a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:16:59.391059 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d1da5bf-a37b-4922-9ec8-0eb907f1e9a2 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1454 microversion: 2.1 time: 0.593752 Aug 09 15:16:59.402319 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3200/6389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:16:58 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1454 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:17:01.685615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-044689fc-08b1-4297-96b8-742660e4e8ee req-1ab3a873-98d2-4176-909e-cf6618949cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b", "tag": "49a6b154-ff61-4d73-8292-2f795194a639"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:17:01.697864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-044689fc-08b1-4297-96b8-742660e4e8ee req-1ab3a873-98d2-4176-909e-cf6618949cb2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:17:01.698667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-044689fc-08b1-4297-96b8-742660e4e8ee req-1ab3a873-98d2-4176-909e-cf6618949cb2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:17:01.699373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-044689fc-08b1-4297-96b8-742660e4e8ee req-1ab3a873-98d2-4176-909e-cf6618949cb2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:17:01.720945 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-044689fc-08b1-4297-96b8-742660e4e8ee req-1ab3a873-98d2-4176-909e-cf6618949cb2 service nova] Creating event network-changed:49a6b154-ff61-4d73-8292-2f795194a639 for instance d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b on n-h2-844626-8 Aug 09 15:17:01.727910 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-044689fc-08b1-4297-96b8-742660e4e8ee req-1ab3a873-98d2-4176-909e-cf6618949cb2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046486 Aug 09 15:17:01.728839 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3190/6390] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:18:41.750347 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e81a619-36fd-4d2d-bb1a-e0ebabb081c8] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:18:41.752065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=13 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:18:41.752840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:18:41.756308 n-d-844626-8 devstack@n-api.service[119406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb00389d-3bc9-4291-a475-262c81a6a465] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:18:41.757082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:18:41.757225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e2b3ff4b-81fe-4efc-808e-cb9597057ac9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:41.757618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e2b3ff4b-81fe-4efc-808e-cb9597057ac9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:41.757924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:18:41.765233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2b3ff4b-81fe-4efc-808e-cb9597057ac9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:41.765784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2b3ff4b-81fe-4efc-808e-cb9597057ac9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:41.766436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2b3ff4b-81fe-4efc-808e-cb9597057ac9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:41.767412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2b3ff4b-81fe-4efc-808e-cb9597057ac9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:41.768042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2b3ff4b-81fe-4efc-808e-cb9597057ac9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:41.768625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e2b3ff4b-81fe-4efc-808e-cb9597057ac9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:41.799577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e2b3ff4b-81fe-4efc-808e-cb9597057ac9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:18:41.883447 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e2b3ff4b-81fe-4efc-808e-cb9597057ac9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 204 len: 0 microversion: 2.1 time: 0.140109 Aug 09 15:18:41.885123 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3201/6391] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:18:41 2022] DELETE /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:18:41.894186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c4168894-1340-4b53-8586-09d8a70eff9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:41.896005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c4168894-1340-4b53-8586-09d8a70eff9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:41.903440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4168894-1340-4b53-8586-09d8a70eff9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:41.904286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4168894-1340-4b53-8586-09d8a70eff9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:41.904782 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4168894-1340-4b53-8586-09d8a70eff9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:41.906063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4168894-1340-4b53-8586-09d8a70eff9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:41.906546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4168894-1340-4b53-8586-09d8a70eff9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:41.906961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4168894-1340-4b53-8586-09d8a70eff9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:42.089289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-4076e8f1-db9d-4403-8d31-0f2a0b08d74d req-c7b4cc65-c8f1-4266-9afa-1037bc236e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b", "tag": "49a6b154-ff61-4d73-8292-2f795194a639"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:18:42.093147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c4168894-1340-4b53-8586-09d8a70eff9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:18:42.101449 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c4168894-1340-4b53-8586-09d8a70eff9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1579 microversion: 2.1 time: 0.211567 Aug 09 15:18:42.101751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4076e8f1-db9d-4403-8d31-0f2a0b08d74d req-c7b4cc65-c8f1-4266-9afa-1037bc236e68 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:42.102040 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3202/6392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:18:41 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1579 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:18:42.102227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4076e8f1-db9d-4403-8d31-0f2a0b08d74d req-c7b4cc65-c8f1-4266-9afa-1037bc236e68 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:42.102841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-4076e8f1-db9d-4403-8d31-0f2a0b08d74d req-c7b4cc65-c8f1-4266-9afa-1037bc236e68 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:42.117146 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-4076e8f1-db9d-4403-8d31-0f2a0b08d74d req-c7b4cc65-c8f1-4266-9afa-1037bc236e68 service nova] Creating event network-changed:49a6b154-ff61-4d73-8292-2f795194a639 for instance d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b on n-h2-844626-8 Aug 09 15:18:42.122840 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-4076e8f1-db9d-4403-8d31-0f2a0b08d74d req-c7b4cc65-c8f1-4266-9afa-1037bc236e68 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.377486 Aug 09 15:18:42.123760 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3191/6393] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:18:43.132583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-07acdf6b-e86f-4059-884d-d963728f585d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:43.133220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-07acdf6b-e86f-4059-884d-d963728f585d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:43.141998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07acdf6b-e86f-4059-884d-d963728f585d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:43.142485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07acdf6b-e86f-4059-884d-d963728f585d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:43.142921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07acdf6b-e86f-4059-884d-d963728f585d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:43.143669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07acdf6b-e86f-4059-884d-d963728f585d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:43.144161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07acdf6b-e86f-4059-884d-d963728f585d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:43.144585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-07acdf6b-e86f-4059-884d-d963728f585d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:43.161726 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e81a619-36fd-4d2d-bb1a-e0ebabb081c8] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 48932. Aug 09 15:18:43.381341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-07acdf6b-e86f-4059-884d-d963728f585d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:18:43.389459 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-07acdf6b-e86f-4059-884d-d963728f585d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1579 microversion: 2.1 time: 0.260780 Aug 09 15:18:43.390052 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3203/6394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:18:43 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1579 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:18:44.215311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1527e145-e459-41ec-af88-2dcfa8380260 req-d9420013-27a0-491f-b6ca-988fed386d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b", "name": "network-vif-deleted", "tag": "49a6b154-ff61-4d73-8292-2f795194a639"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:18:44.228631 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb00389d-3bc9-4291-a475-262c81a6a465] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 48938. Aug 09 15:18:44.234839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1527e145-e459-41ec-af88-2dcfa8380260 req-d9420013-27a0-491f-b6ca-988fed386d4b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:44.235865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1527e145-e459-41ec-af88-2dcfa8380260 req-d9420013-27a0-491f-b6ca-988fed386d4b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:44.236518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1527e145-e459-41ec-af88-2dcfa8380260 req-d9420013-27a0-491f-b6ca-988fed386d4b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:44.250355 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1527e145-e459-41ec-af88-2dcfa8380260 req-d9420013-27a0-491f-b6ca-988fed386d4b service nova] Creating event network-vif-deleted:49a6b154-ff61-4d73-8292-2f795194a639 for instance d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b on n-h2-844626-8 Aug 09 15:18:44.255656 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1527e145-e459-41ec-af88-2dcfa8380260 req-d9420013-27a0-491f-b6ca-988fed386d4b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047179 Aug 09 15:18:44.256302 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3192/6395] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:18:44.412114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-772cad71-56c1-4406-959c-5b91083e73e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:44.412774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-772cad71-56c1-4406-959c-5b91083e73e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:44.420303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-772cad71-56c1-4406-959c-5b91083e73e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:44.420795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-772cad71-56c1-4406-959c-5b91083e73e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:44.421223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-772cad71-56c1-4406-959c-5b91083e73e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:44.421928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-772cad71-56c1-4406-959c-5b91083e73e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:44.422372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-772cad71-56c1-4406-959c-5b91083e73e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:44.422795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-772cad71-56c1-4406-959c-5b91083e73e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:44.538099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-772cad71-56c1-4406-959c-5b91083e73e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:18:44.546574 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-772cad71-56c1-4406-959c-5b91083e73e8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1226 microversion: 2.1 time: 0.138653 Aug 09 15:18:44.547487 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3204/6396] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:18:44 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1226 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:18:45.570153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-77ece9fe-27ab-4cb9-9a93-0425ad19f318 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:45.570982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77ece9fe-27ab-4cb9-9a93-0425ad19f318 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:45.577471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77ece9fe-27ab-4cb9-9a93-0425ad19f318 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:45.577960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77ece9fe-27ab-4cb9-9a93-0425ad19f318 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:45.578409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77ece9fe-27ab-4cb9-9a93-0425ad19f318 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:45.579128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77ece9fe-27ab-4cb9-9a93-0425ad19f318 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:45.579696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77ece9fe-27ab-4cb9-9a93-0425ad19f318 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:45.580126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77ece9fe-27ab-4cb9-9a93-0425ad19f318 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:45.645133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-77ece9fe-27ab-4cb9-9a93-0425ad19f318 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:18:45.653642 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-77ece9fe-27ab-4cb9-9a93-0425ad19f318 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1226 microversion: 2.1 time: 0.088704 Aug 09 15:18:45.654302 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3193/6397] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:18:45 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:18:46.674220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9d2a0956-368a-4c49-a872-098b2998d80d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:46.674846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9d2a0956-368a-4c49-a872-098b2998d80d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:46.681968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d2a0956-368a-4c49-a872-098b2998d80d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:46.682456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d2a0956-368a-4c49-a872-098b2998d80d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:46.682888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d2a0956-368a-4c49-a872-098b2998d80d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:46.683611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d2a0956-368a-4c49-a872-098b2998d80d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:46.684064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d2a0956-368a-4c49-a872-098b2998d80d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:46.684491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9d2a0956-368a-4c49-a872-098b2998d80d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:46.749434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9d2a0956-368a-4c49-a872-098b2998d80d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:18:46.757740 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9d2a0956-368a-4c49-a872-098b2998d80d tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1226 microversion: 2.1 time: 0.087533 Aug 09 15:18:46.758334 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3205/6398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:18:46 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:18:47.657368 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:18:47.658288 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:18:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:18:47.725514 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:18:47.725777 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:18:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:18:47.778576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3751a0a4-f0ef-4f5b-b09c-46793dff7c18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:47.779075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3751a0a4-f0ef-4f5b-b09c-46793dff7c18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:47.787599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3751a0a4-f0ef-4f5b-b09c-46793dff7c18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:47.790572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3751a0a4-f0ef-4f5b-b09c-46793dff7c18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:47.790572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3751a0a4-f0ef-4f5b-b09c-46793dff7c18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:47.790572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3751a0a4-f0ef-4f5b-b09c-46793dff7c18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:47.790572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3751a0a4-f0ef-4f5b-b09c-46793dff7c18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:47.790572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3751a0a4-f0ef-4f5b-b09c-46793dff7c18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:47.855185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3751a0a4-f0ef-4f5b-b09c-46793dff7c18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:18:47.863996 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3751a0a4-f0ef-4f5b-b09c-46793dff7c18 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 200 len: 1226 microversion: 2.1 time: 0.089647 Aug 09 15:18:47.864571 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3194/6399] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:18:47 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:18:48.884835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d368e31-6bf1-4dba-9bca-24d41bd34f9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:48.885507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6d368e31-6bf1-4dba-9bca-24d41bd34f9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:48.892859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d368e31-6bf1-4dba-9bca-24d41bd34f9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:48.893349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d368e31-6bf1-4dba-9bca-24d41bd34f9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:48.893785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d368e31-6bf1-4dba-9bca-24d41bd34f9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:48.894490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d368e31-6bf1-4dba-9bca-24d41bd34f9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:48.894937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d368e31-6bf1-4dba-9bca-24d41bd34f9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:48.895402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d368e31-6bf1-4dba-9bca-24d41bd34f9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:48.910153 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-6d368e31-6bf1-4dba-9bca-24d41bd34f9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b could not be found. Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d368e31-6bf1-4dba-9bca-24d41bd34f9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b HTTP/1.1 Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b could not be found. Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'd9e59af0-bf7c-4a6b-a0a2-1b0982cc373b'} Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b could not be found. Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b could not be found. Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:18:48.911900 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:18:48.917076 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:18:48.917076 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:18:48.917076 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:18:48.917076 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:18:48.917076 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:18:48.917076 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b could not be found. Aug 09 15:18:48.917076 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:18:48.917076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d368e31-6bf1-4dba-9bca-24d41bd34f9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:18:48.917076 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6d368e31-6bf1-4dba-9bca-24d41bd34f9e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b" status: 404 len: 111 microversion: 2.1 time: 0.032625 Aug 09 15:18:48.917076 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3206/6400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:18:48 2022] GET /compute/v2.1/servers/d9e59af0-bf7c-4a6b-a0a2-1b0982cc373b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:18:51.299916 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:18:51.300581 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:18:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:18:55.244774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3f667591-7e28-4762-a314-1fb5f5293046 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:55.245323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3f667591-7e28-4762-a314-1fb5f5293046 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:55.250397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0e25ae55-5833-456b-850d-a8aa36a3afa5 req-0b1004f2-7b37-4180-921e-cfb015a8efb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a", "tag": "849a5f7e-c19f-4237-9ccf-75d57b95a7c9"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:18:55.252937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f667591-7e28-4762-a314-1fb5f5293046 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:55.253415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f667591-7e28-4762-a314-1fb5f5293046 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:55.253871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f667591-7e28-4762-a314-1fb5f5293046 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:55.254564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f667591-7e28-4762-a314-1fb5f5293046 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:55.255297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f667591-7e28-4762-a314-1fb5f5293046 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:55.256053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3f667591-7e28-4762-a314-1fb5f5293046 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:55.262292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0e25ae55-5833-456b-850d-a8aa36a3afa5 req-0b1004f2-7b37-4180-921e-cfb015a8efb4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:55.262792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0e25ae55-5833-456b-850d-a8aa36a3afa5 req-0b1004f2-7b37-4180-921e-cfb015a8efb4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:55.263327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0e25ae55-5833-456b-850d-a8aa36a3afa5 req-0b1004f2-7b37-4180-921e-cfb015a8efb4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:55.274692 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0e25ae55-5833-456b-850d-a8aa36a3afa5 req-0b1004f2-7b37-4180-921e-cfb015a8efb4 service nova] Creating event network-changed:849a5f7e-c19f-4237-9ccf-75d57b95a7c9 for instance 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a on n-h2-844626-8 Aug 09 15:18:55.279973 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0e25ae55-5833-456b-850d-a8aa36a3afa5 req-0b1004f2-7b37-4180-921e-cfb015a8efb4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033276 Aug 09 15:18:55.280565 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3207/6401] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:18:55.283431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3f667591-7e28-4762-a314-1fb5f5293046 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:18:55.370897 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3f667591-7e28-4762-a314-1fb5f5293046 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 204 len: 0 microversion: 2.1 time: 0.129860 Aug 09 15:18:55.372295 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3195/6402] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:18:55 2022] DELETE /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:18:55.382512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8ba4b731-ed6d-480c-ada3-fc4d63522666 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:55.384375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8ba4b731-ed6d-480c-ada3-fc4d63522666 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:55.391615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ba4b731-ed6d-480c-ada3-fc4d63522666 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:55.392182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ba4b731-ed6d-480c-ada3-fc4d63522666 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:55.392673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ba4b731-ed6d-480c-ada3-fc4d63522666 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:55.393589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ba4b731-ed6d-480c-ada3-fc4d63522666 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:55.394187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ba4b731-ed6d-480c-ada3-fc4d63522666 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:55.394751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8ba4b731-ed6d-480c-ada3-fc4d63522666 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:55.547725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8ba4b731-ed6d-480c-ada3-fc4d63522666 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:18:55.555794 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8ba4b731-ed6d-480c-ada3-fc4d63522666 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1578 microversion: 2.1 time: 0.178537 Aug 09 15:18:55.556369 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3208/6403] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:18:55 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:18:56.578412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8141a63-ef2f-49a4-bee4-feaa38078649 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:56.579684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8141a63-ef2f-49a4-bee4-feaa38078649 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:56.586934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8141a63-ef2f-49a4-bee4-feaa38078649 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:56.587469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8141a63-ef2f-49a4-bee4-feaa38078649 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:56.587913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8141a63-ef2f-49a4-bee4-feaa38078649 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:56.588604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8141a63-ef2f-49a4-bee4-feaa38078649 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:56.589074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8141a63-ef2f-49a4-bee4-feaa38078649 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:56.589504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8141a63-ef2f-49a4-bee4-feaa38078649 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:56.722471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e8141a63-ef2f-49a4-bee4-feaa38078649 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:18:56.731868 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e8141a63-ef2f-49a4-bee4-feaa38078649 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1578 microversion: 2.1 time: 0.157939 Aug 09 15:18:56.732420 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3196/6404] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:18:56 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:18:57.754208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1b97d71-6160-4ace-ad60-f0377c72437a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:57.754839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1b97d71-6160-4ace-ad60-f0377c72437a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:57.762089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1b97d71-6160-4ace-ad60-f0377c72437a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:57.762570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1b97d71-6160-4ace-ad60-f0377c72437a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:57.763124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1b97d71-6160-4ace-ad60-f0377c72437a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:57.763722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1b97d71-6160-4ace-ad60-f0377c72437a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:57.764170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1b97d71-6160-4ace-ad60-f0377c72437a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:57.764577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1b97d71-6160-4ace-ad60-f0377c72437a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:57.856561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1b97d71-6160-4ace-ad60-f0377c72437a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:18:57.870923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7b8ea85a-c9a6-47ff-8835-d2a7b6869943 req-750c1855-07ce-410e-8068-038c82e31516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a", "name": "network-vif-deleted", "tag": "849a5f7e-c19f-4237-9ccf-75d57b95a7c9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:18:57.873330 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1b97d71-6160-4ace-ad60-f0377c72437a tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1391 microversion: 2.1 time: 0.122955 Aug 09 15:18:57.874550 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3209/6405] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:18:57 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1391 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:18:57.882179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7b8ea85a-c9a6-47ff-8835-d2a7b6869943 req-750c1855-07ce-410e-8068-038c82e31516 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:57.882757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7b8ea85a-c9a6-47ff-8835-d2a7b6869943 req-750c1855-07ce-410e-8068-038c82e31516 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:57.883285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7b8ea85a-c9a6-47ff-8835-d2a7b6869943 req-750c1855-07ce-410e-8068-038c82e31516 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:57.895995 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7b8ea85a-c9a6-47ff-8835-d2a7b6869943 req-750c1855-07ce-410e-8068-038c82e31516 service nova] Creating event network-vif-deleted:849a5f7e-c19f-4237-9ccf-75d57b95a7c9 for instance 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a on n-h2-844626-8 Aug 09 15:18:57.901002 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7b8ea85a-c9a6-47ff-8835-d2a7b6869943 req-750c1855-07ce-410e-8068-038c82e31516 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033957 Aug 09 15:18:57.901653 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3197/6406] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:18:58.896716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2fd7680-8b0a-42cb-bb5f-581a43944371 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:18:58.897322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c2fd7680-8b0a-42cb-bb5f-581a43944371 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:18:58.903816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2fd7680-8b0a-42cb-bb5f-581a43944371 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:58.904302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2fd7680-8b0a-42cb-bb5f-581a43944371 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:58.904740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2fd7680-8b0a-42cb-bb5f-581a43944371 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:58.905601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2fd7680-8b0a-42cb-bb5f-581a43944371 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:18:58.906076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2fd7680-8b0a-42cb-bb5f-581a43944371 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:18:58.906495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2fd7680-8b0a-42cb-bb5f-581a43944371 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:18:58.968972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c2fd7680-8b0a-42cb-bb5f-581a43944371 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:18:58.977271 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2fd7680-8b0a-42cb-bb5f-581a43944371 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1225 microversion: 2.1 time: 0.085384 Aug 09 15:18:58.977847 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3210/6407] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:18:58 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:00.000231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7c1bf35-4247-466a-9130-4eb1b270fe14 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:00.001019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7c1bf35-4247-466a-9130-4eb1b270fe14 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:00.008291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7c1bf35-4247-466a-9130-4eb1b270fe14 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:00.008805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7c1bf35-4247-466a-9130-4eb1b270fe14 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:00.009468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7c1bf35-4247-466a-9130-4eb1b270fe14 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:00.010199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7c1bf35-4247-466a-9130-4eb1b270fe14 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:00.010665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7c1bf35-4247-466a-9130-4eb1b270fe14 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:00.011135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7c1bf35-4247-466a-9130-4eb1b270fe14 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:00.080549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7c1bf35-4247-466a-9130-4eb1b270fe14 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:00.088854 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7c1bf35-4247-466a-9130-4eb1b270fe14 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1225 microversion: 2.1 time: 0.093870 Aug 09 15:19:00.089455 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3198/6408] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:18:59 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:01.113470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de3ce892-84f8-4c94-bf67-fa37dadceab8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:01.114109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de3ce892-84f8-4c94-bf67-fa37dadceab8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:01.122027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de3ce892-84f8-4c94-bf67-fa37dadceab8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:01.122507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de3ce892-84f8-4c94-bf67-fa37dadceab8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:01.122938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de3ce892-84f8-4c94-bf67-fa37dadceab8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:01.123673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de3ce892-84f8-4c94-bf67-fa37dadceab8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:01.124102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de3ce892-84f8-4c94-bf67-fa37dadceab8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:01.124517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de3ce892-84f8-4c94-bf67-fa37dadceab8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:01.193607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-de3ce892-84f8-4c94-bf67-fa37dadceab8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:01.202222 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de3ce892-84f8-4c94-bf67-fa37dadceab8 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1225 microversion: 2.1 time: 0.094878 Aug 09 15:19:01.202928 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3211/6409] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:01 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:02.224328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:02.224947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:02.232386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:02.232925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:02.233334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:02.234081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:02.234541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:02.234980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:02.268704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:02.269087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:02.269533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:02.269993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lazy-loading 'fault' on Instance uuid 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:19:02.317483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99b0693d22442ffa84b9c845d7cbc58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da8766706c4d418cb0cc4cdadbebf0d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:02.325849 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-703fa4e9-f0d6-4737-aace-9022bc69019e tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 200 len: 1230 microversion: 2.1 time: 0.105551 Aug 09 15:19:02.326428 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3199/6410] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:02 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:03.348807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05551db2-25b8-4dbd-a15f-f468c431e2b3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:03.349414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05551db2-25b8-4dbd-a15f-f468c431e2b3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:03.356732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05551db2-25b8-4dbd-a15f-f468c431e2b3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:03.357196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05551db2-25b8-4dbd-a15f-f468c431e2b3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:03.357619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05551db2-25b8-4dbd-a15f-f468c431e2b3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:03.358281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05551db2-25b8-4dbd-a15f-f468c431e2b3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:03.358756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05551db2-25b8-4dbd-a15f-f468c431e2b3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:03.359182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05551db2-25b8-4dbd-a15f-f468c431e2b3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:03.373301 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-05551db2-25b8-4dbd-a15f-f468c431e2b3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a could not be found. Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05551db2-25b8-4dbd-a15f-f468c431e2b3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a HTTP/1.1 Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a could not be found. Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a'} Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a could not be found. Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a could not be found. Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:03.374959 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.380519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:03.380519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:19:03.380519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:19:03.380519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:19:03.380519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:19:03.380519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a could not be found. Aug 09 15:19:03.380519 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.380519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05551db2-25b8-4dbd-a15f-f468c431e2b3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance 3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:19:03.380519 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05551db2-25b8-4dbd-a15f-f468c431e2b3 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a" status: 404 len: 111 microversion: 2.1 time: 0.032205 Aug 09 15:19:03.380519 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3212/6411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:03 2022] GET /compute/v2.1/servers/3860cd3b-3b95-4c0e-b347-1f7ac7bcb31a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:19:03.831039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17d0289d-8ae1-4338-ad50-d099a0c97c69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:03.831583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17d0289d-8ae1-4338-ad50-d099a0c97c69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:03.838533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17d0289d-8ae1-4338-ad50-d099a0c97c69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:03.839059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17d0289d-8ae1-4338-ad50-d099a0c97c69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:03.839526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17d0289d-8ae1-4338-ad50-d099a0c97c69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:03.840229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17d0289d-8ae1-4338-ad50-d099a0c97c69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:03.840693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17d0289d-8ae1-4338-ad50-d099a0c97c69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:03.841127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17d0289d-8ae1-4338-ad50-d099a0c97c69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:03.854588 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-17d0289d-8ae1-4338-ad50-d099a0c97c69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17d0289d-8ae1-4338-ad50-d099a0c97c69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 HTTP/1.1 Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'a4216e1f-0e73-447c-8a58-1a5b8c3b0475'} Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:19:03.856335 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17d0289d-8ae1-4338-ad50-d099a0c97c69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17d0289d-8ae1-4338-ad50-d099a0c97c69 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 404 len: 111 microversion: 2.1 time: 0.030786 Aug 09 15:19:03.861484 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3200/6412] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:19:03 2022] DELETE /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:19:03.866960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-608a48e3-5c6e-489a-9158-82887a9d66c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:03.867626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-608a48e3-5c6e-489a-9158-82887a9d66c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] [instance: a4216e1f-0e73-447c-8a58-1a5b8c3b0475] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:03.873634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-608a48e3-5c6e-489a-9158-82887a9d66c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:03.874106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-608a48e3-5c6e-489a-9158-82887a9d66c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:03.874536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-608a48e3-5c6e-489a-9158-82887a9d66c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:03.875245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-608a48e3-5c6e-489a-9158-82887a9d66c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:03.875690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-608a48e3-5c6e-489a-9158-82887a9d66c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:03.876105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-608a48e3-5c6e-489a-9158-82887a9d66c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:03.889583 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-608a48e3-5c6e-489a-9158-82887a9d66c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] HTTP exception thrown: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-608a48e3-5c6e-489a-9158-82887a9d66c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Request method failure captured: Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 HTTP/1.1 Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8negFgpdfAT-vQQgOPSycwMJm7AvBFu9N_y_sXNu9qeLBVpWbzElyg9890Clry-gKKptci6wcZfkXlliVttxoqfaVlLVgzN9y98svBffxgVO2Q5gG3FVGUwYc5teE2OTqGbounbVw3B-ks85I4K5am6anuacOFplL3g8JQ56o6h3qfY Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_da8766706c4d418cb0cc4cdadbebf0d5", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/da8766706c4d418cb0cc4cdadbebf0d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: da8766706c4d418cb0cc4cdadbebf0d5 Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestVolumeBootPattern-1449064691 Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f99b0693d22442ffa84b9c845d7cbc58 Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestVolumeBootPattern-1449064691-project Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'a4216e1f-0e73-447c-8a58-1a5b8c3b0475'} Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:03.891174 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.896286 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:03.896286 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:19:03.896286 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:19:03.896286 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:19:03.896286 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:19:03.896286 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. Aug 09 15:19:03.896286 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:03.896286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-608a48e3-5c6e-489a-9158-82887a9d66c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Returning 404 to user: Instance a4216e1f-0e73-447c-8a58-1a5b8c3b0475 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:19:03.896286 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-608a48e3-5c6e-489a-9158-82887a9d66c9 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475" status: 404 len: 111 microversion: 2.1 time: 0.029421 Aug 09 15:19:03.896286 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3213/6413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:03 2022] GET /compute/v2.1/servers/a4216e1f-0e73-447c-8a58-1a5b8c3b0475 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:19:07.339690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70190180-3a8a-4ae0-b6b6-92e57e040838 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] Calling method '.version_select at 0x7f41ddb62310>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:07.373135 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70190180-3a8a-4ae0-b6b6-92e57e040838 tempest-TestVolumeBootPattern-1449064691 tempest-TestVolumeBootPattern-1449064691-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1707078583" status: 202 len: 0 microversion: 2.1 time: 0.036590 Aug 09 15:19:07.374076 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3201/6414] 10.222.0.50 () {58 vars in 1263 bytes} [Tue Aug 9 15:19:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1707078583 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:19:26.554238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:26.554951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:26.699651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1438753615", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:19:26.753978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] validate_networks() for None {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:19:27.049258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:19:27.049797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:19:27.050562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:19:27.051047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:19:27.051485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:19:27.060654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:27.061131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:27.061563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:27.062289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:27.062733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:27.063179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:27.081035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Getting quotas for project 6e585e8daed047d8af1515e065c8591d. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:19:27.086580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Getting quotas for user 42216143b2bf4530b4e6da78fca7850f and project 6e585e8daed047d8af1515e065c8591d. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:19:27.099658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:19:27.101923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:19:27.150355 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c2a489bf-bd6c-42d1-a0f9-4f02893453d9 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601031 Aug 09 15:19:27.151240 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3214/6415] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:19:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:19:27.166244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7089c946-dda5-4456-b3a5-42ec4a743870 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:27.166840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7089c946-dda5-4456-b3a5-42ec4a743870 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:27.170056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:27.170823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:27.229773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7089c946-dda5-4456-b3a5-42ec4a743870 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:27.237806 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7089c946-dda5-4456-b3a5-42ec4a743870 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1222 microversion: 2.1 time: 0.075072 Aug 09 15:19:27.238366 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3202/6416] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:27 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:28.259628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e70005d9-67bb-47f5-80b3-941a733de43b tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:28.260267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e70005d9-67bb-47f5-80b3-941a733de43b tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:28.266772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e70005d9-67bb-47f5-80b3-941a733de43b tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:28.267291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e70005d9-67bb-47f5-80b3-941a733de43b tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:28.267713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e70005d9-67bb-47f5-80b3-941a733de43b tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:28.268387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e70005d9-67bb-47f5-80b3-941a733de43b tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:28.268922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e70005d9-67bb-47f5-80b3-941a733de43b tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:28.269357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e70005d9-67bb-47f5-80b3-941a733de43b tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:28.332338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e70005d9-67bb-47f5-80b3-941a733de43b tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:28.343676 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e70005d9-67bb-47f5-80b3-941a733de43b tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1282 microversion: 2.1 time: 0.088662 Aug 09 15:19:28.356413 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3215/6417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:28 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:29.368158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4bdee59f-8ebd-427b-907f-a8e3c7385967 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:29.368835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4bdee59f-8ebd-427b-907f-a8e3c7385967 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:29.376343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bdee59f-8ebd-427b-907f-a8e3c7385967 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:29.376934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bdee59f-8ebd-427b-907f-a8e3c7385967 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:29.377459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bdee59f-8ebd-427b-907f-a8e3c7385967 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:29.378426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bdee59f-8ebd-427b-907f-a8e3c7385967 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:29.379003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bdee59f-8ebd-427b-907f-a8e3c7385967 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:29.379537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4bdee59f-8ebd-427b-907f-a8e3c7385967 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:29.520102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4bdee59f-8ebd-427b-907f-a8e3c7385967 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:29.528303 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4bdee59f-8ebd-427b-907f-a8e3c7385967 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1322 microversion: 2.1 time: 0.164166 Aug 09 15:19:29.528904 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3203/6418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:29 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:29.953715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-91480829-34db-4245-99a0-f94cbb635967 req-03029590-73e6-4e2d-a465-e0f9eeefa5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e24fe7-666f-4d80-8fa0-e95220f08027", "tag": "f2b4e9e8-a0b3-4e36-b428-f9293a4e3b8a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:19:29.966641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-91480829-34db-4245-99a0-f94cbb635967 req-03029590-73e6-4e2d-a465-e0f9eeefa5a6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:29.967839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-91480829-34db-4245-99a0-f94cbb635967 req-03029590-73e6-4e2d-a465-e0f9eeefa5a6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:29.967839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-91480829-34db-4245-99a0-f94cbb635967 req-03029590-73e6-4e2d-a465-e0f9eeefa5a6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:29.980640 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-91480829-34db-4245-99a0-f94cbb635967 req-03029590-73e6-4e2d-a465-e0f9eeefa5a6 service nova] Creating event network-changed:f2b4e9e8-a0b3-4e36-b428-f9293a4e3b8a for instance c7e24fe7-666f-4d80-8fa0-e95220f08027 on n-h1-844626-8 Aug 09 15:19:29.985801 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-91480829-34db-4245-99a0-f94cbb635967 req-03029590-73e6-4e2d-a465-e0f9eeefa5a6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035961 Aug 09 15:19:29.987165 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3216/6419] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:19:30.550394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-10b7f3bb-b70e-4ddb-a9b2-ba08fd710382 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:30.551121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-10b7f3bb-b70e-4ddb-a9b2-ba08fd710382 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:30.559267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10b7f3bb-b70e-4ddb-a9b2-ba08fd710382 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:30.559839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10b7f3bb-b70e-4ddb-a9b2-ba08fd710382 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:30.560300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10b7f3bb-b70e-4ddb-a9b2-ba08fd710382 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:30.561034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10b7f3bb-b70e-4ddb-a9b2-ba08fd710382 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:30.561533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10b7f3bb-b70e-4ddb-a9b2-ba08fd710382 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:30.561973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-10b7f3bb-b70e-4ddb-a9b2-ba08fd710382 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:30.700658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-10b7f3bb-b70e-4ddb-a9b2-ba08fd710382 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:30.708884 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-10b7f3bb-b70e-4ddb-a9b2-ba08fd710382 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1322 microversion: 2.1 time: 0.162805 Aug 09 15:19:30.709481 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3204/6420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:30 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:31.730349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-31ea3f5e-7b49-4344-81c8-ffb1eb4a4890 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:31.731066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-31ea3f5e-7b49-4344-81c8-ffb1eb4a4890 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:31.738297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31ea3f5e-7b49-4344-81c8-ffb1eb4a4890 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:31.738761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31ea3f5e-7b49-4344-81c8-ffb1eb4a4890 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:31.739224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31ea3f5e-7b49-4344-81c8-ffb1eb4a4890 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:31.739920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31ea3f5e-7b49-4344-81c8-ffb1eb4a4890 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:31.740366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31ea3f5e-7b49-4344-81c8-ffb1eb4a4890 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:31.740775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31ea3f5e-7b49-4344-81c8-ffb1eb4a4890 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:31.889600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-31ea3f5e-7b49-4344-81c8-ffb1eb4a4890 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:31.897893 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-31ea3f5e-7b49-4344-81c8-ffb1eb4a4890 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1322 microversion: 2.1 time: 0.172579 Aug 09 15:19:31.898456 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3217/6421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:31 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:32.919103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-29a70327-4fc6-4299-91e1-f4f8d1b673c0 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:32.919761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-29a70327-4fc6-4299-91e1-f4f8d1b673c0 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:32.927540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29a70327-4fc6-4299-91e1-f4f8d1b673c0 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:32.928049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29a70327-4fc6-4299-91e1-f4f8d1b673c0 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:32.928509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29a70327-4fc6-4299-91e1-f4f8d1b673c0 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:32.929220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29a70327-4fc6-4299-91e1-f4f8d1b673c0 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:32.929688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29a70327-4fc6-4299-91e1-f4f8d1b673c0 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:32.930122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-29a70327-4fc6-4299-91e1-f4f8d1b673c0 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:33.072612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-29a70327-4fc6-4299-91e1-f4f8d1b673c0 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:33.080641 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-29a70327-4fc6-4299-91e1-f4f8d1b673c0 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1322 microversion: 2.1 time: 0.165613 Aug 09 15:19:33.081243 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3205/6422] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:32 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:34.111043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0c81ae68-e2f8-4ae6-b18e-23034d08c116 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:34.112086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0c81ae68-e2f8-4ae6-b18e-23034d08c116 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:34.122807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c81ae68-e2f8-4ae6-b18e-23034d08c116 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:34.123614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c81ae68-e2f8-4ae6-b18e-23034d08c116 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:34.124271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c81ae68-e2f8-4ae6-b18e-23034d08c116 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:34.125308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c81ae68-e2f8-4ae6-b18e-23034d08c116 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:34.126063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c81ae68-e2f8-4ae6-b18e-23034d08c116 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:34.126645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0c81ae68-e2f8-4ae6-b18e-23034d08c116 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:34.263547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-0c81ae68-e2f8-4ae6-b18e-23034d08c116 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:34.272248 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0c81ae68-e2f8-4ae6-b18e-23034d08c116 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1322 microversion: 2.1 time: 0.166519 Aug 09 15:19:34.272248 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3218/6423] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:34 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:35.293130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-55b6d1eb-a90d-4029-bf29-f8dd3e1c18a2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:35.293686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-55b6d1eb-a90d-4029-bf29-f8dd3e1c18a2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:35.300744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55b6d1eb-a90d-4029-bf29-f8dd3e1c18a2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:35.301233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55b6d1eb-a90d-4029-bf29-f8dd3e1c18a2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:35.301670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55b6d1eb-a90d-4029-bf29-f8dd3e1c18a2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:35.302378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55b6d1eb-a90d-4029-bf29-f8dd3e1c18a2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:35.302838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55b6d1eb-a90d-4029-bf29-f8dd3e1c18a2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:35.303275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-55b6d1eb-a90d-4029-bf29-f8dd3e1c18a2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:35.441293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-55b6d1eb-a90d-4029-bf29-f8dd3e1c18a2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:35.449738 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-55b6d1eb-a90d-4029-bf29-f8dd3e1c18a2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1322 microversion: 2.1 time: 0.160691 Aug 09 15:19:35.450340 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3206/6424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:35 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:36.470899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee873054-e9c3-406c-8f94-4937629c21ef tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:36.471718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ee873054-e9c3-406c-8f94-4937629c21ef tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:36.479569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee873054-e9c3-406c-8f94-4937629c21ef tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:36.480062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee873054-e9c3-406c-8f94-4937629c21ef tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:36.480500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee873054-e9c3-406c-8f94-4937629c21ef tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:36.481465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee873054-e9c3-406c-8f94-4937629c21ef tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:36.481924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee873054-e9c3-406c-8f94-4937629c21ef tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:36.482342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ee873054-e9c3-406c-8f94-4937629c21ef tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:36.566241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e5db159d-f3d1-4da3-a407-81ca30eadb9b req-b3b4ec14-359e-4675-bcf6-5a55250457b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e24fe7-666f-4d80-8fa0-e95220f08027", "name": "network-vif-plugged", "status": "completed", "tag": "f2b4e9e8-a0b3-4e36-b428-f9293a4e3b8a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:19:36.576232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e5db159d-f3d1-4da3-a407-81ca30eadb9b req-b3b4ec14-359e-4675-bcf6-5a55250457b4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:36.576722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e5db159d-f3d1-4da3-a407-81ca30eadb9b req-b3b4ec14-359e-4675-bcf6-5a55250457b4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:36.577166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e5db159d-f3d1-4da3-a407-81ca30eadb9b req-b3b4ec14-359e-4675-bcf6-5a55250457b4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:36.589008 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e5db159d-f3d1-4da3-a407-81ca30eadb9b req-b3b4ec14-359e-4675-bcf6-5a55250457b4 service nova] Creating event network-vif-plugged:f2b4e9e8-a0b3-4e36-b428-f9293a4e3b8a for instance c7e24fe7-666f-4d80-8fa0-e95220f08027 on n-h1-844626-8 Aug 09 15:19:36.595457 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e5db159d-f3d1-4da3-a407-81ca30eadb9b req-b3b4ec14-359e-4675-bcf6-5a55250457b4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119825 Aug 09 15:19:36.596084 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3207/6425] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:19:36.630926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ee873054-e9c3-406c-8f94-4937629c21ef tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:36.639117 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee873054-e9c3-406c-8f94-4937629c21ef tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1322 microversion: 2.1 time: 0.172726 Aug 09 15:19:36.639826 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3219/6426] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:36 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:37.662891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:37.668396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70a4fcf9-7af4-4cfc-a51f-245366d5f9d2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:37.669100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-70a4fcf9-7af4-4cfc-a51f-245366d5f9d2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:37.676082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70a4fcf9-7af4-4cfc-a51f-245366d5f9d2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:37.676574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70a4fcf9-7af4-4cfc-a51f-245366d5f9d2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:37.677018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70a4fcf9-7af4-4cfc-a51f-245366d5f9d2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:37.677716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70a4fcf9-7af4-4cfc-a51f-245366d5f9d2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:37.678175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70a4fcf9-7af4-4cfc-a51f-245366d5f9d2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:37.678722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70a4fcf9-7af4-4cfc-a51f-245366d5f9d2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:37.824458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-70a4fcf9-7af4-4cfc-a51f-245366d5f9d2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:37.837941 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70a4fcf9-7af4-4cfc-a51f-245366d5f9d2 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1322 microversion: 2.1 time: 0.175701 Aug 09 15:19:37.839104 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3208/6427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:37 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:38.859160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a48ee3fc-2d64-428e-b086-8fe5cada63e7 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:38.859765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a48ee3fc-2d64-428e-b086-8fe5cada63e7 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:38.862162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:38.862821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:38.869831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a48ee3fc-2d64-428e-b086-8fe5cada63e7 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:38.870312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a48ee3fc-2d64-428e-b086-8fe5cada63e7 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:38.870749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a48ee3fc-2d64-428e-b086-8fe5cada63e7 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:38.871477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a48ee3fc-2d64-428e-b086-8fe5cada63e7 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:38.871911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a48ee3fc-2d64-428e-b086-8fe5cada63e7 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:38.872340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a48ee3fc-2d64-428e-b086-8fe5cada63e7 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:39.004902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a48ee3fc-2d64-428e-b086-8fe5cada63e7 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:39.012980 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a48ee3fc-2d64-428e-b086-8fe5cada63e7 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1472 microversion: 2.1 time: 0.157765 Aug 09 15:19:39.013572 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3220/6428] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:38 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1472 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:39.096017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3e2dae6d-9958-4d93-a5e7-22ac97c404f1 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Calling method '.version_select at 0x7f41ddaa4820>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:39.179068 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3e2dae6d-9958-4d93-a5e7-22ac97c404f1 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/1068f011886f4f5bb881f0c03e011297" status: 200 len: 371 microversion: 2.1 time: 0.142223 Aug 09 15:19:39.179690 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3209/6429] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 9 15:19:39 2022] GET /compute/v2.1/os-quota-sets/1068f011886f4f5bb881f0c03e011297 => generated 371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:19:39.191268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aab043d7-78ce-491b-8dd9-97b9e5482928 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1834953369", "id": 1202731311, "os-flavor-access:is_public": "True"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:19:39.194236 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 15:19:39.194236 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 15:19:39.211146 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aab043d7-78ce-491b-8dd9-97b9e5482928 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.023585 Aug 09 15:19:39.211759 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3221/6430] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:19:39 2022] POST /compute/v2.1/flavors => generated 438 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:19:39.223776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1202731311"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:19:39.226200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:39.232925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:39.233426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:39.233864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:39.234577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:39.235042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:39.235490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:39.325870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9c868ad5c53040d897385bd6f59fe173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1068f011886f4f5bb881f0c03e011297', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:39.332653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1834953369 {{(pid=119406) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 15:19:39.339522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:39.340013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:39.340457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:39.341190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:39.341644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:39.342077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:39.366076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Getting quotas for project 6e585e8daed047d8af1515e065c8591d. Resources: {'cores', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:19:39.371502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Getting quotas for user 42216143b2bf4530b4e6da78fca7850f and project 6e585e8daed047d8af1515e065c8591d. Resources: {'cores', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:19:39.385499 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.compute.api [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] ram quota exceeded for 1068f011886f4f5bb881f0c03e011297, tried to resize instance. Aug 09 15:19:39.386046 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Request method failure captured: Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027/action HTTP/1.1 Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 39 Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nr-kNYhE-DNg8RWYBxBeiDriGBOYqSJSECC1h_aq9ow9GintRiv9fcIMuSXjye4z8-jRcBpdB4c8KaIWVhNpdzpe05dxNG6GHT0S2GKAMSCARfD7T3UVFyTscJXT0Luzp4V0rKQ3yWm6bedU-WW4ZaHhVjmbRiAp12O1ZmhLZF8ujA Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 1068f011886f4f5bb881f0c03e011297 Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-89109247 Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Role: member,reader,admin Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: member,reader,admin Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1068f011886f4f5bb881f0c03e011297", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1068f011886f4f5bb881f0c03e011297"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1068f011886f4f5bb881f0c03e011297"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1068f011886f4f5bb881f0c03e011297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-89109247 Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 1068f011886f4f5bb881f0c03e011297 Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-89109247 Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersAdminNegativeTestJSON-89109247-project-admin Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 9c868ad5c53040d897385bd6f59fe173 Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-89109247-project-admin Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: {"resize": {"flavorRef": "1202731311"}} Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'c7e24fe7-666f-4d80-8fa0-e95220f08027', 'body': {'resize': {'flavorRef': '1202731311'}}} Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:19:39.388283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ed761db-392d-4432-8417-45d0b2d42549 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027/action" status: 403 len: 118 microversion: 2.1 time: 0.169880 Aug 09 15:19:39.393920 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3210/6431] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:19:39 2022] POST /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027/action => generated 118 bytes in 171 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:19:39.398867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9493c4a6-c6d0-45f5-aaff-a9a979e0d3b9 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:39.399676 n-d-844626-8 devstack@n-api.service[119407]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 15:19:39.399676 n-d-844626-8 devstack@n-api.service[119407]: warnings.warn(msg) Aug 09 15:19:39.419167 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9493c4a6-c6d0-45f5-aaff-a9a979e0d3b9 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/1202731311" status: 202 len: 0 microversion: 2.1 time: 0.023767 Aug 09 15:19:39.420029 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3222/6432] 10.222.0.50 () {58 vars in 1161 bytes} [Tue Aug 9 15:19:39 2022] DELETE /compute/v2.1/flavors/1202731311 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:19:39.430120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-38eadac2-a722-49f1-852e-ee58657b1caf tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:39.456818 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-38eadac2-a722-49f1-852e-ee58657b1caf tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031432 Aug 09 15:19:39.457660 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3211/6433] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 15:19:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:39.478476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-29b7a8f8-0dfc-48fa-8760-2a0680711570 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Calling method '.version_select at 0x7f41e75280d0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:39.560101 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-29b7a8f8-0dfc-48fa-8760-2a0680711570 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] 10.222.0.50 "GET /compute/v2.1/os-quota-sets/1068f011886f4f5bb881f0c03e011297" status: 200 len: 371 microversion: 2.1 time: 0.085274 Aug 09 15:19:39.560692 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3223/6434] 10.222.0.50 () {58 vars in 1242 bytes} [Tue Aug 9 15:19:39 2022] GET /compute/v2.1/os-quota-sets/1068f011886f4f5bb881f0c03e011297 => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:19:39.572344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc0d35fe-d19b-471a-be90-caa803a64114 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-984159401", "id": 324786566, "os-flavor-access:is_public": "True"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:19:39.575446 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 15:19:39.575446 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 15:19:39.592007 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc0d35fe-d19b-471a-be90-caa803a64114 tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.023657 Aug 09 15:19:39.592607 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3212/6435] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:19:39 2022] POST /compute/v2.1/flavors => generated 433 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:19:39.604233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "324786566"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:19:39.606593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:39.613154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:39.613648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:39.614070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:39.614755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:39.615240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:39.615663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:39.703975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9c868ad5c53040d897385bd6f59fe173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1068f011886f4f5bb881f0c03e011297', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:39.710752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-984159401 {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 15:19:39.717398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:39.717917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:39.718349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:39.719072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:39.719546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:39.719973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:39.740905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Getting quotas for project 6e585e8daed047d8af1515e065c8591d. Resources: {'cores', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:19:39.746656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Getting quotas for user 42216143b2bf4530b4e6da78fca7850f and project 6e585e8daed047d8af1515e065c8591d. Resources: {'cores', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:19:39.759302 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.compute.api [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] cores quota exceeded for 1068f011886f4f5bb881f0c03e011297, tried to resize instance. Aug 09 15:19:39.759840 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Request method failure captured: Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027/action HTTP/1.1 Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 38 Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nr-kNYhE-DNg8RWYBxBeiDriGBOYqSJSECC1h_aq9ow9GintRiv9fcIMuSXjye4z8-jRcBpdB4c8KaIWVhNpdzpe05dxNG6GHT0S2GKAMSCARfD7T3UVFyTscJXT0Luzp4V0rKQ3yWm6bedU-WW4ZaHhVjmbRiAp12O1ZmhLZF8ujA Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 1068f011886f4f5bb881f0c03e011297 Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-89109247 Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Role: member,reader,admin Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: member,reader,admin Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_1068f011886f4f5bb881f0c03e011297", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/1068f011886f4f5bb881f0c03e011297"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1068f011886f4f5bb881f0c03e011297"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/1068f011886f4f5bb881f0c03e011297"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersAdminNegativeTestJSON-89109247 Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 1068f011886f4f5bb881f0c03e011297 Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-89109247 Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersAdminNegativeTestJSON-89109247-project-admin Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 9c868ad5c53040d897385bd6f59fe173 Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersAdminNegativeTestJSON-89109247-project-admin Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: {"resize": {"flavorRef": "324786566"}} Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'c7e24fe7-666f-4d80-8fa0-e95220f08027', 'body': {'resize': {'flavorRef': '324786566'}}} Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:19:39.761950 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:19:39.767252 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e66a0936-d9a7-49f4-8898-8490e3d861af tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] 10.222.0.50 "POST /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027/action" status: 403 len: 113 microversion: 2.1 time: 0.163069 Aug 09 15:19:39.771368 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3224/6436] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:19:39 2022] POST /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027/action => generated 113 bytes in 167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:19:39.772321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd643d2b-28fc-4c7d-974a-e8f87cd9be9a tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:39.773138 n-d-844626-8 devstack@n-api.service[119406]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 15:19:39.773138 n-d-844626-8 devstack@n-api.service[119406]: warnings.warn(msg) Aug 09 15:19:39.794118 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd643d2b-28fc-4c7d-974a-e8f87cd9be9a tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] 10.222.0.50 "DELETE /compute/v2.1/flavors/324786566" status: 202 len: 0 microversion: 2.1 time: 0.025571 Aug 09 15:19:39.794713 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3213/6437] 10.222.0.50 () {58 vars in 1158 bytes} [Tue Aug 9 15:19:39 2022] DELETE /compute/v2.1/flavors/324786566 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:19:39.806067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ee6b1d14-1907-4056-a652-3436b845930e tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:39.830927 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ee6b1d14-1907-4056-a652-3436b845930e tempest-ServersAdminNegativeTestJSON-89109247 tempest-ServersAdminNegativeTestJSON-89109247-project-admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030623 Aug 09 15:19:39.831469 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3225/6438] 10.222.0.50 () {58 vars in 1146 bytes} [Tue Aug 9 15:19:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:39.856425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b6902aeb-0a30-49a5-8188-1a1f70b10a29 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:39.856818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6902aeb-0a30-49a5-8188-1a1f70b10a29 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:39.863836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6902aeb-0a30-49a5-8188-1a1f70b10a29 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:39.864339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6902aeb-0a30-49a5-8188-1a1f70b10a29 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:39.864787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6902aeb-0a30-49a5-8188-1a1f70b10a29 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:39.865495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6902aeb-0a30-49a5-8188-1a1f70b10a29 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:39.865961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6902aeb-0a30-49a5-8188-1a1f70b10a29 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:39.866397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6902aeb-0a30-49a5-8188-1a1f70b10a29 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:39.892001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6902aeb-0a30-49a5-8188-1a1f70b10a29 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:19:39.976663 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b6902aeb-0a30-49a5-8188-1a1f70b10a29 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 204 len: 0 microversion: 2.1 time: 0.124035 Aug 09 15:19:39.977438 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3214/6439] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:19:39 2022] DELETE /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:19:39.987265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49ffb221-b716-44ba-a611-0852e1000323 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:39.987872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49ffb221-b716-44ba-a611-0852e1000323 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:39.995016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ffb221-b716-44ba-a611-0852e1000323 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:39.995532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ffb221-b716-44ba-a611-0852e1000323 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:39.995959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ffb221-b716-44ba-a611-0852e1000323 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:39.996638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ffb221-b716-44ba-a611-0852e1000323 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:39.997083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ffb221-b716-44ba-a611-0852e1000323 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:39.997497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49ffb221-b716-44ba-a611-0852e1000323 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:40.155452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-49ffb221-b716-44ba-a611-0852e1000323 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:40.167220 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49ffb221-b716-44ba-a611-0852e1000323 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1478 microversion: 2.1 time: 0.184131 Aug 09 15:19:40.168045 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3226/6440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:39 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1478 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:41.194590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e669a622-f2cb-478f-965b-e16178295187 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:41.195326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e669a622-f2cb-478f-965b-e16178295187 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:41.203340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e669a622-f2cb-478f-965b-e16178295187 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:41.203885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e669a622-f2cb-478f-965b-e16178295187 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:41.204376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e669a622-f2cb-478f-965b-e16178295187 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:41.205144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e669a622-f2cb-478f-965b-e16178295187 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:41.205651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e669a622-f2cb-478f-965b-e16178295187 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:41.206130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e669a622-f2cb-478f-965b-e16178295187 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:41.345214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e669a622-f2cb-478f-965b-e16178295187 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42216143b2bf4530b4e6da78fca7850f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e585e8daed047d8af1515e065c8591d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:41.353530 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e669a622-f2cb-478f-965b-e16178295187 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 200 len: 1478 microversion: 2.1 time: 0.163855 Aug 09 15:19:41.354219 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3215/6441] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:41 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 1478 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:41.826374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-6cae9fba-7a54-4028-bebe-80345180db92 req-6d01f9a6-15fa-4c1d-837d-0c51064e37ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e24fe7-666f-4d80-8fa0-e95220f08027", "name": "network-vif-deleted", "tag": "f2b4e9e8-a0b3-4e36-b428-f9293a4e3b8a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:19:41.837659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6cae9fba-7a54-4028-bebe-80345180db92 req-6d01f9a6-15fa-4c1d-837d-0c51064e37ad service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:41.838140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6cae9fba-7a54-4028-bebe-80345180db92 req-6d01f9a6-15fa-4c1d-837d-0c51064e37ad service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:41.838566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6cae9fba-7a54-4028-bebe-80345180db92 req-6d01f9a6-15fa-4c1d-837d-0c51064e37ad service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:41.855405 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-6cae9fba-7a54-4028-bebe-80345180db92 req-6d01f9a6-15fa-4c1d-837d-0c51064e37ad service nova] Creating event network-vif-deleted:f2b4e9e8-a0b3-4e36-b428-f9293a4e3b8a for instance c7e24fe7-666f-4d80-8fa0-e95220f08027 on n-h1-844626-8 Aug 09 15:19:41.862307 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-6cae9fba-7a54-4028-bebe-80345180db92 req-6d01f9a6-15fa-4c1d-837d-0c51064e37ad service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119654 Aug 09 15:19:41.863250 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3227/6442] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:19:42.375453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d31aa4ea-f354-4e99-aaad-1678ee4fecf6 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:42.376043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d31aa4ea-f354-4e99-aaad-1678ee4fecf6 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] [instance: c7e24fe7-666f-4d80-8fa0-e95220f08027] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:42.383542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d31aa4ea-f354-4e99-aaad-1678ee4fecf6 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:42.384044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d31aa4ea-f354-4e99-aaad-1678ee4fecf6 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:42.384492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d31aa4ea-f354-4e99-aaad-1678ee4fecf6 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:42.385213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d31aa4ea-f354-4e99-aaad-1678ee4fecf6 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:42.385674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d31aa4ea-f354-4e99-aaad-1678ee4fecf6 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:42.386112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d31aa4ea-f354-4e99-aaad-1678ee4fecf6 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:42.400493 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-d31aa4ea-f354-4e99-aaad-1678ee4fecf6 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] HTTP exception thrown: Instance c7e24fe7-666f-4d80-8fa0-e95220f08027 could not be found. Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d31aa4ea-f354-4e99-aaad-1678ee4fecf6 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Request method failure captured: Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 HTTP/1.1 Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nr9TjVgjePxMlbluuFVI3PGVuWtm5t8oH2wl2Q17Lf4VwtzLJf9z_oloIdcx4A8nMWiT3JlEj4fiRlag92bQCC88hWj1Xi3uMg6vmLFptoYlz0JptdL_t9iZiPBa9RKzQRqminDoo2Z9ASi0v9HhMPjJH05n_lK1Z8PF9cziprGT8o Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 6e585e8daed047d8af1515e065c8591d Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1728431334 Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_6e585e8daed047d8af1515e065c8591d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/6e585e8daed047d8af1515e065c8591d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6e585e8daed047d8af1515e065c8591d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/6e585e8daed047d8af1515e065c8591d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1728431334 Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 6e585e8daed047d8af1515e065c8591d Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1728431334 Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersAdminNegativeTestJSON-1728431334-project Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 42216143b2bf4530b4e6da78fca7850f Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1728431334-project Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance c7e24fe7-666f-4d80-8fa0-e95220f08027 could not be found. Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'c7e24fe7-666f-4d80-8fa0-e95220f08027'} Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e24fe7-666f-4d80-8fa0-e95220f08027 could not be found. Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e24fe7-666f-4d80-8fa0-e95220f08027 could not be found. Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:42.402226 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:19:42.408027 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:42.408027 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:19:42.408027 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:19:42.408027 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:19:42.408027 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:19:42.408027 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:19:42.408027 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e24fe7-666f-4d80-8fa0-e95220f08027 could not be found. Aug 09 15:19:42.408027 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:19:42.408027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d31aa4ea-f354-4e99-aaad-1678ee4fecf6 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] Returning 404 to user: Instance c7e24fe7-666f-4d80-8fa0-e95220f08027 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:19:42.408027 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d31aa4ea-f354-4e99-aaad-1678ee4fecf6 tempest-ServersAdminNegativeTestJSON-1728431334 tempest-ServersAdminNegativeTestJSON-1728431334-project] 10.222.0.50 "GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027" status: 404 len: 111 microversion: 2.1 time: 0.032540 Aug 09 15:19:42.408027 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3216/6443] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:42 2022] GET /compute/v2.1/servers/c7e24fe7-666f-4d80-8fa0-e95220f08027 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:19:48.647341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-268909605", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "cc31d25d-94a6-40f4-bd60-fc1aa06b7be6"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:19:48.703348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] validate_networks() for [('cc31d25d-94a6-40f4-bd60-fc1aa06b7be6', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:19:49.115933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:19:49.116484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:19:49.117242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:19:49.117878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:19:49.118295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:19:49.128665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:49.129312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:49.130236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:49.131126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:49.131852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:49.132075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:49.152510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Getting quotas for project 9ae7478e83f447be8a1b293ec60d6601. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:19:49.162379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Getting quotas for user 750c7ffb2b054b1ea585b286da7f369d and project 9ae7478e83f447be8a1b293ec60d6601. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:19:49.178906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:19:49.180232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:19:49.245048 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-18212a4e-ef03-4182-9448-5f9fe652be29 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723737 Aug 09 15:19:49.249886 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3228/6444] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:19:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:19:49.258663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-638facef-0210-44fc-87ec-4f81679fce8f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:49.259599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-638facef-0210-44fc-87ec-4f81679fce8f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:49.264267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:49.348238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-638facef-0210-44fc-87ec-4f81679fce8f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:49.354008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:49.356689 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-638facef-0210-44fc-87ec-4f81679fce8f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1214 microversion: 2.1 time: 0.102663 Aug 09 15:19:49.357547 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3217/6445] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:49 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:19:50.379922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb1e20b4-85eb-4944-a734-d4c213bfadaa tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:50.380521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb1e20b4-85eb-4944-a734-d4c213bfadaa tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:50.388320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb1e20b4-85eb-4944-a734-d4c213bfadaa tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:50.389015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb1e20b4-85eb-4944-a734-d4c213bfadaa tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:50.389832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb1e20b4-85eb-4944-a734-d4c213bfadaa tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:50.390817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb1e20b4-85eb-4944-a734-d4c213bfadaa tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:50.391511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb1e20b4-85eb-4944-a734-d4c213bfadaa tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:50.392552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb1e20b4-85eb-4944-a734-d4c213bfadaa tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:50.466957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fb1e20b4-85eb-4944-a734-d4c213bfadaa tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:50.482375 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb1e20b4-85eb-4944-a734-d4c213bfadaa tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1266 microversion: 2.1 time: 0.103655 Aug 09 15:19:50.496736 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3229/6446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:50 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:51.506072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08119135-6513-4004-a3e5-9852fd34cc2a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:51.506704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-08119135-6513-4004-a3e5-9852fd34cc2a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:51.517220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08119135-6513-4004-a3e5-9852fd34cc2a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:51.517728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08119135-6513-4004-a3e5-9852fd34cc2a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:51.518308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08119135-6513-4004-a3e5-9852fd34cc2a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:51.519071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08119135-6513-4004-a3e5-9852fd34cc2a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:51.519599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08119135-6513-4004-a3e5-9852fd34cc2a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:51.520041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08119135-6513-4004-a3e5-9852fd34cc2a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:51.674573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-08119135-6513-4004-a3e5-9852fd34cc2a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:51.682668 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-08119135-6513-4004-a3e5-9852fd34cc2a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1314 microversion: 2.1 time: 0.180576 Aug 09 15:19:51.683302 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3218/6447] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:51 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:51.952272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-cdb1cca0-224f-4233-a74a-4758212902d2 req-190d8e35-15b7-4a78-b5ad-0eb1d30fa888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c40b9de-dfb2-46cf-8ab6-81c5cf85d301", "tag": "901e99c7-0d9a-47a2-99e0-b769b7a41b56"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:19:51.964686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-cdb1cca0-224f-4233-a74a-4758212902d2 req-190d8e35-15b7-4a78-b5ad-0eb1d30fa888 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:51.965156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-cdb1cca0-224f-4233-a74a-4758212902d2 req-190d8e35-15b7-4a78-b5ad-0eb1d30fa888 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:51.965572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-cdb1cca0-224f-4233-a74a-4758212902d2 req-190d8e35-15b7-4a78-b5ad-0eb1d30fa888 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:51.982179 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-cdb1cca0-224f-4233-a74a-4758212902d2 req-190d8e35-15b7-4a78-b5ad-0eb1d30fa888 service nova] Creating event network-changed:901e99c7-0d9a-47a2-99e0-b769b7a41b56 for instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 on n-h1-844626-8 Aug 09 15:19:51.987809 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-cdb1cca0-224f-4233-a74a-4758212902d2 req-190d8e35-15b7-4a78-b5ad-0eb1d30fa888 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039264 Aug 09 15:19:51.988426 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3230/6448] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:19:52.705222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dc10776d-6230-411e-bceb-74a1a92c4054 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:52.705853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dc10776d-6230-411e-bceb-74a1a92c4054 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:52.713802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc10776d-6230-411e-bceb-74a1a92c4054 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:52.714302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc10776d-6230-411e-bceb-74a1a92c4054 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:52.714756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc10776d-6230-411e-bceb-74a1a92c4054 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:52.715507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc10776d-6230-411e-bceb-74a1a92c4054 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:52.715977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc10776d-6230-411e-bceb-74a1a92c4054 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:52.716437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc10776d-6230-411e-bceb-74a1a92c4054 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:52.869635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dc10776d-6230-411e-bceb-74a1a92c4054 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:52.877711 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dc10776d-6230-411e-bceb-74a1a92c4054 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1314 microversion: 2.1 time: 0.176444 Aug 09 15:19:52.878339 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3219/6449] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:52 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:53.903688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-96fd6087-d579-43b4-a624-88f5ebb3c87a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:53.904277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-96fd6087-d579-43b4-a624-88f5ebb3c87a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:53.914011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96fd6087-d579-43b4-a624-88f5ebb3c87a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:53.914584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96fd6087-d579-43b4-a624-88f5ebb3c87a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:53.915253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96fd6087-d579-43b4-a624-88f5ebb3c87a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:53.915963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96fd6087-d579-43b4-a624-88f5ebb3c87a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:53.916409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96fd6087-d579-43b4-a624-88f5ebb3c87a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:53.916827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-96fd6087-d579-43b4-a624-88f5ebb3c87a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:54.069695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-96fd6087-d579-43b4-a624-88f5ebb3c87a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:54.077860 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-96fd6087-d579-43b4-a624-88f5ebb3c87a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1314 microversion: 2.1 time: 0.182257 Aug 09 15:19:54.078439 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3231/6450] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:53 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:55.099032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6897597d-434f-4540-940c-b9d21dd4e9ea tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:55.099652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6897597d-434f-4540-940c-b9d21dd4e9ea tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:55.107722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6897597d-434f-4540-940c-b9d21dd4e9ea tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:55.108287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6897597d-434f-4540-940c-b9d21dd4e9ea tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:55.108772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6897597d-434f-4540-940c-b9d21dd4e9ea tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:55.109500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6897597d-434f-4540-940c-b9d21dd4e9ea tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:55.109987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6897597d-434f-4540-940c-b9d21dd4e9ea tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:55.110436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6897597d-434f-4540-940c-b9d21dd4e9ea tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:55.249471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6897597d-434f-4540-940c-b9d21dd4e9ea tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:55.257451 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6897597d-434f-4540-940c-b9d21dd4e9ea tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1314 microversion: 2.1 time: 0.162496 Aug 09 15:19:55.258029 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3220/6451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:55 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:56.279917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-913c8b7d-17e9-4b56-9827-2a3efb6411c0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:56.280524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-913c8b7d-17e9-4b56-9827-2a3efb6411c0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:56.287910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-913c8b7d-17e9-4b56-9827-2a3efb6411c0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:56.288386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-913c8b7d-17e9-4b56-9827-2a3efb6411c0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:56.288806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-913c8b7d-17e9-4b56-9827-2a3efb6411c0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:56.289489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-913c8b7d-17e9-4b56-9827-2a3efb6411c0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:56.289922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-913c8b7d-17e9-4b56-9827-2a3efb6411c0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:56.290360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-913c8b7d-17e9-4b56-9827-2a3efb6411c0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:56.432113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-913c8b7d-17e9-4b56-9827-2a3efb6411c0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:56.439925 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-913c8b7d-17e9-4b56-9827-2a3efb6411c0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1314 microversion: 2.1 time: 0.165852 Aug 09 15:19:56.440600 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3232/6452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:56 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:57.463979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b1adddef-1aae-409b-92a6-f5d894d8b886 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:57.464621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b1adddef-1aae-409b-92a6-f5d894d8b886 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:57.468450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:57.474862 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1adddef-1aae-409b-92a6-f5d894d8b886 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:57.475743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1adddef-1aae-409b-92a6-f5d894d8b886 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:57.476417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1adddef-1aae-409b-92a6-f5d894d8b886 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:57.477477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1adddef-1aae-409b-92a6-f5d894d8b886 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:57.478111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1adddef-1aae-409b-92a6-f5d894d8b886 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:57.478546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b1adddef-1aae-409b-92a6-f5d894d8b886 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:57.481918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:57.627153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b1adddef-1aae-409b-92a6-f5d894d8b886 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:57.637290 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b1adddef-1aae-409b-92a6-f5d894d8b886 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1314 microversion: 2.1 time: 0.179520 Aug 09 15:19:57.637888 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3221/6453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:57 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:58.617770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-47c1075b-faad-447e-8bdc-dc23fccd8404 req-6c27eb6a-41df-40d3-8893-8c82367acbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c40b9de-dfb2-46cf-8ab6-81c5cf85d301", "name": "network-vif-plugged", "status": "completed", "tag": "901e99c7-0d9a-47a2-99e0-b769b7a41b56"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:19:58.623811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:58.629933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-47c1075b-faad-447e-8bdc-dc23fccd8404 req-6c27eb6a-41df-40d3-8893-8c82367acbb2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:58.630407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-47c1075b-faad-447e-8bdc-dc23fccd8404 req-6c27eb6a-41df-40d3-8893-8c82367acbb2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:58.630829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-47c1075b-faad-447e-8bdc-dc23fccd8404 req-6c27eb6a-41df-40d3-8893-8c82367acbb2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:58.635835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=78 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:58.643814 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-47c1075b-faad-447e-8bdc-dc23fccd8404 req-6c27eb6a-41df-40d3-8893-8c82367acbb2 service nova] Creating event network-vif-plugged:901e99c7-0d9a-47a2-99e0-b769b7a41b56 for instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 on n-h1-844626-8 Aug 09 15:19:58.648983 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-47c1075b-faad-447e-8bdc-dc23fccd8404 req-6c27eb6a-41df-40d3-8893-8c82367acbb2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035012 Aug 09 15:19:58.649732 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3233/6454] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:19:58.658521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b077844-6cb8-4ca1-8910-c2da26770082 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:58.659175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b077844-6cb8-4ca1-8910-c2da26770082 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:58.666633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b077844-6cb8-4ca1-8910-c2da26770082 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:58.667173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b077844-6cb8-4ca1-8910-c2da26770082 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:58.667623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b077844-6cb8-4ca1-8910-c2da26770082 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:58.668346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b077844-6cb8-4ca1-8910-c2da26770082 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:58.668805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b077844-6cb8-4ca1-8910-c2da26770082 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:58.669254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b077844-6cb8-4ca1-8910-c2da26770082 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:58.811355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b077844-6cb8-4ca1-8910-c2da26770082 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:19:58.819313 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b077844-6cb8-4ca1-8910-c2da26770082 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1314 microversion: 2.1 time: 0.164642 Aug 09 15:19:58.819884 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3222/6455] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:58 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:19:59.838414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=5 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:59.839886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=8 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:19:59.846804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fde24b9e-9c18-4d29-8271-a0adea5e63b4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:19:59.847948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fde24b9e-9c18-4d29-8271-a0adea5e63b4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:19:59.855413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fde24b9e-9c18-4d29-8271-a0adea5e63b4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:59.855893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fde24b9e-9c18-4d29-8271-a0adea5e63b4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:59.856318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fde24b9e-9c18-4d29-8271-a0adea5e63b4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:59.857004 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fde24b9e-9c18-4d29-8271-a0adea5e63b4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:19:59.857524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fde24b9e-9c18-4d29-8271-a0adea5e63b4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:19:59.857962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fde24b9e-9c18-4d29-8271-a0adea5e63b4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:19:59.996861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fde24b9e-9c18-4d29-8271-a0adea5e63b4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:00.009100 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fde24b9e-9c18-4d29-8271-a0adea5e63b4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1314 microversion: 2.1 time: 0.171767 Aug 09 15:20:00.009966 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3234/6456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:19:59 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:01.033188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-511469d6-e215-4ce8-9558-ba74784d7496 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:01.033819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-511469d6-e215-4ce8-9558-ba74784d7496 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:01.035752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:20:01.042475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-511469d6-e215-4ce8-9558-ba74784d7496 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:01.043003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-511469d6-e215-4ce8-9558-ba74784d7496 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:01.043470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-511469d6-e215-4ce8-9558-ba74784d7496 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:01.044176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-511469d6-e215-4ce8-9558-ba74784d7496 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:01.044671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-511469d6-e215-4ce8-9558-ba74784d7496 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:01.045080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-511469d6-e215-4ce8-9558-ba74784d7496 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:01.177514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-511469d6-e215-4ce8-9558-ba74784d7496 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:01.198351 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-511469d6-e215-4ce8-9558-ba74784d7496 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1501 microversion: 2.1 time: 0.169067 Aug 09 15:20:01.198944 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3223/6457] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:01 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:01.222356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:20:01.225619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:01.234413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:01.234903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:01.235385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:01.236411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:01.236862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:01.237298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:01.270018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:01.276350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Old instance type m1.heat2, new instance type m1.heat {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 15:20:01.283621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:20:01.283971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:20:01.284444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:20:01.284850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:20:01.285257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:20:01.350151 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4b36fe8c-9cca-482a-b999-2618846e69c8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "POST /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301/action" status: 202 len: 0 microversion: 2.1 time: 0.134202 Aug 09 15:20:01.350783 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3235/6458] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:20:01 2022] POST /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:20:01.359175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0c35665-8cdb-4fc0-8523-bf3affdc6f0d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:01.359811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0c35665-8cdb-4fc0-8523-bf3affdc6f0d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:01.366529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0c35665-8cdb-4fc0-8523-bf3affdc6f0d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:01.367039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0c35665-8cdb-4fc0-8523-bf3affdc6f0d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:01.367558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0c35665-8cdb-4fc0-8523-bf3affdc6f0d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:01.368274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0c35665-8cdb-4fc0-8523-bf3affdc6f0d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:01.368742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0c35665-8cdb-4fc0-8523-bf3affdc6f0d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:01.369176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0c35665-8cdb-4fc0-8523-bf3affdc6f0d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:01.511958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0c35665-8cdb-4fc0-8523-bf3affdc6f0d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:01.521207 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0c35665-8cdb-4fc0-8523-bf3affdc6f0d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1510 microversion: 2.1 time: 0.165948 Aug 09 15:20:01.521812 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3224/6459] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:01 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:02.544513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-326039fd-ca82-43cd-95c8-6cd2beeb5a04 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:02.545458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-326039fd-ca82-43cd-95c8-6cd2beeb5a04 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:02.552437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-326039fd-ca82-43cd-95c8-6cd2beeb5a04 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:02.552930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-326039fd-ca82-43cd-95c8-6cd2beeb5a04 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:02.553355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-326039fd-ca82-43cd-95c8-6cd2beeb5a04 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:02.554048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-326039fd-ca82-43cd-95c8-6cd2beeb5a04 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:02.554494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-326039fd-ca82-43cd-95c8-6cd2beeb5a04 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:02.554911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-326039fd-ca82-43cd-95c8-6cd2beeb5a04 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:02.701772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-326039fd-ca82-43cd-95c8-6cd2beeb5a04 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:02.709755 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-326039fd-ca82-43cd-95c8-6cd2beeb5a04 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1510 microversion: 2.1 time: 0.170116 Aug 09 15:20:02.710304 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3236/6460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:02 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:03.738281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0eca3963-9bb3-4410-a0a5-777b9e311c3e tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:03.738955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0eca3963-9bb3-4410-a0a5-777b9e311c3e tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:03.747199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0eca3963-9bb3-4410-a0a5-777b9e311c3e tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:03.747678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0eca3963-9bb3-4410-a0a5-777b9e311c3e tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:03.748124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0eca3963-9bb3-4410-a0a5-777b9e311c3e tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:03.748888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0eca3963-9bb3-4410-a0a5-777b9e311c3e tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:03.749357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0eca3963-9bb3-4410-a0a5-777b9e311c3e tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:03.749796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0eca3963-9bb3-4410-a0a5-777b9e311c3e tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:03.893584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0eca3963-9bb3-4410-a0a5-777b9e311c3e tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:03.901697 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0eca3963-9bb3-4410-a0a5-777b9e311c3e tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1510 microversion: 2.1 time: 0.167866 Aug 09 15:20:03.902205 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3225/6461] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:03 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:04.924096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-adf793de-0614-4a18-b1d3-5b160bfb4638 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:04.924733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-adf793de-0614-4a18-b1d3-5b160bfb4638 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:04.932314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adf793de-0614-4a18-b1d3-5b160bfb4638 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:04.932802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adf793de-0614-4a18-b1d3-5b160bfb4638 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:04.933241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adf793de-0614-4a18-b1d3-5b160bfb4638 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:04.933933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adf793de-0614-4a18-b1d3-5b160bfb4638 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:04.934376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adf793de-0614-4a18-b1d3-5b160bfb4638 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:04.934792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-adf793de-0614-4a18-b1d3-5b160bfb4638 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:05.074974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-adf793de-0614-4a18-b1d3-5b160bfb4638 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:05.082839 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-adf793de-0614-4a18-b1d3-5b160bfb4638 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.162823 Aug 09 15:20:05.083553 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3237/6462] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:04 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:06.105349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-980d467b-d984-4d34-aba4-12da2424839a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:06.106126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-980d467b-d984-4d34-aba4-12da2424839a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:06.115688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-980d467b-d984-4d34-aba4-12da2424839a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:06.116222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-980d467b-d984-4d34-aba4-12da2424839a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:06.116671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-980d467b-d984-4d34-aba4-12da2424839a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:06.117439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-980d467b-d984-4d34-aba4-12da2424839a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:06.118115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-980d467b-d984-4d34-aba4-12da2424839a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:06.118478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-980d467b-d984-4d34-aba4-12da2424839a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:06.259053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-980d467b-d984-4d34-aba4-12da2424839a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:06.267326 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-980d467b-d984-4d34-aba4-12da2424839a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.166255 Aug 09 15:20:06.267910 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3226/6463] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:06 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:07.288658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db6867a3-71fd-455f-8d32-f381bb35fe46 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:07.289276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-db6867a3-71fd-455f-8d32-f381bb35fe46 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:07.296630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6867a3-71fd-455f-8d32-f381bb35fe46 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:07.297102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6867a3-71fd-455f-8d32-f381bb35fe46 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:07.297558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6867a3-71fd-455f-8d32-f381bb35fe46 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:07.298250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6867a3-71fd-455f-8d32-f381bb35fe46 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:07.298703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6867a3-71fd-455f-8d32-f381bb35fe46 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:07.299130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db6867a3-71fd-455f-8d32-f381bb35fe46 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:07.434862 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-db6867a3-71fd-455f-8d32-f381bb35fe46 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:07.442998 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-db6867a3-71fd-455f-8d32-f381bb35fe46 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.158672 Aug 09 15:20:07.443630 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3238/6464] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:07 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:08.475724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0aa8e285-b103-45c3-bf8d-0a9e5e08cd5d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:08.476869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0aa8e285-b103-45c3-bf8d-0a9e5e08cd5d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:08.488662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa8e285-b103-45c3-bf8d-0a9e5e08cd5d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:08.489511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa8e285-b103-45c3-bf8d-0a9e5e08cd5d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:08.490274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa8e285-b103-45c3-bf8d-0a9e5e08cd5d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:08.491561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa8e285-b103-45c3-bf8d-0a9e5e08cd5d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:08.492405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa8e285-b103-45c3-bf8d-0a9e5e08cd5d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:08.493227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0aa8e285-b103-45c3-bf8d-0a9e5e08cd5d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:08.667465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0aa8e285-b103-45c3-bf8d-0a9e5e08cd5d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:08.675386 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0aa8e285-b103-45c3-bf8d-0a9e5e08cd5d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.206707 Aug 09 15:20:08.675978 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3227/6465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:08 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:20:09.700401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4eec3da9-c21c-4924-8f1b-eab1eb257003 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:09.701277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4eec3da9-c21c-4924-8f1b-eab1eb257003 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:09.710577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eec3da9-c21c-4924-8f1b-eab1eb257003 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:09.711130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eec3da9-c21c-4924-8f1b-eab1eb257003 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:09.711633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eec3da9-c21c-4924-8f1b-eab1eb257003 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:09.712440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eec3da9-c21c-4924-8f1b-eab1eb257003 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:09.712894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eec3da9-c21c-4924-8f1b-eab1eb257003 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:09.713316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4eec3da9-c21c-4924-8f1b-eab1eb257003 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:09.868441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4eec3da9-c21c-4924-8f1b-eab1eb257003 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:09.876545 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4eec3da9-c21c-4924-8f1b-eab1eb257003 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.181594 Aug 09 15:20:09.877141 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3239/6466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:09 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:10.901652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-77da4586-6d71-457a-8255-bc95c69cab58 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:10.902299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77da4586-6d71-457a-8255-bc95c69cab58 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:10.912409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77da4586-6d71-457a-8255-bc95c69cab58 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:10.913064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77da4586-6d71-457a-8255-bc95c69cab58 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:10.913606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77da4586-6d71-457a-8255-bc95c69cab58 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:10.914304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77da4586-6d71-457a-8255-bc95c69cab58 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:10.914929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77da4586-6d71-457a-8255-bc95c69cab58 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:10.915438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77da4586-6d71-457a-8255-bc95c69cab58 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:11.068717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-77da4586-6d71-457a-8255-bc95c69cab58 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:11.077798 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-77da4586-6d71-457a-8255-bc95c69cab58 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.182784 Aug 09 15:20:11.078301 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3228/6467] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:10 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:12.098799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-75be6284-c4d4-44b9-989e-1926f9f44f6a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:12.099421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-75be6284-c4d4-44b9-989e-1926f9f44f6a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:12.106966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75be6284-c4d4-44b9-989e-1926f9f44f6a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:12.107422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75be6284-c4d4-44b9-989e-1926f9f44f6a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:12.107840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75be6284-c4d4-44b9-989e-1926f9f44f6a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:12.108544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75be6284-c4d4-44b9-989e-1926f9f44f6a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:12.108946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75be6284-c4d4-44b9-989e-1926f9f44f6a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:12.109360 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-75be6284-c4d4-44b9-989e-1926f9f44f6a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:12.265654 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-75be6284-c4d4-44b9-989e-1926f9f44f6a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:12.273620 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-75be6284-c4d4-44b9-989e-1926f9f44f6a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.178709 Aug 09 15:20:12.274213 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3240/6468] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:12 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:13.295189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f00ac44a-7d54-4123-aa69-40b29a1e6167 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:13.295713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f00ac44a-7d54-4123-aa69-40b29a1e6167 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:13.303115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f00ac44a-7d54-4123-aa69-40b29a1e6167 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:13.303638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f00ac44a-7d54-4123-aa69-40b29a1e6167 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:13.304090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f00ac44a-7d54-4123-aa69-40b29a1e6167 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:13.304794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f00ac44a-7d54-4123-aa69-40b29a1e6167 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:13.305258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f00ac44a-7d54-4123-aa69-40b29a1e6167 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:13.305693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f00ac44a-7d54-4123-aa69-40b29a1e6167 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:13.455213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f00ac44a-7d54-4123-aa69-40b29a1e6167 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:13.463001 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f00ac44a-7d54-4123-aa69-40b29a1e6167 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.171972 Aug 09 15:20:13.463533 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3229/6469] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:13 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:14.494434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c56fa04d-74bb-458a-89d6-cead32854b98 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:14.495052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c56fa04d-74bb-458a-89d6-cead32854b98 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:14.501847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56fa04d-74bb-458a-89d6-cead32854b98 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:14.502321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56fa04d-74bb-458a-89d6-cead32854b98 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:14.502746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56fa04d-74bb-458a-89d6-cead32854b98 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:14.503433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56fa04d-74bb-458a-89d6-cead32854b98 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:14.503898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56fa04d-74bb-458a-89d6-cead32854b98 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:14.504349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c56fa04d-74bb-458a-89d6-cead32854b98 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:14.644893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c56fa04d-74bb-458a-89d6-cead32854b98 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:14.653141 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c56fa04d-74bb-458a-89d6-cead32854b98 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.164938 Aug 09 15:20:14.653748 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3241/6470] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:14 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:15.677706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0ff3700a-66d6-4697-a6b4-cabddc69fbf7 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:15.678356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0ff3700a-66d6-4697-a6b4-cabddc69fbf7 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:15.686320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ff3700a-66d6-4697-a6b4-cabddc69fbf7 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:15.686820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ff3700a-66d6-4697-a6b4-cabddc69fbf7 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:15.687281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ff3700a-66d6-4697-a6b4-cabddc69fbf7 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:15.688006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ff3700a-66d6-4697-a6b4-cabddc69fbf7 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:15.688463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ff3700a-66d6-4697-a6b4-cabddc69fbf7 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:15.688889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0ff3700a-66d6-4697-a6b4-cabddc69fbf7 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:15.829146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0ff3700a-66d6-4697-a6b4-cabddc69fbf7 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:15.837085 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0ff3700a-66d6-4697-a6b4-cabddc69fbf7 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.165876 Aug 09 15:20:15.837723 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3230/6471] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:15 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:16.861315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b56f752c-c6bf-403c-8524-bd76ad45b586 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:16.861966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b56f752c-c6bf-403c-8524-bd76ad45b586 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:16.871672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b56f752c-c6bf-403c-8524-bd76ad45b586 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:16.872158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b56f752c-c6bf-403c-8524-bd76ad45b586 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:16.872626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b56f752c-c6bf-403c-8524-bd76ad45b586 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:16.873321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b56f752c-c6bf-403c-8524-bd76ad45b586 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:16.873771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b56f752c-c6bf-403c-8524-bd76ad45b586 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:16.874216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b56f752c-c6bf-403c-8524-bd76ad45b586 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:17.021324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b56f752c-c6bf-403c-8524-bd76ad45b586 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:17.030276 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b56f752c-c6bf-403c-8524-bd76ad45b586 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.174992 Aug 09 15:20:17.030409 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3242/6472] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:16 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:18.051285 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-591d8acd-e55b-452f-aa48-31af2d5f9843 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:18.051894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-591d8acd-e55b-452f-aa48-31af2d5f9843 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:18.060531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591d8acd-e55b-452f-aa48-31af2d5f9843 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:18.061028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591d8acd-e55b-452f-aa48-31af2d5f9843 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:18.061464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591d8acd-e55b-452f-aa48-31af2d5f9843 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:18.062170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591d8acd-e55b-452f-aa48-31af2d5f9843 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:18.062624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591d8acd-e55b-452f-aa48-31af2d5f9843 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:18.063057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-591d8acd-e55b-452f-aa48-31af2d5f9843 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:18.202680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-591d8acd-e55b-452f-aa48-31af2d5f9843 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:18.214907 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-591d8acd-e55b-452f-aa48-31af2d5f9843 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.167577 Aug 09 15:20:18.215575 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3231/6473] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:18 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:19.245339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7eb8530-42d5-4135-94fa-9ee8f719b359 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:19.246251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b7eb8530-42d5-4135-94fa-9ee8f719b359 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:19.256706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7eb8530-42d5-4135-94fa-9ee8f719b359 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:19.257335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7eb8530-42d5-4135-94fa-9ee8f719b359 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:19.257959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7eb8530-42d5-4135-94fa-9ee8f719b359 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:19.259036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7eb8530-42d5-4135-94fa-9ee8f719b359 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:19.259664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7eb8530-42d5-4135-94fa-9ee8f719b359 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:19.260106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7eb8530-42d5-4135-94fa-9ee8f719b359 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:19.691587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b7eb8530-42d5-4135-94fa-9ee8f719b359 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:19.699506 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7eb8530-42d5-4135-94fa-9ee8f719b359 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.460212 Aug 09 15:20:19.700079 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3243/6474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:19 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:20.724107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36a80e9d-9419-4a7e-94ff-2802a2f565d0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:20.724894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-36a80e9d-9419-4a7e-94ff-2802a2f565d0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:20.733636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a80e9d-9419-4a7e-94ff-2802a2f565d0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:20.734132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a80e9d-9419-4a7e-94ff-2802a2f565d0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:20.734580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a80e9d-9419-4a7e-94ff-2802a2f565d0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:20.735322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a80e9d-9419-4a7e-94ff-2802a2f565d0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:20.736121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a80e9d-9419-4a7e-94ff-2802a2f565d0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:20.736562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36a80e9d-9419-4a7e-94ff-2802a2f565d0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:20.879480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-36a80e9d-9419-4a7e-94ff-2802a2f565d0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:20.889010 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36a80e9d-9419-4a7e-94ff-2802a2f565d0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.170374 Aug 09 15:20:20.889603 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3232/6475] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:20 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:21.910353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-87627aba-ef3b-4574-8355-306ecc2fc58f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:21.910938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-87627aba-ef3b-4574-8355-306ecc2fc58f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:21.918653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87627aba-ef3b-4574-8355-306ecc2fc58f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:21.919227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87627aba-ef3b-4574-8355-306ecc2fc58f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:21.919657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87627aba-ef3b-4574-8355-306ecc2fc58f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:21.920346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87627aba-ef3b-4574-8355-306ecc2fc58f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:21.920800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87627aba-ef3b-4574-8355-306ecc2fc58f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:21.921215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87627aba-ef3b-4574-8355-306ecc2fc58f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:22.060436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-87627aba-ef3b-4574-8355-306ecc2fc58f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:22.070501 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-87627aba-ef3b-4574-8355-306ecc2fc58f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.163810 Aug 09 15:20:22.071228 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3244/6476] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:21 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:23.094514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a21ae060-43b7-4c76-9043-ab27ecca79ba tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:23.095026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a21ae060-43b7-4c76-9043-ab27ecca79ba tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:23.102465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a21ae060-43b7-4c76-9043-ab27ecca79ba tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:23.102965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a21ae060-43b7-4c76-9043-ab27ecca79ba tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:23.103452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a21ae060-43b7-4c76-9043-ab27ecca79ba tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:23.104182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a21ae060-43b7-4c76-9043-ab27ecca79ba tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:23.104654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a21ae060-43b7-4c76-9043-ab27ecca79ba tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:23.105092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a21ae060-43b7-4c76-9043-ab27ecca79ba tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:23.243290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a21ae060-43b7-4c76-9043-ab27ecca79ba tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:23.251699 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a21ae060-43b7-4c76-9043-ab27ecca79ba tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.161905 Aug 09 15:20:23.252163 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3233/6477] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:23 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:24.284647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8125e4b9-81bd-4ff1-af79-b811685c3443 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:24.285304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8125e4b9-81bd-4ff1-af79-b811685c3443 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:24.293088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8125e4b9-81bd-4ff1-af79-b811685c3443 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:24.293571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8125e4b9-81bd-4ff1-af79-b811685c3443 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:24.294012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8125e4b9-81bd-4ff1-af79-b811685c3443 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:24.294792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8125e4b9-81bd-4ff1-af79-b811685c3443 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:24.295313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8125e4b9-81bd-4ff1-af79-b811685c3443 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:24.295739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8125e4b9-81bd-4ff1-af79-b811685c3443 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:24.443373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8125e4b9-81bd-4ff1-af79-b811685c3443 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:24.451798 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8125e4b9-81bd-4ff1-af79-b811685c3443 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.171719 Aug 09 15:20:24.452392 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3245/6478] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:24 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:25.474155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6907436a-6d94-422e-b2d3-b46635cd45d8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:25.474814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6907436a-6d94-422e-b2d3-b46635cd45d8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:25.481988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6907436a-6d94-422e-b2d3-b46635cd45d8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:25.482477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6907436a-6d94-422e-b2d3-b46635cd45d8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:25.482915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6907436a-6d94-422e-b2d3-b46635cd45d8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:25.483640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6907436a-6d94-422e-b2d3-b46635cd45d8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:25.484095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6907436a-6d94-422e-b2d3-b46635cd45d8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:25.484522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6907436a-6d94-422e-b2d3-b46635cd45d8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:25.631513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6907436a-6d94-422e-b2d3-b46635cd45d8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:25.643470 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6907436a-6d94-422e-b2d3-b46635cd45d8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.172938 Aug 09 15:20:25.644233 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3234/6479] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:25 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:26.667902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf89ab35-2df3-41f6-8b0e-3b4c9e1d89cd tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:26.668679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf89ab35-2df3-41f6-8b0e-3b4c9e1d89cd tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:26.676438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf89ab35-2df3-41f6-8b0e-3b4c9e1d89cd tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:26.676922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf89ab35-2df3-41f6-8b0e-3b4c9e1d89cd tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:26.677353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf89ab35-2df3-41f6-8b0e-3b4c9e1d89cd tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:26.678047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf89ab35-2df3-41f6-8b0e-3b4c9e1d89cd tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:26.678560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf89ab35-2df3-41f6-8b0e-3b4c9e1d89cd tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:26.678983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf89ab35-2df3-41f6-8b0e-3b4c9e1d89cd tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:26.820736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bf89ab35-2df3-41f6-8b0e-3b4c9e1d89cd tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:26.831545 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf89ab35-2df3-41f6-8b0e-3b4c9e1d89cd tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.169205 Aug 09 15:20:26.832298 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3246/6480] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:26 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:27.852265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1f3b7738-05f8-4bb8-a28e-a0674098c049 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:27.852887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1f3b7738-05f8-4bb8-a28e-a0674098c049 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:27.855640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=28 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:20:27.861527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f3b7738-05f8-4bb8-a28e-a0674098c049 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:27.862024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f3b7738-05f8-4bb8-a28e-a0674098c049 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:27.862460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f3b7738-05f8-4bb8-a28e-a0674098c049 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:27.863209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f3b7738-05f8-4bb8-a28e-a0674098c049 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:27.863671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f3b7738-05f8-4bb8-a28e-a0674098c049 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:27.864105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f3b7738-05f8-4bb8-a28e-a0674098c049 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:27.867195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=84 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:20:28.010364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1f3b7738-05f8-4bb8-a28e-a0674098c049 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:28.018764 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1f3b7738-05f8-4bb8-a28e-a0674098c049 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.170455 Aug 09 15:20:28.019400 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3235/6481] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:27 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:29.049720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a64d2934-fc44-4bfe-af96-d73eb6d96ef9 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:29.050532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a64d2934-fc44-4bfe-af96-d73eb6d96ef9 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:29.054649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=32 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:20:29.061882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64d2934-fc44-4bfe-af96-d73eb6d96ef9 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:29.062358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64d2934-fc44-4bfe-af96-d73eb6d96ef9 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:29.062776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64d2934-fc44-4bfe-af96-d73eb6d96ef9 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:29.063492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64d2934-fc44-4bfe-af96-d73eb6d96ef9 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:29.063929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64d2934-fc44-4bfe-af96-d73eb6d96ef9 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:29.064341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a64d2934-fc44-4bfe-af96-d73eb6d96ef9 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:29.067122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:20:29.207887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a64d2934-fc44-4bfe-af96-d73eb6d96ef9 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:29.215681 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a64d2934-fc44-4bfe-af96-d73eb6d96ef9 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.172319 Aug 09 15:20:29.216273 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3247/6482] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:29 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:30.240375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b6b86f61-6b44-47a5-bfcd-b9d4e811388c tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:30.240969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6b86f61-6b44-47a5-bfcd-b9d4e811388c tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:30.250842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6b86f61-6b44-47a5-bfcd-b9d4e811388c tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:30.251537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6b86f61-6b44-47a5-bfcd-b9d4e811388c tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:30.252121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6b86f61-6b44-47a5-bfcd-b9d4e811388c tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:30.253096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6b86f61-6b44-47a5-bfcd-b9d4e811388c tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:30.253707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6b86f61-6b44-47a5-bfcd-b9d4e811388c tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:30.254200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6b86f61-6b44-47a5-bfcd-b9d4e811388c tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:30.408372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b6b86f61-6b44-47a5-bfcd-b9d4e811388c tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:30.420295 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b6b86f61-6b44-47a5-bfcd-b9d4e811388c tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.185439 Aug 09 15:20:30.421088 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3236/6483] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:30 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:31.441923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de75107f-f214-4285-ba7b-078bf87d1aa8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:31.442519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de75107f-f214-4285-ba7b-078bf87d1aa8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:31.450016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de75107f-f214-4285-ba7b-078bf87d1aa8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:31.450512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de75107f-f214-4285-ba7b-078bf87d1aa8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:31.450934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de75107f-f214-4285-ba7b-078bf87d1aa8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:31.451665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de75107f-f214-4285-ba7b-078bf87d1aa8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:31.452118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de75107f-f214-4285-ba7b-078bf87d1aa8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:31.452576 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de75107f-f214-4285-ba7b-078bf87d1aa8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:31.599194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-de75107f-f214-4285-ba7b-078bf87d1aa8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:31.610990 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de75107f-f214-4285-ba7b-078bf87d1aa8 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.172565 Aug 09 15:20:31.611833 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3248/6484] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:31 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:32.321137 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:20:32.321436 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:20:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:20:32.641534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9d250a7e-0808-413d-b82b-7ff4c6c16ed6 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:32.642140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9d250a7e-0808-413d-b82b-7ff4c6c16ed6 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:32.649560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d250a7e-0808-413d-b82b-7ff4c6c16ed6 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:32.650062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d250a7e-0808-413d-b82b-7ff4c6c16ed6 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:32.650513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d250a7e-0808-413d-b82b-7ff4c6c16ed6 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:32.651257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d250a7e-0808-413d-b82b-7ff4c6c16ed6 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:32.651725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d250a7e-0808-413d-b82b-7ff4c6c16ed6 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:32.652161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9d250a7e-0808-413d-b82b-7ff4c6c16ed6 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:32.796963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9d250a7e-0808-413d-b82b-7ff4c6c16ed6 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:32.809582 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9d250a7e-0808-413d-b82b-7ff4c6c16ed6 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.174259 Aug 09 15:20:32.810423 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3237/6485] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:32 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:33.833573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fd8fd46d-217d-4247-be2f-537810763f72 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:33.834201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fd8fd46d-217d-4247-be2f-537810763f72 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:33.841756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd8fd46d-217d-4247-be2f-537810763f72 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:33.842232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd8fd46d-217d-4247-be2f-537810763f72 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:33.842665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd8fd46d-217d-4247-be2f-537810763f72 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:33.843370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd8fd46d-217d-4247-be2f-537810763f72 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:33.843866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd8fd46d-217d-4247-be2f-537810763f72 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:33.844282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd8fd46d-217d-4247-be2f-537810763f72 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:33.986358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fd8fd46d-217d-4247-be2f-537810763f72 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:33.997894 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fd8fd46d-217d-4247-be2f-537810763f72 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.167995 Aug 09 15:20:33.998705 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3249/6486] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:33 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:35.022694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-505e386b-8620-4e82-9a7c-94aa6c30f7fe tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:35.023727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-505e386b-8620-4e82-9a7c-94aa6c30f7fe tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:35.034076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-505e386b-8620-4e82-9a7c-94aa6c30f7fe tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:35.034575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-505e386b-8620-4e82-9a7c-94aa6c30f7fe tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:35.035018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-505e386b-8620-4e82-9a7c-94aa6c30f7fe tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:35.035768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-505e386b-8620-4e82-9a7c-94aa6c30f7fe tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:35.036258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-505e386b-8620-4e82-9a7c-94aa6c30f7fe tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:35.036714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-505e386b-8620-4e82-9a7c-94aa6c30f7fe tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:35.170710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-505e386b-8620-4e82-9a7c-94aa6c30f7fe tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:35.178675 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-505e386b-8620-4e82-9a7c-94aa6c30f7fe tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1515 microversion: 2.1 time: 0.162364 Aug 09 15:20:35.179290 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3238/6487] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:35 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:36.200596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dc5112eb-b7a2-44b0-8515-79f806e32fc4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:36.201207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dc5112eb-b7a2-44b0-8515-79f806e32fc4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:36.208793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc5112eb-b7a2-44b0-8515-79f806e32fc4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:36.209285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc5112eb-b7a2-44b0-8515-79f806e32fc4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:36.209722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc5112eb-b7a2-44b0-8515-79f806e32fc4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:36.210427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc5112eb-b7a2-44b0-8515-79f806e32fc4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:36.211066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc5112eb-b7a2-44b0-8515-79f806e32fc4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:36.211521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dc5112eb-b7a2-44b0-8515-79f806e32fc4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:36.364289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5126f53c-1741-4cd4-a24f-3912b4c42f8d req-6a384da0-d335-4c1b-85c0-55e01d5196c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c40b9de-dfb2-46cf-8ab6-81c5cf85d301", "name": "network-vif-unplugged", "status": "completed", "tag": "901e99c7-0d9a-47a2-99e0-b769b7a41b56"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:20:36.375582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5126f53c-1741-4cd4-a24f-3912b4c42f8d req-6a384da0-d335-4c1b-85c0-55e01d5196c5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:36.375808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5126f53c-1741-4cd4-a24f-3912b4c42f8d req-6a384da0-d335-4c1b-85c0-55e01d5196c5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:36.376487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5126f53c-1741-4cd4-a24f-3912b4c42f8d req-6a384da0-d335-4c1b-85c0-55e01d5196c5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:36.389352 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5126f53c-1741-4cd4-a24f-3912b4c42f8d req-6a384da0-d335-4c1b-85c0-55e01d5196c5 service nova] Creating event network-vif-unplugged:901e99c7-0d9a-47a2-99e0-b769b7a41b56 for instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 on n-h2-844626-8 Aug 09 15:20:36.395376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-5126f53c-1741-4cd4-a24f-3912b4c42f8d req-6a384da0-d335-4c1b-85c0-55e01d5196c5 service nova] Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:20:36.407553 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5126f53c-1741-4cd4-a24f-3912b4c42f8d req-6a384da0-d335-4c1b-85c0-55e01d5196c5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047973 Aug 09 15:20:36.408226 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3239/6488] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:20:36.436541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dc5112eb-b7a2-44b0-8515-79f806e32fc4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:36.444782 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dc5112eb-b7a2-44b0-8515-79f806e32fc4 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1514 microversion: 2.1 time: 0.248396 Aug 09 15:20:36.445463 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3250/6489] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:36 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:37.467847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b2ff1083-c2f2-48ef-bee5-9a8ca5c9186f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:37.468553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b2ff1083-c2f2-48ef-bee5-9a8ca5c9186f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:37.475679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2ff1083-c2f2-48ef-bee5-9a8ca5c9186f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:37.476393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2ff1083-c2f2-48ef-bee5-9a8ca5c9186f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:37.476567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2ff1083-c2f2-48ef-bee5-9a8ca5c9186f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:37.477297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2ff1083-c2f2-48ef-bee5-9a8ca5c9186f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:37.477759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2ff1083-c2f2-48ef-bee5-9a8ca5c9186f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:37.478190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b2ff1083-c2f2-48ef-bee5-9a8ca5c9186f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:37.621176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b2ff1083-c2f2-48ef-bee5-9a8ca5c9186f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:37.631724 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b2ff1083-c2f2-48ef-bee5-9a8ca5c9186f tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1512 microversion: 2.1 time: 0.168662 Aug 09 15:20:37.632129 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3240/6490] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:37 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:38.436185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8f4d93a6-e126-4d3a-8128-546e91e4b97f req-2d5a74a0-95cf-4d7f-bd1d-5cc312878639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c40b9de-dfb2-46cf-8ab6-81c5cf85d301", "tag": "901e99c7-0d9a-47a2-99e0-b769b7a41b56"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:20:38.446947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8f4d93a6-e126-4d3a-8128-546e91e4b97f req-2d5a74a0-95cf-4d7f-bd1d-5cc312878639 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:38.447450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8f4d93a6-e126-4d3a-8128-546e91e4b97f req-2d5a74a0-95cf-4d7f-bd1d-5cc312878639 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:38.447874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8f4d93a6-e126-4d3a-8128-546e91e4b97f req-2d5a74a0-95cf-4d7f-bd1d-5cc312878639 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:38.459826 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8f4d93a6-e126-4d3a-8128-546e91e4b97f req-2d5a74a0-95cf-4d7f-bd1d-5cc312878639 service nova] Creating event network-changed:901e99c7-0d9a-47a2-99e0-b769b7a41b56 for instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 on n-h2-844626-8 Aug 09 15:20:38.466120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-8f4d93a6-e126-4d3a-8128-546e91e4b97f req-2d5a74a0-95cf-4d7f-bd1d-5cc312878639 service nova] Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:20:38.477236 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8f4d93a6-e126-4d3a-8128-546e91e4b97f req-2d5a74a0-95cf-4d7f-bd1d-5cc312878639 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044717 Aug 09 15:20:38.477853 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3251/6491] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:20:38.653133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-396b376e-70b6-4d6c-bdd0-23ce364e3271 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:38.653797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-396b376e-70b6-4d6c-bdd0-23ce364e3271 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:38.661496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-396b376e-70b6-4d6c-bdd0-23ce364e3271 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:38.661988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-396b376e-70b6-4d6c-bdd0-23ce364e3271 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:38.662454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-396b376e-70b6-4d6c-bdd0-23ce364e3271 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:38.663168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-396b376e-70b6-4d6c-bdd0-23ce364e3271 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:38.663624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-396b376e-70b6-4d6c-bdd0-23ce364e3271 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:38.664047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-396b376e-70b6-4d6c-bdd0-23ce364e3271 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:38.847364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-396b376e-70b6-4d6c-bdd0-23ce364e3271 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:38.856986 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-396b376e-70b6-4d6c-bdd0-23ce364e3271 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1512 microversion: 2.1 time: 0.207812 Aug 09 15:20:38.857593 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3241/6492] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:38 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:39.881565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4be1de91-3848-427f-8826-a509be3932b0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:39.882145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4be1de91-3848-427f-8826-a509be3932b0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:39.889048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4be1de91-3848-427f-8826-a509be3932b0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:39.889530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4be1de91-3848-427f-8826-a509be3932b0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:39.889962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4be1de91-3848-427f-8826-a509be3932b0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:39.890657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4be1de91-3848-427f-8826-a509be3932b0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:39.891117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4be1de91-3848-427f-8826-a509be3932b0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:39.891556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4be1de91-3848-427f-8826-a509be3932b0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:40.043487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4be1de91-3848-427f-8826-a509be3932b0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:40.055649 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4be1de91-3848-427f-8826-a509be3932b0 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1509 microversion: 2.1 time: 0.179376 Aug 09 15:20:40.056412 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3252/6493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:39 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:40.076933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7409ac51-edb2-4d7f-a0c2-aa29f8be4096 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:40.077523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7409ac51-edb2-4d7f-a0c2-aa29f8be4096 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:40.085324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7409ac51-edb2-4d7f-a0c2-aa29f8be4096 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:40.085827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7409ac51-edb2-4d7f-a0c2-aa29f8be4096 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:40.086267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7409ac51-edb2-4d7f-a0c2-aa29f8be4096 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:40.086995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7409ac51-edb2-4d7f-a0c2-aa29f8be4096 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:40.087497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7409ac51-edb2-4d7f-a0c2-aa29f8be4096 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:40.087930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7409ac51-edb2-4d7f-a0c2-aa29f8be4096 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:40.116974 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7409ac51-edb2-4d7f-a0c2-aa29f8be4096 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:20:40.168649 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.compute.api [None req-7409ac51-edb2-4d7f-a0c2-aa29f8be4096 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Found an unconfirmed migration during delete, id: 16, status: finished Aug 09 15:20:41.282289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8a09bead-04b7-4b01-a1b3-f4b4d0f77310 req-9ca83755-477b-424b-b700-7e14fdc8fd10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c40b9de-dfb2-46cf-8ab6-81c5cf85d301", "name": "network-vif-plugged", "status": "completed", "tag": "901e99c7-0d9a-47a2-99e0-b769b7a41b56"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:20:41.294552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8a09bead-04b7-4b01-a1b3-f4b4d0f77310 req-9ca83755-477b-424b-b700-7e14fdc8fd10 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:41.295301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8a09bead-04b7-4b01-a1b3-f4b4d0f77310 req-9ca83755-477b-424b-b700-7e14fdc8fd10 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:41.295716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8a09bead-04b7-4b01-a1b3-f4b4d0f77310 req-9ca83755-477b-424b-b700-7e14fdc8fd10 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:41.308410 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8a09bead-04b7-4b01-a1b3-f4b4d0f77310 req-9ca83755-477b-424b-b700-7e14fdc8fd10 service nova] Creating event network-vif-plugged:901e99c7-0d9a-47a2-99e0-b769b7a41b56 for instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 on n-h2-844626-8 Aug 09 15:20:41.315570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-8a09bead-04b7-4b01-a1b3-f4b4d0f77310 req-9ca83755-477b-424b-b700-7e14fdc8fd10 service nova] Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:20:41.326998 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8a09bead-04b7-4b01-a1b3-f4b4d0f77310 req-9ca83755-477b-424b-b700-7e14fdc8fd10 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048752 Aug 09 15:20:41.327658 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3253/6494] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:20:41.621288 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7409ac51-edb2-4d7f-a0c2-aa29f8be4096 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 204 len: 0 microversion: 2.1 time: 1.548061 Aug 09 15:20:41.621877 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3242/6495] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:20:40 2022] DELETE /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 0 bytes in 1550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:20:41.631244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ac0f630d-a8fd-463a-ae89-5fe45ecc0abb tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:41.632083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ac0f630d-a8fd-463a-ae89-5fe45ecc0abb tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:41.639362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac0f630d-a8fd-463a-ae89-5fe45ecc0abb tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:41.639854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac0f630d-a8fd-463a-ae89-5fe45ecc0abb tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:41.640280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac0f630d-a8fd-463a-ae89-5fe45ecc0abb tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:41.640963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac0f630d-a8fd-463a-ae89-5fe45ecc0abb tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:41.641405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac0f630d-a8fd-463a-ae89-5fe45ecc0abb tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:41.641815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac0f630d-a8fd-463a-ae89-5fe45ecc0abb tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:41.791960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac0f630d-a8fd-463a-ae89-5fe45ecc0abb tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:41.800504 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ac0f630d-a8fd-463a-ae89-5fe45ecc0abb tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1501 microversion: 2.1 time: 0.174118 Aug 09 15:20:41.801105 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3254/6496] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:41 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:42.823477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fbcd21db-10cb-4d2c-9460-43df93e0b011 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:42.824187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fbcd21db-10cb-4d2c-9460-43df93e0b011 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:42.831761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbcd21db-10cb-4d2c-9460-43df93e0b011 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:42.832288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbcd21db-10cb-4d2c-9460-43df93e0b011 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:42.832712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbcd21db-10cb-4d2c-9460-43df93e0b011 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:42.833487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbcd21db-10cb-4d2c-9460-43df93e0b011 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:42.833884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbcd21db-10cb-4d2c-9460-43df93e0b011 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:42.834321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbcd21db-10cb-4d2c-9460-43df93e0b011 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:42.973046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fbcd21db-10cb-4d2c-9460-43df93e0b011 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '750c7ffb2b054b1ea585b286da7f369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ae7478e83f447be8a1b293ec60d6601', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:42.981079 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fbcd21db-10cb-4d2c-9460-43df93e0b011 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 200 len: 1501 microversion: 2.1 time: 0.162746 Aug 09 15:20:42.981671 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3243/6497] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:42 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:43.604405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5dd567de-c055-4615-aa51-3c619f4f11c7 req-b87c8e39-b864-4fd8-bcb2-74bcf1f2274a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c40b9de-dfb2-46cf-8ab6-81c5cf85d301", "name": "network-vif-deleted", "tag": "901e99c7-0d9a-47a2-99e0-b769b7a41b56"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:20:43.617002 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5dd567de-c055-4615-aa51-3c619f4f11c7 req-b87c8e39-b864-4fd8-bcb2-74bcf1f2274a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:43.617570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5dd567de-c055-4615-aa51-3c619f4f11c7 req-b87c8e39-b864-4fd8-bcb2-74bcf1f2274a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:43.618095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5dd567de-c055-4615-aa51-3c619f4f11c7 req-b87c8e39-b864-4fd8-bcb2-74bcf1f2274a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:43.631231 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5dd567de-c055-4615-aa51-3c619f4f11c7 req-b87c8e39-b864-4fd8-bcb2-74bcf1f2274a service nova] Creating event network-vif-deleted:901e99c7-0d9a-47a2-99e0-b769b7a41b56 for instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 on n-h2-844626-8 Aug 09 15:20:43.636799 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5dd567de-c055-4615-aa51-3c619f4f11c7 req-b87c8e39-b864-4fd8-bcb2-74bcf1f2274a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036113 Aug 09 15:20:43.637680 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3255/6498] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:20:44.004884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1420b103-eaf3-4bad-9d6a-b1a0d5f4d31d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:44.005532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1420b103-eaf3-4bad-9d6a-b1a0d5f4d31d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:44.013083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1420b103-eaf3-4bad-9d6a-b1a0d5f4d31d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:44.013578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1420b103-eaf3-4bad-9d6a-b1a0d5f4d31d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:44.014025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1420b103-eaf3-4bad-9d6a-b1a0d5f4d31d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:44.014736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1420b103-eaf3-4bad-9d6a-b1a0d5f4d31d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:44.015227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1420b103-eaf3-4bad-9d6a-b1a0d5f4d31d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:44.015662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1420b103-eaf3-4bad-9d6a-b1a0d5f4d31d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:44.030136 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-1420b103-eaf3-4bad-9d6a-b1a0d5f4d31d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] HTTP exception thrown: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1420b103-eaf3-4bad-9d6a-b1a0d5f4d31d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Request method failure captured: Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 HTTP/1.1 Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nsUHTUMiP54gTrJfUamqbe8Q_wgmRrs0Yw5aUMieiZSzun2R5EHmnCpqVOCaY_7UO9VsYP_DY75CRMbWhogChpiY_oyh4sGIJ82o8f_P1nM_UrwekoLFwrFrlEG-g56NGwY2sI6COyfxDQHF6iD3wdHBFdh7S2S386ZyH_Uu0xJZfk Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9ae7478e83f447be8a1b293ec60d6601 Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-1795771665 Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ae7478e83f447be8a1b293ec60d6601", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ae7478e83f447be8a1b293ec60d6601"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ae7478e83f447be8a1b293ec60d6601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ae7478e83f447be8a1b293ec60d6601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-1795771665 Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9ae7478e83f447be8a1b293ec60d6601 Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1795771665 Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-1795771665-project Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 750c7ffb2b054b1ea585b286da7f369d Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-1795771665-project Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '8c40b9de-dfb2-46cf-8ab6-81c5cf85d301'} Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:20:44.031957 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.037185 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:20:44.037185 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:20:44.037185 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:20:44.037185 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:20:44.037185 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:20:44.037185 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.037185 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.037185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1420b103-eaf3-4bad-9d6a-b1a0d5f4d31d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Returning 404 to user: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:20:44.037185 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1420b103-eaf3-4bad-9d6a-b1a0d5f4d31d tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 404 len: 111 microversion: 2.1 time: 0.032477 Aug 09 15:20:44.037185 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3244/6499] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:43 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:20:44.048095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1911de60-a8e7-41c4-8b56-7aac53b82272 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:44.048629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1911de60-a8e7-41c4-8b56-7aac53b82272 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:44.055123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1911de60-a8e7-41c4-8b56-7aac53b82272 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:44.055646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1911de60-a8e7-41c4-8b56-7aac53b82272 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:44.056071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1911de60-a8e7-41c4-8b56-7aac53b82272 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:44.056750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1911de60-a8e7-41c4-8b56-7aac53b82272 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:44.057193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1911de60-a8e7-41c4-8b56-7aac53b82272 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:44.057607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1911de60-a8e7-41c4-8b56-7aac53b82272 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:44.071129 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-1911de60-a8e7-41c4-8b56-7aac53b82272 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] HTTP exception thrown: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1911de60-a8e7-41c4-8b56-7aac53b82272 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Request method failure captured: Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 HTTP/1.1 Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nsUHTUMiP54gTrJfUamqbe8Q_wgmRrs0Yw5aUMieiZSzun2R5EHmnCpqVOCaY_7UO9VsYP_DY75CRMbWhogChpiY_oyh4sGIJ82o8f_P1nM_UrwekoLFwrFrlEG-g56NGwY2sI6COyfxDQHF6iD3wdHBFdh7S2S386ZyH_Uu0xJZfk Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 9ae7478e83f447be8a1b293ec60d6601 Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-DeleteServersTestJSON-1795771665 Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ae7478e83f447be8a1b293ec60d6601", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ae7478e83f447be8a1b293ec60d6601"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ae7478e83f447be8a1b293ec60d6601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ae7478e83f447be8a1b293ec60d6601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-DeleteServersTestJSON-1795771665 Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 9ae7478e83f447be8a1b293ec60d6601 Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-DeleteServersTestJSON-1795771665 Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-DeleteServersTestJSON-1795771665-project Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 750c7ffb2b054b1ea585b286da7f369d Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-DeleteServersTestJSON-1795771665-project Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '8c40b9de-dfb2-46cf-8ab6-81c5cf85d301'} Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:20:44.072812 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1911de60-a8e7-41c4-8b56-7aac53b82272 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Returning 404 to user: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1911de60-a8e7-41c4-8b56-7aac53b82272 tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 404 len: 111 microversion: 2.1 time: 0.030562 Aug 09 15:20:44.077535 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3256/6500] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:20:44 2022] DELETE /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:20:44.083052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4699514f-2931-41a0-8576-ee01fd74ce4a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:44.083704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4699514f-2931-41a0-8576-ee01fd74ce4a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] [instance: 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:44.089981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4699514f-2931-41a0-8576-ee01fd74ce4a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:44.090472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4699514f-2931-41a0-8576-ee01fd74ce4a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:44.090913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4699514f-2931-41a0-8576-ee01fd74ce4a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:44.091647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4699514f-2931-41a0-8576-ee01fd74ce4a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:44.092104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4699514f-2931-41a0-8576-ee01fd74ce4a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:44.092539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4699514f-2931-41a0-8576-ee01fd74ce4a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:44.106457 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4699514f-2931-41a0-8576-ee01fd74ce4a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] HTTP exception thrown: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4699514f-2931-41a0-8576-ee01fd74ce4a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Request method failure captured: Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 HTTP/1.1 Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nsUHTUMiP54gTrJfUamqbe8Q_wgmRrs0Yw5aUMieiZSzun2R5EHmnCpqVOCaY_7UO9VsYP_DY75CRMbWhogChpiY_oyh4sGIJ82o8f_P1nM_UrwekoLFwrFrlEG-g56NGwY2sI6COyfxDQHF6iD3wdHBFdh7S2S386ZyH_Uu0xJZfk Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 9ae7478e83f447be8a1b293ec60d6601 Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-DeleteServersTestJSON-1795771665 Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_9ae7478e83f447be8a1b293ec60d6601", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/9ae7478e83f447be8a1b293ec60d6601"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ae7478e83f447be8a1b293ec60d6601"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/9ae7478e83f447be8a1b293ec60d6601"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-DeleteServersTestJSON-1795771665 Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 9ae7478e83f447be8a1b293ec60d6601 Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-DeleteServersTestJSON-1795771665 Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-DeleteServersTestJSON-1795771665-project Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 750c7ffb2b054b1ea585b286da7f369d Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-DeleteServersTestJSON-1795771665-project Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '8c40b9de-dfb2-46cf-8ab6-81c5cf85d301'} Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:20:44.108069 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.113650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:20:44.113650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:20:44.113650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:20:44.113650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:20:44.113650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:20:44.113650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. Aug 09 15:20:44.113650 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:20:44.113650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4699514f-2931-41a0-8576-ee01fd74ce4a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] Returning 404 to user: Instance 8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:20:44.113650 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4699514f-2931-41a0-8576-ee01fd74ce4a tempest-DeleteServersTestJSON-1795771665 tempest-DeleteServersTestJSON-1795771665-project] 10.222.0.50 "GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301" status: 404 len: 111 microversion: 2.1 time: 0.030398 Aug 09 15:20:44.113650 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3245/6501] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:44 2022] GET /compute/v2.1/servers/8c40b9de-dfb2-46cf-8ab6-81c5cf85d301 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:20:53.217794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1441853211", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "081a21d7-a142-4566-a839-933d5183de74"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:20:53.463220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] validate_networks() for [('081a21d7-a142-4566-a839-933d5183de74', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:20:53.858156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:20:53.858586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:20:53.859058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:20:53.859492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:20:53.860255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:20:53.870299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:53.870784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:53.871268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:53.871992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:53.872471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:53.872888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:53.890688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Getting quotas for project fae68a7680d94664ade9019f07e0ce7d. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:20:53.896717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Getting quotas for user 6f7f150d684747dcaed5b5d0a6b6922b and project fae68a7680d94664ade9019f07e0ce7d. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:20:53.910009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:20:53.912429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:20:53.965774 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d268638c-b2a9-40d8-b5f0-189bb5c6b8b0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884594 Aug 09 15:20:53.966436 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3257/6502] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:20:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:20:53.977841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91e71fbc-0f51-478e-9bfc-a40dd412a20f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:53.978540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91e71fbc-0f51-478e-9bfc-a40dd412a20f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:54.097753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:20:54.114641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91e71fbc-0f51-478e-9bfc-a40dd412a20f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:54.124050 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91e71fbc-0f51-478e-9bfc-a40dd412a20f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1218 microversion: 2.1 time: 0.150191 Aug 09 15:20:54.127809 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3246/6503] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:53 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:55.146525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ac924168-3cc1-42ba-a5ec-8f63d920487e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:55.148057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ac924168-3cc1-42ba-a5ec-8f63d920487e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:55.157824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac924168-3cc1-42ba-a5ec-8f63d920487e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:55.158321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac924168-3cc1-42ba-a5ec-8f63d920487e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:55.158792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac924168-3cc1-42ba-a5ec-8f63d920487e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:55.159500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac924168-3cc1-42ba-a5ec-8f63d920487e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:55.160049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac924168-3cc1-42ba-a5ec-8f63d920487e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:55.160506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ac924168-3cc1-42ba-a5ec-8f63d920487e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:55.233664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ac924168-3cc1-42ba-a5ec-8f63d920487e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:55.242933 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ac924168-3cc1-42ba-a5ec-8f63d920487e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1270 microversion: 2.1 time: 0.101257 Aug 09 15:20:55.243675 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3258/6504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:55 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:56.264892 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-112a8a43-6c1f-4b43-93aa-4d77a0d2a079 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:56.266273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-112a8a43-6c1f-4b43-93aa-4d77a0d2a079 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:56.274043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-112a8a43-6c1f-4b43-93aa-4d77a0d2a079 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:56.274975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-112a8a43-6c1f-4b43-93aa-4d77a0d2a079 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:56.275818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-112a8a43-6c1f-4b43-93aa-4d77a0d2a079 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:56.276820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-112a8a43-6c1f-4b43-93aa-4d77a0d2a079 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:56.277546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-112a8a43-6c1f-4b43-93aa-4d77a0d2a079 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:56.278014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-112a8a43-6c1f-4b43-93aa-4d77a0d2a079 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:56.535066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-112a8a43-6c1f-4b43-93aa-4d77a0d2a079 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:56.550109 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-112a8a43-6c1f-4b43-93aa-4d77a0d2a079 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1318 microversion: 2.1 time: 0.288740 Aug 09 15:20:56.550782 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3247/6505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:56 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:56.808578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5a256c43-edab-43eb-bd5c-1d61a823c81b req-4b9cedc2-fcc9-4e74-af38-3e5f18c9fb06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c15d0e-5ae5-4341-b0cb-00364a0ed5db", "tag": "31f6fc3c-52d6-4a44-a39e-03725b8d1ab4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:20:56.820938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5a256c43-edab-43eb-bd5c-1d61a823c81b req-4b9cedc2-fcc9-4e74-af38-3e5f18c9fb06 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:56.821424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5a256c43-edab-43eb-bd5c-1d61a823c81b req-4b9cedc2-fcc9-4e74-af38-3e5f18c9fb06 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:56.821846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5a256c43-edab-43eb-bd5c-1d61a823c81b req-4b9cedc2-fcc9-4e74-af38-3e5f18c9fb06 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:56.834135 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5a256c43-edab-43eb-bd5c-1d61a823c81b req-4b9cedc2-fcc9-4e74-af38-3e5f18c9fb06 service nova] Creating event network-changed:31f6fc3c-52d6-4a44-a39e-03725b8d1ab4 for instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db on n-h2-844626-8 Aug 09 15:20:56.838993 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5a256c43-edab-43eb-bd5c-1d61a823c81b req-4b9cedc2-fcc9-4e74-af38-3e5f18c9fb06 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034199 Aug 09 15:20:56.839616 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3259/6506] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:20:57.572054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7f47af01-03c0-43e4-b249-e2d9e4875acb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:57.572631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7f47af01-03c0-43e4-b249-e2d9e4875acb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:57.580052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f47af01-03c0-43e4-b249-e2d9e4875acb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:57.580550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f47af01-03c0-43e4-b249-e2d9e4875acb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:57.581004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f47af01-03c0-43e4-b249-e2d9e4875acb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:57.581749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f47af01-03c0-43e4-b249-e2d9e4875acb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:57.582250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f47af01-03c0-43e4-b249-e2d9e4875acb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:57.582684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7f47af01-03c0-43e4-b249-e2d9e4875acb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:57.718854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7f47af01-03c0-43e4-b249-e2d9e4875acb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:57.727151 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7f47af01-03c0-43e4-b249-e2d9e4875acb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1318 microversion: 2.1 time: 0.159180 Aug 09 15:20:57.727768 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3248/6507] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:57 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:20:58.751538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7d8210cd-11ac-45a9-befb-0f72e334fe8b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:20:58.752540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7d8210cd-11ac-45a9-befb-0f72e334fe8b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:20:58.759723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d8210cd-11ac-45a9-befb-0f72e334fe8b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:58.760287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d8210cd-11ac-45a9-befb-0f72e334fe8b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:58.760775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d8210cd-11ac-45a9-befb-0f72e334fe8b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:58.761502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d8210cd-11ac-45a9-befb-0f72e334fe8b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:20:58.761977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d8210cd-11ac-45a9-befb-0f72e334fe8b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:20:58.762800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d8210cd-11ac-45a9-befb-0f72e334fe8b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:20:58.980921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7d8210cd-11ac-45a9-befb-0f72e334fe8b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:20:58.991761 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7d8210cd-11ac-45a9-befb-0f72e334fe8b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1318 microversion: 2.1 time: 0.246535 Aug 09 15:20:58.992739 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3260/6508] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:20:58 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:00.016087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3ab650ba-c6fb-49ea-9c5e-f526f74e4d5c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:00.016688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3ab650ba-c6fb-49ea-9c5e-f526f74e4d5c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:00.018642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:00.024593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ab650ba-c6fb-49ea-9c5e-f526f74e4d5c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:00.025083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ab650ba-c6fb-49ea-9c5e-f526f74e4d5c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:00.025570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ab650ba-c6fb-49ea-9c5e-f526f74e4d5c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:00.026302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ab650ba-c6fb-49ea-9c5e-f526f74e4d5c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:00.026773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ab650ba-c6fb-49ea-9c5e-f526f74e4d5c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:00.027237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3ab650ba-c6fb-49ea-9c5e-f526f74e4d5c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:00.162694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3ab650ba-c6fb-49ea-9c5e-f526f74e4d5c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:00.170724 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3ab650ba-c6fb-49ea-9c5e-f526f74e4d5c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1318 microversion: 2.1 time: 0.160944 Aug 09 15:21:00.171350 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3249/6509] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:00 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:01.192055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c1e6429c-1c91-4d29-b03b-4614f2aac0b5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:01.192766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c1e6429c-1c91-4d29-b03b-4614f2aac0b5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:01.195697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:01.201355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1e6429c-1c91-4d29-b03b-4614f2aac0b5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:01.201837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1e6429c-1c91-4d29-b03b-4614f2aac0b5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:01.202266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1e6429c-1c91-4d29-b03b-4614f2aac0b5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:01.202997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1e6429c-1c91-4d29-b03b-4614f2aac0b5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:01.203469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1e6429c-1c91-4d29-b03b-4614f2aac0b5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:01.203876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1e6429c-1c91-4d29-b03b-4614f2aac0b5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:01.207671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=64 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:01.344768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c1e6429c-1c91-4d29-b03b-4614f2aac0b5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:01.353013 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c1e6429c-1c91-4d29-b03b-4614f2aac0b5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1318 microversion: 2.1 time: 0.164918 Aug 09 15:21:01.363141 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3261/6510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:01 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:01.365700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e27aca30-e0c4-4f86-a4b9-ddd00e454dc5 req-07425405-1030-48d0-8d5b-fb2d7ea1bab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c15d0e-5ae5-4341-b0cb-00364a0ed5db", "name": "network-vif-plugged", "status": "completed", "tag": "31f6fc3c-52d6-4a44-a39e-03725b8d1ab4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:01.375582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e27aca30-e0c4-4f86-a4b9-ddd00e454dc5 req-07425405-1030-48d0-8d5b-fb2d7ea1bab6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:01.376150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e27aca30-e0c4-4f86-a4b9-ddd00e454dc5 req-07425405-1030-48d0-8d5b-fb2d7ea1bab6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:01.376697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e27aca30-e0c4-4f86-a4b9-ddd00e454dc5 req-07425405-1030-48d0-8d5b-fb2d7ea1bab6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:01.388634 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e27aca30-e0c4-4f86-a4b9-ddd00e454dc5 req-07425405-1030-48d0-8d5b-fb2d7ea1bab6 service nova] Creating event network-vif-plugged:31f6fc3c-52d6-4a44-a39e-03725b8d1ab4 for instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db on n-h2-844626-8 Aug 09 15:21:01.393726 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e27aca30-e0c4-4f86-a4b9-ddd00e454dc5 req-07425405-1030-48d0-8d5b-fb2d7ea1bab6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034502 Aug 09 15:21:01.394350 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3250/6511] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:21:02.374908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f209d1c8-1f08-44ef-8500-506a2af8e06c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:02.375543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f209d1c8-1f08-44ef-8500-506a2af8e06c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:02.383113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f209d1c8-1f08-44ef-8500-506a2af8e06c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:02.383593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f209d1c8-1f08-44ef-8500-506a2af8e06c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:02.384017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f209d1c8-1f08-44ef-8500-506a2af8e06c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:02.384701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f209d1c8-1f08-44ef-8500-506a2af8e06c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:02.385139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f209d1c8-1f08-44ef-8500-506a2af8e06c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:02.385552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f209d1c8-1f08-44ef-8500-506a2af8e06c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:02.527157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f209d1c8-1f08-44ef-8500-506a2af8e06c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:02.535177 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f209d1c8-1f08-44ef-8500-506a2af8e06c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1318 microversion: 2.1 time: 0.164449 Aug 09 15:21:02.535752 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3262/6512] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:02 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:03.558456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-927dcdb2-987f-4e2a-9a43-926f53c6a14f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:03.559171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-927dcdb2-987f-4e2a-9a43-926f53c6a14f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:03.566606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-927dcdb2-987f-4e2a-9a43-926f53c6a14f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:03.567364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-927dcdb2-987f-4e2a-9a43-926f53c6a14f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:03.567960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-927dcdb2-987f-4e2a-9a43-926f53c6a14f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:03.568986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-927dcdb2-987f-4e2a-9a43-926f53c6a14f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:03.569656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-927dcdb2-987f-4e2a-9a43-926f53c6a14f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:03.570279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-927dcdb2-987f-4e2a-9a43-926f53c6a14f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:03.716895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-927dcdb2-987f-4e2a-9a43-926f53c6a14f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:03.724692 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-927dcdb2-987f-4e2a-9a43-926f53c6a14f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1509 microversion: 2.1 time: 0.171464 Aug 09 15:21:03.725280 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3251/6513] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:03 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:03.745466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f485067b-dfff-44f5-aa14-d11835ae0256 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:03.746072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f485067b-dfff-44f5-aa14-d11835ae0256 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:03.753732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f485067b-dfff-44f5-aa14-d11835ae0256 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:03.754220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f485067b-dfff-44f5-aa14-d11835ae0256 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:03.754647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f485067b-dfff-44f5-aa14-d11835ae0256 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:03.755362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f485067b-dfff-44f5-aa14-d11835ae0256 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:03.755806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f485067b-dfff-44f5-aa14-d11835ae0256 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:03.756218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f485067b-dfff-44f5-aa14-d11835ae0256 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:03.879384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:03.889666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f485067b-dfff-44f5-aa14-d11835ae0256 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:03.901656 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f485067b-dfff-44f5-aa14-d11835ae0256 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1509 microversion: 2.1 time: 0.159977 Aug 09 15:21:03.902558 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3263/6514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:03 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:03.922918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-62cd35f9-0d12-47f2-ae5c-69ffc759851c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:03.925482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-62cd35f9-0d12-47f2-ae5c-69ffc759851c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:03.932205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62cd35f9-0d12-47f2-ae5c-69ffc759851c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:03.932697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62cd35f9-0d12-47f2-ae5c-69ffc759851c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:03.933138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62cd35f9-0d12-47f2-ae5c-69ffc759851c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:03.933852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62cd35f9-0d12-47f2-ae5c-69ffc759851c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:03.934311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62cd35f9-0d12-47f2-ae5c-69ffc759851c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:03.934739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-62cd35f9-0d12-47f2-ae5c-69ffc759851c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:04.008683 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-62cd35f9-0d12-47f2-ae5c-69ffc759851c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "PUT /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1081 microversion: 2.1 time: 0.089667 Aug 09 15:21:04.009340 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3252/6515] 10.222.0.50 () {60 vars in 1256 bytes} [Tue Aug 9 15:21:03 2022] PUT /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1081 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:04.026516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7bb36de9-79cd-4ace-bb2e-0a9bcbbf3377 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:04.027136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7bb36de9-79cd-4ace-bb2e-0a9bcbbf3377 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:04.029006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:04.034598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb36de9-79cd-4ace-bb2e-0a9bcbbf3377 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:04.035072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb36de9-79cd-4ace-bb2e-0a9bcbbf3377 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:04.035526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb36de9-79cd-4ace-bb2e-0a9bcbbf3377 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:04.036210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb36de9-79cd-4ace-bb2e-0a9bcbbf3377 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:04.036647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb36de9-79cd-4ace-bb2e-0a9bcbbf3377 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:04.037030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7bb36de9-79cd-4ace-bb2e-0a9bcbbf3377 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:04.176502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7bb36de9-79cd-4ace-bb2e-0a9bcbbf3377 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:04.184475 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7bb36de9-79cd-4ace-bb2e-0a9bcbbf3377 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1507 microversion: 2.1 time: 0.161813 Aug 09 15:21:04.185061 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3264/6516] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:04 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:04.207928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f17e94ed-2c4c-4808-b849-7c7d67a161e3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:04.208638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f17e94ed-2c4c-4808-b849-7c7d67a161e3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:04.211161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:04.217312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f17e94ed-2c4c-4808-b849-7c7d67a161e3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:04.217462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f17e94ed-2c4c-4808-b849-7c7d67a161e3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:04.217927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f17e94ed-2c4c-4808-b849-7c7d67a161e3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:04.218755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f17e94ed-2c4c-4808-b849-7c7d67a161e3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:04.219292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f17e94ed-2c4c-4808-b849-7c7d67a161e3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:04.219814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f17e94ed-2c4c-4808-b849-7c7d67a161e3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:04.352727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f17e94ed-2c4c-4808-b849-7c7d67a161e3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:04.361227 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f17e94ed-2c4c-4808-b849-7c7d67a161e3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1507 microversion: 2.1 time: 0.160309 Aug 09 15:21:04.361809 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3253/6517] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:04 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:04.381275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:04.383857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:04.391563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:04.392048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:04.392481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:04.393172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:04.393621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:04.394039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:04.425385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:04.431551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Old instance type m1.heat2, new instance type m1.heat {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 15:21:04.437801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:21:04.438224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:21:04.438697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:21:04.439121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:21:04.439540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:21:04.513786 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4286eb2a-84d0-48c8-b474-f781d10e5515 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "POST /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db/action" status: 202 len: 0 microversion: 2.1 time: 0.136470 Aug 09 15:21:04.514405 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3265/6518] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:21:04 2022] POST /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:21:04.522887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dccbc5e4-c703-4dc5-b2a5-4bfdbf089b98 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:04.523612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dccbc5e4-c703-4dc5-b2a5-4bfdbf089b98 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:04.530139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dccbc5e4-c703-4dc5-b2a5-4bfdbf089b98 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:04.530686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dccbc5e4-c703-4dc5-b2a5-4bfdbf089b98 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:04.531122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dccbc5e4-c703-4dc5-b2a5-4bfdbf089b98 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:04.531821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dccbc5e4-c703-4dc5-b2a5-4bfdbf089b98 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:04.532316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dccbc5e4-c703-4dc5-b2a5-4bfdbf089b98 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:04.532736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dccbc5e4-c703-4dc5-b2a5-4bfdbf089b98 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:04.676827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dccbc5e4-c703-4dc5-b2a5-4bfdbf089b98 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:04.689641 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dccbc5e4-c703-4dc5-b2a5-4bfdbf089b98 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1518 microversion: 2.1 time: 0.170626 Aug 09 15:21:04.690705 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3254/6519] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:04 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:05.713443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-710eba84-1b73-4894-9b19-559d438a69d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:05.714037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-710eba84-1b73-4894-9b19-559d438a69d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:05.720573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-710eba84-1b73-4894-9b19-559d438a69d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:05.721057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-710eba84-1b73-4894-9b19-559d438a69d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:05.721488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-710eba84-1b73-4894-9b19-559d438a69d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:05.722189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-710eba84-1b73-4894-9b19-559d438a69d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:05.722640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-710eba84-1b73-4894-9b19-559d438a69d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:05.723061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-710eba84-1b73-4894-9b19-559d438a69d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:05.950241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-710eba84-1b73-4894-9b19-559d438a69d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:05.958716 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-710eba84-1b73-4894-9b19-559d438a69d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1518 microversion: 2.1 time: 0.250197 Aug 09 15:21:05.959367 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3266/6520] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:05 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1518 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:06.980210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-47049f42-9df6-490b-b11e-45c453bdd0d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:06.980893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-47049f42-9df6-490b-b11e-45c453bdd0d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:06.989042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47049f42-9df6-490b-b11e-45c453bdd0d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:06.989575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47049f42-9df6-490b-b11e-45c453bdd0d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:06.990025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47049f42-9df6-490b-b11e-45c453bdd0d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:06.990782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47049f42-9df6-490b-b11e-45c453bdd0d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:06.991284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47049f42-9df6-490b-b11e-45c453bdd0d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:06.991740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-47049f42-9df6-490b-b11e-45c453bdd0d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:07.132626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-47049f42-9df6-490b-b11e-45c453bdd0d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:07.145268 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-47049f42-9df6-490b-b11e-45c453bdd0d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.168941 Aug 09 15:21:07.146130 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3255/6521] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:06 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:08.169436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-61fa54e1-ca30-40f9-b2f7-dabc24a21650 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:08.170092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-61fa54e1-ca30-40f9-b2f7-dabc24a21650 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:08.177866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61fa54e1-ca30-40f9-b2f7-dabc24a21650 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:08.178359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61fa54e1-ca30-40f9-b2f7-dabc24a21650 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:08.178785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61fa54e1-ca30-40f9-b2f7-dabc24a21650 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:08.179505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61fa54e1-ca30-40f9-b2f7-dabc24a21650 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:08.179944 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61fa54e1-ca30-40f9-b2f7-dabc24a21650 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:08.180357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-61fa54e1-ca30-40f9-b2f7-dabc24a21650 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:08.322392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-61fa54e1-ca30-40f9-b2f7-dabc24a21650 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:08.330241 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-61fa54e1-ca30-40f9-b2f7-dabc24a21650 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.165682 Aug 09 15:21:08.330814 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3267/6522] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:08 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:09.351953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5ca0e0c-4ec0-4df3-baa9-d1976c828f45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:09.352720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c5ca0e0c-4ec0-4df3-baa9-d1976c828f45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:09.360656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5ca0e0c-4ec0-4df3-baa9-d1976c828f45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:09.361202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5ca0e0c-4ec0-4df3-baa9-d1976c828f45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:09.361694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5ca0e0c-4ec0-4df3-baa9-d1976c828f45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:09.362461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5ca0e0c-4ec0-4df3-baa9-d1976c828f45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:09.362993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5ca0e0c-4ec0-4df3-baa9-d1976c828f45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:09.363479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5ca0e0c-4ec0-4df3-baa9-d1976c828f45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:09.509924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5ca0e0c-4ec0-4df3-baa9-d1976c828f45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:09.517992 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c5ca0e0c-4ec0-4df3-baa9-d1976c828f45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.170456 Aug 09 15:21:09.518577 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3256/6523] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:09 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:10.540061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bd429ab7-dc4d-4d56-af11-c19fb0d6badc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:10.540696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bd429ab7-dc4d-4d56-af11-c19fb0d6badc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:10.547939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd429ab7-dc4d-4d56-af11-c19fb0d6badc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:10.548435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd429ab7-dc4d-4d56-af11-c19fb0d6badc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:10.548869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd429ab7-dc4d-4d56-af11-c19fb0d6badc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:10.549562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd429ab7-dc4d-4d56-af11-c19fb0d6badc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:10.550016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd429ab7-dc4d-4d56-af11-c19fb0d6badc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:10.550469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bd429ab7-dc4d-4d56-af11-c19fb0d6badc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:10.691115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bd429ab7-dc4d-4d56-af11-c19fb0d6badc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:10.701283 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bd429ab7-dc4d-4d56-af11-c19fb0d6badc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.165100 Aug 09 15:21:10.701981 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3268/6524] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:10 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:11.725949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aba0614f-6687-40b8-99fd-0dac3174bb7b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:11.726726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aba0614f-6687-40b8-99fd-0dac3174bb7b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:11.736431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aba0614f-6687-40b8-99fd-0dac3174bb7b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:11.736945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aba0614f-6687-40b8-99fd-0dac3174bb7b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:11.737400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aba0614f-6687-40b8-99fd-0dac3174bb7b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:11.738117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aba0614f-6687-40b8-99fd-0dac3174bb7b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:11.738584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aba0614f-6687-40b8-99fd-0dac3174bb7b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:11.739019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aba0614f-6687-40b8-99fd-0dac3174bb7b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:11.897748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aba0614f-6687-40b8-99fd-0dac3174bb7b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:11.905494 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aba0614f-6687-40b8-99fd-0dac3174bb7b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.185700 Aug 09 15:21:11.906090 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3257/6525] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:11 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:12.926371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-50e2ec03-e4f4-45c3-92fa-dd28012693b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:12.926970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-50e2ec03-e4f4-45c3-92fa-dd28012693b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:12.934295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e2ec03-e4f4-45c3-92fa-dd28012693b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:12.934769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e2ec03-e4f4-45c3-92fa-dd28012693b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:12.935236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e2ec03-e4f4-45c3-92fa-dd28012693b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:12.935921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e2ec03-e4f4-45c3-92fa-dd28012693b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:12.936370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e2ec03-e4f4-45c3-92fa-dd28012693b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:12.936792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-50e2ec03-e4f4-45c3-92fa-dd28012693b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:13.077764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-50e2ec03-e4f4-45c3-92fa-dd28012693b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:13.085825 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-50e2ec03-e4f4-45c3-92fa-dd28012693b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.163463 Aug 09 15:21:13.086406 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3269/6526] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:12 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:14.106231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-76473409-5698-4cbc-adf9-5d6e46d814e0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:14.106816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-76473409-5698-4cbc-adf9-5d6e46d814e0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:14.114645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76473409-5698-4cbc-adf9-5d6e46d814e0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:14.115130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76473409-5698-4cbc-adf9-5d6e46d814e0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:14.115597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76473409-5698-4cbc-adf9-5d6e46d814e0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:14.116268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76473409-5698-4cbc-adf9-5d6e46d814e0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:14.116754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76473409-5698-4cbc-adf9-5d6e46d814e0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:14.117174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76473409-5698-4cbc-adf9-5d6e46d814e0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:14.259558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-76473409-5698-4cbc-adf9-5d6e46d814e0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:14.270727 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-76473409-5698-4cbc-adf9-5d6e46d814e0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.168250 Aug 09 15:21:14.271407 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3258/6527] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:14 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:15.294946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e781ec7d-c7c5-4926-91f4-5eb986abf185 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:15.295719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e781ec7d-c7c5-4926-91f4-5eb986abf185 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:15.302909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e781ec7d-c7c5-4926-91f4-5eb986abf185 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:15.303402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e781ec7d-c7c5-4926-91f4-5eb986abf185 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:15.303857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e781ec7d-c7c5-4926-91f4-5eb986abf185 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:15.304550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e781ec7d-c7c5-4926-91f4-5eb986abf185 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:15.305026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e781ec7d-c7c5-4926-91f4-5eb986abf185 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:15.305443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e781ec7d-c7c5-4926-91f4-5eb986abf185 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:15.444686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e781ec7d-c7c5-4926-91f4-5eb986abf185 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:15.455123 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e781ec7d-c7c5-4926-91f4-5eb986abf185 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.164689 Aug 09 15:21:15.455740 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3270/6528] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:15 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:16.476811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-92438270-5396-426e-b958-10554b6529ba tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:16.477419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-92438270-5396-426e-b958-10554b6529ba tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:16.485934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92438270-5396-426e-b958-10554b6529ba tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:16.486421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92438270-5396-426e-b958-10554b6529ba tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:16.486865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92438270-5396-426e-b958-10554b6529ba tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:16.487608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92438270-5396-426e-b958-10554b6529ba tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:16.488075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92438270-5396-426e-b958-10554b6529ba tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:16.488554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92438270-5396-426e-b958-10554b6529ba tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:16.625910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-92438270-5396-426e-b958-10554b6529ba tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:16.634211 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-92438270-5396-426e-b958-10554b6529ba tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.162108 Aug 09 15:21:16.634813 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3259/6529] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:16 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:17.659237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6ebd3ff2-e7e7-4e15-97e8-ba952e58f4b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:17.660137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6ebd3ff2-e7e7-4e15-97e8-ba952e58f4b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:17.670830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ebd3ff2-e7e7-4e15-97e8-ba952e58f4b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:17.671640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ebd3ff2-e7e7-4e15-97e8-ba952e58f4b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:17.672048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ebd3ff2-e7e7-4e15-97e8-ba952e58f4b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:17.672790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ebd3ff2-e7e7-4e15-97e8-ba952e58f4b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:17.673263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ebd3ff2-e7e7-4e15-97e8-ba952e58f4b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:17.673706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6ebd3ff2-e7e7-4e15-97e8-ba952e58f4b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:17.828810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6ebd3ff2-e7e7-4e15-97e8-ba952e58f4b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:17.840778 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6ebd3ff2-e7e7-4e15-97e8-ba952e58f4b4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.187981 Aug 09 15:21:17.841517 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3271/6530] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:17 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:18.862644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9a4c126a-290a-443a-84fb-43fc267f930d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:18.863357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9a4c126a-290a-443a-84fb-43fc267f930d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:18.871035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a4c126a-290a-443a-84fb-43fc267f930d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:18.871557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a4c126a-290a-443a-84fb-43fc267f930d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:18.872008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a4c126a-290a-443a-84fb-43fc267f930d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:18.872706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a4c126a-290a-443a-84fb-43fc267f930d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:18.873162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a4c126a-290a-443a-84fb-43fc267f930d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:18.873588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9a4c126a-290a-443a-84fb-43fc267f930d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:19.008127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9a4c126a-290a-443a-84fb-43fc267f930d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:19.016502 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9a4c126a-290a-443a-84fb-43fc267f930d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.158133 Aug 09 15:21:19.017086 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3260/6531] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:18 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:20.040785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-82e083f2-02db-48c8-aaed-6172b91679a7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:20.041692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-82e083f2-02db-48c8-aaed-6172b91679a7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:20.052302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82e083f2-02db-48c8-aaed-6172b91679a7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:20.052844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82e083f2-02db-48c8-aaed-6172b91679a7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:20.053298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82e083f2-02db-48c8-aaed-6172b91679a7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:20.054461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82e083f2-02db-48c8-aaed-6172b91679a7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:20.055309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82e083f2-02db-48c8-aaed-6172b91679a7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:20.056047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-82e083f2-02db-48c8-aaed-6172b91679a7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:20.208038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-82e083f2-02db-48c8-aaed-6172b91679a7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:20.216232 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-82e083f2-02db-48c8-aaed-6172b91679a7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.180885 Aug 09 15:21:20.216787 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3272/6532] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:20 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:21.238926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-51e1bde9-9c87-49e0-b889-a8ba8129d664 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:21.239578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-51e1bde9-9c87-49e0-b889-a8ba8129d664 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:21.247011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51e1bde9-9c87-49e0-b889-a8ba8129d664 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:21.247568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51e1bde9-9c87-49e0-b889-a8ba8129d664 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:21.248009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51e1bde9-9c87-49e0-b889-a8ba8129d664 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:21.248708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51e1bde9-9c87-49e0-b889-a8ba8129d664 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:21.249164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51e1bde9-9c87-49e0-b889-a8ba8129d664 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:21.249600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-51e1bde9-9c87-49e0-b889-a8ba8129d664 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:21.388326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-51e1bde9-9c87-49e0-b889-a8ba8129d664 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:21.398220 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-51e1bde9-9c87-49e0-b889-a8ba8129d664 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.163784 Aug 09 15:21:21.398794 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3261/6533] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:21 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:22.419742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7ae4fcc4-c937-410c-bd24-d06f643918d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:22.420413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7ae4fcc4-c937-410c-bd24-d06f643918d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:22.427584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae4fcc4-c937-410c-bd24-d06f643918d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:22.428053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae4fcc4-c937-410c-bd24-d06f643918d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:22.428483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae4fcc4-c937-410c-bd24-d06f643918d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:22.429167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae4fcc4-c937-410c-bd24-d06f643918d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:22.429605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae4fcc4-c937-410c-bd24-d06f643918d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:22.430015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ae4fcc4-c937-410c-bd24-d06f643918d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:22.563182 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7ae4fcc4-c937-410c-bd24-d06f643918d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:22.575730 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7ae4fcc4-c937-410c-bd24-d06f643918d8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.159692 Aug 09 15:21:22.576662 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3273/6534] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:22 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:23.600764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-857090c4-0f5e-4a30-9aa3-64797d811197 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:23.601786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-857090c4-0f5e-4a30-9aa3-64797d811197 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:23.611965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-857090c4-0f5e-4a30-9aa3-64797d811197 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:23.612441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-857090c4-0f5e-4a30-9aa3-64797d811197 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:23.612883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-857090c4-0f5e-4a30-9aa3-64797d811197 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:23.613708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-857090c4-0f5e-4a30-9aa3-64797d811197 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:23.614161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-857090c4-0f5e-4a30-9aa3-64797d811197 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:23.614589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-857090c4-0f5e-4a30-9aa3-64797d811197 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:23.760503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-857090c4-0f5e-4a30-9aa3-64797d811197 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:23.771619 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-857090c4-0f5e-4a30-9aa3-64797d811197 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.175402 Aug 09 15:21:23.772360 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3262/6535] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:23 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:24.793812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c8fecb4c-b68d-4d49-a128-cfbcc41ffb9f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:24.794422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c8fecb4c-b68d-4d49-a128-cfbcc41ffb9f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:24.801942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8fecb4c-b68d-4d49-a128-cfbcc41ffb9f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:24.802595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8fecb4c-b68d-4d49-a128-cfbcc41ffb9f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:24.803027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8fecb4c-b68d-4d49-a128-cfbcc41ffb9f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:24.803756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8fecb4c-b68d-4d49-a128-cfbcc41ffb9f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:24.804204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8fecb4c-b68d-4d49-a128-cfbcc41ffb9f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:24.804598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c8fecb4c-b68d-4d49-a128-cfbcc41ffb9f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:24.942340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c8fecb4c-b68d-4d49-a128-cfbcc41ffb9f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:24.954004 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c8fecb4c-b68d-4d49-a128-cfbcc41ffb9f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.164156 Aug 09 15:21:24.954780 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3274/6536] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:24 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:25.978612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d87123f1-0951-46e2-a411-2535b07552d6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:25.979280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d87123f1-0951-46e2-a411-2535b07552d6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:25.987399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d87123f1-0951-46e2-a411-2535b07552d6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:25.987896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d87123f1-0951-46e2-a411-2535b07552d6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:25.988331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d87123f1-0951-46e2-a411-2535b07552d6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:25.989028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d87123f1-0951-46e2-a411-2535b07552d6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:25.989480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d87123f1-0951-46e2-a411-2535b07552d6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:25.989922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d87123f1-0951-46e2-a411-2535b07552d6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:25.992776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:26.153412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d87123f1-0951-46e2-a411-2535b07552d6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:26.165450 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d87123f1-0951-46e2-a411-2535b07552d6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.191453 Aug 09 15:21:26.166097 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3263/6537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:25 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:27.191188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f93210c-3a79-4a4b-9aef-f427ff9894e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:27.191768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f93210c-3a79-4a4b-9aef-f427ff9894e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:27.199376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f93210c-3a79-4a4b-9aef-f427ff9894e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:27.199853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f93210c-3a79-4a4b-9aef-f427ff9894e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:27.200299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f93210c-3a79-4a4b-9aef-f427ff9894e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:27.200985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f93210c-3a79-4a4b-9aef-f427ff9894e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:27.201431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f93210c-3a79-4a4b-9aef-f427ff9894e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:27.201855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f93210c-3a79-4a4b-9aef-f427ff9894e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:27.342117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9f93210c-3a79-4a4b-9aef-f427ff9894e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:27.349950 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9f93210c-3a79-4a4b-9aef-f427ff9894e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.162810 Aug 09 15:21:27.350642 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3275/6538] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:27 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:28.377759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1811afeb-1a26-4007-8b3d-87da16267df2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:28.378370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1811afeb-1a26-4007-8b3d-87da16267df2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:28.385945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1811afeb-1a26-4007-8b3d-87da16267df2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:28.386438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1811afeb-1a26-4007-8b3d-87da16267df2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:28.386881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1811afeb-1a26-4007-8b3d-87da16267df2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:28.387615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1811afeb-1a26-4007-8b3d-87da16267df2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:28.388067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1811afeb-1a26-4007-8b3d-87da16267df2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:28.388500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1811afeb-1a26-4007-8b3d-87da16267df2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:28.537233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1811afeb-1a26-4007-8b3d-87da16267df2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:28.552258 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1811afeb-1a26-4007-8b3d-87da16267df2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.177938 Aug 09 15:21:28.553588 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3264/6539] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:28 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:29.576602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8fa0c3dc-33a4-4118-ae46-4cbd3c074283 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:29.577281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8fa0c3dc-33a4-4118-ae46-4cbd3c074283 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:29.586448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fa0c3dc-33a4-4118-ae46-4cbd3c074283 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:29.586932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fa0c3dc-33a4-4118-ae46-4cbd3c074283 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:29.587385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fa0c3dc-33a4-4118-ae46-4cbd3c074283 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:29.588081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fa0c3dc-33a4-4118-ae46-4cbd3c074283 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:29.588724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fa0c3dc-33a4-4118-ae46-4cbd3c074283 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:29.589033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8fa0c3dc-33a4-4118-ae46-4cbd3c074283 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:29.605195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:29.734214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8fa0c3dc-33a4-4118-ae46-4cbd3c074283 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:29.742781 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8fa0c3dc-33a4-4118-ae46-4cbd3c074283 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.171494 Aug 09 15:21:29.743415 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3276/6540] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:29 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:30.768722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-59790db0-e6ef-4392-97f8-1664a5e95bc4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:30.769673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-59790db0-e6ef-4392-97f8-1664a5e95bc4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:30.773585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=32 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:30.781302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59790db0-e6ef-4392-97f8-1664a5e95bc4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:30.781798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59790db0-e6ef-4392-97f8-1664a5e95bc4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:30.782243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59790db0-e6ef-4392-97f8-1664a5e95bc4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:30.782952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59790db0-e6ef-4392-97f8-1664a5e95bc4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:30.783437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59790db0-e6ef-4392-97f8-1664a5e95bc4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:30.783860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59790db0-e6ef-4392-97f8-1664a5e95bc4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:30.939325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-59790db0-e6ef-4392-97f8-1664a5e95bc4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:30.951157 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-59790db0-e6ef-4392-97f8-1664a5e95bc4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.188261 Aug 09 15:21:30.952134 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3265/6541] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:30 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:31.976795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-826dab04-b144-47ec-ad2a-bcfb8375476d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:31.977488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-826dab04-b144-47ec-ad2a-bcfb8375476d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:31.980204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=36 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:31.986727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-826dab04-b144-47ec-ad2a-bcfb8375476d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:31.987225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-826dab04-b144-47ec-ad2a-bcfb8375476d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:31.987653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-826dab04-b144-47ec-ad2a-bcfb8375476d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:31.988332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-826dab04-b144-47ec-ad2a-bcfb8375476d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:31.988777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-826dab04-b144-47ec-ad2a-bcfb8375476d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:31.989184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-826dab04-b144-47ec-ad2a-bcfb8375476d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:32.140934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-826dab04-b144-47ec-ad2a-bcfb8375476d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:32.149899 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-826dab04-b144-47ec-ad2a-bcfb8375476d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.176821 Aug 09 15:21:32.149899 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3277/6542] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:31 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:33.170400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-69a9a5a1-e3b4-4deb-9410-b8ad02600b36 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:33.170966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-69a9a5a1-e3b4-4deb-9410-b8ad02600b36 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:33.178676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69a9a5a1-e3b4-4deb-9410-b8ad02600b36 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:33.179203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69a9a5a1-e3b4-4deb-9410-b8ad02600b36 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:33.179644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69a9a5a1-e3b4-4deb-9410-b8ad02600b36 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:33.180347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69a9a5a1-e3b4-4deb-9410-b8ad02600b36 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:33.180798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69a9a5a1-e3b4-4deb-9410-b8ad02600b36 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:33.181229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69a9a5a1-e3b4-4deb-9410-b8ad02600b36 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:33.319959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-69a9a5a1-e3b4-4deb-9410-b8ad02600b36 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:33.329144 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-69a9a5a1-e3b4-4deb-9410-b8ad02600b36 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1523 microversion: 2.1 time: 0.162766 Aug 09 15:21:33.329754 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3266/6543] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:33 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:34.271567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8ce466f7-7762-4a12-9f85-11fb9f1a9976 req-f46fec3c-d7da-49d5-9a73-3a574149650d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c15d0e-5ae5-4341-b0cb-00364a0ed5db", "name": "network-vif-unplugged", "status": "completed", "tag": "31f6fc3c-52d6-4a44-a39e-03725b8d1ab4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:34.282906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8ce466f7-7762-4a12-9f85-11fb9f1a9976 req-f46fec3c-d7da-49d5-9a73-3a574149650d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:34.283488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8ce466f7-7762-4a12-9f85-11fb9f1a9976 req-f46fec3c-d7da-49d5-9a73-3a574149650d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:34.283916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8ce466f7-7762-4a12-9f85-11fb9f1a9976 req-f46fec3c-d7da-49d5-9a73-3a574149650d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:34.296138 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8ce466f7-7762-4a12-9f85-11fb9f1a9976 req-f46fec3c-d7da-49d5-9a73-3a574149650d service nova] Creating event network-vif-unplugged:31f6fc3c-52d6-4a44-a39e-03725b8d1ab4 for instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db on n-h1-844626-8 Aug 09 15:21:34.301566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-8ce466f7-7762-4a12-9f85-11fb9f1a9976 req-f46fec3c-d7da-49d5-9a73-3a574149650d service nova] Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:21:34.312549 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8ce466f7-7762-4a12-9f85-11fb9f1a9976 req-f46fec3c-d7da-49d5-9a73-3a574149650d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045154 Aug 09 15:21:34.313387 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3278/6544] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:21:34.351819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-156cfaf8-f85e-4b33-8c20-0e35170cc0b6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:34.352658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-156cfaf8-f85e-4b33-8c20-0e35170cc0b6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:34.361278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-156cfaf8-f85e-4b33-8c20-0e35170cc0b6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:34.361794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-156cfaf8-f85e-4b33-8c20-0e35170cc0b6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:34.362232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-156cfaf8-f85e-4b33-8c20-0e35170cc0b6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:34.362919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-156cfaf8-f85e-4b33-8c20-0e35170cc0b6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:34.363685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-156cfaf8-f85e-4b33-8c20-0e35170cc0b6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:34.364117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-156cfaf8-f85e-4b33-8c20-0e35170cc0b6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:34.514087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-156cfaf8-f85e-4b33-8c20-0e35170cc0b6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:34.522131 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-156cfaf8-f85e-4b33-8c20-0e35170cc0b6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1522 microversion: 2.1 time: 0.175958 Aug 09 15:21:34.523014 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3267/6545] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:34 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:35.546552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f0dfee51-5c3a-41c3-826b-6ec45dd69b2b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:35.547181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f0dfee51-5c3a-41c3-826b-6ec45dd69b2b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:35.553959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0dfee51-5c3a-41c3-826b-6ec45dd69b2b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:35.554430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0dfee51-5c3a-41c3-826b-6ec45dd69b2b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:35.554864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0dfee51-5c3a-41c3-826b-6ec45dd69b2b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:35.555591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0dfee51-5c3a-41c3-826b-6ec45dd69b2b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:35.556036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0dfee51-5c3a-41c3-826b-6ec45dd69b2b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:35.556456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f0dfee51-5c3a-41c3-826b-6ec45dd69b2b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:35.698801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f0dfee51-5c3a-41c3-826b-6ec45dd69b2b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:35.708138 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f0dfee51-5c3a-41c3-826b-6ec45dd69b2b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1520 microversion: 2.1 time: 0.166987 Aug 09 15:21:35.708752 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3279/6546] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:35 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:36.329161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c2138682-0e20-4f22-b9de-02c9f1c449e7 req-a34f996a-c499-49c5-ac20-cc62178d5184 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c15d0e-5ae5-4341-b0cb-00364a0ed5db", "tag": "31f6fc3c-52d6-4a44-a39e-03725b8d1ab4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:36.340016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c2138682-0e20-4f22-b9de-02c9f1c449e7 req-a34f996a-c499-49c5-ac20-cc62178d5184 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:36.340503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c2138682-0e20-4f22-b9de-02c9f1c449e7 req-a34f996a-c499-49c5-ac20-cc62178d5184 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:36.340939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c2138682-0e20-4f22-b9de-02c9f1c449e7 req-a34f996a-c499-49c5-ac20-cc62178d5184 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:36.352651 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-c2138682-0e20-4f22-b9de-02c9f1c449e7 req-a34f996a-c499-49c5-ac20-cc62178d5184 service nova] Creating event network-changed:31f6fc3c-52d6-4a44-a39e-03725b8d1ab4 for instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db on n-h1-844626-8 Aug 09 15:21:36.358157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-c2138682-0e20-4f22-b9de-02c9f1c449e7 req-a34f996a-c499-49c5-ac20-cc62178d5184 service nova] Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:21:36.369651 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c2138682-0e20-4f22-b9de-02c9f1c449e7 req-a34f996a-c499-49c5-ac20-cc62178d5184 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044925 Aug 09 15:21:36.370264 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3268/6547] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:21:36.731025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4ffd36e-5fcb-49b7-b888-af92abb7bb2f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:36.732466 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4ffd36e-5fcb-49b7-b888-af92abb7bb2f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:36.740492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ffd36e-5fcb-49b7-b888-af92abb7bb2f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:36.741379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ffd36e-5fcb-49b7-b888-af92abb7bb2f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:36.742211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ffd36e-5fcb-49b7-b888-af92abb7bb2f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:36.742947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ffd36e-5fcb-49b7-b888-af92abb7bb2f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:36.743688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ffd36e-5fcb-49b7-b888-af92abb7bb2f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:36.744107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4ffd36e-5fcb-49b7-b888-af92abb7bb2f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:36.960718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d4ffd36e-5fcb-49b7-b888-af92abb7bb2f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:36.969248 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4ffd36e-5fcb-49b7-b888-af92abb7bb2f tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1517 microversion: 2.1 time: 0.242443 Aug 09 15:21:36.969842 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3280/6548] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:36 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1517 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:36.991101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8cd024c0-e7ee-4d2e-b1e6-104d0e9448e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:36.991853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8cd024c0-e7ee-4d2e-b1e6-104d0e9448e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:36.998518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cd024c0-e7ee-4d2e-b1e6-104d0e9448e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:36.999019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cd024c0-e7ee-4d2e-b1e6-104d0e9448e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:36.999522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cd024c0-e7ee-4d2e-b1e6-104d0e9448e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:37.000230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cd024c0-e7ee-4d2e-b1e6-104d0e9448e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:37.000790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cd024c0-e7ee-4d2e-b1e6-104d0e9448e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:37.001412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8cd024c0-e7ee-4d2e-b1e6-104d0e9448e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:37.070347 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8cd024c0-e7ee-4d2e-b1e6-104d0e9448e6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "POST /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db/action" status: 204 len: 0 microversion: 2.1 time: 0.083373 Aug 09 15:21:37.071009 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3269/6549] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:21:36 2022] POST /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:21:37.079793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14cb65c7-ad62-4fcb-b9e5-83fb309467ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:37.080453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14cb65c7-ad62-4fcb-b9e5-83fb309467ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:37.086705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14cb65c7-ad62-4fcb-b9e5-83fb309467ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:37.087315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14cb65c7-ad62-4fcb-b9e5-83fb309467ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:37.087745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14cb65c7-ad62-4fcb-b9e5-83fb309467ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:37.088431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14cb65c7-ad62-4fcb-b9e5-83fb309467ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:37.088881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14cb65c7-ad62-4fcb-b9e5-83fb309467ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:37.089293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14cb65c7-ad62-4fcb-b9e5-83fb309467ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:37.341860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14cb65c7-ad62-4fcb-b9e5-83fb309467ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:37.350163 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14cb65c7-ad62-4fcb-b9e5-83fb309467ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1517 microversion: 2.1 time: 0.274463 Aug 09 15:21:37.350986 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3281/6550] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:37 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1517 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:38.372619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d027e4e1-e798-455c-9857-7906b5c370fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:38.373326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d027e4e1-e798-455c-9857-7906b5c370fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:38.380451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d027e4e1-e798-455c-9857-7906b5c370fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:38.380940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d027e4e1-e798-455c-9857-7906b5c370fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:38.381381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d027e4e1-e798-455c-9857-7906b5c370fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:38.382081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d027e4e1-e798-455c-9857-7906b5c370fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:38.382530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d027e4e1-e798-455c-9857-7906b5c370fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:38.382964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d027e4e1-e798-455c-9857-7906b5c370fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:38.522518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d027e4e1-e798-455c-9857-7906b5c370fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:38.530945 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d027e4e1-e798-455c-9857-7906b5c370fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1509 microversion: 2.1 time: 0.162932 Aug 09 15:21:38.531548 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3270/6551] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:38 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:38.553318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af685365-e2fd-4701-bcd6-c8cf7847ac77 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:38.553910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-af685365-e2fd-4701-bcd6-c8cf7847ac77 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:38.560988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af685365-e2fd-4701-bcd6-c8cf7847ac77 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:38.561591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af685365-e2fd-4701-bcd6-c8cf7847ac77 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:38.562029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af685365-e2fd-4701-bcd6-c8cf7847ac77 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:38.562765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af685365-e2fd-4701-bcd6-c8cf7847ac77 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:38.563293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af685365-e2fd-4701-bcd6-c8cf7847ac77 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:38.563712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af685365-e2fd-4701-bcd6-c8cf7847ac77 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:38.692960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-af685365-e2fd-4701-bcd6-c8cf7847ac77 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:38.700672 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af685365-e2fd-4701-bcd6-c8cf7847ac77 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1509 microversion: 2.1 time: 0.151225 Aug 09 15:21:38.701267 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3282/6552] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:38 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:38.724079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0f60d739-2719-4c64-b268-ddeaafb387da tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Action: 'create', calling method: .version_select at 0x7f41cc77d670>, body: {"keypair": {"name": "tempest-keypair-1494953479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7a45xMirOW2IGztdAFkht/qBjYeVZu+XEYoKwt6/sjoJsYs5sDtKYx67iMdU0o3uyGUWusYvET7yQNHvKN1xvi+W1NTWqrfqvvsHIUSwF0EFcHk+aobZ8z1zs66XyEhw=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:38.740851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-0f60d739-2719-4c64-b268-ddeaafb387da tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Getting quotas for project fae68a7680d94664ade9019f07e0ce7d. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:21:38.747375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-0f60d739-2719-4c64-b268-ddeaafb387da tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Getting quotas for user 6f7f150d684747dcaed5b5d0a6b6922b and project fae68a7680d94664ade9019f07e0ce7d. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:21:38.774805 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0f60d739-2719-4c64-b268-ddeaafb387da tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054610 Aug 09 15:21:38.775465 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3271/6553] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:21:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:21:40.324611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-31b0bf7f-5673-4efd-8b22-26e5dd0777cb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:40.325228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-31b0bf7f-5673-4efd-8b22-26e5dd0777cb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:40.331866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31b0bf7f-5673-4efd-8b22-26e5dd0777cb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:40.332325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31b0bf7f-5673-4efd-8b22-26e5dd0777cb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:40.332748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31b0bf7f-5673-4efd-8b22-26e5dd0777cb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:40.333475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31b0bf7f-5673-4efd-8b22-26e5dd0777cb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:40.333925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31b0bf7f-5673-4efd-8b22-26e5dd0777cb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:40.334354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31b0bf7f-5673-4efd-8b22-26e5dd0777cb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:40.471685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-31b0bf7f-5673-4efd-8b22-26e5dd0777cb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:40.479368 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-31b0bf7f-5673-4efd-8b22-26e5dd0777cb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 200 len: 1509 microversion: 2.1 time: 0.158845 Aug 09 15:21:40.479937 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3283/6554] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:40 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:40.500831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42819824-0ead-4a99-aec3-16a5a87af2af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:40.501356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42819824-0ead-4a99-aec3-16a5a87af2af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:40.508662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42819824-0ead-4a99-aec3-16a5a87af2af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:40.509155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42819824-0ead-4a99-aec3-16a5a87af2af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:40.509596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42819824-0ead-4a99-aec3-16a5a87af2af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:40.510294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42819824-0ead-4a99-aec3-16a5a87af2af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:40.510747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42819824-0ead-4a99-aec3-16a5a87af2af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:40.511211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42819824-0ead-4a99-aec3-16a5a87af2af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:40.536169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42819824-0ead-4a99-aec3-16a5a87af2af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:21:40.618306 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42819824-0ead-4a99-aec3-16a5a87af2af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 204 len: 0 microversion: 2.1 time: 0.122199 Aug 09 15:21:40.619226 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3272/6555] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:21:40 2022] DELETE /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:21:40.673582 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1639565577", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "081a21d7-a142-4566-a839-933d5183de74"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:40.727943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] validate_networks() for [('081a21d7-a142-4566-a839-933d5183de74', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:21:41.023246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-812be8d9-12a4-4771-8b5a-314aab74aca4 req-b4428dde-8eff-4ec1-8cc4-6b3084b4ad93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c15d0e-5ae5-4341-b0cb-00364a0ed5db", "name": "network-vif-plugged", "status": "completed", "tag": "31f6fc3c-52d6-4a44-a39e-03725b8d1ab4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:41.035415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-812be8d9-12a4-4771-8b5a-314aab74aca4 req-b4428dde-8eff-4ec1-8cc4-6b3084b4ad93 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:41.035911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-812be8d9-12a4-4771-8b5a-314aab74aca4 req-b4428dde-8eff-4ec1-8cc4-6b3084b4ad93 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:41.036363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-812be8d9-12a4-4771-8b5a-314aab74aca4 req-b4428dde-8eff-4ec1-8cc4-6b3084b4ad93 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:41.049062 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-812be8d9-12a4-4771-8b5a-314aab74aca4 req-b4428dde-8eff-4ec1-8cc4-6b3084b4ad93 service nova] Creating event network-vif-plugged:31f6fc3c-52d6-4a44-a39e-03725b8d1ab4 for instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db on n-h1-844626-8 Aug 09 15:21:41.054191 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-812be8d9-12a4-4771-8b5a-314aab74aca4 req-b4428dde-8eff-4ec1-8cc4-6b3084b4ad93 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035081 Aug 09 15:21:41.054806 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3273/6556] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:21:41.177616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:21:41.178044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:21:41.178676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:21:41.179312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:21:41.179889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:21:41.191869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:41.192343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:41.192776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:41.193494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:41.193942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:41.194355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:41.211967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Getting quotas for project fae68a7680d94664ade9019f07e0ce7d. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:21:41.217396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Getting quotas for user 6f7f150d684747dcaed5b5d0a6b6922b and project fae68a7680d94664ade9019f07e0ce7d. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:21:41.230803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:21:41.233177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:21:41.278440 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a54dc33-8c1b-4b4d-8b3d-607e7a8509ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608796 Aug 09 15:21:41.279393 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3284/6557] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:21:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:21:41.290964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0a10adbb-3567-4680-938c-dbb1d57f2bfc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:41.291757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0a10adbb-3567-4680-938c-dbb1d57f2bfc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:41.351172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0a10adbb-3567-4680-938c-dbb1d57f2bfc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:41.359794 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0a10adbb-3567-4680-938c-dbb1d57f2bfc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1218 microversion: 2.1 time: 0.072367 Aug 09 15:21:41.360392 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3274/6558] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:41 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:42.382819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6c061244-8bd8-44c0-8778-33bb9884d889 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:42.383743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6c061244-8bd8-44c0-8778-33bb9884d889 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:42.393700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c061244-8bd8-44c0-8778-33bb9884d889 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:42.394953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c061244-8bd8-44c0-8778-33bb9884d889 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:42.396287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c061244-8bd8-44c0-8778-33bb9884d889 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:42.397115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c061244-8bd8-44c0-8778-33bb9884d889 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:42.397810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c061244-8bd8-44c0-8778-33bb9884d889 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:42.398500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6c061244-8bd8-44c0-8778-33bb9884d889 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:42.489478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6c061244-8bd8-44c0-8778-33bb9884d889 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:42.501193 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6c061244-8bd8-44c0-8778-33bb9884d889 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1278 microversion: 2.1 time: 0.123910 Aug 09 15:21:42.518494 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3285/6559] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:42 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1278 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:42.521714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-6b798cac-d8fe-49f9-944f-eb1e28dcc1fb req-5ba00f14-77c9-494b-8b15-c5491be5f091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c15d0e-5ae5-4341-b0cb-00364a0ed5db", "name": "network-vif-deleted", "tag": "31f6fc3c-52d6-4a44-a39e-03725b8d1ab4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:42.545853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6b798cac-d8fe-49f9-944f-eb1e28dcc1fb req-5ba00f14-77c9-494b-8b15-c5491be5f091 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:42.556127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6b798cac-d8fe-49f9-944f-eb1e28dcc1fb req-5ba00f14-77c9-494b-8b15-c5491be5f091 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:42.559730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6b798cac-d8fe-49f9-944f-eb1e28dcc1fb req-5ba00f14-77c9-494b-8b15-c5491be5f091 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:42.575538 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-6b798cac-d8fe-49f9-944f-eb1e28dcc1fb req-5ba00f14-77c9-494b-8b15-c5491be5f091 service nova] Creating event network-vif-deleted:31f6fc3c-52d6-4a44-a39e-03725b8d1ab4 for instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db on n-h1-844626-8 Aug 09 15:21:42.581269 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-6b798cac-d8fe-49f9-944f-eb1e28dcc1fb req-5ba00f14-77c9-494b-8b15-c5491be5f091 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063547 Aug 09 15:21:42.581992 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3275/6560] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:21:43.524830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dafc7fd4-2d2e-48b2-bc03-599a1e542b27 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:43.525450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dafc7fd4-2d2e-48b2-bc03-599a1e542b27 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:43.532290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dafc7fd4-2d2e-48b2-bc03-599a1e542b27 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:43.532766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dafc7fd4-2d2e-48b2-bc03-599a1e542b27 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:43.533200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dafc7fd4-2d2e-48b2-bc03-599a1e542b27 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:43.533885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dafc7fd4-2d2e-48b2-bc03-599a1e542b27 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:43.534392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dafc7fd4-2d2e-48b2-bc03-599a1e542b27 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:43.534747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dafc7fd4-2d2e-48b2-bc03-599a1e542b27 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:43.674659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dafc7fd4-2d2e-48b2-bc03-599a1e542b27 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:43.683375 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dafc7fd4-2d2e-48b2-bc03-599a1e542b27 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1318 microversion: 2.1 time: 0.162707 Aug 09 15:21:43.683965 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3286/6561] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:43 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:44.601493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-69f77c1f-4ca4-4c9d-9b3f-3200f20abec7 req-0abf2e82-9c4f-45f1-b518-33082c0161a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce83894b-6d51-4276-b336-c3582f1b2dbe", "tag": "f37a4c93-07b9-4692-b480-8b7bbe2eb6bf"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:44.614035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-69f77c1f-4ca4-4c9d-9b3f-3200f20abec7 req-0abf2e82-9c4f-45f1-b518-33082c0161a9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:44.614531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-69f77c1f-4ca4-4c9d-9b3f-3200f20abec7 req-0abf2e82-9c4f-45f1-b518-33082c0161a9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:44.614977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-69f77c1f-4ca4-4c9d-9b3f-3200f20abec7 req-0abf2e82-9c4f-45f1-b518-33082c0161a9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:44.627463 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-69f77c1f-4ca4-4c9d-9b3f-3200f20abec7 req-0abf2e82-9c4f-45f1-b518-33082c0161a9 service nova] Creating event network-changed:f37a4c93-07b9-4692-b480-8b7bbe2eb6bf for instance ce83894b-6d51-4276-b336-c3582f1b2dbe on n-h1-844626-8 Aug 09 15:21:44.632514 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-69f77c1f-4ca4-4c9d-9b3f-3200f20abec7 req-0abf2e82-9c4f-45f1-b518-33082c0161a9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037875 Aug 09 15:21:44.633123 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3276/6562] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:21:44.707680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-547f6687-372c-4e04-9a32-6aa7d1705179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:44.708310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-547f6687-372c-4e04-9a32-6aa7d1705179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:44.715586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-547f6687-372c-4e04-9a32-6aa7d1705179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:44.716068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-547f6687-372c-4e04-9a32-6aa7d1705179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:44.716506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-547f6687-372c-4e04-9a32-6aa7d1705179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:44.717197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-547f6687-372c-4e04-9a32-6aa7d1705179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:44.717644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-547f6687-372c-4e04-9a32-6aa7d1705179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:44.718061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-547f6687-372c-4e04-9a32-6aa7d1705179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:44.871483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-547f6687-372c-4e04-9a32-6aa7d1705179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:44.880355 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-547f6687-372c-4e04-9a32-6aa7d1705179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1318 microversion: 2.1 time: 0.177988 Aug 09 15:21:44.880938 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3287/6563] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:44 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:45.905505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7a38a608-9954-4263-a1b3-846ef61b320d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:45.906449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7a38a608-9954-4263-a1b3-846ef61b320d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:45.915347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a38a608-9954-4263-a1b3-846ef61b320d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:45.916019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a38a608-9954-4263-a1b3-846ef61b320d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:45.916631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a38a608-9954-4263-a1b3-846ef61b320d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:45.917566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a38a608-9954-4263-a1b3-846ef61b320d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:45.918205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a38a608-9954-4263-a1b3-846ef61b320d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:45.918800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7a38a608-9954-4263-a1b3-846ef61b320d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:46.056987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7a38a608-9954-4263-a1b3-846ef61b320d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:46.064805 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7a38a608-9954-4263-a1b3-846ef61b320d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1318 microversion: 2.1 time: 0.166355 Aug 09 15:21:46.065353 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3277/6564] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:45 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:47.089940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c30d790e-ec4d-4ef1-9062-5d4ee51a7c45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:47.090543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c30d790e-ec4d-4ef1-9062-5d4ee51a7c45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:47.097956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c30d790e-ec4d-4ef1-9062-5d4ee51a7c45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:47.098434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c30d790e-ec4d-4ef1-9062-5d4ee51a7c45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:47.098863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c30d790e-ec4d-4ef1-9062-5d4ee51a7c45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:47.099586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c30d790e-ec4d-4ef1-9062-5d4ee51a7c45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:47.100033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c30d790e-ec4d-4ef1-9062-5d4ee51a7c45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:47.100476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c30d790e-ec4d-4ef1-9062-5d4ee51a7c45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:47.247061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c30d790e-ec4d-4ef1-9062-5d4ee51a7c45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:47.255310 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c30d790e-ec4d-4ef1-9062-5d4ee51a7c45 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1318 microversion: 2.1 time: 0.169143 Aug 09 15:21:47.255848 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3288/6565] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:47 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:48.278223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52708b00-d8a8-4095-ab26-222ac369a405 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:48.279016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52708b00-d8a8-4095-ab26-222ac369a405 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:48.286480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52708b00-d8a8-4095-ab26-222ac369a405 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:48.286918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52708b00-d8a8-4095-ab26-222ac369a405 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:48.287393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52708b00-d8a8-4095-ab26-222ac369a405 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:48.288117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52708b00-d8a8-4095-ab26-222ac369a405 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:48.288608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52708b00-d8a8-4095-ab26-222ac369a405 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:48.289034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52708b00-d8a8-4095-ab26-222ac369a405 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:48.435538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-52708b00-d8a8-4095-ab26-222ac369a405 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:48.446570 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52708b00-d8a8-4095-ab26-222ac369a405 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1318 microversion: 2.1 time: 0.172423 Aug 09 15:21:48.447362 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3278/6566] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:48 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:49.109949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-59c4a35a-d33c-44a5-8c09-201c14cfec75 req-eaf6c45a-9dea-4595-b4dd-10171ea33ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce83894b-6d51-4276-b336-c3582f1b2dbe", "name": "network-vif-plugged", "status": "completed", "tag": "f37a4c93-07b9-4692-b480-8b7bbe2eb6bf"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:49.121433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-59c4a35a-d33c-44a5-8c09-201c14cfec75 req-eaf6c45a-9dea-4595-b4dd-10171ea33ece service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:49.122397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-59c4a35a-d33c-44a5-8c09-201c14cfec75 req-eaf6c45a-9dea-4595-b4dd-10171ea33ece service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:49.122702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-59c4a35a-d33c-44a5-8c09-201c14cfec75 req-eaf6c45a-9dea-4595-b4dd-10171ea33ece service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:49.134439 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-59c4a35a-d33c-44a5-8c09-201c14cfec75 req-eaf6c45a-9dea-4595-b4dd-10171ea33ece service nova] Creating event network-vif-plugged:f37a4c93-07b9-4692-b480-8b7bbe2eb6bf for instance ce83894b-6d51-4276-b336-c3582f1b2dbe on n-h1-844626-8 Aug 09 15:21:49.139504 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-59c4a35a-d33c-44a5-8c09-201c14cfec75 req-eaf6c45a-9dea-4595-b4dd-10171ea33ece service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034264 Aug 09 15:21:49.140103 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3289/6567] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:21:49.470099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f534fab6-91c3-484e-8eca-f581a64f0a21 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:49.470762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f534fab6-91c3-484e-8eca-f581a64f0a21 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:49.478086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f534fab6-91c3-484e-8eca-f581a64f0a21 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:49.478579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f534fab6-91c3-484e-8eca-f581a64f0a21 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:49.479033 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f534fab6-91c3-484e-8eca-f581a64f0a21 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:49.479777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f534fab6-91c3-484e-8eca-f581a64f0a21 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:49.480229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f534fab6-91c3-484e-8eca-f581a64f0a21 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:49.480633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f534fab6-91c3-484e-8eca-f581a64f0a21 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:49.622201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f534fab6-91c3-484e-8eca-f581a64f0a21 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:49.630310 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f534fab6-91c3-484e-8eca-f581a64f0a21 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1318 microversion: 2.1 time: 0.164363 Aug 09 15:21:49.631019 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3279/6568] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:49 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:50.653369 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f8307da3-fb67-426e-9171-6ae835cd0aa4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:50.654197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8307da3-fb67-426e-9171-6ae835cd0aa4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:50.661099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8307da3-fb67-426e-9171-6ae835cd0aa4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:50.661571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8307da3-fb67-426e-9171-6ae835cd0aa4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:50.661995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8307da3-fb67-426e-9171-6ae835cd0aa4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:50.662679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8307da3-fb67-426e-9171-6ae835cd0aa4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:50.663117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8307da3-fb67-426e-9171-6ae835cd0aa4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:50.663559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8307da3-fb67-426e-9171-6ae835cd0aa4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:50.813061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8307da3-fb67-426e-9171-6ae835cd0aa4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:50.821534 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f8307da3-fb67-426e-9171-6ae835cd0aa4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1508 microversion: 2.1 time: 0.173210 Aug 09 15:21:50.822026 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3290/6569] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:50 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:50.841818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d50e2eb-fca7-45f7-9e2e-87d0709473ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:50.842724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4d50e2eb-fca7-45f7-9e2e-87d0709473ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:50.850370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d50e2eb-fca7-45f7-9e2e-87d0709473ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:50.850985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d50e2eb-fca7-45f7-9e2e-87d0709473ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:50.852098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d50e2eb-fca7-45f7-9e2e-87d0709473ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:50.852098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d50e2eb-fca7-45f7-9e2e-87d0709473ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:50.852566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d50e2eb-fca7-45f7-9e2e-87d0709473ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:50.852995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d50e2eb-fca7-45f7-9e2e-87d0709473ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:50.992532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d50e2eb-fca7-45f7-9e2e-87d0709473ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:51.002307 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4d50e2eb-fca7-45f7-9e2e-87d0709473ce tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1508 microversion: 2.1 time: 0.164397 Aug 09 15:21:51.002863 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3280/6570] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:50 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:51.022785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:21:51.025252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:51.031670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:51.032152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:51.032577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:51.033277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:51.033720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:51.034137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:51.063308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:51.069233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Old instance type m1.heat2, new instance type m1.heat {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 15:21:51.075595 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:21:51.075935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:21:51.076411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:21:51.076810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:21:51.077217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:21:51.147847 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2d48b700-56cd-4e13-bf19-dea8a6db1660 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "POST /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe/action" status: 202 len: 0 microversion: 2.1 time: 0.128773 Aug 09 15:21:51.148509 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3291/6571] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:21:51 2022] POST /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:21:51.157103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03869d06-5df9-4541-8022-a761c60d54ed tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:51.157728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03869d06-5df9-4541-8022-a761c60d54ed tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:51.163837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03869d06-5df9-4541-8022-a761c60d54ed tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:51.164449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03869d06-5df9-4541-8022-a761c60d54ed tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:51.164772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03869d06-5df9-4541-8022-a761c60d54ed tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:51.165464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03869d06-5df9-4541-8022-a761c60d54ed tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:51.165957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03869d06-5df9-4541-8022-a761c60d54ed tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:51.166377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03869d06-5df9-4541-8022-a761c60d54ed tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:51.170674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:51.309772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-03869d06-5df9-4541-8022-a761c60d54ed tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:51.318362 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03869d06-5df9-4541-8022-a761c60d54ed tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1515 microversion: 2.1 time: 0.165226 Aug 09 15:21:51.318951 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3281/6572] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:51 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:52.339914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-57cadd63-fb1b-4dd0-966c-35813cad7dde tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:52.340587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-57cadd63-fb1b-4dd0-966c-35813cad7dde tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:52.342854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:52.343477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:52.351631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57cadd63-fb1b-4dd0-966c-35813cad7dde tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:52.352113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57cadd63-fb1b-4dd0-966c-35813cad7dde tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:52.352532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57cadd63-fb1b-4dd0-966c-35813cad7dde tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:52.353219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57cadd63-fb1b-4dd0-966c-35813cad7dde tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:52.353656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57cadd63-fb1b-4dd0-966c-35813cad7dde tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:52.354067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57cadd63-fb1b-4dd0-966c-35813cad7dde tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:52.496077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-57cadd63-fb1b-4dd0-966c-35813cad7dde tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:52.504151 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-57cadd63-fb1b-4dd0-966c-35813cad7dde tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1515 microversion: 2.1 time: 0.168477 Aug 09 15:21:52.504740 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3292/6573] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:52 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:53.528180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-814b2cd1-f411-4a1c-92cf-e358538a9bcb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:53.528783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-814b2cd1-f411-4a1c-92cf-e358538a9bcb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:53.531492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:53.542518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-814b2cd1-f411-4a1c-92cf-e358538a9bcb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:53.543249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-814b2cd1-f411-4a1c-92cf-e358538a9bcb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:53.543890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-814b2cd1-f411-4a1c-92cf-e358538a9bcb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:53.544988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-814b2cd1-f411-4a1c-92cf-e358538a9bcb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:53.545691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-814b2cd1-f411-4a1c-92cf-e358538a9bcb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:53.546302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-814b2cd1-f411-4a1c-92cf-e358538a9bcb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:53.691825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-814b2cd1-f411-4a1c-92cf-e358538a9bcb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:53.703742 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-814b2cd1-f411-4a1c-92cf-e358538a9bcb tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.181774 Aug 09 15:21:53.704334 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3282/6574] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:53 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:54.725117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3a0c84de-8003-4357-905d-15b11b14acf4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:54.725701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3a0c84de-8003-4357-905d-15b11b14acf4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:54.733570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a0c84de-8003-4357-905d-15b11b14acf4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:54.734102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a0c84de-8003-4357-905d-15b11b14acf4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:54.734535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a0c84de-8003-4357-905d-15b11b14acf4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:54.735699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a0c84de-8003-4357-905d-15b11b14acf4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:54.736205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a0c84de-8003-4357-905d-15b11b14acf4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:54.736701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3a0c84de-8003-4357-905d-15b11b14acf4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:54.752473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:21:54.897132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3a0c84de-8003-4357-905d-15b11b14acf4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:54.905074 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3a0c84de-8003-4357-905d-15b11b14acf4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.184017 Aug 09 15:21:54.905627 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3293/6575] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:54 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:55.926328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ae0362d5-a0d6-45f4-bb90-6d390a8327f6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:55.926899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ae0362d5-a0d6-45f4-bb90-6d390a8327f6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:55.934420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae0362d5-a0d6-45f4-bb90-6d390a8327f6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:55.934912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae0362d5-a0d6-45f4-bb90-6d390a8327f6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:55.935378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae0362d5-a0d6-45f4-bb90-6d390a8327f6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:55.936077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae0362d5-a0d6-45f4-bb90-6d390a8327f6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:55.936546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae0362d5-a0d6-45f4-bb90-6d390a8327f6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:55.936971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ae0362d5-a0d6-45f4-bb90-6d390a8327f6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:56.080579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ae0362d5-a0d6-45f4-bb90-6d390a8327f6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:56.091837 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ae0362d5-a0d6-45f4-bb90-6d390a8327f6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.169383 Aug 09 15:21:56.092622 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3283/6576] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:55 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:57.115678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-88ed6af9-e7ae-495b-8c93-6378e7a93d0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:57.116257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-88ed6af9-e7ae-495b-8c93-6378e7a93d0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:57.123943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88ed6af9-e7ae-495b-8c93-6378e7a93d0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:57.124409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88ed6af9-e7ae-495b-8c93-6378e7a93d0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:57.124833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88ed6af9-e7ae-495b-8c93-6378e7a93d0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:57.125521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88ed6af9-e7ae-495b-8c93-6378e7a93d0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:57.125967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88ed6af9-e7ae-495b-8c93-6378e7a93d0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:57.126378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-88ed6af9-e7ae-495b-8c93-6378e7a93d0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:57.273384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-88ed6af9-e7ae-495b-8c93-6378e7a93d0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:57.281640 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-88ed6af9-e7ae-495b-8c93-6378e7a93d0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.170148 Aug 09 15:21:57.282228 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3294/6577] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:57 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:58.304076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d166d32d-345e-45d6-b26d-1161c5ac95f1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:58.304673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d166d32d-345e-45d6-b26d-1161c5ac95f1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:58.312697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d166d32d-345e-45d6-b26d-1161c5ac95f1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:58.313282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d166d32d-345e-45d6-b26d-1161c5ac95f1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:58.313724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d166d32d-345e-45d6-b26d-1161c5ac95f1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:58.314453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d166d32d-345e-45d6-b26d-1161c5ac95f1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:58.314935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d166d32d-345e-45d6-b26d-1161c5ac95f1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:58.315355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d166d32d-345e-45d6-b26d-1161c5ac95f1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:58.464598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d166d32d-345e-45d6-b26d-1161c5ac95f1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:58.472390 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d166d32d-345e-45d6-b26d-1161c5ac95f1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.173383 Aug 09 15:21:58.473124 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3284/6578] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:58 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:21:59.494263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efe98ddf-68fb-40bf-aef4-070102c45ed7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:21:59.494823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-efe98ddf-68fb-40bf-aef4-070102c45ed7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:21:59.502103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efe98ddf-68fb-40bf-aef4-070102c45ed7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:59.502575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efe98ddf-68fb-40bf-aef4-070102c45ed7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:59.502999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efe98ddf-68fb-40bf-aef4-070102c45ed7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:59.503715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efe98ddf-68fb-40bf-aef4-070102c45ed7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:21:59.504152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efe98ddf-68fb-40bf-aef4-070102c45ed7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:21:59.504562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efe98ddf-68fb-40bf-aef4-070102c45ed7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:21:59.647756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-efe98ddf-68fb-40bf-aef4-070102c45ed7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:21:59.655726 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-efe98ddf-68fb-40bf-aef4-070102c45ed7 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.165403 Aug 09 15:21:59.656286 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3295/6579] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:21:59 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:00.676663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a88c3019-2b19-4fa6-9931-03a128c264af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:00.677221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a88c3019-2b19-4fa6-9931-03a128c264af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:00.684635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a88c3019-2b19-4fa6-9931-03a128c264af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:00.685122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a88c3019-2b19-4fa6-9931-03a128c264af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:00.685565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a88c3019-2b19-4fa6-9931-03a128c264af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:00.686263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a88c3019-2b19-4fa6-9931-03a128c264af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:00.686721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a88c3019-2b19-4fa6-9931-03a128c264af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:00.687154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a88c3019-2b19-4fa6-9931-03a128c264af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:00.829248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a88c3019-2b19-4fa6-9931-03a128c264af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:00.837696 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a88c3019-2b19-4fa6-9931-03a128c264af tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.165006 Aug 09 15:22:00.838288 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3285/6580] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:00 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:01.860673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e85f0dfd-e253-4403-9f0d-fb96fcf8a74e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:01.861251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e85f0dfd-e253-4403-9f0d-fb96fcf8a74e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:01.869435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e85f0dfd-e253-4403-9f0d-fb96fcf8a74e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:01.870060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e85f0dfd-e253-4403-9f0d-fb96fcf8a74e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:01.870651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e85f0dfd-e253-4403-9f0d-fb96fcf8a74e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:01.871678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e85f0dfd-e253-4403-9f0d-fb96fcf8a74e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:01.872309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e85f0dfd-e253-4403-9f0d-fb96fcf8a74e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:01.872901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e85f0dfd-e253-4403-9f0d-fb96fcf8a74e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:02.013963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e85f0dfd-e253-4403-9f0d-fb96fcf8a74e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:02.022440 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e85f0dfd-e253-4403-9f0d-fb96fcf8a74e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.165831 Aug 09 15:22:02.022888 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3296/6581] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:01 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:03.044424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0057c802-7c6b-486b-8ab4-1d0c0c409819 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:03.045052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0057c802-7c6b-486b-8ab4-1d0c0c409819 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:03.047937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:22:03.054550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0057c802-7c6b-486b-8ab4-1d0c0c409819 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:03.055294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0057c802-7c6b-486b-8ab4-1d0c0c409819 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:03.055737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0057c802-7c6b-486b-8ab4-1d0c0c409819 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:03.056462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0057c802-7c6b-486b-8ab4-1d0c0c409819 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:03.056924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0057c802-7c6b-486b-8ab4-1d0c0c409819 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:03.057357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0057c802-7c6b-486b-8ab4-1d0c0c409819 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:03.215733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0057c802-7c6b-486b-8ab4-1d0c0c409819 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:03.227421 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0057c802-7c6b-486b-8ab4-1d0c0c409819 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.186704 Aug 09 15:22:03.228235 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3286/6582] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:03 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:04.255066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c197e9c0-b171-41f4-84f2-3ce0f039fe53 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:04.255783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c197e9c0-b171-41f4-84f2-3ce0f039fe53 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:04.258824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:22:04.264922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c197e9c0-b171-41f4-84f2-3ce0f039fe53 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:04.265367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c197e9c0-b171-41f4-84f2-3ce0f039fe53 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:04.265834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c197e9c0-b171-41f4-84f2-3ce0f039fe53 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:04.266520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c197e9c0-b171-41f4-84f2-3ce0f039fe53 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:04.266946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c197e9c0-b171-41f4-84f2-3ce0f039fe53 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:04.267374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c197e9c0-b171-41f4-84f2-3ce0f039fe53 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:04.413313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c197e9c0-b171-41f4-84f2-3ce0f039fe53 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:04.421434 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c197e9c0-b171-41f4-84f2-3ce0f039fe53 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.172249 Aug 09 15:22:04.422009 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3297/6583] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:04 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:05.445462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-feae1de7-7544-4554-ab16-9678092e44e2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:05.446157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-feae1de7-7544-4554-ab16-9678092e44e2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:05.454113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feae1de7-7544-4554-ab16-9678092e44e2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:05.454675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feae1de7-7544-4554-ab16-9678092e44e2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:05.455348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feae1de7-7544-4554-ab16-9678092e44e2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:05.456061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feae1de7-7544-4554-ab16-9678092e44e2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:05.456521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feae1de7-7544-4554-ab16-9678092e44e2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:05.456968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-feae1de7-7544-4554-ab16-9678092e44e2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:05.604436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-feae1de7-7544-4554-ab16-9678092e44e2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:05.612925 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-feae1de7-7544-4554-ab16-9678092e44e2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.171561 Aug 09 15:22:05.613519 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3287/6584] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:05 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:06.634508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b70e72a0-a79a-4521-90c8-d9597cd1d264 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:06.635126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b70e72a0-a79a-4521-90c8-d9597cd1d264 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:06.642506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b70e72a0-a79a-4521-90c8-d9597cd1d264 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:06.642980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b70e72a0-a79a-4521-90c8-d9597cd1d264 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:06.643438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b70e72a0-a79a-4521-90c8-d9597cd1d264 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:06.644124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b70e72a0-a79a-4521-90c8-d9597cd1d264 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:06.644559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b70e72a0-a79a-4521-90c8-d9597cd1d264 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:06.645009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b70e72a0-a79a-4521-90c8-d9597cd1d264 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:06.782539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b70e72a0-a79a-4521-90c8-d9597cd1d264 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:06.790876 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b70e72a0-a79a-4521-90c8-d9597cd1d264 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.160405 Aug 09 15:22:06.791537 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3298/6585] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:06 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:07.736550 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:22:07.737143 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:22:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:22:07.813210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e2241efb-243c-4149-81e0-2e9c299e17d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:07.813824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e2241efb-243c-4149-81e0-2e9c299e17d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:07.820662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2241efb-243c-4149-81e0-2e9c299e17d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:07.821167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2241efb-243c-4149-81e0-2e9c299e17d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:07.821689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2241efb-243c-4149-81e0-2e9c299e17d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:07.822390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2241efb-243c-4149-81e0-2e9c299e17d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:07.822845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2241efb-243c-4149-81e0-2e9c299e17d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:07.823307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2241efb-243c-4149-81e0-2e9c299e17d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:07.962196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e2241efb-243c-4149-81e0-2e9c299e17d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:07.970578 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e2241efb-243c-4149-81e0-2e9c299e17d3 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.161439 Aug 09 15:22:07.971230 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3288/6586] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:07 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:08.991534 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-56dc7dca-b49b-4780-a61f-28383029ec0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:08.992142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-56dc7dca-b49b-4780-a61f-28383029ec0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:08.998983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56dc7dca-b49b-4780-a61f-28383029ec0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:08.999507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56dc7dca-b49b-4780-a61f-28383029ec0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:08.999935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56dc7dca-b49b-4780-a61f-28383029ec0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:09.000650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56dc7dca-b49b-4780-a61f-28383029ec0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:09.001102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56dc7dca-b49b-4780-a61f-28383029ec0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:09.001512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-56dc7dca-b49b-4780-a61f-28383029ec0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:09.134087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-56dc7dca-b49b-4780-a61f-28383029ec0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:09.142046 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-56dc7dca-b49b-4780-a61f-28383029ec0c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.154570 Aug 09 15:22:09.142605 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3299/6587] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:08 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:10.164484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0bb3427-4a3f-4270-992a-3f2129dacaa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:10.165129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0bb3427-4a3f-4270-992a-3f2129dacaa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:10.172748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0bb3427-4a3f-4270-992a-3f2129dacaa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:10.173225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0bb3427-4a3f-4270-992a-3f2129dacaa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:10.173704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0bb3427-4a3f-4270-992a-3f2129dacaa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:10.174420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0bb3427-4a3f-4270-992a-3f2129dacaa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:10.174882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0bb3427-4a3f-4270-992a-3f2129dacaa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:10.175354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0bb3427-4a3f-4270-992a-3f2129dacaa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:10.322277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0bb3427-4a3f-4270-992a-3f2129dacaa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:10.334228 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0bb3427-4a3f-4270-992a-3f2129dacaa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.173661 Aug 09 15:22:10.335105 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3289/6588] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:10 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:11.355704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-632df947-b5c6-4b37-b7cf-bfdd0bd1a442 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:11.356281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-632df947-b5c6-4b37-b7cf-bfdd0bd1a442 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:11.364043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-632df947-b5c6-4b37-b7cf-bfdd0bd1a442 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:11.364524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-632df947-b5c6-4b37-b7cf-bfdd0bd1a442 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:11.364954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-632df947-b5c6-4b37-b7cf-bfdd0bd1a442 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:11.365649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-632df947-b5c6-4b37-b7cf-bfdd0bd1a442 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:11.366098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-632df947-b5c6-4b37-b7cf-bfdd0bd1a442 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:11.366537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-632df947-b5c6-4b37-b7cf-bfdd0bd1a442 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:11.507409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-632df947-b5c6-4b37-b7cf-bfdd0bd1a442 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:11.518953 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-632df947-b5c6-4b37-b7cf-bfdd0bd1a442 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.166922 Aug 09 15:22:11.519960 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3300/6589] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:11 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:12.545655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3e271b1d-d7de-483a-ac3d-4dcbcfe89587 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:12.546464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3e271b1d-d7de-483a-ac3d-4dcbcfe89587 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:12.555289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e271b1d-d7de-483a-ac3d-4dcbcfe89587 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:12.555982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e271b1d-d7de-483a-ac3d-4dcbcfe89587 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:12.556628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e271b1d-d7de-483a-ac3d-4dcbcfe89587 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:12.557552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e271b1d-d7de-483a-ac3d-4dcbcfe89587 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:12.558017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e271b1d-d7de-483a-ac3d-4dcbcfe89587 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:12.558452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e271b1d-d7de-483a-ac3d-4dcbcfe89587 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:12.691758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3e271b1d-d7de-483a-ac3d-4dcbcfe89587 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:12.701571 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3e271b1d-d7de-483a-ac3d-4dcbcfe89587 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.162561 Aug 09 15:22:12.702186 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3290/6590] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:12 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:13.732532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5f88d588-6bc0-49da-813e-c1582ccd8f72 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:13.733505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5f88d588-6bc0-49da-813e-c1582ccd8f72 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:13.740454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f88d588-6bc0-49da-813e-c1582ccd8f72 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:13.740936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f88d588-6bc0-49da-813e-c1582ccd8f72 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:13.741353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f88d588-6bc0-49da-813e-c1582ccd8f72 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:13.742048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f88d588-6bc0-49da-813e-c1582ccd8f72 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:13.742491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f88d588-6bc0-49da-813e-c1582ccd8f72 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:13.742915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f88d588-6bc0-49da-813e-c1582ccd8f72 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:13.892138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5f88d588-6bc0-49da-813e-c1582ccd8f72 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:13.906131 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5f88d588-6bc0-49da-813e-c1582ccd8f72 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.174316 Aug 09 15:22:13.906131 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3301/6591] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:13 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:14.925167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1467afb2-3fb9-41a2-99e2-90d66a487179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:14.925785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1467afb2-3fb9-41a2-99e2-90d66a487179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:14.932958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1467afb2-3fb9-41a2-99e2-90d66a487179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:14.933455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1467afb2-3fb9-41a2-99e2-90d66a487179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:14.933902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1467afb2-3fb9-41a2-99e2-90d66a487179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:14.934606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1467afb2-3fb9-41a2-99e2-90d66a487179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:14.935065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1467afb2-3fb9-41a2-99e2-90d66a487179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:14.935541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1467afb2-3fb9-41a2-99e2-90d66a487179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:15.080155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1467afb2-3fb9-41a2-99e2-90d66a487179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:15.091871 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1467afb2-3fb9-41a2-99e2-90d66a487179 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.170360 Aug 09 15:22:15.092597 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3291/6592] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:14 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:16.118035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-133dfd8e-7e74-408e-90d6-8c0e766500ab tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:16.118711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-133dfd8e-7e74-408e-90d6-8c0e766500ab tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:16.126289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-133dfd8e-7e74-408e-90d6-8c0e766500ab tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:16.126770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-133dfd8e-7e74-408e-90d6-8c0e766500ab tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:16.127240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-133dfd8e-7e74-408e-90d6-8c0e766500ab tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:16.127939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-133dfd8e-7e74-408e-90d6-8c0e766500ab tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:16.128398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-133dfd8e-7e74-408e-90d6-8c0e766500ab tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:16.128819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-133dfd8e-7e74-408e-90d6-8c0e766500ab tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:16.263897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-133dfd8e-7e74-408e-90d6-8c0e766500ab tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:16.275205 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-133dfd8e-7e74-408e-90d6-8c0e766500ab tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.160878 Aug 09 15:22:16.276120 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3302/6593] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:16 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:17.297943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a8f0166-da07-4cd8-8a07-d6d78390748b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:17.298544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a8f0166-da07-4cd8-8a07-d6d78390748b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:17.304850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a8f0166-da07-4cd8-8a07-d6d78390748b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:17.305349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a8f0166-da07-4cd8-8a07-d6d78390748b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:17.305785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a8f0166-da07-4cd8-8a07-d6d78390748b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:17.306486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a8f0166-da07-4cd8-8a07-d6d78390748b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:17.306941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a8f0166-da07-4cd8-8a07-d6d78390748b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:17.307397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a8f0166-da07-4cd8-8a07-d6d78390748b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:17.452297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a8f0166-da07-4cd8-8a07-d6d78390748b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:17.464518 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a8f0166-da07-4cd8-8a07-d6d78390748b tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.171375 Aug 09 15:22:17.465370 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3292/6594] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:17 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:18.491934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f99e2a88-0326-4cde-b977-46f801c9345c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:18.492701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f99e2a88-0326-4cde-b977-46f801c9345c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:18.500622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f99e2a88-0326-4cde-b977-46f801c9345c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:18.501099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f99e2a88-0326-4cde-b977-46f801c9345c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:18.501531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f99e2a88-0326-4cde-b977-46f801c9345c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:18.502335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f99e2a88-0326-4cde-b977-46f801c9345c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:18.502664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f99e2a88-0326-4cde-b977-46f801c9345c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:18.503101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f99e2a88-0326-4cde-b977-46f801c9345c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:18.646488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f99e2a88-0326-4cde-b977-46f801c9345c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:18.658625 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f99e2a88-0326-4cde-b977-46f801c9345c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.170140 Aug 09 15:22:18.659299 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3303/6595] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:18 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:19.683365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-85d1114b-033f-40ed-ab15-f57271730d8c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:19.683965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-85d1114b-033f-40ed-ab15-f57271730d8c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:19.694331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85d1114b-033f-40ed-ab15-f57271730d8c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:19.694953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85d1114b-033f-40ed-ab15-f57271730d8c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:19.695558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85d1114b-033f-40ed-ab15-f57271730d8c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:19.696562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85d1114b-033f-40ed-ab15-f57271730d8c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:19.697174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85d1114b-033f-40ed-ab15-f57271730d8c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:19.697840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-85d1114b-033f-40ed-ab15-f57271730d8c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:19.840579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-85d1114b-033f-40ed-ab15-f57271730d8c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:19.848363 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-85d1114b-033f-40ed-ab15-f57271730d8c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1520 microversion: 2.1 time: 0.170975 Aug 09 15:22:19.848951 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3293/6596] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:19 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:20.774527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-27b3e410-b220-49f5-bc52-a9b0d4855ac4 req-2642138c-76ba-4004-b57f-4f328e276ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce83894b-6d51-4276-b336-c3582f1b2dbe", "name": "network-vif-unplugged", "status": "completed", "tag": "f37a4c93-07b9-4692-b480-8b7bbe2eb6bf"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:22:20.785661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-27b3e410-b220-49f5-bc52-a9b0d4855ac4 req-2642138c-76ba-4004-b57f-4f328e276ea3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:20.786795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-27b3e410-b220-49f5-bc52-a9b0d4855ac4 req-2642138c-76ba-4004-b57f-4f328e276ea3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:20.786795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-27b3e410-b220-49f5-bc52-a9b0d4855ac4 req-2642138c-76ba-4004-b57f-4f328e276ea3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:20.799811 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-27b3e410-b220-49f5-bc52-a9b0d4855ac4 req-2642138c-76ba-4004-b57f-4f328e276ea3 service nova] Creating event network-vif-unplugged:f37a4c93-07b9-4692-b480-8b7bbe2eb6bf for instance ce83894b-6d51-4276-b336-c3582f1b2dbe on n-h2-844626-8 Aug 09 15:22:20.805346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-27b3e410-b220-49f5-bc52-a9b0d4855ac4 req-2642138c-76ba-4004-b57f-4f328e276ea3 service nova] Instance ce83894b-6d51-4276-b336-c3582f1b2dbe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:22:20.816416 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-27b3e410-b220-49f5-bc52-a9b0d4855ac4 req-2642138c-76ba-4004-b57f-4f328e276ea3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045804 Aug 09 15:22:20.817038 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3304/6597] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:22:20.870388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a29b2790-bbb4-4712-bf3a-ed8d0203ca6d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:20.871222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a29b2790-bbb4-4712-bf3a-ed8d0203ca6d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:20.878604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29b2790-bbb4-4712-bf3a-ed8d0203ca6d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:20.879112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29b2790-bbb4-4712-bf3a-ed8d0203ca6d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:20.879575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29b2790-bbb4-4712-bf3a-ed8d0203ca6d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:20.880284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29b2790-bbb4-4712-bf3a-ed8d0203ca6d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:20.880766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29b2790-bbb4-4712-bf3a-ed8d0203ca6d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:20.881445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a29b2790-bbb4-4712-bf3a-ed8d0203ca6d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:21.075454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a29b2790-bbb4-4712-bf3a-ed8d0203ca6d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:21.084382 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a29b2790-bbb4-4712-bf3a-ed8d0203ca6d tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1519 microversion: 2.1 time: 0.218145 Aug 09 15:22:21.085336 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3294/6598] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:20 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:22.112214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f55d6287-eb96-4c2a-8fb5-43856693367e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:22.112819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f55d6287-eb96-4c2a-8fb5-43856693367e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:22.120190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f55d6287-eb96-4c2a-8fb5-43856693367e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:22.120661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f55d6287-eb96-4c2a-8fb5-43856693367e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:22.121087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f55d6287-eb96-4c2a-8fb5-43856693367e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:22.121758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f55d6287-eb96-4c2a-8fb5-43856693367e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:22.122201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f55d6287-eb96-4c2a-8fb5-43856693367e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:22.122717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f55d6287-eb96-4c2a-8fb5-43856693367e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:22.271028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f55d6287-eb96-4c2a-8fb5-43856693367e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:22.279545 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f55d6287-eb96-4c2a-8fb5-43856693367e tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1517 microversion: 2.1 time: 0.172194 Aug 09 15:22:22.280311 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3305/6599] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:22 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:22.843250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-36a9c3ed-3acd-4ed0-8f03-234cca8977ee req-42af69f1-b37b-4c7b-965b-4d3c818a4b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce83894b-6d51-4276-b336-c3582f1b2dbe", "tag": "f37a4c93-07b9-4692-b480-8b7bbe2eb6bf"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:22:22.853921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-36a9c3ed-3acd-4ed0-8f03-234cca8977ee req-42af69f1-b37b-4c7b-965b-4d3c818a4b60 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:22.854400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-36a9c3ed-3acd-4ed0-8f03-234cca8977ee req-42af69f1-b37b-4c7b-965b-4d3c818a4b60 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:22.854826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-36a9c3ed-3acd-4ed0-8f03-234cca8977ee req-42af69f1-b37b-4c7b-965b-4d3c818a4b60 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:22.857387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=83 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:22:22.867957 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-36a9c3ed-3acd-4ed0-8f03-234cca8977ee req-42af69f1-b37b-4c7b-965b-4d3c818a4b60 service nova] Creating event network-changed:f37a4c93-07b9-4692-b480-8b7bbe2eb6bf for instance ce83894b-6d51-4276-b336-c3582f1b2dbe on n-h2-844626-8 Aug 09 15:22:22.873684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-36a9c3ed-3acd-4ed0-8f03-234cca8977ee req-42af69f1-b37b-4c7b-965b-4d3c818a4b60 service nova] Instance ce83894b-6d51-4276-b336-c3582f1b2dbe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:22:22.884468 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-36a9c3ed-3acd-4ed0-8f03-234cca8977ee req-42af69f1-b37b-4c7b-965b-4d3c818a4b60 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047274 Aug 09 15:22:22.885081 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3295/6600] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:22:23.302271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e03286b-feff-42bf-90c7-1fdf0a7045e5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:23.303620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e03286b-feff-42bf-90c7-1fdf0a7045e5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:23.310612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e03286b-feff-42bf-90c7-1fdf0a7045e5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:23.310990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e03286b-feff-42bf-90c7-1fdf0a7045e5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:23.311455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e03286b-feff-42bf-90c7-1fdf0a7045e5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:23.312307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e03286b-feff-42bf-90c7-1fdf0a7045e5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:23.312826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e03286b-feff-42bf-90c7-1fdf0a7045e5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:23.313256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e03286b-feff-42bf-90c7-1fdf0a7045e5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:23.461443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e03286b-feff-42bf-90c7-1fdf0a7045e5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:23.474738 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e03286b-feff-42bf-90c7-1fdf0a7045e5 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1517 microversion: 2.1 time: 0.177118 Aug 09 15:22:23.483875 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3306/6601] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:23 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:24.502005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c28f729-2a2b-4a58-96f1-e3b35c1023d1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:24.502738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c28f729-2a2b-4a58-96f1-e3b35c1023d1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:24.509625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c28f729-2a2b-4a58-96f1-e3b35c1023d1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:24.510115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c28f729-2a2b-4a58-96f1-e3b35c1023d1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:24.510555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c28f729-2a2b-4a58-96f1-e3b35c1023d1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:24.511379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c28f729-2a2b-4a58-96f1-e3b35c1023d1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:24.511832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c28f729-2a2b-4a58-96f1-e3b35c1023d1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:24.512261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c28f729-2a2b-4a58-96f1-e3b35c1023d1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:24.663502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c28f729-2a2b-4a58-96f1-e3b35c1023d1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:24.671871 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c28f729-2a2b-4a58-96f1-e3b35c1023d1 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1514 microversion: 2.1 time: 0.175707 Aug 09 15:22:24.672462 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3296/6602] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:24 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:24.696204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-97f27493-2c57-4548-bec1-562deadadee2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:22:24.696756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-97f27493-2c57-4548-bec1-562deadadee2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:24.704923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97f27493-2c57-4548-bec1-562deadadee2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:24.705417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97f27493-2c57-4548-bec1-562deadadee2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:24.705844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97f27493-2c57-4548-bec1-562deadadee2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:24.706680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97f27493-2c57-4548-bec1-562deadadee2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:24.707213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97f27493-2c57-4548-bec1-562deadadee2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:24.707635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-97f27493-2c57-4548-bec1-562deadadee2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:24.773610 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-97f27493-2c57-4548-bec1-562deadadee2 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "POST /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe/action" status: 204 len: 0 microversion: 2.1 time: 0.084251 Aug 09 15:22:24.774182 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3307/6603] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:22:24 2022] POST /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:22:24.782588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31cbf59c-ef9d-49bc-9e82-acec81d97c4c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:24.783246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31cbf59c-ef9d-49bc-9e82-acec81d97c4c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:24.790769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31cbf59c-ef9d-49bc-9e82-acec81d97c4c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:24.790769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31cbf59c-ef9d-49bc-9e82-acec81d97c4c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:24.791191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31cbf59c-ef9d-49bc-9e82-acec81d97c4c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:24.791799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31cbf59c-ef9d-49bc-9e82-acec81d97c4c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:24.792227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31cbf59c-ef9d-49bc-9e82-acec81d97c4c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:24.792690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31cbf59c-ef9d-49bc-9e82-acec81d97c4c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:24.939796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-31cbf59c-ef9d-49bc-9e82-acec81d97c4c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:24.947822 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31cbf59c-ef9d-49bc-9e82-acec81d97c4c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1514 microversion: 2.1 time: 0.169165 Aug 09 15:22:24.948453 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3297/6604] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:24 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:25.785073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-1e8f2152-e9df-4a98-a5a4-de277a3d8b92 req-d2e3bbf3-3ade-42a2-814d-09d41efeea4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce83894b-6d51-4276-b336-c3582f1b2dbe", "name": "network-vif-plugged", "status": "completed", "tag": "f37a4c93-07b9-4692-b480-8b7bbe2eb6bf"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:22:25.795689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1e8f2152-e9df-4a98-a5a4-de277a3d8b92 req-d2e3bbf3-3ade-42a2-814d-09d41efeea4f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:25.796306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1e8f2152-e9df-4a98-a5a4-de277a3d8b92 req-d2e3bbf3-3ade-42a2-814d-09d41efeea4f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:25.796740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1e8f2152-e9df-4a98-a5a4-de277a3d8b92 req-d2e3bbf3-3ade-42a2-814d-09d41efeea4f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:25.801091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:22:25.811674 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1e8f2152-e9df-4a98-a5a4-de277a3d8b92 req-d2e3bbf3-3ade-42a2-814d-09d41efeea4f service nova] Creating event network-vif-plugged:f37a4c93-07b9-4692-b480-8b7bbe2eb6bf for instance ce83894b-6d51-4276-b336-c3582f1b2dbe on n-h2-844626-8 Aug 09 15:22:25.820275 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-1e8f2152-e9df-4a98-a5a4-de277a3d8b92 req-d2e3bbf3-3ade-42a2-814d-09d41efeea4f service nova] Instance ce83894b-6d51-4276-b336-c3582f1b2dbe is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:22:25.831574 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-1e8f2152-e9df-4a98-a5a4-de277a3d8b92 req-d2e3bbf3-3ade-42a2-814d-09d41efeea4f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051362 Aug 09 15:22:25.832438 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3308/6605] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:22:25.970769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31f595f2-b6e3-4a86-8885-b18a19d9f2cd tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:25.971436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31f595f2-b6e3-4a86-8885-b18a19d9f2cd tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:25.980936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31f595f2-b6e3-4a86-8885-b18a19d9f2cd tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:25.981669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31f595f2-b6e3-4a86-8885-b18a19d9f2cd tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:25.982283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31f595f2-b6e3-4a86-8885-b18a19d9f2cd tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:25.983674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31f595f2-b6e3-4a86-8885-b18a19d9f2cd tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:25.984349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31f595f2-b6e3-4a86-8885-b18a19d9f2cd tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:25.984966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31f595f2-b6e3-4a86-8885-b18a19d9f2cd tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:26.123259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-31f595f2-b6e3-4a86-8885-b18a19d9f2cd tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:26.133403 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31f595f2-b6e3-4a86-8885-b18a19d9f2cd tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1506 microversion: 2.1 time: 0.167747 Aug 09 15:22:26.134102 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3298/6606] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:25 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:26.162630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-131e7d71-3c4c-48d4-ab3f-34a85ffb6fa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:26.163303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-131e7d71-3c4c-48d4-ab3f-34a85ffb6fa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:26.170536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131e7d71-3c4c-48d4-ab3f-34a85ffb6fa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:26.171009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131e7d71-3c4c-48d4-ab3f-34a85ffb6fa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:26.171477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131e7d71-3c4c-48d4-ab3f-34a85ffb6fa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:26.172225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131e7d71-3c4c-48d4-ab3f-34a85ffb6fa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:26.172674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131e7d71-3c4c-48d4-ab3f-34a85ffb6fa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:26.173085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-131e7d71-3c4c-48d4-ab3f-34a85ffb6fa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:26.317590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-131e7d71-3c4c-48d4-ab3f-34a85ffb6fa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:26.329352 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-131e7d71-3c4c-48d4-ab3f-34a85ffb6fa8 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1506 microversion: 2.1 time: 0.171044 Aug 09 15:22:26.330200 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3309/6607] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:26 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:26.355619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-580d4762-2219-48ef-9881-425849e411f4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:26.356201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-580d4762-2219-48ef-9881-425849e411f4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:26.363035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-580d4762-2219-48ef-9881-425849e411f4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:26.363562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-580d4762-2219-48ef-9881-425849e411f4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:26.364003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-580d4762-2219-48ef-9881-425849e411f4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:26.364700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-580d4762-2219-48ef-9881-425849e411f4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:26.365152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-580d4762-2219-48ef-9881-425849e411f4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:26.365580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-580d4762-2219-48ef-9881-425849e411f4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:26.506951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-580d4762-2219-48ef-9881-425849e411f4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:26.517689 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-580d4762-2219-48ef-9881-425849e411f4 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1506 microversion: 2.1 time: 0.165963 Aug 09 15:22:26.518278 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3299/6608] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:26 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:26.538046 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4d7635f-c406-47fa-9b96-9a1dd273742c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:26.538543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4d7635f-c406-47fa-9b96-9a1dd273742c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:26.544939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4d7635f-c406-47fa-9b96-9a1dd273742c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:26.545421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4d7635f-c406-47fa-9b96-9a1dd273742c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:26.545929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4d7635f-c406-47fa-9b96-9a1dd273742c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:26.546597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4d7635f-c406-47fa-9b96-9a1dd273742c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:26.547045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4d7635f-c406-47fa-9b96-9a1dd273742c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:26.547499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4d7635f-c406-47fa-9b96-9a1dd273742c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:26.574080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4d7635f-c406-47fa-9b96-9a1dd273742c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:22:26.654328 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4d7635f-c406-47fa-9b96-9a1dd273742c tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 204 len: 0 microversion: 2.1 time: 0.119930 Aug 09 15:22:26.654941 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3310/6609] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:22:26 2022] DELETE /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:22:26.671590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-31a9787d-a042-4a88-a4fd-ac47b090c89a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:26.672091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31a9787d-a042-4a88-a4fd-ac47b090c89a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:26.678905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31a9787d-a042-4a88-a4fd-ac47b090c89a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:26.679431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31a9787d-a042-4a88-a4fd-ac47b090c89a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:26.679873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31a9787d-a042-4a88-a4fd-ac47b090c89a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:26.680587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31a9787d-a042-4a88-a4fd-ac47b090c89a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:26.681024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31a9787d-a042-4a88-a4fd-ac47b090c89a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:26.681452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-31a9787d-a042-4a88-a4fd-ac47b090c89a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:26.707162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-31a9787d-a042-4a88-a4fd-ac47b090c89a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:22:26.752493 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.compute.api [None req-31a9787d-a042-4a88-a4fd-ac47b090c89a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Instance is already in deleting state, ignoring this request Aug 09 15:22:26.753346 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-31a9787d-a042-4a88-a4fd-ac47b090c89a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 204 len: 0 microversion: 2.1 time: 0.085908 Aug 09 15:22:26.753927 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3300/6610] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:22:26 2022] DELETE /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:22:26.762689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-419f030c-eb73-4bd2-9161-f0189f6daab6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:26.763416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-419f030c-eb73-4bd2-9161-f0189f6daab6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:26.770049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-419f030c-eb73-4bd2-9161-f0189f6daab6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:26.770514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-419f030c-eb73-4bd2-9161-f0189f6daab6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:26.770946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-419f030c-eb73-4bd2-9161-f0189f6daab6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:26.771656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-419f030c-eb73-4bd2-9161-f0189f6daab6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:26.772183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-419f030c-eb73-4bd2-9161-f0189f6daab6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:26.772600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-419f030c-eb73-4bd2-9161-f0189f6daab6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:26.937452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-419f030c-eb73-4bd2-9161-f0189f6daab6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:26.945490 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-419f030c-eb73-4bd2-9161-f0189f6daab6 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1512 microversion: 2.1 time: 0.187081 Aug 09 15:22:26.946077 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3311/6611] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:26 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:27.969712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-556e979b-9b89-4185-b0ee-f5995dcdb33a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:27.970294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-556e979b-9b89-4185-b0ee-f5995dcdb33a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:27.980517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-556e979b-9b89-4185-b0ee-f5995dcdb33a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:27.981225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-556e979b-9b89-4185-b0ee-f5995dcdb33a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:27.981874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-556e979b-9b89-4185-b0ee-f5995dcdb33a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:27.983203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-556e979b-9b89-4185-b0ee-f5995dcdb33a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:27.983822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-556e979b-9b89-4185-b0ee-f5995dcdb33a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:27.984238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-556e979b-9b89-4185-b0ee-f5995dcdb33a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:28.118993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-556e979b-9b89-4185-b0ee-f5995dcdb33a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7f150d684747dcaed5b5d0a6b6922b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae68a7680d94664ade9019f07e0ce7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:28.127212 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-556e979b-9b89-4185-b0ee-f5995dcdb33a tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 200 len: 1512 microversion: 2.1 time: 0.163722 Aug 09 15:22:28.127811 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3301/6612] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:27 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:28.601985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-1da2f925-475f-4dfc-b436-947e7b54d332 req-bee0d1f6-61d1-46b6-883b-42ff81de8db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce83894b-6d51-4276-b336-c3582f1b2dbe", "name": "network-vif-deleted", "tag": "f37a4c93-07b9-4692-b480-8b7bbe2eb6bf"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:22:28.616081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1da2f925-475f-4dfc-b436-947e7b54d332 req-bee0d1f6-61d1-46b6-883b-42ff81de8db1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:28.616463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1da2f925-475f-4dfc-b436-947e7b54d332 req-bee0d1f6-61d1-46b6-883b-42ff81de8db1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:28.616886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1da2f925-475f-4dfc-b436-947e7b54d332 req-bee0d1f6-61d1-46b6-883b-42ff81de8db1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:28.629027 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1da2f925-475f-4dfc-b436-947e7b54d332 req-bee0d1f6-61d1-46b6-883b-42ff81de8db1 service nova] Creating event network-vif-deleted:f37a4c93-07b9-4692-b480-8b7bbe2eb6bf for instance ce83894b-6d51-4276-b336-c3582f1b2dbe on n-h2-844626-8 Aug 09 15:22:28.635033 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-1da2f925-475f-4dfc-b436-947e7b54d332 req-bee0d1f6-61d1-46b6-883b-42ff81de8db1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036913 Aug 09 15:22:28.635680 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3312/6613] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:22:29.153028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9c14b65-5488-4052-8dfd-f345928494fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:29.153553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f9c14b65-5488-4052-8dfd-f345928494fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: ce83894b-6d51-4276-b336-c3582f1b2dbe] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:29.161527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9c14b65-5488-4052-8dfd-f345928494fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:29.162018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9c14b65-5488-4052-8dfd-f345928494fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:29.162464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9c14b65-5488-4052-8dfd-f345928494fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:29.163195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9c14b65-5488-4052-8dfd-f345928494fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:29.163663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9c14b65-5488-4052-8dfd-f345928494fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:29.164091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9c14b65-5488-4052-8dfd-f345928494fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:29.178491 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-f9c14b65-5488-4052-8dfd-f345928494fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] HTTP exception thrown: Instance ce83894b-6d51-4276-b336-c3582f1b2dbe could not be found. Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9c14b65-5488-4052-8dfd-f345928494fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Request method failure captured: Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe HTTP/1.1 Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8ntU21-8-_AgMLABsf0zgNeau-Zrko_jkeyIVvxVtwh--UKy1-pVYs5AXs0SXpoYHVdf78nLKUvC3Ff69-fPHCVWOKN1gLw8YsTcUpip7WpAtSYGhnFJAix5jh0BKh2waX8r5ff-TIBfPL4QCcSLIo7Y2MBWRsRyZfChcwYCE83o-lA Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: fae68a7680d94664ade9019f07e0ce7d Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1277642901 Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fae68a7680d94664ade9019f07e0ce7d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fae68a7680d94664ade9019f07e0ce7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fae68a7680d94664ade9019f07e0ce7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fae68a7680d94664ade9019f07e0ce7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerDiskConfigTestJSON-1277642901 Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: fae68a7680d94664ade9019f07e0ce7d Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1277642901 Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerDiskConfigTestJSON-1277642901-project Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 6f7f150d684747dcaed5b5d0a6b6922b Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerDiskConfigTestJSON-1277642901-project Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance ce83894b-6d51-4276-b336-c3582f1b2dbe could not be found. Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'ce83894b-6d51-4276-b336-c3582f1b2dbe'} Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce83894b-6d51-4276-b336-c3582f1b2dbe could not be found. Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce83894b-6d51-4276-b336-c3582f1b2dbe could not be found. Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:22:29.180259 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.183929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:22:29.183929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:22:29.183929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:22:29.183929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:22:29.183929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:22:29.183929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce83894b-6d51-4276-b336-c3582f1b2dbe could not be found. Aug 09 15:22:29.183929 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.183929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9c14b65-5488-4052-8dfd-f345928494fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Returning 404 to user: Instance ce83894b-6d51-4276-b336-c3582f1b2dbe could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:22:29.183929 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f9c14b65-5488-4052-8dfd-f345928494fc tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe" status: 404 len: 111 microversion: 2.1 time: 0.035401 Aug 09 15:22:29.183929 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3302/6614] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:29 2022] GET /compute/v2.1/servers/ce83894b-6d51-4276-b336-c3582f1b2dbe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:22:29.191763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f4d6b9d9-6fda-4daa-a1d8-8cad9e404671 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '.version_select at 0x7f41dc51e940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:29.219800 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f4d6b9d9-6fda-4daa-a1d8-8cad9e404671 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494953479" status: 202 len: 0 microversion: 2.1 time: 0.032416 Aug 09 15:22:29.220611 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3313/6615] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 15:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494953479 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:22:29.896594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9fb3f6ce-6730-4d45-b6dd-3583bc1513a0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:29.897269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9fb3f6ce-6730-4d45-b6dd-3583bc1513a0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:29.906687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb3f6ce-6730-4d45-b6dd-3583bc1513a0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:29.907349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb3f6ce-6730-4d45-b6dd-3583bc1513a0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:29.907796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb3f6ce-6730-4d45-b6dd-3583bc1513a0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:29.908498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb3f6ce-6730-4d45-b6dd-3583bc1513a0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:29.908958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb3f6ce-6730-4d45-b6dd-3583bc1513a0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:29.909420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9fb3f6ce-6730-4d45-b6dd-3583bc1513a0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:29.923655 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-9fb3f6ce-6730-4d45-b6dd-3583bc1513a0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] HTTP exception thrown: Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db could not be found. Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9fb3f6ce-6730-4d45-b6dd-3583bc1513a0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Request method failure captured: Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db HTTP/1.1 Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8ntU21-8-_AgMLABsf0zgNeau-Zrko_jkeyIVvxVtwh--UKy1-pVYs5AXs0SXpoYHVdf78nLKUvC3Ff69-fPHCVWOKN1gLw8YsTcUpip7WpAtSYGhnFJAix5jh0BKh2waX8r5ff-TIBfPL4QCcSLIo7Y2MBWRsRyZfChcwYCE83o-lA Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: fae68a7680d94664ade9019f07e0ce7d Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1277642901 Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fae68a7680d94664ade9019f07e0ce7d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fae68a7680d94664ade9019f07e0ce7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fae68a7680d94664ade9019f07e0ce7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fae68a7680d94664ade9019f07e0ce7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerDiskConfigTestJSON-1277642901 Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: fae68a7680d94664ade9019f07e0ce7d Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1277642901 Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerDiskConfigTestJSON-1277642901-project Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 6f7f150d684747dcaed5b5d0a6b6922b Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerDiskConfigTestJSON-1277642901-project Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db could not be found. Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'd5c15d0e-5ae5-4341-b0cb-00364a0ed5db'} Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db could not be found. Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:22:29.925242 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db could not be found. Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db could not be found. Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9fb3f6ce-6730-4d45-b6dd-3583bc1513a0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Returning 404 to user: Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9fb3f6ce-6730-4d45-b6dd-3583bc1513a0 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 404 len: 111 microversion: 2.1 time: 0.036313 Aug 09 15:22:29.928479 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3303/6616] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:22:29 2022] DELETE /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:22:29.935802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f1f8296-0d82-4da4-b670-8265026f7410 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:29.936870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f1f8296-0d82-4da4-b670-8265026f7410 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] [instance: d5c15d0e-5ae5-4341-b0cb-00364a0ed5db] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:29.948237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f1f8296-0d82-4da4-b670-8265026f7410 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:29.948719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f1f8296-0d82-4da4-b670-8265026f7410 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:29.949148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f1f8296-0d82-4da4-b670-8265026f7410 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:29.949843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f1f8296-0d82-4da4-b670-8265026f7410 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:29.950283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f1f8296-0d82-4da4-b670-8265026f7410 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:29.950699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f1f8296-0d82-4da4-b670-8265026f7410 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:29.965948 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-4f1f8296-0d82-4da4-b670-8265026f7410 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] HTTP exception thrown: Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db could not be found. Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f1f8296-0d82-4da4-b670-8265026f7410 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Request method failure captured: Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db HTTP/1.1 Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8ntU21-8-_AgMLABsf0zgNeau-Zrko_jkeyIVvxVtwh--UKy1-pVYs5AXs0SXpoYHVdf78nLKUvC3Ff69-fPHCVWOKN1gLw8YsTcUpip7WpAtSYGhnFJAix5jh0BKh2waX8r5ff-TIBfPL4QCcSLIo7Y2MBWRsRyZfChcwYCE83o-lA Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: fae68a7680d94664ade9019f07e0ce7d Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1277642901 Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fae68a7680d94664ade9019f07e0ce7d", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fae68a7680d94664ade9019f07e0ce7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fae68a7680d94664ade9019f07e0ce7d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fae68a7680d94664ade9019f07e0ce7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerDiskConfigTestJSON-1277642901 Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: fae68a7680d94664ade9019f07e0ce7d Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1277642901 Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerDiskConfigTestJSON-1277642901-project Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 6f7f150d684747dcaed5b5d0a6b6922b Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerDiskConfigTestJSON-1277642901-project Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db could not be found. Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'd5c15d0e-5ae5-4341-b0cb-00364a0ed5db'} Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db could not be found. Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db could not be found. Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:22:29.967834 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.971131 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:22:29.971131 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:22:29.971131 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:22:29.971131 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:22:29.971131 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:22:29.971131 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db could not be found. Aug 09 15:22:29.971131 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:22:29.971131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f1f8296-0d82-4da4-b670-8265026f7410 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] Returning 404 to user: Instance d5c15d0e-5ae5-4341-b0cb-00364a0ed5db could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:22:29.971131 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4f1f8296-0d82-4da4-b670-8265026f7410 tempest-ServerDiskConfigTestJSON-1277642901 tempest-ServerDiskConfigTestJSON-1277642901-project] 10.222.0.50 "GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db" status: 404 len: 111 microversion: 2.1 time: 0.037513 Aug 09 15:22:29.971131 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3314/6617] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:29 2022] GET /compute/v2.1/servers/d5c15d0e-5ae5-4341-b0cb-00364a0ed5db => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:22:38.984215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a7b38cf-fcb8-4c90-bf95-e15471b68ecf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'create', calling method: .version_select at 0x7f41dd18adc0>, body: {"keypair": {"name": "tempest-keypair-1527801048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDrld5WHtzV8tBXexlztRvHuNvkxc8nmJsKYxGtm5IEMVq5pLOqYE9Xf0KqWD2+9D+iq1aeyEzVSpAeW4frykilI33EEpYfIDl+B6n7Ea6xZJyGoScrvfuotLMeW9rrDA=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:22:38.991767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=36 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:22:39.002663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-4a7b38cf-fcb8-4c90-bf95-e15471b68ecf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:22:39.008319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-4a7b38cf-fcb8-4c90-bf95-e15471b68ecf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for user 127998e24ecf48d58f3c789530f89898 and project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:22:39.036052 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a7b38cf-fcb8-4c90-bf95-e15471b68ecf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.190357 Aug 09 15:22:39.037132 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3304/6618] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:22:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:22:40.674231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1492345848", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "38bb04fc-70f1-41b1-aef0-d31c411f18a0"}], "security_groups": [{"name": "tempest-securitygroup--1420965144"}], "key_name": "tempest-keypair-1527801048", "user_data": "}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:22:40.683599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:22:40.684261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:22:40.796207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] validate_networks() for [('38bb04fc-70f1-41b1-aef0-d31c411f18a0', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:22:41.186672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:22:41.186672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:22:41.187119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:22:41.187611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:22:41.188009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:22:41.197137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:41.197628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:41.198055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:41.198749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:41.199232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:41.199647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:41.217772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:22:41.223391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for user 127998e24ecf48d58f3c789530f89898 and project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:22:41.236742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:22:41.239072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:22:41.288027 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bea9cac6-6464-48ee-9ec5-449167373db1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.618124 Aug 09 15:22:41.288916 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3315/6619] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:22:40 2022] POST /compute/v2.1/servers => generated 409 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:22:41.298408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:22:41.304542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8a9b0ab0-21af-4590-9ee0-6a04732e442e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:41.305457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8a9b0ab0-21af-4590-9ee0-6a04732e442e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:41.384833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8a9b0ab0-21af-4590-9ee0-6a04732e442e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:41.392234 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8a9b0ab0-21af-4590-9ee0-6a04732e442e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1239 microversion: 2.1 time: 0.095616 Aug 09 15:22:41.399424 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3305/6620] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:41 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1239 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:42.414161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-38e80c77-3080-46df-af8a-3fae472f5f0e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:42.414761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-38e80c77-3080-46df-af8a-3fae472f5f0e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:42.421747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38e80c77-3080-46df-af8a-3fae472f5f0e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:42.422328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38e80c77-3080-46df-af8a-3fae472f5f0e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:42.422840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38e80c77-3080-46df-af8a-3fae472f5f0e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:42.423651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38e80c77-3080-46df-af8a-3fae472f5f0e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:42.424175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38e80c77-3080-46df-af8a-3fae472f5f0e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:42.424688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38e80c77-3080-46df-af8a-3fae472f5f0e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:42.523570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-38e80c77-3080-46df-af8a-3fae472f5f0e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:42.532461 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-38e80c77-3080-46df-af8a-3fae472f5f0e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1299 microversion: 2.1 time: 0.123127 Aug 09 15:22:42.533057 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3316/6621] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:42 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:43.553246 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e728bb20-796a-484b-b505-e7d678326a62 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:43.553890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e728bb20-796a-484b-b505-e7d678326a62 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:43.561339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e728bb20-796a-484b-b505-e7d678326a62 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:43.561846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e728bb20-796a-484b-b505-e7d678326a62 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:43.562300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e728bb20-796a-484b-b505-e7d678326a62 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:43.563016 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e728bb20-796a-484b-b505-e7d678326a62 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:43.563679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e728bb20-796a-484b-b505-e7d678326a62 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:43.564387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e728bb20-796a-484b-b505-e7d678326a62 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:43.804857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e728bb20-796a-484b-b505-e7d678326a62 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:43.813082 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e728bb20-796a-484b-b505-e7d678326a62 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1365 microversion: 2.1 time: 0.263786 Aug 09 15:22:43.813703 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3306/6622] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:43 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:43.950204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2814db5f-5a7c-4454-8f7f-6c29bf2fc292 req-8cf9a1f9-21a1-4b88-bf0e-0ad6f17dd94e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d291a54c-7210-4be5-b760-6157ac99ca9f", "tag": "42231790-f1df-4f5b-8a88-7754180b414a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:22:43.961859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2814db5f-5a7c-4454-8f7f-6c29bf2fc292 req-8cf9a1f9-21a1-4b88-bf0e-0ad6f17dd94e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:43.962351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2814db5f-5a7c-4454-8f7f-6c29bf2fc292 req-8cf9a1f9-21a1-4b88-bf0e-0ad6f17dd94e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:43.962830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2814db5f-5a7c-4454-8f7f-6c29bf2fc292 req-8cf9a1f9-21a1-4b88-bf0e-0ad6f17dd94e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:43.976427 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2814db5f-5a7c-4454-8f7f-6c29bf2fc292 req-8cf9a1f9-21a1-4b88-bf0e-0ad6f17dd94e service nova] Creating event network-changed:42231790-f1df-4f5b-8a88-7754180b414a for instance d291a54c-7210-4be5-b760-6157ac99ca9f on n-h2-844626-8 Aug 09 15:22:43.981586 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2814db5f-5a7c-4454-8f7f-6c29bf2fc292 req-8cf9a1f9-21a1-4b88-bf0e-0ad6f17dd94e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035080 Aug 09 15:22:43.983037 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3317/6623] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:22:44.840082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-59edc237-bf9d-42c5-be3c-33c8414a3e43 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:44.840761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-59edc237-bf9d-42c5-be3c-33c8414a3e43 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:44.848442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59edc237-bf9d-42c5-be3c-33c8414a3e43 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:44.848936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59edc237-bf9d-42c5-be3c-33c8414a3e43 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:44.849377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59edc237-bf9d-42c5-be3c-33c8414a3e43 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:44.850078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59edc237-bf9d-42c5-be3c-33c8414a3e43 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:44.850535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59edc237-bf9d-42c5-be3c-33c8414a3e43 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:44.850962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-59edc237-bf9d-42c5-be3c-33c8414a3e43 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:44.994673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-59edc237-bf9d-42c5-be3c-33c8414a3e43 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:45.002475 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-59edc237-bf9d-42c5-be3c-33c8414a3e43 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1365 microversion: 2.1 time: 0.166998 Aug 09 15:22:45.003070 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3307/6624] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:44 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:46.025589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f6b7d2b3-f23c-4522-bb91-4d09d230b855 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:46.026297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f6b7d2b3-f23c-4522-bb91-4d09d230b855 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:46.033849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6b7d2b3-f23c-4522-bb91-4d09d230b855 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:46.034446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6b7d2b3-f23c-4522-bb91-4d09d230b855 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:46.035018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6b7d2b3-f23c-4522-bb91-4d09d230b855 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:46.036075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6b7d2b3-f23c-4522-bb91-4d09d230b855 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:46.036663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6b7d2b3-f23c-4522-bb91-4d09d230b855 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:46.037218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6b7d2b3-f23c-4522-bb91-4d09d230b855 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:46.205253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f6b7d2b3-f23c-4522-bb91-4d09d230b855 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:46.212898 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f6b7d2b3-f23c-4522-bb91-4d09d230b855 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1365 microversion: 2.1 time: 0.193074 Aug 09 15:22:46.213600 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3318/6625] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:46 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:47.234703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8e7ed684-18a6-41b2-998e-4a8e20e034ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:47.235364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8e7ed684-18a6-41b2-998e-4a8e20e034ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:47.243043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e7ed684-18a6-41b2-998e-4a8e20e034ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:47.243556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e7ed684-18a6-41b2-998e-4a8e20e034ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:47.244029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e7ed684-18a6-41b2-998e-4a8e20e034ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:47.244734 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e7ed684-18a6-41b2-998e-4a8e20e034ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:47.245204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e7ed684-18a6-41b2-998e-4a8e20e034ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:47.245661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8e7ed684-18a6-41b2-998e-4a8e20e034ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:47.377762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8e7ed684-18a6-41b2-998e-4a8e20e034ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:47.388227 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8e7ed684-18a6-41b2-998e-4a8e20e034ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1365 microversion: 2.1 time: 0.157655 Aug 09 15:22:47.388820 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3308/6626] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:47 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:47.860394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-abb8862f-f4ec-414a-8f9f-9af4d936935a req-16de092b-5797-44c0-b966-42d6c9d63cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d291a54c-7210-4be5-b760-6157ac99ca9f", "name": "network-vif-plugged", "status": "completed", "tag": "42231790-f1df-4f5b-8a88-7754180b414a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:22:47.871427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-abb8862f-f4ec-414a-8f9f-9af4d936935a req-16de092b-5797-44c0-b966-42d6c9d63cf9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:47.871913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-abb8862f-f4ec-414a-8f9f-9af4d936935a req-16de092b-5797-44c0-b966-42d6c9d63cf9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:47.872527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-abb8862f-f4ec-414a-8f9f-9af4d936935a req-16de092b-5797-44c0-b966-42d6c9d63cf9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:47.884321 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-abb8862f-f4ec-414a-8f9f-9af4d936935a req-16de092b-5797-44c0-b966-42d6c9d63cf9 service nova] Creating event network-vif-plugged:42231790-f1df-4f5b-8a88-7754180b414a for instance d291a54c-7210-4be5-b760-6157ac99ca9f on n-h2-844626-8 Aug 09 15:22:47.889241 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-abb8862f-f4ec-414a-8f9f-9af4d936935a req-16de092b-5797-44c0-b966-42d6c9d63cf9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033152 Aug 09 15:22:47.889843 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3319/6627] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:22:48.409854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d5a880e-e5fb-4208-be35-a7b61c38450c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:48.410479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d5a880e-e5fb-4208-be35-a7b61c38450c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:48.417926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d5a880e-e5fb-4208-be35-a7b61c38450c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:48.418428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d5a880e-e5fb-4208-be35-a7b61c38450c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:48.418875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d5a880e-e5fb-4208-be35-a7b61c38450c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:48.419623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d5a880e-e5fb-4208-be35-a7b61c38450c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:48.420094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d5a880e-e5fb-4208-be35-a7b61c38450c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:48.420523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d5a880e-e5fb-4208-be35-a7b61c38450c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:48.556697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6d5a880e-e5fb-4208-be35-a7b61c38450c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:48.565085 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d5a880e-e5fb-4208-be35-a7b61c38450c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1365 microversion: 2.1 time: 0.159205 Aug 09 15:22:48.565674 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3309/6628] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:48 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:49.594858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-02255fff-0562-4244-acf4-4661b88622dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:49.595633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-02255fff-0562-4244-acf4-4661b88622dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:49.602530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02255fff-0562-4244-acf4-4661b88622dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:49.603015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02255fff-0562-4244-acf4-4661b88622dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:49.603480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02255fff-0562-4244-acf4-4661b88622dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:49.604178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02255fff-0562-4244-acf4-4661b88622dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:49.604627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02255fff-0562-4244-acf4-4661b88622dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:49.605047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-02255fff-0562-4244-acf4-4661b88622dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:49.750789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-02255fff-0562-4244-acf4-4661b88622dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:22:49.760320 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-02255fff-0562-4244-acf4-4661b88622dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1552 microversion: 2.1 time: 0.170596 Aug 09 15:22:49.761003 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3320/6629] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:22:49 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:22:49.783111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d252e0b-9bf6-4a7a-8e59-77f26c810f6a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:22:49.783748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d252e0b-9bf6-4a7a-8e59-77f26c810f6a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:22:49.791274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d252e0b-9bf6-4a7a-8e59-77f26c810f6a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:49.791815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d252e0b-9bf6-4a7a-8e59-77f26c810f6a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:49.792236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d252e0b-9bf6-4a7a-8e59-77f26c810f6a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:49.792938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d252e0b-9bf6-4a7a-8e59-77f26c810f6a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:49.793393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d252e0b-9bf6-4a7a-8e59-77f26c810f6a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:49.793854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d252e0b-9bf6-4a7a-8e59-77f26c810f6a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:49.883420 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d252e0b-9bf6-4a7a-8e59-77f26c810f6a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104252 Aug 09 15:22:49.884068 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3310/6630] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 15:22:49 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:22:50.881937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-75dcc8f1-eea5-4431-b1df-f85c09806ab4 req-85f19517-bcf6-4d53-89c9-bf02919dfeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d291a54c-7210-4be5-b760-6157ac99ca9f", "tag": "42231790-f1df-4f5b-8a88-7754180b414a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:22:50.892514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-75dcc8f1-eea5-4431-b1df-f85c09806ab4 req-85f19517-bcf6-4d53-89c9-bf02919dfeef service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:22:50.892973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-75dcc8f1-eea5-4431-b1df-f85c09806ab4 req-85f19517-bcf6-4d53-89c9-bf02919dfeef service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:22:50.893385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-75dcc8f1-eea5-4431-b1df-f85c09806ab4 req-85f19517-bcf6-4d53-89c9-bf02919dfeef service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:22:50.904753 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-75dcc8f1-eea5-4431-b1df-f85c09806ab4 req-85f19517-bcf6-4d53-89c9-bf02919dfeef service nova] Creating event network-changed:42231790-f1df-4f5b-8a88-7754180b414a for instance d291a54c-7210-4be5-b760-6157ac99ca9f on n-h2-844626-8 Aug 09 15:22:50.910334 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-75dcc8f1-eea5-4431-b1df-f85c09806ab4 req-85f19517-bcf6-4d53-89c9-bf02919dfeef service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031911 Aug 09 15:22:50.921991 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3321/6631] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:23:26.943969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:23:26.944936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:23:26.945810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=28 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:23:26.949727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-18dff8c0-c6ba-4298-8068-0a960d0cb1c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:26.950371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-18dff8c0-c6ba-4298-8068-0a960d0cb1c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:26.958172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18dff8c0-c6ba-4298-8068-0a960d0cb1c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:26.958671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18dff8c0-c6ba-4298-8068-0a960d0cb1c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:26.959243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18dff8c0-c6ba-4298-8068-0a960d0cb1c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:26.959943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18dff8c0-c6ba-4298-8068-0a960d0cb1c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:26.960404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18dff8c0-c6ba-4298-8068-0a960d0cb1c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:26.960838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18dff8c0-c6ba-4298-8068-0a960d0cb1c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:27.109496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-18dff8c0-c6ba-4298-8068-0a960d0cb1c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:27.119471 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-18dff8c0-c6ba-4298-8068-0a960d0cb1c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1671 microversion: 2.1 time: 0.178067 Aug 09 15:23:27.120054 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3311/6632] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:26 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1671 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:27.138613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:23:27.139693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:23:27.142991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:23:27.143801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=26 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:23:27.149619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d90d8039-a0a3-471e-b2e4-47b2d5e26213 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:27.150376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d90d8039-a0a3-471e-b2e4-47b2d5e26213 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:27.159373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d90d8039-a0a3-471e-b2e4-47b2d5e26213 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:27.159924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d90d8039-a0a3-471e-b2e4-47b2d5e26213 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:27.160354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d90d8039-a0a3-471e-b2e4-47b2d5e26213 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:27.161029 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d90d8039-a0a3-471e-b2e4-47b2d5e26213 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:27.161469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d90d8039-a0a3-471e-b2e4-47b2d5e26213 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:27.162565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d90d8039-a0a3-471e-b2e4-47b2d5e26213 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:27.294836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d90d8039-a0a3-471e-b2e4-47b2d5e26213 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:27.302905 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d90d8039-a0a3-471e-b2e4-47b2d5e26213 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1671 microversion: 2.1 time: 0.165888 Aug 09 15:23:27.303537 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3322/6633] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:27 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:27.322674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d1eb1e93-e5b7-43b2-a29a-43bafb376d7a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:27.323326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d1eb1e93-e5b7-43b2-a29a-43bafb376d7a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:27.329608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1eb1e93-e5b7-43b2-a29a-43bafb376d7a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:27.330100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1eb1e93-e5b7-43b2-a29a-43bafb376d7a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:27.330548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1eb1e93-e5b7-43b2-a29a-43bafb376d7a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:27.331313 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1eb1e93-e5b7-43b2-a29a-43bafb376d7a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:27.331771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1eb1e93-e5b7-43b2-a29a-43bafb376d7a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:27.332204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d1eb1e93-e5b7-43b2-a29a-43bafb376d7a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:27.484497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d1eb1e93-e5b7-43b2-a29a-43bafb376d7a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:27.496296 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d1eb1e93-e5b7-43b2-a29a-43bafb376d7a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1671 microversion: 2.1 time: 0.176869 Aug 09 15:23:27.496888 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3312/6634] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:27 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1671 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:27.516715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:23:27.518957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:27.525119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:27.525602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:27.526038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:27.526720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:27.527202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:27.527621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:27.557339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:27.563393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Old instance type m1.heat2, new instance type m1.heat {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 15:23:27.570480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:23:27.570899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:23:27.571403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:23:27.571835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:23:27.572213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:23:27.638642 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9009f0df-9147-452f-a967-0e06cab3f4f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f/action" status: 202 len: 0 microversion: 2.1 time: 0.125801 Aug 09 15:23:27.639258 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3323/6635] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:23:27 2022] POST /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:23:27.649926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f874bcf7-697a-4b3f-bc0b-84fe232b03eb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:27.650858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f874bcf7-697a-4b3f-bc0b-84fe232b03eb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:27.659446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f874bcf7-697a-4b3f-bc0b-84fe232b03eb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:27.660358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f874bcf7-697a-4b3f-bc0b-84fe232b03eb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:27.660961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f874bcf7-697a-4b3f-bc0b-84fe232b03eb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:27.661940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f874bcf7-697a-4b3f-bc0b-84fe232b03eb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:27.662645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f874bcf7-697a-4b3f-bc0b-84fe232b03eb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:27.663210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f874bcf7-697a-4b3f-bc0b-84fe232b03eb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:27.797935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f874bcf7-697a-4b3f-bc0b-84fe232b03eb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:27.805818 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f874bcf7-697a-4b3f-bc0b-84fe232b03eb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1680 microversion: 2.1 time: 0.161794 Aug 09 15:23:27.806402 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3313/6636] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:27 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:28.828295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9e16ea6-3072-4696-8969-fcb8135ea1e4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:28.829120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a9e16ea6-3072-4696-8969-fcb8135ea1e4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:28.839304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9e16ea6-3072-4696-8969-fcb8135ea1e4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:28.840000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9e16ea6-3072-4696-8969-fcb8135ea1e4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:28.840632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9e16ea6-3072-4696-8969-fcb8135ea1e4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:28.841619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9e16ea6-3072-4696-8969-fcb8135ea1e4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:28.842322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9e16ea6-3072-4696-8969-fcb8135ea1e4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:28.842947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9e16ea6-3072-4696-8969-fcb8135ea1e4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:28.993385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a9e16ea6-3072-4696-8969-fcb8135ea1e4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:29.001317 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a9e16ea6-3072-4696-8969-fcb8135ea1e4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1680 microversion: 2.1 time: 0.178963 Aug 09 15:23:29.001921 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3324/6637] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:28 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:30.022272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-822e5d37-f8ff-439d-bc0a-b8162512048a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:30.022872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-822e5d37-f8ff-439d-bc0a-b8162512048a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:30.030516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-822e5d37-f8ff-439d-bc0a-b8162512048a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:30.030886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-822e5d37-f8ff-439d-bc0a-b8162512048a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:30.031367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-822e5d37-f8ff-439d-bc0a-b8162512048a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:30.032081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-822e5d37-f8ff-439d-bc0a-b8162512048a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:30.032550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-822e5d37-f8ff-439d-bc0a-b8162512048a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:30.032985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-822e5d37-f8ff-439d-bc0a-b8162512048a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:30.180241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-822e5d37-f8ff-439d-bc0a-b8162512048a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:30.189359 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-822e5d37-f8ff-439d-bc0a-b8162512048a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.171156 Aug 09 15:23:30.189953 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3314/6638] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:30 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:31.214359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-919319d9-bf09-45fe-bebb-b50ec4abb28a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:31.214926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-919319d9-bf09-45fe-bebb-b50ec4abb28a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:31.225366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-919319d9-bf09-45fe-bebb-b50ec4abb28a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:31.225844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-919319d9-bf09-45fe-bebb-b50ec4abb28a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:31.226272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-919319d9-bf09-45fe-bebb-b50ec4abb28a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:31.226970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-919319d9-bf09-45fe-bebb-b50ec4abb28a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:31.227458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-919319d9-bf09-45fe-bebb-b50ec4abb28a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:31.227878 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-919319d9-bf09-45fe-bebb-b50ec4abb28a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:31.372892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-919319d9-bf09-45fe-bebb-b50ec4abb28a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:31.380786 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-919319d9-bf09-45fe-bebb-b50ec4abb28a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.172461 Aug 09 15:23:31.381500 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3325/6639] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:31 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:32.404099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0e015bbb-d6c8-4c36-9bf3-723d5927d013 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:32.404701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0e015bbb-d6c8-4c36-9bf3-723d5927d013 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:32.412125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e015bbb-d6c8-4c36-9bf3-723d5927d013 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:32.412621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e015bbb-d6c8-4c36-9bf3-723d5927d013 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:32.413071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e015bbb-d6c8-4c36-9bf3-723d5927d013 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:32.413758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e015bbb-d6c8-4c36-9bf3-723d5927d013 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:32.414220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e015bbb-d6c8-4c36-9bf3-723d5927d013 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:32.414646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0e015bbb-d6c8-4c36-9bf3-723d5927d013 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:32.563395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0e015bbb-d6c8-4c36-9bf3-723d5927d013 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:32.571389 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0e015bbb-d6c8-4c36-9bf3-723d5927d013 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.171236 Aug 09 15:23:32.571975 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3315/6640] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:32 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:33.595314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-248c02f1-ded0-4baf-83c8-992e21fa0018 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:33.595934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-248c02f1-ded0-4baf-83c8-992e21fa0018 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:33.604356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-248c02f1-ded0-4baf-83c8-992e21fa0018 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:33.604839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-248c02f1-ded0-4baf-83c8-992e21fa0018 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:33.605533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-248c02f1-ded0-4baf-83c8-992e21fa0018 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:33.606265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-248c02f1-ded0-4baf-83c8-992e21fa0018 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:33.606693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-248c02f1-ded0-4baf-83c8-992e21fa0018 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:33.607121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-248c02f1-ded0-4baf-83c8-992e21fa0018 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:33.756481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-248c02f1-ded0-4baf-83c8-992e21fa0018 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:33.768198 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-248c02f1-ded0-4baf-83c8-992e21fa0018 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.178522 Aug 09 15:23:33.768934 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3326/6641] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:33 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:34.796398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0e907d8-6c04-428b-bbe9-4de176826f26 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:34.797010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0e907d8-6c04-428b-bbe9-4de176826f26 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:34.811998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0e907d8-6c04-428b-bbe9-4de176826f26 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:34.812497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0e907d8-6c04-428b-bbe9-4de176826f26 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:34.812937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0e907d8-6c04-428b-bbe9-4de176826f26 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:34.813645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0e907d8-6c04-428b-bbe9-4de176826f26 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:34.814101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0e907d8-6c04-428b-bbe9-4de176826f26 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:34.814529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0e907d8-6c04-428b-bbe9-4de176826f26 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:34.966024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0e907d8-6c04-428b-bbe9-4de176826f26 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:34.974325 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0e907d8-6c04-428b-bbe9-4de176826f26 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.187655 Aug 09 15:23:34.974954 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3316/6642] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:34 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:35.996792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3dddb489-02be-4c92-8cb9-1d4a39830a70 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:35.997385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3dddb489-02be-4c92-8cb9-1d4a39830a70 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:36.004721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dddb489-02be-4c92-8cb9-1d4a39830a70 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:36.005201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dddb489-02be-4c92-8cb9-1d4a39830a70 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:36.005625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dddb489-02be-4c92-8cb9-1d4a39830a70 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:36.006319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dddb489-02be-4c92-8cb9-1d4a39830a70 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:36.006796 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dddb489-02be-4c92-8cb9-1d4a39830a70 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:36.007247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3dddb489-02be-4c92-8cb9-1d4a39830a70 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:36.151033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3dddb489-02be-4c92-8cb9-1d4a39830a70 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:36.158921 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3dddb489-02be-4c92-8cb9-1d4a39830a70 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.166161 Aug 09 15:23:36.159522 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3327/6643] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:35 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:37.181494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5c2ad4fa-9f58-49c0-bda1-776cbfd54c61 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:37.182103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5c2ad4fa-9f58-49c0-bda1-776cbfd54c61 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:37.189789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c2ad4fa-9f58-49c0-bda1-776cbfd54c61 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:37.190232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c2ad4fa-9f58-49c0-bda1-776cbfd54c61 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:37.190694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c2ad4fa-9f58-49c0-bda1-776cbfd54c61 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:37.191426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c2ad4fa-9f58-49c0-bda1-776cbfd54c61 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:37.191885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c2ad4fa-9f58-49c0-bda1-776cbfd54c61 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:37.192316 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5c2ad4fa-9f58-49c0-bda1-776cbfd54c61 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:37.336092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5c2ad4fa-9f58-49c0-bda1-776cbfd54c61 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:37.344196 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5c2ad4fa-9f58-49c0-bda1-776cbfd54c61 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.166889 Aug 09 15:23:37.344777 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3317/6644] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:37 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:38.367125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14dd36e3-2b2e-452b-bb94-eca38ae0f9fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:38.367762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14dd36e3-2b2e-452b-bb94-eca38ae0f9fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:38.375575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14dd36e3-2b2e-452b-bb94-eca38ae0f9fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:38.376070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14dd36e3-2b2e-452b-bb94-eca38ae0f9fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:38.376494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14dd36e3-2b2e-452b-bb94-eca38ae0f9fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:38.377156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14dd36e3-2b2e-452b-bb94-eca38ae0f9fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:38.377648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14dd36e3-2b2e-452b-bb94-eca38ae0f9fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:38.378063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14dd36e3-2b2e-452b-bb94-eca38ae0f9fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:38.518028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14dd36e3-2b2e-452b-bb94-eca38ae0f9fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:38.526721 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14dd36e3-2b2e-452b-bb94-eca38ae0f9fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.163599 Aug 09 15:23:38.527331 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3328/6645] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:38 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:39.549844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8b71ec9-fa48-474b-9a7d-b8c44bcab7c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:39.550726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8b71ec9-fa48-474b-9a7d-b8c44bcab7c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:39.560603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b71ec9-fa48-474b-9a7d-b8c44bcab7c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:39.561282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b71ec9-fa48-474b-9a7d-b8c44bcab7c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:39.561827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b71ec9-fa48-474b-9a7d-b8c44bcab7c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:39.563003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b71ec9-fa48-474b-9a7d-b8c44bcab7c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:39.563659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b71ec9-fa48-474b-9a7d-b8c44bcab7c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:39.564380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8b71ec9-fa48-474b-9a7d-b8c44bcab7c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:39.709653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f8b71ec9-fa48-474b-9a7d-b8c44bcab7c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:39.717550 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8b71ec9-fa48-474b-9a7d-b8c44bcab7c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.172708 Aug 09 15:23:39.718133 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3318/6646] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:39 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:40.740372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7a11838-c548-47ce-bad5-ae4adad72c95 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:40.741054 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b7a11838-c548-47ce-bad5-ae4adad72c95 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:40.747995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7a11838-c548-47ce-bad5-ae4adad72c95 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:40.748470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7a11838-c548-47ce-bad5-ae4adad72c95 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:40.748894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7a11838-c548-47ce-bad5-ae4adad72c95 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:40.749603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7a11838-c548-47ce-bad5-ae4adad72c95 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:40.750019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7a11838-c548-47ce-bad5-ae4adad72c95 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:40.750460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7a11838-c548-47ce-bad5-ae4adad72c95 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:40.900377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b7a11838-c548-47ce-bad5-ae4adad72c95 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:40.912671 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7a11838-c548-47ce-bad5-ae4adad72c95 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.176077 Aug 09 15:23:40.913292 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3329/6647] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:40 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:41.934795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b28804e1-193c-44ef-b5b7-fd3b3a23659a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:41.935423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b28804e1-193c-44ef-b5b7-fd3b3a23659a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:41.942976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b28804e1-193c-44ef-b5b7-fd3b3a23659a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:41.943499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b28804e1-193c-44ef-b5b7-fd3b3a23659a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:41.943997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b28804e1-193c-44ef-b5b7-fd3b3a23659a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:41.944702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b28804e1-193c-44ef-b5b7-fd3b3a23659a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:41.945164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b28804e1-193c-44ef-b5b7-fd3b3a23659a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:41.945606 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b28804e1-193c-44ef-b5b7-fd3b3a23659a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:42.084647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b28804e1-193c-44ef-b5b7-fd3b3a23659a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:42.097576 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b28804e1-193c-44ef-b5b7-fd3b3a23659a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.166358 Aug 09 15:23:42.098513 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3319/6648] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:41 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:43.127130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-69f8ac9d-7b8e-4f7d-9b49-abe3e60dd3b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:43.130627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-69f8ac9d-7b8e-4f7d-9b49-abe3e60dd3b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:43.138137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69f8ac9d-7b8e-4f7d-9b49-abe3e60dd3b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:43.138615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69f8ac9d-7b8e-4f7d-9b49-abe3e60dd3b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:43.139152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69f8ac9d-7b8e-4f7d-9b49-abe3e60dd3b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:43.139985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69f8ac9d-7b8e-4f7d-9b49-abe3e60dd3b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:43.140785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69f8ac9d-7b8e-4f7d-9b49-abe3e60dd3b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:43.141539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69f8ac9d-7b8e-4f7d-9b49-abe3e60dd3b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:43.296451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-69f8ac9d-7b8e-4f7d-9b49-abe3e60dd3b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:43.309975 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-69f8ac9d-7b8e-4f7d-9b49-abe3e60dd3b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.186648 Aug 09 15:23:43.310836 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3330/6649] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:43 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:44.332685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2a7ac77-9855-444a-b696-0a3ec712be8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:44.333399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c2a7ac77-9855-444a-b696-0a3ec712be8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:44.340693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2a7ac77-9855-444a-b696-0a3ec712be8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:44.341196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2a7ac77-9855-444a-b696-0a3ec712be8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:44.341646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2a7ac77-9855-444a-b696-0a3ec712be8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:44.342362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2a7ac77-9855-444a-b696-0a3ec712be8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:44.342829 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2a7ac77-9855-444a-b696-0a3ec712be8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:44.343307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2a7ac77-9855-444a-b696-0a3ec712be8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:44.482040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c2a7ac77-9855-444a-b696-0a3ec712be8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:44.493548 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2a7ac77-9855-444a-b696-0a3ec712be8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.165705 Aug 09 15:23:44.494139 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3320/6650] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:44 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:45.515125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-481d635c-a74b-4232-aa4b-d7a60ec557dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:45.515741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-481d635c-a74b-4232-aa4b-d7a60ec557dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:45.522940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-481d635c-a74b-4232-aa4b-d7a60ec557dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:45.523457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-481d635c-a74b-4232-aa4b-d7a60ec557dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:45.523888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-481d635c-a74b-4232-aa4b-d7a60ec557dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:45.524616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-481d635c-a74b-4232-aa4b-d7a60ec557dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:45.525064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-481d635c-a74b-4232-aa4b-d7a60ec557dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:45.525489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-481d635c-a74b-4232-aa4b-d7a60ec557dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:45.660998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-481d635c-a74b-4232-aa4b-d7a60ec557dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:45.669227 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-481d635c-a74b-4232-aa4b-d7a60ec557dc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.158047 Aug 09 15:23:45.669811 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3331/6651] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:45 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:46.690660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-57d8d248-1b63-487a-8239-47dbaa22fddf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:46.691252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-57d8d248-1b63-487a-8239-47dbaa22fddf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:46.698739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57d8d248-1b63-487a-8239-47dbaa22fddf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:46.699258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57d8d248-1b63-487a-8239-47dbaa22fddf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:46.699712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57d8d248-1b63-487a-8239-47dbaa22fddf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:46.700538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57d8d248-1b63-487a-8239-47dbaa22fddf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:46.701009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57d8d248-1b63-487a-8239-47dbaa22fddf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:46.701438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-57d8d248-1b63-487a-8239-47dbaa22fddf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:46.865929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-57d8d248-1b63-487a-8239-47dbaa22fddf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:46.875030 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-57d8d248-1b63-487a-8239-47dbaa22fddf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1685 microversion: 2.1 time: 0.188284 Aug 09 15:23:46.875671 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3321/6652] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:46 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1685 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:47.405337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-660eb3db-ed8c-4dce-a908-cfac03a717ce req-c87d2997-2294-4503-aafc-c52ef4d49cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d291a54c-7210-4be5-b760-6157ac99ca9f", "name": "network-vif-unplugged", "status": "completed", "tag": "42231790-f1df-4f5b-8a88-7754180b414a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:23:47.417120 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-660eb3db-ed8c-4dce-a908-cfac03a717ce req-c87d2997-2294-4503-aafc-c52ef4d49cea service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:47.417881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-660eb3db-ed8c-4dce-a908-cfac03a717ce req-c87d2997-2294-4503-aafc-c52ef4d49cea service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:47.418460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-660eb3db-ed8c-4dce-a908-cfac03a717ce req-c87d2997-2294-4503-aafc-c52ef4d49cea service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:47.431391 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-660eb3db-ed8c-4dce-a908-cfac03a717ce req-c87d2997-2294-4503-aafc-c52ef4d49cea service nova] Creating event network-vif-unplugged:42231790-f1df-4f5b-8a88-7754180b414a for instance d291a54c-7210-4be5-b760-6157ac99ca9f on n-h1-844626-8 Aug 09 15:23:47.437633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-660eb3db-ed8c-4dce-a908-cfac03a717ce req-c87d2997-2294-4503-aafc-c52ef4d49cea service nova] Instance d291a54c-7210-4be5-b760-6157ac99ca9f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:23:47.450494 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-660eb3db-ed8c-4dce-a908-cfac03a717ce req-c87d2997-2294-4503-aafc-c52ef4d49cea service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049254 Aug 09 15:23:47.451141 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3332/6653] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:23:47.906383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-78728910-8e0a-4126-ba26-d9d586334496 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:47.906985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-78728910-8e0a-4126-ba26-d9d586334496 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:47.915718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78728910-8e0a-4126-ba26-d9d586334496 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:47.916225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78728910-8e0a-4126-ba26-d9d586334496 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:47.916679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78728910-8e0a-4126-ba26-d9d586334496 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:47.917410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78728910-8e0a-4126-ba26-d9d586334496 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:47.917901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78728910-8e0a-4126-ba26-d9d586334496 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:47.918347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-78728910-8e0a-4126-ba26-d9d586334496 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:48.057960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-78728910-8e0a-4126-ba26-d9d586334496 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:48.066028 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-78728910-8e0a-4126-ba26-d9d586334496 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1684 microversion: 2.1 time: 0.163689 Aug 09 15:23:48.066872 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3322/6654] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:47 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:49.089365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8335c235-3c74-40a5-9ca3-645a29f42382 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:49.090067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8335c235-3c74-40a5-9ca3-645a29f42382 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:49.098205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8335c235-3c74-40a5-9ca3-645a29f42382 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:49.098719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8335c235-3c74-40a5-9ca3-645a29f42382 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:49.099155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8335c235-3c74-40a5-9ca3-645a29f42382 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:49.099887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8335c235-3c74-40a5-9ca3-645a29f42382 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:49.100346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8335c235-3c74-40a5-9ca3-645a29f42382 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:49.100730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8335c235-3c74-40a5-9ca3-645a29f42382 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:49.249577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8335c235-3c74-40a5-9ca3-645a29f42382 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:49.257723 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8335c235-3c74-40a5-9ca3-645a29f42382 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1682 microversion: 2.1 time: 0.172917 Aug 09 15:23:49.258337 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3333/6655] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:49 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:49.489660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b9ee4553-09d9-4398-aed3-82240ddc6b7e req-38cb5ae0-b598-4071-ae1a-2f82aa2641cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d291a54c-7210-4be5-b760-6157ac99ca9f", "tag": "42231790-f1df-4f5b-8a88-7754180b414a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:23:49.500852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b9ee4553-09d9-4398-aed3-82240ddc6b7e req-38cb5ae0-b598-4071-ae1a-2f82aa2641cd service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:49.501349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b9ee4553-09d9-4398-aed3-82240ddc6b7e req-38cb5ae0-b598-4071-ae1a-2f82aa2641cd service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:49.501875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b9ee4553-09d9-4398-aed3-82240ddc6b7e req-38cb5ae0-b598-4071-ae1a-2f82aa2641cd service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:49.514028 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b9ee4553-09d9-4398-aed3-82240ddc6b7e req-38cb5ae0-b598-4071-ae1a-2f82aa2641cd service nova] Creating event network-changed:42231790-f1df-4f5b-8a88-7754180b414a for instance d291a54c-7210-4be5-b760-6157ac99ca9f on n-h1-844626-8 Aug 09 15:23:49.519884 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-b9ee4553-09d9-4398-aed3-82240ddc6b7e req-38cb5ae0-b598-4071-ae1a-2f82aa2641cd service nova] Instance d291a54c-7210-4be5-b760-6157ac99ca9f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:23:49.531154 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b9ee4553-09d9-4398-aed3-82240ddc6b7e req-38cb5ae0-b598-4071-ae1a-2f82aa2641cd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045177 Aug 09 15:23:49.531967 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3323/6656] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:23:50.278853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5b55d89-77cd-4c00-a1a7-39921a32682f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:50.279634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5b55d89-77cd-4c00-a1a7-39921a32682f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:50.287780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5b55d89-77cd-4c00-a1a7-39921a32682f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:50.288272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5b55d89-77cd-4c00-a1a7-39921a32682f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:50.288780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5b55d89-77cd-4c00-a1a7-39921a32682f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:50.289663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5b55d89-77cd-4c00-a1a7-39921a32682f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:50.290130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5b55d89-77cd-4c00-a1a7-39921a32682f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:50.290552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5b55d89-77cd-4c00-a1a7-39921a32682f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:50.437094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5b55d89-77cd-4c00-a1a7-39921a32682f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:50.445955 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5b55d89-77cd-4c00-a1a7-39921a32682f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1679 microversion: 2.1 time: 0.170977 Aug 09 15:23:50.446553 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3334/6657] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:50 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:50.468187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e59ee417-0591-47d6-9305-3b42751c33c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:23:50.468810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e59ee417-0591-47d6-9305-3b42751c33c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:50.476003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e59ee417-0591-47d6-9305-3b42751c33c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:50.476549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e59ee417-0591-47d6-9305-3b42751c33c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:50.476990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e59ee417-0591-47d6-9305-3b42751c33c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:50.477689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e59ee417-0591-47d6-9305-3b42751c33c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:50.478146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e59ee417-0591-47d6-9305-3b42751c33c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:50.478574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e59ee417-0591-47d6-9305-3b42751c33c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:50.541778 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e59ee417-0591-47d6-9305-3b42751c33c8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f/action" status: 204 len: 0 microversion: 2.1 time: 0.077723 Aug 09 15:23:50.542880 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3324/6658] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:23:50 2022] POST /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:23:50.551288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-783d5ec2-4ac1-41cf-8118-e1b22980df8b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:50.552166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-783d5ec2-4ac1-41cf-8118-e1b22980df8b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:50.558959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783d5ec2-4ac1-41cf-8118-e1b22980df8b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:50.559653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783d5ec2-4ac1-41cf-8118-e1b22980df8b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:50.560160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783d5ec2-4ac1-41cf-8118-e1b22980df8b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:50.560966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783d5ec2-4ac1-41cf-8118-e1b22980df8b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:50.561672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783d5ec2-4ac1-41cf-8118-e1b22980df8b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:50.562138 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783d5ec2-4ac1-41cf-8118-e1b22980df8b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:50.813509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-783d5ec2-4ac1-41cf-8118-e1b22980df8b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:50.825318 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-783d5ec2-4ac1-41cf-8118-e1b22980df8b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1679 microversion: 2.1 time: 0.278086 Aug 09 15:23:50.825963 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3335/6659] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:50 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1679 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:51.849946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-caf8e3b6-a0fb-495a-8aee-e97dc211b712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:51.850756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-caf8e3b6-a0fb-495a-8aee-e97dc211b712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:51.857931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caf8e3b6-a0fb-495a-8aee-e97dc211b712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:51.858537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caf8e3b6-a0fb-495a-8aee-e97dc211b712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:51.859048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caf8e3b6-a0fb-495a-8aee-e97dc211b712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:51.859866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caf8e3b6-a0fb-495a-8aee-e97dc211b712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:51.860432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caf8e3b6-a0fb-495a-8aee-e97dc211b712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:51.860873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-caf8e3b6-a0fb-495a-8aee-e97dc211b712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:52.025433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-caf8e3b6-a0fb-495a-8aee-e97dc211b712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:52.038163 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-caf8e3b6-a0fb-495a-8aee-e97dc211b712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1679 microversion: 2.1 time: 0.193824 Aug 09 15:23:52.052245 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3325/6660] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:51 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:23:53.061856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9b1eced7-1899-4be2-8773-0b90471796a5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:53.062516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9b1eced7-1899-4be2-8773-0b90471796a5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:53.069160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b1eced7-1899-4be2-8773-0b90471796a5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:53.069695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b1eced7-1899-4be2-8773-0b90471796a5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:53.070210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b1eced7-1899-4be2-8773-0b90471796a5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:53.070902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b1eced7-1899-4be2-8773-0b90471796a5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:53.071384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b1eced7-1899-4be2-8773-0b90471796a5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:53.071802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9b1eced7-1899-4be2-8773-0b90471796a5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:53.220800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9b1eced7-1899-4be2-8773-0b90471796a5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:53.229039 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9b1eced7-1899-4be2-8773-0b90471796a5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1671 microversion: 2.1 time: 0.171985 Aug 09 15:23:53.229659 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3336/6661] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:53 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1671 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:53.250450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-de5ec6ad-5a45-4a5b-9563-add09c415203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:53.251018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-de5ec6ad-5a45-4a5b-9563-add09c415203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:53.258237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de5ec6ad-5a45-4a5b-9563-add09c415203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:53.258721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de5ec6ad-5a45-4a5b-9563-add09c415203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:53.259195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de5ec6ad-5a45-4a5b-9563-add09c415203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:53.259912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de5ec6ad-5a45-4a5b-9563-add09c415203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:53.260362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de5ec6ad-5a45-4a5b-9563-add09c415203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:53.260786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-de5ec6ad-5a45-4a5b-9563-add09c415203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:53.396585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-de5ec6ad-5a45-4a5b-9563-add09c415203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:53.399019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:23:53.406699 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-de5ec6ad-5a45-4a5b-9563-add09c415203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1671 microversion: 2.1 time: 0.160289 Aug 09 15:23:53.407314 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3326/6662] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:53 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:53.427079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-41ceea58-29ee-4e07-9936-308adb0d5812 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:53.427720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-41ceea58-29ee-4e07-9936-308adb0d5812 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:53.434258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41ceea58-29ee-4e07-9936-308adb0d5812 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:53.434741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41ceea58-29ee-4e07-9936-308adb0d5812 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:53.435195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41ceea58-29ee-4e07-9936-308adb0d5812 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:53.435907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41ceea58-29ee-4e07-9936-308adb0d5812 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:53.436354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41ceea58-29ee-4e07-9936-308adb0d5812 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:53.436776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41ceea58-29ee-4e07-9936-308adb0d5812 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:53.456272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:23:53.579413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-41ceea58-29ee-4e07-9936-308adb0d5812 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:53.588059 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-41ceea58-29ee-4e07-9936-308adb0d5812 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1671 microversion: 2.1 time: 0.164819 Aug 09 15:23:53.589161 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3337/6663] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:53 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:53.612348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ee808a6a-a154-48cf-80b9-93a8d014a712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:53.613275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee808a6a-a154-48cf-80b9-93a8d014a712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:53.623438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee808a6a-a154-48cf-80b9-93a8d014a712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:53.623438 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee808a6a-a154-48cf-80b9-93a8d014a712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:53.624121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee808a6a-a154-48cf-80b9-93a8d014a712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:53.625139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee808a6a-a154-48cf-80b9-93a8d014a712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:53.625692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee808a6a-a154-48cf-80b9-93a8d014a712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:53.626370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ee808a6a-a154-48cf-80b9-93a8d014a712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:53.654810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ee808a6a-a154-48cf-80b9-93a8d014a712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:23:53.749944 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ee808a6a-a154-48cf-80b9-93a8d014a712 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 204 len: 0 microversion: 2.1 time: 0.141790 Aug 09 15:23:53.750169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-916f235e-732b-4c24-bafe-2c0321c333cd req-d3997109-d02d-4bc1-9215-6ed3df4a2df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d291a54c-7210-4be5-b760-6157ac99ca9f", "name": "network-vif-plugged", "status": "completed", "tag": "42231790-f1df-4f5b-8a88-7754180b414a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:23:53.750565 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3327/6664] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:23:53 2022] DELETE /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:23:53.761985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ec77028-e499-406b-bee1-88c97a5955b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:53.762491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-916f235e-732b-4c24-bafe-2c0321c333cd req-d3997109-d02d-4bc1-9215-6ed3df4a2df8 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:53.762703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ec77028-e499-406b-bee1-88c97a5955b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:53.762967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-916f235e-732b-4c24-bafe-2c0321c333cd req-d3997109-d02d-4bc1-9215-6ed3df4a2df8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:53.763430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-916f235e-732b-4c24-bafe-2c0321c333cd req-d3997109-d02d-4bc1-9215-6ed3df4a2df8 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:53.771730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ec77028-e499-406b-bee1-88c97a5955b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:53.772249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ec77028-e499-406b-bee1-88c97a5955b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:53.772691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ec77028-e499-406b-bee1-88c97a5955b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:53.773502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ec77028-e499-406b-bee1-88c97a5955b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:53.773976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ec77028-e499-406b-bee1-88c97a5955b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:53.774395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ec77028-e499-406b-bee1-88c97a5955b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:53.778312 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-916f235e-732b-4c24-bafe-2c0321c333cd req-d3997109-d02d-4bc1-9215-6ed3df4a2df8 service nova] Creating event network-vif-plugged:42231790-f1df-4f5b-8a88-7754180b414a for instance d291a54c-7210-4be5-b760-6157ac99ca9f on n-h1-844626-8 Aug 09 15:23:53.783801 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-916f235e-732b-4c24-bafe-2c0321c333cd req-d3997109-d02d-4bc1-9215-6ed3df4a2df8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043304 Aug 09 15:23:53.784424 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3338/6665] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:23:53.919060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ec77028-e499-406b-bee1-88c97a5955b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:53.927486 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ec77028-e499-406b-bee1-88c97a5955b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1677 microversion: 2.1 time: 0.172133 Aug 09 15:23:53.928063 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3328/6666] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:53 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:23:54.949672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e998c5a8-b775-4c92-9a64-f1471bc2c6dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:54.950368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e998c5a8-b775-4c92-9a64-f1471bc2c6dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:54.958146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e998c5a8-b775-4c92-9a64-f1471bc2c6dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:54.958629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e998c5a8-b775-4c92-9a64-f1471bc2c6dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:54.959052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e998c5a8-b775-4c92-9a64-f1471bc2c6dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:54.959764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e998c5a8-b775-4c92-9a64-f1471bc2c6dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:54.960205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e998c5a8-b775-4c92-9a64-f1471bc2c6dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:54.960690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e998c5a8-b775-4c92-9a64-f1471bc2c6dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:55.104434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e998c5a8-b775-4c92-9a64-f1471bc2c6dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:55.118060 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e998c5a8-b775-4c92-9a64-f1471bc2c6dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1677 microversion: 2.1 time: 0.172370 Aug 09 15:23:55.119117 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3339/6667] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:54 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:56.153138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a7e5ea90-e7c3-4e25-b49d-f539f9f2ec72 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:56.153693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a7e5ea90-e7c3-4e25-b49d-f539f9f2ec72 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:56.161808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7e5ea90-e7c3-4e25-b49d-f539f9f2ec72 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:56.162317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7e5ea90-e7c3-4e25-b49d-f539f9f2ec72 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:56.162767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7e5ea90-e7c3-4e25-b49d-f539f9f2ec72 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:56.163641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7e5ea90-e7c3-4e25-b49d-f539f9f2ec72 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:56.164106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7e5ea90-e7c3-4e25-b49d-f539f9f2ec72 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:56.164542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a7e5ea90-e7c3-4e25-b49d-f539f9f2ec72 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:56.250447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a7e5ea90-e7c3-4e25-b49d-f539f9f2ec72 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:56.259983 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a7e5ea90-e7c3-4e25-b49d-f539f9f2ec72 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 200 len: 1609 microversion: 2.1 time: 0.111021 Aug 09 15:23:56.260905 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3329/6668] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:56 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 1609 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:23:56.316968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-31ecccaf-ff7c-4c73-a57e-a8e152a19882 req-11dbeda8-614e-471e-99fa-1512592adf3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d291a54c-7210-4be5-b760-6157ac99ca9f", "name": "network-vif-deleted", "tag": "42231790-f1df-4f5b-8a88-7754180b414a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:23:56.328522 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-31ecccaf-ff7c-4c73-a57e-a8e152a19882 req-11dbeda8-614e-471e-99fa-1512592adf3d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:56.329098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-31ecccaf-ff7c-4c73-a57e-a8e152a19882 req-11dbeda8-614e-471e-99fa-1512592adf3d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:56.329591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-31ecccaf-ff7c-4c73-a57e-a8e152a19882 req-11dbeda8-614e-471e-99fa-1512592adf3d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:56.343139 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-31ecccaf-ff7c-4c73-a57e-a8e152a19882 req-11dbeda8-614e-471e-99fa-1512592adf3d service nova] Creating event network-vif-deleted:42231790-f1df-4f5b-8a88-7754180b414a for instance d291a54c-7210-4be5-b760-6157ac99ca9f on n-h1-844626-8 Aug 09 15:23:56.349468 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-31ecccaf-ff7c-4c73-a57e-a8e152a19882 req-11dbeda8-614e-471e-99fa-1512592adf3d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036659 Aug 09 15:23:56.351659 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3340/6669] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:23:57.285080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce79d5b4-5638-4638-b0ac-749045801711 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:57.285802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ce79d5b4-5638-4638-b0ac-749045801711 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:57.289765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:23:57.295799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce79d5b4-5638-4638-b0ac-749045801711 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:57.296305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce79d5b4-5638-4638-b0ac-749045801711 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:57.296756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce79d5b4-5638-4638-b0ac-749045801711 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:57.297594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce79d5b4-5638-4638-b0ac-749045801711 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:57.298149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce79d5b4-5638-4638-b0ac-749045801711 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:57.298563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce79d5b4-5638-4638-b0ac-749045801711 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:57.318643 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-ce79d5b4-5638-4638-b0ac-749045801711 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce79d5b4-5638-4638-b0ac-749045801711 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f HTTP/1.1 Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'd291a54c-7210-4be5-b760-6157ac99ca9f'} Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:23:57.320470 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:23:57.324389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:23:57.324389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:23:57.324389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:23:57.324389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:23:57.324389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:23:57.324389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:23:57.324389 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:23:57.324389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce79d5b4-5638-4638-b0ac-749045801711 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:23:57.324389 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ce79d5b4-5638-4638-b0ac-749045801711 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 404 len: 111 microversion: 2.1 time: 0.043152 Aug 09 15:23:57.324389 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3330/6670] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:57 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:23:57.339942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e6ba01e1-d60e-40d0-a6e6-a42f97fa1609 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:57.340736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e6ba01e1-d60e-40d0-a6e6-a42f97fa1609 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:57.342934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=43 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:23:57.350246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6ba01e1-d60e-40d0-a6e6-a42f97fa1609 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:57.350821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6ba01e1-d60e-40d0-a6e6-a42f97fa1609 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:57.351243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6ba01e1-d60e-40d0-a6e6-a42f97fa1609 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:57.351959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6ba01e1-d60e-40d0-a6e6-a42f97fa1609 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:57.352395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6ba01e1-d60e-40d0-a6e6-a42f97fa1609 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:57.352807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e6ba01e1-d60e-40d0-a6e6-a42f97fa1609 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:57.370375 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e6ba01e1-d60e-40d0-a6e6-a42f97fa1609 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e6ba01e1-d60e-40d0-a6e6-a42f97fa1609 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f HTTP/1.1 Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'd291a54c-7210-4be5-b760-6157ac99ca9f'} Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:23:57.372095 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:23:57.376300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:23:57.376300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:23:57.376300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:23:57.376300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:23:57.376300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:23:57.376300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:23:57.376300 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:23:57.376300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e6ba01e1-d60e-40d0-a6e6-a42f97fa1609 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:23:57.376300 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e6ba01e1-d60e-40d0-a6e6-a42f97fa1609 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 404 len: 111 microversion: 2.1 time: 0.038986 Aug 09 15:23:57.376300 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3341/6671] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:57 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:23:57.423995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-751487619", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "38bb04fc-70f1-41b1-aef0-d31c411f18a0"}], "security_groups": [{"name": "tempest-securitygroup--1420965144"}], "key_name": "tempest-keypair-1527801048", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:23:57.530755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] validate_networks() for [('38bb04fc-70f1-41b1-aef0-d31c411f18a0', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:23:58.011936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:23:58.012358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:23:58.012837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:23:58.013275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:23:58.013720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:23:58.025558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:58.026060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:58.026699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:58.027381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:58.027742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:58.028172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:58.045856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:23:58.051412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for user 127998e24ecf48d58f3c789530f89898 and project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:23:58.065591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:23:58.068043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:23:58.116675 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2d91b143-050e-48f7-adbc-4dc4372e63f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.696438 Aug 09 15:23:58.123344 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3331/6672] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:23:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:23:58.129685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48190ef0-bb82-462e-9e09-a0817505b779 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:58.130395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48190ef0-bb82-462e-9e09-a0817505b779 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:58.191135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48190ef0-bb82-462e-9e09-a0817505b779 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:58.198455 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48190ef0-bb82-462e-9e09-a0817505b779 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1238 microversion: 2.1 time: 0.073265 Aug 09 15:23:58.199252 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3342/6673] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:58 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:23:59.223887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ba77d501-593b-40e1-b461-1c434dda4b64 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:23:59.225047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ba77d501-593b-40e1-b461-1c434dda4b64 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:23:59.239778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba77d501-593b-40e1-b461-1c434dda4b64 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:59.240569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba77d501-593b-40e1-b461-1c434dda4b64 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:59.241021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba77d501-593b-40e1-b461-1c434dda4b64 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:59.241757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba77d501-593b-40e1-b461-1c434dda4b64 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:23:59.242222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba77d501-593b-40e1-b461-1c434dda4b64 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:23:59.242656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ba77d501-593b-40e1-b461-1c434dda4b64 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:23:59.322702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ba77d501-593b-40e1-b461-1c434dda4b64 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:23:59.330561 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ba77d501-593b-40e1-b461-1c434dda4b64 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1308 microversion: 2.1 time: 0.113780 Aug 09 15:23:59.331133 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3332/6674] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:23:59 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:00.352689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32699c24-7755-44b6-b699-eb8ca9869b51 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:00.353382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32699c24-7755-44b6-b699-eb8ca9869b51 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:00.362453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32699c24-7755-44b6-b699-eb8ca9869b51 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:00.363363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32699c24-7755-44b6-b699-eb8ca9869b51 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:00.363830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32699c24-7755-44b6-b699-eb8ca9869b51 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:00.364600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32699c24-7755-44b6-b699-eb8ca9869b51 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:00.365057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32699c24-7755-44b6-b699-eb8ca9869b51 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:00.366572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32699c24-7755-44b6-b699-eb8ca9869b51 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:00.588028 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-32699c24-7755-44b6-b699-eb8ca9869b51 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:00.596074 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32699c24-7755-44b6-b699-eb8ca9869b51 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1364 microversion: 2.1 time: 0.247762 Aug 09 15:24:00.596963 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3343/6675] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:00 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:00.749900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c68a6a4f-bffe-4d18-97d2-c549bba73318 req-eaab6517-d1d5-46d0-af6c-5023ccdcd976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833f292c-b042-4eeb-99c1-b68002010de1", "tag": "20a716be-f190-432e-b8a9-947617b6fdd4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:24:00.761054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c68a6a4f-bffe-4d18-97d2-c549bba73318 req-eaab6517-d1d5-46d0-af6c-5023ccdcd976 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:00.761549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c68a6a4f-bffe-4d18-97d2-c549bba73318 req-eaab6517-d1d5-46d0-af6c-5023ccdcd976 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:00.761998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c68a6a4f-bffe-4d18-97d2-c549bba73318 req-eaab6517-d1d5-46d0-af6c-5023ccdcd976 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:00.775223 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-c68a6a4f-bffe-4d18-97d2-c549bba73318 req-eaab6517-d1d5-46d0-af6c-5023ccdcd976 service nova] Creating event network-changed:20a716be-f190-432e-b8a9-947617b6fdd4 for instance 833f292c-b042-4eeb-99c1-b68002010de1 on n-h2-844626-8 Aug 09 15:24:00.780559 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c68a6a4f-bffe-4d18-97d2-c549bba73318 req-eaab6517-d1d5-46d0-af6c-5023ccdcd976 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111558 Aug 09 15:24:00.781195 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3333/6676] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:24:01.619106 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c7be10e9-eabf-48f8-9263-780f0f491b27 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:01.619657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c7be10e9-eabf-48f8-9263-780f0f491b27 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:01.627243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7be10e9-eabf-48f8-9263-780f0f491b27 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:01.627709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7be10e9-eabf-48f8-9263-780f0f491b27 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:01.628172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7be10e9-eabf-48f8-9263-780f0f491b27 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:01.628883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7be10e9-eabf-48f8-9263-780f0f491b27 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:01.629307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7be10e9-eabf-48f8-9263-780f0f491b27 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:01.629730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c7be10e9-eabf-48f8-9263-780f0f491b27 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:01.775880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c7be10e9-eabf-48f8-9263-780f0f491b27 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:01.783968 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c7be10e9-eabf-48f8-9263-780f0f491b27 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1364 microversion: 2.1 time: 0.169035 Aug 09 15:24:01.784748 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3344/6677] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:01 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:02.806716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3aa20a5b-06e5-41f6-80e6-b3fe345dd973 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:02.807506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3aa20a5b-06e5-41f6-80e6-b3fe345dd973 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:02.815973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa20a5b-06e5-41f6-80e6-b3fe345dd973 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:02.816593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa20a5b-06e5-41f6-80e6-b3fe345dd973 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:02.817048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa20a5b-06e5-41f6-80e6-b3fe345dd973 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:02.817762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa20a5b-06e5-41f6-80e6-b3fe345dd973 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:02.818233 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa20a5b-06e5-41f6-80e6-b3fe345dd973 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:02.818695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3aa20a5b-06e5-41f6-80e6-b3fe345dd973 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:03.063655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3aa20a5b-06e5-41f6-80e6-b3fe345dd973 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:03.077951 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3aa20a5b-06e5-41f6-80e6-b3fe345dd973 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1364 microversion: 2.1 time: 0.275277 Aug 09 15:24:03.079065 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3334/6678] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:02 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1364 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:04.112829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-563a3d3d-735a-49a0-a9f4-611b8d3bb287 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:04.113409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-563a3d3d-735a-49a0-a9f4-611b8d3bb287 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:04.120808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-563a3d3d-735a-49a0-a9f4-611b8d3bb287 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:04.121306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-563a3d3d-735a-49a0-a9f4-611b8d3bb287 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:04.121749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-563a3d3d-735a-49a0-a9f4-611b8d3bb287 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:04.122444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-563a3d3d-735a-49a0-a9f4-611b8d3bb287 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:04.122899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-563a3d3d-735a-49a0-a9f4-611b8d3bb287 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:04.123355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-563a3d3d-735a-49a0-a9f4-611b8d3bb287 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:04.261315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-563a3d3d-735a-49a0-a9f4-611b8d3bb287 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:04.269354 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-563a3d3d-735a-49a0-a9f4-611b8d3bb287 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1364 microversion: 2.1 time: 0.160475 Aug 09 15:24:04.269959 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3345/6679] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:04 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:05.290463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d7b5542f-78c9-4ee7-b766-c985ae4005e5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:05.291057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d7b5542f-78c9-4ee7-b766-c985ae4005e5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:05.298436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7b5542f-78c9-4ee7-b766-c985ae4005e5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:05.298927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7b5542f-78c9-4ee7-b766-c985ae4005e5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:05.299402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7b5542f-78c9-4ee7-b766-c985ae4005e5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:05.300122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7b5542f-78c9-4ee7-b766-c985ae4005e5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:05.300618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7b5542f-78c9-4ee7-b766-c985ae4005e5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:05.301084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d7b5542f-78c9-4ee7-b766-c985ae4005e5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:05.446434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d7b5542f-78c9-4ee7-b766-c985ae4005e5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:05.454146 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d7b5542f-78c9-4ee7-b766-c985ae4005e5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1364 microversion: 2.1 time: 0.167809 Aug 09 15:24:05.454990 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3335/6680] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:05 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:06.476148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-683863cf-1f01-4d2b-98f9-8e5a3ddff263 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:06.476706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-683863cf-1f01-4d2b-98f9-8e5a3ddff263 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:06.484592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683863cf-1f01-4d2b-98f9-8e5a3ddff263 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:06.485069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683863cf-1f01-4d2b-98f9-8e5a3ddff263 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:06.485490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683863cf-1f01-4d2b-98f9-8e5a3ddff263 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:06.486171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683863cf-1f01-4d2b-98f9-8e5a3ddff263 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:06.486610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683863cf-1f01-4d2b-98f9-8e5a3ddff263 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:06.487023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-683863cf-1f01-4d2b-98f9-8e5a3ddff263 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:06.625115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-683863cf-1f01-4d2b-98f9-8e5a3ddff263 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:06.633336 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-683863cf-1f01-4d2b-98f9-8e5a3ddff263 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1364 microversion: 2.1 time: 0.161152 Aug 09 15:24:06.634230 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3346/6681] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:06 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:07.654913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-079ab15e-7b2f-4abd-a264-59e005cc5956 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:07.655525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-079ab15e-7b2f-4abd-a264-59e005cc5956 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:07.662151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-079ab15e-7b2f-4abd-a264-59e005cc5956 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:07.662654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-079ab15e-7b2f-4abd-a264-59e005cc5956 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:07.663107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-079ab15e-7b2f-4abd-a264-59e005cc5956 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:07.663842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-079ab15e-7b2f-4abd-a264-59e005cc5956 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:07.664333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-079ab15e-7b2f-4abd-a264-59e005cc5956 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:07.664748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-079ab15e-7b2f-4abd-a264-59e005cc5956 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:07.804863 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-079ab15e-7b2f-4abd-a264-59e005cc5956 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:07.813197 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-079ab15e-7b2f-4abd-a264-59e005cc5956 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1364 microversion: 2.1 time: 0.162987 Aug 09 15:24:07.814677 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3336/6682] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:07 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:08.299747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-fc4bfe15-712f-47fa-8b05-193acbf9a85e req-db45a06a-5492-497b-a793-afb6f0a8d9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833f292c-b042-4eeb-99c1-b68002010de1", "name": "network-vif-plugged", "status": "completed", "tag": "20a716be-f190-432e-b8a9-947617b6fdd4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:24:08.306533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:24:08.313261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fc4bfe15-712f-47fa-8b05-193acbf9a85e req-db45a06a-5492-497b-a793-afb6f0a8d9fe service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:08.313743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fc4bfe15-712f-47fa-8b05-193acbf9a85e req-db45a06a-5492-497b-a793-afb6f0a8d9fe service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:08.314164 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fc4bfe15-712f-47fa-8b05-193acbf9a85e req-db45a06a-5492-497b-a793-afb6f0a8d9fe service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:08.325691 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-fc4bfe15-712f-47fa-8b05-193acbf9a85e req-db45a06a-5492-497b-a793-afb6f0a8d9fe service nova] Creating event network-vif-plugged:20a716be-f190-432e-b8a9-947617b6fdd4 for instance 833f292c-b042-4eeb-99c1-b68002010de1 on n-h2-844626-8 Aug 09 15:24:08.330945 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-fc4bfe15-712f-47fa-8b05-193acbf9a85e req-db45a06a-5492-497b-a793-afb6f0a8d9fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035069 Aug 09 15:24:08.331904 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3347/6683] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:24:08.836950 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c45f0531-8e75-4532-8bf2-d4f510472336 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:08.837536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c45f0531-8e75-4532-8bf2-d4f510472336 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:08.839637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:24:08.840489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:24:08.847107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c45f0531-8e75-4532-8bf2-d4f510472336 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:08.847620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c45f0531-8e75-4532-8bf2-d4f510472336 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:08.848063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c45f0531-8e75-4532-8bf2-d4f510472336 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:08.848766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c45f0531-8e75-4532-8bf2-d4f510472336 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:08.849215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c45f0531-8e75-4532-8bf2-d4f510472336 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:08.849644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c45f0531-8e75-4532-8bf2-d4f510472336 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:08.984849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c45f0531-8e75-4532-8bf2-d4f510472336 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:08.993284 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c45f0531-8e75-4532-8bf2-d4f510472336 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1364 microversion: 2.1 time: 0.159938 Aug 09 15:24:08.993816 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3337/6684] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:08 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:10.015890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a3832974-b89d-4c57-be07-be5094b25245 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:10.016601 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a3832974-b89d-4c57-be07-be5094b25245 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:10.023371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3832974-b89d-4c57-be07-be5094b25245 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:10.023852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3832974-b89d-4c57-be07-be5094b25245 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:10.024286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3832974-b89d-4c57-be07-be5094b25245 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:10.024978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3832974-b89d-4c57-be07-be5094b25245 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:10.025415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3832974-b89d-4c57-be07-be5094b25245 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:10.025830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3832974-b89d-4c57-be07-be5094b25245 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:10.170009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a3832974-b89d-4c57-be07-be5094b25245 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:10.178456 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a3832974-b89d-4c57-be07-be5094b25245 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1552 microversion: 2.1 time: 0.167436 Aug 09 15:24:10.178648 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3348/6685] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:10 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:10.199312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-546ee354-71ca-4f8f-808e-7855035ee906 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:10.199851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-546ee354-71ca-4f8f-808e-7855035ee906 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:10.206975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-546ee354-71ca-4f8f-808e-7855035ee906 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:10.207497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-546ee354-71ca-4f8f-808e-7855035ee906 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:10.207939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-546ee354-71ca-4f8f-808e-7855035ee906 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:10.208668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-546ee354-71ca-4f8f-808e-7855035ee906 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:10.209123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-546ee354-71ca-4f8f-808e-7855035ee906 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:10.209594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-546ee354-71ca-4f8f-808e-7855035ee906 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:10.290151 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-546ee354-71ca-4f8f-808e-7855035ee906 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094734 Aug 09 15:24:10.290725 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3338/6686] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 15:24:10 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:24:11.284030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f469f1b3-82b0-4e33-85bd-b56131e64904 req-5079e8c2-40e1-4ece-870f-c61029d0459c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833f292c-b042-4eeb-99c1-b68002010de1", "tag": "20a716be-f190-432e-b8a9-947617b6fdd4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:24:11.294687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f469f1b3-82b0-4e33-85bd-b56131e64904 req-5079e8c2-40e1-4ece-870f-c61029d0459c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:11.295191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f469f1b3-82b0-4e33-85bd-b56131e64904 req-5079e8c2-40e1-4ece-870f-c61029d0459c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:11.295619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f469f1b3-82b0-4e33-85bd-b56131e64904 req-5079e8c2-40e1-4ece-870f-c61029d0459c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:11.310964 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f469f1b3-82b0-4e33-85bd-b56131e64904 req-5079e8c2-40e1-4ece-870f-c61029d0459c service nova] Creating event network-changed:20a716be-f190-432e-b8a9-947617b6fdd4 for instance 833f292c-b042-4eeb-99c1-b68002010de1 on n-h2-844626-8 Aug 09 15:24:11.316016 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f469f1b3-82b0-4e33-85bd-b56131e64904 req-5079e8c2-40e1-4ece-870f-c61029d0459c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035706 Aug 09 15:24:11.316665 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3349/6687] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:24:52.173168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:24:52.174145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:24:52.179538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8f3ce171-a624-4b84-8491-ca8edbcec612 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:24:52.190194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f3ce171-a624-4b84-8491-ca8edbcec612 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:52.190874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f3ce171-a624-4b84-8491-ca8edbcec612 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:52.191588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f3ce171-a624-4b84-8491-ca8edbcec612 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:52.222545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8f3ce171-a624-4b84-8491-ca8edbcec612 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Going to try to stop instance {{(pid=119406) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 15:24:52.275474 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8f3ce171-a624-4b84-8491-ca8edbcec612 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1/action" status: 202 len: 0 microversion: 2.1 time: 0.103858 Aug 09 15:24:52.276230 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3339/6688] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:24:52 2022] POST /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:24:52.284649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=19 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:24:52.285585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=48 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:24:52.291904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c99f3e51-f82c-4898-a1cd-45f7bfb6df0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:52.293086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c99f3e51-f82c-4898-a1cd-45f7bfb6df0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:52.303114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c99f3e51-f82c-4898-a1cd-45f7bfb6df0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:52.303597 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c99f3e51-f82c-4898-a1cd-45f7bfb6df0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:52.304034 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c99f3e51-f82c-4898-a1cd-45f7bfb6df0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:52.304750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c99f3e51-f82c-4898-a1cd-45f7bfb6df0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:52.305199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c99f3e51-f82c-4898-a1cd-45f7bfb6df0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:52.305611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c99f3e51-f82c-4898-a1cd-45f7bfb6df0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:52.485317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c99f3e51-f82c-4898-a1cd-45f7bfb6df0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:52.494684 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c99f3e51-f82c-4898-a1cd-45f7bfb6df0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.212844 Aug 09 15:24:52.495439 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3350/6689] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:52 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:53.518955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b43bea96-f663-4c39-98a9-b06f01e5179f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:53.519839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b43bea96-f663-4c39-98a9-b06f01e5179f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:53.527782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b43bea96-f663-4c39-98a9-b06f01e5179f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:53.528415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b43bea96-f663-4c39-98a9-b06f01e5179f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:53.528908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b43bea96-f663-4c39-98a9-b06f01e5179f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:53.529782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b43bea96-f663-4c39-98a9-b06f01e5179f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:53.530335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b43bea96-f663-4c39-98a9-b06f01e5179f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:53.530855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b43bea96-f663-4c39-98a9-b06f01e5179f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:53.697802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b43bea96-f663-4c39-98a9-b06f01e5179f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:53.706719 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b43bea96-f663-4c39-98a9-b06f01e5179f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.192100 Aug 09 15:24:53.707383 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3340/6690] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:53 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:54.728596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cab394b1-eb84-46c7-a8d4-fcea89aa1b1e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:54.729594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cab394b1-eb84-46c7-a8d4-fcea89aa1b1e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:54.738731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab394b1-eb84-46c7-a8d4-fcea89aa1b1e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:54.739293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab394b1-eb84-46c7-a8d4-fcea89aa1b1e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:54.739751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab394b1-eb84-46c7-a8d4-fcea89aa1b1e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:54.740786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab394b1-eb84-46c7-a8d4-fcea89aa1b1e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:54.741288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab394b1-eb84-46c7-a8d4-fcea89aa1b1e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:54.741846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cab394b1-eb84-46c7-a8d4-fcea89aa1b1e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:54.898418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cab394b1-eb84-46c7-a8d4-fcea89aa1b1e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:54.907243 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cab394b1-eb84-46c7-a8d4-fcea89aa1b1e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.182508 Aug 09 15:24:54.907841 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3351/6691] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:54 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:55.933668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0edfcd1-af18-4757-97cf-82c6a361295e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:55.934460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0edfcd1-af18-4757-97cf-82c6a361295e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:55.942813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0edfcd1-af18-4757-97cf-82c6a361295e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:55.943499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0edfcd1-af18-4757-97cf-82c6a361295e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:55.944080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0edfcd1-af18-4757-97cf-82c6a361295e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:55.945084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0edfcd1-af18-4757-97cf-82c6a361295e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:55.945611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0edfcd1-af18-4757-97cf-82c6a361295e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:55.946173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c0edfcd1-af18-4757-97cf-82c6a361295e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:56.137708 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0edfcd1-af18-4757-97cf-82c6a361295e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:56.147113 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0edfcd1-af18-4757-97cf-82c6a361295e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.220618 Aug 09 15:24:56.148055 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3341/6692] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:55 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:57.171723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-191c805f-7814-4d7a-b977-08c3c9854a6e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:57.172341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-191c805f-7814-4d7a-b977-08c3c9854a6e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:57.180572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-191c805f-7814-4d7a-b977-08c3c9854a6e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:57.181079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-191c805f-7814-4d7a-b977-08c3c9854a6e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:57.181506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-191c805f-7814-4d7a-b977-08c3c9854a6e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:57.182267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-191c805f-7814-4d7a-b977-08c3c9854a6e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:57.182707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-191c805f-7814-4d7a-b977-08c3c9854a6e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:57.183145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-191c805f-7814-4d7a-b977-08c3c9854a6e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:57.348560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-191c805f-7814-4d7a-b977-08c3c9854a6e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:57.357450 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-191c805f-7814-4d7a-b977-08c3c9854a6e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.189705 Aug 09 15:24:57.358067 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3352/6693] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:57 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:58.380483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-76d1abe4-586e-4b7b-b8e1-5942dc7d6bdb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:58.381398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-76d1abe4-586e-4b7b-b8e1-5942dc7d6bdb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:58.388567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76d1abe4-586e-4b7b-b8e1-5942dc7d6bdb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:58.389064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76d1abe4-586e-4b7b-b8e1-5942dc7d6bdb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:58.389503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76d1abe4-586e-4b7b-b8e1-5942dc7d6bdb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:58.390353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76d1abe4-586e-4b7b-b8e1-5942dc7d6bdb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:58.390678 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76d1abe4-586e-4b7b-b8e1-5942dc7d6bdb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:58.391176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76d1abe4-586e-4b7b-b8e1-5942dc7d6bdb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:58.576400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-76d1abe4-586e-4b7b-b8e1-5942dc7d6bdb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:58.584685 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-76d1abe4-586e-4b7b-b8e1-5942dc7d6bdb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.208209 Aug 09 15:24:58.585364 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3342/6694] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:58 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:24:59.608267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c1c15134-db12-4019-bfd1-94ba1ebf6507 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:24:59.608979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c1c15134-db12-4019-bfd1-94ba1ebf6507 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:24:59.616320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c15134-db12-4019-bfd1-94ba1ebf6507 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:59.616802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c15134-db12-4019-bfd1-94ba1ebf6507 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:59.617232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c15134-db12-4019-bfd1-94ba1ebf6507 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:59.617936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c15134-db12-4019-bfd1-94ba1ebf6507 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:24:59.618374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c15134-db12-4019-bfd1-94ba1ebf6507 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:24:59.618791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c1c15134-db12-4019-bfd1-94ba1ebf6507 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:24:59.773318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c1c15134-db12-4019-bfd1-94ba1ebf6507 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:24:59.782029 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c1c15134-db12-4019-bfd1-94ba1ebf6507 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.178259 Aug 09 15:24:59.782682 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3353/6695] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:24:59 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:00.804769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f08ad89a-73b8-4321-a0f2-da6a47941df7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:00.805537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f08ad89a-73b8-4321-a0f2-da6a47941df7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:00.814341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f08ad89a-73b8-4321-a0f2-da6a47941df7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:00.815312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f08ad89a-73b8-4321-a0f2-da6a47941df7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:00.816153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f08ad89a-73b8-4321-a0f2-da6a47941df7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:00.817464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f08ad89a-73b8-4321-a0f2-da6a47941df7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:00.818351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f08ad89a-73b8-4321-a0f2-da6a47941df7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:00.819253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f08ad89a-73b8-4321-a0f2-da6a47941df7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:01.084643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f08ad89a-73b8-4321-a0f2-da6a47941df7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:01.093572 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f08ad89a-73b8-4321-a0f2-da6a47941df7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.293036 Aug 09 15:25:01.094178 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3343/6696] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:00 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:02.125024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2b35660f-0f5b-42dc-9219-31cb5bdc77b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:02.125612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2b35660f-0f5b-42dc-9219-31cb5bdc77b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:02.132976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b35660f-0f5b-42dc-9219-31cb5bdc77b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:02.133568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b35660f-0f5b-42dc-9219-31cb5bdc77b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:02.134017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b35660f-0f5b-42dc-9219-31cb5bdc77b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:02.134696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b35660f-0f5b-42dc-9219-31cb5bdc77b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:02.135172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b35660f-0f5b-42dc-9219-31cb5bdc77b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:02.135587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2b35660f-0f5b-42dc-9219-31cb5bdc77b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:02.292613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2b35660f-0f5b-42dc-9219-31cb5bdc77b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:02.302053 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2b35660f-0f5b-42dc-9219-31cb5bdc77b8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.182389 Aug 09 15:25:02.302894 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3354/6697] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:02 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:03.325324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cc85c10b-eebd-4b19-a73f-bc79b9b19ff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:03.325965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cc85c10b-eebd-4b19-a73f-bc79b9b19ff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:03.334307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc85c10b-eebd-4b19-a73f-bc79b9b19ff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:03.334849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc85c10b-eebd-4b19-a73f-bc79b9b19ff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:03.335393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc85c10b-eebd-4b19-a73f-bc79b9b19ff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:03.336130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc85c10b-eebd-4b19-a73f-bc79b9b19ff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:03.336625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc85c10b-eebd-4b19-a73f-bc79b9b19ff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:03.337073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cc85c10b-eebd-4b19-a73f-bc79b9b19ff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:03.520513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cc85c10b-eebd-4b19-a73f-bc79b9b19ff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:03.535212 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cc85c10b-eebd-4b19-a73f-bc79b9b19ff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.213570 Aug 09 15:25:03.536345 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3344/6698] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:03 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:04.558256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5f0abdd4-89b4-44a7-b509-1bfb5ff1070c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:04.559031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5f0abdd4-89b4-44a7-b509-1bfb5ff1070c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:04.566815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f0abdd4-89b4-44a7-b509-1bfb5ff1070c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:04.567354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f0abdd4-89b4-44a7-b509-1bfb5ff1070c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:04.567786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f0abdd4-89b4-44a7-b509-1bfb5ff1070c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:04.568501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f0abdd4-89b4-44a7-b509-1bfb5ff1070c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:04.568948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f0abdd4-89b4-44a7-b509-1bfb5ff1070c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:04.569362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5f0abdd4-89b4-44a7-b509-1bfb5ff1070c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:04.721587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5f0abdd4-89b4-44a7-b509-1bfb5ff1070c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:04.730285 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5f0abdd4-89b4-44a7-b509-1bfb5ff1070c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.176017 Aug 09 15:25:04.730870 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3355/6699] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:04 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:05.752916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b50143f4-1831-4d5c-8ef9-944b2edcff06 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:05.753661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b50143f4-1831-4d5c-8ef9-944b2edcff06 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:05.761538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b50143f4-1831-4d5c-8ef9-944b2edcff06 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:05.762045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b50143f4-1831-4d5c-8ef9-944b2edcff06 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:05.762492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b50143f4-1831-4d5c-8ef9-944b2edcff06 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:05.763278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b50143f4-1831-4d5c-8ef9-944b2edcff06 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:05.763744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b50143f4-1831-4d5c-8ef9-944b2edcff06 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:05.764183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b50143f4-1831-4d5c-8ef9-944b2edcff06 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:05.929809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b50143f4-1831-4d5c-8ef9-944b2edcff06 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:05.943556 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b50143f4-1831-4d5c-8ef9-944b2edcff06 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.194146 Aug 09 15:25:05.944750 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3345/6700] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:05 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:06.980220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fd2d7712-06f2-4792-92ee-caa18875775e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:06.980840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fd2d7712-06f2-4792-92ee-caa18875775e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:06.989197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd2d7712-06f2-4792-92ee-caa18875775e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:06.989707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd2d7712-06f2-4792-92ee-caa18875775e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:06.990148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd2d7712-06f2-4792-92ee-caa18875775e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:06.990933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd2d7712-06f2-4792-92ee-caa18875775e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:06.991565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd2d7712-06f2-4792-92ee-caa18875775e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:06.991995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd2d7712-06f2-4792-92ee-caa18875775e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:07.158432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fd2d7712-06f2-4792-92ee-caa18875775e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:07.166939 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fd2d7712-06f2-4792-92ee-caa18875775e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.191331 Aug 09 15:25:07.167670 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3356/6701] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:06 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:08.194172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5159b424-ddd3-44cd-b4a9-0b10810ec902 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:08.195441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5159b424-ddd3-44cd-b4a9-0b10810ec902 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:08.208410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5159b424-ddd3-44cd-b4a9-0b10810ec902 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:08.209362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5159b424-ddd3-44cd-b4a9-0b10810ec902 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:08.210482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5159b424-ddd3-44cd-b4a9-0b10810ec902 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:08.211946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5159b424-ddd3-44cd-b4a9-0b10810ec902 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:08.212817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5159b424-ddd3-44cd-b4a9-0b10810ec902 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:08.213662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5159b424-ddd3-44cd-b4a9-0b10810ec902 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:08.412662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5159b424-ddd3-44cd-b4a9-0b10810ec902 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:08.428326 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5159b424-ddd3-44cd-b4a9-0b10810ec902 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1658 microversion: 2.1 time: 0.241955 Aug 09 15:25:08.429637 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3346/6702] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:08 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1658 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:08.452297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:25:08.454636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:08.462157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:08.462644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:08.463122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:08.463833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:08.464286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:08.464709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:08.498076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:08.505247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Old instance type m1.heat2, new instance type m1.heat {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 15:25:08.512815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:25:08.513231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:25:08.513707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:25:08.514117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:25:08.514521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:25:08.587821 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7539537c-d09d-45c2-8e41-24f746eee56b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1/action" status: 202 len: 0 microversion: 2.1 time: 0.139849 Aug 09 15:25:08.588364 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3357/6703] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:25:08 2022] POST /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:25:08.600356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-73055ec7-81df-4d7a-953b-8d91e58318c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:08.601956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-73055ec7-81df-4d7a-953b-8d91e58318c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:08.616408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73055ec7-81df-4d7a-953b-8d91e58318c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:08.617317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73055ec7-81df-4d7a-953b-8d91e58318c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:08.618157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73055ec7-81df-4d7a-953b-8d91e58318c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:08.619495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73055ec7-81df-4d7a-953b-8d91e58318c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:08.620347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73055ec7-81df-4d7a-953b-8d91e58318c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:08.621150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-73055ec7-81df-4d7a-953b-8d91e58318c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:08.844640 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-73055ec7-81df-4d7a-953b-8d91e58318c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:08.853127 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-73055ec7-81df-4d7a-953b-8d91e58318c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.259927 Aug 09 15:25:08.854140 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3347/6704] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:08 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:09.884577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-451744ae-8930-48a6-97ef-3993e8f6e69d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:09.885689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-451744ae-8930-48a6-97ef-3993e8f6e69d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:09.896813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-451744ae-8930-48a6-97ef-3993e8f6e69d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:09.897806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-451744ae-8930-48a6-97ef-3993e8f6e69d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:09.898590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-451744ae-8930-48a6-97ef-3993e8f6e69d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:09.899888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-451744ae-8930-48a6-97ef-3993e8f6e69d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:09.900773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-451744ae-8930-48a6-97ef-3993e8f6e69d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:09.901570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-451744ae-8930-48a6-97ef-3993e8f6e69d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:10.072066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-451744ae-8930-48a6-97ef-3993e8f6e69d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:10.080903 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-451744ae-8930-48a6-97ef-3993e8f6e69d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1681 microversion: 2.1 time: 0.204472 Aug 09 15:25:10.081627 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3358/6705] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:09 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:11.103204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c5491d58-5215-463d-ad70-a7252af846d5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:11.104111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c5491d58-5215-463d-ad70-a7252af846d5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:11.113791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5491d58-5215-463d-ad70-a7252af846d5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:11.114298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5491d58-5215-463d-ad70-a7252af846d5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:11.114751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5491d58-5215-463d-ad70-a7252af846d5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:11.115529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5491d58-5215-463d-ad70-a7252af846d5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:11.115996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5491d58-5215-463d-ad70-a7252af846d5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:11.116535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c5491d58-5215-463d-ad70-a7252af846d5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:11.272364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c5491d58-5215-463d-ad70-a7252af846d5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:11.280834 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c5491d58-5215-463d-ad70-a7252af846d5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1686 microversion: 2.1 time: 0.181765 Aug 09 15:25:11.281492 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3348/6706] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:11 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1686 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:12.304438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-06df0f23-722f-473f-85f3-436deb0dfd8d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:12.305278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-06df0f23-722f-473f-85f3-436deb0dfd8d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:12.312807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06df0f23-722f-473f-85f3-436deb0dfd8d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:12.313298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06df0f23-722f-473f-85f3-436deb0dfd8d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:12.313763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06df0f23-722f-473f-85f3-436deb0dfd8d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:12.314476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06df0f23-722f-473f-85f3-436deb0dfd8d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:12.314923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06df0f23-722f-473f-85f3-436deb0dfd8d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:12.315380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-06df0f23-722f-473f-85f3-436deb0dfd8d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:12.475155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-06df0f23-722f-473f-85f3-436deb0dfd8d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:12.489647 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-06df0f23-722f-473f-85f3-436deb0dfd8d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1686 microversion: 2.1 time: 0.189088 Aug 09 15:25:12.490699 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3359/6707] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:12 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1686 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:13.513713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fbfa1482-0fad-4336-b4c2-c8a82dc15934 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:13.514514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fbfa1482-0fad-4336-b4c2-c8a82dc15934 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:13.523139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbfa1482-0fad-4336-b4c2-c8a82dc15934 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:13.523629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbfa1482-0fad-4336-b4c2-c8a82dc15934 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:13.524079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbfa1482-0fad-4336-b4c2-c8a82dc15934 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:13.524815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbfa1482-0fad-4336-b4c2-c8a82dc15934 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:13.525291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbfa1482-0fad-4336-b4c2-c8a82dc15934 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:13.525763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fbfa1482-0fad-4336-b4c2-c8a82dc15934 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:13.732604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fbfa1482-0fad-4336-b4c2-c8a82dc15934 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:13.748015 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fbfa1482-0fad-4336-b4c2-c8a82dc15934 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1685 microversion: 2.1 time: 0.238555 Aug 09 15:25:13.749022 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3349/6708] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:13 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1685 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:14.126530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9840d901-84c3-401e-bea7-55ac58595c54 req-0123952d-36c6-46e6-8f80-e469115b8ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833f292c-b042-4eeb-99c1-b68002010de1", "name": "network-vif-unplugged", "status": "completed", "tag": "20a716be-f190-432e-b8a9-947617b6fdd4"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:25:14.137438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9840d901-84c3-401e-bea7-55ac58595c54 req-0123952d-36c6-46e6-8f80-e469115b8ea2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:14.137926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9840d901-84c3-401e-bea7-55ac58595c54 req-0123952d-36c6-46e6-8f80-e469115b8ea2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:14.138350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9840d901-84c3-401e-bea7-55ac58595c54 req-0123952d-36c6-46e6-8f80-e469115b8ea2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:14.151957 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9840d901-84c3-401e-bea7-55ac58595c54 req-0123952d-36c6-46e6-8f80-e469115b8ea2 service nova] Creating event network-vif-unplugged:20a716be-f190-432e-b8a9-947617b6fdd4 for instance 833f292c-b042-4eeb-99c1-b68002010de1 on n-h1-844626-8 Aug 09 15:25:14.158701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-9840d901-84c3-401e-bea7-55ac58595c54 req-0123952d-36c6-46e6-8f80-e469115b8ea2 service nova] Instance 833f292c-b042-4eeb-99c1-b68002010de1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:25:14.171672 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9840d901-84c3-401e-bea7-55ac58595c54 req-0123952d-36c6-46e6-8f80-e469115b8ea2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139432 Aug 09 15:25:14.172423 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3360/6709] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:25:14.777361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3e76bdfc-c319-4725-81a9-ce08668a6cd9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:14.778412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3e76bdfc-c319-4725-81a9-ce08668a6cd9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:14.790139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e76bdfc-c319-4725-81a9-ce08668a6cd9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:14.790976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e76bdfc-c319-4725-81a9-ce08668a6cd9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:14.792003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e76bdfc-c319-4725-81a9-ce08668a6cd9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:14.793267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e76bdfc-c319-4725-81a9-ce08668a6cd9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:14.794112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e76bdfc-c319-4725-81a9-ce08668a6cd9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:14.794912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e76bdfc-c319-4725-81a9-ce08668a6cd9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:15.014424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3e76bdfc-c319-4725-81a9-ce08668a6cd9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:15.023252 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3e76bdfc-c319-4725-81a9-ce08668a6cd9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1685 microversion: 2.1 time: 0.251462 Aug 09 15:25:15.024153 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3350/6710] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:14 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1685 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:16.048381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-462c353e-93c1-4071-8890-89215356725b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:16.049118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-462c353e-93c1-4071-8890-89215356725b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:16.056770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-462c353e-93c1-4071-8890-89215356725b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:16.057331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-462c353e-93c1-4071-8890-89215356725b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:16.057803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-462c353e-93c1-4071-8890-89215356725b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:16.058571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-462c353e-93c1-4071-8890-89215356725b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:16.059061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-462c353e-93c1-4071-8890-89215356725b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:16.059629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-462c353e-93c1-4071-8890-89215356725b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:16.202216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-838e9116-1595-49e4-bc02-61685363c2f9 req-bad38b7a-e0b3-4505-b337-c0838cc341c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833f292c-b042-4eeb-99c1-b68002010de1", "tag": "20a716be-f190-432e-b8a9-947617b6fdd4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:25:16.217882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-838e9116-1595-49e4-bc02-61685363c2f9 req-bad38b7a-e0b3-4505-b337-c0838cc341c7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:16.218786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-838e9116-1595-49e4-bc02-61685363c2f9 req-bad38b7a-e0b3-4505-b337-c0838cc341c7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:16.219638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-838e9116-1595-49e4-bc02-61685363c2f9 req-bad38b7a-e0b3-4505-b337-c0838cc341c7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:16.228180 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-462c353e-93c1-4071-8890-89215356725b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:16.236767 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-838e9116-1595-49e4-bc02-61685363c2f9 req-bad38b7a-e0b3-4505-b337-c0838cc341c7 service nova] Creating event network-changed:20a716be-f190-432e-b8a9-947617b6fdd4 for instance 833f292c-b042-4eeb-99c1-b68002010de1 on n-h1-844626-8 Aug 09 15:25:16.238331 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-462c353e-93c1-4071-8890-89215356725b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1683 microversion: 2.1 time: 0.195493 Aug 09 15:25:16.239363 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3361/6711] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:16 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1683 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:16.247519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-838e9116-1595-49e4-bc02-61685363c2f9 req-bad38b7a-e0b3-4505-b337-c0838cc341c7 service nova] Instance 833f292c-b042-4eeb-99c1-b68002010de1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:25:16.264181 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-838e9116-1595-49e4-bc02-61685363c2f9 req-bad38b7a-e0b3-4505-b337-c0838cc341c7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066726 Aug 09 15:25:16.264828 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3351/6712] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:25:17.261761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-85d3162c-4e14-4ca3-98a2-fbd88c3adc05 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:17.262404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-85d3162c-4e14-4ca3-98a2-fbd88c3adc05 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:17.270488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d3162c-4e14-4ca3-98a2-fbd88c3adc05 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:17.270986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d3162c-4e14-4ca3-98a2-fbd88c3adc05 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:17.271463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d3162c-4e14-4ca3-98a2-fbd88c3adc05 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:17.272301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d3162c-4e14-4ca3-98a2-fbd88c3adc05 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:17.272819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d3162c-4e14-4ca3-98a2-fbd88c3adc05 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:17.273248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-85d3162c-4e14-4ca3-98a2-fbd88c3adc05 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:17.429203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-85d3162c-4e14-4ca3-98a2-fbd88c3adc05 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:17.437817 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-85d3162c-4e14-4ca3-98a2-fbd88c3adc05 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1679 microversion: 2.1 time: 0.180084 Aug 09 15:25:17.438390 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3362/6713] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:17 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:17.461900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9be9b509-01da-4e0b-b872-2b44c82604e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:25:17.462778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9be9b509-01da-4e0b-b872-2b44c82604e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:17.469742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9be9b509-01da-4e0b-b872-2b44c82604e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:17.470260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9be9b509-01da-4e0b-b872-2b44c82604e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:17.470710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9be9b509-01da-4e0b-b872-2b44c82604e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:17.471488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9be9b509-01da-4e0b-b872-2b44c82604e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:17.471959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9be9b509-01da-4e0b-b872-2b44c82604e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:17.472407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9be9b509-01da-4e0b-b872-2b44c82604e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:17.545558 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9be9b509-01da-4e0b-b872-2b44c82604e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1/action" status: 204 len: 0 microversion: 2.1 time: 0.088762 Aug 09 15:25:17.546122 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3352/6714] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:25:17 2022] POST /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 15:25:17.555008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe9a7571-1ef0-457f-b64c-ef8572d1f083 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:17.555869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe9a7571-1ef0-457f-b64c-ef8572d1f083 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:17.563037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe9a7571-1ef0-457f-b64c-ef8572d1f083 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:17.563572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe9a7571-1ef0-457f-b64c-ef8572d1f083 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:17.563996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe9a7571-1ef0-457f-b64c-ef8572d1f083 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:17.564733 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe9a7571-1ef0-457f-b64c-ef8572d1f083 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:17.565185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe9a7571-1ef0-457f-b64c-ef8572d1f083 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:17.565643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe9a7571-1ef0-457f-b64c-ef8572d1f083 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:17.821970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fe9a7571-1ef0-457f-b64c-ef8572d1f083 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:17.830854 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe9a7571-1ef0-457f-b64c-ef8572d1f083 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1679 microversion: 2.1 time: 0.280008 Aug 09 15:25:17.831711 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3363/6715] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:17 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1679 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:25:18.856096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-42ab18e5-7d0e-4b32-9616-2fea7e532159 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:18.856748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-42ab18e5-7d0e-4b32-9616-2fea7e532159 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:18.865152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ab18e5-7d0e-4b32-9616-2fea7e532159 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:18.865725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ab18e5-7d0e-4b32-9616-2fea7e532159 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:18.866261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ab18e5-7d0e-4b32-9616-2fea7e532159 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:18.867122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ab18e5-7d0e-4b32-9616-2fea7e532159 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:18.867715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ab18e5-7d0e-4b32-9616-2fea7e532159 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:18.868241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-42ab18e5-7d0e-4b32-9616-2fea7e532159 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:19.050704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-42ab18e5-7d0e-4b32-9616-2fea7e532159 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:19.053624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:25:19.063753 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-42ab18e5-7d0e-4b32-9616-2fea7e532159 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1679 microversion: 2.1 time: 0.212581 Aug 09 15:25:19.064557 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3353/6716] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:18 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:20.088791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-10287e89-6019-4c63-8154-f0e5f776e260 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:20.089879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-10287e89-6019-4c63-8154-f0e5f776e260 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:20.101702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10287e89-6019-4c63-8154-f0e5f776e260 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:20.102392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10287e89-6019-4c63-8154-f0e5f776e260 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:20.103000 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10287e89-6019-4c63-8154-f0e5f776e260 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:20.104588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10287e89-6019-4c63-8154-f0e5f776e260 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:20.105290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10287e89-6019-4c63-8154-f0e5f776e260 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:20.105852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-10287e89-6019-4c63-8154-f0e5f776e260 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:20.328976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-10287e89-6019-4c63-8154-f0e5f776e260 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:20.338114 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-10287e89-6019-4c63-8154-f0e5f776e260 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1658 microversion: 2.1 time: 0.255096 Aug 09 15:25:20.339811 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3364/6717] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:20 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1658 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:20.373912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-783efb9e-c935-4068-af31-0e1fa90e69ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:20.374544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-783efb9e-c935-4068-af31-0e1fa90e69ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:20.377443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b1a531c5-29db-48f6-a952-eaaea7db21e0 req-1b814452-3af3-48b2-b724-7e83c407b75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833f292c-b042-4eeb-99c1-b68002010de1", "name": "network-vif-plugged", "status": "completed", "tag": "20a716be-f190-432e-b8a9-947617b6fdd4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:25:20.390191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b1a531c5-29db-48f6-a952-eaaea7db21e0 req-1b814452-3af3-48b2-b724-7e83c407b75e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:20.390898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b1a531c5-29db-48f6-a952-eaaea7db21e0 req-1b814452-3af3-48b2-b724-7e83c407b75e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:20.391550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b1a531c5-29db-48f6-a952-eaaea7db21e0 req-1b814452-3af3-48b2-b724-7e83c407b75e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:20.391734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783efb9e-c935-4068-af31-0e1fa90e69ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:20.392451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783efb9e-c935-4068-af31-0e1fa90e69ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:20.393266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783efb9e-c935-4068-af31-0e1fa90e69ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:20.394540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783efb9e-c935-4068-af31-0e1fa90e69ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:20.395756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783efb9e-c935-4068-af31-0e1fa90e69ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:20.396538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-783efb9e-c935-4068-af31-0e1fa90e69ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:20.407984 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b1a531c5-29db-48f6-a952-eaaea7db21e0 req-1b814452-3af3-48b2-b724-7e83c407b75e service nova] Creating event network-vif-plugged:20a716be-f190-432e-b8a9-947617b6fdd4 for instance 833f292c-b042-4eeb-99c1-b68002010de1 on n-h1-844626-8 Aug 09 15:25:20.413828 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b1a531c5-29db-48f6-a952-eaaea7db21e0 req-1b814452-3af3-48b2-b724-7e83c407b75e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156757 Aug 09 15:25:20.414476 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3354/6718] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:25:20.431905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:25:20.581685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-783efb9e-c935-4068-af31-0e1fa90e69ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:20.596917 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-783efb9e-c935-4068-af31-0e1fa90e69ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1658 microversion: 2.1 time: 0.227051 Aug 09 15:25:20.597992 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3365/6719] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:20 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1658 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:25:20.638384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a67b5897-fb70-4da4-8567-2e8069c8410e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:25:20.650939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a67b5897-fb70-4da4-8567-2e8069c8410e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:20.651831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a67b5897-fb70-4da4-8567-2e8069c8410e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:20.652620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a67b5897-fb70-4da4-8567-2e8069c8410e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:20.695307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a67b5897-fb70-4da4-8567-2e8069c8410e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Going to try to start instance {{(pid=119406) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 15:25:20.749540 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a67b5897-fb70-4da4-8567-2e8069c8410e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1/action" status: 202 len: 0 microversion: 2.1 time: 0.120281 Aug 09 15:25:20.750185 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3355/6720] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:25:20 2022] POST /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:25:20.763344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-35b6b701-0166-425c-b458-e02b49988699 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:20.764512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-35b6b701-0166-425c-b458-e02b49988699 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:20.775710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35b6b701-0166-425c-b458-e02b49988699 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:20.776548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35b6b701-0166-425c-b458-e02b49988699 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:20.777311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35b6b701-0166-425c-b458-e02b49988699 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:20.778524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35b6b701-0166-425c-b458-e02b49988699 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:20.779421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35b6b701-0166-425c-b458-e02b49988699 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:20.780177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-35b6b701-0166-425c-b458-e02b49988699 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:20.959842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-35b6b701-0166-425c-b458-e02b49988699 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:20.968757 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-35b6b701-0166-425c-b458-e02b49988699 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1667 microversion: 2.1 time: 0.213063 Aug 09 15:25:20.969349 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3366/6721] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:20 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1667 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:21.995449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b3b6e5c-f67b-44c3-9633-7bd22e60f621 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:21.996385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b3b6e5c-f67b-44c3-9633-7bd22e60f621 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:22.006404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b3b6e5c-f67b-44c3-9633-7bd22e60f621 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:22.007122 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b3b6e5c-f67b-44c3-9633-7bd22e60f621 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:22.007781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b3b6e5c-f67b-44c3-9633-7bd22e60f621 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:22.008600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b3b6e5c-f67b-44c3-9633-7bd22e60f621 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:22.009119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b3b6e5c-f67b-44c3-9633-7bd22e60f621 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:22.009681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b3b6e5c-f67b-44c3-9633-7bd22e60f621 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:22.189680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0b3b6e5c-f67b-44c3-9633-7bd22e60f621 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:22.199174 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b3b6e5c-f67b-44c3-9633-7bd22e60f621 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1671 microversion: 2.1 time: 0.209726 Aug 09 15:25:22.199795 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3356/6722] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:21 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:22.239149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-125ff2ba-b71c-4c4e-85dc-70e8790d9005 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:22.240006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-125ff2ba-b71c-4c4e-85dc-70e8790d9005 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:22.252526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-125ff2ba-b71c-4c4e-85dc-70e8790d9005 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:22.253266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-125ff2ba-b71c-4c4e-85dc-70e8790d9005 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:22.254027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-125ff2ba-b71c-4c4e-85dc-70e8790d9005 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:22.255267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-125ff2ba-b71c-4c4e-85dc-70e8790d9005 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:22.255945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-125ff2ba-b71c-4c4e-85dc-70e8790d9005 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:22.256783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-125ff2ba-b71c-4c4e-85dc-70e8790d9005 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:22.289583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-125ff2ba-b71c-4c4e-85dc-70e8790d9005 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:25:22.366939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=41 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:25:22.391732 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-125ff2ba-b71c-4c4e-85dc-70e8790d9005 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "DELETE /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 204 len: 0 microversion: 2.1 time: 0.158541 Aug 09 15:25:22.393178 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3367/6723] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:25:22 2022] DELETE /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:25:22.407380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87866053-45fc-483e-ab4a-8d9dc786bd1c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:22.408489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-87866053-45fc-483e-ab4a-8d9dc786bd1c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:22.412091 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=37 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:25:22.422501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87866053-45fc-483e-ab4a-8d9dc786bd1c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:22.423445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87866053-45fc-483e-ab4a-8d9dc786bd1c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:22.424239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87866053-45fc-483e-ab4a-8d9dc786bd1c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:22.425506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87866053-45fc-483e-ab4a-8d9dc786bd1c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:22.426352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87866053-45fc-483e-ab4a-8d9dc786bd1c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:22.427036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-87866053-45fc-483e-ab4a-8d9dc786bd1c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:22.633731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-87866053-45fc-483e-ab4a-8d9dc786bd1c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:22.648064 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87866053-45fc-483e-ab4a-8d9dc786bd1c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1677 microversion: 2.1 time: 0.247320 Aug 09 15:25:22.649153 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3357/6724] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:22 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:25:23.684672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-aa2c8c24-61c6-44a3-8a16-dc33148cbf02 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:23.685538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-aa2c8c24-61c6-44a3-8a16-dc33148cbf02 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:23.694524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa2c8c24-61c6-44a3-8a16-dc33148cbf02 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:23.695023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa2c8c24-61c6-44a3-8a16-dc33148cbf02 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:23.695555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa2c8c24-61c6-44a3-8a16-dc33148cbf02 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:23.696407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa2c8c24-61c6-44a3-8a16-dc33148cbf02 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:23.696977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa2c8c24-61c6-44a3-8a16-dc33148cbf02 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:23.698006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-aa2c8c24-61c6-44a3-8a16-dc33148cbf02 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:24.181242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-aa2c8c24-61c6-44a3-8a16-dc33148cbf02 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:24.192798 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-aa2c8c24-61c6-44a3-8a16-dc33148cbf02 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 200 len: 1677 microversion: 2.1 time: 0.513030 Aug 09 15:25:24.193513 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3368/6725] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:23 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 1677 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:24.922100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-3a4cfe4c-bc16-48ff-bdc0-0536a0024801 req-3c56c2cd-6b09-4acc-8da4-c8db4115c24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833f292c-b042-4eeb-99c1-b68002010de1", "name": "network-vif-deleted", "tag": "20a716be-f190-432e-b8a9-947617b6fdd4"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:25:24.935895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3a4cfe4c-bc16-48ff-bdc0-0536a0024801 req-3c56c2cd-6b09-4acc-8da4-c8db4115c24f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:24.936387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3a4cfe4c-bc16-48ff-bdc0-0536a0024801 req-3c56c2cd-6b09-4acc-8da4-c8db4115c24f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:24.936822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3a4cfe4c-bc16-48ff-bdc0-0536a0024801 req-3c56c2cd-6b09-4acc-8da4-c8db4115c24f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:24.950409 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3a4cfe4c-bc16-48ff-bdc0-0536a0024801 req-3c56c2cd-6b09-4acc-8da4-c8db4115c24f service nova] Creating event network-vif-deleted:20a716be-f190-432e-b8a9-947617b6fdd4 for instance 833f292c-b042-4eeb-99c1-b68002010de1 on n-h1-844626-8 Aug 09 15:25:24.959951 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-3a4cfe4c-bc16-48ff-bdc0-0536a0024801 req-3c56c2cd-6b09-4acc-8da4-c8db4115c24f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041310 Aug 09 15:25:24.961164 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3358/6726] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:25:25.235118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2dceec3b-c133-4860-981f-48d2e35b189f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:25.236287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2dceec3b-c133-4860-981f-48d2e35b189f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:25.250343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dceec3b-c133-4860-981f-48d2e35b189f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:25.251203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dceec3b-c133-4860-981f-48d2e35b189f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:25.252224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dceec3b-c133-4860-981f-48d2e35b189f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:25.253511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dceec3b-c133-4860-981f-48d2e35b189f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:25.254338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dceec3b-c133-4860-981f-48d2e35b189f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:25.255346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2dceec3b-c133-4860-981f-48d2e35b189f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:25.282225 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-2dceec3b-c133-4860-981f-48d2e35b189f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2dceec3b-c133-4860-981f-48d2e35b189f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 HTTP/1.1 Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '833f292c-b042-4eeb-99c1-b68002010de1'} Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:25:25.284266 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:25:25.289809 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:25:25.289809 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:25:25.289809 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:25:25.289809 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:25:25.289809 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:25:25.289809 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:25:25.289809 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:25:25.289809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2dceec3b-c133-4860-981f-48d2e35b189f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:25:25.289809 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2dceec3b-c133-4860-981f-48d2e35b189f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 404 len: 111 microversion: 2.1 time: 0.058997 Aug 09 15:25:25.289809 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3369/6727] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:25 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:25:25.310028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13bdc029-6cc9-49bc-8296-a9490fbde78b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:25.311060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-13bdc029-6cc9-49bc-8296-a9490fbde78b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:25.319522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13bdc029-6cc9-49bc-8296-a9490fbde78b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:25.320204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13bdc029-6cc9-49bc-8296-a9490fbde78b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:25.320768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13bdc029-6cc9-49bc-8296-a9490fbde78b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:25.322244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13bdc029-6cc9-49bc-8296-a9490fbde78b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:25.322894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13bdc029-6cc9-49bc-8296-a9490fbde78b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:25.323489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13bdc029-6cc9-49bc-8296-a9490fbde78b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:25.342834 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-13bdc029-6cc9-49bc-8296-a9490fbde78b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13bdc029-6cc9-49bc-8296-a9490fbde78b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 HTTP/1.1 Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '833f292c-b042-4eeb-99c1-b68002010de1'} Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:25:25.344588 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:25:25.349085 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:25:25.349085 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:25:25.349085 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:25:25.349085 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:25:25.349085 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:25:25.349085 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:25:25.349085 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:25:25.349085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13bdc029-6cc9-49bc-8296-a9490fbde78b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:25:25.349085 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-13bdc029-6cc9-49bc-8296-a9490fbde78b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 404 len: 111 microversion: 2.1 time: 0.042214 Aug 09 15:25:25.349085 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3359/6728] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:25 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:25:25.400927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-269287689", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "38bb04fc-70f1-41b1-aef0-d31c411f18a0"}], "security_groups": [{"name": "tempest-securitygroup--1420965144"}], "key_name": "tempest-keypair-1527801048", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:25:25.580974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] validate_networks() for [('38bb04fc-70f1-41b1-aef0-d31c411f18a0', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:25:26.152402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:25:26.152996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:25:26.153469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:25:26.153873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:25:26.154284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:25:26.169066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:26.169896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:26.170684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:26.172368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:26.173145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:26.173882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:26.205745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:25:26.217558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for user 127998e24ecf48d58f3c789530f89898 and project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:25:26.245290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:25:26.249627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:25:26.323248 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4f889b6-b50d-4bd1-9452-f56e7b09a2fd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.926408 Aug 09 15:25:26.330724 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3370/6729] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:25:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:25:26.339451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-737590ed-07be-4a06-a990-4d2fcb9d0a29 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:26.340756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-737590ed-07be-4a06-a990-4d2fcb9d0a29 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:26.443656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-737590ed-07be-4a06-a990-4d2fcb9d0a29 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:26.461222 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-737590ed-07be-4a06-a990-4d2fcb9d0a29 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1238 microversion: 2.1 time: 0.128436 Aug 09 15:25:26.462925 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3360/6730] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:26 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1238 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:25:27.501950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-79daeaa2-9541-47d3-a259-5e39d46e147a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:27.503117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-79daeaa2-9541-47d3-a259-5e39d46e147a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:27.514912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79daeaa2-9541-47d3-a259-5e39d46e147a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:27.515816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79daeaa2-9541-47d3-a259-5e39d46e147a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:27.516598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79daeaa2-9541-47d3-a259-5e39d46e147a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:27.517894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79daeaa2-9541-47d3-a259-5e39d46e147a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:27.518730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79daeaa2-9541-47d3-a259-5e39d46e147a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:27.519555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-79daeaa2-9541-47d3-a259-5e39d46e147a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:27.626020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-79daeaa2-9541-47d3-a259-5e39d46e147a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:27.639577 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-79daeaa2-9541-47d3-a259-5e39d46e147a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1290 microversion: 2.1 time: 0.146480 Aug 09 15:25:27.640560 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3371/6731] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:27 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1290 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:27.670166 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:25:27.670718 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:25:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:25:28.662971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1b09019a-5c9b-489d-86e3-a94b1440dbca tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:28.663843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1b09019a-5c9b-489d-86e3-a94b1440dbca tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:28.672861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b09019a-5c9b-489d-86e3-a94b1440dbca tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:28.674227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b09019a-5c9b-489d-86e3-a94b1440dbca tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:28.674227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b09019a-5c9b-489d-86e3-a94b1440dbca tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:28.674969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b09019a-5c9b-489d-86e3-a94b1440dbca tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:28.675547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b09019a-5c9b-489d-86e3-a94b1440dbca tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:28.676093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1b09019a-5c9b-489d-86e3-a94b1440dbca tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:29.070871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1b09019a-5c9b-489d-86e3-a94b1440dbca tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:29.079848 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1b09019a-5c9b-489d-86e3-a94b1440dbca tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1364 microversion: 2.1 time: 0.421474 Aug 09 15:25:29.080452 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3361/6732] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:28 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1364 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:29.753971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a9fdf046-ecd4-4488-b558-2d48ee7fafc9 req-62cf6a38-adeb-4e0e-8121-2133080f2d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa66cd24-46d6-4815-a1ab-020369fdc638", "tag": "a140e4d3-bf2e-4d6d-91db-845b6e14ff4c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:25:29.770835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a9fdf046-ecd4-4488-b558-2d48ee7fafc9 req-62cf6a38-adeb-4e0e-8121-2133080f2d2a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:29.772551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a9fdf046-ecd4-4488-b558-2d48ee7fafc9 req-62cf6a38-adeb-4e0e-8121-2133080f2d2a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:29.773608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a9fdf046-ecd4-4488-b558-2d48ee7fafc9 req-62cf6a38-adeb-4e0e-8121-2133080f2d2a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:29.795521 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a9fdf046-ecd4-4488-b558-2d48ee7fafc9 req-62cf6a38-adeb-4e0e-8121-2133080f2d2a service nova] Creating event network-changed:a140e4d3-bf2e-4d6d-91db-845b6e14ff4c for instance fa66cd24-46d6-4815-a1ab-020369fdc638 on n-h2-844626-8 Aug 09 15:25:29.804866 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a9fdf046-ecd4-4488-b558-2d48ee7fafc9 req-62cf6a38-adeb-4e0e-8121-2133080f2d2a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055618 Aug 09 15:25:29.805944 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3372/6733] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:25:30.108189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e672ae18-077a-48d0-a05e-fd6651fe586c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:30.109400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e672ae18-077a-48d0-a05e-fd6651fe586c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:30.122515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e672ae18-077a-48d0-a05e-fd6651fe586c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:30.123548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e672ae18-077a-48d0-a05e-fd6651fe586c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:30.124361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e672ae18-077a-48d0-a05e-fd6651fe586c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:30.125664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e672ae18-077a-48d0-a05e-fd6651fe586c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:30.126567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e672ae18-077a-48d0-a05e-fd6651fe586c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:30.127398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e672ae18-077a-48d0-a05e-fd6651fe586c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:30.402075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e672ae18-077a-48d0-a05e-fd6651fe586c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:30.416902 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e672ae18-077a-48d0-a05e-fd6651fe586c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1364 microversion: 2.1 time: 0.316915 Aug 09 15:25:30.418050 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3362/6734] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:30 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1364 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:31.442256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-335eb215-a023-42a3-ab98-b66ce63efbf7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:31.443009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-335eb215-a023-42a3-ab98-b66ce63efbf7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:31.451445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-335eb215-a023-42a3-ab98-b66ce63efbf7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:31.451952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-335eb215-a023-42a3-ab98-b66ce63efbf7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:31.452391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-335eb215-a023-42a3-ab98-b66ce63efbf7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:31.453140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-335eb215-a023-42a3-ab98-b66ce63efbf7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:31.453600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-335eb215-a023-42a3-ab98-b66ce63efbf7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:31.454033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-335eb215-a023-42a3-ab98-b66ce63efbf7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:31.690295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-335eb215-a023-42a3-ab98-b66ce63efbf7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:31.699406 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-335eb215-a023-42a3-ab98-b66ce63efbf7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1364 microversion: 2.1 time: 0.263364 Aug 09 15:25:31.699895 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3373/6735] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:31 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:32.332931 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:25:32.333256 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:25:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:25:32.736937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2394e6ac-6cd1-4bb8-8084-5373ea752259 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:32.737936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2394e6ac-6cd1-4bb8-8084-5373ea752259 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:32.750208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2394e6ac-6cd1-4bb8-8084-5373ea752259 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:32.751077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2394e6ac-6cd1-4bb8-8084-5373ea752259 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:32.751891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2394e6ac-6cd1-4bb8-8084-5373ea752259 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:32.753163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2394e6ac-6cd1-4bb8-8084-5373ea752259 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:32.754004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2394e6ac-6cd1-4bb8-8084-5373ea752259 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:32.754747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2394e6ac-6cd1-4bb8-8084-5373ea752259 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:32.945740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2394e6ac-6cd1-4bb8-8084-5373ea752259 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:32.954603 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2394e6ac-6cd1-4bb8-8084-5373ea752259 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1364 microversion: 2.1 time: 0.223670 Aug 09 15:25:32.955230 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3363/6736] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:32 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:33.978351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb2b95b6-4987-4fb1-9895-fe57ab066386 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:33.979052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb2b95b6-4987-4fb1-9895-fe57ab066386 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:33.987122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb2b95b6-4987-4fb1-9895-fe57ab066386 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:33.987606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb2b95b6-4987-4fb1-9895-fe57ab066386 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:33.988081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb2b95b6-4987-4fb1-9895-fe57ab066386 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:33.988824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb2b95b6-4987-4fb1-9895-fe57ab066386 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:33.989293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb2b95b6-4987-4fb1-9895-fe57ab066386 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:33.989727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb2b95b6-4987-4fb1-9895-fe57ab066386 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:34.157736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fb2b95b6-4987-4fb1-9895-fe57ab066386 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:34.166283 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb2b95b6-4987-4fb1-9895-fe57ab066386 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1364 microversion: 2.1 time: 0.192532 Aug 09 15:25:34.166906 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3374/6737] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:33 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:35.188441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1d1acf38-be38-47d3-b5d9-d9a61e7728c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:35.189075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1d1acf38-be38-47d3-b5d9-d9a61e7728c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:35.197090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d1acf38-be38-47d3-b5d9-d9a61e7728c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:35.197620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d1acf38-be38-47d3-b5d9-d9a61e7728c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:35.198134 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d1acf38-be38-47d3-b5d9-d9a61e7728c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:35.198861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d1acf38-be38-47d3-b5d9-d9a61e7728c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:35.199568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d1acf38-be38-47d3-b5d9-d9a61e7728c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:35.200024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1d1acf38-be38-47d3-b5d9-d9a61e7728c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:35.357903 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1d1acf38-be38-47d3-b5d9-d9a61e7728c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:35.367875 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1d1acf38-be38-47d3-b5d9-d9a61e7728c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1364 microversion: 2.1 time: 0.183415 Aug 09 15:25:35.368911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3364/6738] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:35 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:36.394377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a0d9c123-cdb2-4c65-a7d6-b695f529aca2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:36.395023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a0d9c123-cdb2-4c65-a7d6-b695f529aca2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:36.398141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:25:36.398875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:25:36.406988 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0d9c123-cdb2-4c65-a7d6-b695f529aca2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:36.407683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0d9c123-cdb2-4c65-a7d6-b695f529aca2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:36.408171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0d9c123-cdb2-4c65-a7d6-b695f529aca2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:36.408993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0d9c123-cdb2-4c65-a7d6-b695f529aca2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:36.409531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0d9c123-cdb2-4c65-a7d6-b695f529aca2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:36.410065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a0d9c123-cdb2-4c65-a7d6-b695f529aca2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:36.613492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a0d9c123-cdb2-4c65-a7d6-b695f529aca2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:36.622539 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a0d9c123-cdb2-4c65-a7d6-b695f529aca2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1364 microversion: 2.1 time: 0.232578 Aug 09 15:25:36.623192 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3375/6739] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:36 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:36.673852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-c9022218-6762-4a5d-b13a-19126d6dd8cb req-534a0971-07c6-4f65-a74d-e41d4a07d34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa66cd24-46d6-4815-a1ab-020369fdc638", "name": "network-vif-plugged", "status": "completed", "tag": "a140e4d3-bf2e-4d6d-91db-845b6e14ff4c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:25:36.682347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:25:36.693052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c9022218-6762-4a5d-b13a-19126d6dd8cb req-534a0971-07c6-4f65-a74d-e41d4a07d34f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:36.693938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c9022218-6762-4a5d-b13a-19126d6dd8cb req-534a0971-07c6-4f65-a74d-e41d4a07d34f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:36.694726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-c9022218-6762-4a5d-b13a-19126d6dd8cb req-534a0971-07c6-4f65-a74d-e41d4a07d34f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:36.711491 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-c9022218-6762-4a5d-b13a-19126d6dd8cb req-534a0971-07c6-4f65-a74d-e41d4a07d34f service nova] Creating event network-vif-plugged:a140e4d3-bf2e-4d6d-91db-845b6e14ff4c for instance fa66cd24-46d6-4815-a1ab-020369fdc638 on n-h2-844626-8 Aug 09 15:25:36.718907 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-c9022218-6762-4a5d-b13a-19126d6dd8cb req-534a0971-07c6-4f65-a74d-e41d4a07d34f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049797 Aug 09 15:25:36.719665 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3365/6740] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:25:37.659663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-69ecf794-bcd1-4f8a-ad96-84bcd9696591 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:37.660309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-69ecf794-bcd1-4f8a-ad96-84bcd9696591 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:37.668653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69ecf794-bcd1-4f8a-ad96-84bcd9696591 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:37.669282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69ecf794-bcd1-4f8a-ad96-84bcd9696591 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:37.669810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69ecf794-bcd1-4f8a-ad96-84bcd9696591 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:37.670641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69ecf794-bcd1-4f8a-ad96-84bcd9696591 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:37.671274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69ecf794-bcd1-4f8a-ad96-84bcd9696591 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:37.671784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69ecf794-bcd1-4f8a-ad96-84bcd9696591 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:37.842261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-69ecf794-bcd1-4f8a-ad96-84bcd9696591 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:37.858095 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-69ecf794-bcd1-4f8a-ad96-84bcd9696591 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1364 microversion: 2.1 time: 0.202564 Aug 09 15:25:37.859245 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3376/6741] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:37 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:38.895613 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5d113c46-1830-484e-8a71-5d4af4c93a04 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:38.896528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5d113c46-1830-484e-8a71-5d4af4c93a04 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:38.904657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d113c46-1830-484e-8a71-5d4af4c93a04 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:38.905284 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d113c46-1830-484e-8a71-5d4af4c93a04 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:38.905897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d113c46-1830-484e-8a71-5d4af4c93a04 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:38.906756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d113c46-1830-484e-8a71-5d4af4c93a04 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:38.907370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d113c46-1830-484e-8a71-5d4af4c93a04 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:38.907849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5d113c46-1830-484e-8a71-5d4af4c93a04 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:39.070048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5d113c46-1830-484e-8a71-5d4af4c93a04 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:25:39.078630 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5d113c46-1830-484e-8a71-5d4af4c93a04 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1552 microversion: 2.1 time: 0.188598 Aug 09 15:25:39.079295 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3366/6742] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:25:38 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1552 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:25:39.105284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9f767995-1983-47be-9f84-930a67fc6a08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:25:39.106102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9f767995-1983-47be-9f84-930a67fc6a08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:25:39.118389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f767995-1983-47be-9f84-930a67fc6a08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:39.119231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f767995-1983-47be-9f84-930a67fc6a08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:39.119948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f767995-1983-47be-9f84-930a67fc6a08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:39.121162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f767995-1983-47be-9f84-930a67fc6a08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:39.121954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f767995-1983-47be-9f84-930a67fc6a08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:39.122670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9f767995-1983-47be-9f84-930a67fc6a08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:39.235983 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9f767995-1983-47be-9f84-930a67fc6a08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138772 Aug 09 15:25:39.236789 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3377/6743] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 15:25:39 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:25:40.725318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-bcc2f2cc-b57b-49a0-b347-65a6345de44a req-a2e11d5d-8218-4c82-8818-fb36c426b1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa66cd24-46d6-4815-a1ab-020369fdc638", "tag": "a140e4d3-bf2e-4d6d-91db-845b6e14ff4c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:25:40.742756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bcc2f2cc-b57b-49a0-b347-65a6345de44a req-a2e11d5d-8218-4c82-8818-fb36c426b1a3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:25:40.743646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bcc2f2cc-b57b-49a0-b347-65a6345de44a req-a2e11d5d-8218-4c82-8818-fb36c426b1a3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:25:40.744397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bcc2f2cc-b57b-49a0-b347-65a6345de44a req-a2e11d5d-8218-4c82-8818-fb36c426b1a3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:25:40.765854 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-bcc2f2cc-b57b-49a0-b347-65a6345de44a req-a2e11d5d-8218-4c82-8818-fb36c426b1a3 service nova] Creating event network-changed:a140e4d3-bf2e-4d6d-91db-845b6e14ff4c for instance fa66cd24-46d6-4815-a1ab-020369fdc638 on n-h2-844626-8 Aug 09 15:25:40.773817 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-bcc2f2cc-b57b-49a0-b347-65a6345de44a req-a2e11d5d-8218-4c82-8818-fb36c426b1a3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055205 Aug 09 15:25:40.775176 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3367/6744] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:26:15.859933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:26:15.861052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:26:15.867463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:26:15.870458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:15.880725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:15.881454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:15.881990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:15.882825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:15.883490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:15.884036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:15.925894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:15.934715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Old instance type m1.heat2, new instance type m1.heat {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 15:26:15.943490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:26:15.944051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:26:15.944722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:26:15.945136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:26:15.945550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:26:16.036952 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f88c63d3-2f98-4899-9f6f-860b0a6a4037 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638/action" status: 202 len: 0 microversion: 2.1 time: 0.179555 Aug 09 15:26:16.037811 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3378/6745] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:26:15 2022] POST /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:26:16.046029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=23 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:26:16.047788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:26:16.054545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9804a5c3-a635-46dd-a2a0-eeebf9f9b2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:16.054981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9804a5c3-a635-46dd-a2a0-eeebf9f9b2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:16.063454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9804a5c3-a635-46dd-a2a0-eeebf9f9b2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:16.064000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9804a5c3-a635-46dd-a2a0-eeebf9f9b2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:16.064485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9804a5c3-a635-46dd-a2a0-eeebf9f9b2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:16.065546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9804a5c3-a635-46dd-a2a0-eeebf9f9b2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:16.066094 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9804a5c3-a635-46dd-a2a0-eeebf9f9b2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:16.066611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9804a5c3-a635-46dd-a2a0-eeebf9f9b2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:16.339349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9804a5c3-a635-46dd-a2a0-eeebf9f9b2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:16.352439 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9804a5c3-a635-46dd-a2a0-eeebf9f9b2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1680 microversion: 2.1 time: 0.308459 Aug 09 15:26:16.353557 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3368/6746] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:16 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1680 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:17.386608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c5180c09-f82b-4855-bcd3-3b6a4d0d2b79 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:17.387711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c5180c09-f82b-4855-bcd3-3b6a4d0d2b79 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:17.398611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5180c09-f82b-4855-bcd3-3b6a4d0d2b79 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:17.399233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5180c09-f82b-4855-bcd3-3b6a4d0d2b79 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:17.399874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5180c09-f82b-4855-bcd3-3b6a4d0d2b79 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:17.401485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5180c09-f82b-4855-bcd3-3b6a4d0d2b79 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:17.402528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5180c09-f82b-4855-bcd3-3b6a4d0d2b79 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:17.403177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c5180c09-f82b-4855-bcd3-3b6a4d0d2b79 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:17.769886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c5180c09-f82b-4855-bcd3-3b6a4d0d2b79 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:17.784471 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c5180c09-f82b-4855-bcd3-3b6a4d0d2b79 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1680 microversion: 2.1 time: 0.403518 Aug 09 15:26:17.785863 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3379/6747] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:17 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1680 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:18.830092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-53b5212e-75f2-4319-9bd9-8cd8af7c5cb0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:18.831030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53b5212e-75f2-4319-9bd9-8cd8af7c5cb0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:18.840827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53b5212e-75f2-4319-9bd9-8cd8af7c5cb0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:18.841289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53b5212e-75f2-4319-9bd9-8cd8af7c5cb0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:18.841742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53b5212e-75f2-4319-9bd9-8cd8af7c5cb0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:18.842483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53b5212e-75f2-4319-9bd9-8cd8af7c5cb0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:18.842972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53b5212e-75f2-4319-9bd9-8cd8af7c5cb0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:18.843582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53b5212e-75f2-4319-9bd9-8cd8af7c5cb0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:19.033667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-53b5212e-75f2-4319-9bd9-8cd8af7c5cb0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:19.044340 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-53b5212e-75f2-4319-9bd9-8cd8af7c5cb0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1680 microversion: 2.1 time: 0.219873 Aug 09 15:26:19.044953 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3369/6748] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:18 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:26:20.068392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a3c7aef5-a5c8-46f6-9bb9-1deeae53b0d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:20.069424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a3c7aef5-a5c8-46f6-9bb9-1deeae53b0d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:20.078095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3c7aef5-a5c8-46f6-9bb9-1deeae53b0d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:20.078590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3c7aef5-a5c8-46f6-9bb9-1deeae53b0d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:20.079057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3c7aef5-a5c8-46f6-9bb9-1deeae53b0d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:20.079769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3c7aef5-a5c8-46f6-9bb9-1deeae53b0d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:20.080215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3c7aef5-a5c8-46f6-9bb9-1deeae53b0d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:20.080634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a3c7aef5-a5c8-46f6-9bb9-1deeae53b0d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:20.254965 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a3c7aef5-a5c8-46f6-9bb9-1deeae53b0d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:20.269587 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a3c7aef5-a5c8-46f6-9bb9-1deeae53b0d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1685 microversion: 2.1 time: 0.205209 Aug 09 15:26:20.270286 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3380/6749] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:20 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1685 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:21.305297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef18acad-750c-40f7-ad18-3d2fc6902173 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:21.305973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef18acad-750c-40f7-ad18-3d2fc6902173 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:21.313754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef18acad-750c-40f7-ad18-3d2fc6902173 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:21.314269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef18acad-750c-40f7-ad18-3d2fc6902173 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:21.314721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef18acad-750c-40f7-ad18-3d2fc6902173 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:21.315489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef18acad-750c-40f7-ad18-3d2fc6902173 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:21.315962 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef18acad-750c-40f7-ad18-3d2fc6902173 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:21.316403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef18acad-750c-40f7-ad18-3d2fc6902173 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:21.482496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef18acad-750c-40f7-ad18-3d2fc6902173 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:21.491790 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef18acad-750c-40f7-ad18-3d2fc6902173 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1685 microversion: 2.1 time: 0.190902 Aug 09 15:26:21.492429 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3370/6750] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:21 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:22.513947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f6185951-1598-4cdf-92d3-4f0c422f0f0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:22.514767 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f6185951-1598-4cdf-92d3-4f0c422f0f0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:22.522877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6185951-1598-4cdf-92d3-4f0c422f0f0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:22.522877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6185951-1598-4cdf-92d3-4f0c422f0f0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:22.523714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6185951-1598-4cdf-92d3-4f0c422f0f0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:22.524419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6185951-1598-4cdf-92d3-4f0c422f0f0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:22.524872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6185951-1598-4cdf-92d3-4f0c422f0f0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:22.525291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6185951-1598-4cdf-92d3-4f0c422f0f0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:22.727920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f6185951-1598-4cdf-92d3-4f0c422f0f0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:22.736311 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f6185951-1598-4cdf-92d3-4f0c422f0f0b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1685 microversion: 2.1 time: 0.226269 Aug 09 15:26:22.736898 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3381/6751] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:22 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1685 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:23.758695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e4191ef-d5c0-4a20-9464-1993eb466cfc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:23.759515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e4191ef-d5c0-4a20-9464-1993eb466cfc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:23.767899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e4191ef-d5c0-4a20-9464-1993eb466cfc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:23.768405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e4191ef-d5c0-4a20-9464-1993eb466cfc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:23.768840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e4191ef-d5c0-4a20-9464-1993eb466cfc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:23.769572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e4191ef-d5c0-4a20-9464-1993eb466cfc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:23.770039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e4191ef-d5c0-4a20-9464-1993eb466cfc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:23.770476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e4191ef-d5c0-4a20-9464-1993eb466cfc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:23.928108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1e4191ef-d5c0-4a20-9464-1993eb466cfc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:23.937778 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e4191ef-d5c0-4a20-9464-1993eb466cfc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1685 microversion: 2.1 time: 0.183361 Aug 09 15:26:23.938552 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3371/6752] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:23 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:24.964157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d5b5157-77f6-477f-9b54-24cfc5662b2b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:24.964910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d5b5157-77f6-477f-9b54-24cfc5662b2b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:24.972473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d5b5157-77f6-477f-9b54-24cfc5662b2b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:24.973129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d5b5157-77f6-477f-9b54-24cfc5662b2b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:24.973774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d5b5157-77f6-477f-9b54-24cfc5662b2b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:24.974791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d5b5157-77f6-477f-9b54-24cfc5662b2b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:24.975641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d5b5157-77f6-477f-9b54-24cfc5662b2b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:24.976239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d5b5157-77f6-477f-9b54-24cfc5662b2b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:25.142177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d5b5157-77f6-477f-9b54-24cfc5662b2b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:25.151767 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d5b5157-77f6-477f-9b54-24cfc5662b2b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1685 microversion: 2.1 time: 0.191713 Aug 09 15:26:25.152705 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3382/6753] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:24 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1685 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:26.177082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c3582c5d-475b-4909-841c-13602d5a7454 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:26.177912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c3582c5d-475b-4909-841c-13602d5a7454 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:26.186449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3582c5d-475b-4909-841c-13602d5a7454 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:26.186976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3582c5d-475b-4909-841c-13602d5a7454 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:26.187576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3582c5d-475b-4909-841c-13602d5a7454 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:26.188400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3582c5d-475b-4909-841c-13602d5a7454 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:26.188844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3582c5d-475b-4909-841c-13602d5a7454 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:26.189357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c3582c5d-475b-4909-841c-13602d5a7454 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:26.369353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c3582c5d-475b-4909-841c-13602d5a7454 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:26.378285 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c3582c5d-475b-4909-841c-13602d5a7454 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1685 microversion: 2.1 time: 0.206156 Aug 09 15:26:26.379030 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3372/6754] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:26 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1685 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:27.405349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6124757c-6dcc-4cb5-bf49-599abcadfa23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:27.406444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6124757c-6dcc-4cb5-bf49-599abcadfa23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:27.415077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6124757c-6dcc-4cb5-bf49-599abcadfa23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:27.415568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6124757c-6dcc-4cb5-bf49-599abcadfa23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:27.416076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6124757c-6dcc-4cb5-bf49-599abcadfa23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:27.416994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6124757c-6dcc-4cb5-bf49-599abcadfa23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:27.417429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6124757c-6dcc-4cb5-bf49-599abcadfa23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:27.417894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6124757c-6dcc-4cb5-bf49-599abcadfa23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:27.633147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6124757c-6dcc-4cb5-bf49-599abcadfa23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:27.649767 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6124757c-6dcc-4cb5-bf49-599abcadfa23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1685 microversion: 2.1 time: 0.251642 Aug 09 15:26:27.650857 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3383/6755] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:27 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1685 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:28.677199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d12b8613-2726-4604-88aa-d22c28220926 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:28.678055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d12b8613-2726-4604-88aa-d22c28220926 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:28.687548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d12b8613-2726-4604-88aa-d22c28220926 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:28.688083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d12b8613-2726-4604-88aa-d22c28220926 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:28.688529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d12b8613-2726-4604-88aa-d22c28220926 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:28.689308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d12b8613-2726-4604-88aa-d22c28220926 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:28.689792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d12b8613-2726-4604-88aa-d22c28220926 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:28.690241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d12b8613-2726-4604-88aa-d22c28220926 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:28.887177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d12b8613-2726-4604-88aa-d22c28220926 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:28.897908 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d12b8613-2726-4604-88aa-d22c28220926 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1685 microversion: 2.1 time: 0.225458 Aug 09 15:26:28.898877 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3373/6756] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:28 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1685 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:29.921452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5fa68f3e-f3d4-4a55-be80-a968c68114b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:29.922113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5fa68f3e-f3d4-4a55-be80-a968c68114b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:29.930133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fa68f3e-f3d4-4a55-be80-a968c68114b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:29.930756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fa68f3e-f3d4-4a55-be80-a968c68114b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:29.931232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fa68f3e-f3d4-4a55-be80-a968c68114b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:29.931970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fa68f3e-f3d4-4a55-be80-a968c68114b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:29.932432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fa68f3e-f3d4-4a55-be80-a968c68114b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:29.933066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fa68f3e-f3d4-4a55-be80-a968c68114b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:30.153199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5fa68f3e-f3d4-4a55-be80-a968c68114b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:30.162571 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5fa68f3e-f3d4-4a55-be80-a968c68114b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1685 microversion: 2.1 time: 0.245191 Aug 09 15:26:30.163490 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3384/6757] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:29 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1685 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:26:31.192968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-28891333-96db-4983-9502-e6fcc196fbb9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:31.192968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-28891333-96db-4983-9502-e6fcc196fbb9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:31.204211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28891333-96db-4983-9502-e6fcc196fbb9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:31.205049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28891333-96db-4983-9502-e6fcc196fbb9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:31.205865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28891333-96db-4983-9502-e6fcc196fbb9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:31.207119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28891333-96db-4983-9502-e6fcc196fbb9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:31.207968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28891333-96db-4983-9502-e6fcc196fbb9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:31.208667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-28891333-96db-4983-9502-e6fcc196fbb9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:31.418352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-28891333-96db-4983-9502-e6fcc196fbb9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:31.429690 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-28891333-96db-4983-9502-e6fcc196fbb9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1684 microversion: 2.1 time: 0.245091 Aug 09 15:26:31.430599 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3374/6758] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:31 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1684 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:31.805987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-92b9f723-910a-40d0-be8f-24500c57e3be req-dcbe0e3a-8efc-4009-a539-28493d55bc65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa66cd24-46d6-4815-a1ab-020369fdc638", "name": "network-vif-unplugged", "status": "completed", "tag": "a140e4d3-bf2e-4d6d-91db-845b6e14ff4c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:26:31.824613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-92b9f723-910a-40d0-be8f-24500c57e3be req-dcbe0e3a-8efc-4009-a539-28493d55bc65 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:31.824613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-92b9f723-910a-40d0-be8f-24500c57e3be req-dcbe0e3a-8efc-4009-a539-28493d55bc65 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:31.825355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-92b9f723-910a-40d0-be8f-24500c57e3be req-dcbe0e3a-8efc-4009-a539-28493d55bc65 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:31.850762 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-92b9f723-910a-40d0-be8f-24500c57e3be req-dcbe0e3a-8efc-4009-a539-28493d55bc65 service nova] Creating event network-vif-unplugged:a140e4d3-bf2e-4d6d-91db-845b6e14ff4c for instance fa66cd24-46d6-4815-a1ab-020369fdc638 on n-h1-844626-8 Aug 09 15:26:31.863133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-92b9f723-910a-40d0-be8f-24500c57e3be req-dcbe0e3a-8efc-4009-a539-28493d55bc65 service nova] Instance fa66cd24-46d6-4815-a1ab-020369fdc638 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:26:31.885798 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-92b9f723-910a-40d0-be8f-24500c57e3be req-dcbe0e3a-8efc-4009-a539-28493d55bc65 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085060 Aug 09 15:26:31.887143 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3385/6759] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:26:32.458214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a10dc34a-056b-4814-ad2c-a71d4b8dbefa tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:32.459476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a10dc34a-056b-4814-ad2c-a71d4b8dbefa tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:32.472697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a10dc34a-056b-4814-ad2c-a71d4b8dbefa tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:32.473481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a10dc34a-056b-4814-ad2c-a71d4b8dbefa tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:32.474295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a10dc34a-056b-4814-ad2c-a71d4b8dbefa tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:32.475688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a10dc34a-056b-4814-ad2c-a71d4b8dbefa tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:32.476529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a10dc34a-056b-4814-ad2c-a71d4b8dbefa tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:32.477607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a10dc34a-056b-4814-ad2c-a71d4b8dbefa tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:32.685144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a10dc34a-056b-4814-ad2c-a71d4b8dbefa tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:32.699999 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a10dc34a-056b-4814-ad2c-a71d4b8dbefa tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1684 microversion: 2.1 time: 0.249599 Aug 09 15:26:32.701118 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3375/6760] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:32 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1684 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:33.736843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7aaafb9a-1db2-44e6-8ec3-35cdd7bba6f0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:33.737538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7aaafb9a-1db2-44e6-8ec3-35cdd7bba6f0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:33.745030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7aaafb9a-1db2-44e6-8ec3-35cdd7bba6f0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:33.745550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7aaafb9a-1db2-44e6-8ec3-35cdd7bba6f0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:33.745991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7aaafb9a-1db2-44e6-8ec3-35cdd7bba6f0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:33.746866 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7aaafb9a-1db2-44e6-8ec3-35cdd7bba6f0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:33.747483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7aaafb9a-1db2-44e6-8ec3-35cdd7bba6f0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:33.747937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7aaafb9a-1db2-44e6-8ec3-35cdd7bba6f0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:33.908939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-414679c5-da7f-4fee-90e9-ca020ae8c38a req-d4f85c32-c08a-4280-a2c0-e22861e06e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa66cd24-46d6-4815-a1ab-020369fdc638", "tag": "a140e4d3-bf2e-4d6d-91db-845b6e14ff4c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:26:33.921223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-414679c5-da7f-4fee-90e9-ca020ae8c38a req-d4f85c32-c08a-4280-a2c0-e22861e06e0b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:33.921831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-414679c5-da7f-4fee-90e9-ca020ae8c38a req-d4f85c32-c08a-4280-a2c0-e22861e06e0b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:33.922210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-414679c5-da7f-4fee-90e9-ca020ae8c38a req-d4f85c32-c08a-4280-a2c0-e22861e06e0b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:33.928400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7aaafb9a-1db2-44e6-8ec3-35cdd7bba6f0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:33.936940 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-414679c5-da7f-4fee-90e9-ca020ae8c38a req-d4f85c32-c08a-4280-a2c0-e22861e06e0b service nova] Creating event network-changed:a140e4d3-bf2e-4d6d-91db-845b6e14ff4c for instance fa66cd24-46d6-4815-a1ab-020369fdc638 on n-h1-844626-8 Aug 09 15:26:33.937505 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7aaafb9a-1db2-44e6-8ec3-35cdd7bba6f0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1682 microversion: 2.1 time: 0.206394 Aug 09 15:26:33.938117 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3386/6761] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:33 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:33.943814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-414679c5-da7f-4fee-90e9-ca020ae8c38a req-d4f85c32-c08a-4280-a2c0-e22861e06e0b service nova] Instance fa66cd24-46d6-4815-a1ab-020369fdc638 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:26:33.958586 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-414679c5-da7f-4fee-90e9-ca020ae8c38a req-d4f85c32-c08a-4280-a2c0-e22861e06e0b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053733 Aug 09 15:26:33.959333 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3376/6762] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:26:34.972794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2e9538e2-d357-4f81-be45-f9819df5bc14 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:34.973913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2e9538e2-d357-4f81-be45-f9819df5bc14 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:34.983308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e9538e2-d357-4f81-be45-f9819df5bc14 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:34.983811 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e9538e2-d357-4f81-be45-f9819df5bc14 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:34.984315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e9538e2-d357-4f81-be45-f9819df5bc14 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:34.985297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e9538e2-d357-4f81-be45-f9819df5bc14 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:34.985774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e9538e2-d357-4f81-be45-f9819df5bc14 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:34.986211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2e9538e2-d357-4f81-be45-f9819df5bc14 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:35.205070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2e9538e2-d357-4f81-be45-f9819df5bc14 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:35.214182 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2e9538e2-d357-4f81-be45-f9819df5bc14 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1679 microversion: 2.1 time: 0.245650 Aug 09 15:26:35.214838 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3387/6763] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:34 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:35.246064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:26:35.247070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:35.257691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:35.258336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:35.258943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:35.260914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:35.261556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:35.262170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:35.330466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:35.331291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:35.332065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:35.333502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:35.334241 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:35.335046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:35.372478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'cores', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:26:35.381880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for user 127998e24ecf48d58f3c789530f89898 and project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'cores', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:26:35.571666 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c63caf15-1143-4cf7-b9b6-f903d571d4a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638/action" status: 202 len: 0 microversion: 2.1 time: 0.334313 Aug 09 15:26:35.572793 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3377/6764] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:26:35 2022] POST /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:26:35.584053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f8d7b294-1a98-4bb9-a3dc-19006dacf0ed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:35.585681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8d7b294-1a98-4bb9-a3dc-19006dacf0ed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:35.597157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8d7b294-1a98-4bb9-a3dc-19006dacf0ed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:35.597958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8d7b294-1a98-4bb9-a3dc-19006dacf0ed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:35.598926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8d7b294-1a98-4bb9-a3dc-19006dacf0ed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:35.599786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8d7b294-1a98-4bb9-a3dc-19006dacf0ed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:35.600547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8d7b294-1a98-4bb9-a3dc-19006dacf0ed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:35.601116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8d7b294-1a98-4bb9-a3dc-19006dacf0ed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:35.796774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f8d7b294-1a98-4bb9-a3dc-19006dacf0ed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:35.807554 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f8d7b294-1a98-4bb9-a3dc-19006dacf0ed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1678 microversion: 2.1 time: 0.228295 Aug 09 15:26:35.808373 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3388/6765] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:35 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:36.843580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e790e874-de6a-44dc-8ebd-8bff9c4fcb6b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:36.844838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e790e874-de6a-44dc-8ebd-8bff9c4fcb6b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:36.858154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e790e874-de6a-44dc-8ebd-8bff9c4fcb6b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:36.859161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e790e874-de6a-44dc-8ebd-8bff9c4fcb6b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:36.859976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e790e874-de6a-44dc-8ebd-8bff9c4fcb6b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:36.861433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e790e874-de6a-44dc-8ebd-8bff9c4fcb6b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:36.862409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e790e874-de6a-44dc-8ebd-8bff9c4fcb6b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:36.864291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e790e874-de6a-44dc-8ebd-8bff9c4fcb6b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:37.091567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e790e874-de6a-44dc-8ebd-8bff9c4fcb6b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:37.103677 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e790e874-de6a-44dc-8ebd-8bff9c4fcb6b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1678 microversion: 2.1 time: 0.270054 Aug 09 15:26:37.113347 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3378/6766] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:36 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1678 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:38.132674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c5783be-dbaf-49ff-ae88-54b5e7e5328e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:38.133553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2c5783be-dbaf-49ff-ae88-54b5e7e5328e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:38.142451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5783be-dbaf-49ff-ae88-54b5e7e5328e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:38.143196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5783be-dbaf-49ff-ae88-54b5e7e5328e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:38.143738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5783be-dbaf-49ff-ae88-54b5e7e5328e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:38.144942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5783be-dbaf-49ff-ae88-54b5e7e5328e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:38.145763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5783be-dbaf-49ff-ae88-54b5e7e5328e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:38.146748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c5783be-dbaf-49ff-ae88-54b5e7e5328e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:38.404731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c5783be-dbaf-49ff-ae88-54b5e7e5328e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:38.420112 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2c5783be-dbaf-49ff-ae88-54b5e7e5328e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1678 microversion: 2.1 time: 0.292604 Aug 09 15:26:38.421807 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3389/6767] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:38 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1678 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:38.744167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-af265556-564d-4662-a62f-2eb647136c08 req-156f3517-bdf5-40d4-a4d6-0a291f0a2218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa66cd24-46d6-4815-a1ab-020369fdc638", "name": "network-vif-plugged", "status": "completed", "tag": "a140e4d3-bf2e-4d6d-91db-845b6e14ff4c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:26:38.764006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-af265556-564d-4662-a62f-2eb647136c08 req-156f3517-bdf5-40d4-a4d6-0a291f0a2218 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:38.765153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-af265556-564d-4662-a62f-2eb647136c08 req-156f3517-bdf5-40d4-a4d6-0a291f0a2218 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:38.766132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-af265556-564d-4662-a62f-2eb647136c08 req-156f3517-bdf5-40d4-a4d6-0a291f0a2218 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:38.790804 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-af265556-564d-4662-a62f-2eb647136c08 req-156f3517-bdf5-40d4-a4d6-0a291f0a2218 service nova] Creating event network-vif-plugged:a140e4d3-bf2e-4d6d-91db-845b6e14ff4c for instance fa66cd24-46d6-4815-a1ab-020369fdc638 on n-h2-844626-8 Aug 09 15:26:38.798331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-af265556-564d-4662-a62f-2eb647136c08 req-156f3517-bdf5-40d4-a4d6-0a291f0a2218 service nova] Instance fa66cd24-46d6-4815-a1ab-020369fdc638 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:26:38.820234 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-af265556-564d-4662-a62f-2eb647136c08 req-156f3517-bdf5-40d4-a4d6-0a291f0a2218 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080801 Aug 09 15:26:38.823791 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3379/6768] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:26:39.447245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d22c900a-21ac-4668-aa3e-fd37dbd473c2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:39.447949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d22c900a-21ac-4668-aa3e-fd37dbd473c2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:39.455403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22c900a-21ac-4668-aa3e-fd37dbd473c2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:39.455983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22c900a-21ac-4668-aa3e-fd37dbd473c2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:39.456497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22c900a-21ac-4668-aa3e-fd37dbd473c2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:39.457499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22c900a-21ac-4668-aa3e-fd37dbd473c2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:39.458289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22c900a-21ac-4668-aa3e-fd37dbd473c2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:39.458949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d22c900a-21ac-4668-aa3e-fd37dbd473c2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:39.474151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-dfaabad7-7e14-4efd-a133-624de79ab59a req-269ff4b8-c283-4b94-a24d-9236c409ff66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa66cd24-46d6-4815-a1ab-020369fdc638", "name": "network-vif-unplugged", "status": "completed", "tag": "a140e4d3-bf2e-4d6d-91db-845b6e14ff4c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:26:39.492987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dfaabad7-7e14-4efd-a133-624de79ab59a req-269ff4b8-c283-4b94-a24d-9236c409ff66 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:39.494039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dfaabad7-7e14-4efd-a133-624de79ab59a req-269ff4b8-c283-4b94-a24d-9236c409ff66 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:39.494912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-dfaabad7-7e14-4efd-a133-624de79ab59a req-269ff4b8-c283-4b94-a24d-9236c409ff66 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:39.514926 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-dfaabad7-7e14-4efd-a133-624de79ab59a req-269ff4b8-c283-4b94-a24d-9236c409ff66 service nova] Creating event network-vif-unplugged:a140e4d3-bf2e-4d6d-91db-845b6e14ff4c for instance fa66cd24-46d6-4815-a1ab-020369fdc638 on n-h2-844626-8 Aug 09 15:26:39.521331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-dfaabad7-7e14-4efd-a133-624de79ab59a req-269ff4b8-c283-4b94-a24d-9236c409ff66 service nova] Instance fa66cd24-46d6-4815-a1ab-020369fdc638 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:26:39.533766 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-dfaabad7-7e14-4efd-a133-624de79ab59a req-269ff4b8-c283-4b94-a24d-9236c409ff66 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063655 Aug 09 15:26:39.534460 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3380/6769] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:26:39.898266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d22c900a-21ac-4668-aa3e-fd37dbd473c2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:39.913151 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d22c900a-21ac-4668-aa3e-fd37dbd473c2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1678 microversion: 2.1 time: 0.469468 Aug 09 15:26:39.914218 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3390/6770] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:39 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1678 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:40.962243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12cba628-73a2-437a-9756-6b92d03fec49 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:40.963471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-12cba628-73a2-437a-9756-6b92d03fec49 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:40.971943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12cba628-73a2-437a-9756-6b92d03fec49 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:40.972944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12cba628-73a2-437a-9756-6b92d03fec49 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:40.973934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12cba628-73a2-437a-9756-6b92d03fec49 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:40.975287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12cba628-73a2-437a-9756-6b92d03fec49 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:40.976232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12cba628-73a2-437a-9756-6b92d03fec49 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:40.977393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12cba628-73a2-437a-9756-6b92d03fec49 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:41.187307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-12cba628-73a2-437a-9756-6b92d03fec49 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:41.199049 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-12cba628-73a2-437a-9756-6b92d03fec49 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1678 microversion: 2.1 time: 0.244078 Aug 09 15:26:41.199990 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3381/6771] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:40 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:41.560271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9c06456b-d1d7-40c5-a8ab-cc7fe1d98a48 req-8abf9df1-2be9-49e7-ab79-969b4c7427e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa66cd24-46d6-4815-a1ab-020369fdc638", "tag": "a140e4d3-bf2e-4d6d-91db-845b6e14ff4c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:26:41.575010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9c06456b-d1d7-40c5-a8ab-cc7fe1d98a48 req-8abf9df1-2be9-49e7-ab79-969b4c7427e6 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:41.575739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9c06456b-d1d7-40c5-a8ab-cc7fe1d98a48 req-8abf9df1-2be9-49e7-ab79-969b4c7427e6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:41.576345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9c06456b-d1d7-40c5-a8ab-cc7fe1d98a48 req-8abf9df1-2be9-49e7-ab79-969b4c7427e6 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:41.592045 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9c06456b-d1d7-40c5-a8ab-cc7fe1d98a48 req-8abf9df1-2be9-49e7-ab79-969b4c7427e6 service nova] Creating event network-changed:a140e4d3-bf2e-4d6d-91db-845b6e14ff4c for instance fa66cd24-46d6-4815-a1ab-020369fdc638 on n-h2-844626-8 Aug 09 15:26:41.600396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-9c06456b-d1d7-40c5-a8ab-cc7fe1d98a48 req-8abf9df1-2be9-49e7-ab79-969b4c7427e6 service nova] Instance fa66cd24-46d6-4815-a1ab-020369fdc638 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:26:41.619289 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9c06456b-d1d7-40c5-a8ab-cc7fe1d98a48 req-8abf9df1-2be9-49e7-ab79-969b4c7427e6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062974 Aug 09 15:26:41.620397 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3391/6772] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:26:42.228048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0e64669-b453-4820-888c-2c134d65cd5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:42.229295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0e64669-b453-4820-888c-2c134d65cd5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:42.244120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0e64669-b453-4820-888c-2c134d65cd5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:42.244667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0e64669-b453-4820-888c-2c134d65cd5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:42.245145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0e64669-b453-4820-888c-2c134d65cd5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:42.246072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0e64669-b453-4820-888c-2c134d65cd5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:42.246479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0e64669-b453-4820-888c-2c134d65cd5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:42.246933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0e64669-b453-4820-888c-2c134d65cd5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:42.276212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:26:42.702308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0e64669-b453-4820-888c-2c134d65cd5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:42.719818 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0e64669-b453-4820-888c-2c134d65cd5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1678 microversion: 2.1 time: 0.499660 Aug 09 15:26:42.729966 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3382/6773] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:42 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1678 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:43.758454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6e2704ee-abc5-4d98-b063-c44a3391cd2a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:43.759281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6e2704ee-abc5-4d98-b063-c44a3391cd2a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:43.766678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e2704ee-abc5-4d98-b063-c44a3391cd2a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:43.767205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e2704ee-abc5-4d98-b063-c44a3391cd2a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:43.767642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e2704ee-abc5-4d98-b063-c44a3391cd2a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:43.768399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e2704ee-abc5-4d98-b063-c44a3391cd2a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:43.768976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e2704ee-abc5-4d98-b063-c44a3391cd2a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:43.769405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6e2704ee-abc5-4d98-b063-c44a3391cd2a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:43.994830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6e2704ee-abc5-4d98-b063-c44a3391cd2a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:44.007758 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6e2704ee-abc5-4d98-b063-c44a3391cd2a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1671 microversion: 2.1 time: 0.254758 Aug 09 15:26:44.008867 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3392/6774] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:43 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1671 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:44.044684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e25a47ae-f69e-4b3e-ab58-0bb669f543b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:44.045676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e25a47ae-f69e-4b3e-ab58-0bb669f543b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:44.054184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e25a47ae-f69e-4b3e-ab58-0bb669f543b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:44.054823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e25a47ae-f69e-4b3e-ab58-0bb669f543b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:44.055410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e25a47ae-f69e-4b3e-ab58-0bb669f543b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:44.059025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e25a47ae-f69e-4b3e-ab58-0bb669f543b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:44.059025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e25a47ae-f69e-4b3e-ab58-0bb669f543b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:44.059025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e25a47ae-f69e-4b3e-ab58-0bb669f543b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:44.264955 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e25a47ae-f69e-4b3e-ab58-0bb669f543b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:44.274232 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e25a47ae-f69e-4b3e-ab58-0bb669f543b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1671 microversion: 2.1 time: 0.233528 Aug 09 15:26:44.274816 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3383/6775] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:44 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1671 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:26:44.296162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-db17db43-5d68-4213-ac09-66661330a888 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:44.296987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-db17db43-5d68-4213-ac09-66661330a888 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:44.305280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db17db43-5d68-4213-ac09-66661330a888 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:44.305771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db17db43-5d68-4213-ac09-66661330a888 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:44.306313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db17db43-5d68-4213-ac09-66661330a888 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:44.307264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db17db43-5d68-4213-ac09-66661330a888 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:44.307814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db17db43-5d68-4213-ac09-66661330a888 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:44.308293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-db17db43-5d68-4213-ac09-66661330a888 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:44.484035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-db17db43-5d68-4213-ac09-66661330a888 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:44.487979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:26:44.493793 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-db17db43-5d68-4213-ac09-66661330a888 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1671 microversion: 2.1 time: 0.201858 Aug 09 15:26:44.494396 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3393/6776] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:44 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1671 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:44.531342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-659a2d29-61c1-42c7-b1f0-19bc63a77098 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:44.532120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-659a2d29-61c1-42c7-b1f0-19bc63a77098 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:44.543654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-659a2d29-61c1-42c7-b1f0-19bc63a77098 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:44.544509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-659a2d29-61c1-42c7-b1f0-19bc63a77098 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:44.545288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-659a2d29-61c1-42c7-b1f0-19bc63a77098 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:44.546541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-659a2d29-61c1-42c7-b1f0-19bc63a77098 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:44.547468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-659a2d29-61c1-42c7-b1f0-19bc63a77098 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:44.548256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-659a2d29-61c1-42c7-b1f0-19bc63a77098 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:44.581378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-659a2d29-61c1-42c7-b1f0-19bc63a77098 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:26:44.688405 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-659a2d29-61c1-42c7-b1f0-19bc63a77098 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 204 len: 0 microversion: 2.1 time: 0.164386 Aug 09 15:26:44.689746 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3384/6777] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:26:44 2022] DELETE /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:26:44.699762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cd5f8137-0b71-458b-8ba3-8f9faf269a7b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:44.700393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cd5f8137-0b71-458b-8ba3-8f9faf269a7b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:44.708786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd5f8137-0b71-458b-8ba3-8f9faf269a7b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:44.709282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd5f8137-0b71-458b-8ba3-8f9faf269a7b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:44.709714 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd5f8137-0b71-458b-8ba3-8f9faf269a7b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:44.710420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd5f8137-0b71-458b-8ba3-8f9faf269a7b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:44.710869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd5f8137-0b71-458b-8ba3-8f9faf269a7b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:44.711313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cd5f8137-0b71-458b-8ba3-8f9faf269a7b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:44.878406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cd5f8137-0b71-458b-8ba3-8f9faf269a7b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:44.887486 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cd5f8137-0b71-458b-8ba3-8f9faf269a7b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1677 microversion: 2.1 time: 0.192239 Aug 09 15:26:44.888111 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3394/6778] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:44 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:45.913835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-468d4d9c-6f4a-4e36-b3a1-740daa361026 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:45.914660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-468d4d9c-6f4a-4e36-b3a1-740daa361026 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:45.918694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:26:45.929541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-468d4d9c-6f4a-4e36-b3a1-740daa361026 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:45.930459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-468d4d9c-6f4a-4e36-b3a1-740daa361026 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:45.931367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-468d4d9c-6f4a-4e36-b3a1-740daa361026 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:45.932651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-468d4d9c-6f4a-4e36-b3a1-740daa361026 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:45.933520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-468d4d9c-6f4a-4e36-b3a1-740daa361026 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:45.934289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-468d4d9c-6f4a-4e36-b3a1-740daa361026 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:46.132149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-468d4d9c-6f4a-4e36-b3a1-740daa361026 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:46.143955 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-468d4d9c-6f4a-4e36-b3a1-740daa361026 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1677 microversion: 2.1 time: 0.236273 Aug 09 15:26:46.145028 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3385/6779] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:45 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1677 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:47.183007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21cbcb28-7d1c-4a0d-9c1f-86e6e06225b1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:47.184022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-21cbcb28-7d1c-4a0d-9c1f-86e6e06225b1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:47.188676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=39 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:26:47.196073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21cbcb28-7d1c-4a0d-9c1f-86e6e06225b1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:47.196580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21cbcb28-7d1c-4a0d-9c1f-86e6e06225b1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:47.197202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21cbcb28-7d1c-4a0d-9c1f-86e6e06225b1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:47.198651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21cbcb28-7d1c-4a0d-9c1f-86e6e06225b1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:47.198830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21cbcb28-7d1c-4a0d-9c1f-86e6e06225b1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:47.199333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21cbcb28-7d1c-4a0d-9c1f-86e6e06225b1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:47.494689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-21cbcb28-7d1c-4a0d-9c1f-86e6e06225b1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:47.506275 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-21cbcb28-7d1c-4a0d-9c1f-86e6e06225b1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 200 len: 1609 microversion: 2.1 time: 0.330616 Aug 09 15:26:47.506887 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3395/6780] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:47 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 1609 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:47.641425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e1af98af-1e39-492e-aff0-44186412eb93 req-8e2e44d9-fd77-412e-8423-cced3722e63b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa66cd24-46d6-4815-a1ab-020369fdc638", "name": "network-vif-deleted", "tag": "a140e4d3-bf2e-4d6d-91db-845b6e14ff4c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:26:47.648391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:26:47.659580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e1af98af-1e39-492e-aff0-44186412eb93 req-8e2e44d9-fd77-412e-8423-cced3722e63b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:47.660255 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e1af98af-1e39-492e-aff0-44186412eb93 req-8e2e44d9-fd77-412e-8423-cced3722e63b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:47.661298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e1af98af-1e39-492e-aff0-44186412eb93 req-8e2e44d9-fd77-412e-8423-cced3722e63b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:47.681421 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e1af98af-1e39-492e-aff0-44186412eb93 req-8e2e44d9-fd77-412e-8423-cced3722e63b service nova] Creating event network-vif-deleted:a140e4d3-bf2e-4d6d-91db-845b6e14ff4c for instance fa66cd24-46d6-4815-a1ab-020369fdc638 on n-h2-844626-8 Aug 09 15:26:47.693504 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e1af98af-1e39-492e-aff0-44186412eb93 req-8e2e44d9-fd77-412e-8423-cced3722e63b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056007 Aug 09 15:26:47.694810 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3386/6781] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:26:48.529491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2315397d-b7ce-4225-bff7-75a3b7c0cd99 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:48.530581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2315397d-b7ce-4225-bff7-75a3b7c0cd99 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:48.539828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2315397d-b7ce-4225-bff7-75a3b7c0cd99 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:48.540445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2315397d-b7ce-4225-bff7-75a3b7c0cd99 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:48.541089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2315397d-b7ce-4225-bff7-75a3b7c0cd99 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:48.541952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2315397d-b7ce-4225-bff7-75a3b7c0cd99 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:48.542529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2315397d-b7ce-4225-bff7-75a3b7c0cd99 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:48.543072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2315397d-b7ce-4225-bff7-75a3b7c0cd99 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:48.562166 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-2315397d-b7ce-4225-bff7-75a3b7c0cd99 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2315397d-b7ce-4225-bff7-75a3b7c0cd99 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 HTTP/1.1 Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'fa66cd24-46d6-4815-a1ab-020369fdc638'} Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:26:48.564536 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:26:48.571641 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:26:48.571641 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:26:48.571641 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:26:48.571641 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:26:48.571641 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:26:48.571641 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:26:48.571641 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:26:48.571641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2315397d-b7ce-4225-bff7-75a3b7c0cd99 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:26:48.571641 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2315397d-b7ce-4225-bff7-75a3b7c0cd99 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 404 len: 111 microversion: 2.1 time: 0.041578 Aug 09 15:26:48.571641 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3396/6782] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:48 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:26:48.594495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bfbb639-c0b2-4798-a66a-e7a4308152e9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:48.595609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8bfbb639-c0b2-4798-a66a-e7a4308152e9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:48.608475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bfbb639-c0b2-4798-a66a-e7a4308152e9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:48.609364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bfbb639-c0b2-4798-a66a-e7a4308152e9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:48.610145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bfbb639-c0b2-4798-a66a-e7a4308152e9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:48.611506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bfbb639-c0b2-4798-a66a-e7a4308152e9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:48.612344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bfbb639-c0b2-4798-a66a-e7a4308152e9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:48.613123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8bfbb639-c0b2-4798-a66a-e7a4308152e9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:48.643392 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-8bfbb639-c0b2-4798-a66a-e7a4308152e9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bfbb639-c0b2-4798-a66a-e7a4308152e9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 HTTP/1.1 Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'fa66cd24-46d6-4815-a1ab-020369fdc638'} Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:26:48.647026 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:26:48.655635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:26:48.655635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:26:48.655635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:26:48.655635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:26:48.655635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:26:48.655635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:26:48.655635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:26:48.655635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8bfbb639-c0b2-4798-a66a-e7a4308152e9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:26:48.655635 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8bfbb639-c0b2-4798-a66a-e7a4308152e9 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 404 len: 111 microversion: 2.1 time: 0.063759 Aug 09 15:26:48.657686 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3387/6783] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:48 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:26:48.734823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1474853674", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "38bb04fc-70f1-41b1-aef0-d31c411f18a0"}], "security_groups": [{"name": "tempest-securitygroup--1420965144"}], "key_name": "tempest-keypair-1527801048", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:26:48.907607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] validate_networks() for [('38bb04fc-70f1-41b1-aef0-d31c411f18a0', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:26:49.541240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:26:49.542336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:26:49.542919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:26:49.543591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:26:49.544900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:26:49.557536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:49.558266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:49.559041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:49.560045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:49.560604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:49.561186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:49.584322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:26:49.591196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for user 127998e24ecf48d58f3c789530f89898 and project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:26:49.612809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:26:49.616803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:26:49.677019 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f2470d2-91cc-48d8-8d2d-25b4d31f70c0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.947427 Aug 09 15:26:49.678087 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3397/6784] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:26:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:26:49.692611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c0250cb9-d4df-45ec-801c-68f9852f60b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:49.693775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c0250cb9-d4df-45ec-801c-68f9852f60b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:49.797754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c0250cb9-d4df-45ec-801c-68f9852f60b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:49.809510 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c0250cb9-d4df-45ec-801c-68f9852f60b7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1239 microversion: 2.1 time: 0.123371 Aug 09 15:26:49.811219 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3388/6785] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:49 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1239 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:50.842799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b9f9abb9-1ccd-40a3-b440-fbe0f7ed3e00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:50.844300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b9f9abb9-1ccd-40a3-b440-fbe0f7ed3e00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:50.854846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9f9abb9-1ccd-40a3-b440-fbe0f7ed3e00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:50.855680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9f9abb9-1ccd-40a3-b440-fbe0f7ed3e00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:50.856330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9f9abb9-1ccd-40a3-b440-fbe0f7ed3e00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:50.857553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9f9abb9-1ccd-40a3-b440-fbe0f7ed3e00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:50.858253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9f9abb9-1ccd-40a3-b440-fbe0f7ed3e00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:50.858867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9f9abb9-1ccd-40a3-b440-fbe0f7ed3e00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:50.950547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b9f9abb9-1ccd-40a3-b440-fbe0f7ed3e00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:50.959949 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b9f9abb9-1ccd-40a3-b440-fbe0f7ed3e00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1291 microversion: 2.1 time: 0.128601 Aug 09 15:26:50.960708 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3398/6786] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:50 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1291 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:51.994721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-747079f5-bc1d-4d1d-a025-6beb28665b53 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:51.995943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-747079f5-bc1d-4d1d-a025-6beb28665b53 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:52.008905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-747079f5-bc1d-4d1d-a025-6beb28665b53 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:52.009643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-747079f5-bc1d-4d1d-a025-6beb28665b53 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:52.010309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-747079f5-bc1d-4d1d-a025-6beb28665b53 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:52.011628 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-747079f5-bc1d-4d1d-a025-6beb28665b53 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:52.012273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-747079f5-bc1d-4d1d-a025-6beb28665b53 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:52.013022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-747079f5-bc1d-4d1d-a025-6beb28665b53 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:52.230287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-747079f5-bc1d-4d1d-a025-6beb28665b53 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:52.245912 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-747079f5-bc1d-4d1d-a025-6beb28665b53 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1365 microversion: 2.1 time: 0.260313 Aug 09 15:26:52.251159 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3389/6787] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:51 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:52.957335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-25542f70-d0a3-40e5-9896-adfbd5ffbf68 req-dd3ef30e-80df-4841-8150-52bf4702b202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d5a370-c42b-4fa9-af33-6c5745e12794", "tag": "79019cd2-7c6c-4f34-aefa-ac1922ac8cce"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:26:52.979136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-25542f70-d0a3-40e5-9896-adfbd5ffbf68 req-dd3ef30e-80df-4841-8150-52bf4702b202 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:52.981126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-25542f70-d0a3-40e5-9896-adfbd5ffbf68 req-dd3ef30e-80df-4841-8150-52bf4702b202 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:52.982425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-25542f70-d0a3-40e5-9896-adfbd5ffbf68 req-dd3ef30e-80df-4841-8150-52bf4702b202 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:53.001426 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-25542f70-d0a3-40e5-9896-adfbd5ffbf68 req-dd3ef30e-80df-4841-8150-52bf4702b202 service nova] Creating event network-changed:79019cd2-7c6c-4f34-aefa-ac1922ac8cce for instance 16d5a370-c42b-4fa9-af33-6c5745e12794 on n-h1-844626-8 Aug 09 15:26:53.010052 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-25542f70-d0a3-40e5-9896-adfbd5ffbf68 req-dd3ef30e-80df-4841-8150-52bf4702b202 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056431 Aug 09 15:26:53.011205 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3399/6788] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:26:53.273078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b3459c0-c430-433f-98fa-9aefbf67a983 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:53.274244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b3459c0-c430-433f-98fa-9aefbf67a983 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:53.287949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b3459c0-c430-433f-98fa-9aefbf67a983 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:53.288876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b3459c0-c430-433f-98fa-9aefbf67a983 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:53.289760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b3459c0-c430-433f-98fa-9aefbf67a983 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:53.291054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b3459c0-c430-433f-98fa-9aefbf67a983 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:53.291953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b3459c0-c430-433f-98fa-9aefbf67a983 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:53.292747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b3459c0-c430-433f-98fa-9aefbf67a983 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:53.469889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b3459c0-c430-433f-98fa-9aefbf67a983 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:53.482098 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b3459c0-c430-433f-98fa-9aefbf67a983 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1365 microversion: 2.1 time: 0.216680 Aug 09 15:26:53.482752 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3390/6789] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:53 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:54.507578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1e37eee2-82d3-4aec-8220-627f1d10aff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:54.508683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1e37eee2-82d3-4aec-8220-627f1d10aff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:54.522026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e37eee2-82d3-4aec-8220-627f1d10aff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:54.522896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e37eee2-82d3-4aec-8220-627f1d10aff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:54.523706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e37eee2-82d3-4aec-8220-627f1d10aff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:54.524992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e37eee2-82d3-4aec-8220-627f1d10aff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:54.525815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e37eee2-82d3-4aec-8220-627f1d10aff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:54.526591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e37eee2-82d3-4aec-8220-627f1d10aff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:54.738954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e37eee2-82d3-4aec-8220-627f1d10aff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:54.754674 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1e37eee2-82d3-4aec-8220-627f1d10aff0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1365 microversion: 2.1 time: 0.251546 Aug 09 15:26:54.756191 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3400/6790] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:54 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:55.792517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-02e9e1f5-56d0-42eb-8174-12d30fe67c5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:55.793142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-02e9e1f5-56d0-42eb-8174-12d30fe67c5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:55.801133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02e9e1f5-56d0-42eb-8174-12d30fe67c5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:55.801636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02e9e1f5-56d0-42eb-8174-12d30fe67c5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:55.802283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02e9e1f5-56d0-42eb-8174-12d30fe67c5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:55.803254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02e9e1f5-56d0-42eb-8174-12d30fe67c5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:55.803709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02e9e1f5-56d0-42eb-8174-12d30fe67c5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:55.804465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02e9e1f5-56d0-42eb-8174-12d30fe67c5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:55.960298 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-02e9e1f5-56d0-42eb-8174-12d30fe67c5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:55.969244 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-02e9e1f5-56d0-42eb-8174-12d30fe67c5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1365 microversion: 2.1 time: 0.181329 Aug 09 15:26:55.969845 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3391/6791] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:55 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:56.999446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b9c4ef37-b879-4811-b9d3-d86e12caccc3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:57.000355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b9c4ef37-b879-4811-b9d3-d86e12caccc3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:57.012742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9c4ef37-b879-4811-b9d3-d86e12caccc3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:57.013607 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9c4ef37-b879-4811-b9d3-d86e12caccc3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:57.014362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9c4ef37-b879-4811-b9d3-d86e12caccc3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:57.017258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9c4ef37-b879-4811-b9d3-d86e12caccc3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:57.018122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9c4ef37-b879-4811-b9d3-d86e12caccc3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:57.019119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9c4ef37-b879-4811-b9d3-d86e12caccc3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:57.225745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b9c4ef37-b879-4811-b9d3-d86e12caccc3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:57.235744 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b9c4ef37-b879-4811-b9d3-d86e12caccc3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1365 microversion: 2.1 time: 0.243432 Aug 09 15:26:57.236353 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3401/6792] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:56 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:58.271790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-02c17be2-b57c-45eb-b152-a36aeecfb55b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:58.272887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-02c17be2-b57c-45eb-b152-a36aeecfb55b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:58.285696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02c17be2-b57c-45eb-b152-a36aeecfb55b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:58.286694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02c17be2-b57c-45eb-b152-a36aeecfb55b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:58.287547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02c17be2-b57c-45eb-b152-a36aeecfb55b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:58.288934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02c17be2-b57c-45eb-b152-a36aeecfb55b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:58.289772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02c17be2-b57c-45eb-b152-a36aeecfb55b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:58.290687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-02c17be2-b57c-45eb-b152-a36aeecfb55b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:58.490217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-02c17be2-b57c-45eb-b152-a36aeecfb55b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:58.500075 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-02c17be2-b57c-45eb-b152-a36aeecfb55b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1365 microversion: 2.1 time: 0.235755 Aug 09 15:26:58.500822 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3392/6793] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:58 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:26:58.706477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2ffc4de1-3a7d-470d-9a61-12faaeb5dba9 req-9d561272-4648-4a3b-a83a-effbbeccc8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d5a370-c42b-4fa9-af33-6c5745e12794", "name": "network-vif-plugged", "status": "completed", "tag": "79019cd2-7c6c-4f34-aefa-ac1922ac8cce"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:26:58.732984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2ffc4de1-3a7d-470d-9a61-12faaeb5dba9 req-9d561272-4648-4a3b-a83a-effbbeccc8b2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:58.733953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2ffc4de1-3a7d-470d-9a61-12faaeb5dba9 req-9d561272-4648-4a3b-a83a-effbbeccc8b2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:58.735393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2ffc4de1-3a7d-470d-9a61-12faaeb5dba9 req-9d561272-4648-4a3b-a83a-effbbeccc8b2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:58.761026 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2ffc4de1-3a7d-470d-9a61-12faaeb5dba9 req-9d561272-4648-4a3b-a83a-effbbeccc8b2 service nova] Creating event network-vif-plugged:79019cd2-7c6c-4f34-aefa-ac1922ac8cce for instance 16d5a370-c42b-4fa9-af33-6c5745e12794 on n-h1-844626-8 Aug 09 15:26:58.771559 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2ffc4de1-3a7d-470d-9a61-12faaeb5dba9 req-9d561272-4648-4a3b-a83a-effbbeccc8b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072711 Aug 09 15:26:58.772801 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3402/6794] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:26:59.527024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7201368d-2783-4611-b38c-1146758d8230 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:26:59.528314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7201368d-2783-4611-b38c-1146758d8230 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:26:59.543999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7201368d-2783-4611-b38c-1146758d8230 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:59.545060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7201368d-2783-4611-b38c-1146758d8230 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:59.545897 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7201368d-2783-4611-b38c-1146758d8230 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:59.547741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7201368d-2783-4611-b38c-1146758d8230 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:26:59.548580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7201368d-2783-4611-b38c-1146758d8230 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:26:59.549379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7201368d-2783-4611-b38c-1146758d8230 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:26:59.794870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7201368d-2783-4611-b38c-1146758d8230 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:26:59.805438 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7201368d-2783-4611-b38c-1146758d8230 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1365 microversion: 2.1 time: 0.284401 Aug 09 15:26:59.806353 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3393/6795] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:26:59 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:27:00.835833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc9e5d55-881d-4332-b90d-7826b22a84a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:27:00.836941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bc9e5d55-881d-4332-b90d-7826b22a84a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:27:00.839329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:27:00.840118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:27:00.850708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc9e5d55-881d-4332-b90d-7826b22a84a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:00.851754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc9e5d55-881d-4332-b90d-7826b22a84a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:00.852362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc9e5d55-881d-4332-b90d-7826b22a84a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:00.853233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc9e5d55-881d-4332-b90d-7826b22a84a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:00.853781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc9e5d55-881d-4332-b90d-7826b22a84a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:00.854237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bc9e5d55-881d-4332-b90d-7826b22a84a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:01.056357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bc9e5d55-881d-4332-b90d-7826b22a84a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:27:01.066056 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc9e5d55-881d-4332-b90d-7826b22a84a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1553 microversion: 2.1 time: 0.235406 Aug 09 15:27:01.066893 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3403/6796] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:27:00 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:27:01.090795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fadf8c9-2efc-45d9-b491-742dc49ae672 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:27:01.091648 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3fadf8c9-2efc-45d9-b491-742dc49ae672 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:27:01.094719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:27:01.105368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fadf8c9-2efc-45d9-b491-742dc49ae672 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:01.106236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fadf8c9-2efc-45d9-b491-742dc49ae672 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:01.107067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fadf8c9-2efc-45d9-b491-742dc49ae672 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:01.108395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fadf8c9-2efc-45d9-b491-742dc49ae672 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:01.109231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fadf8c9-2efc-45d9-b491-742dc49ae672 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:01.109995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fadf8c9-2efc-45d9-b491-742dc49ae672 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:01.211953 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fadf8c9-2efc-45d9-b491-742dc49ae672 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125038 Aug 09 15:27:01.212951 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3394/6797] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 15:27:01 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:27:02.603818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a99c67a1-bebd-4ccd-900d-daff6a055382 req-bf08a30c-6cdc-43b1-b3af-9c4517643b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d5a370-c42b-4fa9-af33-6c5745e12794", "tag": "79019cd2-7c6c-4f34-aefa-ac1922ac8cce"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:27:02.629078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a99c67a1-bebd-4ccd-900d-daff6a055382 req-bf08a30c-6cdc-43b1-b3af-9c4517643b68 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:02.631042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a99c67a1-bebd-4ccd-900d-daff6a055382 req-bf08a30c-6cdc-43b1-b3af-9c4517643b68 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:02.632190 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a99c67a1-bebd-4ccd-900d-daff6a055382 req-bf08a30c-6cdc-43b1-b3af-9c4517643b68 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:02.656718 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a99c67a1-bebd-4ccd-900d-daff6a055382 req-bf08a30c-6cdc-43b1-b3af-9c4517643b68 service nova] Creating event network-changed:79019cd2-7c6c-4f34-aefa-ac1922ac8cce for instance 16d5a370-c42b-4fa9-af33-6c5745e12794 on n-h1-844626-8 Aug 09 15:27:02.668188 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a99c67a1-bebd-4ccd-900d-daff6a055382 req-bf08a30c-6cdc-43b1-b3af-9c4517643b68 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072231 Aug 09 15:27:02.668188 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3404/6798] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:27:07.748913 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:27:07.749800 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:27:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:27:39.272280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=19 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:27:39.273315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:27:39.278248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c78a3d1d-591f-4bab-a9b2-bb6f332be7a1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:27:39.278902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c78a3d1d-591f-4bab-a9b2-bb6f332be7a1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:27:39.286936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c78a3d1d-591f-4bab-a9b2-bb6f332be7a1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:39.287471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c78a3d1d-591f-4bab-a9b2-bb6f332be7a1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:39.287923 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c78a3d1d-591f-4bab-a9b2-bb6f332be7a1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:39.288690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c78a3d1d-591f-4bab-a9b2-bb6f332be7a1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:39.289159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c78a3d1d-591f-4bab-a9b2-bb6f332be7a1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:39.289589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c78a3d1d-591f-4bab-a9b2-bb6f332be7a1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:39.476717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c78a3d1d-591f-4bab-a9b2-bb6f332be7a1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:27:39.491132 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c78a3d1d-591f-4bab-a9b2-bb6f332be7a1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1672 microversion: 2.1 time: 0.221083 Aug 09 15:27:39.492251 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3395/6799] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:27:39 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1672 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:27:39.526989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:27:39.528219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=46 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:27:39.533371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b89cd9ee-40cb-4552-91d5-e7bfc28cd9f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d72e7b8-308e-40df-bda4-67bf4a96bbdd"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:27:39.536197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b89cd9ee-40cb-4552-91d5-e7bfc28cd9f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:27:39.545729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b89cd9ee-40cb-4552-91d5-e7bfc28cd9f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:39.546332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b89cd9ee-40cb-4552-91d5-e7bfc28cd9f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:39.546822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b89cd9ee-40cb-4552-91d5-e7bfc28cd9f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:39.547610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b89cd9ee-40cb-4552-91d5-e7bfc28cd9f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:39.548333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b89cd9ee-40cb-4552-91d5-e7bfc28cd9f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:39.549081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b89cd9ee-40cb-4552-91d5-e7bfc28cd9f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:39.862261 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b89cd9ee-40cb-4552-91d5-e7bfc28cd9f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337350 Aug 09 15:27:39.863046 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3405/6800] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 15:27:39 2022] POST /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:27:51.897810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:27:51.900319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:27:51.903136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:27:51.903811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:27:51.910957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:51.911520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:51.911964 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:51.912703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:51.913165 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:51.913619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:51.946798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:27:51.953741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Old instance type m1.heat2, new instance type m1.heat {{(pid=119406) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 15:27:51.961083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:27:51.961533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:27:51.962006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:27:51.962428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:27:51.962868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:27:52.042350 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2244b769-eb35-45f2-96f4-61d139637ee1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794/action" status: 202 len: 0 microversion: 2.1 time: 0.156652 Aug 09 15:27:52.043226 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3396/6801] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:27:51 2022] POST /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 15:27:52.058372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-69cedf05-01da-428d-ac80-6ea6571bbd31 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:27:52.058372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-69cedf05-01da-428d-ac80-6ea6571bbd31 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:27:52.061800 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:27:52.062577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:27:52.069460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69cedf05-01da-428d-ac80-6ea6571bbd31 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:52.070088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69cedf05-01da-428d-ac80-6ea6571bbd31 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:52.070666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69cedf05-01da-428d-ac80-6ea6571bbd31 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:52.071439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69cedf05-01da-428d-ac80-6ea6571bbd31 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:52.071892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69cedf05-01da-428d-ac80-6ea6571bbd31 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:52.072314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-69cedf05-01da-428d-ac80-6ea6571bbd31 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:52.269589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-69cedf05-01da-428d-ac80-6ea6571bbd31 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:27:52.279916 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-69cedf05-01da-428d-ac80-6ea6571bbd31 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1727 microversion: 2.1 time: 0.231264 Aug 09 15:27:52.280668 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3406/6802] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:27:52 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1727 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:27:53.313117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-48f51da5-41a5-4467-8f88-81a1346981c4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:27:53.313746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-48f51da5-41a5-4467-8f88-81a1346981c4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:27:53.321738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48f51da5-41a5-4467-8f88-81a1346981c4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:53.322242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48f51da5-41a5-4467-8f88-81a1346981c4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:53.322688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48f51da5-41a5-4467-8f88-81a1346981c4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:53.323448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48f51da5-41a5-4467-8f88-81a1346981c4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:53.323910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48f51da5-41a5-4467-8f88-81a1346981c4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:53.324342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-48f51da5-41a5-4467-8f88-81a1346981c4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:53.491193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-48f51da5-41a5-4467-8f88-81a1346981c4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:27:53.502329 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-48f51da5-41a5-4467-8f88-81a1346981c4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1727 microversion: 2.1 time: 0.194290 Aug 09 15:27:53.504257 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3397/6803] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:27:53 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:27:54.541820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f9b483f-ee76-4b7c-a669-bac0a68f0f2d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:27:54.542538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f9b483f-ee76-4b7c-a669-bac0a68f0f2d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:27:54.550513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f9b483f-ee76-4b7c-a669-bac0a68f0f2d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:54.550989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f9b483f-ee76-4b7c-a669-bac0a68f0f2d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:54.551453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f9b483f-ee76-4b7c-a669-bac0a68f0f2d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:54.552332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f9b483f-ee76-4b7c-a669-bac0a68f0f2d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:54.552787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f9b483f-ee76-4b7c-a669-bac0a68f0f2d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:54.553203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f9b483f-ee76-4b7c-a669-bac0a68f0f2d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:54.704947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6f9b483f-ee76-4b7c-a669-bac0a68f0f2d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:27:54.714329 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f9b483f-ee76-4b7c-a669-bac0a68f0f2d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.176982 Aug 09 15:27:54.714944 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3407/6804] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:27:54 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:27:55.737792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9f184cd4-f1dc-41d9-a2aa-2c54993dc51a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:27:55.738666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9f184cd4-f1dc-41d9-a2aa-2c54993dc51a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:27:55.747362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f184cd4-f1dc-41d9-a2aa-2c54993dc51a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:55.748172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f184cd4-f1dc-41d9-a2aa-2c54993dc51a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:55.748777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f184cd4-f1dc-41d9-a2aa-2c54993dc51a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:55.749661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f184cd4-f1dc-41d9-a2aa-2c54993dc51a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:55.750263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f184cd4-f1dc-41d9-a2aa-2c54993dc51a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:55.750877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9f184cd4-f1dc-41d9-a2aa-2c54993dc51a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:55.917752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9f184cd4-f1dc-41d9-a2aa-2c54993dc51a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:27:55.927198 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9f184cd4-f1dc-41d9-a2aa-2c54993dc51a tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.193323 Aug 09 15:27:55.928109 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3398/6805] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:27:55 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:27:56.950312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b176ba05-234e-471e-b886-3ad62c2bbffc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:27:56.951022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b176ba05-234e-471e-b886-3ad62c2bbffc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:27:56.960401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b176ba05-234e-471e-b886-3ad62c2bbffc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:56.960972 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b176ba05-234e-471e-b886-3ad62c2bbffc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:56.961441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b176ba05-234e-471e-b886-3ad62c2bbffc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:56.962198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b176ba05-234e-471e-b886-3ad62c2bbffc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:56.962656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b176ba05-234e-471e-b886-3ad62c2bbffc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:56.963107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b176ba05-234e-471e-b886-3ad62c2bbffc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:57.125472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b176ba05-234e-471e-b886-3ad62c2bbffc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:27:57.135917 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b176ba05-234e-471e-b886-3ad62c2bbffc tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.189824 Aug 09 15:27:57.136521 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3408/6806] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:27:56 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:27:58.158694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-face8551-0d8a-4825-af78-fc273eee4a77 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:27:58.159791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-face8551-0d8a-4825-af78-fc273eee4a77 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:27:58.169228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-face8551-0d8a-4825-af78-fc273eee4a77 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:58.169749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-face8551-0d8a-4825-af78-fc273eee4a77 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:58.170211 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-face8551-0d8a-4825-af78-fc273eee4a77 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:58.171007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-face8551-0d8a-4825-af78-fc273eee4a77 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:58.171531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-face8551-0d8a-4825-af78-fc273eee4a77 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:58.171991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-face8551-0d8a-4825-af78-fc273eee4a77 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:58.363137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-face8551-0d8a-4825-af78-fc273eee4a77 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:27:58.372562 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-face8551-0d8a-4825-af78-fc273eee4a77 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.218404 Aug 09 15:27:58.373182 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3399/6807] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:27:58 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:27:59.400827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1dc1929-beb2-412f-9baf-417ab025bf2f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:27:59.401618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1dc1929-beb2-412f-9baf-417ab025bf2f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:27:59.415015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1dc1929-beb2-412f-9baf-417ab025bf2f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:59.415967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1dc1929-beb2-412f-9baf-417ab025bf2f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:59.416797 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1dc1929-beb2-412f-9baf-417ab025bf2f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:59.418141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1dc1929-beb2-412f-9baf-417ab025bf2f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:27:59.418985 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1dc1929-beb2-412f-9baf-417ab025bf2f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:27:59.419830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1dc1929-beb2-412f-9baf-417ab025bf2f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:27:59.632347 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1dc1929-beb2-412f-9baf-417ab025bf2f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:27:59.643198 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1dc1929-beb2-412f-9baf-417ab025bf2f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.249871 Aug 09 15:27:59.643932 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3409/6808] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:27:59 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:00.670393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df31217c-913d-4213-a838-7ea4b8e35ed2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:00.671257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-df31217c-913d-4213-a838-7ea4b8e35ed2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:00.679525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df31217c-913d-4213-a838-7ea4b8e35ed2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:00.680100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df31217c-913d-4213-a838-7ea4b8e35ed2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:00.680579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df31217c-913d-4213-a838-7ea4b8e35ed2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:00.681385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df31217c-913d-4213-a838-7ea4b8e35ed2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:00.681888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df31217c-913d-4213-a838-7ea4b8e35ed2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:00.682395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df31217c-913d-4213-a838-7ea4b8e35ed2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:00.886796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-df31217c-913d-4213-a838-7ea4b8e35ed2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:00.896095 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-df31217c-913d-4213-a838-7ea4b8e35ed2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.231740 Aug 09 15:28:00.896855 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3400/6809] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:00 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:01.922221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7bf83cd-f7d8-4b42-a76b-c3608b45e536 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:01.923374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e7bf83cd-f7d8-4b42-a76b-c3608b45e536 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:01.933802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bf83cd-f7d8-4b42-a76b-c3608b45e536 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:01.934645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bf83cd-f7d8-4b42-a76b-c3608b45e536 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:01.935507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bf83cd-f7d8-4b42-a76b-c3608b45e536 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:01.936807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bf83cd-f7d8-4b42-a76b-c3608b45e536 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:01.937672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bf83cd-f7d8-4b42-a76b-c3608b45e536 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:01.938454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bf83cd-f7d8-4b42-a76b-c3608b45e536 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:02.187732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e7bf83cd-f7d8-4b42-a76b-c3608b45e536 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:02.205896 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e7bf83cd-f7d8-4b42-a76b-c3608b45e536 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.288859 Aug 09 15:28:02.207495 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3410/6810] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:01 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:03.239859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b3dfa1a6-5eb4-43eb-a648-14dd28edaf08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:03.240806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b3dfa1a6-5eb4-43eb-a648-14dd28edaf08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:03.250690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3dfa1a6-5eb4-43eb-a648-14dd28edaf08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:03.250690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3dfa1a6-5eb4-43eb-a648-14dd28edaf08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:03.251552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3dfa1a6-5eb4-43eb-a648-14dd28edaf08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:03.252449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3dfa1a6-5eb4-43eb-a648-14dd28edaf08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:03.252985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3dfa1a6-5eb4-43eb-a648-14dd28edaf08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:03.253535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b3dfa1a6-5eb4-43eb-a648-14dd28edaf08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:03.438511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b3dfa1a6-5eb4-43eb-a648-14dd28edaf08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:03.448118 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b3dfa1a6-5eb4-43eb-a648-14dd28edaf08 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.212571 Aug 09 15:28:03.448923 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3401/6811] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:03 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:04.490244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6cd00caf-602a-4bb0-8d0e-dcff140bc067 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:04.491439 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6cd00caf-602a-4bb0-8d0e-dcff140bc067 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:04.501197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cd00caf-602a-4bb0-8d0e-dcff140bc067 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:04.501828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cd00caf-602a-4bb0-8d0e-dcff140bc067 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:04.502515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cd00caf-602a-4bb0-8d0e-dcff140bc067 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:04.503336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cd00caf-602a-4bb0-8d0e-dcff140bc067 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:04.503802 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cd00caf-602a-4bb0-8d0e-dcff140bc067 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:04.504288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cd00caf-602a-4bb0-8d0e-dcff140bc067 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:04.705990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6cd00caf-602a-4bb0-8d0e-dcff140bc067 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:04.716070 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6cd00caf-602a-4bb0-8d0e-dcff140bc067 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.231014 Aug 09 15:28:04.716719 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3411/6812] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:04 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:05.744499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b6975bd-d729-4082-8163-735b33450203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:05.745899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b6975bd-d729-4082-8163-735b33450203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:05.754101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b6975bd-d729-4082-8163-735b33450203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:05.754682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b6975bd-d729-4082-8163-735b33450203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:05.755498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b6975bd-d729-4082-8163-735b33450203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:05.756565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b6975bd-d729-4082-8163-735b33450203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:05.757204 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b6975bd-d729-4082-8163-735b33450203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:05.757697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b6975bd-d729-4082-8163-735b33450203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:05.975671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b6975bd-d729-4082-8163-735b33450203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:05.990729 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b6975bd-d729-4082-8163-735b33450203 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.251336 Aug 09 15:28:05.991422 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3402/6813] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:05 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:07.016290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89b29674-31ff-4bf0-846f-c35d55382ac4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:07.017078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-89b29674-31ff-4bf0-846f-c35d55382ac4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:07.028303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89b29674-31ff-4bf0-846f-c35d55382ac4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:07.029321 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89b29674-31ff-4bf0-846f-c35d55382ac4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:07.030263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89b29674-31ff-4bf0-846f-c35d55382ac4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:07.031732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89b29674-31ff-4bf0-846f-c35d55382ac4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:07.032662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89b29674-31ff-4bf0-846f-c35d55382ac4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:07.033614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89b29674-31ff-4bf0-846f-c35d55382ac4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:07.272970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-89b29674-31ff-4bf0-846f-c35d55382ac4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:07.286712 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-89b29674-31ff-4bf0-846f-c35d55382ac4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.273468 Aug 09 15:28:07.287886 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3412/6814] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:07 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:08.332393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5601c363-f475-4388-bd55-9038ec0f9c88 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:08.334756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5601c363-f475-4388-bd55-9038ec0f9c88 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:08.347819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5601c363-f475-4388-bd55-9038ec0f9c88 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:08.348712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5601c363-f475-4388-bd55-9038ec0f9c88 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:08.349951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5601c363-f475-4388-bd55-9038ec0f9c88 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:08.351306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5601c363-f475-4388-bd55-9038ec0f9c88 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:08.352188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5601c363-f475-4388-bd55-9038ec0f9c88 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:08.366434 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5601c363-f475-4388-bd55-9038ec0f9c88 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:08.614747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5601c363-f475-4388-bd55-9038ec0f9c88 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:08.630688 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5601c363-f475-4388-bd55-9038ec0f9c88 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.305526 Aug 09 15:28:08.631813 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3403/6815] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:08 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:09.659591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-801a857d-e1eb-4f42-9305-3d4d79d459f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:09.660310 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-801a857d-e1eb-4f42-9305-3d4d79d459f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:09.668462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-801a857d-e1eb-4f42-9305-3d4d79d459f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:09.668967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-801a857d-e1eb-4f42-9305-3d4d79d459f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:09.669419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-801a857d-e1eb-4f42-9305-3d4d79d459f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:09.670168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-801a857d-e1eb-4f42-9305-3d4d79d459f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:09.670638 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-801a857d-e1eb-4f42-9305-3d4d79d459f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:09.671193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-801a857d-e1eb-4f42-9305-3d4d79d459f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:09.886136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-801a857d-e1eb-4f42-9305-3d4d79d459f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:09.899307 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-801a857d-e1eb-4f42-9305-3d4d79d459f7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1732 microversion: 2.1 time: 0.244389 Aug 09 15:28:09.900163 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3413/6816] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:09 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1732 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:10.435060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-13ff0974-e91f-4308-a035-b4da2d2e7f17 req-51db2a5b-1fe0-4254-b45e-aca99a09b8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d5a370-c42b-4fa9-af33-6c5745e12794", "name": "network-vif-unplugged", "status": "completed", "tag": "79019cd2-7c6c-4f34-aefa-ac1922ac8cce"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:28:10.451147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-13ff0974-e91f-4308-a035-b4da2d2e7f17 req-51db2a5b-1fe0-4254-b45e-aca99a09b8d7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:10.452201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-13ff0974-e91f-4308-a035-b4da2d2e7f17 req-51db2a5b-1fe0-4254-b45e-aca99a09b8d7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:10.453053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-13ff0974-e91f-4308-a035-b4da2d2e7f17 req-51db2a5b-1fe0-4254-b45e-aca99a09b8d7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:10.473641 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-13ff0974-e91f-4308-a035-b4da2d2e7f17 req-51db2a5b-1fe0-4254-b45e-aca99a09b8d7 service nova] Creating event network-vif-unplugged:79019cd2-7c6c-4f34-aefa-ac1922ac8cce for instance 16d5a370-c42b-4fa9-af33-6c5745e12794 on n-h2-844626-8 Aug 09 15:28:10.481700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-13ff0974-e91f-4308-a035-b4da2d2e7f17 req-51db2a5b-1fe0-4254-b45e-aca99a09b8d7 service nova] Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:28:10.498394 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-13ff0974-e91f-4308-a035-b4da2d2e7f17 req-51db2a5b-1fe0-4254-b45e-aca99a09b8d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067336 Aug 09 15:28:10.499447 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3404/6817] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:28:10.929702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ece83f1-8b7c-4b03-a926-76bc0441dc00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:10.930773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4ece83f1-8b7c-4b03-a926-76bc0441dc00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:10.940947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ece83f1-8b7c-4b03-a926-76bc0441dc00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:10.942947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ece83f1-8b7c-4b03-a926-76bc0441dc00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:10.942947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ece83f1-8b7c-4b03-a926-76bc0441dc00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:10.944873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ece83f1-8b7c-4b03-a926-76bc0441dc00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:10.944873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ece83f1-8b7c-4b03-a926-76bc0441dc00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:10.945300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4ece83f1-8b7c-4b03-a926-76bc0441dc00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:11.343648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4ece83f1-8b7c-4b03-a926-76bc0441dc00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:11.355433 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4ece83f1-8b7c-4b03-a926-76bc0441dc00 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1731 microversion: 2.1 time: 0.430802 Aug 09 15:28:11.356402 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3414/6818] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:10 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1731 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:12.399720 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5953373e-f4aa-4148-ad56-95f95ea90edf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:12.402445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5953373e-f4aa-4148-ad56-95f95ea90edf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:12.416509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5953373e-f4aa-4148-ad56-95f95ea90edf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:12.417480 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5953373e-f4aa-4148-ad56-95f95ea90edf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:12.418402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5953373e-f4aa-4148-ad56-95f95ea90edf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:12.420017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5953373e-f4aa-4148-ad56-95f95ea90edf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:12.420941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5953373e-f4aa-4148-ad56-95f95ea90edf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:12.421799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5953373e-f4aa-4148-ad56-95f95ea90edf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:12.555825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3ec17988-7ef9-40f2-bc78-6b1ea5426965 req-0b8c110e-1199-49b9-b92a-8d20ffa95a3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d5a370-c42b-4fa9-af33-6c5745e12794", "tag": "79019cd2-7c6c-4f34-aefa-ac1922ac8cce"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:28:12.581435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3ec17988-7ef9-40f2-bc78-6b1ea5426965 req-0b8c110e-1199-49b9-b92a-8d20ffa95a3d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:12.582412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3ec17988-7ef9-40f2-bc78-6b1ea5426965 req-0b8c110e-1199-49b9-b92a-8d20ffa95a3d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:12.583143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3ec17988-7ef9-40f2-bc78-6b1ea5426965 req-0b8c110e-1199-49b9-b92a-8d20ffa95a3d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:12.604652 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3ec17988-7ef9-40f2-bc78-6b1ea5426965 req-0b8c110e-1199-49b9-b92a-8d20ffa95a3d service nova] Creating event network-changed:79019cd2-7c6c-4f34-aefa-ac1922ac8cce for instance 16d5a370-c42b-4fa9-af33-6c5745e12794 on n-h2-844626-8 Aug 09 15:28:12.612755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-3ec17988-7ef9-40f2-bc78-6b1ea5426965 req-0b8c110e-1199-49b9-b92a-8d20ffa95a3d service nova] Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:28:12.630585 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3ec17988-7ef9-40f2-bc78-6b1ea5426965 req-0b8c110e-1199-49b9-b92a-8d20ffa95a3d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079611 Aug 09 15:28:12.631924 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3415/6819] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:28:12.754410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5953373e-f4aa-4148-ad56-95f95ea90edf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:12.768189 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5953373e-f4aa-4148-ad56-95f95ea90edf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1729 microversion: 2.1 time: 0.375744 Aug 09 15:28:12.768568 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3405/6820] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:12 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1729 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:28:13.796076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e5d942a7-78da-409b-8793-788e6cc0f6c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:13.796805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e5d942a7-78da-409b-8793-788e6cc0f6c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:13.807417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5d942a7-78da-409b-8793-788e6cc0f6c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:13.808604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5d942a7-78da-409b-8793-788e6cc0f6c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:13.809438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5d942a7-78da-409b-8793-788e6cc0f6c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:13.810263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5d942a7-78da-409b-8793-788e6cc0f6c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:13.810904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5d942a7-78da-409b-8793-788e6cc0f6c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:13.811559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5d942a7-78da-409b-8793-788e6cc0f6c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:14.225295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e5d942a7-78da-409b-8793-788e6cc0f6c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:14.239429 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e5d942a7-78da-409b-8793-788e6cc0f6c7 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1729 microversion: 2.1 time: 0.449819 Aug 09 15:28:14.240827 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3416/6821] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:13 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1729 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:15.265533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7023bf9a-d4f4-4f62-b6eb-b8eb3885423c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:15.266379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7023bf9a-d4f4-4f62-b6eb-b8eb3885423c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:15.273005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7023bf9a-d4f4-4f62-b6eb-b8eb3885423c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:15.273513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7023bf9a-d4f4-4f62-b6eb-b8eb3885423c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:15.273977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7023bf9a-d4f4-4f62-b6eb-b8eb3885423c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:15.274757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7023bf9a-d4f4-4f62-b6eb-b8eb3885423c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:15.275309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7023bf9a-d4f4-4f62-b6eb-b8eb3885423c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:15.275777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7023bf9a-d4f4-4f62-b6eb-b8eb3885423c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:15.477556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7023bf9a-d4f4-4f62-b6eb-b8eb3885423c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:15.494502 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7023bf9a-d4f4-4f62-b6eb-b8eb3885423c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1729 microversion: 2.1 time: 0.233564 Aug 09 15:28:15.495649 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3406/6822] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:15 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:28:16.528741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c64be8ce-85eb-45c1-9744-32e7fb4bb3a8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:16.530005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c64be8ce-85eb-45c1-9744-32e7fb4bb3a8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:16.543348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64be8ce-85eb-45c1-9744-32e7fb4bb3a8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:16.544747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64be8ce-85eb-45c1-9744-32e7fb4bb3a8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:16.545535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64be8ce-85eb-45c1-9744-32e7fb4bb3a8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:16.546850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64be8ce-85eb-45c1-9744-32e7fb4bb3a8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:16.547681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64be8ce-85eb-45c1-9744-32e7fb4bb3a8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:16.548465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c64be8ce-85eb-45c1-9744-32e7fb4bb3a8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:16.743963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c64be8ce-85eb-45c1-9744-32e7fb4bb3a8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:16.754960 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c64be8ce-85eb-45c1-9744-32e7fb4bb3a8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1729 microversion: 2.1 time: 0.234141 Aug 09 15:28:16.755924 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3417/6823] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:16 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:17.779749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef92d324-8eeb-4f8b-9791-f8f03e0945ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:17.780783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef92d324-8eeb-4f8b-9791-f8f03e0945ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:17.794451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef92d324-8eeb-4f8b-9791-f8f03e0945ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:17.794961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef92d324-8eeb-4f8b-9791-f8f03e0945ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:17.795446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef92d324-8eeb-4f8b-9791-f8f03e0945ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:17.796278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef92d324-8eeb-4f8b-9791-f8f03e0945ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:17.796817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef92d324-8eeb-4f8b-9791-f8f03e0945ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:17.797450 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef92d324-8eeb-4f8b-9791-f8f03e0945ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:17.983523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef92d324-8eeb-4f8b-9791-f8f03e0945ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:17.992525 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef92d324-8eeb-4f8b-9791-f8f03e0945ff tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1729 microversion: 2.1 time: 0.218229 Aug 09 15:28:17.993166 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3407/6824] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:17 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:19.017548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-efb94298-2342-4eec-bbc7-035893c45f50 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:19.018556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-efb94298-2342-4eec-bbc7-035893c45f50 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:19.028306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efb94298-2342-4eec-bbc7-035893c45f50 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:19.028885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efb94298-2342-4eec-bbc7-035893c45f50 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:19.029507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efb94298-2342-4eec-bbc7-035893c45f50 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:19.030265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efb94298-2342-4eec-bbc7-035893c45f50 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:19.030727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efb94298-2342-4eec-bbc7-035893c45f50 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:19.031189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-efb94298-2342-4eec-bbc7-035893c45f50 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:19.223351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-efb94298-2342-4eec-bbc7-035893c45f50 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:19.234902 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-efb94298-2342-4eec-bbc7-035893c45f50 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1729 microversion: 2.1 time: 0.223670 Aug 09 15:28:19.235653 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3418/6825] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:19 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:20.259179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-130b59ab-1cb1-41b0-bc94-bf592f4d63bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:20.259894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-130b59ab-1cb1-41b0-bc94-bf592f4d63bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:20.267423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-130b59ab-1cb1-41b0-bc94-bf592f4d63bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:20.267935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-130b59ab-1cb1-41b0-bc94-bf592f4d63bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:20.268391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-130b59ab-1cb1-41b0-bc94-bf592f4d63bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:20.269128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-130b59ab-1cb1-41b0-bc94-bf592f4d63bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:20.269602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-130b59ab-1cb1-41b0-bc94-bf592f4d63bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:20.270044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-130b59ab-1cb1-41b0-bc94-bf592f4d63bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:20.441230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-130b59ab-1cb1-41b0-bc94-bf592f4d63bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:20.450737 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-130b59ab-1cb1-41b0-bc94-bf592f4d63bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1729 microversion: 2.1 time: 0.195828 Aug 09 15:28:20.451401 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3408/6826] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:20 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:21.481694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f10ffaf1-29ac-4d6d-a7fe-3b0660d647fe tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:21.482308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f10ffaf1-29ac-4d6d-a7fe-3b0660d647fe tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:21.490436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10ffaf1-29ac-4d6d-a7fe-3b0660d647fe tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:21.490997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10ffaf1-29ac-4d6d-a7fe-3b0660d647fe tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:21.491529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10ffaf1-29ac-4d6d-a7fe-3b0660d647fe tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:21.492441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10ffaf1-29ac-4d6d-a7fe-3b0660d647fe tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:21.493200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10ffaf1-29ac-4d6d-a7fe-3b0660d647fe tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:21.493715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f10ffaf1-29ac-4d6d-a7fe-3b0660d647fe tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:21.661415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f10ffaf1-29ac-4d6d-a7fe-3b0660d647fe tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:21.677781 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f10ffaf1-29ac-4d6d-a7fe-3b0660d647fe tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1729 microversion: 2.1 time: 0.199699 Aug 09 15:28:21.678564 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3419/6827] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:21 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1729 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:22.712757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c564106f-edad-4f42-b6cd-0c5191a72b5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:22.714092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c564106f-edad-4f42-b6cd-0c5191a72b5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:22.716333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=31 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:28:22.723146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c564106f-edad-4f42-b6cd-0c5191a72b5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:22.724540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c564106f-edad-4f42-b6cd-0c5191a72b5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:22.724540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c564106f-edad-4f42-b6cd-0c5191a72b5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:22.725119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c564106f-edad-4f42-b6cd-0c5191a72b5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:22.725880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c564106f-edad-4f42-b6cd-0c5191a72b5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:22.726567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c564106f-edad-4f42-b6cd-0c5191a72b5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:22.731437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:28:22.908254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c564106f-edad-4f42-b6cd-0c5191a72b5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:22.920956 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c564106f-edad-4f42-b6cd-0c5191a72b5d tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1729 microversion: 2.1 time: 0.212512 Aug 09 15:28:22.921836 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3409/6828] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:22 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:23.957445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-39a74d92-ef6d-4060-9791-c9608f9823d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:23.959233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-39a74d92-ef6d-4060-9791-c9608f9823d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:23.966314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=29 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:28:23.977143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39a74d92-ef6d-4060-9791-c9608f9823d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:23.978100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39a74d92-ef6d-4060-9791-c9608f9823d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:23.978750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39a74d92-ef6d-4060-9791-c9608f9823d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:23.980060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39a74d92-ef6d-4060-9791-c9608f9823d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:23.981112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39a74d92-ef6d-4060-9791-c9608f9823d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:23.981871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39a74d92-ef6d-4060-9791-c9608f9823d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:23.986611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=83 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:28:24.184858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-39a74d92-ef6d-4060-9791-c9608f9823d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:24.194396 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-39a74d92-ef6d-4060-9791-c9608f9823d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1729 microversion: 2.1 time: 0.247188 Aug 09 15:28:24.195017 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3420/6829] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:23 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:25.217030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d631b733-1124-49ce-ac98-1319e886473f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:25.217904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d631b733-1124-49ce-ac98-1319e886473f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:25.227765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d631b733-1124-49ce-ac98-1319e886473f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:25.228365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d631b733-1124-49ce-ac98-1319e886473f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:25.228876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d631b733-1124-49ce-ac98-1319e886473f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:25.229774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d631b733-1124-49ce-ac98-1319e886473f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:25.230305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d631b733-1124-49ce-ac98-1319e886473f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:25.230797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d631b733-1124-49ce-ac98-1319e886473f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:25.468958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d631b733-1124-49ce-ac98-1319e886473f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:25.483840 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d631b733-1124-49ce-ac98-1319e886473f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1729 microversion: 2.1 time: 0.270993 Aug 09 15:28:25.484702 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3410/6830] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:25 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1729 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:28:26.509492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1fb55efa-832e-4c32-abc1-79b6654b62b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:26.510289 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1fb55efa-832e-4c32-abc1-79b6654b62b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:26.520332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fb55efa-832e-4c32-abc1-79b6654b62b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:26.520876 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fb55efa-832e-4c32-abc1-79b6654b62b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:26.521332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fb55efa-832e-4c32-abc1-79b6654b62b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:26.522081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fb55efa-832e-4c32-abc1-79b6654b62b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:26.522674 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fb55efa-832e-4c32-abc1-79b6654b62b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:26.523129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1fb55efa-832e-4c32-abc1-79b6654b62b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:26.782528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1fb55efa-832e-4c32-abc1-79b6654b62b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:26.794367 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1fb55efa-832e-4c32-abc1-79b6654b62b5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1726 microversion: 2.1 time: 0.289282 Aug 09 15:28:26.794973 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3421/6831] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:26 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1726 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:26.820203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:28:26.823203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:26.829483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:26.830108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:26.830706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:26.831524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:26.832049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:26.832625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:26.880441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:26.880766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:26.881339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:26.882494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:26.883249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:26.883893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:26.911110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'cores', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:28:26.918142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Getting quotas for user 127998e24ecf48d58f3c789530f89898 and project f3db1d5bb19047d4a655d6580a3336cb. Resources: {'cores', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:28:27.084229 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-efae6174-f75c-4ed4-aaf1-ce34d1b3efb2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "POST /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794/action" status: 202 len: 0 microversion: 2.1 time: 0.270631 Aug 09 15:28:27.085009 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3411/6832] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:28:26 2022] POST /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:28:27.095562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c21a56a5-e2f5-4e03-8f25-6b02f0ba36d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:27.096542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c21a56a5-e2f5-4e03-8f25-6b02f0ba36d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:27.104042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c21a56a5-e2f5-4e03-8f25-6b02f0ba36d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:27.104615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c21a56a5-e2f5-4e03-8f25-6b02f0ba36d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:27.105095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c21a56a5-e2f5-4e03-8f25-6b02f0ba36d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:27.105830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c21a56a5-e2f5-4e03-8f25-6b02f0ba36d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:27.106472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c21a56a5-e2f5-4e03-8f25-6b02f0ba36d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:27.106904 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c21a56a5-e2f5-4e03-8f25-6b02f0ba36d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:27.431140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c21a56a5-e2f5-4e03-8f25-6b02f0ba36d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:27.446214 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c21a56a5-e2f5-4e03-8f25-6b02f0ba36d3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.355098 Aug 09 15:28:27.447348 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3422/6833] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:27 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:28.481309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81766675-6f7a-4b1b-8ca7-2f28b4d5075e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:28.482125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81766675-6f7a-4b1b-8ca7-2f28b4d5075e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:28.496544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81766675-6f7a-4b1b-8ca7-2f28b4d5075e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:28.497301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81766675-6f7a-4b1b-8ca7-2f28b4d5075e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:28.498199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81766675-6f7a-4b1b-8ca7-2f28b4d5075e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:28.499735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81766675-6f7a-4b1b-8ca7-2f28b4d5075e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:28.500694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81766675-6f7a-4b1b-8ca7-2f28b4d5075e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:28.502040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81766675-6f7a-4b1b-8ca7-2f28b4d5075e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:28.705262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-81766675-6f7a-4b1b-8ca7-2f28b4d5075e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:28.714792 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81766675-6f7a-4b1b-8ca7-2f28b4d5075e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.239431 Aug 09 15:28:28.715459 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3412/6834] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:28 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:28:29.526742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-922377a9-29ac-4d08-9010-0bffdc113a94 req-9181ac17-5664-45bc-9694-3d02becb3080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d5a370-c42b-4fa9-af33-6c5745e12794", "name": "network-vif-plugged", "status": "completed", "tag": "79019cd2-7c6c-4f34-aefa-ac1922ac8cce"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:28:29.570567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-922377a9-29ac-4d08-9010-0bffdc113a94 req-9181ac17-5664-45bc-9694-3d02becb3080 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:29.571211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-922377a9-29ac-4d08-9010-0bffdc113a94 req-9181ac17-5664-45bc-9694-3d02becb3080 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:29.571726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-922377a9-29ac-4d08-9010-0bffdc113a94 req-9181ac17-5664-45bc-9694-3d02becb3080 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:29.596075 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-922377a9-29ac-4d08-9010-0bffdc113a94 req-9181ac17-5664-45bc-9694-3d02becb3080 service nova] Creating event network-vif-plugged:79019cd2-7c6c-4f34-aefa-ac1922ac8cce for instance 16d5a370-c42b-4fa9-af33-6c5745e12794 on n-h2-844626-8 Aug 09 15:28:29.603873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-922377a9-29ac-4d08-9010-0bffdc113a94 req-9181ac17-5664-45bc-9694-3d02becb3080 service nova] Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:28:29.616608 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-922377a9-29ac-4d08-9010-0bffdc113a94 req-9181ac17-5664-45bc-9694-3d02becb3080 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094657 Aug 09 15:28:29.617310 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3423/6835] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:28:29.738707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b9fe506-6166-45c6-acda-6d09f40cd8b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:29.739353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b9fe506-6166-45c6-acda-6d09f40cd8b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:29.746828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b9fe506-6166-45c6-acda-6d09f40cd8b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:29.747347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b9fe506-6166-45c6-acda-6d09f40cd8b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:29.747789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b9fe506-6166-45c6-acda-6d09f40cd8b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:29.748513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b9fe506-6166-45c6-acda-6d09f40cd8b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:29.748969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b9fe506-6166-45c6-acda-6d09f40cd8b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:29.749390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b9fe506-6166-45c6-acda-6d09f40cd8b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:29.951098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4b9fe506-6166-45c6-acda-6d09f40cd8b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:29.965773 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b9fe506-6166-45c6-acda-6d09f40cd8b0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.231250 Aug 09 15:28:29.966737 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3413/6836] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:29 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:30.996823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4d534d74-ad9a-4ddd-b228-6c60c0cea531 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:30.998075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4d534d74-ad9a-4ddd-b228-6c60c0cea531 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:31.008330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d534d74-ad9a-4ddd-b228-6c60c0cea531 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:31.008966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d534d74-ad9a-4ddd-b228-6c60c0cea531 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:31.009536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d534d74-ad9a-4ddd-b228-6c60c0cea531 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:31.010365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d534d74-ad9a-4ddd-b228-6c60c0cea531 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:31.010980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d534d74-ad9a-4ddd-b228-6c60c0cea531 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:31.011523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4d534d74-ad9a-4ddd-b228-6c60c0cea531 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:31.337815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4d534d74-ad9a-4ddd-b228-6c60c0cea531 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:31.347603 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4d534d74-ad9a-4ddd-b228-6c60c0cea531 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.359408 Aug 09 15:28:31.348567 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3424/6837] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:30 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:32.376239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-00d60a9b-e59d-417c-b215-16e5a862a72f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:32.377187 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-00d60a9b-e59d-417c-b215-16e5a862a72f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:32.384482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00d60a9b-e59d-417c-b215-16e5a862a72f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:32.385061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00d60a9b-e59d-417c-b215-16e5a862a72f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:32.385454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00d60a9b-e59d-417c-b215-16e5a862a72f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:32.386195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00d60a9b-e59d-417c-b215-16e5a862a72f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:32.386666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00d60a9b-e59d-417c-b215-16e5a862a72f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:32.387115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00d60a9b-e59d-417c-b215-16e5a862a72f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:32.674858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-00d60a9b-e59d-417c-b215-16e5a862a72f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:32.684706 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-00d60a9b-e59d-417c-b215-16e5a862a72f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.312842 Aug 09 15:28:32.685328 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3414/6838] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:32 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:33.597856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-469ab9bb-e7c0-44ad-8ea3-c95a20ecaa01 req-d672162b-991b-476a-a837-fd402452068f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d5a370-c42b-4fa9-af33-6c5745e12794", "name": "network-vif-unplugged", "status": "completed", "tag": "79019cd2-7c6c-4f34-aefa-ac1922ac8cce"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:28:33.618877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-469ab9bb-e7c0-44ad-8ea3-c95a20ecaa01 req-d672162b-991b-476a-a837-fd402452068f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:33.620033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-469ab9bb-e7c0-44ad-8ea3-c95a20ecaa01 req-d672162b-991b-476a-a837-fd402452068f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:33.621017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-469ab9bb-e7c0-44ad-8ea3-c95a20ecaa01 req-d672162b-991b-476a-a837-fd402452068f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:33.645613 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-469ab9bb-e7c0-44ad-8ea3-c95a20ecaa01 req-d672162b-991b-476a-a837-fd402452068f service nova] Creating event network-vif-unplugged:79019cd2-7c6c-4f34-aefa-ac1922ac8cce for instance 16d5a370-c42b-4fa9-af33-6c5745e12794 on n-h1-844626-8 Aug 09 15:28:33.669122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-469ab9bb-e7c0-44ad-8ea3-c95a20ecaa01 req-d672162b-991b-476a-a837-fd402452068f service nova] Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:28:33.694212 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-469ab9bb-e7c0-44ad-8ea3-c95a20ecaa01 req-d672162b-991b-476a-a837-fd402452068f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101395 Aug 09 15:28:33.695807 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3425/6839] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:28:33.711941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fdec91e4-9d05-4633-ac7c-a00624006fa4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:33.713042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fdec91e4-9d05-4633-ac7c-a00624006fa4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:33.728807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdec91e4-9d05-4633-ac7c-a00624006fa4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:33.730266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdec91e4-9d05-4633-ac7c-a00624006fa4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:33.731527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdec91e4-9d05-4633-ac7c-a00624006fa4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:33.732801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdec91e4-9d05-4633-ac7c-a00624006fa4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:33.733776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdec91e4-9d05-4633-ac7c-a00624006fa4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:33.734333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fdec91e4-9d05-4633-ac7c-a00624006fa4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:33.993178 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fdec91e4-9d05-4633-ac7c-a00624006fa4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:34.004413 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fdec91e4-9d05-4633-ac7c-a00624006fa4 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.298900 Aug 09 15:28:34.005503 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3415/6840] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:33 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:35.042290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2cce894-7c91-4f25-9c7f-30751b005c23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:35.043204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b2cce894-7c91-4f25-9c7f-30751b005c23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:35.050070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2cce894-7c91-4f25-9c7f-30751b005c23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:35.050556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2cce894-7c91-4f25-9c7f-30751b005c23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:35.050984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2cce894-7c91-4f25-9c7f-30751b005c23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:35.052144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2cce894-7c91-4f25-9c7f-30751b005c23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:35.052790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2cce894-7c91-4f25-9c7f-30751b005c23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:35.054650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2cce894-7c91-4f25-9c7f-30751b005c23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:35.228089 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2cce894-7c91-4f25-9c7f-30751b005c23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:35.237265 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2cce894-7c91-4f25-9c7f-30751b005c23 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.201231 Aug 09 15:28:35.237757 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3426/6841] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:35 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:35.748384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-3a3f3e9a-e21e-4d31-961a-a82e4c405d65 req-3110296f-0f12-46f4-a10e-c97c0c784d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16d5a370-c42b-4fa9-af33-6c5745e12794", "tag": "79019cd2-7c6c-4f34-aefa-ac1922ac8cce"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:28:35.760682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3a3f3e9a-e21e-4d31-961a-a82e4c405d65 req-3110296f-0f12-46f4-a10e-c97c0c784d55 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:35.761181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3a3f3e9a-e21e-4d31-961a-a82e4c405d65 req-3110296f-0f12-46f4-a10e-c97c0c784d55 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:35.761620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-3a3f3e9a-e21e-4d31-961a-a82e4c405d65 req-3110296f-0f12-46f4-a10e-c97c0c784d55 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:35.775046 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-3a3f3e9a-e21e-4d31-961a-a82e4c405d65 req-3110296f-0f12-46f4-a10e-c97c0c784d55 service nova] Creating event network-changed:79019cd2-7c6c-4f34-aefa-ac1922ac8cce for instance 16d5a370-c42b-4fa9-af33-6c5745e12794 on n-h1-844626-8 Aug 09 15:28:35.787670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-3a3f3e9a-e21e-4d31-961a-a82e4c405d65 req-3110296f-0f12-46f4-a10e-c97c0c784d55 service nova] Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:28:35.803121 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-3a3f3e9a-e21e-4d31-961a-a82e4c405d65 req-3110296f-0f12-46f4-a10e-c97c0c784d55 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059118 Aug 09 15:28:35.803735 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3416/6842] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:28:36.272490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f44f567c-5f1e-408c-baf5-cd104c2b242f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:36.274845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f44f567c-5f1e-408c-baf5-cd104c2b242f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:36.288036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f44f567c-5f1e-408c-baf5-cd104c2b242f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:36.288902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f44f567c-5f1e-408c-baf5-cd104c2b242f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:36.289994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f44f567c-5f1e-408c-baf5-cd104c2b242f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:36.291682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f44f567c-5f1e-408c-baf5-cd104c2b242f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:36.292623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f44f567c-5f1e-408c-baf5-cd104c2b242f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:36.293712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f44f567c-5f1e-408c-baf5-cd104c2b242f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:36.735001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f44f567c-5f1e-408c-baf5-cd104c2b242f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:36.754217 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f44f567c-5f1e-408c-baf5-cd104c2b242f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.488507 Aug 09 15:28:36.755202 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3427/6843] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:36 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:37.778623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:28:37.785121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d15bea1-e578-45d7-a29c-a086db535f8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:37.786116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d15bea1-e578-45d7-a29c-a086db535f8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:37.797772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d15bea1-e578-45d7-a29c-a086db535f8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:37.799043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d15bea1-e578-45d7-a29c-a086db535f8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:37.799043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d15bea1-e578-45d7-a29c-a086db535f8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:37.799939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d15bea1-e578-45d7-a29c-a086db535f8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:37.800687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d15bea1-e578-45d7-a29c-a086db535f8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:37.801427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d15bea1-e578-45d7-a29c-a086db535f8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:38.023474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6d15bea1-e578-45d7-a29c-a086db535f8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:38.041653 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d15bea1-e578-45d7-a29c-a086db535f8c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.264926 Aug 09 15:28:38.042589 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3417/6844] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:37 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:39.069261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f51714a4-b1b8-429e-9344-824551777370 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:39.070176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f51714a4-b1b8-429e-9344-824551777370 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:39.077780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f51714a4-b1b8-429e-9344-824551777370 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:39.078278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f51714a4-b1b8-429e-9344-824551777370 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:39.078991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f51714a4-b1b8-429e-9344-824551777370 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:39.079659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f51714a4-b1b8-429e-9344-824551777370 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:39.080124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f51714a4-b1b8-429e-9344-824551777370 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:39.080552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f51714a4-b1b8-429e-9344-824551777370 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:39.302990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f51714a4-b1b8-429e-9344-824551777370 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:39.312827 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f51714a4-b1b8-429e-9344-824551777370 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.247603 Aug 09 15:28:39.313486 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3428/6845] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:39 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:40.340200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2b2acda-ba20-4c53-8ccf-4996c6c588a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:40.341102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f2b2acda-ba20-4c53-8ccf-4996c6c588a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:40.351719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2b2acda-ba20-4c53-8ccf-4996c6c588a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:40.352330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2b2acda-ba20-4c53-8ccf-4996c6c588a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:40.352859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2b2acda-ba20-4c53-8ccf-4996c6c588a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:40.353816 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2b2acda-ba20-4c53-8ccf-4996c6c588a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:40.354356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2b2acda-ba20-4c53-8ccf-4996c6c588a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:40.354831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2b2acda-ba20-4c53-8ccf-4996c6c588a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:40.590511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f2b2acda-ba20-4c53-8ccf-4996c6c588a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:40.603676 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f2b2acda-ba20-4c53-8ccf-4996c6c588a0 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.271998 Aug 09 15:28:40.604940 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3418/6846] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:40 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:41.636207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62050418-88e2-4839-bb71-f92cf02618a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:41.637012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-62050418-88e2-4839-bb71-f92cf02618a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:41.646379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62050418-88e2-4839-bb71-f92cf02618a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:41.647249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62050418-88e2-4839-bb71-f92cf02618a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:41.647822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62050418-88e2-4839-bb71-f92cf02618a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:41.648697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62050418-88e2-4839-bb71-f92cf02618a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:41.656583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62050418-88e2-4839-bb71-f92cf02618a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:41.657222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62050418-88e2-4839-bb71-f92cf02618a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:41.822206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-62050418-88e2-4839-bb71-f92cf02618a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:41.831317 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-62050418-88e2-4839-bb71-f92cf02618a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.199255 Aug 09 15:28:41.831976 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3429/6847] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:41 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:42.855445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c484ca5f-c992-4ba1-bca0-1700257d47c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:42.856240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c484ca5f-c992-4ba1-bca0-1700257d47c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:42.865183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c484ca5f-c992-4ba1-bca0-1700257d47c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:42.865746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c484ca5f-c992-4ba1-bca0-1700257d47c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:42.866531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c484ca5f-c992-4ba1-bca0-1700257d47c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:42.867548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c484ca5f-c992-4ba1-bca0-1700257d47c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:42.868120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c484ca5f-c992-4ba1-bca0-1700257d47c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:42.868617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c484ca5f-c992-4ba1-bca0-1700257d47c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:43.032451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c484ca5f-c992-4ba1-bca0-1700257d47c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:43.050903 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c484ca5f-c992-4ba1-bca0-1700257d47c6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.200129 Aug 09 15:28:43.051661 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3419/6848] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:42 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:44.073682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-15c61c41-6d71-4d45-85cb-4b33867b3528 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:44.074474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-15c61c41-6d71-4d45-85cb-4b33867b3528 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:44.083297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15c61c41-6d71-4d45-85cb-4b33867b3528 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:44.083832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15c61c41-6d71-4d45-85cb-4b33867b3528 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:44.084280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15c61c41-6d71-4d45-85cb-4b33867b3528 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:44.085020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15c61c41-6d71-4d45-85cb-4b33867b3528 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:44.085485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15c61c41-6d71-4d45-85cb-4b33867b3528 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:44.085918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-15c61c41-6d71-4d45-85cb-4b33867b3528 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:44.276185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-15c61c41-6d71-4d45-85cb-4b33867b3528 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:44.286602 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-15c61c41-6d71-4d45-85cb-4b33867b3528 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.217166 Aug 09 15:28:44.287162 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3430/6849] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:44 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:45.309699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-21c1272d-2f43-456c-a580-5581da500f9f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:45.310439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-21c1272d-2f43-456c-a580-5581da500f9f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:45.318534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21c1272d-2f43-456c-a580-5581da500f9f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:45.319079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21c1272d-2f43-456c-a580-5581da500f9f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:45.319618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21c1272d-2f43-456c-a580-5581da500f9f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:45.320378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21c1272d-2f43-456c-a580-5581da500f9f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:45.320881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21c1272d-2f43-456c-a580-5581da500f9f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:45.321412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-21c1272d-2f43-456c-a580-5581da500f9f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:45.504749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-21c1272d-2f43-456c-a580-5581da500f9f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:45.514316 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-21c1272d-2f43-456c-a580-5581da500f9f tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.208977 Aug 09 15:28:45.515171 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3420/6850] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:45 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:46.537093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64f4ac20-4e18-4148-99fd-eaac203170e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:46.537839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-64f4ac20-4e18-4148-99fd-eaac203170e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:46.545658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64f4ac20-4e18-4148-99fd-eaac203170e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:46.546135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64f4ac20-4e18-4148-99fd-eaac203170e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:46.546580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64f4ac20-4e18-4148-99fd-eaac203170e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:46.547328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64f4ac20-4e18-4148-99fd-eaac203170e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:46.547772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64f4ac20-4e18-4148-99fd-eaac203170e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:46.548263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64f4ac20-4e18-4148-99fd-eaac203170e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:46.709678 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-64f4ac20-4e18-4148-99fd-eaac203170e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:46.720618 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-64f4ac20-4e18-4148-99fd-eaac203170e3 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.187659 Aug 09 15:28:46.721681 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3431/6851] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:46 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:28:47.680224 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:28:47.680811 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:28:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:28:47.743464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-405bdd08-1fd1-4924-8bcf-f4ffa4ce04ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:47.744102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-405bdd08-1fd1-4924-8bcf-f4ffa4ce04ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:47.751728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-405bdd08-1fd1-4924-8bcf-f4ffa4ce04ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:47.752321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-405bdd08-1fd1-4924-8bcf-f4ffa4ce04ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:47.752768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-405bdd08-1fd1-4924-8bcf-f4ffa4ce04ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:47.753611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-405bdd08-1fd1-4924-8bcf-f4ffa4ce04ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:47.754074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-405bdd08-1fd1-4924-8bcf-f4ffa4ce04ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:47.754516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-405bdd08-1fd1-4924-8bcf-f4ffa4ce04ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:47.941893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-405bdd08-1fd1-4924-8bcf-f4ffa4ce04ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:47.956767 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-405bdd08-1fd1-4924-8bcf-f4ffa4ce04ec tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1725 microversion: 2.1 time: 0.216857 Aug 09 15:28:47.957693 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3421/6852] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:47 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:28:48.982222 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bcdbf7f8-ac0c-4e58-ad31-944870ea08f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:48.983265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bcdbf7f8-ac0c-4e58-ad31-944870ea08f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:48.992511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcdbf7f8-ac0c-4e58-ad31-944870ea08f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:48.993042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcdbf7f8-ac0c-4e58-ad31-944870ea08f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:48.993497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcdbf7f8-ac0c-4e58-ad31-944870ea08f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:48.994258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcdbf7f8-ac0c-4e58-ad31-944870ea08f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:48.994766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcdbf7f8-ac0c-4e58-ad31-944870ea08f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:48.995386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bcdbf7f8-ac0c-4e58-ad31-944870ea08f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:49.184063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bcdbf7f8-ac0c-4e58-ad31-944870ea08f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:49.194560 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bcdbf7f8-ac0c-4e58-ad31-944870ea08f6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1718 microversion: 2.1 time: 0.217187 Aug 09 15:28:49.195534 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3432/6853] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:48 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1718 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:49.216563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c222d16e-8851-4e73-bfcd-abcbf8c073cb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:49.217431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c222d16e-8851-4e73-bfcd-abcbf8c073cb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:49.226620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c222d16e-8851-4e73-bfcd-abcbf8c073cb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:49.227184 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c222d16e-8851-4e73-bfcd-abcbf8c073cb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:49.227657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c222d16e-8851-4e73-bfcd-abcbf8c073cb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:49.228494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c222d16e-8851-4e73-bfcd-abcbf8c073cb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:49.228876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c222d16e-8851-4e73-bfcd-abcbf8c073cb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:49.229317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c222d16e-8851-4e73-bfcd-abcbf8c073cb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:49.429722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c222d16e-8851-4e73-bfcd-abcbf8c073cb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:49.450404 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c222d16e-8851-4e73-bfcd-abcbf8c073cb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1718 microversion: 2.1 time: 0.237721 Aug 09 15:28:49.451484 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3422/6854] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:49 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1718 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:28:49.486272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ad2fdd04-d427-42a0-b095-2fe9328c71df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:49.487346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ad2fdd04-d427-42a0-b095-2fe9328c71df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:49.496505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad2fdd04-d427-42a0-b095-2fe9328c71df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:49.497080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad2fdd04-d427-42a0-b095-2fe9328c71df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:49.497639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad2fdd04-d427-42a0-b095-2fe9328c71df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:49.498645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad2fdd04-d427-42a0-b095-2fe9328c71df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:49.499306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad2fdd04-d427-42a0-b095-2fe9328c71df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:49.499907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ad2fdd04-d427-42a0-b095-2fe9328c71df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:49.692143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ad2fdd04-d427-42a0-b095-2fe9328c71df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:49.707061 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ad2fdd04-d427-42a0-b095-2fe9328c71df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1718 microversion: 2.1 time: 0.227966 Aug 09 15:28:49.708640 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3433/6855] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:49 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1718 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:49.732860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5215b0d4-392e-4d57-bc19-277cafa2e63b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:49.733567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5215b0d4-392e-4d57-bc19-277cafa2e63b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:49.741904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5215b0d4-392e-4d57-bc19-277cafa2e63b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:49.742471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5215b0d4-392e-4d57-bc19-277cafa2e63b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:49.743037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5215b0d4-392e-4d57-bc19-277cafa2e63b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:49.743942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5215b0d4-392e-4d57-bc19-277cafa2e63b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:49.744520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5215b0d4-392e-4d57-bc19-277cafa2e63b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:49.745051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5215b0d4-392e-4d57-bc19-277cafa2e63b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:49.748509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:28:49.777490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5215b0d4-392e-4d57-bc19-277cafa2e63b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:28:49.892294 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5215b0d4-392e-4d57-bc19-277cafa2e63b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "DELETE /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 204 len: 0 microversion: 2.1 time: 0.163572 Aug 09 15:28:49.893581 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3423/6856] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:28:49 2022] DELETE /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 15:28:49.905045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9e6c6643-b95a-48ad-8769-216beb15f0cf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:49.905780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9e6c6643-b95a-48ad-8769-216beb15f0cf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:49.914017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6c6643-b95a-48ad-8769-216beb15f0cf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:49.914618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6c6643-b95a-48ad-8769-216beb15f0cf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:49.915155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6c6643-b95a-48ad-8769-216beb15f0cf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:49.916096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6c6643-b95a-48ad-8769-216beb15f0cf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:49.916786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6c6643-b95a-48ad-8769-216beb15f0cf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:49.917327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9e6c6643-b95a-48ad-8769-216beb15f0cf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:50.090212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9e6c6643-b95a-48ad-8769-216beb15f0cf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:50.104284 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9e6c6643-b95a-48ad-8769-216beb15f0cf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1724 microversion: 2.1 time: 0.204448 Aug 09 15:28:50.105160 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3434/6857] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:49 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:51.136857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0dc2b74a-fa12-4c64-8072-f9bebcd72a7c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:51.137830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0dc2b74a-fa12-4c64-8072-f9bebcd72a7c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:51.145446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dc2b74a-fa12-4c64-8072-f9bebcd72a7c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:51.145896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dc2b74a-fa12-4c64-8072-f9bebcd72a7c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:51.146482 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dc2b74a-fa12-4c64-8072-f9bebcd72a7c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:51.147279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dc2b74a-fa12-4c64-8072-f9bebcd72a7c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:51.147852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dc2b74a-fa12-4c64-8072-f9bebcd72a7c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:51.148290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dc2b74a-fa12-4c64-8072-f9bebcd72a7c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:51.198384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a8e7baa5-ec58-4021-b846-d8668be7df79 req-07b6cfd0-52b3-438e-a34c-3c7227119edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d5a370-c42b-4fa9-af33-6c5745e12794", "name": "network-vif-plugged", "status": "completed", "tag": "79019cd2-7c6c-4f34-aefa-ac1922ac8cce"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:28:51.211435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a8e7baa5-ec58-4021-b846-d8668be7df79 req-07b6cfd0-52b3-438e-a34c-3c7227119edb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:51.211931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a8e7baa5-ec58-4021-b846-d8668be7df79 req-07b6cfd0-52b3-438e-a34c-3c7227119edb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:51.212357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a8e7baa5-ec58-4021-b846-d8668be7df79 req-07b6cfd0-52b3-438e-a34c-3c7227119edb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:51.228057 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a8e7baa5-ec58-4021-b846-d8668be7df79 req-07b6cfd0-52b3-438e-a34c-3c7227119edb service nova] Creating event network-vif-plugged:79019cd2-7c6c-4f34-aefa-ac1922ac8cce for instance 16d5a370-c42b-4fa9-af33-6c5745e12794 on n-h1-844626-8 Aug 09 15:28:51.233915 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a8e7baa5-ec58-4021-b846-d8668be7df79 req-07b6cfd0-52b3-438e-a34c-3c7227119edb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039191 Aug 09 15:28:51.234560 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3435/6858] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:28:51.317533 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:28:51.317889 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:28:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:28:51.324798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0dc2b74a-fa12-4c64-8072-f9bebcd72a7c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:51.339331 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0dc2b74a-fa12-4c64-8072-f9bebcd72a7c tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1724 microversion: 2.1 time: 0.207722 Aug 09 15:28:51.339944 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3424/6859] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:51 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:52.343448 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:28:52.344234 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:28:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:28:52.364545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40cfabf0-965b-433f-93ed-58f106a173e8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:52.365672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40cfabf0-965b-433f-93ed-58f106a173e8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:52.380491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40cfabf0-965b-433f-93ed-58f106a173e8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:52.381184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40cfabf0-965b-433f-93ed-58f106a173e8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:52.381762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40cfabf0-965b-433f-93ed-58f106a173e8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:52.382736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40cfabf0-965b-433f-93ed-58f106a173e8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:52.383482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40cfabf0-965b-433f-93ed-58f106a173e8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:52.384260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40cfabf0-965b-433f-93ed-58f106a173e8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:52.473939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-40cfabf0-965b-433f-93ed-58f106a173e8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:52.483650 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40cfabf0-965b-433f-93ed-58f106a173e8 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1656 microversion: 2.1 time: 0.123451 Aug 09 15:28:52.484621 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3436/6860] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:52 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1656 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:28:52.819371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-d0527c24-5663-46b4-9971-5b06de1f745b req-339ec0d7-576e-45ad-b336-7f09375800f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16d5a370-c42b-4fa9-af33-6c5745e12794", "name": "network-vif-deleted", "tag": "79019cd2-7c6c-4f34-aefa-ac1922ac8cce"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:28:52.825506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:28:52.834219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d0527c24-5663-46b4-9971-5b06de1f745b req-339ec0d7-576e-45ad-b336-7f09375800f4 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:52.835458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d0527c24-5663-46b4-9971-5b06de1f745b req-339ec0d7-576e-45ad-b336-7f09375800f4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:52.836180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-d0527c24-5663-46b4-9971-5b06de1f745b req-339ec0d7-576e-45ad-b336-7f09375800f4 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:52.857103 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-d0527c24-5663-46b4-9971-5b06de1f745b req-339ec0d7-576e-45ad-b336-7f09375800f4 service nova] Creating event network-vif-deleted:79019cd2-7c6c-4f34-aefa-ac1922ac8cce for instance 16d5a370-c42b-4fa9-af33-6c5745e12794 on n-h1-844626-8 Aug 09 15:28:52.865096 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-d0527c24-5663-46b4-9971-5b06de1f745b req-339ec0d7-576e-45ad-b336-7f09375800f4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151272 Aug 09 15:28:52.865755 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3425/6861] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:28:53.512328 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-83482963-6e7c-4c81-b505-2b5e7e2378a2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:53.513426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-83482963-6e7c-4c81-b505-2b5e7e2378a2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:53.527267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83482963-6e7c-4c81-b505-2b5e7e2378a2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:53.528126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83482963-6e7c-4c81-b505-2b5e7e2378a2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:53.529102 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83482963-6e7c-4c81-b505-2b5e7e2378a2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:53.530427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83482963-6e7c-4c81-b505-2b5e7e2378a2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:53.531313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83482963-6e7c-4c81-b505-2b5e7e2378a2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:53.532015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83482963-6e7c-4c81-b505-2b5e7e2378a2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:53.608854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-83482963-6e7c-4c81-b505-2b5e7e2378a2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:53.619143 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-83482963-6e7c-4c81-b505-2b5e7e2378a2 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1370 microversion: 2.1 time: 0.115916 Aug 09 15:28:53.619760 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3437/6862] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:53 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1370 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:54.648262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36dee5bc-6f41-4e6d-935a-18f66865e42b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:54.649350 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-36dee5bc-6f41-4e6d-935a-18f66865e42b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:54.657631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36dee5bc-6f41-4e6d-935a-18f66865e42b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:54.658585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36dee5bc-6f41-4e6d-935a-18f66865e42b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:54.659228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36dee5bc-6f41-4e6d-935a-18f66865e42b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:54.660004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36dee5bc-6f41-4e6d-935a-18f66865e42b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:54.660483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36dee5bc-6f41-4e6d-935a-18f66865e42b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:54.660926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36dee5bc-6f41-4e6d-935a-18f66865e42b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:54.739513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-36dee5bc-6f41-4e6d-935a-18f66865e42b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:54.749926 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36dee5bc-6f41-4e6d-935a-18f66865e42b tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1370 microversion: 2.1 time: 0.110968 Aug 09 15:28:54.751009 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3426/6863] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:54 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:55.777301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-277fa764-2f15-4a78-b73b-6caf855e44d1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:55.778394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-277fa764-2f15-4a78-b73b-6caf855e44d1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:55.783230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=36 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:28:55.793172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-277fa764-2f15-4a78-b73b-6caf855e44d1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:55.794003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-277fa764-2f15-4a78-b73b-6caf855e44d1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:55.794729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-277fa764-2f15-4a78-b73b-6caf855e44d1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:55.795963 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-277fa764-2f15-4a78-b73b-6caf855e44d1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:55.796770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-277fa764-2f15-4a78-b73b-6caf855e44d1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:55.797508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-277fa764-2f15-4a78-b73b-6caf855e44d1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:55.803115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=100 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:28:55.901443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-277fa764-2f15-4a78-b73b-6caf855e44d1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:55.911555 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-277fa764-2f15-4a78-b73b-6caf855e44d1 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1370 microversion: 2.1 time: 0.141325 Aug 09 15:28:55.912035 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3438/6864] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:55 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1370 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:56.932836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fb3db0cf-692a-4ff6-9faa-79486023b530 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:56.933431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fb3db0cf-692a-4ff6-9faa-79486023b530 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:56.941327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb3db0cf-692a-4ff6-9faa-79486023b530 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:56.941822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb3db0cf-692a-4ff6-9faa-79486023b530 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:56.942264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb3db0cf-692a-4ff6-9faa-79486023b530 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:56.942986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb3db0cf-692a-4ff6-9faa-79486023b530 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:56.943485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb3db0cf-692a-4ff6-9faa-79486023b530 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:56.943914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fb3db0cf-692a-4ff6-9faa-79486023b530 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:57.019887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fb3db0cf-692a-4ff6-9faa-79486023b530 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '127998e24ecf48d58f3c789530f89898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3db1d5bb19047d4a655d6580a3336cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:28:57.036384 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fb3db0cf-692a-4ff6-9faa-79486023b530 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 200 len: 1370 microversion: 2.1 time: 0.107637 Aug 09 15:28:57.038064 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3427/6865] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:56 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 1370 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:28:58.061144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-90766ca7-e576-49a1-bbd1-a35c1efefc3e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:58.062124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-90766ca7-e576-49a1-bbd1-a35c1efefc3e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:58.070344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90766ca7-e576-49a1-bbd1-a35c1efefc3e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:58.070839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90766ca7-e576-49a1-bbd1-a35c1efefc3e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:58.071315 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90766ca7-e576-49a1-bbd1-a35c1efefc3e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:58.072033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90766ca7-e576-49a1-bbd1-a35c1efefc3e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:58.072485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90766ca7-e576-49a1-bbd1-a35c1efefc3e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:58.072907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-90766ca7-e576-49a1-bbd1-a35c1efefc3e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:58.089183 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-90766ca7-e576-49a1-bbd1-a35c1efefc3e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-90766ca7-e576-49a1-bbd1-a35c1efefc3e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 HTTP/1.1 Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '16d5a370-c42b-4fa9-af33-6c5745e12794'} Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:28:58.091473 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:28:58.095530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:28:58.095530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:28:58.095530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:28:58.095530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:28:58.095530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:28:58.095530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:28:58.095530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:28:58.095530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-90766ca7-e576-49a1-bbd1-a35c1efefc3e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:28:58.095530 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-90766ca7-e576-49a1-bbd1-a35c1efefc3e tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 404 len: 111 microversion: 2.1 time: 0.036619 Aug 09 15:28:58.095530 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3439/6866] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:28:58 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:28:58.164527 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1672dd1f-9406-4e17-a97b-ab5f6cc3b2df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:28:58.166759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1672dd1f-9406-4e17-a97b-ab5f6cc3b2df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:28:58.174509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1672dd1f-9406-4e17-a97b-ab5f6cc3b2df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:58.175002 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1672dd1f-9406-4e17-a97b-ab5f6cc3b2df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:58.175474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1672dd1f-9406-4e17-a97b-ab5f6cc3b2df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:58.176210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1672dd1f-9406-4e17-a97b-ab5f6cc3b2df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:28:58.176669 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1672dd1f-9406-4e17-a97b-ab5f6cc3b2df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:28:58.177104 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1672dd1f-9406-4e17-a97b-ab5f6cc3b2df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:28:58.192488 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-1672dd1f-9406-4e17-a97b-ab5f6cc3b2df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1672dd1f-9406-4e17-a97b-ab5f6cc3b2df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794/os-volume_attachments HTTP/1.1 Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'server_id': '16d5a370-c42b-4fa9-af33-6c5745e12794'} Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:28:58.194420 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1672dd1f-9406-4e17-a97b-ab5f6cc3b2df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1672dd1f-9406-4e17-a97b-ab5f6cc3b2df tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036390 Aug 09 15:28:58.198152 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3428/6867] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:28:58 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:29:02.739848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d60e9ee3-3178-472d-846f-2b65cccb7124 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:02.741256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d60e9ee3-3178-472d-846f-2b65cccb7124 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:02.753386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d60e9ee3-3178-472d-846f-2b65cccb7124 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:02.754055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d60e9ee3-3178-472d-846f-2b65cccb7124 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:02.754580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d60e9ee3-3178-472d-846f-2b65cccb7124 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:02.755516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d60e9ee3-3178-472d-846f-2b65cccb7124 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:02.756251 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d60e9ee3-3178-472d-846f-2b65cccb7124 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:02.756648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d60e9ee3-3178-472d-846f-2b65cccb7124 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:02.774922 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-d60e9ee3-3178-472d-846f-2b65cccb7124 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d60e9ee3-3178-472d-846f-2b65cccb7124 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 HTTP/1.1 Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '16d5a370-c42b-4fa9-af33-6c5745e12794'} Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:02.777852 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d60e9ee3-3178-472d-846f-2b65cccb7124 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d60e9ee3-3178-472d-846f-2b65cccb7124 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "DELETE /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 404 len: 111 microversion: 2.1 time: 0.046917 Aug 09 15:29:02.784920 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3440/6868] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:29:02 2022] DELETE /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:29:02.792345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df69b9c6-621d-4a56-a3e0-0afd377eefed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:02.793081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-df69b9c6-621d-4a56-a3e0-0afd377eefed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 16d5a370-c42b-4fa9-af33-6c5745e12794] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:02.802989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df69b9c6-621d-4a56-a3e0-0afd377eefed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:02.803611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df69b9c6-621d-4a56-a3e0-0afd377eefed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:02.804124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df69b9c6-621d-4a56-a3e0-0afd377eefed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:02.805019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df69b9c6-621d-4a56-a3e0-0afd377eefed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:02.805662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df69b9c6-621d-4a56-a3e0-0afd377eefed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:02.806212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-df69b9c6-621d-4a56-a3e0-0afd377eefed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:02.827802 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-df69b9c6-621d-4a56-a3e0-0afd377eefed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df69b9c6-621d-4a56-a3e0-0afd377eefed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 HTTP/1.1 Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '16d5a370-c42b-4fa9-af33-6c5745e12794'} Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:02.830097 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.838413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.838413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:02.838413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:02.838413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:02.838413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:02.838413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. Aug 09 15:29:02.838413 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.838413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-df69b9c6-621d-4a56-a3e0-0afd377eefed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance 16d5a370-c42b-4fa9-af33-6c5745e12794 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:02.838413 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-df69b9c6-621d-4a56-a3e0-0afd377eefed tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794" status: 404 len: 111 microversion: 2.1 time: 0.046181 Aug 09 15:29:02.838413 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3429/6869] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:02 2022] GET /compute/v2.1/servers/16d5a370-c42b-4fa9-af33-6c5745e12794 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:29:02.846624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b793f277-d6b9-40a3-a863-233b582305ee tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:02.847559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b793f277-d6b9-40a3-a863-233b582305ee tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:02.855335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b793f277-d6b9-40a3-a863-233b582305ee tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:02.856124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b793f277-d6b9-40a3-a863-233b582305ee tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:02.856571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b793f277-d6b9-40a3-a863-233b582305ee tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:02.857469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b793f277-d6b9-40a3-a863-233b582305ee tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:02.857956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b793f277-d6b9-40a3-a863-233b582305ee tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:02.858391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b793f277-d6b9-40a3-a863-233b582305ee tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:02.879300 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-b793f277-d6b9-40a3-a863-233b582305ee tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b793f277-d6b9-40a3-a863-233b582305ee tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 HTTP/1.1 Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'fa66cd24-46d6-4815-a1ab-020369fdc638'} Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:02.880246 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b793f277-d6b9-40a3-a863-233b582305ee tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b793f277-d6b9-40a3-a863-233b582305ee tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "DELETE /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 404 len: 111 microversion: 2.1 time: 0.039688 Aug 09 15:29:02.888924 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3441/6870] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:29:02 2022] DELETE /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:29:02.892143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-973181dd-e6d1-4fca-b6e0-6fbf8073b0dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:02.892143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-973181dd-e6d1-4fca-b6e0-6fbf8073b0dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: fa66cd24-46d6-4815-a1ab-020369fdc638] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:02.899466 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-973181dd-e6d1-4fca-b6e0-6fbf8073b0dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:02.899978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-973181dd-e6d1-4fca-b6e0-6fbf8073b0dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:02.900558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-973181dd-e6d1-4fca-b6e0-6fbf8073b0dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:02.901294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-973181dd-e6d1-4fca-b6e0-6fbf8073b0dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:02.901812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-973181dd-e6d1-4fca-b6e0-6fbf8073b0dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:02.902219 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-973181dd-e6d1-4fca-b6e0-6fbf8073b0dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:02.919586 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-973181dd-e6d1-4fca-b6e0-6fbf8073b0dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-973181dd-e6d1-4fca-b6e0-6fbf8073b0dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 HTTP/1.1 Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'fa66cd24-46d6-4815-a1ab-020369fdc638'} Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:02.921227 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.929930 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.929930 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:02.929930 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:02.929930 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:02.929930 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:02.929930 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. Aug 09 15:29:02.929930 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.929930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-973181dd-e6d1-4fca-b6e0-6fbf8073b0dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance fa66cd24-46d6-4815-a1ab-020369fdc638 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:02.929930 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-973181dd-e6d1-4fca-b6e0-6fbf8073b0dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638" status: 404 len: 111 microversion: 2.1 time: 0.036033 Aug 09 15:29:02.929930 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3430/6871] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:02 2022] GET /compute/v2.1/servers/fa66cd24-46d6-4815-a1ab-020369fdc638 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:29:02.932819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49313cb0-b5ab-4c98-8766-a00314df9be5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:02.933186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49313cb0-b5ab-4c98-8766-a00314df9be5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:02.941021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49313cb0-b5ab-4c98-8766-a00314df9be5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:02.941602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49313cb0-b5ab-4c98-8766-a00314df9be5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:02.941969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49313cb0-b5ab-4c98-8766-a00314df9be5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:02.942709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49313cb0-b5ab-4c98-8766-a00314df9be5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:02.943220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49313cb0-b5ab-4c98-8766-a00314df9be5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:02.943650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49313cb0-b5ab-4c98-8766-a00314df9be5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:02.962247 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-49313cb0-b5ab-4c98-8766-a00314df9be5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49313cb0-b5ab-4c98-8766-a00314df9be5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 HTTP/1.1 Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '833f292c-b042-4eeb-99c1-b68002010de1'} Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:02.963938 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49313cb0-b5ab-4c98-8766-a00314df9be5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49313cb0-b5ab-4c98-8766-a00314df9be5 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "DELETE /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 404 len: 111 microversion: 2.1 time: 0.037013 Aug 09 15:29:02.972389 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3442/6872] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:29:02 2022] DELETE /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:29:02.976815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e39f320-b1bb-473e-9ca0-203c769cd2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:02.977415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e39f320-b1bb-473e-9ca0-203c769cd2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: 833f292c-b042-4eeb-99c1-b68002010de1] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:02.990360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e39f320-b1bb-473e-9ca0-203c769cd2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:02.990656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e39f320-b1bb-473e-9ca0-203c769cd2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:02.991408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e39f320-b1bb-473e-9ca0-203c769cd2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:02.992746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e39f320-b1bb-473e-9ca0-203c769cd2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:02.994182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e39f320-b1bb-473e-9ca0-203c769cd2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:02.994960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e39f320-b1bb-473e-9ca0-203c769cd2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:03.016510 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4e39f320-b1bb-473e-9ca0-203c769cd2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e39f320-b1bb-473e-9ca0-203c769cd2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 HTTP/1.1 Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '833f292c-b042-4eeb-99c1-b68002010de1'} Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:03.018445 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.029034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:03.029034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:03.029034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:03.029034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:03.029034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:03.029034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. Aug 09 15:29:03.029034 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.029034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e39f320-b1bb-473e-9ca0-203c769cd2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance 833f292c-b042-4eeb-99c1-b68002010de1 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:03.029034 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e39f320-b1bb-473e-9ca0-203c769cd2a6 tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1" status: 404 len: 111 microversion: 2.1 time: 0.048414 Aug 09 15:29:03.029034 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3431/6873] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:02 2022] GET /compute/v2.1/servers/833f292c-b042-4eeb-99c1-b68002010de1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:29:03.037107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9df50fe-6d67-47d5-89e4-3433079ae7bf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:03.037107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a9df50fe-6d67-47d5-89e4-3433079ae7bf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:03.047048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9df50fe-6d67-47d5-89e4-3433079ae7bf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:03.047726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9df50fe-6d67-47d5-89e4-3433079ae7bf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:03.048438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9df50fe-6d67-47d5-89e4-3433079ae7bf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:03.050047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9df50fe-6d67-47d5-89e4-3433079ae7bf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:03.050537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9df50fe-6d67-47d5-89e4-3433079ae7bf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:03.050976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a9df50fe-6d67-47d5-89e4-3433079ae7bf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:03.068685 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-a9df50fe-6d67-47d5-89e4-3433079ae7bf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9df50fe-6d67-47d5-89e4-3433079ae7bf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f HTTP/1.1 Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'd291a54c-7210-4be5-b760-6157ac99ca9f'} Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:03.072839 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a9df50fe-6d67-47d5-89e4-3433079ae7bf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a9df50fe-6d67-47d5-89e4-3433079ae7bf tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "DELETE /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 404 len: 111 microversion: 2.1 time: 0.045211 Aug 09 15:29:03.081317 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3443/6874] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:29:03 2022] DELETE /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:29:03.083072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-013cf8f4-c69e-4802-9fd2-827740a505bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:03.083072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-013cf8f4-c69e-4802-9fd2-827740a505bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] [instance: d291a54c-7210-4be5-b760-6157ac99ca9f] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:03.089783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-013cf8f4-c69e-4802-9fd2-827740a505bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:03.090319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-013cf8f4-c69e-4802-9fd2-827740a505bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:03.090771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-013cf8f4-c69e-4802-9fd2-827740a505bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:03.091810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-013cf8f4-c69e-4802-9fd2-827740a505bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:03.092308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-013cf8f4-c69e-4802-9fd2-827740a505bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:03.092761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-013cf8f4-c69e-4802-9fd2-827740a505bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:03.117398 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-013cf8f4-c69e-4802-9fd2-827740a505bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] HTTP exception thrown: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-013cf8f4-c69e-4802-9fd2-827740a505bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Request method failure captured: Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f HTTP/1.1 Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8nu-YRKpMsgx83iA1Bn3_6c7C5H0LCiIhsmcmyQYDnu79RCzQXSRAxqEVa2WR7_FPIzric8EZwLYiU-zVLqJ7guNGXA3xGL4-cbBxok_ptpEEbvJ2vYFmi9bSGcaW0fXTeY1giRRTkZZqH6nQohM51F1_ss4DkDHC5Nwr0aTC4GLYCM Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f3db1d5bb19047d4a655d6580a3336cb", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f3db1d5bb19047d4a655d6580a3336cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: f3db1d5bb19047d4a655d6580a3336cb Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServerActionsTestJSON-935695441 Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 127998e24ecf48d58f3c789530f89898 Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServerActionsTestJSON-935695441-project Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': 'd291a54c-7210-4be5-b760-6157ac99ca9f'} Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:03.120636 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.126131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:03.126131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:03.126131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:03.126131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:03.126131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:03.126131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. Aug 09 15:29:03.126131 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:03.128341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-013cf8f4-c69e-4802-9fd2-827740a505bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Returning 404 to user: Instance d291a54c-7210-4be5-b760-6157ac99ca9f could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:03.131003 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-013cf8f4-c69e-4802-9fd2-827740a505bb tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f" status: 404 len: 111 microversion: 2.1 time: 0.052153 Aug 09 15:29:03.133726 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3432/6875] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:03 2022] GET /compute/v2.1/servers/d291a54c-7210-4be5-b760-6157ac99ca9f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:29:03.147041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-56bd2abe-9933-4fbb-a7e7-3a89d45325dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] Calling method '.version_select at 0x7f41dcbd1a60>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:03.192633 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-56bd2abe-9933-4fbb-a7e7-3a89d45325dd tempest-ServerActionsTestJSON-935695441 tempest-ServerActionsTestJSON-935695441-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527801048" status: 202 len: 0 microversion: 2.1 time: 0.050013 Aug 09 15:29:03.193496 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3444/6876] 10.222.0.50 () {58 vars in 1221 bytes} [Tue Aug 9 15:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527801048 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:29:16.050847 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=15 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:29:16.052782 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:29:16.214969 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1258972032", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "dc833e64-ad9e-43f0-ab4a-c3ec8cdec945"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:29:16.285589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] validate_networks() for [('dc833e64-ad9e-43f0-ab4a-c3ec8cdec945', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:29:16.948694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:29:16.949456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:29:16.950409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:29:16.951366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:29:16.952146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:29:16.963248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:16.963745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:16.964202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:16.964966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:16.965428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:16.965859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:16.985905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Getting quotas for project d2337a54a7354465a94bb852ae6d2bfa. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:29:16.992555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Getting quotas for user f68ec757806b40e09b1f8bcd8a9cf1f4 and project d2337a54a7354465a94bb852ae6d2bfa. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:29:17.008163 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:29:17.010624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:29:17.062326 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-138653c1-9080-4c4d-b130-095713692067 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.034174 Aug 09 15:29:17.064148 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3433/6877] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:29:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:29:17.075134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=15 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:29:17.078828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:29:17.086563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3ad5b2cb-cb42-4fa5-a26a-76a61450ba9e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:17.088575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3ad5b2cb-cb42-4fa5-a26a-76a61450ba9e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:17.183496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3ad5b2cb-cb42-4fa5-a26a-76a61450ba9e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:17.194460 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3ad5b2cb-cb42-4fa5-a26a-76a61450ba9e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1217 microversion: 2.1 time: 0.122349 Aug 09 15:29:17.195112 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3445/6878] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:17 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:18.233343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d440f72d-e05e-48d4-9821-d0408f6751ec tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:18.234520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d440f72d-e05e-48d4-9821-d0408f6751ec tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:18.247370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d440f72d-e05e-48d4-9821-d0408f6751ec tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:18.248283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d440f72d-e05e-48d4-9821-d0408f6751ec tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:18.251937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d440f72d-e05e-48d4-9821-d0408f6751ec tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:18.252857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d440f72d-e05e-48d4-9821-d0408f6751ec tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:18.254194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d440f72d-e05e-48d4-9821-d0408f6751ec tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:18.254194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d440f72d-e05e-48d4-9821-d0408f6751ec tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:18.333808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d440f72d-e05e-48d4-9821-d0408f6751ec tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:18.345117 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d440f72d-e05e-48d4-9821-d0408f6751ec tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1277 microversion: 2.1 time: 0.119760 Aug 09 15:29:18.346218 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3434/6879] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:18 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:19.383787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3fb687d8-143c-4b20-9566-f6ff79153849 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:19.385807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3fb687d8-143c-4b20-9566-f6ff79153849 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:19.399999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fb687d8-143c-4b20-9566-f6ff79153849 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:19.400890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fb687d8-143c-4b20-9566-f6ff79153849 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:19.401974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fb687d8-143c-4b20-9566-f6ff79153849 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:19.403874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fb687d8-143c-4b20-9566-f6ff79153849 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:19.404974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fb687d8-143c-4b20-9566-f6ff79153849 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:19.406140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3fb687d8-143c-4b20-9566-f6ff79153849 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:19.694202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3fb687d8-143c-4b20-9566-f6ff79153849 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:19.722196 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3fb687d8-143c-4b20-9566-f6ff79153849 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1317 microversion: 2.1 time: 0.348552 Aug 09 15:29:19.725534 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3446/6880] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:19 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:20.550842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-18fab970-1a80-44f3-9689-c4b1ec47c22f req-d445a0fe-51be-4522-97a8-ba18ed4131e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21bc4c3b-1719-49a7-8c12-491eab05e3ba", "tag": "1372e011-35ee-4d92-ad12-068df75b2c0a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:29:20.585469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-18fab970-1a80-44f3-9689-c4b1ec47c22f req-d445a0fe-51be-4522-97a8-ba18ed4131e0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:20.589899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-18fab970-1a80-44f3-9689-c4b1ec47c22f req-d445a0fe-51be-4522-97a8-ba18ed4131e0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:20.592250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-18fab970-1a80-44f3-9689-c4b1ec47c22f req-d445a0fe-51be-4522-97a8-ba18ed4131e0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:20.615159 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-18fab970-1a80-44f3-9689-c4b1ec47c22f req-d445a0fe-51be-4522-97a8-ba18ed4131e0 service nova] Creating event network-changed:1372e011-35ee-4d92-ad12-068df75b2c0a for instance 21bc4c3b-1719-49a7-8c12-491eab05e3ba on n-h1-844626-8 Aug 09 15:29:20.624437 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-18fab970-1a80-44f3-9689-c4b1ec47c22f req-d445a0fe-51be-4522-97a8-ba18ed4131e0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086018 Aug 09 15:29:20.625781 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3435/6881] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:29:20.747018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c92cff98-3c84-49f0-aaa0-77c8176c8444 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:20.747934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c92cff98-3c84-49f0-aaa0-77c8176c8444 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:20.756060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c92cff98-3c84-49f0-aaa0-77c8176c8444 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:20.757319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c92cff98-3c84-49f0-aaa0-77c8176c8444 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:20.757319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c92cff98-3c84-49f0-aaa0-77c8176c8444 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:20.758107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c92cff98-3c84-49f0-aaa0-77c8176c8444 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:20.758679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c92cff98-3c84-49f0-aaa0-77c8176c8444 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:20.759235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c92cff98-3c84-49f0-aaa0-77c8176c8444 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:20.919235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c92cff98-3c84-49f0-aaa0-77c8176c8444 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:20.929845 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c92cff98-3c84-49f0-aaa0-77c8176c8444 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1317 microversion: 2.1 time: 0.186917 Aug 09 15:29:20.930477 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3447/6882] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:20 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:29:21.953766 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ec4b0dbe-e9f3-4e93-b508-826c16bf17e3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:21.954713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ec4b0dbe-e9f3-4e93-b508-826c16bf17e3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:21.962517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec4b0dbe-e9f3-4e93-b508-826c16bf17e3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:21.963022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec4b0dbe-e9f3-4e93-b508-826c16bf17e3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:21.963472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec4b0dbe-e9f3-4e93-b508-826c16bf17e3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:21.964209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec4b0dbe-e9f3-4e93-b508-826c16bf17e3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:21.964671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec4b0dbe-e9f3-4e93-b508-826c16bf17e3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:21.965105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ec4b0dbe-e9f3-4e93-b508-826c16bf17e3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:22.133121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ec4b0dbe-e9f3-4e93-b508-826c16bf17e3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:22.141706 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ec4b0dbe-e9f3-4e93-b508-826c16bf17e3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1317 microversion: 2.1 time: 0.193288 Aug 09 15:29:22.142596 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3436/6883] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:21 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:23.166284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1e8073f4-501f-4851-bdef-108d7899baa5 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:23.167009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1e8073f4-501f-4851-bdef-108d7899baa5 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:23.176632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e8073f4-501f-4851-bdef-108d7899baa5 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:23.177121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e8073f4-501f-4851-bdef-108d7899baa5 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:23.177553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e8073f4-501f-4851-bdef-108d7899baa5 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:23.178569 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e8073f4-501f-4851-bdef-108d7899baa5 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:23.178721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e8073f4-501f-4851-bdef-108d7899baa5 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:23.179175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1e8073f4-501f-4851-bdef-108d7899baa5 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:23.340682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1e8073f4-501f-4851-bdef-108d7899baa5 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:23.350521 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1e8073f4-501f-4851-bdef-108d7899baa5 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1317 microversion: 2.1 time: 0.190718 Aug 09 15:29:23.351277 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3448/6884] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:23 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:29:24.373252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa5fbb75-5d2a-490e-9e37-0c7ea306da00 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:24.374095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa5fbb75-5d2a-490e-9e37-0c7ea306da00 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:24.381850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa5fbb75-5d2a-490e-9e37-0c7ea306da00 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:24.382503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa5fbb75-5d2a-490e-9e37-0c7ea306da00 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:24.382954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa5fbb75-5d2a-490e-9e37-0c7ea306da00 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:24.383833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa5fbb75-5d2a-490e-9e37-0c7ea306da00 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:24.384295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa5fbb75-5d2a-490e-9e37-0c7ea306da00 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:24.384726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa5fbb75-5d2a-490e-9e37-0c7ea306da00 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:24.565381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa5fbb75-5d2a-490e-9e37-0c7ea306da00 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:24.579375 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa5fbb75-5d2a-490e-9e37-0c7ea306da00 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1317 microversion: 2.1 time: 0.209488 Aug 09 15:29:24.580542 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3437/6885] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:24 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:25.486728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-d3a33888-2931-469c-9543-bebd51485243 req-84788e6a-e0cd-4910-9ffa-a6240bc93d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bc4c3b-1719-49a7-8c12-491eab05e3ba", "name": "network-vif-plugged", "status": "completed", "tag": "1372e011-35ee-4d92-ad12-068df75b2c0a"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:29:25.497719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d3a33888-2931-469c-9543-bebd51485243 req-84788e6a-e0cd-4910-9ffa-a6240bc93d68 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:25.498268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d3a33888-2931-469c-9543-bebd51485243 req-84788e6a-e0cd-4910-9ffa-a6240bc93d68 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:25.498755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-d3a33888-2931-469c-9543-bebd51485243 req-84788e6a-e0cd-4910-9ffa-a6240bc93d68 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:25.512564 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-d3a33888-2931-469c-9543-bebd51485243 req-84788e6a-e0cd-4910-9ffa-a6240bc93d68 service nova] Creating event network-vif-plugged:1372e011-35ee-4d92-ad12-068df75b2c0a for instance 21bc4c3b-1719-49a7-8c12-491eab05e3ba on n-h1-844626-8 Aug 09 15:29:25.518487 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-d3a33888-2931-469c-9543-bebd51485243 req-84788e6a-e0cd-4910-9ffa-a6240bc93d68 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111619 Aug 09 15:29:25.519227 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3449/6886] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:29:25.604567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e25c9bff-6b3f-4f30-a65b-5b5836e05333 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:25.605388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e25c9bff-6b3f-4f30-a65b-5b5836e05333 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:25.613975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e25c9bff-6b3f-4f30-a65b-5b5836e05333 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:25.614481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e25c9bff-6b3f-4f30-a65b-5b5836e05333 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:25.614922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e25c9bff-6b3f-4f30-a65b-5b5836e05333 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:25.615695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e25c9bff-6b3f-4f30-a65b-5b5836e05333 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:25.616173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e25c9bff-6b3f-4f30-a65b-5b5836e05333 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:25.616621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e25c9bff-6b3f-4f30-a65b-5b5836e05333 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:25.788049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e25c9bff-6b3f-4f30-a65b-5b5836e05333 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:25.802730 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e25c9bff-6b3f-4f30-a65b-5b5836e05333 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1317 microversion: 2.1 time: 0.203361 Aug 09 15:29:25.803867 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3438/6887] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:25 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:26.828253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05c31e45-1dc7-4aad-a8d2-75f98d7ba1b9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:26.829022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05c31e45-1dc7-4aad-a8d2-75f98d7ba1b9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:26.835913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05c31e45-1dc7-4aad-a8d2-75f98d7ba1b9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:26.836420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05c31e45-1dc7-4aad-a8d2-75f98d7ba1b9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:26.836852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05c31e45-1dc7-4aad-a8d2-75f98d7ba1b9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:26.837687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05c31e45-1dc7-4aad-a8d2-75f98d7ba1b9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:26.838142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05c31e45-1dc7-4aad-a8d2-75f98d7ba1b9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:26.838572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05c31e45-1dc7-4aad-a8d2-75f98d7ba1b9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:27.018578 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05c31e45-1dc7-4aad-a8d2-75f98d7ba1b9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:27.027569 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05c31e45-1dc7-4aad-a8d2-75f98d7ba1b9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1507 microversion: 2.1 time: 0.205274 Aug 09 15:29:27.028203 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3450/6888] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:26 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:27.094195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1806775908", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "dc833e64-ad9e-43f0-ab4a-c3ec8cdec945"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:29:27.104840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:29:27.105605 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:29:27.162137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] validate_networks() for [('dc833e64-ad9e-43f0-ab4a-c3ec8cdec945', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:29:27.592819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:29:27.593440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:29:27.594216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:29:27.594750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:29:27.595444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:29:27.607421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:27.607938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:27.608388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:27.609137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:27.610813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:27.610813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:27.631759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Getting quotas for project d2337a54a7354465a94bb852ae6d2bfa. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:29:27.638030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Getting quotas for user f68ec757806b40e09b1f8bcd8a9cf1f4 and project d2337a54a7354465a94bb852ae6d2bfa. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:29:27.654279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:29:27.656954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:29:27.707925 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d62ed1d7-2b54-420b-9377-f2fe51279ac2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617679 Aug 09 15:29:27.708601 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3439/6889] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:29:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:29:27.723791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c6af7379-f59d-4ac5-a066-e3fbc07f3ad0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:27.724879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c6af7379-f59d-4ac5-a066-e3fbc07f3ad0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:27.728509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:29:27.815644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c6af7379-f59d-4ac5-a066-e3fbc07f3ad0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:27.825007 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c6af7379-f59d-4ac5-a066-e3fbc07f3ad0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 200 len: 1217 microversion: 2.1 time: 0.108487 Aug 09 15:29:27.825768 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3451/6890] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:27 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:28.850035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-661dcf6a-fbcb-409c-9ce3-9c61117b38a8 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:28.851180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-661dcf6a-fbcb-409c-9ce3-9c61117b38a8 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:28.865037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-661dcf6a-fbcb-409c-9ce3-9c61117b38a8 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:28.866183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-661dcf6a-fbcb-409c-9ce3-9c61117b38a8 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:28.866981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-661dcf6a-fbcb-409c-9ce3-9c61117b38a8 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:28.868317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-661dcf6a-fbcb-409c-9ce3-9c61117b38a8 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:28.869192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-661dcf6a-fbcb-409c-9ce3-9c61117b38a8 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:28.870106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-661dcf6a-fbcb-409c-9ce3-9c61117b38a8 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:29.044393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-661dcf6a-fbcb-409c-9ce3-9c61117b38a8 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:29.055405 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-661dcf6a-fbcb-409c-9ce3-9c61117b38a8 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 200 len: 1269 microversion: 2.1 time: 0.212338 Aug 09 15:29:29.056418 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3440/6891] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:28 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:30.080461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d063c87-3016-4011-8370-802ccaae8895 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:30.081518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6d063c87-3016-4011-8370-802ccaae8895 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:30.096317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d063c87-3016-4011-8370-802ccaae8895 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:30.096943 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d063c87-3016-4011-8370-802ccaae8895 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:30.097864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d063c87-3016-4011-8370-802ccaae8895 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:30.098696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d063c87-3016-4011-8370-802ccaae8895 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:30.099403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d063c87-3016-4011-8370-802ccaae8895 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:30.100022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d063c87-3016-4011-8370-802ccaae8895 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:30.433890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6d063c87-3016-4011-8370-802ccaae8895 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:30.444443 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6d063c87-3016-4011-8370-802ccaae8895 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 200 len: 1317 microversion: 2.1 time: 0.369811 Aug 09 15:29:30.445321 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3452/6892] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:30 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:29:31.042772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8adb8bad-2e54-4779-8246-fb4032947eff req-01a9e053-9702-48b6-a114-d1332fadb533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "879a6f2e-250d-457d-a998-5690d2d788a4", "tag": "bbe9c459-42c0-4e6d-b10b-bbfa02ff4781"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:29:31.053832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8adb8bad-2e54-4779-8246-fb4032947eff req-01a9e053-9702-48b6-a114-d1332fadb533 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:31.054431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8adb8bad-2e54-4779-8246-fb4032947eff req-01a9e053-9702-48b6-a114-d1332fadb533 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:31.054983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8adb8bad-2e54-4779-8246-fb4032947eff req-01a9e053-9702-48b6-a114-d1332fadb533 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:31.069072 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8adb8bad-2e54-4779-8246-fb4032947eff req-01a9e053-9702-48b6-a114-d1332fadb533 service nova] Creating event network-changed:bbe9c459-42c0-4e6d-b10b-bbfa02ff4781 for instance 879a6f2e-250d-457d-a998-5690d2d788a4 on n-h2-844626-8 Aug 09 15:29:31.075361 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8adb8bad-2e54-4779-8246-fb4032947eff req-01a9e053-9702-48b6-a114-d1332fadb533 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121556 Aug 09 15:29:31.076195 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3441/6893] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:29:31.468852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba6bf956-3a1f-46b7-a0c7-f3b909b20b26 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:31.469762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba6bf956-3a1f-46b7-a0c7-f3b909b20b26 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:31.478531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba6bf956-3a1f-46b7-a0c7-f3b909b20b26 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:31.479181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba6bf956-3a1f-46b7-a0c7-f3b909b20b26 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:31.479720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba6bf956-3a1f-46b7-a0c7-f3b909b20b26 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:31.480527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba6bf956-3a1f-46b7-a0c7-f3b909b20b26 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:31.481058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba6bf956-3a1f-46b7-a0c7-f3b909b20b26 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:31.481552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba6bf956-3a1f-46b7-a0c7-f3b909b20b26 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:31.645657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba6bf956-3a1f-46b7-a0c7-f3b909b20b26 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:31.654114 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba6bf956-3a1f-46b7-a0c7-f3b909b20b26 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 200 len: 1317 microversion: 2.1 time: 0.189294 Aug 09 15:29:31.654715 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3453/6894] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:31 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:32.681652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9195ad8a-1a5b-4f6a-a8ad-a3e34b21bc49 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:32.682942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9195ad8a-1a5b-4f6a-a8ad-a3e34b21bc49 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:32.694212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9195ad8a-1a5b-4f6a-a8ad-a3e34b21bc49 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:32.695131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9195ad8a-1a5b-4f6a-a8ad-a3e34b21bc49 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:32.695916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9195ad8a-1a5b-4f6a-a8ad-a3e34b21bc49 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:32.697172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9195ad8a-1a5b-4f6a-a8ad-a3e34b21bc49 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:32.698006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9195ad8a-1a5b-4f6a-a8ad-a3e34b21bc49 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:32.698789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9195ad8a-1a5b-4f6a-a8ad-a3e34b21bc49 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:32.987309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9195ad8a-1a5b-4f6a-a8ad-a3e34b21bc49 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:32.996116 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9195ad8a-1a5b-4f6a-a8ad-a3e34b21bc49 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 200 len: 1317 microversion: 2.1 time: 0.324249 Aug 09 15:29:32.996736 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3442/6895] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:32 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:34.032382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48e6a5a9-0b2e-457e-b6c4-ccbb042a7b2a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:34.033669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48e6a5a9-0b2e-457e-b6c4-ccbb042a7b2a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:34.046457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48e6a5a9-0b2e-457e-b6c4-ccbb042a7b2a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:34.047550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48e6a5a9-0b2e-457e-b6c4-ccbb042a7b2a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:34.048337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48e6a5a9-0b2e-457e-b6c4-ccbb042a7b2a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:34.049624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48e6a5a9-0b2e-457e-b6c4-ccbb042a7b2a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:34.050332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48e6a5a9-0b2e-457e-b6c4-ccbb042a7b2a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:34.051230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48e6a5a9-0b2e-457e-b6c4-ccbb042a7b2a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:34.220723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48e6a5a9-0b2e-457e-b6c4-ccbb042a7b2a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:34.229332 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48e6a5a9-0b2e-457e-b6c4-ccbb042a7b2a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 200 len: 1317 microversion: 2.1 time: 0.202666 Aug 09 15:29:34.229947 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3454/6896] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:34 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:35.252362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2d6c4d9f-bb2e-423b-95cf-46aa1191895d tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:35.253151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2d6c4d9f-bb2e-423b-95cf-46aa1191895d tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:35.260900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d6c4d9f-bb2e-423b-95cf-46aa1191895d tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:35.261408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d6c4d9f-bb2e-423b-95cf-46aa1191895d tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:35.261856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d6c4d9f-bb2e-423b-95cf-46aa1191895d tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:35.262584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d6c4d9f-bb2e-423b-95cf-46aa1191895d tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:35.263042 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d6c4d9f-bb2e-423b-95cf-46aa1191895d tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:35.263511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d6c4d9f-bb2e-423b-95cf-46aa1191895d tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:35.435263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2d6c4d9f-bb2e-423b-95cf-46aa1191895d tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:35.446638 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2d6c4d9f-bb2e-423b-95cf-46aa1191895d tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 200 len: 1317 microversion: 2.1 time: 0.198113 Aug 09 15:29:35.447799 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3443/6897] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:35 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:35.715914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-441c34d0-b1fa-4da1-8385-e2089ae210aa req-a523653d-4fcc-4d18-b0bb-ddcb9cdfc97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879a6f2e-250d-457d-a998-5690d2d788a4", "name": "network-vif-plugged", "status": "completed", "tag": "bbe9c459-42c0-4e6d-b10b-bbfa02ff4781"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:29:35.731552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-441c34d0-b1fa-4da1-8385-e2089ae210aa req-a523653d-4fcc-4d18-b0bb-ddcb9cdfc97d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:35.732173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-441c34d0-b1fa-4da1-8385-e2089ae210aa req-a523653d-4fcc-4d18-b0bb-ddcb9cdfc97d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:35.732693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-441c34d0-b1fa-4da1-8385-e2089ae210aa req-a523653d-4fcc-4d18-b0bb-ddcb9cdfc97d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:35.748299 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-441c34d0-b1fa-4da1-8385-e2089ae210aa req-a523653d-4fcc-4d18-b0bb-ddcb9cdfc97d service nova] Creating event network-vif-plugged:bbe9c459-42c0-4e6d-b10b-bbfa02ff4781 for instance 879a6f2e-250d-457d-a998-5690d2d788a4 on n-h2-844626-8 Aug 09 15:29:35.754419 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-441c34d0-b1fa-4da1-8385-e2089ae210aa req-a523653d-4fcc-4d18-b0bb-ddcb9cdfc97d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044378 Aug 09 15:29:35.755218 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3455/6898] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:29:36.474666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-68d122f8-4461-479f-9f14-423f15dd851e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:36.475442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-68d122f8-4461-479f-9f14-423f15dd851e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:36.483374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68d122f8-4461-479f-9f14-423f15dd851e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:36.483875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68d122f8-4461-479f-9f14-423f15dd851e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:36.484405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68d122f8-4461-479f-9f14-423f15dd851e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:36.485436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68d122f8-4461-479f-9f14-423f15dd851e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:36.485907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68d122f8-4461-479f-9f14-423f15dd851e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:36.486341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68d122f8-4461-479f-9f14-423f15dd851e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:36.657157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-68d122f8-4461-479f-9f14-423f15dd851e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:36.665667 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-68d122f8-4461-479f-9f14-423f15dd851e tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 200 len: 1317 microversion: 2.1 time: 0.196173 Aug 09 15:29:36.666293 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3444/6899] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:36 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:37.689195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-091db0f2-ecb8-4683-b2a3-aac5b083fff7 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:37.690018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-091db0f2-ecb8-4683-b2a3-aac5b083fff7 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:37.698087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-091db0f2-ecb8-4683-b2a3-aac5b083fff7 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:37.698577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-091db0f2-ecb8-4683-b2a3-aac5b083fff7 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:37.699012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-091db0f2-ecb8-4683-b2a3-aac5b083fff7 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:37.699777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-091db0f2-ecb8-4683-b2a3-aac5b083fff7 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:37.700247 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-091db0f2-ecb8-4683-b2a3-aac5b083fff7 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:37.700669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-091db0f2-ecb8-4683-b2a3-aac5b083fff7 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:37.819630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:29:37.879365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-091db0f2-ecb8-4683-b2a3-aac5b083fff7 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:37.888202 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-091db0f2-ecb8-4683-b2a3-aac5b083fff7 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 200 len: 1507 microversion: 2.1 time: 0.204717 Aug 09 15:29:37.888947 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3456/6900] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:37 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:37.911059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3fe3d6ef-4578-4e14-b4bb-7540d05a48e0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:37.911792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3fe3d6ef-4578-4e14-b4bb-7540d05a48e0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:37.915177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:29:37.916044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:29:37.924687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fe3d6ef-4578-4e14-b4bb-7540d05a48e0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:37.925347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fe3d6ef-4578-4e14-b4bb-7540d05a48e0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:37.925943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fe3d6ef-4578-4e14-b4bb-7540d05a48e0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:37.926784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fe3d6ef-4578-4e14-b4bb-7540d05a48e0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:37.927420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fe3d6ef-4578-4e14-b4bb-7540d05a48e0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:37.927949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3fe3d6ef-4578-4e14-b4bb-7540d05a48e0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:37.957172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3fe3d6ef-4578-4e14-b4bb-7540d05a48e0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:29:38.050088 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3fe3d6ef-4578-4e14-b4bb-7540d05a48e0 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "DELETE /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 204 len: 0 microversion: 2.1 time: 0.143287 Aug 09 15:29:38.051000 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3445/6901] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:29:37 2022] DELETE /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:29:38.064134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5347a590-16f1-4e0e-841e-66e4813981de tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:38.065664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5347a590-16f1-4e0e-841e-66e4813981de tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:38.074333 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5347a590-16f1-4e0e-841e-66e4813981de tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:38.074829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5347a590-16f1-4e0e-841e-66e4813981de tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:38.075318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5347a590-16f1-4e0e-841e-66e4813981de tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:38.076030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5347a590-16f1-4e0e-841e-66e4813981de tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:38.076476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5347a590-16f1-4e0e-841e-66e4813981de tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:38.076894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5347a590-16f1-4e0e-841e-66e4813981de tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:38.232771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5347a590-16f1-4e0e-841e-66e4813981de tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:38.242200 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5347a590-16f1-4e0e-841e-66e4813981de tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 200 len: 1513 microversion: 2.1 time: 0.185813 Aug 09 15:29:38.242919 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3457/6902] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:38 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:39.270489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-acb5a27e-89b1-405c-820c-c6dbe23d66f9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:39.271473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-acb5a27e-89b1-405c-820c-c6dbe23d66f9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:39.280387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acb5a27e-89b1-405c-820c-c6dbe23d66f9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:39.280799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acb5a27e-89b1-405c-820c-c6dbe23d66f9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:39.281364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acb5a27e-89b1-405c-820c-c6dbe23d66f9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:39.282099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acb5a27e-89b1-405c-820c-c6dbe23d66f9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:39.282551 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acb5a27e-89b1-405c-820c-c6dbe23d66f9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:39.283046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-acb5a27e-89b1-405c-820c-c6dbe23d66f9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:39.449394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-acb5a27e-89b1-405c-820c-c6dbe23d66f9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:39.463803 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-acb5a27e-89b1-405c-820c-c6dbe23d66f9 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 200 len: 1513 microversion: 2.1 time: 0.200171 Aug 09 15:29:39.464863 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3446/6903] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:39 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:40.079130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8be4162c-3e9d-4f0b-b173-321b817bb1d5 req-ab1b0ed9-2428-437c-a453-57ff7bcbf74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "879a6f2e-250d-457d-a998-5690d2d788a4", "name": "network-vif-deleted", "tag": "bbe9c459-42c0-4e6d-b10b-bbfa02ff4781"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:29:40.102853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8be4162c-3e9d-4f0b-b173-321b817bb1d5 req-ab1b0ed9-2428-437c-a453-57ff7bcbf74a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:40.103911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8be4162c-3e9d-4f0b-b173-321b817bb1d5 req-ab1b0ed9-2428-437c-a453-57ff7bcbf74a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:40.104865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8be4162c-3e9d-4f0b-b173-321b817bb1d5 req-ab1b0ed9-2428-437c-a453-57ff7bcbf74a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:40.129934 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8be4162c-3e9d-4f0b-b173-321b817bb1d5 req-ab1b0ed9-2428-437c-a453-57ff7bcbf74a service nova] Creating event network-vif-deleted:bbe9c459-42c0-4e6d-b10b-bbfa02ff4781 for instance 879a6f2e-250d-457d-a998-5690d2d788a4 on n-h2-844626-8 Aug 09 15:29:40.136613 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8be4162c-3e9d-4f0b-b173-321b817bb1d5 req-ab1b0ed9-2428-437c-a453-57ff7bcbf74a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065060 Aug 09 15:29:40.138139 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3458/6904] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:29:40.488103 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:40.488895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:40.497085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:40.497554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:40.497996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:40.498728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:40.499379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:40.500056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:40.543212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:40.543717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:40.544194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:40.544649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lazy-loading 'fault' on Instance uuid 879a6f2e-250d-457d-a998-5690d2d788a4 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:29:40.594757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:40.611162 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3b3f4ff8-0b0c-4fb0-bc1c-e8e30d77a6a2 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 200 len: 1307 microversion: 2.1 time: 0.126884 Aug 09 15:29:40.611876 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3447/6905] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:40 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 1307 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:29:41.637574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b00fdb4-5c0b-481f-9550-13bda5bb5315 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:41.638503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3b00fdb4-5c0b-481f-9550-13bda5bb5315 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:41.647550 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b00fdb4-5c0b-481f-9550-13bda5bb5315 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:41.648043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b00fdb4-5c0b-481f-9550-13bda5bb5315 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:41.648482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b00fdb4-5c0b-481f-9550-13bda5bb5315 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:41.649218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b00fdb4-5c0b-481f-9550-13bda5bb5315 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:41.649673 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b00fdb4-5c0b-481f-9550-13bda5bb5315 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:41.650093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3b00fdb4-5c0b-481f-9550-13bda5bb5315 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:41.668491 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-3b00fdb4-5c0b-481f-9550-13bda5bb5315 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] HTTP exception thrown: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b00fdb4-5c0b-481f-9550-13bda5bb5315 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Request method failure captured: Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 HTTP/1.1 Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n1LJgDk3pJjpd8HDUXJg9JzTccIisLRwsbVj-ks9DV9UmoHGMIjN3_l5frIteSRoKW4MIveUNYUemK8w_SnvwaVnsjXBcOJZsNMnC7dAoyLIdCdixXNthOeZFiTwe5e59emokRGmrDEc0f2JEY24crUJRtH5yc7uOTBwcy4XbkSvgk Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2337a54a7354465a94bb852ae6d2bfa", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f68ec757806b40e09b1f8bcd8a9cf1f4 Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '879a6f2e-250d-457d-a998-5690d2d788a4'} Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:41.670353 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:41.677426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:41.677426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:41.677426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:41.677426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:41.677426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:41.677426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:41.677426 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:41.677426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3b00fdb4-5c0b-481f-9550-13bda5bb5315 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Returning 404 to user: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:41.677426 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3b00fdb4-5c0b-481f-9550-13bda5bb5315 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 404 len: 111 microversion: 2.1 time: 0.040369 Aug 09 15:29:41.677426 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3459/6906] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:41 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:29:41.684600 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b6cca0f4-e4f6-4189-b674-d0d5be43a689 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:41.685574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6cca0f4-e4f6-4189-b674-d0d5be43a689 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:41.694765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6cca0f4-e4f6-4189-b674-d0d5be43a689 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:41.695309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6cca0f4-e4f6-4189-b674-d0d5be43a689 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:41.695761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6cca0f4-e4f6-4189-b674-d0d5be43a689 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:41.696506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6cca0f4-e4f6-4189-b674-d0d5be43a689 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:41.696982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6cca0f4-e4f6-4189-b674-d0d5be43a689 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:41.697414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6cca0f4-e4f6-4189-b674-d0d5be43a689 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:41.861293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b6cca0f4-e4f6-4189-b674-d0d5be43a689 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:41.869866 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b6cca0f4-e4f6-4189-b674-d0d5be43a689 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1507 microversion: 2.1 time: 0.191034 Aug 09 15:29:41.870468 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3448/6907] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:41 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1507 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:41.908124 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d121bf7-69f3-4263-957f-ac030cf22a1a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:29:41.912314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6d121bf7-69f3-4263-957f-ac030cf22a1a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: e1c8ca2e-720b-4849-8b85-3b0dad32129b] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:41.922388 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-6d121bf7-69f3-4263-957f-ac030cf22a1a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] HTTP exception thrown: Instance e1c8ca2e-720b-4849-8b85-3b0dad32129b could not be found. Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d121bf7-69f3-4263-957f-ac030cf22a1a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Request method failure captured: Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/e1c8ca2e-720b-4849-8b85-3b0dad32129b/action HTTP/1.1 Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 32 Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n1LJgDk3pJjpd8HDUXJg9JzTccIisLRwsbVj-ks9DV9UmoHGMIjN3_l5frIteSRoKW4MIveUNYUemK8w_SnvwaVnsjXBcOJZsNMnC7dAoyLIdCdixXNthOeZFiTwe5e59emokRGmrDEc0f2JEY24crUJRtH5yc7uOTBwcy4XbkSvgk Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2337a54a7354465a94bb852ae6d2bfa", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f68ec757806b40e09b1f8bcd8a9cf1f4 Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: {"resize": {"flavorRef": "452"}} Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance e1c8ca2e-720b-4849-8b85-3b0dad32129b could not be found. Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'e1c8ca2e-720b-4849-8b85-3b0dad32129b', 'body': {'resize': {'flavorRef': '452'}}} Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c8ca2e-720b-4849-8b85-3b0dad32129b could not be found. Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:41.925870 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c8ca2e-720b-4849-8b85-3b0dad32129b could not be found. Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c8ca2e-720b-4849-8b85-3b0dad32129b could not be found. Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d121bf7-69f3-4263-957f-ac030cf22a1a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Returning 404 to user: Instance e1c8ca2e-720b-4849-8b85-3b0dad32129b could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6d121bf7-69f3-4263-957f-ac030cf22a1a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "POST /compute/v2.1/servers/e1c8ca2e-720b-4849-8b85-3b0dad32129b/action" status: 404 len: 111 microversion: 2.1 time: 0.027761 Aug 09 15:29:41.932684 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3460/6908] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:29:41 2022] POST /compute/v2.1/servers/e1c8ca2e-720b-4849-8b85-3b0dad32129b/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:29:41.939949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fe5ccc7c-a0de-4a50-9615-e27deaa0e9eb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:41.940723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fe5ccc7c-a0de-4a50-9615-e27deaa0e9eb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:41.947601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe5ccc7c-a0de-4a50-9615-e27deaa0e9eb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:41.948102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe5ccc7c-a0de-4a50-9615-e27deaa0e9eb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:41.948542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe5ccc7c-a0de-4a50-9615-e27deaa0e9eb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:41.949260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe5ccc7c-a0de-4a50-9615-e27deaa0e9eb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:41.949715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe5ccc7c-a0de-4a50-9615-e27deaa0e9eb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:41.950145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fe5ccc7c-a0de-4a50-9615-e27deaa0e9eb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:42.125687 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fe5ccc7c-a0de-4a50-9615-e27deaa0e9eb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:42.136791 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fe5ccc7c-a0de-4a50-9615-e27deaa0e9eb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1507 microversion: 2.1 time: 0.200899 Aug 09 15:29:42.137460 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3449/6909] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:41 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:42.162332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6cb30979-3a05-42aa-bc98-c72065987abb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:42.162856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6cb30979-3a05-42aa-bc98-c72065987abb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:42.173661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cb30979-3a05-42aa-bc98-c72065987abb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:42.174212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cb30979-3a05-42aa-bc98-c72065987abb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:42.174684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cb30979-3a05-42aa-bc98-c72065987abb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:42.175640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cb30979-3a05-42aa-bc98-c72065987abb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:42.176136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cb30979-3a05-42aa-bc98-c72065987abb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:42.176593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6cb30979-3a05-42aa-bc98-c72065987abb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:42.341438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6cb30979-3a05-42aa-bc98-c72065987abb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:42.351862 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6cb30979-3a05-42aa-bc98-c72065987abb tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1507 microversion: 2.1 time: 0.193510 Aug 09 15:29:42.352580 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3461/6910] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:42 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:42.373487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "ad140633-c29a-45fd-a378-9823e61b496e"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:29:42.376940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:42.384111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:42.384664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:42.385166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:42.386108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:42.386631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:42.387161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:42.392841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:29:42.436081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:42.442918 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] HTTP exception thrown: Flavor ad140633-c29a-45fd-a378-9823e61b496e could not be found. Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Request method failure captured: Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: request: POST /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba/action HTTP/1.1 Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 65 Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8n1LJgDk3pJjpd8HDUXJg9JzTccIisLRwsbVj-ks9DV9UmoHGMIjN3_l5frIteSRoKW4MIveUNYUemK8w_SnvwaVnsjXBcOJZsNMnC7dAoyLIdCdixXNthOeZFiTwe5e59emokRGmrDEc0f2JEY24crUJRtH5yc7uOTBwcy4XbkSvgk Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2337a54a7354465a94bb852ae6d2bfa", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: f68ec757806b40e09b1f8bcd8a9cf1f4 Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: {"resize": {"flavorRef": "ad140633-c29a-45fd-a378-9823e61b496e"}} Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: exception: Flavor ad140633-c29a-45fd-a378-9823e61b496e could not be found. Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '21bc4c3b-1719-49a7-8c12-491eab05e3ba', 'body': {'resize': {'flavorRef': 'ad140633-c29a-45fd-a378-9823e61b496e'}}} Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 15:29:42.455283 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ad140633-c29a-45fd-a378-9823e61b496e could not be found. Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor ad140633-c29a-45fd-a378-9823e61b496e could not be found. Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ad140633-c29a-45fd-a378-9823e61b496e could not be found. Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Returning 400 to user: Flavor ad140633-c29a-45fd-a378-9823e61b496e could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f2dc052d-c736-48e4-9e5f-cd58dd41ba03 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "POST /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba/action" status: 400 len: 107 microversion: 2.1 time: 0.088270 Aug 09 15:29:42.463360 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3450/6911] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:29:42 2022] POST /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba/action => generated 107 bytes in 90 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:29:42.470216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1c121edd-5653-497b-b66b-1177c7b7c19a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:42.471050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1c121edd-5653-497b-b66b-1177c7b7c19a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:42.479339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c121edd-5653-497b-b66b-1177c7b7c19a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:42.479830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c121edd-5653-497b-b66b-1177c7b7c19a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:42.480262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c121edd-5653-497b-b66b-1177c7b7c19a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:42.480976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c121edd-5653-497b-b66b-1177c7b7c19a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:42.481420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c121edd-5653-497b-b66b-1177c7b7c19a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:42.482209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1c121edd-5653-497b-b66b-1177c7b7c19a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:42.632516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1c121edd-5653-497b-b66b-1177c7b7c19a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:42.642265 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1c121edd-5653-497b-b66b-1177c7b7c19a tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1507 microversion: 2.1 time: 0.176697 Aug 09 15:29:42.643025 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3462/6912] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:42 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:42.668278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b705136e-4e04-42ed-bc8e-a814b96bcf93 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:42.669757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b705136e-4e04-42ed-bc8e-a814b96bcf93 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:42.677550 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b705136e-4e04-42ed-bc8e-a814b96bcf93 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:42.678145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b705136e-4e04-42ed-bc8e-a814b96bcf93 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:42.678675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b705136e-4e04-42ed-bc8e-a814b96bcf93 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:42.679553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b705136e-4e04-42ed-bc8e-a814b96bcf93 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:42.680053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b705136e-4e04-42ed-bc8e-a814b96bcf93 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:42.680593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b705136e-4e04-42ed-bc8e-a814b96bcf93 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:42.838353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b705136e-4e04-42ed-bc8e-a814b96bcf93 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:42.853174 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b705136e-4e04-42ed-bc8e-a814b96bcf93 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1507 microversion: 2.1 time: 0.190225 Aug 09 15:29:42.854205 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3451/6913] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:42 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1507 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:29:42.887465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc1e0344-d0c3-4eca-93f2-e84208335e76 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc1e0344-d0c3-4eca-93f2-e84208335e76 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Request method failure captured: Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: request: POST /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba/action HTTP/1.1 Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 29 Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n1LJgDk3pJjpd8HDUXJg9JzTccIisLRwsbVj-ks9DV9UmoHGMIjN3_l5frIteSRoKW4MIveUNYUemK8w_SnvwaVnsjXBcOJZsNMnC7dAoyLIdCdixXNthOeZFiTwe5e59emokRGmrDEc0f2JEY24crUJRtH5yc7uOTBwcy4XbkSvgk Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2337a54a7354465a94bb852ae6d2bfa", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f68ec757806b40e09b1f8bcd8a9cf1f4 Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: {"resize": {"flavorRef": ""}} Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '21bc4c3b-1719-49a7-8c12-491eab05e3ba', 'body': {'resize': {'flavorRef': ''}}} Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise error Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi '' Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:42.892422 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:42.901188 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:42.901188 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:42.901188 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:42.901188 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:42.901188 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 15:29:42.901188 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 15:29:42.901188 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 09 15:29:42.901188 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:42.901188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bc1e0344-d0c3-4eca-93f2-e84208335e76 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:42.901188 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bc1e0344-d0c3-4eca-93f2-e84208335e76 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "POST /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba/action" status: 400 len: 113 microversion: 2.1 time: 0.011354 Aug 09 15:29:42.901188 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3463/6914] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:29:42 2022] POST /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba/action => generated 113 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 15:29:42.910196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-63edb3d8-0006-49db-81c0-d14d7b9113c3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:42.911363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-63edb3d8-0006-49db-81c0-d14d7b9113c3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:42.921872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63edb3d8-0006-49db-81c0-d14d7b9113c3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:42.922788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63edb3d8-0006-49db-81c0-d14d7b9113c3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:42.923629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63edb3d8-0006-49db-81c0-d14d7b9113c3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:42.924889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63edb3d8-0006-49db-81c0-d14d7b9113c3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:42.925756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63edb3d8-0006-49db-81c0-d14d7b9113c3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:42.926547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-63edb3d8-0006-49db-81c0-d14d7b9113c3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:43.109589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-63edb3d8-0006-49db-81c0-d14d7b9113c3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:43.118272 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-63edb3d8-0006-49db-81c0-d14d7b9113c3 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1507 microversion: 2.1 time: 0.215679 Aug 09 15:29:43.119079 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3452/6915] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:42 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:43.143239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e5aad4a8-e9ce-4741-b50c-a2c6a92e2b20 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:43.143743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e5aad4a8-e9ce-4741-b50c-a2c6a92e2b20 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:43.151497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5aad4a8-e9ce-4741-b50c-a2c6a92e2b20 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:43.151981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5aad4a8-e9ce-4741-b50c-a2c6a92e2b20 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:43.152411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5aad4a8-e9ce-4741-b50c-a2c6a92e2b20 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:43.153116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5aad4a8-e9ce-4741-b50c-a2c6a92e2b20 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:43.153563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5aad4a8-e9ce-4741-b50c-a2c6a92e2b20 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:43.153978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e5aad4a8-e9ce-4741-b50c-a2c6a92e2b20 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:43.170648 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-e5aad4a8-e9ce-4741-b50c-a2c6a92e2b20 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] HTTP exception thrown: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e5aad4a8-e9ce-4741-b50c-a2c6a92e2b20 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Request method failure captured: Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 HTTP/1.1 Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n1LJgDk3pJjpd8HDUXJg9JzTccIisLRwsbVj-ks9DV9UmoHGMIjN3_l5frIteSRoKW4MIveUNYUemK8w_SnvwaVnsjXBcOJZsNMnC7dAoyLIdCdixXNthOeZFiTwe5e59emokRGmrDEc0f2JEY24crUJRtH5yc7uOTBwcy4XbkSvgk Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2337a54a7354465a94bb852ae6d2bfa", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f68ec757806b40e09b1f8bcd8a9cf1f4 Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '879a6f2e-250d-457d-a998-5690d2d788a4'} Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:43.172307 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e5aad4a8-e9ce-4741-b50c-a2c6a92e2b20 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Returning 404 to user: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e5aad4a8-e9ce-4741-b50c-a2c6a92e2b20 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "DELETE /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 404 len: 111 microversion: 2.1 time: 0.034771 Aug 09 15:29:43.178336 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3464/6916] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:29:43 2022] DELETE /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:29:43.189008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7b3b466-dc24-4231-869a-40f2c468ba98 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:43.190126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f7b3b466-dc24-4231-869a-40f2c468ba98 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 879a6f2e-250d-457d-a998-5690d2d788a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:43.200948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7b3b466-dc24-4231-869a-40f2c468ba98 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:43.201768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7b3b466-dc24-4231-869a-40f2c468ba98 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:43.202530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7b3b466-dc24-4231-869a-40f2c468ba98 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:43.203855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7b3b466-dc24-4231-869a-40f2c468ba98 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:43.204682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7b3b466-dc24-4231-869a-40f2c468ba98 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:43.205468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7b3b466-dc24-4231-869a-40f2c468ba98 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:43.604154 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-f7b3b466-dc24-4231-869a-40f2c468ba98 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] HTTP exception thrown: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7b3b466-dc24-4231-869a-40f2c468ba98 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Request method failure captured: Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 HTTP/1.1 Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8n1LJgDk3pJjpd8HDUXJg9JzTccIisLRwsbVj-ks9DV9UmoHGMIjN3_l5frIteSRoKW4MIveUNYUemK8w_SnvwaVnsjXBcOJZsNMnC7dAoyLIdCdixXNthOeZFiTwe5e59emokRGmrDEc0f2JEY24crUJRtH5yc7uOTBwcy4XbkSvgk Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2337a54a7354465a94bb852ae6d2bfa", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: f68ec757806b40e09b1f8bcd8a9cf1f4 Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '879a6f2e-250d-457d-a998-5690d2d788a4'} Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:43.605776 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:43.612959 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:43.612959 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:43.612959 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:43.612959 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:43.612959 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:43.612959 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. Aug 09 15:29:43.612959 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:29:43.612959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7b3b466-dc24-4231-869a-40f2c468ba98 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Returning 404 to user: Instance 879a6f2e-250d-457d-a998-5690d2d788a4 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:43.612959 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f7b3b466-dc24-4231-869a-40f2c468ba98 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4" status: 404 len: 111 microversion: 2.1 time: 0.425718 Aug 09 15:29:43.612959 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3453/6917] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:43 2022] GET /compute/v2.1/servers/879a6f2e-250d-457d-a998-5690d2d788a4 => generated 111 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:29:43.617085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-823fe62c-0bd6-444d-ac69-b0edc5264ebd tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:43.617590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-823fe62c-0bd6-444d-ac69-b0edc5264ebd tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:43.624472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-823fe62c-0bd6-444d-ac69-b0edc5264ebd tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:43.624995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-823fe62c-0bd6-444d-ac69-b0edc5264ebd tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:43.625435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-823fe62c-0bd6-444d-ac69-b0edc5264ebd tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:43.626169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-823fe62c-0bd6-444d-ac69-b0edc5264ebd tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:43.626621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-823fe62c-0bd6-444d-ac69-b0edc5264ebd tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:43.627044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-823fe62c-0bd6-444d-ac69-b0edc5264ebd tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:43.655906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-823fe62c-0bd6-444d-ac69-b0edc5264ebd tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:29:43.767492 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-823fe62c-0bd6-444d-ac69-b0edc5264ebd tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "DELETE /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 204 len: 0 microversion: 2.1 time: 0.153148 Aug 09 15:29:43.768705 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3465/6918] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:29:43 2022] DELETE /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 15:29:43.782303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c1b7e146-1cbc-421b-a8bb-e6491c43bd5b tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:43.783150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c1b7e146-1cbc-421b-a8bb-e6491c43bd5b tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:43.792337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1b7e146-1cbc-421b-a8bb-e6491c43bd5b tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:43.793046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1b7e146-1cbc-421b-a8bb-e6491c43bd5b tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:43.793576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1b7e146-1cbc-421b-a8bb-e6491c43bd5b tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:43.794381 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1b7e146-1cbc-421b-a8bb-e6491c43bd5b tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:43.794942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1b7e146-1cbc-421b-a8bb-e6491c43bd5b tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:43.795456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1b7e146-1cbc-421b-a8bb-e6491c43bd5b tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:43.973387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c1b7e146-1cbc-421b-a8bb-e6491c43bd5b tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:43.982755 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c1b7e146-1cbc-421b-a8bb-e6491c43bd5b tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1513 microversion: 2.1 time: 0.206690 Aug 09 15:29:43.983493 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3454/6919] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:43 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:29:45.014438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1ebdddd-3333-416c-a095-7e945116c930 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:45.015186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1ebdddd-3333-416c-a095-7e945116c930 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:45.023513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1ebdddd-3333-416c-a095-7e945116c930 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:45.024018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1ebdddd-3333-416c-a095-7e945116c930 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:45.024465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1ebdddd-3333-416c-a095-7e945116c930 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:45.025196 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1ebdddd-3333-416c-a095-7e945116c930 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:45.025655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1ebdddd-3333-416c-a095-7e945116c930 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:45.026107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1ebdddd-3333-416c-a095-7e945116c930 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:45.205391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1ebdddd-3333-416c-a095-7e945116c930 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f68ec757806b40e09b1f8bcd8a9cf1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2337a54a7354465a94bb852ae6d2bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:29:45.223421 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1ebdddd-3333-416c-a095-7e945116c930 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 200 len: 1513 microversion: 2.1 time: 0.213617 Aug 09 15:29:45.224556 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3466/6920] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:45 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:29:45.770195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-25f96b91-2b52-4e35-bca4-dcf31bfa0134 req-0c00b169-570a-42fa-8dc7-11eb57ffe77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21bc4c3b-1719-49a7-8c12-491eab05e3ba", "name": "network-vif-deleted", "tag": "1372e011-35ee-4d92-ad12-068df75b2c0a"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:29:45.789907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-25f96b91-2b52-4e35-bca4-dcf31bfa0134 req-0c00b169-570a-42fa-8dc7-11eb57ffe77f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:45.790792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-25f96b91-2b52-4e35-bca4-dcf31bfa0134 req-0c00b169-570a-42fa-8dc7-11eb57ffe77f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:45.791650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-25f96b91-2b52-4e35-bca4-dcf31bfa0134 req-0c00b169-570a-42fa-8dc7-11eb57ffe77f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:45.811333 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-25f96b91-2b52-4e35-bca4-dcf31bfa0134 req-0c00b169-570a-42fa-8dc7-11eb57ffe77f service nova] Creating event network-vif-deleted:1372e011-35ee-4d92-ad12-068df75b2c0a for instance 21bc4c3b-1719-49a7-8c12-491eab05e3ba on n-h1-844626-8 Aug 09 15:29:45.819904 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-25f96b91-2b52-4e35-bca4-dcf31bfa0134 req-0c00b169-570a-42fa-8dc7-11eb57ffe77f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056937 Aug 09 15:29:45.820957 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3455/6921] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:29:46.256978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-748bf41e-1126-4f33-89ea-35d47decfc87 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:29:46.257755 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-748bf41e-1126-4f33-89ea-35d47decfc87 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] [instance: 21bc4c3b-1719-49a7-8c12-491eab05e3ba] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:29:46.266934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-748bf41e-1126-4f33-89ea-35d47decfc87 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:46.267527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-748bf41e-1126-4f33-89ea-35d47decfc87 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:46.267894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-748bf41e-1126-4f33-89ea-35d47decfc87 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:46.268606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-748bf41e-1126-4f33-89ea-35d47decfc87 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:29:46.269079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-748bf41e-1126-4f33-89ea-35d47decfc87 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:29:46.269499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-748bf41e-1126-4f33-89ea-35d47decfc87 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:29:46.274185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:29:46.287715 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-748bf41e-1126-4f33-89ea-35d47decfc87 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] HTTP exception thrown: Instance 21bc4c3b-1719-49a7-8c12-491eab05e3ba could not be found. Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-748bf41e-1126-4f33-89ea-35d47decfc87 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Request method failure captured: Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba HTTP/1.1 Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n1LJgDk3pJjpd8HDUXJg9JzTccIisLRwsbVj-ks9DV9UmoHGMIjN3_l5frIteSRoKW4MIveUNYUemK8w_SnvwaVnsjXBcOJZsNMnC7dAoyLIdCdixXNthOeZFiTwe5e59emokRGmrDEc0f2JEY24crUJRtH5yc7uOTBwcy4XbkSvgk Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_d2337a54a7354465a94bb852ae6d2bfa", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/d2337a54a7354465a94bb852ae6d2bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: d2337a54a7354465a94bb852ae6d2bfa Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1874154218 Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: f68ec757806b40e09b1f8bcd8a9cf1f4 Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-ServersNegativeTestJSON-1874154218-project Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 21bc4c3b-1719-49a7-8c12-491eab05e3ba could not be found. Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '21bc4c3b-1719-49a7-8c12-491eab05e3ba'} Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21bc4c3b-1719-49a7-8c12-491eab05e3ba could not be found. Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21bc4c3b-1719-49a7-8c12-491eab05e3ba could not be found. Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:29:46.289460 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:46.295947 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:29:46.295947 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:29:46.295947 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:29:46.295947 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:29:46.295947 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:29:46.295947 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21bc4c3b-1719-49a7-8c12-491eab05e3ba could not be found. Aug 09 15:29:46.295947 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:29:46.295947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-748bf41e-1126-4f33-89ea-35d47decfc87 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] Returning 404 to user: Instance 21bc4c3b-1719-49a7-8c12-491eab05e3ba could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:29:46.295947 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-748bf41e-1126-4f33-89ea-35d47decfc87 tempest-ServersNegativeTestJSON-1874154218 tempest-ServersNegativeTestJSON-1874154218-project] 10.222.0.50 "GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba" status: 404 len: 111 microversion: 2.1 time: 0.038857 Aug 09 15:29:46.295947 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3467/6922] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:29:46 2022] GET /compute/v2.1/servers/21bc4c3b-1719-49a7-8c12-491eab05e3ba => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:30:29.988978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:30:29.990156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=24 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:30:30.277837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b4285d6-161d-4b31-bb8d-91230289e01e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Action: 'create', calling method: .version_select at 0x7f41dda89280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2129839002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1CoiGc4Wk06XTtl8dMcGosoX5mal/A4E+8aCgpaCGrj1/4fDlNd4TQA7qWmkCS2VhI3/fQAGmHqpYmreVkztTOKKxcmoJKBzP8MToViDcDHp7z8Gy7iFP+Ln+cuM9rtw=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:30:30.315013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-0b4285d6-161d-4b31-bb8d-91230289e01e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Getting quotas for project 59dd4aa3e7c044b4af3d5613b3e99555. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:30:30.326145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-0b4285d6-161d-4b31-bb8d-91230289e01e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Getting quotas for user bf6f25bb68d04f8e8c2a90c0f8411690 and project 59dd4aa3e7c044b4af3d5613b3e99555. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:30:30.366922 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b4285d6-161d-4b31-bb8d-91230289e01e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.386689 Aug 09 15:30:30.367891 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3456/6923] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:30:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:30:30.442419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1926843436", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2129839002", "networks": [{"uuid": "170151ed-b995-47f1-8358-39fcbab1dc55"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:30:30.457663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:30:30.524037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] validate_networks() for [('170151ed-b995-47f1-8358-39fcbab1dc55', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:30:31.250849 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:30:31.251740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:30:31.253116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:30:31.254292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:30:31.255352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:30:31.278048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:31.279135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:31.280012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:31.281492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:31.282397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:31.283297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:31.316416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Getting quotas for project 59dd4aa3e7c044b4af3d5613b3e99555. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:30:31.323953 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Getting quotas for user bf6f25bb68d04f8e8c2a90c0f8411690 and project 59dd4aa3e7c044b4af3d5613b3e99555. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:30:31.344280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:30:31.347020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:30:31.416186 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b5ea9d4e-81a2-409e-a9f8-badfa4123b4d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980295 Aug 09 15:30:31.417932 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3468/6924] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:30:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:30:31.434781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-762911e1-e0e3-4349-8b96-5daf21022a0c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:31.437793 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-762911e1-e0e3-4349-8b96-5daf21022a0c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:31.532877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-762911e1-e0e3-4349-8b96-5daf21022a0c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:30:31.546787 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-762911e1-e0e3-4349-8b96-5daf21022a0c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1263 microversion: 2.1 time: 0.119381 Aug 09 15:30:31.548244 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3457/6925] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:30:31 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1263 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:30:32.585062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3f7ee3ec-bd1e-4ba7-ad3c-86d92d9f729b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:32.586235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3f7ee3ec-bd1e-4ba7-ad3c-86d92d9f729b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:32.595401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f7ee3ec-bd1e-4ba7-ad3c-86d92d9f729b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:32.596348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f7ee3ec-bd1e-4ba7-ad3c-86d92d9f729b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:32.596890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f7ee3ec-bd1e-4ba7-ad3c-86d92d9f729b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:32.597736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f7ee3ec-bd1e-4ba7-ad3c-86d92d9f729b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:32.598303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f7ee3ec-bd1e-4ba7-ad3c-86d92d9f729b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:32.598860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3f7ee3ec-bd1e-4ba7-ad3c-86d92d9f729b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:32.674841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3f7ee3ec-bd1e-4ba7-ad3c-86d92d9f729b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:30:32.683119 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3f7ee3ec-bd1e-4ba7-ad3c-86d92d9f729b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1315 microversion: 2.1 time: 0.105543 Aug 09 15:30:32.683742 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3469/6926] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:30:32 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1315 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:30:33.722258 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6c14efc4-7261-4312-88dc-2ad827298768 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:33.723458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6c14efc4-7261-4312-88dc-2ad827298768 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:33.746341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c14efc4-7261-4312-88dc-2ad827298768 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:33.748069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c14efc4-7261-4312-88dc-2ad827298768 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:33.749323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c14efc4-7261-4312-88dc-2ad827298768 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:33.751149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c14efc4-7261-4312-88dc-2ad827298768 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:33.752422 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c14efc4-7261-4312-88dc-2ad827298768 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:33.753327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6c14efc4-7261-4312-88dc-2ad827298768 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:33.875364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6c14efc4-7261-4312-88dc-2ad827298768 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:30:33.891527 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6c14efc4-7261-4312-88dc-2ad827298768 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1321 microversion: 2.1 time: 0.177162 Aug 09 15:30:33.893224 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3458/6927] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:30:33 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:30:34.930495 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4e5b923f-2a48-4a39-82c1-02bd0e133aca tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:34.931854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4e5b923f-2a48-4a39-82c1-02bd0e133aca tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:34.945476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e5b923f-2a48-4a39-82c1-02bd0e133aca tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:34.946105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e5b923f-2a48-4a39-82c1-02bd0e133aca tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:34.946634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e5b923f-2a48-4a39-82c1-02bd0e133aca tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:34.947565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e5b923f-2a48-4a39-82c1-02bd0e133aca tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:34.948184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e5b923f-2a48-4a39-82c1-02bd0e133aca tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:34.948824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4e5b923f-2a48-4a39-82c1-02bd0e133aca tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:35.080524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-45dabbdb-90ec-46d5-84db-6a45f953de55 req-bec7f111-fba5-4bdc-b155-774f9f1cbc51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d836179-f120-4a6f-a921-c233085a3c3a", "tag": "a9da2da4-a8e7-4510-a67d-89d7e303199f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:30:35.101693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-45dabbdb-90ec-46d5-84db-6a45f953de55 req-bec7f111-fba5-4bdc-b155-774f9f1cbc51 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:35.103239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-45dabbdb-90ec-46d5-84db-6a45f953de55 req-bec7f111-fba5-4bdc-b155-774f9f1cbc51 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:35.105311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-45dabbdb-90ec-46d5-84db-6a45f953de55 req-bec7f111-fba5-4bdc-b155-774f9f1cbc51 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:35.130402 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-45dabbdb-90ec-46d5-84db-6a45f953de55 req-bec7f111-fba5-4bdc-b155-774f9f1cbc51 service nova] Creating event network-changed:a9da2da4-a8e7-4510-a67d-89d7e303199f for instance 4d836179-f120-4a6f-a921-c233085a3c3a on n-h1-844626-8 Aug 09 15:30:35.142494 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-45dabbdb-90ec-46d5-84db-6a45f953de55 req-bec7f111-fba5-4bdc-b155-774f9f1cbc51 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071170 Aug 09 15:30:35.145998 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3459/6928] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:30:35.177679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4e5b923f-2a48-4a39-82c1-02bd0e133aca tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:30:35.196009 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4e5b923f-2a48-4a39-82c1-02bd0e133aca tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1363 microversion: 2.1 time: 0.273238 Aug 09 15:30:35.203384 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3470/6929] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:30:34 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:30:36.236723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ccfc4c9-779d-4edd-9875-c0ccf415957d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:36.237465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1ccfc4c9-779d-4edd-9875-c0ccf415957d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:36.244860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ccfc4c9-779d-4edd-9875-c0ccf415957d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:36.245372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ccfc4c9-779d-4edd-9875-c0ccf415957d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:36.245823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ccfc4c9-779d-4edd-9875-c0ccf415957d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:36.246577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ccfc4c9-779d-4edd-9875-c0ccf415957d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:36.247051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ccfc4c9-779d-4edd-9875-c0ccf415957d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:36.247517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ccfc4c9-779d-4edd-9875-c0ccf415957d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:36.456834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1ccfc4c9-779d-4edd-9875-c0ccf415957d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:30:36.465741 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1ccfc4c9-779d-4edd-9875-c0ccf415957d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1363 microversion: 2.1 time: 0.235094 Aug 09 15:30:36.466332 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3460/6930] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:30:36 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:30:37.489087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5fe1d316-31fe-4c5f-98d1-eb81bc7c5a47 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:37.489821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5fe1d316-31fe-4c5f-98d1-eb81bc7c5a47 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:37.497272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fe1d316-31fe-4c5f-98d1-eb81bc7c5a47 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:37.497766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fe1d316-31fe-4c5f-98d1-eb81bc7c5a47 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:37.498191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fe1d316-31fe-4c5f-98d1-eb81bc7c5a47 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:37.498899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fe1d316-31fe-4c5f-98d1-eb81bc7c5a47 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:37.499379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fe1d316-31fe-4c5f-98d1-eb81bc7c5a47 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:37.499803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fe1d316-31fe-4c5f-98d1-eb81bc7c5a47 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:37.658713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5fe1d316-31fe-4c5f-98d1-eb81bc7c5a47 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:30:37.670105 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5fe1d316-31fe-4c5f-98d1-eb81bc7c5a47 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1363 microversion: 2.1 time: 0.184931 Aug 09 15:30:37.679143 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3471/6931] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:30:37 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:30:38.702949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8f277cfe-bb95-4a3b-8e13-1d9dd1ff6368 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:38.703789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8f277cfe-bb95-4a3b-8e13-1d9dd1ff6368 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:38.711963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f277cfe-bb95-4a3b-8e13-1d9dd1ff6368 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:38.712616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f277cfe-bb95-4a3b-8e13-1d9dd1ff6368 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:38.713170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f277cfe-bb95-4a3b-8e13-1d9dd1ff6368 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:38.714055 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f277cfe-bb95-4a3b-8e13-1d9dd1ff6368 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:38.714621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f277cfe-bb95-4a3b-8e13-1d9dd1ff6368 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:38.715183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8f277cfe-bb95-4a3b-8e13-1d9dd1ff6368 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:38.885237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8f277cfe-bb95-4a3b-8e13-1d9dd1ff6368 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:30:38.894290 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8f277cfe-bb95-4a3b-8e13-1d9dd1ff6368 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1363 microversion: 2.1 time: 0.195829 Aug 09 15:30:38.894908 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3461/6932] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:30:38 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:30:39.865721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a29725e4-10b8-4c46-96a9-c5487893433d req-f4b1e126-9b96-45d3-bb78-36201e371da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d836179-f120-4a6f-a921-c233085a3c3a", "name": "network-vif-plugged", "status": "completed", "tag": "a9da2da4-a8e7-4510-a67d-89d7e303199f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:30:39.881499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a29725e4-10b8-4c46-96a9-c5487893433d req-f4b1e126-9b96-45d3-bb78-36201e371da3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:39.882364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a29725e4-10b8-4c46-96a9-c5487893433d req-f4b1e126-9b96-45d3-bb78-36201e371da3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:39.883262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a29725e4-10b8-4c46-96a9-c5487893433d req-f4b1e126-9b96-45d3-bb78-36201e371da3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:39.903442 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a29725e4-10b8-4c46-96a9-c5487893433d req-f4b1e126-9b96-45d3-bb78-36201e371da3 service nova] Creating event network-vif-plugged:a9da2da4-a8e7-4510-a67d-89d7e303199f for instance 4d836179-f120-4a6f-a921-c233085a3c3a on n-h1-844626-8 Aug 09 15:30:39.910133 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a29725e4-10b8-4c46-96a9-c5487893433d req-f4b1e126-9b96-45d3-bb78-36201e371da3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049127 Aug 09 15:30:39.911269 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3472/6933] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:30:39.917291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-30b51fc1-c5ef-424d-bad5-18ae38d9e210 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:39.918269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-30b51fc1-c5ef-424d-bad5-18ae38d9e210 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:39.938443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30b51fc1-c5ef-424d-bad5-18ae38d9e210 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:39.939552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30b51fc1-c5ef-424d-bad5-18ae38d9e210 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:39.941205 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30b51fc1-c5ef-424d-bad5-18ae38d9e210 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:39.942208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30b51fc1-c5ef-424d-bad5-18ae38d9e210 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:39.942821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30b51fc1-c5ef-424d-bad5-18ae38d9e210 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:39.943460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-30b51fc1-c5ef-424d-bad5-18ae38d9e210 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:40.166361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-30b51fc1-c5ef-424d-bad5-18ae38d9e210 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:30:40.175216 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-30b51fc1-c5ef-424d-bad5-18ae38d9e210 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1363 microversion: 2.1 time: 0.262314 Aug 09 15:30:40.175938 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3462/6934] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:30:39 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:30:41.205596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b7d85f37-1ff8-4213-907b-a73defc2da0b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:41.206841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b7d85f37-1ff8-4213-907b-a73defc2da0b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:41.214873 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7d85f37-1ff8-4213-907b-a73defc2da0b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:41.215492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7d85f37-1ff8-4213-907b-a73defc2da0b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:41.216168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7d85f37-1ff8-4213-907b-a73defc2da0b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:41.217278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7d85f37-1ff8-4213-907b-a73defc2da0b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:41.217916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7d85f37-1ff8-4213-907b-a73defc2da0b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:41.218497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b7d85f37-1ff8-4213-907b-a73defc2da0b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:41.301094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:30:41.337125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:30:41.374410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b7d85f37-1ff8-4213-907b-a73defc2da0b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:30:41.383166 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b7d85f37-1ff8-4213-907b-a73defc2da0b tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1555 microversion: 2.1 time: 0.186925 Aug 09 15:30:41.383768 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3473/6935] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:30:41 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1555 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:30:41.405279 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-26bee58a-0a46-4287-98fd-a6ad294d3de4 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:41.406253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-26bee58a-0a46-4287-98fd-a6ad294d3de4 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:41.414123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26bee58a-0a46-4287-98fd-a6ad294d3de4 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:41.414614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26bee58a-0a46-4287-98fd-a6ad294d3de4 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:41.415065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26bee58a-0a46-4287-98fd-a6ad294d3de4 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:41.415835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26bee58a-0a46-4287-98fd-a6ad294d3de4 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:41.416297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26bee58a-0a46-4287-98fd-a6ad294d3de4 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:41.416714 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26bee58a-0a46-4287-98fd-a6ad294d3de4 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:41.540360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:30:41.576027 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-26bee58a-0a46-4287-98fd-a6ad294d3de4 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:30:41.584961 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-26bee58a-0a46-4287-98fd-a6ad294d3de4 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1555 microversion: 2.1 time: 0.184073 Aug 09 15:30:41.585744 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3463/6936] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:30:41 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:30:43.345067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6bace147-c46d-43de-8078-dfbe84bdb1b9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38e22e8d-a927-485d-91ea-056b01def67f"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:30:43.349859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6bace147-c46d-43de-8078-dfbe84bdb1b9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:43.362292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bace147-c46d-43de-8078-dfbe84bdb1b9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:43.363059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bace147-c46d-43de-8078-dfbe84bdb1b9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:43.363864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bace147-c46d-43de-8078-dfbe84bdb1b9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:43.366092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bace147-c46d-43de-8078-dfbe84bdb1b9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:43.366092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bace147-c46d-43de-8078-dfbe84bdb1b9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:43.366585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6bace147-c46d-43de-8078-dfbe84bdb1b9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:43.673647 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6bace147-c46d-43de-8078-dfbe84bdb1b9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "POST /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336503 Aug 09 15:30:43.674527 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3474/6937] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 15:30:43 2022] POST /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:30:55.737461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7bc8421d-d4a9-4782-adb4-896a6c4b0452 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:55.738125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7bc8421d-d4a9-4782-adb4-896a6c4b0452 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:55.741021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:30:55.742035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=32 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:30:55.750035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bc8421d-d4a9-4782-adb4-896a6c4b0452 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:55.750692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bc8421d-d4a9-4782-adb4-896a6c4b0452 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:55.751335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bc8421d-d4a9-4782-adb4-896a6c4b0452 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:55.752414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bc8421d-d4a9-4782-adb4-896a6c4b0452 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:55.753015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bc8421d-d4a9-4782-adb4-896a6c4b0452 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:55.753503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bc8421d-d4a9-4782-adb4-896a6c4b0452 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:55.851601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-7bc8421d-d4a9-4782-adb4-896a6c4b0452 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lazy-loading 'services' on Instance uuid 4d836179-f120-4a6f-a921-c233085a3c3a {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:30:55.937778 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7bc8421d-d4a9-4782-adb4-896a6c4b0452 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments/38e22e8d-a927-485d-91ea-056b01def67f" status: 202 len: 0 microversion: 2.1 time: 0.203896 Aug 09 15:30:55.938714 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3464/6938] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:30:55 2022] DELETE /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments/38e22e8d-a927-485d-91ea-056b01def67f => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:30:55.946545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:30:55.947419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:30:55.952352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-347ba291-f0ec-4974-a921-48237ab5d8c3 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:55.954847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-347ba291-f0ec-4974-a921-48237ab5d8c3 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:55.963577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347ba291-f0ec-4974-a921-48237ab5d8c3 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:55.964033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347ba291-f0ec-4974-a921-48237ab5d8c3 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:55.964810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347ba291-f0ec-4974-a921-48237ab5d8c3 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:55.965568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347ba291-f0ec-4974-a921-48237ab5d8c3 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:55.966632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347ba291-f0ec-4974-a921-48237ab5d8c3 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:55.967142 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-347ba291-f0ec-4974-a921-48237ab5d8c3 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:56.012472 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-347ba291-f0ec-4974-a921-48237ab5d8c3 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067851 Aug 09 15:30:56.017462 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3475/6939] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:30:55 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:30:57.028660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d70c1035-bf47-48c4-90f7-11bc0c830f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:57.032332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d70c1035-bf47-48c4-90f7-11bc0c830f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:57.041845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d70c1035-bf47-48c4-90f7-11bc0c830f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:57.042535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d70c1035-bf47-48c4-90f7-11bc0c830f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:57.043151 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d70c1035-bf47-48c4-90f7-11bc0c830f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:57.044003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d70c1035-bf47-48c4-90f7-11bc0c830f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:57.044539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d70c1035-bf47-48c4-90f7-11bc0c830f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:57.046216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d70c1035-bf47-48c4-90f7-11bc0c830f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:57.084334 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d70c1035-bf47-48c4-90f7-11bc0c830f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062297 Aug 09 15:30:57.085053 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3465/6940] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:30:57 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:30:58.098650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21395800-c2f3-4c3f-9d0a-4b6ac0073d80 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:58.101179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-21395800-c2f3-4c3f-9d0a-4b6ac0073d80 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:58.109378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21395800-c2f3-4c3f-9d0a-4b6ac0073d80 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:58.109860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21395800-c2f3-4c3f-9d0a-4b6ac0073d80 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:58.110305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21395800-c2f3-4c3f-9d0a-4b6ac0073d80 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:58.111055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21395800-c2f3-4c3f-9d0a-4b6ac0073d80 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:58.111553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21395800-c2f3-4c3f-9d0a-4b6ac0073d80 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:58.111981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21395800-c2f3-4c3f-9d0a-4b6ac0073d80 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:58.148822 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-21395800-c2f3-4c3f-9d0a-4b6ac0073d80 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054865 Aug 09 15:30:58.149470 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3476/6941] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:30:58 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:30:59.162229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-221492be-3f71-4157-9a30-d4e9edef0910 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:30:59.165283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-221492be-3f71-4157-9a30-d4e9edef0910 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:30:59.173770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-221492be-3f71-4157-9a30-d4e9edef0910 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:59.174398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-221492be-3f71-4157-9a30-d4e9edef0910 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:59.174859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-221492be-3f71-4157-9a30-d4e9edef0910 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:59.175644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-221492be-3f71-4157-9a30-d4e9edef0910 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:30:59.176112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-221492be-3f71-4157-9a30-d4e9edef0910 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:30:59.176560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-221492be-3f71-4157-9a30-d4e9edef0910 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:30:59.212735 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-221492be-3f71-4157-9a30-d4e9edef0910 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054635 Aug 09 15:30:59.213474 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3466/6942] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:30:59 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:31:00.228949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-957cb0da-05af-4db9-8ac3-fb6202d40996 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:00.231531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-957cb0da-05af-4db9-8ac3-fb6202d40996 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:00.240715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-957cb0da-05af-4db9-8ac3-fb6202d40996 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:00.241498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-957cb0da-05af-4db9-8ac3-fb6202d40996 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:00.242113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-957cb0da-05af-4db9-8ac3-fb6202d40996 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:00.243345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-957cb0da-05af-4db9-8ac3-fb6202d40996 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:00.244090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-957cb0da-05af-4db9-8ac3-fb6202d40996 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:00.244774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-957cb0da-05af-4db9-8ac3-fb6202d40996 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:00.299703 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-957cb0da-05af-4db9-8ac3-fb6202d40996 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075279 Aug 09 15:31:00.300532 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3477/6943] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:31:00 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:31:01.313896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-13f5e2f7-5dba-4bfa-bad9-48551147d7fd tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:01.316700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-13f5e2f7-5dba-4bfa-bad9-48551147d7fd tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:01.327896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13f5e2f7-5dba-4bfa-bad9-48551147d7fd tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:01.328875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13f5e2f7-5dba-4bfa-bad9-48551147d7fd tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:01.329681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13f5e2f7-5dba-4bfa-bad9-48551147d7fd tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:01.331044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13f5e2f7-5dba-4bfa-bad9-48551147d7fd tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:01.331925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13f5e2f7-5dba-4bfa-bad9-48551147d7fd tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:01.332667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-13f5e2f7-5dba-4bfa-bad9-48551147d7fd tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:01.380903 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-13f5e2f7-5dba-4bfa-bad9-48551147d7fd tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072186 Aug 09 15:31:01.381575 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3467/6944] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:31:01 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:31:01.393520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bb9361fc-1ff7-400f-a303-e840972bc1aa tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:01.394183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bb9361fc-1ff7-400f-a303-e840972bc1aa tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:01.401528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb9361fc-1ff7-400f-a303-e840972bc1aa tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:01.402015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb9361fc-1ff7-400f-a303-e840972bc1aa tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:01.402448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb9361fc-1ff7-400f-a303-e840972bc1aa tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:01.403210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb9361fc-1ff7-400f-a303-e840972bc1aa tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:01.403679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb9361fc-1ff7-400f-a303-e840972bc1aa tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:01.404101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb9361fc-1ff7-400f-a303-e840972bc1aa tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:01.497358 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-bb9361fc-1ff7-400f-a303-e840972bc1aa tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] HTTP exception thrown: Instance 4d836179-f120-4a6f-a921-c233085a3c3a is not attached to volume 38e22e8d-a927-485d-91ea-056b01def67f Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bb9361fc-1ff7-400f-a303-e840972bc1aa tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Request method failure captured: Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments/38e22e8d-a927-485d-91ea-056b01def67f HTTP/1.1 Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n2O-gDYLSt6VQJmWOvQr0m0Zb4DqeuCFMAOlW7erNvbS6QVdD3-tNnhD_rywcHNsNxByWhCUKrZhv_2k0jRVvPE83ZpRitFdMnoP30zbzFhfKXZU6MovsRp3MHo4gI2XrTJzJ5cPYaP8fvNZb3S6wpqSaluV_W47nKyfOM9DiX7XEo Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 59dd4aa3e7c044b4af3d5613b3e99555 Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_59dd4aa3e7c044b4af3d5613b3e99555", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 59dd4aa3e7c044b4af3d5613b3e99555 Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestEncryptedCinderVolumes-59367429-project Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: bf6f25bb68d04f8e8c2a90c0f8411690 Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestEncryptedCinderVolumes-59367429-project Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 4d836179-f120-4a6f-a921-c233085a3c3a is not attached to volume 38e22e8d-a927-485d-91ea-056b01def67f Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'server_id': '4d836179-f120-4a6f-a921-c233085a3c3a', 'id': '38e22e8d-a927-485d-91ea-056b01def67f'} Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 38e22e8d-a927-485d-91ea-056b01def67f. Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d836179-f120-4a6f-a921-c233085a3c3a is not attached to volume 38e22e8d-a927-485d-91ea-056b01def67f Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:31:01.509639 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:31:01.517374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:31:01.517374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:31:01.517374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d836179-f120-4a6f-a921-c233085a3c3a is not attached to volume 38e22e8d-a927-485d-91ea-056b01def67f Aug 09 15:31:01.517374 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:01.517374 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bb9361fc-1ff7-400f-a303-e840972bc1aa tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Returning 404 to user: Instance 4d836179-f120-4a6f-a921-c233085a3c3a is not attached to volume 38e22e8d-a927-485d-91ea-056b01def67f {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:31:01.517374 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bb9361fc-1ff7-400f-a303-e840972bc1aa tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments/38e22e8d-a927-485d-91ea-056b01def67f" status: 404 len: 154 microversion: 2.1 time: 0.122148 Aug 09 15:31:01.517374 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3478/6945] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:31:01 2022] DELETE /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a/os-volume_attachments/38e22e8d-a927-485d-91ea-056b01def67f => generated 154 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:31:06.023999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-538eb899-a093-4862-8d40-04e118665187 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:06.025023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-538eb899-a093-4862-8d40-04e118665187 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:06.040453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-538eb899-a093-4862-8d40-04e118665187 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:06.041268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-538eb899-a093-4862-8d40-04e118665187 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:06.042089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-538eb899-a093-4862-8d40-04e118665187 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:06.043467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-538eb899-a093-4862-8d40-04e118665187 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:06.044367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-538eb899-a093-4862-8d40-04e118665187 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:06.045203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-538eb899-a093-4862-8d40-04e118665187 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:06.081721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-538eb899-a093-4862-8d40-04e118665187 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:31:06.196908 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-538eb899-a093-4862-8d40-04e118665187 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 204 len: 0 microversion: 2.1 time: 0.177948 Aug 09 15:31:06.197980 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3468/6946] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:31:06 2022] DELETE /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:31:06.211304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-52d59475-10c2-4c73-aa16-59f4d5d8ecf5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:06.212551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-52d59475-10c2-4c73-aa16-59f4d5d8ecf5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:06.227494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52d59475-10c2-4c73-aa16-59f4d5d8ecf5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:06.228570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52d59475-10c2-4c73-aa16-59f4d5d8ecf5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:06.229501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52d59475-10c2-4c73-aa16-59f4d5d8ecf5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:06.231030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52d59475-10c2-4c73-aa16-59f4d5d8ecf5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:06.232225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52d59475-10c2-4c73-aa16-59f4d5d8ecf5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:06.232986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-52d59475-10c2-4c73-aa16-59f4d5d8ecf5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:06.449633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-52d59475-10c2-4c73-aa16-59f4d5d8ecf5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:06.460420 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-52d59475-10c2-4c73-aa16-59f4d5d8ecf5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1561 microversion: 2.1 time: 0.256732 Aug 09 15:31:06.461040 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3479/6947] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:06 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1561 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:07.497445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-05291002-327c-402a-ae5b-5e78879633f9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:07.498611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-05291002-327c-402a-ae5b-5e78879633f9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:07.509090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05291002-327c-402a-ae5b-5e78879633f9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:07.509970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05291002-327c-402a-ae5b-5e78879633f9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:07.510781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05291002-327c-402a-ae5b-5e78879633f9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:07.512138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05291002-327c-402a-ae5b-5e78879633f9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:07.512976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05291002-327c-402a-ae5b-5e78879633f9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:07.513855 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-05291002-327c-402a-ae5b-5e78879633f9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:07.699263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-05291002-327c-402a-ae5b-5e78879633f9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:07.708435 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-05291002-327c-402a-ae5b-5e78879633f9 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1561 microversion: 2.1 time: 0.215918 Aug 09 15:31:07.709049 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3469/6948] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:07 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1561 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:31:08.324819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-f354381c-5be3-44e4-98f4-a6f8df4fd03d req-5ebe22d7-96c4-4858-9f37-7d034515b165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d836179-f120-4a6f-a921-c233085a3c3a", "name": "network-vif-deleted", "tag": "a9da2da4-a8e7-4510-a67d-89d7e303199f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:31:08.337694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f354381c-5be3-44e4-98f4-a6f8df4fd03d req-5ebe22d7-96c4-4858-9f37-7d034515b165 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:08.338322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f354381c-5be3-44e4-98f4-a6f8df4fd03d req-5ebe22d7-96c4-4858-9f37-7d034515b165 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:08.338707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-f354381c-5be3-44e4-98f4-a6f8df4fd03d req-5ebe22d7-96c4-4858-9f37-7d034515b165 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:08.354037 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-f354381c-5be3-44e4-98f4-a6f8df4fd03d req-5ebe22d7-96c4-4858-9f37-7d034515b165 service nova] Creating event network-vif-deleted:a9da2da4-a8e7-4510-a67d-89d7e303199f for instance 4d836179-f120-4a6f-a921-c233085a3c3a on n-h1-844626-8 Aug 09 15:31:08.361099 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-f354381c-5be3-44e4-98f4-a6f8df4fd03d req-5ebe22d7-96c4-4858-9f37-7d034515b165 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039450 Aug 09 15:31:08.361858 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3480/6949] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:31:08.740307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:08.742736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:08.761186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:08.762702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:08.764473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:08.765013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:08.767238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:08.768160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:08.822427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:08.822901 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:08.823645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:08.824367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lazy-loading 'fault' on Instance uuid 4d836179-f120-4a6f-a921-c233085a3c3a {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:31:08.888563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:08.898173 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0cfce3fb-5eee-4067-aa14-2714a3e7b363 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 200 len: 1353 microversion: 2.1 time: 0.170234 Aug 09 15:31:08.898788 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3470/6950] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:08 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 1353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:09.922185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36b1d4b1-9ad4-4da9-86a9-15db3542f774 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:09.923223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36b1d4b1-9ad4-4da9-86a9-15db3542f774 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 4d836179-f120-4a6f-a921-c233085a3c3a] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:09.930817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b1d4b1-9ad4-4da9-86a9-15db3542f774 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:09.931335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b1d4b1-9ad4-4da9-86a9-15db3542f774 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:09.931815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b1d4b1-9ad4-4da9-86a9-15db3542f774 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:09.932825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b1d4b1-9ad4-4da9-86a9-15db3542f774 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:09.933326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b1d4b1-9ad4-4da9-86a9-15db3542f774 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:09.933783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36b1d4b1-9ad4-4da9-86a9-15db3542f774 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:09.950984 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-36b1d4b1-9ad4-4da9-86a9-15db3542f774 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] HTTP exception thrown: Instance 4d836179-f120-4a6f-a921-c233085a3c3a could not be found. Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36b1d4b1-9ad4-4da9-86a9-15db3542f774 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Request method failure captured: Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a HTTP/1.1 Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n2O-gDYLSt6VQJmWOvQr0m0Zb4DqeuCFMAOlW7erNvbS6QVdD3-tNnhD_rywcHNsNxByWhCUKrZhv_2k0jRVvPE83ZpRitFdMnoP30zbzFhfKXZU6MovsRp3MHo4gI2XrTJzJ5cPYaP8fvNZb3S6wpqSaluV_W47nKyfOM9DiX7XEo Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 59dd4aa3e7c044b4af3d5613b3e99555 Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_59dd4aa3e7c044b4af3d5613b3e99555", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 59dd4aa3e7c044b4af3d5613b3e99555 Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestEncryptedCinderVolumes-59367429-project Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: bf6f25bb68d04f8e8c2a90c0f8411690 Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestEncryptedCinderVolumes-59367429-project Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 4d836179-f120-4a6f-a921-c233085a3c3a could not be found. Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '4d836179-f120-4a6f-a921-c233085a3c3a'} Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d836179-f120-4a6f-a921-c233085a3c3a could not be found. Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d836179-f120-4a6f-a921-c233085a3c3a could not be found. Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:31:09.953193 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:09.961463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:31:09.961463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:31:09.961463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:31:09.961463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:31:09.961463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:31:09.961463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d836179-f120-4a6f-a921-c233085a3c3a could not be found. Aug 09 15:31:09.961463 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:09.961463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36b1d4b1-9ad4-4da9-86a9-15db3542f774 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Returning 404 to user: Instance 4d836179-f120-4a6f-a921-c233085a3c3a could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:31:09.961463 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36b1d4b1-9ad4-4da9-86a9-15db3542f774 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a" status: 404 len: 111 microversion: 2.1 time: 0.038345 Aug 09 15:31:09.961463 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3481/6951] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:09 2022] GET /compute/v2.1/servers/4d836179-f120-4a6f-a921-c233085a3c3a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:31:09.968189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c8b7f6c1-a43b-4515-9d9a-69e8c1e12381 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '.version_select at 0x7f41dd0cd310>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:10.002553 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c8b7f6c1-a43b-4515-9d9a-69e8c1e12381 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2129839002" status: 202 len: 0 microversion: 2.1 time: 0.040352 Aug 09 15:31:10.002553 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3471/6952] 10.222.0.50 () {58 vars in 1278 bytes} [Tue Aug 9 15:31:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2129839002 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:31:10.027624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9325d6a2-9af2-4fb1-9864-68efcc982e7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Action: 'create', calling method: .version_select at 0x7f41dc8db9d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-169385919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpmpbl3Wz6Lz8XfUVPazrWvUEpaZxh7mxQt5Oo3XmW2n8FOdfHgVjcYJ9mAAnlSEyynSu5AyV0LL5iqwDQ78gSHLqdbW4uqKt0Cuhq+quKQAYqyNTS1JvDWZ7g4QeHOlw=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:31:10.054137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-9325d6a2-9af2-4fb1-9864-68efcc982e7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Getting quotas for project 59dd4aa3e7c044b4af3d5613b3e99555. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:31:10.067330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-9325d6a2-9af2-4fb1-9864-68efcc982e7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Getting quotas for user bf6f25bb68d04f8e8c2a90c0f8411690 and project 59dd4aa3e7c044b4af3d5613b3e99555. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:31:10.100112 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9325d6a2-9af2-4fb1-9864-68efcc982e7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.079866 Aug 09 15:31:10.100930 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3482/6953] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:31:10 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:31:10.155609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1186032972", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-169385919", "networks": [{"uuid": "170151ed-b995-47f1-8358-39fcbab1dc55"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:31:10.220451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] validate_networks() for [('170151ed-b995-47f1-8358-39fcbab1dc55', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:31:10.682399 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:31:10.682878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:31:10.683490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:31:10.683958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:31:10.684424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:31:10.695371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:10.695756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:10.696206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:10.697415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:10.698036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:10.698518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:10.728873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Getting quotas for project 59dd4aa3e7c044b4af3d5613b3e99555. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:31:10.735680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Getting quotas for user bf6f25bb68d04f8e8c2a90c0f8411690 and project 59dd4aa3e7c044b4af3d5613b3e99555. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:31:10.751202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:31:10.753624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:31:10.807790 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4ee4bf62-be3f-4a7b-8167-e11d9eef3b95 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656227 Aug 09 15:31:10.808971 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3472/6954] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:31:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:31:10.826826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3bb94af8-db1e-4765-bf59-d81175a8a314 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:10.827967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3bb94af8-db1e-4765-bf59-d81175a8a314 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:10.915493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3bb94af8-db1e-4765-bf59-d81175a8a314 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:10.925135 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3bb94af8-db1e-4765-bf59-d81175a8a314 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1262 microversion: 2.1 time: 0.106180 Aug 09 15:31:10.926128 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3483/6955] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:10 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1262 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:11.955697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d824af94-01bb-4b55-9227-76827164e0d6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:11.956514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d824af94-01bb-4b55-9227-76827164e0d6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:11.967869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d824af94-01bb-4b55-9227-76827164e0d6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:11.968767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d824af94-01bb-4b55-9227-76827164e0d6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:11.969646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d824af94-01bb-4b55-9227-76827164e0d6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:11.971271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d824af94-01bb-4b55-9227-76827164e0d6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:11.972131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d824af94-01bb-4b55-9227-76827164e0d6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:11.972931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d824af94-01bb-4b55-9227-76827164e0d6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:12.094583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d824af94-01bb-4b55-9227-76827164e0d6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:12.112217 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d824af94-01bb-4b55-9227-76827164e0d6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1322 microversion: 2.1 time: 0.162021 Aug 09 15:31:12.116657 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3473/6956] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:11 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:13.153277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-774c261e-ff70-468d-b6e9-a0da8d854380 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:13.154969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-774c261e-ff70-468d-b6e9-a0da8d854380 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:13.164546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-774c261e-ff70-468d-b6e9-a0da8d854380 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:13.165412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-774c261e-ff70-468d-b6e9-a0da8d854380 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:13.166092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-774c261e-ff70-468d-b6e9-a0da8d854380 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:13.167069 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-774c261e-ff70-468d-b6e9-a0da8d854380 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:13.167795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-774c261e-ff70-468d-b6e9-a0da8d854380 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:13.168429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-774c261e-ff70-468d-b6e9-a0da8d854380 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:13.340325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-774c261e-ff70-468d-b6e9-a0da8d854380 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:13.352603 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-774c261e-ff70-468d-b6e9-a0da8d854380 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1362 microversion: 2.1 time: 0.203165 Aug 09 15:31:13.353314 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3484/6957] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:13 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:31:13.752507 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-99180ddf-7de3-47e1-a9c1-457f6f183037 req-21b7154c-a5c7-4882-838f-fa9bbad5e063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b73123-783d-4110-8b8e-23064536af55", "tag": "c8a9021d-1747-44a6-90ca-14e34a14b015"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:31:13.778407 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-99180ddf-7de3-47e1-a9c1-457f6f183037 req-21b7154c-a5c7-4882-838f-fa9bbad5e063 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:13.778746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-99180ddf-7de3-47e1-a9c1-457f6f183037 req-21b7154c-a5c7-4882-838f-fa9bbad5e063 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:13.779934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-99180ddf-7de3-47e1-a9c1-457f6f183037 req-21b7154c-a5c7-4882-838f-fa9bbad5e063 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:13.819707 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-99180ddf-7de3-47e1-a9c1-457f6f183037 req-21b7154c-a5c7-4882-838f-fa9bbad5e063 service nova] Creating event network-changed:c8a9021d-1747-44a6-90ca-14e34a14b015 for instance 57b73123-783d-4110-8b8e-23064536af55 on n-h1-844626-8 Aug 09 15:31:13.827645 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-99180ddf-7de3-47e1-a9c1-457f6f183037 req-21b7154c-a5c7-4882-838f-fa9bbad5e063 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082230 Aug 09 15:31:13.829568 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3474/6958] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:31:14.389565 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b9f52a41-87da-48f3-a94f-cbc070c56e72 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:14.390401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b9f52a41-87da-48f3-a94f-cbc070c56e72 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:14.400487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9f52a41-87da-48f3-a94f-cbc070c56e72 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:14.401337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9f52a41-87da-48f3-a94f-cbc070c56e72 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:14.402097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9f52a41-87da-48f3-a94f-cbc070c56e72 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:14.403424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9f52a41-87da-48f3-a94f-cbc070c56e72 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:14.404368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9f52a41-87da-48f3-a94f-cbc070c56e72 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:14.405144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b9f52a41-87da-48f3-a94f-cbc070c56e72 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:14.580872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b9f52a41-87da-48f3-a94f-cbc070c56e72 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:14.589558 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b9f52a41-87da-48f3-a94f-cbc070c56e72 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1362 microversion: 2.1 time: 0.204003 Aug 09 15:31:14.590221 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3485/6959] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:14 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:15.612465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7fcfbae6-ab73-4cae-9860-172a02921dd5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:15.613195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7fcfbae6-ab73-4cae-9860-172a02921dd5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:15.620883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fcfbae6-ab73-4cae-9860-172a02921dd5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:15.621370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fcfbae6-ab73-4cae-9860-172a02921dd5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:15.621854 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fcfbae6-ab73-4cae-9860-172a02921dd5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:15.622705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fcfbae6-ab73-4cae-9860-172a02921dd5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:15.623252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fcfbae6-ab73-4cae-9860-172a02921dd5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:15.623630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7fcfbae6-ab73-4cae-9860-172a02921dd5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:15.776927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7fcfbae6-ab73-4cae-9860-172a02921dd5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:15.785849 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7fcfbae6-ab73-4cae-9860-172a02921dd5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1362 microversion: 2.1 time: 0.177966 Aug 09 15:31:15.786611 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3475/6960] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:15 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:16.809890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42d15872-c6d9-47bb-9251-b74a4d614f67 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:16.810706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-42d15872-c6d9-47bb-9251-b74a4d614f67 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:16.818272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42d15872-c6d9-47bb-9251-b74a4d614f67 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:16.818773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42d15872-c6d9-47bb-9251-b74a4d614f67 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:16.819267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42d15872-c6d9-47bb-9251-b74a4d614f67 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:16.819967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42d15872-c6d9-47bb-9251-b74a4d614f67 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:16.820433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42d15872-c6d9-47bb-9251-b74a4d614f67 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:16.820845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42d15872-c6d9-47bb-9251-b74a4d614f67 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:16.971832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-42d15872-c6d9-47bb-9251-b74a4d614f67 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:16.980423 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-42d15872-c6d9-47bb-9251-b74a4d614f67 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1362 microversion: 2.1 time: 0.174601 Aug 09 15:31:16.981042 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3486/6961] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:16 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:18.008300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-352f0bff-33c5-485d-9923-3501d63b906d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:18.009483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-352f0bff-33c5-485d-9923-3501d63b906d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:18.022682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-352f0bff-33c5-485d-9923-3501d63b906d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:18.025186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-352f0bff-33c5-485d-9923-3501d63b906d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:18.026190 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-352f0bff-33c5-485d-9923-3501d63b906d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:18.027746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-352f0bff-33c5-485d-9923-3501d63b906d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:18.028812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-352f0bff-33c5-485d-9923-3501d63b906d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:18.029597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-352f0bff-33c5-485d-9923-3501d63b906d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:18.109134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-23ce0bfd-1d64-40ed-a5d3-719f50a7e43a req-d2bed21e-a572-4348-94f9-c54d237244cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b73123-783d-4110-8b8e-23064536af55", "name": "network-vif-plugged", "status": "completed", "tag": "c8a9021d-1747-44a6-90ca-14e34a14b015"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:31:18.125199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-23ce0bfd-1d64-40ed-a5d3-719f50a7e43a req-d2bed21e-a572-4348-94f9-c54d237244cf service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:18.126277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-23ce0bfd-1d64-40ed-a5d3-719f50a7e43a req-d2bed21e-a572-4348-94f9-c54d237244cf service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:18.127157 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-23ce0bfd-1d64-40ed-a5d3-719f50a7e43a req-d2bed21e-a572-4348-94f9-c54d237244cf service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:18.146022 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-23ce0bfd-1d64-40ed-a5d3-719f50a7e43a req-d2bed21e-a572-4348-94f9-c54d237244cf service nova] Creating event network-vif-plugged:c8a9021d-1747-44a6-90ca-14e34a14b015 for instance 57b73123-783d-4110-8b8e-23064536af55 on n-h1-844626-8 Aug 09 15:31:18.154762 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-23ce0bfd-1d64-40ed-a5d3-719f50a7e43a req-d2bed21e-a572-4348-94f9-c54d237244cf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050591 Aug 09 15:31:18.155982 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3487/6962] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:31:18.289541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-352f0bff-33c5-485d-9923-3501d63b906d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:18.298605 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-352f0bff-33c5-485d-9923-3501d63b906d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1362 microversion: 2.1 time: 0.298239 Aug 09 15:31:18.299237 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3476/6963] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:17 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:19.324204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5aa0063b-13f0-4cca-99b1-270665aa866f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:19.325270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5aa0063b-13f0-4cca-99b1-270665aa866f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:19.336093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5aa0063b-13f0-4cca-99b1-270665aa866f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:19.336911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5aa0063b-13f0-4cca-99b1-270665aa866f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:19.337628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5aa0063b-13f0-4cca-99b1-270665aa866f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:19.338825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5aa0063b-13f0-4cca-99b1-270665aa866f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:19.339771 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5aa0063b-13f0-4cca-99b1-270665aa866f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:19.340521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5aa0063b-13f0-4cca-99b1-270665aa866f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:19.527494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5aa0063b-13f0-4cca-99b1-270665aa866f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:19.538441 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5aa0063b-13f0-4cca-99b1-270665aa866f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1362 microversion: 2.1 time: 0.219498 Aug 09 15:31:19.539061 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3488/6964] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:19 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:20.560528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-58bbd247-784d-46f2-86fe-67e716a1faf0 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:20.561420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-58bbd247-784d-46f2-86fe-67e716a1faf0 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:20.569614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58bbd247-784d-46f2-86fe-67e716a1faf0 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:20.570252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58bbd247-784d-46f2-86fe-67e716a1faf0 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:20.570794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58bbd247-784d-46f2-86fe-67e716a1faf0 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:20.571698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58bbd247-784d-46f2-86fe-67e716a1faf0 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:20.572307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58bbd247-784d-46f2-86fe-67e716a1faf0 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:20.572845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-58bbd247-784d-46f2-86fe-67e716a1faf0 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:20.711549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:31:20.744248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:31:20.753774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-58bbd247-784d-46f2-86fe-67e716a1faf0 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:20.762962 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-58bbd247-784d-46f2-86fe-67e716a1faf0 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1554 microversion: 2.1 time: 0.206730 Aug 09 15:31:20.763739 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3477/6965] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:20 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:20.790872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ab7ceec7-4ef4-4813-bbee-f137dc632397 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:20.791881 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ab7ceec7-4ef4-4813-bbee-f137dc632397 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:20.802031 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab7ceec7-4ef4-4813-bbee-f137dc632397 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:20.802679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab7ceec7-4ef4-4813-bbee-f137dc632397 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:20.803265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab7ceec7-4ef4-4813-bbee-f137dc632397 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:20.804115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab7ceec7-4ef4-4813-bbee-f137dc632397 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:20.804651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab7ceec7-4ef4-4813-bbee-f137dc632397 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:20.805239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab7ceec7-4ef4-4813-bbee-f137dc632397 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:20.925387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:31:20.960284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ab7ceec7-4ef4-4813-bbee-f137dc632397 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:20.969477 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ab7ceec7-4ef4-4813-bbee-f137dc632397 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1554 microversion: 2.1 time: 0.187317 Aug 09 15:31:20.970371 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3489/6966] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:20 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:22.661893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f5f7d93f-6feb-4997-bc42-400e24ae3d56 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "875bca6c-78e7-49d1-8a16-9ddd63042880"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:31:22.664511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f5f7d93f-6feb-4997-bc42-400e24ae3d56 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:22.672710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5f7d93f-6feb-4997-bc42-400e24ae3d56 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:22.673264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5f7d93f-6feb-4997-bc42-400e24ae3d56 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:22.673751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5f7d93f-6feb-4997-bc42-400e24ae3d56 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:22.674596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5f7d93f-6feb-4997-bc42-400e24ae3d56 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:22.675251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5f7d93f-6feb-4997-bc42-400e24ae3d56 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:22.675745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f5f7d93f-6feb-4997-bc42-400e24ae3d56 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:22.947565 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:31:22.964933 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f5f7d93f-6feb-4997-bc42-400e24ae3d56 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "POST /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307050 Aug 09 15:31:22.965527 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3478/6967] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 15:31:22 2022] POST /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:31:35.027064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-526a7e45-4ba8-441a-9dd6-1256a267323f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:35.027795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-526a7e45-4ba8-441a-9dd6-1256a267323f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:35.031162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:31:35.032832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=66 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:31:35.041114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-526a7e45-4ba8-441a-9dd6-1256a267323f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:35.041939 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-526a7e45-4ba8-441a-9dd6-1256a267323f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:35.042481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-526a7e45-4ba8-441a-9dd6-1256a267323f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:35.043407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-526a7e45-4ba8-441a-9dd6-1256a267323f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:35.043906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-526a7e45-4ba8-441a-9dd6-1256a267323f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:35.044508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-526a7e45-4ba8-441a-9dd6-1256a267323f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:35.144930 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-526a7e45-4ba8-441a-9dd6-1256a267323f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lazy-loading 'services' on Instance uuid 57b73123-783d-4110-8b8e-23064536af55 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:31:35.237419 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-526a7e45-4ba8-441a-9dd6-1256a267323f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments/875bca6c-78e7-49d1-8a16-9ddd63042880" status: 202 len: 0 microversion: 2.1 time: 0.215055 Aug 09 15:31:35.238377 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3490/6968] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:31:35 2022] DELETE /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments/875bca6c-78e7-49d1-8a16-9ddd63042880 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:31:35.245599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:31:35.251137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3eb2651d-bd3e-44cb-898c-d5eb0209e4bf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:35.253717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3eb2651d-bd3e-44cb-898c-d5eb0209e4bf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:35.266236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3eb2651d-bd3e-44cb-898c-d5eb0209e4bf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:35.266798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3eb2651d-bd3e-44cb-898c-d5eb0209e4bf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:35.267339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3eb2651d-bd3e-44cb-898c-d5eb0209e4bf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:35.268198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3eb2651d-bd3e-44cb-898c-d5eb0209e4bf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:35.268675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3eb2651d-bd3e-44cb-898c-d5eb0209e4bf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:35.269138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3eb2651d-bd3e-44cb-898c-d5eb0209e4bf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:35.327815 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3eb2651d-bd3e-44cb-898c-d5eb0209e4bf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083963 Aug 09 15:31:35.329303 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3479/6969] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:31:35 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:31:36.344103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7922dae3-98ca-4720-a33e-596d48435884 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:36.346894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7922dae3-98ca-4720-a33e-596d48435884 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:36.355507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7922dae3-98ca-4720-a33e-596d48435884 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:36.356043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7922dae3-98ca-4720-a33e-596d48435884 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:36.356783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7922dae3-98ca-4720-a33e-596d48435884 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:36.357573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7922dae3-98ca-4720-a33e-596d48435884 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:36.358036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7922dae3-98ca-4720-a33e-596d48435884 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:36.358465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7922dae3-98ca-4720-a33e-596d48435884 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:36.394672 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7922dae3-98ca-4720-a33e-596d48435884 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055559 Aug 09 15:31:36.395666 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3491/6970] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:31:36 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:31:37.408797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca96bcc3-6047-4a6e-b5e2-99062d74d0cf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:37.411161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca96bcc3-6047-4a6e-b5e2-99062d74d0cf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:37.421532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca96bcc3-6047-4a6e-b5e2-99062d74d0cf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:37.422548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca96bcc3-6047-4a6e-b5e2-99062d74d0cf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:37.423453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca96bcc3-6047-4a6e-b5e2-99062d74d0cf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:37.424690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca96bcc3-6047-4a6e-b5e2-99062d74d0cf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:37.425684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca96bcc3-6047-4a6e-b5e2-99062d74d0cf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:37.426508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca96bcc3-6047-4a6e-b5e2-99062d74d0cf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:37.489966 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca96bcc3-6047-4a6e-b5e2-99062d74d0cf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085036 Aug 09 15:31:37.491150 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3480/6971] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:31:37 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:31:38.506109 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f8337f21-e388-40ca-bb88-82b83e932ffc tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:38.508548 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f8337f21-e388-40ca-bb88-82b83e932ffc tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:38.516618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8337f21-e388-40ca-bb88-82b83e932ffc tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:38.517110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8337f21-e388-40ca-bb88-82b83e932ffc tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:38.517545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8337f21-e388-40ca-bb88-82b83e932ffc tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:38.518572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8337f21-e388-40ca-bb88-82b83e932ffc tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:38.519137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8337f21-e388-40ca-bb88-82b83e932ffc tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:38.519589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f8337f21-e388-40ca-bb88-82b83e932ffc tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:38.555046 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f8337f21-e388-40ca-bb88-82b83e932ffc tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052981 Aug 09 15:31:38.555684 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3492/6972] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:31:38 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:31:39.569125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6552d188-8cf6-41f9-9218-82a2faa28816 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:39.571596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6552d188-8cf6-41f9-9218-82a2faa28816 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:39.580580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6552d188-8cf6-41f9-9218-82a2faa28816 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:39.581168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6552d188-8cf6-41f9-9218-82a2faa28816 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:39.581752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6552d188-8cf6-41f9-9218-82a2faa28816 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:39.582623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6552d188-8cf6-41f9-9218-82a2faa28816 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:39.583357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6552d188-8cf6-41f9-9218-82a2faa28816 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:39.584018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6552d188-8cf6-41f9-9218-82a2faa28816 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:39.622909 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6552d188-8cf6-41f9-9218-82a2faa28816 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058268 Aug 09 15:31:39.623811 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3481/6973] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:31:39 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:31:40.637107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-448e0585-7156-4d7f-8597-37cc09e19d70 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:40.639474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-448e0585-7156-4d7f-8597-37cc09e19d70 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:40.647119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-448e0585-7156-4d7f-8597-37cc09e19d70 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:40.647599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-448e0585-7156-4d7f-8597-37cc09e19d70 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:40.648042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-448e0585-7156-4d7f-8597-37cc09e19d70 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:40.648790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-448e0585-7156-4d7f-8597-37cc09e19d70 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:40.649245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-448e0585-7156-4d7f-8597-37cc09e19d70 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:40.649668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-448e0585-7156-4d7f-8597-37cc09e19d70 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:40.688919 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-448e0585-7156-4d7f-8597-37cc09e19d70 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055667 Aug 09 15:31:40.690112 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3493/6974] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:31:40 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:31:41.705200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-00bd68ad-6c76-4087-916c-a4d938b49e4e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:41.707617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-00bd68ad-6c76-4087-916c-a4d938b49e4e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:41.716242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00bd68ad-6c76-4087-916c-a4d938b49e4e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:41.716933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00bd68ad-6c76-4087-916c-a4d938b49e4e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:41.717513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00bd68ad-6c76-4087-916c-a4d938b49e4e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:41.718441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00bd68ad-6c76-4087-916c-a4d938b49e4e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:41.719125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00bd68ad-6c76-4087-916c-a4d938b49e4e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:41.719949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00bd68ad-6c76-4087-916c-a4d938b49e4e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:41.756061 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-00bd68ad-6c76-4087-916c-a4d938b49e4e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054949 Aug 09 15:31:41.756777 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3482/6975] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:31:41 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:31:41.768510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58261bba-167a-4de5-9270-603f9971cca8 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:41.769419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-58261bba-167a-4de5-9270-603f9971cca8 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:41.776744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58261bba-167a-4de5-9270-603f9971cca8 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:41.777225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58261bba-167a-4de5-9270-603f9971cca8 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:41.777664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58261bba-167a-4de5-9270-603f9971cca8 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:41.778395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58261bba-167a-4de5-9270-603f9971cca8 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:41.778836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58261bba-167a-4de5-9270-603f9971cca8 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:41.779299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-58261bba-167a-4de5-9270-603f9971cca8 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:41.873697 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-58261bba-167a-4de5-9270-603f9971cca8 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] HTTP exception thrown: Instance 57b73123-783d-4110-8b8e-23064536af55 is not attached to volume 875bca6c-78e7-49d1-8a16-9ddd63042880 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58261bba-167a-4de5-9270-603f9971cca8 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Request method failure captured: Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments/875bca6c-78e7-49d1-8a16-9ddd63042880 HTTP/1.1 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n2O-gDYLSt6VQJmWOvQr0m0Zb4DqeuCFMAOlW7erNvbS6QVdD3-tNnhD_rywcHNsNxByWhCUKrZhv_2k0jRVvPE83ZpRitFdMnoP30zbzFhfKXZU6MovsRp3MHo4gI2XrTJzJ5cPYaP8fvNZb3S6wpqSaluV_W47nKyfOM9DiX7XEo Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 59dd4aa3e7c044b4af3d5613b3e99555 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_59dd4aa3e7c044b4af3d5613b3e99555", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 59dd4aa3e7c044b4af3d5613b3e99555 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestEncryptedCinderVolumes-59367429-project Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: bf6f25bb68d04f8e8c2a90c0f8411690 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestEncryptedCinderVolumes-59367429-project Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 57b73123-783d-4110-8b8e-23064536af55 is not attached to volume 875bca6c-78e7-49d1-8a16-9ddd63042880 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'server_id': '57b73123-783d-4110-8b8e-23064536af55', 'id': '875bca6c-78e7-49d1-8a16-9ddd63042880'} Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 875bca6c-78e7-49d1-8a16-9ddd63042880. Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b73123-783d-4110-8b8e-23064536af55 is not attached to volume 875bca6c-78e7-49d1-8a16-9ddd63042880 Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:31:41.876913 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:31:41.883766 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:31:41.883766 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:31:41.883766 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b73123-783d-4110-8b8e-23064536af55 is not attached to volume 875bca6c-78e7-49d1-8a16-9ddd63042880 Aug 09 15:31:41.883766 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:41.883766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-58261bba-167a-4de5-9270-603f9971cca8 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Returning 404 to user: Instance 57b73123-783d-4110-8b8e-23064536af55 is not attached to volume 875bca6c-78e7-49d1-8a16-9ddd63042880 {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:31:41.883766 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-58261bba-167a-4de5-9270-603f9971cca8 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments/875bca6c-78e7-49d1-8a16-9ddd63042880" status: 404 len: 154 microversion: 2.1 time: 0.115527 Aug 09 15:31:41.883766 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3494/6976] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:31:41 2022] DELETE /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55/os-volume_attachments/875bca6c-78e7-49d1-8a16-9ddd63042880 => generated 154 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:31:45.409951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4b03277e-b0e6-4b1e-8c73-547bf1ae7e7a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:45.410772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b03277e-b0e6-4b1e-8c73-547bf1ae7e7a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:45.423622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b03277e-b0e6-4b1e-8c73-547bf1ae7e7a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:45.424528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b03277e-b0e6-4b1e-8c73-547bf1ae7e7a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:45.425336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b03277e-b0e6-4b1e-8c73-547bf1ae7e7a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:45.426646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b03277e-b0e6-4b1e-8c73-547bf1ae7e7a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:45.427528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b03277e-b0e6-4b1e-8c73-547bf1ae7e7a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:45.428301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4b03277e-b0e6-4b1e-8c73-547bf1ae7e7a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:45.478200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4b03277e-b0e6-4b1e-8c73-547bf1ae7e7a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:31:45.599507 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4b03277e-b0e6-4b1e-8c73-547bf1ae7e7a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 204 len: 0 microversion: 2.1 time: 0.196679 Aug 09 15:31:45.600582 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3483/6977] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:31:45 2022] DELETE /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:31:45.611780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-57b3342c-3f4b-4754-9408-c9ad8a1f1087 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:45.613113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-57b3342c-3f4b-4754-9408-c9ad8a1f1087 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:45.620705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57b3342c-3f4b-4754-9408-c9ad8a1f1087 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:45.621353 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57b3342c-3f4b-4754-9408-c9ad8a1f1087 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:45.621867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57b3342c-3f4b-4754-9408-c9ad8a1f1087 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:45.622596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57b3342c-3f4b-4754-9408-c9ad8a1f1087 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:45.623049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57b3342c-3f4b-4754-9408-c9ad8a1f1087 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:45.623515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-57b3342c-3f4b-4754-9408-c9ad8a1f1087 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:45.792270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-57b3342c-3f4b-4754-9408-c9ad8a1f1087 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:45.806087 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-57b3342c-3f4b-4754-9408-c9ad8a1f1087 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1560 microversion: 2.1 time: 0.198309 Aug 09 15:31:45.807270 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3495/6978] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:45 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:46.839242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-636ac372-74c9-46df-b62f-395ee21f7710 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:46.839985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-636ac372-74c9-46df-b62f-395ee21f7710 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:46.848349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-636ac372-74c9-46df-b62f-395ee21f7710 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:46.848861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-636ac372-74c9-46df-b62f-395ee21f7710 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:46.849320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-636ac372-74c9-46df-b62f-395ee21f7710 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:46.850071 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-636ac372-74c9-46df-b62f-395ee21f7710 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:46.850547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-636ac372-74c9-46df-b62f-395ee21f7710 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:46.850991 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-636ac372-74c9-46df-b62f-395ee21f7710 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:47.012636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-636ac372-74c9-46df-b62f-395ee21f7710 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:47.022131 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-636ac372-74c9-46df-b62f-395ee21f7710 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1560 microversion: 2.1 time: 0.187340 Aug 09 15:31:47.022772 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3484/6979] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:46 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:31:47.747334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-60375160-b7f2-4cc4-b2d2-da698d4817db req-5d1f0a19-8538-4e7e-9d9e-ec50b533f6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b73123-783d-4110-8b8e-23064536af55", "name": "network-vif-deleted", "tag": "c8a9021d-1747-44a6-90ca-14e34a14b015"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:31:47.758785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-60375160-b7f2-4cc4-b2d2-da698d4817db req-5d1f0a19-8538-4e7e-9d9e-ec50b533f6fc service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:47.759302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-60375160-b7f2-4cc4-b2d2-da698d4817db req-5d1f0a19-8538-4e7e-9d9e-ec50b533f6fc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:47.759730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-60375160-b7f2-4cc4-b2d2-da698d4817db req-5d1f0a19-8538-4e7e-9d9e-ec50b533f6fc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:47.783799 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-60375160-b7f2-4cc4-b2d2-da698d4817db req-5d1f0a19-8538-4e7e-9d9e-ec50b533f6fc service nova] Creating event network-vif-deleted:c8a9021d-1747-44a6-90ca-14e34a14b015 for instance 57b73123-783d-4110-8b8e-23064536af55 on n-h1-844626-8 Aug 09 15:31:47.789448 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-60375160-b7f2-4cc4-b2d2-da698d4817db req-5d1f0a19-8538-4e7e-9d9e-ec50b533f6fc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045991 Aug 09 15:31:47.790080 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3496/6980] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:31:48.044265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:48.045028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:48.052932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:48.053446 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:48.053870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:48.054636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:48.055118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:48.055538 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:48.104488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:48.105372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:48.106179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:48.106795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lazy-loading 'fault' on Instance uuid 57b73123-783d-4110-8b8e-23064536af55 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:31:48.168364 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:48.183232 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-18daa5aa-266b-4c8e-af62-82943f29a53d tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 200 len: 1352 microversion: 2.1 time: 0.142871 Aug 09 15:31:48.191280 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3485/6981] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:48 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 1352 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:49.216685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62755530-abf7-4e6d-8524-41d6336b54b7 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:49.217350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-62755530-abf7-4e6d-8524-41d6336b54b7 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 57b73123-783d-4110-8b8e-23064536af55] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:49.225807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62755530-abf7-4e6d-8524-41d6336b54b7 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:49.226282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62755530-abf7-4e6d-8524-41d6336b54b7 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:49.226804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62755530-abf7-4e6d-8524-41d6336b54b7 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:49.227631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62755530-abf7-4e6d-8524-41d6336b54b7 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:49.228127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62755530-abf7-4e6d-8524-41d6336b54b7 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:49.228541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-62755530-abf7-4e6d-8524-41d6336b54b7 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:49.257356 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-62755530-abf7-4e6d-8524-41d6336b54b7 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] HTTP exception thrown: Instance 57b73123-783d-4110-8b8e-23064536af55 could not be found. Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62755530-abf7-4e6d-8524-41d6336b54b7 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Request method failure captured: Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 HTTP/1.1 Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n2O-gDYLSt6VQJmWOvQr0m0Zb4DqeuCFMAOlW7erNvbS6QVdD3-tNnhD_rywcHNsNxByWhCUKrZhv_2k0jRVvPE83ZpRitFdMnoP30zbzFhfKXZU6MovsRp3MHo4gI2XrTJzJ5cPYaP8fvNZb3S6wpqSaluV_W47nKyfOM9DiX7XEo Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 59dd4aa3e7c044b4af3d5613b3e99555 Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_59dd4aa3e7c044b4af3d5613b3e99555", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 59dd4aa3e7c044b4af3d5613b3e99555 Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestEncryptedCinderVolumes-59367429-project Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: bf6f25bb68d04f8e8c2a90c0f8411690 Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestEncryptedCinderVolumes-59367429-project Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 57b73123-783d-4110-8b8e-23064536af55 could not be found. Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '57b73123-783d-4110-8b8e-23064536af55'} Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b73123-783d-4110-8b8e-23064536af55 could not be found. Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b73123-783d-4110-8b8e-23064536af55 could not be found. Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:31:49.261201 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:49.265558 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:31:49.265558 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:31:49.265558 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:31:49.265558 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:31:49.265558 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:31:49.265558 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b73123-783d-4110-8b8e-23064536af55 could not be found. Aug 09 15:31:49.265558 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:31:49.265558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-62755530-abf7-4e6d-8524-41d6336b54b7 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Returning 404 to user: Instance 57b73123-783d-4110-8b8e-23064536af55 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:31:49.265558 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-62755530-abf7-4e6d-8524-41d6336b54b7 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55" status: 404 len: 111 microversion: 2.1 time: 0.052776 Aug 09 15:31:49.265558 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3497/6982] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:49 2022] GET /compute/v2.1/servers/57b73123-783d-4110-8b8e-23064536af55 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:31:49.273856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-30f5de5c-b06f-4367-932d-b103ae9aa466 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '.version_select at 0x7f41dda6a670>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:49.297764 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-30f5de5c-b06f-4367-932d-b103ae9aa466 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-169385919" status: 202 len: 0 microversion: 2.1 time: 0.027779 Aug 09 15:31:49.298603 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3486/6983] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 15:31:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-169385919 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:31:49.324209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b4ea886e-640e-463d-a304-6ea1b563f2c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Action: 'create', calling method: .version_select at 0x7f41dde60a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1855189859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH1Abcy3R+hjdxZzr+FmDrEB9ZDReNX1D5F9TgWzGNdvj/znwU95jJUY8kKyuLc1EtO3ZZ/35BsNTsImV1DXHuQTSsVhDnbnadTOVYaaZ8Cog55bv6069X7uJVhmqcyLkw=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:31:49.343348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b4ea886e-640e-463d-a304-6ea1b563f2c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Getting quotas for project 59dd4aa3e7c044b4af3d5613b3e99555. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:31:49.353191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-b4ea886e-640e-463d-a304-6ea1b563f2c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Getting quotas for user bf6f25bb68d04f8e8c2a90c0f8411690 and project 59dd4aa3e7c044b4af3d5613b3e99555. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:31:49.395585 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b4ea886e-640e-463d-a304-6ea1b563f2c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.075207 Aug 09 15:31:49.396681 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3498/6984] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:31:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:31:49.465773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-692186878", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1855189859", "networks": [{"uuid": "170151ed-b995-47f1-8358-39fcbab1dc55"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:31:49.528558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] validate_networks() for [('170151ed-b995-47f1-8358-39fcbab1dc55', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:31:49.985483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:31:49.985919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:31:49.986390 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:31:49.988063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:31:49.989404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:31:50.001685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:50.002563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:50.003292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:50.004325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:50.004946 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:50.005506 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:50.027463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Getting quotas for project 59dd4aa3e7c044b4af3d5613b3e99555. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:31:50.034568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Getting quotas for user bf6f25bb68d04f8e8c2a90c0f8411690 and project 59dd4aa3e7c044b4af3d5613b3e99555. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:31:50.051611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:31:50.055116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:31:50.130559 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e1a76dae-bafe-4e99-9cfd-9ca4bb30cb92 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669165 Aug 09 15:31:50.131733 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3487/6985] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:31:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:31:50.154207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b1bea50-0080-4dfc-9cd5-daeb75308510 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:50.154998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b1bea50-0080-4dfc-9cd5-daeb75308510 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:50.218119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b1bea50-0080-4dfc-9cd5-daeb75308510 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:50.225895 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b1bea50-0080-4dfc-9cd5-daeb75308510 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1262 microversion: 2.1 time: 0.076944 Aug 09 15:31:50.226778 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3499/6986] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:50 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1262 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:51.251397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81ecad20-75ab-417e-9aaf-91e9f0276281 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:51.252332 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81ecad20-75ab-417e-9aaf-91e9f0276281 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:51.260839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81ecad20-75ab-417e-9aaf-91e9f0276281 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:51.261429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81ecad20-75ab-417e-9aaf-91e9f0276281 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:51.261942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81ecad20-75ab-417e-9aaf-91e9f0276281 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:51.263206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81ecad20-75ab-417e-9aaf-91e9f0276281 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:51.264043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81ecad20-75ab-417e-9aaf-91e9f0276281 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:51.264801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81ecad20-75ab-417e-9aaf-91e9f0276281 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:51.363308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-81ecad20-75ab-417e-9aaf-91e9f0276281 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:51.375433 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81ecad20-75ab-417e-9aaf-91e9f0276281 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1314 microversion: 2.1 time: 0.130472 Aug 09 15:31:51.376922 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3488/6987] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:51 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1314 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:52.405999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a713bc6-f4a6-4d1a-9180-230131016780 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:52.407127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a713bc6-f4a6-4d1a-9180-230131016780 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:52.418465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a713bc6-f4a6-4d1a-9180-230131016780 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:52.419681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a713bc6-f4a6-4d1a-9180-230131016780 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:52.420716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a713bc6-f4a6-4d1a-9180-230131016780 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:52.422234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a713bc6-f4a6-4d1a-9180-230131016780 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:52.423359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a713bc6-f4a6-4d1a-9180-230131016780 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:52.424351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a713bc6-f4a6-4d1a-9180-230131016780 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:52.646215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4a713bc6-f4a6-4d1a-9180-230131016780 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:52.660819 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a713bc6-f4a6-4d1a-9180-230131016780 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1362 microversion: 2.1 time: 0.262525 Aug 09 15:31:52.661903 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3500/6988] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:52 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:53.103036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b8505ad9-2084-4c6c-b099-e9b6b5f23140 req-50364151-5dce-4f30-9499-af5c472d13fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f7a8752-0b10-4e89-8f59-9becfad6b1f3", "tag": "ffce4bf2-c05f-4d18-8905-fb315eba6671"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:31:53.119981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b8505ad9-2084-4c6c-b099-e9b6b5f23140 req-50364151-5dce-4f30-9499-af5c472d13fe service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:53.120564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b8505ad9-2084-4c6c-b099-e9b6b5f23140 req-50364151-5dce-4f30-9499-af5c472d13fe service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:53.121098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b8505ad9-2084-4c6c-b099-e9b6b5f23140 req-50364151-5dce-4f30-9499-af5c472d13fe service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:53.134007 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b8505ad9-2084-4c6c-b099-e9b6b5f23140 req-50364151-5dce-4f30-9499-af5c472d13fe service nova] Creating event network-changed:ffce4bf2-c05f-4d18-8905-fb315eba6671 for instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 on n-h1-844626-8 Aug 09 15:31:53.139916 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b8505ad9-2084-4c6c-b099-e9b6b5f23140 req-50364151-5dce-4f30-9499-af5c472d13fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040775 Aug 09 15:31:53.140850 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3489/6989] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:31:53.703329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2eff000-564c-4b67-ab14-13a638b25141 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:53.704474 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b2eff000-564c-4b67-ab14-13a638b25141 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:53.717699 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2eff000-564c-4b67-ab14-13a638b25141 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:53.718692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2eff000-564c-4b67-ab14-13a638b25141 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:53.719772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2eff000-564c-4b67-ab14-13a638b25141 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:53.721060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2eff000-564c-4b67-ab14-13a638b25141 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:53.721805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2eff000-564c-4b67-ab14-13a638b25141 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:53.722567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2eff000-564c-4b67-ab14-13a638b25141 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:53.902308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2eff000-564c-4b67-ab14-13a638b25141 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:53.911548 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2eff000-564c-4b67-ab14-13a638b25141 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1362 microversion: 2.1 time: 0.218385 Aug 09 15:31:53.912070 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3501/6990] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:53 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:54.935671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-565b5ff5-33d2-46f3-86ed-d0f15099a400 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:54.936834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-565b5ff5-33d2-46f3-86ed-d0f15099a400 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:54.944272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-565b5ff5-33d2-46f3-86ed-d0f15099a400 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:54.944924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-565b5ff5-33d2-46f3-86ed-d0f15099a400 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:54.945360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-565b5ff5-33d2-46f3-86ed-d0f15099a400 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:54.946320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-565b5ff5-33d2-46f3-86ed-d0f15099a400 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:54.946804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-565b5ff5-33d2-46f3-86ed-d0f15099a400 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:54.947288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-565b5ff5-33d2-46f3-86ed-d0f15099a400 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:55.130457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-565b5ff5-33d2-46f3-86ed-d0f15099a400 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:55.139144 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-565b5ff5-33d2-46f3-86ed-d0f15099a400 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1362 microversion: 2.1 time: 0.209101 Aug 09 15:31:55.139874 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3490/6991] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:54 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:56.160351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a4bfa427-1cc9-4cf6-9cce-94ef1d2ab916 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:56.161129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a4bfa427-1cc9-4cf6-9cce-94ef1d2ab916 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:56.169278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4bfa427-1cc9-4cf6-9cce-94ef1d2ab916 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:56.169775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4bfa427-1cc9-4cf6-9cce-94ef1d2ab916 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:56.170209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4bfa427-1cc9-4cf6-9cce-94ef1d2ab916 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:56.170931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4bfa427-1cc9-4cf6-9cce-94ef1d2ab916 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:56.171419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4bfa427-1cc9-4cf6-9cce-94ef1d2ab916 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:56.171840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4bfa427-1cc9-4cf6-9cce-94ef1d2ab916 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:56.350392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a4bfa427-1cc9-4cf6-9cce-94ef1d2ab916 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:56.364938 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a4bfa427-1cc9-4cf6-9cce-94ef1d2ab916 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1362 microversion: 2.1 time: 0.208049 Aug 09 15:31:56.366028 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3502/6992] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:56 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:57.403794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-36b10439-1f12-40ca-a771-e1f6ea34de73 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:57.404889 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-36b10439-1f12-40ca-a771-e1f6ea34de73 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:57.417985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b10439-1f12-40ca-a771-e1f6ea34de73 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:57.418976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b10439-1f12-40ca-a771-e1f6ea34de73 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:57.419822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b10439-1f12-40ca-a771-e1f6ea34de73 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:57.421083 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b10439-1f12-40ca-a771-e1f6ea34de73 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:57.421957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b10439-1f12-40ca-a771-e1f6ea34de73 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:57.422741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-36b10439-1f12-40ca-a771-e1f6ea34de73 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:57.628079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-36b10439-1f12-40ca-a771-e1f6ea34de73 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:57.637607 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-36b10439-1f12-40ca-a771-e1f6ea34de73 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1362 microversion: 2.1 time: 0.241235 Aug 09 15:31:57.638215 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3491/6993] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:57 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:58.185428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-26c7c60b-638d-4528-b96b-1fb4751633bc req-b8b4fd67-6bcc-4bcc-b9af-5b2ee877f22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7a8752-0b10-4e89-8f59-9becfad6b1f3", "name": "network-vif-plugged", "status": "completed", "tag": "ffce4bf2-c05f-4d18-8905-fb315eba6671"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:31:58.204814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-26c7c60b-638d-4528-b96b-1fb4751633bc req-b8b4fd67-6bcc-4bcc-b9af-5b2ee877f22c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:58.205604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-26c7c60b-638d-4528-b96b-1fb4751633bc req-b8b4fd67-6bcc-4bcc-b9af-5b2ee877f22c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:58.206421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-26c7c60b-638d-4528-b96b-1fb4751633bc req-b8b4fd67-6bcc-4bcc-b9af-5b2ee877f22c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:58.233874 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-26c7c60b-638d-4528-b96b-1fb4751633bc req-b8b4fd67-6bcc-4bcc-b9af-5b2ee877f22c service nova] Creating event network-vif-plugged:ffce4bf2-c05f-4d18-8905-fb315eba6671 for instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 on n-h1-844626-8 Aug 09 15:31:58.244298 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-26c7c60b-638d-4528-b96b-1fb4751633bc req-b8b4fd67-6bcc-4bcc-b9af-5b2ee877f22c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063154 Aug 09 15:31:58.246057 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3503/6994] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:31:58.662926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-008a67d8-8deb-4080-b739-83400a4c1913 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:58.663744 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-008a67d8-8deb-4080-b739-83400a4c1913 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:58.678423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008a67d8-8deb-4080-b739-83400a4c1913 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:58.679133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008a67d8-8deb-4080-b739-83400a4c1913 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:58.679768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008a67d8-8deb-4080-b739-83400a4c1913 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:58.680637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008a67d8-8deb-4080-b739-83400a4c1913 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:58.681141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008a67d8-8deb-4080-b739-83400a4c1913 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:58.681603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-008a67d8-8deb-4080-b739-83400a4c1913 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:58.836930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-008a67d8-8deb-4080-b739-83400a4c1913 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:31:58.845456 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-008a67d8-8deb-4080-b739-83400a4c1913 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1362 microversion: 2.1 time: 0.189020 Aug 09 15:31:58.846075 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3492/6995] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:58 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:31:59.880790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5fe4af0a-24ae-4c7f-9f1e-4a7738abfa7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:31:59.881505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5fe4af0a-24ae-4c7f-9f1e-4a7738abfa7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:31:59.888308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fe4af0a-24ae-4c7f-9f1e-4a7738abfa7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:59.888794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fe4af0a-24ae-4c7f-9f1e-4a7738abfa7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:59.889224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fe4af0a-24ae-4c7f-9f1e-4a7738abfa7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:31:59.889966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fe4af0a-24ae-4c7f-9f1e-4a7738abfa7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:31:59.890413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fe4af0a-24ae-4c7f-9f1e-4a7738abfa7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:31:59.890832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5fe4af0a-24ae-4c7f-9f1e-4a7738abfa7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:00.058542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5fe4af0a-24ae-4c7f-9f1e-4a7738abfa7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:32:00.072047 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5fe4af0a-24ae-4c7f-9f1e-4a7738abfa7c tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1555 microversion: 2.1 time: 0.196475 Aug 09 15:32:00.072958 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3504/6996] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:31:59 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:32:00.112775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-afb64103-da79-4425-97a2-cb29db91705e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:00.113958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-afb64103-da79-4425-97a2-cb29db91705e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:00.118338 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:32:00.119785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:32:00.132777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afb64103-da79-4425-97a2-cb29db91705e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:00.133618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afb64103-da79-4425-97a2-cb29db91705e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:00.134396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afb64103-da79-4425-97a2-cb29db91705e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:00.135783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afb64103-da79-4425-97a2-cb29db91705e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:00.136497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afb64103-da79-4425-97a2-cb29db91705e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:00.137597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-afb64103-da79-4425-97a2-cb29db91705e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:00.331460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-afb64103-da79-4425-97a2-cb29db91705e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:32:00.341541 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-afb64103-da79-4425-97a2-cb29db91705e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1555 microversion: 2.1 time: 0.236371 Aug 09 15:32:00.342270 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3493/6997] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:32:00 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1555 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:32:03.069737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4be0d1da-ad81-41f1-8578-c4ce3d435a31 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd598816-2d8e-4ca1-99f9-c1c8a528d398"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:32:03.072415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4be0d1da-ad81-41f1-8578-c4ce3d435a31 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:03.074765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:32:03.081758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4be0d1da-ad81-41f1-8578-c4ce3d435a31 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:03.082218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4be0d1da-ad81-41f1-8578-c4ce3d435a31 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:03.082664 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4be0d1da-ad81-41f1-8578-c4ce3d435a31 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:03.083424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4be0d1da-ad81-41f1-8578-c4ce3d435a31 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:03.083879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4be0d1da-ad81-41f1-8578-c4ce3d435a31 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:03.084302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4be0d1da-ad81-41f1-8578-c4ce3d435a31 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:03.412002 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4be0d1da-ad81-41f1-8578-c4ce3d435a31 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "POST /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346297 Aug 09 15:32:03.412783 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3505/6998] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 15:32:03 2022] POST /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:32:15.425554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-06828f30-77da-4153-9bc1-333c415a2f11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:15.426439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-06828f30-77da-4153-9bc1-333c415a2f11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:15.428257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:32:15.429077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:32:15.437686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06828f30-77da-4153-9bc1-333c415a2f11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:15.438679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06828f30-77da-4153-9bc1-333c415a2f11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:15.438810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06828f30-77da-4153-9bc1-333c415a2f11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:15.439614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06828f30-77da-4153-9bc1-333c415a2f11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:15.440120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06828f30-77da-4153-9bc1-333c415a2f11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:15.440591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-06828f30-77da-4153-9bc1-333c415a2f11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:15.540490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-06828f30-77da-4153-9bc1-333c415a2f11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lazy-loading 'services' on Instance uuid 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:32:15.631244 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-06828f30-77da-4153-9bc1-333c415a2f11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments/fd598816-2d8e-4ca1-99f9-c1c8a528d398" status: 202 len: 0 microversion: 2.1 time: 0.209523 Aug 09 15:32:15.632278 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3494/6999] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:32:15 2022] DELETE /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments/fd598816-2d8e-4ca1-99f9-c1c8a528d398 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:32:15.642807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8100dd7-73d1-4a0c-b842-5d795fa71487 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:15.645821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8100dd7-73d1-4a0c-b842-5d795fa71487 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:15.649493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:32:15.650408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:32:15.660922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8100dd7-73d1-4a0c-b842-5d795fa71487 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:15.661557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8100dd7-73d1-4a0c-b842-5d795fa71487 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:15.662187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8100dd7-73d1-4a0c-b842-5d795fa71487 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:15.663135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8100dd7-73d1-4a0c-b842-5d795fa71487 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:15.664658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8100dd7-73d1-4a0c-b842-5d795fa71487 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:15.666057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8100dd7-73d1-4a0c-b842-5d795fa71487 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:15.724909 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8100dd7-73d1-4a0c-b842-5d795fa71487 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086563 Aug 09 15:32:15.725697 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3506/7000] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:32:15 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:32:16.740405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2d7a36ae-f933-4ed3-a8f9-a207a11cafd6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:16.743828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2d7a36ae-f933-4ed3-a8f9-a207a11cafd6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:16.751375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d7a36ae-f933-4ed3-a8f9-a207a11cafd6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:16.752032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d7a36ae-f933-4ed3-a8f9-a207a11cafd6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:16.752576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d7a36ae-f933-4ed3-a8f9-a207a11cafd6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:16.753326 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d7a36ae-f933-4ed3-a8f9-a207a11cafd6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:16.753794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d7a36ae-f933-4ed3-a8f9-a207a11cafd6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:16.754232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2d7a36ae-f933-4ed3-a8f9-a207a11cafd6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:16.789965 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2d7a36ae-f933-4ed3-a8f9-a207a11cafd6 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055330 Aug 09 15:32:16.790578 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3495/7001] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:32:16 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:32:17.803197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9399acd8-0390-41a1-b5b8-d7d4eae18b5e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:17.806023 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9399acd8-0390-41a1-b5b8-d7d4eae18b5e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:17.815123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9399acd8-0390-41a1-b5b8-d7d4eae18b5e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:17.816077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9399acd8-0390-41a1-b5b8-d7d4eae18b5e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:17.816666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9399acd8-0390-41a1-b5b8-d7d4eae18b5e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:17.817596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9399acd8-0390-41a1-b5b8-d7d4eae18b5e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:17.818158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9399acd8-0390-41a1-b5b8-d7d4eae18b5e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:17.818689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9399acd8-0390-41a1-b5b8-d7d4eae18b5e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:17.860737 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9399acd8-0390-41a1-b5b8-d7d4eae18b5e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061795 Aug 09 15:32:17.861421 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3507/7002] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:32:17 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:32:18.875362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fd894254-1fb2-4979-8439-7176503ef13f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:18.878750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fd894254-1fb2-4979-8439-7176503ef13f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:18.888330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd894254-1fb2-4979-8439-7176503ef13f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:18.888886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd894254-1fb2-4979-8439-7176503ef13f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:18.889426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd894254-1fb2-4979-8439-7176503ef13f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:18.890312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd894254-1fb2-4979-8439-7176503ef13f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:18.890710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd894254-1fb2-4979-8439-7176503ef13f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:18.891248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fd894254-1fb2-4979-8439-7176503ef13f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:18.971026 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fd894254-1fb2-4979-8439-7176503ef13f tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099919 Aug 09 15:32:18.972172 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3496/7003] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:32:18 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:32:19.986736 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ca35f4bb-b4e0-4015-949e-6b8497a3b3c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:19.990205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ca35f4bb-b4e0-4015-949e-6b8497a3b3c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:20.000938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca35f4bb-b4e0-4015-949e-6b8497a3b3c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:20.001820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca35f4bb-b4e0-4015-949e-6b8497a3b3c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:20.002610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca35f4bb-b4e0-4015-949e-6b8497a3b3c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:20.003908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca35f4bb-b4e0-4015-949e-6b8497a3b3c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:20.004728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca35f4bb-b4e0-4015-949e-6b8497a3b3c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:20.005482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ca35f4bb-b4e0-4015-949e-6b8497a3b3c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:20.064379 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ca35f4bb-b4e0-4015-949e-6b8497a3b3c5 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082685 Aug 09 15:32:20.065417 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3508/7004] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:32:19 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:32:21.079419 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e802a8e-a08a-4794-b3e4-231d90c0fc55 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:21.083003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e802a8e-a08a-4794-b3e4-231d90c0fc55 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:21.093108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e802a8e-a08a-4794-b3e4-231d90c0fc55 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:21.094349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e802a8e-a08a-4794-b3e4-231d90c0fc55 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:21.095054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e802a8e-a08a-4794-b3e4-231d90c0fc55 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:21.096084 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e802a8e-a08a-4794-b3e4-231d90c0fc55 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:21.096945 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e802a8e-a08a-4794-b3e4-231d90c0fc55 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:21.097770 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e802a8e-a08a-4794-b3e4-231d90c0fc55 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:21.142955 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e802a8e-a08a-4794-b3e4-231d90c0fc55 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068786 Aug 09 15:32:21.144037 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3497/7005] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:32:21 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:32:22.156938 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb0fecd6-f063-49f5-b58c-96e3d57caabf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:22.159841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb0fecd6-f063-49f5-b58c-96e3d57caabf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:22.168875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb0fecd6-f063-49f5-b58c-96e3d57caabf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:22.169498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb0fecd6-f063-49f5-b58c-96e3d57caabf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:22.170128 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb0fecd6-f063-49f5-b58c-96e3d57caabf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:22.171018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb0fecd6-f063-49f5-b58c-96e3d57caabf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:22.171742 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb0fecd6-f063-49f5-b58c-96e3d57caabf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:22.172357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb0fecd6-f063-49f5-b58c-96e3d57caabf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:22.209543 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb0fecd6-f063-49f5-b58c-96e3d57caabf tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057213 Aug 09 15:32:22.210224 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3509/7006] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:32:22 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:32:22.223117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ac44adf-da48-4f98-85be-d6428d181e11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:22.223944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1ac44adf-da48-4f98-85be-d6428d181e11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:22.231927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ac44adf-da48-4f98-85be-d6428d181e11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:22.232467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ac44adf-da48-4f98-85be-d6428d181e11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:22.232949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ac44adf-da48-4f98-85be-d6428d181e11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:22.233736 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ac44adf-da48-4f98-85be-d6428d181e11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:22.234324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ac44adf-da48-4f98-85be-d6428d181e11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:22.234813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ac44adf-da48-4f98-85be-d6428d181e11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:22.326541 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-1ac44adf-da48-4f98-85be-d6428d181e11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] HTTP exception thrown: Instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 is not attached to volume fd598816-2d8e-4ca1-99f9-c1c8a528d398 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ac44adf-da48-4f98-85be-d6428d181e11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Request method failure captured: Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments/fd598816-2d8e-4ca1-99f9-c1c8a528d398 HTTP/1.1 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8n2O-gDYLSt6VQJmWOvQr0m0Zb4DqeuCFMAOlW7erNvbS6QVdD3-tNnhD_rywcHNsNxByWhCUKrZhv_2k0jRVvPE83ZpRitFdMnoP30zbzFhfKXZU6MovsRp3MHo4gI2XrTJzJ5cPYaP8fvNZb3S6wpqSaluV_W47nKyfOM9DiX7XEo Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 59dd4aa3e7c044b4af3d5613b3e99555 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_59dd4aa3e7c044b4af3d5613b3e99555", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 59dd4aa3e7c044b4af3d5613b3e99555 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestEncryptedCinderVolumes-59367429-project Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: bf6f25bb68d04f8e8c2a90c0f8411690 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestEncryptedCinderVolumes-59367429-project Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 is not attached to volume fd598816-2d8e-4ca1-99f9-c1c8a528d398 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'server_id': '7f7a8752-0b10-4e89-8f59-9becfad6b1f3', 'id': 'fd598816-2d8e-4ca1-99f9-c1c8a528d398'} Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fd598816-2d8e-4ca1-99f9-c1c8a528d398. Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 is not attached to volume fd598816-2d8e-4ca1-99f9-c1c8a528d398 Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:32:22.328679 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:32:22.335073 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:32:22.335073 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:32:22.335073 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 is not attached to volume fd598816-2d8e-4ca1-99f9-c1c8a528d398 Aug 09 15:32:22.335073 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:32:22.335073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ac44adf-da48-4f98-85be-d6428d181e11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Returning 404 to user: Instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 is not attached to volume fd598816-2d8e-4ca1-99f9-c1c8a528d398 {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:32:22.335073 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1ac44adf-da48-4f98-85be-d6428d181e11 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments/fd598816-2d8e-4ca1-99f9-c1c8a528d398" status: 404 len: 154 microversion: 2.1 time: 0.111914 Aug 09 15:32:22.335073 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3498/7007] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:32:22 2022] DELETE /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3/os-volume_attachments/fd598816-2d8e-4ca1-99f9-c1c8a528d398 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:32:25.818119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4b98ca45-a78f-4cbb-a8bc-5676477e271e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:25.818704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4b98ca45-a78f-4cbb-a8bc-5676477e271e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:25.826984 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b98ca45-a78f-4cbb-a8bc-5676477e271e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:25.827633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b98ca45-a78f-4cbb-a8bc-5676477e271e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:25.828147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b98ca45-a78f-4cbb-a8bc-5676477e271e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:25.828958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b98ca45-a78f-4cbb-a8bc-5676477e271e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:25.829524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b98ca45-a78f-4cbb-a8bc-5676477e271e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:25.830027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4b98ca45-a78f-4cbb-a8bc-5676477e271e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:25.859040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4b98ca45-a78f-4cbb-a8bc-5676477e271e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:32:25.963165 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4b98ca45-a78f-4cbb-a8bc-5676477e271e tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "DELETE /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 204 len: 0 microversion: 2.1 time: 0.148195 Aug 09 15:32:25.964093 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3510/7008] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:32:25 2022] DELETE /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:32:25.974302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f7c69d31-910f-46d0-8d5e-fbebb7af77a1 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:25.975375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f7c69d31-910f-46d0-8d5e-fbebb7af77a1 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:25.985758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7c69d31-910f-46d0-8d5e-fbebb7af77a1 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:25.986455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7c69d31-910f-46d0-8d5e-fbebb7af77a1 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:25.987061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7c69d31-910f-46d0-8d5e-fbebb7af77a1 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:25.987942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7c69d31-910f-46d0-8d5e-fbebb7af77a1 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:25.988511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7c69d31-910f-46d0-8d5e-fbebb7af77a1 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:25.988995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f7c69d31-910f-46d0-8d5e-fbebb7af77a1 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:26.174396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f7c69d31-910f-46d0-8d5e-fbebb7af77a1 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:32:26.192660 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f7c69d31-910f-46d0-8d5e-fbebb7af77a1 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1561 microversion: 2.1 time: 0.221831 Aug 09 15:32:26.194129 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3499/7009] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:32:25 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1561 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:32:27.239478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6d456844-fcc8-4ed7-8f9a-2d186179dfef tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:27.240205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6d456844-fcc8-4ed7-8f9a-2d186179dfef tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:27.248179 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d456844-fcc8-4ed7-8f9a-2d186179dfef tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:27.248819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d456844-fcc8-4ed7-8f9a-2d186179dfef tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:27.249117 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d456844-fcc8-4ed7-8f9a-2d186179dfef tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:27.249841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d456844-fcc8-4ed7-8f9a-2d186179dfef tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:27.250299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d456844-fcc8-4ed7-8f9a-2d186179dfef tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:27.250729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6d456844-fcc8-4ed7-8f9a-2d186179dfef tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:27.429785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6d456844-fcc8-4ed7-8f9a-2d186179dfef tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:32:27.438498 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6d456844-fcc8-4ed7-8f9a-2d186179dfef tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1561 microversion: 2.1 time: 0.203528 Aug 09 15:32:27.439148 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3511/7010] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:32:27 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1561 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:32:28.179310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-fb461ffd-59c2-4f83-b7e1-ffacb879af86 req-6c87863e-b34f-4086-a5a3-17027f7682d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7a8752-0b10-4e89-8f59-9becfad6b1f3", "name": "network-vif-deleted", "tag": "ffce4bf2-c05f-4d18-8905-fb315eba6671"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:32:28.194972 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-fb461ffd-59c2-4f83-b7e1-ffacb879af86 req-6c87863e-b34f-4086-a5a3-17027f7682d1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:28.195787 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-fb461ffd-59c2-4f83-b7e1-ffacb879af86 req-6c87863e-b34f-4086-a5a3-17027f7682d1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:28.196376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-fb461ffd-59c2-4f83-b7e1-ffacb879af86 req-6c87863e-b34f-4086-a5a3-17027f7682d1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:28.215382 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-fb461ffd-59c2-4f83-b7e1-ffacb879af86 req-6c87863e-b34f-4086-a5a3-17027f7682d1 service nova] Creating event network-vif-deleted:ffce4bf2-c05f-4d18-8905-fb315eba6671 for instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 on n-h1-844626-8 Aug 09 15:32:28.222231 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-fb461ffd-59c2-4f83-b7e1-ffacb879af86 req-6c87863e-b34f-4086-a5a3-17027f7682d1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047786 Aug 09 15:32:28.223299 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3500/7011] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:32:28.466283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:28.467461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:28.480764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:28.482043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:28.482815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:28.484121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:28.484937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:28.485688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:28.548543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:28.549587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:28.550373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:28.551233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lazy-loading 'fault' on Instance uuid 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:32:28.615351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf6f25bb68d04f8e8c2a90c0f8411690', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd4aa3e7c044b4af3d5613b3e99555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:32:28.633162 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-243e87f4-b7fe-440e-aa55-aef665e49f16 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 200 len: 1352 microversion: 2.1 time: 0.173344 Aug 09 15:32:28.634410 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3512/7012] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:32:28 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 1352 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:32:29.668074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4b8e061-df9e-4739-a1bc-94f8a5426f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:29.669077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b4b8e061-df9e-4739-a1bc-94f8a5426f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] [instance: 7f7a8752-0b10-4e89-8f59-9becfad6b1f3] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:32:29.677123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4b8e061-df9e-4739-a1bc-94f8a5426f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:29.677765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4b8e061-df9e-4739-a1bc-94f8a5426f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:29.678217 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4b8e061-df9e-4739-a1bc-94f8a5426f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:29.679017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4b8e061-df9e-4739-a1bc-94f8a5426f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:32:29.679664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4b8e061-df9e-4739-a1bc-94f8a5426f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:32:29.680209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b4b8e061-df9e-4739-a1bc-94f8a5426f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:32:29.697718 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-b4b8e061-df9e-4739-a1bc-94f8a5426f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] HTTP exception thrown: Instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 could not be found. Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4b8e061-df9e-4739-a1bc-94f8a5426f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Request method failure captured: Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 HTTP/1.1 Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8n2O-gDYLSt6VQJmWOvQr0m0Zb4DqeuCFMAOlW7erNvbS6QVdD3-tNnhD_rywcHNsNxByWhCUKrZhv_2k0jRVvPE83ZpRitFdMnoP30zbzFhfKXZU6MovsRp3MHo4gI2XrTJzJ5cPYaP8fvNZb3S6wpqSaluV_W47nKyfOM9DiX7XEo Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 59dd4aa3e7c044b4af3d5613b3e99555 Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_59dd4aa3e7c044b4af3d5613b3e99555", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/59dd4aa3e7c044b4af3d5613b3e99555"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 59dd4aa3e7c044b4af3d5613b3e99555 Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-59367429 Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestEncryptedCinderVolumes-59367429-project Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: bf6f25bb68d04f8e8c2a90c0f8411690 Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestEncryptedCinderVolumes-59367429-project Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 could not be found. Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '7f7a8752-0b10-4e89-8f59-9becfad6b1f3'} Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 could not be found. Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 could not be found. Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:32:29.699859 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:32:29.707635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:32:29.707635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:32:29.707635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:32:29.707635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:32:29.707635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:32:29.707635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 could not be found. Aug 09 15:32:29.707635 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:32:29.707635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b4b8e061-df9e-4739-a1bc-94f8a5426f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Returning 404 to user: Instance 7f7a8752-0b10-4e89-8f59-9becfad6b1f3 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:32:29.707635 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b4b8e061-df9e-4739-a1bc-94f8a5426f5a tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3" status: 404 len: 111 microversion: 2.1 time: 0.040163 Aug 09 15:32:29.707635 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3501/7013] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:32:29 2022] GET /compute/v2.1/servers/7f7a8752-0b10-4e89-8f59-9becfad6b1f3 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 15:32:29.713780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0b1be9df-678c-4129-b563-6f741bbaa8f3 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] Calling method '.version_select at 0x7f41e751dee0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:32:29.739901 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0b1be9df-678c-4129-b563-6f741bbaa8f3 tempest-TestEncryptedCinderVolumes-59367429 tempest-TestEncryptedCinderVolumes-59367429-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1855189859" status: 202 len: 0 microversion: 2.1 time: 0.030948 Aug 09 15:32:29.740693 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3513/7014] 10.222.0.50 () {58 vars in 1278 bytes} [Tue Aug 9 15:32:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1855189859 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:33:05.157643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ded5fd9-a18b-4dad-936f-3b663e791fd5 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Action: 'create', calling method: .version_select at 0x7f41ddd4daf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-325738739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWCdglnNVhkJ9RJuP9a65/RuXmme0kDi3PIT72wz9G22geeZUSNZsusl8YqJhzEqdAPZz8leqSb1NJsg+L/F3a27J4xH6+ww5o3WjV6y/UhMwYQVLxnj+1CHNd23RISQQ=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:33:05.163984 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=16 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:33:05.164672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:33:05.179250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-1ded5fd9-a18b-4dad-936f-3b663e791fd5 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Getting quotas for project 77754f57df154a578dd66a6cf0164654. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:33:05.185664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-1ded5fd9-a18b-4dad-936f-3b663e791fd5 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Getting quotas for user 175a9e49f1a64a3c8d5d5e5c8cc62998 and project 77754f57df154a578dd66a6cf0164654. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:33:05.214443 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1ded5fd9-a18b-4dad-936f-3b663e791fd5 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061056 Aug 09 15:33:05.215152 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3502/7015] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:33:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:33:05.273644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:33:05.274910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:33:05.282411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1017642925", "imageRef": "64b0f141-3c0e-4e3f-8e15-ab449ddfbb02", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-325738739", "networks": [{"uuid": "b5d492ee-c7e8-4e1f-a20d-fd1f0322e252"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:33:05.368864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] validate_networks() for [('b5d492ee-c7e8-4e1f-a20d-fd1f0322e252', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:33:05.825509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:33:05.825932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:33:05.826492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:33:05.826917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:33:05.827350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:33:05.838051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:05.838539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:05.838975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:05.839766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:05.840217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:05.840686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:05.861027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Getting quotas for project 77754f57df154a578dd66a6cf0164654. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:33:05.867332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Getting quotas for user 175a9e49f1a64a3c8d5d5e5c8cc62998 and project 77754f57df154a578dd66a6cf0164654. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:33:05.883459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:33:05.885900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64b0f141-3c0e-4e3f-8e15-ab449ddfbb02',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:33:05.936270 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [18a0f6bf-2f33-43d1-b92b-51304770c0fb] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 15:33:06.946013 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [18a0f6bf-2f33-43d1-b92b-51304770c0fb] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52002. Aug 09 15:33:06.950995 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-afbbc2b4-b509-4a0d-8880-2f214fbe542a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.681395 Aug 09 15:33:06.951742 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3514/7016] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:33:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:33:06.965501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-87520af4-15c8-49a5-8719-8e9046a12457 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:06.966198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-87520af4-15c8-49a5-8719-8e9046a12457 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:07.059142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-87520af4-15c8-49a5-8719-8e9046a12457 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:07.068289 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-87520af4-15c8-49a5-8719-8e9046a12457 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1258 microversion: 2.1 time: 0.108895 Aug 09 15:33:07.069098 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3503/7017] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:06 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1258 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:33:08.094134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-687a40c4-fd56-44a5-a24e-5a3131aebc16 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:08.094995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-687a40c4-fd56-44a5-a24e-5a3131aebc16 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:08.104888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-687a40c4-fd56-44a5-a24e-5a3131aebc16 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:08.105497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-687a40c4-fd56-44a5-a24e-5a3131aebc16 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:08.106493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-687a40c4-fd56-44a5-a24e-5a3131aebc16 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:08.107306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-687a40c4-fd56-44a5-a24e-5a3131aebc16 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:08.107915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-687a40c4-fd56-44a5-a24e-5a3131aebc16 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:08.108471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-687a40c4-fd56-44a5-a24e-5a3131aebc16 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:08.214409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-687a40c4-fd56-44a5-a24e-5a3131aebc16 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:08.226721 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-687a40c4-fd56-44a5-a24e-5a3131aebc16 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1310 microversion: 2.1 time: 0.138526 Aug 09 15:33:08.227381 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3515/7018] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:08 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1310 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:09.258253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-136cef4b-255a-43d6-b1ae-8ce02ac6eca4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:09.259979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-136cef4b-255a-43d6-b1ae-8ce02ac6eca4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:09.303289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-136cef4b-255a-43d6-b1ae-8ce02ac6eca4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:09.309123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-136cef4b-255a-43d6-b1ae-8ce02ac6eca4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:09.312493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-136cef4b-255a-43d6-b1ae-8ce02ac6eca4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:09.317385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-136cef4b-255a-43d6-b1ae-8ce02ac6eca4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:09.318899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-136cef4b-255a-43d6-b1ae-8ce02ac6eca4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:09.321013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-136cef4b-255a-43d6-b1ae-8ce02ac6eca4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:09.710267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-136cef4b-255a-43d6-b1ae-8ce02ac6eca4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:09.724586 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-136cef4b-255a-43d6-b1ae-8ce02ac6eca4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.477475 Aug 09 15:33:09.725219 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3504/7019] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:09 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:10.766092 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b1a4b3d-4e38-4fd0-8f1c-f45227c94853 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:10.767287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b1a4b3d-4e38-4fd0-8f1c-f45227c94853 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:10.779618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b1a4b3d-4e38-4fd0-8f1c-f45227c94853 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:10.780616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b1a4b3d-4e38-4fd0-8f1c-f45227c94853 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:10.781470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b1a4b3d-4e38-4fd0-8f1c-f45227c94853 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:10.782814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b1a4b3d-4e38-4fd0-8f1c-f45227c94853 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:10.783793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b1a4b3d-4e38-4fd0-8f1c-f45227c94853 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:10.784667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b1a4b3d-4e38-4fd0-8f1c-f45227c94853 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:11.089918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b1a4b3d-4e38-4fd0-8f1c-f45227c94853 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:11.101950 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b1a4b3d-4e38-4fd0-8f1c-f45227c94853 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.340955 Aug 09 15:33:11.103149 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3516/7020] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:10 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:12.134519 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c1251830-16bf-486a-ae3a-7d34166c34ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:12.136604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c1251830-16bf-486a-ae3a-7d34166c34ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:12.153432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1251830-16bf-486a-ae3a-7d34166c34ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:12.155384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1251830-16bf-486a-ae3a-7d34166c34ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:12.156660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1251830-16bf-486a-ae3a-7d34166c34ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:12.158804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1251830-16bf-486a-ae3a-7d34166c34ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:12.160843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1251830-16bf-486a-ae3a-7d34166c34ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:12.162994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c1251830-16bf-486a-ae3a-7d34166c34ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:12.366235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c1251830-16bf-486a-ae3a-7d34166c34ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:12.380531 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c1251830-16bf-486a-ae3a-7d34166c34ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.256017 Aug 09 15:33:12.381631 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3505/7021] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:12 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:13.404910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33a3cd3a-aafb-4d24-b4f0-ace25636d94f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:13.405657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-33a3cd3a-aafb-4d24-b4f0-ace25636d94f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:13.412912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33a3cd3a-aafb-4d24-b4f0-ace25636d94f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:13.413424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33a3cd3a-aafb-4d24-b4f0-ace25636d94f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:13.413857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33a3cd3a-aafb-4d24-b4f0-ace25636d94f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:13.414573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33a3cd3a-aafb-4d24-b4f0-ace25636d94f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:13.415022 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33a3cd3a-aafb-4d24-b4f0-ace25636d94f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:13.415454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33a3cd3a-aafb-4d24-b4f0-ace25636d94f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:13.630197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-33a3cd3a-aafb-4d24-b4f0-ace25636d94f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:13.647538 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-33a3cd3a-aafb-4d24-b4f0-ace25636d94f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.246489 Aug 09 15:33:13.649019 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3517/7022] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:13 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:14.680659 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-beeabb4d-3fa0-4fd2-bf83-d9b2ab0c05af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:14.681788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-beeabb4d-3fa0-4fd2-bf83-d9b2ab0c05af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:14.693911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beeabb4d-3fa0-4fd2-bf83-d9b2ab0c05af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:14.694742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beeabb4d-3fa0-4fd2-bf83-d9b2ab0c05af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:14.695661 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beeabb4d-3fa0-4fd2-bf83-d9b2ab0c05af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:14.696976 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beeabb4d-3fa0-4fd2-bf83-d9b2ab0c05af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:14.697926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beeabb4d-3fa0-4fd2-bf83-d9b2ab0c05af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:14.698726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-beeabb4d-3fa0-4fd2-bf83-d9b2ab0c05af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:14.927911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-beeabb4d-3fa0-4fd2-bf83-d9b2ab0c05af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:14.936846 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-beeabb4d-3fa0-4fd2-bf83-d9b2ab0c05af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.263817 Aug 09 15:33:14.937380 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3506/7023] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:14 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:15.962313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b45c9ae9-ee52-4e12-8d2a-551d05bbb2c6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:15.965228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b45c9ae9-ee52-4e12-8d2a-551d05bbb2c6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:15.971144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:33:15.972596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:33:15.983932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b45c9ae9-ee52-4e12-8d2a-551d05bbb2c6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:15.984789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b45c9ae9-ee52-4e12-8d2a-551d05bbb2c6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:15.985516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b45c9ae9-ee52-4e12-8d2a-551d05bbb2c6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:15.986757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b45c9ae9-ee52-4e12-8d2a-551d05bbb2c6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:15.987532 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b45c9ae9-ee52-4e12-8d2a-551d05bbb2c6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:15.988183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b45c9ae9-ee52-4e12-8d2a-551d05bbb2c6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:16.170202 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b45c9ae9-ee52-4e12-8d2a-551d05bbb2c6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:16.186449 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b45c9ae9-ee52-4e12-8d2a-551d05bbb2c6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.230172 Aug 09 15:33:16.199657 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3518/7024] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:15 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:33:17.225548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79a7b126-652d-4584-8ae4-3fd00a340f0a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:17.226465 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-79a7b126-652d-4584-8ae4-3fd00a340f0a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:17.237577 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:33:17.242155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79a7b126-652d-4584-8ae4-3fd00a340f0a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:17.243581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79a7b126-652d-4584-8ae4-3fd00a340f0a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:17.244327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79a7b126-652d-4584-8ae4-3fd00a340f0a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:17.246119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79a7b126-652d-4584-8ae4-3fd00a340f0a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:17.247536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79a7b126-652d-4584-8ae4-3fd00a340f0a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:17.248516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79a7b126-652d-4584-8ae4-3fd00a340f0a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:17.615355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-79a7b126-652d-4584-8ae4-3fd00a340f0a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:17.635361 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-79a7b126-652d-4584-8ae4-3fd00a340f0a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.413281 Aug 09 15:33:17.639146 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3507/7025] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:17 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:18.679619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e3fc3f55-caa3-4b93-a39b-55ffcbdd8917 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:18.680882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e3fc3f55-caa3-4b93-a39b-55ffcbdd8917 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:18.689757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3fc3f55-caa3-4b93-a39b-55ffcbdd8917 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:18.690252 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3fc3f55-caa3-4b93-a39b-55ffcbdd8917 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:18.690724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3fc3f55-caa3-4b93-a39b-55ffcbdd8917 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:18.691509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3fc3f55-caa3-4b93-a39b-55ffcbdd8917 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:18.691966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3fc3f55-caa3-4b93-a39b-55ffcbdd8917 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:18.692394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e3fc3f55-caa3-4b93-a39b-55ffcbdd8917 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:18.865118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e3fc3f55-caa3-4b93-a39b-55ffcbdd8917 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:18.874226 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e3fc3f55-caa3-4b93-a39b-55ffcbdd8917 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.205349 Aug 09 15:33:18.874866 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3519/7026] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:18 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:19.899234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c7f65dd5-7a41-4257-9b29-492154c94095 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:19.900525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c7f65dd5-7a41-4257-9b29-492154c94095 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:19.913236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7f65dd5-7a41-4257-9b29-492154c94095 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:19.914015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7f65dd5-7a41-4257-9b29-492154c94095 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:19.914620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7f65dd5-7a41-4257-9b29-492154c94095 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:19.915868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7f65dd5-7a41-4257-9b29-492154c94095 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:19.916949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7f65dd5-7a41-4257-9b29-492154c94095 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:19.917756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c7f65dd5-7a41-4257-9b29-492154c94095 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:20.195420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c7f65dd5-7a41-4257-9b29-492154c94095 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:20.210447 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c7f65dd5-7a41-4257-9b29-492154c94095 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.317741 Aug 09 15:33:20.211687 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3508/7027] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:19 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:20.308839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-1bd6a036-5989-4a88-a54b-d54903bbf5cd req-09bcde1f-59b0-414d-8b7d-b7e2e77db16f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa4114c-d443-483c-b399-08c8425b35cc", "tag": "f0e24676-2477-4f10-8247-8a08cd06fe42"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:33:20.320365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1bd6a036-5989-4a88-a54b-d54903bbf5cd req-09bcde1f-59b0-414d-8b7d-b7e2e77db16f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:20.320843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1bd6a036-5989-4a88-a54b-d54903bbf5cd req-09bcde1f-59b0-414d-8b7d-b7e2e77db16f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:20.321287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-1bd6a036-5989-4a88-a54b-d54903bbf5cd req-09bcde1f-59b0-414d-8b7d-b7e2e77db16f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:20.334181 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-1bd6a036-5989-4a88-a54b-d54903bbf5cd req-09bcde1f-59b0-414d-8b7d-b7e2e77db16f service nova] Creating event network-changed:f0e24676-2477-4f10-8247-8a08cd06fe42 for instance 0aa4114c-d443-483c-b399-08c8425b35cc on n-h2-844626-8 Aug 09 15:33:20.340326 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-1bd6a036-5989-4a88-a54b-d54903bbf5cd req-09bcde1f-59b0-414d-8b7d-b7e2e77db16f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036615 Aug 09 15:33:20.340976 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3520/7028] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:33:21.235493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0b584a99-6cad-47d5-abbe-5c0c76cfdc8e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:21.236130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0b584a99-6cad-47d5-abbe-5c0c76cfdc8e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:21.245474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b584a99-6cad-47d5-abbe-5c0c76cfdc8e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:21.245986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b584a99-6cad-47d5-abbe-5c0c76cfdc8e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:21.246472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b584a99-6cad-47d5-abbe-5c0c76cfdc8e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:21.247242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b584a99-6cad-47d5-abbe-5c0c76cfdc8e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:21.247716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b584a99-6cad-47d5-abbe-5c0c76cfdc8e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:21.248159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0b584a99-6cad-47d5-abbe-5c0c76cfdc8e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:21.414545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0b584a99-6cad-47d5-abbe-5c0c76cfdc8e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:21.429117 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0b584a99-6cad-47d5-abbe-5c0c76cfdc8e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.197176 Aug 09 15:33:21.430161 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3509/7029] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:21 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:22.467826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b12708a7-d2b8-45ae-87fb-96e7c907beef tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:22.468820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b12708a7-d2b8-45ae-87fb-96e7c907beef tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:22.476630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b12708a7-d2b8-45ae-87fb-96e7c907beef tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:22.477277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b12708a7-d2b8-45ae-87fb-96e7c907beef tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:22.478064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b12708a7-d2b8-45ae-87fb-96e7c907beef tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:22.479624 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b12708a7-d2b8-45ae-87fb-96e7c907beef tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:22.480479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b12708a7-d2b8-45ae-87fb-96e7c907beef tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:22.481250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b12708a7-d2b8-45ae-87fb-96e7c907beef tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:22.665790 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b12708a7-d2b8-45ae-87fb-96e7c907beef tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:22.676005 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b12708a7-d2b8-45ae-87fb-96e7c907beef tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.215836 Aug 09 15:33:22.677128 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3521/7030] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:22 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:23.703057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-421efb39-f461-4bd1-8b4a-10671b5dd259 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:23.704158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-421efb39-f461-4bd1-8b4a-10671b5dd259 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:23.715839 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-421efb39-f461-4bd1-8b4a-10671b5dd259 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:23.716749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-421efb39-f461-4bd1-8b4a-10671b5dd259 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:23.717940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-421efb39-f461-4bd1-8b4a-10671b5dd259 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:23.718918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-421efb39-f461-4bd1-8b4a-10671b5dd259 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:23.719468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-421efb39-f461-4bd1-8b4a-10671b5dd259 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:23.719954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-421efb39-f461-4bd1-8b4a-10671b5dd259 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:23.881473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-421efb39-f461-4bd1-8b4a-10671b5dd259 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:23.890504 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-421efb39-f461-4bd1-8b4a-10671b5dd259 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.192873 Aug 09 15:33:23.891220 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3510/7031] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:23 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:24.845889 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-bbe81cf5-ec32-45c4-8d89-58f375823cf3 req-63460ff0-f092-46ff-9c7e-2d64552ad559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa4114c-d443-483c-b399-08c8425b35cc", "name": "network-vif-plugged", "status": "completed", "tag": "f0e24676-2477-4f10-8247-8a08cd06fe42"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:33:24.865820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bbe81cf5-ec32-45c4-8d89-58f375823cf3 req-63460ff0-f092-46ff-9c7e-2d64552ad559 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:24.866697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bbe81cf5-ec32-45c4-8d89-58f375823cf3 req-63460ff0-f092-46ff-9c7e-2d64552ad559 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:24.867526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bbe81cf5-ec32-45c4-8d89-58f375823cf3 req-63460ff0-f092-46ff-9c7e-2d64552ad559 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:24.890476 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-bbe81cf5-ec32-45c4-8d89-58f375823cf3 req-63460ff0-f092-46ff-9c7e-2d64552ad559 service nova] Creating event network-vif-plugged:f0e24676-2477-4f10-8247-8a08cd06fe42 for instance 0aa4114c-d443-483c-b399-08c8425b35cc on n-h2-844626-8 Aug 09 15:33:24.900187 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-bbe81cf5-ec32-45c4-8d89-58f375823cf3 req-63460ff0-f092-46ff-9c7e-2d64552ad559 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061579 Aug 09 15:33:24.901347 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3522/7032] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:33:24.917125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60bfaa38-3833-4385-b6cb-12a7aa948319 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:24.919866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60bfaa38-3833-4385-b6cb-12a7aa948319 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:24.935753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60bfaa38-3833-4385-b6cb-12a7aa948319 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:24.936653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60bfaa38-3833-4385-b6cb-12a7aa948319 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:24.937467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60bfaa38-3833-4385-b6cb-12a7aa948319 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:24.938769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60bfaa38-3833-4385-b6cb-12a7aa948319 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:24.939623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60bfaa38-3833-4385-b6cb-12a7aa948319 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:24.940428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60bfaa38-3833-4385-b6cb-12a7aa948319 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:25.208670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60bfaa38-3833-4385-b6cb-12a7aa948319 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:25.218708 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60bfaa38-3833-4385-b6cb-12a7aa948319 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.309214 Aug 09 15:33:25.219386 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3511/7033] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:24 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:26.244574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-655549a1-cb10-443b-b734-5c876024533f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:26.245261 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-655549a1-cb10-443b-b734-5c876024533f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:26.253529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-655549a1-cb10-443b-b734-5c876024533f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:26.254170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-655549a1-cb10-443b-b734-5c876024533f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:26.254709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-655549a1-cb10-443b-b734-5c876024533f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:26.255623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-655549a1-cb10-443b-b734-5c876024533f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:26.256285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-655549a1-cb10-443b-b734-5c876024533f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:26.256799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-655549a1-cb10-443b-b734-5c876024533f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:26.445197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-655549a1-cb10-443b-b734-5c876024533f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:26.454026 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-655549a1-cb10-443b-b734-5c876024533f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1358 microversion: 2.1 time: 0.216093 Aug 09 15:33:26.454634 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3523/7034] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:26 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:27.477586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-77d94b7e-9c4c-438e-9faf-b429a666c96e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:27.478552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77d94b7e-9c4c-438e-9faf-b429a666c96e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:27.486954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77d94b7e-9c4c-438e-9faf-b429a666c96e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:27.487567 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77d94b7e-9c4c-438e-9faf-b429a666c96e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:27.488013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77d94b7e-9c4c-438e-9faf-b429a666c96e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:27.488824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77d94b7e-9c4c-438e-9faf-b429a666c96e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:27.489300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77d94b7e-9c4c-438e-9faf-b429a666c96e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:27.489745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77d94b7e-9c4c-438e-9faf-b429a666c96e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:27.663516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-77d94b7e-9c4c-438e-9faf-b429a666c96e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:27.672897 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-77d94b7e-9c4c-438e-9faf-b429a666c96e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1547 microversion: 2.1 time: 0.199384 Aug 09 15:33:27.673605 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3512/7035] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:27 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1547 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:27.696716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81204151-75cb-49da-a47f-ccf09f321efb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:27.697710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-81204151-75cb-49da-a47f-ccf09f321efb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:27.706837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81204151-75cb-49da-a47f-ccf09f321efb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:27.707460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81204151-75cb-49da-a47f-ccf09f321efb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:27.707947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81204151-75cb-49da-a47f-ccf09f321efb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:27.708744 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81204151-75cb-49da-a47f-ccf09f321efb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:27.709214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81204151-75cb-49da-a47f-ccf09f321efb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:27.709628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81204151-75cb-49da-a47f-ccf09f321efb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:27.879334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-81204151-75cb-49da-a47f-ccf09f321efb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:27.889126 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81204151-75cb-49da-a47f-ccf09f321efb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1547 microversion: 2.1 time: 0.197479 Aug 09 15:33:27.889848 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3524/7036] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:27 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1547 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:27.912622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1e3c6b3d-4b3a-49d3-8322-25881ecd3700 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:27.918818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1e3c6b3d-4b3a-49d3-8322-25881ecd3700 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:27.919797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1e3c6b3d-4b3a-49d3-8322-25881ecd3700 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Searching by: {'deleted': False, 'project_id': '77754f57df154a578dd66a6cf0164654'} {{(pid=119406) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 15:33:27.927379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e3c6b3d-4b3a-49d3-8322-25881ecd3700 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:27.927880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e3c6b3d-4b3a-49d3-8322-25881ecd3700 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:27.928347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e3c6b3d-4b3a-49d3-8322-25881ecd3700 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:27.929280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e3c6b3d-4b3a-49d3-8322-25881ecd3700 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:27.929650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e3c6b3d-4b3a-49d3-8322-25881ecd3700 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:27.930354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1e3c6b3d-4b3a-49d3-8322-25881ecd3700 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:27.963637 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.multi_cell_list [None req-1e3c6b3d-4b3a-49d3-8322-25881ecd3700 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119406) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 15:33:28.000759 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1e3c6b3d-4b3a-49d3-8322-25881ecd3700 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.092846 Aug 09 15:33:28.001399 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3513/7037] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 15:33:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:33:28.015686 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1dc3fdad-2e42-4412-8f4e-44c3e2502fd0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:28.016266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1dc3fdad-2e42-4412-8f4e-44c3e2502fd0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:28.024658 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1dc3fdad-2e42-4412-8f4e-44c3e2502fd0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:28.025555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1dc3fdad-2e42-4412-8f4e-44c3e2502fd0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:28.026113 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1dc3fdad-2e42-4412-8f4e-44c3e2502fd0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:28.027274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1dc3fdad-2e42-4412-8f4e-44c3e2502fd0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:28.027785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1dc3fdad-2e42-4412-8f4e-44c3e2502fd0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:28.028245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1dc3fdad-2e42-4412-8f4e-44c3e2502fd0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:28.225044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1dc3fdad-2e42-4412-8f4e-44c3e2502fd0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:28.234200 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1dc3fdad-2e42-4412-8f4e-44c3e2502fd0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1547 microversion: 2.1 time: 0.223323 Aug 09 15:33:28.234867 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3525/7038] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:28 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1547 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:29.892621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-298f29e1-6be9-4f4d-81ca-65b3ba0fda25 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d41cecd3-49d6-419a-97dc-773e3e7b3043"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:33:29.895202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-298f29e1-6be9-4f4d-81ca-65b3ba0fda25 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:29.903718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-298f29e1-6be9-4f4d-81ca-65b3ba0fda25 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:29.904268 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-298f29e1-6be9-4f4d-81ca-65b3ba0fda25 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:29.904758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-298f29e1-6be9-4f4d-81ca-65b3ba0fda25 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:29.905534 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-298f29e1-6be9-4f4d-81ca-65b3ba0fda25 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:29.906120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-298f29e1-6be9-4f4d-81ca-65b3ba0fda25 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:29.906614 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-298f29e1-6be9-4f4d-81ca-65b3ba0fda25 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:30.434994 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-298f29e1-6be9-4f4d-81ca-65b3ba0fda25 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "POST /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.546294 Aug 09 15:33:30.435722 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3514/7039] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 15:33:29 2022] POST /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments => generated 194 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:33:44.805130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9a3b7ea0-93cb-4077-8e71-a2a3f91e61af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:44.806370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9a3b7ea0-93cb-4077-8e71-a2a3f91e61af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:44.811115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:33:44.812276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=60 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:33:44.824773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a3b7ea0-93cb-4077-8e71-a2a3f91e61af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:44.825608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a3b7ea0-93cb-4077-8e71-a2a3f91e61af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:44.826358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a3b7ea0-93cb-4077-8e71-a2a3f91e61af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:44.827620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a3b7ea0-93cb-4077-8e71-a2a3f91e61af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:44.828411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a3b7ea0-93cb-4077-8e71-a2a3f91e61af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:44.829160 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9a3b7ea0-93cb-4077-8e71-a2a3f91e61af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:45.219416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9a3b7ea0-93cb-4077-8e71-a2a3f91e61af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:45.229245 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9a3b7ea0-93cb-4077-8e71-a2a3f91e61af tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1593 microversion: 2.1 time: 0.431668 Aug 09 15:33:45.229900 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3526/7040] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:44 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1593 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:33:47.622557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-bae7a074-c972-4430-a73a-541ff4952bea req-25a8a724-170a-4f5d-8e85-a029a59282d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa4114c-d443-483c-b399-08c8425b35cc", "tag": "f0e24676-2477-4f10-8247-8a08cd06fe42"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:33:47.635291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:33:47.637113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:33:47.638291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:33:47.652621 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bae7a074-c972-4430-a73a-541ff4952bea req-25a8a724-170a-4f5d-8e85-a029a59282d7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:47.653497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bae7a074-c972-4430-a73a-541ff4952bea req-25a8a724-170a-4f5d-8e85-a029a59282d7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:47.654300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-bae7a074-c972-4430-a73a-541ff4952bea req-25a8a724-170a-4f5d-8e85-a029a59282d7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:47.679350 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-bae7a074-c972-4430-a73a-541ff4952bea req-25a8a724-170a-4f5d-8e85-a029a59282d7 service nova] Creating event network-changed:f0e24676-2477-4f10-8247-8a08cd06fe42 for instance 0aa4114c-d443-483c-b399-08c8425b35cc on n-h2-844626-8 Aug 09 15:33:47.689103 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-bae7a074-c972-4430-a73a-541ff4952bea req-25a8a724-170a-4f5d-8e85-a029a59282d7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073819 Aug 09 15:33:47.690204 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3515/7041] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:33:49.449894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9b96290-d003-48dc-83fb-cd33bd6f0313 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1668766161"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:33:49.451517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e9b96290-d003-48dc-83fb-cd33bd6f0313 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:49.462468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9b96290-d003-48dc-83fb-cd33bd6f0313 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:49.464101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9b96290-d003-48dc-83fb-cd33bd6f0313 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:49.465107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9b96290-d003-48dc-83fb-cd33bd6f0313 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:49.466650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9b96290-d003-48dc-83fb-cd33bd6f0313 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:49.467229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9b96290-d003-48dc-83fb-cd33bd6f0313 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:49.467700 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9b96290-d003-48dc-83fb-cd33bd6f0313 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:49.703001 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.network.security_group_api [None req-e9b96290-d003-48dc-83fb-cd33bd6f0313 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Adding security group 25ee5925-8c02-42fa-98f6-3b1be6f41297 to port f0e24676-2477-4f10-8247-8a08cd06fe42 Aug 09 15:33:50.159022 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e9b96290-d003-48dc-83fb-cd33bd6f0313 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "POST /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/action" status: 202 len: 0 microversion: 2.1 time: 0.714533 Aug 09 15:33:50.162154 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3527/7042] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:33:49 2022] POST /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:33:50.171392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-601be518-96ed-4836-8ad3-7c2dcf4c98a9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:33:50.172392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-601be518-96ed-4836-8ad3-7c2dcf4c98a9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:33:50.174591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7e7dbe90-5635-4b63-aea1-83033d179abd req-0be5e564-ed21-4c37-88fc-d6d9c897438e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa4114c-d443-483c-b399-08c8425b35cc", "tag": "f0e24676-2477-4f10-8247-8a08cd06fe42"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:33:50.182047 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601be518-96ed-4836-8ad3-7c2dcf4c98a9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:50.182838 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601be518-96ed-4836-8ad3-7c2dcf4c98a9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:50.183552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601be518-96ed-4836-8ad3-7c2dcf4c98a9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:50.184484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601be518-96ed-4836-8ad3-7c2dcf4c98a9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:50.185132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601be518-96ed-4836-8ad3-7c2dcf4c98a9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:50.185896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-601be518-96ed-4836-8ad3-7c2dcf4c98a9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:50.215535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7e7dbe90-5635-4b63-aea1-83033d179abd req-0be5e564-ed21-4c37-88fc-d6d9c897438e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:33:50.216742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7e7dbe90-5635-4b63-aea1-83033d179abd req-0be5e564-ed21-4c37-88fc-d6d9c897438e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:33:50.217521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7e7dbe90-5635-4b63-aea1-83033d179abd req-0be5e564-ed21-4c37-88fc-d6d9c897438e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:33:50.248345 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7e7dbe90-5635-4b63-aea1-83033d179abd req-0be5e564-ed21-4c37-88fc-d6d9c897438e service nova] Creating event network-changed:f0e24676-2477-4f10-8247-8a08cd06fe42 for instance 0aa4114c-d443-483c-b399-08c8425b35cc on n-h2-844626-8 Aug 09 15:33:50.260629 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7e7dbe90-5635-4b63-aea1-83033d179abd req-0be5e564-ed21-4c37-88fc-d6d9c897438e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093344 Aug 09 15:33:50.264230 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3516/7043] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:33:50.685191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-601be518-96ed-4836-8ad3-7c2dcf4c98a9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:33:50.710662 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-601be518-96ed-4836-8ad3-7c2dcf4c98a9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1759 microversion: 2.1 time: 0.543261 Aug 09 15:33:50.728393 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3528/7044] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:33:50 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1759 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:35:29.138084 n-d-844626-8 devstack@n-api.service[119406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2072e827-cf31-416a-97b9-dec37834bdb2] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:35:29.139985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:35:29.141239 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:35:29.149322 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a6a6df54-4e78-4184-b3a7-527837135f3f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:35:29.153415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a6a6df54-4e78-4184-b3a7-527837135f3f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:35:29.166023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6a6df54-4e78-4184-b3a7-527837135f3f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:35:29.166893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6a6df54-4e78-4184-b3a7-527837135f3f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:35:29.167739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6a6df54-4e78-4184-b3a7-527837135f3f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:35:29.169012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6a6df54-4e78-4184-b3a7-527837135f3f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:35:29.169852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6a6df54-4e78-4184-b3a7-527837135f3f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:35:29.170610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6a6df54-4e78-4184-b3a7-527837135f3f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:35:29.304438 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a6a6df54-4e78-4184-b3a7-527837135f3f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "POST /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/action" status: 202 len: 0 microversion: 2.1 time: 0.169621 Aug 09 15:35:29.304999 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3517/7045] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:35:29 2022] POST /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:35:29.314434 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96165289-31fc-4874-b2d8-1756550c06bf] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:35:29.315858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:35:29.317162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=16 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:35:29.324630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-98ed1728-bf85-4550-86dd-17ed1e0fe7de tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:35:29.325745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-98ed1728-bf85-4550-86dd-17ed1e0fe7de tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:35:29.336682 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98ed1728-bf85-4550-86dd-17ed1e0fe7de tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:35:29.337476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98ed1728-bf85-4550-86dd-17ed1e0fe7de tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:35:29.338205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98ed1728-bf85-4550-86dd-17ed1e0fe7de tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:35:29.339468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98ed1728-bf85-4550-86dd-17ed1e0fe7de tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:35:29.340156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98ed1728-bf85-4550-86dd-17ed1e0fe7de tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:35:29.340646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98ed1728-bf85-4550-86dd-17ed1e0fe7de tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:35:29.685910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-98ed1728-bf85-4550-86dd-17ed1e0fe7de tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:35:29.695668 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-98ed1728-bf85-4550-86dd-17ed1e0fe7de tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1761 microversion: 2.1 time: 0.384683 Aug 09 15:35:29.696458 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3529/7046] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:35:29 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1761 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:35:30.728135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-46d72c9f-6b54-41a2-9cb4-058d0b9e2185 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:35:30.729403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-46d72c9f-6b54-41a2-9cb4-058d0b9e2185 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:35:30.748238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46d72c9f-6b54-41a2-9cb4-058d0b9e2185 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:35:30.749162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46d72c9f-6b54-41a2-9cb4-058d0b9e2185 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:35:30.749951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46d72c9f-6b54-41a2-9cb4-058d0b9e2185 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:35:30.751463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46d72c9f-6b54-41a2-9cb4-058d0b9e2185 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:35:30.752288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46d72c9f-6b54-41a2-9cb4-058d0b9e2185 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:35:30.753066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-46d72c9f-6b54-41a2-9cb4-058d0b9e2185 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:35:30.754548 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] [2072e827-cf31-416a-97b9-dec37834bdb2] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52228. Aug 09 15:35:30.993759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-46d72c9f-6b54-41a2-9cb4-058d0b9e2185 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:35:31.004550 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-46d72c9f-6b54-41a2-9cb4-058d0b9e2185 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1766 microversion: 2.1 time: 0.288080 Aug 09 15:35:31.005181 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3518/7047] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:35:30 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1766 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:35:32.028147 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9950e561-aa7d-42ee-b344-aa841098c5b4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:35:32.029020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9950e561-aa7d-42ee-b344-aa841098c5b4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:35:32.039224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9950e561-aa7d-42ee-b344-aa841098c5b4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:35:32.039750 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9950e561-aa7d-42ee-b344-aa841098c5b4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:35:32.040341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9950e561-aa7d-42ee-b344-aa841098c5b4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:35:32.041443 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9950e561-aa7d-42ee-b344-aa841098c5b4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:35:32.041962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9950e561-aa7d-42ee-b344-aa841098c5b4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:35:32.042411 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9950e561-aa7d-42ee-b344-aa841098c5b4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:35:32.049237 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [96165289-31fc-4874-b2d8-1756550c06bf] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52234. Aug 09 15:35:32.235720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9950e561-aa7d-42ee-b344-aa841098c5b4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:35:32.245305 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9950e561-aa7d-42ee-b344-aa841098c5b4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1759 microversion: 2.1 time: 0.221062 Aug 09 15:35:32.245998 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3530/7048] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:35:32 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1759 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:35:32.360180 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:35:32.360512 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:35:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:36:49.350827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-235c7c2c-727e-491f-b3fd-d21ee18e1ea9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1668766161"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:36:49.354425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-235c7c2c-727e-491f-b3fd-d21ee18e1ea9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:36:49.354695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:36:49.355638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:36:49.364926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235c7c2c-727e-491f-b3fd-d21ee18e1ea9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:49.365585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235c7c2c-727e-491f-b3fd-d21ee18e1ea9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:49.366265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235c7c2c-727e-491f-b3fd-d21ee18e1ea9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:49.367265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235c7c2c-727e-491f-b3fd-d21ee18e1ea9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:49.367959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235c7c2c-727e-491f-b3fd-d21ee18e1ea9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:49.368414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-235c7c2c-727e-491f-b3fd-d21ee18e1ea9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:49.606615 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.network.security_group_api [None req-235c7c2c-727e-491f-b3fd-d21ee18e1ea9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Removing security group 25ee5925-8c02-42fa-98f6-3b1be6f41297 from port f0e24676-2477-4f10-8247-8a08cd06fe42 Aug 09 15:36:50.304411 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-235c7c2c-727e-491f-b3fd-d21ee18e1ea9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "POST /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/action" status: 202 len: 0 microversion: 2.1 time: 0.960764 Aug 09 15:36:50.306463 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3519/7049] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:36:49 2022] POST /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/action => generated 0 bytes in 964 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:36:50.326166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:36:50.330773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=12 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:36:50.596541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-fdaf0362-a650-448a-91dc-fea2dfe8a7ed req-78edd98e-3ffd-40db-9550-3349808c4867 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa4114c-d443-483c-b399-08c8425b35cc", "tag": "f0e24676-2477-4f10-8247-8a08cd06fe42"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:36:50.636291 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fdaf0362-a650-448a-91dc-fea2dfe8a7ed req-78edd98e-3ffd-40db-9550-3349808c4867 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:50.641144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fdaf0362-a650-448a-91dc-fea2dfe8a7ed req-78edd98e-3ffd-40db-9550-3349808c4867 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:50.642243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-fdaf0362-a650-448a-91dc-fea2dfe8a7ed req-78edd98e-3ffd-40db-9550-3349808c4867 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:50.698376 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-fdaf0362-a650-448a-91dc-fea2dfe8a7ed req-78edd98e-3ffd-40db-9550-3349808c4867 service nova] Creating event network-changed:f0e24676-2477-4f10-8247-8a08cd06fe42 for instance 0aa4114c-d443-483c-b399-08c8425b35cc on n-h2-844626-8 Aug 09 15:36:50.719827 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-fdaf0362-a650-448a-91dc-fea2dfe8a7ed req-78edd98e-3ffd-40db-9550-3349808c4867 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.401128 Aug 09 15:36:50.723128 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3531/7050] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:36:52.972223 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1c7b63d9-f0da-496e-ba7f-17d8cfb45862 req-edc7f799-07ce-45b9-b00d-6486967861ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa4114c-d443-483c-b399-08c8425b35cc", "tag": "f0e24676-2477-4f10-8247-8a08cd06fe42"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:36:52.990947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1c7b63d9-f0da-496e-ba7f-17d8cfb45862 req-edc7f799-07ce-45b9-b00d-6486967861ca service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:52.992114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1c7b63d9-f0da-496e-ba7f-17d8cfb45862 req-edc7f799-07ce-45b9-b00d-6486967861ca service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:52.992917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1c7b63d9-f0da-496e-ba7f-17d8cfb45862 req-edc7f799-07ce-45b9-b00d-6486967861ca service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:53.017207 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1c7b63d9-f0da-496e-ba7f-17d8cfb45862 req-edc7f799-07ce-45b9-b00d-6486967861ca service nova] Creating event network-changed:f0e24676-2477-4f10-8247-8a08cd06fe42 for instance 0aa4114c-d443-483c-b399-08c8425b35cc on n-h2-844626-8 Aug 09 15:36:53.041723 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1c7b63d9-f0da-496e-ba7f-17d8cfb45862 req-edc7f799-07ce-45b9-b00d-6486967861ca service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082165 Aug 09 15:36:53.045880 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3520/7051] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:36:53.062502 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6b80f621-8418-42e4-b0a8-530a3aeb7a7c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:36:53.063318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6b80f621-8418-42e4-b0a8-530a3aeb7a7c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:36:53.076397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b80f621-8418-42e4-b0a8-530a3aeb7a7c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:53.077108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b80f621-8418-42e4-b0a8-530a3aeb7a7c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:53.077841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b80f621-8418-42e4-b0a8-530a3aeb7a7c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:53.078998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b80f621-8418-42e4-b0a8-530a3aeb7a7c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:53.079858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b80f621-8418-42e4-b0a8-530a3aeb7a7c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:53.080299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6b80f621-8418-42e4-b0a8-530a3aeb7a7c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:53.235305 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-6b80f621-8418-42e4-b0a8-530a3aeb7a7c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lazy-loading 'services' on Instance uuid 0aa4114c-d443-483c-b399-08c8425b35cc {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:36:53.394551 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6b80f621-8418-42e4-b0a8-530a3aeb7a7c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments/d41cecd3-49d6-419a-97dc-773e3e7b3043" status: 202 len: 0 microversion: 2.1 time: 0.341544 Aug 09 15:36:53.420417 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3532/7052] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:36:53 2022] DELETE /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments/d41cecd3-49d6-419a-97dc-773e3e7b3043 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:36:53.421127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c12f863-f4a7-4273-be91-f0f714967a39 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:36:53.425153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2c12f863-f4a7-4273-be91-f0f714967a39 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:36:53.455695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c12f863-f4a7-4273-be91-f0f714967a39 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:53.460008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c12f863-f4a7-4273-be91-f0f714967a39 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:53.462090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c12f863-f4a7-4273-be91-f0f714967a39 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:53.463513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c12f863-f4a7-4273-be91-f0f714967a39 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:53.464176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c12f863-f4a7-4273-be91-f0f714967a39 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:53.464788 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c12f863-f4a7-4273-be91-f0f714967a39 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:53.553217 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2c12f863-f4a7-4273-be91-f0f714967a39 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147040 Aug 09 15:36:53.563325 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3521/7053] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:36:53 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:36:54.588216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-01ecf887-a1f1-4800-af91-99d9420bdcb6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:36:54.592915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-01ecf887-a1f1-4800-af91-99d9420bdcb6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:36:54.605280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01ecf887-a1f1-4800-af91-99d9420bdcb6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:54.606563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01ecf887-a1f1-4800-af91-99d9420bdcb6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:54.608110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01ecf887-a1f1-4800-af91-99d9420bdcb6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:54.609918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01ecf887-a1f1-4800-af91-99d9420bdcb6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:54.610584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01ecf887-a1f1-4800-af91-99d9420bdcb6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:54.611366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-01ecf887-a1f1-4800-af91-99d9420bdcb6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:54.682377 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-01ecf887-a1f1-4800-af91-99d9420bdcb6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107199 Aug 09 15:36:54.683283 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3533/7054] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:36:54 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:36:55.707836 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf1dda97-8da2-4122-8bc6-91735069fea8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:36:55.711549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf1dda97-8da2-4122-8bc6-91735069fea8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:36:55.724508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf1dda97-8da2-4122-8bc6-91735069fea8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:55.725369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf1dda97-8da2-4122-8bc6-91735069fea8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:55.726179 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf1dda97-8da2-4122-8bc6-91735069fea8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:55.727558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf1dda97-8da2-4122-8bc6-91735069fea8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:55.728403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf1dda97-8da2-4122-8bc6-91735069fea8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:55.729155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf1dda97-8da2-4122-8bc6-91735069fea8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:55.795365 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf1dda97-8da2-4122-8bc6-91735069fea8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101713 Aug 09 15:36:55.795365 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3522/7055] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:36:55 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:36:56.818108 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7ba7ad50-1488-4adb-aa68-3e809f3bfc9b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:36:56.822724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7ba7ad50-1488-4adb-aa68-3e809f3bfc9b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:36:56.837980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ba7ad50-1488-4adb-aa68-3e809f3bfc9b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:56.838949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ba7ad50-1488-4adb-aa68-3e809f3bfc9b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:56.839707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ba7ad50-1488-4adb-aa68-3e809f3bfc9b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:56.841075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ba7ad50-1488-4adb-aa68-3e809f3bfc9b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:56.841907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ba7ad50-1488-4adb-aa68-3e809f3bfc9b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:56.842710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7ba7ad50-1488-4adb-aa68-3e809f3bfc9b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:56.906682 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7ba7ad50-1488-4adb-aa68-3e809f3bfc9b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096561 Aug 09 15:36:56.914166 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3534/7056] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:36:56 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:36:57.931411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-297b0cc4-b681-4921-b271-cd40c29ce375 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:36:57.936494 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-297b0cc4-b681-4921-b271-cd40c29ce375 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:36:57.963539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-297b0cc4-b681-4921-b271-cd40c29ce375 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:57.964451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-297b0cc4-b681-4921-b271-cd40c29ce375 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:57.965242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-297b0cc4-b681-4921-b271-cd40c29ce375 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:57.966517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-297b0cc4-b681-4921-b271-cd40c29ce375 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:57.967393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-297b0cc4-b681-4921-b271-cd40c29ce375 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:57.968162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-297b0cc4-b681-4921-b271-cd40c29ce375 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:58.034279 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-297b0cc4-b681-4921-b271-cd40c29ce375 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111181 Aug 09 15:36:58.035599 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3523/7057] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:36:57 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:36:59.058336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b299b0f-0654-4d67-806c-8be773148bbb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:36:59.062413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5b299b0f-0654-4d67-806c-8be773148bbb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:36:59.076468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b299b0f-0654-4d67-806c-8be773148bbb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:59.077358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b299b0f-0654-4d67-806c-8be773148bbb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:59.078226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b299b0f-0654-4d67-806c-8be773148bbb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:59.079519 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b299b0f-0654-4d67-806c-8be773148bbb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:36:59.080391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b299b0f-0654-4d67-806c-8be773148bbb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:36:59.081145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b299b0f-0654-4d67-806c-8be773148bbb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:36:59.147495 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5b299b0f-0654-4d67-806c-8be773148bbb tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095625 Aug 09 15:36:59.149020 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3535/7058] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:36:59 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:37:00.167317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bf3fa02b-4830-4687-8477-b6ffff96d690 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:00.171073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bf3fa02b-4830-4687-8477-b6ffff96d690 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:00.179939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf3fa02b-4830-4687-8477-b6ffff96d690 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:00.180655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf3fa02b-4830-4687-8477-b6ffff96d690 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:00.181231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf3fa02b-4830-4687-8477-b6ffff96d690 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:00.182116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf3fa02b-4830-4687-8477-b6ffff96d690 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:00.182732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf3fa02b-4830-4687-8477-b6ffff96d690 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:00.183457 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bf3fa02b-4830-4687-8477-b6ffff96d690 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:00.241022 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bf3fa02b-4830-4687-8477-b6ffff96d690 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080104 Aug 09 15:37:00.241750 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3524/7059] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:37:00 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:37:00.255433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe20b05d-c7a3-44b6-abe4-97e060503df7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:00.256299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe20b05d-c7a3-44b6-abe4-97e060503df7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:00.268239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe20b05d-c7a3-44b6-abe4-97e060503df7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:00.269168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe20b05d-c7a3-44b6-abe4-97e060503df7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:00.270150 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe20b05d-c7a3-44b6-abe4-97e060503df7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:00.271562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe20b05d-c7a3-44b6-abe4-97e060503df7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:00.272417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe20b05d-c7a3-44b6-abe4-97e060503df7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:00.273200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe20b05d-c7a3-44b6-abe4-97e060503df7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:00.416745 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-fe20b05d-c7a3-44b6-abe4-97e060503df7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] HTTP exception thrown: Instance 0aa4114c-d443-483c-b399-08c8425b35cc is not attached to volume d41cecd3-49d6-419a-97dc-773e3e7b3043 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe20b05d-c7a3-44b6-abe4-97e060503df7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Request method failure captured: Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: request: DELETE /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments/d41cecd3-49d6-419a-97dc-773e3e7b3043 HTTP/1.1 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n4eSIImYNk8eorxxi8sL8OVXyXEv2S93zGxPasWjOJaFf-q-6BnBw5-ITuZ2B9Hnqvy2SrcfX2ZluD6TS4L0FT0S9flqw0Y1Wy2u3D8QyvX0h9sI_yxXFiuED0bJI7LGYrfLLdpu8--WfDXih5HCOxzZk3BzGAOXgymUu9clue_NvI Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 77754f57df154a578dd66a6cf0164654 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestMinimumBasicScenario-1079836151 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_77754f57df154a578dd66a6cf0164654", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/77754f57df154a578dd66a6cf0164654"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77754f57df154a578dd66a6cf0164654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77754f57df154a578dd66a6cf0164654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestMinimumBasicScenario-1079836151 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 77754f57df154a578dd66a6cf0164654 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1079836151 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestMinimumBasicScenario-1079836151-project Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 175a9e49f1a64a3c8d5d5e5c8cc62998 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestMinimumBasicScenario-1079836151-project Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 0aa4114c-d443-483c-b399-08c8425b35cc is not attached to volume d41cecd3-49d6-419a-97dc-773e3e7b3043 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'server_id': '0aa4114c-d443-483c-b399-08c8425b35cc', 'id': 'd41cecd3-49d6-419a-97dc-773e3e7b3043'} Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d41cecd3-49d6-419a-97dc-773e3e7b3043. Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa4114c-d443-483c-b399-08c8425b35cc is not attached to volume d41cecd3-49d6-419a-97dc-773e3e7b3043 Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:37:00.419929 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:37:00.427606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:37:00.427606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:37:00.427606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa4114c-d443-483c-b399-08c8425b35cc is not attached to volume d41cecd3-49d6-419a-97dc-773e3e7b3043 Aug 09 15:37:00.427606 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:37:00.427606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe20b05d-c7a3-44b6-abe4-97e060503df7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Returning 404 to user: Instance 0aa4114c-d443-483c-b399-08c8425b35cc is not attached to volume d41cecd3-49d6-419a-97dc-773e3e7b3043 {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:37:00.427606 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe20b05d-c7a3-44b6-abe4-97e060503df7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments/d41cecd3-49d6-419a-97dc-773e3e7b3043" status: 404 len: 154 microversion: 2.1 time: 0.172362 Aug 09 15:37:00.427606 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3536/7060] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:37:00 2022] DELETE /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc/os-volume_attachments/d41cecd3-49d6-419a-97dc-773e3e7b3043 => generated 154 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:37:04.887563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-818d8057-a517-40ac-baf8-34e562943c1a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:04.888281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-818d8057-a517-40ac-baf8-34e562943c1a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:04.895795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-818d8057-a517-40ac-baf8-34e562943c1a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:04.896309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-818d8057-a517-40ac-baf8-34e562943c1a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:04.896762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-818d8057-a517-40ac-baf8-34e562943c1a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:04.897504 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-818d8057-a517-40ac-baf8-34e562943c1a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:04.897970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-818d8057-a517-40ac-baf8-34e562943c1a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:04.898409 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-818d8057-a517-40ac-baf8-34e562943c1a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:04.927272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-818d8057-a517-40ac-baf8-34e562943c1a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:37:05.037041 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-818d8057-a517-40ac-baf8-34e562943c1a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "DELETE /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 204 len: 0 microversion: 2.1 time: 0.152538 Aug 09 15:37:05.037932 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3525/7061] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:37:04 2022] DELETE /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:37:05.050156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf2bf85b-4050-40da-ae79-a98bd5c70a19 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:05.051719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf2bf85b-4050-40da-ae79-a98bd5c70a19 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:05.060263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf2bf85b-4050-40da-ae79-a98bd5c70a19 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:05.060809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf2bf85b-4050-40da-ae79-a98bd5c70a19 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:05.061218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf2bf85b-4050-40da-ae79-a98bd5c70a19 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:05.061981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf2bf85b-4050-40da-ae79-a98bd5c70a19 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:05.062415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf2bf85b-4050-40da-ae79-a98bd5c70a19 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:05.062860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf2bf85b-4050-40da-ae79-a98bd5c70a19 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:05.277795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bf2bf85b-4050-40da-ae79-a98bd5c70a19 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:05.291305 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf2bf85b-4050-40da-ae79-a98bd5c70a19 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1553 microversion: 2.1 time: 0.246131 Aug 09 15:37:05.292388 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3537/7062] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:05 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1553 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:06.315428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d185b0ff-705f-4d11-8d52-946b64106e75 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:06.316715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d185b0ff-705f-4d11-8d52-946b64106e75 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:06.324888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d185b0ff-705f-4d11-8d52-946b64106e75 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:06.325530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d185b0ff-705f-4d11-8d52-946b64106e75 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:06.325887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d185b0ff-705f-4d11-8d52-946b64106e75 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:06.326627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d185b0ff-705f-4d11-8d52-946b64106e75 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:06.327115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d185b0ff-705f-4d11-8d52-946b64106e75 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:06.327763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d185b0ff-705f-4d11-8d52-946b64106e75 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:06.506468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d185b0ff-705f-4d11-8d52-946b64106e75 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:06.514922 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d185b0ff-705f-4d11-8d52-946b64106e75 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1553 microversion: 2.1 time: 0.203993 Aug 09 15:37:06.515778 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3526/7063] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:06 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:07.539581 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1bbd4a0a-018c-4043-a002-8c396213e8e2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:07.540575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1bbd4a0a-018c-4043-a002-8c396213e8e2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:07.551885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bbd4a0a-018c-4043-a002-8c396213e8e2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:07.552679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bbd4a0a-018c-4043-a002-8c396213e8e2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:07.554364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bbd4a0a-018c-4043-a002-8c396213e8e2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:07.555986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bbd4a0a-018c-4043-a002-8c396213e8e2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:07.556850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bbd4a0a-018c-4043-a002-8c396213e8e2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:07.557457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bbd4a0a-018c-4043-a002-8c396213e8e2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:07.721849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e2499a02-c4bf-4cfa-8cd5-a86cbd5f1958 req-e30239e2-e238-44dd-b081-a481f0b37ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa4114c-d443-483c-b399-08c8425b35cc", "name": "network-vif-deleted", "tag": "f0e24676-2477-4f10-8247-8a08cd06fe42"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:37:07.725880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1bbd4a0a-018c-4043-a002-8c396213e8e2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:07.741647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e2499a02-c4bf-4cfa-8cd5-a86cbd5f1958 req-e30239e2-e238-44dd-b081-a481f0b37ac7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:07.742349 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e2499a02-c4bf-4cfa-8cd5-a86cbd5f1958 req-e30239e2-e238-44dd-b081-a481f0b37ac7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:07.742527 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1bbd4a0a-018c-4043-a002-8c396213e8e2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 200 len: 1511 microversion: 2.1 time: 0.205626 Aug 09 15:37:07.743157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e2499a02-c4bf-4cfa-8cd5-a86cbd5f1958 req-e30239e2-e238-44dd-b081-a481f0b37ac7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:07.747155 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3538/7064] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:07 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:07.763617 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e2499a02-c4bf-4cfa-8cd5-a86cbd5f1958 req-e30239e2-e238-44dd-b081-a481f0b37ac7 service nova] Creating event network-vif-deleted:f0e24676-2477-4f10-8247-8a08cd06fe42 for instance 0aa4114c-d443-483c-b399-08c8425b35cc on n-h2-844626-8 Aug 09 15:37:07.773154 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:37:07.773490 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:37:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.50) !!! Aug 09 15:37:07.788301 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e2499a02-c4bf-4cfa-8cd5-a86cbd5f1958 req-e30239e2-e238-44dd-b081-a481f0b37ac7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073853 Aug 09 15:37:07.789886 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3527/7065] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:37:08.770948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30ee5853-b4bb-45f7-ac1f-d16f23a0bda2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:08.772066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-30ee5853-b4bb-45f7-ac1f-d16f23a0bda2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 0aa4114c-d443-483c-b399-08c8425b35cc] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:08.785231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30ee5853-b4bb-45f7-ac1f-d16f23a0bda2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:08.785828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30ee5853-b4bb-45f7-ac1f-d16f23a0bda2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:08.786653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30ee5853-b4bb-45f7-ac1f-d16f23a0bda2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:08.787973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30ee5853-b4bb-45f7-ac1f-d16f23a0bda2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:08.788842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30ee5853-b4bb-45f7-ac1f-d16f23a0bda2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:08.789490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-30ee5853-b4bb-45f7-ac1f-d16f23a0bda2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:08.816024 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-30ee5853-b4bb-45f7-ac1f-d16f23a0bda2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] HTTP exception thrown: Instance 0aa4114c-d443-483c-b399-08c8425b35cc could not be found. Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30ee5853-b4bb-45f7-ac1f-d16f23a0bda2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Request method failure captured: Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc HTTP/1.1 Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n4eSIImYNk8eorxxi8sL8OVXyXEv2S93zGxPasWjOJaFf-q-6BnBw5-ITuZ2B9Hnqvy2SrcfX2ZluD6TS4L0FT0S9flqw0Y1Wy2u3D8QyvX0h9sI_yxXFiuED0bJI7LGYrfLLdpu8--WfDXih5HCOxzZk3BzGAOXgymUu9clue_NvI Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 77754f57df154a578dd66a6cf0164654 Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestMinimumBasicScenario-1079836151 Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_77754f57df154a578dd66a6cf0164654", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/77754f57df154a578dd66a6cf0164654"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77754f57df154a578dd66a6cf0164654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77754f57df154a578dd66a6cf0164654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestMinimumBasicScenario-1079836151 Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 77754f57df154a578dd66a6cf0164654 Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1079836151 Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestMinimumBasicScenario-1079836151-project Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 175a9e49f1a64a3c8d5d5e5c8cc62998 Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestMinimumBasicScenario-1079836151-project Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 0aa4114c-d443-483c-b399-08c8425b35cc could not be found. Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '0aa4114c-d443-483c-b399-08c8425b35cc'} Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa4114c-d443-483c-b399-08c8425b35cc could not be found. Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa4114c-d443-483c-b399-08c8425b35cc could not be found. Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:37:08.819277 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:37:08.828053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:37:08.828053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:37:08.828053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:37:08.828053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:37:08.828053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:37:08.828053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa4114c-d443-483c-b399-08c8425b35cc could not be found. Aug 09 15:37:08.828053 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:37:08.828053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-30ee5853-b4bb-45f7-ac1f-d16f23a0bda2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Returning 404 to user: Instance 0aa4114c-d443-483c-b399-08c8425b35cc could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:37:08.828053 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-30ee5853-b4bb-45f7-ac1f-d16f23a0bda2 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc" status: 404 len: 111 microversion: 2.1 time: 0.058455 Aug 09 15:37:08.828053 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3539/7066] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:08 2022] GET /compute/v2.1/servers/0aa4114c-d443-483c-b399-08c8425b35cc => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:37:08.836891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9cb11051-89c7-4136-b0f7-5b71a368baf0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '.version_select at 0x7f41e758a4c0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:08.869613 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9cb11051-89c7-4136-b0f7-5b71a368baf0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-325738739" status: 202 len: 0 microversion: 2.1 time: 0.041029 Aug 09 15:37:08.870266 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3528/7067] 10.222.0.50 () {58 vars in 1269 bytes} [Tue Aug 9 15:37:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-325738739 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:37:20.658829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af7729ae-70a7-4791-9481-9189d51cd1d6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Action: 'create', calling method: .version_select at 0x7f41dd422f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1253513932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4ZxBeCNqeoJL4jcQTVUEn+YFWv/T5l9rNDedlPLNSj6/PmG0DGmhQxyDL9rV/19ZLjcL2gNey1taCSOtgiNUlCBdnEUJYG+Fby3Cin7o0TMJHotsXzskqp2WTiOmLOBQ=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:37:20.666100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=18 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:37:20.666770 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:37:20.684600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-af7729ae-70a7-4791-9481-9189d51cd1d6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Getting quotas for project 77754f57df154a578dd66a6cf0164654. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:37:20.690804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-af7729ae-70a7-4791-9481-9189d51cd1d6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Getting quotas for user 175a9e49f1a64a3c8d5d5e5c8cc62998 and project 77754f57df154a578dd66a6cf0164654. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:37:20.735064 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af7729ae-70a7-4791-9481-9189d51cd1d6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.080949 Aug 09 15:37:20.736054 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3540/7068] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:37:20 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:37:20.820755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:37:20.822210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:37:20.831418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1725079228", "imageRef": "b35071b2-2a9a-4cfa-825e-2579fd5e993d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1253513932", "networks": [{"uuid": "b5d492ee-c7e8-4e1f-a20d-fd1f0322e252"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:37:20.927524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] validate_networks() for [('b5d492ee-c7e8-4e1f-a20d-fd1f0322e252', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:37:21.546300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:37:21.547051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:37:21.547992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:37:21.548777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:37:21.549535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:37:21.566111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:21.566807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:21.567627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:21.568983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:21.569807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:21.570568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:21.601012 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Getting quotas for project 77754f57df154a578dd66a6cf0164654. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:37:21.607750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Getting quotas for user 175a9e49f1a64a3c8d5d5e5c8cc62998 and project 77754f57df154a578dd66a6cf0164654. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:37:21.627796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:37:21.631378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b35071b2-2a9a-4cfa-825e-2579fd5e993d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:37:21.688145 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-574d3a34-c333-4c5b-9413-7402222e1fcf tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.870502 Aug 09 15:37:21.689296 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3529/7069] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:37:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:37:21.712722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a2c31ec-0fcd-4a9a-97df-71a72b7d757b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:21.713827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a2c31ec-0fcd-4a9a-97df-71a72b7d757b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:21.815834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a2c31ec-0fcd-4a9a-97df-71a72b7d757b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:21.830211 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a2c31ec-0fcd-4a9a-97df-71a72b7d757b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1259 microversion: 2.1 time: 0.130731 Aug 09 15:37:21.831206 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3541/7070] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:21 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1259 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:22.860982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-339fe294-1d52-4916-b52e-0f04c1c0e547 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:22.862034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-339fe294-1d52-4916-b52e-0f04c1c0e547 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:22.875802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-339fe294-1d52-4916-b52e-0f04c1c0e547 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:22.876722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-339fe294-1d52-4916-b52e-0f04c1c0e547 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:22.877525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-339fe294-1d52-4916-b52e-0f04c1c0e547 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:22.879224 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-339fe294-1d52-4916-b52e-0f04c1c0e547 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:22.880096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-339fe294-1d52-4916-b52e-0f04c1c0e547 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:22.881022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-339fe294-1d52-4916-b52e-0f04c1c0e547 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:23.008740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-339fe294-1d52-4916-b52e-0f04c1c0e547 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:23.026173 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-339fe294-1d52-4916-b52e-0f04c1c0e547 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1311 microversion: 2.1 time: 0.175153 Aug 09 15:37:23.026893 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3530/7071] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:22 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1311 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:24.061632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9c9dfe06-b264-42fb-934b-3a4803e39980 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:24.064184 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9c9dfe06-b264-42fb-934b-3a4803e39980 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:24.104778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c9dfe06-b264-42fb-934b-3a4803e39980 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:24.105836 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c9dfe06-b264-42fb-934b-3a4803e39980 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:24.106621 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c9dfe06-b264-42fb-934b-3a4803e39980 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:24.107980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c9dfe06-b264-42fb-934b-3a4803e39980 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:24.110813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c9dfe06-b264-42fb-934b-3a4803e39980 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:24.112427 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9c9dfe06-b264-42fb-934b-3a4803e39980 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:24.501615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9c9dfe06-b264-42fb-934b-3a4803e39980 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:24.517497 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9c9dfe06-b264-42fb-934b-3a4803e39980 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1359 microversion: 2.1 time: 0.463051 Aug 09 15:37:24.520122 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3542/7072] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:24 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1359 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:25.548158 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-513faeb2-6e7f-4b6a-93cb-2fb71ceffe05 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:25.551500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-513faeb2-6e7f-4b6a-93cb-2fb71ceffe05 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:25.566004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-513faeb2-6e7f-4b6a-93cb-2fb71ceffe05 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:25.567611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-513faeb2-6e7f-4b6a-93cb-2fb71ceffe05 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:25.568773 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-513faeb2-6e7f-4b6a-93cb-2fb71ceffe05 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:25.570525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-513faeb2-6e7f-4b6a-93cb-2fb71ceffe05 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:25.571749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-513faeb2-6e7f-4b6a-93cb-2fb71ceffe05 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:25.572495 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-513faeb2-6e7f-4b6a-93cb-2fb71ceffe05 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:25.967023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-513faeb2-6e7f-4b6a-93cb-2fb71ceffe05 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:26.000307 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-513faeb2-6e7f-4b6a-93cb-2fb71ceffe05 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1359 microversion: 2.1 time: 0.458989 Aug 09 15:37:26.001798 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3531/7073] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:25 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1359 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:26.035786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-11ea5322-3e58-4011-89fc-15e15c9f1729 req-d1e7f89e-b183-41bc-8af3-388e9a7eac83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e7ba60c-ed6c-4915-a917-e05e63afd1a4", "tag": "a40763df-3264-4341-8803-06298919ddfd"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:37:26.069468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-11ea5322-3e58-4011-89fc-15e15c9f1729 req-d1e7f89e-b183-41bc-8af3-388e9a7eac83 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:26.069968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-11ea5322-3e58-4011-89fc-15e15c9f1729 req-d1e7f89e-b183-41bc-8af3-388e9a7eac83 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:26.070402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-11ea5322-3e58-4011-89fc-15e15c9f1729 req-d1e7f89e-b183-41bc-8af3-388e9a7eac83 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:26.105588 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-11ea5322-3e58-4011-89fc-15e15c9f1729 req-d1e7f89e-b183-41bc-8af3-388e9a7eac83 service nova] Creating event network-changed:a40763df-3264-4341-8803-06298919ddfd for instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 on n-h1-844626-8 Aug 09 15:37:26.113803 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-11ea5322-3e58-4011-89fc-15e15c9f1729 req-d1e7f89e-b183-41bc-8af3-388e9a7eac83 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297014 Aug 09 15:37:26.114718 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3543/7074] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:37:27.044547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-590c2eee-c5ad-46bb-b573-f4794617fd37 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:27.052112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-590c2eee-c5ad-46bb-b573-f4794617fd37 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:27.078125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-590c2eee-c5ad-46bb-b573-f4794617fd37 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:27.079125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-590c2eee-c5ad-46bb-b573-f4794617fd37 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:27.080819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-590c2eee-c5ad-46bb-b573-f4794617fd37 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:27.082570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-590c2eee-c5ad-46bb-b573-f4794617fd37 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:27.083373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-590c2eee-c5ad-46bb-b573-f4794617fd37 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:27.084074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-590c2eee-c5ad-46bb-b573-f4794617fd37 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:27.500226 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-590c2eee-c5ad-46bb-b573-f4794617fd37 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:27.537433 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-590c2eee-c5ad-46bb-b573-f4794617fd37 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1359 microversion: 2.1 time: 0.499686 Aug 09 15:37:27.539057 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3532/7075] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:27 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1359 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:28.576397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a4642f40-7c9f-44fe-96cc-8bd151b6b787 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:28.577833 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a4642f40-7c9f-44fe-96cc-8bd151b6b787 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:28.592409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4642f40-7c9f-44fe-96cc-8bd151b6b787 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:28.593283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4642f40-7c9f-44fe-96cc-8bd151b6b787 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:28.594061 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4642f40-7c9f-44fe-96cc-8bd151b6b787 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:28.595656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4642f40-7c9f-44fe-96cc-8bd151b6b787 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:28.596507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4642f40-7c9f-44fe-96cc-8bd151b6b787 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:28.597320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a4642f40-7c9f-44fe-96cc-8bd151b6b787 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:28.872564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a4642f40-7c9f-44fe-96cc-8bd151b6b787 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:28.885086 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a4642f40-7c9f-44fe-96cc-8bd151b6b787 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1359 microversion: 2.1 time: 0.313428 Aug 09 15:37:28.886120 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3544/7076] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:28 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1359 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:29.933007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a8cfe17d-88c0-4ac8-98ea-75869d47da3a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:29.941529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a8cfe17d-88c0-4ac8-98ea-75869d47da3a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:29.958448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8cfe17d-88c0-4ac8-98ea-75869d47da3a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:29.959858 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8cfe17d-88c0-4ac8-98ea-75869d47da3a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:29.963630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8cfe17d-88c0-4ac8-98ea-75869d47da3a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:29.965175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8cfe17d-88c0-4ac8-98ea-75869d47da3a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:29.966126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8cfe17d-88c0-4ac8-98ea-75869d47da3a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:29.967004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a8cfe17d-88c0-4ac8-98ea-75869d47da3a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:30.335652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a8cfe17d-88c0-4ac8-98ea-75869d47da3a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:30.379335 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a8cfe17d-88c0-4ac8-98ea-75869d47da3a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1359 microversion: 2.1 time: 0.459883 Aug 09 15:37:30.380355 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3533/7077] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:29 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1359 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:31.419429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7d74def7-e06f-4f1d-9bfa-02b5d4fc0873 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:31.420861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7d74def7-e06f-4f1d-9bfa-02b5d4fc0873 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:31.434918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d74def7-e06f-4f1d-9bfa-02b5d4fc0873 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:31.435952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d74def7-e06f-4f1d-9bfa-02b5d4fc0873 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:31.436890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d74def7-e06f-4f1d-9bfa-02b5d4fc0873 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:31.438176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d74def7-e06f-4f1d-9bfa-02b5d4fc0873 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:31.438839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d74def7-e06f-4f1d-9bfa-02b5d4fc0873 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:31.439648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7d74def7-e06f-4f1d-9bfa-02b5d4fc0873 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:31.701659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7d74def7-e06f-4f1d-9bfa-02b5d4fc0873 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:31.712645 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7d74def7-e06f-4f1d-9bfa-02b5d4fc0873 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1359 microversion: 2.1 time: 0.301047 Aug 09 15:37:31.713279 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3545/7078] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:31 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1359 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:37:32.750560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ee0bd1b-df99-487a-9c06-63f9e8a5fe4a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:32.751802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ee0bd1b-df99-487a-9c06-63f9e8a5fe4a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:32.756125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:37:32.757426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:37:32.769357 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ee0bd1b-df99-487a-9c06-63f9e8a5fe4a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:32.770336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ee0bd1b-df99-487a-9c06-63f9e8a5fe4a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:32.771075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ee0bd1b-df99-487a-9c06-63f9e8a5fe4a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:32.772172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ee0bd1b-df99-487a-9c06-63f9e8a5fe4a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:32.772888 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ee0bd1b-df99-487a-9c06-63f9e8a5fe4a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:32.773629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ee0bd1b-df99-487a-9c06-63f9e8a5fe4a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:32.989833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ee0bd1b-df99-487a-9c06-63f9e8a5fe4a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:32.998913 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ee0bd1b-df99-487a-9c06-63f9e8a5fe4a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1359 microversion: 2.1 time: 0.256168 Aug 09 15:37:32.999610 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3534/7079] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:32 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:34.038564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-60ca5956-9265-43b7-83a9-6da0c15df41f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:34.039715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-60ca5956-9265-43b7-83a9-6da0c15df41f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:34.043696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:37:34.057226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60ca5956-9265-43b7-83a9-6da0c15df41f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:34.058098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60ca5956-9265-43b7-83a9-6da0c15df41f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:34.058886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60ca5956-9265-43b7-83a9-6da0c15df41f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:34.060238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60ca5956-9265-43b7-83a9-6da0c15df41f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:34.061100 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60ca5956-9265-43b7-83a9-6da0c15df41f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:34.061887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-60ca5956-9265-43b7-83a9-6da0c15df41f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:34.284118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-60ca5956-9265-43b7-83a9-6da0c15df41f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:34.298129 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-60ca5956-9265-43b7-83a9-6da0c15df41f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1359 microversion: 2.1 time: 0.266990 Aug 09 15:37:34.299209 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3546/7080] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:34 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:35.323429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-01eebf45-1816-4117-a6c4-b073d542b5ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:35.324131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-01eebf45-1816-4117-a6c4-b073d542b5ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:35.332608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01eebf45-1816-4117-a6c4-b073d542b5ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:35.333256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01eebf45-1816-4117-a6c4-b073d542b5ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:35.333887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01eebf45-1816-4117-a6c4-b073d542b5ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:35.334754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01eebf45-1816-4117-a6c4-b073d542b5ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:35.335355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01eebf45-1816-4117-a6c4-b073d542b5ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:35.336213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-01eebf45-1816-4117-a6c4-b073d542b5ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:35.602593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-01eebf45-1816-4117-a6c4-b073d542b5ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:35.613886 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-01eebf45-1816-4117-a6c4-b073d542b5ad tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1359 microversion: 2.1 time: 0.295611 Aug 09 15:37:35.614853 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3535/7081] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:35 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1359 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:36.638942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4fdaddc4-ccdd-49f1-86e1-65ec2ba6a70f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:36.639968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4fdaddc4-ccdd-49f1-86e1-65ec2ba6a70f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:36.648188 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fdaddc4-ccdd-49f1-86e1-65ec2ba6a70f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:36.648701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fdaddc4-ccdd-49f1-86e1-65ec2ba6a70f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:36.649166 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fdaddc4-ccdd-49f1-86e1-65ec2ba6a70f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:36.649949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fdaddc4-ccdd-49f1-86e1-65ec2ba6a70f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:36.650420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fdaddc4-ccdd-49f1-86e1-65ec2ba6a70f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:36.650884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4fdaddc4-ccdd-49f1-86e1-65ec2ba6a70f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:36.873080 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4fdaddc4-ccdd-49f1-86e1-65ec2ba6a70f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:36.884229 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4fdaddc4-ccdd-49f1-86e1-65ec2ba6a70f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1359 microversion: 2.1 time: 0.249504 Aug 09 15:37:36.884936 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3547/7082] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:36 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1359 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:37.746378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b281259b-4e26-4926-92cd-bd9c4a28ead1 req-b877dc32-a97f-43bd-bfb9-cabdc3ff8cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e7ba60c-ed6c-4915-a917-e05e63afd1a4", "name": "network-vif-plugged", "status": "completed", "tag": "a40763df-3264-4341-8803-06298919ddfd"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:37:37.764592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b281259b-4e26-4926-92cd-bd9c4a28ead1 req-b877dc32-a97f-43bd-bfb9-cabdc3ff8cf9 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:37.765420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b281259b-4e26-4926-92cd-bd9c4a28ead1 req-b877dc32-a97f-43bd-bfb9-cabdc3ff8cf9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:37.766212 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b281259b-4e26-4926-92cd-bd9c4a28ead1 req-b877dc32-a97f-43bd-bfb9-cabdc3ff8cf9 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:37.788380 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b281259b-4e26-4926-92cd-bd9c4a28ead1 req-b877dc32-a97f-43bd-bfb9-cabdc3ff8cf9 service nova] Creating event network-vif-plugged:a40763df-3264-4341-8803-06298919ddfd for instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 on n-h1-844626-8 Aug 09 15:37:37.798070 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b281259b-4e26-4926-92cd-bd9c4a28ead1 req-b877dc32-a97f-43bd-bfb9-cabdc3ff8cf9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168539 Aug 09 15:37:37.799471 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3536/7083] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:37:37.923689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7cca59be-26b5-427f-9d15-c6252051fc1e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:37.924671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7cca59be-26b5-427f-9d15-c6252051fc1e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:37.936643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cca59be-26b5-427f-9d15-c6252051fc1e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:37.937547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cca59be-26b5-427f-9d15-c6252051fc1e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:37.938306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cca59be-26b5-427f-9d15-c6252051fc1e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:37.940832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cca59be-26b5-427f-9d15-c6252051fc1e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:37.941629 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cca59be-26b5-427f-9d15-c6252051fc1e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:37.942340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7cca59be-26b5-427f-9d15-c6252051fc1e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:38.166387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7cca59be-26b5-427f-9d15-c6252051fc1e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:38.175806 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7cca59be-26b5-427f-9d15-c6252051fc1e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1359 microversion: 2.1 time: 0.258940 Aug 09 15:37:38.176556 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3548/7084] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:37 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:37:39.206040 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9a7ef7c-34b9-4d5a-80dc-ec2b1c5e24e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:39.207167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f9a7ef7c-34b9-4d5a-80dc-ec2b1c5e24e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:39.215250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9a7ef7c-34b9-4d5a-80dc-ec2b1c5e24e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:39.215951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9a7ef7c-34b9-4d5a-80dc-ec2b1c5e24e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:39.216537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9a7ef7c-34b9-4d5a-80dc-ec2b1c5e24e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:39.217404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9a7ef7c-34b9-4d5a-80dc-ec2b1c5e24e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:39.218053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9a7ef7c-34b9-4d5a-80dc-ec2b1c5e24e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:39.218622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9a7ef7c-34b9-4d5a-80dc-ec2b1c5e24e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:39.396487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f9a7ef7c-34b9-4d5a-80dc-ec2b1c5e24e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:39.405145 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f9a7ef7c-34b9-4d5a-80dc-ec2b1c5e24e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1359 microversion: 2.1 time: 0.206456 Aug 09 15:37:39.405753 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3537/7085] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:39 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:40.440798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1b2e380f-41ff-4b23-b24f-830246993430 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:40.441423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1b2e380f-41ff-4b23-b24f-830246993430 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:40.449262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b2e380f-41ff-4b23-b24f-830246993430 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:40.449812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b2e380f-41ff-4b23-b24f-830246993430 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:40.450326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b2e380f-41ff-4b23-b24f-830246993430 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:40.451066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b2e380f-41ff-4b23-b24f-830246993430 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:40.451603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b2e380f-41ff-4b23-b24f-830246993430 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:40.452095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b2e380f-41ff-4b23-b24f-830246993430 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:40.702925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1b2e380f-41ff-4b23-b24f-830246993430 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:40.716497 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1b2e380f-41ff-4b23-b24f-830246993430 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1549 microversion: 2.1 time: 0.279529 Aug 09 15:37:40.717549 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3549/7086] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:40 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1549 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:40.753769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4e721221-4f77-4cd6-8a64-6ab9a80073c8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:40.754877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4e721221-4f77-4cd6-8a64-6ab9a80073c8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:40.766578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e721221-4f77-4cd6-8a64-6ab9a80073c8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:40.767132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e721221-4f77-4cd6-8a64-6ab9a80073c8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:40.767568 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e721221-4f77-4cd6-8a64-6ab9a80073c8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:40.768305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e721221-4f77-4cd6-8a64-6ab9a80073c8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:40.768768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e721221-4f77-4cd6-8a64-6ab9a80073c8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:40.769269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4e721221-4f77-4cd6-8a64-6ab9a80073c8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:40.987915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4e721221-4f77-4cd6-8a64-6ab9a80073c8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:41.003380 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4e721221-4f77-4cd6-8a64-6ab9a80073c8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1549 microversion: 2.1 time: 0.256807 Aug 09 15:37:41.004468 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3538/7087] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:40 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1549 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:41.043040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32796d37-9af7-49c6-a241-c97d61dfb7c9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:41.052402 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-32796d37-9af7-49c6-a241-c97d61dfb7c9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:41.053855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32796d37-9af7-49c6-a241-c97d61dfb7c9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Searching by: {'deleted': False, 'project_id': '77754f57df154a578dd66a6cf0164654'} {{(pid=119407) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 15:37:41.064044 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32796d37-9af7-49c6-a241-c97d61dfb7c9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:41.064888 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32796d37-9af7-49c6-a241-c97d61dfb7c9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:41.065632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32796d37-9af7-49c6-a241-c97d61dfb7c9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:41.067019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32796d37-9af7-49c6-a241-c97d61dfb7c9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:41.067922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32796d37-9af7-49c6-a241-c97d61dfb7c9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:41.068703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32796d37-9af7-49c6-a241-c97d61dfb7c9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:41.111012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.multi_cell_list [None req-32796d37-9af7-49c6-a241-c97d61dfb7c9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=119407) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 15:37:41.145036 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32796d37-9af7-49c6-a241-c97d61dfb7c9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.109724 Aug 09 15:37:41.145735 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3550/7088] 10.222.0.50 () {58 vars in 1125 bytes} [Tue Aug 9 15:37:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:37:41.158127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ef2ceb46-a95a-419c-a79f-843ba2159231 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:41.158954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ef2ceb46-a95a-419c-a79f-843ba2159231 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:41.166509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef2ceb46-a95a-419c-a79f-843ba2159231 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:41.167046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef2ceb46-a95a-419c-a79f-843ba2159231 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:41.167540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef2ceb46-a95a-419c-a79f-843ba2159231 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:41.168330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef2ceb46-a95a-419c-a79f-843ba2159231 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:41.168795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef2ceb46-a95a-419c-a79f-843ba2159231 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:41.169227 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ef2ceb46-a95a-419c-a79f-843ba2159231 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:41.355032 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ef2ceb46-a95a-419c-a79f-843ba2159231 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:41.368445 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ef2ceb46-a95a-419c-a79f-843ba2159231 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1549 microversion: 2.1 time: 0.213848 Aug 09 15:37:41.369346 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3539/7089] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:41 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1549 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:37:43.204280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05d4417c-eff0-4dac-a7ca-60496c037f70 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d49acc4-4daa-4a08-bf95-60a0d667f266"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:37:43.208734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05d4417c-eff0-4dac-a7ca-60496c037f70 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:43.213322 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e81a619-36fd-4d2d-bb1a-e0ebabb081c8] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:37:43.222839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05d4417c-eff0-4dac-a7ca-60496c037f70 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:43.223772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05d4417c-eff0-4dac-a7ca-60496c037f70 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:43.224531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05d4417c-eff0-4dac-a7ca-60496c037f70 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:43.225908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05d4417c-eff0-4dac-a7ca-60496c037f70 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:43.226683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05d4417c-eff0-4dac-a7ca-60496c037f70 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:43.227482 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05d4417c-eff0-4dac-a7ca-60496c037f70 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:44.222267 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e81a619-36fd-4d2d-bb1a-e0ebabb081c8] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52558. Aug 09 15:37:44.391021 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05d4417c-eff0-4dac-a7ca-60496c037f70 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "POST /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.194394 Aug 09 15:37:44.391972 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3551/7090] 10.222.0.50 () {60 vars in 1323 bytes} [Tue Aug 9 15:37:43 2022] POST /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments => generated 194 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:37:58.175007 n-d-844626-8 devstack@n-api.service[119406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb00389d-3bc9-4291-a475-262c81a6a465] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:37:58.181193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7beb5032-9188-49af-bd8e-2809a42f7782 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:37:58.182191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7beb5032-9188-49af-bd8e-2809a42f7782 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:37:58.186691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:37:58.187814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=58 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:37:58.198159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7beb5032-9188-49af-bd8e-2809a42f7782 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:58.198925 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7beb5032-9188-49af-bd8e-2809a42f7782 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:58.199641 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7beb5032-9188-49af-bd8e-2809a42f7782 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:58.200872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7beb5032-9188-49af-bd8e-2809a42f7782 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:37:58.202198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7beb5032-9188-49af-bd8e-2809a42f7782 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:37:58.202652 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7beb5032-9188-49af-bd8e-2809a42f7782 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:37:58.457356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7beb5032-9188-49af-bd8e-2809a42f7782 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:37:58.473823 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7beb5032-9188-49af-bd8e-2809a42f7782 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1595 microversion: 2.1 time: 0.300871 Aug 09 15:37:58.474933 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3540/7091] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:37:58 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1595 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:38:01.530960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-17596921-a090-4f48-a7d1-2548ebf5f8a9 req-1adfbd86-7eff-42d4-9815-13b8eeb40c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e7ba60c-ed6c-4915-a917-e05e63afd1a4", "tag": "a40763df-3264-4341-8803-06298919ddfd"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:38:01.540415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:38:01.541319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:38:01.542528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:38:01.547872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-17596921-a090-4f48-a7d1-2548ebf5f8a9 req-1adfbd86-7eff-42d4-9815-13b8eeb40c8e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:01.548440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-17596921-a090-4f48-a7d1-2548ebf5f8a9 req-1adfbd86-7eff-42d4-9815-13b8eeb40c8e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:01.548966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-17596921-a090-4f48-a7d1-2548ebf5f8a9 req-1adfbd86-7eff-42d4-9815-13b8eeb40c8e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:01.566310 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-17596921-a090-4f48-a7d1-2548ebf5f8a9 req-1adfbd86-7eff-42d4-9815-13b8eeb40c8e service nova] Creating event network-changed:a40763df-3264-4341-8803-06298919ddfd for instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 on n-h1-844626-8 Aug 09 15:38:01.573227 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-17596921-a090-4f48-a7d1-2548ebf5f8a9 req-1adfbd86-7eff-42d4-9815-13b8eeb40c8e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046006 Aug 09 15:38:01.573973 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3552/7092] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:38:03.398980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ac5cc375-825b-44ac-bbc4-020cf5b45758 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1813046812"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:38:03.399968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ac5cc375-825b-44ac-bbc4-020cf5b45758 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:03.415520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac5cc375-825b-44ac-bbc4-020cf5b45758 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:03.416432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac5cc375-825b-44ac-bbc4-020cf5b45758 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:03.417240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac5cc375-825b-44ac-bbc4-020cf5b45758 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:03.418570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac5cc375-825b-44ac-bbc4-020cf5b45758 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:03.419586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac5cc375-825b-44ac-bbc4-020cf5b45758 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:03.420426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ac5cc375-825b-44ac-bbc4-020cf5b45758 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:03.452659 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb00389d-3bc9-4291-a475-262c81a6a465] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 52620. Aug 09 15:38:03.628930 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.network.security_group_api [None req-ac5cc375-825b-44ac-bbc4-020cf5b45758 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Adding security group 07c6c67a-42b9-4574-993a-edbc41ea730c to port a40763df-3264-4341-8803-06298919ddfd Aug 09 15:38:04.217072 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ac5cc375-825b-44ac-bbc4-020cf5b45758 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "POST /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/action" status: 202 len: 0 microversion: 2.1 time: 0.826818 Aug 09 15:38:04.226948 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3541/7093] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:38:03 2022] POST /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:38:04.236515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-4a586dce-f0f0-4b95-b1b2-e018692c69c6 req-aae16cee-6693-4757-9d55-bb7317ee5609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e7ba60c-ed6c-4915-a917-e05e63afd1a4", "tag": "a40763df-3264-4341-8803-06298919ddfd"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:38:04.239263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b5765447-aae3-4fa9-9b52-3983df4842fd tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:38:04.240699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b5765447-aae3-4fa9-9b52-3983df4842fd tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:04.253081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5765447-aae3-4fa9-9b52-3983df4842fd tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:04.254479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5765447-aae3-4fa9-9b52-3983df4842fd tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:04.255526 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5765447-aae3-4fa9-9b52-3983df4842fd tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:04.257037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5765447-aae3-4fa9-9b52-3983df4842fd tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:04.258060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5765447-aae3-4fa9-9b52-3983df4842fd tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:04.259620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b5765447-aae3-4fa9-9b52-3983df4842fd tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:04.261725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4a586dce-f0f0-4b95-b1b2-e018692c69c6 req-aae16cee-6693-4757-9d55-bb7317ee5609 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:04.262228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4a586dce-f0f0-4b95-b1b2-e018692c69c6 req-aae16cee-6693-4757-9d55-bb7317ee5609 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:04.262946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-4a586dce-f0f0-4b95-b1b2-e018692c69c6 req-aae16cee-6693-4757-9d55-bb7317ee5609 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:04.278168 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-4a586dce-f0f0-4b95-b1b2-e018692c69c6 req-aae16cee-6693-4757-9d55-bb7317ee5609 service nova] Creating event network-changed:a40763df-3264-4341-8803-06298919ddfd for instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 on n-h1-844626-8 Aug 09 15:38:04.285773 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-4a586dce-f0f0-4b95-b1b2-e018692c69c6 req-aae16cee-6693-4757-9d55-bb7317ee5609 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061716 Aug 09 15:38:04.286795 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3553/7094] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:38:04.571215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b5765447-aae3-4fa9-9b52-3983df4842fd tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:38:04.594891 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b5765447-aae3-4fa9-9b52-3983df4842fd tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1760 microversion: 2.1 time: 0.362925 Aug 09 15:38:04.597577 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3542/7095] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:38:04 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1760 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:38:12.083334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-260bf257-0790-4308-9f33-9852e0a6d49a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:38:12.087186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-260bf257-0790-4308-9f33-9852e0a6d49a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:12.096414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-260bf257-0790-4308-9f33-9852e0a6d49a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:12.097020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-260bf257-0790-4308-9f33-9852e0a6d49a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:12.097706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-260bf257-0790-4308-9f33-9852e0a6d49a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:12.098521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-260bf257-0790-4308-9f33-9852e0a6d49a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:12.099200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-260bf257-0790-4308-9f33-9852e0a6d49a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:12.099663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-260bf257-0790-4308-9f33-9852e0a6d49a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:12.228731 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-260bf257-0790-4308-9f33-9852e0a6d49a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "POST /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/action" status: 202 len: 0 microversion: 2.1 time: 0.150581 Aug 09 15:38:12.233387 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3554/7096] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:38:12 2022] POST /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:38:12.241342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ecaee77a-6d43-4915-b18e-55b99c234f6f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:38:12.242484 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ecaee77a-6d43-4915-b18e-55b99c234f6f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:12.252899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecaee77a-6d43-4915-b18e-55b99c234f6f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:12.253739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecaee77a-6d43-4915-b18e-55b99c234f6f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:12.254432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecaee77a-6d43-4915-b18e-55b99c234f6f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:12.255571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecaee77a-6d43-4915-b18e-55b99c234f6f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:12.256391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecaee77a-6d43-4915-b18e-55b99c234f6f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:12.257220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecaee77a-6d43-4915-b18e-55b99c234f6f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:12.489784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ecaee77a-6d43-4915-b18e-55b99c234f6f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:38:12.505277 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ecaee77a-6d43-4915-b18e-55b99c234f6f tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1752 microversion: 2.1 time: 0.268554 Aug 09 15:38:12.506883 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3543/7097] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:38:12 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1752 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:38:13.543284 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8b829fa8-2355-448d-b0ea-6c4c288423a4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:38:13.543928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8b829fa8-2355-448d-b0ea-6c4c288423a4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:13.551132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b829fa8-2355-448d-b0ea-6c4c288423a4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:13.551805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b829fa8-2355-448d-b0ea-6c4c288423a4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:13.552412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b829fa8-2355-448d-b0ea-6c4c288423a4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:13.553366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b829fa8-2355-448d-b0ea-6c4c288423a4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:13.554050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b829fa8-2355-448d-b0ea-6c4c288423a4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:13.554995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8b829fa8-2355-448d-b0ea-6c4c288423a4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:13.779375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-8b829fa8-2355-448d-b0ea-6c4c288423a4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:38:13.789260 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8b829fa8-2355-448d-b0ea-6c4c288423a4 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1757 microversion: 2.1 time: 0.252340 Aug 09 15:38:13.789879 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3555/7098] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:38:13 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1757 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:38:14.818866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f9d8caf4-7a6e-4cbb-bb7b-fad6ba9ac08c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:38:14.820053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f9d8caf4-7a6e-4cbb-bb7b-fad6ba9ac08c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:14.832834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9d8caf4-7a6e-4cbb-bb7b-fad6ba9ac08c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:14.833723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9d8caf4-7a6e-4cbb-bb7b-fad6ba9ac08c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:14.834521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9d8caf4-7a6e-4cbb-bb7b-fad6ba9ac08c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:14.836166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9d8caf4-7a6e-4cbb-bb7b-fad6ba9ac08c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:14.837270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9d8caf4-7a6e-4cbb-bb7b-fad6ba9ac08c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:14.838041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f9d8caf4-7a6e-4cbb-bb7b-fad6ba9ac08c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:15.079022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f9d8caf4-7a6e-4cbb-bb7b-fad6ba9ac08c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:38:15.094789 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f9d8caf4-7a6e-4cbb-bb7b-fad6ba9ac08c tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1757 microversion: 2.1 time: 0.283489 Aug 09 15:38:15.095953 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3544/7099] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:38:14 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1757 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:38:16.134268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6faf8841-7c9d-4a2b-8e37-4e53f21d3f2e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:38:16.135455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6faf8841-7c9d-4a2b-8e37-4e53f21d3f2e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:16.147967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6faf8841-7c9d-4a2b-8e37-4e53f21d3f2e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:16.148857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6faf8841-7c9d-4a2b-8e37-4e53f21d3f2e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:16.149645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6faf8841-7c9d-4a2b-8e37-4e53f21d3f2e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:16.150893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6faf8841-7c9d-4a2b-8e37-4e53f21d3f2e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:16.151741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6faf8841-7c9d-4a2b-8e37-4e53f21d3f2e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:16.152513 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6faf8841-7c9d-4a2b-8e37-4e53f21d3f2e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:16.427311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6faf8841-7c9d-4a2b-8e37-4e53f21d3f2e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:38:16.440473 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6faf8841-7c9d-4a2b-8e37-4e53f21d3f2e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1757 microversion: 2.1 time: 0.313485 Aug 09 15:38:16.441461 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3556/7100] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:38:16 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1757 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:38:17.474249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f489edd9-21af-4c81-8995-02f0bec02f68 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:38:17.475442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f489edd9-21af-4c81-8995-02f0bec02f68 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:17.488893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f489edd9-21af-4c81-8995-02f0bec02f68 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:17.489805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f489edd9-21af-4c81-8995-02f0bec02f68 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:17.490552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f489edd9-21af-4c81-8995-02f0bec02f68 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:17.491828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f489edd9-21af-4c81-8995-02f0bec02f68 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:17.492634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f489edd9-21af-4c81-8995-02f0bec02f68 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:17.493369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f489edd9-21af-4c81-8995-02f0bec02f68 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:17.751673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f489edd9-21af-4c81-8995-02f0bec02f68 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:38:17.761912 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f489edd9-21af-4c81-8995-02f0bec02f68 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1757 microversion: 2.1 time: 0.295279 Aug 09 15:38:17.762678 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3545/7101] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:38:17 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1757 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:38:18.789295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-320b3c72-f5f7-47d0-8551-81de9655380e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:38:18.790327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-320b3c72-f5f7-47d0-8551-81de9655380e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:18.804458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-320b3c72-f5f7-47d0-8551-81de9655380e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:18.804458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-320b3c72-f5f7-47d0-8551-81de9655380e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:18.804458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-320b3c72-f5f7-47d0-8551-81de9655380e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:18.805096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-320b3c72-f5f7-47d0-8551-81de9655380e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:18.805616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-320b3c72-f5f7-47d0-8551-81de9655380e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:18.806331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-320b3c72-f5f7-47d0-8551-81de9655380e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:19.029604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-320b3c72-f5f7-47d0-8551-81de9655380e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:38:19.045039 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-320b3c72-f5f7-47d0-8551-81de9655380e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1757 microversion: 2.1 time: 0.262137 Aug 09 15:38:19.046054 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3557/7102] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:38:18 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1757 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:38:20.074743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5515336b-03ff-4c42-9db2-7531287356e7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:38:20.075977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5515336b-03ff-4c42-9db2-7531287356e7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:20.088942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5515336b-03ff-4c42-9db2-7531287356e7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:20.089823 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5515336b-03ff-4c42-9db2-7531287356e7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:20.090635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5515336b-03ff-4c42-9db2-7531287356e7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:20.091990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5515336b-03ff-4c42-9db2-7531287356e7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:20.092850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5515336b-03ff-4c42-9db2-7531287356e7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:20.093679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5515336b-03ff-4c42-9db2-7531287356e7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:20.372746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5515336b-03ff-4c42-9db2-7531287356e7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:38:20.384324 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5515336b-03ff-4c42-9db2-7531287356e7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1757 microversion: 2.1 time: 0.317073 Aug 09 15:38:20.399120 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3546/7103] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:38:20 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1757 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:38:21.423131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-460dfbd4-3c86-4c2d-9de9-707dd399d0b8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:38:21.423957 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-460dfbd4-3c86-4c2d-9de9-707dd399d0b8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:21.433274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460dfbd4-3c86-4c2d-9de9-707dd399d0b8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:21.433773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460dfbd4-3c86-4c2d-9de9-707dd399d0b8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:21.434214 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460dfbd4-3c86-4c2d-9de9-707dd399d0b8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:21.434948 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460dfbd4-3c86-4c2d-9de9-707dd399d0b8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:21.435451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460dfbd4-3c86-4c2d-9de9-707dd399d0b8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:21.435884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-460dfbd4-3c86-4c2d-9de9-707dd399d0b8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:21.673265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-460dfbd4-3c86-4c2d-9de9-707dd399d0b8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:38:21.684995 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-460dfbd4-3c86-4c2d-9de9-707dd399d0b8 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1757 microversion: 2.1 time: 0.264864 Aug 09 15:38:21.684995 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3558/7104] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:38:21 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1757 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:38:22.711439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7945fb26-de64-4a66-884f-8c76ad92f464 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:38:22.712368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7945fb26-de64-4a66-884f-8c76ad92f464 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:22.731940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7945fb26-de64-4a66-884f-8c76ad92f464 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:22.732731 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7945fb26-de64-4a66-884f-8c76ad92f464 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:22.733490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7945fb26-de64-4a66-884f-8c76ad92f464 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:22.734689 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7945fb26-de64-4a66-884f-8c76ad92f464 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:22.735462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7945fb26-de64-4a66-884f-8c76ad92f464 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:22.736185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7945fb26-de64-4a66-884f-8c76ad92f464 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:22.991843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7945fb26-de64-4a66-884f-8c76ad92f464 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:38:23.008591 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7945fb26-de64-4a66-884f-8c76ad92f464 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1757 microversion: 2.1 time: 0.302152 Aug 09 15:38:23.008591 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3547/7105] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:38:22 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1757 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:38:24.038884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bb0d5cf6-c274-4d13-b7d0-3e6975acfbbe tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:38:24.039636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bb0d5cf6-c274-4d13-b7d0-3e6975acfbbe tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:24.048162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb0d5cf6-c274-4d13-b7d0-3e6975acfbbe tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:24.048718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb0d5cf6-c274-4d13-b7d0-3e6975acfbbe tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:24.049226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb0d5cf6-c274-4d13-b7d0-3e6975acfbbe tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:24.049964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb0d5cf6-c274-4d13-b7d0-3e6975acfbbe tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:24.050425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb0d5cf6-c274-4d13-b7d0-3e6975acfbbe tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:24.050892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bb0d5cf6-c274-4d13-b7d0-3e6975acfbbe tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:24.264421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bb0d5cf6-c274-4d13-b7d0-3e6975acfbbe tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:38:24.279995 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bb0d5cf6-c274-4d13-b7d0-3e6975acfbbe tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1760 microversion: 2.1 time: 0.247289 Aug 09 15:38:24.281058 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3559/7106] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:38:24 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1760 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:38:51.341404 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:38:51.342187 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:38:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:38:57.429998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-26c405c9-dd45-493e-a49f-7e597701bb65 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1813046812"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:38:57.430846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-26c405c9-dd45-493e-a49f-7e597701bb65 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:38:57.433616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=16 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:38:57.434510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=46 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:38:57.442363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26c405c9-dd45-493e-a49f-7e597701bb65 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:57.442965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26c405c9-dd45-493e-a49f-7e597701bb65 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:57.443460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26c405c9-dd45-493e-a49f-7e597701bb65 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:57.444259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26c405c9-dd45-493e-a49f-7e597701bb65 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:57.444754 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26c405c9-dd45-493e-a49f-7e597701bb65 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:57.445202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-26c405c9-dd45-493e-a49f-7e597701bb65 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:57.679613 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.network.security_group_api [None req-26c405c9-dd45-493e-a49f-7e597701bb65 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Removing security group 07c6c67a-42b9-4574-993a-edbc41ea730c from port a40763df-3264-4341-8803-06298919ddfd Aug 09 15:38:58.266467 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-26c405c9-dd45-493e-a49f-7e597701bb65 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "POST /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/action" status: 202 len: 0 microversion: 2.1 time: 0.841325 Aug 09 15:38:58.272896 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3548/7107] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:38:57 2022] POST /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/action => generated 0 bytes in 844 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:38:58.281815 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-12696acd-be26-4208-b6bb-6dfb01506870 req-6ab0490c-816e-4d06-b80d-13191372f7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e7ba60c-ed6c-4915-a917-e05e63afd1a4", "tag": "a40763df-3264-4341-8803-06298919ddfd"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:38:58.305529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=16 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:38:58.307584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:38:58.312970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-12696acd-be26-4208-b6bb-6dfb01506870 req-6ab0490c-816e-4d06-b80d-13191372f7d3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:38:58.315431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-12696acd-be26-4208-b6bb-6dfb01506870 req-6ab0490c-816e-4d06-b80d-13191372f7d3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:38:58.316932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-12696acd-be26-4208-b6bb-6dfb01506870 req-6ab0490c-816e-4d06-b80d-13191372f7d3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:38:58.357737 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-12696acd-be26-4208-b6bb-6dfb01506870 req-6ab0490c-816e-4d06-b80d-13191372f7d3 service nova] Creating event network-changed:a40763df-3264-4341-8803-06298919ddfd for instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 on n-h1-844626-8 Aug 09 15:38:58.369585 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-12696acd-be26-4208-b6bb-6dfb01506870 req-6ab0490c-816e-4d06-b80d-13191372f7d3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095594 Aug 09 15:38:58.372268 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3560/7108] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:39:00.911150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-752fc492-4660-47e3-9fa3-e81a375e7bcc tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:00.912092 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-752fc492-4660-47e3-9fa3-e81a375e7bcc tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:00.918848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-82a631d9-942a-4259-b2ae-c8d61d3d3fa9 req-f10c7021-cd7c-4067-ad3f-240963b26b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e7ba60c-ed6c-4915-a917-e05e63afd1a4", "tag": "a40763df-3264-4341-8803-06298919ddfd"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:39:00.924363 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752fc492-4660-47e3-9fa3-e81a375e7bcc tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:00.924914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752fc492-4660-47e3-9fa3-e81a375e7bcc tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:00.925379 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752fc492-4660-47e3-9fa3-e81a375e7bcc tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:00.927143 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752fc492-4660-47e3-9fa3-e81a375e7bcc tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:00.928280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752fc492-4660-47e3-9fa3-e81a375e7bcc tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:00.928756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-752fc492-4660-47e3-9fa3-e81a375e7bcc tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:00.935533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-82a631d9-942a-4259-b2ae-c8d61d3d3fa9 req-f10c7021-cd7c-4067-ad3f-240963b26b71 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:00.936417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-82a631d9-942a-4259-b2ae-c8d61d3d3fa9 req-f10c7021-cd7c-4067-ad3f-240963b26b71 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:00.937267 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-82a631d9-942a-4259-b2ae-c8d61d3d3fa9 req-f10c7021-cd7c-4067-ad3f-240963b26b71 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:00.952158 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-82a631d9-942a-4259-b2ae-c8d61d3d3fa9 req-f10c7021-cd7c-4067-ad3f-240963b26b71 service nova] Creating event network-changed:a40763df-3264-4341-8803-06298919ddfd for instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 on n-h1-844626-8 Aug 09 15:39:00.958198 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-82a631d9-942a-4259-b2ae-c8d61d3d3fa9 req-f10c7021-cd7c-4067-ad3f-240963b26b71 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047151 Aug 09 15:39:00.959826 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3561/7109] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:39:01.080047 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-752fc492-4660-47e3-9fa3-e81a375e7bcc tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lazy-loading 'services' on Instance uuid 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:39:01.200494 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-752fc492-4660-47e3-9fa3-e81a375e7bcc tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments/9d49acc4-4daa-4a08-bf95-60a0d667f266" status: 202 len: 0 microversion: 2.1 time: 0.295165 Aug 09 15:39:01.206928 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3549/7110] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:39:00 2022] DELETE /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments/9d49acc4-4daa-4a08-bf95-60a0d667f266 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:39:01.217792 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44f92c63-28a3-43f4-8062-52c103164ec9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:01.222174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44f92c63-28a3-43f4-8062-52c103164ec9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:01.234306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44f92c63-28a3-43f4-8062-52c103164ec9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:01.235708 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44f92c63-28a3-43f4-8062-52c103164ec9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:01.236858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44f92c63-28a3-43f4-8062-52c103164ec9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:01.238459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44f92c63-28a3-43f4-8062-52c103164ec9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:01.239649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44f92c63-28a3-43f4-8062-52c103164ec9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:01.240683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44f92c63-28a3-43f4-8062-52c103164ec9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:01.302527 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44f92c63-28a3-43f4-8062-52c103164ec9 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093424 Aug 09 15:39:01.304496 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3562/7111] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:39:01 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:39:02.328305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82fe68c6-0c29-4b9b-a65f-321737382db7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:02.334127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-82fe68c6-0c29-4b9b-a65f-321737382db7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:02.347772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82fe68c6-0c29-4b9b-a65f-321737382db7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:02.348821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82fe68c6-0c29-4b9b-a65f-321737382db7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:02.349630 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82fe68c6-0c29-4b9b-a65f-321737382db7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:02.351017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82fe68c6-0c29-4b9b-a65f-321737382db7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:02.351954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82fe68c6-0c29-4b9b-a65f-321737382db7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:02.352772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82fe68c6-0c29-4b9b-a65f-321737382db7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:02.406216 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-82fe68c6-0c29-4b9b-a65f-321737382db7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088001 Aug 09 15:39:02.415204 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3550/7112] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:39:02 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:39:03.423821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e45a029c-dc97-4323-af65-d57915ccbe0e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:03.425973 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e45a029c-dc97-4323-af65-d57915ccbe0e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:03.433131 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e45a029c-dc97-4323-af65-d57915ccbe0e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:03.433609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e45a029c-dc97-4323-af65-d57915ccbe0e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:03.434039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e45a029c-dc97-4323-af65-d57915ccbe0e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:03.434754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e45a029c-dc97-4323-af65-d57915ccbe0e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:03.435237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e45a029c-dc97-4323-af65-d57915ccbe0e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:03.435656 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e45a029c-dc97-4323-af65-d57915ccbe0e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:03.475926 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e45a029c-dc97-4323-af65-d57915ccbe0e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057329 Aug 09 15:39:03.476384 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3563/7113] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:39:03 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:39:04.492486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-03dee4e5-8c31-4a71-9747-58b6f407ff8b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:04.497070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-03dee4e5-8c31-4a71-9747-58b6f407ff8b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:04.509385 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03dee4e5-8c31-4a71-9747-58b6f407ff8b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:04.510153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03dee4e5-8c31-4a71-9747-58b6f407ff8b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:04.510965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03dee4e5-8c31-4a71-9747-58b6f407ff8b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:04.512225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03dee4e5-8c31-4a71-9747-58b6f407ff8b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:04.513048 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03dee4e5-8c31-4a71-9747-58b6f407ff8b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:04.513931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-03dee4e5-8c31-4a71-9747-58b6f407ff8b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:04.568713 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-03dee4e5-8c31-4a71-9747-58b6f407ff8b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083062 Aug 09 15:39:04.569766 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3551/7114] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:39:04 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:39:05.586772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-38926ba4-249f-49e2-b0aa-e81602b2a5e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:05.589452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-38926ba4-249f-49e2-b0aa-e81602b2a5e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:05.597320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38926ba4-249f-49e2-b0aa-e81602b2a5e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:05.597961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38926ba4-249f-49e2-b0aa-e81602b2a5e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:05.598399 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38926ba4-249f-49e2-b0aa-e81602b2a5e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:05.599145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38926ba4-249f-49e2-b0aa-e81602b2a5e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:05.599783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38926ba4-249f-49e2-b0aa-e81602b2a5e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:05.600210 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-38926ba4-249f-49e2-b0aa-e81602b2a5e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:05.651448 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-38926ba4-249f-49e2-b0aa-e81602b2a5e1 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069598 Aug 09 15:39:05.652405 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3564/7115] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:39:05 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:39:06.665142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dfe973af-a3ae-46fe-8d9f-f485b554bf08 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:06.667803 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dfe973af-a3ae-46fe-8d9f-f485b554bf08 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:06.675818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfe973af-a3ae-46fe-8d9f-f485b554bf08 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:06.676330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfe973af-a3ae-46fe-8d9f-f485b554bf08 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:06.676781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfe973af-a3ae-46fe-8d9f-f485b554bf08 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:06.677536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfe973af-a3ae-46fe-8d9f-f485b554bf08 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:06.678006 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfe973af-a3ae-46fe-8d9f-f485b554bf08 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:06.678443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfe973af-a3ae-46fe-8d9f-f485b554bf08 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:06.719003 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dfe973af-a3ae-46fe-8d9f-f485b554bf08 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058309 Aug 09 15:39:06.719659 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3552/7116] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:39:06 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:39:07.738006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5430412d-c54a-4da6-abc8-2b076caac1b7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:07.741603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5430412d-c54a-4da6-abc8-2b076caac1b7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:07.754062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5430412d-c54a-4da6-abc8-2b076caac1b7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:07.754900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5430412d-c54a-4da6-abc8-2b076caac1b7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:07.755683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5430412d-c54a-4da6-abc8-2b076caac1b7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:07.756906 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5430412d-c54a-4da6-abc8-2b076caac1b7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:07.757694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5430412d-c54a-4da6-abc8-2b076caac1b7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:07.758424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5430412d-c54a-4da6-abc8-2b076caac1b7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:07.815132 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5430412d-c54a-4da6-abc8-2b076caac1b7 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084135 Aug 09 15:39:07.816196 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3565/7117] 10.222.0.50 () {58 vars in 1302 bytes} [Tue Aug 9 15:39:07 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 15:39:07.835739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19a5e9af-135b-4a87-b82f-b3d4e30d844e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:07.836611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-19a5e9af-135b-4a87-b82f-b3d4e30d844e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:07.850097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19a5e9af-135b-4a87-b82f-b3d4e30d844e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:07.850960 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19a5e9af-135b-4a87-b82f-b3d4e30d844e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:07.851762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19a5e9af-135b-4a87-b82f-b3d4e30d844e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:07.853068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19a5e9af-135b-4a87-b82f-b3d4e30d844e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:07.853905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19a5e9af-135b-4a87-b82f-b3d4e30d844e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:07.854674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19a5e9af-135b-4a87-b82f-b3d4e30d844e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:07.986743 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-19a5e9af-135b-4a87-b82f-b3d4e30d844e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] HTTP exception thrown: Instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 is not attached to volume 9d49acc4-4daa-4a08-bf95-60a0d667f266 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19a5e9af-135b-4a87-b82f-b3d4e30d844e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Request method failure captured: Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: request: DELETE /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments/9d49acc4-4daa-4a08-bf95-60a0d667f266 HTTP/1.1 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8n4eSIImYNk8eorxxi8sL8OVXyXEv2S93zGxPasWjOJaFf-q-6BnBw5-ITuZ2B9Hnqvy2SrcfX2ZluD6TS4L0FT0S9flqw0Y1Wy2u3D8QyvX0h9sI_yxXFiuED0bJI7LGYrfLLdpu8--WfDXih5HCOxzZk3BzGAOXgymUu9clue_NvI Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 77754f57df154a578dd66a6cf0164654 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestMinimumBasicScenario-1079836151 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_77754f57df154a578dd66a6cf0164654", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/77754f57df154a578dd66a6cf0164654"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77754f57df154a578dd66a6cf0164654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77754f57df154a578dd66a6cf0164654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestMinimumBasicScenario-1079836151 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 77754f57df154a578dd66a6cf0164654 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1079836151 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestMinimumBasicScenario-1079836151-project Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 175a9e49f1a64a3c8d5d5e5c8cc62998 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestMinimumBasicScenario-1079836151-project Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 is not attached to volume 9d49acc4-4daa-4a08-bf95-60a0d667f266 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'server_id': '8e7ba60c-ed6c-4915-a917-e05e63afd1a4', 'id': '9d49acc4-4daa-4a08-bf95-60a0d667f266'} Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9d49acc4-4daa-4a08-bf95-60a0d667f266. Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 is not attached to volume 9d49acc4-4daa-4a08-bf95-60a0d667f266 Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:39:07.989516 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:39:07.994996 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:39:07.994996 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:39:07.994996 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 is not attached to volume 9d49acc4-4daa-4a08-bf95-60a0d667f266 Aug 09 15:39:07.994996 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:39:07.994996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19a5e9af-135b-4a87-b82f-b3d4e30d844e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Returning 404 to user: Instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 is not attached to volume 9d49acc4-4daa-4a08-bf95-60a0d667f266 {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:39:07.994996 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-19a5e9af-135b-4a87-b82f-b3d4e30d844e tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments/9d49acc4-4daa-4a08-bf95-60a0d667f266" status: 404 len: 154 microversion: 2.1 time: 0.164390 Aug 09 15:39:07.994996 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3553/7118] 10.222.0.50 () {58 vars in 1416 bytes} [Tue Aug 9 15:39:07 2022] DELETE /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4/os-volume_attachments/9d49acc4-4daa-4a08-bf95-60a0d667f266 => generated 154 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:39:12.433410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-40646bd7-e439-4cfc-9307-d7ec7c3bc0a0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:12.434285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40646bd7-e439-4cfc-9307-d7ec7c3bc0a0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:12.448775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40646bd7-e439-4cfc-9307-d7ec7c3bc0a0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:12.449649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40646bd7-e439-4cfc-9307-d7ec7c3bc0a0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:12.450777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40646bd7-e439-4cfc-9307-d7ec7c3bc0a0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:12.452204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40646bd7-e439-4cfc-9307-d7ec7c3bc0a0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:12.453335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40646bd7-e439-4cfc-9307-d7ec7c3bc0a0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:12.454508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-40646bd7-e439-4cfc-9307-d7ec7c3bc0a0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:12.508574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-40646bd7-e439-4cfc-9307-d7ec7c3bc0a0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:39:12.644269 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-40646bd7-e439-4cfc-9307-d7ec7c3bc0a0 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "DELETE /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 204 len: 0 microversion: 2.1 time: 0.218323 Aug 09 15:39:12.644889 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3566/7119] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:39:12 2022] DELETE /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:39:12.654990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-69285ca0-8c7d-4adf-9b78-12c60737ec5a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:12.656086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-69285ca0-8c7d-4adf-9b78-12c60737ec5a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:12.664733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69285ca0-8c7d-4adf-9b78-12c60737ec5a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:12.665514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69285ca0-8c7d-4adf-9b78-12c60737ec5a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:12.666078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69285ca0-8c7d-4adf-9b78-12c60737ec5a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:12.667054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69285ca0-8c7d-4adf-9b78-12c60737ec5a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:12.667667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69285ca0-8c7d-4adf-9b78-12c60737ec5a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:12.668306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-69285ca0-8c7d-4adf-9b78-12c60737ec5a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:12.915377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-69285ca0-8c7d-4adf-9b78-12c60737ec5a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:12.930302 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-69285ca0-8c7d-4adf-9b78-12c60737ec5a tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1555 microversion: 2.1 time: 0.278987 Aug 09 15:39:12.931405 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3554/7120] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:12 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1555 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:39:13.967633 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e7bbc701-a8ef-471d-9de8-3bf6ad4e48e6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:13.968452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e7bbc701-a8ef-471d-9de8-3bf6ad4e48e6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:13.977378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bbc701-a8ef-471d-9de8-3bf6ad4e48e6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:13.978030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bbc701-a8ef-471d-9de8-3bf6ad4e48e6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:13.978568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bbc701-a8ef-471d-9de8-3bf6ad4e48e6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:13.979453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bbc701-a8ef-471d-9de8-3bf6ad4e48e6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:13.980019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bbc701-a8ef-471d-9de8-3bf6ad4e48e6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:13.980539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e7bbc701-a8ef-471d-9de8-3bf6ad4e48e6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:14.253510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e7bbc701-a8ef-471d-9de8-3bf6ad4e48e6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:14.261968 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e7bbc701-a8ef-471d-9de8-3bf6ad4e48e6 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1555 microversion: 2.1 time: 0.299302 Aug 09 15:39:14.262659 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3567/7121] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:13 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1555 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:39:15.297100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d60d2500-af3d-488a-8df5-f18e88605d93 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:15.298310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d60d2500-af3d-488a-8df5-f18e88605d93 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:15.321654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60d2500-af3d-488a-8df5-f18e88605d93 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:15.325305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60d2500-af3d-488a-8df5-f18e88605d93 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:15.325763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60d2500-af3d-488a-8df5-f18e88605d93 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:15.327215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60d2500-af3d-488a-8df5-f18e88605d93 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:15.329119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60d2500-af3d-488a-8df5-f18e88605d93 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:15.330413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d60d2500-af3d-488a-8df5-f18e88605d93 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:15.406743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3327d9c1-ff06-4a6e-858d-df050408933c req-54a38488-bc8d-430b-bffc-a8f3c8e3bc52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e7ba60c-ed6c-4915-a917-e05e63afd1a4", "name": "network-vif-deleted", "tag": "a40763df-3264-4341-8803-06298919ddfd"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:39:15.425991 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3327d9c1-ff06-4a6e-858d-df050408933c req-54a38488-bc8d-430b-bffc-a8f3c8e3bc52 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:15.426918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3327d9c1-ff06-4a6e-858d-df050408933c req-54a38488-bc8d-430b-bffc-a8f3c8e3bc52 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:15.427741 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3327d9c1-ff06-4a6e-858d-df050408933c req-54a38488-bc8d-430b-bffc-a8f3c8e3bc52 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:15.436418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d60d2500-af3d-488a-8df5-f18e88605d93 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '175a9e49f1a64a3c8d5d5e5c8cc62998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77754f57df154a578dd66a6cf0164654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:15.449180 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3327d9c1-ff06-4a6e-858d-df050408933c req-54a38488-bc8d-430b-bffc-a8f3c8e3bc52 service nova] Creating event network-vif-deleted:a40763df-3264-4341-8803-06298919ddfd for instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 on n-h1-844626-8 Aug 09 15:39:15.451309 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d60d2500-af3d-488a-8df5-f18e88605d93 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 200 len: 1513 microversion: 2.1 time: 0.169012 Aug 09 15:39:15.452111 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3555/7122] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:15 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:39:15.458314 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3327d9c1-ff06-4a6e-858d-df050408933c req-54a38488-bc8d-430b-bffc-a8f3c8e3bc52 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058429 Aug 09 15:39:15.459765 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3568/7123] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:39:16.476462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c705b7d-5989-45b5-9815-5b34d7b3e14b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:16.477177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c705b7d-5989-45b5-9815-5b34d7b3e14b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] [instance: 8e7ba60c-ed6c-4915-a917-e05e63afd1a4] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:16.485442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c705b7d-5989-45b5-9815-5b34d7b3e14b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:16.485949 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c705b7d-5989-45b5-9815-5b34d7b3e14b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:16.486408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c705b7d-5989-45b5-9815-5b34d7b3e14b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:16.487245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c705b7d-5989-45b5-9815-5b34d7b3e14b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:16.487725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c705b7d-5989-45b5-9815-5b34d7b3e14b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:16.488166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c705b7d-5989-45b5-9815-5b34d7b3e14b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:16.504199 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-1c705b7d-5989-45b5-9815-5b34d7b3e14b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] HTTP exception thrown: Instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 could not be found. Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c705b7d-5989-45b5-9815-5b34d7b3e14b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Request method failure captured: Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 HTTP/1.1 Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8n4eSIImYNk8eorxxi8sL8OVXyXEv2S93zGxPasWjOJaFf-q-6BnBw5-ITuZ2B9Hnqvy2SrcfX2ZluD6TS4L0FT0S9flqw0Y1Wy2u3D8QyvX0h9sI_yxXFiuED0bJI7LGYrfLLdpu8--WfDXih5HCOxzZk3BzGAOXgymUu9clue_NvI Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 77754f57df154a578dd66a6cf0164654 Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestMinimumBasicScenario-1079836151 Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_77754f57df154a578dd66a6cf0164654", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/77754f57df154a578dd66a6cf0164654"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77754f57df154a578dd66a6cf0164654"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/77754f57df154a578dd66a6cf0164654"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestMinimumBasicScenario-1079836151 Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 77754f57df154a578dd66a6cf0164654 Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1079836151 Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestMinimumBasicScenario-1079836151-project Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 175a9e49f1a64a3c8d5d5e5c8cc62998 Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestMinimumBasicScenario-1079836151-project Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 could not be found. Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '8e7ba60c-ed6c-4915-a917-e05e63afd1a4'} Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 could not be found. Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 could not be found. Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:39:16.505878 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:39:16.512814 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:39:16.512814 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:39:16.512814 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:39:16.512814 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:39:16.512814 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:39:16.512814 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 could not be found. Aug 09 15:39:16.512814 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:39:16.512814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c705b7d-5989-45b5-9815-5b34d7b3e14b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Returning 404 to user: Instance 8e7ba60c-ed6c-4915-a917-e05e63afd1a4 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:39:16.512814 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c705b7d-5989-45b5-9815-5b34d7b3e14b tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4" status: 404 len: 111 microversion: 2.1 time: 0.035176 Aug 09 15:39:16.512814 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3556/7124] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:16 2022] GET /compute/v2.1/servers/8e7ba60c-ed6c-4915-a917-e05e63afd1a4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:39:16.518403 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0fbc9127-454f-4749-8aad-5f9bf517e663 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] Calling method '.version_select at 0x7f41dd402940>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:16.542471 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0fbc9127-454f-4749-8aad-5f9bf517e663 tempest-TestMinimumBasicScenario-1079836151 tempest-TestMinimumBasicScenario-1079836151-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1253513932" status: 202 len: 0 microversion: 2.1 time: 0.029385 Aug 09 15:39:16.543210 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3569/7125] 10.222.0.50 () {58 vars in 1272 bytes} [Tue Aug 9 15:39:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1253513932 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:39:29.445629 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=18 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:39:29.446859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:39:29.683828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-841db707-3d18-4f6a-96d5-88080e37f8ec tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'create', calling method: .version_select at 0x7f41de1130d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-189098836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjjM66NXvqxXMaVXPQCumBr3Gnzkfh1+66vbzkEQT1bKUVj01wTFNnmidpYX1der0S6TaXYf1t4yxnermmYJtPcugv5k51bIovz7Q6o7GMgrFqig5EjeUrHK3OFiVDUMQ=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:39:29.710683 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-841db707-3d18-4f6a-96d5-88080e37f8ec tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for project 595d222e7a56448d9eaaf060d77c552b. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:39:29.717156 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-841db707-3d18-4f6a-96d5-88080e37f8ec tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for user 3ca5b4f643564db09dfb30dd2a691789 and project 595d222e7a56448d9eaaf060d77c552b. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:39:29.748794 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-841db707-3d18-4f6a-96d5-88080e37f8ec tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.314250 Aug 09 15:39:29.749593 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3557/7126] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:39:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:39:38.632996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:39:38.633814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:39:38.638808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-84871220", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "c79217e2-c319-47de-82d7-249eb9c82c93"}], "key_name": "tempest-TestNetworkAdvancedServerOps-189098836", "security_groups": [{"name": "tempest-secgroup-smoke-1949821377"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:39:38.799394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] validate_networks() for [('c79217e2-c319-47de-82d7-249eb9c82c93', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:39:39.428409 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:39:39.428989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:39:39.429850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:39:39.430432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:39:39.431187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:39:39.446687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:39.447554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:39.448342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:39.449688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:39.450471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:39.450974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:39.485139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for project 595d222e7a56448d9eaaf060d77c552b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:39:39.496053 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for user 3ca5b4f643564db09dfb30dd2a691789 and project 595d222e7a56448d9eaaf060d77c552b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:39:39.522571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:39:39.527373 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:39:39.613967 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3d51bfaa-6beb-44fc-acc9-d335947ba164 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.982102 Aug 09 15:39:39.615354 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3570/7127] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:39:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:39:39.638125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08bbea3c-8df4-4505-aefa-da54a8291e9b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:39.640553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-08bbea3c-8df4-4505-aefa-da54a8291e9b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:39.725750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:39:39.733694 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-08bbea3c-8df4-4505-aefa-da54a8291e9b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:39.759733 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-08bbea3c-8df4-4505-aefa-da54a8291e9b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1264 microversion: 2.1 time: 0.131032 Aug 09 15:39:39.775331 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3558/7128] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:39 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1264 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:39:40.805019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d1737e74-dbc6-4c0f-8b68-9004ad664f37 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:40.807363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d1737e74-dbc6-4c0f-8b68-9004ad664f37 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:40.822690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1737e74-dbc6-4c0f-8b68-9004ad664f37 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:40.823970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1737e74-dbc6-4c0f-8b68-9004ad664f37 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:40.824751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1737e74-dbc6-4c0f-8b68-9004ad664f37 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:40.826088 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1737e74-dbc6-4c0f-8b68-9004ad664f37 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:40.826914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1737e74-dbc6-4c0f-8b68-9004ad664f37 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:40.828715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d1737e74-dbc6-4c0f-8b68-9004ad664f37 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:40.962501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d1737e74-dbc6-4c0f-8b68-9004ad664f37 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:40.973149 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d1737e74-dbc6-4c0f-8b68-9004ad664f37 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1260 microversion: 2.1 time: 0.180459 Aug 09 15:39:40.974006 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3571/7129] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:40 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:39:42.003810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dfdf7446-33f0-47f5-9481-fdfb5dd9f094 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:42.003810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dfdf7446-33f0-47f5-9481-fdfb5dd9f094 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:42.017698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfdf7446-33f0-47f5-9481-fdfb5dd9f094 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:42.018896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfdf7446-33f0-47f5-9481-fdfb5dd9f094 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:42.019667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfdf7446-33f0-47f5-9481-fdfb5dd9f094 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:42.020747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfdf7446-33f0-47f5-9481-fdfb5dd9f094 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:42.021483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfdf7446-33f0-47f5-9481-fdfb5dd9f094 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:42.022161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dfdf7446-33f0-47f5-9481-fdfb5dd9f094 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:42.119789 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dfdf7446-33f0-47f5-9481-fdfb5dd9f094 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:42.139222 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dfdf7446-33f0-47f5-9481-fdfb5dd9f094 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1322 microversion: 2.1 time: 0.144421 Aug 09 15:39:42.141810 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3559/7130] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:41 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:39:43.165552 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-098e9233-89e7-41ab-9067-c5f57ea1ea66 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:43.166363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-098e9233-89e7-41ab-9067-c5f57ea1ea66 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:43.175955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-098e9233-89e7-41ab-9067-c5f57ea1ea66 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:43.176566 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-098e9233-89e7-41ab-9067-c5f57ea1ea66 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:43.177158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-098e9233-89e7-41ab-9067-c5f57ea1ea66 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:43.178669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-098e9233-89e7-41ab-9067-c5f57ea1ea66 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:43.179424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-098e9233-89e7-41ab-9067-c5f57ea1ea66 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:43.180136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-098e9233-89e7-41ab-9067-c5f57ea1ea66 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:43.320229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-cdcea8c9-18c8-46cb-aff5-29964fcf38fb req-ef238398-1081-49a4-b3a0-412b3eb76cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293e1c96-15e8-43c2-ab5c-eba551c5cdc5", "tag": "0aa22694-802d-4979-b4d0-d5136bcda64f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:39:43.342186 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cdcea8c9-18c8-46cb-aff5-29964fcf38fb req-ef238398-1081-49a4-b3a0-412b3eb76cf7 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:43.343546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cdcea8c9-18c8-46cb-aff5-29964fcf38fb req-ef238398-1081-49a4-b3a0-412b3eb76cf7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:43.344722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-cdcea8c9-18c8-46cb-aff5-29964fcf38fb req-ef238398-1081-49a4-b3a0-412b3eb76cf7 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:43.380004 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-cdcea8c9-18c8-46cb-aff5-29964fcf38fb req-ef238398-1081-49a4-b3a0-412b3eb76cf7 service nova] Creating event network-changed:0aa22694-802d-4979-b4d0-d5136bcda64f for instance 293e1c96-15e8-43c2-ab5c-eba551c5cdc5 on n-h1-844626-8 Aug 09 15:39:43.399567 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-cdcea8c9-18c8-46cb-aff5-29964fcf38fb req-ef238398-1081-49a4-b3a0-412b3eb76cf7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085253 Aug 09 15:39:43.400995 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3560/7131] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:39:43.443037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-098e9233-89e7-41ab-9067-c5f57ea1ea66 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:43.454068 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-098e9233-89e7-41ab-9067-c5f57ea1ea66 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1390 microversion: 2.1 time: 0.293314 Aug 09 15:39:43.455318 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3572/7132] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:43 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1390 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:39:44.494210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-662f6b74-195e-4687-af49-4f1ff3ff530f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:44.495569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-662f6b74-195e-4687-af49-4f1ff3ff530f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:44.507171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-662f6b74-195e-4687-af49-4f1ff3ff530f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:44.508123 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-662f6b74-195e-4687-af49-4f1ff3ff530f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:44.508944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-662f6b74-195e-4687-af49-4f1ff3ff530f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:44.510347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-662f6b74-195e-4687-af49-4f1ff3ff530f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:44.511039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-662f6b74-195e-4687-af49-4f1ff3ff530f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:44.511702 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-662f6b74-195e-4687-af49-4f1ff3ff530f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:44.740079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-662f6b74-195e-4687-af49-4f1ff3ff530f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:44.752282 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-662f6b74-195e-4687-af49-4f1ff3ff530f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1390 microversion: 2.1 time: 0.267801 Aug 09 15:39:44.753129 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3561/7133] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:44 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1390 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:39:45.783814 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9df2a636-0842-45d0-b44a-90759ca538fb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:45.784662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9df2a636-0842-45d0-b44a-90759ca538fb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:45.792451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9df2a636-0842-45d0-b44a-90759ca538fb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:45.793027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9df2a636-0842-45d0-b44a-90759ca538fb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:45.793791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9df2a636-0842-45d0-b44a-90759ca538fb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:45.794710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9df2a636-0842-45d0-b44a-90759ca538fb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:45.795337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9df2a636-0842-45d0-b44a-90759ca538fb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:45.795841 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9df2a636-0842-45d0-b44a-90759ca538fb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:45.983298 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9df2a636-0842-45d0-b44a-90759ca538fb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:45.995773 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9df2a636-0842-45d0-b44a-90759ca538fb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1390 microversion: 2.1 time: 0.216304 Aug 09 15:39:45.996602 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3573/7134] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:45 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1390 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:39:47.032331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7bb6e52e-2f81-4a75-89eb-b47dc1abf857 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:47.033442 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7bb6e52e-2f81-4a75-89eb-b47dc1abf857 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:47.042549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bb6e52e-2f81-4a75-89eb-b47dc1abf857 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:47.043070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bb6e52e-2f81-4a75-89eb-b47dc1abf857 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:47.043549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bb6e52e-2f81-4a75-89eb-b47dc1abf857 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:47.044276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bb6e52e-2f81-4a75-89eb-b47dc1abf857 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:47.044747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bb6e52e-2f81-4a75-89eb-b47dc1abf857 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:47.045188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7bb6e52e-2f81-4a75-89eb-b47dc1abf857 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:47.255570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7bb6e52e-2f81-4a75-89eb-b47dc1abf857 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:47.264468 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7bb6e52e-2f81-4a75-89eb-b47dc1abf857 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1390 microversion: 2.1 time: 0.238154 Aug 09 15:39:47.265121 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3562/7135] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:47 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1390 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:39:48.290780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-77c63f20-1d93-4efd-a3e2-60ff4bb0f7da tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:48.291854 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-77c63f20-1d93-4efd-a3e2-60ff4bb0f7da tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:48.304612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77c63f20-1d93-4efd-a3e2-60ff4bb0f7da tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:48.305395 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77c63f20-1d93-4efd-a3e2-60ff4bb0f7da tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:48.305903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77c63f20-1d93-4efd-a3e2-60ff4bb0f7da tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:48.306824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77c63f20-1d93-4efd-a3e2-60ff4bb0f7da tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:48.307499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77c63f20-1d93-4efd-a3e2-60ff4bb0f7da tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:48.308090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-77c63f20-1d93-4efd-a3e2-60ff4bb0f7da tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:48.535116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-77c63f20-1d93-4efd-a3e2-60ff4bb0f7da tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:48.547853 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-77c63f20-1d93-4efd-a3e2-60ff4bb0f7da tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1390 microversion: 2.1 time: 0.264111 Aug 09 15:39:48.548913 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3574/7136] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:48 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1390 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:39:49.659965 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-84bc1f01-4d8e-4fb0-8963-fc54ef5229aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:49.661175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-84bc1f01-4d8e-4fb0-8963-fc54ef5229aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:49.674203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bc1f01-4d8e-4fb0-8963-fc54ef5229aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:49.675068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bc1f01-4d8e-4fb0-8963-fc54ef5229aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:49.675899 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bc1f01-4d8e-4fb0-8963-fc54ef5229aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:49.677147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bc1f01-4d8e-4fb0-8963-fc54ef5229aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:49.677953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bc1f01-4d8e-4fb0-8963-fc54ef5229aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:49.678712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-84bc1f01-4d8e-4fb0-8963-fc54ef5229aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:49.758244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:39:49.927612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-84bc1f01-4d8e-4fb0-8963-fc54ef5229aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:49.936685 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-84bc1f01-4d8e-4fb0-8963-fc54ef5229aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1390 microversion: 2.1 time: 0.284147 Aug 09 15:39:49.937474 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3563/7137] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:49 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1390 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:39:50.403011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-eef0229b-5a94-4f34-946a-ab36095ad188 req-ca6753ea-1158-4140-aea0-a49e4978d0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293e1c96-15e8-43c2-ab5c-eba551c5cdc5", "name": "network-vif-plugged", "status": "completed", "tag": "0aa22694-802d-4979-b4d0-d5136bcda64f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:39:50.411498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:39:50.412702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:39:50.424846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eef0229b-5a94-4f34-946a-ab36095ad188 req-ca6753ea-1158-4140-aea0-a49e4978d0bc service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:50.425558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eef0229b-5a94-4f34-946a-ab36095ad188 req-ca6753ea-1158-4140-aea0-a49e4978d0bc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:50.426812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-eef0229b-5a94-4f34-946a-ab36095ad188 req-ca6753ea-1158-4140-aea0-a49e4978d0bc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:50.443502 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-eef0229b-5a94-4f34-946a-ab36095ad188 req-ca6753ea-1158-4140-aea0-a49e4978d0bc service nova] Creating event network-vif-plugged:0aa22694-802d-4979-b4d0-d5136bcda64f for instance 293e1c96-15e8-43c2-ab5c-eba551c5cdc5 on n-h1-844626-8 Aug 09 15:39:50.449045 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-eef0229b-5a94-4f34-946a-ab36095ad188 req-ca6753ea-1158-4140-aea0-a49e4978d0bc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052379 Aug 09 15:39:50.449674 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3575/7138] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:39:50.981556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f206ad9d-c141-4544-8c03-62bb5a01011a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:50.982176 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f206ad9d-c141-4544-8c03-62bb5a01011a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:50.990723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f206ad9d-c141-4544-8c03-62bb5a01011a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:50.991274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f206ad9d-c141-4544-8c03-62bb5a01011a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:50.991728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f206ad9d-c141-4544-8c03-62bb5a01011a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:50.992461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f206ad9d-c141-4544-8c03-62bb5a01011a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:50.992934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f206ad9d-c141-4544-8c03-62bb5a01011a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:50.993372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f206ad9d-c141-4544-8c03-62bb5a01011a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:51.162206 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f206ad9d-c141-4544-8c03-62bb5a01011a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:51.170664 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f206ad9d-c141-4544-8c03-62bb5a01011a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1390 microversion: 2.1 time: 0.193107 Aug 09 15:39:51.171551 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3564/7139] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:50 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1390 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:39:52.195752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fc46b87c-375b-4c39-9bd3-088cd7e330b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:52.196650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fc46b87c-375b-4c39-9bd3-088cd7e330b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:52.205727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc46b87c-375b-4c39-9bd3-088cd7e330b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:52.206278 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc46b87c-375b-4c39-9bd3-088cd7e330b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:52.206754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc46b87c-375b-4c39-9bd3-088cd7e330b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:52.207978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc46b87c-375b-4c39-9bd3-088cd7e330b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:52.208489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc46b87c-375b-4c39-9bd3-088cd7e330b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:52.209037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fc46b87c-375b-4c39-9bd3-088cd7e330b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:52.418677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fc46b87c-375b-4c39-9bd3-088cd7e330b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:52.432877 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fc46b87c-375b-4c39-9bd3-088cd7e330b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1562 microversion: 2.1 time: 0.241807 Aug 09 15:39:52.433519 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3576/7140] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:52 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:39:52.456943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-171df25b-7542-4e50-a712-eefe1ba06092 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:52.458020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-171df25b-7542-4e50-a712-eefe1ba06092 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:52.469973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-171df25b-7542-4e50-a712-eefe1ba06092 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:52.471001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-171df25b-7542-4e50-a712-eefe1ba06092 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:52.471799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-171df25b-7542-4e50-a712-eefe1ba06092 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:52.472977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-171df25b-7542-4e50-a712-eefe1ba06092 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:52.473975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-171df25b-7542-4e50-a712-eefe1ba06092 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:52.474801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-171df25b-7542-4e50-a712-eefe1ba06092 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:52.664873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-171df25b-7542-4e50-a712-eefe1ba06092 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:52.674571 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-171df25b-7542-4e50-a712-eefe1ba06092 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1562 microversion: 2.1 time: 0.222008 Aug 09 15:39:52.675223 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3565/7141] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:52 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:39:54.863773 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b1669bc8-0a60-44f7-8c70-3e222597b012 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:39:54.864553 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b1669bc8-0a60-44f7-8c70-3e222597b012 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:39:54.868282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-7ee17e42-8939-4f9e-9317-f59eee02562d req-41dfb17a-385d-4c0f-aaa6-1e9889f5418f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293e1c96-15e8-43c2-ab5c-eba551c5cdc5", "tag": "0aa22694-802d-4979-b4d0-d5136bcda64f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:39:54.873584 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1669bc8-0a60-44f7-8c70-3e222597b012 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:54.874144 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1669bc8-0a60-44f7-8c70-3e222597b012 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:54.874592 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1669bc8-0a60-44f7-8c70-3e222597b012 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:54.875602 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1669bc8-0a60-44f7-8c70-3e222597b012 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:54.876561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1669bc8-0a60-44f7-8c70-3e222597b012 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:54.877248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1669bc8-0a60-44f7-8c70-3e222597b012 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:54.886820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7ee17e42-8939-4f9e-9317-f59eee02562d req-41dfb17a-385d-4c0f-aaa6-1e9889f5418f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:39:54.888913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7ee17e42-8939-4f9e-9317-f59eee02562d req-41dfb17a-385d-4c0f-aaa6-1e9889f5418f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:39:54.890068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-7ee17e42-8939-4f9e-9317-f59eee02562d req-41dfb17a-385d-4c0f-aaa6-1e9889f5418f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:39:54.914845 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-7ee17e42-8939-4f9e-9317-f59eee02562d req-41dfb17a-385d-4c0f-aaa6-1e9889f5418f service nova] Creating event network-changed:0aa22694-802d-4979-b4d0-d5136bcda64f for instance 293e1c96-15e8-43c2-ab5c-eba551c5cdc5 on n-h1-844626-8 Aug 09 15:39:54.925146 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-7ee17e42-8939-4f9e-9317-f59eee02562d req-41dfb17a-385d-4c0f-aaa6-1e9889f5418f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062248 Aug 09 15:39:54.926828 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3566/7142] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:39:55.075867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b1669bc8-0a60-44f7-8c70-3e222597b012 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:39:55.091674 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b1669bc8-0a60-44f7-8c70-3e222597b012 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1562 microversion: 2.1 time: 0.232557 Aug 09 15:39:55.092723 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3577/7143] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:39:54 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:40:17.505079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8912b4f5-d99f-4f57-90f5-3325b692857d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:40:17.508057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8912b4f5-d99f-4f57-90f5-3325b692857d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:17.510608 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:40:17.511292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=40 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:40:17.519548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8912b4f5-d99f-4f57-90f5-3325b692857d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:17.520066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8912b4f5-d99f-4f57-90f5-3325b692857d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:17.520671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8912b4f5-d99f-4f57-90f5-3325b692857d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:17.521456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8912b4f5-d99f-4f57-90f5-3325b692857d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:17.522036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8912b4f5-d99f-4f57-90f5-3325b692857d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:17.522536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8912b4f5-d99f-4f57-90f5-3325b692857d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:17.589388 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8912b4f5-d99f-4f57-90f5-3325b692857d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5/action" status: 200 len: 24572 microversion: 2.1 time: 0.091309 Aug 09 15:40:17.590350 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3567/7144] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:40:17 2022] POST /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5/action => generated 24572 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 15:40:27.788775 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:40:27.789499 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:40:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:40:28.406868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e38f054f-04a0-427f-aca7-0e5fc524379f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:40:28.410929 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e38f054f-04a0-427f-aca7-0e5fc524379f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:28.415732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:40:28.418680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=40 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:40:28.432115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e38f054f-04a0-427f-aca7-0e5fc524379f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:28.433628 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e38f054f-04a0-427f-aca7-0e5fc524379f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:28.434516 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e38f054f-04a0-427f-aca7-0e5fc524379f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:28.440067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e38f054f-04a0-427f-aca7-0e5fc524379f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:28.440994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e38f054f-04a0-427f-aca7-0e5fc524379f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:28.449205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e38f054f-04a0-427f-aca7-0e5fc524379f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:28.595824 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e38f054f-04a0-427f-aca7-0e5fc524379f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5/action" status: 202 len: 0 microversion: 2.1 time: 0.197792 Aug 09 15:40:28.596581 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3578/7145] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:40:28 2022] POST /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:40:28.610604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-92794329-6d6b-4d51-bf83-453a686c4aa2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:28.611877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-92794329-6d6b-4d51-bf83-453a686c4aa2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:28.617938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:40:28.619383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:40:28.627319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92794329-6d6b-4d51-bf83-453a686c4aa2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:28.627843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92794329-6d6b-4d51-bf83-453a686c4aa2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:28.628302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92794329-6d6b-4d51-bf83-453a686c4aa2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:28.629062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92794329-6d6b-4d51-bf83-453a686c4aa2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:28.629742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92794329-6d6b-4d51-bf83-453a686c4aa2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:28.630556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-92794329-6d6b-4d51-bf83-453a686c4aa2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:29.265822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-92794329-6d6b-4d51-bf83-453a686c4aa2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:40:29.280843 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-92794329-6d6b-4d51-bf83-453a686c4aa2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1686 microversion: 2.1 time: 0.677742 Aug 09 15:40:29.281979 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3568/7146] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:28 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1686 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:40:30.321704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eca32954-7538-4811-a54d-0e893d2f41a1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:30.322571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eca32954-7538-4811-a54d-0e893d2f41a1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:30.330073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eca32954-7538-4811-a54d-0e893d2f41a1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:30.330749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eca32954-7538-4811-a54d-0e893d2f41a1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:30.332348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eca32954-7538-4811-a54d-0e893d2f41a1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:30.332994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eca32954-7538-4811-a54d-0e893d2f41a1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:30.333630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eca32954-7538-4811-a54d-0e893d2f41a1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:30.334218 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eca32954-7538-4811-a54d-0e893d2f41a1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:30.539006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eca32954-7538-4811-a54d-0e893d2f41a1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:40:30.555027 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eca32954-7538-4811-a54d-0e893d2f41a1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1666 microversion: 2.1 time: 0.240976 Aug 09 15:40:30.556166 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3579/7147] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:30 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1666 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:40:31.734625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1ae2c280-4884-46cd-95a4-26d0ccba6542 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:40:31.737459 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1ae2c280-4884-46cd-95a4-26d0ccba6542 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:31.746432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ae2c280-4884-46cd-95a4-26d0ccba6542 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:31.746928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ae2c280-4884-46cd-95a4-26d0ccba6542 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:31.747415 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ae2c280-4884-46cd-95a4-26d0ccba6542 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:31.748192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ae2c280-4884-46cd-95a4-26d0ccba6542 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:31.748656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ae2c280-4884-46cd-95a4-26d0ccba6542 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:31.749230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1ae2c280-4884-46cd-95a4-26d0ccba6542 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:31.816954 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1ae2c280-4884-46cd-95a4-26d0ccba6542 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5/action" status: 200 len: 32641 microversion: 2.1 time: 0.088512 Aug 09 15:40:31.818176 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3569/7148] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:40:31 2022] POST /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5/action => generated 32641 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:40:31.834465 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a1e7424-f4d4-4df2-a555-1f9a008ca706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:40:31.835114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a1e7424-f4d4-4df2-a555-1f9a008ca706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:31.843318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a1e7424-f4d4-4df2-a555-1f9a008ca706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:31.843858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a1e7424-f4d4-4df2-a555-1f9a008ca706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:31.844382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a1e7424-f4d4-4df2-a555-1f9a008ca706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:31.845217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a1e7424-f4d4-4df2-a555-1f9a008ca706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:31.845751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a1e7424-f4d4-4df2-a555-1f9a008ca706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:31.846253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a1e7424-f4d4-4df2-a555-1f9a008ca706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:31.952523 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a1e7424-f4d4-4df2-a555-1f9a008ca706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5/action" status: 202 len: 0 microversion: 2.1 time: 0.122590 Aug 09 15:40:31.953857 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3580/7149] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:40:31 2022] POST /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 15:40:31.966883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-da9a4745-a7cc-4e54-a5f6-f2386d12fc85 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:31.968209 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-da9a4745-a7cc-4e54-a5f6-f2386d12fc85 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:31.979665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da9a4745-a7cc-4e54-a5f6-f2386d12fc85 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:31.980404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da9a4745-a7cc-4e54-a5f6-f2386d12fc85 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:31.981198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da9a4745-a7cc-4e54-a5f6-f2386d12fc85 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:31.982218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da9a4745-a7cc-4e54-a5f6-f2386d12fc85 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:31.983070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da9a4745-a7cc-4e54-a5f6-f2386d12fc85 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:31.984086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-da9a4745-a7cc-4e54-a5f6-f2386d12fc85 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:32.307148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da9a4745-a7cc-4e54-a5f6-f2386d12fc85 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:40:32.316728 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-da9a4745-a7cc-4e54-a5f6-f2386d12fc85 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1673 microversion: 2.1 time: 0.357073 Aug 09 15:40:32.317748 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3570/7150] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:31 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1673 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:40:33.346446 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e1228b41-3751-47c3-a94d-a579a18c5414 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:33.347304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e1228b41-3751-47c3-a94d-a579a18c5414 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:33.355013 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1228b41-3751-47c3-a94d-a579a18c5414 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:33.355605 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1228b41-3751-47c3-a94d-a579a18c5414 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:33.356036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1228b41-3751-47c3-a94d-a579a18c5414 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:33.356778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1228b41-3751-47c3-a94d-a579a18c5414 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:33.357285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1228b41-3751-47c3-a94d-a579a18c5414 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:33.357717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e1228b41-3751-47c3-a94d-a579a18c5414 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:33.547342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e1228b41-3751-47c3-a94d-a579a18c5414 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:40:33.559552 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e1228b41-3751-47c3-a94d-a579a18c5414 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1681 microversion: 2.1 time: 0.218336 Aug 09 15:40:33.560214 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3581/7151] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:33 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1681 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:40:33.688813 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b83afc0-77bb-41dc-ac99-451ddd1799c6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:40:33.691281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b83afc0-77bb-41dc-ac99-451ddd1799c6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:33.699516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b83afc0-77bb-41dc-ac99-451ddd1799c6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:33.700126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b83afc0-77bb-41dc-ac99-451ddd1799c6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:33.700712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b83afc0-77bb-41dc-ac99-451ddd1799c6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:33.701601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b83afc0-77bb-41dc-ac99-451ddd1799c6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:33.702297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b83afc0-77bb-41dc-ac99-451ddd1799c6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:33.702843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b83afc0-77bb-41dc-ac99-451ddd1799c6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:33.772381 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b83afc0-77bb-41dc-ac99-451ddd1799c6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5/action" status: 200 len: 38433 microversion: 2.1 time: 0.089024 Aug 09 15:40:33.773337 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3571/7152] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:40:33 2022] POST /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5/action => generated 38433 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 15:40:35.239011 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c06cff0c-8836-4233-bb9b-412fb158ce65 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:35.240999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c06cff0c-8836-4233-bb9b-412fb158ce65 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:35.243851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-993709b5-83fc-4350-b10a-cd1202f0e257 req-cb6f1f6d-ba4f-441f-aae3-d83a06e2c75f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "293e1c96-15e8-43c2-ab5c-eba551c5cdc5", "tag": "0aa22694-802d-4979-b4d0-d5136bcda64f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:40:35.253885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c06cff0c-8836-4233-bb9b-412fb158ce65 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:35.254746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c06cff0c-8836-4233-bb9b-412fb158ce65 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:35.255570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c06cff0c-8836-4233-bb9b-412fb158ce65 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:35.256879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c06cff0c-8836-4233-bb9b-412fb158ce65 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:35.257712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c06cff0c-8836-4233-bb9b-412fb158ce65 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:35.258075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-993709b5-83fc-4350-b10a-cd1202f0e257 req-cb6f1f6d-ba4f-441f-aae3-d83a06e2c75f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:35.258468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c06cff0c-8836-4233-bb9b-412fb158ce65 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:35.258654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-993709b5-83fc-4350-b10a-cd1202f0e257 req-cb6f1f6d-ba4f-441f-aae3-d83a06e2c75f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:35.259010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-993709b5-83fc-4350-b10a-cd1202f0e257 req-cb6f1f6d-ba4f-441f-aae3-d83a06e2c75f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:35.277280 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-993709b5-83fc-4350-b10a-cd1202f0e257 req-cb6f1f6d-ba4f-441f-aae3-d83a06e2c75f service nova] Creating event network-changed:0aa22694-802d-4979-b4d0-d5136bcda64f for instance 293e1c96-15e8-43c2-ab5c-eba551c5cdc5 on n-h1-844626-8 Aug 09 15:40:35.285012 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-993709b5-83fc-4350-b10a-cd1202f0e257 req-cb6f1f6d-ba4f-441f-aae3-d83a06e2c75f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049019 Aug 09 15:40:35.286512 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3572/7153] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:40:35.308927 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c06cff0c-8836-4233-bb9b-412fb158ce65 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:40:35.492901 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c06cff0c-8836-4233-bb9b-412fb158ce65 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "DELETE /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 204 len: 0 microversion: 2.1 time: 0.259950 Aug 09 15:40:35.494668 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3582/7154] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:40:35 2022] DELETE /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:40:35.505879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0dd09b64-7abb-4774-84c8-09f8e8bcce4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:35.507561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0dd09b64-7abb-4774-84c8-09f8e8bcce4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:35.519692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dd09b64-7abb-4774-84c8-09f8e8bcce4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:35.520292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dd09b64-7abb-4774-84c8-09f8e8bcce4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:35.520748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dd09b64-7abb-4774-84c8-09f8e8bcce4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:35.521500 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dd09b64-7abb-4774-84c8-09f8e8bcce4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:35.522401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dd09b64-7abb-4774-84c8-09f8e8bcce4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:35.522868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0dd09b64-7abb-4774-84c8-09f8e8bcce4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:35.725894 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0dd09b64-7abb-4774-84c8-09f8e8bcce4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:40:35.736645 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0dd09b64-7abb-4774-84c8-09f8e8bcce4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1687 microversion: 2.1 time: 0.236531 Aug 09 15:40:35.737556 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3573/7155] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:35 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1687 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:40:36.767344 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bf7d1b45-7750-4e13-bb6d-e0fd841c3086 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:36.768729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bf7d1b45-7750-4e13-bb6d-e0fd841c3086 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:36.783455 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf7d1b45-7750-4e13-bb6d-e0fd841c3086 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:36.784316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf7d1b45-7750-4e13-bb6d-e0fd841c3086 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:36.785110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf7d1b45-7750-4e13-bb6d-e0fd841c3086 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:36.786438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf7d1b45-7750-4e13-bb6d-e0fd841c3086 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:36.787308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf7d1b45-7750-4e13-bb6d-e0fd841c3086 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:36.788101 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bf7d1b45-7750-4e13-bb6d-e0fd841c3086 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:36.995867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bf7d1b45-7750-4e13-bb6d-e0fd841c3086 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:40:37.011373 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bf7d1b45-7750-4e13-bb6d-e0fd841c3086 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1687 microversion: 2.1 time: 0.252949 Aug 09 15:40:37.012422 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3583/7156] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:36 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1687 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:40:37.853776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-53b2ce93-9fbc-4cd2-9cc3-615773ef65a1 req-9edd1e65-2e6b-486c-86e6-3260c455cb59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "293e1c96-15e8-43c2-ab5c-eba551c5cdc5", "name": "network-vif-deleted", "tag": "0aa22694-802d-4979-b4d0-d5136bcda64f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:40:37.870174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-53b2ce93-9fbc-4cd2-9cc3-615773ef65a1 req-9edd1e65-2e6b-486c-86e6-3260c455cb59 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:37.870673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-53b2ce93-9fbc-4cd2-9cc3-615773ef65a1 req-9edd1e65-2e6b-486c-86e6-3260c455cb59 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:37.871132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-53b2ce93-9fbc-4cd2-9cc3-615773ef65a1 req-9edd1e65-2e6b-486c-86e6-3260c455cb59 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:37.887398 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-53b2ce93-9fbc-4cd2-9cc3-615773ef65a1 req-9edd1e65-2e6b-486c-86e6-3260c455cb59 service nova] Creating event network-vif-deleted:0aa22694-802d-4979-b4d0-d5136bcda64f for instance 293e1c96-15e8-43c2-ab5c-eba551c5cdc5 on n-h1-844626-8 Aug 09 15:40:37.893502 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-53b2ce93-9fbc-4cd2-9cc3-615773ef65a1 req-9edd1e65-2e6b-486c-86e6-3260c455cb59 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048846 Aug 09 15:40:37.894144 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3574/7157] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:40:38.044853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:38.046049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:38.061405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:38.061844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:38.062413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:38.063339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:38.064104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:38.064672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:38.102404 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:38.102887 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:38.103365 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:38.103821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lazy-loading 'fault' on Instance uuid 293e1c96-15e8-43c2-ab5c-eba551c5cdc5 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:40:38.171643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:40:38.184575 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1bdeafb0-e71b-4062-9809-2725f229319a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 200 len: 1354 microversion: 2.1 time: 0.147169 Aug 09 15:40:38.185580 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3584/7158] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:38 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 1354 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:40:39.222404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f191bd6-6195-4606-bdcb-a26a330078d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:39.224076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4f191bd6-6195-4606-bdcb-a26a330078d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 293e1c96-15e8-43c2-ab5c-eba551c5cdc5] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:39.235243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f191bd6-6195-4606-bdcb-a26a330078d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:39.236162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f191bd6-6195-4606-bdcb-a26a330078d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:39.236980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f191bd6-6195-4606-bdcb-a26a330078d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:39.238286 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f191bd6-6195-4606-bdcb-a26a330078d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:39.239200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f191bd6-6195-4606-bdcb-a26a330078d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:39.240046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4f191bd6-6195-4606-bdcb-a26a330078d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:39.267407 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-4f191bd6-6195-4606-bdcb-a26a330078d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] HTTP exception thrown: Instance 293e1c96-15e8-43c2-ab5c-eba551c5cdc5 could not be found. Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f191bd6-6195-4606-bdcb-a26a330078d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Request method failure captured: Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 HTTP/1.1 Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8n-wWj9WpQ7S_u-7y-n71vOR8Au_4UmgBa2wNz6rWCK__f-sxVABSN2zjqecqGC4IKaZVq-WcDEBtWz3KvoZvJhxDJbh8Jb_veqORDioviTgRfM8r8in8FLIT0_af7oefgXyAkdhAOfs_MBfLyn8o866ykWUknSf8OqrmStdHFFUClw Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 595d222e7a56448d9eaaf060d77c552b Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_595d222e7a56448d9eaaf060d77c552b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 595d222e7a56448d9eaaf060d77c552b Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestNetworkAdvancedServerOps-276209286-project Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3ca5b4f643564db09dfb30dd2a691789 Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-276209286-project Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 293e1c96-15e8-43c2-ab5c-eba551c5cdc5 could not be found. Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '293e1c96-15e8-43c2-ab5c-eba551c5cdc5'} Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 293e1c96-15e8-43c2-ab5c-eba551c5cdc5 could not be found. Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 293e1c96-15e8-43c2-ab5c-eba551c5cdc5 could not be found. Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:40:39.270846 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:40:39.277914 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:40:39.277914 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:40:39.277914 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:40:39.277914 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:40:39.277914 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:40:39.277914 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:40:39.277914 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 293e1c96-15e8-43c2-ab5c-eba551c5cdc5 could not be found. Aug 09 15:40:39.277914 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:40:39.277914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4f191bd6-6195-4606-bdcb-a26a330078d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Returning 404 to user: Instance 293e1c96-15e8-43c2-ab5c-eba551c5cdc5 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:40:39.277914 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4f191bd6-6195-4606-bdcb-a26a330078d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5" status: 404 len: 111 microversion: 2.1 time: 0.061648 Aug 09 15:40:39.277914 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3575/7159] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:39 2022] GET /compute/v2.1/servers/293e1c96-15e8-43c2-ab5c-eba551c5cdc5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:40:44.088898 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dca84581-1338-476a-b6cd-3c2ce110097d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '.version_select at 0x7f41dd422d30>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:44.121011 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dca84581-1338-476a-b6cd-3c2ce110097d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-189098836" status: 202 len: 0 microversion: 2.1 time: 0.039871 Aug 09 15:40:44.121806 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3585/7160] 10.222.0.50 () {58 vars in 1281 bytes} [Tue Aug 9 15:40:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-189098836 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:40:44.164079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7390a531-2631-4d89-bb85-62418b2bda91 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'create', calling method: .version_select at 0x7f41ddda0040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1093450749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAhb3NPa9vbO3JZ2EjuTh7PNEhXGuHRW6xbw8ZoqsKcYDjXQbn2j4KSSjosQXvCgmB5Zw1oP7ZrUxOsQBKqVm1SvXXulu/S6uAyHG0Qfm8ENMuX4DO7vFLzceG33tQ7TA=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:40:44.204273 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-7390a531-2631-4d89-bb85-62418b2bda91 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for project 595d222e7a56448d9eaaf060d77c552b. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:40:44.216464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-7390a531-2631-4d89-bb85-62418b2bda91 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for user 3ca5b4f643564db09dfb30dd2a691789 and project 595d222e7a56448d9eaaf060d77c552b. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:40:44.262979 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7390a531-2631-4d89-bb85-62418b2bda91 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.106821 Aug 09 15:40:44.263828 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3576/7161] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:40:44 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:40:52.787279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:40:52.794380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-882811953", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "3373463c-d4ca-4b67-95f5-2053ac2d15a4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1093450749", "security_groups": [{"name": "tempest-secgroup-smoke-893085739"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:40:53.056715 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] validate_networks() for [('3373463c-d4ca-4b67-95f5-2053ac2d15a4', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:40:53.751997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:40:53.752493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:40:53.753232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:40:53.753795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:40:53.754515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:40:53.775918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:53.777512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:53.778630 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:53.780096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:53.780769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:53.781371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:53.818701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for project 595d222e7a56448d9eaaf060d77c552b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:40:53.834527 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for user 3ca5b4f643564db09dfb30dd2a691789 and project 595d222e7a56448d9eaaf060d77c552b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:40:53.861909 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:40:53.869917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:40:53.967970 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0de62d69-8f9d-487b-8717-b618f735bbe0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.182153 Aug 09 15:40:53.969403 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3586/7162] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:40:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:40:53.985769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=32 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:40:53.992449 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dee81122-7aca-4175-8aa8-970667b030b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:53.993430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dee81122-7aca-4175-8aa8-970667b030b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:54.092743 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dee81122-7aca-4175-8aa8-970667b030b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:40:54.100385 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dee81122-7aca-4175-8aa8-970667b030b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1266 microversion: 2.1 time: 0.119974 Aug 09 15:40:54.102185 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3577/7163] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:53 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:40:55.135585 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b17fca2b-05c1-4d3d-b9b8-0855c3501a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:55.136384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b17fca2b-05c1-4d3d-b9b8-0855c3501a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:55.145975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17fca2b-05c1-4d3d-b9b8-0855c3501a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:55.146491 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17fca2b-05c1-4d3d-b9b8-0855c3501a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:55.146924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17fca2b-05c1-4d3d-b9b8-0855c3501a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:55.147688 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17fca2b-05c1-4d3d-b9b8-0855c3501a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:55.148148 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17fca2b-05c1-4d3d-b9b8-0855c3501a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:55.148568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b17fca2b-05c1-4d3d-b9b8-0855c3501a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:55.223855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b17fca2b-05c1-4d3d-b9b8-0855c3501a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:40:55.238765 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b17fca2b-05c1-4d3d-b9b8-0855c3501a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1318 microversion: 2.1 time: 0.107859 Aug 09 15:40:55.239887 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3587/7164] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:55 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1318 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:40:56.264023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7261de42-048e-430a-9fde-5e40dc41e960 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:56.265367 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7261de42-048e-430a-9fde-5e40dc41e960 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:56.278049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7261de42-048e-430a-9fde-5e40dc41e960 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:56.278049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7261de42-048e-430a-9fde-5e40dc41e960 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:56.278049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7261de42-048e-430a-9fde-5e40dc41e960 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:56.279064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7261de42-048e-430a-9fde-5e40dc41e960 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:56.280374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7261de42-048e-430a-9fde-5e40dc41e960 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:56.281632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7261de42-048e-430a-9fde-5e40dc41e960 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:56.444941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7261de42-048e-430a-9fde-5e40dc41e960 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:40:56.460988 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7261de42-048e-430a-9fde-5e40dc41e960 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1324 microversion: 2.1 time: 0.202256 Aug 09 15:40:56.463018 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3578/7165] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:56 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1324 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:40:57.501726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6567f012-7fd4-474b-aed0-a40e5d90a4b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:57.502979 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6567f012-7fd4-474b-aed0-a40e5d90a4b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:57.516115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6567f012-7fd4-474b-aed0-a40e5d90a4b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:57.516478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6567f012-7fd4-474b-aed0-a40e5d90a4b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:57.517171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6567f012-7fd4-474b-aed0-a40e5d90a4b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:57.518540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6567f012-7fd4-474b-aed0-a40e5d90a4b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:57.519462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6567f012-7fd4-474b-aed0-a40e5d90a4b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:57.520258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6567f012-7fd4-474b-aed0-a40e5d90a4b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:57.806407 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6567f012-7fd4-474b-aed0-a40e5d90a4b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:40:57.821815 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6567f012-7fd4-474b-aed0-a40e5d90a4b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1391 microversion: 2.1 time: 0.326901 Aug 09 15:40:57.827287 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3588/7166] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:57 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1391 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:40:57.968859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-79a01759-91ae-42c7-8ac5-71ef9e3cee58 req-8a943a75-e1a6-4459-8e42-4af8d6e31b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8029426-4d5b-4c1a-8c28-a32193f9ceac", "tag": "fca8d20e-7175-417e-a697-661957f9c688"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:40:57.990306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-79a01759-91ae-42c7-8ac5-71ef9e3cee58 req-8a943a75-e1a6-4459-8e42-4af8d6e31b24 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:57.991559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-79a01759-91ae-42c7-8ac5-71ef9e3cee58 req-8a943a75-e1a6-4459-8e42-4af8d6e31b24 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:57.992530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-79a01759-91ae-42c7-8ac5-71ef9e3cee58 req-8a943a75-e1a6-4459-8e42-4af8d6e31b24 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:58.024071 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-79a01759-91ae-42c7-8ac5-71ef9e3cee58 req-8a943a75-e1a6-4459-8e42-4af8d6e31b24 service nova] Creating event network-changed:fca8d20e-7175-417e-a697-661957f9c688 for instance a8029426-4d5b-4c1a-8c28-a32193f9ceac on n-h1-844626-8 Aug 09 15:40:58.039038 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-79a01759-91ae-42c7-8ac5-71ef9e3cee58 req-8a943a75-e1a6-4459-8e42-4af8d6e31b24 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072926 Aug 09 15:40:58.040284 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3579/7167] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:40:58.848958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-766f4a7c-8283-48c7-833d-399272889ab3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:40:58.849951 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-766f4a7c-8283-48c7-833d-399272889ab3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:40:58.854279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:40:58.864422 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-766f4a7c-8283-48c7-833d-399272889ab3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:58.865217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-766f4a7c-8283-48c7-833d-399272889ab3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:58.866007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-766f4a7c-8283-48c7-833d-399272889ab3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:58.867295 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-766f4a7c-8283-48c7-833d-399272889ab3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:40:58.868052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-766f4a7c-8283-48c7-833d-399272889ab3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:40:58.868740 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-766f4a7c-8283-48c7-833d-399272889ab3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:40:59.098086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-766f4a7c-8283-48c7-833d-399272889ab3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:40:59.112549 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-766f4a7c-8283-48c7-833d-399272889ab3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1391 microversion: 2.1 time: 0.270698 Aug 09 15:40:59.113592 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3589/7168] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:40:58 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1391 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:00.142654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fac10b84-be4e-4ecd-8264-b37816117291 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:00.143680 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fac10b84-be4e-4ecd-8264-b37816117291 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:00.146617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:41:00.154481 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fac10b84-be4e-4ecd-8264-b37816117291 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:00.155188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fac10b84-be4e-4ecd-8264-b37816117291 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:00.155798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fac10b84-be4e-4ecd-8264-b37816117291 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:00.156664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fac10b84-be4e-4ecd-8264-b37816117291 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:00.157242 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fac10b84-be4e-4ecd-8264-b37816117291 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:00.157751 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fac10b84-be4e-4ecd-8264-b37816117291 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:00.439686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fac10b84-be4e-4ecd-8264-b37816117291 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:00.450529 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fac10b84-be4e-4ecd-8264-b37816117291 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1391 microversion: 2.1 time: 0.314815 Aug 09 15:41:00.451185 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3580/7169] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:00 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1391 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:01.486064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c165bf2a-d22b-4edb-986a-7e3f26bd6a0c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:01.486949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c165bf2a-d22b-4edb-986a-7e3f26bd6a0c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:01.499593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c165bf2a-d22b-4edb-986a-7e3f26bd6a0c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:01.500419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c165bf2a-d22b-4edb-986a-7e3f26bd6a0c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:01.501223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c165bf2a-d22b-4edb-986a-7e3f26bd6a0c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:01.503058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c165bf2a-d22b-4edb-986a-7e3f26bd6a0c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:01.503908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c165bf2a-d22b-4edb-986a-7e3f26bd6a0c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:01.504672 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c165bf2a-d22b-4edb-986a-7e3f26bd6a0c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:01.712570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c165bf2a-d22b-4edb-986a-7e3f26bd6a0c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:01.721226 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c165bf2a-d22b-4edb-986a-7e3f26bd6a0c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1391 microversion: 2.1 time: 0.242275 Aug 09 15:41:01.721863 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3590/7170] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:01 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1391 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:02.747521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-00be352b-915d-4265-bcd0-a1d641e824b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:02.749963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-00be352b-915d-4265-bcd0-a1d641e824b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:02.761045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00be352b-915d-4265-bcd0-a1d641e824b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:02.761961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00be352b-915d-4265-bcd0-a1d641e824b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:02.762810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00be352b-915d-4265-bcd0-a1d641e824b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:02.764159 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00be352b-915d-4265-bcd0-a1d641e824b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:02.765003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00be352b-915d-4265-bcd0-a1d641e824b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:02.765811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-00be352b-915d-4265-bcd0-a1d641e824b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:03.042559 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-00be352b-915d-4265-bcd0-a1d641e824b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:03.051909 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-00be352b-915d-4265-bcd0-a1d641e824b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1391 microversion: 2.1 time: 0.312081 Aug 09 15:41:03.052534 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3581/7171] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:02 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1391 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:04.075212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-83db2070-d102-4d3f-a259-628d71caeeee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:04.076118 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-83db2070-d102-4d3f-a259-628d71caeeee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:04.078680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:41:04.079440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:41:04.086357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83db2070-d102-4d3f-a259-628d71caeeee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:04.086855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83db2070-d102-4d3f-a259-628d71caeeee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:04.087416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83db2070-d102-4d3f-a259-628d71caeeee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:04.088122 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83db2070-d102-4d3f-a259-628d71caeeee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:04.088577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83db2070-d102-4d3f-a259-628d71caeeee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:04.089005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-83db2070-d102-4d3f-a259-628d71caeeee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:04.287608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-83db2070-d102-4d3f-a259-628d71caeeee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:04.302364 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-83db2070-d102-4d3f-a259-628d71caeeee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1391 microversion: 2.1 time: 0.231422 Aug 09 15:41:04.303771 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3591/7172] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:04 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1391 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:04.797383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-10dd6957-1db5-4398-9db3-42761069ad24 req-86616539-3a07-49cb-8cca-6457050b696a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8029426-4d5b-4c1a-8c28-a32193f9ceac", "name": "network-vif-plugged", "status": "completed", "tag": "fca8d20e-7175-417e-a697-661957f9c688"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:41:04.807464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:41:04.815393 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-10dd6957-1db5-4398-9db3-42761069ad24 req-86616539-3a07-49cb-8cca-6457050b696a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:04.816210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-10dd6957-1db5-4398-9db3-42761069ad24 req-86616539-3a07-49cb-8cca-6457050b696a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:04.817003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-10dd6957-1db5-4398-9db3-42761069ad24 req-86616539-3a07-49cb-8cca-6457050b696a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:04.833560 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-10dd6957-1db5-4398-9db3-42761069ad24 req-86616539-3a07-49cb-8cca-6457050b696a service nova] Creating event network-vif-plugged:fca8d20e-7175-417e-a697-661957f9c688 for instance a8029426-4d5b-4c1a-8c28-a32193f9ceac on n-h1-844626-8 Aug 09 15:41:04.840152 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-10dd6957-1db5-4398-9db3-42761069ad24 req-86616539-3a07-49cb-8cca-6457050b696a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047126 Aug 09 15:41:04.841277 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3582/7173] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:41:05.340319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-044566df-c160-4714-809d-e4e86d05374b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:05.341112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-044566df-c160-4714-809d-e4e86d05374b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:05.349660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-044566df-c160-4714-809d-e4e86d05374b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:05.350349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-044566df-c160-4714-809d-e4e86d05374b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:05.351754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-044566df-c160-4714-809d-e4e86d05374b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:05.351754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-044566df-c160-4714-809d-e4e86d05374b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:05.352555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-044566df-c160-4714-809d-e4e86d05374b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:05.353065 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-044566df-c160-4714-809d-e4e86d05374b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:05.601976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-044566df-c160-4714-809d-e4e86d05374b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:05.612290 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-044566df-c160-4714-809d-e4e86d05374b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1391 microversion: 2.1 time: 0.276522 Aug 09 15:41:05.613083 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3592/7174] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:05 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1391 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:06.646845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1c00621e-ed05-4778-b554-25b5d0a05106 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:06.648191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1c00621e-ed05-4778-b554-25b5d0a05106 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:06.659980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c00621e-ed05-4778-b554-25b5d0a05106 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:06.660893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c00621e-ed05-4778-b554-25b5d0a05106 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:06.661693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c00621e-ed05-4778-b554-25b5d0a05106 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:06.662992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c00621e-ed05-4778-b554-25b5d0a05106 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:06.663875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c00621e-ed05-4778-b554-25b5d0a05106 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:06.664651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1c00621e-ed05-4778-b554-25b5d0a05106 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:06.869497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1c00621e-ed05-4778-b554-25b5d0a05106 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:06.878939 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1c00621e-ed05-4778-b554-25b5d0a05106 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1563 microversion: 2.1 time: 0.241623 Aug 09 15:41:06.879610 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3583/7175] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:06 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:06.902448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48a8a951-8bf3-4bc8-93cd-2916d3ce2eb7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:06.903060 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48a8a951-8bf3-4bc8-93cd-2916d3ce2eb7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:06.912003 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48a8a951-8bf3-4bc8-93cd-2916d3ce2eb7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:06.912693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48a8a951-8bf3-4bc8-93cd-2916d3ce2eb7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:06.913241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48a8a951-8bf3-4bc8-93cd-2916d3ce2eb7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:06.914075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48a8a951-8bf3-4bc8-93cd-2916d3ce2eb7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:06.914626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48a8a951-8bf3-4bc8-93cd-2916d3ce2eb7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:06.915287 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48a8a951-8bf3-4bc8-93cd-2916d3ce2eb7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:07.101808 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-48a8a951-8bf3-4bc8-93cd-2916d3ce2eb7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:07.110608 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48a8a951-8bf3-4bc8-93cd-2916d3ce2eb7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1563 microversion: 2.1 time: 0.212384 Aug 09 15:41:07.111448 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3593/7176] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:06 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1563 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:09.432189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9a7e84cf-eec9-407c-b364-cd094bd93e7f req-d4dae873-20fa-46fd-9bb8-015a54e0338f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8029426-4d5b-4c1a-8c28-a32193f9ceac", "tag": "fca8d20e-7175-417e-a697-661957f9c688"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:41:09.436723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-048216d9-ef4f-4176-a92e-4bc76a032fad tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:09.437563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-048216d9-ef4f-4176-a92e-4bc76a032fad tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:09.446076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-048216d9-ef4f-4176-a92e-4bc76a032fad tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:09.446937 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-048216d9-ef4f-4176-a92e-4bc76a032fad tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:09.447627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-048216d9-ef4f-4176-a92e-4bc76a032fad tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:09.448837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-048216d9-ef4f-4176-a92e-4bc76a032fad tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:09.449943 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-048216d9-ef4f-4176-a92e-4bc76a032fad tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:09.450617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-048216d9-ef4f-4176-a92e-4bc76a032fad tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:09.452361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9a7e84cf-eec9-407c-b364-cd094bd93e7f req-d4dae873-20fa-46fd-9bb8-015a54e0338f service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:09.453039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9a7e84cf-eec9-407c-b364-cd094bd93e7f req-d4dae873-20fa-46fd-9bb8-015a54e0338f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:09.453711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9a7e84cf-eec9-407c-b364-cd094bd93e7f req-d4dae873-20fa-46fd-9bb8-015a54e0338f service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:09.475484 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9a7e84cf-eec9-407c-b364-cd094bd93e7f req-d4dae873-20fa-46fd-9bb8-015a54e0338f service nova] Creating event network-changed:fca8d20e-7175-417e-a697-661957f9c688 for instance a8029426-4d5b-4c1a-8c28-a32193f9ceac on n-h1-844626-8 Aug 09 15:41:09.484313 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9a7e84cf-eec9-407c-b364-cd094bd93e7f req-d4dae873-20fa-46fd-9bb8-015a54e0338f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055336 Aug 09 15:41:09.485321 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3594/7177] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:41:09.823266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-048216d9-ef4f-4176-a92e-4bc76a032fad tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:09.833590 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-048216d9-ef4f-4176-a92e-4bc76a032fad tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1563 microversion: 2.1 time: 0.410761 Aug 09 15:41:09.835057 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3584/7178] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:09 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1563 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:31.242159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-8d1b3f13-bbe5-4ed6-bda1-2f835b26a19f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:41:31.244786 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-8d1b3f13-bbe5-4ed6-bda1-2f835b26a19f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:31.247751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=11 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:41:31.248426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=46 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:41:31.255440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d1b3f13-bbe5-4ed6-bda1-2f835b26a19f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:31.255915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d1b3f13-bbe5-4ed6-bda1-2f835b26a19f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:31.256345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d1b3f13-bbe5-4ed6-bda1-2f835b26a19f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:31.257055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d1b3f13-bbe5-4ed6-bda1-2f835b26a19f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:31.257500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d1b3f13-bbe5-4ed6-bda1-2f835b26a19f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:31.257916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-8d1b3f13-bbe5-4ed6-bda1-2f835b26a19f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:31.328614 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-8d1b3f13-bbe5-4ed6-bda1-2f835b26a19f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac/action" status: 200 len: 24574 microversion: 2.1 time: 0.090939 Aug 09 15:41:31.329681 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3595/7179] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:41:31 2022] POST /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac/action => generated 24574 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:41:42.343544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-adedbf25-7fc6-46e9-96bb-1fdd7581c7f7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:41:42.347000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-adedbf25-7fc6-46e9-96bb-1fdd7581c7f7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:42.349692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=9 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:41:42.350413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=34 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:41:42.358730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adedbf25-7fc6-46e9-96bb-1fdd7581c7f7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:42.359274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adedbf25-7fc6-46e9-96bb-1fdd7581c7f7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:42.359735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adedbf25-7fc6-46e9-96bb-1fdd7581c7f7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:42.360729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adedbf25-7fc6-46e9-96bb-1fdd7581c7f7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:42.361214 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adedbf25-7fc6-46e9-96bb-1fdd7581c7f7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:42.361664 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-adedbf25-7fc6-46e9-96bb-1fdd7581c7f7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:42.461057 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-adedbf25-7fc6-46e9-96bb-1fdd7581c7f7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac/action" status: 202 len: 0 microversion: 2.1 time: 0.122586 Aug 09 15:41:42.461777 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3585/7180] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:41:42 2022] POST /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:41:42.476779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dacfc6de-e3ab-414a-b6cb-1f5be204dc99 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:42.477642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dacfc6de-e3ab-414a-b6cb-1f5be204dc99 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:42.480392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:41:42.481205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:41:42.489441 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dacfc6de-e3ab-414a-b6cb-1f5be204dc99 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:42.490035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dacfc6de-e3ab-414a-b6cb-1f5be204dc99 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:42.490544 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dacfc6de-e3ab-414a-b6cb-1f5be204dc99 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:42.491509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dacfc6de-e3ab-414a-b6cb-1f5be204dc99 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:42.492016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dacfc6de-e3ab-414a-b6cb-1f5be204dc99 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:42.492419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dacfc6de-e3ab-414a-b6cb-1f5be204dc99 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:42.789227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dacfc6de-e3ab-414a-b6cb-1f5be204dc99 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:42.803814 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dacfc6de-e3ab-414a-b6cb-1f5be204dc99 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1674 microversion: 2.1 time: 0.334620 Aug 09 15:41:42.804664 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3596/7181] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:42 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1674 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:43.828444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa51e835-c15c-41e1-bee3-a8f372bd80ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:43.829161 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa51e835-c15c-41e1-bee3-a8f372bd80ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:43.837898 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa51e835-c15c-41e1-bee3-a8f372bd80ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:43.838650 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa51e835-c15c-41e1-bee3-a8f372bd80ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:43.839289 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa51e835-c15c-41e1-bee3-a8f372bd80ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:43.840142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa51e835-c15c-41e1-bee3-a8f372bd80ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:43.840717 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa51e835-c15c-41e1-bee3-a8f372bd80ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:43.841345 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa51e835-c15c-41e1-bee3-a8f372bd80ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:44.009748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa51e835-c15c-41e1-bee3-a8f372bd80ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:44.025719 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa51e835-c15c-41e1-bee3-a8f372bd80ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.201784 Aug 09 15:41:44.026856 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3586/7182] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:43 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:45.064542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-be0f29ea-fa79-46e0-b64a-2d2b69dc4f34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:45.065485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-be0f29ea-fa79-46e0-b64a-2d2b69dc4f34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:45.074224 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be0f29ea-fa79-46e0-b64a-2d2b69dc4f34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:45.074723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be0f29ea-fa79-46e0-b64a-2d2b69dc4f34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:45.075262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be0f29ea-fa79-46e0-b64a-2d2b69dc4f34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:45.075995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be0f29ea-fa79-46e0-b64a-2d2b69dc4f34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:45.076452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be0f29ea-fa79-46e0-b64a-2d2b69dc4f34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:45.077168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-be0f29ea-fa79-46e0-b64a-2d2b69dc4f34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:45.268078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-be0f29ea-fa79-46e0-b64a-2d2b69dc4f34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:45.277513 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-be0f29ea-fa79-46e0-b64a-2d2b69dc4f34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.218576 Aug 09 15:41:45.278178 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3597/7183] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:45 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:46.304994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-284d75f9-1aee-40d7-bd4a-589c24a2d3af tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:46.305986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-284d75f9-1aee-40d7-bd4a-589c24a2d3af tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:46.316795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-284d75f9-1aee-40d7-bd4a-589c24a2d3af tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:46.317387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-284d75f9-1aee-40d7-bd4a-589c24a2d3af tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:46.317956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-284d75f9-1aee-40d7-bd4a-589c24a2d3af tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:46.318834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-284d75f9-1aee-40d7-bd4a-589c24a2d3af tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:46.319406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-284d75f9-1aee-40d7-bd4a-589c24a2d3af tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:46.320089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-284d75f9-1aee-40d7-bd4a-589c24a2d3af tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:46.555596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-284d75f9-1aee-40d7-bd4a-589c24a2d3af tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:46.564443 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-284d75f9-1aee-40d7-bd4a-589c24a2d3af tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.266855 Aug 09 15:41:46.565066 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3587/7184] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:46 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:47.600362 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-13365701-039e-4eae-aaaf-2d2e838ffdef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:47.601206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-13365701-039e-4eae-aaaf-2d2e838ffdef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:47.611009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13365701-039e-4eae-aaaf-2d2e838ffdef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:47.611547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13365701-039e-4eae-aaaf-2d2e838ffdef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:47.611990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13365701-039e-4eae-aaaf-2d2e838ffdef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:47.612717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13365701-039e-4eae-aaaf-2d2e838ffdef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:47.613177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13365701-039e-4eae-aaaf-2d2e838ffdef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:47.613606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13365701-039e-4eae-aaaf-2d2e838ffdef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:47.802084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-13365701-039e-4eae-aaaf-2d2e838ffdef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:47.821506 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-13365701-039e-4eae-aaaf-2d2e838ffdef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.224986 Aug 09 15:41:47.822305 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3598/7185] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:47 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:48.859826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e59a027f-190d-4aa8-b9be-312b5e511354 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:48.860505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e59a027f-190d-4aa8-b9be-312b5e511354 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:48.871660 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e59a027f-190d-4aa8-b9be-312b5e511354 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:48.872497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e59a027f-190d-4aa8-b9be-312b5e511354 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:48.873197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e59a027f-190d-4aa8-b9be-312b5e511354 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:48.874336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e59a027f-190d-4aa8-b9be-312b5e511354 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:48.875074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e59a027f-190d-4aa8-b9be-312b5e511354 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:48.875781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e59a027f-190d-4aa8-b9be-312b5e511354 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:49.134958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e59a027f-190d-4aa8-b9be-312b5e511354 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:49.144765 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e59a027f-190d-4aa8-b9be-312b5e511354 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.291892 Aug 09 15:41:49.145469 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3588/7186] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:48 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:50.171391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fd5d1beb-dccb-44b5-9dfd-acf5930303c8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:50.172215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fd5d1beb-dccb-44b5-9dfd-acf5930303c8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:50.180510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd5d1beb-dccb-44b5-9dfd-acf5930303c8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:50.180983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd5d1beb-dccb-44b5-9dfd-acf5930303c8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:50.181448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd5d1beb-dccb-44b5-9dfd-acf5930303c8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:50.182153 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd5d1beb-dccb-44b5-9dfd-acf5930303c8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:50.182611 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd5d1beb-dccb-44b5-9dfd-acf5930303c8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:50.183036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fd5d1beb-dccb-44b5-9dfd-acf5930303c8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:50.358634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fd5d1beb-dccb-44b5-9dfd-acf5930303c8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:50.369426 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fd5d1beb-dccb-44b5-9dfd-acf5930303c8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.202360 Aug 09 15:41:50.370161 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3599/7187] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:50 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:51.397037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a6b80ba0-050a-4fc0-8bc4-708c8ff13ed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:51.399270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a6b80ba0-050a-4fc0-8bc4-708c8ff13ed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:51.412439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6b80ba0-050a-4fc0-8bc4-708c8ff13ed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:51.413369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6b80ba0-050a-4fc0-8bc4-708c8ff13ed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:51.414183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6b80ba0-050a-4fc0-8bc4-708c8ff13ed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:51.415513 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6b80ba0-050a-4fc0-8bc4-708c8ff13ed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:51.416334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6b80ba0-050a-4fc0-8bc4-708c8ff13ed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:51.417535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a6b80ba0-050a-4fc0-8bc4-708c8ff13ed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:51.586520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a6b80ba0-050a-4fc0-8bc4-708c8ff13ed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:51.596014 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a6b80ba0-050a-4fc0-8bc4-708c8ff13ed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.207094 Aug 09 15:41:51.596709 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3589/7188] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:51 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:52.621510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-484215ce-8397-47a0-89e9-1df46125d2f0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:52.622314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-484215ce-8397-47a0-89e9-1df46125d2f0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:52.630599 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484215ce-8397-47a0-89e9-1df46125d2f0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:52.631398 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484215ce-8397-47a0-89e9-1df46125d2f0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:52.631970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484215ce-8397-47a0-89e9-1df46125d2f0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:52.632925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484215ce-8397-47a0-89e9-1df46125d2f0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:52.633440 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484215ce-8397-47a0-89e9-1df46125d2f0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:52.634005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-484215ce-8397-47a0-89e9-1df46125d2f0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:52.820778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-484215ce-8397-47a0-89e9-1df46125d2f0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:52.833900 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-484215ce-8397-47a0-89e9-1df46125d2f0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.218294 Aug 09 15:41:52.834651 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3600/7189] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:52 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:53.860758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5adf8d92-15d0-4626-ab00-88b64507ca7d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:53.861838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5adf8d92-15d0-4626-ab00-88b64507ca7d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:53.872093 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5adf8d92-15d0-4626-ab00-88b64507ca7d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:53.872523 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5adf8d92-15d0-4626-ab00-88b64507ca7d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:53.872980 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5adf8d92-15d0-4626-ab00-88b64507ca7d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:53.873730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5adf8d92-15d0-4626-ab00-88b64507ca7d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:53.874199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5adf8d92-15d0-4626-ab00-88b64507ca7d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:53.874639 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5adf8d92-15d0-4626-ab00-88b64507ca7d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:54.058593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5adf8d92-15d0-4626-ab00-88b64507ca7d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:54.068906 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5adf8d92-15d0-4626-ab00-88b64507ca7d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.214645 Aug 09 15:41:54.069635 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3590/7190] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:53 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:55.104818 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-677b341b-4b6b-42ce-9d99-7236b999d273 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:55.105668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-677b341b-4b6b-42ce-9d99-7236b999d273 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:55.113645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-677b341b-4b6b-42ce-9d99-7236b999d273 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:55.114258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-677b341b-4b6b-42ce-9d99-7236b999d273 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:55.114743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-677b341b-4b6b-42ce-9d99-7236b999d273 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:55.115559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-677b341b-4b6b-42ce-9d99-7236b999d273 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:55.116056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-677b341b-4b6b-42ce-9d99-7236b999d273 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:55.116520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-677b341b-4b6b-42ce-9d99-7236b999d273 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:55.299845 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-677b341b-4b6b-42ce-9d99-7236b999d273 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:55.309377 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-677b341b-4b6b-42ce-9d99-7236b999d273 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.208943 Aug 09 15:41:55.310001 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3601/7191] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:55 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:56.333343 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-76ff307f-3765-40ba-b16e-6b2b932e1bde tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:56.334232 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-76ff307f-3765-40ba-b16e-6b2b932e1bde tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:56.342968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76ff307f-3765-40ba-b16e-6b2b932e1bde tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:56.343707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76ff307f-3765-40ba-b16e-6b2b932e1bde tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:56.344144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76ff307f-3765-40ba-b16e-6b2b932e1bde tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:56.345020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76ff307f-3765-40ba-b16e-6b2b932e1bde tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:56.345542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76ff307f-3765-40ba-b16e-6b2b932e1bde tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:56.346030 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-76ff307f-3765-40ba-b16e-6b2b932e1bde tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:56.566716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-76ff307f-3765-40ba-b16e-6b2b932e1bde tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:56.577096 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-76ff307f-3765-40ba-b16e-6b2b932e1bde tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.248151 Aug 09 15:41:56.577728 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3591/7192] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:56 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:41:57.613588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-923318cc-cb32-4075-9662-020f00d56274 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:57.614462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-923318cc-cb32-4075-9662-020f00d56274 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:57.622824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-923318cc-cb32-4075-9662-020f00d56274 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:57.623573 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-923318cc-cb32-4075-9662-020f00d56274 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:57.624094 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-923318cc-cb32-4075-9662-020f00d56274 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:57.625008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-923318cc-cb32-4075-9662-020f00d56274 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:57.625537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-923318cc-cb32-4075-9662-020f00d56274 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:57.626038 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-923318cc-cb32-4075-9662-020f00d56274 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:57.821282 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-923318cc-cb32-4075-9662-020f00d56274 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:57.835862 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-923318cc-cb32-4075-9662-020f00d56274 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.227017 Aug 09 15:41:57.836966 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3602/7193] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:57 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:41:58.871837 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-cb81e439-8879-427c-9927-6f96916fdba1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:41:58.872780 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-cb81e439-8879-427c-9927-6f96916fdba1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:41:58.883462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb81e439-8879-427c-9927-6f96916fdba1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:58.884312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb81e439-8879-427c-9927-6f96916fdba1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:58.885307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb81e439-8879-427c-9927-6f96916fdba1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:58.886170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb81e439-8879-427c-9927-6f96916fdba1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:41:58.886810 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb81e439-8879-427c-9927-6f96916fdba1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:41:58.887444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-cb81e439-8879-427c-9927-6f96916fdba1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:41:59.062112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-cb81e439-8879-427c-9927-6f96916fdba1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:41:59.077315 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-cb81e439-8879-427c-9927-6f96916fdba1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1679 microversion: 2.1 time: 0.210312 Aug 09 15:41:59.078506 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3592/7194] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:41:58 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:42:00.105518 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f159d0dd-7a51-45bb-976d-f96819465073 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:00.106473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f159d0dd-7a51-45bb-976d-f96819465073 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:00.115772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f159d0dd-7a51-45bb-976d-f96819465073 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:00.116337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f159d0dd-7a51-45bb-976d-f96819465073 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:00.116847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f159d0dd-7a51-45bb-976d-f96819465073 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:00.117642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f159d0dd-7a51-45bb-976d-f96819465073 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:00.118203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f159d0dd-7a51-45bb-976d-f96819465073 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:00.118685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f159d0dd-7a51-45bb-976d-f96819465073 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:00.288760 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f159d0dd-7a51-45bb-976d-f96819465073 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:42:00.297783 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f159d0dd-7a51-45bb-976d-f96819465073 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1682 microversion: 2.1 time: 0.197163 Aug 09 15:42:00.298481 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3603/7195] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:42:00 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1682 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:42:24.555585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c34394b6-85c5-4ce9-8add-1173feb96f4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:42:24.558440 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c34394b6-85c5-4ce9-8add-1173feb96f4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:24.561378 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=16 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:42:24.562563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:42:24.570832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c34394b6-85c5-4ce9-8add-1173feb96f4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:24.571488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c34394b6-85c5-4ce9-8add-1173feb96f4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:24.572124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c34394b6-85c5-4ce9-8add-1173feb96f4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:24.572928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c34394b6-85c5-4ce9-8add-1173feb96f4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:24.573509 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c34394b6-85c5-4ce9-8add-1173feb96f4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:24.574001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c34394b6-85c5-4ce9-8add-1173feb96f4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:24.639039 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c34394b6-85c5-4ce9-8add-1173feb96f4a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac/action" status: 200 len: 69179 microversion: 2.1 time: 0.087643 Aug 09 15:42:24.639797 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3593/7196] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:42:24 2022] POST /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac/action => generated 69179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:42:32.614076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1edd77a3-cf47-4e17-9b9d-6cb811017c17 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:32.615035 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1edd77a3-cf47-4e17-9b9d-6cb811017c17 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:32.621687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=16 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:42:32.622949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=48 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:42:32.630349 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1edd77a3-cf47-4e17-9b9d-6cb811017c17 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:32.631076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1edd77a3-cf47-4e17-9b9d-6cb811017c17 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:32.632132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1edd77a3-cf47-4e17-9b9d-6cb811017c17 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:32.633341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1edd77a3-cf47-4e17-9b9d-6cb811017c17 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:32.634839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1edd77a3-cf47-4e17-9b9d-6cb811017c17 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:32.635596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1edd77a3-cf47-4e17-9b9d-6cb811017c17 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:32.691622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1edd77a3-cf47-4e17-9b9d-6cb811017c17 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:42:32.717656 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-2f991f67-74bc-49f7-ab0c-7671a54c5876 req-23ac526c-975d-4291-9319-a85a5e6d542a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8029426-4d5b-4c1a-8c28-a32193f9ceac", "tag": "fca8d20e-7175-417e-a697-661957f9c688"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:42:32.734737 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2f991f67-74bc-49f7-ab0c-7671a54c5876 req-23ac526c-975d-4291-9319-a85a5e6d542a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:32.735798 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2f991f67-74bc-49f7-ab0c-7671a54c5876 req-23ac526c-975d-4291-9319-a85a5e6d542a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:32.736478 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2f991f67-74bc-49f7-ab0c-7671a54c5876 req-23ac526c-975d-4291-9319-a85a5e6d542a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:32.757245 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-2f991f67-74bc-49f7-ab0c-7671a54c5876 req-23ac526c-975d-4291-9319-a85a5e6d542a service nova] Creating event network-changed:fca8d20e-7175-417e-a697-661957f9c688 for instance a8029426-4d5b-4c1a-8c28-a32193f9ceac on n-h1-844626-8 Aug 09 15:42:32.768043 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-2f991f67-74bc-49f7-ab0c-7671a54c5876 req-23ac526c-975d-4291-9319-a85a5e6d542a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154009 Aug 09 15:42:32.768351 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3594/7197] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:42:32.834421 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1edd77a3-cf47-4e17-9b9d-6cb811017c17 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 204 len: 0 microversion: 2.1 time: 0.227736 Aug 09 15:42:32.836084 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3604/7198] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:42:32 2022] DELETE /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:42:32.852135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-91a1d7d2-b065-47fd-94f3-09bb5a090a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:32.854023 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-91a1d7d2-b065-47fd-94f3-09bb5a090a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:32.867673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91a1d7d2-b065-47fd-94f3-09bb5a090a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:32.868994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91a1d7d2-b065-47fd-94f3-09bb5a090a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:32.870057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91a1d7d2-b065-47fd-94f3-09bb5a090a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:32.871792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91a1d7d2-b065-47fd-94f3-09bb5a090a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:32.872594 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91a1d7d2-b065-47fd-94f3-09bb5a090a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:32.873599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-91a1d7d2-b065-47fd-94f3-09bb5a090a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:33.087493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-91a1d7d2-b065-47fd-94f3-09bb5a090a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:42:33.102980 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-91a1d7d2-b065-47fd-94f3-09bb5a090a02 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1688 microversion: 2.1 time: 0.259205 Aug 09 15:42:33.104129 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3595/7199] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:42:32 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1688 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:42:34.141940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-526fec3c-185e-45ed-8c7a-bddccbe9b1f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:34.143899 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-526fec3c-185e-45ed-8c7a-bddccbe9b1f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:34.154272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-526fec3c-185e-45ed-8c7a-bddccbe9b1f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:34.155346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-526fec3c-185e-45ed-8c7a-bddccbe9b1f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:34.155675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-526fec3c-185e-45ed-8c7a-bddccbe9b1f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:34.156535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-526fec3c-185e-45ed-8c7a-bddccbe9b1f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:34.157213 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-526fec3c-185e-45ed-8c7a-bddccbe9b1f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:34.157675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-526fec3c-185e-45ed-8c7a-bddccbe9b1f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:34.531872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-526fec3c-185e-45ed-8c7a-bddccbe9b1f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:42:34.541083 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-526fec3c-185e-45ed-8c7a-bddccbe9b1f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 200 len: 1688 microversion: 2.1 time: 0.405352 Aug 09 15:42:34.542113 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3605/7200] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:42:34 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 1688 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:42:35.044564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-1552df92-c3dc-4254-ae8e-58c45f71b1af req-5566af77-37f3-439e-b0ce-69126d33e9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8029426-4d5b-4c1a-8c28-a32193f9ceac", "name": "network-vif-deleted", "tag": "fca8d20e-7175-417e-a697-661957f9c688"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:42:35.059786 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1552df92-c3dc-4254-ae8e-58c45f71b1af req-5566af77-37f3-439e-b0ce-69126d33e9bc service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:35.060626 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1552df92-c3dc-4254-ae8e-58c45f71b1af req-5566af77-37f3-439e-b0ce-69126d33e9bc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:35.061057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-1552df92-c3dc-4254-ae8e-58c45f71b1af req-5566af77-37f3-439e-b0ce-69126d33e9bc service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:35.087507 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-1552df92-c3dc-4254-ae8e-58c45f71b1af req-5566af77-37f3-439e-b0ce-69126d33e9bc service nova] Creating event network-vif-deleted:fca8d20e-7175-417e-a697-661957f9c688 for instance a8029426-4d5b-4c1a-8c28-a32193f9ceac on n-h1-844626-8 Aug 09 15:42:35.099982 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-1552df92-c3dc-4254-ae8e-58c45f71b1af req-5566af77-37f3-439e-b0ce-69126d33e9bc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073220 Aug 09 15:42:35.101433 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3596/7201] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:42:35.577211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4c87304b-6134-418a-ab42-b9c5bc17c864 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:35.578561 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4c87304b-6134-418a-ab42-b9c5bc17c864 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a8029426-4d5b-4c1a-8c28-a32193f9ceac] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:35.589494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c87304b-6134-418a-ab42-b9c5bc17c864 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:35.590294 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c87304b-6134-418a-ab42-b9c5bc17c864 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:35.590941 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c87304b-6134-418a-ab42-b9c5bc17c864 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:35.592168 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c87304b-6134-418a-ab42-b9c5bc17c864 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:35.592846 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c87304b-6134-418a-ab42-b9c5bc17c864 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:35.593415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4c87304b-6134-418a-ab42-b9c5bc17c864 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:35.616964 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-4c87304b-6134-418a-ab42-b9c5bc17c864 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] HTTP exception thrown: Instance a8029426-4d5b-4c1a-8c28-a32193f9ceac could not be found. Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4c87304b-6134-418a-ab42-b9c5bc17c864 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Request method failure captured: Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac HTTP/1.1 Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n-wWj9WpQ7S_u-7y-n71vOR8Au_4UmgBa2wNz6rWCK__f-sxVABSN2zjqecqGC4IKaZVq-WcDEBtWz3KvoZvJhxDJbh8Jb_veqORDioviTgRfM8r8in8FLIT0_af7oefgXyAkdhAOfs_MBfLyn8o866ykWUknSf8OqrmStdHFFUClw Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 595d222e7a56448d9eaaf060d77c552b Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_595d222e7a56448d9eaaf060d77c552b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 595d222e7a56448d9eaaf060d77c552b Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestNetworkAdvancedServerOps-276209286-project Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 3ca5b4f643564db09dfb30dd2a691789 Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-276209286-project Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance a8029426-4d5b-4c1a-8c28-a32193f9ceac could not be found. Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'a8029426-4d5b-4c1a-8c28-a32193f9ceac'} Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8029426-4d5b-4c1a-8c28-a32193f9ceac could not be found. Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8029426-4d5b-4c1a-8c28-a32193f9ceac could not be found. Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:42:35.618974 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:42:35.628126 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:42:35.628126 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:42:35.628126 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:42:35.628126 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:42:35.628126 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:42:35.628126 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:42:35.628126 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8029426-4d5b-4c1a-8c28-a32193f9ceac could not be found. Aug 09 15:42:35.628126 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:42:35.628126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4c87304b-6134-418a-ab42-b9c5bc17c864 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Returning 404 to user: Instance a8029426-4d5b-4c1a-8c28-a32193f9ceac could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:42:35.628126 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4c87304b-6134-418a-ab42-b9c5bc17c864 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac" status: 404 len: 111 microversion: 2.1 time: 0.059091 Aug 09 15:42:35.628126 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3606/7202] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:42:35 2022] GET /compute/v2.1/servers/a8029426-4d5b-4c1a-8c28-a32193f9ceac => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:42:40.221821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f37aa007-0b43-46e7-95c1-5ec53600aebb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '.version_select at 0x7f41dddeaf70>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:40.254011 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f37aa007-0b43-46e7-95c1-5ec53600aebb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1093450749" status: 202 len: 0 microversion: 2.1 time: 0.036597 Aug 09 15:42:40.255258 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3597/7203] 10.222.0.50 () {58 vars in 1284 bytes} [Tue Aug 9 15:42:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1093450749 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 15:42:40.299379 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0a7dd3e9-a2ff-4944-b34b-1f759009dc3e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'create', calling method: .version_select at 0x7f41dd422280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-5920329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTzDi6mO5v9vKu3+HFzErZfMwUCPwzWeyVBLKghdGPrsyOJweKtlgkP2/UqERSB/QhBVWYQp9LyR7CP+9ITEntmr8r860yNwd4guav9IisIBao1xq+z7flUoMyLmo0aQw=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:42:40.331143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0a7dd3e9-a2ff-4944-b34b-1f759009dc3e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for project 595d222e7a56448d9eaaf060d77c552b. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:42:40.339536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0a7dd3e9-a2ff-4944-b34b-1f759009dc3e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for user 3ca5b4f643564db09dfb30dd2a691789 and project 595d222e7a56448d9eaaf060d77c552b. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:42:40.380787 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0a7dd3e9-a2ff-4944-b34b-1f759009dc3e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.089692 Aug 09 15:42:40.381767 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3607/7204] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:42:40 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:42:49.037975 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=14 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:42:49.044799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-524353727", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "ca7dfbad-1508-4590-8ae3-5e91fae1fe47"}], "key_name": "tempest-TestNetworkAdvancedServerOps-5920329", "security_groups": [{"name": "tempest-secgroup-smoke-1771689823"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:42:49.227978 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] validate_networks() for [('ca7dfbad-1508-4590-8ae3-5e91fae1fe47', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:42:50.200696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:42:50.201575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:42:50.202563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:42:50.203686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:42:50.204486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:42:50.230511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:50.230511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:50.230511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:50.230511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:50.230511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:50.230511 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:50.281416 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for project 595d222e7a56448d9eaaf060d77c552b. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:42:50.290213 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for user 3ca5b4f643564db09dfb30dd2a691789 and project 595d222e7a56448d9eaaf060d77c552b. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:42:50.309653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:42:50.312752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:42:50.389643 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-744bc4d1-ab06-469b-9084-a084dd21e3e2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.355760 Aug 09 15:42:50.391486 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3598/7205] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:42:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:42:50.407825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:42:50.410747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:42:50.412788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:42:50.423746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-856566fd-a0e5-4536-8428-3a4f132a3c57 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:50.425350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-856566fd-a0e5-4536-8428-3a4f132a3c57 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:50.565319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-856566fd-a0e5-4536-8428-3a4f132a3c57 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:42:50.586716 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-856566fd-a0e5-4536-8428-3a4f132a3c57 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1263 microversion: 2.1 time: 0.182622 Aug 09 15:42:50.588291 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3608/7206] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:42:50 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:42:51.627231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f398a837-524e-490f-8ec0-39f65f82ac45 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:51.628315 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f398a837-524e-490f-8ec0-39f65f82ac45 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:51.643539 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f398a837-524e-490f-8ec0-39f65f82ac45 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:51.644396 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f398a837-524e-490f-8ec0-39f65f82ac45 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:51.645154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f398a837-524e-490f-8ec0-39f65f82ac45 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:51.646427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f398a837-524e-490f-8ec0-39f65f82ac45 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:51.647281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f398a837-524e-490f-8ec0-39f65f82ac45 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:51.648057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f398a837-524e-490f-8ec0-39f65f82ac45 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:51.749982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f398a837-524e-490f-8ec0-39f65f82ac45 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:42:51.766009 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f398a837-524e-490f-8ec0-39f65f82ac45 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1315 microversion: 2.1 time: 0.146215 Aug 09 15:42:51.767326 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3599/7207] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:42:51 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:42:52.811622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d91b0b25-a7f6-4ffa-a91e-5da4c2450999 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:52.811622 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d91b0b25-a7f6-4ffa-a91e-5da4c2450999 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:52.818191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d91b0b25-a7f6-4ffa-a91e-5da4c2450999 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:52.819266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d91b0b25-a7f6-4ffa-a91e-5da4c2450999 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:52.819623 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d91b0b25-a7f6-4ffa-a91e-5da4c2450999 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:52.820487 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d91b0b25-a7f6-4ffa-a91e-5da4c2450999 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:52.821067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d91b0b25-a7f6-4ffa-a91e-5da4c2450999 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:52.821697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d91b0b25-a7f6-4ffa-a91e-5da4c2450999 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:53.031066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d91b0b25-a7f6-4ffa-a91e-5da4c2450999 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:42:53.045897 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d91b0b25-a7f6-4ffa-a91e-5da4c2450999 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1321 microversion: 2.1 time: 0.247085 Aug 09 15:42:53.046779 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3609/7208] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:42:52 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:42:54.069455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2c20fd4d-a731-4d19-b1a1-82ad9f1cc4d4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:54.070843 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2c20fd4d-a731-4d19-b1a1-82ad9f1cc4d4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:54.083763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c20fd4d-a731-4d19-b1a1-82ad9f1cc4d4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:54.084532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c20fd4d-a731-4d19-b1a1-82ad9f1cc4d4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:54.085391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c20fd4d-a731-4d19-b1a1-82ad9f1cc4d4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:54.086320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c20fd4d-a731-4d19-b1a1-82ad9f1cc4d4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:54.087125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c20fd4d-a731-4d19-b1a1-82ad9f1cc4d4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:54.087771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2c20fd4d-a731-4d19-b1a1-82ad9f1cc4d4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:54.458578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2c20fd4d-a731-4d19-b1a1-82ad9f1cc4d4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:42:54.470342 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2c20fd4d-a731-4d19-b1a1-82ad9f1cc4d4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1389 microversion: 2.1 time: 0.405184 Aug 09 15:42:54.471656 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3600/7209] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:42:54 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1389 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:42:54.698005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-985aee72-234a-48ec-bd7d-5ddfc80f3e50 req-d668d9b8-1826-4fd1-b173-6bffdef40652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7522f12-465c-468d-bcfc-b5889e0a268c", "tag": "2961a06f-92c6-4538-8a12-dfec357f04b9"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:42:54.711575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-985aee72-234a-48ec-bd7d-5ddfc80f3e50 req-d668d9b8-1826-4fd1-b173-6bffdef40652 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:54.712256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-985aee72-234a-48ec-bd7d-5ddfc80f3e50 req-d668d9b8-1826-4fd1-b173-6bffdef40652 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:54.712804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-985aee72-234a-48ec-bd7d-5ddfc80f3e50 req-d668d9b8-1826-4fd1-b173-6bffdef40652 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:54.734140 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-985aee72-234a-48ec-bd7d-5ddfc80f3e50 req-d668d9b8-1826-4fd1-b173-6bffdef40652 service nova] Creating event network-changed:2961a06f-92c6-4538-8a12-dfec357f04b9 for instance a7522f12-465c-468d-bcfc-b5889e0a268c on n-h1-844626-8 Aug 09 15:42:54.743895 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-985aee72-234a-48ec-bd7d-5ddfc80f3e50 req-d668d9b8-1826-4fd1-b173-6bffdef40652 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176967 Aug 09 15:42:54.745046 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3610/7210] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:42:55.510763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e2990d92-a706-4857-ae1f-2b2c6a8f13bd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:55.512031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e2990d92-a706-4857-ae1f-2b2c6a8f13bd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:55.516157 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:42:55.523890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2990d92-a706-4857-ae1f-2b2c6a8f13bd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:55.524535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2990d92-a706-4857-ae1f-2b2c6a8f13bd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:55.525098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2990d92-a706-4857-ae1f-2b2c6a8f13bd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:55.526000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2990d92-a706-4857-ae1f-2b2c6a8f13bd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:55.526596 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2990d92-a706-4857-ae1f-2b2c6a8f13bd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:55.527188 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e2990d92-a706-4857-ae1f-2b2c6a8f13bd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:55.762004 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e2990d92-a706-4857-ae1f-2b2c6a8f13bd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:42:55.771480 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e2990d92-a706-4857-ae1f-2b2c6a8f13bd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1389 microversion: 2.1 time: 0.267975 Aug 09 15:42:55.772176 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3601/7211] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:42:55 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1389 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:42:56.798071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2c083b91-a924-44b3-b126-8845536710f9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:56.799425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2c083b91-a924-44b3-b126-8845536710f9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:56.811269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c083b91-a924-44b3-b126-8845536710f9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:56.812093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c083b91-a924-44b3-b126-8845536710f9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:56.815240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c083b91-a924-44b3-b126-8845536710f9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:56.815240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c083b91-a924-44b3-b126-8845536710f9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:56.815240 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c083b91-a924-44b3-b126-8845536710f9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:56.815805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2c083b91-a924-44b3-b126-8845536710f9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:57.001923 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2c083b91-a924-44b3-b126-8845536710f9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:42:57.011852 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2c083b91-a924-44b3-b126-8845536710f9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1389 microversion: 2.1 time: 0.220774 Aug 09 15:42:57.012843 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3611/7212] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:42:56 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1389 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:42:58.042649 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-eee1f6c6-8aef-4272-bd2f-20a88c24b55d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:58.043828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-eee1f6c6-8aef-4272-bd2f-20a88c24b55d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:58.056252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee1f6c6-8aef-4272-bd2f-20a88c24b55d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:58.057073 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee1f6c6-8aef-4272-bd2f-20a88c24b55d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:58.057848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee1f6c6-8aef-4272-bd2f-20a88c24b55d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:58.059066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee1f6c6-8aef-4272-bd2f-20a88c24b55d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:58.059866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee1f6c6-8aef-4272-bd2f-20a88c24b55d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:58.060644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-eee1f6c6-8aef-4272-bd2f-20a88c24b55d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:58.303933 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-eee1f6c6-8aef-4272-bd2f-20a88c24b55d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:42:58.313396 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-eee1f6c6-8aef-4272-bd2f-20a88c24b55d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1389 microversion: 2.1 time: 0.277882 Aug 09 15:42:58.314052 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3602/7213] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:42:58 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1389 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:42:59.340137 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e584f57e-ed89-450d-b754-5ebe8e3ffaf6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:42:59.341052 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e584f57e-ed89-450d-b754-5ebe8e3ffaf6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:42:59.351609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e584f57e-ed89-450d-b754-5ebe8e3ffaf6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:59.352564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e584f57e-ed89-450d-b754-5ebe8e3ffaf6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:59.353288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e584f57e-ed89-450d-b754-5ebe8e3ffaf6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:59.354558 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e584f57e-ed89-450d-b754-5ebe8e3ffaf6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:42:59.355509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e584f57e-ed89-450d-b754-5ebe8e3ffaf6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:42:59.356249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e584f57e-ed89-450d-b754-5ebe8e3ffaf6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:42:59.572244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e584f57e-ed89-450d-b754-5ebe8e3ffaf6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:42:59.587267 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e584f57e-ed89-450d-b754-5ebe8e3ffaf6 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1389 microversion: 2.1 time: 0.252577 Aug 09 15:42:59.588364 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3612/7214] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:42:59 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1389 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:00.610942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ca3797c8-c441-4c3d-8e09-505e07621d44 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:00.611929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ca3797c8-c441-4c3d-8e09-505e07621d44 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:00.615723 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:43:00.616607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:43:00.624926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca3797c8-c441-4c3d-8e09-505e07621d44 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:00.625578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca3797c8-c441-4c3d-8e09-505e07621d44 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:00.626096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca3797c8-c441-4c3d-8e09-505e07621d44 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:00.626989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca3797c8-c441-4c3d-8e09-505e07621d44 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:00.627561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca3797c8-c441-4c3d-8e09-505e07621d44 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:00.628053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ca3797c8-c441-4c3d-8e09-505e07621d44 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:00.854240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ca3797c8-c441-4c3d-8e09-505e07621d44 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:00.866809 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ca3797c8-c441-4c3d-8e09-505e07621d44 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1389 microversion: 2.1 time: 0.259998 Aug 09 15:43:00.867992 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3603/7215] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:00 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1389 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:01.356616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:43:01.435540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-6c89dd56-4478-4414-bd38-593c8b56ad30 req-84ec2e8b-5d94-41b3-8202-3de17fb66d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7522f12-465c-468d-bcfc-b5889e0a268c", "name": "network-vif-plugged", "status": "completed", "tag": "2961a06f-92c6-4538-8a12-dfec357f04b9"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:43:01.448432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6c89dd56-4478-4414-bd38-593c8b56ad30 req-84ec2e8b-5d94-41b3-8202-3de17fb66d82 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:01.449001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6c89dd56-4478-4414-bd38-593c8b56ad30 req-84ec2e8b-5d94-41b3-8202-3de17fb66d82 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:01.449485 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-6c89dd56-4478-4414-bd38-593c8b56ad30 req-84ec2e8b-5d94-41b3-8202-3de17fb66d82 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:01.465114 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-6c89dd56-4478-4414-bd38-593c8b56ad30 req-84ec2e8b-5d94-41b3-8202-3de17fb66d82 service nova] Creating event network-vif-plugged:2961a06f-92c6-4538-8a12-dfec357f04b9 for instance a7522f12-465c-468d-bcfc-b5889e0a268c on n-h1-844626-8 Aug 09 15:43:01.471659 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-6c89dd56-4478-4414-bd38-593c8b56ad30 req-84ec2e8b-5d94-41b3-8202-3de17fb66d82 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126637 Aug 09 15:43:01.472454 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3613/7216] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:43:01.894013 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-56c9910f-969d-42a2-8121-da60875d0324 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:01.895059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-56c9910f-969d-42a2-8121-da60875d0324 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:01.904437 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c9910f-969d-42a2-8121-da60875d0324 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:01.905631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c9910f-969d-42a2-8121-da60875d0324 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:01.906133 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c9910f-969d-42a2-8121-da60875d0324 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:01.906944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c9910f-969d-42a2-8121-da60875d0324 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:01.907455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c9910f-969d-42a2-8121-da60875d0324 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:01.907895 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56c9910f-969d-42a2-8121-da60875d0324 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:02.120870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-56c9910f-969d-42a2-8121-da60875d0324 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:02.136620 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-56c9910f-969d-42a2-8121-da60875d0324 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1389 microversion: 2.1 time: 0.246175 Aug 09 15:43:02.137742 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3604/7217] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:01 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1389 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:03.174281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-851ed04b-38ca-49dd-af4c-3ff696702606 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:03.175172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-851ed04b-38ca-49dd-af4c-3ff696702606 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:03.183560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-851ed04b-38ca-49dd-af4c-3ff696702606 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:03.184050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-851ed04b-38ca-49dd-af4c-3ff696702606 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:03.184484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-851ed04b-38ca-49dd-af4c-3ff696702606 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:03.185335 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-851ed04b-38ca-49dd-af4c-3ff696702606 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:03.186041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-851ed04b-38ca-49dd-af4c-3ff696702606 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:03.186539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-851ed04b-38ca-49dd-af4c-3ff696702606 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:03.423406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-851ed04b-38ca-49dd-af4c-3ff696702606 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:03.437428 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-851ed04b-38ca-49dd-af4c-3ff696702606 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1562 microversion: 2.1 time: 0.268393 Aug 09 15:43:03.438519 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3614/7218] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:03 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1562 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:03.467935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17ae7028-8b9c-49af-94e4-2726e0077b25 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:03.468833 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17ae7028-8b9c-49af-94e4-2726e0077b25 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:03.490309 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17ae7028-8b9c-49af-94e4-2726e0077b25 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:03.491263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17ae7028-8b9c-49af-94e4-2726e0077b25 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:03.492028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17ae7028-8b9c-49af-94e4-2726e0077b25 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:03.493293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17ae7028-8b9c-49af-94e4-2726e0077b25 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:03.494045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17ae7028-8b9c-49af-94e4-2726e0077b25 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:03.494634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17ae7028-8b9c-49af-94e4-2726e0077b25 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:03.740870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-17ae7028-8b9c-49af-94e4-2726e0077b25 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:03.751119 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17ae7028-8b9c-49af-94e4-2726e0077b25 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1562 microversion: 2.1 time: 0.287500 Aug 09 15:43:03.751868 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3605/7219] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:03 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1562 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:06.758563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c685a53a-974e-4ca3-9fbb-cbbef2167781 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:06.759632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c685a53a-974e-4ca3-9fbb-cbbef2167781 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:06.761859 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-2cac34b1-99fb-45f2-ae41-c8bcf7accbf1 req-9726b302-f5f0-42e2-9da0-50df784d0403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7522f12-465c-468d-bcfc-b5889e0a268c", "tag": "2961a06f-92c6-4538-8a12-dfec357f04b9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:43:06.772644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c685a53a-974e-4ca3-9fbb-cbbef2167781 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:06.773468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c685a53a-974e-4ca3-9fbb-cbbef2167781 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:06.774200 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c685a53a-974e-4ca3-9fbb-cbbef2167781 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:06.775528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c685a53a-974e-4ca3-9fbb-cbbef2167781 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:06.776324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c685a53a-974e-4ca3-9fbb-cbbef2167781 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:06.777042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c685a53a-974e-4ca3-9fbb-cbbef2167781 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:06.783005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2cac34b1-99fb-45f2-ae41-c8bcf7accbf1 req-9726b302-f5f0-42e2-9da0-50df784d0403 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:06.783870 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2cac34b1-99fb-45f2-ae41-c8bcf7accbf1 req-9726b302-f5f0-42e2-9da0-50df784d0403 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:06.784589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-2cac34b1-99fb-45f2-ae41-c8bcf7accbf1 req-9726b302-f5f0-42e2-9da0-50df784d0403 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:06.807412 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-2cac34b1-99fb-45f2-ae41-c8bcf7accbf1 req-9726b302-f5f0-42e2-9da0-50df784d0403 service nova] Creating event network-changed:2961a06f-92c6-4538-8a12-dfec357f04b9 for instance a7522f12-465c-468d-bcfc-b5889e0a268c on n-h1-844626-8 Aug 09 15:43:06.817481 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-2cac34b1-99fb-45f2-ae41-c8bcf7accbf1 req-9726b302-f5f0-42e2-9da0-50df784d0403 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062114 Aug 09 15:43:06.818964 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3606/7220] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:43:07.128787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c685a53a-974e-4ca3-9fbb-cbbef2167781 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:07.139833 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c685a53a-974e-4ca3-9fbb-cbbef2167781 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1562 microversion: 2.1 time: 0.388807 Aug 09 15:43:07.151623 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3615/7221] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:06 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1562 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:28.454521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=11 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:43:28.455386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=46 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:43:28.463208 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1a4464b8-331b-4c6b-a5c9-e5eb0048fc0e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:43:28.471444 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1a4464b8-331b-4c6b-a5c9-e5eb0048fc0e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:28.477420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a4464b8-331b-4c6b-a5c9-e5eb0048fc0e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:28.477977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a4464b8-331b-4c6b-a5c9-e5eb0048fc0e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:28.478470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a4464b8-331b-4c6b-a5c9-e5eb0048fc0e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:28.479428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a4464b8-331b-4c6b-a5c9-e5eb0048fc0e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:28.479908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a4464b8-331b-4c6b-a5c9-e5eb0048fc0e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:28.480394 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1a4464b8-331b-4c6b-a5c9-e5eb0048fc0e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:28.543550 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1a4464b8-331b-4c6b-a5c9-e5eb0048fc0e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c/action" status: 200 len: 24562 microversion: 2.1 time: 0.090822 Aug 09 15:43:28.544831 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3607/7222] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:43:28 2022] POST /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c/action => generated 24562 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:43:34.920738 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:43:34.923737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:34.926619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=18 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:43:34.927477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=34 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:43:34.934367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:34.934858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:34.935361 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:34.936134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:34.936593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:34.937010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:34.989853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:35.000199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Old instance type m1.heat2, new instance type m1.heat {{(pid=119407) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 09 15:43:35.011145 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:43:35.011843 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:43:35.012644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:43:35.013346 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:43:35.013911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:43:35.112081 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b1e65827-f3ce-466b-b97b-fc054fe9fdfa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c/action" status: 202 len: 0 microversion: 2.1 time: 0.196325 Aug 09 15:43:35.113143 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3616/7223] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:43:34 2022] POST /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:43:35.125418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67aa1bef-659e-42f9-8644-e1030b8d9868 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:35.126229 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-67aa1bef-659e-42f9-8644-e1030b8d9868 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:35.136726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67aa1bef-659e-42f9-8644-e1030b8d9868 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:35.137339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67aa1bef-659e-42f9-8644-e1030b8d9868 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:35.137808 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67aa1bef-659e-42f9-8644-e1030b8d9868 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:35.138562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67aa1bef-659e-42f9-8644-e1030b8d9868 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:35.139045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67aa1bef-659e-42f9-8644-e1030b8d9868 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:35.139553 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67aa1bef-659e-42f9-8644-e1030b8d9868 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:35.337845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-67aa1bef-659e-42f9-8644-e1030b8d9868 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:35.349230 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-67aa1bef-659e-42f9-8644-e1030b8d9868 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1688 microversion: 2.1 time: 0.228897 Aug 09 15:43:35.349825 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3608/7224] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:35 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1688 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:43:36.378911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a931e7ba-5ac6-4563-baea-d80248d9640e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:36.379928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a931e7ba-5ac6-4563-baea-d80248d9640e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:36.391250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a931e7ba-5ac6-4563-baea-d80248d9640e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:36.392133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a931e7ba-5ac6-4563-baea-d80248d9640e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:36.392925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a931e7ba-5ac6-4563-baea-d80248d9640e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:36.394178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a931e7ba-5ac6-4563-baea-d80248d9640e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:36.394995 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a931e7ba-5ac6-4563-baea-d80248d9640e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:36.395794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a931e7ba-5ac6-4563-baea-d80248d9640e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:36.608772 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a931e7ba-5ac6-4563-baea-d80248d9640e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:36.618301 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a931e7ba-5ac6-4563-baea-d80248d9640e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1688 microversion: 2.1 time: 0.248543 Aug 09 15:43:36.619158 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3617/7225] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:36 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1688 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:37.647248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5cf59c09-8748-40fc-8992-f80e8d8895f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:37.648439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5cf59c09-8748-40fc-8992-f80e8d8895f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:37.663294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cf59c09-8748-40fc-8992-f80e8d8895f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:37.664147 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cf59c09-8748-40fc-8992-f80e8d8895f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:37.664970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cf59c09-8748-40fc-8992-f80e8d8895f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:37.666362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cf59c09-8748-40fc-8992-f80e8d8895f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:37.667269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cf59c09-8748-40fc-8992-f80e8d8895f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:37.668089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5cf59c09-8748-40fc-8992-f80e8d8895f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:37.906922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5cf59c09-8748-40fc-8992-f80e8d8895f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:37.917664 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5cf59c09-8748-40fc-8992-f80e8d8895f8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1688 microversion: 2.1 time: 0.277575 Aug 09 15:43:37.918441 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3609/7226] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:37 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1688 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:38.959620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-31ce6a56-047c-4e1b-b2e0-167fb4897d0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:38.960689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-31ce6a56-047c-4e1b-b2e0-167fb4897d0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:38.973352 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31ce6a56-047c-4e1b-b2e0-167fb4897d0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:38.974149 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31ce6a56-047c-4e1b-b2e0-167fb4897d0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:38.974871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31ce6a56-047c-4e1b-b2e0-167fb4897d0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:38.976127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31ce6a56-047c-4e1b-b2e0-167fb4897d0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:38.976947 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31ce6a56-047c-4e1b-b2e0-167fb4897d0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:38.977723 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-31ce6a56-047c-4e1b-b2e0-167fb4897d0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:39.193992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-31ce6a56-047c-4e1b-b2e0-167fb4897d0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:39.203445 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-31ce6a56-047c-4e1b-b2e0-167fb4897d0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1688 microversion: 2.1 time: 0.251750 Aug 09 15:43:39.204257 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3618/7227] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:38 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1688 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:40.228276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6f40e974-b6ee-4b05-98f3-7ca776f1a56f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:40.229192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6f40e974-b6ee-4b05-98f3-7ca776f1a56f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:40.238759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f40e974-b6ee-4b05-98f3-7ca776f1a56f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:40.239698 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f40e974-b6ee-4b05-98f3-7ca776f1a56f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:40.240426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f40e974-b6ee-4b05-98f3-7ca776f1a56f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:40.241643 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f40e974-b6ee-4b05-98f3-7ca776f1a56f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:40.242139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f40e974-b6ee-4b05-98f3-7ca776f1a56f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:40.242588 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6f40e974-b6ee-4b05-98f3-7ca776f1a56f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:40.429668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6f40e974-b6ee-4b05-98f3-7ca776f1a56f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:40.442288 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6f40e974-b6ee-4b05-98f3-7ca776f1a56f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1688 microversion: 2.1 time: 0.217939 Aug 09 15:43:40.443455 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3610/7228] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:40 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1688 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:43:41.476781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-666352e1-d2a8-4932-8dad-1fe4dc9137d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:41.477719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-666352e1-d2a8-4932-8dad-1fe4dc9137d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:41.487503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-666352e1-d2a8-4932-8dad-1fe4dc9137d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:41.488016 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-666352e1-d2a8-4932-8dad-1fe4dc9137d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:41.488500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-666352e1-d2a8-4932-8dad-1fe4dc9137d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:41.489293 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-666352e1-d2a8-4932-8dad-1fe4dc9137d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:41.489764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-666352e1-d2a8-4932-8dad-1fe4dc9137d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:41.490234 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-666352e1-d2a8-4932-8dad-1fe4dc9137d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:41.810453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-666352e1-d2a8-4932-8dad-1fe4dc9137d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:41.826771 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-666352e1-d2a8-4932-8dad-1fe4dc9137d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1688 microversion: 2.1 time: 0.355168 Aug 09 15:43:41.828269 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3619/7229] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:41 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1688 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:42.866022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d161f49f-b56d-4a95-aef6-7097b5f0606a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:42.866783 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d161f49f-b56d-4a95-aef6-7097b5f0606a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:42.875471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d161f49f-b56d-4a95-aef6-7097b5f0606a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:42.875994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d161f49f-b56d-4a95-aef6-7097b5f0606a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:42.876476 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d161f49f-b56d-4a95-aef6-7097b5f0606a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:42.877604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d161f49f-b56d-4a95-aef6-7097b5f0606a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:42.878166 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d161f49f-b56d-4a95-aef6-7097b5f0606a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:42.878615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d161f49f-b56d-4a95-aef6-7097b5f0606a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:43.122958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d161f49f-b56d-4a95-aef6-7097b5f0606a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:43.133337 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d161f49f-b56d-4a95-aef6-7097b5f0606a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.271991 Aug 09 15:43:43.133983 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3611/7230] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:42 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:44.161722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5801bc8-a08c-48d0-a363-82dec9a3cc06 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:44.162869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5801bc8-a08c-48d0-a363-82dec9a3cc06 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:44.176220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5801bc8-a08c-48d0-a363-82dec9a3cc06 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:44.177072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5801bc8-a08c-48d0-a363-82dec9a3cc06 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:44.177848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5801bc8-a08c-48d0-a363-82dec9a3cc06 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:44.179155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5801bc8-a08c-48d0-a363-82dec9a3cc06 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:44.179975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5801bc8-a08c-48d0-a363-82dec9a3cc06 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:44.180737 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5801bc8-a08c-48d0-a363-82dec9a3cc06 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:44.394084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5801bc8-a08c-48d0-a363-82dec9a3cc06 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:44.408691 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5801bc8-a08c-48d0-a363-82dec9a3cc06 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.254688 Aug 09 15:43:44.409741 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3620/7231] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:44 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:45.444966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e49180ed-6cc6-431a-9da9-db7d2db6bdf8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:45.446037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e49180ed-6cc6-431a-9da9-db7d2db6bdf8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:45.455755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e49180ed-6cc6-431a-9da9-db7d2db6bdf8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:45.456473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e49180ed-6cc6-431a-9da9-db7d2db6bdf8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:45.457041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e49180ed-6cc6-431a-9da9-db7d2db6bdf8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:45.458078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e49180ed-6cc6-431a-9da9-db7d2db6bdf8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:45.458663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e49180ed-6cc6-431a-9da9-db7d2db6bdf8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:45.459321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e49180ed-6cc6-431a-9da9-db7d2db6bdf8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:45.649610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e49180ed-6cc6-431a-9da9-db7d2db6bdf8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:45.664217 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e49180ed-6cc6-431a-9da9-db7d2db6bdf8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.223298 Aug 09 15:43:45.665294 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3612/7232] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:45 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:43:46.689423 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a288738a-6437-4515-a36a-b0d51a61e4a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:46.690377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a288738a-6437-4515-a36a-b0d51a61e4a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:46.700096 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a288738a-6437-4515-a36a-b0d51a61e4a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:46.700779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a288738a-6437-4515-a36a-b0d51a61e4a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:46.701358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a288738a-6437-4515-a36a-b0d51a61e4a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:46.702591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a288738a-6437-4515-a36a-b0d51a61e4a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:46.703066 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a288738a-6437-4515-a36a-b0d51a61e4a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:46.703713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a288738a-6437-4515-a36a-b0d51a61e4a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:46.881910 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a288738a-6437-4515-a36a-b0d51a61e4a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:46.890766 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a288738a-6437-4515-a36a-b0d51a61e4a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.205769 Aug 09 15:43:46.891417 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3621/7233] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:46 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:47.914114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7520b8f6-3b7e-44f5-83f1-8f16fa3fbecd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:47.915007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7520b8f6-3b7e-44f5-83f1-8f16fa3fbecd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:47.923310 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7520b8f6-3b7e-44f5-83f1-8f16fa3fbecd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:47.923826 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7520b8f6-3b7e-44f5-83f1-8f16fa3fbecd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:47.924282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7520b8f6-3b7e-44f5-83f1-8f16fa3fbecd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:47.925045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7520b8f6-3b7e-44f5-83f1-8f16fa3fbecd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:47.925518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7520b8f6-3b7e-44f5-83f1-8f16fa3fbecd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:47.925958 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7520b8f6-3b7e-44f5-83f1-8f16fa3fbecd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:48.112970 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7520b8f6-3b7e-44f5-83f1-8f16fa3fbecd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:48.121929 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7520b8f6-3b7e-44f5-83f1-8f16fa3fbecd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.211869 Aug 09 15:43:48.122549 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3613/7234] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:47 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:49.144823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8eb0ca0-1926-4d7a-96de-81f71e27a940 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:49.145475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8eb0ca0-1926-4d7a-96de-81f71e27a940 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:49.153895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8eb0ca0-1926-4d7a-96de-81f71e27a940 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:49.154390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8eb0ca0-1926-4d7a-96de-81f71e27a940 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:49.154827 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8eb0ca0-1926-4d7a-96de-81f71e27a940 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:49.155668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8eb0ca0-1926-4d7a-96de-81f71e27a940 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:49.156171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8eb0ca0-1926-4d7a-96de-81f71e27a940 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:49.156670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8eb0ca0-1926-4d7a-96de-81f71e27a940 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:49.337746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e8eb0ca0-1926-4d7a-96de-81f71e27a940 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:49.347193 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8eb0ca0-1926-4d7a-96de-81f71e27a940 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.206403 Aug 09 15:43:49.348065 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3622/7235] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:49 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:50.371433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dc0aa298-d2e3-49f5-ae73-a57c02035fb8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:50.372262 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dc0aa298-d2e3-49f5-ae73-a57c02035fb8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:50.380818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc0aa298-d2e3-49f5-ae73-a57c02035fb8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:50.381337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc0aa298-d2e3-49f5-ae73-a57c02035fb8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:50.381932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc0aa298-d2e3-49f5-ae73-a57c02035fb8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:50.383160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc0aa298-d2e3-49f5-ae73-a57c02035fb8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:50.384149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc0aa298-d2e3-49f5-ae73-a57c02035fb8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:50.384781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc0aa298-d2e3-49f5-ae73-a57c02035fb8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:50.563785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dc0aa298-d2e3-49f5-ae73-a57c02035fb8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:50.576223 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dc0aa298-d2e3-49f5-ae73-a57c02035fb8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.209244 Aug 09 15:43:50.577641 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3614/7236] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:50 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:51.613932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-467538b4-017e-454b-939d-db7af69c170b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:51.614785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-467538b4-017e-454b-939d-db7af69c170b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:51.623529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-467538b4-017e-454b-939d-db7af69c170b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:51.624040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-467538b4-017e-454b-939d-db7af69c170b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:51.624493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-467538b4-017e-454b-939d-db7af69c170b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:51.625330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-467538b4-017e-454b-939d-db7af69c170b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:51.625806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-467538b4-017e-454b-939d-db7af69c170b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:51.626227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-467538b4-017e-454b-939d-db7af69c170b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:51.792414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-467538b4-017e-454b-939d-db7af69c170b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:51.801773 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-467538b4-017e-454b-939d-db7af69c170b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.192235 Aug 09 15:43:51.802406 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3623/7237] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:51 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:52.834699 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-64b9802b-2831-4d38-8f57-742b019cdaa8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:52.835498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-64b9802b-2831-4d38-8f57-742b019cdaa8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:52.843336 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64b9802b-2831-4d38-8f57-742b019cdaa8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:52.843850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64b9802b-2831-4d38-8f57-742b019cdaa8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:52.846563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64b9802b-2831-4d38-8f57-742b019cdaa8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:52.846563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64b9802b-2831-4d38-8f57-742b019cdaa8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:52.846563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64b9802b-2831-4d38-8f57-742b019cdaa8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:52.846563 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-64b9802b-2831-4d38-8f57-742b019cdaa8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:53.015562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-64b9802b-2831-4d38-8f57-742b019cdaa8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:53.027423 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-64b9802b-2831-4d38-8f57-742b019cdaa8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.196469 Aug 09 15:43:53.028137 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3615/7238] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:52 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:54.051666 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af27ec60-ea51-4253-83f7-4ebf34e8913c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:54.052381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-af27ec60-ea51-4253-83f7-4ebf34e8913c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:54.061693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af27ec60-ea51-4253-83f7-4ebf34e8913c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:54.062186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af27ec60-ea51-4253-83f7-4ebf34e8913c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:54.062613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af27ec60-ea51-4253-83f7-4ebf34e8913c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:54.063390 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af27ec60-ea51-4253-83f7-4ebf34e8913c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:54.063856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af27ec60-ea51-4253-83f7-4ebf34e8913c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:54.064285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af27ec60-ea51-4253-83f7-4ebf34e8913c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:54.257606 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-af27ec60-ea51-4253-83f7-4ebf34e8913c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:54.266580 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af27ec60-ea51-4253-83f7-4ebf34e8913c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.219524 Aug 09 15:43:54.267183 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3624/7239] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:54 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:55.290271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-19f58dde-0a3e-4302-8f8e-e770afa169d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:55.291254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-19f58dde-0a3e-4302-8f8e-e770afa169d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:55.299552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19f58dde-0a3e-4302-8f8e-e770afa169d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:55.300075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19f58dde-0a3e-4302-8f8e-e770afa169d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:55.300525 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19f58dde-0a3e-4302-8f8e-e770afa169d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:55.301272 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19f58dde-0a3e-4302-8f8e-e770afa169d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:55.301746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19f58dde-0a3e-4302-8f8e-e770afa169d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:55.302197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-19f58dde-0a3e-4302-8f8e-e770afa169d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:55.481406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-19f58dde-0a3e-4302-8f8e-e770afa169d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:55.490121 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-19f58dde-0a3e-4302-8f8e-e770afa169d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.204458 Aug 09 15:43:55.490742 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3616/7240] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:55 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:56.512908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ab0746d5-81dc-4722-8496-ea7bf6a667d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:56.513533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ab0746d5-81dc-4722-8496-ea7bf6a667d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:56.521087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab0746d5-81dc-4722-8496-ea7bf6a667d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:56.521593 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab0746d5-81dc-4722-8496-ea7bf6a667d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:56.522027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab0746d5-81dc-4722-8496-ea7bf6a667d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:56.522745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab0746d5-81dc-4722-8496-ea7bf6a667d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:56.523225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab0746d5-81dc-4722-8496-ea7bf6a667d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:56.523653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab0746d5-81dc-4722-8496-ea7bf6a667d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:56.710393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ab0746d5-81dc-4722-8496-ea7bf6a667d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:56.723695 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ab0746d5-81dc-4722-8496-ea7bf6a667d8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.214570 Aug 09 15:43:56.724627 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3625/7241] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:56 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:57.758319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-af059b38-634e-421c-bcaf-18d2852f06ee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:57.759351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-af059b38-634e-421c-bcaf-18d2852f06ee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:57.767881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af059b38-634e-421c-bcaf-18d2852f06ee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:57.768391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af059b38-634e-421c-bcaf-18d2852f06ee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:57.768811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af059b38-634e-421c-bcaf-18d2852f06ee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:57.769557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af059b38-634e-421c-bcaf-18d2852f06ee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:57.770052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af059b38-634e-421c-bcaf-18d2852f06ee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:57.770488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-af059b38-634e-421c-bcaf-18d2852f06ee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:57.926069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-af059b38-634e-421c-bcaf-18d2852f06ee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:57.939637 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-af059b38-634e-421c-bcaf-18d2852f06ee tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.185245 Aug 09 15:43:57.940630 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3617/7242] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:57 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:43:58.968998 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5b3bdc06-19b5-4bc4-ad15-5bb54b129cc2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:43:58.969668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5b3bdc06-19b5-4bc4-ad15-5bb54b129cc2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:43:58.977381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b3bdc06-19b5-4bc4-ad15-5bb54b129cc2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:58.977912 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b3bdc06-19b5-4bc4-ad15-5bb54b129cc2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:58.978429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b3bdc06-19b5-4bc4-ad15-5bb54b129cc2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:58.979237 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b3bdc06-19b5-4bc4-ad15-5bb54b129cc2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:43:58.979669 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b3bdc06-19b5-4bc4-ad15-5bb54b129cc2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:43:58.986232 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5b3bdc06-19b5-4bc4-ad15-5bb54b129cc2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:43:59.146531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5b3bdc06-19b5-4bc4-ad15-5bb54b129cc2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:43:59.157880 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5b3bdc06-19b5-4bc4-ad15-5bb54b129cc2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1693 microversion: 2.1 time: 0.193011 Aug 09 15:43:59.158560 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3626/7243] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:43:58 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:44:00.100225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-6a1226f0-284b-4bec-af9c-e3fa9d72b25b req-524af633-f4f6-46bb-9208-5a98e9712292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7522f12-465c-468d-bcfc-b5889e0a268c", "name": "network-vif-unplugged", "status": "completed", "tag": "2961a06f-92c6-4538-8a12-dfec357f04b9"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:44:00.112910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=23 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:44:00.120432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6a1226f0-284b-4bec-af9c-e3fa9d72b25b req-524af633-f4f6-46bb-9208-5a98e9712292 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:00.121276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6a1226f0-284b-4bec-af9c-e3fa9d72b25b req-524af633-f4f6-46bb-9208-5a98e9712292 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:00.122003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-6a1226f0-284b-4bec-af9c-e3fa9d72b25b req-524af633-f4f6-46bb-9208-5a98e9712292 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:00.136254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=65 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:44:00.152912 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-6a1226f0-284b-4bec-af9c-e3fa9d72b25b req-524af633-f4f6-46bb-9208-5a98e9712292 service nova] Creating event network-vif-unplugged:2961a06f-92c6-4538-8a12-dfec357f04b9 for instance a7522f12-465c-468d-bcfc-b5889e0a268c on n-h2-844626-8 Aug 09 15:44:00.164658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [req-6a1226f0-284b-4bec-af9c-e3fa9d72b25b req-524af633-f4f6-46bb-9208-5a98e9712292 service nova] Instance a7522f12-465c-468d-bcfc-b5889e0a268c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119406) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:44:00.182358 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-33760421-5e4e-4e7a-9045-7363e474660d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:00.183563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-33760421-5e4e-4e7a-9045-7363e474660d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:00.187997 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-6a1226f0-284b-4bec-af9c-e3fa9d72b25b req-524af633-f4f6-46bb-9208-5a98e9712292 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094536 Aug 09 15:44:00.190507 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3618/7244] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:44:00.195662 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33760421-5e4e-4e7a-9045-7363e474660d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:00.196982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33760421-5e4e-4e7a-9045-7363e474660d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:00.197529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33760421-5e4e-4e7a-9045-7363e474660d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:00.198410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33760421-5e4e-4e7a-9045-7363e474660d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:00.200171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33760421-5e4e-4e7a-9045-7363e474660d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:00.201026 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-33760421-5e4e-4e7a-9045-7363e474660d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:00.465509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-33760421-5e4e-4e7a-9045-7363e474660d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:00.474631 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-33760421-5e4e-4e7a-9045-7363e474660d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1692 microversion: 2.1 time: 0.297847 Aug 09 15:44:00.475506 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3627/7245] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:00 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1692 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:44:01.512778 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-712d55e3-04e7-4175-a060-68e20d4a9877 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:01.513703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-712d55e3-04e7-4175-a060-68e20d4a9877 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:01.521589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-712d55e3-04e7-4175-a060-68e20d4a9877 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:01.521987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-712d55e3-04e7-4175-a060-68e20d4a9877 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:01.522582 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-712d55e3-04e7-4175-a060-68e20d4a9877 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:01.523496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-712d55e3-04e7-4175-a060-68e20d4a9877 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:01.524294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-712d55e3-04e7-4175-a060-68e20d4a9877 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:01.524986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-712d55e3-04e7-4175-a060-68e20d4a9877 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:01.706547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-712d55e3-04e7-4175-a060-68e20d4a9877 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:01.715362 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-712d55e3-04e7-4175-a060-68e20d4a9877 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1692 microversion: 2.1 time: 0.209114 Aug 09 15:44:01.716191 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3619/7246] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:01 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1692 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:44:02.210005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a697bc2b-b79d-460d-8ffa-fa7bf5231360 req-483be5f9-5252-45d6-9f65-6b98208a6cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7522f12-465c-468d-bcfc-b5889e0a268c", "tag": "2961a06f-92c6-4538-8a12-dfec357f04b9"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:44:02.222425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a697bc2b-b79d-460d-8ffa-fa7bf5231360 req-483be5f9-5252-45d6-9f65-6b98208a6cc0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:02.222864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a697bc2b-b79d-460d-8ffa-fa7bf5231360 req-483be5f9-5252-45d6-9f65-6b98208a6cc0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:02.223326 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a697bc2b-b79d-460d-8ffa-fa7bf5231360 req-483be5f9-5252-45d6-9f65-6b98208a6cc0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:02.237547 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a697bc2b-b79d-460d-8ffa-fa7bf5231360 req-483be5f9-5252-45d6-9f65-6b98208a6cc0 service nova] Creating event network-changed:2961a06f-92c6-4538-8a12-dfec357f04b9 for instance a7522f12-465c-468d-bcfc-b5889e0a268c on n-h2-844626-8 Aug 09 15:44:02.245538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-a697bc2b-b79d-460d-8ffa-fa7bf5231360 req-483be5f9-5252-45d6-9f65-6b98208a6cc0 service nova] Instance a7522f12-465c-468d-bcfc-b5889e0a268c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:44:02.262234 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a697bc2b-b79d-460d-8ffa-fa7bf5231360 req-483be5f9-5252-45d6-9f65-6b98208a6cc0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056468 Aug 09 15:44:02.263153 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3628/7247] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:44:02.752333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-60971bd7-92ed-4f7b-a58d-a412c4573fd1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:02.753169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-60971bd7-92ed-4f7b-a58d-a412c4573fd1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:02.760727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60971bd7-92ed-4f7b-a58d-a412c4573fd1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:02.761244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60971bd7-92ed-4f7b-a58d-a412c4573fd1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:02.761735 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60971bd7-92ed-4f7b-a58d-a412c4573fd1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:02.762485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60971bd7-92ed-4f7b-a58d-a412c4573fd1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:02.763225 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60971bd7-92ed-4f7b-a58d-a412c4573fd1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:02.763647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-60971bd7-92ed-4f7b-a58d-a412c4573fd1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:03.482085 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-60971bd7-92ed-4f7b-a58d-a412c4573fd1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:03.493877 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-60971bd7-92ed-4f7b-a58d-a412c4573fd1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1690 microversion: 2.1 time: 0.745810 Aug 09 15:44:03.494716 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3620/7248] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:02 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1690 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:44:04.518574 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36ddd98a-2a78-4211-a7f9-b2ed246534fe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:04.519368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36ddd98a-2a78-4211-a7f9-b2ed246534fe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:04.526355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36ddd98a-2a78-4211-a7f9-b2ed246534fe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:04.526872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36ddd98a-2a78-4211-a7f9-b2ed246534fe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:04.527325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36ddd98a-2a78-4211-a7f9-b2ed246534fe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:04.528078 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36ddd98a-2a78-4211-a7f9-b2ed246534fe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:04.528537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36ddd98a-2a78-4211-a7f9-b2ed246534fe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:04.528971 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36ddd98a-2a78-4211-a7f9-b2ed246534fe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:04.689381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-36ddd98a-2a78-4211-a7f9-b2ed246534fe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:04.698916 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36ddd98a-2a78-4211-a7f9-b2ed246534fe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1687 microversion: 2.1 time: 0.185570 Aug 09 15:44:04.699704 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3629/7249] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:04 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:44:04.721671 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a22d1777-cc2c-4c6b-a9dc-3e1531641344 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:44:04.722408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a22d1777-cc2c-4c6b-a9dc-3e1531641344 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:04.729927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a22d1777-cc2c-4c6b-a9dc-3e1531641344 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:04.730430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a22d1777-cc2c-4c6b-a9dc-3e1531641344 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:04.730875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a22d1777-cc2c-4c6b-a9dc-3e1531641344 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:04.731646 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a22d1777-cc2c-4c6b-a9dc-3e1531641344 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:04.732112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a22d1777-cc2c-4c6b-a9dc-3e1531641344 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:04.732547 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a22d1777-cc2c-4c6b-a9dc-3e1531641344 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:04.802236 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a22d1777-cc2c-4c6b-a9dc-3e1531641344 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c/action" status: 204 len: 0 microversion: 2.1 time: 0.084409 Aug 09 15:44:04.802852 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3621/7250] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:44:04 2022] POST /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:44:04.814568 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-046b792f-a616-48a0-83a4-d4fae5702cfe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:04.815727 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-046b792f-a616-48a0-83a4-d4fae5702cfe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:04.826388 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-046b792f-a616-48a0-83a4-d4fae5702cfe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:04.827366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-046b792f-a616-48a0-83a4-d4fae5702cfe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:04.828099 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-046b792f-a616-48a0-83a4-d4fae5702cfe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:04.829366 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-046b792f-a616-48a0-83a4-d4fae5702cfe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:04.830174 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-046b792f-a616-48a0-83a4-d4fae5702cfe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:04.830739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-046b792f-a616-48a0-83a4-d4fae5702cfe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:05.084706 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-046b792f-a616-48a0-83a4-d4fae5702cfe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:05.088135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:44:05.099324 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-046b792f-a616-48a0-83a4-d4fae5702cfe tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1687 microversion: 2.1 time: 0.291256 Aug 09 15:44:05.100534 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3630/7251] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:04 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1687 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:44:05.123811 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-807ea2e9-d1fc-49c4-9669-0e8761b7ae78 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:05.124555 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-807ea2e9-d1fc-49c4-9669-0e8761b7ae78 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:05.132312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-807ea2e9-d1fc-49c4-9669-0e8761b7ae78 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:05.132832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-807ea2e9-d1fc-49c4-9669-0e8761b7ae78 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:05.133306 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-807ea2e9-d1fc-49c4-9669-0e8761b7ae78 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:05.134045 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-807ea2e9-d1fc-49c4-9669-0e8761b7ae78 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:05.134570 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-807ea2e9-d1fc-49c4-9669-0e8761b7ae78 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:05.135020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-807ea2e9-d1fc-49c4-9669-0e8761b7ae78 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:05.388287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-807ea2e9-d1fc-49c4-9669-0e8761b7ae78 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:05.405012 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-807ea2e9-d1fc-49c4-9669-0e8761b7ae78 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1687 microversion: 2.1 time: 0.285360 Aug 09 15:44:05.406792 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3622/7252] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:05 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1687 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:44:05.525387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-0227327b-70c8-4038-995a-5f959d190660 req-1d317efe-8752-4bcc-b4fa-6266ed976938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7522f12-465c-468d-bcfc-b5889e0a268c", "name": "network-vif-plugged", "status": "completed", "tag": "2961a06f-92c6-4538-8a12-dfec357f04b9"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:44:05.536890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=35 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:44:05.552556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0227327b-70c8-4038-995a-5f959d190660 req-1d317efe-8752-4bcc-b4fa-6266ed976938 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:05.553381 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0227327b-70c8-4038-995a-5f959d190660 req-1d317efe-8752-4bcc-b4fa-6266ed976938 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:05.555637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-0227327b-70c8-4038-995a-5f959d190660 req-1d317efe-8752-4bcc-b4fa-6266ed976938 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:05.580095 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-0227327b-70c8-4038-995a-5f959d190660 req-1d317efe-8752-4bcc-b4fa-6266ed976938 service nova] Creating event network-vif-plugged:2961a06f-92c6-4538-8a12-dfec357f04b9 for instance a7522f12-465c-468d-bcfc-b5889e0a268c on n-h2-844626-8 Aug 09 15:44:05.591334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [req-0227327b-70c8-4038-995a-5f959d190660 req-1d317efe-8752-4bcc-b4fa-6266ed976938 service nova] Instance a7522f12-465c-468d-bcfc-b5889e0a268c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-844626-8', 'n-h2-844626-8'} {{(pid=119407) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 09 15:44:05.613525 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-0227327b-70c8-4038-995a-5f959d190660 req-1d317efe-8752-4bcc-b4fa-6266ed976938 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096116 Aug 09 15:44:05.614670 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3631/7253] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:44:06.442196 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6540f0ed-b093-42a3-8a12-c556fb5418b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:06.443126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6540f0ed-b093-42a3-8a12-c556fb5418b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:06.452408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6540f0ed-b093-42a3-8a12-c556fb5418b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:06.453116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6540f0ed-b093-42a3-8a12-c556fb5418b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:06.453690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6540f0ed-b093-42a3-8a12-c556fb5418b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:06.454713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6540f0ed-b093-42a3-8a12-c556fb5418b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:06.455802 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6540f0ed-b093-42a3-8a12-c556fb5418b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:06.456423 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6540f0ed-b093-42a3-8a12-c556fb5418b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:06.636942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6540f0ed-b093-42a3-8a12-c556fb5418b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:06.646279 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6540f0ed-b093-42a3-8a12-c556fb5418b8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1679 microversion: 2.1 time: 0.208632 Aug 09 15:44:06.646902 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3623/7254] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:06 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:44:30.886512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:44:30.887301 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=5 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:44:30.961880 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e9122e4f-c9e7-410a-9ffa-e17e7131a6cd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:44:30.964504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e9122e4f-c9e7-410a-9ffa-e17e7131a6cd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:30.972783 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9122e4f-c9e7-410a-9ffa-e17e7131a6cd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:30.973325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9122e4f-c9e7-410a-9ffa-e17e7131a6cd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:30.973801 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9122e4f-c9e7-410a-9ffa-e17e7131a6cd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:30.974567 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9122e4f-c9e7-410a-9ffa-e17e7131a6cd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:30.975225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9122e4f-c9e7-410a-9ffa-e17e7131a6cd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:30.975884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e9122e4f-c9e7-410a-9ffa-e17e7131a6cd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:31.044032 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e9122e4f-c9e7-410a-9ffa-e17e7131a6cd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c/action" status: 200 len: 24578 microversion: 2.1 time: 0.159262 Aug 09 15:44:31.044681 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3632/7255] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:44:30 2022] POST /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c/action => generated 24578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 15:44:38.457384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-37e7a96d-81ea-4edc-8a18-15fe203dae0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:38.458777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37e7a96d-81ea-4edc-8a18-15fe203dae0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:38.460680 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-5094219d-9690-4133-b645-a1251e4dddb7 req-eb8b0c46-2f2c-42a6-afb5-bd5f7780099b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7522f12-465c-468d-bcfc-b5889e0a268c", "tag": "2961a06f-92c6-4538-8a12-dfec357f04b9"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:44:38.463939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=11 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:44:38.464775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:44:38.477712 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37e7a96d-81ea-4edc-8a18-15fe203dae0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:38.478546 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37e7a96d-81ea-4edc-8a18-15fe203dae0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:38.478994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5094219d-9690-4133-b645-a1251e4dddb7 req-eb8b0c46-2f2c-42a6-afb5-bd5f7780099b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:38.479256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37e7a96d-81ea-4edc-8a18-15fe203dae0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:38.480341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5094219d-9690-4133-b645-a1251e4dddb7 req-eb8b0c46-2f2c-42a6-afb5-bd5f7780099b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:38.481059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37e7a96d-81ea-4edc-8a18-15fe203dae0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:38.481230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-5094219d-9690-4133-b645-a1251e4dddb7 req-eb8b0c46-2f2c-42a6-afb5-bd5f7780099b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:38.481631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37e7a96d-81ea-4edc-8a18-15fe203dae0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:38.482311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-37e7a96d-81ea-4edc-8a18-15fe203dae0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:38.514264 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-5094219d-9690-4133-b645-a1251e4dddb7 req-eb8b0c46-2f2c-42a6-afb5-bd5f7780099b service nova] Creating event network-changed:2961a06f-92c6-4538-8a12-dfec357f04b9 for instance a7522f12-465c-468d-bcfc-b5889e0a268c on n-h2-844626-8 Aug 09 15:44:38.515742 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-37e7a96d-81ea-4edc-8a18-15fe203dae0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:44:38.523716 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-5094219d-9690-4133-b645-a1251e4dddb7 req-eb8b0c46-2f2c-42a6-afb5-bd5f7780099b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067461 Aug 09 15:44:38.525310 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3633/7256] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:44:38.681684 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-37e7a96d-81ea-4edc-8a18-15fe203dae0f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "DELETE /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 204 len: 0 microversion: 2.1 time: 0.226526 Aug 09 15:44:38.683560 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3624/7257] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:44:38 2022] DELETE /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:44:38.700710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f1e9b9d9-f8de-42f5-ad18-14f2972114c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:38.702752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f1e9b9d9-f8de-42f5-ad18-14f2972114c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:38.715258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1e9b9d9-f8de-42f5-ad18-14f2972114c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:38.716696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1e9b9d9-f8de-42f5-ad18-14f2972114c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:38.717562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1e9b9d9-f8de-42f5-ad18-14f2972114c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:38.719274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1e9b9d9-f8de-42f5-ad18-14f2972114c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:38.720170 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1e9b9d9-f8de-42f5-ad18-14f2972114c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:38.721258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f1e9b9d9-f8de-42f5-ad18-14f2972114c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:39.014745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f1e9b9d9-f8de-42f5-ad18-14f2972114c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:39.028150 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f1e9b9d9-f8de-42f5-ad18-14f2972114c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1685 microversion: 2.1 time: 0.337460 Aug 09 15:44:39.029217 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3634/7258] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:38 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1685 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:44:40.056575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39997830-67dc-43bc-b92c-7c110949a3d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:40.057819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39997830-67dc-43bc-b92c-7c110949a3d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:40.071127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39997830-67dc-43bc-b92c-7c110949a3d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:40.072020 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39997830-67dc-43bc-b92c-7c110949a3d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:40.072769 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39997830-67dc-43bc-b92c-7c110949a3d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:40.074140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39997830-67dc-43bc-b92c-7c110949a3d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:40.074911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39997830-67dc-43bc-b92c-7c110949a3d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:40.076025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39997830-67dc-43bc-b92c-7c110949a3d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:40.332864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-39997830-67dc-43bc-b92c-7c110949a3d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:40.343820 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39997830-67dc-43bc-b92c-7c110949a3d2 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1685 microversion: 2.1 time: 0.295459 Aug 09 15:44:40.351619 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3625/7259] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:40 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1685 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:44:40.871317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-11bf7739-bbb1-4eb6-89cb-8a33decf8c71 req-a05c5d9a-c5ff-4a23-a1b6-6a1e30a9248b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7522f12-465c-468d-bcfc-b5889e0a268c", "name": "network-vif-deleted", "tag": "2961a06f-92c6-4538-8a12-dfec357f04b9"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:44:40.886743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-11bf7739-bbb1-4eb6-89cb-8a33decf8c71 req-a05c5d9a-c5ff-4a23-a1b6-6a1e30a9248b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:40.888457 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-11bf7739-bbb1-4eb6-89cb-8a33decf8c71 req-a05c5d9a-c5ff-4a23-a1b6-6a1e30a9248b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:40.889173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-11bf7739-bbb1-4eb6-89cb-8a33decf8c71 req-a05c5d9a-c5ff-4a23-a1b6-6a1e30a9248b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:40.907072 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-11bf7739-bbb1-4eb6-89cb-8a33decf8c71 req-a05c5d9a-c5ff-4a23-a1b6-6a1e30a9248b service nova] Creating event network-vif-deleted:2961a06f-92c6-4538-8a12-dfec357f04b9 for instance a7522f12-465c-468d-bcfc-b5889e0a268c on n-h2-844626-8 Aug 09 15:44:40.914649 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-11bf7739-bbb1-4eb6-89cb-8a33decf8c71 req-a05c5d9a-c5ff-4a23-a1b6-6a1e30a9248b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047391 Aug 09 15:44:40.915520 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3635/7260] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:44:41.376934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:41.377799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:41.389623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:41.390311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:41.391015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:41.392321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:41.393079 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:41.393795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:41.446141 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:41.448398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:41.448398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:41.449090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lazy-loading 'fault' on Instance uuid a7522f12-465c-468d-bcfc-b5889e0a268c {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:44:41.519498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:41.527508 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ffc32604-5782-4880-86e0-986e053bc7aa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 200 len: 1353 microversion: 2.1 time: 0.156702 Aug 09 15:44:41.528264 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3626/7261] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:41 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 1353 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:44:42.555847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89cbbe85-50e8-4e25-b45a-aa4e933e9dfb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:42.556901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-89cbbe85-50e8-4e25-b45a-aa4e933e9dfb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: a7522f12-465c-468d-bcfc-b5889e0a268c] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:42.566596 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89cbbe85-50e8-4e25-b45a-aa4e933e9dfb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:42.567229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89cbbe85-50e8-4e25-b45a-aa4e933e9dfb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:42.567689 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89cbbe85-50e8-4e25-b45a-aa4e933e9dfb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:42.568716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89cbbe85-50e8-4e25-b45a-aa4e933e9dfb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:42.569201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89cbbe85-50e8-4e25-b45a-aa4e933e9dfb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:42.569640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-89cbbe85-50e8-4e25-b45a-aa4e933e9dfb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:42.590786 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-89cbbe85-50e8-4e25-b45a-aa4e933e9dfb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] HTTP exception thrown: Instance a7522f12-465c-468d-bcfc-b5889e0a268c could not be found. Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89cbbe85-50e8-4e25-b45a-aa4e933e9dfb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Request method failure captured: Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c HTTP/1.1 Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8n-wWj9WpQ7S_u-7y-n71vOR8Au_4UmgBa2wNz6rWCK__f-sxVABSN2zjqecqGC4IKaZVq-WcDEBtWz3KvoZvJhxDJbh8Jb_veqORDioviTgRfM8r8in8FLIT0_af7oefgXyAkdhAOfs_MBfLyn8o866ykWUknSf8OqrmStdHFFUClw Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 595d222e7a56448d9eaaf060d77c552b Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_595d222e7a56448d9eaaf060d77c552b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 595d222e7a56448d9eaaf060d77c552b Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestNetworkAdvancedServerOps-276209286-project Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 3ca5b4f643564db09dfb30dd2a691789 Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestNetworkAdvancedServerOps-276209286-project Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance a7522f12-465c-468d-bcfc-b5889e0a268c could not be found. Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': 'a7522f12-465c-468d-bcfc-b5889e0a268c'} Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7522f12-465c-468d-bcfc-b5889e0a268c could not be found. Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7522f12-465c-468d-bcfc-b5889e0a268c could not be found. Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:44:42.592657 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:44:42.600874 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:44:42.600874 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:44:42.600874 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:44:42.600874 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:44:42.600874 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:44:42.600874 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:44:42.600874 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7522f12-465c-468d-bcfc-b5889e0a268c could not be found. Aug 09 15:44:42.600874 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:44:42.600874 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-89cbbe85-50e8-4e25-b45a-aa4e933e9dfb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Returning 404 to user: Instance a7522f12-465c-468d-bcfc-b5889e0a268c could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:44:42.600874 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-89cbbe85-50e8-4e25-b45a-aa4e933e9dfb tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c" status: 404 len: 111 microversion: 2.1 time: 0.043418 Aug 09 15:44:42.600874 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3636/7262] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:42 2022] GET /compute/v2.1/servers/a7522f12-465c-468d-bcfc-b5889e0a268c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:44:46.954064 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c6af37a-19df-422c-bbf9-8a15a20981c7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '.version_select at 0x7f41de2155e0>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:46.986905 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c6af37a-19df-422c-bbf9-8a15a20981c7 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-5920329" status: 202 len: 0 microversion: 2.1 time: 0.041916 Aug 09 15:44:46.987822 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3627/7263] 10.222.0.50 () {58 vars in 1275 bytes} [Tue Aug 9 15:44:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-5920329 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:44:47.024233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4ea29fc8-b5ae-470d-832d-aa0a335e6fa3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'create', calling method: .version_select at 0x7f41dc8d1c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-388637382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLNsAyvxuga5+XDnlpNAlkes76b65h0iuXgvZ8WXhivdm8bslELKS+cCZwWkB8lARXmSHOI+iMuy8r9XumilexprSv9+RVQ/G7azJE5Re9hSp94Rf6rb37pCxHKY+ToCg=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:44:47.047916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-4ea29fc8-b5ae-470d-832d-aa0a335e6fa3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for project 595d222e7a56448d9eaaf060d77c552b. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:44:47.053917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-4ea29fc8-b5ae-470d-832d-aa0a335e6fa3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for user 3ca5b4f643564db09dfb30dd2a691789 and project 595d222e7a56448d9eaaf060d77c552b. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:44:47.084864 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4ea29fc8-b5ae-470d-832d-aa0a335e6fa3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.067000 Aug 09 15:44:47.085734 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3637/7264] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:44:47 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:44:55.228468 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:44:55.238068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1584168208", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "85e89d2a-f303-4e18-b420-b6e9c39245a0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-388637382", "security_groups": [{"name": "tempest-secgroup-smoke-414856240"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:44:55.428426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] validate_networks() for [('85e89d2a-f303-4e18-b420-b6e9c39245a0', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:44:56.174566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:44:56.175175 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:44:56.175812 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:44:56.176414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:44:56.176989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:44:56.188665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:56.189398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:56.189986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:56.191356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:56.192160 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:56.192827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:56.216954 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for project 595d222e7a56448d9eaaf060d77c552b. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:44:56.229625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for user 3ca5b4f643564db09dfb30dd2a691789 and project 595d222e7a56448d9eaaf060d77c552b. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:44:56.251591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:44:56.254667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:44:56.334246 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a886b569-2fd7-4f6a-b9e7-08262c411af3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.109215 Aug 09 15:44:56.348244 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3628/7265] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:44:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 15:44:56.351787 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=16 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:44:56.375922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f75f115-f61a-4f90-ac63-a96d2ebd77a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:56.379853 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f75f115-f61a-4f90-ac63-a96d2ebd77a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:56.485834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4f75f115-f61a-4f90-ac63-a96d2ebd77a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:56.499598 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4f75f115-f61a-4f90-ac63-a96d2ebd77a5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1266 microversion: 2.1 time: 0.151243 Aug 09 15:44:56.500817 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3638/7266] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:56 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:44:57.547312 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-959ef264-0811-4c1d-aaa0-f2a772e800fc tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:57.548590 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-959ef264-0811-4c1d-aaa0-f2a772e800fc tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:57.570806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-959ef264-0811-4c1d-aaa0-f2a772e800fc tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:57.572001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-959ef264-0811-4c1d-aaa0-f2a772e800fc tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:57.573288 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-959ef264-0811-4c1d-aaa0-f2a772e800fc tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:57.574795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-959ef264-0811-4c1d-aaa0-f2a772e800fc tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:57.576475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-959ef264-0811-4c1d-aaa0-f2a772e800fc tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:57.577307 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-959ef264-0811-4c1d-aaa0-f2a772e800fc tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:57.674904 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-959ef264-0811-4c1d-aaa0-f2a772e800fc tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:57.689544 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-959ef264-0811-4c1d-aaa0-f2a772e800fc tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1318 microversion: 2.1 time: 0.154852 Aug 09 15:44:57.690556 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3629/7267] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:57 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:44:58.719934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-de096bbd-5ebb-46b9-98ed-a6eae7c51a3b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:44:58.721940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-de096bbd-5ebb-46b9-98ed-a6eae7c51a3b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:44:58.734978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de096bbd-5ebb-46b9-98ed-a6eae7c51a3b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:58.736324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de096bbd-5ebb-46b9-98ed-a6eae7c51a3b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:58.737207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de096bbd-5ebb-46b9-98ed-a6eae7c51a3b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:58.738588 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de096bbd-5ebb-46b9-98ed-a6eae7c51a3b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:44:58.739515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de096bbd-5ebb-46b9-98ed-a6eae7c51a3b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:44:58.740496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-de096bbd-5ebb-46b9-98ed-a6eae7c51a3b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:44:59.436299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-de096bbd-5ebb-46b9-98ed-a6eae7c51a3b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:44:59.450214 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-de096bbd-5ebb-46b9-98ed-a6eae7c51a3b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1324 microversion: 2.1 time: 0.736551 Aug 09 15:44:59.465575 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3639/7268] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:44:58 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1324 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:45:00.494593 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f119b598-9619-47d7-bbd4-93b521027c58 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:00.495609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f119b598-9619-47d7-bbd4-93b521027c58 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:00.504997 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f119b598-9619-47d7-bbd4-93b521027c58 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:00.505578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f119b598-9619-47d7-bbd4-93b521027c58 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:00.506037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f119b598-9619-47d7-bbd4-93b521027c58 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:00.506767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f119b598-9619-47d7-bbd4-93b521027c58 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:00.507282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f119b598-9619-47d7-bbd4-93b521027c58 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:00.507814 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f119b598-9619-47d7-bbd4-93b521027c58 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:00.777078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f119b598-9619-47d7-bbd4-93b521027c58 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:00.794899 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f119b598-9619-47d7-bbd4-93b521027c58 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1391 microversion: 2.1 time: 0.310395 Aug 09 15:45:00.796048 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3630/7269] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:00 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1391 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:00.831829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-50ec8f83-62de-42c1-a23d-1f3199e7e85c req-fc84b6e1-e6f1-46ba-86dd-ce95cbff03c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "560d0628-098f-4b02-baa1-4b813976b51d", "tag": "629120cf-11b0-4ba0-a66d-62d43b1d287c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:45:00.858911 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-50ec8f83-62de-42c1-a23d-1f3199e7e85c req-fc84b6e1-e6f1-46ba-86dd-ce95cbff03c2 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:00.859793 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-50ec8f83-62de-42c1-a23d-1f3199e7e85c req-fc84b6e1-e6f1-46ba-86dd-ce95cbff03c2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:00.860555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-50ec8f83-62de-42c1-a23d-1f3199e7e85c req-fc84b6e1-e6f1-46ba-86dd-ce95cbff03c2 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:00.876633 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-50ec8f83-62de-42c1-a23d-1f3199e7e85c req-fc84b6e1-e6f1-46ba-86dd-ce95cbff03c2 service nova] Creating event network-changed:629120cf-11b0-4ba0-a66d-62d43b1d287c for instance 560d0628-098f-4b02-baa1-4b813976b51d on n-h1-844626-8 Aug 09 15:45:00.883411 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-50ec8f83-62de-42c1-a23d-1f3199e7e85c req-fc84b6e1-e6f1-46ba-86dd-ce95cbff03c2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061010 Aug 09 15:45:00.884540 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3640/7270] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:45:01.833132 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1f69c273-4b07-45e9-aa42-c260c09fa47b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:01.833879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1f69c273-4b07-45e9-aa42-c260c09fa47b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:01.841599 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f69c273-4b07-45e9-aa42-c260c09fa47b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:01.842116 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f69c273-4b07-45e9-aa42-c260c09fa47b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:01.842583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f69c273-4b07-45e9-aa42-c260c09fa47b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:01.843403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f69c273-4b07-45e9-aa42-c260c09fa47b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:01.843853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f69c273-4b07-45e9-aa42-c260c09fa47b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:01.844542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1f69c273-4b07-45e9-aa42-c260c09fa47b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:02.066575 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1f69c273-4b07-45e9-aa42-c260c09fa47b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:02.075588 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1f69c273-4b07-45e9-aa42-c260c09fa47b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1391 microversion: 2.1 time: 0.246069 Aug 09 15:45:02.076290 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3631/7271] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:01 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1391 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:03.101171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-64f08441-8025-4b37-8952-7cd45f9ff874 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:03.102339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-64f08441-8025-4b37-8952-7cd45f9ff874 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:03.104902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:45:03.112820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64f08441-8025-4b37-8952-7cd45f9ff874 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:03.113392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64f08441-8025-4b37-8952-7cd45f9ff874 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:03.114068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64f08441-8025-4b37-8952-7cd45f9ff874 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:03.115043 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64f08441-8025-4b37-8952-7cd45f9ff874 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:03.115696 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64f08441-8025-4b37-8952-7cd45f9ff874 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:03.116255 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-64f08441-8025-4b37-8952-7cd45f9ff874 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:03.359850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-64f08441-8025-4b37-8952-7cd45f9ff874 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:03.374077 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-64f08441-8025-4b37-8952-7cd45f9ff874 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1391 microversion: 2.1 time: 0.279096 Aug 09 15:45:03.375122 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3641/7272] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:03 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1391 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:45:04.409654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0d7fd502-3341-4262-a18b-1531605c16d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:04.410822 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0d7fd502-3341-4262-a18b-1531605c16d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:04.423642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d7fd502-3341-4262-a18b-1531605c16d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:04.424491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d7fd502-3341-4262-a18b-1531605c16d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:04.425317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d7fd502-3341-4262-a18b-1531605c16d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:04.426696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d7fd502-3341-4262-a18b-1531605c16d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:04.427516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d7fd502-3341-4262-a18b-1531605c16d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:04.428359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0d7fd502-3341-4262-a18b-1531605c16d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:04.644838 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0d7fd502-3341-4262-a18b-1531605c16d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:04.659699 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0d7fd502-3341-4262-a18b-1531605c16d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1391 microversion: 2.1 time: 0.257660 Aug 09 15:45:04.660812 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3632/7273] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:04 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:05.694657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22d3470a-f1df-454c-977a-1effd4366aa0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:05.695363 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22d3470a-f1df-454c-977a-1effd4366aa0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:05.703447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22d3470a-f1df-454c-977a-1effd4366aa0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:05.703932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22d3470a-f1df-454c-977a-1effd4366aa0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:05.704367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22d3470a-f1df-454c-977a-1effd4366aa0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:05.705081 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22d3470a-f1df-454c-977a-1effd4366aa0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:05.705539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22d3470a-f1df-454c-977a-1effd4366aa0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:05.705959 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22d3470a-f1df-454c-977a-1effd4366aa0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:05.900006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22d3470a-f1df-454c-977a-1effd4366aa0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:05.910143 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22d3470a-f1df-454c-977a-1effd4366aa0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1391 microversion: 2.1 time: 0.219534 Aug 09 15:45:05.910870 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3642/7274] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:05 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1391 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:06.039882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-80783bc3-b290-4ee3-875e-b16d0a050860 req-97d184b1-703d-4512-bdca-aa07e4b05efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560d0628-098f-4b02-baa1-4b813976b51d", "name": "network-vif-plugged", "status": "completed", "tag": "629120cf-11b0-4ba0-a66d-62d43b1d287c"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:45:06.051741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-80783bc3-b290-4ee3-875e-b16d0a050860 req-97d184b1-703d-4512-bdca-aa07e4b05efa service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:06.052192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-80783bc3-b290-4ee3-875e-b16d0a050860 req-97d184b1-703d-4512-bdca-aa07e4b05efa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:06.052651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-80783bc3-b290-4ee3-875e-b16d0a050860 req-97d184b1-703d-4512-bdca-aa07e4b05efa service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:06.071401 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-80783bc3-b290-4ee3-875e-b16d0a050860 req-97d184b1-703d-4512-bdca-aa07e4b05efa service nova] Creating event network-vif-plugged:629120cf-11b0-4ba0-a66d-62d43b1d287c for instance 560d0628-098f-4b02-baa1-4b813976b51d on n-h1-844626-8 Aug 09 15:45:06.078447 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-80783bc3-b290-4ee3-875e-b16d0a050860 req-97d184b1-703d-4512-bdca-aa07e4b05efa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043424 Aug 09 15:45:06.079297 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3633/7275] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:45:06.936709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-af32eed6-2214-46f8-8827-d3536ca6dce0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:06.937875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-af32eed6-2214-46f8-8827-d3536ca6dce0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:06.941488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:45:06.954484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af32eed6-2214-46f8-8827-d3536ca6dce0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:06.955400 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af32eed6-2214-46f8-8827-d3536ca6dce0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:06.956194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af32eed6-2214-46f8-8827-d3536ca6dce0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:06.957401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af32eed6-2214-46f8-8827-d3536ca6dce0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:06.958223 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af32eed6-2214-46f8-8827-d3536ca6dce0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:06.958980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-af32eed6-2214-46f8-8827-d3536ca6dce0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:07.187761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-af32eed6-2214-46f8-8827-d3536ca6dce0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:07.200572 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-af32eed6-2214-46f8-8827-d3536ca6dce0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1391 microversion: 2.1 time: 0.270842 Aug 09 15:45:07.201534 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3643/7276] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:06 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1391 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:08.237474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:45:08.238849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:45:08.247967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-81dc1243-4652-4546-895a-d2ce14642d6c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:08.249251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-81dc1243-4652-4546-895a-d2ce14642d6c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:08.262776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81dc1243-4652-4546-895a-d2ce14642d6c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:08.263670 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81dc1243-4652-4546-895a-d2ce14642d6c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:08.264475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81dc1243-4652-4546-895a-d2ce14642d6c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:08.265765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81dc1243-4652-4546-895a-d2ce14642d6c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:08.266653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81dc1243-4652-4546-895a-d2ce14642d6c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:08.267475 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-81dc1243-4652-4546-895a-d2ce14642d6c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:08.526815 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-81dc1243-4652-4546-895a-d2ce14642d6c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:08.541287 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-81dc1243-4652-4546-895a-d2ce14642d6c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1563 microversion: 2.1 time: 0.305318 Aug 09 15:45:08.542656 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3634/7277] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:08 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1563 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:08.577460 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b8d2c76e-cd01-4ace-baeb-7a39c20905d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:08.578634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b8d2c76e-cd01-4ace-baeb-7a39c20905d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:08.591958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8d2c76e-cd01-4ace-baeb-7a39c20905d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:08.592864 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8d2c76e-cd01-4ace-baeb-7a39c20905d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:08.593639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8d2c76e-cd01-4ace-baeb-7a39c20905d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:08.594884 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8d2c76e-cd01-4ace-baeb-7a39c20905d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:08.595732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8d2c76e-cd01-4ace-baeb-7a39c20905d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:08.596493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b8d2c76e-cd01-4ace-baeb-7a39c20905d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:08.843615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b8d2c76e-cd01-4ace-baeb-7a39c20905d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:08.857078 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b8d2c76e-cd01-4ace-baeb-7a39c20905d9 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1563 microversion: 2.1 time: 0.286680 Aug 09 15:45:08.858138 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3644/7278] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:08 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1563 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:45:11.520963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a310862-6780-48f3-b907-95913889e652 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:11.521993 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a310862-6780-48f3-b907-95913889e652 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:11.526574 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:45:11.535989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-b12c42f2-4a69-4496-8c23-a0506e5518da req-95eddd00-3ddf-4def-9aac-6a9b02ac5656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "560d0628-098f-4b02-baa1-4b813976b51d", "tag": "629120cf-11b0-4ba0-a66d-62d43b1d287c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:45:11.536852 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a310862-6780-48f3-b907-95913889e652 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:11.537524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a310862-6780-48f3-b907-95913889e652 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:11.538249 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a310862-6780-48f3-b907-95913889e652 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:11.539597 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a310862-6780-48f3-b907-95913889e652 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:11.540413 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a310862-6780-48f3-b907-95913889e652 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:11.541167 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a310862-6780-48f3-b907-95913889e652 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:11.555258 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b12c42f2-4a69-4496-8c23-a0506e5518da req-95eddd00-3ddf-4def-9aac-6a9b02ac5656 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:11.556079 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b12c42f2-4a69-4496-8c23-a0506e5518da req-95eddd00-3ddf-4def-9aac-6a9b02ac5656 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:11.556781 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-b12c42f2-4a69-4496-8c23-a0506e5518da req-95eddd00-3ddf-4def-9aac-6a9b02ac5656 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:11.578648 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-b12c42f2-4a69-4496-8c23-a0506e5518da req-95eddd00-3ddf-4def-9aac-6a9b02ac5656 service nova] Creating event network-changed:629120cf-11b0-4ba0-a66d-62d43b1d287c for instance 560d0628-098f-4b02-baa1-4b813976b51d on n-h1-844626-8 Aug 09 15:45:11.588416 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-b12c42f2-4a69-4496-8c23-a0506e5518da req-95eddd00-3ddf-4def-9aac-6a9b02ac5656 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061068 Aug 09 15:45:11.589434 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3645/7279] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:45:11.999139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a310862-6780-48f3-b907-95913889e652 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:12.019871 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a310862-6780-48f3-b907-95913889e652 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1563 microversion: 2.1 time: 0.502111 Aug 09 15:45:12.022009 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3635/7280] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:11 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1563 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:45:32.537908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=9 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:45:32.539299 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=34 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:45:32.547456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-13409b11-b2db-493d-876f-b727af3d2911 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:45:32.551739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-13409b11-b2db-493d-876f-b727af3d2911 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:32.566085 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13409b11-b2db-493d-876f-b727af3d2911 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:32.566924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13409b11-b2db-493d-876f-b727af3d2911 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:32.567743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13409b11-b2db-493d-876f-b727af3d2911 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:32.569012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13409b11-b2db-493d-876f-b727af3d2911 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:32.569908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13409b11-b2db-493d-876f-b727af3d2911 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:32.570636 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-13409b11-b2db-493d-876f-b727af3d2911 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:32.649537 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-13409b11-b2db-493d-876f-b727af3d2911 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d/action" status: 200 len: 24566 microversion: 2.1 time: 0.115247 Aug 09 15:45:32.650298 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3646/7281] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:45:32 2022] POST /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d/action => generated 24566 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:45:43.677234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b6bd2850-b361-444e-9542-5eb78112b40c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:45:43.679707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:45:43.680612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=40 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:45:43.687296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6bd2850-b361-444e-9542-5eb78112b40c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:43.687807 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6bd2850-b361-444e-9542-5eb78112b40c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:43.688253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b6bd2850-b361-444e-9542-5eb78112b40c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:43.722425 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b6bd2850-b361-444e-9542-5eb78112b40c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Going to try to stop instance {{(pid=119406) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 15:45:43.795131 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b6bd2850-b361-444e-9542-5eb78112b40c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d/action" status: 202 len: 0 microversion: 2.1 time: 0.122048 Aug 09 15:45:43.795981 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3636/7282] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:45:43 2022] POST /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:45:43.812025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5e3e1402-1905-470a-ba9f-da0674e17142 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:43.816384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5e3e1402-1905-470a-ba9f-da0674e17142 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:43.827217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:45:43.829453 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:45:43.839340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e3e1402-1905-470a-ba9f-da0674e17142 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:43.840175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e3e1402-1905-470a-ba9f-da0674e17142 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:43.840949 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e3e1402-1905-470a-ba9f-da0674e17142 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:43.842169 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e3e1402-1905-470a-ba9f-da0674e17142 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:43.842970 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e3e1402-1905-470a-ba9f-da0674e17142 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:43.843747 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5e3e1402-1905-470a-ba9f-da0674e17142 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:44.072807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5e3e1402-1905-470a-ba9f-da0674e17142 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:44.082624 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5e3e1402-1905-470a-ba9f-da0674e17142 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.279782 Aug 09 15:45:44.083483 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3647/7283] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:43 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:45.108174 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a619d8ac-4128-461d-a04f-b779aeea3624 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:45.108912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a619d8ac-4128-461d-a04f-b779aeea3624 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:45.117968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a619d8ac-4128-461d-a04f-b779aeea3624 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:45.118886 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a619d8ac-4128-461d-a04f-b779aeea3624 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:45.119696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a619d8ac-4128-461d-a04f-b779aeea3624 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:45.121146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a619d8ac-4128-461d-a04f-b779aeea3624 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:45.122215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a619d8ac-4128-461d-a04f-b779aeea3624 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:45.123113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a619d8ac-4128-461d-a04f-b779aeea3624 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:45.364627 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a619d8ac-4128-461d-a04f-b779aeea3624 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:45.374914 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a619d8ac-4128-461d-a04f-b779aeea3624 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.272072 Aug 09 15:45:45.375616 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3637/7284] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:45 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:46.398769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-32e50434-68c0-4ff0-83cd-e1bc51fee961 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:46.400055 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-32e50434-68c0-4ff0-83cd-e1bc51fee961 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:46.408642 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32e50434-68c0-4ff0-83cd-e1bc51fee961 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:46.409266 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32e50434-68c0-4ff0-83cd-e1bc51fee961 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:46.409720 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32e50434-68c0-4ff0-83cd-e1bc51fee961 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:46.410528 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32e50434-68c0-4ff0-83cd-e1bc51fee961 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:46.411021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32e50434-68c0-4ff0-83cd-e1bc51fee961 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:46.411619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-32e50434-68c0-4ff0-83cd-e1bc51fee961 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:46.577919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-32e50434-68c0-4ff0-83cd-e1bc51fee961 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:46.587251 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-32e50434-68c0-4ff0-83cd-e1bc51fee961 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.192644 Aug 09 15:45:46.588025 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3648/7285] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:46 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:47.617397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-dc97a046-08e4-48cf-b82a-fb78cda621c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:47.618528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-dc97a046-08e4-48cf-b82a-fb78cda621c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:47.631428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc97a046-08e4-48cf-b82a-fb78cda621c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:47.632311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc97a046-08e4-48cf-b82a-fb78cda621c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:47.633078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc97a046-08e4-48cf-b82a-fb78cda621c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:47.634359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc97a046-08e4-48cf-b82a-fb78cda621c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:47.635282 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc97a046-08e4-48cf-b82a-fb78cda621c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:47.636082 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-dc97a046-08e4-48cf-b82a-fb78cda621c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:47.801909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-dc97a046-08e4-48cf-b82a-fb78cda621c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:47.811344 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-dc97a046-08e4-48cf-b82a-fb78cda621c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.201732 Aug 09 15:45:47.812061 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3638/7286] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:47 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:48.834734 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d3dc87c1-3ce8-467a-8ff5-c0f0ffc8251e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:48.835468 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d3dc87c1-3ce8-467a-8ff5-c0f0ffc8251e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:48.843520 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3dc87c1-3ce8-467a-8ff5-c0f0ffc8251e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:48.844010 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3dc87c1-3ce8-467a-8ff5-c0f0ffc8251e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:48.844447 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3dc87c1-3ce8-467a-8ff5-c0f0ffc8251e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:48.845176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3dc87c1-3ce8-467a-8ff5-c0f0ffc8251e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:48.845632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3dc87c1-3ce8-467a-8ff5-c0f0ffc8251e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:48.846059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d3dc87c1-3ce8-467a-8ff5-c0f0ffc8251e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:49.006162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d3dc87c1-3ce8-467a-8ff5-c0f0ffc8251e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:49.015431 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d3dc87c1-3ce8-467a-8ff5-c0f0ffc8251e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.184622 Aug 09 15:45:49.016103 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3649/7287] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:48 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:50.045026 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3d3273da-621d-45df-9fb8-78a97bfcf126 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:50.046197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3d3273da-621d-45df-9fb8-78a97bfcf126 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:50.058673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d3273da-621d-45df-9fb8-78a97bfcf126 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:50.059586 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d3273da-621d-45df-9fb8-78a97bfcf126 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:50.060397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d3273da-621d-45df-9fb8-78a97bfcf126 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:50.061691 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d3273da-621d-45df-9fb8-78a97bfcf126 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:50.062529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d3273da-621d-45df-9fb8-78a97bfcf126 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:50.063287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3d3273da-621d-45df-9fb8-78a97bfcf126 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:50.285414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3d3273da-621d-45df-9fb8-78a97bfcf126 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:50.299820 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3d3273da-621d-45df-9fb8-78a97bfcf126 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.261477 Aug 09 15:45:50.300944 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3639/7288] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:50 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:51.325401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-45c055eb-e567-4f82-a3f3-c32f13565819 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:51.326008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-45c055eb-e567-4f82-a3f3-c32f13565819 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:51.333784 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45c055eb-e567-4f82-a3f3-c32f13565819 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:51.334288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45c055eb-e567-4f82-a3f3-c32f13565819 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:51.334722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45c055eb-e567-4f82-a3f3-c32f13565819 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:51.335484 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45c055eb-e567-4f82-a3f3-c32f13565819 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:51.335935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45c055eb-e567-4f82-a3f3-c32f13565819 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:51.336357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-45c055eb-e567-4f82-a3f3-c32f13565819 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:51.496671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-45c055eb-e567-4f82-a3f3-c32f13565819 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:51.506076 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-45c055eb-e567-4f82-a3f3-c32f13565819 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.185028 Aug 09 15:45:51.506684 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3650/7289] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:51 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:52.529741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6d2134c9-466d-4892-a91f-bb48f88bfed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:52.530414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6d2134c9-466d-4892-a91f-bb48f88bfed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:52.539108 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d2134c9-466d-4892-a91f-bb48f88bfed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:52.539623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d2134c9-466d-4892-a91f-bb48f88bfed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:52.540070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d2134c9-466d-4892-a91f-bb48f88bfed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:52.540800 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d2134c9-466d-4892-a91f-bb48f88bfed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:52.541265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d2134c9-466d-4892-a91f-bb48f88bfed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:52.541693 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6d2134c9-466d-4892-a91f-bb48f88bfed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:52.770111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6d2134c9-466d-4892-a91f-bb48f88bfed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:52.778732 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6d2134c9-466d-4892-a91f-bb48f88bfed1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.252978 Aug 09 15:45:52.779383 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3640/7290] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:52 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:53.804119 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ab8eab47-72b7-4cc5-b446-1879f231581a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:53.805171 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ab8eab47-72b7-4cc5-b446-1879f231581a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:53.813871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab8eab47-72b7-4cc5-b446-1879f231581a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:53.814368 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab8eab47-72b7-4cc5-b446-1879f231581a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:53.814840 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab8eab47-72b7-4cc5-b446-1879f231581a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:53.815631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab8eab47-72b7-4cc5-b446-1879f231581a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:53.816093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab8eab47-72b7-4cc5-b446-1879f231581a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:53.816525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ab8eab47-72b7-4cc5-b446-1879f231581a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:53.980883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ab8eab47-72b7-4cc5-b446-1879f231581a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:53.989668 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ab8eab47-72b7-4cc5-b446-1879f231581a tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.191514 Aug 09 15:45:53.990283 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3651/7291] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:53 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:55.012234 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7b4ac5c9-eb01-412b-9ccf-54addb36b87f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:55.012830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7b4ac5c9-eb01-412b-9ccf-54addb36b87f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:55.022267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b4ac5c9-eb01-412b-9ccf-54addb36b87f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:55.022821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b4ac5c9-eb01-412b-9ccf-54addb36b87f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:55.023569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b4ac5c9-eb01-412b-9ccf-54addb36b87f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:55.024428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b4ac5c9-eb01-412b-9ccf-54addb36b87f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:55.025121 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b4ac5c9-eb01-412b-9ccf-54addb36b87f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:55.025644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7b4ac5c9-eb01-412b-9ccf-54addb36b87f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:55.191270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7b4ac5c9-eb01-412b-9ccf-54addb36b87f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:55.202444 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7b4ac5c9-eb01-412b-9ccf-54addb36b87f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.194282 Aug 09 15:45:55.203182 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3641/7292] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:55 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:56.225659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-599c1303-a5c3-4115-a87f-df27ade2b978 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:56.226506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-599c1303-a5c3-4115-a87f-df27ade2b978 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:56.234756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-599c1303-a5c3-4115-a87f-df27ade2b978 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:56.235195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-599c1303-a5c3-4115-a87f-df27ade2b978 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:56.235625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-599c1303-a5c3-4115-a87f-df27ade2b978 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:56.236342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-599c1303-a5c3-4115-a87f-df27ade2b978 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:56.236794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-599c1303-a5c3-4115-a87f-df27ade2b978 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:56.237216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-599c1303-a5c3-4115-a87f-df27ade2b978 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:56.397348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-599c1303-a5c3-4115-a87f-df27ade2b978 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:56.407431 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-599c1303-a5c3-4115-a87f-df27ade2b978 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.185739 Aug 09 15:45:56.408117 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3652/7293] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:56 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:57.430860 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9c6ac874-a250-4ffa-b914-eb00224e9b34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:57.431542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9c6ac874-a250-4ffa-b914-eb00224e9b34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:57.439725 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c6ac874-a250-4ffa-b914-eb00224e9b34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:57.440237 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c6ac874-a250-4ffa-b914-eb00224e9b34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:57.440688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c6ac874-a250-4ffa-b914-eb00224e9b34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:57.441454 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c6ac874-a250-4ffa-b914-eb00224e9b34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:57.441924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c6ac874-a250-4ffa-b914-eb00224e9b34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:57.442358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c6ac874-a250-4ffa-b914-eb00224e9b34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:57.653060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9c6ac874-a250-4ffa-b914-eb00224e9b34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:57.661700 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9c6ac874-a250-4ffa-b914-eb00224e9b34 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.235247 Aug 09 15:45:57.662314 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3642/7294] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:57 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:58.684937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1684f546-cc8b-4a02-818a-e57c45989157 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:58.685591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1684f546-cc8b-4a02-818a-e57c45989157 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:58.693434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1684f546-cc8b-4a02-818a-e57c45989157 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:58.694173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1684f546-cc8b-4a02-818a-e57c45989157 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:58.694667 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1684f546-cc8b-4a02-818a-e57c45989157 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:58.695475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1684f546-cc8b-4a02-818a-e57c45989157 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:58.695974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1684f546-cc8b-4a02-818a-e57c45989157 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:58.696437 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1684f546-cc8b-4a02-818a-e57c45989157 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:58.854679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1684f546-cc8b-4a02-818a-e57c45989157 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:45:58.863597 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1684f546-cc8b-4a02-818a-e57c45989157 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1692 microversion: 2.1 time: 0.182592 Aug 09 15:45:58.864076 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3653/7295] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:58 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:45:59.887411 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08e9252c-a521-4dd3-961b-6ba763bfffb1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:45:59.888352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-08e9252c-a521-4dd3-961b-6ba763bfffb1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:45:59.896181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08e9252c-a521-4dd3-961b-6ba763bfffb1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:59.896692 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08e9252c-a521-4dd3-961b-6ba763bfffb1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:59.897185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08e9252c-a521-4dd3-961b-6ba763bfffb1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:45:59.897924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08e9252c-a521-4dd3-961b-6ba763bfffb1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:45:59.898388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08e9252c-a521-4dd3-961b-6ba763bfffb1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:45:59.898850 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08e9252c-a521-4dd3-961b-6ba763bfffb1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:00.055302 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-08e9252c-a521-4dd3-961b-6ba763bfffb1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:46:00.072222 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-08e9252c-a521-4dd3-961b-6ba763bfffb1 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1669 microversion: 2.1 time: 0.189223 Aug 09 15:46:00.073330 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3643/7296] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:45:59 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1669 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:46:01.217320 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-94e81c81-badb-49ca-a43a-81152b44d98b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:46:01.219964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-94e81c81-badb-49ca-a43a-81152b44d98b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:01.228479 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94e81c81-badb-49ca-a43a-81152b44d98b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:01.228989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94e81c81-badb-49ca-a43a-81152b44d98b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:01.229426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94e81c81-badb-49ca-a43a-81152b44d98b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:01.230151 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94e81c81-badb-49ca-a43a-81152b44d98b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:01.230718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94e81c81-badb-49ca-a43a-81152b44d98b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:01.231297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-94e81c81-badb-49ca-a43a-81152b44d98b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:01.294086 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-94e81c81-badb-49ca-a43a-81152b44d98b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d/action" status: 200 len: 38440 microversion: 2.1 time: 0.080567 Aug 09 15:46:01.294942 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3654/7297] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:46:01 2022] POST /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d/action => generated 38440 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:46:01.308571 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4a55d390-7def-4aa6-b7ea-e41684d2b69f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:46:01.316406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a55d390-7def-4aa6-b7ea-e41684d2b69f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:01.316912 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a55d390-7def-4aa6-b7ea-e41684d2b69f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:01.317371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4a55d390-7def-4aa6-b7ea-e41684d2b69f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:01.347113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4a55d390-7def-4aa6-b7ea-e41684d2b69f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Going to try to start instance {{(pid=119406) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 15:46:01.399928 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4a55d390-7def-4aa6-b7ea-e41684d2b69f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d/action" status: 202 len: 0 microversion: 2.1 time: 0.095267 Aug 09 15:46:01.400565 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3644/7298] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:46:01 2022] POST /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:46:01.410469 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-42998150-c7a9-4232-8492-a1fc89630872 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:01.411211 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-42998150-c7a9-4232-8492-a1fc89630872 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:01.418956 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42998150-c7a9-4232-8492-a1fc89630872 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:01.419546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42998150-c7a9-4232-8492-a1fc89630872 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:01.420032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42998150-c7a9-4232-8492-a1fc89630872 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:01.420890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42998150-c7a9-4232-8492-a1fc89630872 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:01.421386 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42998150-c7a9-4232-8492-a1fc89630872 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:01.421809 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-42998150-c7a9-4232-8492-a1fc89630872 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:01.679114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-42998150-c7a9-4232-8492-a1fc89630872 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:46:01.688661 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-42998150-c7a9-4232-8492-a1fc89630872 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1678 microversion: 2.1 time: 0.282477 Aug 09 15:46:01.689519 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3655/7299] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:01 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1678 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:46:02.727612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aa94d7d9-5013-4027-8fc5-b74625956cfd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:02.728564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aa94d7d9-5013-4027-8fc5-b74625956cfd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:02.736663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa94d7d9-5013-4027-8fc5-b74625956cfd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:02.737177 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa94d7d9-5013-4027-8fc5-b74625956cfd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:02.737635 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa94d7d9-5013-4027-8fc5-b74625956cfd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:02.738377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa94d7d9-5013-4027-8fc5-b74625956cfd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:02.738853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa94d7d9-5013-4027-8fc5-b74625956cfd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:02.739333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aa94d7d9-5013-4027-8fc5-b74625956cfd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:02.932746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aa94d7d9-5013-4027-8fc5-b74625956cfd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:46:02.941575 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aa94d7d9-5013-4027-8fc5-b74625956cfd tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1682 microversion: 2.1 time: 0.218987 Aug 09 15:46:02.942200 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3645/7300] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:02 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:46:27.179357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3168f3cf-c4c1-424a-91d6-528f7042c383 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:46:27.181640 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3168f3cf-c4c1-424a-91d6-528f7042c383 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:27.184480 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=18 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:46:27.185135 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=52 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:46:27.192444 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3168f3cf-c4c1-424a-91d6-528f7042c383 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:27.193074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3168f3cf-c4c1-424a-91d6-528f7042c383 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:27.193831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3168f3cf-c4c1-424a-91d6-528f7042c383 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:27.194598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3168f3cf-c4c1-424a-91d6-528f7042c383 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:27.195121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3168f3cf-c4c1-424a-91d6-528f7042c383 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:27.195632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3168f3cf-c4c1-424a-91d6-528f7042c383 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:27.430286 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3168f3cf-c4c1-424a-91d6-528f7042c383 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d/action" status: 200 len: 63002 microversion: 2.1 time: 0.254385 Aug 09 15:46:27.431766 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3656/7301] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:46:27 2022] POST /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d/action => generated 63002 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 15:46:34.947191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-965f3dab-17c1-4c66-a709-040363c896c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:34.948634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-965f3dab-17c1-4c66-a709-040363c896c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:34.951886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-a88c72da-d460-4229-9693-f744d16daf32 req-e73ee52d-69d9-49e3-a4c6-8ede40b2a805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "560d0628-098f-4b02-baa1-4b813976b51d", "tag": "629120cf-11b0-4ba0-a66d-62d43b1d287c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:46:34.965353 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=20 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:46:34.966452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:46:34.972719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-965f3dab-17c1-4c66-a709-040363c896c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:34.973508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-965f3dab-17c1-4c66-a709-040363c896c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:34.980946 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a88c72da-d460-4229-9693-f744d16daf32 req-e73ee52d-69d9-49e3-a4c6-8ede40b2a805 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:34.981752 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a88c72da-d460-4229-9693-f744d16daf32 req-e73ee52d-69d9-49e3-a4c6-8ede40b2a805 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:34.982496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-965f3dab-17c1-4c66-a709-040363c896c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:34.983758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-965f3dab-17c1-4c66-a709-040363c896c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:34.985259 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-965f3dab-17c1-4c66-a709-040363c896c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:34.985832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-965f3dab-17c1-4c66-a709-040363c896c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:34.987609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-a88c72da-d460-4229-9693-f744d16daf32 req-e73ee52d-69d9-49e3-a4c6-8ede40b2a805 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:35.003398 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-a88c72da-d460-4229-9693-f744d16daf32 req-e73ee52d-69d9-49e3-a4c6-8ede40b2a805 service nova] Creating event network-changed:629120cf-11b0-4ba0-a66d-62d43b1d287c for instance 560d0628-098f-4b02-baa1-4b813976b51d on n-h1-844626-8 Aug 09 15:46:35.010022 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-a88c72da-d460-4229-9693-f744d16daf32 req-e73ee52d-69d9-49e3-a4c6-8ede40b2a805 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067958 Aug 09 15:46:35.011375 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3657/7302] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:46:35.035931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-965f3dab-17c1-4c66-a709-040363c896c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:46:35.169088 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-965f3dab-17c1-4c66-a709-040363c896c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "DELETE /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 204 len: 0 microversion: 2.1 time: 0.233500 Aug 09 15:46:35.170644 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3646/7303] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:46:34 2022] DELETE /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:46:35.186024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fb780a9d-7e98-4066-9bdb-d6fa32a2e5b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:35.192191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fb780a9d-7e98-4066-9bdb-d6fa32a2e5b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:35.203976 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb780a9d-7e98-4066-9bdb-d6fa32a2e5b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:35.204860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb780a9d-7e98-4066-9bdb-d6fa32a2e5b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:35.205657 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb780a9d-7e98-4066-9bdb-d6fa32a2e5b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:35.206962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb780a9d-7e98-4066-9bdb-d6fa32a2e5b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:35.207813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb780a9d-7e98-4066-9bdb-d6fa32a2e5b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:35.208659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fb780a9d-7e98-4066-9bdb-d6fa32a2e5b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:35.434201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fb780a9d-7e98-4066-9bdb-d6fa32a2e5b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:46:35.448850 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fb780a9d-7e98-4066-9bdb-d6fa32a2e5b5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1569 microversion: 2.1 time: 0.271871 Aug 09 15:46:35.449753 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3658/7304] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:35 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1569 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:46:36.477019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5f7408c2-671a-466b-b621-0c9011733706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:36.477781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5f7408c2-671a-466b-b621-0c9011733706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:36.486003 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f7408c2-671a-466b-b621-0c9011733706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:36.486518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f7408c2-671a-466b-b621-0c9011733706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:36.486999 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f7408c2-671a-466b-b621-0c9011733706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:36.489774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f7408c2-671a-466b-b621-0c9011733706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:36.489774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f7408c2-671a-466b-b621-0c9011733706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:36.489774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5f7408c2-671a-466b-b621-0c9011733706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:36.744716 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5f7408c2-671a-466b-b621-0c9011733706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:46:36.760910 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5f7408c2-671a-466b-b621-0c9011733706 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 200 len: 1569 microversion: 2.1 time: 0.288076 Aug 09 15:46:36.762238 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3647/7305] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:36 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 1569 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:46:37.304504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-98d49fb4-c75c-406f-a635-5f250f24daf6 req-08cab40e-2f23-481f-b585-55e820bc64e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560d0628-098f-4b02-baa1-4b813976b51d", "name": "network-vif-deleted", "tag": "629120cf-11b0-4ba0-a66d-62d43b1d287c"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:46:37.319758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-98d49fb4-c75c-406f-a635-5f250f24daf6 req-08cab40e-2f23-481f-b585-55e820bc64e1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:37.320241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-98d49fb4-c75c-406f-a635-5f250f24daf6 req-08cab40e-2f23-481f-b585-55e820bc64e1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:37.321318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-98d49fb4-c75c-406f-a635-5f250f24daf6 req-08cab40e-2f23-481f-b585-55e820bc64e1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:37.338481 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-98d49fb4-c75c-406f-a635-5f250f24daf6 req-08cab40e-2f23-481f-b585-55e820bc64e1 service nova] Creating event network-vif-deleted:629120cf-11b0-4ba0-a66d-62d43b1d287c for instance 560d0628-098f-4b02-baa1-4b813976b51d on n-h1-844626-8 Aug 09 15:46:37.345537 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-98d49fb4-c75c-406f-a635-5f250f24daf6 req-08cab40e-2f23-481f-b585-55e820bc64e1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048831 Aug 09 15:46:37.346919 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3659/7306] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:46:37.795439 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67f50d9f-6a5c-49b3-baa4-4451813690ef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:37.796358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-67f50d9f-6a5c-49b3-baa4-4451813690ef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 560d0628-098f-4b02-baa1-4b813976b51d] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:37.805536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67f50d9f-6a5c-49b3-baa4-4451813690ef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:37.806037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67f50d9f-6a5c-49b3-baa4-4451813690ef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:37.806697 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67f50d9f-6a5c-49b3-baa4-4451813690ef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:37.807490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67f50d9f-6a5c-49b3-baa4-4451813690ef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:37.807917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67f50d9f-6a5c-49b3-baa4-4451813690ef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:37.808580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-67f50d9f-6a5c-49b3-baa4-4451813690ef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:37.825475 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-67f50d9f-6a5c-49b3-baa4-4451813690ef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] HTTP exception thrown: Instance 560d0628-098f-4b02-baa1-4b813976b51d could not be found. Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67f50d9f-6a5c-49b3-baa4-4451813690ef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Request method failure captured: Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d HTTP/1.1 Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8n-wWj9WpQ7S_u-7y-n71vOR8Au_4UmgBa2wNz6rWCK__f-sxVABSN2zjqecqGC4IKaZVq-WcDEBtWz3KvoZvJhxDJbh8Jb_veqORDioviTgRfM8r8in8FLIT0_af7oefgXyAkdhAOfs_MBfLyn8o866ykWUknSf8OqrmStdHFFUClw Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 595d222e7a56448d9eaaf060d77c552b Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_595d222e7a56448d9eaaf060d77c552b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 595d222e7a56448d9eaaf060d77c552b Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestNetworkAdvancedServerOps-276209286-project Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3ca5b4f643564db09dfb30dd2a691789 Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-276209286-project Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 560d0628-098f-4b02-baa1-4b813976b51d could not be found. Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '560d0628-098f-4b02-baa1-4b813976b51d'} Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 560d0628-098f-4b02-baa1-4b813976b51d could not be found. Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 560d0628-098f-4b02-baa1-4b813976b51d could not be found. Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:46:37.828110 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:46:37.839573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:46:37.839573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:46:37.839573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:46:37.839573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:46:37.839573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:46:37.839573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:46:37.839573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 560d0628-098f-4b02-baa1-4b813976b51d could not be found. Aug 09 15:46:37.839573 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:46:37.839573 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-67f50d9f-6a5c-49b3-baa4-4451813690ef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Returning 404 to user: Instance 560d0628-098f-4b02-baa1-4b813976b51d could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:46:37.839573 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-67f50d9f-6a5c-49b3-baa4-4451813690ef tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d" status: 404 len: 111 microversion: 2.1 time: 0.039140 Aug 09 15:46:37.839573 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3648/7307] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:37 2022] GET /compute/v2.1/servers/560d0628-098f-4b02-baa1-4b813976b51d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:46:42.162724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7350a680-de1f-4c2e-88be-6215faeb852e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '.version_select at 0x7f41dc8868b0>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:42.194348 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7350a680-de1f-4c2e-88be-6215faeb852e tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-388637382" status: 202 len: 0 microversion: 2.1 time: 0.039852 Aug 09 15:46:42.195263 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3660/7308] 10.222.0.50 () {58 vars in 1281 bytes} [Tue Aug 9 15:46:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-388637382 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:46:42.232330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ebb7220e-d494-4249-b6a8-f200791a5416 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'create', calling method: .version_select at 0x7f41ddf50160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1390018132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHz0pb0VibeyjeC4yOI0OgYSSRHZuSasm9FLGK+H7qUJotBCoCE1vtiH0BVwcLqGbDZ8bV/c3xDt0ZzYUkUT4xVbvr+XhcZJi1XRzCAg+Yz5dj7gvraJ0lKQ8oylVNN89w=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:46:42.253341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-ebb7220e-d494-4249-b6a8-f200791a5416 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for project 595d222e7a56448d9eaaf060d77c552b. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:46:42.260119 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-ebb7220e-d494-4249-b6a8-f200791a5416 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for user 3ca5b4f643564db09dfb30dd2a691789 and project 595d222e7a56448d9eaaf060d77c552b. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:46:42.291005 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ebb7220e-d494-4249-b6a8-f200791a5416 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.063571 Aug 09 15:46:42.291867 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3649/7309] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:46:42 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:46:49.979230 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1682198594", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "networks": [{"uuid": "0f794c4a-f321-4274-9c16-88a8cb48ffe7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1390018132", "security_groups": [{"name": "tempest-secgroup-smoke-1622540478"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:46:50.009533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=14 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:46:50.251702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] validate_networks() for [('0f794c4a-f321-4274-9c16-88a8cb48ffe7', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:46:51.041209 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:46:51.042083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:46:51.042542 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:46:51.043045 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:46:51.043619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:46:51.056562 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:51.057051 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:51.057492 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:51.058274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:51.058725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:51.059172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:51.082851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for project 595d222e7a56448d9eaaf060d77c552b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:46:51.091725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Getting quotas for user 3ca5b4f643564db09dfb30dd2a691789 and project 595d222e7a56448d9eaaf060d77c552b. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:46:51.115158 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:46:51.118228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:46:51.174381 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f620749a-42a6-4f34-a22f-0fea1ba1e3ed tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.202757 Aug 09 15:46:51.185277 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3661/7310] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:46:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:46:51.196278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-11ddbc98-6def-47b2-a8b2-901ced6e3e15 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:51.197540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-11ddbc98-6def-47b2-a8b2-901ced6e3e15 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:51.203380 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:46:51.316389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-11ddbc98-6def-47b2-a8b2-901ced6e3e15 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:46:51.332515 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-11ddbc98-6def-47b2-a8b2-901ced6e3e15 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1267 microversion: 2.1 time: 0.143274 Aug 09 15:46:51.334476 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3650/7311] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:51 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:46:52.371197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-640ec7cb-5196-4c55-b509-f757f4d289c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:52.372073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-640ec7cb-5196-4c55-b509-f757f4d289c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:52.380510 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-640ec7cb-5196-4c55-b509-f757f4d289c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:52.381110 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-640ec7cb-5196-4c55-b509-f757f4d289c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:52.381832 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-640ec7cb-5196-4c55-b509-f757f4d289c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:52.382713 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-640ec7cb-5196-4c55-b509-f757f4d289c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:52.383259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-640ec7cb-5196-4c55-b509-f757f4d289c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:52.383902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-640ec7cb-5196-4c55-b509-f757f4d289c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:52.518543 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-640ec7cb-5196-4c55-b509-f757f4d289c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:46:52.533934 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-640ec7cb-5196-4c55-b509-f757f4d289c0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1319 microversion: 2.1 time: 0.166790 Aug 09 15:46:52.539207 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3662/7312] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:52 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:46:53.578135 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-71456024-d43c-4134-ac5a-ee1fa32f0461 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:53.579351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-71456024-d43c-4134-ac5a-ee1fa32f0461 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:53.605053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71456024-d43c-4134-ac5a-ee1fa32f0461 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:53.605688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71456024-d43c-4134-ac5a-ee1fa32f0461 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:53.608451 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71456024-d43c-4134-ac5a-ee1fa32f0461 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:53.610857 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71456024-d43c-4134-ac5a-ee1fa32f0461 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:53.612340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71456024-d43c-4134-ac5a-ee1fa32f0461 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:53.613668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-71456024-d43c-4134-ac5a-ee1fa32f0461 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:53.900867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-71456024-d43c-4134-ac5a-ee1fa32f0461 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:46:53.910032 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-71456024-d43c-4134-ac5a-ee1fa32f0461 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1393 microversion: 2.1 time: 0.338917 Aug 09 15:46:53.911306 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3651/7313] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:53 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1393 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:46:54.529812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-61c142f7-519e-4318-9cda-23f897b77c3a req-5e6ef99d-1f2b-4728-b757-d995413e4cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84312b77-e813-4b36-8d5c-a9a20ad4d918", "tag": "cc0a2ac8-bcb4-4526-a617-c38fc1a1ec8f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:46:54.545130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-61c142f7-519e-4318-9cda-23f897b77c3a req-5e6ef99d-1f2b-4728-b757-d995413e4cb1 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:54.545895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-61c142f7-519e-4318-9cda-23f897b77c3a req-5e6ef99d-1f2b-4728-b757-d995413e4cb1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:54.546819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-61c142f7-519e-4318-9cda-23f897b77c3a req-5e6ef99d-1f2b-4728-b757-d995413e4cb1 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:54.560419 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-61c142f7-519e-4318-9cda-23f897b77c3a req-5e6ef99d-1f2b-4728-b757-d995413e4cb1 service nova] Creating event network-changed:cc0a2ac8-bcb4-4526-a617-c38fc1a1ec8f for instance 84312b77-e813-4b36-8d5c-a9a20ad4d918 on n-h1-844626-8 Aug 09 15:46:54.566590 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-61c142f7-519e-4318-9cda-23f897b77c3a req-5e6ef99d-1f2b-4728-b757-d995413e4cb1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043665 Aug 09 15:46:54.567268 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3663/7314] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:46:54.946335 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-999f6d8e-4284-4af5-bd98-e500db186a6f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:54.947168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-999f6d8e-4284-4af5-bd98-e500db186a6f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:54.956472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-999f6d8e-4284-4af5-bd98-e500db186a6f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:54.957201 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-999f6d8e-4284-4af5-bd98-e500db186a6f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:54.957790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-999f6d8e-4284-4af5-bd98-e500db186a6f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:54.958819 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-999f6d8e-4284-4af5-bd98-e500db186a6f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:54.959427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-999f6d8e-4284-4af5-bd98-e500db186a6f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:54.960412 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-999f6d8e-4284-4af5-bd98-e500db186a6f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:55.161039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-999f6d8e-4284-4af5-bd98-e500db186a6f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:46:55.172165 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-999f6d8e-4284-4af5-bd98-e500db186a6f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1393 microversion: 2.1 time: 0.231082 Aug 09 15:46:55.173076 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3652/7315] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:54 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1393 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:46:56.197049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1b58ddc4-53f0-4dec-b1de-bb345b982ada tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:56.198920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1b58ddc4-53f0-4dec-b1de-bb345b982ada tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:56.206702 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b58ddc4-53f0-4dec-b1de-bb345b982ada tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:56.207449 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b58ddc4-53f0-4dec-b1de-bb345b982ada tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:56.207857 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b58ddc4-53f0-4dec-b1de-bb345b982ada tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:56.208709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b58ddc4-53f0-4dec-b1de-bb345b982ada tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:56.209175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b58ddc4-53f0-4dec-b1de-bb345b982ada tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:56.209603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b58ddc4-53f0-4dec-b1de-bb345b982ada tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:56.403206 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1b58ddc4-53f0-4dec-b1de-bb345b982ada tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:46:56.412899 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1b58ddc4-53f0-4dec-b1de-bb345b982ada tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1393 microversion: 2.1 time: 0.221662 Aug 09 15:46:56.413690 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3664/7316] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:56 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1393 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:46:57.434947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3e6462c6-5705-4be7-98d6-1cc0953b75b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:57.435764 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3e6462c6-5705-4be7-98d6-1cc0953b75b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:57.443370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e6462c6-5705-4be7-98d6-1cc0953b75b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:57.443907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e6462c6-5705-4be7-98d6-1cc0953b75b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:57.444361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e6462c6-5705-4be7-98d6-1cc0953b75b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:57.445088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e6462c6-5705-4be7-98d6-1cc0953b75b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:57.445556 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e6462c6-5705-4be7-98d6-1cc0953b75b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:57.445998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3e6462c6-5705-4be7-98d6-1cc0953b75b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:57.658806 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3e6462c6-5705-4be7-98d6-1cc0953b75b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:46:57.668156 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3e6462c6-5705-4be7-98d6-1cc0953b75b4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1393 microversion: 2.1 time: 0.237367 Aug 09 15:46:57.668955 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3653/7317] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:57 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1393 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:46:58.695071 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4535efac-0b92-4532-a91b-78d8f31fe0d0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:58.696185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4535efac-0b92-4532-a91b-78d8f31fe0d0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:58.701716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:46:58.712810 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4535efac-0b92-4532-a91b-78d8f31fe0d0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:58.713703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4535efac-0b92-4532-a91b-78d8f31fe0d0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:58.714514 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4535efac-0b92-4532-a91b-78d8f31fe0d0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:58.715914 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4535efac-0b92-4532-a91b-78d8f31fe0d0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:58.716751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4535efac-0b92-4532-a91b-78d8f31fe0d0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:58.717535 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4535efac-0b92-4532-a91b-78d8f31fe0d0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:58.918308 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4535efac-0b92-4532-a91b-78d8f31fe0d0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:46:58.932712 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4535efac-0b92-4532-a91b-78d8f31fe0d0 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1393 microversion: 2.1 time: 0.245139 Aug 09 15:46:58.933562 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3665/7318] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:58 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1393 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:46:59.963633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-80bdf449-0944-4087-8c70-bafcc63bb6ea tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:46:59.964402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-80bdf449-0944-4087-8c70-bafcc63bb6ea tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:46:59.972391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80bdf449-0944-4087-8c70-bafcc63bb6ea tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:59.973022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80bdf449-0944-4087-8c70-bafcc63bb6ea tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:59.973521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80bdf449-0944-4087-8c70-bafcc63bb6ea tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:46:59.974453 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80bdf449-0944-4087-8c70-bafcc63bb6ea tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:46:59.975077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80bdf449-0944-4087-8c70-bafcc63bb6ea tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:46:59.975765 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-80bdf449-0944-4087-8c70-bafcc63bb6ea tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:00.140144 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-80bdf449-0944-4087-8c70-bafcc63bb6ea tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:00.149226 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-80bdf449-0944-4087-8c70-bafcc63bb6ea tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1393 microversion: 2.1 time: 0.189410 Aug 09 15:47:00.149857 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3654/7319] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:46:59 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1393 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:47:00.484130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ec30fc26-ea78-46cc-8b81-1240857a04d9 req-444e395b-07c4-474e-9170-755d34253424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84312b77-e813-4b36-8d5c-a9a20ad4d918", "name": "network-vif-plugged", "status": "completed", "tag": "cc0a2ac8-bcb4-4526-a617-c38fc1a1ec8f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:47:00.497433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ec30fc26-ea78-46cc-8b81-1240857a04d9 req-444e395b-07c4-474e-9170-755d34253424 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:00.498040 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ec30fc26-ea78-46cc-8b81-1240857a04d9 req-444e395b-07c4-474e-9170-755d34253424 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:00.498525 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ec30fc26-ea78-46cc-8b81-1240857a04d9 req-444e395b-07c4-474e-9170-755d34253424 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:00.516609 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ec30fc26-ea78-46cc-8b81-1240857a04d9 req-444e395b-07c4-474e-9170-755d34253424 service nova] Creating event network-vif-plugged:cc0a2ac8-bcb4-4526-a617-c38fc1a1ec8f for instance 84312b77-e813-4b36-8d5c-a9a20ad4d918 on n-h1-844626-8 Aug 09 15:47:00.524527 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ec30fc26-ea78-46cc-8b81-1240857a04d9 req-444e395b-07c4-474e-9170-755d34253424 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044736 Aug 09 15:47:00.526013 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3666/7320] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:47:01.173703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2ff1ba3b-ff67-43aa-9ed9-a20c441c1d3f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:01.174611 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2ff1ba3b-ff67-43aa-9ed9-a20c441c1d3f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:01.183035 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ff1ba3b-ff67-43aa-9ed9-a20c441c1d3f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:01.183603 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ff1ba3b-ff67-43aa-9ed9-a20c441c1d3f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:01.184060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ff1ba3b-ff67-43aa-9ed9-a20c441c1d3f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:01.184820 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ff1ba3b-ff67-43aa-9ed9-a20c441c1d3f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:01.185301 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ff1ba3b-ff67-43aa-9ed9-a20c441c1d3f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:01.185768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2ff1ba3b-ff67-43aa-9ed9-a20c441c1d3f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:01.324971 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:47:01.343805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2ff1ba3b-ff67-43aa-9ed9-a20c441c1d3f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:01.353364 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2ff1ba3b-ff67-43aa-9ed9-a20c441c1d3f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1393 microversion: 2.1 time: 0.184080 Aug 09 15:47:01.354349 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3655/7321] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:01 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1393 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:47:02.377901 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a76f280a-33d8-4cf2-b539-c51a61c21326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:02.379025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a76f280a-33d8-4cf2-b539-c51a61c21326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:02.381730 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:47:02.382711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:47:02.391176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a76f280a-33d8-4cf2-b539-c51a61c21326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:02.391659 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a76f280a-33d8-4cf2-b539-c51a61c21326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:02.392107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a76f280a-33d8-4cf2-b539-c51a61c21326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:02.392826 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a76f280a-33d8-4cf2-b539-c51a61c21326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:02.393274 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a76f280a-33d8-4cf2-b539-c51a61c21326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:02.393698 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a76f280a-33d8-4cf2-b539-c51a61c21326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:02.565610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a76f280a-33d8-4cf2-b539-c51a61c21326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:02.574628 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a76f280a-33d8-4cf2-b539-c51a61c21326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1566 microversion: 2.1 time: 0.201290 Aug 09 15:47:02.575276 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3667/7322] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:02 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1566 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:47:02.596760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5e8f7f2c-2746-4652-8bf9-82a1882acd01 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:02.597388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5e8f7f2c-2746-4652-8bf9-82a1882acd01 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:02.605421 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e8f7f2c-2746-4652-8bf9-82a1882acd01 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:02.605963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e8f7f2c-2746-4652-8bf9-82a1882acd01 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:02.606503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e8f7f2c-2746-4652-8bf9-82a1882acd01 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:02.607386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e8f7f2c-2746-4652-8bf9-82a1882acd01 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:02.608065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e8f7f2c-2746-4652-8bf9-82a1882acd01 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:02.608537 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5e8f7f2c-2746-4652-8bf9-82a1882acd01 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:02.759530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5e8f7f2c-2746-4652-8bf9-82a1882acd01 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:02.768574 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5e8f7f2c-2746-4652-8bf9-82a1882acd01 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1566 microversion: 2.1 time: 0.175805 Aug 09 15:47:02.769285 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3656/7323] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:02 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:47:04.943997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e471f0f3-32ba-4b8c-88aa-ac5bfaa12326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:04.944609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e471f0f3-32ba-4b8c-88aa-ac5bfaa12326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:04.950996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-155a3354-874d-492b-9b1f-986e161fe7bb req-246ad355-b31a-435a-a1b1-07d5e80ce202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84312b77-e813-4b36-8d5c-a9a20ad4d918", "tag": "cc0a2ac8-bcb4-4526-a617-c38fc1a1ec8f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:47:04.962791 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e471f0f3-32ba-4b8c-88aa-ac5bfaa12326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:04.963992 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e471f0f3-32ba-4b8c-88aa-ac5bfaa12326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:04.964644 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e471f0f3-32ba-4b8c-88aa-ac5bfaa12326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:04.966059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e471f0f3-32ba-4b8c-88aa-ac5bfaa12326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:04.966980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e471f0f3-32ba-4b8c-88aa-ac5bfaa12326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:04.968029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-155a3354-874d-492b-9b1f-986e161fe7bb req-246ad355-b31a-435a-a1b1-07d5e80ce202 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:04.968541 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-155a3354-874d-492b-9b1f-986e161fe7bb req-246ad355-b31a-435a-a1b1-07d5e80ce202 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:04.968998 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-155a3354-874d-492b-9b1f-986e161fe7bb req-246ad355-b31a-435a-a1b1-07d5e80ce202 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:04.969208 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e471f0f3-32ba-4b8c-88aa-ac5bfaa12326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:04.982730 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-155a3354-874d-492b-9b1f-986e161fe7bb req-246ad355-b31a-435a-a1b1-07d5e80ce202 service nova] Creating event network-changed:cc0a2ac8-bcb4-4526-a617-c38fc1a1ec8f for instance 84312b77-e813-4b36-8d5c-a9a20ad4d918 on n-h1-844626-8 Aug 09 15:47:04.989195 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-155a3354-874d-492b-9b1f-986e161fe7bb req-246ad355-b31a-435a-a1b1-07d5e80ce202 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042469 Aug 09 15:47:04.990180 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3657/7324] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:47:05.191647 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e471f0f3-32ba-4b8c-88aa-ac5bfaa12326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:05.206774 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e471f0f3-32ba-4b8c-88aa-ac5bfaa12326 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1566 microversion: 2.1 time: 0.266926 Aug 09 15:47:05.208076 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3668/7325] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:04 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1566 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:47:26.564797 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-70b0abd7-63d9-44ab-897b-9922475b375b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:47:26.567910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-70b0abd7-63d9-44ab-897b-9922475b375b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:26.571990 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:47:26.572935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=38 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:47:26.582120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70b0abd7-63d9-44ab-897b-9922475b375b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:26.582741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70b0abd7-63d9-44ab-897b-9922475b375b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:26.583207 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70b0abd7-63d9-44ab-897b-9922475b375b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:26.583926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70b0abd7-63d9-44ab-897b-9922475b375b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:26.584516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70b0abd7-63d9-44ab-897b-9922475b375b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:26.584953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-70b0abd7-63d9-44ab-897b-9922475b375b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:26.648337 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-70b0abd7-63d9-44ab-897b-9922475b375b tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918/action" status: 200 len: 24566 microversion: 2.1 time: 0.088293 Aug 09 15:47:26.649250 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3658/7326] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:47:26 2022] POST /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918/action => generated 24566 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:47:37.584126 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-72b84444-e0f8-4161-a442-58cafa69b4e8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:47:37.585499 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-72b84444-e0f8-4161-a442-58cafa69b4e8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:37.587871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=7 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:47:37.588649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=36 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:47:37.597357 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72b84444-e0f8-4161-a442-58cafa69b4e8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:37.597975 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72b84444-e0f8-4161-a442-58cafa69b4e8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:37.598420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72b84444-e0f8-4161-a442-58cafa69b4e8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:37.599377 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72b84444-e0f8-4161-a442-58cafa69b4e8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:37.600086 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72b84444-e0f8-4161-a442-58cafa69b4e8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:37.600655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-72b84444-e0f8-4161-a442-58cafa69b4e8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:37.630097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-72b84444-e0f8-4161-a442-58cafa69b4e8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lazy-loading 'flavor' on Instance uuid 84312b77-e813-4b36-8d5c-a9a20ad4d918 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:47:37.715066 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-72b84444-e0f8-4161-a442-58cafa69b4e8 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918/action" status: 202 len: 0 microversion: 2.1 time: 0.134982 Aug 09 15:47:37.716164 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3669/7327] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:47:37 2022] POST /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:47:37.726261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-79be7fb4-d41b-4ce1-a693-db5e679a63b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:37.727463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-79be7fb4-d41b-4ce1-a693-db5e679a63b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:37.732710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:47:37.733730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=4 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:47:37.741039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79be7fb4-d41b-4ce1-a693-db5e679a63b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:37.741722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79be7fb4-d41b-4ce1-a693-db5e679a63b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:37.742236 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79be7fb4-d41b-4ce1-a693-db5e679a63b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:37.743077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79be7fb4-d41b-4ce1-a693-db5e679a63b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:37.743700 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79be7fb4-d41b-4ce1-a693-db5e679a63b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:37.744270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-79be7fb4-d41b-4ce1-a693-db5e679a63b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:37.901920 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-79be7fb4-d41b-4ce1-a693-db5e679a63b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:37.910391 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-79be7fb4-d41b-4ce1-a693-db5e679a63b3 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1693 microversion: 2.1 time: 0.189107 Aug 09 15:47:37.910963 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3659/7328] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:37 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1693 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:47:38.936905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2fb1de71-abf2-408f-b4bc-5a07cdce1efa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:38.937609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2fb1de71-abf2-408f-b4bc-5a07cdce1efa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:38.945141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fb1de71-abf2-408f-b4bc-5a07cdce1efa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:38.945651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fb1de71-abf2-408f-b4bc-5a07cdce1efa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:38.946093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fb1de71-abf2-408f-b4bc-5a07cdce1efa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:38.946820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fb1de71-abf2-408f-b4bc-5a07cdce1efa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:38.947434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fb1de71-abf2-408f-b4bc-5a07cdce1efa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:38.947922 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2fb1de71-abf2-408f-b4bc-5a07cdce1efa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:39.129962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2fb1de71-abf2-408f-b4bc-5a07cdce1efa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:39.139537 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2fb1de71-abf2-408f-b4bc-5a07cdce1efa tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1676 microversion: 2.1 time: 0.209032 Aug 09 15:47:39.140176 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3670/7329] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:38 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:47:40.242760 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3be63fd0-9f74-4944-871d-7697a46eff14 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:47:40.245663 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3be63fd0-9f74-4944-871d-7697a46eff14 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:40.255069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3be63fd0-9f74-4944-871d-7697a46eff14 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:40.255622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3be63fd0-9f74-4944-871d-7697a46eff14 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:40.256081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3be63fd0-9f74-4944-871d-7697a46eff14 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:40.257008 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3be63fd0-9f74-4944-871d-7697a46eff14 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:40.257483 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3be63fd0-9f74-4944-871d-7697a46eff14 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:40.257921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3be63fd0-9f74-4944-871d-7697a46eff14 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:40.332086 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3be63fd0-9f74-4944-871d-7697a46eff14 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918/action" status: 200 len: 38360 microversion: 2.1 time: 0.094241 Aug 09 15:47:40.332680 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3660/7330] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:47:40 2022] POST /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918/action => generated 38360 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:47:40.347764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4a661331-43f0-44e1-9625-7a0c91f13b7c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:47:40.348370 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4a661331-43f0-44e1-9625-7a0c91f13b7c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:40.357279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a661331-43f0-44e1-9625-7a0c91f13b7c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:40.357789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a661331-43f0-44e1-9625-7a0c91f13b7c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:40.358231 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a661331-43f0-44e1-9625-7a0c91f13b7c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:40.358966 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a661331-43f0-44e1-9625-7a0c91f13b7c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:40.359454 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a661331-43f0-44e1-9625-7a0c91f13b7c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:40.359895 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4a661331-43f0-44e1-9625-7a0c91f13b7c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:40.449984 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4a661331-43f0-44e1-9625-7a0c91f13b7c tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918/action" status: 202 len: 0 microversion: 2.1 time: 0.106551 Aug 09 15:47:40.450673 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3671/7331] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:47:40 2022] POST /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:47:40.460140 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fca07580-80f3-4f05-a94d-8c77c7d9eaa4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:40.460942 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fca07580-80f3-4f05-a94d-8c77c7d9eaa4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:40.468948 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fca07580-80f3-4f05-a94d-8c77c7d9eaa4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:40.469514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fca07580-80f3-4f05-a94d-8c77c7d9eaa4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:40.469914 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fca07580-80f3-4f05-a94d-8c77c7d9eaa4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:40.470686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fca07580-80f3-4f05-a94d-8c77c7d9eaa4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:40.471328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fca07580-80f3-4f05-a94d-8c77c7d9eaa4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:40.471684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fca07580-80f3-4f05-a94d-8c77c7d9eaa4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:40.644371 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fca07580-80f3-4f05-a94d-8c77c7d9eaa4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:40.659325 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fca07580-80f3-4f05-a94d-8c77c7d9eaa4 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1682 microversion: 2.1 time: 0.203219 Aug 09 15:47:40.660426 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3661/7332] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:40 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:47:41.685533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28fbef13-d99a-4c64-a5c7-d6916b93bc9f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:41.686239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28fbef13-d99a-4c64-a5c7-d6916b93bc9f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:41.695277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fbef13-d99a-4c64-a5c7-d6916b93bc9f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:41.695835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fbef13-d99a-4c64-a5c7-d6916b93bc9f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:41.696283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fbef13-d99a-4c64-a5c7-d6916b93bc9f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:41.697025 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fbef13-d99a-4c64-a5c7-d6916b93bc9f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:41.697483 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fbef13-d99a-4c64-a5c7-d6916b93bc9f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:41.697908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28fbef13-d99a-4c64-a5c7-d6916b93bc9f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:41.866070 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-28fbef13-d99a-4c64-a5c7-d6916b93bc9f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:41.874487 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28fbef13-d99a-4c64-a5c7-d6916b93bc9f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1682 microversion: 2.1 time: 0.193443 Aug 09 15:47:41.875140 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3672/7333] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:41 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1682 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:47:42.907805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-0cb45513-b1af-44ba-a93d-88433b4f773d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:42.908458 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-0cb45513-b1af-44ba-a93d-88433b4f773d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:42.917619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cb45513-b1af-44ba-a93d-88433b4f773d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:42.918192 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cb45513-b1af-44ba-a93d-88433b4f773d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:42.918673 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cb45513-b1af-44ba-a93d-88433b4f773d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:42.919552 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cb45513-b1af-44ba-a93d-88433b4f773d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:42.920061 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cb45513-b1af-44ba-a93d-88433b4f773d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:42.920561 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-0cb45513-b1af-44ba-a93d-88433b4f773d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:43.101544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-0cb45513-b1af-44ba-a93d-88433b4f773d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:43.110664 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-0cb45513-b1af-44ba-a93d-88433b4f773d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1685 microversion: 2.1 time: 0.206874 Aug 09 15:47:43.111707 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3662/7334] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:42 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1685 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:47:43.265778 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2a0b2ce2-c608-48db-94b1-003fb3cd7d2d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:47:43.268136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2a0b2ce2-c608-48db-94b1-003fb3cd7d2d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:43.278129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a0b2ce2-c608-48db-94b1-003fb3cd7d2d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:43.278724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a0b2ce2-c608-48db-94b1-003fb3cd7d2d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:43.279246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a0b2ce2-c608-48db-94b1-003fb3cd7d2d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:43.280027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a0b2ce2-c608-48db-94b1-003fb3cd7d2d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:43.280531 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a0b2ce2-c608-48db-94b1-003fb3cd7d2d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:43.281019 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2a0b2ce2-c608-48db-94b1-003fb3cd7d2d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:43.329494 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2a0b2ce2-c608-48db-94b1-003fb3cd7d2d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "POST /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918/action" status: 200 len: 38360 microversion: 2.1 time: 0.067588 Aug 09 15:47:43.330216 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3673/7335] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:47:43 2022] POST /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918/action => generated 38360 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 15:47:44.646882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2b81bfe2-51c3-4e5f-9798-2c101912edd5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:44.648617 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b81bfe2-51c3-4e5f-9798-2c101912edd5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:44.658300 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b81bfe2-51c3-4e5f-9798-2c101912edd5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:44.658818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b81bfe2-51c3-4e5f-9798-2c101912edd5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:44.659557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b81bfe2-51c3-4e5f-9798-2c101912edd5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:44.660352 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b81bfe2-51c3-4e5f-9798-2c101912edd5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:44.660885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b81bfe2-51c3-4e5f-9798-2c101912edd5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:44.661337 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2b81bfe2-51c3-4e5f-9798-2c101912edd5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:44.696939 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2b81bfe2-51c3-4e5f-9798-2c101912edd5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:47:44.747989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-2b558fed-e9d6-4d1d-9d70-6e23fb28fd4b req-abb3c6d6-568f-4e95-b27b-3b831bde4e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84312b77-e813-4b36-8d5c-a9a20ad4d918", "tag": "cc0a2ac8-bcb4-4526-a617-c38fc1a1ec8f"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:47:44.760018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2b558fed-e9d6-4d1d-9d70-6e23fb28fd4b req-abb3c6d6-568f-4e95-b27b-3b831bde4e69 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:44.760517 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2b558fed-e9d6-4d1d-9d70-6e23fb28fd4b req-abb3c6d6-568f-4e95-b27b-3b831bde4e69 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:44.760961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-2b558fed-e9d6-4d1d-9d70-6e23fb28fd4b req-abb3c6d6-568f-4e95-b27b-3b831bde4e69 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:44.774587 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-2b558fed-e9d6-4d1d-9d70-6e23fb28fd4b req-abb3c6d6-568f-4e95-b27b-3b831bde4e69 service nova] Creating event network-changed:cc0a2ac8-bcb4-4526-a617-c38fc1a1ec8f for instance 84312b77-e813-4b36-8d5c-a9a20ad4d918 on n-h1-844626-8 Aug 09 15:47:44.780920 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-2b558fed-e9d6-4d1d-9d70-6e23fb28fd4b req-abb3c6d6-568f-4e95-b27b-3b831bde4e69 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138436 Aug 09 15:47:44.781946 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3674/7336] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:47:44.803634 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2b81bfe2-51c3-4e5f-9798-2c101912edd5 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "DELETE /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 204 len: 0 microversion: 2.1 time: 0.163795 Aug 09 15:47:44.804724 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3663/7337] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:47:44 2022] DELETE /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:47:44.818748 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ed525f8c-2e49-4053-a1f1-ffbfd55b1970 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:44.819837 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ed525f8c-2e49-4053-a1f1-ffbfd55b1970 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:44.833779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed525f8c-2e49-4053-a1f1-ffbfd55b1970 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:44.834477 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed525f8c-2e49-4053-a1f1-ffbfd55b1970 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:44.835236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed525f8c-2e49-4053-a1f1-ffbfd55b1970 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:44.836090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed525f8c-2e49-4053-a1f1-ffbfd55b1970 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:44.836842 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed525f8c-2e49-4053-a1f1-ffbfd55b1970 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:44.837452 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ed525f8c-2e49-4053-a1f1-ffbfd55b1970 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:45.019877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ed525f8c-2e49-4053-a1f1-ffbfd55b1970 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:45.029334 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ed525f8c-2e49-4053-a1f1-ffbfd55b1970 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1691 microversion: 2.1 time: 0.217220 Aug 09 15:47:45.031069 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3675/7338] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:44 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1691 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:47:46.058724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3a167d5e-7cf2-4d59-ab83-503889593f5d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:46.059927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3a167d5e-7cf2-4d59-ab83-503889593f5d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:46.074566 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a167d5e-7cf2-4d59-ab83-503889593f5d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:46.075456 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a167d5e-7cf2-4d59-ab83-503889593f5d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:46.075924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a167d5e-7cf2-4d59-ab83-503889593f5d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:46.076695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a167d5e-7cf2-4d59-ab83-503889593f5d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:46.077170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a167d5e-7cf2-4d59-ab83-503889593f5d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:46.077619 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3a167d5e-7cf2-4d59-ab83-503889593f5d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:46.278360 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3a167d5e-7cf2-4d59-ab83-503889593f5d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:46.288301 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3a167d5e-7cf2-4d59-ab83-503889593f5d tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1691 microversion: 2.1 time: 0.238240 Aug 09 15:47:46.288949 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3664/7339] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:46 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1691 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:47:47.315391 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-fe96f666-aaa0-43a1-aaf5-554c7fb711cf tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:47.316631 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-fe96f666-aaa0-43a1-aaf5-554c7fb711cf tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:47.321240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-81650c62-0d6b-4c9a-aaae-8097f75a4a7c req-1d98159a-3f3c-4a7b-a053-69b687e76a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84312b77-e813-4b36-8d5c-a9a20ad4d918", "name": "network-vif-deleted", "tag": "cc0a2ac8-bcb4-4526-a617-c38fc1a1ec8f"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:47:47.329960 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe96f666-aaa0-43a1-aaf5-554c7fb711cf tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:47.331375 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe96f666-aaa0-43a1-aaf5-554c7fb711cf tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:47.332207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe96f666-aaa0-43a1-aaf5-554c7fb711cf tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:47.333829 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe96f666-aaa0-43a1-aaf5-554c7fb711cf tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:47.335121 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe96f666-aaa0-43a1-aaf5-554c7fb711cf tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:47.335967 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-fe96f666-aaa0-43a1-aaf5-554c7fb711cf tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:47.341384 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-81650c62-0d6b-4c9a-aaae-8097f75a4a7c req-1d98159a-3f3c-4a7b-a053-69b687e76a56 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:47.342238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-81650c62-0d6b-4c9a-aaae-8097f75a4a7c req-1d98159a-3f3c-4a7b-a053-69b687e76a56 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:47.343203 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-81650c62-0d6b-4c9a-aaae-8097f75a4a7c req-1d98159a-3f3c-4a7b-a053-69b687e76a56 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:47.362499 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-81650c62-0d6b-4c9a-aaae-8097f75a4a7c req-1d98159a-3f3c-4a7b-a053-69b687e76a56 service nova] Creating event network-vif-deleted:cc0a2ac8-bcb4-4526-a617-c38fc1a1ec8f for instance 84312b77-e813-4b36-8d5c-a9a20ad4d918 on n-h1-844626-8 Aug 09 15:47:47.368660 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-81650c62-0d6b-4c9a-aaae-8097f75a4a7c req-1d98159a-3f3c-4a7b-a053-69b687e76a56 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056438 Aug 09 15:47:47.369589 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3665/7340] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:47:47.438478 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-fe96f666-aaa0-43a1-aaf5-554c7fb711cf tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca5b4f643564db09dfb30dd2a691789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '595d222e7a56448d9eaaf060d77c552b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:47:47.453037 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-fe96f666-aaa0-43a1-aaf5-554c7fb711cf tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 200 len: 1504 microversion: 2.1 time: 0.145696 Aug 09 15:47:47.454412 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3676/7341] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:47 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:47:48.478317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8098c769-25b0-4f75-8d90-43ce1b49d75f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:48.479271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8098c769-25b0-4f75-8d90-43ce1b49d75f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] [instance: 84312b77-e813-4b36-8d5c-a9a20ad4d918] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:47:48.487885 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8098c769-25b0-4f75-8d90-43ce1b49d75f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:48.488387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8098c769-25b0-4f75-8d90-43ce1b49d75f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:48.488879 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8098c769-25b0-4f75-8d90-43ce1b49d75f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:48.489623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8098c769-25b0-4f75-8d90-43ce1b49d75f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:47:48.490096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8098c769-25b0-4f75-8d90-43ce1b49d75f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:47:48.490533 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8098c769-25b0-4f75-8d90-43ce1b49d75f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:47:48.507040 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-8098c769-25b0-4f75-8d90-43ce1b49d75f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] HTTP exception thrown: Instance 84312b77-e813-4b36-8d5c-a9a20ad4d918 could not be found. Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8098c769-25b0-4f75-8d90-43ce1b49d75f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Request method failure captured: Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 HTTP/1.1 Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8n-wWj9WpQ7S_u-7y-n71vOR8Au_4UmgBa2wNz6rWCK__f-sxVABSN2zjqecqGC4IKaZVq-WcDEBtWz3KvoZvJhxDJbh8Jb_veqORDioviTgRfM8r8in8FLIT0_af7oefgXyAkdhAOfs_MBfLyn8o866ykWUknSf8OqrmStdHFFUClw Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 595d222e7a56448d9eaaf060d77c552b Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_595d222e7a56448d9eaaf060d77c552b", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/595d222e7a56448d9eaaf060d77c552b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 595d222e7a56448d9eaaf060d77c552b Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-276209286 Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestNetworkAdvancedServerOps-276209286-project Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: 3ca5b4f643564db09dfb30dd2a691789 Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestNetworkAdvancedServerOps-276209286-project Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 84312b77-e813-4b36-8d5c-a9a20ad4d918 could not be found. Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '84312b77-e813-4b36-8d5c-a9a20ad4d918'} Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84312b77-e813-4b36-8d5c-a9a20ad4d918 could not be found. Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84312b77-e813-4b36-8d5c-a9a20ad4d918 could not be found. Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:47:48.508981 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:47:48.517685 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:47:48.517685 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:47:48.517685 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:47:48.517685 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:47:48.517685 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:47:48.517685 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:47:48.517685 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84312b77-e813-4b36-8d5c-a9a20ad4d918 could not be found. Aug 09 15:47:48.517685 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 15:47:48.517685 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8098c769-25b0-4f75-8d90-43ce1b49d75f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Returning 404 to user: Instance 84312b77-e813-4b36-8d5c-a9a20ad4d918 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:47:48.517685 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8098c769-25b0-4f75-8d90-43ce1b49d75f tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918" status: 404 len: 111 microversion: 2.1 time: 0.037355 Aug 09 15:47:48.517685 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3666/7342] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:47:48 2022] GET /compute/v2.1/servers/84312b77-e813-4b36-8d5c-a9a20ad4d918 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:47:53.393406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c847d978-612e-4713-8c83-add6da99c747 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] Calling method '.version_select at 0x7f41dc8b0790>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:47:53.430025 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c847d978-612e-4713-8c83-add6da99c747 tempest-TestNetworkAdvancedServerOps-276209286 tempest-TestNetworkAdvancedServerOps-276209286-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1390018132" status: 202 len: 0 microversion: 2.1 time: 0.044625 Aug 09 15:47:53.431157 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3677/7343] 10.222.0.50 () {58 vars in 1284 bytes} [Tue Aug 9 15:47:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1390018132 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:48:08.606376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:48:08.609043 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:48:08.941292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-437e34ac-0445-4576-9509-3a062a06a12e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Action: 'create', calling method: .version_select at 0x7f41e758a8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1268031132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4pqLZ1tzxw94HtByyemE9GqLmK/PVXenx3FllfscF4JtBGu94lADUz31+J2LxuUhRrNBWGD+DzHO2vXaVyAxL033TqrqNFCzj7uBadFZhoylotG6uklzHOteBS+ZVNNA=="}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:48:08.968420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-437e34ac-0445-4576-9509-3a062a06a12e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Getting quotas for project 4c1bd85d9c174e3aba9196adb76a024e. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:48:08.979749 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-437e34ac-0445-4576-9509-3a062a06a12e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Getting quotas for user 5eb0181a8edb4795a68511d3a66924be and project 4c1bd85d9c174e3aba9196adb76a024e. Resources: {'key_pairs'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:48:09.036263 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-437e34ac-0445-4576-9509-3a062a06a12e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.444442 Aug 09 15:48:09.037412 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3667/7344] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:48:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:48:10.772268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:48:10.775048 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:48:10.785161 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1914026923", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1268031132", "security_groups": [{"name": "tempest-secgroup-smoke-566953751"}], "networks": [{"uuid": "7e215805-0173-48f8-9331-afb6c0a0d9d0"}]}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:48:10.986515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.network.neutron [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] validate_networks() for [('7e215805-0173-48f8-9331-afb6c0a0d9d0', None, None, None, None, None)] {{(pid=119407) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:48:11.518056 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Flavor limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:48:11.518779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Image limits 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:48:11.519705 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Flavor pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:48:11.520429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Image pref 0:0:0 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:48:11.521175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.virt.hardware [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119407) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:48:11.537269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:11.538091 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:11.538847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:11.540195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:11.540968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:11.541709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:11.573098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Getting quotas for project 4c1bd85d9c174e3aba9196adb76a024e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:48:11.580327 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Getting quotas for user 5eb0181a8edb4795a68511d3a66924be and project 4c1bd85d9c174e3aba9196adb76a024e. Resources: {'cores', 'instances', 'ram'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:48:11.595745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Going to run 1 instances... {{(pid=119407) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:48:11.598163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119407) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:48:11.654324 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4f956242-d94c-42fb-93cf-3fd52636ad39 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.885437 Aug 09 15:48:11.654905 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3678/7345] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:48:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:48:11.668245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-da138339-fadd-446b-a73b-95b3d8e222b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:48:11.669095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-da138339-fadd-446b-a73b-95b3d8e222b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:48:11.741768 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-da138339-fadd-446b-a73b-95b3d8e222b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:48:11.754859 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-da138339-fadd-446b-a73b-95b3d8e222b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1247 microversion: 2.1 time: 0.092159 Aug 09 15:48:11.755965 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3668/7346] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:48:11 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1247 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:48:12.782757 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-46e38be2-e32d-459c-a3b6-d7186d5df846 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:48:12.783555 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-46e38be2-e32d-459c-a3b6-d7186d5df846 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:48:12.791980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46e38be2-e32d-459c-a3b6-d7186d5df846 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:12.792505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46e38be2-e32d-459c-a3b6-d7186d5df846 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:12.792968 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46e38be2-e32d-459c-a3b6-d7186d5df846 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:12.793693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46e38be2-e32d-459c-a3b6-d7186d5df846 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:12.794176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46e38be2-e32d-459c-a3b6-d7186d5df846 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:12.794583 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-46e38be2-e32d-459c-a3b6-d7186d5df846 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:12.974428 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-46e38be2-e32d-459c-a3b6-d7186d5df846 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:48:12.989187 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-46e38be2-e32d-459c-a3b6-d7186d5df846 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1299 microversion: 2.1 time: 0.211195 Aug 09 15:48:12.992608 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3679/7347] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:48:12 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:48:14.017046 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d6f2a0d5-5134-4712-a6ff-605ddf27b69d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:48:14.018111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d6f2a0d5-5134-4712-a6ff-605ddf27b69d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:48:14.031068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6f2a0d5-5134-4712-a6ff-605ddf27b69d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:14.031878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6f2a0d5-5134-4712-a6ff-605ddf27b69d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:14.032784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6f2a0d5-5134-4712-a6ff-605ddf27b69d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:14.034341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6f2a0d5-5134-4712-a6ff-605ddf27b69d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:14.035487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6f2a0d5-5134-4712-a6ff-605ddf27b69d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:14.036496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d6f2a0d5-5134-4712-a6ff-605ddf27b69d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:14.312856 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d6f2a0d5-5134-4712-a6ff-605ddf27b69d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:48:14.328321 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d6f2a0d5-5134-4712-a6ff-605ddf27b69d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1372 microversion: 2.1 time: 0.317687 Aug 09 15:48:14.329881 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3669/7348] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:48:14 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1372 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:48:15.374180 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b8a51abf-eebd-4456-844f-375d1171ff09 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:48:15.391377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b8a51abf-eebd-4456-844f-375d1171ff09 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:48:15.422007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8a51abf-eebd-4456-844f-375d1171ff09 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:15.423781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8a51abf-eebd-4456-844f-375d1171ff09 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:15.424988 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8a51abf-eebd-4456-844f-375d1171ff09 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:15.427261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8a51abf-eebd-4456-844f-375d1171ff09 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:15.428665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8a51abf-eebd-4456-844f-375d1171ff09 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:15.430679 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b8a51abf-eebd-4456-844f-375d1171ff09 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:15.513303 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3e5571cf-1156-4060-8d2d-3bd1a765f611 req-4ce1fe62-1d18-4243-8d72-c922bdfff74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a3a7ee-1cb1-4b94-9334-665a6ba35cff", "tag": "1843dab8-c83e-4987-87c9-1d2c4224aced"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:48:15.547858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3e5571cf-1156-4060-8d2d-3bd1a765f611 req-4ce1fe62-1d18-4243-8d72-c922bdfff74b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:15.548692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3e5571cf-1156-4060-8d2d-3bd1a765f611 req-4ce1fe62-1d18-4243-8d72-c922bdfff74b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:15.549675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3e5571cf-1156-4060-8d2d-3bd1a765f611 req-4ce1fe62-1d18-4243-8d72-c922bdfff74b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:15.568397 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3e5571cf-1156-4060-8d2d-3bd1a765f611 req-4ce1fe62-1d18-4243-8d72-c922bdfff74b service nova] Creating event network-changed:1843dab8-c83e-4987-87c9-1d2c4224aced for instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff on n-h1-844626-8 Aug 09 15:48:15.575971 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3e5571cf-1156-4060-8d2d-3bd1a765f611 req-4ce1fe62-1d18-4243-8d72-c922bdfff74b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224630 Aug 09 15:48:15.577552 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3680/7349] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:48:15.814512 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b8a51abf-eebd-4456-844f-375d1171ff09 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:48:15.823820 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b8a51abf-eebd-4456-844f-375d1171ff09 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1372 microversion: 2.1 time: 0.467218 Aug 09 15:48:15.824566 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3670/7350] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:48:15 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1372 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:48:16.851990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b509c308-93b0-4596-9488-7fa1c8ead7b5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:48:16.853037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b509c308-93b0-4596-9488-7fa1c8ead7b5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:48:16.864215 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b509c308-93b0-4596-9488-7fa1c8ead7b5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:16.865072 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b509c308-93b0-4596-9488-7fa1c8ead7b5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:16.865850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b509c308-93b0-4596-9488-7fa1c8ead7b5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:16.867183 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b509c308-93b0-4596-9488-7fa1c8ead7b5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:16.867983 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b509c308-93b0-4596-9488-7fa1c8ead7b5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:16.868806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b509c308-93b0-4596-9488-7fa1c8ead7b5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:17.138694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b509c308-93b0-4596-9488-7fa1c8ead7b5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:48:17.152956 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b509c308-93b0-4596-9488-7fa1c8ead7b5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1372 microversion: 2.1 time: 0.310545 Aug 09 15:48:17.154034 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3681/7351] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:48:16 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1372 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:48:18.174961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4450b5e1-81d1-4bab-b25e-36376628afc1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:48:18.175906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4450b5e1-81d1-4bab-b25e-36376628afc1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:48:18.184983 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4450b5e1-81d1-4bab-b25e-36376628afc1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:18.185508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4450b5e1-81d1-4bab-b25e-36376628afc1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:18.186220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4450b5e1-81d1-4bab-b25e-36376628afc1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:18.186979 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4450b5e1-81d1-4bab-b25e-36376628afc1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:18.187479 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4450b5e1-81d1-4bab-b25e-36376628afc1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:18.187931 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4450b5e1-81d1-4bab-b25e-36376628afc1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:18.355222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4450b5e1-81d1-4bab-b25e-36376628afc1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:48:18.364064 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4450b5e1-81d1-4bab-b25e-36376628afc1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1372 microversion: 2.1 time: 0.193375 Aug 09 15:48:18.364848 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3671/7352] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:48:18 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1372 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:48:19.390902 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a610478-acbb-4e38-90c7-570cc349d0ef tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:48:19.392041 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a610478-acbb-4e38-90c7-570cc349d0ef tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:48:19.404765 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a610478-acbb-4e38-90c7-570cc349d0ef tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:19.405618 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a610478-acbb-4e38-90c7-570cc349d0ef tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:19.406421 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a610478-acbb-4e38-90c7-570cc349d0ef tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:19.407728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a610478-acbb-4e38-90c7-570cc349d0ef tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:19.408551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a610478-acbb-4e38-90c7-570cc349d0ef tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:19.409319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a610478-acbb-4e38-90c7-570cc349d0ef tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:19.591429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a610478-acbb-4e38-90c7-570cc349d0ef tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:48:19.600459 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a610478-acbb-4e38-90c7-570cc349d0ef tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1372 microversion: 2.1 time: 0.216777 Aug 09 15:48:19.601176 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3682/7353] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:48:19 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:48:20.624107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d3b197b4-5bfb-4db9-a7df-04e0bfce3fe9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:48:20.624851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d3b197b4-5bfb-4db9-a7df-04e0bfce3fe9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:48:20.632772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3b197b4-5bfb-4db9-a7df-04e0bfce3fe9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:20.633329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3b197b4-5bfb-4db9-a7df-04e0bfce3fe9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:20.633924 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3b197b4-5bfb-4db9-a7df-04e0bfce3fe9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:20.634710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3b197b4-5bfb-4db9-a7df-04e0bfce3fe9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:20.635368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3b197b4-5bfb-4db9-a7df-04e0bfce3fe9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:20.635821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d3b197b4-5bfb-4db9-a7df-04e0bfce3fe9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:20.822389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d3b197b4-5bfb-4db9-a7df-04e0bfce3fe9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:48:20.837113 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d3b197b4-5bfb-4db9-a7df-04e0bfce3fe9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1372 microversion: 2.1 time: 0.216892 Aug 09 15:48:20.838139 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3672/7354] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:48:20 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:48:21.045104 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-020c9a6a-fb5b-43fe-8feb-d5939f2db9e5 req-60373117-8f90-43b2-a0bf-6c8538ad1de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a3a7ee-1cb1-4b94-9334-665a6ba35cff", "name": "network-vif-plugged", "status": "completed", "tag": "1843dab8-c83e-4987-87c9-1d2c4224aced"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:48:21.056704 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-020c9a6a-fb5b-43fe-8feb-d5939f2db9e5 req-60373117-8f90-43b2-a0bf-6c8538ad1de3 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:21.057176 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-020c9a6a-fb5b-43fe-8feb-d5939f2db9e5 req-60373117-8f90-43b2-a0bf-6c8538ad1de3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:21.057598 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-020c9a6a-fb5b-43fe-8feb-d5939f2db9e5 req-60373117-8f90-43b2-a0bf-6c8538ad1de3 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:21.070383 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-020c9a6a-fb5b-43fe-8feb-d5939f2db9e5 req-60373117-8f90-43b2-a0bf-6c8538ad1de3 service nova] Creating event network-vif-plugged:1843dab8-c83e-4987-87c9-1d2c4224aced for instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff on n-h1-844626-8 Aug 09 15:48:21.076908 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-020c9a6a-fb5b-43fe-8feb-d5939f2db9e5 req-60373117-8f90-43b2-a0bf-6c8538ad1de3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141185 Aug 09 15:48:21.078026 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3683/7355] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:48:21.870907 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e26ae16e-8479-44b8-95b7-84df0f3af91d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:48:21.871665 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e26ae16e-8479-44b8-95b7-84df0f3af91d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:48:21.874531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:48:21.885750 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e26ae16e-8479-44b8-95b7-84df0f3af91d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:21.886274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e26ae16e-8479-44b8-95b7-84df0f3af91d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:21.886722 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e26ae16e-8479-44b8-95b7-84df0f3af91d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:21.887589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e26ae16e-8479-44b8-95b7-84df0f3af91d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:21.887996 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e26ae16e-8479-44b8-95b7-84df0f3af91d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:21.888433 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e26ae16e-8479-44b8-95b7-84df0f3af91d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:22.046667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e26ae16e-8479-44b8-95b7-84df0f3af91d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:48:22.055731 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e26ae16e-8479-44b8-95b7-84df0f3af91d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1372 microversion: 2.1 time: 0.189076 Aug 09 15:48:22.056373 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3673/7356] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:48:21 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:48:23.075414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:48:23.076198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:48:23.082438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36d42733-f213-44f0-9d6f-2d43efb54b9e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:48:23.083199 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36d42733-f213-44f0-9d6f-2d43efb54b9e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:48:23.091524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36d42733-f213-44f0-9d6f-2d43efb54b9e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:23.092017 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36d42733-f213-44f0-9d6f-2d43efb54b9e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:23.092445 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36d42733-f213-44f0-9d6f-2d43efb54b9e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:23.093163 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36d42733-f213-44f0-9d6f-2d43efb54b9e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:23.093609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36d42733-f213-44f0-9d6f-2d43efb54b9e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:23.094027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36d42733-f213-44f0-9d6f-2d43efb54b9e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:23.266268 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-36d42733-f213-44f0-9d6f-2d43efb54b9e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:48:23.275337 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36d42733-f213-44f0-9d6f-2d43efb54b9e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1556 microversion: 2.1 time: 0.200633 Aug 09 15:48:23.275968 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3684/7357] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:48:23 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1556 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:48:23.296218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c2f7e685-4eb2-459e-bc9d-d5844be74a53 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:48:23.296915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c2f7e685-4eb2-459e-bc9d-d5844be74a53 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:48:23.305323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2f7e685-4eb2-459e-bc9d-d5844be74a53 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:23.305832 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2f7e685-4eb2-459e-bc9d-d5844be74a53 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:23.306340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2f7e685-4eb2-459e-bc9d-d5844be74a53 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:23.307112 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2f7e685-4eb2-459e-bc9d-d5844be74a53 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:23.307604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2f7e685-4eb2-459e-bc9d-d5844be74a53 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:23.308049 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c2f7e685-4eb2-459e-bc9d-d5844be74a53 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:23.475253 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c2f7e685-4eb2-459e-bc9d-d5844be74a53 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:48:23.488370 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c2f7e685-4eb2-459e-bc9d-d5844be74a53 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1556 microversion: 2.1 time: 0.196182 Aug 09 15:48:23.489051 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3674/7358] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:48:23 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1556 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:48:25.676997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-62e31cf4-b09d-4c5d-967e-290ee91ac3a2 req-5b08e176-d5a4-4787-893d-ea625c2bad55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a3a7ee-1cb1-4b94-9334-665a6ba35cff", "tag": "1843dab8-c83e-4987-87c9-1d2c4224aced"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:48:25.695795 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-62e31cf4-b09d-4c5d-967e-290ee91ac3a2 req-5b08e176-d5a4-4787-893d-ea625c2bad55 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:48:25.696632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-62e31cf4-b09d-4c5d-967e-290ee91ac3a2 req-5b08e176-d5a4-4787-893d-ea625c2bad55 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:48:25.697645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-62e31cf4-b09d-4c5d-967e-290ee91ac3a2 req-5b08e176-d5a4-4787-893d-ea625c2bad55 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:48:25.719963 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-62e31cf4-b09d-4c5d-967e-290ee91ac3a2 req-5b08e176-d5a4-4787-893d-ea625c2bad55 service nova] Creating event network-changed:1843dab8-c83e-4987-87c9-1d2c4224aced for instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff on n-h1-844626-8 Aug 09 15:48:25.728606 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-62e31cf4-b09d-4c5d-967e-290ee91ac3a2 req-5b08e176-d5a4-4787-893d-ea625c2bad55 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058030 Aug 09 15:48:25.729692 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3685/7359] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:50:19.952115 n-d-844626-8 devstack@n-api.service[119406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb00389d-3bc9-4291-a475-262c81a6a465] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:50:19.953398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:50:19.954333 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=36 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:50:19.960318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2eb65c86-12a1-4ce9-86c0-1059f287a08e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:50:19.961120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2eb65c86-12a1-4ce9-86c0-1059f287a08e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:19.971294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2eb65c86-12a1-4ce9-86c0-1059f287a08e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:19.972028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2eb65c86-12a1-4ce9-86c0-1059f287a08e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:19.972558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2eb65c86-12a1-4ce9-86c0-1059f287a08e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:19.973329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2eb65c86-12a1-4ce9-86c0-1059f287a08e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:19.973928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2eb65c86-12a1-4ce9-86c0-1059f287a08e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:19.974406 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2eb65c86-12a1-4ce9-86c0-1059f287a08e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:20.002932 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-2eb65c86-12a1-4ce9-86c0-1059f287a08e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lazy-loading 'flavor' on Instance uuid 21a3a7ee-1cb1-4b94-9334-665a6ba35cff {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:50:20.238693 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2eb65c86-12a1-4ce9-86c0-1059f287a08e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "POST /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff/action" status: 202 len: 0 microversion: 2.1 time: 0.288298 Aug 09 15:50:20.239740 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3675/7360] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:50:19 2022] POST /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:50:20.248161 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e81a619-36fd-4d2d-bb1a-e0ebabb081c8] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 15:50:20.249879 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96165289-31fc-4874-b2d8-1756550c06bf] AMQP server on 10.222.0.50:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 09 15:50:20.251314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:50:20.252917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=32 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:50:20.260380 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2479cbd6-edda-4a8b-a185-cb8e9eeb15b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:20.261964 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2479cbd6-edda-4a8b-a185-cb8e9eeb15b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:20.277014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2479cbd6-edda-4a8b-a185-cb8e9eeb15b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:20.278281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2479cbd6-edda-4a8b-a185-cb8e9eeb15b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:20.279339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2479cbd6-edda-4a8b-a185-cb8e9eeb15b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:20.280883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2479cbd6-edda-4a8b-a185-cb8e9eeb15b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:20.282059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2479cbd6-edda-4a8b-a185-cb8e9eeb15b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:20.282820 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2479cbd6-edda-4a8b-a185-cb8e9eeb15b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:20.611414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2479cbd6-edda-4a8b-a185-cb8e9eeb15b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:20.625857 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2479cbd6-edda-4a8b-a185-cb8e9eeb15b8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1681 microversion: 2.1 time: 0.379800 Aug 09 15:50:20.627310 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3686/7361] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:20 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1681 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:21.650842 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3adf6ab1-0bb5-4c18-9b3a-36a72aa6fde6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:21.651644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3adf6ab1-0bb5-4c18-9b3a-36a72aa6fde6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:21.660710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3adf6ab1-0bb5-4c18-9b3a-36a72aa6fde6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:21.661260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3adf6ab1-0bb5-4c18-9b3a-36a72aa6fde6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:21.661941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3adf6ab1-0bb5-4c18-9b3a-36a72aa6fde6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:21.662705 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3adf6ab1-0bb5-4c18-9b3a-36a72aa6fde6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:21.663195 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3adf6ab1-0bb5-4c18-9b3a-36a72aa6fde6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:21.663634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3adf6ab1-0bb5-4c18-9b3a-36a72aa6fde6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:21.670068 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb00389d-3bc9-4291-a475-262c81a6a465] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54104. Aug 09 15:50:21.849323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3adf6ab1-0bb5-4c18-9b3a-36a72aa6fde6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:21.864063 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3adf6ab1-0bb5-4c18-9b3a-36a72aa6fde6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1681 microversion: 2.1 time: 0.219247 Aug 09 15:50:21.865140 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3676/7362] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:21 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1681 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:22.903193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6852830c-65ca-4c66-a720-030dc8de6b02 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:22.904277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6852830c-65ca-4c66-a720-030dc8de6b02 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:22.917486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6852830c-65ca-4c66-a720-030dc8de6b02 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:22.918093 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6852830c-65ca-4c66-a720-030dc8de6b02 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:22.918564 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6852830c-65ca-4c66-a720-030dc8de6b02 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:22.919342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6852830c-65ca-4c66-a720-030dc8de6b02 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:22.920488 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6852830c-65ca-4c66-a720-030dc8de6b02 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:22.920933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6852830c-65ca-4c66-a720-030dc8de6b02 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:22.930540 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e81a619-36fd-4d2d-bb1a-e0ebabb081c8] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54108. Aug 09 15:50:22.931343 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [96165289-31fc-4874-b2d8-1756550c06bf] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54110. Aug 09 15:50:23.126189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6852830c-65ca-4c66-a720-030dc8de6b02 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:23.135504 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6852830c-65ca-4c66-a720-030dc8de6b02 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1681 microversion: 2.1 time: 0.239129 Aug 09 15:50:23.136084 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3687/7363] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:22 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:24.159542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-89bd10a1-e8fb-461a-8892-0ec928106804 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:24.160139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-89bd10a1-e8fb-461a-8892-0ec928106804 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:24.167940 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89bd10a1-e8fb-461a-8892-0ec928106804 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:24.168557 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89bd10a1-e8fb-461a-8892-0ec928106804 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:24.169021 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89bd10a1-e8fb-461a-8892-0ec928106804 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:24.170005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89bd10a1-e8fb-461a-8892-0ec928106804 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:24.170339 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89bd10a1-e8fb-461a-8892-0ec928106804 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:24.170883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-89bd10a1-e8fb-461a-8892-0ec928106804 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:24.325848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-89bd10a1-e8fb-461a-8892-0ec928106804 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:24.337660 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-89bd10a1-e8fb-461a-8892-0ec928106804 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1681 microversion: 2.1 time: 0.182154 Aug 09 15:50:24.337660 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3677/7364] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:24 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:25.360580 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-bdb8490b-b1f6-46df-b5c0-338bfe74fec4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:25.361634 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-bdb8490b-b1f6-46df-b5c0-338bfe74fec4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:25.369617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdb8490b-b1f6-46df-b5c0-338bfe74fec4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:25.370297 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdb8490b-b1f6-46df-b5c0-338bfe74fec4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:25.370822 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdb8490b-b1f6-46df-b5c0-338bfe74fec4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:25.371735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdb8490b-b1f6-46df-b5c0-338bfe74fec4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:25.372334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdb8490b-b1f6-46df-b5c0-338bfe74fec4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:25.372872 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-bdb8490b-b1f6-46df-b5c0-338bfe74fec4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:25.549207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-bdb8490b-b1f6-46df-b5c0-338bfe74fec4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:25.558028 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-bdb8490b-b1f6-46df-b5c0-338bfe74fec4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1681 microversion: 2.1 time: 0.202006 Aug 09 15:50:25.558658 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3688/7365] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:25 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:26.582149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-68637d9c-5b0a-4da4-adca-ffc98cc6a6f9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:26.582790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-68637d9c-5b0a-4da4-adca-ffc98cc6a6f9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:26.591238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68637d9c-5b0a-4da4-adca-ffc98cc6a6f9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:26.591748 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68637d9c-5b0a-4da4-adca-ffc98cc6a6f9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:26.592221 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68637d9c-5b0a-4da4-adca-ffc98cc6a6f9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:26.593010 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68637d9c-5b0a-4da4-adca-ffc98cc6a6f9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:26.593535 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68637d9c-5b0a-4da4-adca-ffc98cc6a6f9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:26.594015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-68637d9c-5b0a-4da4-adca-ffc98cc6a6f9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:26.790672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-68637d9c-5b0a-4da4-adca-ffc98cc6a6f9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:26.804973 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-68637d9c-5b0a-4da4-adca-ffc98cc6a6f9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1681 microversion: 2.1 time: 0.226723 Aug 09 15:50:26.805998 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3678/7366] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:26 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1681 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:27.808622 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:50:27.809565 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:50:27.841679 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-935d243d-e575-42a9-abd5-17b2cafbdea8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:27.842432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-935d243d-e575-42a9-abd5-17b2cafbdea8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:27.852917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935d243d-e575-42a9-abd5-17b2cafbdea8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:27.853676 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935d243d-e575-42a9-abd5-17b2cafbdea8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:27.854342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935d243d-e575-42a9-abd5-17b2cafbdea8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:27.855526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935d243d-e575-42a9-abd5-17b2cafbdea8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:27.856235 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935d243d-e575-42a9-abd5-17b2cafbdea8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:27.856896 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-935d243d-e575-42a9-abd5-17b2cafbdea8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:28.024511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-935d243d-e575-42a9-abd5-17b2cafbdea8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:28.042582 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-935d243d-e575-42a9-abd5-17b2cafbdea8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1681 microversion: 2.1 time: 0.204771 Aug 09 15:50:28.043392 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3689/7367] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:27 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:29.066759 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f63515fc-ba0b-4c29-a314-da41b0cedfad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:29.067445 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f63515fc-ba0b-4c29-a314-da41b0cedfad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:29.075072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f63515fc-ba0b-4c29-a314-da41b0cedfad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:29.075633 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f63515fc-ba0b-4c29-a314-da41b0cedfad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:29.076090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f63515fc-ba0b-4c29-a314-da41b0cedfad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:29.076845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f63515fc-ba0b-4c29-a314-da41b0cedfad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:29.077346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f63515fc-ba0b-4c29-a314-da41b0cedfad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:29.077906 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f63515fc-ba0b-4c29-a314-da41b0cedfad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:29.255328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f63515fc-ba0b-4c29-a314-da41b0cedfad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:29.269908 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f63515fc-ba0b-4c29-a314-da41b0cedfad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1681 microversion: 2.1 time: 0.207111 Aug 09 15:50:29.271000 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3679/7368] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:29 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:30.294614 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-54d17175-13bd-4ef0-92fb-a395d8b688d2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:30.295645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-54d17175-13bd-4ef0-92fb-a395d8b688d2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:30.304191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54d17175-13bd-4ef0-92fb-a395d8b688d2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:30.304719 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54d17175-13bd-4ef0-92fb-a395d8b688d2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:30.305141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54d17175-13bd-4ef0-92fb-a395d8b688d2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:30.305945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54d17175-13bd-4ef0-92fb-a395d8b688d2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:30.306401 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54d17175-13bd-4ef0-92fb-a395d8b688d2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:30.306848 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-54d17175-13bd-4ef0-92fb-a395d8b688d2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:30.515493 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-54d17175-13bd-4ef0-92fb-a395d8b688d2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:30.524687 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-54d17175-13bd-4ef0-92fb-a395d8b688d2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1681 microversion: 2.1 time: 0.235003 Aug 09 15:50:30.525275 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3690/7369] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:30 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1681 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:31.550430 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-53134674-f749-49b1-8563-829b447c398e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:31.551560 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-53134674-f749-49b1-8563-829b447c398e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:31.560424 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53134674-f749-49b1-8563-829b447c398e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:31.561102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53134674-f749-49b1-8563-829b447c398e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:31.561730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53134674-f749-49b1-8563-829b447c398e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:31.562674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53134674-f749-49b1-8563-829b447c398e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:31.563320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53134674-f749-49b1-8563-829b447c398e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:31.563878 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-53134674-f749-49b1-8563-829b447c398e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:31.749039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-53134674-f749-49b1-8563-829b447c398e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:31.758319 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-53134674-f749-49b1-8563-829b447c398e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1702 microversion: 2.1 time: 0.214402 Aug 09 15:50:31.758920 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3680/7370] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:31 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1702 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:32.383031 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:50:32.383846 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:50:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:50:32.782030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6a6734d7-cc53-4d62-8869-3b9f2c4bead6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:32.782861 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6a6734d7-cc53-4d62-8869-3b9f2c4bead6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:32.791559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a6734d7-cc53-4d62-8869-3b9f2c4bead6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:32.792058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a6734d7-cc53-4d62-8869-3b9f2c4bead6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:32.792506 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a6734d7-cc53-4d62-8869-3b9f2c4bead6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:32.793228 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a6734d7-cc53-4d62-8869-3b9f2c4bead6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:32.793677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a6734d7-cc53-4d62-8869-3b9f2c4bead6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:32.794074 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6a6734d7-cc53-4d62-8869-3b9f2c4bead6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:32.980304 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6a6734d7-cc53-4d62-8869-3b9f2c4bead6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:32.989932 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6a6734d7-cc53-4d62-8869-3b9f2c4bead6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1702 microversion: 2.1 time: 0.212366 Aug 09 15:50:32.990549 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3691/7371] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:32 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1702 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:34.030397 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e5b70001-02c3-4eff-8d59-9e7fb78b4d77 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:34.035330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e5b70001-02c3-4eff-8d59-9e7fb78b4d77 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:34.056952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5b70001-02c3-4eff-8d59-9e7fb78b4d77 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:34.057795 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5b70001-02c3-4eff-8d59-9e7fb78b4d77 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:34.061372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5b70001-02c3-4eff-8d59-9e7fb78b4d77 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:34.062585 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5b70001-02c3-4eff-8d59-9e7fb78b4d77 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:34.072610 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5b70001-02c3-4eff-8d59-9e7fb78b4d77 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:34.074602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e5b70001-02c3-4eff-8d59-9e7fb78b4d77 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:34.324344 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e5b70001-02c3-4eff-8d59-9e7fb78b4d77 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:34.334637 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e5b70001-02c3-4eff-8d59-9e7fb78b4d77 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1697 microversion: 2.1 time: 0.319149 Aug 09 15:50:34.350530 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3681/7372] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:34 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1697 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:35.380334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-44e4e212-0d35-4477-90a2-9bf5cbda0cf7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:35.382012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-44e4e212-0d35-4477-90a2-9bf5cbda0cf7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:35.412414 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44e4e212-0d35-4477-90a2-9bf5cbda0cf7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:35.419653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44e4e212-0d35-4477-90a2-9bf5cbda0cf7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:35.420935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44e4e212-0d35-4477-90a2-9bf5cbda0cf7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:35.425571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44e4e212-0d35-4477-90a2-9bf5cbda0cf7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:35.427831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44e4e212-0d35-4477-90a2-9bf5cbda0cf7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:35.428280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-44e4e212-0d35-4477-90a2-9bf5cbda0cf7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:35.718413 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-44e4e212-0d35-4477-90a2-9bf5cbda0cf7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:35.746818 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-44e4e212-0d35-4477-90a2-9bf5cbda0cf7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1697 microversion: 2.1 time: 0.390408 Aug 09 15:50:35.750953 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3692/7373] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:35 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1697 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:50:35.820105 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-88811af1-2d73-436f-b5a3-1273ea4e642c req-88b0befd-b65d-4501-8c62-72cf65fc0d95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a3a7ee-1cb1-4b94-9334-665a6ba35cff", "name": "network-vif-plugged", "status": "completed", "tag": "1843dab8-c83e-4987-87c9-1d2c4224aced"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:50:35.844498 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-88811af1-2d73-436f-b5a3-1273ea4e642c req-88b0befd-b65d-4501-8c62-72cf65fc0d95 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:35.845871 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-88811af1-2d73-436f-b5a3-1273ea4e642c req-88b0befd-b65d-4501-8c62-72cf65fc0d95 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:35.846881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-88811af1-2d73-436f-b5a3-1273ea4e642c req-88b0befd-b65d-4501-8c62-72cf65fc0d95 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:35.873055 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-88811af1-2d73-436f-b5a3-1273ea4e642c req-88b0befd-b65d-4501-8c62-72cf65fc0d95 service nova] Creating event network-vif-plugged:1843dab8-c83e-4987-87c9-1d2c4224aced for instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff on n-h1-844626-8 Aug 09 15:50:35.885311 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-88811af1-2d73-436f-b5a3-1273ea4e642c req-88b0befd-b65d-4501-8c62-72cf65fc0d95 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073936 Aug 09 15:50:35.887041 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3682/7374] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:50:36.783387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c09848da-f530-4c32-8d05-758a088f1468 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:36.784286 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c09848da-f530-4c32-8d05-758a088f1468 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:36.793524 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c09848da-f530-4c32-8d05-758a088f1468 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:36.794242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c09848da-f530-4c32-8d05-758a088f1468 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:36.794816 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c09848da-f530-4c32-8d05-758a088f1468 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:36.795982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c09848da-f530-4c32-8d05-758a088f1468 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:36.796694 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c09848da-f530-4c32-8d05-758a088f1468 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:36.797332 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c09848da-f530-4c32-8d05-758a088f1468 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:37.039709 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c09848da-f530-4c32-8d05-758a088f1468 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:37.056397 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c09848da-f530-4c32-8d05-758a088f1468 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1697 microversion: 2.1 time: 0.277139 Aug 09 15:50:37.075118 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3693/7375] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:36 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1697 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:38.101490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3099a563-e6e4-4316-90c7-77b9d528324b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:38.103031 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3099a563-e6e4-4316-90c7-77b9d528324b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:38.111676 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3099a563-e6e4-4316-90c7-77b9d528324b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:38.112470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3099a563-e6e4-4316-90c7-77b9d528324b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:38.113102 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3099a563-e6e4-4316-90c7-77b9d528324b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:38.114072 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3099a563-e6e4-4316-90c7-77b9d528324b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:38.115355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3099a563-e6e4-4316-90c7-77b9d528324b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:38.116070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3099a563-e6e4-4316-90c7-77b9d528324b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:38.374982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3099a563-e6e4-4316-90c7-77b9d528324b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:38.389239 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3099a563-e6e4-4316-90c7-77b9d528324b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1697 microversion: 2.1 time: 0.297625 Aug 09 15:50:38.390299 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3683/7376] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:38 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1697 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:50:39.415132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-14bae784-5d57-44ff-92ed-5e75171125a1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:39.416076 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-14bae784-5d57-44ff-92ed-5e75171125a1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:39.428378 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14bae784-5d57-44ff-92ed-5e75171125a1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:39.429641 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14bae784-5d57-44ff-92ed-5e75171125a1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:39.430339 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14bae784-5d57-44ff-92ed-5e75171125a1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:39.431393 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14bae784-5d57-44ff-92ed-5e75171125a1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:39.432083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14bae784-5d57-44ff-92ed-5e75171125a1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:39.433498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-14bae784-5d57-44ff-92ed-5e75171125a1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:39.647458 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-14bae784-5d57-44ff-92ed-5e75171125a1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:39.662242 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-14bae784-5d57-44ff-92ed-5e75171125a1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1697 microversion: 2.1 time: 0.253191 Aug 09 15:50:39.669916 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3694/7377] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:39 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1697 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:40.702019 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-77141a24-0206-42c8-9aaf-1dbb7f037870 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:40.702875 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-77141a24-0206-42c8-9aaf-1dbb7f037870 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:40.711707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77141a24-0206-42c8-9aaf-1dbb7f037870 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:40.712348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77141a24-0206-42c8-9aaf-1dbb7f037870 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:40.713287 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77141a24-0206-42c8-9aaf-1dbb7f037870 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:40.714491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77141a24-0206-42c8-9aaf-1dbb7f037870 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:40.716126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77141a24-0206-42c8-9aaf-1dbb7f037870 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:40.716893 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-77141a24-0206-42c8-9aaf-1dbb7f037870 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:40.984872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-77141a24-0206-42c8-9aaf-1dbb7f037870 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:41.000914 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-77141a24-0206-42c8-9aaf-1dbb7f037870 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1697 microversion: 2.1 time: 0.303545 Aug 09 15:50:41.002329 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3684/7378] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:40 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1697 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:42.026775 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c0ff0515-75b7-4dc9-a5cf-ce0804dae55a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:42.027554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c0ff0515-75b7-4dc9-a5cf-ce0804dae55a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:42.036330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0ff0515-75b7-4dc9-a5cf-ce0804dae55a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:42.036908 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0ff0515-75b7-4dc9-a5cf-ce0804dae55a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:42.037416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0ff0515-75b7-4dc9-a5cf-ce0804dae55a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:42.038219 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0ff0515-75b7-4dc9-a5cf-ce0804dae55a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:42.038758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0ff0515-75b7-4dc9-a5cf-ce0804dae55a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:42.039270 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c0ff0515-75b7-4dc9-a5cf-ce0804dae55a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:42.236570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c0ff0515-75b7-4dc9-a5cf-ce0804dae55a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:42.249642 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c0ff0515-75b7-4dc9-a5cf-ce0804dae55a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1697 microversion: 2.1 time: 0.227342 Aug 09 15:50:42.250617 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3695/7379] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:42 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1697 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:43.288941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a48092bd-23ea-4477-b338-935952042dfc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:43.291436 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a48092bd-23ea-4477-b338-935952042dfc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:43.306114 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a48092bd-23ea-4477-b338-935952042dfc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:43.307100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a48092bd-23ea-4477-b338-935952042dfc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:43.308017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a48092bd-23ea-4477-b338-935952042dfc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:43.309540 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a48092bd-23ea-4477-b338-935952042dfc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:43.310625 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a48092bd-23ea-4477-b338-935952042dfc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:43.312529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a48092bd-23ea-4477-b338-935952042dfc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:43.533666 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a48092bd-23ea-4477-b338-935952042dfc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:43.548154 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a48092bd-23ea-4477-b338-935952042dfc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1697 microversion: 2.1 time: 0.267998 Aug 09 15:50:43.549699 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3685/7380] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:43 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1697 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:44.572942 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-2459225c-d9be-428d-a965-6d383cc2ce1a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:44.573408 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-2459225c-d9be-428d-a965-6d383cc2ce1a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:44.581545 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2459225c-d9be-428d-a965-6d383cc2ce1a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:44.582068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2459225c-d9be-428d-a965-6d383cc2ce1a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:44.582556 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2459225c-d9be-428d-a965-6d383cc2ce1a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:44.583725 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2459225c-d9be-428d-a965-6d383cc2ce1a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:44.584383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2459225c-d9be-428d-a965-6d383cc2ce1a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:44.584828 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-2459225c-d9be-428d-a965-6d383cc2ce1a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:44.838090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-2459225c-d9be-428d-a965-6d383cc2ce1a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:44.847510 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-2459225c-d9be-428d-a965-6d383cc2ce1a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1679 microversion: 2.1 time: 0.279183 Aug 09 15:50:44.848182 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3696/7381] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:44 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1679 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:45.871516 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9412c38a-9e33-4cce-a08e-bfec1de87675 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:45.872292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9412c38a-9e33-4cce-a08e-bfec1de87675 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:45.880684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9412c38a-9e33-4cce-a08e-bfec1de87675 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:45.881408 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9412c38a-9e33-4cce-a08e-bfec1de87675 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:45.881952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9412c38a-9e33-4cce-a08e-bfec1de87675 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:45.882934 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9412c38a-9e33-4cce-a08e-bfec1de87675 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:45.883545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9412c38a-9e33-4cce-a08e-bfec1de87675 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:45.884022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9412c38a-9e33-4cce-a08e-bfec1de87675 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:46.123576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9412c38a-9e33-4cce-a08e-bfec1de87675 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:46.132059 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9412c38a-9e33-4cce-a08e-bfec1de87675 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1679 microversion: 2.1 time: 0.264583 Aug 09 15:50:46.132819 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3686/7382] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:45 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1679 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:47.154508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-98cd78d2-3a90-42b9-948a-e1e355ddcacb tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:47.155204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-98cd78d2-3a90-42b9-948a-e1e355ddcacb tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:47.163134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98cd78d2-3a90-42b9-948a-e1e355ddcacb tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:47.163711 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98cd78d2-3a90-42b9-948a-e1e355ddcacb tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:47.164312 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98cd78d2-3a90-42b9-948a-e1e355ddcacb tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:47.165134 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98cd78d2-3a90-42b9-948a-e1e355ddcacb tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:47.165683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98cd78d2-3a90-42b9-948a-e1e355ddcacb tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:47.166201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-98cd78d2-3a90-42b9-948a-e1e355ddcacb tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:47.338547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-98cd78d2-3a90-42b9-948a-e1e355ddcacb tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:47.347548 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-98cd78d2-3a90-42b9-948a-e1e355ddcacb tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1622 microversion: 2.1 time: 0.197184 Aug 09 15:50:47.348342 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3697/7383] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:47 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1622 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:47.370536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9202c6f5-7673-4f12-a7ed-a16d7faf1a43 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:50:47.371218 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9202c6f5-7673-4f12-a7ed-a16d7faf1a43 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:47.378882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9202c6f5-7673-4f12-a7ed-a16d7faf1a43 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:47.379473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9202c6f5-7673-4f12-a7ed-a16d7faf1a43 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:47.380005 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9202c6f5-7673-4f12-a7ed-a16d7faf1a43 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:47.380777 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9202c6f5-7673-4f12-a7ed-a16d7faf1a43 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:47.381321 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9202c6f5-7673-4f12-a7ed-a16d7faf1a43 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:47.381873 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9202c6f5-7673-4f12-a7ed-a16d7faf1a43 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:47.515231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9202c6f5-7673-4f12-a7ed-a16d7faf1a43 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119406) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 09 15:50:47.616067 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9202c6f5-7673-4f12-a7ed-a16d7faf1a43 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "POST /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff/action" status: 202 len: 0 microversion: 2.1 time: 0.248973 Aug 09 15:50:47.621498 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3687/7384] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:50:47 2022] POST /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:50:47.643893 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f6e513d3-da04-42a5-b564-d418fc06ecd0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:47.644776 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f6e513d3-da04-42a5-b564-d418fc06ecd0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:47.655424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6e513d3-da04-42a5-b564-d418fc06ecd0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:47.656290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6e513d3-da04-42a5-b564-d418fc06ecd0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:47.657063 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6e513d3-da04-42a5-b564-d418fc06ecd0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:47.657962 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6e513d3-da04-42a5-b564-d418fc06ecd0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:47.658707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6e513d3-da04-42a5-b564-d418fc06ecd0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:47.668262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f6e513d3-da04-42a5-b564-d418fc06ecd0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:47.696930 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ee8b1dad-944e-4544-9852-07c2be5b29ef req-864bbd20-923c-4944-9afd-86e066e9901b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a3a7ee-1cb1-4b94-9334-665a6ba35cff", "name": "network-vif-unplugged", "status": "completed", "tag": "1843dab8-c83e-4987-87c9-1d2c4224aced"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:50:47.726044 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ee8b1dad-944e-4544-9852-07c2be5b29ef req-864bbd20-923c-4944-9afd-86e066e9901b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:47.727290 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ee8b1dad-944e-4544-9852-07c2be5b29ef req-864bbd20-923c-4944-9afd-86e066e9901b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:47.728977 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ee8b1dad-944e-4544-9852-07c2be5b29ef req-864bbd20-923c-4944-9afd-86e066e9901b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:47.765616 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.compute.server_external_events [req-ee8b1dad-944e-4544-9852-07c2be5b29ef req-864bbd20-923c-4944-9afd-86e066e9901b service nova] Unable to find a host for instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff. Dropping event network-vif-unplugged {{(pid=119406) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 15:50:47.767334 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ee8b1dad-944e-4544-9852-07c2be5b29ef req-864bbd20-923c-4944-9afd-86e066e9901b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.080455 Aug 09 15:50:47.769269 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3688/7385] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 84 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 09 15:50:47.915472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f6e513d3-da04-42a5-b564-d418fc06ecd0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:47.925855 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f6e513d3-da04-42a5-b564-d418fc06ecd0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1630 microversion: 2.1 time: 0.302078 Aug 09 15:50:47.926658 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3698/7386] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:47 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1630 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:48.953150 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9c59fa96-3622-436b-aa6d-1a1422ca24a5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:48.954261 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9c59fa96-3622-436b-aa6d-1a1422ca24a5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:48.968514 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c59fa96-3622-436b-aa6d-1a1422ca24a5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:48.969388 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c59fa96-3622-436b-aa6d-1a1422ca24a5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:48.970128 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c59fa96-3622-436b-aa6d-1a1422ca24a5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:48.971486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c59fa96-3622-436b-aa6d-1a1422ca24a5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:48.972120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c59fa96-3622-436b-aa6d-1a1422ca24a5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:48.972746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9c59fa96-3622-436b-aa6d-1a1422ca24a5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:49.162090 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9c59fa96-3622-436b-aa6d-1a1422ca24a5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:49.169292 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:50:49.179256 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9c59fa96-3622-436b-aa6d-1a1422ca24a5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1630 microversion: 2.1 time: 0.231243 Aug 09 15:50:49.180383 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3689/7387] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:48 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1630 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:50.214322 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d2161522-0a43-4d13-a224-0d6efcc75212 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:50.215385 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d2161522-0a43-4d13-a224-0d6efcc75212 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:50.224244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2161522-0a43-4d13-a224-0d6efcc75212 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:50.224754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2161522-0a43-4d13-a224-0d6efcc75212 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:50.225195 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2161522-0a43-4d13-a224-0d6efcc75212 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:50.226204 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2161522-0a43-4d13-a224-0d6efcc75212 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:50.226924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2161522-0a43-4d13-a224-0d6efcc75212 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:50.227627 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d2161522-0a43-4d13-a224-0d6efcc75212 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:50.899152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d2161522-0a43-4d13-a224-0d6efcc75212 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:50.903751 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=83 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:50:50.916687 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d2161522-0a43-4d13-a224-0d6efcc75212 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1688 microversion: 2.1 time: 0.707089 Aug 09 15:50:50.918017 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3699/7388] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:50 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1688 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:51.954992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e839aee7-580b-4750-8470-6f3cc086ec87 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:51.956138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e839aee7-580b-4750-8470-6f3cc086ec87 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:51.962067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:50:51.977222 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e839aee7-580b-4750-8470-6f3cc086ec87 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:51.978181 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e839aee7-580b-4750-8470-6f3cc086ec87 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:51.979014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e839aee7-580b-4750-8470-6f3cc086ec87 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:51.980238 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e839aee7-580b-4750-8470-6f3cc086ec87 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:51.984311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e839aee7-580b-4750-8470-6f3cc086ec87 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:51.984311 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e839aee7-580b-4750-8470-6f3cc086ec87 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:52.247618 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e839aee7-580b-4750-8470-6f3cc086ec87 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:52.263066 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e839aee7-580b-4750-8470-6f3cc086ec87 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1688 microversion: 2.1 time: 0.315066 Aug 09 15:50:52.267879 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3690/7389] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:51 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1688 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:50:53.294954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f625ca9-7d69-4891-a50b-dfdfe639ca37 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:53.297015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f625ca9-7d69-4891-a50b-dfdfe639ca37 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:53.308766 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=29 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:50:53.312563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f625ca9-7d69-4891-a50b-dfdfe639ca37 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:53.313999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f625ca9-7d69-4891-a50b-dfdfe639ca37 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:53.314997 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f625ca9-7d69-4891-a50b-dfdfe639ca37 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:53.316473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f625ca9-7d69-4891-a50b-dfdfe639ca37 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:53.317248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f625ca9-7d69-4891-a50b-dfdfe639ca37 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:53.317969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-6f625ca9-7d69-4891-a50b-dfdfe639ca37 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:53.581612 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6f625ca9-7d69-4891-a50b-dfdfe639ca37 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:53.594900 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f625ca9-7d69-4891-a50b-dfdfe639ca37 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1688 microversion: 2.1 time: 0.307403 Aug 09 15:50:53.595922 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3700/7390] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:53 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1688 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:54.620137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-08516b31-4577-4d27-93d5-879c4264fa9a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:54.620900 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-08516b31-4577-4d27-93d5-879c4264fa9a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:54.630866 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08516b31-4577-4d27-93d5-879c4264fa9a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:54.632001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08516b31-4577-4d27-93d5-879c4264fa9a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:54.632487 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08516b31-4577-4d27-93d5-879c4264fa9a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:54.633270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08516b31-4577-4d27-93d5-879c4264fa9a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:54.633755 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08516b31-4577-4d27-93d5-879c4264fa9a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:54.634199 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-08516b31-4577-4d27-93d5-879c4264fa9a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:54.899602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-08516b31-4577-4d27-93d5-879c4264fa9a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:54.909732 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-08516b31-4577-4d27-93d5-879c4264fa9a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1688 microversion: 2.1 time: 0.293751 Aug 09 15:50:54.910333 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3691/7391] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:54 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1688 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:55.943703 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a159e746-cf97-4486-b538-882999dec232 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:55.944831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a159e746-cf97-4486-b538-882999dec232 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:55.952987 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a159e746-cf97-4486-b538-882999dec232 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:55.953481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a159e746-cf97-4486-b538-882999dec232 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:55.953916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a159e746-cf97-4486-b538-882999dec232 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:55.954653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a159e746-cf97-4486-b538-882999dec232 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:55.955302 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a159e746-cf97-4486-b538-882999dec232 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:55.955817 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a159e746-cf97-4486-b538-882999dec232 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:56.215663 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a159e746-cf97-4486-b538-882999dec232 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:56.230697 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a159e746-cf97-4486-b538-882999dec232 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1688 microversion: 2.1 time: 0.291455 Aug 09 15:50:56.231778 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3701/7392] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:55 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1688 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:57.258876 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-12871a54-1bf8-4b39-8969-1e0ca464130b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:57.260067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-12871a54-1bf8-4b39-8969-1e0ca464130b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:57.276097 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12871a54-1bf8-4b39-8969-1e0ca464130b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:57.277014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12871a54-1bf8-4b39-8969-1e0ca464130b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:57.277776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12871a54-1bf8-4b39-8969-1e0ca464130b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:57.279304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12871a54-1bf8-4b39-8969-1e0ca464130b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:57.280299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12871a54-1bf8-4b39-8969-1e0ca464130b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:57.281145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-12871a54-1bf8-4b39-8969-1e0ca464130b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:57.567486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-12871a54-1bf8-4b39-8969-1e0ca464130b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:57.582606 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-12871a54-1bf8-4b39-8969-1e0ca464130b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1688 microversion: 2.1 time: 0.332215 Aug 09 15:50:57.599672 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3692/7393] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:57 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1688 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:58.617892 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-43fe2f14-9121-4f35-b9f4-ce4046989f60 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:58.618677 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-43fe2f14-9121-4f35-b9f4-ce4046989f60 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:58.627420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43fe2f14-9121-4f35-b9f4-ce4046989f60 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:58.627954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43fe2f14-9121-4f35-b9f4-ce4046989f60 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:58.628604 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43fe2f14-9121-4f35-b9f4-ce4046989f60 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:58.629559 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43fe2f14-9121-4f35-b9f4-ce4046989f60 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:58.630217 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43fe2f14-9121-4f35-b9f4-ce4046989f60 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:58.630749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-43fe2f14-9121-4f35-b9f4-ce4046989f60 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:58.793471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-43fe2f14-9121-4f35-b9f4-ce4046989f60 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:50:58.802610 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-43fe2f14-9121-4f35-b9f4-ce4046989f60 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1688 microversion: 2.1 time: 0.188805 Aug 09 15:50:58.803243 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3702/7394] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:58 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:50:59.824989 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-96974bf1-1d76-4834-be44-88315db5b7d7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:50:59.825922 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-96974bf1-1d76-4834-be44-88315db5b7d7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:50:59.837841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96974bf1-1d76-4834-be44-88315db5b7d7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:59.839283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96974bf1-1d76-4834-be44-88315db5b7d7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:59.840110 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96974bf1-1d76-4834-be44-88315db5b7d7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:50:59.841508 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96974bf1-1d76-4834-be44-88315db5b7d7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:50:59.842355 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96974bf1-1d76-4834-be44-88315db5b7d7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:50:59.843193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-96974bf1-1d76-4834-be44-88315db5b7d7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:51:00.020474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-96974bf1-1d76-4834-be44-88315db5b7d7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:51:00.033133 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-96974bf1-1d76-4834-be44-88315db5b7d7 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1688 microversion: 2.1 time: 0.212394 Aug 09 15:51:00.034386 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3693/7395] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:50:59 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1688 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:51:01.073256 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c83f03f2-31c4-46ad-9f59-c99eac0baada tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:51:01.073924 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c83f03f2-31c4-46ad-9f59-c99eac0baada tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:51:01.081551 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c83f03f2-31c4-46ad-9f59-c99eac0baada tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:51:01.082039 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c83f03f2-31c4-46ad-9f59-c99eac0baada tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:51:01.082470 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c83f03f2-31c4-46ad-9f59-c99eac0baada tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:51:01.083330 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c83f03f2-31c4-46ad-9f59-c99eac0baada tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:51:01.083729 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c83f03f2-31c4-46ad-9f59-c99eac0baada tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:51:01.084233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c83f03f2-31c4-46ad-9f59-c99eac0baada tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:51:01.247511 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c83f03f2-31c4-46ad-9f59-c99eac0baada tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:51:01.256142 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c83f03f2-31c4-46ad-9f59-c99eac0baada tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1688 microversion: 2.1 time: 0.186777 Aug 09 15:51:01.256747 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3703/7396] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:51:01 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:51:02.280528 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3dd34417-879f-40c5-8dfd-d7541f9c672c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:51:02.281341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3dd34417-879f-40c5-8dfd-d7541f9c672c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:51:02.289796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3dd34417-879f-40c5-8dfd-d7541f9c672c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:51:02.290398 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3dd34417-879f-40c5-8dfd-d7541f9c672c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:51:02.290935 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3dd34417-879f-40c5-8dfd-d7541f9c672c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:51:02.291818 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3dd34417-879f-40c5-8dfd-d7541f9c672c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:51:02.292320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3dd34417-879f-40c5-8dfd-d7541f9c672c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:51:02.292844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3dd34417-879f-40c5-8dfd-d7541f9c672c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:51:02.477517 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3dd34417-879f-40c5-8dfd-d7541f9c672c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:51:02.485717 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3dd34417-879f-40c5-8dfd-d7541f9c672c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1688 microversion: 2.1 time: 0.210282 Aug 09 15:51:02.486398 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3694/7397] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:51:02 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1688 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:51:03.511728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05dabb41-74b8-4ec2-843f-c44e6d26278c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:51:03.512496 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05dabb41-74b8-4ec2-843f-c44e6d26278c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:51:03.521309 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05dabb41-74b8-4ec2-843f-c44e6d26278c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:51:03.521794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05dabb41-74b8-4ec2-843f-c44e6d26278c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:51:03.522229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05dabb41-74b8-4ec2-843f-c44e6d26278c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:51:03.522937 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05dabb41-74b8-4ec2-843f-c44e6d26278c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:51:03.523410 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05dabb41-74b8-4ec2-843f-c44e6d26278c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:51:03.523830 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05dabb41-74b8-4ec2-843f-c44e6d26278c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:51:03.694372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05dabb41-74b8-4ec2-843f-c44e6d26278c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:51:03.710644 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05dabb41-74b8-4ec2-843f-c44e6d26278c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1688 microversion: 2.1 time: 0.202970 Aug 09 15:51:03.712965 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3704/7398] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:51:03 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1688 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:51:03.820358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-12e604f7-663f-4a2a-9d52-56dd58c1a233 req-a018eee0-8392-48fb-940d-2ecc865ccc4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a3a7ee-1cb1-4b94-9334-665a6ba35cff", "name": "network-vif-plugged", "status": "completed", "tag": "1843dab8-c83e-4987-87c9-1d2c4224aced"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:51:03.840245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-12e604f7-663f-4a2a-9d52-56dd58c1a233 req-a018eee0-8392-48fb-940d-2ecc865ccc4e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:51:03.841099 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-12e604f7-663f-4a2a-9d52-56dd58c1a233 req-a018eee0-8392-48fb-940d-2ecc865ccc4e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:51:03.841844 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-12e604f7-663f-4a2a-9d52-56dd58c1a233 req-a018eee0-8392-48fb-940d-2ecc865ccc4e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:51:03.865031 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-12e604f7-663f-4a2a-9d52-56dd58c1a233 req-a018eee0-8392-48fb-940d-2ecc865ccc4e service nova] Creating event network-vif-plugged:1843dab8-c83e-4987-87c9-1d2c4224aced for instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff on n-h1-844626-8 Aug 09 15:51:03.878060 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-12e604f7-663f-4a2a-9d52-56dd58c1a233 req-a018eee0-8392-48fb-940d-2ecc865ccc4e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063683 Aug 09 15:51:03.878741 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3695/7399] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:51:04.746442 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-41fbd844-f851-4e6b-9c2f-b2706fe4f1dc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:51:04.747139 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-41fbd844-f851-4e6b-9c2f-b2706fe4f1dc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:51:04.754877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41fbd844-f851-4e6b-9c2f-b2706fe4f1dc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:51:04.755509 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41fbd844-f851-4e6b-9c2f-b2706fe4f1dc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:51:04.756001 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41fbd844-f851-4e6b-9c2f-b2706fe4f1dc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:51:04.756739 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41fbd844-f851-4e6b-9c2f-b2706fe4f1dc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:51:04.757197 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41fbd844-f851-4e6b-9c2f-b2706fe4f1dc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:51:04.757651 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-41fbd844-f851-4e6b-9c2f-b2706fe4f1dc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:51:04.921189 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-41fbd844-f851-4e6b-9c2f-b2706fe4f1dc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:51:04.931196 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-41fbd844-f851-4e6b-9c2f-b2706fe4f1dc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1688 microversion: 2.1 time: 0.188914 Aug 09 15:51:04.931907 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3705/7400] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:51:04 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:51:05.958941 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3442042e-622c-4c96-986a-59b7e4820cb4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:51:05.959792 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3442042e-622c-4c96-986a-59b7e4820cb4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:51:05.967741 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3442042e-622c-4c96-986a-59b7e4820cb4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:51:05.968314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3442042e-622c-4c96-986a-59b7e4820cb4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:51:05.968776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3442042e-622c-4c96-986a-59b7e4820cb4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:51:05.969564 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3442042e-622c-4c96-986a-59b7e4820cb4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:51:05.970138 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3442042e-622c-4c96-986a-59b7e4820cb4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:51:05.970580 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3442042e-622c-4c96-986a-59b7e4820cb4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:51:06.145404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3442042e-622c-4c96-986a-59b7e4820cb4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:51:06.154345 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3442042e-622c-4c96-986a-59b7e4820cb4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1675 microversion: 2.1 time: 0.201778 Aug 09 15:51:06.154994 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3696/7401] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:51:05 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:16.665226 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=11 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:52:16.666064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=37 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:52:16.670903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-28cd3c17-9937-4607-8b3e-c53295135776 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:16.671436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28cd3c17-9937-4607-8b3e-c53295135776 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:16.672243 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=13 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:52:16.673753 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=38 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:52:16.679239 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28cd3c17-9937-4607-8b3e-c53295135776 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:16.679724 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28cd3c17-9937-4607-8b3e-c53295135776 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:16.679929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-17fa07fa-22ed-432c-a0e9-b4ba2f3bb4da req-8b383e04-d6a7-4f3b-bff8-70eedb0f4940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a3a7ee-1cb1-4b94-9334-665a6ba35cff", "tag": "1843dab8-c83e-4987-87c9-1d2c4224aced"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:52:16.680382 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28cd3c17-9937-4607-8b3e-c53295135776 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:16.681111 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28cd3c17-9937-4607-8b3e-c53295135776 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:16.681560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28cd3c17-9937-4607-8b3e-c53295135776 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:16.682254 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-28cd3c17-9937-4607-8b3e-c53295135776 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:16.696952 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-17fa07fa-22ed-432c-a0e9-b4ba2f3bb4da req-8b383e04-d6a7-4f3b-bff8-70eedb0f4940 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:16.697502 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-17fa07fa-22ed-432c-a0e9-b4ba2f3bb4da req-8b383e04-d6a7-4f3b-bff8-70eedb0f4940 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:16.698252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-17fa07fa-22ed-432c-a0e9-b4ba2f3bb4da req-8b383e04-d6a7-4f3b-bff8-70eedb0f4940 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:16.712100 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-17fa07fa-22ed-432c-a0e9-b4ba2f3bb4da req-8b383e04-d6a7-4f3b-bff8-70eedb0f4940 service nova] Creating event network-changed:1843dab8-c83e-4987-87c9-1d2c4224aced for instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff on n-h1-844626-8 Aug 09 15:52:16.719439 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-17fa07fa-22ed-432c-a0e9-b4ba2f3bb4da req-8b383e04-d6a7-4f3b-bff8-70eedb0f4940 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050271 Aug 09 15:52:16.719668 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-28cd3c17-9937-4607-8b3e-c53295135776 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:52:16.720412 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3697/7402] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:52:16.811675 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-28cd3c17-9937-4607-8b3e-c53295135776 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "DELETE /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 204 len: 0 microversion: 2.1 time: 0.148386 Aug 09 15:52:16.815120 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3706/7403] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:52:16 2022] DELETE /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 15:52:16.824520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2255ac20-eba6-4210-835f-231d22f01c2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:16.825266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2255ac20-eba6-4210-835f-231d22f01c2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:16.837395 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2255ac20-eba6-4210-835f-231d22f01c2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:16.838953 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2255ac20-eba6-4210-835f-231d22f01c2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:16.840120 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2255ac20-eba6-4210-835f-231d22f01c2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:16.841420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2255ac20-eba6-4210-835f-231d22f01c2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:16.842271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2255ac20-eba6-4210-835f-231d22f01c2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:16.843060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2255ac20-eba6-4210-835f-231d22f01c2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:17.080095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2255ac20-eba6-4210-835f-231d22f01c2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:17.090235 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2255ac20-eba6-4210-835f-231d22f01c2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1681 microversion: 2.1 time: 0.270172 Aug 09 15:52:17.091133 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3698/7404] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:16 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1681 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:18.114834 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-23408f18-9290-4329-90a5-9857fe250cab tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:18.115665 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-23408f18-9290-4329-90a5-9857fe250cab tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:18.123616 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23408f18-9290-4329-90a5-9857fe250cab tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:18.124107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23408f18-9290-4329-90a5-9857fe250cab tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:18.124537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23408f18-9290-4329-90a5-9857fe250cab tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:18.125314 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23408f18-9290-4329-90a5-9857fe250cab tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:18.125804 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23408f18-9290-4329-90a5-9857fe250cab tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:18.126221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-23408f18-9290-4329-90a5-9857fe250cab tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:18.487855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-23408f18-9290-4329-90a5-9857fe250cab tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:18.499289 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-23408f18-9290-4329-90a5-9857fe250cab tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 200 len: 1681 microversion: 2.1 time: 0.388985 Aug 09 15:52:18.500074 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3707/7405] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:18 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 1681 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:18.825130 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5e82984c-50bc-4a55-a27a-81098d9792c4 req-e2f66008-cb50-427d-8c29-09ceabf20214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a3a7ee-1cb1-4b94-9334-665a6ba35cff", "name": "network-vif-deleted", "tag": "1843dab8-c83e-4987-87c9-1d2c4224aced"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:52:18.838486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5e82984c-50bc-4a55-a27a-81098d9792c4 req-e2f66008-cb50-427d-8c29-09ceabf20214 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:18.839036 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5e82984c-50bc-4a55-a27a-81098d9792c4 req-e2f66008-cb50-427d-8c29-09ceabf20214 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:18.839503 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5e82984c-50bc-4a55-a27a-81098d9792c4 req-e2f66008-cb50-427d-8c29-09ceabf20214 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:18.855132 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5e82984c-50bc-4a55-a27a-81098d9792c4 req-e2f66008-cb50-427d-8c29-09ceabf20214 service nova] Creating event network-vif-deleted:1843dab8-c83e-4987-87c9-1d2c4224aced for instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff on n-h1-844626-8 Aug 09 15:52:18.862188 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5e82984c-50bc-4a55-a27a-81098d9792c4 req-e2f66008-cb50-427d-8c29-09ceabf20214 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040908 Aug 09 15:52:18.862939 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3699/7406] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:52:19.525617 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21653138-3761-471e-a068-a4a8fd323a0d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:19.526253 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-21653138-3761-471e-a068-a4a8fd323a0d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 21a3a7ee-1cb1-4b94-9334-665a6ba35cff] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:19.534934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21653138-3761-471e-a068-a4a8fd323a0d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:19.535416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21653138-3761-471e-a068-a4a8fd323a0d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:19.535885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21653138-3761-471e-a068-a4a8fd323a0d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:19.536670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21653138-3761-471e-a068-a4a8fd323a0d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:19.537325 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21653138-3761-471e-a068-a4a8fd323a0d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:19.537807 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21653138-3761-471e-a068-a4a8fd323a0d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:19.553835 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-21653138-3761-471e-a068-a4a8fd323a0d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] HTTP exception thrown: Instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff could not be found. Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21653138-3761-471e-a068-a4a8fd323a0d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Request method failure captured: Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff HTTP/1.1 Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8oGxhKAXO4KZUfPmS9Fbj-vYLhZ18yrDG5AKc3UcIFnTyteLyZLCwAQJF_tD1gF-HJqC5bErO_NAyx_7kT5v3jV8RBr3vwFbqVy7ZeXqGEzDnnY6lCFD6mZoFoh49zEafy29EGcG3RCbtGvIZk5DxdgflZ6XC7xadktZhADhKys6jIk Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 4c1bd85d9c174e3aba9196adb76a024e Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestShelveInstance-1997281490 Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c1bd85d9c174e3aba9196adb76a024e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c1bd85d9c174e3aba9196adb76a024e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c1bd85d9c174e3aba9196adb76a024e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c1bd85d9c174e3aba9196adb76a024e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestShelveInstance-1997281490 Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 4c1bd85d9c174e3aba9196adb76a024e Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestShelveInstance-1997281490 Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestShelveInstance-1997281490-project Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 5eb0181a8edb4795a68511d3a66924be Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestShelveInstance-1997281490-project Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff could not be found. Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '21a3a7ee-1cb1-4b94-9334-665a6ba35cff'} Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff could not be found. Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff could not be found. Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:52:19.555655 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:52:19.563851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:52:19.563851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:52:19.563851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:52:19.563851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:52:19.563851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:52:19.563851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff could not be found. Aug 09 15:52:19.563851 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:52:19.563851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21653138-3761-471e-a068-a4a8fd323a0d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Returning 404 to user: Instance 21a3a7ee-1cb1-4b94-9334-665a6ba35cff could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:52:19.563851 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-21653138-3761-471e-a068-a4a8fd323a0d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff" status: 404 len: 111 microversion: 2.1 time: 0.036334 Aug 09 15:52:19.563851 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3708/7407] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:19 2022] GET /compute/v2.1/servers/21a3a7ee-1cb1-4b94-9334-665a6ba35cff => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:52:19.759490 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a5acfe00-3ad8-46c5-9a14-69b5be168d48 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '.version_select at 0x7f41dd278e50>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:19.794582 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a5acfe00-3ad8-46c5-9a14-69b5be168d48 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1268031132" status: 202 len: 0 microversion: 2.1 time: 0.039998 Aug 09 15:52:19.795473 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3700/7408] 10.222.0.50 () {58 vars in 1254 bytes} [Tue Aug 9 15:52:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1268031132 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:52:19.818521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-0887e4df-ee1a-42e5-93a7-89bd39689e3c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Action: 'create', calling method: .version_select at 0x7f41dcbdbee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1648631537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBtQnjwCcUkunG6yCguDfZdmZ/IN6ruB6MI1+btZBvjjtRED/uJ5oFwiVbhGLslQURZopHEF6LRPePpZN6wI91AQWReRRCOazZMStm3Ki1NtSxjpgOTnSJvI181wU/MRQ=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:52:19.835905 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0887e4df-ee1a-42e5-93a7-89bd39689e3c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Getting quotas for project 4c1bd85d9c174e3aba9196adb76a024e. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:52:19.842978 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-0887e4df-ee1a-42e5-93a7-89bd39689e3c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Getting quotas for user 5eb0181a8edb4795a68511d3a66924be and project 4c1bd85d9c174e3aba9196adb76a024e. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:52:19.878533 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-0887e4df-ee1a-42e5-93a7-89bd39689e3c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.063858 Aug 09 15:52:19.879726 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3709/7409] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:52:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:52:40.123041 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=10 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:52:40.123919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:52:40.129057 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1168802951", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1648631537", "security_groups": [{"name": "tempest-secgroup-smoke-1290054470"}], "networks": [{"uuid": "7e215805-0173-48f8-9331-afb6c0a0d9d0"}], "block_device_mapping_v2": [{"uuid": "ba79f9e7-3742-43e7-8e1c-2b034e6d56e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:52:40.284986 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] validate_networks() for [('7e215805-0173-48f8-9331-afb6c0a0d9d0', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:52:40.784197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:52:40.784632 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:52:40.785131 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:52:40.785589 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:52:40.786015 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:52:40.796915 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:40.797414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:40.797880 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:40.798645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:40.799189 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:40.799645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:40.819505 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Getting quotas for project 4c1bd85d9c174e3aba9196adb76a024e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:52:40.825883 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Getting quotas for user 5eb0181a8edb4795a68511d3a66924be and project 4c1bd85d9c174e3aba9196adb76a024e. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:52:40.894921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:52:40.898308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ba79f9e7-3742-43e7-8e1c-2b034e6d56e1',volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:52:41.076710 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ab81a1f1-8342-4fe1-a626-0b9e27dbf378 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.955570 Aug 09 15:52:41.084723 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3701/7410] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:52:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:52:41.094341 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-989c1e74-3c05-4558-889d-7a472ab496bf tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:41.095435 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-989c1e74-3c05-4558-889d-7a472ab496bf tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:41.100894 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:52:41.102376 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=4 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:52:41.103340 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:52:41.188774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-989c1e74-3c05-4558-889d-7a472ab496bf tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:41.201432 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-989c1e74-3c05-4558-889d-7a472ab496bf tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1089 microversion: 2.1 time: 0.114389 Aug 09 15:52:41.202418 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3710/7411] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:41 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1089 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:42.232164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-82e0d2a4-a171-410a-b094-15b7ef6822f4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:42.233323 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-82e0d2a4-a171-410a-b094-15b7ef6822f4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:42.242373 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82e0d2a4-a171-410a-b094-15b7ef6822f4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:42.243194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82e0d2a4-a171-410a-b094-15b7ef6822f4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:42.243947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82e0d2a4-a171-410a-b094-15b7ef6822f4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:42.245230 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82e0d2a4-a171-410a-b094-15b7ef6822f4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:42.246034 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82e0d2a4-a171-410a-b094-15b7ef6822f4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:42.246772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-82e0d2a4-a171-410a-b094-15b7ef6822f4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:42.336578 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-82e0d2a4-a171-410a-b094-15b7ef6822f4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:42.353254 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-82e0d2a4-a171-410a-b094-15b7ef6822f4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1195 microversion: 2.1 time: 0.130344 Aug 09 15:52:42.354761 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3702/7412] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:42 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1195 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:43.398603 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7523d539-1406-4191-aa7e-f9299e052b8c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:43.401850 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7523d539-1406-4191-aa7e-f9299e052b8c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:43.422476 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7523d539-1406-4191-aa7e-f9299e052b8c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:43.424173 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7523d539-1406-4191-aa7e-f9299e052b8c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:43.425317 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7523d539-1406-4191-aa7e-f9299e052b8c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:43.426955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7523d539-1406-4191-aa7e-f9299e052b8c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:43.428859 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7523d539-1406-4191-aa7e-f9299e052b8c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:43.430098 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7523d539-1406-4191-aa7e-f9299e052b8c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:43.658655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7523d539-1406-4191-aa7e-f9299e052b8c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:43.675458 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7523d539-1406-4191-aa7e-f9299e052b8c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1273 microversion: 2.1 time: 0.284129 Aug 09 15:52:43.676509 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3711/7413] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:43 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1273 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:44.156707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-8342877a-71ea-4c93-811c-3aa7b1b89742 req-342553f3-0b26-4fea-9d60-b3bfacc7a780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4543c3d0-f36f-4601-b20f-36b2a05f8619", "tag": "886f2ba6-debc-4fdd-bd26-3b3f894fda03"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:52:44.180067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8342877a-71ea-4c93-811c-3aa7b1b89742 req-342553f3-0b26-4fea-9d60-b3bfacc7a780 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:44.182771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8342877a-71ea-4c93-811c-3aa7b1b89742 req-342553f3-0b26-4fea-9d60-b3bfacc7a780 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:44.184127 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-8342877a-71ea-4c93-811c-3aa7b1b89742 req-342553f3-0b26-4fea-9d60-b3bfacc7a780 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:44.210945 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-8342877a-71ea-4c93-811c-3aa7b1b89742 req-342553f3-0b26-4fea-9d60-b3bfacc7a780 service nova] Creating event network-changed:886f2ba6-debc-4fdd-bd26-3b3f894fda03 for instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 on n-h1-844626-8 Aug 09 15:52:44.221655 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-8342877a-71ea-4c93-811c-3aa7b1b89742 req-342553f3-0b26-4fea-9d60-b3bfacc7a780 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074114 Aug 09 15:52:44.222972 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3703/7414] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:52:44.706625 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1359a834-b038-4439-b288-b2778e14301c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:44.708868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1359a834-b038-4439-b288-b2778e14301c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:44.724397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1359a834-b038-4439-b288-b2778e14301c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:44.725285 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1359a834-b038-4439-b288-b2778e14301c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:44.726348 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1359a834-b038-4439-b288-b2778e14301c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:44.727343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1359a834-b038-4439-b288-b2778e14301c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:44.727945 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1359a834-b038-4439-b288-b2778e14301c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:44.728639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1359a834-b038-4439-b288-b2778e14301c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:44.928989 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1359a834-b038-4439-b288-b2778e14301c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:44.939717 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1359a834-b038-4439-b288-b2778e14301c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1273 microversion: 2.1 time: 0.242919 Aug 09 15:52:44.940852 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3712/7415] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:44 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:45.968910 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-50c9b1c5-a8d5-452e-ab4c-e3688b584638 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:45.970107 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-50c9b1c5-a8d5-452e-ab4c-e3688b584638 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:45.980615 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c9b1c5-a8d5-452e-ab4c-e3688b584638 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:45.981137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c9b1c5-a8d5-452e-ab4c-e3688b584638 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:45.981601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c9b1c5-a8d5-452e-ab4c-e3688b584638 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:45.982389 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c9b1c5-a8d5-452e-ab4c-e3688b584638 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:45.982868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c9b1c5-a8d5-452e-ab4c-e3688b584638 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:45.983365 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-50c9b1c5-a8d5-452e-ab4c-e3688b584638 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:46.220739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-50c9b1c5-a8d5-452e-ab4c-e3688b584638 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:46.235098 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-50c9b1c5-a8d5-452e-ab4c-e3688b584638 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1273 microversion: 2.1 time: 0.276377 Aug 09 15:52:46.236196 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3704/7416] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:45 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1273 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:47.270405 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e321f607-5839-401c-a1a2-b1452924721d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:47.271245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e321f607-5839-401c-a1a2-b1452924721d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:47.279432 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e321f607-5839-401c-a1a2-b1452924721d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:47.279925 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e321f607-5839-401c-a1a2-b1452924721d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:47.280354 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e321f607-5839-401c-a1a2-b1452924721d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:47.281146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e321f607-5839-401c-a1a2-b1452924721d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:47.281538 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e321f607-5839-401c-a1a2-b1452924721d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:47.281969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e321f607-5839-401c-a1a2-b1452924721d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:47.441103 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e321f607-5839-401c-a1a2-b1452924721d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:47.450663 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e321f607-5839-401c-a1a2-b1452924721d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1273 microversion: 2.1 time: 0.184444 Aug 09 15:52:47.451313 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3713/7417] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:47 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:48.475077 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f0ed11e1-7f2d-4a66-bc32-de23d672f5c1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:48.476827 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f0ed11e1-7f2d-4a66-bc32-de23d672f5c1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:48.486707 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0ed11e1-7f2d-4a66-bc32-de23d672f5c1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:48.487370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0ed11e1-7f2d-4a66-bc32-de23d672f5c1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:48.487835 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0ed11e1-7f2d-4a66-bc32-de23d672f5c1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:48.488607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0ed11e1-7f2d-4a66-bc32-de23d672f5c1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:48.489080 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0ed11e1-7f2d-4a66-bc32-de23d672f5c1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:48.489521 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f0ed11e1-7f2d-4a66-bc32-de23d672f5c1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:48.743327 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f0ed11e1-7f2d-4a66-bc32-de23d672f5c1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:48.758972 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f0ed11e1-7f2d-4a66-bc32-de23d672f5c1 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1273 microversion: 2.1 time: 0.288710 Aug 09 15:52:48.760248 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3705/7418] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:48 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:49.794279 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c001a581-c85b-4e4a-a847-2d7b06c974ba tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:49.795372 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c001a581-c85b-4e4a-a847-2d7b06c974ba tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:49.803996 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c001a581-c85b-4e4a-a847-2d7b06c974ba tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:49.804497 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c001a581-c85b-4e4a-a847-2d7b06c974ba tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:49.804935 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c001a581-c85b-4e4a-a847-2d7b06c974ba tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:49.805649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c001a581-c85b-4e4a-a847-2d7b06c974ba tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:49.806112 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c001a581-c85b-4e4a-a847-2d7b06c974ba tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:49.806536 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c001a581-c85b-4e4a-a847-2d7b06c974ba tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:49.988589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c001a581-c85b-4e4a-a847-2d7b06c974ba tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:49.999010 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c001a581-c85b-4e4a-a847-2d7b06c974ba tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1261 microversion: 2.1 time: 0.209841 Aug 09 15:52:49.999676 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3714/7419] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:49 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1261 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:51.036100 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f2a9768e-2cb9-4687-8eca-5506d07970aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:51.037250 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f2a9768e-2cb9-4687-8eca-5506d07970aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:51.042235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:52:51.043493 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:52:51.053682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2a9768e-2cb9-4687-8eca-5506d07970aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:51.054604 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2a9768e-2cb9-4687-8eca-5506d07970aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:51.055392 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2a9768e-2cb9-4687-8eca-5506d07970aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:51.056441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2a9768e-2cb9-4687-8eca-5506d07970aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:51.057267 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2a9768e-2cb9-4687-8eca-5506d07970aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:51.058086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f2a9768e-2cb9-4687-8eca-5506d07970aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:51.238911 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f2a9768e-2cb9-4687-8eca-5506d07970aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:51.248797 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f2a9768e-2cb9-4687-8eca-5506d07970aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1261 microversion: 2.1 time: 0.220187 Aug 09 15:52:51.249658 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3706/7420] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:51 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:52.271436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d4a0124a-8f5f-4c31-a884-c96b7eb8f153 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:52.272097 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d4a0124a-8f5f-4c31-a884-c96b7eb8f153 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:52.275073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:52:52.281329 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4a0124a-8f5f-4c31-a884-c96b7eb8f153 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:52.281844 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4a0124a-8f5f-4c31-a884-c96b7eb8f153 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:52.282288 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4a0124a-8f5f-4c31-a884-c96b7eb8f153 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:52.283049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4a0124a-8f5f-4c31-a884-c96b7eb8f153 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:52.283619 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4a0124a-8f5f-4c31-a884-c96b7eb8f153 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:52.283982 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d4a0124a-8f5f-4c31-a884-c96b7eb8f153 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:52.447577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d4a0124a-8f5f-4c31-a884-c96b7eb8f153 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:52.456208 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d4a0124a-8f5f-4c31-a884-c96b7eb8f153 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1261 microversion: 2.1 time: 0.189064 Aug 09 15:52:52.456826 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3715/7421] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:52 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:53.478709 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2e847a1b-3a98-4d83-bc4d-104ca91c3f5c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:53.479410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2e847a1b-3a98-4d83-bc4d-104ca91c3f5c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:53.487115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e847a1b-3a98-4d83-bc4d-104ca91c3f5c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:53.487651 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e847a1b-3a98-4d83-bc4d-104ca91c3f5c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:53.488096 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e847a1b-3a98-4d83-bc4d-104ca91c3f5c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:53.488830 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e847a1b-3a98-4d83-bc4d-104ca91c3f5c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:53.489296 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e847a1b-3a98-4d83-bc4d-104ca91c3f5c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:53.489730 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2e847a1b-3a98-4d83-bc4d-104ca91c3f5c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:53.636825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2e847a1b-3a98-4d83-bc4d-104ca91c3f5c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:53.645434 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2e847a1b-3a98-4d83-bc4d-104ca91c3f5c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1261 microversion: 2.1 time: 0.170904 Aug 09 15:52:53.646043 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3707/7422] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:53 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:54.667541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a56dca94-fe48-454f-8db0-7c9e5819870a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:54.668263 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a56dca94-fe48-454f-8db0-7c9e5819870a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:54.676205 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56dca94-fe48-454f-8db0-7c9e5819870a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:54.676743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56dca94-fe48-454f-8db0-7c9e5819870a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:54.677175 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56dca94-fe48-454f-8db0-7c9e5819870a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:54.678008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56dca94-fe48-454f-8db0-7c9e5819870a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:54.678563 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56dca94-fe48-454f-8db0-7c9e5819870a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:54.678993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a56dca94-fe48-454f-8db0-7c9e5819870a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:54.837265 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a56dca94-fe48-454f-8db0-7c9e5819870a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:54.846524 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a56dca94-fe48-454f-8db0-7c9e5819870a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1261 microversion: 2.1 time: 0.183293 Aug 09 15:52:54.847195 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3716/7423] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:54 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:55.868762 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d828fab2-6fcf-43f3-93cd-34d497a182b6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:55.869387 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d828fab2-6fcf-43f3-93cd-34d497a182b6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:55.877674 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d828fab2-6fcf-43f3-93cd-34d497a182b6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:55.878182 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d828fab2-6fcf-43f3-93cd-34d497a182b6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:55.878631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d828fab2-6fcf-43f3-93cd-34d497a182b6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:55.879410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d828fab2-6fcf-43f3-93cd-34d497a182b6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:55.879913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d828fab2-6fcf-43f3-93cd-34d497a182b6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:55.880391 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d828fab2-6fcf-43f3-93cd-34d497a182b6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:56.056591 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d828fab2-6fcf-43f3-93cd-34d497a182b6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:56.069273 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d828fab2-6fcf-43f3-93cd-34d497a182b6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1261 microversion: 2.1 time: 0.204806 Aug 09 15:52:56.070350 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3708/7424] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:55 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:57.092882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3c14ccc9-50bd-456c-82f5-f2ef4e949aad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:57.093869 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-3c14ccc9-50bd-456c-82f5-f2ef4e949aad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:57.102433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c14ccc9-50bd-456c-82f5-f2ef4e949aad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:57.102986 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c14ccc9-50bd-456c-82f5-f2ef4e949aad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:57.103507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c14ccc9-50bd-456c-82f5-f2ef4e949aad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:57.104249 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c14ccc9-50bd-456c-82f5-f2ef4e949aad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:57.104732 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c14ccc9-50bd-456c-82f5-f2ef4e949aad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:57.105345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-3c14ccc9-50bd-456c-82f5-f2ef4e949aad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:57.297387 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-3c14ccc9-50bd-456c-82f5-f2ef4e949aad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:57.308331 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3c14ccc9-50bd-456c-82f5-f2ef4e949aad tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1261 microversion: 2.1 time: 0.220352 Aug 09 15:52:57.308964 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3717/7425] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:57 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:58.348197 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-52525cd5-e81c-4f12-9797-d5b6db17ae2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:58.349328 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-52525cd5-e81c-4f12-9797-d5b6db17ae2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:58.363374 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52525cd5-e81c-4f12-9797-d5b6db17ae2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:58.364283 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52525cd5-e81c-4f12-9797-d5b6db17ae2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:58.365402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52525cd5-e81c-4f12-9797-d5b6db17ae2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:58.366846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52525cd5-e81c-4f12-9797-d5b6db17ae2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:58.367655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52525cd5-e81c-4f12-9797-d5b6db17ae2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:58.368447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-52525cd5-e81c-4f12-9797-d5b6db17ae2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:58.421494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-3f15e08e-45cf-454c-8a0c-cd688ce7ce0c req-04e1d9d8-82e0-4f14-8561-4655c55cf784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4543c3d0-f36f-4601-b20f-36b2a05f8619", "name": "network-vif-plugged", "status": "completed", "tag": "886f2ba6-debc-4fdd-bd26-3b3f894fda03"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:52:58.444717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3f15e08e-45cf-454c-8a0c-cd688ce7ce0c req-04e1d9d8-82e0-4f14-8561-4655c55cf784 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:58.445529 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3f15e08e-45cf-454c-8a0c-cd688ce7ce0c req-04e1d9d8-82e0-4f14-8561-4655c55cf784 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:58.446334 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-3f15e08e-45cf-454c-8a0c-cd688ce7ce0c req-04e1d9d8-82e0-4f14-8561-4655c55cf784 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:58.468950 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-3f15e08e-45cf-454c-8a0c-cd688ce7ce0c req-04e1d9d8-82e0-4f14-8561-4655c55cf784 service nova] Creating event network-vif-plugged:886f2ba6-debc-4fdd-bd26-3b3f894fda03 for instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 on n-h1-844626-8 Aug 09 15:52:58.479864 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-3f15e08e-45cf-454c-8a0c-cd688ce7ce0c req-04e1d9d8-82e0-4f14-8561-4655c55cf784 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064912 Aug 09 15:52:58.480834 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3718/7426] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:52:58.611728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-52525cd5-e81c-4f12-9797-d5b6db17ae2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:58.624362 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-52525cd5-e81c-4f12-9797-d5b6db17ae2d tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1261 microversion: 2.1 time: 0.285130 Aug 09 15:52:58.625244 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3709/7427] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:58 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1261 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:59.662316 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-39f456bd-6239-489e-8987-b82963068c56 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:59.664900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-39f456bd-6239-489e-8987-b82963068c56 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:59.677768 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39f456bd-6239-489e-8987-b82963068c56 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:59.678661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39f456bd-6239-489e-8987-b82963068c56 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:59.680429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39f456bd-6239-489e-8987-b82963068c56 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:59.681695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39f456bd-6239-489e-8987-b82963068c56 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:59.682486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39f456bd-6239-489e-8987-b82963068c56 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:59.683280 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-39f456bd-6239-489e-8987-b82963068c56 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:59.851903 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-39f456bd-6239-489e-8987-b82963068c56 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:52:59.861037 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-39f456bd-6239-489e-8987-b82963068c56 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1444 microversion: 2.1 time: 0.207324 Aug 09 15:52:59.861686 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3719/7428] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:59 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1444 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:52:59.894951 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a880011f-5361-4318-8788-75558e97de67 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:52:59.895776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a880011f-5361-4318-8788-75558e97de67 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:52:59.904168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a880011f-5361-4318-8788-75558e97de67 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:59.904726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a880011f-5361-4318-8788-75558e97de67 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:59.905216 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a880011f-5361-4318-8788-75558e97de67 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:52:59.906351 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a880011f-5361-4318-8788-75558e97de67 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:52:59.907059 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a880011f-5361-4318-8788-75558e97de67 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:52:59.907609 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a880011f-5361-4318-8788-75558e97de67 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:53:00.096703 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a880011f-5361-4318-8788-75558e97de67 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:53:00.105918 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a880011f-5361-4318-8788-75558e97de67 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1444 microversion: 2.1 time: 0.215000 Aug 09 15:53:00.106540 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3710/7429] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:52:59 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1444 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:53:02.511762 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-13aeee3b-5dd6-4b3e-86d9-3026553f79f2 req-8d24c23b-295d-4889-9435-1e5931f328b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4543c3d0-f36f-4601-b20f-36b2a05f8619", "tag": "886f2ba6-debc-4fdd-bd26-3b3f894fda03"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:53:02.524675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-13aeee3b-5dd6-4b3e-86d9-3026553f79f2 req-8d24c23b-295d-4889-9435-1e5931f328b5 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:53:02.525276 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-13aeee3b-5dd6-4b3e-86d9-3026553f79f2 req-8d24c23b-295d-4889-9435-1e5931f328b5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:53:02.525774 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-13aeee3b-5dd6-4b3e-86d9-3026553f79f2 req-8d24c23b-295d-4889-9435-1e5931f328b5 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:53:02.541676 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-13aeee3b-5dd6-4b3e-86d9-3026553f79f2 req-8d24c23b-295d-4889-9435-1e5931f328b5 service nova] Creating event network-changed:886f2ba6-debc-4fdd-bd26-3b3f894fda03 for instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 on n-h1-844626-8 Aug 09 15:53:02.548821 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-13aeee3b-5dd6-4b3e-86d9-3026553f79f2 req-8d24c23b-295d-4889-9435-1e5931f328b5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112558 Aug 09 15:53:02.549927 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3720/7430] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:53:51.366043 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:53:51.366755 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:53:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:55:00.350547 n-d-844626-8 devstack@n-api.service[119406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2072e827-cf31-416a-97b9-dec37834bdb2] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:55:00.356273 n-d-844626-8 devstack@n-api.service[119406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb00389d-3bc9-4291-a475-262c81a6a465] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:55:00.356867 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:55:00.357677 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=52 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:55:00.417967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3875fc74-b54e-4270-a4e1-79136c0fa5e4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:55:00.418739 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3875fc74-b54e-4270-a4e1-79136c0fa5e4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:00.425947 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3875fc74-b54e-4270-a4e1-79136c0fa5e4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:00.426501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3875fc74-b54e-4270-a4e1-79136c0fa5e4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:00.426936 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3875fc74-b54e-4270-a4e1-79136c0fa5e4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:00.427779 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3875fc74-b54e-4270-a4e1-79136c0fa5e4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:00.428477 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3875fc74-b54e-4270-a4e1-79136c0fa5e4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:00.428921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3875fc74-b54e-4270-a4e1-79136c0fa5e4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:00.457548 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.objects.instance [None req-3875fc74-b54e-4270-a4e1-79136c0fa5e4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lazy-loading 'flavor' on Instance uuid 4543c3d0-f36f-4601-b20f-36b2a05f8619 {{(pid=119406) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 15:55:00.558107 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3875fc74-b54e-4270-a4e1-79136c0fa5e4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "POST /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619/action" status: 202 len: 0 microversion: 2.1 time: 0.209631 Aug 09 15:55:00.558821 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3711/7431] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:55:00 2022] POST /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:55:00.567794 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96165289-31fc-4874-b2d8-1756550c06bf] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 15:55:00.569600 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e81a619-36fd-4d2d-bb1a-e0ebabb081c8] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 15:55:00.570915 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=24 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:55:00.572933 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=52 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:55:00.581600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-71791737-456a-4eb3-86ac-4451c979e059 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:00.582824 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-71791737-456a-4eb3-86ac-4451c979e059 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:00.595685 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71791737-456a-4eb3-86ac-4451c979e059 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:00.596426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71791737-456a-4eb3-86ac-4451c979e059 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:00.597178 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71791737-456a-4eb3-86ac-4451c979e059 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:00.598451 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71791737-456a-4eb3-86ac-4451c979e059 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:00.599570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71791737-456a-4eb3-86ac-4451c979e059 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:00.600342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-71791737-456a-4eb3-86ac-4451c979e059 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:00.790018 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-71791737-456a-4eb3-86ac-4451c979e059 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:00.798604 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-71791737-456a-4eb3-86ac-4451c979e059 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.234037 Aug 09 15:55:00.799278 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3721/7432] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:00 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:01.825386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d76e184f-5e46-40cb-81ce-0e8e2c81dab3 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:01.826125 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d76e184f-5e46-40cb-81ce-0e8e2c81dab3 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:01.842111 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] [2072e827-cf31-416a-97b9-dec37834bdb2] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54640. Aug 09 15:55:01.845471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d76e184f-5e46-40cb-81ce-0e8e2c81dab3 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:01.846375 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d76e184f-5e46-40cb-81ce-0e8e2c81dab3 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:01.847200 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d76e184f-5e46-40cb-81ce-0e8e2c81dab3 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:01.849427 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d76e184f-5e46-40cb-81ce-0e8e2c81dab3 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:01.850257 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d76e184f-5e46-40cb-81ce-0e8e2c81dab3 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:01.851011 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d76e184f-5e46-40cb-81ce-0e8e2c81dab3 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:01.887759 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb00389d-3bc9-4291-a475-262c81a6a465] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54642. Aug 09 15:55:02.039994 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d76e184f-5e46-40cb-81ce-0e8e2c81dab3 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:02.049090 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d76e184f-5e46-40cb-81ce-0e8e2c81dab3 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.231973 Aug 09 15:55:02.049762 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3712/7433] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:01 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:03.072114 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c4746e0d-4287-4e76-a512-39dc00484200 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:03.072977 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c4746e0d-4287-4e76-a512-39dc00484200 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:03.085419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4746e0d-4287-4e76-a512-39dc00484200 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:03.086229 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4746e0d-4287-4e76-a512-39dc00484200 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:03.086847 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4746e0d-4287-4e76-a512-39dc00484200 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:03.087735 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4746e0d-4287-4e76-a512-39dc00484200 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:03.088272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4746e0d-4287-4e76-a512-39dc00484200 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:03.088753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c4746e0d-4287-4e76-a512-39dc00484200 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:03.095910 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e81a619-36fd-4d2d-bb1a-e0ebabb081c8] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54648. Aug 09 15:55:03.100535 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [96165289-31fc-4874-b2d8-1756550c06bf] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 54646. Aug 09 15:55:03.254418 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c4746e0d-4287-4e76-a512-39dc00484200 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:03.264270 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c4746e0d-4287-4e76-a512-39dc00484200 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.196728 Aug 09 15:55:03.264860 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3722/7434] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:03 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:04.286293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9eb5c49b-f427-43c2-9a91-faadde41c7b4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:04.287065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9eb5c49b-f427-43c2-9a91-faadde41c7b4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:04.294775 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9eb5c49b-f427-43c2-9a91-faadde41c7b4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:04.295400 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9eb5c49b-f427-43c2-9a91-faadde41c7b4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:04.295981 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9eb5c49b-f427-43c2-9a91-faadde41c7b4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:04.296801 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9eb5c49b-f427-43c2-9a91-faadde41c7b4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:04.297358 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9eb5c49b-f427-43c2-9a91-faadde41c7b4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:04.297908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9eb5c49b-f427-43c2-9a91-faadde41c7b4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:04.460052 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-9eb5c49b-f427-43c2-9a91-faadde41c7b4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:04.468925 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9eb5c49b-f427-43c2-9a91-faadde41c7b4 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.186556 Aug 09 15:55:04.469551 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3713/7435] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:04 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:05.510645 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-4821ee50-9d88-4762-a5cd-1c5b1c557370 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:05.511821 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-4821ee50-9d88-4762-a5cd-1c5b1c557370 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:05.523129 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4821ee50-9d88-4762-a5cd-1c5b1c557370 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:05.523835 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4821ee50-9d88-4762-a5cd-1c5b1c557370 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:05.524412 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4821ee50-9d88-4762-a5cd-1c5b1c557370 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:05.525425 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4821ee50-9d88-4762-a5cd-1c5b1c557370 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:05.527313 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4821ee50-9d88-4762-a5cd-1c5b1c557370 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:05.528068 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-4821ee50-9d88-4762-a5cd-1c5b1c557370 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:05.741969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-4821ee50-9d88-4762-a5cd-1c5b1c557370 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:05.752839 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-4821ee50-9d88-4762-a5cd-1c5b1c557370 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.249790 Aug 09 15:55:05.753610 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3723/7436] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:05 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:06.781334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bc7036da-ed84-40f3-a8b0-594c1465a01b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:06.782014 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bc7036da-ed84-40f3-a8b0-594c1465a01b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:06.790761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc7036da-ed84-40f3-a8b0-594c1465a01b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:06.791386 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc7036da-ed84-40f3-a8b0-594c1465a01b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:06.791890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc7036da-ed84-40f3-a8b0-594c1465a01b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:06.792727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc7036da-ed84-40f3-a8b0-594c1465a01b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:06.793256 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc7036da-ed84-40f3-a8b0-594c1465a01b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:06.793733 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bc7036da-ed84-40f3-a8b0-594c1465a01b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:06.964805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bc7036da-ed84-40f3-a8b0-594c1465a01b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:06.974012 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bc7036da-ed84-40f3-a8b0-594c1465a01b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.196677 Aug 09 15:55:06.974621 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3714/7437] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:06 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:07.996721 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-9312ab5c-cf61-40c5-8d30-094634e3c60e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:07.997731 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-9312ab5c-cf61-40c5-8d30-094634e3c60e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:08.006575 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9312ab5c-cf61-40c5-8d30-094634e3c60e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:08.007075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9312ab5c-cf61-40c5-8d30-094634e3c60e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:08.007560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9312ab5c-cf61-40c5-8d30-094634e3c60e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:08.008311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9312ab5c-cf61-40c5-8d30-094634e3c60e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:08.008780 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9312ab5c-cf61-40c5-8d30-094634e3c60e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:08.009201 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-9312ab5c-cf61-40c5-8d30-094634e3c60e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:08.194870 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-9312ab5c-cf61-40c5-8d30-094634e3c60e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:08.203641 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-9312ab5c-cf61-40c5-8d30-094634e3c60e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.211246 Aug 09 15:55:08.204246 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3724/7438] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:07 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:09.226543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e862b094-8ca6-4744-a80d-7c2594248a3a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:09.227420 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e862b094-8ca6-4744-a80d-7c2594248a3a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:09.235402 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e862b094-8ca6-4744-a80d-7c2594248a3a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:09.235908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e862b094-8ca6-4744-a80d-7c2594248a3a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:09.236334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e862b094-8ca6-4744-a80d-7c2594248a3a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:09.237076 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e862b094-8ca6-4744-a80d-7c2594248a3a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:09.237543 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e862b094-8ca6-4744-a80d-7c2594248a3a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:09.237968 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e862b094-8ca6-4744-a80d-7c2594248a3a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:09.392696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e862b094-8ca6-4744-a80d-7c2594248a3a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:09.403179 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e862b094-8ca6-4744-a80d-7c2594248a3a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.179695 Aug 09 15:55:09.403942 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3715/7439] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:09 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:10.426324 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-49f21d51-4268-4bb1-b00d-31d70e2159e6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:10.427257 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-49f21d51-4268-4bb1-b00d-31d70e2159e6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:10.440008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49f21d51-4268-4bb1-b00d-31d70e2159e6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:10.440955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49f21d51-4268-4bb1-b00d-31d70e2159e6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:10.441600 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49f21d51-4268-4bb1-b00d-31d70e2159e6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:10.442879 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49f21d51-4268-4bb1-b00d-31d70e2159e6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:10.443716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49f21d51-4268-4bb1-b00d-31d70e2159e6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:10.444505 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-49f21d51-4268-4bb1-b00d-31d70e2159e6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:10.610717 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-49f21d51-4268-4bb1-b00d-31d70e2159e6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:10.620314 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-49f21d51-4268-4bb1-b00d-31d70e2159e6 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.197869 Aug 09 15:55:10.621255 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3725/7440] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:10 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:11.645874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-a641caff-5c2a-41a1-8815-95a8c63e8730 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:11.646544 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-a641caff-5c2a-41a1-8815-95a8c63e8730 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:11.655022 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a641caff-5c2a-41a1-8815-95a8c63e8730 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:11.655576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a641caff-5c2a-41a1-8815-95a8c63e8730 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:11.656058 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a641caff-5c2a-41a1-8815-95a8c63e8730 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:11.656805 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a641caff-5c2a-41a1-8815-95a8c63e8730 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:11.657275 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a641caff-5c2a-41a1-8815-95a8c63e8730 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:11.657732 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-a641caff-5c2a-41a1-8815-95a8c63e8730 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:11.857809 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-a641caff-5c2a-41a1-8815-95a8c63e8730 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:11.866878 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-a641caff-5c2a-41a1-8815-95a8c63e8730 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.225447 Aug 09 15:55:11.867498 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3716/7441] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:11 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:12.891626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-ba212c04-58bb-4ba8-b920-3ffa9d59a3aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:12.892615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-ba212c04-58bb-4ba8-b920-3ffa9d59a3aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:12.901475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba212c04-58bb-4ba8-b920-3ffa9d59a3aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:12.902194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba212c04-58bb-4ba8-b920-3ffa9d59a3aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:12.902756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba212c04-58bb-4ba8-b920-3ffa9d59a3aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:12.903660 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba212c04-58bb-4ba8-b920-3ffa9d59a3aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:12.904384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba212c04-58bb-4ba8-b920-3ffa9d59a3aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:12.904917 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-ba212c04-58bb-4ba8-b920-3ffa9d59a3aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:13.111292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-ba212c04-58bb-4ba8-b920-3ffa9d59a3aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:13.119800 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-ba212c04-58bb-4ba8-b920-3ffa9d59a3aa tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.232970 Aug 09 15:55:13.120609 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3726/7442] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:12 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:14.143111 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6becba1b-b988-4e8a-b53b-1a2f98092e1b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:14.144240 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6becba1b-b988-4e8a-b53b-1a2f98092e1b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:14.154075 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6becba1b-b988-4e8a-b53b-1a2f98092e1b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:14.154747 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6becba1b-b988-4e8a-b53b-1a2f98092e1b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:14.155319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6becba1b-b988-4e8a-b53b-1a2f98092e1b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:14.156469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6becba1b-b988-4e8a-b53b-1a2f98092e1b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:14.157325 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6becba1b-b988-4e8a-b53b-1a2f98092e1b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:14.158088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6becba1b-b988-4e8a-b53b-1a2f98092e1b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:14.349740 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6becba1b-b988-4e8a-b53b-1a2f98092e1b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:14.359226 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6becba1b-b988-4e8a-b53b-1a2f98092e1b tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.221022 Aug 09 15:55:14.359940 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3717/7443] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:14 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:15.391863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f98bcc05-3683-4959-bc41-f531109f7263 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:15.392498 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f98bcc05-3683-4959-bc41-f531109f7263 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:15.399999 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f98bcc05-3683-4959-bc41-f531109f7263 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:15.400526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f98bcc05-3683-4959-bc41-f531109f7263 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:15.400955 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f98bcc05-3683-4959-bc41-f531109f7263 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:15.401670 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f98bcc05-3683-4959-bc41-f531109f7263 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:15.402242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f98bcc05-3683-4959-bc41-f531109f7263 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:15.402661 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f98bcc05-3683-4959-bc41-f531109f7263 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:15.588969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f98bcc05-3683-4959-bc41-f531109f7263 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:15.602018 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f98bcc05-3683-4959-bc41-f531109f7263 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1570 microversion: 2.1 time: 0.214447 Aug 09 15:55:15.602951 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3727/7444] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:15 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1570 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:15.627896 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d93cfd0a-da68-4b5f-a8ed-9ee8a6e6e1ce tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:55:15.628672 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d93cfd0a-da68-4b5f-a8ed-9ee8a6e6e1ce tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:15.636414 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d93cfd0a-da68-4b5f-a8ed-9ee8a6e6e1ce tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:15.636917 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d93cfd0a-da68-4b5f-a8ed-9ee8a6e6e1ce tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:15.637368 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d93cfd0a-da68-4b5f-a8ed-9ee8a6e6e1ce tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:15.638152 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d93cfd0a-da68-4b5f-a8ed-9ee8a6e6e1ce tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:15.638623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d93cfd0a-da68-4b5f-a8ed-9ee8a6e6e1ce tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:15.639068 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d93cfd0a-da68-4b5f-a8ed-9ee8a6e6e1ce tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:15.677295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d93cfd0a-da68-4b5f-a8ed-9ee8a6e6e1ce tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=119406) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 09 15:55:15.760873 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d93cfd0a-da68-4b5f-a8ed-9ee8a6e6e1ce tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "POST /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619/action" status: 202 len: 0 microversion: 2.1 time: 0.136563 Aug 09 15:55:15.762315 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3718/7445] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:55:15 2022] POST /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 15:55:15.772852 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-cceb4397-6e85-4c15-a4f5-e46ecedd4b7e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:15.773471 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-cceb4397-6e85-4c15-a4f5-e46ecedd4b7e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:15.781759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cceb4397-6e85-4c15-a4f5-e46ecedd4b7e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:15.781759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cceb4397-6e85-4c15-a4f5-e46ecedd4b7e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:15.781759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cceb4397-6e85-4c15-a4f5-e46ecedd4b7e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:15.782394 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cceb4397-6e85-4c15-a4f5-e46ecedd4b7e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:15.782537 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cceb4397-6e85-4c15-a4f5-e46ecedd4b7e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:15.783191 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-cceb4397-6e85-4c15-a4f5-e46ecedd4b7e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:16.008931 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-cceb4397-6e85-4c15-a4f5-e46ecedd4b7e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:16.024339 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-cceb4397-6e85-4c15-a4f5-e46ecedd4b7e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1518 microversion: 2.1 time: 0.255140 Aug 09 15:55:16.025385 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3728/7446] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:15 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1518 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:55:17.062384 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-d9586e93-ae18-430b-8d65-65ef4ebdd31c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:17.063848 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e81a0c8f-30f7-4956-92d5-baafa34ebe2b req-9adc28ad-6401-4d5a-9c12-b04ee023b9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4543c3d0-f36f-4601-b20f-36b2a05f8619", "name": "network-vif-unplugged", "status": "completed", "tag": "886f2ba6-debc-4fdd-bd26-3b3f894fda03"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:55:17.064392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-d9586e93-ae18-430b-8d65-65ef4ebdd31c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:17.072396 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9586e93-ae18-430b-8d65-65ef4ebdd31c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:17.073507 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9586e93-ae18-430b-8d65-65ef4ebdd31c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:17.074225 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9586e93-ae18-430b-8d65-65ef4ebdd31c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:17.075420 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9586e93-ae18-430b-8d65-65ef4ebdd31c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:17.076177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9586e93-ae18-430b-8d65-65ef4ebdd31c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:17.076918 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-d9586e93-ae18-430b-8d65-65ef4ebdd31c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:17.087330 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e81a0c8f-30f7-4956-92d5-baafa34ebe2b req-9adc28ad-6401-4d5a-9c12-b04ee023b9ac service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:17.088291 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e81a0c8f-30f7-4956-92d5-baafa34ebe2b req-9adc28ad-6401-4d5a-9c12-b04ee023b9ac service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:17.089185 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e81a0c8f-30f7-4956-92d5-baafa34ebe2b req-9adc28ad-6401-4d5a-9c12-b04ee023b9ac service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:17.114794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.compute.server_external_events [req-e81a0c8f-30f7-4956-92d5-baafa34ebe2b req-9adc28ad-6401-4d5a-9c12-b04ee023b9ac service nova] Unable to find a host for instance 4543c3d0-f36f-4601-b20f-36b2a05f8619. Dropping event network-vif-unplugged {{(pid=119406) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 15:55:17.117644 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e81a0c8f-30f7-4956-92d5-baafa34ebe2b req-9adc28ad-6401-4d5a-9c12-b04ee023b9ac service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.146916 Aug 09 15:55:17.119060 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3719/7447] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 149 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 09 15:55:17.250067 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-d9586e93-ae18-430b-8d65-65ef4ebdd31c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:17.266413 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-d9586e93-ae18-430b-8d65-65ef4ebdd31c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1520 microversion: 2.1 time: 0.210358 Aug 09 15:55:17.267937 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3729/7448] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:17 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:55:18.298009 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8b5e6549-9fe6-46cc-84c9-75ecf52ea950 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:18.299069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8b5e6549-9fe6-46cc-84c9-75ecf52ea950 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:18.309831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b5e6549-9fe6-46cc-84c9-75ecf52ea950 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:18.310584 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b5e6549-9fe6-46cc-84c9-75ecf52ea950 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:18.311198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b5e6549-9fe6-46cc-84c9-75ecf52ea950 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:18.312228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b5e6549-9fe6-46cc-84c9-75ecf52ea950 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:18.312701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b5e6549-9fe6-46cc-84c9-75ecf52ea950 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:18.313215 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8b5e6549-9fe6-46cc-84c9-75ecf52ea950 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:18.502101 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-8b5e6549-9fe6-46cc-84c9-75ecf52ea950 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:18.514803 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8b5e6549-9fe6-46cc-84c9-75ecf52ea950 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1520 microversion: 2.1 time: 0.221919 Aug 09 15:55:18.516022 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3720/7449] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:18 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:55:19.549926 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-7b6cc73e-191f-4090-82b1-f1c0bdf3b860 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:19.550648 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-7b6cc73e-191f-4090-82b1-f1c0bdf3b860 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:19.559436 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b6cc73e-191f-4090-82b1-f1c0bdf3b860 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:19.559950 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b6cc73e-191f-4090-82b1-f1c0bdf3b860 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:19.560397 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b6cc73e-191f-4090-82b1-f1c0bdf3b860 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:19.561429 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b6cc73e-191f-4090-82b1-f1c0bdf3b860 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:19.561891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b6cc73e-191f-4090-82b1-f1c0bdf3b860 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:19.562319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-7b6cc73e-191f-4090-82b1-f1c0bdf3b860 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:19.765127 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-7b6cc73e-191f-4090-82b1-f1c0bdf3b860 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:19.775590 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-7b6cc73e-191f-4090-82b1-f1c0bdf3b860 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1520 microversion: 2.1 time: 0.229525 Aug 09 15:55:19.787129 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3730/7450] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:19 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:20.817874 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-aeba2526-67b6-482a-a718-ba9ca42070e5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:20.819069 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-aeba2526-67b6-482a-a718-ba9ca42070e5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:20.832790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeba2526-67b6-482a-a718-ba9ca42070e5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:20.833790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeba2526-67b6-482a-a718-ba9ca42070e5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:20.834634 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeba2526-67b6-482a-a718-ba9ca42070e5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:20.835995 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeba2526-67b6-482a-a718-ba9ca42070e5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:20.836877 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeba2526-67b6-482a-a718-ba9ca42070e5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:20.837662 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-aeba2526-67b6-482a-a718-ba9ca42070e5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:21.048081 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-aeba2526-67b6-482a-a718-ba9ca42070e5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:21.063284 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-aeba2526-67b6-482a-a718-ba9ca42070e5 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1520 microversion: 2.1 time: 0.252945 Aug 09 15:55:21.064385 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3721/7451] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:20 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:22.102077 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-81a09ce0-f1d2-47cd-a3f6-d62129760cfd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:22.103181 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-81a09ce0-f1d2-47cd-a3f6-d62129760cfd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:22.114695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81a09ce0-f1d2-47cd-a3f6-d62129760cfd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:22.115359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81a09ce0-f1d2-47cd-a3f6-d62129760cfd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:22.116042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81a09ce0-f1d2-47cd-a3f6-d62129760cfd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:22.117136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81a09ce0-f1d2-47cd-a3f6-d62129760cfd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:22.117690 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81a09ce0-f1d2-47cd-a3f6-d62129760cfd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:22.118207 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-81a09ce0-f1d2-47cd-a3f6-d62129760cfd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:22.381609 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-81a09ce0-f1d2-47cd-a3f6-d62129760cfd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:22.395602 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-81a09ce0-f1d2-47cd-a3f6-d62129760cfd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1520 microversion: 2.1 time: 0.299645 Aug 09 15:55:22.396663 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3731/7452] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:22 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:23.430636 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-72637e84-eae9-4774-842d-908674a61482 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:23.431499 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-72637e84-eae9-4774-842d-908674a61482 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:23.439890 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72637e84-eae9-4774-842d-908674a61482 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:23.440501 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72637e84-eae9-4774-842d-908674a61482 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:23.441029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72637e84-eae9-4774-842d-908674a61482 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:23.441794 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72637e84-eae9-4774-842d-908674a61482 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:23.442278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72637e84-eae9-4774-842d-908674a61482 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:23.442726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-72637e84-eae9-4774-842d-908674a61482 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:23.632405 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-72637e84-eae9-4774-842d-908674a61482 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:23.643394 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-72637e84-eae9-4774-842d-908674a61482 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1576 microversion: 2.1 time: 0.216770 Aug 09 15:55:23.644347 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3722/7453] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:23 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:23.656916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-c0a5fd28-a6ee-48a1-9244-c13932ac1c48 req-974a5860-82a3-45ca-9ca2-9124a3717a70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4543c3d0-f36f-4601-b20f-36b2a05f8619", "tag": "886f2ba6-debc-4fdd-bd26-3b3f894fda03"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:55:23.671718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c0a5fd28-a6ee-48a1-9244-c13932ac1c48 req-974a5860-82a3-45ca-9ca2-9124a3717a70 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:23.672716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c0a5fd28-a6ee-48a1-9244-c13932ac1c48 req-974a5860-82a3-45ca-9ca2-9124a3717a70 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:23.673359 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-c0a5fd28-a6ee-48a1-9244-c13932ac1c48 req-974a5860-82a3-45ca-9ca2-9124a3717a70 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:23.688039 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-c0a5fd28-a6ee-48a1-9244-c13932ac1c48 req-974a5860-82a3-45ca-9ca2-9124a3717a70 service nova] Creating event network-changed:886f2ba6-debc-4fdd-bd26-3b3f894fda03 for instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 on n-h2-844626-8 Aug 09 15:55:23.695989 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-c0a5fd28-a6ee-48a1-9244-c13932ac1c48 req-974a5860-82a3-45ca-9ca2-9124a3717a70 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042627 Aug 09 15:55:23.697483 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3732/7454] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 15:55:24.682317 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17b1dc8b-e8c0-4579-8510-c647ae646edd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:24.683070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17b1dc8b-e8c0-4579-8510-c647ae646edd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:24.691154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17b1dc8b-e8c0-4579-8510-c647ae646edd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:24.691654 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17b1dc8b-e8c0-4579-8510-c647ae646edd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:24.692149 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17b1dc8b-e8c0-4579-8510-c647ae646edd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:24.692882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17b1dc8b-e8c0-4579-8510-c647ae646edd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:24.693601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17b1dc8b-e8c0-4579-8510-c647ae646edd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:24.694056 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17b1dc8b-e8c0-4579-8510-c647ae646edd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:24.859441 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-17b1dc8b-e8c0-4579-8510-c647ae646edd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:24.877553 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17b1dc8b-e8c0-4579-8510-c647ae646edd tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1576 microversion: 2.1 time: 0.198818 Aug 09 15:55:24.878706 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3723/7455] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:24 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:25.909227 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-22c6ca27-f4a7-4e27-b5ab-aec0d7b2064c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:25.909958 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-22c6ca27-f4a7-4e27-b5ab-aec0d7b2064c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:25.918159 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22c6ca27-f4a7-4e27-b5ab-aec0d7b2064c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:25.918649 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22c6ca27-f4a7-4e27-b5ab-aec0d7b2064c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:25.919187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22c6ca27-f4a7-4e27-b5ab-aec0d7b2064c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:25.919831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22c6ca27-f4a7-4e27-b5ab-aec0d7b2064c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:25.920290 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22c6ca27-f4a7-4e27-b5ab-aec0d7b2064c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:25.920710 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-22c6ca27-f4a7-4e27-b5ab-aec0d7b2064c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:26.084007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-22c6ca27-f4a7-4e27-b5ab-aec0d7b2064c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:26.093319 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-22c6ca27-f4a7-4e27-b5ab-aec0d7b2064c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1576 microversion: 2.1 time: 0.189567 Aug 09 15:55:26.093963 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3733/7456] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:25 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:27.117089 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f566930c-2ff9-4eb9-849e-9c4854d048de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:27.117781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f566930c-2ff9-4eb9-849e-9c4854d048de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:27.126277 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f566930c-2ff9-4eb9-849e-9c4854d048de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:27.126790 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f566930c-2ff9-4eb9-849e-9c4854d048de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:27.127260 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f566930c-2ff9-4eb9-849e-9c4854d048de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:27.127982 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f566930c-2ff9-4eb9-849e-9c4854d048de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:27.128426 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f566930c-2ff9-4eb9-849e-9c4854d048de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:27.128872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f566930c-2ff9-4eb9-849e-9c4854d048de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:27.287864 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f566930c-2ff9-4eb9-849e-9c4854d048de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:27.297411 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f566930c-2ff9-4eb9-849e-9c4854d048de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1576 microversion: 2.1 time: 0.184378 Aug 09 15:55:27.298267 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3724/7457] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:27 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:27.716374 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:55:27.716620 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 15:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:55:28.321716 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f5ba7ea5-993f-4869-8f83-94698da0cde0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:28.322613 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f5ba7ea5-993f-4869-8f83-94698da0cde0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:28.330858 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5ba7ea5-993f-4869-8f83-94698da0cde0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:28.331533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5ba7ea5-993f-4869-8f83-94698da0cde0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:28.332133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5ba7ea5-993f-4869-8f83-94698da0cde0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:28.332954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5ba7ea5-993f-4869-8f83-94698da0cde0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:28.333501 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5ba7ea5-993f-4869-8f83-94698da0cde0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:28.334015 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f5ba7ea5-993f-4869-8f83-94698da0cde0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:28.490281 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-f5ba7ea5-993f-4869-8f83-94698da0cde0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:28.498518 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f5ba7ea5-993f-4869-8f83-94698da0cde0 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1576 microversion: 2.1 time: 0.181833 Aug 09 15:55:28.499141 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3734/7458] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:28 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1576 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:29.521000 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-3c193cb6-0f03-404b-9942-8376a7dd2a4e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:29.521620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-3c193cb6-0f03-404b-9942-8376a7dd2a4e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:29.529647 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c193cb6-0f03-404b-9942-8376a7dd2a4e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:29.530231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c193cb6-0f03-404b-9942-8376a7dd2a4e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:29.530745 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c193cb6-0f03-404b-9942-8376a7dd2a4e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:29.531522 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c193cb6-0f03-404b-9942-8376a7dd2a4e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:29.531985 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c193cb6-0f03-404b-9942-8376a7dd2a4e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:29.532530 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-3c193cb6-0f03-404b-9942-8376a7dd2a4e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:29.538324 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:55:29.727853 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-3c193cb6-0f03-404b-9942-8376a7dd2a4e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:29.737063 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-3c193cb6-0f03-404b-9942-8376a7dd2a4e tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1576 microversion: 2.1 time: 0.220223 Aug 09 15:55:29.737650 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3725/7459] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:29 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:30.772794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1405ea8f-a756-4e18-adb0-18a91d17378c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:30.773456 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1405ea8f-a756-4e18-adb0-18a91d17378c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:30.776459 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=29 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:55:30.782655 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1405ea8f-a756-4e18-adb0-18a91d17378c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:30.783260 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1405ea8f-a756-4e18-adb0-18a91d17378c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:30.783831 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1405ea8f-a756-4e18-adb0-18a91d17378c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:30.784494 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1405ea8f-a756-4e18-adb0-18a91d17378c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:30.785036 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1405ea8f-a756-4e18-adb0-18a91d17378c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:30.785526 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1405ea8f-a756-4e18-adb0-18a91d17378c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:30.788868 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=81 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:55:30.950343 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1405ea8f-a756-4e18-adb0-18a91d17378c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:30.959362 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1405ea8f-a756-4e18-adb0-18a91d17378c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1576 microversion: 2.1 time: 0.190856 Aug 09 15:55:30.959959 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3735/7460] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:30 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:31.986095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-d382ba99-0d0d-4e80-ac36-1974b69a3f7f tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:31.987270 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-d382ba99-0d0d-4e80-ac36-1974b69a3f7f tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:31.991264 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:55:32.001718 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d382ba99-0d0d-4e80-ac36-1974b69a3f7f tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:32.002583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d382ba99-0d0d-4e80-ac36-1974b69a3f7f tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:32.003443 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d382ba99-0d0d-4e80-ac36-1974b69a3f7f tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:32.004655 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d382ba99-0d0d-4e80-ac36-1974b69a3f7f tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:32.005460 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d382ba99-0d0d-4e80-ac36-1974b69a3f7f tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:32.006274 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-d382ba99-0d0d-4e80-ac36-1974b69a3f7f tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:32.174024 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-d382ba99-0d0d-4e80-ac36-1974b69a3f7f tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:32.182790 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-d382ba99-0d0d-4e80-ac36-1974b69a3f7f tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1576 microversion: 2.1 time: 0.204100 Aug 09 15:55:32.183429 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3726/7461] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:31 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:32.396869 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:55:32.396869 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:55:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:55:33.205059 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-20c11484-72b6-42fe-92cd-eb5b61191f59 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:33.205570 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-20c11484-72b6-42fe-92cd-eb5b61191f59 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:33.212248 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20c11484-72b6-42fe-92cd-eb5b61191f59 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:33.212753 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20c11484-72b6-42fe-92cd-eb5b61191f59 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:33.213154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20c11484-72b6-42fe-92cd-eb5b61191f59 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:33.213856 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20c11484-72b6-42fe-92cd-eb5b61191f59 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:33.214292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20c11484-72b6-42fe-92cd-eb5b61191f59 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:33.214819 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-20c11484-72b6-42fe-92cd-eb5b61191f59 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:33.366152 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-20c11484-72b6-42fe-92cd-eb5b61191f59 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:33.375053 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-20c11484-72b6-42fe-92cd-eb5b61191f59 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1576 microversion: 2.1 time: 0.174152 Aug 09 15:55:33.375696 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3736/7462] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:33 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:34.397728 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f8e26122-b25a-44b0-9a06-8652d838f267 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:34.398382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f8e26122-b25a-44b0-9a06-8652d838f267 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:34.406576 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8e26122-b25a-44b0-9a06-8652d838f267 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:34.407109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8e26122-b25a-44b0-9a06-8652d838f267 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:34.407581 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8e26122-b25a-44b0-9a06-8652d838f267 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:34.408320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8e26122-b25a-44b0-9a06-8652d838f267 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:34.408763 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8e26122-b25a-44b0-9a06-8652d838f267 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:34.409228 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f8e26122-b25a-44b0-9a06-8652d838f267 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:34.602726 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f8e26122-b25a-44b0-9a06-8652d838f267 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:34.617612 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f8e26122-b25a-44b0-9a06-8652d838f267 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1576 microversion: 2.1 time: 0.223493 Aug 09 15:55:34.618638 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3727/7463] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:34 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1576 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:55:35.058540 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-cca960e8-daf4-4c5b-9ffc-e99f4fc4b21d req-2860f483-2582-482b-b769-5f00fa07a48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4543c3d0-f36f-4601-b20f-36b2a05f8619", "name": "network-vif-plugged", "status": "completed", "tag": "886f2ba6-debc-4fdd-bd26-3b3f894fda03"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:55:35.080806 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-cca960e8-daf4-4c5b-9ffc-e99f4fc4b21d req-2860f483-2582-482b-b769-5f00fa07a48c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:35.081586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-cca960e8-daf4-4c5b-9ffc-e99f4fc4b21d req-2860f483-2582-482b-b769-5f00fa07a48c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:35.082632 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-cca960e8-daf4-4c5b-9ffc-e99f4fc4b21d req-2860f483-2582-482b-b769-5f00fa07a48c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:35.106029 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-cca960e8-daf4-4c5b-9ffc-e99f4fc4b21d req-2860f483-2582-482b-b769-5f00fa07a48c service nova] Creating event network-vif-plugged:886f2ba6-debc-4fdd-bd26-3b3f894fda03 for instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 on n-h2-844626-8 Aug 09 15:55:35.115312 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-cca960e8-daf4-4c5b-9ffc-e99f4fc4b21d req-2860f483-2582-482b-b769-5f00fa07a48c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064639 Aug 09 15:55:35.116799 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3737/7464] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:55:35.642601 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-4d43bc63-e3d1-45e4-a855-c492ab3826b2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:35.643607 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-4d43bc63-e3d1-45e4-a855-c492ab3826b2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:35.654305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d43bc63-e3d1-45e4-a855-c492ab3826b2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:35.654902 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d43bc63-e3d1-45e4-a855-c492ab3826b2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:35.655724 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d43bc63-e3d1-45e4-a855-c492ab3826b2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:35.656849 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d43bc63-e3d1-45e4-a855-c492ab3826b2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:35.657710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d43bc63-e3d1-45e4-a855-c492ab3826b2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:35.658346 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-4d43bc63-e3d1-45e4-a855-c492ab3826b2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:35.822305 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-4d43bc63-e3d1-45e4-a855-c492ab3826b2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:35.831335 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-4d43bc63-e3d1-45e4-a855-c492ab3826b2 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1576 microversion: 2.1 time: 0.193585 Aug 09 15:55:35.831959 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3728/7465] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:35 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:55:36.855825 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a8b86f4e-8dd4-4ed8-9719-c545c840d6d8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:55:36.856523 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a8b86f4e-8dd4-4ed8-9719-c545c840d6d8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:55:36.864136 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b86f4e-8dd4-4ed8-9719-c545c840d6d8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:36.864620 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b86f4e-8dd4-4ed8-9719-c545c840d6d8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:36.865050 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b86f4e-8dd4-4ed8-9719-c545c840d6d8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:36.865761 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b86f4e-8dd4-4ed8-9719-c545c840d6d8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:55:36.866216 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b86f4e-8dd4-4ed8-9719-c545c840d6d8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:55:36.866635 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a8b86f4e-8dd4-4ed8-9719-c545c840d6d8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:55:37.051027 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a8b86f4e-8dd4-4ed8-9719-c545c840d6d8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:55:37.059972 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a8b86f4e-8dd4-4ed8-9719-c545c840d6d8 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1563 microversion: 2.1 time: 0.210165 Aug 09 15:55:37.060667 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3738/7466] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:55:36 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1563 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:56:58.068210 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=5 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:56:58.070359 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=22 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:56:58.073769 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=7 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:56:58.075812 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=19 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:56:58.078966 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b9662674-0c1d-48af-b340-5ba98a0b111a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:56:58.079938 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b9662674-0c1d-48af-b340-5ba98a0b111a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:56:58.092785 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9662674-0c1d-48af-b340-5ba98a0b111a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:56:58.093686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9662674-0c1d-48af-b340-5ba98a0b111a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:56:58.094497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9662674-0c1d-48af-b340-5ba98a0b111a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:56:58.095861 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9662674-0c1d-48af-b340-5ba98a0b111a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:56:58.096738 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9662674-0c1d-48af-b340-5ba98a0b111a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:56:58.098171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b9662674-0c1d-48af-b340-5ba98a0b111a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:56:58.150529 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b9662674-0c1d-48af-b340-5ba98a0b111a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 15:56:58.167587 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-9770a5e8-8605-4cc8-977f-4c1f261768f8 req-becad4c8-a325-451c-9785-16bfbf82397d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4543c3d0-f36f-4601-b20f-36b2a05f8619", "tag": "886f2ba6-debc-4fdd-bd26-3b3f894fda03"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:56:58.178020 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9770a5e8-8605-4cc8-977f-4c1f261768f8 req-becad4c8-a325-451c-9785-16bfbf82397d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:56:58.178591 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9770a5e8-8605-4cc8-977f-4c1f261768f8 req-becad4c8-a325-451c-9785-16bfbf82397d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:56:58.179116 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-9770a5e8-8605-4cc8-977f-4c1f261768f8 req-becad4c8-a325-451c-9785-16bfbf82397d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:56:58.191720 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-9770a5e8-8605-4cc8-977f-4c1f261768f8 req-becad4c8-a325-451c-9785-16bfbf82397d service nova] Creating event network-changed:886f2ba6-debc-4fdd-bd26-3b3f894fda03 for instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 on n-h2-844626-8 Aug 09 15:56:58.197866 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-9770a5e8-8605-4cc8-977f-4c1f261768f8 req-becad4c8-a325-451c-9785-16bfbf82397d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127651 Aug 09 15:56:58.198992 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3739/7467] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:56:58.295989 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b9662674-0c1d-48af-b340-5ba98a0b111a tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "DELETE /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 204 len: 0 microversion: 2.1 time: 0.230855 Aug 09 15:56:58.297298 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3729/7468] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 15:56:58 2022] DELETE /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 15:56:58.309033 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dbaf6e63-c359-42be-99cd-fec1ad7fcafc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:56:58.311154 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dbaf6e63-c359-42be-99cd-fec1ad7fcafc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:56:58.318475 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbaf6e63-c359-42be-99cd-fec1ad7fcafc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:56:58.318990 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbaf6e63-c359-42be-99cd-fec1ad7fcafc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:56:58.319464 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbaf6e63-c359-42be-99cd-fec1ad7fcafc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:56:58.320238 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbaf6e63-c359-42be-99cd-fec1ad7fcafc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:56:58.320693 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbaf6e63-c359-42be-99cd-fec1ad7fcafc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:56:58.321123 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dbaf6e63-c359-42be-99cd-fec1ad7fcafc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:56:58.489155 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dbaf6e63-c359-42be-99cd-fec1ad7fcafc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:56:58.504766 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dbaf6e63-c359-42be-99cd-fec1ad7fcafc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.200649 Aug 09 15:56:58.505954 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3740/7469] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:56:58 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:56:59.541251 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-2bc0b0f2-f09a-474b-ba32-3ddbab1d1dff tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:56:59.542025 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-2bc0b0f2-f09a-474b-ba32-3ddbab1d1dff tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:56:59.549784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2bc0b0f2-f09a-474b-ba32-3ddbab1d1dff tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:56:59.550318 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2bc0b0f2-f09a-474b-ba32-3ddbab1d1dff tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:56:59.550791 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2bc0b0f2-f09a-474b-ba32-3ddbab1d1dff tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:56:59.551623 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2bc0b0f2-f09a-474b-ba32-3ddbab1d1dff tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:56:59.552117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2bc0b0f2-f09a-474b-ba32-3ddbab1d1dff tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:56:59.552549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-2bc0b0f2-f09a-474b-ba32-3ddbab1d1dff tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:56:59.801053 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-2bc0b0f2-f09a-474b-ba32-3ddbab1d1dff tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:56:59.815435 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-2bc0b0f2-f09a-474b-ba32-3ddbab1d1dff tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1569 microversion: 2.1 time: 0.278245 Aug 09 15:56:59.816495 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3730/7470] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:56:59 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1569 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:00.633167 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-43526187-ff95-4229-8483-c6376be0791a req-a10754a8-565b-4b0a-898e-5cf998bf0f89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4543c3d0-f36f-4601-b20f-36b2a05f8619", "name": "network-vif-deleted", "tag": "886f2ba6-debc-4fdd-bd26-3b3f894fda03"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:57:00.654897 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-43526187-ff95-4229-8483-c6376be0791a req-a10754a8-565b-4b0a-898e-5cf998bf0f89 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:00.656146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-43526187-ff95-4229-8483-c6376be0791a req-a10754a8-565b-4b0a-898e-5cf998bf0f89 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:00.657042 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-43526187-ff95-4229-8483-c6376be0791a req-a10754a8-565b-4b0a-898e-5cf998bf0f89 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:00.683524 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-43526187-ff95-4229-8483-c6376be0791a req-a10754a8-565b-4b0a-898e-5cf998bf0f89 service nova] Creating event network-vif-deleted:886f2ba6-debc-4fdd-bd26-3b3f894fda03 for instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 on n-h2-844626-8 Aug 09 15:57:00.690676 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-43526187-ff95-4229-8483-c6376be0791a req-a10754a8-565b-4b0a-898e-5cf998bf0f89 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065557 Aug 09 15:57:00.691490 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3741/7471] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:57:00.853164 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-6e22dd5c-ae60-4274-8a9c-77df1fbd1356 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:00.854074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-6e22dd5c-ae60-4274-8a9c-77df1fbd1356 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:00.863356 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e22dd5c-ae60-4274-8a9c-77df1fbd1356 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:00.863851 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e22dd5c-ae60-4274-8a9c-77df1fbd1356 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:00.864463 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e22dd5c-ae60-4274-8a9c-77df1fbd1356 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:00.865314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e22dd5c-ae60-4274-8a9c-77df1fbd1356 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:00.865824 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e22dd5c-ae60-4274-8a9c-77df1fbd1356 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:00.866382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-6e22dd5c-ae60-4274-8a9c-77df1fbd1356 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:00.995713 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-6e22dd5c-ae60-4274-8a9c-77df1fbd1356 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:01.007862 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-6e22dd5c-ae60-4274-8a9c-77df1fbd1356 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1220 microversion: 2.1 time: 0.158955 Aug 09 15:57:01.008754 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3731/7472] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:00 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1220 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:57:02.034430 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-05ba07a1-30a4-4d5f-b01c-1fdd74fbaed9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:02.035292 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-05ba07a1-30a4-4d5f-b01c-1fdd74fbaed9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:02.043921 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05ba07a1-30a4-4d5f-b01c-1fdd74fbaed9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:02.044697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05ba07a1-30a4-4d5f-b01c-1fdd74fbaed9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:02.045243 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05ba07a1-30a4-4d5f-b01c-1fdd74fbaed9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:02.046087 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05ba07a1-30a4-4d5f-b01c-1fdd74fbaed9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:02.046643 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05ba07a1-30a4-4d5f-b01c-1fdd74fbaed9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:02.047244 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-05ba07a1-30a4-4d5f-b01c-1fdd74fbaed9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:02.138351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-05ba07a1-30a4-4d5f-b01c-1fdd74fbaed9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:02.148357 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-05ba07a1-30a4-4d5f-b01c-1fdd74fbaed9 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1220 microversion: 2.1 time: 0.121701 Aug 09 15:57:02.149141 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3742/7473] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:02 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1220 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:03.183304 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-356f3982-ec05-4686-9235-eca070b14646 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:03.183865 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-356f3982-ec05-4686-9235-eca070b14646 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:03.191314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-356f3982-ec05-4686-9235-eca070b14646 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:03.191821 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-356f3982-ec05-4686-9235-eca070b14646 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:03.192263 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-356f3982-ec05-4686-9235-eca070b14646 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:03.192992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-356f3982-ec05-4686-9235-eca070b14646 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:03.193467 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-356f3982-ec05-4686-9235-eca070b14646 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:03.193887 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-356f3982-ec05-4686-9235-eca070b14646 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:03.267254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-356f3982-ec05-4686-9235-eca070b14646 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:03.276567 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-356f3982-ec05-4686-9235-eca070b14646 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1220 microversion: 2.1 time: 0.098289 Aug 09 15:57:03.277235 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3732/7474] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:03 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:57:04.299891 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-36cd82cb-faf7-464a-8370-1ee4aa62b4de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:04.300695 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-36cd82cb-faf7-464a-8370-1ee4aa62b4de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:04.307417 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36cd82cb-faf7-464a-8370-1ee4aa62b4de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:04.307907 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36cd82cb-faf7-464a-8370-1ee4aa62b4de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:04.308337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36cd82cb-faf7-464a-8370-1ee4aa62b4de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:04.309057 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36cd82cb-faf7-464a-8370-1ee4aa62b4de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:04.309504 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36cd82cb-faf7-464a-8370-1ee4aa62b4de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:04.309940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-36cd82cb-faf7-464a-8370-1ee4aa62b4de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:04.391758 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-36cd82cb-faf7-464a-8370-1ee4aa62b4de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:04.400793 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-36cd82cb-faf7-464a-8370-1ee4aa62b4de tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1220 microversion: 2.1 time: 0.105244 Aug 09 15:57:04.401413 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3743/7475] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:04 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:05.437908 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-56207843-83ee-4cfa-a741-b0fe6f606bdc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:05.438642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-56207843-83ee-4cfa-a741-b0fe6f606bdc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:05.447376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56207843-83ee-4cfa-a741-b0fe6f606bdc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:05.447956 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56207843-83ee-4cfa-a741-b0fe6f606bdc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:05.448471 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56207843-83ee-4cfa-a741-b0fe6f606bdc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:05.449329 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56207843-83ee-4cfa-a741-b0fe6f606bdc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:05.449846 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56207843-83ee-4cfa-a741-b0fe6f606bdc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:05.450470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-56207843-83ee-4cfa-a741-b0fe6f606bdc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:05.530173 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-56207843-83ee-4cfa-a741-b0fe6f606bdc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5eb0181a8edb4795a68511d3a66924be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c1bd85d9c174e3aba9196adb76a024e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:05.544740 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-56207843-83ee-4cfa-a741-b0fe6f606bdc tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 200 len: 1220 microversion: 2.1 time: 0.114809 Aug 09 15:57:05.545624 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3733/7476] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:05 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:06.568331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f86b1be0-2266-4d5a-bf33-24e83de5819c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:06.569198 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-f86b1be0-2266-4d5a-bf33-24e83de5819c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] [instance: 4543c3d0-f36f-4601-b20f-36b2a05f8619] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:06.578064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f86b1be0-2266-4d5a-bf33-24e83de5819c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:06.578557 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f86b1be0-2266-4d5a-bf33-24e83de5819c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:06.578993 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f86b1be0-2266-4d5a-bf33-24e83de5819c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:06.579749 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f86b1be0-2266-4d5a-bf33-24e83de5819c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:06.580264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f86b1be0-2266-4d5a-bf33-24e83de5819c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:06.580697 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-f86b1be0-2266-4d5a-bf33-24e83de5819c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:06.599274 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.wsgi [None req-f86b1be0-2266-4d5a-bf33-24e83de5819c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] HTTP exception thrown: Instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 could not be found. Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f86b1be0-2266-4d5a-bf33-24e83de5819c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Request method failure captured: Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: request: GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 HTTP/1.1 Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: Accept: application/json Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: Accept-Encoding: identity Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: Connection: close Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: Content-Length: 0 Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: Content-Type: application/json Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: Host: 10.222.0.50 Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: Openstack-System-Scope: None Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: User-Agent: python-urllib3/1.26.11 Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Auth-Token: gAAAAABi8oGxhKAXO4KZUfPmS9Fbj-vYLhZ18yrDG5AKc3UcIFnTyteLyZLCwAQJF_tD1gF-HJqC5bErO_NAyx_7kT5v3jV8RBr3vwFbqVy7ZeXqGEzDnnY6lCFD6mZoFoh49zEafy29EGcG3RCbtGvIZk5DxdgflZ6XC7xadktZhADhKys6jIk Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Id: None Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Domain-Name: None Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Identity-Status: Confirmed Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Is-Admin-Project: True Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Id: default Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Domain-Name: Default Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Id: 4c1bd85d9c174e3aba9196adb76a024e Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Project-Name: tempest-TestShelveInstance-1997281490 Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Role: reader,member Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Roles: reader,member Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_4c1bd85d9c174e3aba9196adb76a024e", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/4c1bd85d9c174e3aba9196adb76a024e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c1bd85d9c174e3aba9196adb76a024e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/4c1bd85d9c174e3aba9196adb76a024e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant: tempest-TestShelveInstance-1997281490 Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Id: 4c1bd85d9c174e3aba9196adb76a024e Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-Tenant-Name: tempest-TestShelveInstance-1997281490 Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-User: tempest-TestShelveInstance-1997281490-project Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Id: default Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-User-Domain-Name: Default Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-User-Id: 5eb0181a8edb4795a68511d3a66924be Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: X-User-Name: tempest-TestShelveInstance-1997281490-project Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: method: > Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: exception: Instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 could not be found. Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: action_args: {'id': '4543c3d0-f36f-4601-b20f-36b2a05f8619'} Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 could not be found. Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 could not be found. Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 15:57:06.601530 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:57:06.610133 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 15:57:06.610133 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 15:57:06.610133 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 15:57:06.610133 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 15:57:06.610133 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 15:57:06.610133 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 could not be found. Aug 09 15:57:06.610133 n-d-844626-8 devstack@n-api.service[119407]: ERROR nova.api.openstack.wsgi Aug 09 15:57:06.610133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-f86b1be0-2266-4d5a-bf33-24e83de5819c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Returning 404 to user: Instance 4543c3d0-f36f-4601-b20f-36b2a05f8619 could not be found. {{(pid=119407) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 15:57:06.610133 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-f86b1be0-2266-4d5a-bf33-24e83de5819c tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619" status: 404 len: 111 microversion: 2.1 time: 0.039376 Aug 09 15:57:06.610133 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3744/7477] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:06 2022] GET /compute/v2.1/servers/4543c3d0-f36f-4601-b20f-36b2a05f8619 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 15:57:06.920153 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-41aadbca-1ba5-4633-bc31-208aecae9126 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] Calling method '.version_select at 0x7f41ddf50160>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:06.980775 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-41aadbca-1ba5-4633-bc31-208aecae9126 tempest-TestShelveInstance-1997281490 tempest-TestShelveInstance-1997281490-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1648631537" status: 202 len: 0 microversion: 2.1 time: 0.067801 Aug 09 15:57:06.981939 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3734/7478] 10.222.0.50 () {58 vars in 1254 bytes} [Tue Aug 9 15:57:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1648631537 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 15:57:11.375705 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 15:57:11.376565 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 15:57:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 15:57:35.980367 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=12 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:57:35.981759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=24 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:57:36.322500 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-3477306f-6147-4b7c-a28d-96d363c15450 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Action: 'create', calling method: .version_select at 0x7f41dd58fdc0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1518644830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIE0JyhLirxGEtOwtzokBkysm1Tc3uwXOnIOmznRHUrpvGRBzTfCw5H0njKSG5wMsLGCz+HOv+vKt0M8Ybdq/8h24kryYy/Za0Z/bLukJzFDL0EJRQ/GQ6vFmKE8/dNa3Q=="}} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:57:36.353572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3477306f-6147-4b7c-a28d-96d363c15450 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Getting quotas for project 80810c2561ac45f5910b9bcc0ca45721. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:57:36.365934 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.quota [None req-3477306f-6147-4b7c-a28d-96d363c15450 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Getting quotas for user e47b0fca9c1e4cacac9d291a3e3858b5 and project 80810c2561ac45f5910b9bcc0ca45721. Resources: {'key_pairs'} {{(pid=119407) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:57:36.417851 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-3477306f-6147-4b7c-a28d-96d363c15450 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.447493 Aug 09 15:57:36.418920 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3745/7479] 10.222.0.50 () {60 vars in 1159 bytes} [Tue Aug 9 15:57:35 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:57:38.287746 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:57:38.289137 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:57:38.298684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1042392148", "imageRef": "f0e08d35-6013-4ff5-9f41-f40d5739b250", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1518644830", "security_groups": [{"name": "tempest-secgroup-smoke-1057720338"}], "networks": [{"uuid": "6577bd68-663f-4f0a-a8c7-69e954120acc"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:57:38.485172 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] validate_networks() for [('6577bd68-663f-4f0a-a8c7-69e954120acc', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 15:57:39.307653 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 15:57:39.308554 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 15:57:39.309115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 15:57:39.309784 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 15:57:39.310667 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 15:57:39.326095 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:39.326841 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:39.327715 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:39.328905 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:39.329631 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:39.330293 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:39.361688 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Getting quotas for project 80810c2561ac45f5910b9bcc0ca45721. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 15:57:39.372403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Getting quotas for user e47b0fca9c1e4cacac9d291a3e3858b5 and project 80810c2561ac45f5910b9bcc0ca45721. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 15:57:39.397776 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 15:57:39.402472 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f0e08d35-6013-4ff5-9f41-f40d5739b250',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 15:57:39.497310 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e8e00ca0-c511-4777-91cd-ef88fabce4a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.212996 Aug 09 15:57:39.503371 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3735/7480] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 15:57:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 15:57:39.520242 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6989375c-c14f-4ee1-baef-fef80fa19d72 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:39.522461 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6989375c-c14f-4ee1-baef-fef80fa19d72 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:39.622007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6989375c-c14f-4ee1-baef-fef80fa19d72 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:39.634452 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6989375c-c14f-4ee1-baef-fef80fa19d72 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1249 microversion: 2.1 time: 0.123836 Aug 09 15:57:39.635737 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3746/7481] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:39 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1249 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:40.678109 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-fa4a2090-14e7-43fc-8092-db70ed7c66eb tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:40.679115 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-fa4a2090-14e7-43fc-8092-db70ed7c66eb tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:40.691542 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa4a2090-14e7-43fc-8092-db70ed7c66eb tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:40.692470 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa4a2090-14e7-43fc-8092-db70ed7c66eb tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:40.693342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa4a2090-14e7-43fc-8092-db70ed7c66eb tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:40.694620 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa4a2090-14e7-43fc-8092-db70ed7c66eb tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:40.695518 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa4a2090-14e7-43fc-8092-db70ed7c66eb tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:40.696319 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-fa4a2090-14e7-43fc-8092-db70ed7c66eb tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:40.821136 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-fa4a2090-14e7-43fc-8092-db70ed7c66eb tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:40.836799 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-fa4a2090-14e7-43fc-8092-db70ed7c66eb tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1301 microversion: 2.1 time: 0.169179 Aug 09 15:57:40.837911 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3736/7482] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:40 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1301 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:41.877546 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-602b79fc-4488-4ad2-aa2a-13ae30284243 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:41.879512 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-602b79fc-4488-4ad2-aa2a-13ae30284243 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:41.894337 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-602b79fc-4488-4ad2-aa2a-13ae30284243 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:41.895877 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-602b79fc-4488-4ad2-aa2a-13ae30284243 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:41.897130 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-602b79fc-4488-4ad2-aa2a-13ae30284243 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:41.899221 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-602b79fc-4488-4ad2-aa2a-13ae30284243 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:41.900062 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-602b79fc-4488-4ad2-aa2a-13ae30284243 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:41.900900 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-602b79fc-4488-4ad2-aa2a-13ae30284243 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:42.056125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-602b79fc-4488-4ad2-aa2a-13ae30284243 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:42.071138 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-602b79fc-4488-4ad2-aa2a-13ae30284243 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1307 microversion: 2.1 time: 0.203414 Aug 09 15:57:42.072131 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3747/7483] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:41 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:43.105191 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-bee400c9-ae56-4d5e-a277-c4d5f3df814e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:43.106682 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-bee400c9-ae56-4d5e-a277-c4d5f3df814e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:43.116645 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bee400c9-ae56-4d5e-a277-c4d5f3df814e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:43.118051 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bee400c9-ae56-4d5e-a277-c4d5f3df814e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:43.118891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bee400c9-ae56-4d5e-a277-c4d5f3df814e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:43.120370 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bee400c9-ae56-4d5e-a277-c4d5f3df814e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:43.121062 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bee400c9-ae56-4d5e-a277-c4d5f3df814e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:43.121799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-bee400c9-ae56-4d5e-a277-c4d5f3df814e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:43.425668 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-bee400c9-ae56-4d5e-a277-c4d5f3df814e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:43.446691 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-bee400c9-ae56-4d5e-a277-c4d5f3df814e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1375 microversion: 2.1 time: 0.345626 Aug 09 15:57:43.449374 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3737/7484] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:43 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1375 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:43.651541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-952ccdf1-c6ed-42ac-a3bd-17a390b1df92 req-ddd75d6c-f811-4bb5-939f-6da403fa29bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889666b9-5a35-462b-9a1c-cfe25e7d2f98", "tag": "be81af4f-d8df-499c-95ea-b7805ccb0cd8"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:57:43.673890 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-952ccdf1-c6ed-42ac-a3bd-17a390b1df92 req-ddd75d6c-f811-4bb5-939f-6da403fa29bb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:43.675032 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-952ccdf1-c6ed-42ac-a3bd-17a390b1df92 req-ddd75d6c-f811-4bb5-939f-6da403fa29bb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:43.675839 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-952ccdf1-c6ed-42ac-a3bd-17a390b1df92 req-ddd75d6c-f811-4bb5-939f-6da403fa29bb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:43.707261 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-952ccdf1-c6ed-42ac-a3bd-17a390b1df92 req-ddd75d6c-f811-4bb5-939f-6da403fa29bb service nova] Creating event network-changed:be81af4f-d8df-499c-95ea-b7805ccb0cd8 for instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 on n-h1-844626-8 Aug 09 15:57:43.717278 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-952ccdf1-c6ed-42ac-a3bd-17a390b1df92 req-ddd75d6c-f811-4bb5-939f-6da403fa29bb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081355 Aug 09 15:57:43.718914 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3748/7485] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:57:44.488474 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-44a6c390-7bf8-42cb-9e3a-8d8e0396215e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:44.489624 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-44a6c390-7bf8-42cb-9e3a-8d8e0396215e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:44.504447 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44a6c390-7bf8-42cb-9e3a-8d8e0396215e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:44.505342 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44a6c390-7bf8-42cb-9e3a-8d8e0396215e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:44.506146 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44a6c390-7bf8-42cb-9e3a-8d8e0396215e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:44.507491 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44a6c390-7bf8-42cb-9e3a-8d8e0396215e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:44.508369 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44a6c390-7bf8-42cb-9e3a-8d8e0396215e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:44.509155 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-44a6c390-7bf8-42cb-9e3a-8d8e0396215e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:44.764235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-44a6c390-7bf8-42cb-9e3a-8d8e0396215e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:44.777910 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-44a6c390-7bf8-42cb-9e3a-8d8e0396215e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1375 microversion: 2.1 time: 0.296974 Aug 09 15:57:44.778814 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3738/7486] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:44 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1375 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:45.819434 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-e8d7409c-8140-4c40-ad39-69073ed041c1 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:45.820707 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-e8d7409c-8140-4c40-ad39-69073ed041c1 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:45.834264 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d7409c-8140-4c40-ad39-69073ed041c1 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:45.835187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d7409c-8140-4c40-ad39-69073ed041c1 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:45.835940 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d7409c-8140-4c40-ad39-69073ed041c1 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:45.837194 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d7409c-8140-4c40-ad39-69073ed041c1 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:45.837974 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d7409c-8140-4c40-ad39-69073ed041c1 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:45.838675 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-e8d7409c-8140-4c40-ad39-69073ed041c1 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:46.065105 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-e8d7409c-8140-4c40-ad39-69073ed041c1 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:46.080097 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-e8d7409c-8140-4c40-ad39-69073ed041c1 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1375 microversion: 2.1 time: 0.269066 Aug 09 15:57:46.081751 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3749/7487] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:45 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1375 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:47.118963 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-e7971fdd-07cc-40e3-bb4e-a6f7233a6d7f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:47.119869 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-e7971fdd-07cc-40e3-bb4e-a6f7233a6d7f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:47.128774 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7971fdd-07cc-40e3-bb4e-a6f7233a6d7f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:47.129280 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7971fdd-07cc-40e3-bb4e-a6f7233a6d7f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:47.129719 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7971fdd-07cc-40e3-bb4e-a6f7233a6d7f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:47.130455 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7971fdd-07cc-40e3-bb4e-a6f7233a6d7f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:47.130918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7971fdd-07cc-40e3-bb4e-a6f7233a6d7f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:47.131377 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-e7971fdd-07cc-40e3-bb4e-a6f7233a6d7f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:47.341706 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-e7971fdd-07cc-40e3-bb4e-a6f7233a6d7f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:47.354101 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-e7971fdd-07cc-40e3-bb4e-a6f7233a6d7f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1375 microversion: 2.1 time: 0.240686 Aug 09 15:57:47.355125 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3739/7488] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:47 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1375 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:48.384728 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-c940539e-d80f-49f7-a6a1-eb609e1e8dce tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:48.385608 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-c940539e-d80f-49f7-a6a1-eb609e1e8dce tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:48.394262 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c940539e-d80f-49f7-a6a1-eb609e1e8dce tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:48.395014 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c940539e-d80f-49f7-a6a1-eb609e1e8dce tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:48.396007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c940539e-d80f-49f7-a6a1-eb609e1e8dce tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:48.396756 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c940539e-d80f-49f7-a6a1-eb609e1e8dce tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:48.397355 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c940539e-d80f-49f7-a6a1-eb609e1e8dce tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:48.398075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-c940539e-d80f-49f7-a6a1-eb609e1e8dce tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:48.609250 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-c940539e-d80f-49f7-a6a1-eb609e1e8dce tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:48.624407 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-c940539e-d80f-49f7-a6a1-eb609e1e8dce tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1375 microversion: 2.1 time: 0.243608 Aug 09 15:57:48.625272 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3750/7489] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:48 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1375 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:49.583063 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-af1d57f8-4898-4492-a41d-774a4bcc6c96 req-6fd84be3-220f-4c40-9dac-9ef39e22a87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889666b9-5a35-462b-9a1c-cfe25e7d2f98", "name": "network-vif-plugged", "status": "completed", "tag": "be81af4f-d8df-499c-95ea-b7805ccb0cd8"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:57:49.595642 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:57:49.596686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=6 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:57:49.600235 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-af1d57f8-4898-4492-a41d-774a4bcc6c96 req-6fd84be3-220f-4c40-9dac-9ef39e22a87e service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:49.601142 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-af1d57f8-4898-4492-a41d-774a4bcc6c96 req-6fd84be3-220f-4c40-9dac-9ef39e22a87e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:49.602675 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-af1d57f8-4898-4492-a41d-774a4bcc6c96 req-6fd84be3-220f-4c40-9dac-9ef39e22a87e service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:49.626401 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-af1d57f8-4898-4492-a41d-774a4bcc6c96 req-6fd84be3-220f-4c40-9dac-9ef39e22a87e service nova] Creating event network-vif-plugged:be81af4f-d8df-499c-95ea-b7805ccb0cd8 for instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 on n-h1-844626-8 Aug 09 15:57:49.636946 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-af1d57f8-4898-4492-a41d-774a4bcc6c96 req-6fd84be3-220f-4c40-9dac-9ef39e22a87e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060288 Aug 09 15:57:49.639277 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3740/7490] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:57:49.660928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-87efe710-27b0-409f-b815-2f1773410885 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:49.663005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-87efe710-27b0-409f-b815-2f1773410885 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:49.688652 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:57:49.708300 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87efe710-27b0-409f-b815-2f1773410885 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:49.709073 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87efe710-27b0-409f-b815-2f1773410885 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:49.710064 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87efe710-27b0-409f-b815-2f1773410885 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:49.712571 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87efe710-27b0-409f-b815-2f1773410885 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:49.713356 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87efe710-27b0-409f-b815-2f1773410885 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:49.714006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-87efe710-27b0-409f-b815-2f1773410885 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:49.986798 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-87efe710-27b0-409f-b815-2f1773410885 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:49.999798 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-87efe710-27b0-409f-b815-2f1773410885 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1375 microversion: 2.1 time: 0.348814 Aug 09 15:57:50.001004 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3751/7491] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:49 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1375 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:51.036366 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-f3915172-0062-4da9-b49f-c2a304d891ef tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:51.037781 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-f3915172-0062-4da9-b49f-c2a304d891ef tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:51.052183 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3915172-0062-4da9-b49f-c2a304d891ef tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:51.053098 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3915172-0062-4da9-b49f-c2a304d891ef tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:51.053944 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3915172-0062-4da9-b49f-c2a304d891ef tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:51.055772 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3915172-0062-4da9-b49f-c2a304d891ef tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:51.056961 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3915172-0062-4da9-b49f-c2a304d891ef tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:51.057840 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-f3915172-0062-4da9-b49f-c2a304d891ef tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:51.318531 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-f3915172-0062-4da9-b49f-c2a304d891ef tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:51.334633 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-f3915172-0062-4da9-b49f-c2a304d891ef tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1375 microversion: 2.1 time: 0.306649 Aug 09 15:57:51.335737 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3741/7492] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:51 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1375 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 15:57:52.369572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5978d81e-ec9d-4489-94d6-f20c3d6caaa7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:52.370433 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5978d81e-ec9d-4489-94d6-f20c3d6caaa7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:52.379486 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5978d81e-ec9d-4489-94d6-f20c3d6caaa7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:52.380140 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5978d81e-ec9d-4489-94d6-f20c3d6caaa7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:52.380779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5978d81e-ec9d-4489-94d6-f20c3d6caaa7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:52.381533 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5978d81e-ec9d-4489-94d6-f20c3d6caaa7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:52.382075 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5978d81e-ec9d-4489-94d6-f20c3d6caaa7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:52.382572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5978d81e-ec9d-4489-94d6-f20c3d6caaa7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:52.638590 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5978d81e-ec9d-4489-94d6-f20c3d6caaa7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:52.648442 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5978d81e-ec9d-4489-94d6-f20c3d6caaa7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1561 microversion: 2.1 time: 0.283655 Aug 09 15:57:52.649244 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3752/7493] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:52 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1561 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:52.677756 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c02cd45a-fb98-4474-850e-3b328500ca26 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 15:57:52.678916 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c02cd45a-fb98-4474-850e-3b328500ca26 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:57:52.692154 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c02cd45a-fb98-4474-850e-3b328500ca26 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:52.692752 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c02cd45a-fb98-4474-850e-3b328500ca26 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:52.693269 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c02cd45a-fb98-4474-850e-3b328500ca26 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:52.694299 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c02cd45a-fb98-4474-850e-3b328500ca26 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:52.695202 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c02cd45a-fb98-4474-850e-3b328500ca26 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:52.696028 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c02cd45a-fb98-4474-850e-3b328500ca26 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:52.926065 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-c02cd45a-fb98-4474-850e-3b328500ca26 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 15:57:52.941111 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c02cd45a-fb98-4474-850e-3b328500ca26 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1561 microversion: 2.1 time: 0.271946 Aug 09 15:57:52.942163 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3742/7494] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 15:57:52 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1561 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 15:57:55.640058 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8e42e3bc-3b50-4e0a-83ab-f9a1e45eaf8a req-ca00c29d-70ba-472a-b540-80ca13fde61c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889666b9-5a35-462b-9a1c-cfe25e7d2f98", "tag": "be81af4f-d8df-499c-95ea-b7805ccb0cd8"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:57:55.656779 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8e42e3bc-3b50-4e0a-83ab-f9a1e45eaf8a req-ca00c29d-70ba-472a-b540-80ca13fde61c service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:57:55.657508 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8e42e3bc-3b50-4e0a-83ab-f9a1e45eaf8a req-ca00c29d-70ba-472a-b540-80ca13fde61c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:57:55.658162 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8e42e3bc-3b50-4e0a-83ab-f9a1e45eaf8a req-ca00c29d-70ba-472a-b540-80ca13fde61c service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:57:55.678364 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8e42e3bc-3b50-4e0a-83ab-f9a1e45eaf8a req-ca00c29d-70ba-472a-b540-80ca13fde61c service nova] Creating event network-changed:be81af4f-d8df-499c-95ea-b7805ccb0cd8 for instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 on n-h1-844626-8 Aug 09 15:57:55.687304 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8e42e3bc-3b50-4e0a-83ab-f9a1e45eaf8a req-ca00c29d-70ba-472a-b540-80ca13fde61c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053198 Aug 09 15:57:55.688572 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3753/7495] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 15:59:50.756975 n-d-844626-8 devstack@n-api.service[119406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2072e827-cf31-416a-97b9-dec37834bdb2] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:59:50.757855 n-d-844626-8 devstack@n-api.service[119406]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb00389d-3bc9-4291-a475-262c81a6a465] AMQP server on 10.222.0.50:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 15:59:50.758418 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:59:50.759194 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=40 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:59:50.763489 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ecedbc5d-19d9-4fcf-9ff2-d01ce86b3643 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-2123889005"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:59:50.765992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ecedbc5d-19d9-4fcf-9ff2-d01ce86b3643 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 15:59:50.774169 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecedbc5d-19d9-4fcf-9ff2-d01ce86b3643 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:59:50.774684 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecedbc5d-19d9-4fcf-9ff2-d01ce86b3643 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:59:50.775162 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecedbc5d-19d9-4fcf-9ff2-d01ce86b3643 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:59:50.775881 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecedbc5d-19d9-4fcf-9ff2-d01ce86b3643 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:59:50.776341 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecedbc5d-19d9-4fcf-9ff2-d01ce86b3643 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:59:50.776757 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ecedbc5d-19d9-4fcf-9ff2-d01ce86b3643 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:59:51.018287 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ecedbc5d-19d9-4fcf-9ff2-d01ce86b3643 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "POST /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98/action" status: 202 len: 0 microversion: 2.1 time: 0.262560 Aug 09 15:59:51.019983 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3743/7496] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 15:59:50 2022] POST /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 09 15:59:58.090533 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e81a619-36fd-4d2d-bb1a-e0ebabb081c8] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 15:59:58.094136 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96165289-31fc-4874-b2d8-1756550c06bf] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 15:59:58.095503 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:59:58.097726 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=34 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 15:59:58.109318 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-8a80d873-9099-47ed-adf7-a15b6e5feabc req-006da189-7068-4f11-a5d4-71fc5765f17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889666b9-5a35-462b-9a1c-cfe25e7d2f98", "name": "network-vif-plugged", "status": "completed", "tag": "be81af4f-d8df-499c-95ea-b7805ccb0cd8"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 15:59:58.129936 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8a80d873-9099-47ed-adf7-a15b6e5feabc req-006da189-7068-4f11-a5d4-71fc5765f17d service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 15:59:58.131350 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8a80d873-9099-47ed-adf7-a15b6e5feabc req-006da189-7068-4f11-a5d4-71fc5765f17d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 15:59:58.132419 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-8a80d873-9099-47ed-adf7-a15b6e5feabc req-006da189-7068-4f11-a5d4-71fc5765f17d service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 15:59:58.154813 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-8a80d873-9099-47ed-adf7-a15b6e5feabc req-006da189-7068-4f11-a5d4-71fc5765f17d service nova] Creating event network-vif-plugged:be81af4f-d8df-499c-95ea-b7805ccb0cd8 for instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 on n-h1-844626-8 Aug 09 15:59:58.164133 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-8a80d873-9099-47ed-adf7-a15b6e5feabc req-006da189-7068-4f11-a5d4-71fc5765f17d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076029 Aug 09 15:59:58.165829 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3754/7497] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 15:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:00:05.846486 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:00:05.847583 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:00:05.853431 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2065257953", "imageRef": "57b860ba-d749-4e37-bd49-39d6d7ea8385", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1518644830", "security_groups": [{"name": "tempest-secgroup-smoke-1057720338"}], "networks": [{"uuid": "6577bd68-663f-4f0a-a8c7-69e954120acc"}]}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:00:05.880543 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb00389d-3bc9-4291-a475-262c81a6a465] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 55156. Aug 09 16:00:05.882265 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] [2072e827-cf31-416a-97b9-dec37834bdb2] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 55154. Aug 09 16:00:06.023545 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.network.neutron [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] validate_networks() for [('6577bd68-663f-4f0a-a8c7-69e954120acc', None, None, None, None, None)] {{(pid=119406) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 16:00:06.872404 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Flavor limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 16:00:06.873372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Image limits 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 16:00:06.873372 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Flavor pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 16:00:06.873992 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Image pref 0:0:0 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 16:00:06.874496 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.virt.hardware [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=119406) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 16:00:06.884320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:06.884817 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:06.885265 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:06.886007 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:06.886473 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:06.886918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:06.912308 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Getting quotas for project 80810c2561ac45f5910b9bcc0ca45721. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 16:00:06.919281 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.quota [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Getting quotas for user e47b0fca9c1e4cacac9d291a3e3858b5 and project 80810c2561ac45f5910b9bcc0ca45721. Resources: {'cores', 'instances', 'ram'} {{(pid=119406) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 16:00:06.934070 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Going to run 1 instances... {{(pid=119406) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 16:00:06.936758 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='57b860ba-d749-4e37-bd49-39d6d7ea8385',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=119406) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 16:00:07.003404 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-8c42f2d9-f602-475b-b99f-4317e29d8ed0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.160608 Aug 09 16:00:07.004113 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3744/7498] 10.222.0.50 () {60 vars in 1147 bytes} [Tue Aug 9 16:00:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 16:00:07.019431 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-6f59a03a-62db-4f39-b517-826787d391b5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:07.022577 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-6f59a03a-62db-4f39-b517-826787d391b5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:07.053525 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e81a619-36fd-4d2d-bb1a-e0ebabb081c8] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 55170. Aug 09 16:00:07.054394 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [96165289-31fc-4874-b2d8-1756550c06bf] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 55172. Aug 09 16:00:07.092241 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-6f59a03a-62db-4f39-b517-826787d391b5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:07.102334 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-6f59a03a-62db-4f39-b517-826787d391b5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1249 microversion: 2.1 time: 0.089933 Aug 09 16:00:07.103035 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3755/7499] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:07 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:07.989403 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-ee1baa4f-1abf-4d5f-8b0d-b9c91c393675 req-0b5bce0a-c556-4980-9639-861080c64a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889666b9-5a35-462b-9a1c-cfe25e7d2f98", "name": "network-vif-unplugged", "status": "completed", "tag": "be81af4f-d8df-499c-95ea-b7805ccb0cd8"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:00:08.005066 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ee1baa4f-1abf-4d5f-8b0d-b9c91c393675 req-0b5bce0a-c556-4980-9639-861080c64a6b service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:08.005612 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ee1baa4f-1abf-4d5f-8b0d-b9c91c393675 req-0b5bce0a-c556-4980-9639-861080c64a6b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:08.006117 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-ee1baa4f-1abf-4d5f-8b0d-b9c91c393675 req-0b5bce0a-c556-4980-9639-861080c64a6b service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:08.021692 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-ee1baa4f-1abf-4d5f-8b0d-b9c91c393675 req-0b5bce0a-c556-4980-9639-861080c64a6b service nova] Creating event network-vif-unplugged:be81af4f-d8df-499c-95ea-b7805ccb0cd8 for instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 on n-h1-844626-8 Aug 09 16:00:08.034134 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-ee1baa4f-1abf-4d5f-8b0d-b9c91c393675 req-0b5bce0a-c556-4980-9639-861080c64a6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051453 Aug 09 16:00:08.035078 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3745/7500] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 16:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:00:08.126006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-df5ce5c1-919a-4c87-9fd9-37c3ffe98a5e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:08.126883 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-df5ce5c1-919a-4c87-9fd9-37c3ffe98a5e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:08.147463 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:00:08.216012 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-df5ce5c1-919a-4c87-9fd9-37c3ffe98a5e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:08.228515 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-df5ce5c1-919a-4c87-9fd9-37c3ffe98a5e tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1249 microversion: 2.1 time: 0.107065 Aug 09 16:00:08.229379 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3756/7501] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:08 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1249 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:09.258086 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-791a3b34-6322-4104-827e-43c82eb9d327 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:09.259001 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-791a3b34-6322-4104-827e-43c82eb9d327 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:09.324532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-791a3b34-6322-4104-827e-43c82eb9d327 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:09.335244 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-791a3b34-6322-4104-827e-43c82eb9d327 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1249 microversion: 2.1 time: 0.082436 Aug 09 16:00:09.336440 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3746/7502] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:09 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:10.370646 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-569300fc-8823-4aee-b12a-cbadc2ee1bb6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:10.371277 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-569300fc-8823-4aee-b12a-cbadc2ee1bb6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:10.440875 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-569300fc-8823-4aee-b12a-cbadc2ee1bb6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:10.457712 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-569300fc-8823-4aee-b12a-cbadc2ee1bb6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1249 microversion: 2.1 time: 0.090878 Aug 09 16:00:10.458628 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3757/7503] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:10 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:11.480657 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-39df58c2-a533-47fe-899e-f7ec61f31c50 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:11.481771 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-39df58c2-a533-47fe-899e-f7ec61f31c50 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:11.491485 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39df58c2-a533-47fe-899e-f7ec61f31c50 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:11.492126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39df58c2-a533-47fe-899e-f7ec61f31c50 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:11.492681 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39df58c2-a533-47fe-899e-f7ec61f31c50 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:11.493510 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39df58c2-a533-47fe-899e-f7ec61f31c50 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:11.494087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39df58c2-a533-47fe-899e-f7ec61f31c50 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:11.494644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-39df58c2-a533-47fe-899e-f7ec61f31c50 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:11.573088 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-39df58c2-a533-47fe-899e-f7ec61f31c50 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:11.582005 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-39df58c2-a533-47fe-899e-f7ec61f31c50 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1253 microversion: 2.1 time: 0.105987 Aug 09 16:00:11.582627 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3747/7504] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:11 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1253 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:12.607125 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-418d65ee-8a8b-402e-b3c5-3b40b8ea59c2 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:12.608115 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-418d65ee-8a8b-402e-b3c5-3b40b8ea59c2 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:12.625005 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-418d65ee-8a8b-402e-b3c5-3b40b8ea59c2 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:12.626021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-418d65ee-8a8b-402e-b3c5-3b40b8ea59c2 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:12.626919 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-418d65ee-8a8b-402e-b3c5-3b40b8ea59c2 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:12.628371 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-418d65ee-8a8b-402e-b3c5-3b40b8ea59c2 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:12.629311 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-418d65ee-8a8b-402e-b3c5-3b40b8ea59c2 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:12.630156 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-418d65ee-8a8b-402e-b3c5-3b40b8ea59c2 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:12.750803 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-418d65ee-8a8b-402e-b3c5-3b40b8ea59c2 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:12.760754 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-418d65ee-8a8b-402e-b3c5-3b40b8ea59c2 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1307 microversion: 2.1 time: 0.159254 Aug 09 16:00:12.775273 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3758/7505] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:12 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:13.788462 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7dc68e10-12df-4569-914e-0223498c61fd tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:13.792303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7dc68e10-12df-4569-914e-0223498c61fd tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:13.809170 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc68e10-12df-4569-914e-0223498c61fd tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:13.811362 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc68e10-12df-4569-914e-0223498c61fd tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:13.812410 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc68e10-12df-4569-914e-0223498c61fd tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:13.814168 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc68e10-12df-4569-914e-0223498c61fd tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:13.815334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc68e10-12df-4569-914e-0223498c61fd tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:13.816294 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7dc68e10-12df-4569-914e-0223498c61fd tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:14.339452 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7dc68e10-12df-4569-914e-0223498c61fd tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:14.360127 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7dc68e10-12df-4569-914e-0223498c61fd tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1375 microversion: 2.1 time: 0.578905 Aug 09 16:00:14.365119 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3748/7506] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:13 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1375 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:15.393799 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-a1ea96ea-4cde-4a8b-85be-cf18590da0f8 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:15.396269 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-a1ea96ea-4cde-4a8b-85be-cf18590da0f8 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:15.406416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1ea96ea-4cde-4a8b-85be-cf18590da0f8 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:15.407426 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1ea96ea-4cde-4a8b-85be-cf18590da0f8 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:15.408245 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1ea96ea-4cde-4a8b-85be-cf18590da0f8 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:15.410777 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1ea96ea-4cde-4a8b-85be-cf18590da0f8 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:15.412637 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1ea96ea-4cde-4a8b-85be-cf18590da0f8 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:15.413416 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-a1ea96ea-4cde-4a8b-85be-cf18590da0f8 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:15.776541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-a1ea96ea-4cde-4a8b-85be-cf18590da0f8 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:15.793983 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-a1ea96ea-4cde-4a8b-85be-cf18590da0f8 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1375 microversion: 2.1 time: 0.404303 Aug 09 16:00:15.821868 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-38855c49-7331-4840-a70e-9ea7a5d12bbe req-4651cfb2-e3f0-43fa-a797-500f50219043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4f18ab-247d-424b-8c4a-3b81a4acace8", "tag": "494c355d-680f-4936-8635-5fcc0bf643f6"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:00:15.823415 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3759/7507] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:15 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1375 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:15.842572 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-38855c49-7331-4840-a70e-9ea7a5d12bbe req-4651cfb2-e3f0-43fa-a797-500f50219043 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:15.844087 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-38855c49-7331-4840-a70e-9ea7a5d12bbe req-4651cfb2-e3f0-43fa-a797-500f50219043 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:15.845245 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-38855c49-7331-4840-a70e-9ea7a5d12bbe req-4651cfb2-e3f0-43fa-a797-500f50219043 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:15.885613 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-38855c49-7331-4840-a70e-9ea7a5d12bbe req-4651cfb2-e3f0-43fa-a797-500f50219043 service nova] Creating event network-changed:494c355d-680f-4936-8635-5fcc0bf643f6 for instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 on n-h2-844626-8 Aug 09 16:00:15.896299 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-38855c49-7331-4840-a70e-9ea7a5d12bbe req-4651cfb2-e3f0-43fa-a797-500f50219043 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086855 Aug 09 16:00:15.897864 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3749/7508] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 16:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:00:16.840338 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a77f265-0e53-45fd-9e15-3360cad02d33 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:16.841805 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a77f265-0e53-45fd-9e15-3360cad02d33 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:16.860133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a77f265-0e53-45fd-9e15-3360cad02d33 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:16.861681 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a77f265-0e53-45fd-9e15-3360cad02d33 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:16.862539 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a77f265-0e53-45fd-9e15-3360cad02d33 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:16.863855 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a77f265-0e53-45fd-9e15-3360cad02d33 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:16.865146 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a77f265-0e53-45fd-9e15-3360cad02d33 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:16.866203 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a77f265-0e53-45fd-9e15-3360cad02d33 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:17.142610 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a77f265-0e53-45fd-9e15-3360cad02d33 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:17.159880 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a77f265-0e53-45fd-9e15-3360cad02d33 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1375 microversion: 2.1 time: 0.327273 Aug 09 16:00:17.175157 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3760/7509] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:16 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1375 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:18.192039 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-7e284790-b5f2-465f-a701-faf830ddb6f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:18.194872 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-7e284790-b5f2-465f-a701-faf830ddb6f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:18.199382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:00:18.213314 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e284790-b5f2-465f-a701-faf830ddb6f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:18.214602 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e284790-b5f2-465f-a701-faf830ddb6f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:18.216054 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e284790-b5f2-465f-a701-faf830ddb6f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:18.217532 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e284790-b5f2-465f-a701-faf830ddb6f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:18.218579 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e284790-b5f2-465f-a701-faf830ddb6f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:18.219193 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-7e284790-b5f2-465f-a701-faf830ddb6f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:18.491331 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-7e284790-b5f2-465f-a701-faf830ddb6f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:18.507999 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-7e284790-b5f2-465f-a701-faf830ddb6f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1375 microversion: 2.1 time: 0.326673 Aug 09 16:00:18.519393 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3750/7510] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:18 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1375 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:19.540763 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-5a669547-2d36-4153-8ff6-db4f81e15750 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:19.541345 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-5a669547-2d36-4153-8ff6-db4f81e15750 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:19.549186 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a669547-2d36-4153-8ff6-db4f81e15750 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:19.549692 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a669547-2d36-4153-8ff6-db4f81e15750 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:19.550132 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a669547-2d36-4153-8ff6-db4f81e15750 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:19.550882 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a669547-2d36-4153-8ff6-db4f81e15750 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:19.551364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a669547-2d36-4153-8ff6-db4f81e15750 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:19.551788 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-5a669547-2d36-4153-8ff6-db4f81e15750 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:19.824008 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-5a669547-2d36-4153-8ff6-db4f81e15750 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:19.837944 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-5a669547-2d36-4153-8ff6-db4f81e15750 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1375 microversion: 2.1 time: 0.301032 Aug 09 16:00:19.850564 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3761/7511] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:19 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1375 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:20.870569 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-1441fd82-2278-4543-878a-cdc943f70fc4 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:20.871488 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-1441fd82-2278-4543-878a-cdc943f70fc4 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:20.874129 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell0:SELECT=8 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:00:20.884198 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1441fd82-2278-4543-878a-cdc943f70fc4 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:20.885074 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1441fd82-2278-4543-878a-cdc943f70fc4 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:20.885921 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1441fd82-2278-4543-878a-cdc943f70fc4 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:20.887361 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1441fd82-2278-4543-878a-cdc943f70fc4 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:20.888126 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1441fd82-2278-4543-878a-cdc943f70fc4 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:20.888891 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-1441fd82-2278-4543-878a-cdc943f70fc4 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:21.098145 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-1441fd82-2278-4543-878a-cdc943f70fc4 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:21.107578 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-1441fd82-2278-4543-878a-cdc943f70fc4 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1375 microversion: 2.1 time: 0.241102 Aug 09 16:00:21.108400 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3751/7512] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:20 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1375 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:22.131009 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-21c9c97e-2ab8-42bb-a6d8-59472fd82555 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:22.131785 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-21c9c97e-2ab8-42bb-a6d8-59472fd82555 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:22.133586 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell0:SELECT=6 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:00:22.140671 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21c9c97e-2ab8-42bb-a6d8-59472fd82555 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:22.141336 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21c9c97e-2ab8-42bb-a6d8-59472fd82555 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:22.141954 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21c9c97e-2ab8-42bb-a6d8-59472fd82555 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:22.142712 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21c9c97e-2ab8-42bb-a6d8-59472fd82555 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:22.143259 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21c9c97e-2ab8-42bb-a6d8-59472fd82555 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:22.143687 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-21c9c97e-2ab8-42bb-a6d8-59472fd82555 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:22.437212 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-21c9c97e-2ab8-42bb-a6d8-59472fd82555 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:22.445626 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-21c9c97e-2ab8-42bb-a6d8-59472fd82555 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1375 microversion: 2.1 time: 0.318724 Aug 09 16:00:22.446330 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3762/7513] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:22 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1375 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:23.468696 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-b05e2311-8a0d-49a1-ba27-75d5d9c6fa97 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:23.469432 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-b05e2311-8a0d-49a1-ba27-75d5d9c6fa97 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:23.478037 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05e2311-8a0d-49a1-ba27-75d5d9c6fa97 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:23.478592 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05e2311-8a0d-49a1-ba27-75d5d9c6fa97 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:23.479113 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05e2311-8a0d-49a1-ba27-75d5d9c6fa97 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:23.479929 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05e2311-8a0d-49a1-ba27-75d5d9c6fa97 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:23.480429 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05e2311-8a0d-49a1-ba27-75d5d9c6fa97 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:23.480909 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-b05e2311-8a0d-49a1-ba27-75d5d9c6fa97 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:23.650417 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-b05e2311-8a0d-49a1-ba27-75d5d9c6fa97 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:23.659762 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-b05e2311-8a0d-49a1-ba27-75d5d9c6fa97 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1375 microversion: 2.1 time: 0.195006 Aug 09 16:00:23.660665 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3752/7514] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:23 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1375 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:24.688084 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-dec23077-c32e-43b7-aaa6-f62829e385f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:24.689193 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-dec23077-c32e-43b7-aaa6-f62829e385f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:24.702589 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dec23077-c32e-43b7-aaa6-f62829e385f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:24.703450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dec23077-c32e-43b7-aaa6-f62829e385f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:24.704233 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dec23077-c32e-43b7-aaa6-f62829e385f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:24.705530 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dec23077-c32e-43b7-aaa6-f62829e385f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:24.706364 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dec23077-c32e-43b7-aaa6-f62829e385f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:24.707172 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-dec23077-c32e-43b7-aaa6-f62829e385f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:24.898141 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-dec23077-c32e-43b7-aaa6-f62829e385f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:24.913210 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-dec23077-c32e-43b7-aaa6-f62829e385f3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1375 microversion: 2.1 time: 0.232551 Aug 09 16:00:24.914377 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3763/7515] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:24 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1375 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:25.942376 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-5783f2aa-5374-4d7b-8586-64988556214b tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:25.943252 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-5783f2aa-5374-4d7b-8586-64988556214b tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:25.950464 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5783f2aa-5374-4d7b-8586-64988556214b tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:25.950967 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5783f2aa-5374-4d7b-8586-64988556214b tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:25.951520 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5783f2aa-5374-4d7b-8586-64988556214b tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:25.952348 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5783f2aa-5374-4d7b-8586-64988556214b tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:25.952834 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5783f2aa-5374-4d7b-8586-64988556214b tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:25.953303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-5783f2aa-5374-4d7b-8586-64988556214b tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:26.112428 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-5783f2aa-5374-4d7b-8586-64988556214b tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:26.122530 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-5783f2aa-5374-4d7b-8586-64988556214b tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1375 microversion: 2.1 time: 0.184188 Aug 09 16:00:26.123210 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3753/7516] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:25 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:26.717554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-ed57c2f3-0b8f-48f0-93a5-ef31a5b18567 req-9a831c62-f346-4413-8cae-ff96c0e97ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4f18ab-247d-424b-8c4a-3b81a4acace8", "name": "network-vif-plugged", "status": "completed", "tag": "494c355d-680f-4936-8635-5fcc0bf643f6"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:00:26.728626 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ed57c2f3-0b8f-48f0-93a5-ef31a5b18567 req-9a831c62-f346-4413-8cae-ff96c0e97ae0 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:26.729095 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ed57c2f3-0b8f-48f0-93a5-ef31a5b18567 req-9a831c62-f346-4413-8cae-ff96c0e97ae0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:26.729515 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-ed57c2f3-0b8f-48f0-93a5-ef31a5b18567 req-9a831c62-f346-4413-8cae-ff96c0e97ae0 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:26.742258 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-ed57c2f3-0b8f-48f0-93a5-ef31a5b18567 req-9a831c62-f346-4413-8cae-ff96c0e97ae0 service nova] Creating event network-vif-plugged:494c355d-680f-4936-8635-5fcc0bf643f6 for instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 on n-h2-844626-8 Aug 09 16:00:26.748074 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-ed57c2f3-0b8f-48f0-93a5-ef31a5b18567 req-9a831c62-f346-4413-8cae-ff96c0e97ae0 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111701 Aug 09 16:00:26.749070 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3764/7517] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 16:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:00:27.150320 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-592d3a7c-5919-46bc-abb3-d39ee06ba7a5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:27.151220 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-592d3a7c-5919-46bc-abb3-d39ee06ba7a5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:27.158761 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-592d3a7c-5919-46bc-abb3-d39ee06ba7a5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:27.159347 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-592d3a7c-5919-46bc-abb3-d39ee06ba7a5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:27.159828 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-592d3a7c-5919-46bc-abb3-d39ee06ba7a5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:27.160622 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-592d3a7c-5919-46bc-abb3-d39ee06ba7a5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:27.161148 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-592d3a7c-5919-46bc-abb3-d39ee06ba7a5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:27.161644 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-592d3a7c-5919-46bc-abb3-d39ee06ba7a5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:27.325729 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-592d3a7c-5919-46bc-abb3-d39ee06ba7a5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:27.335236 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-592d3a7c-5919-46bc-abb3-d39ee06ba7a5 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1375 microversion: 2.1 time: 0.190263 Aug 09 16:00:27.335869 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3754/7518] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:27 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:28.372789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-423bf5b8-a830-4a2a-97b1-d5caa744257f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:28.373406 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-423bf5b8-a830-4a2a-97b1-d5caa744257f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:28.375969 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=29 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:00:28.382981 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-423bf5b8-a830-4a2a-97b1-d5caa744257f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:28.383560 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-423bf5b8-a830-4a2a-97b1-d5caa744257f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:28.384006 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-423bf5b8-a830-4a2a-97b1-d5caa744257f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:28.384759 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-423bf5b8-a830-4a2a-97b1-d5caa744257f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:28.385272 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-423bf5b8-a830-4a2a-97b1-d5caa744257f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:28.385701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-423bf5b8-a830-4a2a-97b1-d5caa744257f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:28.544473 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-423bf5b8-a830-4a2a-97b1-d5caa744257f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:28.553303 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-423bf5b8-a830-4a2a-97b1-d5caa744257f tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1560 microversion: 2.1 time: 0.186313 Aug 09 16:00:28.553912 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3765/7519] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:28 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:28.575727 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-17274898-8b83-431e-a231-fb5a2bf17766 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:00:28.576382 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-17274898-8b83-431e-a231-fb5a2bf17766 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:00:28.584524 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17274898-8b83-431e-a231-fb5a2bf17766 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:28.585038 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17274898-8b83-431e-a231-fb5a2bf17766 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:28.585492 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17274898-8b83-431e-a231-fb5a2bf17766 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:28.586231 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17274898-8b83-431e-a231-fb5a2bf17766 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:28.586701 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17274898-8b83-431e-a231-fb5a2bf17766 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:28.587171 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-17274898-8b83-431e-a231-fb5a2bf17766 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:28.749804 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-17274898-8b83-431e-a231-fb5a2bf17766 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:00:28.762101 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-17274898-8b83-431e-a231-fb5a2bf17766 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1560 microversion: 2.1 time: 0.190066 Aug 09 16:00:28.762935 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3755/7520] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:00:28 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:00:30.950928 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-11545d18-49b9-4223-92da-db8279b1adeb req-43eef67e-f56b-4389-ab6e-8cb5a1622d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4f18ab-247d-424b-8c4a-3b81a4acace8", "tag": "494c355d-680f-4936-8635-5fcc0bf643f6"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:00:30.963037 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-11545d18-49b9-4223-92da-db8279b1adeb req-43eef67e-f56b-4389-ab6e-8cb5a1622d52 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:00:30.963554 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-11545d18-49b9-4223-92da-db8279b1adeb req-43eef67e-f56b-4389-ab6e-8cb5a1622d52 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:00:30.964187 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-11545d18-49b9-4223-92da-db8279b1adeb req-43eef67e-f56b-4389-ab6e-8cb5a1622d52 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:00:30.980149 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-11545d18-49b9-4223-92da-db8279b1adeb req-43eef67e-f56b-4389-ab6e-8cb5a1622d52 service nova] Creating event network-changed:494c355d-680f-4936-8635-5fcc0bf643f6 for instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 on n-h2-844626-8 Aug 09 16:00:30.986206 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-11545d18-49b9-4223-92da-db8279b1adeb req-43eef67e-f56b-4389-ab6e-8cb5a1622d52 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038990 Aug 09 16:00:30.987367 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3766/7521] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 16:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:00:31.388623 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:00:31.388980 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 16:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:00:32.408969 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:00:32.409652 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 16:00:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:02:02.841340 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:02:02.842106 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=54 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:02:02.847515 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-97d15630-04e1-4a2f-a513-c90d0ff0cda7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1311663194"}} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:02:02.849919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-97d15630-04e1-4a2f-a513-c90d0ff0cda7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:02:02.859118 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97d15630-04e1-4a2f-a513-c90d0ff0cda7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:02.859638 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97d15630-04e1-4a2f-a513-c90d0ff0cda7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:02.860078 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97d15630-04e1-4a2f-a513-c90d0ff0cda7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:02.860796 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97d15630-04e1-4a2f-a513-c90d0ff0cda7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:02.861254 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97d15630-04e1-4a2f-a513-c90d0ff0cda7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:02.861686 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-97d15630-04e1-4a2f-a513-c90d0ff0cda7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:03.404300 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-97d15630-04e1-4a2f-a513-c90d0ff0cda7 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "POST /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8/action" status: 202 len: 0 microversion: 2.1 time: 0.564080 Aug 09 16:02:03.405502 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3756/7522] 10.222.0.50 () {60 vars in 1278 bytes} [Tue Aug 9 16:02:02 2022] POST /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 09 16:02:07.731072 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:02:07.732663 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 16:02:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:02:09.158474 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9e81a619-36fd-4d2d-bb1a-e0ebabb081c8] AMQP server on 10.222.0.50:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 09 16:02:09.162852 n-d-844626-8 devstack@n-api.service[119407]: ERROR oslo.messaging._drivers.impl_rabbit [-] [96165289-31fc-4874-b2d8-1756550c06bf] AMQP server on 10.222.0.50:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 09 16:02:09.164392 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=3 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:02:09.166650 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=46 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:02:09.177980 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-501e5c0e-d287-4365-a029-ee9ec0f9ca3f req-ce37a4a6-82fb-4833-91a5-a455fa5c2641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4f18ab-247d-424b-8c4a-3b81a4acace8", "name": "network-vif-plugged", "status": "completed", "tag": "494c355d-680f-4936-8635-5fcc0bf643f6"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:02:09.205932 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-501e5c0e-d287-4365-a029-ee9ec0f9ca3f req-ce37a4a6-82fb-4833-91a5-a455fa5c2641 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:09.207489 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-501e5c0e-d287-4365-a029-ee9ec0f9ca3f req-ce37a4a6-82fb-4833-91a5-a455fa5c2641 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:09.208547 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-501e5c0e-d287-4365-a029-ee9ec0f9ca3f req-ce37a4a6-82fb-4833-91a5-a455fa5c2641 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:09.235045 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-501e5c0e-d287-4365-a029-ee9ec0f9ca3f req-ce37a4a6-82fb-4833-91a5-a455fa5c2641 service nova] Creating event network-vif-plugged:494c355d-680f-4936-8635-5fcc0bf643f6 for instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 on n-h2-844626-8 Aug 09 16:02:09.250917 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-501e5c0e-d287-4365-a029-ee9ec0f9ca3f req-ce37a4a6-82fb-4833-91a5-a455fa5c2641 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104429 Aug 09 16:02:09.252228 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3767/7523] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 16:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:02:22.347562 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-c21e025c-132e-4a36-b20e-710a2d73ed80 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:02:22.348334 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c21e025c-132e-4a36-b20e-710a2d73ed80 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:02:22.352030 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_api:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:02:22.353236 n-d-844626-8 devstack@n-api.service[119407]: DEBUG dbcounter [-] [119407] Writing DB stats nova_cell1:SELECT=2 {{(pid=119407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:02:22.359448 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_api:SELECT=2 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:02:22.361845 n-d-844626-8 devstack@n-api.service[119406]: DEBUG dbcounter [-] [119406] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=119406) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:02:22.365704 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c21e025c-132e-4a36-b20e-710a2d73ed80 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:22.366658 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c21e025c-132e-4a36-b20e-710a2d73ed80 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:22.367690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c21e025c-132e-4a36-b20e-710a2d73ed80 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:22.368831 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c21e025c-132e-4a36-b20e-710a2d73ed80 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:22.369598 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c21e025c-132e-4a36-b20e-710a2d73ed80 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:22.369973 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-c21e025c-132e-4a36-b20e-710a2d73ed80 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:22.377290 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [9e81a619-36fd-4d2d-bb1a-e0ebabb081c8] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 55500. Aug 09 16:02:22.379006 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] [96165289-31fc-4874-b2d8-1756550c06bf] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 55502. Aug 09 16:02:22.412919 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-c21e025c-132e-4a36-b20e-710a2d73ed80 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Going to try to terminate instance {{(pid=119406) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:02:22.472952 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [req-bd6a15ba-7f61-4e80-81b1-3a9aec6b9ccb req-a24dd767-6137-48be-94c8-5b0816d6e78a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4f18ab-247d-424b-8c4a-3b81a4acace8", "tag": "494c355d-680f-4936-8635-5fcc0bf643f6"}]} {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:02:22.488572 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bd6a15ba-7f61-4e80-81b1-3a9aec6b9ccb req-a24dd767-6137-48be-94c8-5b0816d6e78a service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:22.489490 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bd6a15ba-7f61-4e80-81b1-3a9aec6b9ccb req-a24dd767-6137-48be-94c8-5b0816d6e78a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:22.490107 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [req-bd6a15ba-7f61-4e80-81b1-3a9aec6b9ccb req-a24dd767-6137-48be-94c8-5b0816d6e78a service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:22.504834 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.compute.server_external_events [req-bd6a15ba-7f61-4e80-81b1-3a9aec6b9ccb req-a24dd767-6137-48be-94c8-5b0816d6e78a service nova] Creating event network-changed:494c355d-680f-4936-8635-5fcc0bf643f6 for instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 on n-h2-844626-8 Aug 09 16:02:22.517108 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [req-bd6a15ba-7f61-4e80-81b1-3a9aec6b9ccb req-a24dd767-6137-48be-94c8-5b0816d6e78a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168059 Aug 09 16:02:22.518131 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3768/7524] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 16:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:02:22.531941 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-c21e025c-132e-4a36-b20e-710a2d73ed80 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "DELETE /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 204 len: 0 microversion: 2.1 time: 0.188761 Aug 09 16:02:22.533630 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3757/7525] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 16:02:22 2022] DELETE /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:02:22.545684 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2704da7-5813-406a-9dbe-e11d5bf4ff08 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:02:22.546438 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b2704da7-5813-406a-9dbe-e11d5bf4ff08 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:02:22.556683 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2704da7-5813-406a-9dbe-e11d5bf4ff08 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:22.557481 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2704da7-5813-406a-9dbe-e11d5bf4ff08 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:22.558177 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2704da7-5813-406a-9dbe-e11d5bf4ff08 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:22.559342 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2704da7-5813-406a-9dbe-e11d5bf4ff08 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:22.560083 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2704da7-5813-406a-9dbe-e11d5bf4ff08 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:22.560764 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2704da7-5813-406a-9dbe-e11d5bf4ff08 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:22.791865 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2704da7-5813-406a-9dbe-e11d5bf4ff08 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:02:22.804961 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2704da7-5813-406a-9dbe-e11d5bf4ff08 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1685 microversion: 2.1 time: 0.264220 Aug 09 16:02:22.805742 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3769/7526] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:02:22 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1685 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:02:23.237549 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-e96ea90e-fe34-42f6-b1cf-b4bf74422b0e req-809a0ae3-b114-428a-a317-b6a157973d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4f18ab-247d-424b-8c4a-3b81a4acace8", "name": "network-vif-unplugged", "status": "completed", "tag": "494c355d-680f-4936-8635-5fcc0bf643f6"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:02:23.256017 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e96ea90e-fe34-42f6-b1cf-b4bf74422b0e req-809a0ae3-b114-428a-a317-b6a157973d56 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:23.257029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e96ea90e-fe34-42f6-b1cf-b4bf74422b0e req-809a0ae3-b114-428a-a317-b6a157973d56 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:23.258029 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-e96ea90e-fe34-42f6-b1cf-b4bf74422b0e req-809a0ae3-b114-428a-a317-b6a157973d56 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:23.286360 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-e96ea90e-fe34-42f6-b1cf-b4bf74422b0e req-809a0ae3-b114-428a-a317-b6a157973d56 service nova] Creating event network-vif-unplugged:494c355d-680f-4936-8635-5fcc0bf643f6 for instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 on n-h2-844626-8 Aug 09 16:02:23.296350 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-e96ea90e-fe34-42f6-b1cf-b4bf74422b0e req-809a0ae3-b114-428a-a317-b6a157973d56 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066371 Aug 09 16:02:23.297631 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3758/7527] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 16:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:02:23.832920 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-eb6d71b6-76f5-4c4e-8062-6d1dfc9a4463 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:02:23.833823 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-eb6d71b6-76f5-4c4e-8062-6d1dfc9a4463 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:02:23.845701 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb6d71b6-76f5-4c4e-8062-6d1dfc9a4463 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:23.846860 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb6d71b6-76f5-4c4e-8062-6d1dfc9a4463 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:23.847594 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb6d71b6-76f5-4c4e-8062-6d1dfc9a4463 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:23.849007 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb6d71b6-76f5-4c4e-8062-6d1dfc9a4463 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:23.849743 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb6d71b6-76f5-4c4e-8062-6d1dfc9a4463 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:23.850383 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-eb6d71b6-76f5-4c4e-8062-6d1dfc9a4463 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:24.177306 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-eb6d71b6-76f5-4c4e-8062-6d1dfc9a4463 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:02:24.200571 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-eb6d71b6-76f5-4c4e-8062-6d1dfc9a4463 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1685 microversion: 2.1 time: 0.373960 Aug 09 16:02:24.201770 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3770/7528] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:02:23 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1685 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:02:25.185595 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-5d2b9efd-c154-4a67-9175-d7c11679f3d0 req-c56dfdb8-3de1-4ca2-a6f5-257c8c623c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4f18ab-247d-424b-8c4a-3b81a4acace8", "name": "network-vif-deleted", "tag": "494c355d-680f-4936-8635-5fcc0bf643f6"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:02:25.198383 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5d2b9efd-c154-4a67-9175-d7c11679f3d0 req-c56dfdb8-3de1-4ca2-a6f5-257c8c623c84 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:25.198957 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5d2b9efd-c154-4a67-9175-d7c11679f3d0 req-c56dfdb8-3de1-4ca2-a6f5-257c8c623c84 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:25.199536 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-5d2b9efd-c154-4a67-9175-d7c11679f3d0 req-c56dfdb8-3de1-4ca2-a6f5-257c8c623c84 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:25.215390 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-5d2b9efd-c154-4a67-9175-d7c11679f3d0 req-c56dfdb8-3de1-4ca2-a6f5-257c8c623c84 service nova] Creating event network-vif-deleted:494c355d-680f-4936-8635-5fcc0bf643f6 for instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 on n-h2-844626-8 Aug 09 16:02:25.222787 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-5d2b9efd-c154-4a67-9175-d7c11679f3d0 req-c56dfdb8-3de1-4ca2-a6f5-257c8c623c84 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136481 Aug 09 16:02:25.224051 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3759/7529] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 16:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:02:25.237521 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:02:25.238615 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:02:25.246871 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:25.247448 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:25.248049 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:25.248794 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:25.249246 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:25.249722 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:25.299867 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:25.301021 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:25.301851 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:25.302653 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lazy-loading 'fault' on Instance uuid 9e4f18ab-247d-424b-8c4a-3b81a4acace8 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:02:25.362472 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:02:25.372054 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-1b1a7849-ce56-4b68-8bbb-861c43784301 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 200 len: 1339 microversion: 2.1 time: 0.141312 Aug 09 16:02:25.373134 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3771/7530] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:02:25 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 1339 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:02:26.404695 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9741aa78-7651-4615-8a2f-4a9a0afa9d30 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:02:26.405710 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-9741aa78-7651-4615-8a2f-4a9a0afa9d30 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 9e4f18ab-247d-424b-8c4a-3b81a4acace8] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:02:26.416295 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9741aa78-7651-4615-8a2f-4a9a0afa9d30 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:26.417060 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9741aa78-7651-4615-8a2f-4a9a0afa9d30 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:26.417767 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9741aa78-7651-4615-8a2f-4a9a0afa9d30 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:26.418959 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9741aa78-7651-4615-8a2f-4a9a0afa9d30 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:26.419799 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9741aa78-7651-4615-8a2f-4a9a0afa9d30 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:26.420469 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-9741aa78-7651-4615-8a2f-4a9a0afa9d30 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:26.446932 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-9741aa78-7651-4615-8a2f-4a9a0afa9d30 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] HTTP exception thrown: Instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 could not be found. Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9741aa78-7651-4615-8a2f-4a9a0afa9d30 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Request method failure captured: Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 HTTP/1.1 Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8oPmLTz7TuHcSELdyJ9tioKxmKDx1MBm_4AwjUCZhQqpjd4pZoYvQa1eoEuxsUNGiw_gT8vP24e9swktD7aUBa1yfJKU0v4UA1Y8MVY_36zOSGV4p_4dDxuDVH3ZWChx_NuBHmM8PGRj8z6azVk3hBU_wAqz4klH7cqk0xo_NA-m9RM Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 80810c2561ac45f5910b9bcc0ca45721 Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestSnapshotPattern-400729185 Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_80810c2561ac45f5910b9bcc0ca45721", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/80810c2561ac45f5910b9bcc0ca45721"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/80810c2561ac45f5910b9bcc0ca45721"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/80810c2561ac45f5910b9bcc0ca45721"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestSnapshotPattern-400729185 Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 80810c2561ac45f5910b9bcc0ca45721 Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestSnapshotPattern-400729185 Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestSnapshotPattern-400729185-project Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e47b0fca9c1e4cacac9d291a3e3858b5 Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestSnapshotPattern-400729185-project Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 could not be found. Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '9e4f18ab-247d-424b-8c4a-3b81a4acace8'} Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 could not be found. Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 could not be found. Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:02:26.450497 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 16:02:26.459882 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:02:26.459882 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:02:26.459882 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:02:26.459882 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:02:26.459882 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:02:26.459882 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 could not be found. Aug 09 16:02:26.459882 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 16:02:26.459882 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-9741aa78-7651-4615-8a2f-4a9a0afa9d30 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Returning 404 to user: Instance 9e4f18ab-247d-424b-8c4a-3b81a4acace8 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:02:26.459882 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-9741aa78-7651-4615-8a2f-4a9a0afa9d30 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8" status: 404 len: 111 microversion: 2.1 time: 0.058024 Aug 09 16:02:26.459882 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3760/7531] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:02:26 2022] GET /compute/v2.1/servers/9e4f18ab-247d-424b-8c4a-3b81a4acace8 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 16:02:28.473185 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-48f87f5b-ca52-4596-b82b-0d3641b0ec8d tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:02:28.474331 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48f87f5b-ca52-4596-b82b-0d3641b0ec8d tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:02:28.477271 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-02a41682-38a4-4f10-ad46-8ef4f4bd41e0 req-03e1e5da-4e42-4200-9927-8a55b5b057fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889666b9-5a35-462b-9a1c-cfe25e7d2f98", "tag": "be81af4f-d8df-499c-95ea-b7805ccb0cd8"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:02:28.487789 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48f87f5b-ca52-4596-b82b-0d3641b0ec8d tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:28.488718 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48f87f5b-ca52-4596-b82b-0d3641b0ec8d tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:28.489462 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48f87f5b-ca52-4596-b82b-0d3641b0ec8d tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:28.490745 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48f87f5b-ca52-4596-b82b-0d3641b0ec8d tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:28.491916 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48f87f5b-ca52-4596-b82b-0d3641b0ec8d tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:28.492994 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-48f87f5b-ca52-4596-b82b-0d3641b0ec8d tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:28.498124 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-02a41682-38a4-4f10-ad46-8ef4f4bd41e0 req-03e1e5da-4e42-4200-9927-8a55b5b057fb service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:28.499018 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-02a41682-38a4-4f10-ad46-8ef4f4bd41e0 req-03e1e5da-4e42-4200-9927-8a55b5b057fb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:28.499928 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-02a41682-38a4-4f10-ad46-8ef4f4bd41e0 req-03e1e5da-4e42-4200-9927-8a55b5b057fb service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:28.522346 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-02a41682-38a4-4f10-ad46-8ef4f4bd41e0 req-03e1e5da-4e42-4200-9927-8a55b5b057fb service nova] Creating event network-changed:be81af4f-d8df-499c-95ea-b7805ccb0cd8 for instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 on n-h1-844626-8 Aug 09 16:02:28.530296 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-02a41682-38a4-4f10-ad46-8ef4f4bd41e0 req-03e1e5da-4e42-4200-9927-8a55b5b057fb service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060737 Aug 09 16:02:28.531494 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3761/7532] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 16:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 16:02:28.549143 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-48f87f5b-ca52-4596-b82b-0d3641b0ec8d tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Going to try to terminate instance {{(pid=119407) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 16:02:28.675006 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-48f87f5b-ca52-4596-b82b-0d3641b0ec8d tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "DELETE /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 204 len: 0 microversion: 2.1 time: 0.211421 Aug 09 16:02:28.676256 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3772/7533] 10.222.0.50 () {58 vars in 1239 bytes} [Tue Aug 9 16:02:28 2022] DELETE /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 16:02:28.708926 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-ce8cd728-c41a-44d2-b1ca-5708af0ac962 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:02:28.710303 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-ce8cd728-c41a-44d2-b1ca-5708af0ac962 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:02:28.724401 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce8cd728-c41a-44d2-b1ca-5708af0ac962 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:28.726354 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce8cd728-c41a-44d2-b1ca-5708af0ac962 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:28.727248 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce8cd728-c41a-44d2-b1ca-5708af0ac962 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:28.728587 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce8cd728-c41a-44d2-b1ca-5708af0ac962 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:28.729461 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce8cd728-c41a-44d2-b1ca-5708af0ac962 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:28.730278 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-ce8cd728-c41a-44d2-b1ca-5708af0ac962 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:28.955276 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.policy [None req-ce8cd728-c41a-44d2-b1ca-5708af0ac962 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119406) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:02:28.965379 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-ce8cd728-c41a-44d2-b1ca-5708af0ac962 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1685 microversion: 2.1 time: 0.278768 Aug 09 16:02:28.966092 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3762/7534] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:02:28 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1685 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:02:30.005754 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-988cb486-2416-4987-9ef2-241d931015a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:02:30.006813 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-988cb486-2416-4987-9ef2-241d931015a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:02:30.014389 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988cb486-2416-4987-9ef2-241d931015a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:30.014885 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988cb486-2416-4987-9ef2-241d931015a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:30.015351 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988cb486-2416-4987-9ef2-241d931015a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:30.016090 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988cb486-2416-4987-9ef2-241d931015a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:30.016541 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988cb486-2416-4987-9ef2-241d931015a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:30.016961 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-988cb486-2416-4987-9ef2-241d931015a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:30.274886 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-988cb486-2416-4987-9ef2-241d931015a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:02:30.289983 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-988cb486-2416-4987-9ef2-241d931015a3 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1685 microversion: 2.1 time: 0.290405 Aug 09 16:02:30.291562 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3773/7535] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:02:29 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1685 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 16:02:30.921244 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [req-b9245422-e23b-4740-a807-c922b8dae643 req-37735d9f-0483-4640-b9d3-7682d3551438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889666b9-5a35-462b-9a1c-cfe25e7d2f98", "name": "network-vif-deleted", "tag": "be81af4f-d8df-499c-95ea-b7805ccb0cd8"}]} {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 16:02:30.942913 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b9245422-e23b-4740-a807-c922b8dae643 req-37735d9f-0483-4640-b9d3-7682d3551438 service nova] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:30.943558 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b9245422-e23b-4740-a807-c922b8dae643 req-37735d9f-0483-4640-b9d3-7682d3551438 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:30.944247 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [req-b9245422-e23b-4740-a807-c922b8dae643 req-37735d9f-0483-4640-b9d3-7682d3551438 service nova] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:30.961332 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.compute.server_external_events [req-b9245422-e23b-4740-a807-c922b8dae643 req-37735d9f-0483-4640-b9d3-7682d3551438 service nova] Creating event network-vif-deleted:be81af4f-d8df-499c-95ea-b7805ccb0cd8 for instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 on n-h1-844626-8 Aug 09 16:02:30.967612 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [req-b9245422-e23b-4740-a807-c922b8dae643 req-37735d9f-0483-4640-b9d3-7682d3551438 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054133 Aug 09 16:02:30.968538 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3763/7536] 10.222.0.50 () {64 vars in 1317 bytes} [Tue Aug 9 16:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 16:02:31.332271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:02:31.333220 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.compute.api [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119407) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:02:31.344863 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:31.345639 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:31.346271 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:31.347450 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:31.348283 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:31.349024 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:31.400746 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:31.401579 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:31.402424 n-d-844626-8 devstack@n-api.service[119407]: DEBUG oslo_concurrency.lockutils [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119407) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:31.403133 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.objects.instance [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lazy-loading 'fault' on Instance uuid 889666b9-5a35-462b-9a1c-cfe25e7d2f98 {{(pid=119407) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 16:02:31.491415 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.policy [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47b0fca9c1e4cacac9d291a3e3858b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80810c2561ac45f5910b9bcc0ca45721', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=119407) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 16:02:31.503236 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b2db5f66-ebd5-4cb2-91b9-42efb3dde01c tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 200 len: 1339 microversion: 2.1 time: 0.177799 Aug 09 16:02:31.504242 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3774/7537] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:02:31 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 1339 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 16:02:32.537297 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-952e8775-83e9-42cc-887a-3f83943d5fd6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '>' {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:02:32.538721 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.compute.api [None req-952e8775-83e9-42cc-887a-3f83943d5fd6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] [instance: 889666b9-5a35-462b-9a1c-cfe25e7d2f98] Fetching instance by UUID {{(pid=119406) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 16:02:32.552987 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-952e8775-83e9-42cc-887a-3f83943d5fd6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:32.553918 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-952e8775-83e9-42cc-887a-3f83943d5fd6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:32.554825 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-952e8775-83e9-42cc-887a-3f83943d5fd6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:32.556266 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-952e8775-83e9-42cc-887a-3f83943d5fd6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Acquiring lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 16:02:32.557139 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-952e8775-83e9-42cc-887a-3f83943d5fd6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 16:02:32.557927 n-d-844626-8 devstack@n-api.service[119406]: DEBUG oslo_concurrency.lockutils [None req-952e8775-83e9-42cc-887a-3f83943d5fd6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Lock "ddbfddb0-c2c9-4ef5-89a4-ddda97ad2fa0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=119406) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 16:02:32.587583 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.wsgi [None req-952e8775-83e9-42cc-887a-3f83943d5fd6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] HTTP exception thrown: Instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 could not be found. Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-952e8775-83e9-42cc-887a-3f83943d5fd6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Request method failure captured: Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: request: GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 HTTP/1.1 Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: Accept: application/json Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: Accept-Encoding: identity Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: Connection: close Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: Content-Length: 0 Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: Content-Type: application/json Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: Host: 10.222.0.50 Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: Openstack-System-Scope: None Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: User-Agent: python-urllib3/1.26.11 Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Auth-Token: gAAAAABi8oPmLTz7TuHcSELdyJ9tioKxmKDx1MBm_4AwjUCZhQqpjd4pZoYvQa1eoEuxsUNGiw_gT8vP24e9swktD7aUBa1yfJKU0v4UA1Y8MVY_36zOSGV4p_4dDxuDVH3ZWChx_NuBHmM8PGRj8z6azVk3hBU_wAqz4klH7cqk0xo_NA-m9RM Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Id: None Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Domain-Name: None Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Identity-Status: Confirmed Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Is-Admin-Project: True Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Id: default Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Domain-Name: Default Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Id: 80810c2561ac45f5910b9bcc0ca45721 Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Project-Name: tempest-TestSnapshotPattern-400729185 Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Role: reader,member Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Roles: reader,member Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:8080/v1/AUTH_80810c2561ac45f5910b9bcc0ca45721", "adminURL": "http://10.222.0.50:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/80810c2561ac45f5910b9bcc0ca45721"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/80810c2561ac45f5910b9bcc0ca45721"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/80810c2561ac45f5910b9bcc0ca45721"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}] Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant: tempest-TestSnapshotPattern-400729185 Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Id: 80810c2561ac45f5910b9bcc0ca45721 Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-Tenant-Name: tempest-TestSnapshotPattern-400729185 Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-User: tempest-TestSnapshotPattern-400729185-project Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Id: default Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-User-Domain-Name: Default Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-User-Id: e47b0fca9c1e4cacac9d291a3e3858b5 Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: X-User-Name: tempest-TestSnapshotPattern-400729185-project Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: method: > Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: exception: Instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 could not be found. Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: action_args: {'id': '889666b9-5a35-462b-9a1c-cfe25e7d2f98'} Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: {{(pid=119406) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 could not be found. Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 could not be found. Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 16:02:32.591067 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 16:02:32.596690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 16:02:32.596690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 16:02:32.596690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 16:02:32.596690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 16:02:32.596690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 16:02:32.596690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 could not be found. Aug 09 16:02:32.596690 n-d-844626-8 devstack@n-api.service[119406]: ERROR nova.api.openstack.wsgi Aug 09 16:02:32.596690 n-d-844626-8 devstack@n-api.service[119406]: DEBUG nova.api.openstack.wsgi [None req-952e8775-83e9-42cc-887a-3f83943d5fd6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Returning 404 to user: Instance 889666b9-5a35-462b-9a1c-cfe25e7d2f98 could not be found. {{(pid=119406) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 16:02:32.596690 n-d-844626-8 devstack@n-api.service[119406]: INFO nova.api.openstack.requestlog [None req-952e8775-83e9-42cc-887a-3f83943d5fd6 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98" status: 404 len: 111 microversion: 2.1 time: 0.066832 Aug 09 16:02:32.596690 n-d-844626-8 devstack@n-api.service[119406]: [pid: 119406|app: 0|req: 3764/7538] 10.222.0.50 () {58 vars in 1236 bytes} [Tue Aug 9 16:02:32 2022] GET /compute/v2.1/servers/889666b9-5a35-462b-9a1c-cfe25e7d2f98 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 16:02:32.925319 n-d-844626-8 devstack@n-api.service[119407]: DEBUG nova.api.openstack.wsgi [None req-b69c84f0-f2e9-4eeb-8832-7f8ba38245d0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] Calling method '.version_select at 0x7f41dcb39e50>' {{(pid=119407) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 16:02:32.972237 n-d-844626-8 devstack@n-api.service[119407]: INFO nova.api.openstack.requestlog [None req-b69c84f0-f2e9-4eeb-8832-7f8ba38245d0 tempest-TestSnapshotPattern-400729185 tempest-TestSnapshotPattern-400729185-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1518644830" status: 202 len: 0 microversion: 2.1 time: 0.056217 Aug 09 16:02:32.973369 n-d-844626-8 devstack@n-api.service[119407]: [pid: 119407|app: 0|req: 3775/7539] 10.222.0.50 () {58 vars in 1257 bytes} [Tue Aug 9 16:02:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1518644830 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 16:03:51.400132 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:03:51.401189 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 16:03:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:05:27.748607 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:05:27.749414 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 16:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:05:27.835947 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:05:27.836277 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 16:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:05:32.427149 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:05:32.427149 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 16:05:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:05:35.898177 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:05:35.899158 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 16:05:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:05:42.366955 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:05:42.367686 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 16:05:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:07:11.412287 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:07:11.412287 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 16:07:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:08:47.762637 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:08:47.763616 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 16:08:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:08:47.848221 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:08:47.848470 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 16:08:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:08:52.434364 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:08:52.435176 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 16:08:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:08:55.909705 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:08:55.910552 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 16:08:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:09:02.378171 n-d-844626-8 devstack@n-api.service[119406]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:09:02.379026 n-d-844626-8 devstack@n-api.service[119406]: Tue Aug 9 16:09:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 16:10:31.424846 n-d-844626-8 devstack@n-api.service[119407]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 16:10:31.425849 n-d-844626-8 devstack@n-api.service[119407]: Tue Aug 9 16:10:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!